-- Logs begin at Wed 2022-10-12 21:19:57 UTC, end at Wed 2022-10-12 23:47:46 UTC. -- Oct 12 21:48:45.605421 n-d-861111-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 12 21:48:45.614079 n-d-861111-1 devstack@n-api.service[104441]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 12 21:48:45.616084 n-d-861111-1 devstack@n-api.service[104441]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 12 21:48:45 2022] *** Oct 12 21:48:45.616084 n-d-861111-1 devstack@n-api.service[104441]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 21:48:45.616084 n-d-861111-1 devstack@n-api.service[104441]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 21:48:45.616084 n-d-861111-1 devstack@n-api.service[104441]: nodename: n-d-861111-1 Oct 12 21:48:45.616084 n-d-861111-1 devstack@n-api.service[104441]: machine: x86_64 Oct 12 21:48:45.616084 n-d-861111-1 devstack@n-api.service[104441]: clock source: unix Oct 12 21:48:45.616084 n-d-861111-1 devstack@n-api.service[104441]: pcre jit disabled Oct 12 21:48:45.616084 n-d-861111-1 devstack@n-api.service[104441]: detected number of CPU cores: 4 Oct 12 21:48:45.616084 n-d-861111-1 devstack@n-api.service[104441]: current working directory: / Oct 12 21:48:45.616084 n-d-861111-1 devstack@n-api.service[104441]: detected binary path: /usr/bin/uwsgi-core Oct 12 21:48:45.616750 n-d-861111-1 devstack@n-api.service[104441]: your processes number limit is 47680 Oct 12 21:48:45.616750 n-d-861111-1 devstack@n-api.service[104441]: your memory page size is 4096 bytes Oct 12 21:48:45.616750 n-d-861111-1 devstack@n-api.service[104441]: detected max file descriptor number: 2048 Oct 12 21:48:45.616750 n-d-861111-1 devstack@n-api.service[104441]: lock engine: pthread robust mutexes Oct 12 21:48:45.616750 n-d-861111-1 devstack@n-api.service[104441]: thunder lock: enabled Oct 12 21:48:45.616750 n-d-861111-1 devstack@n-api.service[104441]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 12 21:48:45.616750 n-d-861111-1 devstack@n-api.service[104441]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 12 21:48:45.656142 n-d-861111-1 devstack@n-api.service[104441]: Python main interpreter initialized at 0x557487a709c0 Oct 12 21:48:45.656142 n-d-861111-1 devstack@n-api.service[104441]: python threads support enabled Oct 12 21:48:45.656142 n-d-861111-1 devstack@n-api.service[104441]: your server socket listen backlog is limited to 100 connections Oct 12 21:48:45.656142 n-d-861111-1 devstack@n-api.service[104441]: your mercy for graceful operations on workers is 90 seconds Oct 12 21:48:45.656497 n-d-861111-1 devstack@n-api.service[104441]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 21:48:45.656579 n-d-861111-1 devstack@n-api.service[104441]: *** Operational MODE: preforking *** Oct 12 21:48:45.656804 n-d-861111-1 devstack@n-api.service[104441]: *** uWSGI is running in multiple interpreter mode *** Oct 12 21:48:45.656804 n-d-861111-1 devstack@n-api.service[104441]: spawned uWSGI master process (pid: 104441) Oct 12 21:48:45.656983 n-d-861111-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 12 21:48:45.657508 n-d-861111-1 devstack@n-api.service[104441]: spawned uWSGI worker 1 (pid: 104442, cores: 1) Oct 12 21:48:45.657843 n-d-861111-1 devstack@n-api.service[104441]: spawned uWSGI worker 2 (pid: 104443, cores: 1) Oct 12 21:48:45.658011 n-d-861111-1 devstack@n-api.service[104441]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 21:48:46.320597 n-d-861111-1 devstack@n-api.service[104442]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 21:48:46.325217 n-d-861111-1 devstack@n-api.service[104443]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 21:48:47.397263 n-d-861111-1 devstack@n-api.service[104442]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 21:48:47.397263 n-d-861111-1 devstack@n-api.service[104442]: from cryptography.utils import int_from_bytes Oct 12 21:48:47.397877 n-d-861111-1 devstack@n-api.service[104443]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 21:48:47.397877 n-d-861111-1 devstack@n-api.service[104443]: from cryptography.utils import int_from_bytes Oct 12 21:48:47.398264 n-d-861111-1 devstack@n-api.service[104442]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 21:48:47.398264 n-d-861111-1 devstack@n-api.service[104442]: from cryptography.utils import int_from_bytes Oct 12 21:48:47.398376 n-d-861111-1 devstack@n-api.service[104443]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 21:48:47.398376 n-d-861111-1 devstack@n-api.service[104443]: from cryptography.utils import int_from_bytes Oct 12 21:48:49.887916 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 21:48:49.888459 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 21:48:49.888679 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 21:48:49.889037 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 21:48:49.889290 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 21:48:49.889675 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.890000 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.890317 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.890412 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 21:48:49.890759 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.890841 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 21:48:49.891025 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.891181 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 21:48:49.891300 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.891571 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.891657 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 21:48:49.891830 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 21:48:49.891924 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.892197 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.892282 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.892454 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.892538 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.892766 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.892859 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.893088 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-861111-1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.893179 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.893408 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.893500 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.893718 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.893823 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.894017 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.894107 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.894330 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.894424 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.894636 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.894736 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.894906 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.895002 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.895218 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.895336 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.895564 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-861111-1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.895747 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.895887 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.896195 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.896333 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.896495 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.896603 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.896801 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.896899 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.897102 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.897220 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.897421 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.897534 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.897724 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.897820 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.898037 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.898222 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.898342 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.898529 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.898648 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.898831 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.898951 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.899139 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.899375 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-861111-1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.899522 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.899691 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.899779 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.899999 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.900095 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.900305 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.900393 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.900681 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.900766 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.901001 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.901139 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.901303 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.901407 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.901620 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.902284 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-861111-1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.902485 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.902583 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.902790 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.902885 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.903113 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.903208 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.903457 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.903559 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.903772 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.903870 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.904092 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.904202 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.904388 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.904480 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.904699 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.904783 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.905005 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.905115 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.905322 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.905412 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.905622 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.905707 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.905923 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.906017 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.906170 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.906277 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.906474 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.906580 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.906795 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.906909 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.907110 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.907215 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.907450 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.907542 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.907698 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.907815 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.907944 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.908119 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.908245 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.908369 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.908563 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.908657 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.908868 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.908980 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.909172 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.909296 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.909474 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.909615 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.909779 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.909870 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.910081 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.910174 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.910382 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.910474 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.910691 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.910787 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.910989 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.911075 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.911322 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.911414 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.911633 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.911729 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.911951 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.912037 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.912255 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.912340 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.912560 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.912644 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.912866 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.912952 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.913170 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.913254 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.913475 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.913567 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.913785 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.913880 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.914103 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.914188 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.914406 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.914498 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.914721 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.914811 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.915056 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.915198 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.915363 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.915461 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.915667 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.915753 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.915969 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.916053 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.916286 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.916383 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.916597 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.916680 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.916902 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.916987 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.917149 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.917231 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.917456 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.917542 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.917757 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.917843 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.918070 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.918162 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.918372 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.918456 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.918673 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.918833 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.918974 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.919061 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.919277 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.919389 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.919582 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.919697 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.919883 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.919978 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.920186 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.920287 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.920487 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.920587 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.920785 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.920878 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.921088 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.921186 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.921386 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.921491 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.921690 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.921781 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.921987 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.922073 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.922287 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.922384 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.922591 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.922684 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.922894 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.922979 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.923193 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.923315 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.923518 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.923617 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.923820 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.923912 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.924122 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.924216 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.924422 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.924509 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.924733 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.924825 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.925034 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.925127 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.925340 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.925426 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.925639 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.925723 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.925937 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.926031 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.926238 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.926322 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.926539 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.926631 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.926841 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.926934 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.927142 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.927231 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.927461 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.927591 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.927763 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.927850 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.928067 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.928150 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.928367 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.928450 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.928667 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.928760 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.928964 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.929050 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.929262 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.929347 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.929559 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.929645 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.929856 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.929941 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.930153 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.930249 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.930449 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.930535 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.930742 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.930826 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.931039 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.931129 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.931363 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.931455 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.931666 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.931756 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.931966 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.932063 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.932262 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.932346 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.932563 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.932653 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.932861 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.932954 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.933196 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.933289 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.933515 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.933602 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.933822 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.933917 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.934126 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.934211 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.934427 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.934518 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.934743 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:48:49.934830 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.935067 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.935150 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.935397 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.935486 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.935722 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.935815 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.936027 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.936112 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.936331 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.936415 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.936640 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.936779 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.936952 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.937053 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.937266 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.937359 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.937580 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.937667 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.937890 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.937985 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.938193 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.938375 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.938501 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.938588 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.938805 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.938915 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.939117 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.939200 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.939458 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.939547 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.939771 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.939855 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.940079 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.940172 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.940390 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.940477 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.940707 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.940799 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.941016 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.941192 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.941332 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.941417 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.941647 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.941737 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.941953 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.942047 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.942258 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.942343 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.942561 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.942646 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.942900 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.942996 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.943211 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.943313 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.943544 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.943639 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.943859 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.943945 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.944165 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.944247 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.944474 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.944579 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.944781 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.944869 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.945084 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.945169 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.945393 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.945478 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.945701 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.945788 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.946005 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.946091 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.946319 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.946402 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.946640 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.946772 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.946937 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.947023 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.947303 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.947404 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.947574 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.947659 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.947887 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.947990 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.948195 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.948304 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.949012 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.949109 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.949333 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.949429 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.949635 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.949742 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.949937 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.950031 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.950238 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.950332 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.950541 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.950644 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.950841 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.950934 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.951151 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.951259 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.951495 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.951601 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.951798 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.951883 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.952100 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.952184 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.952411 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.952504 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.952713 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.952797 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.953014 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.953105 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.953317 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.953402 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.953617 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.953701 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.953926 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.954010 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.954234 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.954320 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.954588 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.954687 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.954840 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.954931 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.955148 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.955273 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.955536 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.955642 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.955775 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.955872 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.956075 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.956159 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.956379 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.956469 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.956681 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.956795 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.956986 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.957082 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.957305 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.957392 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.957592 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.957685 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.957895 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.957978 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.958205 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.958291 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.958509 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.958602 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.958813 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.958903 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.959119 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.959202 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.959454 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.959542 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.959767 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.959853 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.960075 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.960159 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.960657 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.960750 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.960972 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.961055 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.961270 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.961353 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.961575 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.961660 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.961874 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.961970 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.962173 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.962265 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.962470 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.962555 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.962772 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.962856 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.963071 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.963164 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.963392 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.963479 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.963692 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.963776 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.963992 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.964089 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.964862 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.965021 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.965162 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.965299 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.965443 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.965597 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.965730 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.965822 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.966036 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.966124 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.966336 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.966430 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.966639 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.966731 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.966942 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.967027 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.967286 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.967420 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.967599 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.967684 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.967901 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.967986 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.968204 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.968292 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.968504 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.968589 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.968843 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.968928 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.969148 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.969235 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.969455 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.969539 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.969764 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.969848 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.970074 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.970161 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.970390 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.970482 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.970698 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.970796 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.971010 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.971095 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.971341 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.971429 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.971654 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.971756 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.971961 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.972046 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.972276 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.972366 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.972577 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.972678 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.972888 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.972973 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.973204 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.973287 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.973515 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.973608 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.973836 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.973920 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.974143 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.974234 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.974453 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.974545 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.974753 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.974838 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.975062 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.975145 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.975392 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.975484 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.975702 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.975834 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.976011 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.976096 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.976327 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.976413 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.976636 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.976721 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.976948 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.977038 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.977253 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.977339 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.977561 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.977659 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.977866 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.977950 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.978175 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.978296 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.978472 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.978557 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.978781 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.978874 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.979097 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.979181 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.979429 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.979517 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.979736 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.979834 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.980073 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.980157 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.980391 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.980479 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.980695 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.980788 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.980999 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.981083 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.981307 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.981391 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.981610 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.981704 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.981911 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.981995 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.982219 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.982303 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.982530 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.982616 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.982838 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.982923 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.983144 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.983269 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.983470 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.983558 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.983773 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.983857 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.984074 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.984168 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.984377 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.984462 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.984678 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.984762 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.984982 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.985067 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.985292 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.985388 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.985596 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.985681 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.985909 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.985994 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.986218 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.986315 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.986518 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.986602 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.986819 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.986918 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.987128 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.987212 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.987453 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.987583 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.987755 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.987855 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.988058 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.988152 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.988360 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.988445 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.988676 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.988769 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.988979 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.989071 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.989282 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.989366 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.989594 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.989687 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.989895 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.989978 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.990199 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.990284 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.990503 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.990589 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.990807 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.990891 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.991112 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.991204 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.991454 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.991541 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.991762 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.991859 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.992068 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.992152 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.992376 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.992473 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.992684 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.992768 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.992991 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.993075 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.993298 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.993384 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.993615 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.993698 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.993919 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.994012 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.994224 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.994309 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.994529 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.994620 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.994831 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.994928 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.995140 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.995309 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.995498 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.995583 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.995821 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.996060 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.996156 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.996391 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.996489 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.996702 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.996789 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.997013 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.997106 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.997326 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.997410 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.997644 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.997771 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.997971 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.998205 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.998294 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.998539 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.998638 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.998852 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.998945 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.999168 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.999297 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.999497 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.999590 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.999800 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:49.999894 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.000108 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.000201 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.000412 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.000517 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.000715 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.000801 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.001020 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.001105 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.001326 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.001411 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.001628 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.001720 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.001933 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.002019 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.002236 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.002321 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.002539 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.002621 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.002843 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.002934 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.003142 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.003254 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.003475 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.003561 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.003786 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.003881 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.004086 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.004180 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.004390 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.004483 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.004689 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.004773 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.004991 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.005076 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.005296 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.005454 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.005594 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.005726 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.005898 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.006041 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.006219 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.006364 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.006526 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.006661 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.006828 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.006959 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.007131 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.007314 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.007460 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.007584 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.007778 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.007871 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.008081 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.008168 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.008384 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.008469 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.008684 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.008779 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.008991 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.009079 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.009295 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.009382 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.009595 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.009680 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.009902 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.009989 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.010210 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.010303 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.010517 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.010601 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.010820 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.010907 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.011647 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.011752 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.011956 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.012049 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.012256 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.012340 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.012567 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.012650 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.012873 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.012965 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.013177 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.013271 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.013479 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.013563 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.013780 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.013871 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.014084 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.014168 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.014385 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.014477 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.014688 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.014781 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.014990 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.015075 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.015315 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.015442 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.015621 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.015716 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.015923 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.016007 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.016223 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.016307 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.016524 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.016609 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.016827 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.016913 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.017127 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.017210 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.017443 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.017530 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.017812 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.017910 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.018049 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.018134 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.018349 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.018443 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.018651 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.018736 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.018953 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.019056 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.019267 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.019367 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.019579 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.019678 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.019890 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.020047 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.020195 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.020280 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.020493 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.020579 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.020796 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.020889 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.021092 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.021176 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.021392 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.021482 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.021690 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.021787 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.021993 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.022078 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.022293 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.022385 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.022594 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.022688 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.022893 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.022979 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.023193 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.023298 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.023516 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.023605 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.023817 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.023901 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.024122 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.024208 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.024423 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.024516 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.024724 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.024809 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.025020 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.025104 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.025320 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.025405 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.025621 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.025723 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.025943 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.026037 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.026253 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.026338 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.026576 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.027222 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.027446 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.027550 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.027750 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.027837 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.028059 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.028144 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.028371 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.028465 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.028675 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.028761 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.028988 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.029083 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.029297 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.029392 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.029607 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.029693 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.029909 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.030003 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.030210 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.030297 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.030519 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.030604 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.030823 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.030908 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.031131 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.031217 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.031472 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.031561 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.031783 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.031869 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.032087 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.032176 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.032388 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.032475 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.032691 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.032782 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.032999 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.033086 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.033304 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.033389 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.033609 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.033694 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.033914 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.034001 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.034221 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.034306 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.034522 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.034615 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.034829 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.034915 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.035135 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.035221 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.035465 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.035564 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.035774 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.035867 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.036077 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.036162 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.036380 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.036473 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.036682 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.036767 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.036989 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.037073 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.037296 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.037391 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.037599 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.037685 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.037901 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.037982 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.038199 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.038285 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.038502 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.038587 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.038801 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.038975 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.039122 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.039208 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.039454 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.039550 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.039758 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.039845 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.040064 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.040151 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.040366 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.040451 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.040675 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.040769 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.040978 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.041125 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.041309 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.041393 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.041611 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.041705 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.041995 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.042079 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.042323 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.042418 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.042634 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.042728 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.042940 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.043025 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.043278 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.043369 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.043565 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.043664 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.043874 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.043958 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.044193 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.044278 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.044494 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.044588 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.044794 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.044879 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.045095 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.045181 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.045413 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.045500 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.045721 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.045815 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.046040 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.046125 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.046366 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.046488 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.046669 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.046755 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.046973 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.047057 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.047295 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.047459 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.047620 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.047769 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.047927 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.048077 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.048248 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.048398 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.048662 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.048748 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.048970 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.049177 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.049283 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.049371 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.049614 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.049701 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.049920 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.050007 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.050241 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.050339 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.050560 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.050646 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.050868 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.050961 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.051178 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.051321 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.051502 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.051596 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.051812 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.051904 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.052122 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.052221 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.052431 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.052516 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.052752 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.052838 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.053062 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.053156 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.053374 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.053460 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.053675 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.053760 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.053998 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.054086 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.054320 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.054405 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.054635 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.054728 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.054951 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.055037 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.055272 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.055385 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.055581 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.055709 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.055886 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.056025 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.056206 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.056348 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.056515 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.056664 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.056824 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.056967 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.057131 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.057271 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.057436 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.057580 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.057738 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.058404 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.058553 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.058704 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.058876 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.059028 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.059179 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.059358 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.059523 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.059669 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.059834 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.059997 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.060153 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.060272 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.060470 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.060575 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.060806 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.060944 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.061080 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.061222 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.061383 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.061520 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.061684 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.061820 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.061983 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.062109 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.062286 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.062378 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.062623 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.062721 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.062924 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.063010 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.063257 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.063358 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.063584 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.063680 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.063897 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.063981 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.064201 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.064298 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.064503 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.064591 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.064836 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.064920 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.065139 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.065237 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.065451 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.065537 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.065766 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.065851 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.066091 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.066194 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.066393 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.066480 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.066695 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.066794 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.066997 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.067092 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.067324 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.067415 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.067628 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.067714 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.067928 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.068017 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.068230 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.068316 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.068535 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.068683 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.068825 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.068961 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.069120 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.069217 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.069425 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.069556 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.069727 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.069869 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.070015 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.070145 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.070317 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.070453 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.070620 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.070762 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.070938 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.071067 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.071203 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.071489 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.071618 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.071751 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.071883 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.072028 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.072162 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.072305 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.072438 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.072570 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.072760 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.072902 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.073076 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.073220 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.073389 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.073561 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.074285 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.074418 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.074594 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.074740 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.074907 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.075041 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.075222 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.075389 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.075559 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.075647 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.075866 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.075960 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.076183 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.076268 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.076496 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.076590 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.076812 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.076897 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.077130 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.077321 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.077449 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.077648 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.077765 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.077957 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.078073 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.078266 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.078391 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.078575 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.078718 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.078888 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.079011 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.079198 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.079534 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.079630 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.079841 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.079928 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.080146 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.080241 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.080455 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.080549 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.080765 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.080859 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.081081 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.081185 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.081394 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.081481 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.081705 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.081791 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.082013 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.082100 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.082321 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.082408 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.082630 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.082716 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.082940 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.083026 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.083292 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.083394 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.083614 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.083713 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.083920 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.084013 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.084233 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.084320 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.084546 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.084646 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.084859 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.084957 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.085168 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.085260 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.085757 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.085858 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.086067 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.086204 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.086653 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.086754 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.086850 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.086919 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.086991 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.087070 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.087294 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.087386 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.087600 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.087695 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.087912 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.087997 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.088225 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.088318 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.088538 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.088668 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.088848 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.088964 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.089176 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.089378 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.089488 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.089599 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.089798 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.089997 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.090121 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.090308 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.090456 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.090636 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.090776 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.090957 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.091088 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.091296 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.091426 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.091610 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.091739 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.091924 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.092248 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.092337 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.092553 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.092639 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.092855 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.092943 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.093163 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.093249 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.093466 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.093553 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.093769 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.093855 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.094086 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.094173 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.094391 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.094477 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.094693 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.094778 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.095003 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.095090 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.095324 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.095411 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.095630 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.095853 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.095949 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.096203 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.096308 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.096520 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.096606 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.096824 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.096910 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.097142 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.097239 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.097448 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.097534 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.097753 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.097979 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.098065 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.098323 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.098415 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.098640 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.098777 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.098962 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.099058 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.099291 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.099382 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.099598 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.099687 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.099900 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.099986 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.100209 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.100297 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.100515 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.100602 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.100815 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.100900 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.101122 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.101244 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.101424 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.101512 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.101726 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.101811 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.102029 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.102114 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.102330 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.102417 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.102634 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.102720 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.102934 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.103032 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.103288 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.103378 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.103555 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.103641 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.103859 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.103966 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.104159 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.104246 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.104461 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.104546 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.104781 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.104877 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.105090 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.105184 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.105393 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.105516 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.105698 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.105794 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.106003 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.106089 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.106305 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.106397 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.106617 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.106704 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.106921 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.107006 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.107223 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.107330 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.107545 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.107634 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.107853 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.107938 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.108158 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.108246 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.108479 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.108566 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.108789 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.108920 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.109096 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.109192 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.109404 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.109499 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.109708 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.109803 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.110024 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.110241 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.110337 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.110571 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.110667 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.110889 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.110983 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.111217 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.111341 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.111561 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.111657 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.111865 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.111951 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.112168 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.112404 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.112496 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.112737 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.112825 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.113057 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.113153 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.113362 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.113447 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.113668 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.113760 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.113975 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.114063 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.114282 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.114368 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.114583 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.114673 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.114887 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.114980 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.115192 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.115304 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.115520 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.115614 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.115825 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.115911 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.116132 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.116224 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.116433 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.116527 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.116738 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.116824 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.117041 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.117143 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.117349 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.117450 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.117656 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.117742 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.117965 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.118059 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.118272 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.118440 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.118579 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.118664 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.118889 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.119001 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.119190 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.119302 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.119522 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.119612 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.119828 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.119927 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.120132 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.120221 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.120960 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.121056 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.121286 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.121389 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.121596 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.121703 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.121897 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.121984 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.122205 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.122513 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.122611 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.122823 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.122909 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.123137 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.123223 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.123493 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.123589 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.123800 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.123887 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.124104 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.124188 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.124431 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.124742 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.124826 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.125058 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.125143 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.125368 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.125456 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.125693 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.125779 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.126007 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.126093 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.126332 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.126419 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.126657 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.126744 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.126961 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.127047 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.127283 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.127384 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.127585 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.127692 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.127892 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.127980 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.128206 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.128299 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.128514 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.128601 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.128815 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.128908 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.129117 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.129221 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.129418 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.129512 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.129717 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.129813 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.130018 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.130111 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.130315 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.130401 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.130616 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.130710 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.130919 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.131011 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.131216 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.131322 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.131537 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.131624 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.131836 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.131930 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.132133 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.132226 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.132431 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.132518 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.132729 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.132814 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.133030 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.133122 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.133328 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.133415 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.133627 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.133712 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.133924 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.134009 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.134224 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.134310 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.134520 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.134604 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.134820 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.134911 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.135126 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.135211 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.135468 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.135555 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.135771 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.135866 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.136646 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.136750 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.136956 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.137041 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.137260 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.137352 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.137580 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.137669 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.137899 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.137986 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.138211 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.138309 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.138517 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.138603 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.138832 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.138951 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.139137 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.139223 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.139470 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.139558 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.139780 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.139866 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.140090 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.140186 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.140397 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.140483 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.140703 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.140795 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.141025 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.141145 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.141332 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.141424 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.141634 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.141752 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.141946 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.142033 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.142256 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.142341 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.142563 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.142655 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.142871 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.142955 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.143176 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.143288 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.143523 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.143623 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.143830 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.143916 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.144135 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.144220 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.144440 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.144535 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.144745 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.144830 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.145050 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.145143 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.145358 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.145451 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.145660 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.145744 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.145965 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.146051 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.146276 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.146362 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.146581 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.146673 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.146888 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.146984 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.147197 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.147304 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.147531 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.147616 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.147837 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.148005 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.148147 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.148241 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.148464 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.148557 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.148777 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.148871 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.149103 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.149188 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.149427 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.149510 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.149734 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.149830 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.150045 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.150167 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.150347 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.150433 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.150586 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 21:48:50.150704 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.151017 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.151396 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.153394 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.153394 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.153394 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.153394 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:48:50.153394 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 21:48:50.303512 n-d-861111-1 devstack@n-api.service[104442]: INFO dbcounter [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] Registered counter for database nova_api Oct 12 21:48:50.320892 n-d-861111-1 devstack@n-api.service[104443]: INFO dbcounter [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] Registered counter for database nova_api Oct 12 21:48:50.324629 n-d-861111-1 devstack@n-api.service[104442]: DEBUG oslo_db.sqlalchemy.engines [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 21:48:50.331259 n-d-861111-1 devstack@n-api.service[104442]: DEBUG dbcounter [-] [104442] Writer thread running {{(pid=104442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 21:48:50.342403 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_db.sqlalchemy.engines [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 21:48:50.348877 n-d-861111-1 devstack@n-api.service[104443]: DEBUG dbcounter [-] [104443] Writer thread running {{(pid=104443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 21:48:50.392032 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.context [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2bc00301-6462-4874-9c83-c889d0ff6a49(cell1) {{(pid=104442) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 21:48:50.395969 n-d-861111-1 devstack@n-api.service[104442]: DEBUG oslo_concurrency.lockutils [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:48:50.396449 n-d-861111-1 devstack@n-api.service[104442]: DEBUG oslo_concurrency.lockutils [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:48:50.398433 n-d-861111-1 devstack@n-api.service[104442]: DEBUG oslo_concurrency.lockutils [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:48:50.399682 n-d-861111-1 devstack@n-api.service[104442]: DEBUG oslo_concurrency.lockutils [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:48:50.400479 n-d-861111-1 devstack@n-api.service[104442]: DEBUG oslo_concurrency.lockutils [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:48:50.402953 n-d-861111-1 devstack@n-api.service[104442]: DEBUG oslo_concurrency.lockutils [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:48:50.405772 n-d-861111-1 devstack@n-api.service[104442]: INFO dbcounter [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] Registered counter for database nova_cell0 Oct 12 21:48:50.408030 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.context [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2bc00301-6462-4874-9c83-c889d0ff6a49(cell1) {{(pid=104443) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 21:48:50.410209 n-d-861111-1 devstack@n-api.service[104442]: INFO dbcounter [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] Registered counter for database nova_cell1 Oct 12 21:48:50.411925 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:48:50.412397 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:48:50.413996 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:48:50.414722 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:48:50.415164 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:48:50.417204 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:48:50.417954 n-d-861111-1 devstack@n-api.service[104442]: DEBUG oslo_db.sqlalchemy.engines [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 21:48:50.419816 n-d-861111-1 devstack@n-api.service[104443]: INFO dbcounter [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] Registered counter for database nova_cell0 Oct 12 21:48:50.420522 n-d-861111-1 devstack@n-api.service[104442]: DEBUG oslo_db.sqlalchemy.engines [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 21:48:50.423882 n-d-861111-1 devstack@n-api.service[104443]: INFO dbcounter [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] Registered counter for database nova_cell1 Oct 12 21:48:50.424693 n-d-861111-1 devstack@n-api.service[104442]: DEBUG dbcounter [-] [104442] Writer thread running {{(pid=104442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 21:48:50.430416 n-d-861111-1 devstack@n-api.service[104442]: DEBUG dbcounter [-] [104442] Writer thread running {{(pid=104442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 21:48:50.431036 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_db.sqlalchemy.engines [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 21:48:50.432716 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_db.sqlalchemy.engines [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 21:48:50.438767 n-d-861111-1 devstack@n-api.service[104443]: DEBUG dbcounter [-] [104443] Writer thread running {{(pid=104443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 21:48:50.573738 n-d-861111-1 devstack@n-api.service[104443]: DEBUG dbcounter [-] [104443] Writer thread running {{(pid=104443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 21:48:50.583818 n-d-861111-1 devstack@n-api.service[104443]: INFO dbcounter [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] Registered counter for database nova_cell0 Oct 12 21:48:50.592981 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_db.sqlalchemy.engines [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 21:48:50.595151 n-d-861111-1 devstack@n-api.service[104442]: INFO dbcounter [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] Registered counter for database nova_cell0 Oct 12 21:48:50.597764 n-d-861111-1 devstack@n-api.service[104443]: DEBUG dbcounter [-] [104443] Writer thread running {{(pid=104443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 21:48:50.604290 n-d-861111-1 devstack@n-api.service[104442]: DEBUG oslo_db.sqlalchemy.engines [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 21:48:50.610194 n-d-861111-1 devstack@n-api.service[104442]: DEBUG dbcounter [-] [104442] Writer thread running {{(pid=104442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 21:48:50.937250 n-d-861111-1 devstack@n-api.service[104443]: WARNING keystonemiddleware.auth_token [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 21:48:50.944573 n-d-861111-1 devstack@n-api.service[104443]: WARNING keystonemiddleware.auth_token [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 21:48:50.960795 n-d-861111-1 devstack@n-api.service[104442]: WARNING keystonemiddleware.auth_token [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 21:48:50.968664 n-d-861111-1 devstack@n-api.service[104442]: WARNING keystonemiddleware.auth_token [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 21:48:51.286353 n-d-861111-1 devstack@n-api.service[104443]: WARNING keystonemiddleware.auth_token [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 21:48:51.292385 n-d-861111-1 devstack@n-api.service[104443]: WARNING keystonemiddleware.auth_token [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 21:48:51.297782 n-d-861111-1 devstack@n-api.service[104443]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557487a709c0 pid: 104443 (default app) Oct 12 21:48:51.299870 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:48:51.301030 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001743 Oct 12 21:48:51.301426 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Wed Oct 12 21:48:51 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:48:51.319956 n-d-861111-1 devstack@n-api.service[104442]: WARNING keystonemiddleware.auth_token [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 21:48:51.326542 n-d-861111-1 devstack@n-api.service[104442]: WARNING keystonemiddleware.auth_token [None req-cc391471-d94a-46fd-a435-37aadd80554f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 21:48:51.331914 n-d-861111-1 devstack@n-api.service[104442]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557487a709c0 pid: 104442 (default app) Oct 12 21:50:12.312900 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:50:12.313916 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 12 21:50:12.314327 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 12 21:50:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:50:12.334290 n-d-861111-1 devstack@n-api.service[104442]: DEBUG dbcounter [-] [104442] Writing DB stats nova_api:SELECT=3 {{(pid=104442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:50:12.336477 n-d-861111-1 devstack@n-api.service[104442]: DEBUG dbcounter [-] [104442] Writing DB stats nova_cell1:SELECT=3 {{(pid=104442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:50:12.337278 n-d-861111-1 devstack@n-api.service[104442]: DEBUG dbcounter [-] [104442] Writing DB stats nova_cell0:SELECT=3 {{(pid=104442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:50:12.338594 n-d-861111-1 devstack@n-api.service[104442]: DEBUG dbcounter [-] [104442] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:50:13.179856 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-527024c6-20be-405d-b712-a58297a950c4 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:50:13.213276 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-527024c6-20be-405d-b712-a58297a950c4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.891051 Oct 12 21:50:13.214223 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 12 21:50:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:50:15.838309 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:50:15.839460 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-d502d5a3-24a3-4dde-9388-c275a500e94c None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Oct 12 21:50:15.840069 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 12 21:50:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:50:16.287606 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-e8169f7d-6d8a-4314-ad0c-197f892050b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1, "ram": 256, "name": "cirros256"}} {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:16.335071 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-e8169f7d-6d8a-4314-ad0c-197f892050b6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.488503 Oct 12 21:50:16.335844 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 12 21:50:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:50:16.349315 n-d-861111-1 devstack@n-api.service[104443]: DEBUG dbcounter [-] [104443] Writing DB stats nova_api:SELECT=3 {{(pid=104443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:50:16.350167 n-d-861111-1 devstack@n-api.service[104443]: DEBUG dbcounter [-] [104443] Writing DB stats nova_cell0:SELECT=3 {{(pid=104443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:50:16.352193 n-d-861111-1 devstack@n-api.service[104443]: DEBUG dbcounter [-] [104443] Writing DB stats nova_cell1:SELECT=3 {{(pid=104443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:50:16.353008 n-d-861111-1 devstack@n-api.service[104443]: DEBUG dbcounter [-] [104443] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:50:16.556554 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-1d3f4737-a25e-4934-93a4-2a06e8868219 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:16.625973 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-1d3f4737-a25e-4934-93a4-2a06e8868219 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281815 Oct 12 21:50:16.626558 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 12 21:50:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:50:19.221483 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-e8169f7d-6d8a-4314-ad0c-197f892050b6 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:50:19.222635 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-e8169f7d-6d8a-4314-ad0c-197f892050b6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001686 Oct 12 21:50:19.223132 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 12 21:50:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:50:20.012173 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-a02b6f2c-0be2-4904-a891-c509aeec56a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:20.068773 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-a02b6f2c-0be2-4904-a891-c509aeec56a1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.838852 Oct 12 21:50:20.070942 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 12 21:50:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:50:20.083682 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-d5e7e47d-3667-4687-9e40-a5afb6b17a8f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:20.125404 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-d5e7e47d-3667-4687-9e40-a5afb6b17a8f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046107 Oct 12 21:50:20.126198 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 12 21:50:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:50:22.931261 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-a02b6f2c-0be2-4904-a891-c509aeec56a1 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:50:22.931261 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-a02b6f2c-0be2-4904-a891-c509aeec56a1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002608 Oct 12 21:50:22.931261 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 12 21:50:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:50:23.607824 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-cbf12321-8e56-4304-9391-973385a66d15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G"}} {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:23.628754 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-cbf12321-8e56-4304-9391-973385a66d15 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.694015 Oct 12 21:50:23.629309 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 12 21:50:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:50:23.642069 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-beff04c3-91e9-4ad0-a14e-8013e52c484a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:23.670657 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-beff04c3-91e9-4ad0-a14e-8013e52c484a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032188 Oct 12 21:50:23.671837 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 12 21:50:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:50:26.282280 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-cbf12321-8e56-4304-9391-973385a66d15 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:50:26.283332 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-cbf12321-8e56-4304-9391-973385a66d15 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 12 21:50:26.283960 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 12 21:50:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:50:26.741403 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-44e098a9-7b41-42fe-9182-9688d70010b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "swap": 0, "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:26.760491 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-44e098a9-7b41-42fe-9182-9688d70010b3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.470377 Oct 12 21:50:26.761045 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 12 21:50:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:50:26.773806 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-5d075786-4575-4aaf-901c-a062708f67a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:26.808272 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-5d075786-4575-4aaf-901c-a062708f67a8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038606 Oct 12 21:50:26.810117 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 12 21:50:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:50:29.517985 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-44e098a9-7b41-42fe-9182-9688d70010b3 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:50:29.519861 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-44e098a9-7b41-42fe-9182-9688d70010b3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002305 Oct 12 21:50:29.526935 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 12 21:50:29 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:50:29.992202 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-a8616b09-0c7a-4a50-9054-9ea35f5f3438 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0}} {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:30.014079 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-a8616b09-0c7a-4a50-9054-9ea35f5f3438 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.485182 Oct 12 21:50:30.027610 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-4bfc4ae0-6712-4519-a1c0-50278c0525dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:30.033170 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 12 21:50:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 21:50:30.055275 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-4bfc4ae0-6712-4519-a1c0-50278c0525dd admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031301 Oct 12 21:50:30.067884 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 12 21:50:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:50:32.695578 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-a8616b09-0c7a-4a50-9054-9ea35f5f3438 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:50:32.696574 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-a8616b09-0c7a-4a50-9054-9ea35f5f3438 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 12 21:50:32.699547 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 12 21:50:32 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:50:33.180248 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-f08794bf-bdd7-49cc-974e-4a12744c2fc9 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:50:33.204445 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-f08794bf-bdd7-49cc-974e-4a12744c2fc9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.501494 Oct 12 21:50:33.204920 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 12 21:50:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 21:50:35.748130 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-a8616b09-0c7a-4a50-9054-9ea35f5f3438 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:50:35.749159 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-a8616b09-0c7a-4a50-9054-9ea35f5f3438 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Oct 12 21:50:35.749569 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 12 21:50:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:50:36.164401 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-d30f1252-1663-47c3-a87f-7c5aa5a5b150 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1", "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:36.183179 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-d30f1252-1663-47c3-a87f-7c5aa5a5b150 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.427625 Oct 12 21:50:36.183760 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 12 21:50:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:50:36.196182 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-f6cac7e8-3c6a-4615-86fe-0497599869b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:36.225727 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-f6cac7e8-3c6a-4615-86fe-0497599869b4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033680 Oct 12 21:50:36.226315 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 12 21:50:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:50:38.822078 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-d30f1252-1663-47c3-a87f-7c5aa5a5b150 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:50:38.823097 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-d30f1252-1663-47c3-a87f-7c5aa5a5b150 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 12 21:50:38.823553 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 12 21:50:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:50:39.232475 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-e8d3468a-ef82-40a5-9486-0da35e331d42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "vcpus": 1, "name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:39.251597 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-e8d3468a-ef82-40a5-9486-0da35e331d42 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.421615 Oct 12 21:50:39.252255 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 12 21:50:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:50:39.265190 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-9037ecfe-bfac-47cf-a711-bdeb41ded2e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:39.295320 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-9037ecfe-bfac-47cf-a711-bdeb41ded2e0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033763 Oct 12 21:50:39.295917 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 12 21:50:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:50:41.886345 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-e8d3468a-ef82-40a5-9486-0da35e331d42 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:50:41.887322 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-e8d3468a-ef82-40a5-9486-0da35e331d42 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 12 21:50:41.887998 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 12 21:50:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:50:42.270552 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-f5f9a12b-fe53-45de-afdb-9205802e8d33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "swap": 0}} {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:42.292697 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-f5f9a12b-fe53-45de-afdb-9205802e8d33 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.398237 Oct 12 21:50:42.293428 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 12 21:50:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:50:42.307407 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-9a70fa48-6505-4b2e-aa50-25ee0f3aee52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:42.337899 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-9a70fa48-6505-4b2e-aa50-25ee0f3aee52 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035676 Oct 12 21:50:42.338486 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 12 21:50:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:50:44.959591 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-f5f9a12b-fe53-45de-afdb-9205802e8d33 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:50:44.960606 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-f5f9a12b-fe53-45de-afdb-9205802e8d33 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002267 Oct 12 21:50:44.961233 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 12 21:50:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:50:45.400803 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-927ae158-7037-443a-bab4-a66a8dc104dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "swap": 0, "disk": 80, "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:45.407075 n-d-861111-1 devstack@n-api.service[104442]: DEBUG dbcounter [-] [104442] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:50:45.423474 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-927ae158-7037-443a-bab4-a66a8dc104dc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.455927 Oct 12 21:50:45.424153 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 12 21:50:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:50:45.436278 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-bf553d27-6b4f-46fe-b3bf-691a974e26bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:45.463025 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-bf553d27-6b4f-46fe-b3bf-691a974e26bb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030347 Oct 12 21:50:45.464030 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 12 21:50:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:50:48.076588 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-927ae158-7037-443a-bab4-a66a8dc104dc admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:50:48.077601 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-927ae158-7037-443a-bab4-a66a8dc104dc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 12 21:50:48.077997 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 12 21:50:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:50:48.587525 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-aa69d795-5a8f-4b9f-81af-ae092d01eaa3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "swap": 0, "id": "5", "ram": 16384}} {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:48.597488 n-d-861111-1 devstack@n-api.service[104443]: DEBUG dbcounter [-] [104443] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:50:48.613965 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-aa69d795-5a8f-4b9f-81af-ae092d01eaa3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.529884 Oct 12 21:50:48.614490 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 12 21:50:48 2022] POST /compute/v2.1/flavors => generated 408 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:50:48.626360 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-12efd062-45e5-4089-9830-31ee0d4b40e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:50:48.651800 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-12efd062-45e5-4089-9830-31ee0d4b40e4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029011 Oct 12 21:50:48.655314 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 12 21:50:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 21:51:10.012482 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-aa69d795-5a8f-4b9f-81af-ae092d01eaa3 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:10.013497 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-aa69d795-5a8f-4b9f-81af-ae092d01eaa3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 12 21:51:10.013902 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 12 21:51:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:51:10.026745 n-d-861111-1 devstack@n-api.service[104442]: DEBUG dbcounter [-] [104442] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=104442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:51:10.400707 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-e6e058f9-27c3-496f-9d6c-adfe3de4e2dd admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:10.418586 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-e6e058f9-27c3-496f-9d6c-adfe3de4e2dd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398440 Oct 12 21:51:10.419117 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 12 21:51:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 21:51:11.713162 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-aa69d795-5a8f-4b9f-81af-ae092d01eaa3 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:11.714205 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-aa69d795-5a8f-4b9f-81af-ae092d01eaa3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 12 21:51:11.714624 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 12 21:51:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:51:12.289243 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-3322a0d6-2c6d-47b5-a3bb-37238cb98548 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:12.294941 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.wsgi [None req-3322a0d6-2c6d-47b5-a3bb-37238cb98548 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-3322a0d6-2c6d-47b5-a3bb-37238cb98548 admin admin] Request method failure captured: Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: Accept: application/json Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: Accept-Encoding: gzip, deflate Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: Connection: keep-alive Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: Content-Length: 0 Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: Host: 10.222.0.16 Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: Openstack-Api-Version: compute 2.92 Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: Openstack-System-Scope: None Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: User-Agent: python-novaclient Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: X-Auth-Token: gAAAAABjRzbP3kMp6DOrmu1krY-St7FDx66gP86gkyhz-spNwvGB6KJ1L-6WjbAWQnQsZezAmcBvL6Lyq1kjs31I1MurDXmK1a80qtuXVokpWZipToccDcFcJsNyPoSqKDTzH8oT6OVmzGFdv57cdIljMhZfc0oeUYziqVQK4VNlTAgiUsp04cc Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: X-Domain-Id: None Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: X-Domain-Name: None Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: X-Identity-Status: Confirmed Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: X-Is-Admin-Project: True Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: X-Project-Domain-Id: default Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: X-Project-Domain-Name: Default Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: X-Project-Id: 500a3a30c2a540549c5148737e90a3b1 Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: X-Project-Name: admin Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: X-Role: admin,reader,member Oct 12 21:51:12.298223 n-d-861111-1 devstack@n-api.service[104442]: X-Roles: admin,reader,member Oct 12 21:51:12.299893 n-d-861111-1 devstack@n-api.service[104442]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_500a3a30c2a540549c5148737e90a3b1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:51:12.299893 n-d-861111-1 devstack@n-api.service[104442]: X-Tenant: admin Oct 12 21:51:12.299893 n-d-861111-1 devstack@n-api.service[104442]: X-Tenant-Id: 500a3a30c2a540549c5148737e90a3b1 Oct 12 21:51:12.299893 n-d-861111-1 devstack@n-api.service[104442]: X-Tenant-Name: admin Oct 12 21:51:12.299893 n-d-861111-1 devstack@n-api.service[104442]: X-User: admin Oct 12 21:51:12.299893 n-d-861111-1 devstack@n-api.service[104442]: X-User-Domain-Id: default Oct 12 21:51:12.299893 n-d-861111-1 devstack@n-api.service[104442]: X-User-Domain-Name: Default Oct 12 21:51:12.299893 n-d-861111-1 devstack@n-api.service[104442]: X-User-Id: 960a21e0e21d4995a9676887db1e5b47 Oct 12 21:51:12.299893 n-d-861111-1 devstack@n-api.service[104442]: X-User-Name: admin Oct 12 21:51:12.299893 n-d-861111-1 devstack@n-api.service[104442]: method: > Oct 12 21:51:12.299893 n-d-861111-1 devstack@n-api.service[104442]: exception: Flavor 42 could not be found. Oct 12 21:51:12.299893 n-d-861111-1 devstack@n-api.service[104442]: action_args: {'id': '42'} Oct 12 21:51:12.299893 n-d-861111-1 devstack@n-api.service[104442]: {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:51:12.299893 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:51:12.300838 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Oct 12 21:51:12.302036 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-3322a0d6-2c6d-47b5-a3bb-37238cb98548 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104442) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:51:12.303141 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-3322a0d6-2c6d-47b5-a3bb-37238cb98548 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393492 Oct 12 21:51:12.303141 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 12 21:51:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 21:51:12.309510 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-afe30d1b-d759-466d-8622-7a017e2cabbf admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:12.331659 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-afe30d1b-d759-466d-8622-7a017e2cabbf admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025773 Oct 12 21:51:12.332836 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 12 21:51:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 21:51:12.344343 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-f7dc637e-80cd-49d8-9793-98e8bf4e0f6c admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:12.365809 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-f7dc637e-80cd-49d8-9793-98e8bf4e0f6c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026232 Oct 12 21:51:12.366345 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 12 21:51:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 21:51:12.375652 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-d195abec-7780-4252-a8d1-b04148bbc0b9 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:12.381405 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.wsgi [None req-d195abec-7780-4252-a8d1-b04148bbc0b9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-d195abec-7780-4252-a8d1-b04148bbc0b9 admin admin] Request method failure captured: Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: Accept: application/json Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: Accept-Encoding: gzip, deflate Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: Connection: keep-alive Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: Content-Length: 0 Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: Host: 10.222.0.16 Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: Openstack-Api-Version: compute 2.92 Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: Openstack-System-Scope: None Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: User-Agent: python-novaclient Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: X-Auth-Token: gAAAAABjRzbP3kMp6DOrmu1krY-St7FDx66gP86gkyhz-spNwvGB6KJ1L-6WjbAWQnQsZezAmcBvL6Lyq1kjs31I1MurDXmK1a80qtuXVokpWZipToccDcFcJsNyPoSqKDTzH8oT6OVmzGFdv57cdIljMhZfc0oeUYziqVQK4VNlTAgiUsp04cc Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: X-Domain-Id: None Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: X-Domain-Name: None Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: X-Identity-Status: Confirmed Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: X-Is-Admin-Project: True Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: X-Project-Domain-Id: default Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: X-Project-Domain-Name: Default Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: X-Project-Id: 500a3a30c2a540549c5148737e90a3b1 Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: X-Project-Name: admin Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: X-Role: admin,reader,member Oct 12 21:51:12.384658 n-d-861111-1 devstack@n-api.service[104443]: X-Roles: admin,reader,member Oct 12 21:51:12.386200 n-d-861111-1 devstack@n-api.service[104443]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_500a3a30c2a540549c5148737e90a3b1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:51:12.386200 n-d-861111-1 devstack@n-api.service[104443]: X-Tenant: admin Oct 12 21:51:12.386200 n-d-861111-1 devstack@n-api.service[104443]: X-Tenant-Id: 500a3a30c2a540549c5148737e90a3b1 Oct 12 21:51:12.386200 n-d-861111-1 devstack@n-api.service[104443]: X-Tenant-Name: admin Oct 12 21:51:12.386200 n-d-861111-1 devstack@n-api.service[104443]: X-User: admin Oct 12 21:51:12.386200 n-d-861111-1 devstack@n-api.service[104443]: X-User-Domain-Id: default Oct 12 21:51:12.386200 n-d-861111-1 devstack@n-api.service[104443]: X-User-Domain-Name: Default Oct 12 21:51:12.386200 n-d-861111-1 devstack@n-api.service[104443]: X-User-Id: 960a21e0e21d4995a9676887db1e5b47 Oct 12 21:51:12.386200 n-d-861111-1 devstack@n-api.service[104443]: X-User-Name: admin Oct 12 21:51:12.386200 n-d-861111-1 devstack@n-api.service[104443]: method: > Oct 12 21:51:12.386200 n-d-861111-1 devstack@n-api.service[104443]: exception: Flavor 42 could not be found. Oct 12 21:51:12.386200 n-d-861111-1 devstack@n-api.service[104443]: action_args: {'id': '42'} Oct 12 21:51:12.386200 n-d-861111-1 devstack@n-api.service[104443]: {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:51:12.386200 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:51:12.387061 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Oct 12 21:51:12.388305 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-d195abec-7780-4252-a8d1-b04148bbc0b9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:51:12.389767 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-d195abec-7780-4252-a8d1-b04148bbc0b9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013984 Oct 12 21:51:12.389767 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 12 21:51:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 21:51:13.593807 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-f7dc637e-80cd-49d8-9793-98e8bf4e0f6c admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:13.594874 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-f7dc637e-80cd-49d8-9793-98e8bf4e0f6c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 12 21:51:13.595320 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 12 21:51:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:51:14.108497 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-b6adf2c9-c329-4146-8a11-074354978a04 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:14.114111 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.wsgi [None req-b6adf2c9-c329-4146-8a11-074354978a04 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-b6adf2c9-c329-4146-8a11-074354978a04 admin admin] Request method failure captured: Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: Accept: application/json Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: Accept-Encoding: gzip, deflate Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: Connection: keep-alive Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: Content-Length: 0 Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: Host: 10.222.0.16 Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: Openstack-Api-Version: compute 2.92 Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: Openstack-System-Scope: None Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: User-Agent: python-novaclient Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: X-Auth-Token: gAAAAABjRzbRJytLv7p8ywqlvXCAm_tlgdCvTe-2wUgrjesnyywu3rzkKwqjkOQ4u6-WIgftvhFJ9S1Ho3Bp0_iq-SI6c2cZcWFUAiuu7sqJRMwLt7LGRNYmWrOgZmdgTOKulUzRMxVCnlXQfWo_LeBQdxKGC5wXB2ku1bFvkAKR2QhaQ8VKYjk Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: X-Domain-Id: None Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: X-Domain-Name: None Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: X-Identity-Status: Confirmed Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: X-Is-Admin-Project: True Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: X-Project-Domain-Id: default Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: X-Project-Domain-Name: Default Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: X-Project-Id: 500a3a30c2a540549c5148737e90a3b1 Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: X-Project-Name: admin Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: X-Role: admin,reader,member Oct 12 21:51:14.115708 n-d-861111-1 devstack@n-api.service[104443]: X-Roles: admin,reader,member Oct 12 21:51:14.117223 n-d-861111-1 devstack@n-api.service[104443]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_500a3a30c2a540549c5148737e90a3b1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:51:14.117223 n-d-861111-1 devstack@n-api.service[104443]: X-Tenant: admin Oct 12 21:51:14.117223 n-d-861111-1 devstack@n-api.service[104443]: X-Tenant-Id: 500a3a30c2a540549c5148737e90a3b1 Oct 12 21:51:14.117223 n-d-861111-1 devstack@n-api.service[104443]: X-Tenant-Name: admin Oct 12 21:51:14.117223 n-d-861111-1 devstack@n-api.service[104443]: X-User: admin Oct 12 21:51:14.117223 n-d-861111-1 devstack@n-api.service[104443]: X-User-Domain-Id: default Oct 12 21:51:14.117223 n-d-861111-1 devstack@n-api.service[104443]: X-User-Domain-Name: Default Oct 12 21:51:14.117223 n-d-861111-1 devstack@n-api.service[104443]: X-User-Id: 960a21e0e21d4995a9676887db1e5b47 Oct 12 21:51:14.117223 n-d-861111-1 devstack@n-api.service[104443]: X-User-Name: admin Oct 12 21:51:14.117223 n-d-861111-1 devstack@n-api.service[104443]: method: > Oct 12 21:51:14.117223 n-d-861111-1 devstack@n-api.service[104443]: exception: Flavor 84 could not be found. Oct 12 21:51:14.117223 n-d-861111-1 devstack@n-api.service[104443]: action_args: {'id': '84'} Oct 12 21:51:14.117223 n-d-861111-1 devstack@n-api.service[104443]: {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:51:14.117223 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:51:14.118188 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Oct 12 21:51:14.119600 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-b6adf2c9-c329-4146-8a11-074354978a04 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:51:14.120805 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-b6adf2c9-c329-4146-8a11-074354978a04 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.384770 Oct 12 21:51:14.120805 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 12 21:51:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 21:51:14.126787 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-cf3b96e4-058c-4859-a92a-40325ef02816 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:14.142177 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-cf3b96e4-058c-4859-a92a-40325ef02816 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018948 Oct 12 21:51:14.142657 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 12 21:51:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 21:51:14.151849 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-7b850f55-aa33-4294-b162-59b02ec61a97 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:14.167484 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-7b850f55-aa33-4294-b162-59b02ec61a97 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019081 Oct 12 21:51:14.168009 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 12 21:51:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 21:51:14.177631 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-8ed68d04-d315-487e-8668-a530a739f08c admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:14.182505 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.wsgi [None req-8ed68d04-d315-487e-8668-a530a739f08c admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-8ed68d04-d315-487e-8668-a530a739f08c admin admin] Request method failure captured: Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: Accept: application/json Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: Accept-Encoding: gzip, deflate Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: Connection: keep-alive Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: Content-Length: 0 Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: Host: 10.222.0.16 Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: Openstack-Api-Version: compute 2.92 Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: Openstack-System-Scope: None Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: User-Agent: python-novaclient Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: X-Auth-Token: gAAAAABjRzbRJytLv7p8ywqlvXCAm_tlgdCvTe-2wUgrjesnyywu3rzkKwqjkOQ4u6-WIgftvhFJ9S1Ho3Bp0_iq-SI6c2cZcWFUAiuu7sqJRMwLt7LGRNYmWrOgZmdgTOKulUzRMxVCnlXQfWo_LeBQdxKGC5wXB2ku1bFvkAKR2QhaQ8VKYjk Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: X-Domain-Id: None Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: X-Domain-Name: None Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: X-Identity-Status: Confirmed Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: X-Is-Admin-Project: True Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: X-Project-Domain-Id: default Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: X-Project-Domain-Name: Default Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: X-Project-Id: 500a3a30c2a540549c5148737e90a3b1 Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: X-Project-Name: admin Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: X-Role: admin,reader,member Oct 12 21:51:14.184045 n-d-861111-1 devstack@n-api.service[104442]: X-Roles: admin,reader,member Oct 12 21:51:14.185538 n-d-861111-1 devstack@n-api.service[104442]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_500a3a30c2a540549c5148737e90a3b1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:51:14.185538 n-d-861111-1 devstack@n-api.service[104442]: X-Tenant: admin Oct 12 21:51:14.185538 n-d-861111-1 devstack@n-api.service[104442]: X-Tenant-Id: 500a3a30c2a540549c5148737e90a3b1 Oct 12 21:51:14.185538 n-d-861111-1 devstack@n-api.service[104442]: X-Tenant-Name: admin Oct 12 21:51:14.185538 n-d-861111-1 devstack@n-api.service[104442]: X-User: admin Oct 12 21:51:14.185538 n-d-861111-1 devstack@n-api.service[104442]: X-User-Domain-Id: default Oct 12 21:51:14.185538 n-d-861111-1 devstack@n-api.service[104442]: X-User-Domain-Name: Default Oct 12 21:51:14.185538 n-d-861111-1 devstack@n-api.service[104442]: X-User-Id: 960a21e0e21d4995a9676887db1e5b47 Oct 12 21:51:14.185538 n-d-861111-1 devstack@n-api.service[104442]: X-User-Name: admin Oct 12 21:51:14.185538 n-d-861111-1 devstack@n-api.service[104442]: method: > Oct 12 21:51:14.185538 n-d-861111-1 devstack@n-api.service[104442]: exception: Flavor 84 could not be found. Oct 12 21:51:14.185538 n-d-861111-1 devstack@n-api.service[104442]: action_args: {'id': '84'} Oct 12 21:51:14.185538 n-d-861111-1 devstack@n-api.service[104442]: {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:51:14.185538 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:51:14.186474 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Oct 12 21:51:14.187794 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-8ed68d04-d315-487e-8668-a530a739f08c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104442) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:51:14.188993 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-8ed68d04-d315-487e-8668-a530a739f08c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011804 Oct 12 21:51:14.188993 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 12 21:51:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 21:51:15.400485 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-7b850f55-aa33-4294-b162-59b02ec61a97 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:15.401484 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-7b850f55-aa33-4294-b162-59b02ec61a97 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 12 21:51:15.401882 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 12 21:51:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:51:15.917062 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-deb702c8-3476-4467-8945-63405754f977 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:15.922698 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.wsgi [None req-deb702c8-3476-4467-8945-63405754f977 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-deb702c8-3476-4467-8945-63405754f977 admin admin] Request method failure captured: Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: Accept: application/json Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: Accept-Encoding: gzip, deflate Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: Connection: keep-alive Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: Content-Length: 0 Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: Host: 10.222.0.16 Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: Openstack-Api-Version: compute 2.92 Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: Openstack-System-Scope: None Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: User-Agent: python-novaclient Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: X-Auth-Token: gAAAAABjRzbTsrlenyCVyJRP7OJ96L5Q0mN2KLFY0wE2uPODpbFLr_pu4OOmDeqTAeN3XEgyRui7qgnaGgBEFrtgolF-uEPDXRrOyYrvLg7QlzqCmqhs1BeP-WPgiD-G-bv2f3UYbxdv3gfRctR60FKcU6dRJ4BskipM2vRdSfDINOLQHzZXDRM Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: X-Domain-Id: None Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: X-Domain-Name: None Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: X-Identity-Status: Confirmed Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: X-Is-Admin-Project: True Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: X-Project-Domain-Id: default Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: X-Project-Domain-Name: Default Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: X-Project-Id: 500a3a30c2a540549c5148737e90a3b1 Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: X-Project-Name: admin Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: X-Role: admin,reader,member Oct 12 21:51:15.924217 n-d-861111-1 devstack@n-api.service[104442]: X-Roles: admin,reader,member Oct 12 21:51:15.925765 n-d-861111-1 devstack@n-api.service[104442]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_500a3a30c2a540549c5148737e90a3b1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:51:15.925765 n-d-861111-1 devstack@n-api.service[104442]: X-Tenant: admin Oct 12 21:51:15.925765 n-d-861111-1 devstack@n-api.service[104442]: X-Tenant-Id: 500a3a30c2a540549c5148737e90a3b1 Oct 12 21:51:15.925765 n-d-861111-1 devstack@n-api.service[104442]: X-Tenant-Name: admin Oct 12 21:51:15.925765 n-d-861111-1 devstack@n-api.service[104442]: X-User: admin Oct 12 21:51:15.925765 n-d-861111-1 devstack@n-api.service[104442]: X-User-Domain-Id: default Oct 12 21:51:15.925765 n-d-861111-1 devstack@n-api.service[104442]: X-User-Domain-Name: Default Oct 12 21:51:15.925765 n-d-861111-1 devstack@n-api.service[104442]: X-User-Id: 960a21e0e21d4995a9676887db1e5b47 Oct 12 21:51:15.925765 n-d-861111-1 devstack@n-api.service[104442]: X-User-Name: admin Oct 12 21:51:15.925765 n-d-861111-1 devstack@n-api.service[104442]: method: > Oct 12 21:51:15.925765 n-d-861111-1 devstack@n-api.service[104442]: exception: Flavor 451 could not be found. Oct 12 21:51:15.925765 n-d-861111-1 devstack@n-api.service[104442]: action_args: {'id': '451'} Oct 12 21:51:15.925765 n-d-861111-1 devstack@n-api.service[104442]: {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:51:15.925765 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:51:15.926605 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: ERROR nova.api.openstack.wsgi Oct 12 21:51:15.927819 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-deb702c8-3476-4467-8945-63405754f977 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104442) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:51:15.929011 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-deb702c8-3476-4467-8945-63405754f977 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.386861 Oct 12 21:51:15.929011 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 12 21:51:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 21:51:15.935565 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-22774c82-e459-42e5-823c-c419c78f33c2 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:15.950663 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-22774c82-e459-42e5-823c-c419c78f33c2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018660 Oct 12 21:51:15.951174 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 12 21:51:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 21:51:15.961194 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-1193a605-4fb2-403a-bbeb-da823628b5a4 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:15.975901 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-1193a605-4fb2-403a-bbeb-da823628b5a4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019086 Oct 12 21:51:15.976430 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 12 21:51:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 21:51:15.985372 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-8db20424-dc41-4af8-8fed-c7bdca253258 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:15.990165 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.wsgi [None req-8db20424-dc41-4af8-8fed-c7bdca253258 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-8db20424-dc41-4af8-8fed-c7bdca253258 admin admin] Request method failure captured: Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: Accept: application/json Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: Accept-Encoding: gzip, deflate Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: Connection: keep-alive Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: Content-Length: 0 Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: Host: 10.222.0.16 Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: Openstack-Api-Version: compute 2.92 Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: Openstack-System-Scope: None Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: User-Agent: python-novaclient Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: X-Auth-Token: gAAAAABjRzbTsrlenyCVyJRP7OJ96L5Q0mN2KLFY0wE2uPODpbFLr_pu4OOmDeqTAeN3XEgyRui7qgnaGgBEFrtgolF-uEPDXRrOyYrvLg7QlzqCmqhs1BeP-WPgiD-G-bv2f3UYbxdv3gfRctR60FKcU6dRJ4BskipM2vRdSfDINOLQHzZXDRM Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: X-Domain-Id: None Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: X-Domain-Name: None Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: X-Identity-Status: Confirmed Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: X-Is-Admin-Project: True Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: X-Project-Domain-Id: default Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: X-Project-Domain-Name: Default Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: X-Project-Id: 500a3a30c2a540549c5148737e90a3b1 Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: X-Project-Name: admin Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: X-Role: admin,reader,member Oct 12 21:51:15.991757 n-d-861111-1 devstack@n-api.service[104443]: X-Roles: admin,reader,member Oct 12 21:51:15.993278 n-d-861111-1 devstack@n-api.service[104443]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_500a3a30c2a540549c5148737e90a3b1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/500a3a30c2a540549c5148737e90a3b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:51:15.993278 n-d-861111-1 devstack@n-api.service[104443]: X-Tenant: admin Oct 12 21:51:15.993278 n-d-861111-1 devstack@n-api.service[104443]: X-Tenant-Id: 500a3a30c2a540549c5148737e90a3b1 Oct 12 21:51:15.993278 n-d-861111-1 devstack@n-api.service[104443]: X-Tenant-Name: admin Oct 12 21:51:15.993278 n-d-861111-1 devstack@n-api.service[104443]: X-User: admin Oct 12 21:51:15.993278 n-d-861111-1 devstack@n-api.service[104443]: X-User-Domain-Id: default Oct 12 21:51:15.993278 n-d-861111-1 devstack@n-api.service[104443]: X-User-Domain-Name: Default Oct 12 21:51:15.993278 n-d-861111-1 devstack@n-api.service[104443]: X-User-Id: 960a21e0e21d4995a9676887db1e5b47 Oct 12 21:51:15.993278 n-d-861111-1 devstack@n-api.service[104443]: X-User-Name: admin Oct 12 21:51:15.993278 n-d-861111-1 devstack@n-api.service[104443]: method: > Oct 12 21:51:15.993278 n-d-861111-1 devstack@n-api.service[104443]: exception: Flavor 451 could not be found. Oct 12 21:51:15.993278 n-d-861111-1 devstack@n-api.service[104443]: action_args: {'id': '451'} Oct 12 21:51:15.993278 n-d-861111-1 devstack@n-api.service[104443]: {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:51:15.993278 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:51:15.994177 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: ERROR nova.api.openstack.wsgi Oct 12 21:51:15.995451 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-8db20424-dc41-4af8-8fed-c7bdca253258 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:51:15.996666 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-8db20424-dc41-4af8-8fed-c7bdca253258 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011158 Oct 12 21:51:15.996666 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 12 21:51:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 21:51:17.201177 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-1193a605-4fb2-403a-bbeb-da823628b5a4 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:17.202197 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-1193a605-4fb2-403a-bbeb-da823628b5a4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 12 21:51:17.202594 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 12 21:51:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:51:17.718228 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-e3bef2ef-022d-4145-91cf-46c064672f3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:51:17.737394 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-e3bef2ef-022d-4145-91cf-46c064672f3f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.396703 Oct 12 21:51:17.737988 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Oct 12 21:51:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:51:18.940683 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-1193a605-4fb2-403a-bbeb-da823628b5a4 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:18.941693 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-1193a605-4fb2-403a-bbeb-da823628b5a4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 12 21:51:18.942088 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 12 21:51:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:51:19.461978 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-af6c0adf-daa1-45f9-836e-9521c7c68a35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:51:19.480567 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-af6c0adf-daa1-45f9-836e-9521c7c68a35 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.402369 Oct 12 21:51:19.481111 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Oct 12 21:51:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:51:20.685305 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-1193a605-4fb2-403a-bbeb-da823628b5a4 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:20.686309 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-1193a605-4fb2-403a-bbeb-da823628b5a4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 12 21:51:20.686707 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 12 21:51:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:51:21.198897 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-fd3ff072-26a4-4245-bcec-e55187328445 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:51:21.217148 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-fd3ff072-26a4-4245-bcec-e55187328445 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.395998 Oct 12 21:51:21.217677 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Oct 12 21:51:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:51:22.426221 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-1193a605-4fb2-403a-bbeb-da823628b5a4 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:22.427228 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-1193a605-4fb2-403a-bbeb-da823628b5a4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Oct 12 21:51:22.427683 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 12 21:51:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:51:22.940811 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-0fa2ee33-e0b2-4d61-8aa2-8335282ed972 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:51:22.958915 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-0fa2ee33-e0b2-4d61-8aa2-8335282ed972 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.392970 Oct 12 21:51:22.959485 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Oct 12 21:51:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:51:24.167679 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-1193a605-4fb2-403a-bbeb-da823628b5a4 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:24.168686 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-1193a605-4fb2-403a-bbeb-da823628b5a4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 12 21:51:24.169084 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 12 21:51:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:51:24.678934 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-fcbf9cfd-945b-4eba-a4ff-534994d70c29 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:51:24.698884 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-fcbf9cfd-945b-4eba-a4ff-534994d70c29 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.395754 Oct 12 21:51:24.699451 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Wed Oct 12 21:51:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 21:52:21.751983 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-1193a605-4fb2-403a-bbeb-da823628b5a4 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:52:21.752990 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-1193a605-4fb2-403a-bbeb-da823628b5a4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Oct 12 21:52:21.753420 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 12 21:52:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:52:21.764149 n-d-861111-1 devstack@n-api.service[104443]: DEBUG dbcounter [-] [104443] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:52:22.140413 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-0288d77b-668d-4a35-bad6-fab87f3f0b91 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:52:22.160937 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-0288d77b-668d-4a35-bad6-fab87f3f0b91 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401390 Oct 12 21:52:22.161471 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 12 21:52:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 21:52:22.182206 n-d-861111-1 devstack@n-api.service[104442]: DEBUG dbcounter [-] [104442] Writing DB stats nova_api:SELECT=14 {{(pid=104442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:52:22.186022 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-c57072f5-efdc-4139-b43c-90a00dcbb1f7 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:52:22.193798 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-c57072f5-efdc-4139-b43c-90a00dcbb1f7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013139 Oct 12 21:52:22.194326 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Wed Oct 12 21:52:22 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:52:22.206819 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-0d4cb15b-c290-49b6-985f-548d8ae08a40 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:52:22.214361 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-0d4cb15b-c290-49b6-985f-548d8ae08a40 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011810 Oct 12 21:52:22.214896 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Wed Oct 12 21:52:22 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 21:52:22.226307 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-34f11da5-a3b9-4df9-a8fa-99e70ec6d452 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:52:22.233467 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-34f11da5-a3b9-4df9-a8fa-99e70ec6d452 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010721 Oct 12 21:52:22.233978 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Wed Oct 12 21:52:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 21:52:22.246619 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-b76e10b2-3913-4541-a941-7c089f798153 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:52:22.254409 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-b76e10b2-3913-4541-a941-7c089f798153 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011347 Oct 12 21:52:22.254924 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Wed Oct 12 21:52:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 21:57:41.180214 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-34f11da5-a3b9-4df9-a8fa-99e70ec6d452 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:57:41.181219 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-34f11da5-a3b9-4df9-a8fa-99e70ec6d452 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 12 21:57:41.181646 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 12 21:57:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:57:41.324899 n-d-861111-1 devstack@n-api.service[104443]: DEBUG dbcounter [-] [104443] Writing DB stats nova_api:SELECT=6 {{(pid=104443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:57:41.466621 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-ecf044ab-7d0f-40a4-b410-391ce01671ba admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:57:41.471227 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-ecf044ab-7d0f-40a4-b410-391ce01671ba admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:57:41.471723 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-ecf044ab-7d0f-40a4-b410-391ce01671ba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:57:41.472140 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-ecf044ab-7d0f-40a4-b410-391ce01671ba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:57:41.472835 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-ecf044ab-7d0f-40a4-b410-391ce01671ba admin admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:57:41.473270 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-ecf044ab-7d0f-40a4-b410-391ce01671ba admin admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:57:41.473682 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-ecf044ab-7d0f-40a4-b410-391ce01671ba admin admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:57:41.512062 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-ecf044ab-7d0f-40a4-b410-391ce01671ba admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.188432 Oct 12 21:57:41.512613 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 12 21:57:41 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 21:57:42.598104 n-d-861111-1 devstack@n-api.service[104442]: DEBUG nova.api.openstack.wsgi [None req-34f11da5-a3b9-4df9-a8fa-99e70ec6d452 admin admin] Calling method '>' {{(pid=104442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:57:42.599101 n-d-861111-1 devstack@n-api.service[104442]: INFO nova.api.openstack.requestlog [None req-34f11da5-a3b9-4df9-a8fa-99e70ec6d452 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 12 21:57:42.599533 n-d-861111-1 devstack@n-api.service[104442]: [pid: 104442|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 12 21:57:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:57:42.790844 n-d-861111-1 devstack@n-api.service[104443]: DEBUG nova.api.openstack.wsgi [None req-4dd0c30b-de12-4b7d-9d0c-85df01a97f16 admin admin] Calling method '>' {{(pid=104443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:57:42.794281 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-4dd0c30b-de12-4b7d-9d0c-85df01a97f16 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:57:42.794756 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-4dd0c30b-de12-4b7d-9d0c-85df01a97f16 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:57:42.795190 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-4dd0c30b-de12-4b7d-9d0c-85df01a97f16 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:57:42.795929 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-4dd0c30b-de12-4b7d-9d0c-85df01a97f16 admin admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:57:42.796374 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-4dd0c30b-de12-4b7d-9d0c-85df01a97f16 admin admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:57:42.796817 n-d-861111-1 devstack@n-api.service[104443]: DEBUG oslo_concurrency.lockutils [None req-4dd0c30b-de12-4b7d-9d0c-85df01a97f16 admin admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:57:42.819414 n-d-861111-1 devstack@n-api.service[104443]: INFO nova.api.openstack.requestlog [None req-4dd0c30b-de12-4b7d-9d0c-85df01a97f16 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.080864 Oct 12 21:57:42.819905 n-d-861111-1 devstack@n-api.service[104443]: [pid: 104443|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 12 21:57:42 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 21:58:27.378650 n-d-861111-1 devstack@n-api.service[104441]: Wed Oct 12 21:58:27 2022 - graceful shutdown triggered... Oct 12 21:58:27.379172 n-d-861111-1 devstack@n-api.service[104442]: Gracefully killing worker 1 (pid: 104442)... Oct 12 21:58:27.379409 n-d-861111-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 12 21:58:27.380098 n-d-861111-1 devstack@n-api.service[104443]: Gracefully killing worker 2 (pid: 104443)... Oct 12 21:58:27.505434 n-d-861111-1 devstack@n-api.service[104442]: DEBUG dbcounter [-] [104442] Writing DB stats nova_api:SELECT=4 {{(pid=104442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:58:28.379352 n-d-861111-1 devstack@n-api.service[104441]: worker 1 buried after 1 seconds Oct 12 21:58:28.379898 n-d-861111-1 devstack@n-api.service[104441]: worker 2 buried after 1 seconds Oct 12 21:58:28.379898 n-d-861111-1 devstack@n-api.service[104441]: goodbye to uWSGI. Oct 12 21:58:28.380965 n-d-861111-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 12 21:58:28.381522 n-d-861111-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 12 21:58:28.384290 n-d-861111-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 12 21:58:28.400781 n-d-861111-1 devstack@n-api.service[120437]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 12 21:58:28.414554 n-d-861111-1 devstack@n-api.service[120437]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 12 21:58:28 2022] *** Oct 12 21:58:28.414554 n-d-861111-1 devstack@n-api.service[120437]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 21:58:28.414554 n-d-861111-1 devstack@n-api.service[120437]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 21:58:28.414554 n-d-861111-1 devstack@n-api.service[120437]: nodename: n-d-861111-1 Oct 12 21:58:28.414554 n-d-861111-1 devstack@n-api.service[120437]: machine: x86_64 Oct 12 21:58:28.414554 n-d-861111-1 devstack@n-api.service[120437]: clock source: unix Oct 12 21:58:28.414554 n-d-861111-1 devstack@n-api.service[120437]: pcre jit disabled Oct 12 21:58:28.414554 n-d-861111-1 devstack@n-api.service[120437]: detected number of CPU cores: 4 Oct 12 21:58:28.414554 n-d-861111-1 devstack@n-api.service[120437]: current working directory: / Oct 12 21:58:28.414554 n-d-861111-1 devstack@n-api.service[120437]: detected binary path: /usr/bin/uwsgi-core Oct 12 21:58:28.415327 n-d-861111-1 devstack@n-api.service[120437]: your processes number limit is 47680 Oct 12 21:58:28.415327 n-d-861111-1 devstack@n-api.service[120437]: your memory page size is 4096 bytes Oct 12 21:58:28.415327 n-d-861111-1 devstack@n-api.service[120437]: detected max file descriptor number: 2048 Oct 12 21:58:28.415327 n-d-861111-1 devstack@n-api.service[120437]: lock engine: pthread robust mutexes Oct 12 21:58:28.415327 n-d-861111-1 devstack@n-api.service[120437]: thunder lock: enabled Oct 12 21:58:28.415327 n-d-861111-1 devstack@n-api.service[120437]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 12 21:58:28.415327 n-d-861111-1 devstack@n-api.service[120437]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 12 21:58:28.455806 n-d-861111-1 devstack@n-api.service[120437]: Python main interpreter initialized at 0x555fc18b59c0 Oct 12 21:58:28.455806 n-d-861111-1 devstack@n-api.service[120437]: python threads support enabled Oct 12 21:58:28.455806 n-d-861111-1 devstack@n-api.service[120437]: your server socket listen backlog is limited to 100 connections Oct 12 21:58:28.455806 n-d-861111-1 devstack@n-api.service[120437]: your mercy for graceful operations on workers is 90 seconds Oct 12 21:58:28.456272 n-d-861111-1 devstack@n-api.service[120437]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 21:58:28.456272 n-d-861111-1 devstack@n-api.service[120437]: *** Operational MODE: preforking *** Oct 12 21:58:28.456506 n-d-861111-1 devstack@n-api.service[120437]: *** uWSGI is running in multiple interpreter mode *** Oct 12 21:58:28.456506 n-d-861111-1 devstack@n-api.service[120437]: spawned uWSGI master process (pid: 120437) Oct 12 21:58:28.456717 n-d-861111-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 12 21:58:28.458502 n-d-861111-1 devstack@n-api.service[120437]: spawned uWSGI worker 1 (pid: 120452, cores: 1) Oct 12 21:58:28.458502 n-d-861111-1 devstack@n-api.service[120437]: spawned uWSGI worker 2 (pid: 120453, cores: 1) Oct 12 21:58:28.459099 n-d-861111-1 devstack@n-api.service[120437]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 21:58:29.116083 n-d-861111-1 devstack@n-api.service[120452]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 21:58:29.126218 n-d-861111-1 devstack@n-api.service[120453]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 21:58:30.282241 n-d-861111-1 devstack@n-api.service[120452]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 21:58:30.282241 n-d-861111-1 devstack@n-api.service[120452]: from cryptography.utils import int_from_bytes Oct 12 21:58:30.282904 n-d-861111-1 devstack@n-api.service[120452]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 21:58:30.282904 n-d-861111-1 devstack@n-api.service[120452]: from cryptography.utils import int_from_bytes Oct 12 21:58:30.283568 n-d-861111-1 devstack@n-api.service[120453]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 21:58:30.283568 n-d-861111-1 devstack@n-api.service[120453]: from cryptography.utils import int_from_bytes Oct 12 21:58:30.284011 n-d-861111-1 devstack@n-api.service[120453]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 21:58:30.284011 n-d-861111-1 devstack@n-api.service[120453]: from cryptography.utils import int_from_bytes Oct 12 21:58:32.685687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 21:58:32.686229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 21:58:32.686475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 21:58:32.686788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 21:58:32.687171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 21:58:32.687284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 21:58:32.687396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 21:58:32.687471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.687661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 21:58:32.687821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.687969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 21:58:32.688124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.688228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 21:58:32.688421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.688592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.688749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.688927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.689033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.689258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.689359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.689584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.689692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.689917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.690023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.690210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.690311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.690523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.690621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.690848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.691012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-861111-1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.691178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.691368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.691463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.691639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.691756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.692178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.692348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-861111-1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.692501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.692651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.692923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.693082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.693207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.693337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.693559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.693662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.693874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.694924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.695070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.695267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.695447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.695594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.695855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.696007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.696280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.696280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.696604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.696777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.696945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.697066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.697202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.697529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.698353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.698524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.698739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.698933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.699066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.699194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-861111-1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.699387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.699534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.699534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.699839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.700024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.700183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.700334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.700499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.700647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.700790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-861111-1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.700943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.701117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.702057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.702268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.702856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.703015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.703667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.703667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.703887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.703985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.704078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.704588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.704708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.704797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.704881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.704970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.705062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.705146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.705240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.705325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.705418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.705502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.705584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.705666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.705757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.705852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.705942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.706031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.706124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.706216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.706305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.706395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.706485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.706578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.706662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.706752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.706838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.706929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.706929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.707097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.707097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.707332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.707421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.707517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.707610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.707742 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.707846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.707932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.708022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.708107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.708189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.708279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.708373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.708511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.708639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.708727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.708835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.708980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.709083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.709177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.709296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.709382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.709564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.709666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.709760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.709851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.709935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.710018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.710107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.710204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.710288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.710371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.710453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.710592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.710760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.710866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.711077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.711211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.711415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.711554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.711731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.711826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.712056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.712201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.712403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.712494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.712709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.712967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.713263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.713386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.713386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.713541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.713966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.714066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.714238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.714382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.714528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.714737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.714976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.715098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.715284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.715407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.715603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.715710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.715922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.716023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.716231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.716334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.716539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.716663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.716847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.716956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.717146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.717240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.717454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.717580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.717762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.717872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.718066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.718201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.718373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.718489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.718750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.718855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.718982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.719074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.719304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.719411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.719613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.719776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.719920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.720026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.720223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.720330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.720533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.720624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.720845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.720943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.721150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.721255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.721457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.721549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.721762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.721909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.722068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.722168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.722377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.722478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.722683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.722794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.722993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.723137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.723335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.723439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.723637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.723743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.723942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.724051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.724248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.724365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.724560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.724697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.724869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.724963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.725177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.725267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.725477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.725577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.725790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.725883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.726097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.726190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.726405 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.726505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.726712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.726814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.727017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.727122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.727347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.727482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.727655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.727791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.728000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.728136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.728268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.728369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.728570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.728672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.728872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.728968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.729192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.729286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.729512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.729605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.729820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.729909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.730123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.730229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.730428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.730519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.730734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.730827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.731040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.731156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.731383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.731492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.731712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.731815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.732027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.732124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.732340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.732441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.732652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.732758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.732977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 21:58:32.733127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.733286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.733421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.733600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.733702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.733924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.734024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.734234 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.734341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.734543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.734644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.734852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.734953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.735171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.735310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.735517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.735619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.735850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.735943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.736165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.736266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.736479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.736587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.736792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.736884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.737101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.737201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.737422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.737522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.737747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.737841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.738068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.738247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.738403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.738566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.738714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.738881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.739053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.739192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.739352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.739443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.739635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.739739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.739967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.740074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.740291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.740395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.740604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.740762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.740930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.741022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.741254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.741354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.741566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.741667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.741879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.741999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.742200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.742311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.742510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.742609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.742824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.742921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.743188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.743314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.743559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.743656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.743747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.743841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.744062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.744700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.744913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.745015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.745251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.745356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.745570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.745669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.745887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.745977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.746200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.746298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.746514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.746604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.746831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.746920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.747146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.747291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.747497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.747614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.747819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.747926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.748094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.748182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.748401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.748496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.748706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.748809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.749023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.749162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.749318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.749419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.749640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.749732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.749953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.750045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.750262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.750358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.750568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.750658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.750878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.750985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.751186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.751295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.751521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.751633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.751832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.751931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.752138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.752249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.752454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.752569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.752761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.752852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.753067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.753166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.753379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.753481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.753689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.753800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.753989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.754089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.754300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.754405 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.754606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.754731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.754912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.755032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.755223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.755374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.755562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.755680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.755879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.755995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.756191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.756309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.756499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.756615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.756821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.756952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.757131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.757253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.757442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.757566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.757756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.757890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.758096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.758215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.758378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.758504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.758692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.758825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.759021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.759138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.759377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.759515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.759739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.760916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.761056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.761193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.761322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.761460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.761631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.761771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.761771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.762014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.762150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.762289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.762388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.762498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.762592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.762677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.762759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.762841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.763011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.763153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.763298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.763448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.763625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.763772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.764002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.764128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.764240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.764363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.764517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.764643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.764822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.764982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.765392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.765518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.765638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.765748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.765871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.765982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.766091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.766206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.766386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.766521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.766702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.766828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.767012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.767128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.767348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.767494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.767662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.767793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.767974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.768125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.768334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.768508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.768647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.768777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.768905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.769032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.769167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.769310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.769490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.769623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.769799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.769932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.770121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.770265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.770911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.771077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.771168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.771321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.771412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.771508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.771599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.771732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.771821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.771919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.772005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.772087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.772294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.772386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.772615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.772725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.772946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.773057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.773248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.773411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.773561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.773684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.773871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.773987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.774181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.774276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.774490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.774590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.774808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.774899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.775118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.775273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.775486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.775580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.775801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.775894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.776124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.776216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.776431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.776560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.776749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.776841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.777050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.777150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.777362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.777456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.777685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.777782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.778001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.778093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.778380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.778485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.778620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.778713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.778938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.779041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.779273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.779381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.779576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.779668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.779887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.780022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.780194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.780301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.780503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.780606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.780800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.780960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.781112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.781204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.781420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.781512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.781730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.781831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.782033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.782134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.782341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.782439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.782647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.782738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.782948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.783102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.783287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.783397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.783582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.783676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.783895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.783986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.784205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.784296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.784523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.784621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.784833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.784923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.785134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.785231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.785436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.785528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.785747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.785836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.786060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.786156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.786363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.786453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.786667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.786758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.786969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.787069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.787315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.787408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.787626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.787732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.787929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.788032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.788242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.788340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.788546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.788637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.788854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.788959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.789164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.789255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.789468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.789559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.789775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.789867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.790086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.790181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.790393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.790485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.790702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.790807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.791035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.791137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.791414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.791519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.791731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.791832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.792040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.792130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.792361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.792450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.792668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.792772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.792979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.793069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.793290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.793380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.793595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.793729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.793906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.793999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.794219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.794318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.794547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.794799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.794891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.795136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.795264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.795480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.795573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.795785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.795874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.796099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.796211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.796421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.796521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.796761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.797009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.797103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.797353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.797452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.797678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.797777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.797987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.798133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.798292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.798391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.798595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.798697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.798903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.798995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.799207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.799403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.799536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.799637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.799838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.799931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.800148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.800262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.800448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.800547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.800752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.800879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.801054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.801174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.801359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.801467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.801670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.801774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.801972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.802103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.802284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.802387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.802588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.802689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.802895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.802998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.803201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.803325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.803549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.803648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.803836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.803938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.804137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.804244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.804441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.804535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.804753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.804872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.805085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.805177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.805398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.805511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.805694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.805789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.805999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.806100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.806305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.806477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.807157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.807310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.807489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.807597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.807842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.807965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.808096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.808204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.808403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.808496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.808711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.808888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.809035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.809187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.809329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.809473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.809603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.809698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.809914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.810085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.810263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.810401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.810559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.810710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.810852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.811001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.811152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.811315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.811465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.811559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.811730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.811825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.812033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.812129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.812335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.812430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.812643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.812744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.812949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.813059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.813250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.813344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.813555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.813656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.813855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.814055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.814145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.814229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.814449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.814551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.814749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.814850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.815052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.815153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.815377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.815471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.815689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.815793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.815990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.816093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.816305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.816395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.816612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.816713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.816914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.817015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.817216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.817310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.817522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.817615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.817823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.817916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.818124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.818231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.818430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.818531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.818759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.818900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.819054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.819148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.819384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.819480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.819691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.819783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.819994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.820100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.820332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.820447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.820591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.820684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.820897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.821038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.821199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.821328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.821499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.821600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.821800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.821906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.822102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.822222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.822963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.823064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.823291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.823441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.823607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.823701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.823915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.824046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.824221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.824314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.824523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.824622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.824828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.824931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.825156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.825252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.825451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.825553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.825764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.825865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.826071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.826165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.826379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.826478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.826686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.826778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.826996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.827087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.827330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.827425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.827635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.827738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.827951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.828045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.828260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.828360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.828571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.828673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.828872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.829019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.829175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.829275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.829493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.829595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.829803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.829903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.830113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.830212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.830441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.830632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.830801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.830890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.831030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.831168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.831359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.831456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.831667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.831760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.831979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.832079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.832286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.832380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.832595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.832697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.832906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.833012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.833218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.833314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.833522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.833614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.833832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.833933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.834143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.834237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.834452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.834544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.834758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.834861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.835068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.835162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.835402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.835507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.835713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.835818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.836027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.836119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.836336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.836435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.836641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.836743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.836948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.837085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.837251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.837348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.837580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.837679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.837877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.837974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.838202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.838293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.838516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.838865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.839078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.839179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.839427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.839539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.839724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.839817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.840040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.840140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.840350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.840465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.840677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.840790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.840979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.841073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.841382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.841483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.841691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.841788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.841999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.842090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.842310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.842410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.842612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.842704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.842917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.843024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.843227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.843358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.843578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.843679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.843883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.843984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.844188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.844298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.844490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.844584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.844810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.844909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.845114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.845209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.845434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.845527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.845772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.845863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.846080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.846180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.846388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.846482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.846695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.846844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.847021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.847154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.847355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.847490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.847683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.847813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.848105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.848198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.848425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.848527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.848734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.848835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.849047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.849187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.849355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.849459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.849680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.849773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.850003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.850097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.850316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.850423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.850634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.850749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.850941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.851047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.851278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.851390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.851606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.851700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.851922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.852028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.852247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.852349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.852562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.852656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.852883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.852977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.853195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.853289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.854035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.854148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.854364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.854469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.854686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.854789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.854987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.855080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.855382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.855520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.855694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.855832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.855999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.856092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.856325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.856419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.856631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.856733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.856943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.857036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.857254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.857361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.857562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.857656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.857866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.857967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.858169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.858272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.858488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.858581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.858791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.858892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.859105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.859207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.859439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.859543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.859750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.859842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.860059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.860166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.860360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.860497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.860681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.860820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.861027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.861174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.861296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.861416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.861572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.861676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.861874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.861978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.862213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.862314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.862514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.862608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.862832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.862933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.863143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.863293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.863475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.863569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.863783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.863878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.864091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.864185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.864430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.864534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.864734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.864826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.865041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.865134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.865358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.865461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.865683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.865776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.865988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.866097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.866298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.866394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.866607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.866708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.866911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.867012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.867212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.867478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.867572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.867659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.867836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.867930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.868138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.868239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.868440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.868534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.868742 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.868837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.869077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.869200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.869420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.869561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.869728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.869823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.870040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.870143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.870344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.870444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.870647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.870755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.870948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.871073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.871289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.871414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.871597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.871753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.871924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.872040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.872228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.872330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.872531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.872642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.872837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.872955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.873142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.873241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.873455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.873573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.873769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.873871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.874082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.874182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.874399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.874579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.874737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.874887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.875037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.875194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.875362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.875505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.875644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.875787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.875932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.876097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.876273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.876466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.876618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.876795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.876940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.877109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.877274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.877421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.877560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.877707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.877850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.877996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.878149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.878296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.878609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.878757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.878901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.879067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.879275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.879396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.879529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.879624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.879856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.879959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.880236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.880366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.880506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.880627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.880823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.880928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.881142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.881242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.881456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.881561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.881771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.881865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.882085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.882189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.882411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.882504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.882740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.882836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.883044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.883145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.883391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.883506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.883710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.883818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.884023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.884138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.884335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.884438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.884651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.885359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.885531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.885671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.885821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.885970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.886112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.886251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.886394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.886544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.886693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.886835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.886976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.887116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.887317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.887415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.887653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.887747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.887970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.888064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.888284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.888387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.888596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.888700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.888908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.889000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.889221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.889429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.889548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.889750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.889887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.890084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.890211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.890412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.890514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.890737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.890886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.891056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.891151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.891399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.891673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.891779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.892000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.892115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.892310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.892412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.892621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.892724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.892931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.893033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.893238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.893348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.893559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.893674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.893871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.893973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.894176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.894278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.894493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.894602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.894797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.894897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.895109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.895361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.895475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.895710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.895816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.896025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.896120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.896346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.896437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.896670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.896772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.896983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.897079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.897287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.897518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.897612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.897866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.897973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.898189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.898283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.898502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.898594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.898814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.898919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.899119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.899221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.899451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.899546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.899762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.899865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.900068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.900167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.900423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.900521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.900745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.900845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.901052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.901164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.901359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.901493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.901669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.901775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.901971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.902087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.902278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.902393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.902581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.902673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.902883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.902982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.903187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.903332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.903518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.903650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.903821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.903915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.904127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.904232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.904427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.904521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.904738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.904845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.905049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.905169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.905354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.905448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.905660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.905764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.905967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.906070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.906280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.906375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.906586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.906686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.906943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.907087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.907287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.907404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.907587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.907682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.907896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.907991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.908218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.908311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.908528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.908620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.908838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.908940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.909142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.909234 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.909451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.909577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.909771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.910005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.910117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.910337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.910430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.910656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.910765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.910989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.911155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.911344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.911447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.911641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.911739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.911946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.912186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.912301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.912525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.912632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.912852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.912946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.913159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.913250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.913471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.913566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.913781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.913875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.914090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.914221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.914398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.914494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.914704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.914804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.915013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.915128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.915345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.915452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.915652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.915754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.916480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.916598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.916801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.916914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.917106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.917199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.917414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.917516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.917723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.917823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.918038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.918139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.918357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.918459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.918671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.918773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.918983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.919077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.919316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.919431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.919628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.919721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.920007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.920115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.920247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.920344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.920556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.920649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.920870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.920965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.921198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.921294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.921511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.921604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.921814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.921907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.922125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.922224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.922440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.922545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.922755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.922858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.923076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.923178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.923440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.923546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.923759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.923862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.924068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.924160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.924376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.924490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.924695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.924797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.925004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.925120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.925332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.925492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.925669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.925765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.925997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.926100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.926318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.926412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.926622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.926718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.926932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.927053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.927263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.927369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.927563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.927663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.927878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.927972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.928187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.928290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.928488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.928591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.928789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.928884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.929095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.929202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.929397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.929497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.929699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.929800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.930001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.930122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.930305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.930411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.930606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.930701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.930907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.931010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.931349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.931471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.931658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.931796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.931906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.931995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.932163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.932294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.932465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.932600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.932770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.932865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.933070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.933171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.933376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.933478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.933677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.933772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.933977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.934070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.934278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.934370 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.934585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.934679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.934896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.934989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.935200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.935344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.935530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.935624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.935836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.935939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.936141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.936247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.936446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.936548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.936771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.936870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.937092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.937213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.937406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.937516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.937714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.937823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.938029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.938135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.938345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.938439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.938658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.938753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.938969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.939064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.939297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.939396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.939607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.939711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.939916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.940011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.940241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.940356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.940557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.940668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.940859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.940961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.941177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.941269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.941492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.941602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.941806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.941902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.942119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.942213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.942427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.942535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.942757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.942860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.943064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.943156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.943395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.943503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.943703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.943805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.944012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.944105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.944323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.944425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.944637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.944731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.944947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.945049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.945256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.945358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.945568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.945699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.945879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.945973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.946189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.946289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.946503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.946603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.946814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.946915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.947129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.947801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.947991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.948098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.948320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.948428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.948634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.948733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.948963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.949053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.949291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.949391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.949604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.949701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.949915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.950004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.950219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.950320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.950469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 21:58:32.950571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.950884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.951230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.951585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.951905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.952220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.952531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 21:58:32.952774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 21:58:33.012646 n-d-861111-1 devstack@n-api.service[120452]: INFO dbcounter [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] Registered counter for database nova_api Oct 12 21:58:33.015394 n-d-861111-1 devstack@n-api.service[120453]: INFO dbcounter [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] Registered counter for database nova_api Oct 12 21:58:33.034227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_db.sqlalchemy.engines [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 21:58:33.035841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_db.sqlalchemy.engines [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 21:58:33.040794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writer thread running {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 21:58:33.042966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writer thread running {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 21:58:33.098771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.context [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2bc00301-6462-4874-9c83-c889d0ff6a49(cell1) {{(pid=120452) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 21:58:33.099968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.context [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2bc00301-6462-4874-9c83-c889d0ff6a49(cell1) {{(pid=120453) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 21:58:33.102811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:58:33.103331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:58:33.105340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:58:33.105340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:58:33.105531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:58:33.105791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:58:33.106199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:58:33.106303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:58:33.106940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:58:33.107430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:58:33.108367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:58:33.109452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:58:33.110408 n-d-861111-1 devstack@n-api.service[120452]: INFO dbcounter [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] Registered counter for database nova_cell0 Oct 12 21:58:33.111519 n-d-861111-1 devstack@n-api.service[120453]: INFO dbcounter [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] Registered counter for database nova_cell0 Oct 12 21:58:33.114661 n-d-861111-1 devstack@n-api.service[120452]: INFO dbcounter [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] Registered counter for database nova_cell1 Oct 12 21:58:33.115568 n-d-861111-1 devstack@n-api.service[120453]: INFO dbcounter [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] Registered counter for database nova_cell1 Oct 12 21:58:33.124113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_db.sqlalchemy.engines [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 21:58:33.125630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_db.sqlalchemy.engines [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 21:58:33.127807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_db.sqlalchemy.engines [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 21:58:33.130424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_db.sqlalchemy.engines [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 21:58:33.131485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writer thread running {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 21:58:33.135995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writer thread running {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 21:58:33.138506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writer thread running {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 21:58:33.276212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writer thread running {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 21:58:33.284690 n-d-861111-1 devstack@n-api.service[120453]: INFO dbcounter [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] Registered counter for database nova_cell0 Oct 12 21:58:33.285370 n-d-861111-1 devstack@n-api.service[120452]: INFO dbcounter [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] Registered counter for database nova_cell0 Oct 12 21:58:33.291771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_db.sqlalchemy.engines [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 21:58:33.293845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_db.sqlalchemy.engines [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 21:58:33.296763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writer thread running {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 21:58:33.299699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writer thread running {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 21:58:33.617889 n-d-861111-1 devstack@n-api.service[120453]: WARNING keystonemiddleware.auth_token [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 21:58:33.622079 n-d-861111-1 devstack@n-api.service[120452]: WARNING keystonemiddleware.auth_token [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 21:58:33.624922 n-d-861111-1 devstack@n-api.service[120453]: WARNING keystonemiddleware.auth_token [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 21:58:33.629323 n-d-861111-1 devstack@n-api.service[120452]: WARNING keystonemiddleware.auth_token [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 21:58:33.966550 n-d-861111-1 devstack@n-api.service[120453]: WARNING keystonemiddleware.auth_token [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 21:58:33.969674 n-d-861111-1 devstack@n-api.service[120452]: WARNING keystonemiddleware.auth_token [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 21:58:33.972456 n-d-861111-1 devstack@n-api.service[120453]: WARNING keystonemiddleware.auth_token [None req-3699d00d-d507-4114-861b-73d50b1a9858 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 21:58:33.975662 n-d-861111-1 devstack@n-api.service[120452]: WARNING keystonemiddleware.auth_token [None req-f2f6c887-2d22-4f59-88c3-6d1b1c9652bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 21:58:33.977760 n-d-861111-1 devstack@n-api.service[120453]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555fc18b59c0 pid: 120453 (default app) Oct 12 21:58:33.980970 n-d-861111-1 devstack@n-api.service[120452]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555fc18b59c0 pid: 120452 (default app) Oct 12 21:59:13.145629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:13.146748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:13.147553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:13.148330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:14.600870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d85092f2-68a2-4dc9-984c-f01ffbc0aa5d tempest-FlavorsV261TestJSON-1226020355 tempest-FlavorsV261TestJSON-1226020355-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-293870880", "id": 1921213966, "os-flavor-access:is_public": "True"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:14.679677 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d85092f2-68a2-4dc9-984c-f01ffbc0aa5d tempest-FlavorsV261TestJSON-1226020355 tempest-FlavorsV261TestJSON-1226020355-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 1.543005 Oct 12 21:59:14.688503 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1/1] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 21:59:13 2022] POST /compute/v2.1/flavors => generated 467 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:59:14.714405 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:14.717472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:14.718497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:14.719457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:15.265179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1152685992", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:16.369903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] validate_networks() for None {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 21:59:16.506180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-51a4e20b-d9f9-4c72-b325-2f724cb3f4de tempest-FlavorsV261TestJSON-2136682380 tempest-FlavorsV261TestJSON-2136682380-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:16.544360 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-51a4e20b-d9f9-4c72-b325-2f724cb3f4de tempest-FlavorsV261TestJSON-2136682380 tempest-FlavorsV261TestJSON-2136682380-project] 10.222.0.16 "GET /compute/v2.1/flavors/1921213966" status: 200 len: 467 microversion: 2.61 time: 1.852285 Oct 12 21:59:16.545583 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1/2] 10.222.0.16 () {60 vars in 1199 bytes} [Wed Oct 12 21:59:14 2022] GET /compute/v2.1/flavors/1921213966 => generated 467 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:59:16.952491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e1f6afd9-9bc2-4454-86d5-a6fc899cff52 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:16.969154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f6afd9-9bc2-4454-86d5-a6fc899cff52 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:16.969651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f6afd9-9bc2-4454-86d5-a6fc899cff52 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:16.974122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f6afd9-9bc2-4454-86d5-a6fc899cff52 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:16.978930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f6afd9-9bc2-4454-86d5-a6fc899cff52 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:16.983620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f6afd9-9bc2-4454-86d5-a6fc899cff52 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:16.984110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f6afd9-9bc2-4454-86d5-a6fc899cff52 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:17.065841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 21:59:17.066387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 21:59:17.066973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 21:59:17.067978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 21:59:17.068557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 21:59:17.105931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:17.109296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:17.110172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:17.113306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:17.114405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:17.115292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:17.119538 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e1f6afd9-9bc2-4454-86d5-a6fc899cff52 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.567116 Oct 12 21:59:17.120179 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 12 21:59:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:17.222383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Getting quotas for project 62279514893442c3993a79dab7c2cbb3. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 21:59:17.238143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Getting quotas for user 6696c1546f834f638bc626413360a81f and project 62279514893442c3993a79dab7c2cbb3. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 21:59:17.267004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 21:59:17.276692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 21:59:17.420956 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2f557a99-aa7c-4463-973e-3f177cd75946 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.643791 Oct 12 21:59:17.430773 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2/4] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 21:59:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 21:59:17.586206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-368e215f-633f-4c57-8ca6-7fbfa7f6f84a tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1589395187", "ram": 512, "vcpus": 1, "disk": 10, "id": 1298719648, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:17.693015 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-368e215f-633f-4c57-8ca6-7fbfa7f6f84a tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.571768 Oct 12 21:59:17.694173 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3/5] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 21:59:17 2022] POST /compute/v2.1/flavors => generated 416 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:17.871715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-86f68b58-edba-4160-b26d-3381d28e8255 tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Calling method '.version_select at 0x7f5129a92670>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:17.873732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-86f68b58-edba-4160-b26d-3381d28e8255 tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'd851f5266ee44270b579068cb86756f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44fda09670b447ea3c2b6e062350c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-86f68b58-edba-4160-b26d-3381d28e8255 tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Request method failure captured: Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRziwxCc_uffGUrHVpBYXiXXQsWSK06vA49pD8-Eh0hRlkRLh1AufJHQdCit5rv-ZO9JuQ-XHGrdUvZXRJ394DpazD6Vts3Sr45BsxDAJ4Hq2FsbbTp8-I6jODAMoe5DkLVX87KNFUzgLbvUmrILrUlB7cimDkf5AahUP98r1kBAa8wE Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: f44fda09670b447ea3c2b6e062350c4b Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1134263190 Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 21:59:17.881982 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 21:59:17.883374 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f44fda09670b447ea3c2b6e062350c4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f44fda09670b447ea3c2b6e062350c4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f44fda09670b447ea3c2b6e062350c4b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f44fda09670b447ea3c2b6e062350c4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:17.883374 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1134263190 Oct 12 21:59:17.883374 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: f44fda09670b447ea3c2b6e062350c4b Oct 12 21:59:17.883374 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1134263190 Oct 12 21:59:17.883374 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-HypervisorAdminNegativeTestJSON-1134263190-project Oct 12 21:59:17.883374 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:17.883374 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:17.883374 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: d851f5266ee44270b579068cb86756f0 Oct 12 21:59:17.883374 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1134263190-project Oct 12 21:59:17.883374 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 21:59:17.883374 n-d-861111-1 devstack@n-api.service[120453]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 12 21:59:17.883374 n-d-861111-1 devstack@n-api.service[120453]: action_args: {} Oct 12 21:59:17.883374 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:17.884207 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 12 21:59:17.885258 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:17.886489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-86f68b58-edba-4160-b26d-3381d28e8255 tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:17.889136 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-86f68b58-edba-4160-b26d-3381d28e8255 tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.455876 Oct 12 21:59:17.889818 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3/6] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 12 21:59:17 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 458 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:17.901777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e67a9824-3461-449d-979d-ac3c404790d7 tempest-FlavorsV261TestJSON-1226020355 tempest-FlavorsV261TestJSON-1226020355-project-admin] Action: 'update', calling method: .version_select at 0x7f512a03bb80>, body: {"flavor": {"description": "new"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:18.007384 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e67a9824-3461-449d-979d-ac3c404790d7 tempest-FlavorsV261TestJSON-1226020355 tempest-FlavorsV261TestJSON-1226020355-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1921213966" status: 200 len: 468 microversion: 2.61 time: 0.114318 Oct 12 21:59:18.008007 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4/7] 10.222.0.16 () {62 vars in 1219 bytes} [Wed Oct 12 21:59:17 2022] PUT /compute/v2.1/flavors/1921213966 => generated 468 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:59:18.018046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-40993773-2d8d-4f74-be66-b92d27bf0b4b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '.version_select at 0x7f5129b29160>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:18.022816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6b4adb80-000e-4510-9bb6-dcc0fd39da38 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-483629482"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:18.030666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-40993773-2d8d-4f74-be66-b92d27bf0b4b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2bc00301-6462-4874-9c83-c889d0ff6a49(cell1) {{(pid=120452) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 12 21:59:18.030861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.aggregate [None req-6b4adb80-000e-4510-9bb6-dcc0fd39da38 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Generated uuid 7aa895b5-d067-4a45-9ae4-ba3a4a568a99 for aggregate {{(pid=120453) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 21:59:18.033552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40993773-2d8d-4f74-be66-b92d27bf0b4b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:18.035099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40993773-2d8d-4f74-be66-b92d27bf0b4b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:18.036618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40993773-2d8d-4f74-be66-b92d27bf0b4b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:18.113488 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6b4adb80-000e-4510-9bb6-dcc0fd39da38 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.102213 Oct 12 21:59:18.116999 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 5/8] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 21:59:18 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:18.134038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0e4a8e94-7387-4b77-a3c3-0f866f4d7eb8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:18.135051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0e4a8e94-7387-4b77-a3c3-0f866f4d7eb8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:18.142786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40993773-2d8d-4f74-be66-b92d27bf0b4b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:18.143810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40993773-2d8d-4f74-be66-b92d27bf0b4b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:18.148867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40993773-2d8d-4f74-be66-b92d27bf0b4b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:18.195337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40993773-2d8d-4f74-be66-b92d27bf0b4b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:18.195758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40993773-2d8d-4f74-be66-b92d27bf0b4b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:18.196458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40993773-2d8d-4f74-be66-b92d27bf0b4b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:18.216472 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-40993773-2d8d-4f74-be66-b92d27bf0b4b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.520468 Oct 12 21:59:18.218247 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 4/9] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 12 21:59:17 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:18.310252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0e4a8e94-7387-4b77-a3c3-0f866f4d7eb8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:18.350573 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0e4a8e94-7387-4b77-a3c3-0f866f4d7eb8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1220 microversion: 2.1 time: 0.229336 Oct 12 21:59:18.363270 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 6/10] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:18 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1220 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:18.367874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-abb86b7f-bfe7-4e35-b5ca-94e3abbf2119 tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Calling method '.version_select at 0x7f51291bdaf0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:18.375621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-abb86b7f-bfe7-4e35-b5ca-94e3abbf2119 tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'd851f5266ee44270b579068cb86756f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44fda09670b447ea3c2b6e062350c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-abb86b7f-bfe7-4e35-b5ca-94e3abbf2119 tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Request method failure captured: Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRziwxCc_uffGUrHVpBYXiXXQsWSK06vA49pD8-Eh0hRlkRLh1AufJHQdCit5rv-ZO9JuQ-XHGrdUvZXRJ394DpazD6Vts3Sr45BsxDAJ4Hq2FsbbTp8-I6jODAMoe5DkLVX87KNFUzgLbvUmrILrUlB7cimDkf5AahUP98r1kBAa8wE Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: f44fda09670b447ea3c2b6e062350c4b Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1134263190 Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 21:59:18.380178 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 21:59:18.381481 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f44fda09670b447ea3c2b6e062350c4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f44fda09670b447ea3c2b6e062350c4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f44fda09670b447ea3c2b6e062350c4b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f44fda09670b447ea3c2b6e062350c4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:18.381481 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1134263190 Oct 12 21:59:18.381481 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: f44fda09670b447ea3c2b6e062350c4b Oct 12 21:59:18.381481 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1134263190 Oct 12 21:59:18.381481 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-HypervisorAdminNegativeTestJSON-1134263190-project Oct 12 21:59:18.381481 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:18.381481 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:18.381481 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: d851f5266ee44270b579068cb86756f0 Oct 12 21:59:18.381481 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1134263190-project Oct 12 21:59:18.381481 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 21:59:18.381481 n-d-861111-1 devstack@n-api.service[120453]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 12 21:59:18.381481 n-d-861111-1 devstack@n-api.service[120453]: action_args: {} Oct 12 21:59:18.381481 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:18.382230 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 12 21:59:18.384553 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:18.388761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-abb86b7f-bfe7-4e35-b5ca-94e3abbf2119 tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:18.391009 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-abb86b7f-bfe7-4e35-b5ca-94e3abbf2119 tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.034012 Oct 12 21:59:18.393520 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 7/11] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 21:59:18 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:18.411459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-541b2d4a-d43b-45f8-990d-0735013bc809 tempest-FlavorsV261TestJSON-2136682380 tempest-FlavorsV261TestJSON-2136682380-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:18.525461 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-541b2d4a-d43b-45f8-990d-0735013bc809 tempest-FlavorsV261TestJSON-2136682380 tempest-FlavorsV261TestJSON-2136682380-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6695 microversion: 2.61 time: 0.128168 Oct 12 21:59:18.530645 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 8/12] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 12 21:59:18 2022] GET /compute/v2.1/flavors/detail => generated 6695 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 21:59:18.535440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b45d0816-289d-4efd-a158-909993ad5b36 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861111-1"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:18.600251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b45d0816-289d-4efd-a158-909993ad5b36 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:18.602303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b45d0816-289d-4efd-a158-909993ad5b36 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:18.607010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b45d0816-289d-4efd-a158-909993ad5b36 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:18.658782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-63398664-a5cc-4ca4-8e31-0ab76f7428bd tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:18.677511 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-63398664-a5cc-4ca4-8e31-0ab76f7428bd tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] HTTP exception thrown: Flavor 1298719648 has no extra specs with key hw:cpu_thread_policy. Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-63398664-a5cc-4ca4-8e31-0ab76f7428bd tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] Request method failure captured: Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/flavors/1298719648/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRziwk8w_9hHqR2O1HR-ZFZlDxz4NxZBGdfNG309sq5cuz2sa0LRFJ7XpNx_CO7V2psJKUJYrhOcafx8uT_qcAqV35vNDoaHqmu_g3q4dpKYNoXxlxjB79iAoDMDJELFNKkIJ2R_ftRidyyL1b8g8bonxUWgL3n7exWaZYKhp8ukSM8o Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: fdc1572aef31416a9535ad48a3a1582b Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 21:59:18.685557 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 21:59:18.686729 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdc1572aef31416a9535ad48a3a1582b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdc1572aef31416a9535ad48a3a1582b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdc1572aef31416a9535ad48a3a1582b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdc1572aef31416a9535ad48a3a1582b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:18.686729 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 Oct 12 21:59:18.686729 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: fdc1572aef31416a9535ad48a3a1582b Oct 12 21:59:18.686729 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 Oct 12 21:59:18.686729 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project Oct 12 21:59:18.686729 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 21:59:18.686729 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 21:59:18.686729 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 18071ce010334c238772935799f26a7b Oct 12 21:59:18.686729 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project Oct 12 21:59:18.686729 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 21:59:18.686729 n-d-861111-1 devstack@n-api.service[120452]: exception: Flavor 1298719648 has no extra specs with key hw:cpu_thread_policy. Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'flavor_id': '1298719648', 'id': 'hw:cpu_thread_policy'} Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1298719648 has no extra specs with key hw:cpu_thread_policy. Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:18.687405 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:18.689122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:18.689122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:18.689122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:18.689122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:59:18.689122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:59:18.689122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1298719648 has no extra specs with key hw:cpu_thread_policy. Oct 12 21:59:18.689122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:18.689122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-63398664-a5cc-4ca4-8e31-0ab76f7428bd tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] Returning 404 to user: Flavor 1298719648 has no extra specs with key hw:cpu_thread_policy. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:18.691184 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-63398664-a5cc-4ca4-8e31-0ab76f7428bd tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] 10.222.0.16 "GET /compute/v2.1/flavors/1298719648/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.467896 Oct 12 21:59:18.697259 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 5/13] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 12 21:59:18 2022] GET /compute/v2.1/flavors/1298719648/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 473 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:18.704204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-acb53564-8574-44ea-b94e-9a6336f30096 tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Calling method '.version_select at 0x7f512a4ac9d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:18.708919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-acb53564-8574-44ea-b94e-9a6336f30096 tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'd851f5266ee44270b579068cb86756f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44fda09670b447ea3c2b6e062350c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-acb53564-8574-44ea-b94e-9a6336f30096 tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Request method failure captured: Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRziwxCc_uffGUrHVpBYXiXXQsWSK06vA49pD8-Eh0hRlkRLh1AufJHQdCit5rv-ZO9JuQ-XHGrdUvZXRJ394DpazD6Vts3Sr45BsxDAJ4Hq2FsbbTp8-I6jODAMoe5DkLVX87KNFUzgLbvUmrILrUlB7cimDkf5AahUP98r1kBAa8wE Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: f44fda09670b447ea3c2b6e062350c4b Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1134263190 Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 21:59:18.721053 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 21:59:18.722554 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f44fda09670b447ea3c2b6e062350c4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f44fda09670b447ea3c2b6e062350c4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f44fda09670b447ea3c2b6e062350c4b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f44fda09670b447ea3c2b6e062350c4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:18.722554 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1134263190 Oct 12 21:59:18.722554 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: f44fda09670b447ea3c2b6e062350c4b Oct 12 21:59:18.722554 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1134263190 Oct 12 21:59:18.722554 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-HypervisorAdminNegativeTestJSON-1134263190-project Oct 12 21:59:18.722554 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 21:59:18.722554 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 21:59:18.722554 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: d851f5266ee44270b579068cb86756f0 Oct 12 21:59:18.722554 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1134263190-project Oct 12 21:59:18.722554 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 21:59:18.722554 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 12 21:59:18.722554 n-d-861111-1 devstack@n-api.service[120452]: action_args: {} Oct 12 21:59:18.722554 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:18.728196 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:18.729365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 21:59:18.729365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 21:59:18.729365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 21:59:18.729365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 21:59:18.729365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 21:59:18.729365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 21:59:18.729365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 12 21:59:18.729365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:18.729365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:18.729365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:18.729365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:18.729365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:18.729365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:18.729365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 21:59:18.729365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 21:59:18.729365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 12 21:59:18.729365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:18.730351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-acb53564-8574-44ea-b94e-9a6336f30096 tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:18.730351 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-acb53564-8574-44ea-b94e-9a6336f30096 tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.029572 Oct 12 21:59:18.730351 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 6/14] 10.222.0.16 () {58 vars in 1179 bytes} [Wed Oct 12 21:59:18 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:18.734368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-789df2aa-7c1a-4078-aa4c-c6823ba4b7d4 tempest-FlavorsV261TestJSON-2136682380 tempest-FlavorsV261TestJSON-2136682380-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:18.815348 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-789df2aa-7c1a-4078-aa4c-c6823ba4b7d4 tempest-FlavorsV261TestJSON-2136682380 tempest-FlavorsV261TestJSON-2136682380-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3409 microversion: 2.61 time: 0.090430 Oct 12 21:59:18.827703 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 7/15] 10.222.0.16 () {60 vars in 1166 bytes} [Wed Oct 12 21:59:18 2022] GET /compute/v2.1/flavors => generated 3409 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 21:59:18.836185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-035231c7-f52b-497a-90d7-709c9a98e414 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:18.849956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-035231c7-f52b-497a-90d7-709c9a98e414 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '18071ce010334c238772935799f26a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc1572aef31416a9535ad48a3a1582b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-035231c7-f52b-497a-90d7-709c9a98e414 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] Request method failure captured: Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/flavors/1298719648/os-extra_specs HTTP/1.1 Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 66 Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRziwk8w_9hHqR2O1HR-ZFZlDxz4NxZBGdfNG309sq5cuz2sa0LRFJ7XpNx_CO7V2psJKUJYrhOcafx8uT_qcAqV35vNDoaHqmu_g3q4dpKYNoXxlxjB79iAoDMDJELFNKkIJ2R_ftRidyyL1b8g8bonxUWgL3n7exWaZYKhp8ukSM8o Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: fdc1572aef31416a9535ad48a3a1582b Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 21:59:18.852542 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 21:59:18.853527 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdc1572aef31416a9535ad48a3a1582b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdc1572aef31416a9535ad48a3a1582b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdc1572aef31416a9535ad48a3a1582b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdc1572aef31416a9535ad48a3a1582b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:18.853527 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 Oct 12 21:59:18.853527 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: fdc1572aef31416a9535ad48a3a1582b Oct 12 21:59:18.853527 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 Oct 12 21:59:18.853527 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project Oct 12 21:59:18.853527 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 21:59:18.853527 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 21:59:18.853527 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 18071ce010334c238772935799f26a7b Oct 12 21:59:18.853527 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project Oct 12 21:59:18.853527 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 21:59:18.853527 n-d-861111-1 devstack@n-api.service[120452]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 12 21:59:18.853527 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'flavor_id': '1298719648', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 21:59:18.854199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 12 21:59:18.855060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:18.856019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-035231c7-f52b-497a-90d7-709c9a98e414 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:18.859264 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-035231c7-f52b-497a-90d7-709c9a98e414 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] 10.222.0.16 "POST /compute/v2.1/flavors/1298719648/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.030185 Oct 12 21:59:18.860209 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 8/16] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Oct 12 21:59:18 2022] POST /compute/v2.1/flavors/1298719648/os-extra_specs => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:19.563009 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b45d0816-289d-4efd-a158-909993ad5b36 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 1.030948 Oct 12 21:59:19.563696 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 9/17] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 12 21:59:18 2022] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:19.568916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e58fff8c-89c2-4229-9690-19856f8adfeb tempest-FlavorsV261TestJSON-1226020355 tempest-FlavorsV261TestJSON-1226020355-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:19.644078 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e58fff8c-89c2-4229-9690-19856f8adfeb tempest-FlavorsV261TestJSON-1226020355 tempest-FlavorsV261TestJSON-1226020355-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1921213966" status: 202 len: 0 microversion: 2.61 time: 0.079110 Oct 12 21:59:19.644741 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 10/18] 10.222.0.16 () {60 vars in 1202 bytes} [Wed Oct 12 21:59:19 2022] DELETE /compute/v2.1/flavors/1921213966 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 21:59:19.666714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-24cf7ee5-c6b0-4f70-803e-2d6cabd014b9 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:19.735936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-db23b232-7f57-48b6-8b0f-9c60b016cc2a tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Calling method '.version_select at 0x7f512a4acb80>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:19.735936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db23b232-7f57-48b6-8b0f-9c60b016cc2a tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:19.735936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db23b232-7f57-48b6-8b0f-9c60b016cc2a tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:19.735936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db23b232-7f57-48b6-8b0f-9c60b016cc2a tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:19.745752 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-24cf7ee5-c6b0-4f70-803e-2d6cabd014b9 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1298719648/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.094880 Oct 12 21:59:19.746871 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 11/19] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Oct 12 21:59:19 2022] POST /compute/v2.1/flavors/1298719648/os-extra_specs => generated 66 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 21:59:19.751996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-219f7dfb-1928-4b9a-8ab8-5801276da9d1 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:19.752958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-219f7dfb-1928-4b9a-8ab8-5801276da9d1 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:19.784309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db23b232-7f57-48b6-8b0f-9c60b016cc2a tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:19.784807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db23b232-7f57-48b6-8b0f-9c60b016cc2a tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:19.786409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db23b232-7f57-48b6-8b0f-9c60b016cc2a tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:19.822406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db23b232-7f57-48b6-8b0f-9c60b016cc2a tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:19.822641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-219f7dfb-1928-4b9a-8ab8-5801276da9d1 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:19.823749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db23b232-7f57-48b6-8b0f-9c60b016cc2a tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:19.824493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db23b232-7f57-48b6-8b0f-9c60b016cc2a tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:19.831963 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-db23b232-7f57-48b6-8b0f-9c60b016cc2a tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.970651 Oct 12 21:59:19.832994 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 9/20] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 21:59:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:19.838241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-98190a01-c2f2-46fa-8b50-ebe435c6796b tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861111-1"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:19.838808 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-219f7dfb-1928-4b9a-8ab8-5801276da9d1 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1220 microversion: 2.1 time: 0.090264 Oct 12 21:59:19.840034 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 12/21] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:19 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:19.856428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-11c32252-bd76-40ba-a2f9-9e55a8d284f7 tempest-FlavorsV261TestJSON-1226020355 tempest-FlavorsV261TestJSON-1226020355-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:19.885827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98190a01-c2f2-46fa-8b50-ebe435c6796b tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:19.886559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98190a01-c2f2-46fa-8b50-ebe435c6796b tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:19.887182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98190a01-c2f2-46fa-8b50-ebe435c6796b tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:19.922687 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-11c32252-bd76-40ba-a2f9-9e55a8d284f7 tempest-FlavorsV261TestJSON-1226020355 tempest-FlavorsV261TestJSON-1226020355-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6284 microversion: 2.61 time: 0.081428 Oct 12 21:59:19.923278 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 13/22] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 12 21:59:19 2022] GET /compute/v2.1/flavors/detail => generated 6284 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 21:59:19.965755 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-98190a01-c2f2-46fa-8b50-ebe435c6796b tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-861111-1. Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-98190a01-c2f2-46fa-8b50-ebe435c6796b tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Request method failure captured: Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 39 Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzizFbmbzzw4MmGDEmAs8A1yFrFGWLtvpWq3MvkgjiLwjw2AFBoxm5OdAEJDtOSu9t7M8hwMykVeBCqlC1RC2fZ9pe6LCh0dNzHTAxSZ-6Skd3PaUuitsryIrbr9CLPWQAJmwegHlYRRzmbJHMc11PmgVUevVXpjTFgLdMHjff43Kco Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1dd953b9ffe14b04a7dae3549a941ec9 Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 21:59:19.982858 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 21:59:19.983920 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1dd953b9ffe14b04a7dae3549a941ec9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:19.983920 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:19.983920 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1dd953b9ffe14b04a7dae3549a941ec9 Oct 12 21:59:19.983920 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:19.983920 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin Oct 12 21:59:19.983920 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 21:59:19.983920 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 21:59:19.983920 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 99c714101346471baff51bba8bd22dc1 Oct 12 21:59:19.983920 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin Oct 12 21:59:19.983920 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 21:59:19.983920 n-d-861111-1 devstack@n-api.service[120452]: {"add_host": {"host": "n-h1-861111-1"}} Oct 12 21:59:19.983920 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 21:59:19.983920 n-d-861111-1 devstack@n-api.service[120452]: exception: Aggregate 1 already has host n-h1-861111-1. Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-861111-1'}}} Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result.read() Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 21:59:19.984543 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-861111-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi session.flush() Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 21:59:19.985472 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 21:59:19.986462 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 21:59:19.987353 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result.read() Oct 12 21:59:19.988267 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 21:59:19.988267 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 21:59:19.988267 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 21:59:19.988267 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 21:59:19.988267 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 21:59:19.988267 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 21:59:19.988267 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 21:59:19.988267 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 21:59:19.988267 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-861111-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 12 21:59:19.988267 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 12 21:59:19.988267 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 12, 21, 59, 19, 952273), 'updated_at': None, 'host': 'n-h1-861111-1', 'aggregate_id': 1}] Oct 12 21:59:19.988267 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 21:59:19.988267 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:19.988267 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:19.988267 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:19.988267 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:19.988267 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-861111-1. Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:19.989300 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-861111-1. Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:59:19.992277 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:59:19.997333 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-861111-1. Oct 12 21:59:19.997333 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.000484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-98190a01-c2f2-46fa-8b50-ebe435c6796b tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-861111-1. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:20.001772 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-98190a01-c2f2-46fa-8b50-ebe435c6796b tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.167546 Oct 12 21:59:20.003072 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 10/23] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 12 21:59:19 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 12 21:59:20.015482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8121a200-1a59-4787-af37-780f5337b0fd tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:20.017934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8121a200-1a59-4787-af37-780f5337b0fd tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '18071ce010334c238772935799f26a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc1572aef31416a9535ad48a3a1582b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8121a200-1a59-4787-af37-780f5337b0fd tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] Request method failure captured: Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/flavors/1298719648/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRziwk8w_9hHqR2O1HR-ZFZlDxz4NxZBGdfNG309sq5cuz2sa0LRFJ7XpNx_CO7V2psJKUJYrhOcafx8uT_qcAqV35vNDoaHqmu_g3q4dpKYNoXxlxjB79iAoDMDJELFNKkIJ2R_ftRidyyL1b8g8bonxUWgL3n7exWaZYKhp8ukSM8o Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: fdc1572aef31416a9535ad48a3a1582b Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 21:59:20.020250 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 21:59:20.021261 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdc1572aef31416a9535ad48a3a1582b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdc1572aef31416a9535ad48a3a1582b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdc1572aef31416a9535ad48a3a1582b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdc1572aef31416a9535ad48a3a1582b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:20.021261 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 Oct 12 21:59:20.021261 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: fdc1572aef31416a9535ad48a3a1582b Oct 12 21:59:20.021261 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 Oct 12 21:59:20.021261 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project Oct 12 21:59:20.021261 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 21:59:20.021261 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 21:59:20.021261 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 18071ce010334c238772935799f26a7b Oct 12 21:59:20.021261 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project Oct 12 21:59:20.021261 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 21:59:20.021261 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'flavor_id': '1298719648', 'id': 'hw:numa_nodes'} Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:20.021859 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 21:59:20.022775 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 21:59:20.022775 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 21:59:20.022775 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 21:59:20.022775 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 21:59:20.022775 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 21:59:20.022775 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 12 21:59:20.022775 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.022775 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:20.022775 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.022775 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.022775 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.022775 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.022775 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 21:59:20.022775 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 21:59:20.022775 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 12 21:59:20.022775 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.025567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f3e5b0de-012c-4e12-b80e-30ee146b420e tempest-AZAdminV2TestJSON-1371334189 tempest-AZAdminV2TestJSON-1371334189-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:20.025687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8121a200-1a59-4787-af37-780f5337b0fd tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:20.026717 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8121a200-1a59-4787-af37-780f5337b0fd tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] 10.222.0.16 "DELETE /compute/v2.1/flavors/1298719648/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.021808 Oct 12 21:59:20.027620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3e5b0de-012c-4e12-b80e-30ee146b420e tempest-AZAdminV2TestJSON-1371334189 tempest-AZAdminV2TestJSON-1371334189-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:20.028597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3e5b0de-012c-4e12-b80e-30ee146b420e tempest-AZAdminV2TestJSON-1371334189 tempest-AZAdminV2TestJSON-1371334189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:20.029163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3e5b0de-012c-4e12-b80e-30ee146b420e tempest-AZAdminV2TestJSON-1371334189 tempest-AZAdminV2TestJSON-1371334189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:20.031125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3e5b0de-012c-4e12-b80e-30ee146b420e tempest-AZAdminV2TestJSON-1371334189 tempest-AZAdminV2TestJSON-1371334189-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:20.031737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3e5b0de-012c-4e12-b80e-30ee146b420e tempest-AZAdminV2TestJSON-1371334189 tempest-AZAdminV2TestJSON-1371334189-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:20.032341 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 11/24] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 21:59:20 2022] DELETE /compute/v2.1/flavors/1298719648/os-extra_specs/hw:numa_nodes => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:20.032540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3e5b0de-012c-4e12-b80e-30ee146b420e tempest-AZAdminV2TestJSON-1371334189 tempest-AZAdminV2TestJSON-1371334189-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:20.037814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a30cfe6-f797-49ec-9aa0-d5331e80f6cf tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Calling method '.version_select at 0x7f512972caf0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:20.040601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a30cfe6-f797-49ec-9aa0-d5331e80f6cf tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'd851f5266ee44270b579068cb86756f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44fda09670b447ea3c2b6e062350c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a30cfe6-f797-49ec-9aa0-d5331e80f6cf tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Request method failure captured: Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRziwxCc_uffGUrHVpBYXiXXQsWSK06vA49pD8-Eh0hRlkRLh1AufJHQdCit5rv-ZO9JuQ-XHGrdUvZXRJ394DpazD6Vts3Sr45BsxDAJ4Hq2FsbbTp8-I6jODAMoe5DkLVX87KNFUzgLbvUmrILrUlB7cimDkf5AahUP98r1kBAa8wE Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: f44fda09670b447ea3c2b6e062350c4b Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1134263190 Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 21:59:20.042448 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 21:59:20.043576 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f44fda09670b447ea3c2b6e062350c4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f44fda09670b447ea3c2b6e062350c4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f44fda09670b447ea3c2b6e062350c4b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f44fda09670b447ea3c2b6e062350c4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:20.043576 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1134263190 Oct 12 21:59:20.043576 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: f44fda09670b447ea3c2b6e062350c4b Oct 12 21:59:20.043576 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1134263190 Oct 12 21:59:20.043576 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-HypervisorAdminNegativeTestJSON-1134263190-project Oct 12 21:59:20.043576 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 21:59:20.043576 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 21:59:20.043576 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: d851f5266ee44270b579068cb86756f0 Oct 12 21:59:20.043576 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1134263190-project Oct 12 21:59:20.043576 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 21:59:20.043576 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 12 21:59:20.043576 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '1'} Oct 12 21:59:20.043576 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:20.044309 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:20.045170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 21:59:20.045170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 21:59:20.045170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 21:59:20.045170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 21:59:20.045170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 21:59:20.045170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 21:59:20.045170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 12 21:59:20.045170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.045170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:20.045170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.045170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.045170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.045170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.045170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 21:59:20.045170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 21:59:20.045170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 12 21:59:20.045170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.048127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a30cfe6-f797-49ec-9aa0-d5331e80f6cf tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:20.049182 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7a30cfe6-f797-49ec-9aa0-d5331e80f6cf tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.015543 Oct 12 21:59:20.055865 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 12/25] 10.222.0.16 () {58 vars in 1173 bytes} [Wed Oct 12 21:59:20 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:20.061151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8bd63940-ff3a-45b4-893f-eb7726ee3295 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861111-1"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:20.075961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bd63940-ff3a-45b4-893f-eb7726ee3295 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:20.076683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bd63940-ff3a-45b4-893f-eb7726ee3295 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:20.077229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bd63940-ff3a-45b4-893f-eb7726ee3295 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:20.105522 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f3e5b0de-012c-4e12-b80e-30ee146b420e tempest-AZAdminV2TestJSON-1371334189 tempest-AZAdminV2TestJSON-1371334189-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.169130 Oct 12 21:59:20.114646 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 14/26] 10.222.0.16 () {58 vars in 1164 bytes} [Wed Oct 12 21:59:19 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 21:59:20.122293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-17d65356-02ab-4fcb-899e-e5ccb46b675d tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:20.150674 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-17d65356-02ab-4fcb-899e-e5ccb46b675d tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1298719648/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034626 Oct 12 21:59:20.151465 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 15/27] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Oct 12 21:59:20 2022] POST /compute/v2.1/flavors/1298719648/os-extra_specs => generated 66 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 21:59:20.156388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb7e2982-34e3-4d53-9f21-7480d774b5ca tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Calling method '.version_select at 0x7f512910dee0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:20.158724 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-cb7e2982-34e3-4d53-9f21-7480d774b5ca tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] HTTP exception thrown: Hypervisor with ID 'b0dab2e2-001b-4118-87cd-2f4678cb075a' could not be found. Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb7e2982-34e3-4d53-9f21-7480d774b5ca tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Request method failure captured: Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-hypervisors/b0dab2e2-001b-4118-87cd-2f4678cb075a/uptime HTTP/1.1 Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRziz9MtPH9IPO_c8vQLDXFWEDd17uRUTjgEeSglhNDQQUmPde6QTMuhs6ZyTIL-3TBvpBWUIFxtTDC3Zxig-YVD7mqxfcPLWocgeT9XDA8buWaQHlyPjb_EgCzufrVPCUxu6pBRAWKgAJcoJIC776xP2Tlq6qZNh_s4pXi1-H740NLI Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 2696cc7b70484bba8d75578ba1db9a1d Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1014391416 Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 21:59:20.162906 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 21:59:20.164604 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2696cc7b70484bba8d75578ba1db9a1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2696cc7b70484bba8d75578ba1db9a1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2696cc7b70484bba8d75578ba1db9a1d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2696cc7b70484bba8d75578ba1db9a1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:20.164604 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1014391416 Oct 12 21:59:20.164604 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 2696cc7b70484bba8d75578ba1db9a1d Oct 12 21:59:20.164604 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1014391416 Oct 12 21:59:20.164604 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin Oct 12 21:59:20.164604 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:20.164604 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:20.164604 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: e0157aaed3164ac8beb7e673c0cf9053 Oct 12 21:59:20.164604 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin Oct 12 21:59:20.164604 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 21:59:20.164604 n-d-861111-1 devstack@n-api.service[120453]: exception: Hypervisor with ID 'b0dab2e2-001b-4118-87cd-2f4678cb075a' could not be found. Oct 12 21:59:20.164604 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'b0dab2e2-001b-4118-87cd-2f4678cb075a'} Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'b0dab2e2-001b-4118-87cd-2f4678cb075a' Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 12 21:59:20.165299 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'b0dab2e2-001b-4118-87cd-2f4678cb075a' could not be found. Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:20.166488 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.168636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.168636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.168636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.168636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:59:20.168636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:59:20.168636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'b0dab2e2-001b-4118-87cd-2f4678cb075a' could not be found. Oct 12 21:59:20.168636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.168636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb7e2982-34e3-4d53-9f21-7480d774b5ca tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Returning 404 to user: Hypervisor with ID 'b0dab2e2-001b-4118-87cd-2f4678cb075a' could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:20.169965 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cb7e2982-34e3-4d53-9f21-7480d774b5ca tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/b0dab2e2-001b-4118-87cd-2f4678cb075a/uptime" status: 404 len: 123 microversion: 2.1 time: 0.017005 Oct 12 21:59:20.175029 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 16/28] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 12 21:59:20 2022] GET /compute/v2.1/os-hypervisors/b0dab2e2-001b-4118-87cd-2f4678cb075a/uptime => generated 123 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:20.182266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-59bbe5cc-1c9a-4445-87be-fd52098ea5dd tempest-AZAdminV2TestJSON-1371334189 tempest-AZAdminV2TestJSON-1371334189-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:20.184372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59bbe5cc-1c9a-4445-87be-fd52098ea5dd tempest-AZAdminV2TestJSON-1371334189 tempest-AZAdminV2TestJSON-1371334189-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:20.184944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59bbe5cc-1c9a-4445-87be-fd52098ea5dd tempest-AZAdminV2TestJSON-1371334189 tempest-AZAdminV2TestJSON-1371334189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:20.185459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59bbe5cc-1c9a-4445-87be-fd52098ea5dd tempest-AZAdminV2TestJSON-1371334189 tempest-AZAdminV2TestJSON-1371334189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:20.186415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59bbe5cc-1c9a-4445-87be-fd52098ea5dd tempest-AZAdminV2TestJSON-1371334189 tempest-AZAdminV2TestJSON-1371334189-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:20.186936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59bbe5cc-1c9a-4445-87be-fd52098ea5dd tempest-AZAdminV2TestJSON-1371334189 tempest-AZAdminV2TestJSON-1371334189-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:20.187561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59bbe5cc-1c9a-4445-87be-fd52098ea5dd tempest-AZAdminV2TestJSON-1371334189 tempest-AZAdminV2TestJSON-1371334189-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:20.222611 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-59bbe5cc-1c9a-4445-87be-fd52098ea5dd tempest-AZAdminV2TestJSON-1371334189 tempest-AZAdminV2TestJSON-1371334189-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.046416 Oct 12 21:59:20.223206 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 17/29] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 12 21:59:20 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:20.228271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bbfb9948-b248-4bbc-ba85-b07cb763cbad tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:20.233023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bbfb9948-b248-4bbc-ba85-b07cb763cbad tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '18071ce010334c238772935799f26a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc1572aef31416a9535ad48a3a1582b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bbfb9948-b248-4bbc-ba85-b07cb763cbad tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] Request method failure captured: Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: request: PUT /compute/v2.1/flavors/1298719648/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 22 Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRziwk8w_9hHqR2O1HR-ZFZlDxz4NxZBGdfNG309sq5cuz2sa0LRFJ7XpNx_CO7V2psJKUJYrhOcafx8uT_qcAqV35vNDoaHqmu_g3q4dpKYNoXxlxjB79iAoDMDJELFNKkIJ2R_ftRidyyL1b8g8bonxUWgL3n7exWaZYKhp8ukSM8o Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: fdc1572aef31416a9535ad48a3a1582b Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 21:59:20.235025 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 21:59:20.236329 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdc1572aef31416a9535ad48a3a1582b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdc1572aef31416a9535ad48a3a1582b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdc1572aef31416a9535ad48a3a1582b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdc1572aef31416a9535ad48a3a1582b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:20.236329 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 Oct 12 21:59:20.236329 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: fdc1572aef31416a9535ad48a3a1582b Oct 12 21:59:20.236329 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 Oct 12 21:59:20.236329 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project Oct 12 21:59:20.236329 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:20.236329 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:20.236329 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 18071ce010334c238772935799f26a7b Oct 12 21:59:20.236329 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project Oct 12 21:59:20.236329 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 21:59:20.236329 n-d-861111-1 devstack@n-api.service[120453]: {"hw:numa_nodes": "1"} Oct 12 21:59:20.236329 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 21:59:20.236329 n-d-861111-1 devstack@n-api.service[120453]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'flavor_id': '1298719648', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:20.237137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 12 21:59:20.238249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.240133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bbfb9948-b248-4bbc-ba85-b07cb763cbad tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:20.241108 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bbfb9948-b248-4bbc-ba85-b07cb763cbad tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023 tempest-FlavorsExtraSpecsNegativeTestJSON-1584323023-project] 10.222.0.16 "PUT /compute/v2.1/flavors/1298719648/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016976 Oct 12 21:59:20.242004 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 18/30] 10.222.0.16 () {60 vars in 1265 bytes} [Wed Oct 12 21:59:20 2022] PUT /compute/v2.1/flavors/1298719648/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:20.250268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2dd22017-3059-4286-8402-8f4dc0cf679c tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Calling method '.version_select at 0x7f51290b2e50>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:20.258915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2dd22017-3059-4286-8402-8f4dc0cf679c tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2bc00301-6462-4874-9c83-c889d0ff6a49(cell1) {{(pid=120453) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 12 21:59:20.259780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dd22017-3059-4286-8402-8f4dc0cf679c tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:20.260336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dd22017-3059-4286-8402-8f4dc0cf679c tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:20.260912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dd22017-3059-4286-8402-8f4dc0cf679c tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:20.298548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dd22017-3059-4286-8402-8f4dc0cf679c tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:20.299362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dd22017-3059-4286-8402-8f4dc0cf679c tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:20.299804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dd22017-3059-4286-8402-8f4dc0cf679c tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:20.312111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dd22017-3059-4286-8402-8f4dc0cf679c tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:20.312588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dd22017-3059-4286-8402-8f4dc0cf679c tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:20.313208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dd22017-3059-4286-8402-8f4dc0cf679c tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:20.319472 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2dd22017-3059-4286-8402-8f4dc0cf679c tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.075811 Oct 12 21:59:20.320771 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 19/31] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 21:59:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:20.325426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3326b5d7-d011-4808-930c-b06603111506 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:20.338827 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-3326b5d7-d011-4808-930c-b06603111506 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] HTTP exception thrown: Flavor 1298719648 has no extra specs with key hw:cpu_thread_policy. Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3326b5d7-d011-4808-930c-b06603111506 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] Request method failure captured: Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/flavors/1298719648/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzizCyOAGU_0e9owlraaGg5He74A3752TGucR-VKsxWFUeTbczitZKzIHcRcrCsDO6oEGJhUFUsa0oFiyYz6TS2OUOIqAakvnwEG5hcyGYjbe2pwPTAtu4mnGjl2hwTD1VCvlJTJV6LfjFqEgd9fiXR-udmWh1BW7NbIV-Oyd7tsh4I Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: ad08e0f101704b688de838b00f54fb31 Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 21:59:20.340576 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 21:59:20.341600 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad08e0f101704b688de838b00f54fb31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad08e0f101704b688de838b00f54fb31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad08e0f101704b688de838b00f54fb31", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad08e0f101704b688de838b00f54fb31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:20.341600 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 Oct 12 21:59:20.341600 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: ad08e0f101704b688de838b00f54fb31 Oct 12 21:59:20.341600 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 Oct 12 21:59:20.341600 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin Oct 12 21:59:20.341600 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:20.341600 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:20.341600 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a78a7cbd064b4cf8834d5b7a8b40b6c2 Oct 12 21:59:20.341600 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin Oct 12 21:59:20.341600 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 21:59:20.341600 n-d-861111-1 devstack@n-api.service[120453]: exception: Flavor 1298719648 has no extra specs with key hw:cpu_thread_policy. Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'flavor_id': '1298719648', 'id': 'hw:cpu_thread_policy'} Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1298719648 has no extra specs with key hw:cpu_thread_policy. Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:20.342130 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.343179 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.343179 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.343179 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.343179 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:59:20.343179 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:59:20.343179 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1298719648 has no extra specs with key hw:cpu_thread_policy. Oct 12 21:59:20.343179 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.345710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3326b5d7-d011-4808-930c-b06603111506 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] Returning 404 to user: Flavor 1298719648 has no extra specs with key hw:cpu_thread_policy. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:20.346764 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3326b5d7-d011-4808-930c-b06603111506 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1298719648/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.024746 Oct 12 21:59:20.347535 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 20/32] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 12 21:59:20 2022] DELETE /compute/v2.1/flavors/1298719648/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:20.353259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b375c01-768f-4882-9896-2270a56ecc3d tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Calling method '.version_select at 0x7f51290b10d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:20.355437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b375c01-768f-4882-9896-2270a56ecc3d tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'd851f5266ee44270b579068cb86756f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44fda09670b447ea3c2b6e062350c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b375c01-768f-4882-9896-2270a56ecc3d tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Request method failure captured: Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRziwxCc_uffGUrHVpBYXiXXQsWSK06vA49pD8-Eh0hRlkRLh1AufJHQdCit5rv-ZO9JuQ-XHGrdUvZXRJ394DpazD6Vts3Sr45BsxDAJ4Hq2FsbbTp8-I6jODAMoe5DkLVX87KNFUzgLbvUmrILrUlB7cimDkf5AahUP98r1kBAa8wE Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: f44fda09670b447ea3c2b6e062350c4b Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1134263190 Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 21:59:20.357274 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 21:59:20.358289 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f44fda09670b447ea3c2b6e062350c4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f44fda09670b447ea3c2b6e062350c4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f44fda09670b447ea3c2b6e062350c4b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f44fda09670b447ea3c2b6e062350c4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:20.358289 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1134263190 Oct 12 21:59:20.358289 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: f44fda09670b447ea3c2b6e062350c4b Oct 12 21:59:20.358289 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1134263190 Oct 12 21:59:20.358289 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-HypervisorAdminNegativeTestJSON-1134263190-project Oct 12 21:59:20.358289 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:20.358289 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:20.358289 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: d851f5266ee44270b579068cb86756f0 Oct 12 21:59:20.358289 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1134263190-project Oct 12 21:59:20.358289 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 21:59:20.358289 n-d-861111-1 devstack@n-api.service[120453]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 12 21:59:20.358289 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1'} Oct 12 21:59:20.358289 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:20.358896 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 12 21:59:20.360294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.362385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b375c01-768f-4882-9896-2270a56ecc3d tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:20.363420 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8b375c01-768f-4882-9896-2270a56ecc3d tempest-HypervisorAdminNegativeTestJSON-1134263190 tempest-HypervisorAdminNegativeTestJSON-1134263190-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.014645 Oct 12 21:59:20.364468 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 21/33] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 21:59:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:20.370326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-99ad7d06-ae53-4071-908c-2033f6ed3ab4 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:20.373837 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-99ad7d06-ae53-4071-908c-2033f6ed3ab4 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-99ad7d06-ae53-4071-908c-2033f6ed3ab4 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] Request method failure captured: Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: request: PUT /compute/v2.1/flavors/1298719648/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 27 Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzizCyOAGU_0e9owlraaGg5He74A3752TGucR-VKsxWFUeTbczitZKzIHcRcrCsDO6oEGJhUFUsa0oFiyYz6TS2OUOIqAakvnwEG5hcyGYjbe2pwPTAtu4mnGjl2hwTD1VCvlJTJV6LfjFqEgd9fiXR-udmWh1BW7NbIV-Oyd7tsh4I Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: ad08e0f101704b688de838b00f54fb31 Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 21:59:20.375261 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 21:59:20.376483 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad08e0f101704b688de838b00f54fb31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad08e0f101704b688de838b00f54fb31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad08e0f101704b688de838b00f54fb31", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad08e0f101704b688de838b00f54fb31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:20.376483 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 Oct 12 21:59:20.376483 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: ad08e0f101704b688de838b00f54fb31 Oct 12 21:59:20.376483 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 Oct 12 21:59:20.376483 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin Oct 12 21:59:20.376483 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:20.376483 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:20.376483 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a78a7cbd064b4cf8834d5b7a8b40b6c2 Oct 12 21:59:20.376483 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin Oct 12 21:59:20.376483 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 21:59:20.376483 n-d-861111-1 devstack@n-api.service[120453]: {"hw:cpu_policy": "shared"} Oct 12 21:59:20.376483 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 21:59:20.376483 n-d-861111-1 devstack@n-api.service[120453]: exception: Request body and URI mismatch Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'flavor_id': '1298719648', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.377295 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.378427 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:59:20.378427 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:59:20.378427 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 12 21:59:20.378427 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.379305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-99ad7d06-ae53-4071-908c-2033f6ed3ab4 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:20.380270 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-99ad7d06-ae53-4071-908c-2033f6ed3ab4 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1298719648/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.013605 Oct 12 21:59:20.381365 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 22/34] 10.222.0.16 () {60 vars in 1265 bytes} [Wed Oct 12 21:59:20 2022] PUT /compute/v2.1/flavors/1298719648/os-extra_specs/hw:numa_nodes => generated 73 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 21:59:20.390647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a2cf36de-0a6a-42bb-9e9a-7fafb8ebc677 tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Calling method '.version_select at 0x7f51290b20d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:20.392670 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-a2cf36de-0a6a-42bb-9e9a-7fafb8ebc677 tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] HTTP exception thrown: Hypervisor with ID '9402395f-402e-43f6-820f-747f75a1e59e' could not be found. Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a2cf36de-0a6a-42bb-9e9a-7fafb8ebc677 tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Request method failure captured: Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-hypervisors/9402395f-402e-43f6-820f-747f75a1e59e HTTP/1.1 Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRziz9MtPH9IPO_c8vQLDXFWEDd17uRUTjgEeSglhNDQQUmPde6QTMuhs6ZyTIL-3TBvpBWUIFxtTDC3Zxig-YVD7mqxfcPLWocgeT9XDA8buWaQHlyPjb_EgCzufrVPCUxu6pBRAWKgAJcoJIC776xP2Tlq6qZNh_s4pXi1-H740NLI Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 2696cc7b70484bba8d75578ba1db9a1d Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1014391416 Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 21:59:20.395283 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 21:59:20.396541 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2696cc7b70484bba8d75578ba1db9a1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2696cc7b70484bba8d75578ba1db9a1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2696cc7b70484bba8d75578ba1db9a1d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2696cc7b70484bba8d75578ba1db9a1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:20.396541 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1014391416 Oct 12 21:59:20.396541 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 2696cc7b70484bba8d75578ba1db9a1d Oct 12 21:59:20.396541 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1014391416 Oct 12 21:59:20.396541 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin Oct 12 21:59:20.396541 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:20.396541 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:20.396541 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: e0157aaed3164ac8beb7e673c0cf9053 Oct 12 21:59:20.396541 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin Oct 12 21:59:20.396541 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 21:59:20.396541 n-d-861111-1 devstack@n-api.service[120453]: exception: Hypervisor with ID '9402395f-402e-43f6-820f-747f75a1e59e' could not be found. Oct 12 21:59:20.396541 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '9402395f-402e-43f6-820f-747f75a1e59e'} Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9402395f-402e-43f6-820f-747f75a1e59e' Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 12 21:59:20.397348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 21:59:20.399118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9402395f-402e-43f6-820f-747f75a1e59e' could not be found. Oct 12 21:59:20.400815 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.400815 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:20.400815 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.400815 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.400815 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.400815 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.400815 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:59:20.400815 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:59:20.400815 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9402395f-402e-43f6-820f-747f75a1e59e' could not be found. Oct 12 21:59:20.400815 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.404207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a2cf36de-0a6a-42bb-9e9a-7fafb8ebc677 tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] Returning 404 to user: Hypervisor with ID '9402395f-402e-43f6-820f-747f75a1e59e' could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:20.405220 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a2cf36de-0a6a-42bb-9e9a-7fafb8ebc677 tempest-HypervisorAdminNegativeTestJSON-1014391416 tempest-HypervisorAdminNegativeTestJSON-1014391416-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/9402395f-402e-43f6-820f-747f75a1e59e" status: 404 len: 123 microversion: 2.1 time: 0.022158 Oct 12 21:59:20.406222 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 23/35] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 12 21:59:20 2022] GET /compute/v2.1/os-hypervisors/9402395f-402e-43f6-820f-747f75a1e59e => generated 123 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:20.414484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7538e107-0313-4713-8542-9ae261ab5984 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7538e107-0313-4713-8542-9ae261ab5984 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] Request method failure captured: Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: request: PUT /compute/v2.1/flavors/1298719648/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 49 Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzizCyOAGU_0e9owlraaGg5He74A3752TGucR-VKsxWFUeTbczitZKzIHcRcrCsDO6oEGJhUFUsa0oFiyYz6TS2OUOIqAakvnwEG5hcyGYjbe2pwPTAtu4mnGjl2hwTD1VCvlJTJV6LfjFqEgd9fiXR-udmWh1BW7NbIV-Oyd7tsh4I Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: ad08e0f101704b688de838b00f54fb31 Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 21:59:20.420121 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 21:59:20.421303 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad08e0f101704b688de838b00f54fb31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad08e0f101704b688de838b00f54fb31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad08e0f101704b688de838b00f54fb31", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad08e0f101704b688de838b00f54fb31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:20.421303 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 Oct 12 21:59:20.421303 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: ad08e0f101704b688de838b00f54fb31 Oct 12 21:59:20.421303 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 Oct 12 21:59:20.421303 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin Oct 12 21:59:20.421303 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:20.421303 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:20.421303 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a78a7cbd064b4cf8834d5b7a8b40b6c2 Oct 12 21:59:20.421303 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin Oct 12 21:59:20.421303 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 21:59:20.421303 n-d-861111-1 devstack@n-api.service[120453]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 12 21:59:20.421303 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'flavor_id': '1298719648', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance: Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 12 21:59:20.421966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.423342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:20.424601 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:20.424601 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:20.424601 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 21:59:20.424601 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 21:59:20.424601 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 12 21:59:20.424601 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:20.424601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7538e107-0313-4713-8542-9ae261ab5984 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:20.424601 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7538e107-0313-4713-8542-9ae261ab5984 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1298719648/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.014070 Oct 12 21:59:20.424601 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 24/36] 10.222.0.16 () {60 vars in 1265 bytes} [Wed Oct 12 21:59:20 2022] PUT /compute/v2.1/flavors/1298719648/os-extra_specs/hw:numa_nodes => generated 117 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 21:59:20.436819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e3f1c275-6e46-4321-96f4-c8d07b2a2301 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:20.446651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=5,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:20.463078 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e3f1c275-6e46-4321-96f4-c8d07b2a2301 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1298719648" status: 202 len: 0 microversion: 2.1 time: 0.030690 Oct 12 21:59:20.464711 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 25/37] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 12 21:59:20 2022] DELETE /compute/v2.1/flavors/1298719648 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 21:59:20.472112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c5e9b8d9-a7af-4008-a088-2c6453c6dc0c tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:20.495901 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c5e9b8d9-a7af-4008-a088-2c6453c6dc0c tempest-FlavorsExtraSpecsNegativeTestJSON-976974503 tempest-FlavorsExtraSpecsNegativeTestJSON-976974503-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027481 Oct 12 21:59:20.496483 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 26/38] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 21:59:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 21:59:20.868770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3afe41b4-8bc5-490d-856b-f74574a69ac2 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:20.869397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3afe41b4-8bc5-490d-856b-f74574a69ac2 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:20.878647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3afe41b4-8bc5-490d-856b-f74574a69ac2 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:20.879946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3afe41b4-8bc5-490d-856b-f74574a69ac2 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:20.880567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3afe41b4-8bc5-490d-856b-f74574a69ac2 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:20.881695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3afe41b4-8bc5-490d-856b-f74574a69ac2 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:20.882467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3afe41b4-8bc5-490d-856b-f74574a69ac2 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:20.883097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3afe41b4-8bc5-490d-856b-f74574a69ac2 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:20.969381 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8bd63940-ff3a-45b4-893f-eb7726ee3295 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.911800 Oct 12 21:59:20.969974 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 13/39] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 12 21:59:20 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:20.988111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4973796d-75ea-458e-9c63-30497aecace7 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:21.040451 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4973796d-75ea-458e-9c63-30497aecace7 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.059905 Oct 12 21:59:21.042873 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 14/40] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 21:59:20 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 12 21:59:21.055935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4dd70640-d173-47cd-a74a-966865c802f0 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2124826838"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:21.065197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.aggregate [None req-4dd70640-d173-47cd-a74a-966865c802f0 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Generated uuid bed6fb07-b06e-4bbf-8087-ccc14955ea14 for aggregate {{(pid=120452) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 21:59:21.078109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3afe41b4-8bc5-490d-856b-f74574a69ac2 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:21.093992 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3afe41b4-8bc5-490d-856b-f74574a69ac2 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1272 microversion: 2.1 time: 0.231488 Oct 12 21:59:21.095282 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 27/41] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:20 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:21.102115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a5d14b5c-accb-439c-bcf6-4443632d205c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1158724145", "name": "tempest-test_aggregate-1509747097"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:21.135939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.aggregate [None req-a5d14b5c-accb-439c-bcf6-4443632d205c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Generated uuid 85bb522f-a24e-4fae-90a2-5ba501ad34b4 for aggregate {{(pid=120453) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 21:59:21.156481 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4dd70640-d173-47cd-a74a-966865c802f0 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.107492 Oct 12 21:59:21.162604 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 15/42] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 21:59:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 21:59:21.188600 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a5d14b5c-accb-439c-bcf6-4443632d205c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.088024 Oct 12 21:59:21.195330 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 28/43] 10.222.0.16 () {60 vars in 1165 bytes} [Wed Oct 12 21:59:21 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:21.205632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0d585f77-90d7-4b4c-bb69-d5ecbd1a8e2e tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:21.230498 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0d585f77-90d7-4b4c-bb69-d5ecbd1a8e2e tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 517 microversion: 2.1 time: 0.032539 Oct 12 21:59:21.232283 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 29/44] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 12 21:59:21 2022] GET /compute/v2.1/os-aggregates => generated 517 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:21.260293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3fd7e84f-c7f6-4b89-a7d1-95657bac2e0d tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861111-1"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:21.276684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fd7e84f-c7f6-4b89-a7d1-95657bac2e0d tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:21.277359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fd7e84f-c7f6-4b89-a7d1-95657bac2e0d tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:21.278095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fd7e84f-c7f6-4b89-a7d1-95657bac2e0d tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:21.544154 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3fd7e84f-c7f6-4b89-a7d1-95657bac2e0d tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 315 microversion: 2.1 time: 0.293891 Oct 12 21:59:21.544763 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 30/45] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 12 21:59:21 2022] POST /compute/v2.1/os-aggregates/3/action => generated 315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:21.802258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d64af5c8-208e-4f2d-a4dd-727df9db57c3 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861111-1"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:21.806513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d64af5c8-208e-4f2d-a4dd-727df9db57c3 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '3f8d0f8194bc4bfdb6ec664b74cd3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41167f320c5d4f7fbf507493bbd52011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d64af5c8-208e-4f2d-a4dd-727df9db57c3 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Request method failure captured: Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 39 Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRziw7sBUmqVgnlVnGeqzadideJY0q4eDK4Xm2VdEtBEtelMi3J6ahPto8hQoBax-1kGt6oT7bwtLMqMdVa2FgocJAh8BYFQCvn0574AZIlB0jE2oUl6gwM4HBI7QpnrMjMW9Kzpjwia1bFP1-Eb3HzkXB5N4aoh642oazstPm4GhMzo Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 41167f320c5d4f7fbf507493bbd52011 Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 21:59:21.811389 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 21:59:21.812927 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41167f320c5d4f7fbf507493bbd52011", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:21.812927 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 21:59:21.812927 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 41167f320c5d4f7fbf507493bbd52011 Oct 12 21:59:21.812927 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 21:59:21.812927 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-AggregatesAdminNegativeTestJSON-493335821-project Oct 12 21:59:21.812927 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 21:59:21.812927 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 21:59:21.812927 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 3f8d0f8194bc4bfdb6ec664b74cd3e98 Oct 12 21:59:21.812927 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-493335821-project Oct 12 21:59:21.812927 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 21:59:21.812927 n-d-861111-1 devstack@n-api.service[120452]: {"add_host": {"host": "n-h1-861111-1"}} Oct 12 21:59:21.812927 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 21:59:21.812927 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-861111-1'}}} Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:21.813781 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 12 21:59:21.814893 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:21.817803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d64af5c8-208e-4f2d-a4dd-727df9db57c3 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:21.817803 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d64af5c8-208e-4f2d-a4dd-727df9db57c3 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.642917 Oct 12 21:59:21.822298 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 16/46] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 12 21:59:21 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 646 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 21:59:21.826948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fa29eb9d-0673-492d-914c-f49767e16fb4 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:21.861316 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fa29eb9d-0673-492d-914c-f49767e16fb4 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.037667 Oct 12 21:59:21.867595 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 31/47] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 21:59:21 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 21:59:21.873106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2adf462d-d8ec-400f-bf52-51f514ef6eb2 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1935148201"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:21.876566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.aggregate [None req-2adf462d-d8ec-400f-bf52-51f514ef6eb2 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Generated uuid add075ef-3840-4209-b3a3-a6011ce015d5 for aggregate {{(pid=120452) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 21:59:21.903929 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2adf462d-d8ec-400f-bf52-51f514ef6eb2 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.033012 Oct 12 21:59:21.904780 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 17/48] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 21:59:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:21.918052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-176afc79-606f-4331-a717-e43ddc8ebd34 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1314391936"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:21.942074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-176afc79-606f-4331-a717-e43ddc8ebd34 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:21.942774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-176afc79-606f-4331-a717-e43ddc8ebd34 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:21.944274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-176afc79-606f-4331-a717-e43ddc8ebd34 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:21.961921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-176afc79-606f-4331-a717-e43ddc8ebd34 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:21.964136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-176afc79-606f-4331-a717-e43ddc8ebd34 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:21.964785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-176afc79-606f-4331-a717-e43ddc8ebd34 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:22.001227 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-176afc79-606f-4331-a717-e43ddc8ebd34 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1314391936 could not be found. Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-176afc79-606f-4331-a717-e43ddc8ebd34 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Request method failure captured: Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 58 Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzizFbmbzzw4MmGDEmAs8A1yFrFGWLtvpWq3MvkgjiLwjw2AFBoxm5OdAEJDtOSu9t7M8hwMykVeBCqlC1RC2fZ9pe6LCh0dNzHTAxSZ-6Skd3PaUuitsryIrbr9CLPWQAJmwegHlYRRzmbJHMc11PmgVUevVXpjTFgLdMHjff43Kco Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1dd953b9ffe14b04a7dae3549a941ec9 Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 21:59:22.016499 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 21:59:22.017842 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1dd953b9ffe14b04a7dae3549a941ec9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:22.017842 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:22.017842 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1dd953b9ffe14b04a7dae3549a941ec9 Oct 12 21:59:22.017842 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:22.017842 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin Oct 12 21:59:22.017842 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:22.017842 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:22.017842 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 99c714101346471baff51bba8bd22dc1 Oct 12 21:59:22.017842 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin Oct 12 21:59:22.017842 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 21:59:22.017842 n-d-861111-1 devstack@n-api.service[120453]: {"add_host": {"host": "tempest-nonexist_host-1314391936"}} Oct 12 21:59:22.017842 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: exception: Compute host tempest-nonexist_host-1314391936 could not be found. Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1314391936'}}} Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1314391936' is not mapped to any cell Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:22.018543 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 12 21:59:22.019757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1314391936 could not be found. Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1314391936 could not be found. Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:22.020910 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:22.022107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:22.022107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:22.022107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:22.022107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:59:22.022107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:59:22.022107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1314391936 could not be found. Oct 12 21:59:22.022107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:22.025021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-176afc79-606f-4331-a717-e43ddc8ebd34 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1314391936 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:22.027387 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-176afc79-606f-4331-a717-e43ddc8ebd34 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.114684 Oct 12 21:59:22.029301 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 32/49] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 12 21:59:21 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:22.038030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1b951b9e-63a4-4e75-8920-c74aee4c145a tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:22.078342 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1b951b9e-63a4-4e75-8920-c74aee4c145a tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.045533 Oct 12 21:59:22.081546 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 18/50] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 21:59:22 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 21:59:22.096732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7704dcac-3196-4d23-a78b-f370d2830144 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7704dcac-3196-4d23-a78b-f370d2830144 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Request method failure captured: Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 283 Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzizFbmbzzw4MmGDEmAs8A1yFrFGWLtvpWq3MvkgjiLwjw2AFBoxm5OdAEJDtOSu9t7M8hwMykVeBCqlC1RC2fZ9pe6LCh0dNzHTAxSZ-6Skd3PaUuitsryIrbr9CLPWQAJmwegHlYRRzmbJHMc11PmgVUevVXpjTFgLdMHjff43Kco Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1dd953b9ffe14b04a7dae3549a941ec9 Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 21:59:22.106446 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 21:59:22.107582 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1dd953b9ffe14b04a7dae3549a941ec9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:22.107582 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:22.107582 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1dd953b9ffe14b04a7dae3549a941ec9 Oct 12 21:59:22.107582 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:22.107582 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin Oct 12 21:59:22.107582 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 21:59:22.107582 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 21:59:22.107582 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 99c714101346471baff51bba8bd22dc1 Oct 12 21:59:22.107582 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin Oct 12 21:59:22.107582 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 21:59:22.108060 n-d-861111-1 devstack@n-api.service[120452]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 12 21:59:22.108060 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 21:59:22.108060 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 21:59:22.108060 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 12 21:59:22.108060 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:22.108060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:22.108060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 21:59:22.108060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 21:59:22.108060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 21:59:22.108060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 21:59:22.108545 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 21:59:22.108545 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:22.108545 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 12 21:59:22.108545 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 21:59:22.108545 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:22.108545 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 12 21:59:22.108545 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 12 21:59:22.108545 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:22.108545 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:22.108545 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:22.108545 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:22.108545 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:22.108545 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:22.108545 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:22.108545 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:22.108545 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:22.108545 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:22.109314 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 21:59:22.109314 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 21:59:22.109314 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 21:59:22.109314 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 21:59:22.109314 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 21:59:22.109314 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 21:59:22.109314 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 21:59:22.109314 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 21:59:22.109314 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 21:59:22.109314 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:22.109314 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:22.109314 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:22.109314 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:22.109314 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:22.109314 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:22.109996 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 21:59:22.109996 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 21:59:22.109996 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 21:59:22.109996 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:22.111192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7704dcac-3196-4d23-a78b-f370d2830144 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:22.113360 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7704dcac-3196-4d23-a78b-f370d2830144 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.027396 Oct 12 21:59:22.114800 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 19/51] 10.222.0.16 () {60 vars in 1165 bytes} [Wed Oct 12 21:59:22 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 21:59:22.132071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e021e8b3-924f-4f35-a13f-e223aacf3526 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:22.134099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e021e8b3-924f-4f35-a13f-e223aacf3526 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:22.160842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e021e8b3-924f-4f35-a13f-e223aacf3526 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:22.163724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e021e8b3-924f-4f35-a13f-e223aacf3526 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:22.165148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e021e8b3-924f-4f35-a13f-e223aacf3526 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:22.167377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e021e8b3-924f-4f35-a13f-e223aacf3526 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:22.168962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e021e8b3-924f-4f35-a13f-e223aacf3526 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:22.171302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e021e8b3-924f-4f35-a13f-e223aacf3526 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:22.566662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-731828489", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "availability_zone": "tempest-test_az-1158724145"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:22.594196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:22.596710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:22.597635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:22.602036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:22.603281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:22.603957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:22.742705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] validate_networks() for None {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 21:59:23.223473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 21:59:23.224574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 21:59:23.225274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 21:59:23.225863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 21:59:23.226497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 21:59:23.249917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:23.250749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:23.251391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:23.252313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:23.252986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:23.254075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:23.299521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Getting quotas for project 83e13591fa0c4a789d71e35d18f97f37. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 21:59:23.304534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Getting quotas for user 8c7541fc7fee4bb0a911a3a211edd010 and project 83e13591fa0c4a789d71e35d18f97f37. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 21:59:23.329703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 21:59:23.332371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 21:59:23.425519 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1c137eda-4d67-4435-a56e-d8415eb98ed1 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.384268 Oct 12 21:59:23.432776 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 33/52] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 21:59:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 21:59:23.443889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a4988c24-288e-44ba-8b45-194282dd39f8 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a4988c24-288e-44ba-8b45-194282dd39f8 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Request method failure captured: Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 27 Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzizFbmbzzw4MmGDEmAs8A1yFrFGWLtvpWq3MvkgjiLwjw2AFBoxm5OdAEJDtOSu9t7M8hwMykVeBCqlC1RC2fZ9pe6LCh0dNzHTAxSZ-6Skd3PaUuitsryIrbr9CLPWQAJmwegHlYRRzmbJHMc11PmgVUevVXpjTFgLdMHjff43Kco Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1dd953b9ffe14b04a7dae3549a941ec9 Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 21:59:23.448486 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 21:59:23.449523 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1dd953b9ffe14b04a7dae3549a941ec9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:23.449523 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:23.449523 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1dd953b9ffe14b04a7dae3549a941ec9 Oct 12 21:59:23.449523 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:23.449523 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin Oct 12 21:59:23.449523 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:23.449523 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:23.449523 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 99c714101346471baff51bba8bd22dc1 Oct 12 21:59:23.449523 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin Oct 12 21:59:23.449523 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 21:59:23.449523 n-d-861111-1 devstack@n-api.service[120453]: {"aggregate": {"name": ""}} Oct 12 21:59:23.449523 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 21:59:23.449523 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi '' Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:23.450156 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 12 21:59:23.451876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:23.452948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a4988c24-288e-44ba-8b45-194282dd39f8 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:23.452948 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a4988c24-288e-44ba-8b45-194282dd39f8 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.015869 Oct 12 21:59:23.464169 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 34/53] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 21:59:23 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 21:59:23.469413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-407a0551-7ff4-4cc8-9f71-f50a3800dc8b tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:23.470032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-407a0551-7ff4-4cc8-9f71-f50a3800dc8b tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:23.599851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-407a0551-7ff4-4cc8-9f71-f50a3800dc8b tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:23.607156 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-407a0551-7ff4-4cc8-9f71-f50a3800dc8b tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1242 microversion: 2.1 time: 0.142135 Oct 12 21:59:23.627099 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 35/54] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:23 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1242 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:23.634177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0f4562fb-0774-4a99-81c4-e2d0c2eab55e tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1556230823"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:23.645361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0f4562fb-0774-4a99-81c4-e2d0c2eab55e tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '3f8d0f8194bc4bfdb6ec664b74cd3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41167f320c5d4f7fbf507493bbd52011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0f4562fb-0774-4a99-81c4-e2d0c2eab55e tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Request method failure captured: Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 60 Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRziw7sBUmqVgnlVnGeqzadideJY0q4eDK4Xm2VdEtBEtelMi3J6ahPto8hQoBax-1kGt6oT7bwtLMqMdVa2FgocJAh8BYFQCvn0574AZIlB0jE2oUl6gwM4HBI7QpnrMjMW9Kzpjwia1bFP1-Eb3HzkXB5N4aoh642oazstPm4GhMzo Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 41167f320c5d4f7fbf507493bbd52011 Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 21:59:23.647256 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 21:59:23.648602 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41167f320c5d4f7fbf507493bbd52011", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:23.648602 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 21:59:23.648602 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 41167f320c5d4f7fbf507493bbd52011 Oct 12 21:59:23.648602 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 21:59:23.648602 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AggregatesAdminNegativeTestJSON-493335821-project Oct 12 21:59:23.648602 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:23.648602 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:23.648602 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 3f8d0f8194bc4bfdb6ec664b74cd3e98 Oct 12 21:59:23.648602 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-493335821-project Oct 12 21:59:23.648602 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 21:59:23.648602 n-d-861111-1 devstack@n-api.service[120453]: {"aggregate": {"name": "tempest-test_aggregate-1556230823"}} Oct 12 21:59:23.648602 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 21:59:23.648602 n-d-861111-1 devstack@n-api.service[120453]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1556230823'}}} Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 21:59:23.649400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 21:59:23.650524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 12 21:59:23.651732 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:23.652498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0f4562fb-0774-4a99-81c4-e2d0c2eab55e tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:23.660629 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0f4562fb-0774-4a99-81c4-e2d0c2eab55e tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.032202 Oct 12 21:59:23.667960 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 36/55] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 21:59:23 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:23.674252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6291e185-afe4-4a6e-a6fc-0dfdf4da74ac tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-442013360"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:23.684436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.aggregate [None req-6291e185-afe4-4a6e-a6fc-0dfdf4da74ac tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Generated uuid 6d77a14d-cdc1-47da-a847-ccaffe6ec76e for aggregate {{(pid=120453) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 21:59:23.743827 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6291e185-afe4-4a6e-a6fc-0dfdf4da74ac tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.074454 Oct 12 21:59:23.751670 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 37/56] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 21:59:23 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:23.772032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cec31abb-fdf5-4e22-b9e8-df5060f5f7ed tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-442013360"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:23.787361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.aggregate [None req-cec31abb-fdf5-4e22-b9e8-df5060f5f7ed tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Generated uuid 80698ac6-bc8e-4a45-bd2a-c81a5c81e66a for aggregate {{(pid=120453) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 21:59:23.816641 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-cec31abb-fdf5-4e22-b9e8-df5060f5f7ed tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-442013360 already exists. Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cec31abb-fdf5-4e22-b9e8-df5060f5f7ed tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Request method failure captured: Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 59 Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzizFbmbzzw4MmGDEmAs8A1yFrFGWLtvpWq3MvkgjiLwjw2AFBoxm5OdAEJDtOSu9t7M8hwMykVeBCqlC1RC2fZ9pe6LCh0dNzHTAxSZ-6Skd3PaUuitsryIrbr9CLPWQAJmwegHlYRRzmbJHMc11PmgVUevVXpjTFgLdMHjff43Kco Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1dd953b9ffe14b04a7dae3549a941ec9 Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 21:59:23.819109 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 21:59:23.820853 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1dd953b9ffe14b04a7dae3549a941ec9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:23.820853 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:23.820853 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1dd953b9ffe14b04a7dae3549a941ec9 Oct 12 21:59:23.820853 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:23.820853 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin Oct 12 21:59:23.820853 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:23.820853 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:23.820853 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 99c714101346471baff51bba8bd22dc1 Oct 12 21:59:23.820853 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin Oct 12 21:59:23.820853 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 21:59:23.820853 n-d-861111-1 devstack@n-api.service[120453]: {"aggregate": {"name": "tempest-test_aggregate-442013360"}} Oct 12 21:59:23.820853 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 21:59:23.820853 n-d-861111-1 devstack@n-api.service[120453]: exception: Aggregate tempest-test_aggregate-442013360 already exists. Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-442013360'}}} Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 12 21:59:23.821511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-442013360 already exists. Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 21:59:23.822432 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 12 21:59:23.823448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 12 21:59:23.823448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-442013360 already exists. Oct 12 21:59:23.823448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:23.823448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:23.823448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:23.823448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:23.823448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:23.823448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:23.823448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:59:23.823448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:59:23.823448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-442013360 already exists. Oct 12 21:59:23.823448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:23.825526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cec31abb-fdf5-4e22-b9e8-df5060f5f7ed tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-442013360 already exists. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:23.832271 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cec31abb-fdf5-4e22-b9e8-df5060f5f7ed tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.079283 Oct 12 21:59:23.833146 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 38/57] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 21:59:23 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 21:59:23.842086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb2c071f-9c5b-4f1c-9273-8c0ae715a9b1 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:23.916969 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cb2c071f-9c5b-4f1c-9273-8c0ae715a9b1 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.079158 Oct 12 21:59:23.917776 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 39/58] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 21:59:23 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 12 21:59:23.926504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b603da01-3160-4ab6-a438-6da71d47fb26 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1001248976"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:23.931291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.aggregate [None req-b603da01-3160-4ab6-a438-6da71d47fb26 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Generated uuid 048af950-299d-4322-86ea-9b82b745e8e9 for aggregate {{(pid=120453) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 21:59:23.996798 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b603da01-3160-4ab6-a438-6da71d47fb26 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.073758 Oct 12 21:59:24.000214 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 40/59] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 21:59:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 21:59:24.017323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5c10ee12-bb5a-4c1e-98aa-fe15bf654509 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:24.020671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5c10ee12-bb5a-4c1e-98aa-fe15bf654509 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '3f8d0f8194bc4bfdb6ec664b74cd3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41167f320c5d4f7fbf507493bbd52011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5c10ee12-bb5a-4c1e-98aa-fe15bf654509 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Request method failure captured: Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRziw7sBUmqVgnlVnGeqzadideJY0q4eDK4Xm2VdEtBEtelMi3J6ahPto8hQoBax-1kGt6oT7bwtLMqMdVa2FgocJAh8BYFQCvn0574AZIlB0jE2oUl6gwM4HBI7QpnrMjMW9Kzpjwia1bFP1-Eb3HzkXB5N4aoh642oazstPm4GhMzo Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 41167f320c5d4f7fbf507493bbd52011 Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 21:59:24.026263 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 21:59:24.027371 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41167f320c5d4f7fbf507493bbd52011", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:24.027371 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 21:59:24.027371 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 41167f320c5d4f7fbf507493bbd52011 Oct 12 21:59:24.027371 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 21:59:24.027371 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AggregatesAdminNegativeTestJSON-493335821-project Oct 12 21:59:24.027371 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:24.027371 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:24.027371 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 3f8d0f8194bc4bfdb6ec664b74cd3e98 Oct 12 21:59:24.027371 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-493335821-project Oct 12 21:59:24.027371 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 21:59:24.027371 n-d-861111-1 devstack@n-api.service[120453]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 12 21:59:24.027371 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '6'} Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:24.027980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 21:59:24.029033 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 21:59:24.029033 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 21:59:24.029033 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 21:59:24.029033 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 21:59:24.029033 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 21:59:24.029033 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 12 21:59:24.029033 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.029033 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:24.029033 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.029033 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:24.029033 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:24.029033 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:24.029033 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 21:59:24.029033 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 21:59:24.029033 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 12 21:59:24.029033 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.034797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5c10ee12-bb5a-4c1e-98aa-fe15bf654509 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:24.036119 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5c10ee12-bb5a-4c1e-98aa-fe15bf654509 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.023786 Oct 12 21:59:24.043482 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 41/60] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 21:59:24 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:24.058682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5dc8cbef-b2c9-423b-aecf-19485d2939d8 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:24.126167 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5dc8cbef-b2c9-423b-aecf-19485d2939d8 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.081279 Oct 12 21:59:24.132148 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 42/61] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 21:59:24 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 21:59:24.146404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-616c50d3-6149-48d8-bcb0-c76794528ce6 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:24.186141 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-616c50d3-6149-48d8-bcb0-c76794528ce6 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-616c50d3-6149-48d8-bcb0-c76794528ce6 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Request method failure captured: Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzizFbmbzzw4MmGDEmAs8A1yFrFGWLtvpWq3MvkgjiLwjw2AFBoxm5OdAEJDtOSu9t7M8hwMykVeBCqlC1RC2fZ9pe6LCh0dNzHTAxSZ-6Skd3PaUuitsryIrbr9CLPWQAJmwegHlYRRzmbJHMc11PmgVUevVXpjTFgLdMHjff43Kco Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1dd953b9ffe14b04a7dae3549a941ec9 Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 21:59:24.188040 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 21:59:24.189340 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1dd953b9ffe14b04a7dae3549a941ec9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:24.189340 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:24.189340 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1dd953b9ffe14b04a7dae3549a941ec9 Oct 12 21:59:24.189340 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:24.189340 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin Oct 12 21:59:24.189340 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:24.189340 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:24.189340 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 99c714101346471baff51bba8bd22dc1 Oct 12 21:59:24.189340 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin Oct 12 21:59:24.189340 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 21:59:24.189340 n-d-861111-1 devstack@n-api.service[120453]: exception: Aggregate -1 could not be found. Oct 12 21:59:24.189340 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '-1'} Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 21:59:24.190051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.190980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:24.192020 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:24.192020 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:24.192020 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:59:24.192020 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:59:24.192020 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 12 21:59:24.192020 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.205099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-616c50d3-6149-48d8-bcb0-c76794528ce6 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:24.205841 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-616c50d3-6149-48d8-bcb0-c76794528ce6 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.068035 Oct 12 21:59:24.210506 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 43/62] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 12 21:59:24 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 21:59:24.220970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0f275081-3b0f-49f8-939e-eca0141527ee tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1286284359"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:24.234634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.aggregate [None req-0f275081-3b0f-49f8-939e-eca0141527ee tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Generated uuid b6b77108-a85e-44e4-b87c-615bf7d1951c for aggregate {{(pid=120453) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 21:59:24.294158 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0f275081-3b0f-49f8-939e-eca0141527ee tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.079262 Oct 12 21:59:24.303778 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 44/63] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 21:59:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 21:59:24.340545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2edbd61a-762b-4bbb-9940-f024caf595cb tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:24.347881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2edbd61a-762b-4bbb-9940-f024caf595cb tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '3f8d0f8194bc4bfdb6ec664b74cd3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41167f320c5d4f7fbf507493bbd52011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2edbd61a-762b-4bbb-9940-f024caf595cb tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Request method failure captured: Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRziw7sBUmqVgnlVnGeqzadideJY0q4eDK4Xm2VdEtBEtelMi3J6ahPto8hQoBax-1kGt6oT7bwtLMqMdVa2FgocJAh8BYFQCvn0574AZIlB0jE2oUl6gwM4HBI7QpnrMjMW9Kzpjwia1bFP1-Eb3HzkXB5N4aoh642oazstPm4GhMzo Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 41167f320c5d4f7fbf507493bbd52011 Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 21:59:24.352654 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 21:59:24.354054 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41167f320c5d4f7fbf507493bbd52011", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:24.354054 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 21:59:24.354054 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 41167f320c5d4f7fbf507493bbd52011 Oct 12 21:59:24.354054 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 21:59:24.354054 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AggregatesAdminNegativeTestJSON-493335821-project Oct 12 21:59:24.354054 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:24.354054 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:24.354054 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 3f8d0f8194bc4bfdb6ec664b74cd3e98 Oct 12 21:59:24.354054 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-493335821-project Oct 12 21:59:24.354054 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 21:59:24.354054 n-d-861111-1 devstack@n-api.service[120453]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 12 21:59:24.354054 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '7'} Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:24.354656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 21:59:24.355586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 21:59:24.355586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 21:59:24.355586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 21:59:24.355586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 21:59:24.355586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 21:59:24.355586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 12 21:59:24.355586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.355586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:24.355586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.355586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:24.355586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:24.355586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:24.355586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 21:59:24.355586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 21:59:24.355586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 12 21:59:24.355586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.369990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2edbd61a-762b-4bbb-9940-f024caf595cb tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:24.372801 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2edbd61a-762b-4bbb-9940-f024caf595cb tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.058137 Oct 12 21:59:24.376879 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 45/64] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 12 21:59:24 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 62 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:24.401859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6a2eea46-99ec-4538-b419-8d52ab2cf9eb tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:24.488063 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6a2eea46-99ec-4538-b419-8d52ab2cf9eb tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.105808 Oct 12 21:59:24.490964 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 46/65] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 21:59:24 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 21:59:24.503132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d9ab3101-4bbd-4f49-bd14-558027a202b0 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:24.525441 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-d9ab3101-4bbd-4f49-bd14-558027a202b0 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d9ab3101-4bbd-4f49-bd14-558027a202b0 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Request method failure captured: Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzizFbmbzzw4MmGDEmAs8A1yFrFGWLtvpWq3MvkgjiLwjw2AFBoxm5OdAEJDtOSu9t7M8hwMykVeBCqlC1RC2fZ9pe6LCh0dNzHTAxSZ-6Skd3PaUuitsryIrbr9CLPWQAJmwegHlYRRzmbJHMc11PmgVUevVXpjTFgLdMHjff43Kco Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1dd953b9ffe14b04a7dae3549a941ec9 Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 21:59:24.542626 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 21:59:24.543862 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1dd953b9ffe14b04a7dae3549a941ec9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:24.543862 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:24.543862 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1dd953b9ffe14b04a7dae3549a941ec9 Oct 12 21:59:24.543862 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 21:59:24.543862 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin Oct 12 21:59:24.543862 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:24.543862 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:24.543862 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 99c714101346471baff51bba8bd22dc1 Oct 12 21:59:24.543862 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin Oct 12 21:59:24.543862 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 21:59:24.543862 n-d-861111-1 devstack@n-api.service[120453]: exception: Aggregate -1 could not be found. Oct 12 21:59:24.543862 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '-1'} Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:24.544512 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 12 21:59:24.545475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.546379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d9ab3101-4bbd-4f49-bd14-558027a202b0 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:24.548604 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d9ab3101-4bbd-4f49-bd14-558027a202b0 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.050173 Oct 12 21:59:24.554335 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 47/66] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 21:59:24 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 21:59:24.571680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ca7ba77a-7973-4330-8761-cbd84d525dd0 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:24.580524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ca7ba77a-7973-4330-8761-cbd84d525dd0 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '3f8d0f8194bc4bfdb6ec664b74cd3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41167f320c5d4f7fbf507493bbd52011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ca7ba77a-7973-4330-8761-cbd84d525dd0 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Request method failure captured: Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRziw7sBUmqVgnlVnGeqzadideJY0q4eDK4Xm2VdEtBEtelMi3J6ahPto8hQoBax-1kGt6oT7bwtLMqMdVa2FgocJAh8BYFQCvn0574AZIlB0jE2oUl6gwM4HBI7QpnrMjMW9Kzpjwia1bFP1-Eb3HzkXB5N4aoh642oazstPm4GhMzo Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 41167f320c5d4f7fbf507493bbd52011 Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 21:59:24.598662 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 21:59:24.600104 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41167f320c5d4f7fbf507493bbd52011", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:24.600104 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 21:59:24.600104 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 41167f320c5d4f7fbf507493bbd52011 Oct 12 21:59:24.600104 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 21:59:24.600104 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AggregatesAdminNegativeTestJSON-493335821-project Oct 12 21:59:24.600104 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:24.600104 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:24.600104 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 3f8d0f8194bc4bfdb6ec664b74cd3e98 Oct 12 21:59:24.600104 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-493335821-project Oct 12 21:59:24.600104 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 21:59:24.600104 n-d-861111-1 devstack@n-api.service[120453]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 12 21:59:24.600104 n-d-861111-1 devstack@n-api.service[120453]: action_args: {} Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:24.600787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 21:59:24.602277 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 21:59:24.602277 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 21:59:24.602277 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 21:59:24.602277 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 21:59:24.602277 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 21:59:24.602277 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 12 21:59:24.602277 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.602277 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:24.602277 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.602277 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:24.602277 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:24.602277 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:24.602277 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 21:59:24.602277 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 21:59:24.602277 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 12 21:59:24.602277 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:24.610026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ca7ba77a-7973-4330-8761-cbd84d525dd0 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:24.615913 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ca7ba77a-7973-4330-8761-cbd84d525dd0 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.052915 Oct 12 21:59:24.617919 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 48/67] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 12 21:59:24 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 60 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:24.655031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-78e68f29-92b2-4c96-9a29-cbd0d5a3b5ef tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:24.659398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-78e68f29-92b2-4c96-9a29-cbd0d5a3b5ef tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:24.918588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-78e68f29-92b2-4c96-9a29-cbd0d5a3b5ef tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:24.933196 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-78e68f29-92b2-4c96-9a29-cbd0d5a3b5ef tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1242 microversion: 2.1 time: 0.298047 Oct 12 21:59:24.933856 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 49/68] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:24 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1242 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:25.961900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a07fbeaa-3092-4aa2-b75c-0ad3347c1cc0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:25.964129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a07fbeaa-3092-4aa2-b75c-0ad3347c1cc0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:25.966610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=9,nova_api:INSERT=9 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:25.985855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a07fbeaa-3092-4aa2-b75c-0ad3347c1cc0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:25.986941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a07fbeaa-3092-4aa2-b75c-0ad3347c1cc0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:25.988889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a07fbeaa-3092-4aa2-b75c-0ad3347c1cc0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:25.992791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a07fbeaa-3092-4aa2-b75c-0ad3347c1cc0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:25.995137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a07fbeaa-3092-4aa2-b75c-0ad3347c1cc0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:25.996546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a07fbeaa-3092-4aa2-b75c-0ad3347c1cc0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:26.330870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e021e8b3-924f-4f35-a13f-e223aacf3526 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:26.378131 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e021e8b3-924f-4f35-a13f-e223aacf3526 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1342 microversion: 2.1 time: 4.251499 Oct 12 21:59:26.378729 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 20/69] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:22 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1342 bytes in 4253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:26.905443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a07fbeaa-3092-4aa2-b75c-0ad3347c1cc0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:26.917756 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a07fbeaa-3092-4aa2-b75c-0ad3347c1cc0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1242 microversion: 2.1 time: 0.961245 Oct 12 21:59:26.926892 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 50/70] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:25 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1242 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:27.407412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49464f01-6a91-4126-9139-f01b4e6fa493 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:27.409439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-49464f01-6a91-4126-9139-f01b4e6fa493 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:27.414900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:27.427907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49464f01-6a91-4126-9139-f01b4e6fa493 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:27.432554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49464f01-6a91-4126-9139-f01b4e6fa493 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:27.433672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49464f01-6a91-4126-9139-f01b4e6fa493 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:27.435682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49464f01-6a91-4126-9139-f01b4e6fa493 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:27.436463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49464f01-6a91-4126-9139-f01b4e6fa493 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:27.437127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49464f01-6a91-4126-9139-f01b4e6fa493 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:27.948677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f92e47d6-113f-4725-a87b-61a4ede74d47 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:27.950514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f92e47d6-113f-4725-a87b-61a4ede74d47 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:27.968832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f92e47d6-113f-4725-a87b-61a4ede74d47 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:27.972271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f92e47d6-113f-4725-a87b-61a4ede74d47 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:27.973554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f92e47d6-113f-4725-a87b-61a4ede74d47 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:27.985832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f92e47d6-113f-4725-a87b-61a4ede74d47 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:27.988383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f92e47d6-113f-4725-a87b-61a4ede74d47 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:27.989048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f92e47d6-113f-4725-a87b-61a4ede74d47 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:28.333179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f92e47d6-113f-4725-a87b-61a4ede74d47 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:28.352923 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f92e47d6-113f-4725-a87b-61a4ede74d47 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1296 microversion: 2.1 time: 0.412293 Oct 12 21:59:28.353723 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 51/71] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:27 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1296 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 21:59:28.364035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-49464f01-6a91-4126-9139-f01b4e6fa493 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:28.383474 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-49464f01-6a91-4126-9139-f01b4e6fa493 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1342 microversion: 2.1 time: 0.978828 Oct 12 21:59:28.387446 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 21/72] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:27 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1342 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:29.375970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-54036227-d111-4397-9431-02e59ffa902f tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:29.376739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-54036227-d111-4397-9431-02e59ffa902f tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:29.392892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-54036227-d111-4397-9431-02e59ffa902f tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:29.393448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-54036227-d111-4397-9431-02e59ffa902f tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:29.393848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-54036227-d111-4397-9431-02e59ffa902f tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:29.394581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-54036227-d111-4397-9431-02e59ffa902f tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:29.401490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-54036227-d111-4397-9431-02e59ffa902f tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:29.402124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-54036227-d111-4397-9431-02e59ffa902f tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:29.420039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0b68bf00-45a3-4270-9ae2-23ee71564c88 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:29.421539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0b68bf00-45a3-4270-9ae2-23ee71564c88 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:29.432480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b68bf00-45a3-4270-9ae2-23ee71564c88 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:29.434810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b68bf00-45a3-4270-9ae2-23ee71564c88 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:29.435461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b68bf00-45a3-4270-9ae2-23ee71564c88 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:29.439620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b68bf00-45a3-4270-9ae2-23ee71564c88 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:29.441925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b68bf00-45a3-4270-9ae2-23ee71564c88 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:29.442600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b68bf00-45a3-4270-9ae2-23ee71564c88 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:29.721522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-54036227-d111-4397-9431-02e59ffa902f tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:29.734715 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-54036227-d111-4397-9431-02e59ffa902f tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1296 microversion: 2.1 time: 0.362409 Oct 12 21:59:29.735398 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 52/73] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:29 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1296 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:29.996207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0b68bf00-45a3-4270-9ae2-23ee71564c88 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:30.005216 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0b68bf00-45a3-4270-9ae2-23ee71564c88 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1342 microversion: 2.1 time: 0.592405 Oct 12 21:59:30.011386 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 22/74] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:29 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1342 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:30.764736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d359bc21-94e5-4c11-a8f1-c044b88f1e6c tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:30.765419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d359bc21-94e5-4c11-a8f1-c044b88f1e6c tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:30.785474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d359bc21-94e5-4c11-a8f1-c044b88f1e6c tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:30.794970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d359bc21-94e5-4c11-a8f1-c044b88f1e6c tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:30.799262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d359bc21-94e5-4c11-a8f1-c044b88f1e6c tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:30.801230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d359bc21-94e5-4c11-a8f1-c044b88f1e6c tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:30.804528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d359bc21-94e5-4c11-a8f1-c044b88f1e6c tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:30.807287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d359bc21-94e5-4c11-a8f1-c044b88f1e6c tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:31.037919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d359bc21-94e5-4c11-a8f1-c044b88f1e6c tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:31.048832 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d359bc21-94e5-4c11-a8f1-c044b88f1e6c tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1296 microversion: 2.1 time: 0.292053 Oct 12 21:59:31.050302 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 23/75] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:30 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1296 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 21:59:31.056868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ed881e00-a652-4852-adfd-530297309ae6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:31.057780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ed881e00-a652-4852-adfd-530297309ae6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:31.065903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed881e00-a652-4852-adfd-530297309ae6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:31.066820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed881e00-a652-4852-adfd-530297309ae6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:31.067543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed881e00-a652-4852-adfd-530297309ae6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:31.068671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed881e00-a652-4852-adfd-530297309ae6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:31.071295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed881e00-a652-4852-adfd-530297309ae6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:31.072987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed881e00-a652-4852-adfd-530297309ae6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:31.113844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a1c761f6-5083-4433-9b3a-15a2d08f82a2 req-4dc3afb3-913e-43cd-ae2d-20fb934da321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373004a6-fff2-4a8c-95d7-3d33ef32f89d", "tag": "614ffa2d-72a9-4c09-8791-293fc379f766"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:31.159019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a1c761f6-5083-4433-9b3a-15a2d08f82a2 req-4dc3afb3-913e-43cd-ae2d-20fb934da321 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:31.164743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a1c761f6-5083-4433-9b3a-15a2d08f82a2 req-4dc3afb3-913e-43cd-ae2d-20fb934da321 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:31.169748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a1c761f6-5083-4433-9b3a-15a2d08f82a2 req-4dc3afb3-913e-43cd-ae2d-20fb934da321 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:31.223318 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a1c761f6-5083-4433-9b3a-15a2d08f82a2 req-4dc3afb3-913e-43cd-ae2d-20fb934da321 service nova] Creating event network-changed:614ffa2d-72a9-4c09-8791-293fc379f766 for instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d on n-h1-861111-1 Oct 12 21:59:31.224096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a1c761f6-5083-4433-9b3a-15a2d08f82a2 req-4dc3afb3-913e-43cd-ae2d-20fb934da321 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 21:59:31.224723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a1c761f6-5083-4433-9b3a-15a2d08f82a2 req-4dc3afb3-913e-43cd-ae2d-20fb934da321 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 21:59:31.227321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a428edae-71af-4c4b-a9db-36d5bf1bf563 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:31.227946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a428edae-71af-4c4b-a9db-36d5bf1bf563 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:31.228520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a428edae-71af-4c4b-a9db-36d5bf1bf563 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:31.229405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a428edae-71af-4c4b-a9db-36d5bf1bf563 None None] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:31.230014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a428edae-71af-4c4b-a9db-36d5bf1bf563 None None] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:31.230573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a428edae-71af-4c4b-a9db-36d5bf1bf563 None None] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:31.242436 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.compute.rpcapi [None req-a428edae-71af-4c4b-a9db-36d5bf1bf563 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 12 21:59:31.243620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a428edae-71af-4c4b-a9db-36d5bf1bf563 None None] Releasing lock "compute-rpcapi-router" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 21:59:31.266265 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a428edae-71af-4c4b-a9db-36d5bf1bf563 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.788602 Oct 12 21:59:31.267981 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 53/76] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 21:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:31.621241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ed881e00-a652-4852-adfd-530297309ae6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:31.632018 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ed881e00-a652-4852-adfd-530297309ae6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1342 microversion: 2.1 time: 0.580443 Oct 12 21:59:31.647517 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 24/77] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:31 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1342 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:32.078788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bfa998e4-c083-4775-915d-1f02b26eb532 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:32.080193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bfa998e4-c083-4775-915d-1f02b26eb532 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:32.107295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfa998e4-c083-4775-915d-1f02b26eb532 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:32.109861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfa998e4-c083-4775-915d-1f02b26eb532 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:32.111403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfa998e4-c083-4775-915d-1f02b26eb532 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:32.115444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfa998e4-c083-4775-915d-1f02b26eb532 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:32.120597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfa998e4-c083-4775-915d-1f02b26eb532 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:32.124267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfa998e4-c083-4775-915d-1f02b26eb532 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:32.304374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ed881e00-a652-4852-adfd-530297309ae6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:32.306340 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ed881e00-a652-4852-adfd-530297309ae6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002299 Oct 12 21:59:32.306832 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 25/78] 10.222.0.16 () {56 vars in 886 bytes} [Wed Oct 12 21:59:32 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 21:59:33.087740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0855711c-83ac-406a-8a7b-eec1221619c6 tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-670871649", "id": 244008358, "os-flavor-access:is_public": "False"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:33.141653 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0855711c-83ac-406a-8a7b-eec1221619c6 tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.635467 Oct 12 21:59:33.154464 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 26/79] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 21:59:32 2022] POST /compute/v2.1/flavors => generated 427 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:33.168030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-33c7d954-86fe-4b06-8bdf-53f7307c77a6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:33.171828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-33c7d954-86fe-4b06-8bdf-53f7307c77a6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:33.188826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33c7d954-86fe-4b06-8bdf-53f7307c77a6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:33.191744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33c7d954-86fe-4b06-8bdf-53f7307c77a6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:33.194014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33c7d954-86fe-4b06-8bdf-53f7307c77a6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:33.196171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33c7d954-86fe-4b06-8bdf-53f7307c77a6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:33.198955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33c7d954-86fe-4b06-8bdf-53f7307c77a6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:33.199845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33c7d954-86fe-4b06-8bdf-53f7307c77a6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:33.234155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bfa998e4-c083-4775-915d-1f02b26eb532 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:33.244422 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bfa998e4-c083-4775-915d-1f02b26eb532 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1338 microversion: 2.1 time: 1.171065 Oct 12 21:59:33.265007 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 54/80] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:32 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1338 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:33.277630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-be22d234-032e-465d-9bd4-a115702cf092 tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "25581a255dff48f98f712a0fa7da00c8"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:34.010664 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-be22d234-032e-465d-9bd4-a115702cf092 tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/244008358/action" status: 200 len: 96 microversion: 2.1 time: 0.743960 Oct 12 21:59:34.012647 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 55/81] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Oct 12 21:59:33 2022] POST /compute/v2.1/flavors/244008358/action => generated 96 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 21:59:34.571071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-72f9e6b9-a88b-446e-824c-ba82d708e603 tempest-FlavorsAccessTestJSON-746744659 tempest-FlavorsAccessTestJSON-746744659-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:34.631557 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-72f9e6b9-a88b-446e-824c-ba82d708e603 tempest-FlavorsAccessTestJSON-746744659 tempest-FlavorsAccessTestJSON-746744659-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.611087 Oct 12 21:59:34.646644 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 56/82] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 21:59:34 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:34.657749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-964b4b3c-a7a0-4ff5-b02e-999a291eb019 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:34.658605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-964b4b3c-a7a0-4ff5-b02e-999a291eb019 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:34.669158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964b4b3c-a7a0-4ff5-b02e-999a291eb019 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:34.669973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964b4b3c-a7a0-4ff5-b02e-999a291eb019 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:34.670655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964b4b3c-a7a0-4ff5-b02e-999a291eb019 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:34.671614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964b4b3c-a7a0-4ff5-b02e-999a291eb019 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:34.672215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964b4b3c-a7a0-4ff5-b02e-999a291eb019 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:34.673241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964b4b3c-a7a0-4ff5-b02e-999a291eb019 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:34.923389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=20 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:34.941869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-33c7d954-86fe-4b06-8bdf-53f7307c77a6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:34.951276 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-33c7d954-86fe-4b06-8bdf-53f7307c77a6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1342 microversion: 2.1 time: 1.800092 Oct 12 21:59:34.956634 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 27/83] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:33 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1342 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:35.111370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-964b4b3c-a7a0-4ff5-b02e-999a291eb019 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:35.122128 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-964b4b3c-a7a0-4ff5-b02e-999a291eb019 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1338 microversion: 2.1 time: 0.474013 Oct 12 21:59:35.123341 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 57/84] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:34 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1338 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:35.146042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e40f3c9e-f513-4f9b-80d4-68c56c54e66c tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "25581a255dff48f98f712a0fa7da00c8"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:35.283669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ec3f9e4b-8fc6-4b28-b1cc-6b5bff26c3d9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Calling method '.version_select at 0x7f5128e26160>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:35.285605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec3f9e4b-8fc6-4b28-b1cc-6b5bff26c3d9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:35.291292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec3f9e4b-8fc6-4b28-b1cc-6b5bff26c3d9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:35.292503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec3f9e4b-8fc6-4b28-b1cc-6b5bff26c3d9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:35.341239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec3f9e4b-8fc6-4b28-b1cc-6b5bff26c3d9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:35.343804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec3f9e4b-8fc6-4b28-b1cc-6b5bff26c3d9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:35.344273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec3f9e4b-8fc6-4b28-b1cc-6b5bff26c3d9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:35.394393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec3f9e4b-8fc6-4b28-b1cc-6b5bff26c3d9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:35.396319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec3f9e4b-8fc6-4b28-b1cc-6b5bff26c3d9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:35.400109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec3f9e4b-8fc6-4b28-b1cc-6b5bff26c3d9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:35.428132 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ec3f9e4b-8fc6-4b28-b1cc-6b5bff26c3d9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.470124 Oct 12 21:59:35.430349 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 28/85] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 21:59:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:35.614413 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e40f3c9e-f513-4f9b-80d4-68c56c54e66c tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/244008358/action" status: 200 len: 21 microversion: 2.1 time: 0.490521 Oct 12 21:59:35.619007 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 58/86] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Oct 12 21:59:35 2022] POST /compute/v2.1/flavors/244008358/action => generated 21 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 21:59:35.768725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a613f383-e7bd-41cb-8ac0-4b844d4a338d req-15ddf152-c2bf-4cd3-b99c-28f872f082f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946", "tag": "5e230016-d9c7-4177-8e7e-fdca5ec7bf77"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:35.799440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a613f383-e7bd-41cb-8ac0-4b844d4a338d req-15ddf152-c2bf-4cd3-b99c-28f872f082f5 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:35.807379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a613f383-e7bd-41cb-8ac0-4b844d4a338d req-15ddf152-c2bf-4cd3-b99c-28f872f082f5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:35.808172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a613f383-e7bd-41cb-8ac0-4b844d4a338d req-15ddf152-c2bf-4cd3-b99c-28f872f082f5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:35.838828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0c15e60f-52ef-4118-a6c1-c44fb2f022a1 tempest-HypervisorAdminNegativeUnderV252Test-201954673 tempest-HypervisorAdminNegativeUnderV252Test-201954673-project] Calling method '.version_select at 0x7f5128dee040>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:35.841036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0c15e60f-52ef-4118-a6c1-c44fb2f022a1 tempest-HypervisorAdminNegativeUnderV252Test-201954673 tempest-HypervisorAdminNegativeUnderV252Test-201954673-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '5b44f0728b4f4d2d8b4bc39843d2bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01c8c5eacce4abb9d7b1de294e21c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0c15e60f-52ef-4118-a6c1-c44fb2f022a1 tempest-HypervisorAdminNegativeUnderV252Test-201954673 tempest-HypervisorAdminNegativeUnderV252Test-201954673-project] Request method failure captured: Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-hypervisors/n-h1-861111-1/search HTTP/1.1 Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzjEFTIF7GmcuMra7BRVp42wYfuk10GJ9mu-wu-VWQS4cy9TZHi8k9cZXQRsU3BdQqqo2LhirEPIBs39P1NVHO1jUz1shPe1fFuMOizUARxoNVxPfj_eNUZ4DgyZA7W409Wt_6PyFxGpW74r0xi_e7jblL-qurMktNGhn2xayVHcce8 Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: a01c8c5eacce4abb9d7b1de294e21c50 Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-201954673 Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 21:59:35.842999 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 21:59:35.844436 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a01c8c5eacce4abb9d7b1de294e21c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a01c8c5eacce4abb9d7b1de294e21c50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a01c8c5eacce4abb9d7b1de294e21c50", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a01c8c5eacce4abb9d7b1de294e21c50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:35.844436 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-201954673 Oct 12 21:59:35.844436 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: a01c8c5eacce4abb9d7b1de294e21c50 Oct 12 21:59:35.844436 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-201954673 Oct 12 21:59:35.844436 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-201954673-project Oct 12 21:59:35.844436 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 21:59:35.844436 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 21:59:35.844436 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 5b44f0728b4f4d2d8b4bc39843d2bf21 Oct 12 21:59:35.844436 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-201954673-project Oct 12 21:59:35.844436 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 21:59:35.844436 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 12 21:59:35.844436 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'n-h1-861111-1'} Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:35.845185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 12 21:59:35.846497 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:35.857814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0c15e60f-52ef-4118-a6c1-c44fb2f022a1 tempest-HypervisorAdminNegativeUnderV252Test-201954673 tempest-HypervisorAdminNegativeUnderV252Test-201954673-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:35.860162 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0c15e60f-52ef-4118-a6c1-c44fb2f022a1 tempest-HypervisorAdminNegativeUnderV252Test-201954673 tempest-HypervisorAdminNegativeUnderV252Test-201954673-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-861111-1/search" status: 403 len: 117 microversion: 2.1 time: 0.419664 Oct 12 21:59:35.860923 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 29/87] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 12 21:59:35 2022] GET /compute/v2.1/os-hypervisors/n-h1-861111-1/search => generated 117 bytes in 421 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:35.878806 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a613f383-e7bd-41cb-8ac0-4b844d4a338d req-15ddf152-c2bf-4cd3-b99c-28f872f082f5 service nova] Creating event network-changed:5e230016-d9c7-4177-8e7e-fdca5ec7bf77 for instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 on n-h1-861111-1 Oct 12 21:59:35.879428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b1c4788b-5b9d-4d00-9e76-b12394b01cef tempest-FlavorsAccessTestJSON-746744659 tempest-FlavorsAccessTestJSON-746744659-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:35.904377 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a613f383-e7bd-41cb-8ac0-4b844d4a338d req-15ddf152-c2bf-4cd3-b99c-28f872f082f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.283840 Oct 12 21:59:35.904988 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 59/88] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 21:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:35.929643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5424c2f7-3a51-4119-883e-92a739d731a9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Calling method '.version_select at 0x7f5128e44ca0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:35.931530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5424c2f7-3a51-4119-883e-92a739d731a9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:35.942279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5424c2f7-3a51-4119-883e-92a739d731a9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:35.942721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5424c2f7-3a51-4119-883e-92a739d731a9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:35.954631 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b1c4788b-5b9d-4d00-9e76-b12394b01cef tempest-FlavorsAccessTestJSON-746744659 tempest-FlavorsAccessTestJSON-746744659-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.091131 Oct 12 21:59:35.955253 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 30/89] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 21:59:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:35.979273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b3c8573a-9afc-433e-b5d3-0c061e646a1c tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:35.989343 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-5424c2f7-3a51-4119-883e-92a739d731a9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5424c2f7-3a51-4119-883e-92a739d731a9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Request method failure captured: Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzjGU93eUGealHcRbMYdPAjEtTVuMr2-rBB6K2WtP8T3cQ1w--J340kirfWCbS5mfZSh5dTijG4Ny-8TAyF1bMXfwxE2No33wZKJlHvhx4xvNsLr7WU33J_e7IBq7TJnAt2BloXq2zTxkPwiPZnQBEdgCSFqscvzZjXzl6am8okxx0Q Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: b0da16b0f8484233ae961b5f6a28a42a Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-899147738 Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 21:59:35.990856 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 21:59:35.992401 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0da16b0f8484233ae961b5f6a28a42a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0da16b0f8484233ae961b5f6a28a42a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0da16b0f8484233ae961b5f6a28a42a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0da16b0f8484233ae961b5f6a28a42a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:35.992401 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-899147738 Oct 12 21:59:35.992401 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: b0da16b0f8484233ae961b5f6a28a42a Oct 12 21:59:35.992401 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-899147738 Oct 12 21:59:35.992401 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin Oct 12 21:59:35.992401 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:35.992401 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:35.992401 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: ba6a5c9116464ebe9acc0c625d3dc818 Oct 12 21:59:35.992401 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin Oct 12 21:59:35.992401 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 21:59:35.992401 n-d-861111-1 devstack@n-api.service[120453]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 12 21:59:35.992401 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:35.993192 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:35.994458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:35.994458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:59:35.994458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:59:35.994458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 12 21:59:35.994458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:36.000987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5424c2f7-3a51-4119-883e-92a739d731a9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:36.004542 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5424c2f7-3a51-4119-883e-92a739d731a9 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.096276 Oct 12 21:59:36.015501 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 60/90] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 12 21:59:35 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:36.045668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6c95b9c3-54bb-497d-955e-39f85ba61bc8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:36.050943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6c95b9c3-54bb-497d-955e-39f85ba61bc8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:36.074547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c95b9c3-54bb-497d-955e-39f85ba61bc8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:36.075871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c95b9c3-54bb-497d-955e-39f85ba61bc8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:36.076588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c95b9c3-54bb-497d-955e-39f85ba61bc8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:36.086957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c95b9c3-54bb-497d-955e-39f85ba61bc8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:36.088276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c95b9c3-54bb-497d-955e-39f85ba61bc8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:36.089224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c95b9c3-54bb-497d-955e-39f85ba61bc8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:36.137946 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b3c8573a-9afc-433e-b5d3-0c061e646a1c tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/244008358" status: 202 len: 0 microversion: 2.1 time: 0.166955 Oct 12 21:59:36.139678 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 31/91] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 12 21:59:35 2022] DELETE /compute/v2.1/flavors/244008358 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 21:59:36.153155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4d2c55d7-a175-4590-8036-15e6e92f90f7 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Calling method '.version_select at 0x7f5128e34a60>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:36.155677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d2c55d7-a175-4590-8036-15e6e92f90f7 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:36.157258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d2c55d7-a175-4590-8036-15e6e92f90f7 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:36.157876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d2c55d7-a175-4590-8036-15e6e92f90f7 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:36.176868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d2c55d7-a175-4590-8036-15e6e92f90f7 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:36.177935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d2c55d7-a175-4590-8036-15e6e92f90f7 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:36.178703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d2c55d7-a175-4590-8036-15e6e92f90f7 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:36.188271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5,nova_api:DELETE=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:36.209407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d2c55d7-a175-4590-8036-15e6e92f90f7 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:36.210762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d2c55d7-a175-4590-8036-15e6e92f90f7 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:36.211154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d2c55d7-a175-4590-8036-15e6e92f90f7 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:36.245462 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4d2c55d7-a175-4590-8036-15e6e92f90f7 tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.104022 Oct 12 21:59:36.246747 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 32/92] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 21:59:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:36.254525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d3030a9-4243-4066-85c8-89da3a2b31fd tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:36.297991 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5d3030a9-4243-4066-85c8-89da3a2b31fd tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049567 Oct 12 21:59:36.299400 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 33/93] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 21:59:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:36.306535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9ceb6376-93b7-422a-9fb4-e307a6c20cb2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:36.307620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9ceb6376-93b7-422a-9fb4-e307a6c20cb2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:36.317822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ceb6376-93b7-422a-9fb4-e307a6c20cb2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:36.321812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ceb6376-93b7-422a-9fb4-e307a6c20cb2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:36.322654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ceb6376-93b7-422a-9fb4-e307a6c20cb2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:36.324408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ceb6376-93b7-422a-9fb4-e307a6c20cb2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:36.326395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ceb6376-93b7-422a-9fb4-e307a6c20cb2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:36.326990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ceb6376-93b7-422a-9fb4-e307a6c20cb2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:36.619774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6c95b9c3-54bb-497d-955e-39f85ba61bc8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:36.637893 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6c95b9c3-54bb-497d-955e-39f85ba61bc8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1342 microversion: 2.1 time: 0.604692 Oct 12 21:59:36.640989 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 61/94] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:36 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1342 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:36.647472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-70d316c5-56a3-451b-b80b-566212abe01c tempest-HypervisorAdminNegativeUnderV252Test-201954673 tempest-HypervisorAdminNegativeUnderV252Test-201954673-project] Calling method '.version_select at 0x7f5128e44af0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:36.649514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-70d316c5-56a3-451b-b80b-566212abe01c tempest-HypervisorAdminNegativeUnderV252Test-201954673 tempest-HypervisorAdminNegativeUnderV252Test-201954673-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '5b44f0728b4f4d2d8b4bc39843d2bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01c8c5eacce4abb9d7b1de294e21c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-70d316c5-56a3-451b-b80b-566212abe01c tempest-HypervisorAdminNegativeUnderV252Test-201954673 tempest-HypervisorAdminNegativeUnderV252Test-201954673-project] Request method failure captured: Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzjEFTIF7GmcuMra7BRVp42wYfuk10GJ9mu-wu-VWQS4cy9TZHi8k9cZXQRsU3BdQqqo2LhirEPIBs39P1NVHO1jUz1shPe1fFuMOizUARxoNVxPfj_eNUZ4DgyZA7W409Wt_6PyFxGpW74r0xi_e7jblL-qurMktNGhn2xayVHcce8 Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: a01c8c5eacce4abb9d7b1de294e21c50 Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-201954673 Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 21:59:36.651531 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 21:59:36.652801 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a01c8c5eacce4abb9d7b1de294e21c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a01c8c5eacce4abb9d7b1de294e21c50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a01c8c5eacce4abb9d7b1de294e21c50", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a01c8c5eacce4abb9d7b1de294e21c50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:36.652801 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-201954673 Oct 12 21:59:36.652801 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: a01c8c5eacce4abb9d7b1de294e21c50 Oct 12 21:59:36.652801 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-201954673 Oct 12 21:59:36.652801 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-201954673-project Oct 12 21:59:36.652801 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 21:59:36.652801 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 21:59:36.652801 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 5b44f0728b4f4d2d8b4bc39843d2bf21 Oct 12 21:59:36.652801 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-201954673-project Oct 12 21:59:36.652801 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 21:59:36.652801 n-d-861111-1 devstack@n-api.service[120453]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 12 21:59:36.652801 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1'} Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 21:59:36.653555 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 12 21:59:36.654630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 21:59:36.656362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-70d316c5-56a3-451b-b80b-566212abe01c tempest-HypervisorAdminNegativeUnderV252Test-201954673 tempest-HypervisorAdminNegativeUnderV252Test-201954673-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:36.657352 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-70d316c5-56a3-451b-b80b-566212abe01c tempest-HypervisorAdminNegativeUnderV252Test-201954673 tempest-HypervisorAdminNegativeUnderV252Test-201954673-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.013937 Oct 12 21:59:36.658389 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 62/95] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 12 21:59:36 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:36.667710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c8cd7619-71ee-4520-b970-c46ee8ebbe40 tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1214966604", "id": 1775217548, "os-flavor-access:is_public": "False"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:36.683813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9ceb6376-93b7-422a-9fb4-e307a6c20cb2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:36.694403 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9ceb6376-93b7-422a-9fb4-e307a6c20cb2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1338 microversion: 2.1 time: 0.393215 Oct 12 21:59:36.695777 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 34/96] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:36 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1338 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:36.702732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c30b5eeb-f0d7-45bc-ad88-1545cf8cb6bd tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Calling method '.version_select at 0x7f5128e348b0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:36.705075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c30b5eeb-f0d7-45bc-ad88-1545cf8cb6bd tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:36.705818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c30b5eeb-f0d7-45bc-ad88-1545cf8cb6bd tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:36.706536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c30b5eeb-f0d7-45bc-ad88-1545cf8cb6bd tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:36.724276 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-c30b5eeb-f0d7-45bc-ad88-1545cf8cb6bd tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] HTTP exception thrown: No hypervisor matching '8d5a9d74-6434-431d-ae1b-56c4859f0c55' could be found. Oct 12 21:59:36.724995 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c8cd7619-71ee-4520-b970-c46ee8ebbe40 tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.065324 Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c30b5eeb-f0d7-45bc-ad88-1545cf8cb6bd tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Request method failure captured: Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-hypervisors/8d5a9d74-6434-431d-ae1b-56c4859f0c55/servers HTTP/1.1 Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzjGU93eUGealHcRbMYdPAjEtTVuMr2-rBB6K2WtP8T3cQ1w--J340kirfWCbS5mfZSh5dTijG4Ny-8TAyF1bMXfwxE2No33wZKJlHvhx4xvNsLr7WU33J_e7IBq7TJnAt2BloXq2zTxkPwiPZnQBEdgCSFqscvzZjXzl6am8okxx0Q Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: b0da16b0f8484233ae961b5f6a28a42a Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-899147738 Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 21:59:36.727473 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 21:59:36.728632 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0da16b0f8484233ae961b5f6a28a42a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0da16b0f8484233ae961b5f6a28a42a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0da16b0f8484233ae961b5f6a28a42a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0da16b0f8484233ae961b5f6a28a42a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 21:59:36.728632 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-899147738 Oct 12 21:59:36.728632 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: b0da16b0f8484233ae961b5f6a28a42a Oct 12 21:59:36.728632 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-899147738 Oct 12 21:59:36.728632 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin Oct 12 21:59:36.728632 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 21:59:36.728632 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 21:59:36.728632 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: ba6a5c9116464ebe9acc0c625d3dc818 Oct 12 21:59:36.728632 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin Oct 12 21:59:36.728632 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 21:59:36.728632 n-d-861111-1 devstack@n-api.service[120452]: exception: No hypervisor matching '8d5a9d74-6434-431d-ae1b-56c4859f0c55' could be found. Oct 12 21:59:36.728632 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '8d5a9d74-6434-431d-ae1b-56c4859f0c55'} Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '8d5a9d74-6434-431d-ae1b-56c4859f0c55' could be found. Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:36.729287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 21:59:36.730269 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 21:59:36.730269 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 21:59:36.730269 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 21:59:36.730269 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 21:59:36.730269 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '8d5a9d74-6434-431d-ae1b-56c4859f0c55' could be found. Oct 12 21:59:36.730269 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 21:59:36.733459 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 63/97] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 21:59:36 2022] POST /compute/v2.1/flavors => generated 431 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:36.734112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c30b5eeb-f0d7-45bc-ad88-1545cf8cb6bd tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] Returning 404 to user: No hypervisor matching '8d5a9d74-6434-431d-ae1b-56c4859f0c55' could be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 21:59:36.737599 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c30b5eeb-f0d7-45bc-ad88-1545cf8cb6bd tempest-HypervisorAdminNegativeUnderV252Test-899147738 tempest-HypervisorAdminNegativeUnderV252Test-899147738-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/8d5a9d74-6434-431d-ae1b-56c4859f0c55/servers" status: 404 len: 123 microversion: 2.1 time: 0.038675 Oct 12 21:59:36.738735 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 35/98] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Oct 12 21:59:36 2022] GET /compute/v2.1/os-hypervisors/8d5a9d74-6434-431d-ae1b-56c4859f0c55/servers => generated 123 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 21:59:36.747989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-46f8323b-3195-48ae-a02b-5aaf4a0708b3 tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:36.762670 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-46f8323b-3195-48ae-a02b-5aaf4a0708b3 tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1775217548/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.021826 Oct 12 21:59:36.763973 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 64/99] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 12 21:59:36 2022] GET /compute/v2.1/flavors/1775217548/os-flavor-access => generated 21 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 21:59:36.774717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-92b26bf9-ea8b-4156-998b-b5d124c7a72a tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:36.810962 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-92b26bf9-ea8b-4156-998b-b5d124c7a72a tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1775217548" status: 202 len: 0 microversion: 2.1 time: 0.036800 Oct 12 21:59:36.812540 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 36/100] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 12 21:59:36 2022] DELETE /compute/v2.1/flavors/1775217548 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 21:59:36.821267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1118bac6-c22e-4660-a9b5-869cb6e2b1a9 tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:36.851957 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1118bac6-c22e-4660-a9b5-869cb6e2b1a9 tempest-FlavorsAccessTestJSON-135361713 tempest-FlavorsAccessTestJSON-135361713-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033414 Oct 12 21:59:36.853289 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 65/101] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 21:59:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:37.668793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e82b0ccd-2a1d-443e-b782-310b8ae6153d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:37.670798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e82b0ccd-2a1d-443e-b782-310b8ae6153d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:37.685503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e82b0ccd-2a1d-443e-b782-310b8ae6153d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:37.687820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e82b0ccd-2a1d-443e-b782-310b8ae6153d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:37.697214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e82b0ccd-2a1d-443e-b782-310b8ae6153d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:37.698164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e82b0ccd-2a1d-443e-b782-310b8ae6153d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:37.699890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e82b0ccd-2a1d-443e-b782-310b8ae6153d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:37.702768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e82b0ccd-2a1d-443e-b782-310b8ae6153d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:37.730301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4679bc36-ba68-479e-9953-b41b0d4ca342 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:37.731996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4679bc36-ba68-479e-9953-b41b0d4ca342 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:37.748474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4679bc36-ba68-479e-9953-b41b0d4ca342 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:37.759639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4679bc36-ba68-479e-9953-b41b0d4ca342 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:37.760597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4679bc36-ba68-479e-9953-b41b0d4ca342 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:37.763713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4679bc36-ba68-479e-9953-b41b0d4ca342 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:37.764799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4679bc36-ba68-479e-9953-b41b0d4ca342 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:37.767926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4679bc36-ba68-479e-9953-b41b0d4ca342 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:38.266785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4679bc36-ba68-479e-9953-b41b0d4ca342 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:38.274786 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4679bc36-ba68-479e-9953-b41b0d4ca342 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1338 microversion: 2.1 time: 0.554755 Oct 12 21:59:38.280902 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 66/102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:37 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1338 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:38.402061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e82b0ccd-2a1d-443e-b782-310b8ae6153d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:38.410547 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e82b0ccd-2a1d-443e-b782-310b8ae6153d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1342 microversion: 2.1 time: 0.751403 Oct 12 21:59:38.411270 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 37/103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:37 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1342 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:39.307329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5dc13c78-97d8-4db1-b39c-398c9d54cc1b tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:39.308587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5dc13c78-97d8-4db1-b39c-398c9d54cc1b tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:39.348959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5dc13c78-97d8-4db1-b39c-398c9d54cc1b tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:39.353607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5dc13c78-97d8-4db1-b39c-398c9d54cc1b tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:39.355162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5dc13c78-97d8-4db1-b39c-398c9d54cc1b tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:39.356827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5dc13c78-97d8-4db1-b39c-398c9d54cc1b tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:39.357718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5dc13c78-97d8-4db1-b39c-398c9d54cc1b tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:39.359427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5dc13c78-97d8-4db1-b39c-398c9d54cc1b tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:39.434953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-99fc24ab-9d00-4e60-b216-1ce85f56f1e4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:39.435625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-99fc24ab-9d00-4e60-b216-1ce85f56f1e4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:39.447038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99fc24ab-9d00-4e60-b216-1ce85f56f1e4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:39.447557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99fc24ab-9d00-4e60-b216-1ce85f56f1e4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:39.447998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99fc24ab-9d00-4e60-b216-1ce85f56f1e4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:39.454033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99fc24ab-9d00-4e60-b216-1ce85f56f1e4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:39.454521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99fc24ab-9d00-4e60-b216-1ce85f56f1e4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:39.457375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99fc24ab-9d00-4e60-b216-1ce85f56f1e4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:39.966776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5dc13c78-97d8-4db1-b39c-398c9d54cc1b tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:39.974943 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5dc13c78-97d8-4db1-b39c-398c9d54cc1b tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1338 microversion: 2.1 time: 0.674619 Oct 12 21:59:39.993912 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 67/104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:39 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1338 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 21:59:40.155978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-99fc24ab-9d00-4e60-b216-1ce85f56f1e4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:40.173269 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-99fc24ab-9d00-4e60-b216-1ce85f56f1e4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1342 microversion: 2.1 time: 0.739677 Oct 12 21:59:40.174171 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 38/105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:39 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1342 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:40.399030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f4d60c32-0d10-4ecc-8095-fd23b5628805 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:40.407969 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f4d60c32-0d10-4ecc-8095-fd23b5628805 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.274802 Oct 12 21:59:40.409239 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 68/106] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 21:59:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:40.499986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-76b6c54d-042c-4bf6-a102-0a78decd2cde tempest-ServersWithSpecificFlavorTestJSON-386270835 tempest-ServersWithSpecificFlavorTestJSON-386270835-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-78041589", "id": 512672274, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:40.521090 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-76b6c54d-042c-4bf6-a102-0a78decd2cde tempest-ServersWithSpecificFlavorTestJSON-386270835 tempest-ServersWithSpecificFlavorTestJSON-386270835-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 420 microversion: 2.1 time: 0.100520 Oct 12 21:59:40.530727 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 39/107] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 21:59:40 2022] POST /compute/v2.1/flavors => generated 420 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:40.534198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-25c1926c-c200-44b0-96fe-f12eb935ec2b tempest-ServersWithSpecificFlavorTestJSON-386270835 tempest-ServersWithSpecificFlavorTestJSON-386270835-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:40.546185 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-25c1926c-c200-44b0-96fe-f12eb935ec2b tempest-ServersWithSpecificFlavorTestJSON-386270835 tempest-ServersWithSpecificFlavorTestJSON-386270835-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015752 Oct 12 21:59:40.552137 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 69/108] 10.222.0.16 () {58 vars in 1182 bytes} [Wed Oct 12 21:59:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 21:59:40.561284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-21dee88d-0219-49a1-a330-240c0ff84064 tempest-ServersWithSpecificFlavorTestJSON-386270835 tempest-ServersWithSpecificFlavorTestJSON-386270835-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-723763029", "id": 1418581079, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:40.610818 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-21dee88d-0219-49a1-a330-240c0ff84064 tempest-ServersWithSpecificFlavorTestJSON-386270835 tempest-ServersWithSpecificFlavorTestJSON-386270835-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.056759 Oct 12 21:59:40.625813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2f8d8fb9-c32c-429a-bc4b-d3b863a6515c tempest-ServersWithSpecificFlavorTestJSON-386270835 tempest-ServersWithSpecificFlavorTestJSON-386270835-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:40.630955 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 40/109] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 21:59:40 2022] POST /compute/v2.1/flavors => generated 424 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 21:59:40.637529 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2f8d8fb9-c32c-429a-bc4b-d3b863a6515c tempest-ServersWithSpecificFlavorTestJSON-386270835 tempest-ServersWithSpecificFlavorTestJSON-386270835-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016314 Oct 12 21:59:40.638379 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 70/110] 10.222.0.16 () {58 vars in 1182 bytes} [Wed Oct 12 21:59:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 21:59:40.653283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c0f3acaa-3535-4438-a8d7-b06f7289543f tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Action: 'create', calling method: .version_select at 0x7f5128dcbee0>, body: {"keypair": {"name": "tempest-keypair-922931407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOj4DtMgQD4W9jAuwjXnMY5tEAoCBGk6XTxpn0sne3JXXMv4Ul2ZQYDfrwbieehtj4mwCdcWyRBwo8t+RXMpdTzB03zzXBeG24k6uOGcJXnDvj1FrbzAMlWgTvxfC5+mFA=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:40.705060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c0f3acaa-3535-4438-a8d7-b06f7289543f tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Getting quotas for project a5e1f0c64d2e4154a3c0749af66adb6a. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 21:59:40.715112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c0f3acaa-3535-4438-a8d7-b06f7289543f tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Getting quotas for user 11b16666035d4646a403d79d83f9a67b and project a5e1f0c64d2e4154a3c0749af66adb6a. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 21:59:40.748960 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c0f3acaa-3535-4438-a8d7-b06f7289543f tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.101208 Oct 12 21:59:40.749567 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 41/111] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 21:59:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:41.000550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-04e072fa-2eb4-42b0-8513-3bf93c5c31f2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:41.001985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-04e072fa-2eb4-42b0-8513-3bf93c5c31f2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:41.015085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04e072fa-2eb4-42b0-8513-3bf93c5c31f2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:41.017746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04e072fa-2eb4-42b0-8513-3bf93c5c31f2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:41.018790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04e072fa-2eb4-42b0-8513-3bf93c5c31f2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:41.019889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04e072fa-2eb4-42b0-8513-3bf93c5c31f2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:41.020434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04e072fa-2eb4-42b0-8513-3bf93c5c31f2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:41.021631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04e072fa-2eb4-42b0-8513-3bf93c5c31f2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:41.200429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7dca9ab6-0a0b-4035-9f4d-63b3f51c4200 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:41.201625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7dca9ab6-0a0b-4035-9f4d-63b3f51c4200 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:41.213320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7dca9ab6-0a0b-4035-9f4d-63b3f51c4200 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:41.216228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7dca9ab6-0a0b-4035-9f4d-63b3f51c4200 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:41.218057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7dca9ab6-0a0b-4035-9f4d-63b3f51c4200 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:41.220159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7dca9ab6-0a0b-4035-9f4d-63b3f51c4200 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:41.221023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7dca9ab6-0a0b-4035-9f4d-63b3f51c4200 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:41.224892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7dca9ab6-0a0b-4035-9f4d-63b3f51c4200 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:41.242545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=14 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:41.333892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-04e072fa-2eb4-42b0-8513-3bf93c5c31f2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:41.350058 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-04e072fa-2eb4-42b0-8513-3bf93c5c31f2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1338 microversion: 2.1 time: 0.353109 Oct 12 21:59:41.352995 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 71/112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:40 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1338 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:41.935087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7dca9ab6-0a0b-4035-9f4d-63b3f51c4200 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:41.970236 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7dca9ab6-0a0b-4035-9f4d-63b3f51c4200 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1342 microversion: 2.1 time: 0.775189 Oct 12 21:59:41.972783 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 42/113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:41 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1342 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:42.379521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b6356237-0dba-4094-b3cd-b98d663b6441 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:42.380700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b6356237-0dba-4094-b3cd-b98d663b6441 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:42.390412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6356237-0dba-4094-b3cd-b98d663b6441 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:42.392920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6356237-0dba-4094-b3cd-b98d663b6441 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:42.396657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6356237-0dba-4094-b3cd-b98d663b6441 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:42.398559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6356237-0dba-4094-b3cd-b98d663b6441 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:42.399525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6356237-0dba-4094-b3cd-b98d663b6441 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:42.401238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6356237-0dba-4094-b3cd-b98d663b6441 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:42.999546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7fc1a443-6cb7-4c00-83de-9937666e3de8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:43.001226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7fc1a443-6cb7-4c00-83de-9937666e3de8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:43.010112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b6356237-0dba-4094-b3cd-b98d663b6441 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:43.019843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:43.035682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fc1a443-6cb7-4c00-83de-9937666e3de8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:43.036518 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b6356237-0dba-4094-b3cd-b98d663b6441 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1338 microversion: 2.1 time: 0.661030 Oct 12 21:59:43.037772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fc1a443-6cb7-4c00-83de-9937666e3de8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:43.053121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fc1a443-6cb7-4c00-83de-9937666e3de8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:43.057722 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 72/114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:42 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1338 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:43.060071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fc1a443-6cb7-4c00-83de-9937666e3de8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:43.062349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fc1a443-6cb7-4c00-83de-9937666e3de8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:43.064059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fc1a443-6cb7-4c00-83de-9937666e3de8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:43.462774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7fc1a443-6cb7-4c00-83de-9937666e3de8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:43.467881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:43.481479 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7fc1a443-6cb7-4c00-83de-9937666e3de8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1342 microversion: 2.1 time: 0.487132 Oct 12 21:59:43.482964 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 43/115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:42 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1342 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 21:59:44.076801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ea6096cf-9bea-4ff0-97c1-620c0f601e22 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:44.077417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ea6096cf-9bea-4ff0-97c1-620c0f601e22 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:44.088216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea6096cf-9bea-4ff0-97c1-620c0f601e22 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:44.089475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea6096cf-9bea-4ff0-97c1-620c0f601e22 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:44.091520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea6096cf-9bea-4ff0-97c1-620c0f601e22 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:44.092506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea6096cf-9bea-4ff0-97c1-620c0f601e22 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:44.093636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea6096cf-9bea-4ff0-97c1-620c0f601e22 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:44.094707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea6096cf-9bea-4ff0-97c1-620c0f601e22 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:44.510730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3cedc337-29b1-4d10-8eec-ff3b81321312 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:44.511378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3cedc337-29b1-4d10-8eec-ff3b81321312 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:44.519112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3cedc337-29b1-4d10-8eec-ff3b81321312 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:44.519635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3cedc337-29b1-4d10-8eec-ff3b81321312 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:44.520070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3cedc337-29b1-4d10-8eec-ff3b81321312 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:44.539083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3cedc337-29b1-4d10-8eec-ff3b81321312 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:44.539681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3cedc337-29b1-4d10-8eec-ff3b81321312 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:44.540296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3cedc337-29b1-4d10-8eec-ff3b81321312 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:45.038927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3cedc337-29b1-4d10-8eec-ff3b81321312 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:45.068356 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3cedc337-29b1-4d10-8eec-ff3b81321312 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1342 microversion: 2.1 time: 0.561864 Oct 12 21:59:45.072887 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 44/116] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:44 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1342 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:45.447562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7b92c79e-37f5-4228-b3a3-1ec559bd87bb tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1908734117", "ram": 512, "vcpus": 1, "disk": 10, "id": 1149292298, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:45.493809 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7b92c79e-37f5-4228-b3a3-1ec559bd87bb tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.419439 Oct 12 21:59:45.504187 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 45/117] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 21:59:45 2022] POST /compute/v2.1/flavors => generated 416 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:45.509565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2e77b3dd-a5ac-40aa-ae6d-2c40b2ee792b tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:45.587038 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2e77b3dd-a5ac-40aa-ae6d-2c40b2ee792b tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1149292298/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.081118 Oct 12 21:59:45.588640 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 46/118] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Oct 12 21:59:45 2022] POST /compute/v2.1/flavors/1149292298/os-extra_specs => generated 66 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 21:59:45.723578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ea6096cf-9bea-4ff0-97c1-620c0f601e22 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:45.744102 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ea6096cf-9bea-4ff0-97c1-620c0f601e22 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1338 microversion: 2.1 time: 1.669460 Oct 12 21:59:45.747406 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 73/119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:44 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1338 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:46.099177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9134af18-6e20-4f2b-b8a2-e5c5c78c923c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:46.100105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9134af18-6e20-4f2b-b8a2-e5c5c78c923c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:46.112538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9134af18-6e20-4f2b-b8a2-e5c5c78c923c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:46.115740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9134af18-6e20-4f2b-b8a2-e5c5c78c923c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:46.117718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9134af18-6e20-4f2b-b8a2-e5c5c78c923c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:46.118881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9134af18-6e20-4f2b-b8a2-e5c5c78c923c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:46.121048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9134af18-6e20-4f2b-b8a2-e5c5c78c923c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:46.121748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9134af18-6e20-4f2b-b8a2-e5c5c78c923c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:46.122225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f67adda2-4c40-4068-b829-1d414a7ab97c tempest-FlavorsExtraSpecsTestJSON-1985422507 tempest-FlavorsExtraSpecsTestJSON-1985422507-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:46.138515 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f67adda2-4c40-4068-b829-1d414a7ab97c tempest-FlavorsExtraSpecsTestJSON-1985422507 tempest-FlavorsExtraSpecsTestJSON-1985422507-project] 10.222.0.16 "GET /compute/v2.1/flavors/1149292298/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.533786 Oct 12 21:59:46.139383 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 47/120] 10.222.0.16 () {58 vars in 1203 bytes} [Wed Oct 12 21:59:45 2022] GET /compute/v2.1/flavors/1149292298/os-extra_specs => generated 66 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 21:59:46.152639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bd27f748-2787-440d-87cc-5bf5a9e6b124 tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:46.191200 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bd27f748-2787-440d-87cc-5bf5a9e6b124 tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1149292298/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044120 Oct 12 21:59:46.197213 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 48/121] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Oct 12 21:59:46 2022] POST /compute/v2.1/flavors/1149292298/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 21:59:46.203312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d0fb8fba-d161-4946-a606-f72ae593e333 tempest-FlavorsExtraSpecsTestJSON-1985422507 tempest-FlavorsExtraSpecsTestJSON-1985422507-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:46.227884 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d0fb8fba-d161-4946-a606-f72ae593e333 tempest-FlavorsExtraSpecsTestJSON-1985422507 tempest-FlavorsExtraSpecsTestJSON-1985422507-project] 10.222.0.16 "GET /compute/v2.1/flavors/1149292298/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.016927 Oct 12 21:59:46.229170 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 49/122] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 21:59:46 2022] GET /compute/v2.1/flavors/1149292298/os-extra_specs/hw:numa_nodes => generated 22 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 21:59:46.243668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6e4d582b-a4f4-42ea-af7d-307928e620e3 tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:46.288999 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6e4d582b-a4f4-42ea-af7d-307928e620e3 tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1149292298/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.053681 Oct 12 21:59:46.290219 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 50/123] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Oct 12 21:59:46 2022] POST /compute/v2.1/flavors/1149292298/os-extra_specs => generated 66 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 21:59:46.305055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-743839f8-f745-4ff5-8043-9f6d122172bf tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:46.320727 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-743839f8-f745-4ff5-8043-9f6d122172bf tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1149292298/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.023766 Oct 12 21:59:46.321807 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 51/124] 10.222.0.16 () {58 vars in 1203 bytes} [Wed Oct 12 21:59:46 2022] GET /compute/v2.1/flavors/1149292298/os-extra_specs => generated 66 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 21:59:46.335826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0b4f177a-d449-4ca6-b993-5cb38fec3d88 tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:46.390264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=3,nova_api:INSERT=6,nova_api:SAVEPOINT=7,nova_api:RELEASE=7 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:46.410850 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0b4f177a-d449-4ca6-b993-5cb38fec3d88 tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1149292298/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.080596 Oct 12 21:59:46.411944 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 52/125] 10.222.0.16 () {60 vars in 1265 bytes} [Wed Oct 12 21:59:46 2022] PUT /compute/v2.1/flavors/1149292298/os-extra_specs/hw:numa_nodes => generated 22 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 21:59:46.448660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-781f6035-2602-4fa2-bcb8-33e3bbcb2b97 tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:46.462351 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-781f6035-2602-4fa2-bcb8-33e3bbcb2b97 tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1149292298/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044738 Oct 12 21:59:46.468014 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 53/126] 10.222.0.16 () {58 vars in 1203 bytes} [Wed Oct 12 21:59:46 2022] GET /compute/v2.1/flavors/1149292298/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 21:59:46.474468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c9468d85-3c7f-43b7-b2bb-e445b56a109d tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:46.543331 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c9468d85-3c7f-43b7-b2bb-e445b56a109d tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1149292298/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.072735 Oct 12 21:59:46.547135 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 54/127] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 21:59:46 2022] DELETE /compute/v2.1/flavors/1149292298/os-extra_specs/hw:numa_nodes => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 12 21:59:46.557707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8561ea07-76f7-4f9d-b16c-26c79ec797b8 tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:46.608834 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8561ea07-76f7-4f9d-b16c-26c79ec797b8 tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1149292298/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.055541 Oct 12 21:59:46.609951 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 55/128] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 21:59:46 2022] DELETE /compute/v2.1/flavors/1149292298/os-extra_specs/hw:cpu_policy => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 21:59:46.625517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6c054550-316a-4164-9b6c-a02ce050cc9f tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:46.641089 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6c054550-316a-4164-9b6c-a02ce050cc9f tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1149292298/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025413 Oct 12 21:59:46.642838 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 56/129] 10.222.0.16 () {58 vars in 1203 bytes} [Wed Oct 12 21:59:46 2022] GET /compute/v2.1/flavors/1149292298/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 21:59:46.654299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1479371435", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "1418581079", "adminPass": "***", "networks": [{"uuid": "d3fadd76-09d4-4371-a263-cdd334f9f270"}], "security_groups": [{"name": "tempest-securitygroup--1311237933"}], "key_name": "tempest-keypair-922931407", "user_data": "}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:46.660127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9134af18-6e20-4f2b-b8a2-e5c5c78c923c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:46.674590 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9134af18-6e20-4f2b-b8a2-e5c5c78c923c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1342 microversion: 2.1 time: 0.581046 Oct 12 21:59:46.675596 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 74/130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:46 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1342 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 21:59:46.706208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7cbdb365-b9fd-4bf7-8e10-2b268648fd1f tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:46.745582 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7cbdb365-b9fd-4bf7-8e10-2b268648fd1f tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1149292298" status: 202 len: 0 microversion: 2.1 time: 0.052821 Oct 12 21:59:46.746899 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 75/131] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 12 21:59:46 2022] DELETE /compute/v2.1/flavors/1149292298 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 21:59:46.758100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a403f7b6-e607-40f0-ac3d-6ab9db97428a tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:46.812735 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a403f7b6-e607-40f0-ac3d-6ab9db97428a tempest-FlavorsExtraSpecsTestJSON-982447029 tempest-FlavorsExtraSpecsTestJSON-982447029-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.061431 Oct 12 21:59:46.815975 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 76/132] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 21:59:46 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 21:59:46.849640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-83550ff0-b5de-47a4-926b-6746202be367 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:46.850718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-83550ff0-b5de-47a4-926b-6746202be367 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:46.861688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83550ff0-b5de-47a4-926b-6746202be367 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:46.862549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83550ff0-b5de-47a4-926b-6746202be367 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:46.863163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83550ff0-b5de-47a4-926b-6746202be367 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:46.864072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83550ff0-b5de-47a4-926b-6746202be367 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:46.864701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83550ff0-b5de-47a4-926b-6746202be367 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:46.865351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83550ff0-b5de-47a4-926b-6746202be367 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:47.038641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] validate_networks() for [('d3fadd76-09d4-4371-a263-cdd334f9f270', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 21:59:47.290400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-83550ff0-b5de-47a4-926b-6746202be367 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:47.308111 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-83550ff0-b5de-47a4-926b-6746202be367 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1338 microversion: 2.1 time: 0.482707 Oct 12 21:59:47.309041 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 77/133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:46 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1338 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:47.698001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f1e9ee96-1f92-4ef0-a706-3f125b72b7e6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:47.698612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f1e9ee96-1f92-4ef0-a706-3f125b72b7e6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:47.707760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1e9ee96-1f92-4ef0-a706-3f125b72b7e6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:47.708257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1e9ee96-1f92-4ef0-a706-3f125b72b7e6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:47.720100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1e9ee96-1f92-4ef0-a706-3f125b72b7e6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:47.721113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1e9ee96-1f92-4ef0-a706-3f125b72b7e6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:47.721611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1e9ee96-1f92-4ef0-a706-3f125b72b7e6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:47.722045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1e9ee96-1f92-4ef0-a706-3f125b72b7e6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:48.174338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f1e9ee96-1f92-4ef0-a706-3f125b72b7e6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:48.182671 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f1e9ee96-1f92-4ef0-a706-3f125b72b7e6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1342 microversion: 2.1 time: 0.488510 Oct 12 21:59:48.195737 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 78/134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:47 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1342 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:48.335801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1df9df84-b636-4abc-b3ab-f496dda4fac2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:48.336487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1df9df84-b636-4abc-b3ab-f496dda4fac2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:48.345227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1df9df84-b636-4abc-b3ab-f496dda4fac2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:48.345961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1df9df84-b636-4abc-b3ab-f496dda4fac2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:48.346750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1df9df84-b636-4abc-b3ab-f496dda4fac2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:48.347769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1df9df84-b636-4abc-b3ab-f496dda4fac2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:48.348557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1df9df84-b636-4abc-b3ab-f496dda4fac2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:48.349291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1df9df84-b636-4abc-b3ab-f496dda4fac2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:48.712331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 21:59:48.714081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 21:59:48.714704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 21:59:48.715273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 21:59:48.715835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 21:59:48.731369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:48.732498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:48.733259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:48.734262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:48.734847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:48.735448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:48.762490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1df9df84-b636-4abc-b3ab-f496dda4fac2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:48.775595 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1df9df84-b636-4abc-b3ab-f496dda4fac2 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1338 microversion: 2.1 time: 0.444158 Oct 12 21:59:48.777809 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 79/135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:48 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1338 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:48.813676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Getting quotas for project a5e1f0c64d2e4154a3c0749af66adb6a. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 21:59:48.818856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Getting quotas for user 11b16666035d4646a403d79d83f9a67b and project a5e1f0c64d2e4154a3c0749af66adb6a. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 21:59:48.849330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 21:59:48.853320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 21:59:48.971070 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-aa71cd1e-50ec-45ab-bed2-a5823f7bb783 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.326416 Oct 12 21:59:48.972299 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 57/136] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 21:59:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 2329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 21:59:48.990799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c4d3fbc0-9cb7-48e7-9fc1-20484a0e7f22 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:48.992019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c4d3fbc0-9cb7-48e7-9fc1-20484a0e7f22 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:49.207633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3034f4af-bf30-4384-8672-e231fd604886 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:49.208257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3034f4af-bf30-4384-8672-e231fd604886 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:49.221213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3034f4af-bf30-4384-8672-e231fd604886 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:49.221709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3034f4af-bf30-4384-8672-e231fd604886 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:49.222130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3034f4af-bf30-4384-8672-e231fd604886 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:49.222834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3034f4af-bf30-4384-8672-e231fd604886 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:49.233219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c4d3fbc0-9cb7-48e7-9fc1-20484a0e7f22 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:49.237905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3034f4af-bf30-4384-8672-e231fd604886 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:49.238555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3034f4af-bf30-4384-8672-e231fd604886 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:49.241523 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c4d3fbc0-9cb7-48e7-9fc1-20484a0e7f22 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1264 microversion: 2.1 time: 0.260731 Oct 12 21:59:49.261762 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 80/137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:48 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1264 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:50.059845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3034f4af-bf30-4384-8672-e231fd604886 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:50.071586 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3034f4af-bf30-4384-8672-e231fd604886 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1342 microversion: 2.1 time: 0.868311 Oct 12 21:59:50.072181 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 58/138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:49 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1342 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 21:59:50.096769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-78d3b20b-f741-4d68-8026-9b125fb22c15 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:50.097602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-78d3b20b-f741-4d68-8026-9b125fb22c15 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:50.098269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-c7e5a95b-1bbd-4cc6-86ae-6d98d5b96db4 req-1a9fab9a-1326-4f48-90b5-202c8fa96e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946", "name": "network-vif-plugged", "status": "completed", "tag": "5e230016-d9c7-4177-8e7e-fdca5ec7bf77"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:50.117678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78d3b20b-f741-4d68-8026-9b125fb22c15 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:50.118407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78d3b20b-f741-4d68-8026-9b125fb22c15 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:50.121477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78d3b20b-f741-4d68-8026-9b125fb22c15 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:50.122396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78d3b20b-f741-4d68-8026-9b125fb22c15 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:50.123016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78d3b20b-f741-4d68-8026-9b125fb22c15 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:50.125699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78d3b20b-f741-4d68-8026-9b125fb22c15 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:50.138374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c7e5a95b-1bbd-4cc6-86ae-6d98d5b96db4 req-1a9fab9a-1326-4f48-90b5-202c8fa96e6b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:50.151958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c7e5a95b-1bbd-4cc6-86ae-6d98d5b96db4 req-1a9fab9a-1326-4f48-90b5-202c8fa96e6b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:50.154408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c7e5a95b-1bbd-4cc6-86ae-6d98d5b96db4 req-1a9fab9a-1326-4f48-90b5-202c8fa96e6b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:50.187373 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-c7e5a95b-1bbd-4cc6-86ae-6d98d5b96db4 req-1a9fab9a-1326-4f48-90b5-202c8fa96e6b service nova] Creating event network-vif-plugged:5e230016-d9c7-4177-8e7e-fdca5ec7bf77 for instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 on n-h1-861111-1 Oct 12 21:59:50.206720 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-c7e5a95b-1bbd-4cc6-86ae-6d98d5b96db4 req-1a9fab9a-1326-4f48-90b5-202c8fa96e6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.549791 Oct 12 21:59:50.210106 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 81/139] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 21:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:50.272593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-de5a92e6-8e33-4f04-8697-060caafe9c62 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:50.273416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-de5a92e6-8e33-4f04-8697-060caafe9c62 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:50.287555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de5a92e6-8e33-4f04-8697-060caafe9c62 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:50.289138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de5a92e6-8e33-4f04-8697-060caafe9c62 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:50.290068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de5a92e6-8e33-4f04-8697-060caafe9c62 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:50.291130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de5a92e6-8e33-4f04-8697-060caafe9c62 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:50.295748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de5a92e6-8e33-4f04-8697-060caafe9c62 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:50.296486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de5a92e6-8e33-4f04-8697-060caafe9c62 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:50.586718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-78d3b20b-f741-4d68-8026-9b125fb22c15 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:50.599337 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-78d3b20b-f741-4d68-8026-9b125fb22c15 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1338 microversion: 2.1 time: 0.526083 Oct 12 21:59:50.616674 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 59/140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:50 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1338 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:50.836421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-de5a92e6-8e33-4f04-8697-060caafe9c62 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:50.847988 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-de5a92e6-8e33-4f04-8697-060caafe9c62 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1268 microversion: 2.1 time: 0.583048 Oct 12 21:59:50.868439 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 82/141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:50 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1268 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 21:59:51.095130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-191b7c44-dc89-45ef-87b9-7c7303c4f2a3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:51.096558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-191b7c44-dc89-45ef-87b9-7c7303c4f2a3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:51.113392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191b7c44-dc89-45ef-87b9-7c7303c4f2a3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:51.119055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191b7c44-dc89-45ef-87b9-7c7303c4f2a3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:51.119966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191b7c44-dc89-45ef-87b9-7c7303c4f2a3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:51.123779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191b7c44-dc89-45ef-87b9-7c7303c4f2a3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:51.124481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191b7c44-dc89-45ef-87b9-7c7303c4f2a3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:51.125061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191b7c44-dc89-45ef-87b9-7c7303c4f2a3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:51.528333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-191b7c44-dc89-45ef-87b9-7c7303c4f2a3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:51.541246 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-191b7c44-dc89-45ef-87b9-7c7303c4f2a3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1342 microversion: 2.1 time: 0.448200 Oct 12 21:59:51.543599 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 60/142] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:51 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1342 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:51.625195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8233cd0d-0897-488a-b8ab-dcec319bf515 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:51.625808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8233cd0d-0897-488a-b8ab-dcec319bf515 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:51.639993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8233cd0d-0897-488a-b8ab-dcec319bf515 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:51.640534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8233cd0d-0897-488a-b8ab-dcec319bf515 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:51.640971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8233cd0d-0897-488a-b8ab-dcec319bf515 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:51.641690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8233cd0d-0897-488a-b8ab-dcec319bf515 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:51.642115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8233cd0d-0897-488a-b8ab-dcec319bf515 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:51.642538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8233cd0d-0897-488a-b8ab-dcec319bf515 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:51.880929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-42c19757-5b4c-4f5d-b17a-49cbbb6b8fdb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:51.882338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-42c19757-5b4c-4f5d-b17a-49cbbb6b8fdb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:51.891695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-42c19757-5b4c-4f5d-b17a-49cbbb6b8fdb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:51.892183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-42c19757-5b4c-4f5d-b17a-49cbbb6b8fdb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:51.894696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-42c19757-5b4c-4f5d-b17a-49cbbb6b8fdb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:51.896415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-42c19757-5b4c-4f5d-b17a-49cbbb6b8fdb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:51.898614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-42c19757-5b4c-4f5d-b17a-49cbbb6b8fdb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:51.899772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-42c19757-5b4c-4f5d-b17a-49cbbb6b8fdb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:52.191189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8233cd0d-0897-488a-b8ab-dcec319bf515 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:52.269236 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8233cd0d-0897-488a-b8ab-dcec319bf515 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1338 microversion: 2.1 time: 0.648062 Oct 12 21:59:52.270215 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 83/143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:51 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1338 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:52.326079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-42c19757-5b4c-4f5d-b17a-49cbbb6b8fdb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:52.335480 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-42c19757-5b4c-4f5d-b17a-49cbbb6b8fdb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1322 microversion: 2.1 time: 0.458068 Oct 12 21:59:52.336081 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 61/144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:51 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:52.477892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-44896075-b211-4d49-a298-b9ec2012b00b req-388b21c5-d4eb-4531-b97b-61b4688565be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373004a6-fff2-4a8c-95d7-3d33ef32f89d", "name": "network-vif-plugged", "status": "completed", "tag": "614ffa2d-72a9-4c09-8791-293fc379f766"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:52.508607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-44896075-b211-4d49-a298-b9ec2012b00b req-388b21c5-d4eb-4531-b97b-61b4688565be service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:52.511683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-44896075-b211-4d49-a298-b9ec2012b00b req-388b21c5-d4eb-4531-b97b-61b4688565be service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:52.515753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-44896075-b211-4d49-a298-b9ec2012b00b req-388b21c5-d4eb-4531-b97b-61b4688565be service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:52.566355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a637d26-65bc-42c1-b058-0afa0c735528 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:52.566976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7a637d26-65bc-42c1-b058-0afa0c735528 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:52.570395 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-44896075-b211-4d49-a298-b9ec2012b00b req-388b21c5-d4eb-4531-b97b-61b4688565be service nova] Creating event network-vif-plugged:614ffa2d-72a9-4c09-8791-293fc379f766 for instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d on n-h1-861111-1 Oct 12 21:59:52.593485 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-44896075-b211-4d49-a298-b9ec2012b00b req-388b21c5-d4eb-4531-b97b-61b4688565be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121386 Oct 12 21:59:52.593959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a637d26-65bc-42c1-b058-0afa0c735528 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:52.594486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a637d26-65bc-42c1-b058-0afa0c735528 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:52.594929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a637d26-65bc-42c1-b058-0afa0c735528 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:52.595398 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 84/145] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 21:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 21:59:52.595723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a637d26-65bc-42c1-b058-0afa0c735528 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:52.596226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a637d26-65bc-42c1-b058-0afa0c735528 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:52.596661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a637d26-65bc-42c1-b058-0afa0c735528 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:53.123692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a637d26-65bc-42c1-b058-0afa0c735528 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:53.137049 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7a637d26-65bc-42c1-b058-0afa0c735528 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1342 microversion: 2.1 time: 0.574864 Oct 12 21:59:53.142248 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 62/146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:52 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1342 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 21:59:53.300032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bff9aff6-63a7-49f5-b7e0-a5910b6c18fd tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:53.300980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bff9aff6-63a7-49f5-b7e0-a5910b6c18fd tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:53.319147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bff9aff6-63a7-49f5-b7e0-a5910b6c18fd tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:53.321898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bff9aff6-63a7-49f5-b7e0-a5910b6c18fd tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:53.324139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bff9aff6-63a7-49f5-b7e0-a5910b6c18fd tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:53.325156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bff9aff6-63a7-49f5-b7e0-a5910b6c18fd tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:53.325835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bff9aff6-63a7-49f5-b7e0-a5910b6c18fd tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:53.326762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bff9aff6-63a7-49f5-b7e0-a5910b6c18fd tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:53.735198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-642e0ee3-a3bc-4753-a19b-33b9cfc399d0 tempest-SecurityGroupsTestAdminJSON-814582856 tempest-SecurityGroupsTestAdminJSON-814582856-project] Action: 'create', calling method: .version_select at 0x7f5128e44ee0>, body: {"security_group": {"name": "tempest-securitygroup-1674851000", "description": "tempest-description-1046238329"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:54.176084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bff9aff6-63a7-49f5-b7e0-a5910b6c18fd tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:54.199791 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bff9aff6-63a7-49f5-b7e0-a5910b6c18fd tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1338 microversion: 2.1 time: 0.898581 Oct 12 21:59:54.214602 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 63/147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:53 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1338 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:54.221936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4a92094a-37ce-4688-8d13-fc156c2a2a2f tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:54.225931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4a92094a-37ce-4688-8d13-fc156c2a2a2f tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:54.248072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a92094a-37ce-4688-8d13-fc156c2a2a2f tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:54.250424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a92094a-37ce-4688-8d13-fc156c2a2a2f tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:54.251376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a92094a-37ce-4688-8d13-fc156c2a2a2f tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:54.252492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a92094a-37ce-4688-8d13-fc156c2a2a2f tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:54.254351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a92094a-37ce-4688-8d13-fc156c2a2a2f tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:54.255152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a92094a-37ce-4688-8d13-fc156c2a2a2f tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:54.409812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4a92094a-37ce-4688-8d13-fc156c2a2a2f tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:54.423106 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4a92094a-37ce-4688-8d13-fc156c2a2a2f tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1322 microversion: 2.1 time: 0.207268 Oct 12 21:59:54.432586 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 64/148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:54 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:54.464458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b33f5799-fe52-46ef-ada5-33552c467468 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:54.466437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b33f5799-fe52-46ef-ada5-33552c467468 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:54.484443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b33f5799-fe52-46ef-ada5-33552c467468 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:54.486740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b33f5799-fe52-46ef-ada5-33552c467468 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:54.487447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b33f5799-fe52-46ef-ada5-33552c467468 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:54.489067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b33f5799-fe52-46ef-ada5-33552c467468 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:54.489847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b33f5799-fe52-46ef-ada5-33552c467468 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:54.490487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b33f5799-fe52-46ef-ada5-33552c467468 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:54.977534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b33f5799-fe52-46ef-ada5-33552c467468 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:54.988354 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b33f5799-fe52-46ef-ada5-33552c467468 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1342 microversion: 2.1 time: 0.554176 Oct 12 21:59:54.988766 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-642e0ee3-a3bc-4753-a19b-33b9cfc399d0 tempest-SecurityGroupsTestAdminJSON-814582856 tempest-SecurityGroupsTestAdminJSON-814582856-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.826097 Oct 12 21:59:54.991434 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 65/149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:54 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1342 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:55.008411 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 85/150] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 21:59:53 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:55.028857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f31561d7-a949-4fc1-b136-08d223c492d8 tempest-SecurityGroupsTestAdminJSON-814582856 tempest-SecurityGroupsTestAdminJSON-814582856-project] Action: 'create', calling method: .version_select at 0x7f5128c26d30>, body: {"security_group": {"name": "tempest-securitygroup-820981823", "description": "tempest-description-2004691657"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:55.231403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8d590189-9f7e-40ca-8e01-063b8326cfd6 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:55.232524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8d590189-9f7e-40ca-8e01-063b8326cfd6 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:55.244896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d590189-9f7e-40ca-8e01-063b8326cfd6 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:55.250073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d590189-9f7e-40ca-8e01-063b8326cfd6 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:55.250877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d590189-9f7e-40ca-8e01-063b8326cfd6 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:55.252101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d590189-9f7e-40ca-8e01-063b8326cfd6 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:55.252863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d590189-9f7e-40ca-8e01-063b8326cfd6 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:55.253508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d590189-9f7e-40ca-8e01-063b8326cfd6 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:55.620666 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f31561d7-a949-4fc1-b136-08d223c492d8 tempest-SecurityGroupsTestAdminJSON-814582856 tempest-SecurityGroupsTestAdminJSON-814582856-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.595977 Oct 12 21:59:55.623611 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 66/151] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 21:59:55 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:55.630649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7c6c8c1c-55b6-4af0-be07-f5f7031125a7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:55.631552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7c6c8c1c-55b6-4af0-be07-f5f7031125a7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:55.643252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6c8c1c-55b6-4af0-be07-f5f7031125a7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:55.645563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6c8c1c-55b6-4af0-be07-f5f7031125a7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:55.649130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6c8c1c-55b6-4af0-be07-f5f7031125a7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:55.650284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6c8c1c-55b6-4af0-be07-f5f7031125a7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:55.650953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6c8c1c-55b6-4af0-be07-f5f7031125a7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:55.651610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6c8c1c-55b6-4af0-be07-f5f7031125a7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:55.719431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8d590189-9f7e-40ca-8e01-063b8326cfd6 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:55.729968 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8d590189-9f7e-40ca-8e01-063b8326cfd6 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1488 microversion: 2.1 time: 0.508916 Oct 12 21:59:55.734708 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 86/152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:55 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1488 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:55.871080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7c6c8c1c-55b6-4af0-be07-f5f7031125a7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:55.889252 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7c6c8c1c-55b6-4af0-be07-f5f7031125a7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1322 microversion: 2.1 time: 0.264349 Oct 12 21:59:55.890290 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 67/153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:55 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:55.910795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b9efe65c-9603-4b39-8ce1-ade6b0b0a321 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:55.911815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b9efe65c-9603-4b39-8ce1-ade6b0b0a321 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:55.939514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9efe65c-9603-4b39-8ce1-ade6b0b0a321 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:55.944857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9efe65c-9603-4b39-8ce1-ade6b0b0a321 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:55.946525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9efe65c-9603-4b39-8ce1-ade6b0b0a321 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:55.947716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9efe65c-9603-4b39-8ce1-ade6b0b0a321 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:55.948206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9efe65c-9603-4b39-8ce1-ade6b0b0a321 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:55.949703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9efe65c-9603-4b39-8ce1-ade6b0b0a321 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:56.195746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-19e6d0cc-9ce3-4cc4-9367-95a796ba0b3a tempest-SecurityGroupsTestAdminJSON-1624002160 tempest-SecurityGroupsTestAdminJSON-1624002160-project-admin] Action: 'create', calling method: .version_select at 0x7f5128fb99d0>, body: {"security_group": {"name": "tempest-securitygroup-1286624425", "description": "tempest-description-1173514256"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:56.862587 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b9efe65c-9603-4b39-8ce1-ade6b0b0a321 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1639 microversion: 2.1 time: 0.969755 Oct 12 21:59:56.867051 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 68/154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:55 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1639 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:56.986283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7ac80632-e11b-4254-bfe6-6d295a1ecf2b tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Action: 'update', calling method: .version_select at 0x7f5128ce51f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:57.112569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ac80632-e11b-4254-bfe6-6d295a1ecf2b tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:57.113198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ac80632-e11b-4254-bfe6-6d295a1ecf2b tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:57.113732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ac80632-e11b-4254-bfe6-6d295a1ecf2b tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:57.114738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ac80632-e11b-4254-bfe6-6d295a1ecf2b tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:57.115449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ac80632-e11b-4254-bfe6-6d295a1ecf2b tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:57.116008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ac80632-e11b-4254-bfe6-6d295a1ecf2b tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:57.226560 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7ac80632-e11b-4254-bfe6-6d295a1ecf2b tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/016e4d2ff166414b8346747bf03e8ef9" status: 200 len: 240 microversion: 2.36 time: 0.358195 Oct 12 21:59:57.227835 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 69/155] 10.222.0.16 () {62 vars in 1303 bytes} [Wed Oct 12 21:59:56 2022] PUT /compute/v2.1/os-quota-sets/016e4d2ff166414b8346747bf03e8ef9 => generated 240 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:59:57.232962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-463adb07-5cd3-41f6-85b3-d817d2084b9e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:57.235261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-463adb07-5cd3-41f6-85b3-d817d2084b9e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:57.246262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-463adb07-5cd3-41f6-85b3-d817d2084b9e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:57.252079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-463adb07-5cd3-41f6-85b3-d817d2084b9e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:57.252863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-463adb07-5cd3-41f6-85b3-d817d2084b9e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:57.253809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-463adb07-5cd3-41f6-85b3-d817d2084b9e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:57.259575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-463adb07-5cd3-41f6-85b3-d817d2084b9e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:57.260558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-463adb07-5cd3-41f6-85b3-d817d2084b9e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:57.312984 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-19e6d0cc-9ce3-4cc4-9367-95a796ba0b3a tempest-SecurityGroupsTestAdminJSON-1624002160 tempest-SecurityGroupsTestAdminJSON-1624002160-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.576587 Oct 12 21:59:57.323537 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 87/156] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 21:59:55 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:57.328736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4eda52e4-9a08-4d3b-9fea-f942d9908c32 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:57.329481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4eda52e4-9a08-4d3b-9fea-f942d9908c32 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:57.340672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:57.346476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4eda52e4-9a08-4d3b-9fea-f942d9908c32 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:57.348580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4eda52e4-9a08-4d3b-9fea-f942d9908c32 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:57.351077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4eda52e4-9a08-4d3b-9fea-f942d9908c32 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:57.353182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4eda52e4-9a08-4d3b-9fea-f942d9908c32 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:57.354005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4eda52e4-9a08-4d3b-9fea-f942d9908c32 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:57.358280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4eda52e4-9a08-4d3b-9fea-f942d9908c32 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:57.414628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4eda52e4-9a08-4d3b-9fea-f942d9908c32 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 21:59:57.651311 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4eda52e4-9a08-4d3b-9fea-f942d9908c32 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 204 len: 0 microversion: 2.1 time: 0.325353 Oct 12 21:59:57.652522 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 88/157] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 21:59:57 2022] DELETE /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 21:59:57.660142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-012be358-5eac-4682-8a42-7ea2dc3870b8 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:57.661018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-012be358-5eac-4682-8a42-7ea2dc3870b8 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:57.677620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-012be358-5eac-4682-8a42-7ea2dc3870b8 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:57.678666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-012be358-5eac-4682-8a42-7ea2dc3870b8 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:57.679107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-012be358-5eac-4682-8a42-7ea2dc3870b8 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:57.679843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-012be358-5eac-4682-8a42-7ea2dc3870b8 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:57.688058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-012be358-5eac-4682-8a42-7ea2dc3870b8 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:57.688772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-012be358-5eac-4682-8a42-7ea2dc3870b8 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:57.734518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-463adb07-5cd3-41f6-85b3-d817d2084b9e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:57.750426 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-463adb07-5cd3-41f6-85b3-d817d2084b9e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1492 microversion: 2.1 time: 0.521207 Oct 12 21:59:57.789807 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 70/158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:57 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1492 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:57.795812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-15157b07-5561-4bce-aa42-0d71eb293893 tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Calling method '.version_select at 0x7f5128d04430>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:57.857365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-012be358-5eac-4682-8a42-7ea2dc3870b8 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:57.869955 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-012be358-5eac-4682-8a42-7ea2dc3870b8 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1322 microversion: 2.1 time: 0.215977 Oct 12 21:59:57.871936 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 89/159] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:57 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:57.888650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e0a19fca-2336-471b-8b48-0de83b32e369 tempest-SecurityGroupsTestAdminJSON-1624002160 tempest-SecurityGroupsTestAdminJSON-1624002160-project-admin] Action: 'create', calling method: .version_select at 0x7f5128dfdd30>, body: {"security_group": {"name": "tempest-securitygroup-1704349612", "description": "tempest-description-359551636"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:57.915087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15157b07-5561-4bce-aa42-0d71eb293893 tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:57.917195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15157b07-5561-4bce-aa42-0d71eb293893 tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:57.919641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15157b07-5561-4bce-aa42-0d71eb293893 tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:57.921172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15157b07-5561-4bce-aa42-0d71eb293893 tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:57.924413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15157b07-5561-4bce-aa42-0d71eb293893 tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:57.925165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15157b07-5561-4bce-aa42-0d71eb293893 tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:57.949811 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-15157b07-5561-4bce-aa42-0d71eb293893 tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/016e4d2ff166414b8346747bf03e8ef9/detail" status: 200 len: 672 microversion: 2.36 time: 0.158401 Oct 12 21:59:57.951394 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 71/160] 10.222.0.16 () {60 vars in 1304 bytes} [Wed Oct 12 21:59:57 2022] GET /compute/v2.1/os-quota-sets/016e4d2ff166414b8346747bf03e8ef9/detail => generated 672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:59:57.958826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ee286060-746f-45bb-ab68-bb3a090ab597 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:57.960495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ee286060-746f-45bb-ab68-bb3a090ab597 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:57.969758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee286060-746f-45bb-ab68-bb3a090ab597 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:57.970630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee286060-746f-45bb-ab68-bb3a090ab597 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:57.971384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee286060-746f-45bb-ab68-bb3a090ab597 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:57.973266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee286060-746f-45bb-ab68-bb3a090ab597 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:57.974161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee286060-746f-45bb-ab68-bb3a090ab597 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:57.975436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee286060-746f-45bb-ab68-bb3a090ab597 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:58.301328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ee286060-746f-45bb-ab68-bb3a090ab597 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 21:59:58.314103 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ee286060-746f-45bb-ab68-bb3a090ab597 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1494 microversion: 2.1 time: 0.358399 Oct 12 21:59:58.317253 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 72/161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:57 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1494 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 21:59:58.516874 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e0a19fca-2336-471b-8b48-0de83b32e369 tempest-SecurityGroupsTestAdminJSON-1624002160 tempest-SecurityGroupsTestAdminJSON-1624002160-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.643835 Oct 12 21:59:58.520044 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 90/162] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 21:59:57 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 21:59:58.532092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-21a6d45b-0ea3-45f0-8604-bb49d0ecd1de tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Action: 'update', calling method: .version_select at 0x7f5128dfd670>, body: {"quota_set": {"ram": "2048"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 21:59:58.589679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0a1097a2-1ef8-4196-bb08-ba417c8e53fd tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:58.590322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0a1097a2-1ef8-4196-bb08-ba417c8e53fd tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:58.604615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1097a2-1ef8-4196-bb08-ba417c8e53fd tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:58.605191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1097a2-1ef8-4196-bb08-ba417c8e53fd tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:58.607175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1097a2-1ef8-4196-bb08-ba417c8e53fd tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:58.608035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1097a2-1ef8-4196-bb08-ba417c8e53fd tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:58.610047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1097a2-1ef8-4196-bb08-ba417c8e53fd tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:58.610722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1097a2-1ef8-4196-bb08-ba417c8e53fd tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:58.650935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a6d45b-0ea3-45f0-8604-bb49d0ecd1de tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:58.651695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a6d45b-0ea3-45f0-8604-bb49d0ecd1de tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:58.652278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a6d45b-0ea3-45f0-8604-bb49d0ecd1de tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:58.655642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a6d45b-0ea3-45f0-8604-bb49d0ecd1de tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:58.657806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a6d45b-0ea3-45f0-8604-bb49d0ecd1de tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:58.659153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a6d45b-0ea3-45f0-8604-bb49d0ecd1de tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:58.675537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0a1097a2-1ef8-4196-bb08-ba417c8e53fd tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 21:59:58.721452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a6d45b-0ea3-45f0-8604-bb49d0ecd1de tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:58.721940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a6d45b-0ea3-45f0-8604-bb49d0ecd1de tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:58.722574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a6d45b-0ea3-45f0-8604-bb49d0ecd1de tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:58.723479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a6d45b-0ea3-45f0-8604-bb49d0ecd1de tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:58.724125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a6d45b-0ea3-45f0-8604-bb49d0ecd1de tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:58.724726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a6d45b-0ea3-45f0-8604-bb49d0ecd1de tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:58.808643 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-21a6d45b-0ea3-45f0-8604-bb49d0ecd1de tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/016e4d2ff166414b8346747bf03e8ef9?user_id=d6d60c39d62e4bdba4924dd8edf4882e" status: 200 len: 240 microversion: 2.36 time: 0.285519 Oct 12 21:59:58.810957 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 91/163] 10.222.0.16 () {62 vars in 1384 bytes} [Wed Oct 12 21:59:58 2022] PUT /compute/v2.1/os-quota-sets/016e4d2ff166414b8346747bf03e8ef9?user_id=d6d60c39d62e4bdba4924dd8edf4882e => generated 240 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:59:58.817948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-17cd7088-c085-4616-87ca-76939fad3d6d tempest-SecurityGroupsTestAdminJSON-1624002160 tempest-SecurityGroupsTestAdminJSON-1624002160-project-admin] Calling method '.version_select at 0x7f5128f85790>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:58.967948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:58.981699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1097a2-1ef8-4196-bb08-ba417c8e53fd tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 21:59:58.982333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1097a2-1ef8-4196-bb08-ba417c8e53fd tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 21:59:58.984525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7aa3566-0341-46cb-885d-ffb510349198 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:58.985245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7aa3566-0341-46cb-885d-ffb510349198 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:58.985870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7aa3566-0341-46cb-885d-ffb510349198 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:58.987681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7aa3566-0341-46cb-885d-ffb510349198 None None] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:58.988366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7aa3566-0341-46cb-885d-ffb510349198 None None] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:58.989653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7aa3566-0341-46cb-885d-ffb510349198 None None] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:59.004705 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.compute.rpcapi [None req-b7aa3566-0341-46cb-885d-ffb510349198 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 12 21:59:59.007997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7aa3566-0341-46cb-885d-ffb510349198 None None] Releasing lock "compute-rpcapi-router" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 21:59:59.038135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SAVEPOINT=2,nova_api:UPDATE=1,nova_api:RELEASE=2,nova_api:SELECT=89,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 21:59:59.079742 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b7aa3566-0341-46cb-885d-ffb510349198 None None] 10.222.0.16 "DELETE /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 204 len: 0 microversion: 2.1 time: 0.760309 Oct 12 21:59:59.092598 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 73/164] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 21:59:58 2022] DELETE /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 0 bytes in 768 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 21:59:59.099491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f56566f1-fefb-406a-8967-d53d7fa26b8c tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] Calling method '.version_select at 0x7f5128ce5af0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:59.333009 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f56566f1-fefb-406a-8967-d53d7fa26b8c tempest-QuotasAdminTestV236-182655920 tempest-QuotasAdminTestV236-182655920-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/016e4d2ff166414b8346747bf03e8ef9?user_id=d6d60c39d62e4bdba4924dd8edf4882e" status: 200 len: 282 microversion: 2.36 time: 0.237747 Oct 12 21:59:59.342262 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 74/165] 10.222.0.16 () {60 vars in 1364 bytes} [Wed Oct 12 21:59:59 2022] GET /compute/v2.1/os-quota-sets/016e4d2ff166414b8346747bf03e8ef9?user_id=d6d60c39d62e4bdba4924dd8edf4882e => generated 282 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 21:59:59.352449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0968eff3-7d6d-4bab-9f81-a3236e36a386 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 21:59:59.354840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0968eff3-7d6d-4bab-9f81-a3236e36a386 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 21:59:59.854782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0968eff3-7d6d-4bab-9f81-a3236e36a386 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:59.855694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0968eff3-7d6d-4bab-9f81-a3236e36a386 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:59.856298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0968eff3-7d6d-4bab-9f81-a3236e36a386 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 21:59:59.857176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0968eff3-7d6d-4bab-9f81-a3236e36a386 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 21:59:59.857806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0968eff3-7d6d-4bab-9f81-a3236e36a386 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 21:59:59.858383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0968eff3-7d6d-4bab-9f81-a3236e36a386 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:00.404068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0968eff3-7d6d-4bab-9f81-a3236e36a386 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:00.416047 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0968eff3-7d6d-4bab-9f81-a3236e36a386 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1322 microversion: 2.1 time: 1.080264 Oct 12 22:00:00.416644 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 75/166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 21:59:59 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1322 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:00.426674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6f636594-095a-4521-94d6-41f487f4de6f tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:00.434756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6f636594-095a-4521-94d6-41f487f4de6f tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:00.455533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f636594-095a-4521-94d6-41f487f4de6f tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:00.457769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f636594-095a-4521-94d6-41f487f4de6f tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:00.459853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f636594-095a-4521-94d6-41f487f4de6f tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:00.462055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f636594-095a-4521-94d6-41f487f4de6f tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:00.464704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f636594-095a-4521-94d6-41f487f4de6f tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:00.465306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f636594-095a-4521-94d6-41f487f4de6f tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:01.373747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6f636594-095a-4521-94d6-41f487f4de6f tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:01.387268 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6f636594-095a-4521-94d6-41f487f4de6f tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1498 microversion: 2.1 time: 0.966354 Oct 12 22:00:01.388410 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 76/167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:00 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1498 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:01.403990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b9a2afbf-3426-4d5a-adb2-e9bdeefd4dac tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:01.404905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b9a2afbf-3426-4d5a-adb2-e9bdeefd4dac tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:01.421305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9a2afbf-3426-4d5a-adb2-e9bdeefd4dac tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:01.422494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9a2afbf-3426-4d5a-adb2-e9bdeefd4dac tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:01.422953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9a2afbf-3426-4d5a-adb2-e9bdeefd4dac tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:01.424967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9a2afbf-3426-4d5a-adb2-e9bdeefd4dac tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:01.427346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9a2afbf-3426-4d5a-adb2-e9bdeefd4dac tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:01.428600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9a2afbf-3426-4d5a-adb2-e9bdeefd4dac tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:01.819510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b9a2afbf-3426-4d5a-adb2-e9bdeefd4dac tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c7541fc7fee4bb0a911a3a211edd010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e13591fa0c4a789d71e35d18f97f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:01.830065 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b9a2afbf-3426-4d5a-adb2-e9bdeefd4dac tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 200 len: 1452 microversion: 2.1 time: 0.440170 Oct 12 22:00:01.832926 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 77/168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:01 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 1452 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:01.843306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bfff0ade-1add-4a51-b6b8-efd99e713902 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:01.847972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bfff0ade-1add-4a51-b6b8-efd99e713902 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:01.858945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfff0ade-1add-4a51-b6b8-efd99e713902 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:01.861211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfff0ade-1add-4a51-b6b8-efd99e713902 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:01.867984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfff0ade-1add-4a51-b6b8-efd99e713902 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:01.868988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfff0ade-1add-4a51-b6b8-efd99e713902 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:01.869816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfff0ade-1add-4a51-b6b8-efd99e713902 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:01.870424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfff0ade-1add-4a51-b6b8-efd99e713902 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:03.454822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bfff0ade-1add-4a51-b6b8-efd99e713902 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:03.467872 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bfff0ade-1add-4a51-b6b8-efd99e713902 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1390 microversion: 2.1 time: 1.633313 Oct 12 22:00:03.469052 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 78/169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:01 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1390 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:03.478331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-31b5f4e1-4447-42cd-b1a0-30c3d627554b req-a65583d0-8628-41f0-993a-fdc38c04fc8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946", "name": "network-vif-deleted", "tag": "5e230016-d9c7-4177-8e7e-fdca5ec7bf77"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:03.538946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-31b5f4e1-4447-42cd-b1a0-30c3d627554b req-a65583d0-8628-41f0-993a-fdc38c04fc8a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:03.540036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-31b5f4e1-4447-42cd-b1a0-30c3d627554b req-a65583d0-8628-41f0-993a-fdc38c04fc8a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:03.540624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-31b5f4e1-4447-42cd-b1a0-30c3d627554b req-a65583d0-8628-41f0-993a-fdc38c04fc8a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:03.582558 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-31b5f4e1-4447-42cd-b1a0-30c3d627554b req-a65583d0-8628-41f0-993a-fdc38c04fc8a service nova] Creating event network-vif-deleted:5e230016-d9c7-4177-8e7e-fdca5ec7bf77 for instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 on n-h1-861111-1 Oct 12 22:00:03.593722 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-31b5f4e1-4447-42cd-b1a0-30c3d627554b req-a65583d0-8628-41f0-993a-fdc38c04fc8a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121605 Oct 12 22:00:03.595884 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 79/170] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:03.606179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9f8c35ca-6377-405c-95fe-9a51244ae540 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:03.610726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9f8c35ca-6377-405c-95fe-9a51244ae540 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:03.618583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f8c35ca-6377-405c-95fe-9a51244ae540 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:03.619357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f8c35ca-6377-405c-95fe-9a51244ae540 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:03.620015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f8c35ca-6377-405c-95fe-9a51244ae540 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:03.621739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f8c35ca-6377-405c-95fe-9a51244ae540 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:03.622342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f8c35ca-6377-405c-95fe-9a51244ae540 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:03.622964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f8c35ca-6377-405c-95fe-9a51244ae540 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:04.206784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9f8c35ca-6377-405c-95fe-9a51244ae540 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:04.216316 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9f8c35ca-6377-405c-95fe-9a51244ae540 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 200 len: 1456 microversion: 2.1 time: 0.618985 Oct 12 22:00:04.227314 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 80/171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:03 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 1456 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:04.273389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3501bdf2-aafe-4895-83e8-f90efec141d0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:04.274038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3501bdf2-aafe-4895-83e8-f90efec141d0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:04.305040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3501bdf2-aafe-4895-83e8-f90efec141d0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:04.305789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3501bdf2-aafe-4895-83e8-f90efec141d0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:04.306405 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3501bdf2-aafe-4895-83e8-f90efec141d0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:04.307331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3501bdf2-aafe-4895-83e8-f90efec141d0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:04.307937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3501bdf2-aafe-4895-83e8-f90efec141d0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:04.308532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3501bdf2-aafe-4895-83e8-f90efec141d0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:04.324274 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-17cd7088-c085-4616-87ca-76939fad3d6d tempest-SecurityGroupsTestAdminJSON-1624002160 tempest-SecurityGroupsTestAdminJSON-1624002160-project-admin] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11056 microversion: 2.1 time: 5.510823 Oct 12 22:00:04.325409 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 92/172] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Oct 12 21:59:58 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11056 bytes in 5514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:00:04.330281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-0bbfa49f-fa28-4e17-b232-70d955930d3e req-49c5cfe2-6333-4574-805d-ade5f94fe86f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373004a6-fff2-4a8c-95d7-3d33ef32f89d", "name": "network-vif-deleted", "tag": "614ffa2d-72a9-4c09-8791-293fc379f766"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:04.379778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0bbfa49f-fa28-4e17-b232-70d955930d3e req-49c5cfe2-6333-4574-805d-ade5f94fe86f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:04.382395 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-3501bdf2-aafe-4895-83e8-f90efec141d0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] HTTP exception thrown: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. Oct 12 22:00:04.382763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0bbfa49f-fa28-4e17-b232-70d955930d3e req-49c5cfe2-6333-4574-805d-ade5f94fe86f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:04.383267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0bbfa49f-fa28-4e17-b232-70d955930d3e req-49c5cfe2-6333-4574-805d-ade5f94fe86f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3501bdf2-aafe-4895-83e8-f90efec141d0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Request method failure captured: Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 HTTP/1.1 Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzixL60DKtZ0wPIyJpdXkNjST1m8Dxf4kXIAuolJ3vTJi2gZxgmCh8rTCna1aXLoLyYAEolOQGIEZkJpq06HavtA-pyrGd0u4H8YCcam-AaUzGn1s1tamTcZWLVa6VH7Pw-oFZDyxF-yA2qeowGH8a0iGLqgPV3Gpbo6BKbZTmyb1Dc Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 83e13591fa0c4a789d71e35d18f97f37 Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-AggregatesAdminTestJSON-822261613 Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:00:04.391698 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:00:04.392994 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83e13591fa0c4a789d71e35d18f97f37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83e13591fa0c4a789d71e35d18f97f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_83e13591fa0c4a789d71e35d18f97f37", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/83e13591fa0c4a789d71e35d18f97f37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:04.392994 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-AggregatesAdminTestJSON-822261613 Oct 12 22:00:04.392994 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 83e13591fa0c4a789d71e35d18f97f37 Oct 12 22:00:04.392994 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-822261613 Oct 12 22:00:04.392994 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-AggregatesAdminTestJSON-822261613-project Oct 12 22:00:04.392994 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:04.392994 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:04.392994 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 8c7541fc7fee4bb0a911a3a211edd010 Oct 12 22:00:04.392994 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-AggregatesAdminTestJSON-822261613-project Oct 12 22:00:04.392994 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:00:04.392994 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. Oct 12 22:00:04.392994 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946'} Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:04.393642 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. Oct 12 22:00:04.394722 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:04.404607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3501bdf2-aafe-4895-83e8-f90efec141d0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Returning 404 to user: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:04.406073 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3501bdf2-aafe-4895-83e8-f90efec141d0 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 404 len: 111 microversion: 2.1 time: 0.175602 Oct 12 22:00:04.408390 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 81/173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:04 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:04.410367 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-0bbfa49f-fa28-4e17-b232-70d955930d3e req-49c5cfe2-6333-4574-805d-ade5f94fe86f service nova] Creating event network-vif-deleted:614ffa2d-72a9-4c09-8791-293fc379f766 for instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d on n-h1-861111-1 Oct 12 22:00:04.421840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aca8ce17-2737-4704-84f6-56a3342d1656 tempest-SecurityGroupsTestAdminJSON-814582856 tempest-SecurityGroupsTestAdminJSON-814582856-project] Calling method '.version_select at 0x7f5128c3a280>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:04.424513 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-0bbfa49f-fa28-4e17-b232-70d955930d3e req-49c5cfe2-6333-4574-805d-ade5f94fe86f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097648 Oct 12 22:00:04.425666 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 93/174] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:04.449919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5a25d8bf-5fa4-440c-b8b5-a14384c4b4de tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861111-1"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:04.470156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a25d8bf-5fa4-440c-b8b5-a14384c4b4de tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:04.470875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a25d8bf-5fa4-440c-b8b5-a14384c4b4de tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:04.471506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a25d8bf-5fa4-440c-b8b5-a14384c4b4de tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:04.714213 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5a25d8bf-5fa4-440c-b8b5-a14384c4b4de tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 300 microversion: 2.1 time: 0.286958 Oct 12 22:00:04.715107 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 94/175] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 12 22:00:04 2022] POST /compute/v2.1/os-aggregates/3/action => generated 300 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:04.720963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4d3cab16-744d-478b-a812-046ff115f7e6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:04.722527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4d3cab16-744d-478b-a812-046ff115f7e6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:04.730808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d3cab16-744d-478b-a812-046ff115f7e6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:04.731536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d3cab16-744d-478b-a812-046ff115f7e6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:04.732131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d3cab16-744d-478b-a812-046ff115f7e6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:04.732995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d3cab16-744d-478b-a812-046ff115f7e6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:04.733600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d3cab16-744d-478b-a812-046ff115f7e6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:04.734197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d3cab16-744d-478b-a812-046ff115f7e6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:04.996424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4d3cab16-744d-478b-a812-046ff115f7e6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:05.010176 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4d3cab16-744d-478b-a812-046ff115f7e6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1390 microversion: 2.1 time: 0.293106 Oct 12 22:00:05.011044 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 95/176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:04 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1390 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:05.015908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1c09f799-ebf4-47b1-8ee1-0382ad18f074 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:05.068672 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1c09f799-ebf4-47b1-8ee1-0382ad18f074 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.056123 Oct 12 22:00:05.069723 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 96/177] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:00:05 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:00:05.084940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-167b3da9-5cdf-4d89-b73e-d6c19faf7d40 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1628844981"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:05.089537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.aggregate [None req-167b3da9-5cdf-4d89-b73e-d6c19faf7d40 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Generated uuid f2bdb3fb-9528-4948-b62b-fe1ec37bb125 for aggregate {{(pid=120453) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:00:05.169679 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-167b3da9-5cdf-4d89-b73e-d6c19faf7d40 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.090711 Oct 12 22:00:05.171095 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 97/178] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 22:00:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:05.195557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c1c62dc0-d862-467a-95f3-098bb5a4348c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861111-1"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:05.228999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1c62dc0-d862-467a-95f3-098bb5a4348c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:05.229768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1c62dc0-d862-467a-95f3-098bb5a4348c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:05.230276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1c62dc0-d862-467a-95f3-098bb5a4348c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:05.492427 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c1c62dc0-d862-467a-95f3-098bb5a4348c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.313066 Oct 12 22:00:05.493342 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 98/179] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 12 22:00:05 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:05.500497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-11e922ed-49ef-4379-abc8-45f34fb75e7d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:05.501131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-11e922ed-49ef-4379-abc8-45f34fb75e7d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:05.518679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11e922ed-49ef-4379-abc8-45f34fb75e7d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:05.519291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11e922ed-49ef-4379-abc8-45f34fb75e7d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:05.519998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11e922ed-49ef-4379-abc8-45f34fb75e7d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:05.520910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11e922ed-49ef-4379-abc8-45f34fb75e7d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:05.522098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11e922ed-49ef-4379-abc8-45f34fb75e7d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:05.531578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11e922ed-49ef-4379-abc8-45f34fb75e7d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:05.596371 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-11e922ed-49ef-4379-abc8-45f34fb75e7d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] HTTP exception thrown: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-11e922ed-49ef-4379-abc8-45f34fb75e7d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Request method failure captured: Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d HTTP/1.1 Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzivT0OU0BNpg9FJtNsm8iG6kmLTgW0pNUWoTPRDJCqueLK1q4qDKxAYYeeG65bsuOL8AiwPkeOHQl-FUEWSSZvyFzJFeNV8XyB5hHRm0kpt4d66LYrcuUHfLl4s5a8JY5vOGaUKpcXYVuDpJxqyxBdfWpFT_5Eb82eh3SXIvgi6iTA Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 62279514893442c3993a79dab7c2cbb3 Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:00:05.598608 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:00:05.600617 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62279514893442c3993a79dab7c2cbb3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:05.600617 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:05.600617 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 62279514893442c3993a79dab7c2cbb3 Oct 12 22:00:05.600617 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:05.600617 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-DeleteServersAdminTestJSON-1175865066-project Oct 12 22:00:05.600617 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:05.600617 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:05.600617 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6696c1546f834f638bc626413360a81f Oct 12 22:00:05.600617 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-DeleteServersAdminTestJSON-1175865066-project Oct 12 22:00:05.600617 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:00:05.600617 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. Oct 12 22:00:05.600617 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '373004a6-fff2-4a8c-95d7-3d33ef32f89d'} Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:05.601334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. Oct 12 22:00:05.602600 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:05.603741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-11e922ed-49ef-4379-abc8-45f34fb75e7d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Returning 404 to user: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:05.603741 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-11e922ed-49ef-4379-abc8-45f34fb75e7d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 404 len: 111 microversion: 2.1 time: 0.106462 Oct 12 22:00:05.612292 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 99/180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:05 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:05.618007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a3ee86cf-6386-4d75-bc6b-30c190ae73e7 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:05.632853 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a3ee86cf-6386-4d75-bc6b-30c190ae73e7 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 242 microversion: 2.1 time: 0.018792 Oct 12 22:00:05.634091 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 100/181] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 12 22:00:05 2022] GET /compute/v2.1/os-aggregates/8 => generated 242 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:05.647032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-321a611e-7464-4dc8-8f93-88020d6d1e93 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861111-1"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:05.671742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-321a611e-7464-4dc8-8f93-88020d6d1e93 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:05.673730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-321a611e-7464-4dc8-8f93-88020d6d1e93 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:05.674823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-321a611e-7464-4dc8-8f93-88020d6d1e93 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:05.945348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:06.079153 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-321a611e-7464-4dc8-8f93-88020d6d1e93 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.437733 Oct 12 22:00:06.080583 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 101/182] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 12 22:00:05 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:00:06.086412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1484755680", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:06.181985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] validate_networks() for None {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:00:06.265921 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-aca8ce17-2737-4704-84f6-56a3342d1656 tempest-SecurityGroupsTestAdminJSON-814582856 tempest-SecurityGroupsTestAdminJSON-814582856-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 1.855376 Oct 12 22:00:06.266512 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 82/183] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Oct 12 22:00:04 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:06.280528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a152f19d-8cb0-4dc6-b11d-2a81b5fbf4ae tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:06.281419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a152f19d-8cb0-4dc6-b11d-2a81b5fbf4ae tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:06.301337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a152f19d-8cb0-4dc6-b11d-2a81b5fbf4ae tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:06.302125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a152f19d-8cb0-4dc6-b11d-2a81b5fbf4ae tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:06.302772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a152f19d-8cb0-4dc6-b11d-2a81b5fbf4ae tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:06.303754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a152f19d-8cb0-4dc6-b11d-2a81b5fbf4ae tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:06.304414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a152f19d-8cb0-4dc6-b11d-2a81b5fbf4ae tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:06.305002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a152f19d-8cb0-4dc6-b11d-2a81b5fbf4ae tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:06.523327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:00:06.523886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:00:06.524172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:00:06.527852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:00:06.528297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:00:06.538988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:06.539743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:06.540320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:06.541966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:06.542585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:06.543224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:06.565517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Getting quotas for project 62279514893442c3993a79dab7c2cbb3. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:00:06.572065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Getting quotas for user 6696c1546f834f638bc626413360a81f and project 62279514893442c3993a79dab7c2cbb3. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:00:06.587013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:00:06.599914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:00:06.672699 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6f87b8f7-495c-4da7-aae1-430b0ad49bc4 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590524 Oct 12 22:00:06.675396 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 102/184] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:00:06.681969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-70b533c7-2b81-4a37-9f94-15e0125690e4 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:06.719101 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-70b533c7-2b81-4a37-9f94-15e0125690e4 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.042596 Oct 12 22:00:06.721218 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 103/185] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:00:06 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:00:06.729747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b992c0da-c1eb-4d90-b21c-8059168b612d tempest-SecurityGroupsTestAdminJSON-1624002160 tempest-SecurityGroupsTestAdminJSON-1624002160-project-admin] Calling method '.version_select at 0x7f5128f6bee0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:06.917969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a152f19d-8cb0-4dc6-b11d-2a81b5fbf4ae tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:06.946925 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a152f19d-8cb0-4dc6-b11d-2a81b5fbf4ae tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1390 microversion: 2.1 time: 0.679196 Oct 12 22:00:06.947912 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 83/186] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:06 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1390 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:06.975434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1f1c045-22b0-4222-9cbb-253e35baf3b6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:06.976064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a1f1c045-22b0-4222-9cbb-253e35baf3b6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:06.977707 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b992c0da-c1eb-4d90-b21c-8059168b612d tempest-SecurityGroupsTestAdminJSON-1624002160 tempest-SecurityGroupsTestAdminJSON-1624002160-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/aaa18ac8-5990-4d63-985d-8e3c13613c10" status: 202 len: 0 microversion: 2.1 time: 0.252189 Oct 12 22:00:06.978833 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 104/187] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:00:06 2022] DELETE /compute/v2.1/os-security-groups/aaa18ac8-5990-4d63-985d-8e3c13613c10 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:06.991218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-01d208fe-362f-4959-80d2-f13ecd47cca4 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1089774539"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:07.003042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.aggregate [None req-01d208fe-362f-4959-80d2-f13ecd47cca4 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Generated uuid f8faba4c-7445-4823-8e88-ea40e11ca595 for aggregate {{(pid=120453) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:00:07.039224 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-01d208fe-362f-4959-80d2-f13ecd47cca4 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.059095 Oct 12 22:00:07.040383 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 105/188] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 22:00:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:07.045495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-abb7ecae-7c0c-41c0-b54d-333adf99192a tempest-SecurityGroupsTestAdminJSON-1624002160 tempest-SecurityGroupsTestAdminJSON-1624002160-project-admin] Calling method '.version_select at 0x7f5128fa9820>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:07.336844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a1f1c045-22b0-4222-9cbb-253e35baf3b6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:07.359894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=25 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:07.362599 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a1f1c045-22b0-4222-9cbb-253e35baf3b6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 200 len: 1220 microversion: 2.1 time: 0.393179 Oct 12 22:00:07.363895 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 84/189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:06 2022] GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 1220 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:07.371445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6f51a1a5-05de-4434-a6c2-9216c096081c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861111-1"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:07.386964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f51a1a5-05de-4434-a6c2-9216c096081c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:07.387983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f51a1a5-05de-4434-a6c2-9216c096081c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:07.388922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f51a1a5-05de-4434-a6c2-9216c096081c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:07.403700 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-abb7ecae-7c0c-41c0-b54d-333adf99192a tempest-SecurityGroupsTestAdminJSON-1624002160 tempest-SecurityGroupsTestAdminJSON-1624002160-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/4e66682c-74c7-418b-a697-c8aebba5451e" status: 202 len: 0 microversion: 2.1 time: 0.357980 Oct 12 22:00:07.405118 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 106/190] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:00:07 2022] DELETE /compute/v2.1/os-security-groups/4e66682c-74c7-418b-a697-c8aebba5451e => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:07.414033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ed97b593-c0b8-4ec2-b682-cc0a907366c0 tempest-SecurityGroupsTestAdminJSON-814582856 tempest-SecurityGroupsTestAdminJSON-814582856-project] Calling method '.version_select at 0x7f5128cb9550>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:07.605821 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6f51a1a5-05de-4434-a6c2-9216c096081c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.235058 Oct 12 22:00:07.608328 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 85/191] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 12 22:00:07 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:07.907049 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ed97b593-c0b8-4ec2-b682-cc0a907366c0 tempest-SecurityGroupsTestAdminJSON-814582856 tempest-SecurityGroupsTestAdminJSON-814582856-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/2aecdd52-6c40-4559-8ad9-17a3c5ed8e1a" status: 202 len: 0 microversion: 2.1 time: 0.497364 Oct 12 22:00:07.908433 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 107/192] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:00:07 2022] DELETE /compute/v2.1/os-security-groups/2aecdd52-6c40-4559-8ad9-17a3c5ed8e1a => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:07.916062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7f1d35cf-910e-4167-b83e-5302dccab830 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:07.921797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:07.935083 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7f1d35cf-910e-4167-b83e-5302dccab830 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.025025 Oct 12 22:00:07.938730 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 108/193] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 12 22:00:07 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:07.958055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-14dd5d15-5d4c-4cda-acc8-5af8d3150b0a tempest-SecurityGroupsTestAdminJSON-814582856 tempest-SecurityGroupsTestAdminJSON-814582856-project] Calling method '.version_select at 0x7f5128fb90d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:08.182498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1864357480", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "13df621a-275e-488a-8347-5e43bb46475f"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:08.232269 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-14dd5d15-5d4c-4cda-acc8-5af8d3150b0a tempest-SecurityGroupsTestAdminJSON-814582856 tempest-SecurityGroupsTestAdminJSON-814582856-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/27557ce7-dbfb-4030-9b6a-db1172e79ad2" status: 202 len: 0 microversion: 2.1 time: 0.291444 Oct 12 22:00:08.233186 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 109/194] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:00:07 2022] DELETE /compute/v2.1/os-security-groups/27557ce7-dbfb-4030-9b6a-db1172e79ad2 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:08.252375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f71903cd-0437-408b-98f7-9ef3dd3f8842 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861111-1"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:08.274449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f71903cd-0437-408b-98f7-9ef3dd3f8842 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:08.275231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f71903cd-0437-408b-98f7-9ef3dd3f8842 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:08.275977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f71903cd-0437-408b-98f7-9ef3dd3f8842 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:08.319100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] validate_networks() for [('13df621a-275e-488a-8347-5e43bb46475f', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:00:08.430309 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f71903cd-0437-408b-98f7-9ef3dd3f8842 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.195621 Oct 12 22:00:08.431797 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 110/195] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 12 22:00:08 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:08.437310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-127bf1fe-486c-453b-b9bd-dbbcc7b52af3 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:08.438444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-127bf1fe-486c-453b-b9bd-dbbcc7b52af3 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:08.447212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-127bf1fe-486c-453b-b9bd-dbbcc7b52af3 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:08.448195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-127bf1fe-486c-453b-b9bd-dbbcc7b52af3 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:08.448884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-127bf1fe-486c-453b-b9bd-dbbcc7b52af3 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:08.449807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-127bf1fe-486c-453b-b9bd-dbbcc7b52af3 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:08.450734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-127bf1fe-486c-453b-b9bd-dbbcc7b52af3 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:08.451416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-127bf1fe-486c-453b-b9bd-dbbcc7b52af3 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:08.682112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-127bf1fe-486c-453b-b9bd-dbbcc7b52af3 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:08.689898 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-127bf1fe-486c-453b-b9bd-dbbcc7b52af3 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1390 microversion: 2.1 time: 0.256773 Oct 12 22:00:08.691451 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 111/196] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:08 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1390 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:08.974469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bf9aa928-f715-4086-8afc-1a3e6b364237 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Calling method '.version_select at 0x7f51290b1550>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:09.001778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:09.057292 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bf9aa928-f715-4086-8afc-1a3e6b364237 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074" status: 200 len: 371 microversion: 2.1 time: 0.364776 Oct 12 22:00:09.058296 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 112/197] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 12 22:00:08 2022] GET /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074 => generated 371 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:09.064720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-29693f25-b6f9-4c6b-8473-b3190d5e1a20 req-21d1308e-d0f1-4c4e-a0f6-b8799e64ad5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1848e1da-8fef-4d2e-93b0-87af0c4fe39d", "tag": "6d33ba53-ea2f-4f4f-a7b2-f87a95f5c19e"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:09.090219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-29693f25-b6f9-4c6b-8473-b3190d5e1a20 req-21d1308e-d0f1-4c4e-a0f6-b8799e64ad5b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:09.090787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-29693f25-b6f9-4c6b-8473-b3190d5e1a20 req-21d1308e-d0f1-4c4e-a0f6-b8799e64ad5b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:09.091142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-29693f25-b6f9-4c6b-8473-b3190d5e1a20 req-21d1308e-d0f1-4c4e-a0f6-b8799e64ad5b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:09.115625 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-29693f25-b6f9-4c6b-8473-b3190d5e1a20 req-21d1308e-d0f1-4c4e-a0f6-b8799e64ad5b service nova] Creating event network-changed:6d33ba53-ea2f-4f4f-a7b2-f87a95f5c19e for instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d on n-h2-861111-1 Oct 12 22:00:09.148546 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-29693f25-b6f9-4c6b-8473-b3190d5e1a20 req-21d1308e-d0f1-4c4e-a0f6-b8799e64ad5b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083913 Oct 12 22:00:09.150970 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 113/198] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:09.157018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-05b6e44f-8316-4ca2-9bbb-de100b242fa6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:09.158253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-05b6e44f-8316-4ca2-9bbb-de100b242fa6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:09.179362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05b6e44f-8316-4ca2-9bbb-de100b242fa6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:09.180165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05b6e44f-8316-4ca2-9bbb-de100b242fa6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:09.180671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05b6e44f-8316-4ca2-9bbb-de100b242fa6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:09.181604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05b6e44f-8316-4ca2-9bbb-de100b242fa6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:09.182258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05b6e44f-8316-4ca2-9bbb-de100b242fa6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:09.183045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05b6e44f-8316-4ca2-9bbb-de100b242fa6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:09.280916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-05b6e44f-8316-4ca2-9bbb-de100b242fa6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:09.294838 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-05b6e44f-8316-4ca2-9bbb-de100b242fa6 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 200 len: 1278 microversion: 2.1 time: 0.142477 Oct 12 22:00:09.296001 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 114/199] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:09 2022] GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 1278 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:09.302118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-64a6f162-6aa6-4132-a04f-2ab1313c95b5 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:09.336393 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-64a6f162-6aa6-4132-a04f-2ab1313c95b5 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.038963 Oct 12 22:00:09.337440 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 115/200] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:00:09 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:00:09.346952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dc61c5b6-0242-4349-a4be-2555d5472db1 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Action: 'update', calling method: .version_select at 0x7f5128fa9670>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:09.645328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc61c5b6-0242-4349-a4be-2555d5472db1 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:09.646966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc61c5b6-0242-4349-a4be-2555d5472db1 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:09.647925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc61c5b6-0242-4349-a4be-2555d5472db1 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:09.651681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc61c5b6-0242-4349-a4be-2555d5472db1 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:09.652281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc61c5b6-0242-4349-a4be-2555d5472db1 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:09.652952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc61c5b6-0242-4349-a4be-2555d5472db1 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:09.759831 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dc61c5b6-0242-4349-a4be-2555d5472db1 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074" status: 200 len: 328 microversion: 2.1 time: 0.420430 Oct 12 22:00:09.761718 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 116/201] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 12 22:00:09 2022] PUT /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074 => generated 328 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:09.767468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1223514e-92b5-41ee-bf1b-24226fd46d57 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-168180062"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:09.772643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.aggregate [None req-1223514e-92b5-41ee-bf1b-24226fd46d57 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Generated uuid da9cc077-e3ca-4a80-afef-1afb9fd153f1 for aggregate {{(pid=120453) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:00:09.833347 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1223514e-92b5-41ee-bf1b-24226fd46d57 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.070269 Oct 12 22:00:09.835578 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 117/202] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 22:00:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:09.845186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-acca77f5-9d62-4b4e-ae9f-436882394fc7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:09.846048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-acca77f5-9d62-4b4e-ae9f-436882394fc7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:09.863877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acca77f5-9d62-4b4e-ae9f-436882394fc7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:09.867080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acca77f5-9d62-4b4e-ae9f-436882394fc7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:09.867587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acca77f5-9d62-4b4e-ae9f-436882394fc7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:09.868340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acca77f5-9d62-4b4e-ae9f-436882394fc7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:09.868803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acca77f5-9d62-4b4e-ae9f-436882394fc7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:09.869236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acca77f5-9d62-4b4e-ae9f-436882394fc7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:10.072771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:00:10.073679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:00:10.074313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:00:10.075124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:00:10.076067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:00:10.099111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-acca77f5-9d62-4b4e-ae9f-436882394fc7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:10.106207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:10.106864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:10.107411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:10.112594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:10.119279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:10.119767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:10.134935 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-acca77f5-9d62-4b4e-ae9f-436882394fc7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1390 microversion: 2.1 time: 0.293666 Oct 12 22:00:10.135672 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 118/203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:09 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1390 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:10.147280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-261c0ef6-31a7-4c59-89d6-ba312e5fbf2c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861111-1"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:10.171342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-261c0ef6-31a7-4c59-89d6-ba312e5fbf2c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:10.171836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-261c0ef6-31a7-4c59-89d6-ba312e5fbf2c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:10.172310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-261c0ef6-31a7-4c59-89d6-ba312e5fbf2c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:10.200047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Getting quotas for project 61e71a9eeaa044e8aa939548f15a585e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:00:10.210985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Getting quotas for user 1fe98ba1ceec4b849eb45eb46ce4d425 and project 61e71a9eeaa044e8aa939548f15a585e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:00:10.241277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:00:10.244012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:00:10.390153 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d9ede9a9-66fc-4338-bb5a-ca70e4ce648d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.764875 Oct 12 22:00:10.397407 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 86/204] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:00:10.504860 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-261c0ef6-31a7-4c59-89d6-ba312e5fbf2c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.366401 Oct 12 22:00:10.508562 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 119/205] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 12 22:00:10 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:10.515998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-29d4015e-aaa1-4c0c-b2ab-9c7a035c55c8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:10.519023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-29d4015e-aaa1-4c0c-b2ab-9c7a035c55c8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:10.542231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d4015e-aaa1-4c0c-b2ab-9c7a035c55c8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:10.543790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d4015e-aaa1-4c0c-b2ab-9c7a035c55c8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:10.544244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d4015e-aaa1-4c0c-b2ab-9c7a035c55c8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:10.548004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d4015e-aaa1-4c0c-b2ab-9c7a035c55c8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:10.548751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d4015e-aaa1-4c0c-b2ab-9c7a035c55c8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:10.549203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d4015e-aaa1-4c0c-b2ab-9c7a035c55c8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:11.023804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-192771653", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:11.115609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:00:11.272461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-29d4015e-aaa1-4c0c-b2ab-9c7a035c55c8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:11.280847 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-29d4015e-aaa1-4c0c-b2ab-9c7a035c55c8 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 200 len: 1320 microversion: 2.1 time: 0.771032 Oct 12 22:00:11.298644 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 120/206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:10 2022] GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 1320 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:11.308783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f52dfca4-7bd8-4ccf-b986-6952362a2426 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:11.309412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f52dfca4-7bd8-4ccf-b986-6952362a2426 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:11.434332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f52dfca4-7bd8-4ccf-b986-6952362a2426 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:11.444321 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f52dfca4-7bd8-4ccf-b986-6952362a2426 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1211 microversion: 2.1 time: 0.145329 Oct 12 22:00:11.445153 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 121/207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:11 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1211 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:11.463777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7155aabf-8c96-4640-b6e4-50b741491475 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861111-1"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:11.494807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7155aabf-8c96-4640-b6e4-50b741491475 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:11.496708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7155aabf-8c96-4640-b6e4-50b741491475 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:11.499412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7155aabf-8c96-4640-b6e4-50b741491475 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:11.657696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:00:11.658131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:00:11.658608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:00:11.659025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:00:11.659472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:00:11.682190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:11.682810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:11.683276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:11.684817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:11.685758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:11.686225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:11.719676 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7155aabf-8c96-4640-b6e4-50b741491475 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.272541 Oct 12 22:00:11.722807 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 122/208] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 12 22:00:11 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:11.747758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-639622a5-2720-491a-99ee-f184a036116e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:11.758443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-639622a5-2720-491a-99ee-f184a036116e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:11.797885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-639622a5-2720-491a-99ee-f184a036116e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:11.798393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-639622a5-2720-491a-99ee-f184a036116e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:11.798839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-639622a5-2720-491a-99ee-f184a036116e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:11.799596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-639622a5-2720-491a-99ee-f184a036116e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:11.800830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Getting quotas for project ef34fa2ef2ed4843ba2a775fe0449074. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:00:11.802008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-639622a5-2720-491a-99ee-f184a036116e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:11.803193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-639622a5-2720-491a-99ee-f184a036116e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:11.809237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Getting quotas for user 65a99cc4e9544f589832706aceb386e3 and project ef34fa2ef2ed4843ba2a775fe0449074. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:00:11.847291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.utils [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] cores quota exceeded for ef34fa2ef2ed4843ba2a775fe0449074, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120452) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 12 22:00:11.848540 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Request method failure captured: Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 144 Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzjmSPvT7-gmqchWY6V9Ly7TQcRen29D2jjq0bQQvcsXiOQopWOUORESZJTFTQCgx3DwjRhOAiqmhOWdKPU-v2eBkTxzZIINlLgLyEsPxwq_FVmc0BQLRhSKQTOyafLibX2HR0cnBxfSpsL4J4xBTiSlIeA21DF-WJ1ti1awYRYdQCU Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ef34fa2ef2ed4843ba2a775fe0449074 Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-QuotasAdminNegativeTest-1030389540 Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:00:11.873010 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:00:11.874549 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef34fa2ef2ed4843ba2a775fe0449074"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef34fa2ef2ed4843ba2a775fe0449074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef34fa2ef2ed4843ba2a775fe0449074", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef34fa2ef2ed4843ba2a775fe0449074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:11.874549 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-QuotasAdminNegativeTest-1030389540 Oct 12 22:00:11.874549 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ef34fa2ef2ed4843ba2a775fe0449074 Oct 12 22:00:11.874549 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1030389540 Oct 12 22:00:11.874549 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-QuotasAdminNegativeTest-1030389540-project Oct 12 22:00:11.874549 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:11.874549 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:11.874549 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 65a99cc4e9544f589832706aceb386e3 Oct 12 22:00:11.874549 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-QuotasAdminNegativeTest-1030389540-project Oct 12 22:00:11.874549 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:00:11.874549 n-d-861111-1 devstack@n-api.service[120452]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-192771653", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} Oct 12 22:00:11.874549 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-192771653', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452'}}} Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 22:00:11.875573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:11.876842 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:11.878386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:11.879811 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:11.879811 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:11.879811 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:11.879811 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:11.879811 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 22:00:11.879811 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:11.879811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:11.879811 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8fac6f75-3e39-4b80-854b-7dc69685cdca tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.467566 Oct 12 22:00:11.879811 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 87/209] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:10 2022] POST /compute/v2.1/servers => generated 111 bytes in 1475 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:11.899111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c3edf35e-3b6e-4feb-ae29-648f092b7d00 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:11.952653 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c3edf35e-3b6e-4feb-ae29-648f092b7d00 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.058246 Oct 12 22:00:11.953151 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 88/210] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 12 22:00:11 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:00:11.971689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f83359a-8a69-42ba-a362-874bb861c0a4 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Action: 'update', calling method: .version_select at 0x7f5128b1f5e0>, body: {"quota_set": {"cores": 20}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:12.335528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f83359a-8a69-42ba-a362-874bb861c0a4 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:12.339361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f83359a-8a69-42ba-a362-874bb861c0a4 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:12.339808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f83359a-8a69-42ba-a362-874bb861c0a4 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:12.342025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f83359a-8a69-42ba-a362-874bb861c0a4 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:12.343482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f83359a-8a69-42ba-a362-874bb861c0a4 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:12.345733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f83359a-8a69-42ba-a362-874bb861c0a4 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:12.375817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-639622a5-2720-491a-99ee-f184a036116e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:12.388574 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-639622a5-2720-491a-99ee-f184a036116e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1390 microversion: 2.1 time: 0.659752 Oct 12 22:00:12.390903 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 123/211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:11 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1390 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:12.398784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-016ab492-d29f-4c7e-8ed4-b0177b9bc49c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1744300946"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:12.403750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.aggregate [None req-016ab492-d29f-4c7e-8ed4-b0177b9bc49c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Generated uuid ade4d247-72ff-4a20-8d0e-77ff90834616 for aggregate {{(pid=120453) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:00:12.456445 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-016ab492-d29f-4c7e-8ed4-b0177b9bc49c tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.064227 Oct 12 22:00:12.468372 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 124/212] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 22:00:12 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:12.485600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b62c44e1-0f31-4db6-ace5-46687eaa0c47 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2098863666"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:12.498172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.aggregate [None req-b62c44e1-0f31-4db6-ace5-46687eaa0c47 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Generated uuid f956aba1-47d7-4240-8755-e442062b8089 for aggregate {{(pid=120453) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:00:12.499312 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f83359a-8a69-42ba-a362-874bb861c0a4 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074" status: 200 len: 329 microversion: 2.1 time: 0.540955 Oct 12 22:00:12.502213 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 89/213] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 12 22:00:11 2022] PUT /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074 => generated 329 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:12.508671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-43fb66df-2d36-44f5-acab-81768768e8ae tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:12.509485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-43fb66df-2d36-44f5-acab-81768768e8ae tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:12.533246 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43fb66df-2d36-44f5-acab-81768768e8ae tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:12.533991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43fb66df-2d36-44f5-acab-81768768e8ae tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:12.534602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43fb66df-2d36-44f5-acab-81768768e8ae tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:12.535690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43fb66df-2d36-44f5-acab-81768768e8ae tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:12.536350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43fb66df-2d36-44f5-acab-81768768e8ae tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:12.548160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43fb66df-2d36-44f5-acab-81768768e8ae tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:12.550653 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b62c44e1-0f31-4db6-ace5-46687eaa0c47 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.079509 Oct 12 22:00:12.559569 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 125/214] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 22:00:12 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:12.572873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bb08a5e4-4289-4a4f-b5c1-eee3305bd983 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:12.575107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bb08a5e4-4289-4a4f-b5c1-eee3305bd983 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:12.593170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb08a5e4-4289-4a4f-b5c1-eee3305bd983 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:12.595036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb08a5e4-4289-4a4f-b5c1-eee3305bd983 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:12.595703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb08a5e4-4289-4a4f-b5c1-eee3305bd983 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:12.596573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb08a5e4-4289-4a4f-b5c1-eee3305bd983 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:12.597739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb08a5e4-4289-4a4f-b5c1-eee3305bd983 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:12.600080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb08a5e4-4289-4a4f-b5c1-eee3305bd983 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:12.913710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bb08a5e4-4289-4a4f-b5c1-eee3305bd983 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:12.926918 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bb08a5e4-4289-4a4f-b5c1-eee3305bd983 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1263 microversion: 2.1 time: 0.364030 Oct 12 22:00:12.930268 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 126/215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:12 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1263 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:12.941145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-114b7a93-19b8-4cc5-b9d7-04bd8df9c714 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:12.989233 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-114b7a93-19b8-4cc5-b9d7-04bd8df9c714 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.057641 Oct 12 22:00:12.994713 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 127/216] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 12 22:00:12 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:00:13.006807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c881ec9b-ccfd-4fca-8d55-7cf156658799 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Calling method '.version_select at 0x7f5128fb9160>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:13.104125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-43fb66df-2d36-44f5-acab-81768768e8ae tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:13.127381 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-43fb66df-2d36-44f5-acab-81768768e8ae tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 200 len: 1320 microversion: 2.1 time: 0.622050 Oct 12 22:00:13.129721 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 90/217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:12 2022] GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 1320 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:13.141538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cabf4272-798c-4495-8985-934f0776589b tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861111-1"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:13.156886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cabf4272-798c-4495-8985-934f0776589b tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:13.157740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cabf4272-798c-4495-8985-934f0776589b tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:13.158582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cabf4272-798c-4495-8985-934f0776589b tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:13.182803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:13.188090 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c881ec9b-ccfd-4fca-8d55-7cf156658799 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074" status: 200 len: 371 microversion: 2.1 time: 0.190932 Oct 12 22:00:13.190745 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 128/218] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 12 22:00:12 2022] GET /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074 => generated 371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:13.208815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3957a2d0-1391-44ef-9040-4045ba069a29 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:13.223492 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-3957a2d0-1391-44ef-9040-4045ba069a29 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3957a2d0-1391-44ef-9040-4045ba069a29 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Request method failure captured: Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzi0yH0d2DoqEAdZ1qNZSY2lhz_f1h9IZZMLBLT8pNQTJj4d5FbRjF46ZPG3GeTGPXfMC4wWD__uLQd-hGOp-m1kk2dK12Mik5SN3TX9CsRQsWuYD5PNF8a1cYLb2W5bpM9F637HcWuR5fPp5U0mCENZm1nXJcbNXo6wBx_ftRbPTZI Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7b8cc7499d944867bd3de574918861e4 Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AggregatesAdminTestJSON-1449769757 Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:00:13.226328 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:00:13.227778 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b8cc7499d944867bd3de574918861e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b8cc7499d944867bd3de574918861e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b8cc7499d944867bd3de574918861e4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b8cc7499d944867bd3de574918861e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:13.227778 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AggregatesAdminTestJSON-1449769757 Oct 12 22:00:13.227778 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7b8cc7499d944867bd3de574918861e4 Oct 12 22:00:13.227778 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1449769757 Oct 12 22:00:13.227778 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AggregatesAdminTestJSON-1449769757-project-admin Oct 12 22:00:13.227778 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:13.227778 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:13.227778 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 75931388803c4531ad897231b4d92ded Oct 12 22:00:13.227778 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AggregatesAdminTestJSON-1449769757-project-admin Oct 12 22:00:13.227778 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:00:13.227778 n-d-861111-1 devstack@n-api.service[120453]: exception: Aggregate 11 could not be found. Oct 12 22:00:13.227778 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '11'} Oct 12 22:00:13.227778 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:13.228656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 12 22:00:13.229770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:13.232038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3957a2d0-1391-44ef-9040-4045ba069a29 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:13.233052 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3957a2d0-1391-44ef-9040-4045ba069a29 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.041193 Oct 12 22:00:13.237138 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 129/219] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:00:13 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:00:13.243208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eae2f79e-3e5d-42c2-a495-08feedefa059 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Action: 'update', calling method: .version_select at 0x7f5128d3fe50>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:13.408222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eae2f79e-3e5d-42c2-a495-08feedefa059 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:13.410583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eae2f79e-3e5d-42c2-a495-08feedefa059 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:13.411151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eae2f79e-3e5d-42c2-a495-08feedefa059 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:13.412651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eae2f79e-3e5d-42c2-a495-08feedefa059 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:13.413368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eae2f79e-3e5d-42c2-a495-08feedefa059 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:13.415332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eae2f79e-3e5d-42c2-a495-08feedefa059 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:13.426210 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cabf4272-798c-4495-8985-934f0776589b tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 243 microversion: 2.1 time: 0.292473 Oct 12 22:00:13.428058 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 91/220] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 12 22:00:13 2022] POST /compute/v2.1/os-aggregates/12/action => generated 243 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:13.436598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f9f3d013-79a6-4f61-9174-0ff25fe1efb7 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:13.461906 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-f9f3d013-79a6-4f61-9174-0ff25fe1efb7 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f9f3d013-79a6-4f61-9174-0ff25fe1efb7 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Request method failure captured: Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzi0yH0d2DoqEAdZ1qNZSY2lhz_f1h9IZZMLBLT8pNQTJj4d5FbRjF46ZPG3GeTGPXfMC4wWD__uLQd-hGOp-m1kk2dK12Mik5SN3TX9CsRQsWuYD5PNF8a1cYLb2W5bpM9F637HcWuR5fPp5U0mCENZm1nXJcbNXo6wBx_ftRbPTZI Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 7b8cc7499d944867bd3de574918861e4 Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-AggregatesAdminTestJSON-1449769757 Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 22:00:13.465342 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 22:00:13.466688 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b8cc7499d944867bd3de574918861e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b8cc7499d944867bd3de574918861e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b8cc7499d944867bd3de574918861e4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b8cc7499d944867bd3de574918861e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:13.466688 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-AggregatesAdminTestJSON-1449769757 Oct 12 22:00:13.466688 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 7b8cc7499d944867bd3de574918861e4 Oct 12 22:00:13.466688 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1449769757 Oct 12 22:00:13.466688 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-AggregatesAdminTestJSON-1449769757-project-admin Oct 12 22:00:13.466688 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:13.466688 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:13.466688 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 75931388803c4531ad897231b4d92ded Oct 12 22:00:13.466688 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-AggregatesAdminTestJSON-1449769757-project-admin Oct 12 22:00:13.466688 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:00:13.466688 n-d-861111-1 devstack@n-api.service[120452]: exception: Aggregate 11 could not be found. Oct 12 22:00:13.466688 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '11'} Oct 12 22:00:13.466688 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:00:13.467508 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:13.468705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:13.470083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:13.470083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:13.470083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:13.470083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 12 22:00:13.470083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:13.471155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f9f3d013-79a6-4f61-9174-0ff25fe1efb7 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:13.472187 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f9f3d013-79a6-4f61-9174-0ff25fe1efb7 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.042489 Oct 12 22:00:13.475942 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 92/221] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 12 22:00:13 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:00:13.495092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-743a8db1-0be4-4f18-aa34-8f931f564040 req-fd663cbc-0f9a-467d-b9b8-a0801bef4ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca31258-b0ea-447d-aff6-5612a0746d3c", "tag": "ce6e8cde-b0cb-4892-95a8-9630e7a4ad93"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:13.521395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:13.539228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-743a8db1-0be4-4f18-aa34-8f931f564040 req-fd663cbc-0f9a-467d-b9b8-a0801bef4ae7 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:13.539968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-743a8db1-0be4-4f18-aa34-8f931f564040 req-fd663cbc-0f9a-467d-b9b8-a0801bef4ae7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:13.540643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-743a8db1-0be4-4f18-aa34-8f931f564040 req-fd663cbc-0f9a-467d-b9b8-a0801bef4ae7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:13.549103 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eae2f79e-3e5d-42c2-a495-08feedefa059 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074" status: 200 len: 328 microversion: 2.1 time: 0.310554 Oct 12 22:00:13.550096 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 130/222] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 12 22:00:13 2022] PUT /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074 => generated 328 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:13.557607 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-743a8db1-0be4-4f18-aa34-8f931f564040 req-fd663cbc-0f9a-467d-b9b8-a0801bef4ae7 service nova] Creating event network-changed:ce6e8cde-b0cb-4892-95a8-9630e7a4ad93 for instance 7ca31258-b0ea-447d-aff6-5612a0746d3c on n-h1-861111-1 Oct 12 22:00:13.565145 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-743a8db1-0be4-4f18-aa34-8f931f564040 req-fd663cbc-0f9a-467d-b9b8-a0801bef4ae7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087386 Oct 12 22:00:13.566479 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 93/223] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:13.572209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e272ab4f-d7bc-44e3-9a19-784e7cd8f01c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:13.572858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e272ab4f-d7bc-44e3-9a19-784e7cd8f01c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:13.574664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-129de429-2759-483d-a6c3-6d2278d76c43 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861111-1"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:13.579656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-129de429-2759-483d-a6c3-6d2278d76c43 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '3f8d0f8194bc4bfdb6ec664b74cd3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41167f320c5d4f7fbf507493bbd52011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-129de429-2759-483d-a6c3-6d2278d76c43 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Request method failure captured: Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 42 Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRziw7sBUmqVgnlVnGeqzadideJY0q4eDK4Xm2VdEtBEtelMi3J6ahPto8hQoBax-1kGt6oT7bwtLMqMdVa2FgocJAh8BYFQCvn0574AZIlB0jE2oUl6gwM4HBI7QpnrMjMW9Kzpjwia1bFP1-Eb3HzkXB5N4aoh642oazstPm4GhMzo Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 41167f320c5d4f7fbf507493bbd52011 Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:00:13.583060 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:00:13.584581 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41167f320c5d4f7fbf507493bbd52011", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41167f320c5d4f7fbf507493bbd52011"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:13.584581 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 22:00:13.584581 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 41167f320c5d4f7fbf507493bbd52011 Oct 12 22:00:13.584581 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-493335821 Oct 12 22:00:13.584581 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-AggregatesAdminNegativeTestJSON-493335821-project Oct 12 22:00:13.584581 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:13.584581 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:13.584581 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 3f8d0f8194bc4bfdb6ec664b74cd3e98 Oct 12 22:00:13.584581 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-493335821-project Oct 12 22:00:13.584581 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:00:13.584581 n-d-861111-1 devstack@n-api.service[120452]: {"remove_host": {"host": "n-h1-861111-1"}} Oct 12 22:00:13.584581 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:00:13.584581 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h1-861111-1'}}} Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:00:13.585485 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 12 22:00:13.586708 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:13.592290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e272ab4f-d7bc-44e3-9a19-784e7cd8f01c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:13.592791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e272ab4f-d7bc-44e3-9a19-784e7cd8f01c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:13.593232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e272ab4f-d7bc-44e3-9a19-784e7cd8f01c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:13.593952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e272ab4f-d7bc-44e3-9a19-784e7cd8f01c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:13.594407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e272ab4f-d7bc-44e3-9a19-784e7cd8f01c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:13.594829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e272ab4f-d7bc-44e3-9a19-784e7cd8f01c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:13.595756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-129de429-2759-483d-a6c3-6d2278d76c43 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:13.596761 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-129de429-2759-483d-a6c3-6d2278d76c43 tempest-AggregatesAdminNegativeTestJSON-493335821 tempest-AggregatesAdminNegativeTestJSON-493335821-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.028778 Oct 12 22:00:13.597516 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 94/224] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 12 22:00:13 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:13.605967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8ca5118e-69af-4935-a836-895809b1d0fa tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1796177567", "name": "tempest-test_aggregate-893797461"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:13.655052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.aggregate [None req-8ca5118e-69af-4935-a836-895809b1d0fa tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Generated uuid e6d981a1-5dec-4a3f-8800-d52bb08ce8a3 for aggregate {{(pid=120452) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:00:13.720623 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8ca5118e-69af-4935-a836-895809b1d0fa tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.117981 Oct 12 22:00:13.728276 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 95/225] 10.222.0.16 () {60 vars in 1165 bytes} [Wed Oct 12 22:00:13 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:13.735569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0e2ebfb3-2d83-4765-aeb1-4fa32ef8323d tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861111-1"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:13.750867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e2ebfb3-2d83-4765-aeb1-4fa32ef8323d tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:13.751623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e2ebfb3-2d83-4765-aeb1-4fa32ef8323d tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:13.752080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e2ebfb3-2d83-4765-aeb1-4fa32ef8323d tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:14.021065 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0e2ebfb3-2d83-4765-aeb1-4fa32ef8323d tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 228 microversion: 2.1 time: 0.290912 Oct 12 22:00:14.023179 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 96/226] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 12 22:00:13 2022] POST /compute/v2.1/os-aggregates/12/action => generated 228 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:14.030158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-266c9724-a325-4e56-a1b8-bef169cd7762 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:14.054820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e272ab4f-d7bc-44e3-9a19-784e7cd8f01c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:14.066519 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e272ab4f-d7bc-44e3-9a19-784e7cd8f01c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1390 microversion: 2.1 time: 0.515170 Oct 12 22:00:14.072738 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-266c9724-a325-4e56-a1b8-bef169cd7762 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.047471 Oct 12 22:00:14.075375 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 97/227] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 12 22:00:14 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:00:14.083164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1509977013", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:14.091609 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 131/228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:13 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1390 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:14.097107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e321572f-85ff-4084-b362-748d91bd2139 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:14.099742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e321572f-85ff-4084-b362-748d91bd2139 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:14.112922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e321572f-85ff-4084-b362-748d91bd2139 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:14.113813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e321572f-85ff-4084-b362-748d91bd2139 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:14.115181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e321572f-85ff-4084-b362-748d91bd2139 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:14.116119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e321572f-85ff-4084-b362-748d91bd2139 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:14.116775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e321572f-85ff-4084-b362-748d91bd2139 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:14.117418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e321572f-85ff-4084-b362-748d91bd2139 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:14.143938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:00:14.232693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e321572f-85ff-4084-b362-748d91bd2139 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:14.265362 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e321572f-85ff-4084-b362-748d91bd2139 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1269 microversion: 2.1 time: 0.171342 Oct 12 22:00:14.279267 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 132/229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:14 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:14.279267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-513ff9b9-ebfa-4516-96b8-b7e6677f8fda tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:14.320166 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-513ff9b9-ebfa-4516-96b8-b7e6677f8fda tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.051794 Oct 12 22:00:14.322515 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 133/230] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 12 22:00:14 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:00:14.332934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-96e3e945-1e7e-45a6-8442-48539590d32d tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:14.343690 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-96e3e945-1e7e-45a6-8442-48539590d32d tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-96e3e945-1e7e-45a6-8442-48539590d32d tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Request method failure captured: Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzi0yH0d2DoqEAdZ1qNZSY2lhz_f1h9IZZMLBLT8pNQTJj4d5FbRjF46ZPG3GeTGPXfMC4wWD__uLQd-hGOp-m1kk2dK12Mik5SN3TX9CsRQsWuYD5PNF8a1cYLb2W5bpM9F637HcWuR5fPp5U0mCENZm1nXJcbNXo6wBx_ftRbPTZI Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7b8cc7499d944867bd3de574918861e4 Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AggregatesAdminTestJSON-1449769757 Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:00:14.346403 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:00:14.347912 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b8cc7499d944867bd3de574918861e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b8cc7499d944867bd3de574918861e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b8cc7499d944867bd3de574918861e4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b8cc7499d944867bd3de574918861e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:14.347912 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AggregatesAdminTestJSON-1449769757 Oct 12 22:00:14.347912 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7b8cc7499d944867bd3de574918861e4 Oct 12 22:00:14.347912 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1449769757 Oct 12 22:00:14.347912 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AggregatesAdminTestJSON-1449769757-project-admin Oct 12 22:00:14.347912 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:14.347912 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:14.347912 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 75931388803c4531ad897231b4d92ded Oct 12 22:00:14.347912 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AggregatesAdminTestJSON-1449769757-project-admin Oct 12 22:00:14.347912 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:00:14.347912 n-d-861111-1 devstack@n-api.service[120453]: exception: Aggregate 13 could not be found. Oct 12 22:00:14.347912 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '13'} Oct 12 22:00:14.347912 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:14.348811 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 12 22:00:14.351592 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.357221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-96e3e945-1e7e-45a6-8442-48539590d32d tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:14.359706 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-96e3e945-1e7e-45a6-8442-48539590d32d tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.034504 Oct 12 22:00:14.360787 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 134/231] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:00:14 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:00:14.369138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-79ffa79d-e0ef-4442-8fa8-f0afb12a23ce tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:14.369828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-79ffa79d-e0ef-4442-8fa8-f0afb12a23ce tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:14.376408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79ffa79d-e0ef-4442-8fa8-f0afb12a23ce tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:14.376966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79ffa79d-e0ef-4442-8fa8-f0afb12a23ce tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:14.377415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79ffa79d-e0ef-4442-8fa8-f0afb12a23ce tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:14.378193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79ffa79d-e0ef-4442-8fa8-f0afb12a23ce tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:14.378657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79ffa79d-e0ef-4442-8fa8-f0afb12a23ce tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:14.379091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79ffa79d-e0ef-4442-8fa8-f0afb12a23ce tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:14.737669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-79ffa79d-e0ef-4442-8fa8-f0afb12a23ce tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:14.751477 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-79ffa79d-e0ef-4442-8fa8-f0afb12a23ce tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 200 len: 1320 microversion: 2.1 time: 0.388679 Oct 12 22:00:14.752068 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 135/232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:14 2022] GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 1320 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:14.763354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aa3e7933-f3ad-4ac2-a0e7-31dc5636f2bb tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1957338725"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:14.779179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.aggregate [None req-aa3e7933-f3ad-4ac2-a0e7-31dc5636f2bb tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Generated uuid 457aba1a-ed6c-41ba-945a-853fe333408f for aggregate {{(pid=120453) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:00:14.820831 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aa3e7933-f3ad-4ac2-a0e7-31dc5636f2bb tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.061371 Oct 12 22:00:14.821552 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 136/233] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 22:00:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:14.826223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af7257ed-0634-41e6-a56c-f16a0c48b8b6 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:14.863784 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-af7257ed-0634-41e6-a56c-f16a0c48b8b6 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af7257ed-0634-41e6-a56c-f16a0c48b8b6 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Request method failure captured: Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzi0yH0d2DoqEAdZ1qNZSY2lhz_f1h9IZZMLBLT8pNQTJj4d5FbRjF46ZPG3GeTGPXfMC4wWD__uLQd-hGOp-m1kk2dK12Mik5SN3TX9CsRQsWuYD5PNF8a1cYLb2W5bpM9F637HcWuR5fPp5U0mCENZm1nXJcbNXo6wBx_ftRbPTZI Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7b8cc7499d944867bd3de574918861e4 Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AggregatesAdminTestJSON-1449769757 Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:00:14.866305 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:00:14.867799 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b8cc7499d944867bd3de574918861e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b8cc7499d944867bd3de574918861e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b8cc7499d944867bd3de574918861e4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b8cc7499d944867bd3de574918861e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:14.867799 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AggregatesAdminTestJSON-1449769757 Oct 12 22:00:14.867799 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7b8cc7499d944867bd3de574918861e4 Oct 12 22:00:14.867799 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1449769757 Oct 12 22:00:14.867799 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AggregatesAdminTestJSON-1449769757-project-admin Oct 12 22:00:14.867799 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:14.867799 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:14.867799 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 75931388803c4531ad897231b4d92ded Oct 12 22:00:14.867799 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AggregatesAdminTestJSON-1449769757-project-admin Oct 12 22:00:14.867799 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:00:14.867799 n-d-861111-1 devstack@n-api.service[120453]: exception: Aggregate 13 could not be found. Oct 12 22:00:14.867799 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '13'} Oct 12 22:00:14.867799 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:00:14.868628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:14.870181 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:14.871485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:14.871485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:14.871485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:14.871485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 12 22:00:14.871485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.872607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af7257ed-0634-41e6-a56c-f16a0c48b8b6 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:14.873753 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-af7257ed-0634-41e6-a56c-f16a0c48b8b6 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.051164 Oct 12 22:00:14.879464 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 137/234] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 12 22:00:14 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:00:14.884745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e14c6570-7b5d-4fd0-9a5f-bfb9b486267a tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:14.892107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:00:14.892682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:00:14.892981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:00:14.893386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:00:14.893791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:00:14.899777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e14c6570-7b5d-4fd0-9a5f-bfb9b486267a tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:14.900495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e14c6570-7b5d-4fd0-9a5f-bfb9b486267a tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:14.901116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e14c6570-7b5d-4fd0-9a5f-bfb9b486267a tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:14.908288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e14c6570-7b5d-4fd0-9a5f-bfb9b486267a tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:14.909187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e14c6570-7b5d-4fd0-9a5f-bfb9b486267a tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:14.910117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e14c6570-7b5d-4fd0-9a5f-bfb9b486267a tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:14.910631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:14.911111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:14.918211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:14.920124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:14.920599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:14.921024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:14.921761 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.compute.aggregates [None req-e14c6570-7b5d-4fd0-9a5f-bfb9b486267a tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Failed to remove host nonexist_host from aggregate 14. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 12 22:00:14.922446 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-e14c6570-7b5d-4fd0-9a5f-bfb9b486267a tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 14 Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e14c6570-7b5d-4fd0-9a5f-bfb9b486267a tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Request method failure captured: Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/os-aggregates/14/action HTTP/1.1 Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 42 Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzizFbmbzzw4MmGDEmAs8A1yFrFGWLtvpWq3MvkgjiLwjw2AFBoxm5OdAEJDtOSu9t7M8hwMykVeBCqlC1RC2fZ9pe6LCh0dNzHTAxSZ-6Skd3PaUuitsryIrbr9CLPWQAJmwegHlYRRzmbJHMc11PmgVUevVXpjTFgLdMHjff43Kco Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1dd953b9ffe14b04a7dae3549a941ec9 Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:00:14.924890 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:00:14.926129 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1dd953b9ffe14b04a7dae3549a941ec9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1dd953b9ffe14b04a7dae3549a941ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:14.926129 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 22:00:14.926129 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1dd953b9ffe14b04a7dae3549a941ec9 Oct 12 22:00:14.926129 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013 Oct 12 22:00:14.926129 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin Oct 12 22:00:14.926129 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:14.926129 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:14.926129 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 99c714101346471baff51bba8bd22dc1 Oct 12 22:00:14.926129 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin Oct 12 22:00:14.926129 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:00:14.926129 n-d-861111-1 devstack@n-api.service[120453]: {"remove_host": {"host": "nonexist_host"}} Oct 12 22:00:14.926129 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:00:14.926129 n-d-861111-1 devstack@n-api.service[120453]: exception: Cannot remove host nonexist_host in aggregate 14 Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '14', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 12 22:00:14.926841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 12 22:00:14.928171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 14 Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.930175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:14.931494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:14.931494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:14.931494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:14.931494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:14.931494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 14 Oct 12 22:00:14.931494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:14.932778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e14c6570-7b5d-4fd0-9a5f-bfb9b486267a tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 14 {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:14.933829 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e14c6570-7b5d-4fd0-9a5f-bfb9b486267a tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/14/action" status: 404 len: 94 microversion: 2.1 time: 0.053167 Oct 12 22:00:14.934890 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 138/235] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 12 22:00:14 2022] POST /compute/v2.1/os-aggregates/14/action => generated 94 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:00:14.940947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b348f675-db32-4860-9862-e94f8c42ee59 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1969636501"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:14.945133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.aggregate [None req-b348f675-db32-4860-9862-e94f8c42ee59 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Generated uuid 53a2afb8-96f3-4508-82a5-832ca6a6f6a8 for aggregate {{(pid=120453) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:00:14.986060 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b348f675-db32-4860-9862-e94f8c42ee59 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.048789 Oct 12 22:00:14.989527 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 139/236] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 22:00:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:14.998228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Getting quotas for project ef34fa2ef2ed4843ba2a775fe0449074. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:00:15.002162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-da573811-da92-4e6c-a3ba-bc92ecfa4ec2 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:15.011685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Getting quotas for user 65a99cc4e9544f589832706aceb386e3 and project ef34fa2ef2ed4843ba2a775fe0449074. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:00:15.041522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.utils [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] instances quota exceeded for ef34fa2ef2ed4843ba2a775fe0449074, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120452) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 12 22:00:15.042193 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Request method failure captured: Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 145 Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzjmSPvT7-gmqchWY6V9Ly7TQcRen29D2jjq0bQQvcsXiOQopWOUORESZJTFTQCgx3DwjRhOAiqmhOWdKPU-v2eBkTxzZIINlLgLyEsPxwq_FVmc0BQLRhSKQTOyafLibX2HR0cnBxfSpsL4J4xBTiSlIeA21DF-WJ1ti1awYRYdQCU Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ef34fa2ef2ed4843ba2a775fe0449074 Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-QuotasAdminNegativeTest-1030389540 Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:00:15.046517 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:00:15.048076 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef34fa2ef2ed4843ba2a775fe0449074"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef34fa2ef2ed4843ba2a775fe0449074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef34fa2ef2ed4843ba2a775fe0449074", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef34fa2ef2ed4843ba2a775fe0449074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:15.048076 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-QuotasAdminNegativeTest-1030389540 Oct 12 22:00:15.048076 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ef34fa2ef2ed4843ba2a775fe0449074 Oct 12 22:00:15.048076 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1030389540 Oct 12 22:00:15.048076 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-QuotasAdminNegativeTest-1030389540-project Oct 12 22:00:15.048076 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:15.048076 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:15.048076 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 65a99cc4e9544f589832706aceb386e3 Oct 12 22:00:15.048076 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-QuotasAdminNegativeTest-1030389540-project Oct 12 22:00:15.048076 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:00:15.048076 n-d-861111-1 devstack@n-api.service[120452]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1509977013", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} Oct 12 22:00:15.048076 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1509977013', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452'}}} Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 22:00:15.048813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:15.050041 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:15.052223 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:15.054212 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:15.054212 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:15.054212 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:15.054212 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:15.054212 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 22:00:15.054212 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:15.054212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:15.057810 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-745114ab-67d4-4098-bb21-9636e03bdf69 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.978516 Oct 12 22:00:15.066047 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-da573811-da92-4e6c-a3ba-bc92ecfa4ec2 tempest-AggregatesAdminNegativeTestJSON-2079446013 tempest-AggregatesAdminNegativeTestJSON-2079446013-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.074897 Oct 12 22:00:15.067111 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 140/237] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 12 22:00:14 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:00:15.094712 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 98/238] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:14 2022] POST /compute/v2.1/servers => generated 119 bytes in 1021 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:15.106243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5eae161d-469b-46c4-86c0-cb77e78d8dd4 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:15.118008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e3e7fb71-c770-422f-8a8e-9e78daa5de74 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Action: 'update', calling method: .version_select at 0x7f5128a8cc10>, body: {"quota_set": {"instances": 10}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:15.150486 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5eae161d-469b-46c4-86c0-cb77e78d8dd4 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 228 microversion: 2.1 time: 0.067267 Oct 12 22:00:15.153393 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 141/239] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:00:15 2022] GET /compute/v2.1/os-aggregates/15 => generated 228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:15.175898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-935f7014-ffac-4c82-b0ed-a2092ed33d30 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:15.179646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-935f7014-ffac-4c82-b0ed-a2092ed33d30 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:15.222478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-935f7014-ffac-4c82-b0ed-a2092ed33d30 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:15.227126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-935f7014-ffac-4c82-b0ed-a2092ed33d30 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:15.229585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-935f7014-ffac-4c82-b0ed-a2092ed33d30 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:15.231742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-935f7014-ffac-4c82-b0ed-a2092ed33d30 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:15.234958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-935f7014-ffac-4c82-b0ed-a2092ed33d30 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:15.241902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-935f7014-ffac-4c82-b0ed-a2092ed33d30 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:15.346052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3e7fb71-c770-422f-8a8e-9e78daa5de74 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:15.346741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3e7fb71-c770-422f-8a8e-9e78daa5de74 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:15.348185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3e7fb71-c770-422f-8a8e-9e78daa5de74 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:15.350850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3e7fb71-c770-422f-8a8e-9e78daa5de74 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:15.351448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3e7fb71-c770-422f-8a8e-9e78daa5de74 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:15.352039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3e7fb71-c770-422f-8a8e-9e78daa5de74 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:15.509596 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e3e7fb71-c770-422f-8a8e-9e78daa5de74 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074" status: 200 len: 329 microversion: 2.1 time: 0.413051 Oct 12 22:00:15.522057 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 99/240] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 12 22:00:15 2022] PUT /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074 => generated 329 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:15.529226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bff05a9a-35b2-420b-b9f0-755490df51e7 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:15.597251 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bff05a9a-35b2-420b-b9f0-755490df51e7 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 266 microversion: 2.1 time: 0.073134 Oct 12 22:00:15.598286 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 100/241] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 12 22:00:15 2022] POST /compute/v2.1/os-aggregates/15/action => generated 266 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:15.617106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a6158bb4-2497-4ff4-8c1c-942cb79df3a7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:15.622121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a6158bb4-2497-4ff4-8c1c-942cb79df3a7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:15.638198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6158bb4-2497-4ff4-8c1c-942cb79df3a7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:15.638808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6158bb4-2497-4ff4-8c1c-942cb79df3a7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:15.642245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6158bb4-2497-4ff4-8c1c-942cb79df3a7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:15.643215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6158bb4-2497-4ff4-8c1c-942cb79df3a7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:15.644803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6158bb4-2497-4ff4-8c1c-942cb79df3a7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:15.647227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6158bb4-2497-4ff4-8c1c-942cb79df3a7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:15.934077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-935f7014-ffac-4c82-b0ed-a2092ed33d30 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:15.947251 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-935f7014-ffac-4c82-b0ed-a2092ed33d30 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1390 microversion: 2.1 time: 0.791490 Oct 12 22:00:15.949448 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 142/242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:15 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1390 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:15.959891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f889caaf-c654-41be-9c36-0d109ea8b575 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Calling method '.version_select at 0x7f5128fb9310>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:16.075368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a6158bb4-2497-4ff4-8c1c-942cb79df3a7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:16.087880 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a6158bb4-2497-4ff4-8c1c-942cb79df3a7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1311 microversion: 2.1 time: 0.481750 Oct 12 22:00:16.088781 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 101/243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:15 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1311 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:16.099964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fea0a51e-351f-4258-a334-861c81040275 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:16.141292 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fea0a51e-351f-4258-a334-861c81040275 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 242 microversion: 2.1 time: 0.039028 Oct 12 22:00:16.143148 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 102/244] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:00:16 2022] GET /compute/v2.1/os-aggregates/15 => generated 242 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:16.148503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0f3f0585-1750-4f99-b6b0-dbaebccee13d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:16.156503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0f3f0585-1750-4f99-b6b0-dbaebccee13d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:16.180922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f3f0585-1750-4f99-b6b0-dbaebccee13d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:16.181441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f3f0585-1750-4f99-b6b0-dbaebccee13d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:16.183342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f3f0585-1750-4f99-b6b0-dbaebccee13d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:16.184122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f3f0585-1750-4f99-b6b0-dbaebccee13d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:16.190019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f3f0585-1750-4f99-b6b0-dbaebccee13d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:16.190487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f3f0585-1750-4f99-b6b0-dbaebccee13d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:16.329729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=43 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:16.348679 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f889caaf-c654-41be-9c36-0d109ea8b575 tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074" status: 200 len: 371 microversion: 2.1 time: 0.397240 Oct 12 22:00:16.350903 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 143/245] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 12 22:00:15 2022] GET /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074 => generated 371 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:16.356142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e5f3a1fa-d572-43ba-82d7-5289a5cb5c34 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:16.425599 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e5f3a1fa-d572-43ba-82d7-5289a5cb5c34 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.073167 Oct 12 22:00:16.431696 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 144/246] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 12 22:00:16 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:00:16.442419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-10a53eff-88ab-40db-89e8-6c435ee28dbe tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Action: 'update', calling method: .version_select at 0x7f5128ca5ca0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:16.549645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10a53eff-88ab-40db-89e8-6c435ee28dbe tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:16.550128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10a53eff-88ab-40db-89e8-6c435ee28dbe tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:16.550731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10a53eff-88ab-40db-89e8-6c435ee28dbe tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:16.552833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10a53eff-88ab-40db-89e8-6c435ee28dbe tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:16.561178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10a53eff-88ab-40db-89e8-6c435ee28dbe tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:16.561676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10a53eff-88ab-40db-89e8-6c435ee28dbe tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:16.629477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0f3f0585-1750-4f99-b6b0-dbaebccee13d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:16.642570 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0f3f0585-1750-4f99-b6b0-dbaebccee13d tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 200 len: 1320 microversion: 2.1 time: 0.497803 Oct 12 22:00:16.645158 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 103/247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:16 2022] GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 1320 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:16.658845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-53a31fd9-b376-4a9c-8d03-78ca0daeb09b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1197283935", "availability_zone": "tempest-test_az-1327324609"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:16.663005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.aggregate [None req-53a31fd9-b376-4a9c-8d03-78ca0daeb09b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Generated uuid 29151b19-c494-42c5-9a92-aabf3a6207f0 for aggregate {{(pid=120452) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:00:16.664977 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-10a53eff-88ab-40db-89e8-6c435ee28dbe tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074" status: 200 len: 325 microversion: 2.1 time: 0.237515 Oct 12 22:00:16.666471 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 145/248] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 12 22:00:16 2022] PUT /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074 => generated 325 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:16.739726 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-53a31fd9-b376-4a9c-8d03-78ca0daeb09b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.092766 Oct 12 22:00:16.741572 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 104/249] 10.222.0.16 () {60 vars in 1165 bytes} [Wed Oct 12 22:00:16 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:16.755426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f15e5697-e06d-42c2-bfd0-fdb58f37c833 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1197283935_new", "availability_zone": "tempest-test_az-1327324609_new"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:16.866998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-105633386", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:16.924887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f15e5697-e06d-42c2-bfd0-fdb58f37c833 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:16.925650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f15e5697-e06d-42c2-bfd0-fdb58f37c833 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:16.926754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f15e5697-e06d-42c2-bfd0-fdb58f37c833 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:16.971468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:00:17.029267 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f15e5697-e06d-42c2-bfd0-fdb58f37c833 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 337 microversion: 2.1 time: 0.279534 Oct 12 22:00:17.030613 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 146/250] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 12 22:00:16 2022] PUT /compute/v2.1/os-aggregates/16 => generated 337 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:00:17.039191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ce4c92d0-3bbb-45ec-bfc4-570938f88c03 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:17.042100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ce4c92d0-3bbb-45ec-bfc4-570938f88c03 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:17.058674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce4c92d0-3bbb-45ec-bfc4-570938f88c03 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:17.064252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce4c92d0-3bbb-45ec-bfc4-570938f88c03 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:17.065022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce4c92d0-3bbb-45ec-bfc4-570938f88c03 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:17.066196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce4c92d0-3bbb-45ec-bfc4-570938f88c03 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:17.068224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce4c92d0-3bbb-45ec-bfc4-570938f88c03 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:17.069459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce4c92d0-3bbb-45ec-bfc4-570938f88c03 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:17.542678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:00:17.543231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:00:17.543718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:00:17.544300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:00:17.544862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:00:17.560723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:17.567577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:17.568050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:17.568874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:17.569319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:17.569749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:17.597803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Getting quotas for project ef34fa2ef2ed4843ba2a775fe0449074. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:00:17.609121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Getting quotas for user 65a99cc4e9544f589832706aceb386e3 and project ef34fa2ef2ed4843ba2a775fe0449074. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:00:17.623323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.utils [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] ram quota exceeded for ef34fa2ef2ed4843ba2a775fe0449074, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120452) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 12 22:00:17.623917 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Request method failure captured: Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 144 Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzjmSPvT7-gmqchWY6V9Ly7TQcRen29D2jjq0bQQvcsXiOQopWOUORESZJTFTQCgx3DwjRhOAiqmhOWdKPU-v2eBkTxzZIINlLgLyEsPxwq_FVmc0BQLRhSKQTOyafLibX2HR0cnBxfSpsL4J4xBTiSlIeA21DF-WJ1ti1awYRYdQCU Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ef34fa2ef2ed4843ba2a775fe0449074 Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-QuotasAdminNegativeTest-1030389540 Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:00:17.626413 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:00:17.627955 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef34fa2ef2ed4843ba2a775fe0449074"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef34fa2ef2ed4843ba2a775fe0449074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef34fa2ef2ed4843ba2a775fe0449074", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef34fa2ef2ed4843ba2a775fe0449074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:17.627955 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-QuotasAdminNegativeTest-1030389540 Oct 12 22:00:17.627955 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ef34fa2ef2ed4843ba2a775fe0449074 Oct 12 22:00:17.627955 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1030389540 Oct 12 22:00:17.627955 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-QuotasAdminNegativeTest-1030389540-project Oct 12 22:00:17.627955 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:17.627955 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:17.627955 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 65a99cc4e9544f589832706aceb386e3 Oct 12 22:00:17.627955 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-QuotasAdminNegativeTest-1030389540-project Oct 12 22:00:17.627955 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:00:17.627955 n-d-861111-1 devstack@n-api.service[120452]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-105633386", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} Oct 12 22:00:17.627955 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-105633386', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452'}}} Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 22:00:17.628773 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:17.629952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:17.631852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:17.633318 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:17.633318 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:17.633318 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:17.633318 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:17.633318 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 22:00:17.633318 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:17.635201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:17.636272 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b7cb51f7-7406-4286-9f4c-7bf437912f81 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.775300 Oct 12 22:00:17.637213 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 105/251] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:16 2022] POST /compute/v2.1/servers => generated 110 bytes in 777 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:00:17.643864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ed1d320c-6fe9-4af2-8653-db021dcc72f3 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:17.667423 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ed1d320c-6fe9-4af2-8653-db021dcc72f3 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.029030 Oct 12 22:00:17.668006 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 106/252] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 12 22:00:17 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:17.674308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-91a18116-ceed-4102-b6d6-0ea4b60c6fb1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:17.675463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-91a18116-ceed-4102-b6d6-0ea4b60c6fb1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:17.681816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91a18116-ceed-4102-b6d6-0ea4b60c6fb1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:17.682534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91a18116-ceed-4102-b6d6-0ea4b60c6fb1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:17.683180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91a18116-ceed-4102-b6d6-0ea4b60c6fb1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:17.684112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91a18116-ceed-4102-b6d6-0ea4b60c6fb1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:17.684750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91a18116-ceed-4102-b6d6-0ea4b60c6fb1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:17.685473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91a18116-ceed-4102-b6d6-0ea4b60c6fb1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:17.913286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-91a18116-ceed-4102-b6d6-0ea4b60c6fb1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:17.921322 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-91a18116-ceed-4102-b6d6-0ea4b60c6fb1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1311 microversion: 2.1 time: 0.252108 Oct 12 22:00:17.922008 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 107/253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:17 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1311 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:17.926397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ee74825d-e5bb-4424-aae9-5ac3789f1c5f tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Action: 'update', calling method: .version_select at 0x7f5128ea9160>, body: {"quota_set": {"ram": 51200}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:17.955701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ce4c92d0-3bbb-45ec-bfc4-570938f88c03 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:17.965799 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ce4c92d0-3bbb-45ec-bfc4-570938f88c03 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1390 microversion: 2.1 time: 0.933376 Oct 12 22:00:17.966736 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 147/254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:17 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1390 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:17.972662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3886ba0a-5eee-48a0-917a-203a73b0a9cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:17.973505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3886ba0a-5eee-48a0-917a-203a73b0a9cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:17.980805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3886ba0a-5eee-48a0-917a-203a73b0a9cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:17.981941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3886ba0a-5eee-48a0-917a-203a73b0a9cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:17.982549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3886ba0a-5eee-48a0-917a-203a73b0a9cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:17.983891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3886ba0a-5eee-48a0-917a-203a73b0a9cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:17.984511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3886ba0a-5eee-48a0-917a-203a73b0a9cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:17.985091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3886ba0a-5eee-48a0-917a-203a73b0a9cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:18.186383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee74825d-e5bb-4424-aae9-5ac3789f1c5f tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:18.187131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee74825d-e5bb-4424-aae9-5ac3789f1c5f tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:18.187793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee74825d-e5bb-4424-aae9-5ac3789f1c5f tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:18.188853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee74825d-e5bb-4424-aae9-5ac3789f1c5f tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:18.189698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee74825d-e5bb-4424-aae9-5ac3789f1c5f tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:18.190293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee74825d-e5bb-4424-aae9-5ac3789f1c5f tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:18.246341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:18.261007 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ee74825d-e5bb-4424-aae9-5ac3789f1c5f tempest-QuotasAdminNegativeTest-1570901821 tempest-QuotasAdminNegativeTest-1570901821-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074" status: 200 len: 329 microversion: 2.1 time: 0.337593 Oct 12 22:00:18.262232 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 108/255] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 12 22:00:17 2022] PUT /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074 => generated 329 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:18.269538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-98dfa95d-0070-4cca-97aa-2b5c154a7443 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:18.302136 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-98dfa95d-0070-4cca-97aa-2b5c154a7443 tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.038373 Oct 12 22:00:18.302788 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 109/256] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 12 22:00:18 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:00:18.311228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-93942a77-b4c7-42bf-9da3-a41b4632e557 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Action: 'update', calling method: .version_select at 0x7f5128b1f430>, body: {"quota_set": {"ram": 0}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:18.320245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-93942a77-b4c7-42bf-9da3-a41b4632e557 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '65a99cc4e9544f589832706aceb386e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef34fa2ef2ed4843ba2a775fe0449074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-93942a77-b4c7-42bf-9da3-a41b4632e557 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Request method failure captured: Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: request: PUT /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074 HTTP/1.1 Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 25 Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzjmSPvT7-gmqchWY6V9Ly7TQcRen29D2jjq0bQQvcsXiOQopWOUORESZJTFTQCgx3DwjRhOAiqmhOWdKPU-v2eBkTxzZIINlLgLyEsPxwq_FVmc0BQLRhSKQTOyafLibX2HR0cnBxfSpsL4J4xBTiSlIeA21DF-WJ1ti1awYRYdQCU Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ef34fa2ef2ed4843ba2a775fe0449074 Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-QuotasAdminNegativeTest-1030389540 Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:00:18.322357 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:00:18.323764 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef34fa2ef2ed4843ba2a775fe0449074"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef34fa2ef2ed4843ba2a775fe0449074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef34fa2ef2ed4843ba2a775fe0449074", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef34fa2ef2ed4843ba2a775fe0449074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:18.323764 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-QuotasAdminNegativeTest-1030389540 Oct 12 22:00:18.323764 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ef34fa2ef2ed4843ba2a775fe0449074 Oct 12 22:00:18.323764 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1030389540 Oct 12 22:00:18.323764 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-QuotasAdminNegativeTest-1030389540-project Oct 12 22:00:18.323764 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:18.323764 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:18.323764 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 65a99cc4e9544f589832706aceb386e3 Oct 12 22:00:18.323764 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-QuotasAdminNegativeTest-1030389540-project Oct 12 22:00:18.323764 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:00:18.323764 n-d-861111-1 devstack@n-api.service[120452]: {"quota_set": {"ram": 0}} Oct 12 22:00:18.323764 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:00:18.323764 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 12 22:00:18.323764 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'ef34fa2ef2ed4843ba2a775fe0449074', 'body': {'quota_set': {'ram': 0}}} Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:18.324564 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:18.325580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:18.326728 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:18.326728 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:18.326728 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:00:18.326728 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:00:18.326728 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 12 22:00:18.326728 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:18.326728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-93942a77-b4c7-42bf-9da3-a41b4632e557 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:18.326728 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-93942a77-b4c7-42bf-9da3-a41b4632e557 tempest-QuotasAdminNegativeTest-1030389540 tempest-QuotasAdminNegativeTest-1030389540-project] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074" status: 403 len: 116 microversion: 2.1 time: 0.019695 Oct 12 22:00:18.326728 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 110/257] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 12 22:00:18 2022] PUT /compute/v2.1/os-quota-sets/ef34fa2ef2ed4843ba2a775fe0449074 => generated 116 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:18.339012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1871a312-566d-4934-9e2c-5e15035c717b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-795963091"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:18.342633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.aggregate [None req-1871a312-566d-4934-9e2c-5e15035c717b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Generated uuid 2e0c3468-3067-45da-98f3-7d831c3a120b for aggregate {{(pid=120452) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:00:18.375781 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1871a312-566d-4934-9e2c-5e15035c717b tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041789 Oct 12 22:00:18.378229 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 111/258] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 22:00:18 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:18.392320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ca0594c3-f82d-4c99-ba91-d01391b91ebd tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:18.413529 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ca0594c3-f82d-4c99-ba91-d01391b91ebd tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.027585 Oct 12 22:00:18.414319 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 112/259] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 12 22:00:18 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:00:18.426300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bf4a939b-d520-4b71-b340-6957a212ef6d tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:18.463983 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bf4a939b-d520-4b71-b340-6957a212ef6d tempest-AggregatesAdminTestJSON-1449769757 tempest-AggregatesAdminTestJSON-1449769757-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.041550 Oct 12 22:00:18.465707 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 113/260] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 12 22:00:18 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 12 22:00:18.489635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-23dbde52-3c58-4508-82e6-60dd67a82b05 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:18.490158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-23dbde52-3c58-4508-82e6-60dd67a82b05 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:18.499170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23dbde52-3c58-4508-82e6-60dd67a82b05 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:18.499803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23dbde52-3c58-4508-82e6-60dd67a82b05 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:18.500177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23dbde52-3c58-4508-82e6-60dd67a82b05 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:18.500880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23dbde52-3c58-4508-82e6-60dd67a82b05 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:18.501337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23dbde52-3c58-4508-82e6-60dd67a82b05 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:18.501770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23dbde52-3c58-4508-82e6-60dd67a82b05 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:18.523207 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-23dbde52-3c58-4508-82e6-60dd67a82b05 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] HTTP exception thrown: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-23dbde52-3c58-4508-82e6-60dd67a82b05 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Request method failure captured: Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 HTTP/1.1 Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzixL60DKtZ0wPIyJpdXkNjST1m8Dxf4kXIAuolJ3vTJi2gZxgmCh8rTCna1aXLoLyYAEolOQGIEZkJpq06HavtA-pyrGd0u4H8YCcam-AaUzGn1s1tamTcZWLVa6VH7Pw-oFZDyxF-yA2qeowGH8a0iGLqgPV3Gpbo6BKbZTmyb1Dc Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 83e13591fa0c4a789d71e35d18f97f37 Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-AggregatesAdminTestJSON-822261613 Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:00:18.528397 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:00:18.529925 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83e13591fa0c4a789d71e35d18f97f37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83e13591fa0c4a789d71e35d18f97f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_83e13591fa0c4a789d71e35d18f97f37", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/83e13591fa0c4a789d71e35d18f97f37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:18.529925 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-AggregatesAdminTestJSON-822261613 Oct 12 22:00:18.529925 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 83e13591fa0c4a789d71e35d18f97f37 Oct 12 22:00:18.529925 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-822261613 Oct 12 22:00:18.529925 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-AggregatesAdminTestJSON-822261613-project Oct 12 22:00:18.529925 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:18.529925 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:18.529925 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 8c7541fc7fee4bb0a911a3a211edd010 Oct 12 22:00:18.529925 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-AggregatesAdminTestJSON-822261613-project Oct 12 22:00:18.529925 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:00:18.529925 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. Oct 12 22:00:18.529925 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946'} Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:18.530565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. Oct 12 22:00:18.532198 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:18.534050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-23dbde52-3c58-4508-82e6-60dd67a82b05 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Returning 404 to user: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:18.534050 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-23dbde52-3c58-4508-82e6-60dd67a82b05 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 404 len: 111 microversion: 2.1 time: 0.055943 Oct 12 22:00:18.536876 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 114/261] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:00:18 2022] DELETE /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:18.542428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-870618d2-9bcb-4352-8a0e-a21c6c51c636 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:18.543200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-870618d2-9bcb-4352-8a0e-a21c6c51c636 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] [instance: 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:18.550070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-870618d2-9bcb-4352-8a0e-a21c6c51c636 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:18.550939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-870618d2-9bcb-4352-8a0e-a21c6c51c636 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:18.551631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-870618d2-9bcb-4352-8a0e-a21c6c51c636 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:18.552692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-870618d2-9bcb-4352-8a0e-a21c6c51c636 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:18.553448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-870618d2-9bcb-4352-8a0e-a21c6c51c636 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:18.554141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-870618d2-9bcb-4352-8a0e-a21c6c51c636 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:18.584777 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-870618d2-9bcb-4352-8a0e-a21c6c51c636 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] HTTP exception thrown: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-870618d2-9bcb-4352-8a0e-a21c6c51c636 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Request method failure captured: Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 HTTP/1.1 Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzixL60DKtZ0wPIyJpdXkNjST1m8Dxf4kXIAuolJ3vTJi2gZxgmCh8rTCna1aXLoLyYAEolOQGIEZkJpq06HavtA-pyrGd0u4H8YCcam-AaUzGn1s1tamTcZWLVa6VH7Pw-oFZDyxF-yA2qeowGH8a0iGLqgPV3Gpbo6BKbZTmyb1Dc Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 83e13591fa0c4a789d71e35d18f97f37 Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-AggregatesAdminTestJSON-822261613 Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:00:18.586792 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:00:18.588053 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83e13591fa0c4a789d71e35d18f97f37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83e13591fa0c4a789d71e35d18f97f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_83e13591fa0c4a789d71e35d18f97f37", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/83e13591fa0c4a789d71e35d18f97f37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:18.588053 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-AggregatesAdminTestJSON-822261613 Oct 12 22:00:18.588053 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 83e13591fa0c4a789d71e35d18f97f37 Oct 12 22:00:18.588053 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-822261613 Oct 12 22:00:18.588053 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-AggregatesAdminTestJSON-822261613-project Oct 12 22:00:18.588053 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:18.588053 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:18.588053 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 8c7541fc7fee4bb0a911a3a211edd010 Oct 12 22:00:18.588053 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-AggregatesAdminTestJSON-822261613-project Oct 12 22:00:18.588053 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:00:18.588053 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. Oct 12 22:00:18.588053 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946'} Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:18.589055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. Oct 12 22:00:18.590168 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:18.593049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-870618d2-9bcb-4352-8a0e-a21c6c51c636 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] Returning 404 to user: Instance 7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:18.594148 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-870618d2-9bcb-4352-8a0e-a21c6c51c636 tempest-AggregatesAdminTestJSON-822261613 tempest-AggregatesAdminTestJSON-822261613-project] 10.222.0.16 "GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946" status: 404 len: 111 microversion: 2.1 time: 0.055946 Oct 12 22:00:18.596920 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 115/262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:18 2022] GET /compute/v2.1/servers/7ef2e8ef-f4f0-4c96-a9bc-4c55b6f08946 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:18.603935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-7a4c07f4-203f-43ea-a2cf-c5040931422a req-d4c84f2a-bf5c-4793-98ed-1264f1ca2007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1848e1da-8fef-4d2e-93b0-87af0c4fe39d", "name": "network-vif-plugged", "status": "completed", "tag": "6d33ba53-ea2f-4f4f-a7b2-f87a95f5c19e"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:18.615557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7a4c07f4-203f-43ea-a2cf-c5040931422a req-d4c84f2a-bf5c-4793-98ed-1264f1ca2007 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:18.616077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7a4c07f4-203f-43ea-a2cf-c5040931422a req-d4c84f2a-bf5c-4793-98ed-1264f1ca2007 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:18.616509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7a4c07f4-203f-43ea-a2cf-c5040931422a req-d4c84f2a-bf5c-4793-98ed-1264f1ca2007 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:18.620690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:18.633739 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-7a4c07f4-203f-43ea-a2cf-c5040931422a req-d4c84f2a-bf5c-4793-98ed-1264f1ca2007 service nova] Creating event network-vif-plugged:6d33ba53-ea2f-4f4f-a7b2-f87a95f5c19e for instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d on n-h2-861111-1 Oct 12 22:00:18.640355 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-7a4c07f4-203f-43ea-a2cf-c5040931422a req-d4c84f2a-bf5c-4793-98ed-1264f1ca2007 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041977 Oct 12 22:00:18.641685 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 116/263] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:18.949118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4944acf3-266a-4593-ad9b-12405e571f8f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:18.949850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4944acf3-266a-4593-ad9b-12405e571f8f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:18.966365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4944acf3-266a-4593-ad9b-12405e571f8f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:18.966914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4944acf3-266a-4593-ad9b-12405e571f8f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:18.969855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4944acf3-266a-4593-ad9b-12405e571f8f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:18.970823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4944acf3-266a-4593-ad9b-12405e571f8f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:18.971350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4944acf3-266a-4593-ad9b-12405e571f8f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:18.971796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4944acf3-266a-4593-ad9b-12405e571f8f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:19.001724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3886ba0a-5eee-48a0-917a-203a73b0a9cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:19.016328 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3886ba0a-5eee-48a0-917a-203a73b0a9cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 200 len: 1320 microversion: 2.1 time: 1.048313 Oct 12 22:00:19.017260 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 148/264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:17 2022] GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 1320 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:19.027980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-327b8937-bba9-47eb-827f-18313f3b2b16 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:19.028742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-327b8937-bba9-47eb-827f-18313f3b2b16 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:19.040736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-327b8937-bba9-47eb-827f-18313f3b2b16 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:19.047815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-327b8937-bba9-47eb-827f-18313f3b2b16 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:19.048506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-327b8937-bba9-47eb-827f-18313f3b2b16 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:19.049900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-327b8937-bba9-47eb-827f-18313f3b2b16 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:19.050817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-327b8937-bba9-47eb-827f-18313f3b2b16 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:19.051498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-327b8937-bba9-47eb-827f-18313f3b2b16 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:19.060991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:19.368969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4944acf3-266a-4593-ad9b-12405e571f8f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:19.377876 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4944acf3-266a-4593-ad9b-12405e571f8f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1311 microversion: 2.1 time: 0.435490 Oct 12 22:00:19.389569 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 117/265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:18 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1311 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:19.681193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-a82a4dca-6d7f-4113-8c49-321ae7e46816 req-3cf3c77a-644c-43fa-9e5a-e77a96fd257f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1701358b-ffd8-442b-add8-6fa9581ceaa4", "tag": "0bf1a6c0-d01b-4b06-ae76-9244a6b48643"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:19.693642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a82a4dca-6d7f-4113-8c49-321ae7e46816 req-3cf3c77a-644c-43fa-9e5a-e77a96fd257f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:19.694832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a82a4dca-6d7f-4113-8c49-321ae7e46816 req-3cf3c77a-644c-43fa-9e5a-e77a96fd257f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:19.695853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a82a4dca-6d7f-4113-8c49-321ae7e46816 req-3cf3c77a-644c-43fa-9e5a-e77a96fd257f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:19.731276 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-a82a4dca-6d7f-4113-8c49-321ae7e46816 req-3cf3c77a-644c-43fa-9e5a-e77a96fd257f service nova] Creating event network-changed:0bf1a6c0-d01b-4b06-ae76-9244a6b48643 for instance 1701358b-ffd8-442b-add8-6fa9581ceaa4 on n-h1-861111-1 Oct 12 22:00:19.741053 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-a82a4dca-6d7f-4113-8c49-321ae7e46816 req-3cf3c77a-644c-43fa-9e5a-e77a96fd257f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063615 Oct 12 22:00:19.742800 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 118/266] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:00:19.839413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-327b8937-bba9-47eb-827f-18313f3b2b16 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:19.853240 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-327b8937-bba9-47eb-827f-18313f3b2b16 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1390 microversion: 2.1 time: 0.834873 Oct 12 22:00:19.853989 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 149/267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:19 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1390 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:20.043477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c5ad12f6-a7fc-4a0a-9045-503790f7d4bb tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:20.044328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c5ad12f6-a7fc-4a0a-9045-503790f7d4bb tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:20.050492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5ad12f6-a7fc-4a0a-9045-503790f7d4bb tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:20.050985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5ad12f6-a7fc-4a0a-9045-503790f7d4bb tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:20.051448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5ad12f6-a7fc-4a0a-9045-503790f7d4bb tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:20.052202 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5ad12f6-a7fc-4a0a-9045-503790f7d4bb tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:20.052655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5ad12f6-a7fc-4a0a-9045-503790f7d4bb tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:20.053075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5ad12f6-a7fc-4a0a-9045-503790f7d4bb tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:20.278020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c5ad12f6-a7fc-4a0a-9045-503790f7d4bb tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:20.288087 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c5ad12f6-a7fc-4a0a-9045-503790f7d4bb tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 200 len: 1320 microversion: 2.1 time: 0.248930 Oct 12 22:00:20.305934 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 119/268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:20 2022] GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 1320 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:20.410024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1e15eb9b-2a59-4490-996c-88c6f6b2e220 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:20.410895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1e15eb9b-2a59-4490-996c-88c6f6b2e220 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:20.423194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e15eb9b-2a59-4490-996c-88c6f6b2e220 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:20.426937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e15eb9b-2a59-4490-996c-88c6f6b2e220 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:20.427697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e15eb9b-2a59-4490-996c-88c6f6b2e220 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:20.428633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e15eb9b-2a59-4490-996c-88c6f6b2e220 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:20.430493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e15eb9b-2a59-4490-996c-88c6f6b2e220 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:20.433409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e15eb9b-2a59-4490-996c-88c6f6b2e220 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:20.881885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2e558374-2f81-4cd1-a29b-0bdffe3af81a tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:20.882725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2e558374-2f81-4cd1-a29b-0bdffe3af81a tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:20.890338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e558374-2f81-4cd1-a29b-0bdffe3af81a tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:20.891513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e558374-2f81-4cd1-a29b-0bdffe3af81a tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:20.892198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e558374-2f81-4cd1-a29b-0bdffe3af81a tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:20.895918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e558374-2f81-4cd1-a29b-0bdffe3af81a tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:20.896628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e558374-2f81-4cd1-a29b-0bdffe3af81a tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:20.897292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e558374-2f81-4cd1-a29b-0bdffe3af81a tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:21.018973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1e15eb9b-2a59-4490-996c-88c6f6b2e220 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:21.031546 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1e15eb9b-2a59-4490-996c-88c6f6b2e220 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1311 microversion: 2.1 time: 0.625413 Oct 12 22:00:21.032131 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 150/269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:20 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1311 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:21.186907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2e558374-2f81-4cd1-a29b-0bdffe3af81a tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:21.198392 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2e558374-2f81-4cd1-a29b-0bdffe3af81a tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1390 microversion: 2.1 time: 0.321357 Oct 12 22:00:21.205929 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 120/270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:20 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1390 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:00:21.315207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8f6c6b53-7381-4dd2-93ec-eebd84f0b6c0 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:21.315933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8f6c6b53-7381-4dd2-93ec-eebd84f0b6c0 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:21.324039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f6c6b53-7381-4dd2-93ec-eebd84f0b6c0 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:21.324799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f6c6b53-7381-4dd2-93ec-eebd84f0b6c0 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:21.325443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f6c6b53-7381-4dd2-93ec-eebd84f0b6c0 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:21.327017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f6c6b53-7381-4dd2-93ec-eebd84f0b6c0 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:21.327706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f6c6b53-7381-4dd2-93ec-eebd84f0b6c0 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:21.328358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f6c6b53-7381-4dd2-93ec-eebd84f0b6c0 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:21.787148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8f6c6b53-7381-4dd2-93ec-eebd84f0b6c0 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:21.804922 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8f6c6b53-7381-4dd2-93ec-eebd84f0b6c0 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 200 len: 1320 microversion: 2.1 time: 0.494581 Oct 12 22:00:21.815279 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 151/271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:21 2022] GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 1320 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:21.966619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-9f3d9e0f-4173-46e3-8080-b0b3108a0436 req-98d6edaf-2667-410e-94b9-246a377685f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca31258-b0ea-447d-aff6-5612a0746d3c", "name": "network-vif-plugged", "status": "completed", "tag": "ce6e8cde-b0cb-4892-95a8-9630e7a4ad93"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:21.985670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9f3d9e0f-4173-46e3-8080-b0b3108a0436 req-98d6edaf-2667-410e-94b9-246a377685f5 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:21.986416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9f3d9e0f-4173-46e3-8080-b0b3108a0436 req-98d6edaf-2667-410e-94b9-246a377685f5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:21.987054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9f3d9e0f-4173-46e3-8080-b0b3108a0436 req-98d6edaf-2667-410e-94b9-246a377685f5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:22.015214 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-9f3d9e0f-4173-46e3-8080-b0b3108a0436 req-98d6edaf-2667-410e-94b9-246a377685f5 service nova] Creating event network-vif-plugged:ce6e8cde-b0cb-4892-95a8-9630e7a4ad93 for instance 7ca31258-b0ea-447d-aff6-5612a0746d3c on n-h1-861111-1 Oct 12 22:00:22.030940 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-9f3d9e0f-4173-46e3-8080-b0b3108a0436 req-98d6edaf-2667-410e-94b9-246a377685f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068072 Oct 12 22:00:22.038606 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 121/272] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:22.058884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3ecb3a9a-f3db-4b39-962a-a8bdfcdb6853 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:22.060008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3ecb3a9a-f3db-4b39-962a-a8bdfcdb6853 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:22.072037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ecb3a9a-f3db-4b39-962a-a8bdfcdb6853 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:22.072938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ecb3a9a-f3db-4b39-962a-a8bdfcdb6853 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:22.073580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ecb3a9a-f3db-4b39-962a-a8bdfcdb6853 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:22.074510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ecb3a9a-f3db-4b39-962a-a8bdfcdb6853 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:22.075164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ecb3a9a-f3db-4b39-962a-a8bdfcdb6853 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:22.080921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ecb3a9a-f3db-4b39-962a-a8bdfcdb6853 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:22.236146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ebd4381e-4a15-43c5-a2e5-0fd6397f670c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:22.237116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ebd4381e-4a15-43c5-a2e5-0fd6397f670c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:22.257027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebd4381e-4a15-43c5-a2e5-0fd6397f670c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:22.257805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebd4381e-4a15-43c5-a2e5-0fd6397f670c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:22.258493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebd4381e-4a15-43c5-a2e5-0fd6397f670c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:22.259457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebd4381e-4a15-43c5-a2e5-0fd6397f670c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:22.260064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebd4381e-4a15-43c5-a2e5-0fd6397f670c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:22.260487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebd4381e-4a15-43c5-a2e5-0fd6397f670c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:22.543504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3ecb3a9a-f3db-4b39-962a-a8bdfcdb6853 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:22.556946 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3ecb3a9a-f3db-4b39-962a-a8bdfcdb6853 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1311 microversion: 2.1 time: 0.501724 Oct 12 22:00:22.569141 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 152/273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:22 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1311 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:23.017255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ebd4381e-4a15-43c5-a2e5-0fd6397f670c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:23.029562 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ebd4381e-4a15-43c5-a2e5-0fd6397f670c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1588 microversion: 2.1 time: 0.798977 Oct 12 22:00:23.040534 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 122/274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:22 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1588 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:23.071550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f14cf48b-6753-4180-ae96-fd1d49d7ab80 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:23.094612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd85ad80-358d-43c9-a779-8e4d35cefb0b tempest-AZAdminNegativeTestJSON-1450312597 tempest-AZAdminNegativeTestJSON-1450312597-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:23.096868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dd85ad80-358d-43c9-a779-8e4d35cefb0b tempest-AZAdminNegativeTestJSON-1450312597 tempest-AZAdminNegativeTestJSON-1450312597-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '440d7a7c4a9641da8586a6fa06e63da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d395612b459f860019abf583e96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:23.097436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f14cf48b-6753-4180-ae96-fd1d49d7ab80 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd85ad80-358d-43c9-a779-8e4d35cefb0b tempest-AZAdminNegativeTestJSON-1450312597 tempest-AZAdminNegativeTestJSON-1450312597-project] Request method failure captured: Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzj19s1QeBAQyuWkLyP4oUCI4l9bJ1wkFBGEdrHOjgioiYJbXkgcFE16-3WftmKs7UqUef0dI7cih735Og_YAKAOzIoXwm8fHrPflbDOlfSk4PB6XVD_9ojscwyprLSW6OSL8Y00I5x0NC3-EQaCCLQ2ufOisp2KCoV79PuVwkZCL-E Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0507d395612b459f860019abf583e96c Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1450312597 Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:00:23.099711 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:00:23.101211 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0507d395612b459f860019abf583e96c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0507d395612b459f860019abf583e96c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0507d395612b459f860019abf583e96c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0507d395612b459f860019abf583e96c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:23.101211 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AZAdminNegativeTestJSON-1450312597 Oct 12 22:00:23.101211 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0507d395612b459f860019abf583e96c Oct 12 22:00:23.101211 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1450312597 Oct 12 22:00:23.101211 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AZAdminNegativeTestJSON-1450312597-project Oct 12 22:00:23.101211 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:23.101211 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:23.101211 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 440d7a7c4a9641da8586a6fa06e63da3 Oct 12 22:00:23.101211 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AZAdminNegativeTestJSON-1450312597-project Oct 12 22:00:23.101211 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:00:23.101211 n-d-861111-1 devstack@n-api.service[120453]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 12 22:00:23.101211 n-d-861111-1 devstack@n-api.service[120453]: action_args: {} Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:00:23.102051 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:00:23.103379 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:00:23.103379 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:00:23.103379 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:00:23.103379 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:00:23.103379 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:00:23.103379 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 12 22:00:23.103379 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:23.103379 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:23.103379 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:23.103379 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:23.103379 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:23.103379 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:23.103379 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:00:23.103379 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:00:23.103379 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 12 22:00:23.103379 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:23.106909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd85ad80-358d-43c9-a779-8e4d35cefb0b tempest-AZAdminNegativeTestJSON-1450312597 tempest-AZAdminNegativeTestJSON-1450312597-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:23.107802 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dd85ad80-358d-43c9-a779-8e4d35cefb0b tempest-AZAdminNegativeTestJSON-1450312597 tempest-AZAdminNegativeTestJSON-1450312597-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.463538 Oct 12 22:00:23.110494 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 153/275] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 12 22:00:22 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 467 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:00:23.112263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f14cf48b-6753-4180-ae96-fd1d49d7ab80 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:23.112773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f14cf48b-6753-4180-ae96-fd1d49d7ab80 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:23.113219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f14cf48b-6753-4180-ae96-fd1d49d7ab80 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:23.113942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f14cf48b-6753-4180-ae96-fd1d49d7ab80 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:23.120084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f14cf48b-6753-4180-ae96-fd1d49d7ab80 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:23.120694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f14cf48b-6753-4180-ae96-fd1d49d7ab80 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:23.125256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a24006f3-95f0-4e8b-9d9d-a839daf141ce tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:23.126200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a24006f3-95f0-4e8b-9d9d-a839daf141ce tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:23.146743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a24006f3-95f0-4e8b-9d9d-a839daf141ce tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:23.147843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a24006f3-95f0-4e8b-9d9d-a839daf141ce tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:23.150919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a24006f3-95f0-4e8b-9d9d-a839daf141ce tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:23.151986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a24006f3-95f0-4e8b-9d9d-a839daf141ce tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:23.152662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a24006f3-95f0-4e8b-9d9d-a839daf141ce tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:23.155514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a24006f3-95f0-4e8b-9d9d-a839daf141ce tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:23.544179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f14cf48b-6753-4180-ae96-fd1d49d7ab80 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:23.551905 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f14cf48b-6753-4180-ae96-fd1d49d7ab80 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 200 len: 1320 microversion: 2.1 time: 0.494569 Oct 12 22:00:23.552491 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 123/276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:23 2022] GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 1320 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:23.602351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ee6fcf40-c016-40d0-9534-df1463666d9d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:23.603301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ee6fcf40-c016-40d0-9534-df1463666d9d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:23.611045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee6fcf40-c016-40d0-9534-df1463666d9d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:23.612018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee6fcf40-c016-40d0-9534-df1463666d9d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:23.612659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee6fcf40-c016-40d0-9534-df1463666d9d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:23.613601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee6fcf40-c016-40d0-9534-df1463666d9d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:23.614313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee6fcf40-c016-40d0-9534-df1463666d9d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:23.615095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee6fcf40-c016-40d0-9534-df1463666d9d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:23.661608 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a24006f3-95f0-4e8b-9d9d-a839daf141ce tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.549956 Oct 12 22:00:23.662222 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 154/277] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:00:23 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d/os-interface => generated 284 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:24.689546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4458643b-e415-494d-a423-7b1391ca3325 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Calling method '.version_select at 0x7f512a50f550>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:24.698756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4458643b-e415-494d-a423-7b1391ca3325 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:24.701042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4458643b-e415-494d-a423-7b1391ca3325 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:24.701498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4458643b-e415-494d-a423-7b1391ca3325 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:24.760727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4458643b-e415-494d-a423-7b1391ca3325 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:24.765749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4458643b-e415-494d-a423-7b1391ca3325 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:24.766211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4458643b-e415-494d-a423-7b1391ca3325 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:24.801061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ee6fcf40-c016-40d0-9534-df1463666d9d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:24.806898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4458643b-e415-494d-a423-7b1391ca3325 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:24.807428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4458643b-e415-494d-a423-7b1391ca3325 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:24.807876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4458643b-e415-494d-a423-7b1391ca3325 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:24.809265 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ee6fcf40-c016-40d0-9534-df1463666d9d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1311 microversion: 2.1 time: 1.215081 Oct 12 22:00:24.814158 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 124/278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:23 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1311 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:00:24.825334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-85923694-8c76-4998-8a1f-aa112cd9b395 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:24.826023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-85923694-8c76-4998-8a1f-aa112cd9b395 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:24.841278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85923694-8c76-4998-8a1f-aa112cd9b395 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:24.841841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85923694-8c76-4998-8a1f-aa112cd9b395 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:24.842295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85923694-8c76-4998-8a1f-aa112cd9b395 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:24.843029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85923694-8c76-4998-8a1f-aa112cd9b395 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:24.844944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85923694-8c76-4998-8a1f-aa112cd9b395 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:24.850031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85923694-8c76-4998-8a1f-aa112cd9b395 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:24.852899 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4458643b-e415-494d-a423-7b1391ca3325 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1425 microversion: 2.41 time: 0.785465 Oct 12 22:00:24.867273 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 155/279] 10.222.0.16 () {60 vars in 1208 bytes} [Wed Oct 12 22:00:24 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1425 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:00:24.878834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5f116638-bf1f-40d3-bdbe-9941f9e859cb tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-751074250"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:24.883640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.aggregate [None req-5f116638-bf1f-40d3-bdbe-9941f9e859cb tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Generated uuid f92d5dc2-ebdb-496a-9bc7-df5f4cf780f0 for aggregate {{(pid=120453) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:00:24.928108 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5f116638-bf1f-40d3-bdbe-9941f9e859cb tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.053240 Oct 12 22:00:24.931721 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 156/280] 10.222.0.16 () {62 vars in 1205 bytes} [Wed Oct 12 22:00:24 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:00:24.946701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4532a9b5-d4e8-4350-a673-1d4b0066beb0 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1529580503"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:24.996823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:25.012179 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4532a9b5-d4e8-4350-a673-1d4b0066beb0 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.073895 Oct 12 22:00:25.013358 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 157/281] 10.222.0.16 () {62 vars in 1213 bytes} [Wed Oct 12 22:00:24 2022] PUT /compute/v2.1/os-aggregates/18 => generated 300 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:00:25.035317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dfb1c6f5-edb2-480c-92a3-6d6ac0ee20a1 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:25.044948 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dfb1c6f5-edb2-480c-92a3-6d6ac0ee20a1 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.021029 Oct 12 22:00:25.047498 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 158/282] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 12 22:00:25 2022] GET /compute/v2.1/os-aggregates/18 => generated 300 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:00:25.063514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2f0c233c-42f8-4ac0-a3e2-aa4e715d43bb tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861111-1"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:25.082335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f0c233c-42f8-4ac0-a3e2-aa4e715d43bb tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:25.083804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f0c233c-42f8-4ac0-a3e2-aa4e715d43bb tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:25.084986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f0c233c-42f8-4ac0-a3e2-aa4e715d43bb tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:25.308083 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2f0c233c-42f8-4ac0-a3e2-aa4e715d43bb tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 315 microversion: 2.41 time: 0.251625 Oct 12 22:00:25.309299 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 159/283] 10.222.0.16 () {62 vars in 1235 bytes} [Wed Oct 12 22:00:25 2022] POST /compute/v2.1/os-aggregates/18/action => generated 315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 22:00:25.324249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87476416-ee13-4533-8c45-b097488f0759 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861111-1"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:25.387072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87476416-ee13-4533-8c45-b097488f0759 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:25.387848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87476416-ee13-4533-8c45-b097488f0759 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:25.389066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87476416-ee13-4533-8c45-b097488f0759 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:25.513131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-85923694-8c76-4998-8a1f-aa112cd9b395 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:25.537453 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-85923694-8c76-4998-8a1f-aa112cd9b395 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 200 len: 1470 microversion: 2.1 time: 0.721861 Oct 12 22:00:25.551619 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 125/284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:24 2022] GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 1470 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:25.598398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a47fc78e-03b6-4a51-b4c4-65543cbe25f6 tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:25.600755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a47fc78e-03b6-4a51-b4c4-65543cbe25f6 tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:25.635349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a47fc78e-03b6-4a51-b4c4-65543cbe25f6 tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:25.637434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a47fc78e-03b6-4a51-b4c4-65543cbe25f6 tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:25.637886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a47fc78e-03b6-4a51-b4c4-65543cbe25f6 tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:25.638661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a47fc78e-03b6-4a51-b4c4-65543cbe25f6 tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:25.639126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a47fc78e-03b6-4a51-b4c4-65543cbe25f6 tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:25.639597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a47fc78e-03b6-4a51-b4c4-65543cbe25f6 tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:25.691627 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-87476416-ee13-4533-8c45-b097488f0759 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 300 microversion: 2.41 time: 0.366293 Oct 12 22:00:25.692205 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 160/285] 10.222.0.16 () {62 vars in 1235 bytes} [Wed Oct 12 22:00:25 2022] POST /compute/v2.1/os-aggregates/18/action => generated 300 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:00:25.705064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1e5ef00d-dfa1-4243-b154-a6b8e84ad090 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:25.768870 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1e5ef00d-dfa1-4243-b154-a6b8e84ad090 tempest-AggregatesAdminTestV241-2010642985 tempest-AggregatesAdminTestV241-2010642985-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.067483 Oct 12 22:00:25.774662 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 161/286] 10.222.0.16 () {60 vars in 1196 bytes} [Wed Oct 12 22:00:25 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:25.837994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a810cf2d-ed0f-4341-9552-f2b62ed97df5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:25.839067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a810cf2d-ed0f-4341-9552-f2b62ed97df5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:25.856263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a810cf2d-ed0f-4341-9552-f2b62ed97df5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:25.857634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a810cf2d-ed0f-4341-9552-f2b62ed97df5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:25.859844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a810cf2d-ed0f-4341-9552-f2b62ed97df5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:25.862894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a810cf2d-ed0f-4341-9552-f2b62ed97df5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:25.865966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a810cf2d-ed0f-4341-9552-f2b62ed97df5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:25.867082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a810cf2d-ed0f-4341-9552-f2b62ed97df5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:25.885322 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a47fc78e-03b6-4a51-b4c4-65543cbe25f6 tempest-DeleteServersAdminTestJSON-268167712 tempest-DeleteServersAdminTestJSON-268167712-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c/action" status: 202 len: 0 microversion: 2.1 time: 0.317451 Oct 12 22:00:25.888834 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 126/287] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:00:25 2022] POST /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:25.908158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-caa2d278-1672-4769-a5f2-4b10cdb182df tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:25.912575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-caa2d278-1672-4769-a5f2-4b10cdb182df tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:25.932149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caa2d278-1672-4769-a5f2-4b10cdb182df tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:25.933865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caa2d278-1672-4769-a5f2-4b10cdb182df tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:25.935777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caa2d278-1672-4769-a5f2-4b10cdb182df tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:25.937504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caa2d278-1672-4769-a5f2-4b10cdb182df tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:25.938751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caa2d278-1672-4769-a5f2-4b10cdb182df tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:25.939906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caa2d278-1672-4769-a5f2-4b10cdb182df tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:26.012335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caa2d278-1672-4769-a5f2-4b10cdb182df tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:26.013078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caa2d278-1672-4769-a5f2-4b10cdb182df tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:26.013698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caa2d278-1672-4769-a5f2-4b10cdb182df tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:26.014331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-caa2d278-1672-4769-a5f2-4b10cdb182df tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lazy-loading 'fault' on Instance uuid 7ca31258-b0ea-447d-aff6-5612a0746d3c {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:00:26.304332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a810cf2d-ed0f-4341-9552-f2b62ed97df5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:26.318835 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a810cf2d-ed0f-4341-9552-f2b62ed97df5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1311 microversion: 2.1 time: 0.484054 Oct 12 22:00:26.322244 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 162/288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:25 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1311 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:00:26.726640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=15 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:26.728144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=9 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:26.905415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-caa2d278-1672-4769-a5f2-4b10cdb182df tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:26.916137 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-caa2d278-1672-4769-a5f2-4b10cdb182df tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 200 len: 1453 microversion: 2.1 time: 1.022754 Oct 12 22:00:26.919901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b378a0c0-f9ae-46d1-9d0d-daa4e07b5573 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Action: 'update', calling method: .version_select at 0x7f5128cb9430>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:26.928242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b378a0c0-f9ae-46d1-9d0d-daa4e07b5573 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:26.928422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b378a0c0-f9ae-46d1-9d0d-daa4e07b5573 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:26.929267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b378a0c0-f9ae-46d1-9d0d-daa4e07b5573 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:26.935713 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 127/289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:25 2022] GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 1453 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:26.938546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b378a0c0-f9ae-46d1-9d0d-daa4e07b5573 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:26.939265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b378a0c0-f9ae-46d1-9d0d-daa4e07b5573 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:26.939952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b378a0c0-f9ae-46d1-9d0d-daa4e07b5573 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:26.947615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d5c27029-1f13-4ef7-a260-83f28706b5e5 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:26.951515 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-b378a0c0-f9ae-46d1-9d0d-daa4e07b5573 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] HTTP exception thrown: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. Oct 12 22:00:26.951727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d5c27029-1f13-4ef7-a260-83f28706b5e5 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b378a0c0-f9ae-46d1-9d0d-daa4e07b5573 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Request method failure captured: Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: request: PUT /compute/v2.1/os-services/02d93739-b814-4adc-8e03-4767cb88f88a HTTP/1.1 Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 56 Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzj6xmbJf_vkKWlkXGg_5ArJl_J7vN7t5CO9Hle-z6H89qM1agWxQYhOPyfmF9NRfRiEZJ7dWvaO3vOCHiP_V2YFJ3nfidbUUWrcvQybFYHsLk-N5M2zBSbFqAv32WMvadbB3OvhgqQNu00jRJu5qY5ZN15mptb-oCKMxZm1ei_hMc4 Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.53 Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7c92ab5f6830407eab1a0d341edf041e Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-890848670 Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:00:26.959877 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:00:26.961184 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c92ab5f6830407eab1a0d341edf041e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c92ab5f6830407eab1a0d341edf041e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7c92ab5f6830407eab1a0d341edf041e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7c92ab5f6830407eab1a0d341edf041e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:26.961184 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-890848670 Oct 12 22:00:26.961184 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7c92ab5f6830407eab1a0d341edf041e Oct 12 22:00:26.961184 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-890848670 Oct 12 22:00:26.961184 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin Oct 12 22:00:26.961184 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:26.961184 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:26.961184 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: e0e9b8cefd3b426db475f7a1f9ec72d5 Oct 12 22:00:26.961184 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin Oct 12 22:00:26.961184 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:00:26.961184 n-d-861111-1 devstack@n-api.service[120453]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 12 22:00:26.961184 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:00:26.961184 n-d-861111-1 devstack@n-api.service[120453]: exception: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '02d93739-b814-4adc-8e03-4767cb88f88a', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:26.961889 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:26.963356 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:26.964414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:26.964414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. Oct 12 22:00:26.964414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:26.964414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b378a0c0-f9ae-46d1-9d0d-daa4e07b5573 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Returning 404 to user: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:26.964414 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b378a0c0-f9ae-46d1-9d0d-daa4e07b5573 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/02d93739-b814-4adc-8e03-4767cb88f88a" status: 404 len: 110 microversion: 2.53 time: 0.240497 Oct 12 22:00:26.968882 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 163/290] 10.222.0.16 () {62 vars in 1309 bytes} [Wed Oct 12 22:00:26 2022] PUT /compute/v2.1/os-services/02d93739-b814-4adc-8e03-4767cb88f88a => generated 110 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 12 22:00:26.974726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b6457ef0-d129-47dd-8a0a-7f4ede643f1f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Action: 'update', calling method: .version_select at 0x7f5128dfd670>, body: {"status": "disabled"} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:26.978850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6457ef0-d129-47dd-8a0a-7f4ede643f1f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:26.985851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5c27029-1f13-4ef7-a260-83f28706b5e5 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:26.986104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5c27029-1f13-4ef7-a260-83f28706b5e5 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:26.986549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5c27029-1f13-4ef7-a260-83f28706b5e5 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:26.987374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5c27029-1f13-4ef7-a260-83f28706b5e5 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:26.987888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5c27029-1f13-4ef7-a260-83f28706b5e5 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:26.988860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5c27029-1f13-4ef7-a260-83f28706b5e5 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:26.990450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6457ef0-d129-47dd-8a0a-7f4ede643f1f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:26.991426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6457ef0-d129-47dd-8a0a-7f4ede643f1f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:26.998837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6457ef0-d129-47dd-8a0a-7f4ede643f1f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:27.000045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6457ef0-d129-47dd-8a0a-7f4ede643f1f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:27.000676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6457ef0-d129-47dd-8a0a-7f4ede643f1f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:27.009138 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-b6457ef0-d129-47dd-8a0a-7f4ede643f1f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] HTTP exception thrown: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b6457ef0-d129-47dd-8a0a-7f4ede643f1f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Request method failure captured: Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: request: PUT /compute/v2.1/os-services/02d93739-b814-4adc-8e03-4767cb88f88a HTTP/1.1 Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 22 Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzj6xmbJf_vkKWlkXGg_5ArJl_J7vN7t5CO9Hle-z6H89qM1agWxQYhOPyfmF9NRfRiEZJ7dWvaO3vOCHiP_V2YFJ3nfidbUUWrcvQybFYHsLk-N5M2zBSbFqAv32WMvadbB3OvhgqQNu00jRJu5qY5ZN15mptb-oCKMxZm1ei_hMc4 Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.53 Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7c92ab5f6830407eab1a0d341edf041e Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-890848670 Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:00:27.027638 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:00:27.029048 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c92ab5f6830407eab1a0d341edf041e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c92ab5f6830407eab1a0d341edf041e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7c92ab5f6830407eab1a0d341edf041e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7c92ab5f6830407eab1a0d341edf041e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:27.029048 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-890848670 Oct 12 22:00:27.029048 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7c92ab5f6830407eab1a0d341edf041e Oct 12 22:00:27.029048 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-890848670 Oct 12 22:00:27.029048 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin Oct 12 22:00:27.029048 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:27.029048 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:27.029048 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: e0e9b8cefd3b426db475f7a1f9ec72d5 Oct 12 22:00:27.029048 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin Oct 12 22:00:27.029048 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:00:27.029048 n-d-861111-1 devstack@n-api.service[120453]: {"status": "disabled"} Oct 12 22:00:27.029048 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:00:27.029048 n-d-861111-1 devstack@n-api.service[120453]: exception: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. Oct 12 22:00:27.029048 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '02d93739-b814-4adc-8e03-4767cb88f88a', 'body': {'status': 'disabled'}} Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:27.029840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:27.030981 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:27.032068 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. Oct 12 22:00:27.032068 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:27.034212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b6457ef0-d129-47dd-8a0a-7f4ede643f1f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Returning 404 to user: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:27.041569 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b6457ef0-d129-47dd-8a0a-7f4ede643f1f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/02d93739-b814-4adc-8e03-4767cb88f88a" status: 404 len: 110 microversion: 2.53 time: 0.065829 Oct 12 22:00:27.048633 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 164/291] 10.222.0.16 () {62 vars in 1309 bytes} [Wed Oct 12 22:00:26 2022] PUT /compute/v2.1/os-services/02d93739-b814-4adc-8e03-4767cb88f88a => generated 110 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:00:27.050451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d5c27029-1f13-4ef7-a260-83f28706b5e5 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:00:27.057580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a5b19309-ac8d-4e9b-a071-1f038d98688d tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Action: 'update', calling method: .version_select at 0x7f5128cb9d30>, body: {"status": "enabled"} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:27.066865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5b19309-ac8d-4e9b-a071-1f038d98688d tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:27.070317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5b19309-ac8d-4e9b-a071-1f038d98688d tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:27.070878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5b19309-ac8d-4e9b-a071-1f038d98688d tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:27.085998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5b19309-ac8d-4e9b-a071-1f038d98688d tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:27.086578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5b19309-ac8d-4e9b-a071-1f038d98688d tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:27.089021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5b19309-ac8d-4e9b-a071-1f038d98688d tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:27.100148 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-a5b19309-ac8d-4e9b-a071-1f038d98688d tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] HTTP exception thrown: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a5b19309-ac8d-4e9b-a071-1f038d98688d tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Request method failure captured: Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: request: PUT /compute/v2.1/os-services/02d93739-b814-4adc-8e03-4767cb88f88a HTTP/1.1 Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 21 Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzj6xmbJf_vkKWlkXGg_5ArJl_J7vN7t5CO9Hle-z6H89qM1agWxQYhOPyfmF9NRfRiEZJ7dWvaO3vOCHiP_V2YFJ3nfidbUUWrcvQybFYHsLk-N5M2zBSbFqAv32WMvadbB3OvhgqQNu00jRJu5qY5ZN15mptb-oCKMxZm1ei_hMc4 Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.53 Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7c92ab5f6830407eab1a0d341edf041e Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-890848670 Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:00:27.102924 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:00:27.104452 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c92ab5f6830407eab1a0d341edf041e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c92ab5f6830407eab1a0d341edf041e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7c92ab5f6830407eab1a0d341edf041e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7c92ab5f6830407eab1a0d341edf041e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:27.104452 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-890848670 Oct 12 22:00:27.104452 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7c92ab5f6830407eab1a0d341edf041e Oct 12 22:00:27.104452 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-890848670 Oct 12 22:00:27.104452 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin Oct 12 22:00:27.104452 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:27.104452 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:27.104452 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: e0e9b8cefd3b426db475f7a1f9ec72d5 Oct 12 22:00:27.104452 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin Oct 12 22:00:27.104452 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:00:27.104452 n-d-861111-1 devstack@n-api.service[120453]: {"status": "enabled"} Oct 12 22:00:27.104452 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:00:27.104452 n-d-861111-1 devstack@n-api.service[120453]: exception: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. Oct 12 22:00:27.104452 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '02d93739-b814-4adc-8e03-4767cb88f88a', 'body': {'status': 'enabled'}} Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:27.105363 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:27.106877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:27.108269 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. Oct 12 22:00:27.108269 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:27.111261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a5b19309-ac8d-4e9b-a071-1f038d98688d tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Returning 404 to user: Service 02d93739-b814-4adc-8e03-4767cb88f88a could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:27.111667 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a5b19309-ac8d-4e9b-a071-1f038d98688d tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/02d93739-b814-4adc-8e03-4767cb88f88a" status: 404 len: 110 microversion: 2.53 time: 0.060082 Oct 12 22:00:27.112351 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 165/292] 10.222.0.16 () {62 vars in 1309 bytes} [Wed Oct 12 22:00:27 2022] PUT /compute/v2.1/os-services/02d93739-b814-4adc-8e03-4767cb88f88a => generated 110 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:00:27.127256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e341cfb7-50a9-4a91-addd-1c5f61833f7f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:27.137205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e341cfb7-50a9-4a91-addd-1c5f61833f7f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:27.137910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e341cfb7-50a9-4a91-addd-1c5f61833f7f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:27.138536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e341cfb7-50a9-4a91-addd-1c5f61833f7f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:27.139789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e341cfb7-50a9-4a91-addd-1c5f61833f7f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:27.140427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e341cfb7-50a9-4a91-addd-1c5f61833f7f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:27.141026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e341cfb7-50a9-4a91-addd-1c5f61833f7f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:27.175765 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e341cfb7-50a9-4a91-addd-1c5f61833f7f tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.054538 Oct 12 22:00:27.191987 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 166/293] 10.222.0.16 () {60 vars in 1178 bytes} [Wed Oct 12 22:00:27 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:00:27.200227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-17beeb52-b31c-4532-b586-7296cb847166 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:27.203841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17beeb52-b31c-4532-b586-7296cb847166 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:27.204329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17beeb52-b31c-4532-b586-7296cb847166 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:27.204769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17beeb52-b31c-4532-b586-7296cb847166 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:27.205509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17beeb52-b31c-4532-b586-7296cb847166 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:27.205964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17beeb52-b31c-4532-b586-7296cb847166 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:27.219283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17beeb52-b31c-4532-b586-7296cb847166 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:27.266427 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-17beeb52-b31c-4532-b586-7296cb847166 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.071706 Oct 12 22:00:27.281533 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 167/294] 10.222.0.16 () {60 vars in 1211 bytes} [Wed Oct 12 22:00:27 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:00:27.299860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1d08bc45-3482-4b23-9bc1-17fc35b1c51b tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:27.308708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d08bc45-3482-4b23-9bc1-17fc35b1c51b tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:27.309287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d08bc45-3482-4b23-9bc1-17fc35b1c51b tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:27.309833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d08bc45-3482-4b23-9bc1-17fc35b1c51b tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:27.310677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d08bc45-3482-4b23-9bc1-17fc35b1c51b tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:27.311120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d08bc45-3482-4b23-9bc1-17fc35b1c51b tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:27.311655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d08bc45-3482-4b23-9bc1-17fc35b1c51b tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:27.312297 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d5c27029-1f13-4ef7-a260-83f28706b5e5 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 204 len: 0 microversion: 2.1 time: 0.371002 Oct 12 22:00:27.316140 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 128/295] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:00:26 2022] DELETE /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:00:27.331067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-98d5be5e-31bb-432c-8266-66cce0cc4ffa tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:27.335122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-98d5be5e-31bb-432c-8266-66cce0cc4ffa tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:27.341776 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1d08bc45-3482-4b23-9bc1-17fc35b1c51b tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.050596 Oct 12 22:00:27.350812 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 168/296] 10.222.0.16 () {60 vars in 1178 bytes} [Wed Oct 12 22:00:27 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:00:27.353420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98d5be5e-31bb-432c-8266-66cce0cc4ffa tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:27.354759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98d5be5e-31bb-432c-8266-66cce0cc4ffa tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:27.355209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98d5be5e-31bb-432c-8266-66cce0cc4ffa tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:27.355937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98d5be5e-31bb-432c-8266-66cce0cc4ffa tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:27.357916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-11f11d97-2a91-4125-ac9d-7d3e29ac2566 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:27.358567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98d5be5e-31bb-432c-8266-66cce0cc4ffa tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:27.359049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98d5be5e-31bb-432c-8266-66cce0cc4ffa tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:27.359278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-11f11d97-2a91-4125-ac9d-7d3e29ac2566 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:27.366313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11f11d97-2a91-4125-ac9d-7d3e29ac2566 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:27.367169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11f11d97-2a91-4125-ac9d-7d3e29ac2566 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:27.367776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11f11d97-2a91-4125-ac9d-7d3e29ac2566 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:27.368704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11f11d97-2a91-4125-ac9d-7d3e29ac2566 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:27.369542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11f11d97-2a91-4125-ac9d-7d3e29ac2566 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:27.370125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11f11d97-2a91-4125-ac9d-7d3e29ac2566 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:27.440833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98d5be5e-31bb-432c-8266-66cce0cc4ffa tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:27.441931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98d5be5e-31bb-432c-8266-66cce0cc4ffa tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:27.442546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98d5be5e-31bb-432c-8266-66cce0cc4ffa tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:27.443666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-98d5be5e-31bb-432c-8266-66cce0cc4ffa tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lazy-loading 'fault' on Instance uuid 7ca31258-b0ea-447d-aff6-5612a0746d3c {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:00:27.799551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-11f11d97-2a91-4125-ac9d-7d3e29ac2566 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:27.830132 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-11f11d97-2a91-4125-ac9d-7d3e29ac2566 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1311 microversion: 2.1 time: 0.474291 Oct 12 22:00:27.833947 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 169/297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:27 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1311 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:27.844020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-98d5be5e-31bb-432c-8266-66cce0cc4ffa tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:27.863974 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-98d5be5e-31bb-432c-8266-66cce0cc4ffa tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 200 len: 1459 microversion: 2.1 time: 0.541310 Oct 12 22:00:27.878013 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 129/298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:27 2022] GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 1459 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:27.878859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3719592f-f2b8-4187-a3c4-c8fe2a70afaf tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:27.889739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3719592f-f2b8-4187-a3c4-c8fe2a70afaf tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:27.891474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3719592f-f2b8-4187-a3c4-c8fe2a70afaf tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:27.892709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3719592f-f2b8-4187-a3c4-c8fe2a70afaf tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:27.897263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3719592f-f2b8-4187-a3c4-c8fe2a70afaf tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:27.897990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3719592f-f2b8-4187-a3c4-c8fe2a70afaf tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:27.898648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3719592f-f2b8-4187-a3c4-c8fe2a70afaf tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:27.986954 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3719592f-f2b8-4187-a3c4-c8fe2a70afaf tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-861111-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.142028 Oct 12 22:00:27.988585 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 170/299] 10.222.0.16 () {60 vars in 1235 bytes} [Wed Oct 12 22:00:27 2022] GET /compute/v2.1/os-services?host=n-d-861111-1&binary=xxx => generated 16 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:28.002899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d8413043-a4e8-4bb4-8ff8-63f368a020c5 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:28.009123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8413043-a4e8-4bb4-8ff8-63f368a020c5 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:28.010020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8413043-a4e8-4bb4-8ff8-63f368a020c5 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:28.010691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8413043-a4e8-4bb4-8ff8-63f368a020c5 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:28.012302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8413043-a4e8-4bb4-8ff8-63f368a020c5 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:28.013313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8413043-a4e8-4bb4-8ff8-63f368a020c5 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:28.014011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8413043-a4e8-4bb4-8ff8-63f368a020c5 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:28.082206 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d8413043-a4e8-4bb4-8ff8-63f368a020c5 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.084314 Oct 12 22:00:28.095407 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 130/300] 10.222.0.16 () {60 vars in 1178 bytes} [Wed Oct 12 22:00:27 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:00:28.100206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-547d38f4-d57d-4f71-a8ea-770ca5a55059 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:28.109120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-547d38f4-d57d-4f71-a8ea-770ca5a55059 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:28.112043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-547d38f4-d57d-4f71-a8ea-770ca5a55059 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:28.115642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-547d38f4-d57d-4f71-a8ea-770ca5a55059 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:28.118570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-547d38f4-d57d-4f71-a8ea-770ca5a55059 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:28.122059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-547d38f4-d57d-4f71-a8ea-770ca5a55059 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:28.126500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-547d38f4-d57d-4f71-a8ea-770ca5a55059 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:28.200333 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-547d38f4-d57d-4f71-a8ea-770ca5a55059 tempest-ServicesAdminNegativeV253TestJSON-890848670 tempest-ServicesAdminNegativeV253TestJSON-890848670-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.107023 Oct 12 22:00:28.201639 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 171/301] 10.222.0.16 () {60 vars in 1239 bytes} [Wed Oct 12 22:00:28 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:00:28.245267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-64463cbf-05ed-4db6-8d3a-47eb9664c807 req-9a505ff6-e808-41d9-a835-812306523468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1701358b-ffd8-442b-add8-6fa9581ceaa4", "name": "network-vif-plugged", "status": "completed", "tag": "0bf1a6c0-d01b-4b06-ae76-9244a6b48643"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:28.252362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=49 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:28.259562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-64463cbf-05ed-4db6-8d3a-47eb9664c807 req-9a505ff6-e808-41d9-a835-812306523468 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:28.260823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-64463cbf-05ed-4db6-8d3a-47eb9664c807 req-9a505ff6-e808-41d9-a835-812306523468 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:28.261494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-64463cbf-05ed-4db6-8d3a-47eb9664c807 req-9a505ff6-e808-41d9-a835-812306523468 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:28.277573 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-64463cbf-05ed-4db6-8d3a-47eb9664c807 req-9a505ff6-e808-41d9-a835-812306523468 service nova] Creating event network-vif-plugged:0bf1a6c0-d01b-4b06-ae76-9244a6b48643 for instance 1701358b-ffd8-442b-add8-6fa9581ceaa4 on n-h1-861111-1 Oct 12 22:00:28.283262 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-64463cbf-05ed-4db6-8d3a-47eb9664c807 req-9a505ff6-e808-41d9-a835-812306523468 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042542 Oct 12 22:00:28.284565 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 172/302] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:00:28.564893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-024f70a6-f7c1-4fc4-9e45-fb2d8a27e9f0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:28.565835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-024f70a6-f7c1-4fc4-9e45-fb2d8a27e9f0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:28.578809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024f70a6-f7c1-4fc4-9e45-fb2d8a27e9f0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:28.580702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024f70a6-f7c1-4fc4-9e45-fb2d8a27e9f0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:28.581704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024f70a6-f7c1-4fc4-9e45-fb2d8a27e9f0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:28.583455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024f70a6-f7c1-4fc4-9e45-fb2d8a27e9f0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:28.586760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024f70a6-f7c1-4fc4-9e45-fb2d8a27e9f0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:28.587482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024f70a6-f7c1-4fc4-9e45-fb2d8a27e9f0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:28.926158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0ffc24fb-c0a6-42f2-9688-e0d94e5068c4 tempest-ServicesAdminNegativeV253TestJSON-2005207481 tempest-ServicesAdminNegativeV253TestJSON-2005207481-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:28.929867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0ffc24fb-c0a6-42f2-9688-e0d94e5068c4 tempest-ServicesAdminNegativeV253TestJSON-2005207481 tempest-ServicesAdminNegativeV253TestJSON-2005207481-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '45d5c825257a4eb4b9149def23c014a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831fd6e35e674b7cbb83590f3ec2deb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0ffc24fb-c0a6-42f2-9688-e0d94e5068c4 tempest-ServicesAdminNegativeV253TestJSON-2005207481 tempest-ServicesAdminNegativeV253TestJSON-2005207481-project] Request method failure captured: Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzj4LSX6ndvluRzT7wlZXgCljMcrTZnm5l244KiGA8L4dAKajhqy0cZHYj_wRdlQqlJnqr1eR7H_lpuLB9oUer5yTk6rTsJA9ox1niijg3Oarlk-jo8lLboV6FRkvAC5I1LFXCy_U7p5LrJSDUF4YmbaNzGJ3VmXXE59Yhp8xxbc8rg Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: X-Openstack-Nova-Api-Version: 2.53 Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 831fd6e35e674b7cbb83590f3ec2deb1 Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2005207481 Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:00:28.932035 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:00:28.933353 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/831fd6e35e674b7cbb83590f3ec2deb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/831fd6e35e674b7cbb83590f3ec2deb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_831fd6e35e674b7cbb83590f3ec2deb1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/831fd6e35e674b7cbb83590f3ec2deb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:28.933353 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2005207481 Oct 12 22:00:28.933353 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 831fd6e35e674b7cbb83590f3ec2deb1 Oct 12 22:00:28.933353 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2005207481 Oct 12 22:00:28.933353 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2005207481-project Oct 12 22:00:28.933353 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:28.933353 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:28.933353 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 45d5c825257a4eb4b9149def23c014a5 Oct 12 22:00:28.933353 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2005207481-project Oct 12 22:00:28.933353 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:00:28.933353 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 22:00:28.933353 n-d-861111-1 devstack@n-api.service[120452]: action_args: {} Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:00:28.934044 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 22:00:28.936176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:28.937417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0ffc24fb-c0a6-42f2-9688-e0d94e5068c4 tempest-ServicesAdminNegativeV253TestJSON-2005207481 tempest-ServicesAdminNegativeV253TestJSON-2005207481-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:28.937417 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0ffc24fb-c0a6-42f2-9688-e0d94e5068c4 tempest-ServicesAdminNegativeV253TestJSON-2005207481 tempest-ServicesAdminNegativeV253TestJSON-2005207481-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.723507 Oct 12 22:00:28.937417 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 131/303] 10.222.0.16 () {60 vars in 1178 bytes} [Wed Oct 12 22:00:28 2022] GET /compute/v2.1/os-services => generated 112 bytes in 725 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:00:28.944702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-024f70a6-f7c1-4fc4-9e45-fb2d8a27e9f0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:28.951758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-8316dc72-44ca-4d74-9725-96943f23a929 req-610d9216-f25b-4a93-a482-cc3fbb60036c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1848e1da-8fef-4d2e-93b0-87af0c4fe39d", "tag": "6d33ba53-ea2f-4f4f-a7b2-f87a95f5c19e"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:28.953455 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-024f70a6-f7c1-4fc4-9e45-fb2d8a27e9f0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 200 len: 1588 microversion: 2.1 time: 0.393293 Oct 12 22:00:28.954005 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 173/304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:28 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 1588 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:28.969435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8316dc72-44ca-4d74-9725-96943f23a929 req-610d9216-f25b-4a93-a482-cc3fbb60036c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:28.973787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fcc4fd0e-bc43-4236-a3dd-a6d57df5f26b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:28.974782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fcc4fd0e-bc43-4236-a3dd-a6d57df5f26b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:28.977403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8316dc72-44ca-4d74-9725-96943f23a929 req-610d9216-f25b-4a93-a482-cc3fbb60036c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:28.977831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8316dc72-44ca-4d74-9725-96943f23a929 req-610d9216-f25b-4a93-a482-cc3fbb60036c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:28.989766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcc4fd0e-bc43-4236-a3dd-a6d57df5f26b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:28.991508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcc4fd0e-bc43-4236-a3dd-a6d57df5f26b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:28.992181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcc4fd0e-bc43-4236-a3dd-a6d57df5f26b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:28.993239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcc4fd0e-bc43-4236-a3dd-a6d57df5f26b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:28.993907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcc4fd0e-bc43-4236-a3dd-a6d57df5f26b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:28.994533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcc4fd0e-bc43-4236-a3dd-a6d57df5f26b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:29.009831 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-8316dc72-44ca-4d74-9725-96943f23a929 req-610d9216-f25b-4a93-a482-cc3fbb60036c service nova] Creating event network-changed:6d33ba53-ea2f-4f4f-a7b2-f87a95f5c19e for instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d on n-h2-861111-1 Oct 12 22:00:29.026644 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-8316dc72-44ca-4d74-9725-96943f23a929 req-610d9216-f25b-4a93-a482-cc3fbb60036c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091444 Oct 12 22:00:29.027272 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 132/305] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:29.040118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-48597e4b-9bf0-4bef-ab96-daa760a02e4e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:29.044175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-48597e4b-9bf0-4bef-ab96-daa760a02e4e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:29.059027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48597e4b-9bf0-4bef-ab96-daa760a02e4e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:29.059691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48597e4b-9bf0-4bef-ab96-daa760a02e4e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:29.059978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48597e4b-9bf0-4bef-ab96-daa760a02e4e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:29.060678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48597e4b-9bf0-4bef-ab96-daa760a02e4e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:29.062476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48597e4b-9bf0-4bef-ab96-daa760a02e4e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:29.068192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48597e4b-9bf0-4bef-ab96-daa760a02e4e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:29.109788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:29.187442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48597e4b-9bf0-4bef-ab96-daa760a02e4e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:29.188250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48597e4b-9bf0-4bef-ab96-daa760a02e4e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:29.191438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48597e4b-9bf0-4bef-ab96-daa760a02e4e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:29.196506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-48597e4b-9bf0-4bef-ab96-daa760a02e4e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lazy-loading 'fault' on Instance uuid 7ca31258-b0ea-447d-aff6-5612a0746d3c {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:00:29.314140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fcc4fd0e-bc43-4236-a3dd-a6d57df5f26b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:29.325814 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fcc4fd0e-bc43-4236-a3dd-a6d57df5f26b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1311 microversion: 2.1 time: 0.370542 Oct 12 22:00:29.346961 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 174/306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:28 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1311 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:29.994490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-48597e4b-9bf0-4bef-ab96-daa760a02e4e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6696c1546f834f638bc626413360a81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62279514893442c3993a79dab7c2cbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:30.003179 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-48597e4b-9bf0-4bef-ab96-daa760a02e4e tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 200 len: 1459 microversion: 2.1 time: 0.971630 Oct 12 22:00:30.012387 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 133/307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:29 2022] GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 1459 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:30.358294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02f62cc3-92bb-4a7a-b751-4f4af1349507 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:30.360956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-02f62cc3-92bb-4a7a-b751-4f4af1349507 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:30.383935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02f62cc3-92bb-4a7a-b751-4f4af1349507 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:30.385578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02f62cc3-92bb-4a7a-b751-4f4af1349507 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:30.387340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02f62cc3-92bb-4a7a-b751-4f4af1349507 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:30.395890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02f62cc3-92bb-4a7a-b751-4f4af1349507 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:30.396618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02f62cc3-92bb-4a7a-b751-4f4af1349507 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:30.398602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02f62cc3-92bb-4a7a-b751-4f4af1349507 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:30.885780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-02f62cc3-92bb-4a7a-b751-4f4af1349507 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:30.898895 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-02f62cc3-92bb-4a7a-b751-4f4af1349507 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1495 microversion: 2.1 time: 0.546738 Oct 12 22:00:30.901237 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 175/308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:30 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1495 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:31.404251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-de7eb9a5-4d54-44a9-870d-9cf28d7ec52f tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] Action: 'create', calling method: .version_select at 0x7f5128a8cdc0>, body: {"pool": null} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:31.532361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-672ab255-b826-451b-ba75-e3daeecfed15 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:31.533015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-672ab255-b826-451b-ba75-e3daeecfed15 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:31.543409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-672ab255-b826-451b-ba75-e3daeecfed15 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:31.544269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-672ab255-b826-451b-ba75-e3daeecfed15 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:31.548241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-672ab255-b826-451b-ba75-e3daeecfed15 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:31.549002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-672ab255-b826-451b-ba75-e3daeecfed15 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:31.549475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-672ab255-b826-451b-ba75-e3daeecfed15 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:31.549916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-672ab255-b826-451b-ba75-e3daeecfed15 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:31.948192 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-672ab255-b826-451b-ba75-e3daeecfed15 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1646 microversion: 2.1 time: 1.025517 Oct 12 22:00:31.949357 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 176/309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:30 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1646 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:31.956809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-adda518b-f15f-420d-9f25-99e1997a87cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:31.959219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-adda518b-f15f-420d-9f25-99e1997a87cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:31.967932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adda518b-f15f-420d-9f25-99e1997a87cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:31.969649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adda518b-f15f-420d-9f25-99e1997a87cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:31.970314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adda518b-f15f-420d-9f25-99e1997a87cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:31.972090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adda518b-f15f-420d-9f25-99e1997a87cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:31.973020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adda518b-f15f-420d-9f25-99e1997a87cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:31.973906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adda518b-f15f-420d-9f25-99e1997a87cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:32.022158 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-adda518b-f15f-420d-9f25-99e1997a87cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] HTTP exception thrown: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-adda518b-f15f-420d-9f25-99e1997a87cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Request method failure captured: Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c HTTP/1.1 Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzivT0OU0BNpg9FJtNsm8iG6kmLTgW0pNUWoTPRDJCqueLK1q4qDKxAYYeeG65bsuOL8AiwPkeOHQl-FUEWSSZvyFzJFeNV8XyB5hHRm0kpt4d66LYrcuUHfLl4s5a8JY5vOGaUKpcXYVuDpJxqyxBdfWpFT_5Eb82eh3SXIvgi6iTA Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 62279514893442c3993a79dab7c2cbb3 Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:00:32.025554 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:00:32.027326 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62279514893442c3993a79dab7c2cbb3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:32.027326 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:32.027326 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 62279514893442c3993a79dab7c2cbb3 Oct 12 22:00:32.027326 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:32.027326 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-DeleteServersAdminTestJSON-1175865066-project Oct 12 22:00:32.027326 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:32.027326 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:32.027326 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6696c1546f834f638bc626413360a81f Oct 12 22:00:32.027326 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-DeleteServersAdminTestJSON-1175865066-project Oct 12 22:00:32.027326 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:00:32.027326 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. Oct 12 22:00:32.027326 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '7ca31258-b0ea-447d-aff6-5612a0746d3c'} Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:32.028211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. Oct 12 22:00:32.029416 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:32.031727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-adda518b-f15f-420d-9f25-99e1997a87cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Returning 404 to user: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:32.033150 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-adda518b-f15f-420d-9f25-99e1997a87cf tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 404 len: 111 microversion: 2.1 time: 0.082394 Oct 12 22:00:32.034464 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 177/310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:31 2022] GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:32.048947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-6e14e60a-7fd8-4e17-9861-1615507cc384 req-d6a61eaa-697b-413a-aa78-6d5f40cc5e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca31258-b0ea-447d-aff6-5612a0746d3c", "name": "network-vif-deleted", "tag": "ce6e8cde-b0cb-4892-95a8-9630e7a4ad93"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:32.074869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6e14e60a-7fd8-4e17-9861-1615507cc384 req-d6a61eaa-697b-413a-aa78-6d5f40cc5e93 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:32.076147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6e14e60a-7fd8-4e17-9861-1615507cc384 req-d6a61eaa-697b-413a-aa78-6d5f40cc5e93 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:32.076700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6e14e60a-7fd8-4e17-9861-1615507cc384 req-d6a61eaa-697b-413a-aa78-6d5f40cc5e93 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:32.092477 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6e14e60a-7fd8-4e17-9861-1615507cc384 req-d6a61eaa-697b-413a-aa78-6d5f40cc5e93 service nova] Creating event network-vif-deleted:ce6e8cde-b0cb-4892-95a8-9630e7a4ad93 for instance 7ca31258-b0ea-447d-aff6-5612a0746d3c on n-h1-861111-1 Oct 12 22:00:32.099343 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-6e14e60a-7fd8-4e17-9861-1615507cc384 req-d6a61eaa-697b-413a-aa78-6d5f40cc5e93 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062510 Oct 12 22:00:32.100630 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 178/311] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:32.109696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b2f1b70b-93d4-400e-85c9-51df9c813263 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:32.110414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b2f1b70b-93d4-400e-85c9-51df9c813263 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:32.119683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2f1b70b-93d4-400e-85c9-51df9c813263 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:32.120672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2f1b70b-93d4-400e-85c9-51df9c813263 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:32.122208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2f1b70b-93d4-400e-85c9-51df9c813263 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:32.122485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2f1b70b-93d4-400e-85c9-51df9c813263 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:32.122989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2f1b70b-93d4-400e-85c9-51df9c813263 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:32.123492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2f1b70b-93d4-400e-85c9-51df9c813263 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:32.131210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:32.324843 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b2f1b70b-93d4-400e-85c9-51df9c813263 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1646 microversion: 2.1 time: 0.222520 Oct 12 22:00:32.326591 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 179/312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:32 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1646 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:32.335524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1e8f3248-0315-43af-aa3d-61a0845694da tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:32.336215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1e8f3248-0315-43af-aa3d-61a0845694da tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:32.343693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e8f3248-0315-43af-aa3d-61a0845694da tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:32.344633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e8f3248-0315-43af-aa3d-61a0845694da tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:32.345916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e8f3248-0315-43af-aa3d-61a0845694da tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:32.346795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e8f3248-0315-43af-aa3d-61a0845694da tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:32.348083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e8f3248-0315-43af-aa3d-61a0845694da tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:32.348712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e8f3248-0315-43af-aa3d-61a0845694da tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:32.368428 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-1e8f3248-0315-43af-aa3d-61a0845694da tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] HTTP exception thrown: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1e8f3248-0315-43af-aa3d-61a0845694da tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Request method failure captured: Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c HTTP/1.1 Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzivT0OU0BNpg9FJtNsm8iG6kmLTgW0pNUWoTPRDJCqueLK1q4qDKxAYYeeG65bsuOL8AiwPkeOHQl-FUEWSSZvyFzJFeNV8XyB5hHRm0kpt4d66LYrcuUHfLl4s5a8JY5vOGaUKpcXYVuDpJxqyxBdfWpFT_5Eb82eh3SXIvgi6iTA Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 62279514893442c3993a79dab7c2cbb3 Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:00:32.373684 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:00:32.375206 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62279514893442c3993a79dab7c2cbb3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:32.375206 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:32.375206 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 62279514893442c3993a79dab7c2cbb3 Oct 12 22:00:32.375206 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:32.375206 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-DeleteServersAdminTestJSON-1175865066-project Oct 12 22:00:32.375206 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:32.375206 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:32.375206 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6696c1546f834f638bc626413360a81f Oct 12 22:00:32.375206 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-DeleteServersAdminTestJSON-1175865066-project Oct 12 22:00:32.375206 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:00:32.375206 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. Oct 12 22:00:32.375206 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '7ca31258-b0ea-447d-aff6-5612a0746d3c'} Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:32.376089 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. Oct 12 22:00:32.377441 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:32.381411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1e8f3248-0315-43af-aa3d-61a0845694da tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Returning 404 to user: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:32.386632 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1e8f3248-0315-43af-aa3d-61a0845694da tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 404 len: 111 microversion: 2.1 time: 0.057106 Oct 12 22:00:32.387533 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 180/313] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:00:32 2022] DELETE /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:32.398722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-da8055db-08eb-49fd-b0cb-6d6740bd5de3 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:32.405133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da8055db-08eb-49fd-b0cb-6d6740bd5de3 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:32.405870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da8055db-08eb-49fd-b0cb-6d6740bd5de3 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:32.406545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da8055db-08eb-49fd-b0cb-6d6740bd5de3 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:32.407497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da8055db-08eb-49fd-b0cb-6d6740bd5de3 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:32.408106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da8055db-08eb-49fd-b0cb-6d6740bd5de3 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:32.408706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da8055db-08eb-49fd-b0cb-6d6740bd5de3 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:32.464246 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-da8055db-08eb-49fd-b0cb-6d6740bd5de3 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.073939 Oct 12 22:00:32.465874 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 181/314] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 12 22:00:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:32.480083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e72d62c0-a80b-470b-97b7-e2e0bab8bb3c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:32.482143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e72d62c0-a80b-470b-97b7-e2e0bab8bb3c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 7ca31258-b0ea-447d-aff6-5612a0746d3c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:32.496799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e72d62c0-a80b-470b-97b7-e2e0bab8bb3c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:32.497306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e72d62c0-a80b-470b-97b7-e2e0bab8bb3c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:32.497830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e72d62c0-a80b-470b-97b7-e2e0bab8bb3c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:32.500804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e72d62c0-a80b-470b-97b7-e2e0bab8bb3c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:32.502894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e72d62c0-a80b-470b-97b7-e2e0bab8bb3c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:32.503765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e72d62c0-a80b-470b-97b7-e2e0bab8bb3c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:32.527648 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-e72d62c0-a80b-470b-97b7-e2e0bab8bb3c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] HTTP exception thrown: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e72d62c0-a80b-470b-97b7-e2e0bab8bb3c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Request method failure captured: Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c HTTP/1.1 Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzivT0OU0BNpg9FJtNsm8iG6kmLTgW0pNUWoTPRDJCqueLK1q4qDKxAYYeeG65bsuOL8AiwPkeOHQl-FUEWSSZvyFzJFeNV8XyB5hHRm0kpt4d66LYrcuUHfLl4s5a8JY5vOGaUKpcXYVuDpJxqyxBdfWpFT_5Eb82eh3SXIvgi6iTA Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 62279514893442c3993a79dab7c2cbb3 Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:00:32.529387 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:00:32.530786 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62279514893442c3993a79dab7c2cbb3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:32.530786 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:32.530786 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 62279514893442c3993a79dab7c2cbb3 Oct 12 22:00:32.530786 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:32.530786 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-DeleteServersAdminTestJSON-1175865066-project Oct 12 22:00:32.530786 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:32.530786 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:32.530786 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6696c1546f834f638bc626413360a81f Oct 12 22:00:32.530786 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-DeleteServersAdminTestJSON-1175865066-project Oct 12 22:00:32.530786 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:00:32.530786 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. Oct 12 22:00:32.530786 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '7ca31258-b0ea-447d-aff6-5612a0746d3c'} Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:32.531631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. Oct 12 22:00:32.533978 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:32.535125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e72d62c0-a80b-470b-97b7-e2e0bab8bb3c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Returning 404 to user: Instance 7ca31258-b0ea-447d-aff6-5612a0746d3c could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:32.535125 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e72d62c0-a80b-470b-97b7-e2e0bab8bb3c tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c" status: 404 len: 111 microversion: 2.1 time: 0.062404 Oct 12 22:00:32.535125 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 182/315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:32 2022] GET /compute/v2.1/servers/7ca31258-b0ea-447d-aff6-5612a0746d3c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:32.537615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f037860a-da83-4729-9f9a-67ad7d10f951 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861111-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:32.540065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f037860a-da83-4729-9f9a-67ad7d10f951 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:32.547180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f037860a-da83-4729-9f9a-67ad7d10f951 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:32.547728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f037860a-da83-4729-9f9a-67ad7d10f951 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:32.548162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f037860a-da83-4729-9f9a-67ad7d10f951 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:32.549481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f037860a-da83-4729-9f9a-67ad7d10f951 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:32.550087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f037860a-da83-4729-9f9a-67ad7d10f951 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:32.550820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f037860a-da83-4729-9f9a-67ad7d10f951 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:33.701923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-f037860a-da83-4729-9f9a-67ad7d10f951 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lazy-loading 'flavor' on Instance uuid 1701358b-ffd8-442b-add8-6fa9581ceaa4 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:00:33.807099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f037860a-da83-4729-9f9a-67ad7d10f951 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Going to try to live migrate instance to n-h2-861111-1 {{(pid=120453) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:00:33.884884 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-de7eb9a5-4d54-44a9-870d-9cf28d7ec52f tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.366936 Oct 12 22:00:33.886901 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 134/316] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 12 22:00:30 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:33.892564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0093fd45-f4fc-4628-bbed-a7ed8a0d63d3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:33.893259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0093fd45-f4fc-4628-bbed-a7ed8a0d63d3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:33.908221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0093fd45-f4fc-4628-bbed-a7ed8a0d63d3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:33.908731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0093fd45-f4fc-4628-bbed-a7ed8a0d63d3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:33.910190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0093fd45-f4fc-4628-bbed-a7ed8a0d63d3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:33.911519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0093fd45-f4fc-4628-bbed-a7ed8a0d63d3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:33.912039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0093fd45-f4fc-4628-bbed-a7ed8a0d63d3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:33.912417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0093fd45-f4fc-4628-bbed-a7ed8a0d63d3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:33.932268 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-0093fd45-f4fc-4628-bbed-a7ed8a0d63d3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] HTTP exception thrown: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0093fd45-f4fc-4628-bbed-a7ed8a0d63d3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Request method failure captured: Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d HTTP/1.1 Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzivT0OU0BNpg9FJtNsm8iG6kmLTgW0pNUWoTPRDJCqueLK1q4qDKxAYYeeG65bsuOL8AiwPkeOHQl-FUEWSSZvyFzJFeNV8XyB5hHRm0kpt4d66LYrcuUHfLl4s5a8JY5vOGaUKpcXYVuDpJxqyxBdfWpFT_5Eb82eh3SXIvgi6iTA Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 62279514893442c3993a79dab7c2cbb3 Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:00:33.935685 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:00:33.937132 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62279514893442c3993a79dab7c2cbb3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:33.937132 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:33.937132 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 62279514893442c3993a79dab7c2cbb3 Oct 12 22:00:33.937132 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:33.937132 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-DeleteServersAdminTestJSON-1175865066-project Oct 12 22:00:33.937132 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:33.937132 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:33.937132 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 6696c1546f834f638bc626413360a81f Oct 12 22:00:33.937132 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersAdminTestJSON-1175865066-project Oct 12 22:00:33.937132 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:00:33.937132 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. Oct 12 22:00:33.937132 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '373004a6-fff2-4a8c-95d7-3d33ef32f89d'} Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:33.937911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. Oct 12 22:00:33.939158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:33.944084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0093fd45-f4fc-4628-bbed-a7ed8a0d63d3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Returning 404 to user: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:33.945296 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0093fd45-f4fc-4628-bbed-a7ed8a0d63d3 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "DELETE /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 404 len: 111 microversion: 2.1 time: 0.057132 Oct 12 22:00:33.948004 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 135/317] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:00:33 2022] DELETE /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:33.956473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6ab50906-9754-4e03-8810-4efcef7b2820 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] Calling method '.version_select at 0x7f5128a8caf0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:34.249331 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6ab50906-9754-4e03-8810-4efcef7b2820 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/a3cec058-974b-46ba-95ab-4003e15d2c9d" status: 200 len: 141 microversion: 2.1 time: 0.300061 Oct 12 22:00:34.249940 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 136/318] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 12 22:00:33 2022] GET /compute/v2.1/os-floating-ips/a3cec058-974b-46ba-95ab-4003e15d2c9d => generated 141 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:34.256862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-99a3db56-2a90-4c43-b29a-2670ca6bec94 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:34.257541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-99a3db56-2a90-4c43-b29a-2670ca6bec94 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] [instance: 373004a6-fff2-4a8c-95d7-3d33ef32f89d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:34.267041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99a3db56-2a90-4c43-b29a-2670ca6bec94 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:34.268722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99a3db56-2a90-4c43-b29a-2670ca6bec94 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:34.269374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99a3db56-2a90-4c43-b29a-2670ca6bec94 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:34.270440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99a3db56-2a90-4c43-b29a-2670ca6bec94 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:34.271573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99a3db56-2a90-4c43-b29a-2670ca6bec94 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:34.272269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99a3db56-2a90-4c43-b29a-2670ca6bec94 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:34.303200 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-99a3db56-2a90-4c43-b29a-2670ca6bec94 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] HTTP exception thrown: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-99a3db56-2a90-4c43-b29a-2670ca6bec94 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Request method failure captured: Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d HTTP/1.1 Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzivT0OU0BNpg9FJtNsm8iG6kmLTgW0pNUWoTPRDJCqueLK1q4qDKxAYYeeG65bsuOL8AiwPkeOHQl-FUEWSSZvyFzJFeNV8XyB5hHRm0kpt4d66LYrcuUHfLl4s5a8JY5vOGaUKpcXYVuDpJxqyxBdfWpFT_5Eb82eh3SXIvgi6iTA Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 62279514893442c3993a79dab7c2cbb3 Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:00:34.304812 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:00:34.306215 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62279514893442c3993a79dab7c2cbb3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62279514893442c3993a79dab7c2cbb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:34.306215 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:34.306215 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 62279514893442c3993a79dab7c2cbb3 Oct 12 22:00:34.306215 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1175865066 Oct 12 22:00:34.306215 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-DeleteServersAdminTestJSON-1175865066-project Oct 12 22:00:34.306215 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:34.306215 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:34.306215 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 6696c1546f834f638bc626413360a81f Oct 12 22:00:34.306215 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersAdminTestJSON-1175865066-project Oct 12 22:00:34.306215 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:00:34.306215 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. Oct 12 22:00:34.306215 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '373004a6-fff2-4a8c-95d7-3d33ef32f89d'} Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:34.307052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. Oct 12 22:00:34.308379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:34.309654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-99a3db56-2a90-4c43-b29a-2670ca6bec94 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] Returning 404 to user: Instance 373004a6-fff2-4a8c-95d7-3d33ef32f89d could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:34.309654 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-99a3db56-2a90-4c43-b29a-2670ca6bec94 tempest-DeleteServersAdminTestJSON-1175865066 tempest-DeleteServersAdminTestJSON-1175865066-project] 10.222.0.16 "GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d" status: 404 len: 111 microversion: 2.1 time: 0.055545 Oct 12 22:00:34.310936 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 137/319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:34 2022] GET /compute/v2.1/servers/373004a6-fff2-4a8c-95d7-3d33ef32f89d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:34.316706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b0a70b3a-183f-4d72-b3fc-5ed13ec5e3e1 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] Calling method '.version_select at 0x7f5128a16c10>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:34.586007 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b0a70b3a-183f-4d72-b3fc-5ed13ec5e3e1 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.273728 Oct 12 22:00:34.587218 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 138/320] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 12 22:00:34 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:34.603065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4dd80c14-daf7-4785-801b-b3f53d2d836c tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] Calling method '.version_select at 0x7f5128978dc0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:35.558671 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4dd80c14-daf7-4785-801b-b3f53d2d836c tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/a3cec058-974b-46ba-95ab-4003e15d2c9d" status: 202 len: 0 microversion: 2.1 time: 0.961880 Oct 12 22:00:35.559672 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 139/321] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:00:34 2022] DELETE /compute/v2.1/os-floating-ips/a3cec058-974b-46ba-95ab-4003e15d2c9d => generated 0 bytes in 963 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:35.888905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6d7effb8-f210-409a-92e0-abc5cb55a9a6 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1818821131", "id": 289024038, "os-flavor-access:is_public": "False"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:35.909431 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6d7effb8-f210-409a-92e0-abc5cb55a9a6 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.348462 Oct 12 22:00:35.910026 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 140/322] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:35 2022] POST /compute/v2.1/flavors => generated 436 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:36.199178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-31f9d032-8a14-4600-a4a8-23c94dbfe019 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-308412112", "id": 400632018, "os-flavor-access:is_public": "True"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:36.221068 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-31f9d032-8a14-4600-a4a8-23c94dbfe019 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.308596 Oct 12 22:00:36.222414 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 141/323] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:35 2022] POST /compute/v2.1/flavors => generated 426 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:36.226971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-271db7c0-22c3-43c5-a92a-ff614d9ad418 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] Action: 'create', calling method: .version_select at 0x7f5128a97af0>, body: {"pool": null} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:36.881872 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f037860a-da83-4729-9f9a-67ad7d10f951 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4/action" status: 202 len: 0 microversion: 2.1 time: 4.348667 Oct 12 22:00:36.885636 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 183/324] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:00:32 2022] POST /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4/action => generated 0 bytes in 4350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:37.187799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-79eaf8a7-0494-44b0-a9fd-92fa778a24b7 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:37.199747 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-79eaf8a7-0494-44b0-a9fd-92fa778a24b7 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.313423 Oct 12 22:00:37.200681 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 184/325] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:00:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:37.209958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-04d62b85-551e-457a-88f6-dbf7814de6a6 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b537e3867939409384e41bafff939f58"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:37.442385 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-04d62b85-551e-457a-88f6-dbf7814de6a6 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/289024038/action" status: 200 len: 96 microversion: 2.1 time: 0.237082 Oct 12 22:00:37.443279 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 185/326] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Oct 12 22:00:37 2022] POST /compute/v2.1/flavors/289024038/action => generated 96 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:00:37.714531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-395420f6-3a77-425c-afbb-ad8c9c0a0e88 tempest-QuotaClassesAdminTestJSON-1738891088 tempest-QuotaClassesAdminTestJSON-1738891088-project-admin] Calling method '.version_select at 0x7f5128be0b80>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:37.730497 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-395420f6-3a77-425c-afbb-ad8c9c0a0e88 tempest-QuotaClassesAdminTestJSON-1738891088 tempest-QuotaClassesAdminTestJSON-1738891088-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.285680 Oct 12 22:00:37.731070 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 186/327] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 12 22:00:37 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:37.735638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ebed884b-9588-45b1-98be-39d5bdd3a01e tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:37.754879 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ebed884b-9588-45b1-98be-39d5bdd3a01e tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/400632018" status: 202 len: 0 microversion: 2.1 time: 0.022471 Oct 12 22:00:37.756011 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 187/328] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 12 22:00:37 2022] DELETE /compute/v2.1/flavors/400632018 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:37.761628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7e971471-7b37-495e-be8e-12529a1698f8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:37.762661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7e971471-7b37-495e-be8e-12529a1698f8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:37.769377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e971471-7b37-495e-be8e-12529a1698f8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:37.770292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e971471-7b37-495e-be8e-12529a1698f8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:37.770983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e971471-7b37-495e-be8e-12529a1698f8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:37.771783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e971471-7b37-495e-be8e-12529a1698f8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:37.772409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e971471-7b37-495e-be8e-12529a1698f8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:37.772649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e971471-7b37-495e-be8e-12529a1698f8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:37.912081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7e971471-7b37-495e-be8e-12529a1698f8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:37.919724 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7e971471-7b37-495e-be8e-12529a1698f8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1505 microversion: 2.1 time: 0.162271 Oct 12 22:00:37.920288 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 188/329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:37 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:37.924624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e75bbf95-5d51-475e-ae6c-12ad1123dac5 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:37.946068 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e75bbf95-5d51-475e-ae6c-12ad1123dac5 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3076 microversion: 2.1 time: 0.024769 Oct 12 22:00:37.946634 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 189/330] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 12 22:00:37 2022] GET /compute/v2.1/flavors => generated 3076 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:37.951401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6dc346de-4122-4fa8-b4a6-ea953927a376 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b537e3867939409384e41bafff939f58"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:38.026046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=16 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:38.132660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:38.136104 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-6dc346de-4122-4fa8-b4a6-ea953927a376 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] HTTP exception thrown: Flavor access already exists for flavor 22 and project b537e3867939409384e41bafff939f58 combination. Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6dc346de-4122-4fa8-b4a6-ea953927a376 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Request method failure captured: Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/flavors/289024038/action HTTP/1.1 Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 67 Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzkAyAooGFCaLMZIGbOzCrfbXCHC4V5N6fChopWzNm0qOO_UybkmJcY9Jk_QwyQ3U_624McH9M4KoFGD9mXwcIkZ5RvrR66ERNIc3IS4gUHdpzljdxn0FRrdEEJOEX4kkSJ8UuqKOhFzitOii4IB3qy5Hl9TkJ065WcvKZpgiPT1xlY Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: add93c33d1c7451aa58c0acad906b287 Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-957763472 Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:00:38.154666 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:00:38.156180 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/add93c33d1c7451aa58c0acad906b287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/add93c33d1c7451aa58c0acad906b287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_add93c33d1c7451aa58c0acad906b287", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/add93c33d1c7451aa58c0acad906b287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:38.156180 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-957763472 Oct 12 22:00:38.156180 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: add93c33d1c7451aa58c0acad906b287 Oct 12 22:00:38.156180 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-957763472 Oct 12 22:00:38.156180 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin Oct 12 22:00:38.156180 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:38.156180 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:38.156180 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6b0ae278f1ec43abbec5002acd1f567f Oct 12 22:00:38.156180 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin Oct 12 22:00:38.156180 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:00:38.156180 n-d-861111-1 devstack@n-api.service[120453]: {"addTenantAccess": {"tenant": "b537e3867939409384e41bafff939f58"}} Oct 12 22:00:38.156180 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: exception: Flavor access already exists for flavor 22 and project b537e3867939409384e41bafff939f58 combination. Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '289024038', 'body': {'addTenantAccess': {'tenant': 'b537e3867939409384e41bafff939f58'}}} Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result.read() Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 22:00:38.157039 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '22-b537e3867939409384e41bafff939f58' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi session.flush() Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 22:00:38.158239 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 22:00:38.159524 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 22:00:38.161220 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 22:00:38.162396 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 22:00:38.162396 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result.read() Oct 12 22:00:38.162396 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 22:00:38.162396 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 22:00:38.162396 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 22:00:38.162396 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 22:00:38.162396 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 22:00:38.162396 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 22:00:38.162396 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 22:00:38.162396 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 22:00:38.162396 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '22-b537e3867939409384e41bafff939f58' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 12 22:00:38.162396 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 12 22:00:38.162396 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 12, 22, 0, 38, 131856), 'updated_at': None, 'flavor_id': 22, 'project_id': 'b537e3867939409384e41bafff939f58'}] Oct 12 22:00:38.162396 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 22:00:38.162396 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:38.162396 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:38.162396 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 22 and project b537e3867939409384e41bafff939f58 combination. Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:38.163677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 22 and project b537e3867939409384e41bafff939f58 combination. Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:38.165315 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:38.166581 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 22 and project b537e3867939409384e41bafff939f58 combination. Oct 12 22:00:38.166581 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:38.166581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6dc346de-4122-4fa8-b4a6-ea953927a376 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Returning 409 to user: Flavor access already exists for flavor 22 and project b537e3867939409384e41bafff939f58 combination. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:38.166581 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6dc346de-4122-4fa8-b4a6-ea953927a376 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/289024038/action" status: 409 len: 152 microversion: 2.1 time: 0.208426 Oct 12 22:00:38.166581 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 190/331] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Oct 12 22:00:37 2022] POST /compute/v2.1/flavors/289024038/action => generated 152 bytes in 213 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:00:38.166581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-220dd934-f9e2-4b6a-bf23-ee60dcbd061d tempest-QuotaClassesAdminTestJSON-1738891088 tempest-QuotaClassesAdminTestJSON-1738891088-project-admin] Action: 'update', calling method: .version_select at 0x7f51288cddc0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:38.331139 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-271db7c0-22c3-43c5-a92a-ff614d9ad418 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.107671 Oct 12 22:00:38.331762 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 142/332] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 12 22:00:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:38.336574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-acc768f6-424a-4be3-887e-e8a22d1002f3 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:38.357970 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-acc768f6-424a-4be3-887e-e8a22d1002f3 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.024922 Oct 12 22:00:38.358563 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 143/333] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:38 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:38.424311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8a806c7d-0b76-40f0-bb58-4fb1decb55e5 tempest-FlavorsV255TestJSON-99731976 tempest-FlavorsV255TestJSON-99731976-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-2025583433", "id": 811528532, "os-flavor-access:is_public": "True"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:38.462318 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8a806c7d-0b76-40f0-bb58-4fb1decb55e5 tempest-FlavorsV255TestJSON-99731976 tempest-FlavorsV255TestJSON-99731976-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.101996 Oct 12 22:00:38.463316 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 144/334] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 22:00:38 2022] POST /compute/v2.1/flavors => generated 446 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:00:38.469082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ce7d6691-ef1c-4fca-85b1-cf33c18170f6 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:38.479775 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ce7d6691-ef1c-4fca-85b1-cf33c18170f6 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014798 Oct 12 22:00:38.479975 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-220dd934-f9e2-4b6a-bf23-ee60dcbd061d tempest-QuotaClassesAdminTestJSON-1738891088 tempest-QuotaClassesAdminTestJSON-1738891088-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.317369 Oct 12 22:00:38.487583 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 191/335] 10.222.0.16 () {60 vars in 1206 bytes} [Wed Oct 12 22:00:38 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:38.487738 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 145/336] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:00:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:38.491024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4131262c-9b4d-4ec0-8ca1-4bd8ffdd2f43 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] Calling method '.version_select at 0x7f5128978700>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:38.494093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1b2b0638-0422-41a1-b12c-b2b5a3dce1c7 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b537e3867939409384e41bafff939f58"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:38.563214 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1b2b0638-0422-41a1-b12c-b2b5a3dce1c7 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/289024038/action" status: 200 len: 21 microversion: 2.1 time: 0.075267 Oct 12 22:00:38.563214 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 192/337] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Oct 12 22:00:38 2022] POST /compute/v2.1/flavors/289024038/action => generated 21 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:00:38.567942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-39cf1fad-b648-4b44-a98b-2e21965470d7 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1899859149", "id": 801570486, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:38.586500 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-39cf1fad-b648-4b44-a98b-2e21965470d7 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.022246 Oct 12 22:00:38.587393 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 193/338] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:38 2022] POST /compute/v2.1/flavors => generated 414 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:38.692000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-99049909-07c6-437d-acba-c4ee0e1543cb tempest-FlavorsV255TestJSON-1881144362 tempest-FlavorsV255TestJSON-1881144362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:38.699750 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-99049909-07c6-437d-acba-c4ee0e1543cb tempest-FlavorsV255TestJSON-1881144362 tempest-FlavorsV255TestJSON-1881144362-project] 10.222.0.16 "GET /compute/v2.1/flavors/811528532" status: 200 len: 446 microversion: 2.55 time: 0.111415 Oct 12 22:00:38.700320 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 194/339] 10.222.0.16 () {60 vars in 1196 bytes} [Wed Oct 12 22:00:38 2022] GET /compute/v2.1/flavors/811528532 => generated 446 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:00:38.704902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-22d9ade6-8102-4f88-9ab4-8bd6ced59f66 tempest-QuotaClassesAdminTestJSON-1738891088 tempest-QuotaClassesAdminTestJSON-1738891088-project-admin] Calling method '.version_select at 0x7f5128ac51f0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:38.715743 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-22d9ade6-8102-4f88-9ab4-8bd6ced59f66 tempest-QuotaClassesAdminTestJSON-1738891088 tempest-QuotaClassesAdminTestJSON-1738891088-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.014341 Oct 12 22:00:38.716474 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 195/340] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 12 22:00:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:38.722723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bcba2262-0950-4d79-bdcf-4e7f401ecf71 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:38.731626 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bcba2262-0950-4d79-bdcf-4e7f401ecf71 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014311 Oct 12 22:00:38.732181 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 196/341] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:00:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:38.743991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2520eb56-2360-4162-93a9-f4eda05897a4 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:38.760463 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2520eb56-2360-4162-93a9-f4eda05897a4 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/289024038" status: 202 len: 0 microversion: 2.1 time: 0.019829 Oct 12 22:00:38.764180 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 197/342] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 12 22:00:38 2022] DELETE /compute/v2.1/flavors/289024038 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:38.768232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3e6c9965-b142-48eb-8152-52a8c0e1d621 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:38.791196 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3e6c9965-b142-48eb-8152-52a8c0e1d621 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6634 microversion: 2.1 time: 0.028760 Oct 12 22:00:38.791795 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 198/343] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:38 2022] GET /compute/v2.1/flavors/detail => generated 6634 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:38.797526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-358c0248-6d27-4245-98be-e636413c2e56 tempest-FlavorsV255TestJSON-99731976 tempest-FlavorsV255TestJSON-99731976-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:38.827617 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-358c0248-6d27-4245-98be-e636413c2e56 tempest-FlavorsV255TestJSON-99731976 tempest-FlavorsV255TestJSON-99731976-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/811528532" status: 200 len: 447 microversion: 2.55 time: 0.033866 Oct 12 22:00:38.831416 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 199/344] 10.222.0.16 () {62 vars in 1216 bytes} [Wed Oct 12 22:00:38 2022] PUT /compute/v2.1/flavors/811528532 => generated 447 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:00:38.837385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8e7b5dfe-0696-4ec4-bd13-566ec735eb8f tempest-QuotaClassesAdminTestJSON-1738891088 tempest-QuotaClassesAdminTestJSON-1738891088-project-admin] Action: 'update', calling method: .version_select at 0x7f51288cdb80>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:38.858809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=16,nova_api:INSERT=13,nova_api:DELETE=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:38.952012 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8e7b5dfe-0696-4ec4-bd13-566ec735eb8f tempest-QuotaClassesAdminTestJSON-1738891088 tempest-QuotaClassesAdminTestJSON-1738891088-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.118376 Oct 12 22:00:38.952656 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 200/345] 10.222.0.16 () {60 vars in 1206 bytes} [Wed Oct 12 22:00:38 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:38.965475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-1bd1a622-6e47-43b7-b43a-f288549d66c1 req-5f27f9bd-5a79-4ad5-a670-6affd3167d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1701358b-ffd8-442b-add8-6fa9581ceaa4", "name": "network-vif-unplugged", "status": "completed", "tag": "0bf1a6c0-d01b-4b06-ae76-9244a6b48643"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:38.976379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1bd1a622-6e47-43b7-b43a-f288549d66c1 req-5f27f9bd-5a79-4ad5-a670-6affd3167d04 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:38.977013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1bd1a622-6e47-43b7-b43a-f288549d66c1 req-5f27f9bd-5a79-4ad5-a670-6affd3167d04 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:38.977369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1bd1a622-6e47-43b7-b43a-f288549d66c1 req-5f27f9bd-5a79-4ad5-a670-6affd3167d04 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:38.988486 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-1bd1a622-6e47-43b7-b43a-f288549d66c1 req-5f27f9bd-5a79-4ad5-a670-6affd3167d04 service nova] Creating event network-vif-unplugged:0bf1a6c0-d01b-4b06-ae76-9244a6b48643 for instance 1701358b-ffd8-442b-add8-6fa9581ceaa4 on n-h1-861111-1 Oct 12 22:00:38.994572 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-1bd1a622-6e47-43b7-b43a-f288549d66c1 req-5f27f9bd-5a79-4ad5-a670-6affd3167d04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034178 Oct 12 22:00:38.995597 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 201/346] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:39.000619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2795f900-ee9c-44e0-8b5c-346860169a7e tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.029302 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2795f900-ee9c-44e0-8b5c-346860169a7e tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 4028 microversion: 2.1 time: 0.032502 Oct 12 22:00:39.037511 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 202/347] 10.222.0.16 () {58 vars in 1165 bytes} [Wed Oct 12 22:00:38 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 4028 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:39.037511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3c3ff8c6-0e53-40fa-881f-b84d3fadf6db tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.057962 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3c3ff8c6-0e53-40fa-881f-b84d3fadf6db tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6634 microversion: 2.1 time: 0.026597 Oct 12 22:00:39.058827 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 203/348] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:39 2022] GET /compute/v2.1/flavors/detail => generated 6634 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:39.063071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-065eed9e-a893-4f9a-b0ea-b506405bb7b7 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.088463 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-065eed9e-a893-4f9a-b0ea-b506405bb7b7 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/801570486" status: 202 len: 0 microversion: 2.1 time: 0.027460 Oct 12 22:00:39.091654 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 204/349] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 12 22:00:39 2022] DELETE /compute/v2.1/flavors/801570486 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:39.096825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-71cd9300-86d4-4371-917d-304f783ae7a4 tempest-FlavorsV255TestJSON-1881144362 tempest-FlavorsV255TestJSON-1881144362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.128916 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-71cd9300-86d4-4371-917d-304f783ae7a4 tempest-FlavorsV255TestJSON-1881144362 tempest-FlavorsV255TestJSON-1881144362-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6588 microversion: 2.55 time: 0.035773 Oct 12 22:00:39.130822 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 205/350] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 12 22:00:39 2022] GET /compute/v2.1/flavors/detail => generated 6588 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:00:39.149523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dcc53d04-9d01-4216-a48f-a836ab23469a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.152319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dcc53d04-9d01-4216-a48f-a836ab23469a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:39.167340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcc53d04-9d01-4216-a48f-a836ab23469a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:39.168743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcc53d04-9d01-4216-a48f-a836ab23469a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:39.170089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcc53d04-9d01-4216-a48f-a836ab23469a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:39.171677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcc53d04-9d01-4216-a48f-a836ab23469a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:39.172364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcc53d04-9d01-4216-a48f-a836ab23469a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:39.173119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcc53d04-9d01-4216-a48f-a836ab23469a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:39.349654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dcc53d04-9d01-4216-a48f-a836ab23469a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:39.358598 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dcc53d04-9d01-4216-a48f-a836ab23469a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1505 microversion: 2.1 time: 0.220482 Oct 12 22:00:39.363712 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 206/351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:39 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:39.365235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-57d84beb-41a6-4552-82eb-ebd328c4ed91 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.375943 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-57d84beb-41a6-4552-82eb-ebd328c4ed91 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014787 Oct 12 22:00:39.377044 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 207/352] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:00:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:39.382506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3388b66e-dee1-43a8-829d-5a89864c9841 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1445918654", "id": 418950337, "os-flavor-access:is_public": "True"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:39.406147 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3388b66e-dee1-43a8-829d-5a89864c9841 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.027417 Oct 12 22:00:39.407298 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 208/353] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:39 2022] POST /compute/v2.1/flavors => generated 435 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:39.412042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-73949379-b539-4e02-8cfc-3313ca2e7e69 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.435327 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-73949379-b539-4e02-8cfc-3313ca2e7e69 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6655 microversion: 2.1 time: 0.026560 Oct 12 22:00:39.436012 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 209/354] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:39 2022] GET /compute/v2.1/flavors/detail => generated 6655 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:39.440635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-294453d5-80f2-4d8f-8452-fcbd942f4847 tempest-FlavorsV255TestJSON-1881144362 tempest-FlavorsV255TestJSON-1881144362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.476076 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-294453d5-80f2-4d8f-8452-fcbd942f4847 tempest-FlavorsV255TestJSON-1881144362 tempest-FlavorsV255TestJSON-1881144362-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3953 microversion: 2.55 time: 0.038983 Oct 12 22:00:39.478760 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 210/355] 10.222.0.16 () {60 vars in 1166 bytes} [Wed Oct 12 22:00:39 2022] GET /compute/v2.1/flavors => generated 3953 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:00:39.488390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-172c1a41-5632-48a0-8efe-4d1174d6c0e1 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.525167 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-172c1a41-5632-48a0-8efe-4d1174d6c0e1 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.045077 Oct 12 22:00:39.536807 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 211/356] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Oct 12 22:00:39 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:39.536807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7514a0db-f3c7-441a-9932-9968b6685f29 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.538950 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-7514a0db-f3c7-441a-9932-9968b6685f29 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7514a0db-f3c7-441a-9932-9968b6685f29 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Request method failure captured: Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/flavors/418950337/os-flavor-access HTTP/1.1 Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzkAyAooGFCaLMZIGbOzCrfbXCHC4V5N6fChopWzNm0qOO_UybkmJcY9Jk_QwyQ3U_624McH9M4KoFGD9mXwcIkZ5RvrR66ERNIc3IS4gUHdpzljdxn0FRrdEEJOEX4kkSJ8UuqKOhFzitOii4IB3qy5Hl9TkJ065WcvKZpgiPT1xlY Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: add93c33d1c7451aa58c0acad906b287 Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-957763472 Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:00:39.540538 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:00:39.542022 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/add93c33d1c7451aa58c0acad906b287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/add93c33d1c7451aa58c0acad906b287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_add93c33d1c7451aa58c0acad906b287", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/add93c33d1c7451aa58c0acad906b287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:39.542022 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-957763472 Oct 12 22:00:39.542022 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: add93c33d1c7451aa58c0acad906b287 Oct 12 22:00:39.542022 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-957763472 Oct 12 22:00:39.542022 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin Oct 12 22:00:39.542022 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:39.542022 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:39.542022 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6b0ae278f1ec43abbec5002acd1f567f Oct 12 22:00:39.542022 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin Oct 12 22:00:39.542022 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:00:39.542022 n-d-861111-1 devstack@n-api.service[120453]: exception: Access list not available for public flavors. Oct 12 22:00:39.542022 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'flavor_id': '418950337'} Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 12 22:00:39.542847 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:39.544271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7514a0db-f3c7-441a-9932-9968b6685f29 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:39.544488 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7514a0db-f3c7-441a-9932-9968b6685f29 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/418950337/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.016689 Oct 12 22:00:39.545144 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 212/357] 10.222.0.16 () {58 vars in 1206 bytes} [Wed Oct 12 22:00:39 2022] GET /compute/v2.1/flavors/418950337/os-flavor-access => generated 91 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:00:39.549741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-28e97163-e807-4da9-9f6d-74aac33216fc tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1928306490", "id": 1924427274, "os-flavor-access:is_public": "True"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:39.573165 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-28e97163-e807-4da9-9f6d-74aac33216fc tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.026829 Oct 12 22:00:39.579335 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 213/358] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:39 2022] POST /compute/v2.1/flavors => generated 429 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:39.588486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c0624921-5a5e-4e41-89f2-43ba08106ca2 tempest-FlavorsV255TestJSON-99731976 tempest-FlavorsV255TestJSON-99731976-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.609412 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c0624921-5a5e-4e41-89f2-43ba08106ca2 tempest-FlavorsV255TestJSON-99731976 tempest-FlavorsV255TestJSON-99731976-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/811528532" status: 202 len: 0 microversion: 2.55 time: 0.025711 Oct 12 22:00:39.610705 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 214/359] 10.222.0.16 () {60 vars in 1199 bytes} [Wed Oct 12 22:00:39 2022] DELETE /compute/v2.1/flavors/811528532 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:00:39.620264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cdb3a72e-5818-433e-856b-289a159f9082 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.633522 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cdb3a72e-5818-433e-856b-289a159f9082 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.021399 Oct 12 22:00:39.634551 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 215/360] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 12 22:00:39 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:39.639153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0ea28658-5921-4491-8d01-bd2bdcf2cbef tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.661436 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0ea28658-5921-4491-8d01-bd2bdcf2cbef tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/418950337" status: 202 len: 0 microversion: 2.1 time: 0.025519 Oct 12 22:00:39.662831 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 216/361] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 12 22:00:39 2022] DELETE /compute/v2.1/flavors/418950337 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:39.667974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b4f76d7a-6243-496f-a72d-cb938284f731 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.688783 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b4f76d7a-6243-496f-a72d-cb938284f731 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1924427274" status: 202 len: 0 microversion: 2.1 time: 0.024524 Oct 12 22:00:39.690188 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4131262c-9b4d-4ec0-8ca1-4bd8ffdd2f43 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/a9a3af56-f37a-43d3-9266-7d7a7fee9303" status: 202 len: 0 microversion: 2.1 time: 1.207279 Oct 12 22:00:39.691134 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 146/362] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:00:38 2022] DELETE /compute/v2.1/os-floating-ips/a9a3af56-f37a-43d3-9266-7d7a7fee9303 => generated 0 bytes in 1209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:39.692710 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 217/363] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 12 22:00:39 2022] DELETE /compute/v2.1/flavors/1924427274 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:39.696425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9fbbc112-3357-427e-9c79-f376825854ff tempest-FlavorsV255TestJSON-99731976 tempest-FlavorsV255TestJSON-99731976-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.699170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b7ad1b1-bc8b-437c-83d5-bbd1b38bba6f tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.711964 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8b7ad1b1-bc8b-437c-83d5-bbd1b38bba6f tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017832 Oct 12 22:00:39.715575 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 218/364] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:00:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:39.720058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a3dcf62f-c44e-4a12-9548-fe35abe327a2 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.724299 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9fbbc112-3357-427e-9c79-f376825854ff tempest-FlavorsV255TestJSON-99731976 tempest-FlavorsV255TestJSON-99731976-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6151 microversion: 2.55 time: 0.031737 Oct 12 22:00:39.725296 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 147/365] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 12 22:00:39 2022] GET /compute/v2.1/flavors/detail => generated 6151 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:00:39.730648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5bf2eb2c-7d22-4d44-b569-89468b173b31 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.755481 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a3dcf62f-c44e-4a12-9548-fe35abe327a2 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.041209 Oct 12 22:00:39.757308 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 219/366] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:39 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:39.758505 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5bf2eb2c-7d22-4d44-b569-89468b173b31 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.031959 Oct 12 22:00:39.759597 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 148/367] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:39 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:39.764160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1e552306-6c79-4537-a969-0b5f725aa7d6 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.767203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a6bbe18e-f52c-4266-9b05-46acff356eb6 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] Calling method '.version_select at 0x7f5128c2caf0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.811269 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1e552306-6c79-4537-a969-0b5f725aa7d6 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2910 microversion: 2.1 time: 0.050503 Oct 12 22:00:39.811864 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 149/368] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 12 22:00:39 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2910 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:39.817523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6ba95633-d3d6-4b66-b2e5-54cc8bf6071a tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1539190653", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:39.826932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:39.840937 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6ba95633-d3d6-4b66-b2e5-54cc8bf6071a tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.027865 Oct 12 22:00:39.841535 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 150/369] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:39 2022] POST /compute/v2.1/flavors => generated 507 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:39.846173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-522ffd4b-e0e7-4aec-8922-30723c45e401 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1282972672", "id": 1075988557, "os-flavor-access:is_public": "False"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:39.869844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-a6bbe18e-f52c-4266-9b05-46acff356eb6 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a9a3af56-f37a-43d3-9266-7d7a7fee9303 could not be found", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:00:39.870661 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-a6bbe18e-f52c-4266-9b05-46acff356eb6 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] HTTP exception thrown: Floating IP not found for ID a9a3af56-f37a-43d3-9266-7d7a7fee9303 Oct 12 22:00:39.871827 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-522ffd4b-e0e7-4aec-8922-30723c45e401 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.028774 Oct 12 22:00:39.875446 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 151/370] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:39 2022] POST /compute/v2.1/flavors => generated 439 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:39.883607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e570f190-99b1-482c-8e90-6a5008695407 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a6bbe18e-f52c-4266-9b05-46acff356eb6 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] Request method failure captured: Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-floating-ips/a9a3af56-f37a-43d3-9266-7d7a7fee9303 HTTP/1.1 Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzj-H7xnBOWLBgEbCCyApwBlo1XAdbb_5LPGQiXkU0-jlsT5g9gJFjQiqSGOYJM1avK-pihClJxNmUAuP-NjLn-YSiS8IAelPlcxLELxV1KNzqJ-x6HOtVLYkVjHLh5k6XF1xfEpLjErQOWZAO1z2Exx49ZVQE0Zgpxlvme3TGS512I Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7c422522b8364eee947eb9e6e6804dad Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FloatingIPsTestJSON-236024546 Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:00:39.886684 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:00:39.887932 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c422522b8364eee947eb9e6e6804dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c422522b8364eee947eb9e6e6804dad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7c422522b8364eee947eb9e6e6804dad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7c422522b8364eee947eb9e6e6804dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:39.887932 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FloatingIPsTestJSON-236024546 Oct 12 22:00:39.887932 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7c422522b8364eee947eb9e6e6804dad Oct 12 22:00:39.887932 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FloatingIPsTestJSON-236024546 Oct 12 22:00:39.887932 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FloatingIPsTestJSON-236024546-project Oct 12 22:00:39.887932 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:39.887932 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:39.887932 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: fb959517747f447fb388f734748592e1 Oct 12 22:00:39.887932 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FloatingIPsTestJSON-236024546-project Oct 12 22:00:39.887932 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:00:39.887932 n-d-861111-1 devstack@n-api.service[120453]: exception: Floating IP not found for ID a9a3af56-f37a-43d3-9266-7d7a7fee9303 Oct 12 22:00:39.887932 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'a9a3af56-f37a-43d3-9266-7d7a7fee9303'} Oct 12 22:00:39.887932 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:00:39.888668 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a9a3af56-f37a-43d3-9266-7d7a7fee9303 could not be found Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e95ca02e-4abc-4c83-a8f7-2f17f92cbddc'] Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a9a3af56-f37a-43d3-9266-7d7a7fee9303. Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:39.889675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a9a3af56-f37a-43d3-9266-7d7a7fee9303 Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:39.890740 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:39.895564 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a9a3af56-f37a-43d3-9266-7d7a7fee9303 Oct 12 22:00:39.895564 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:39.895564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a6bbe18e-f52c-4266-9b05-46acff356eb6 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] Returning 404 to user: Floating IP not found for ID a9a3af56-f37a-43d3-9266-7d7a7fee9303 {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:39.895564 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a6bbe18e-f52c-4266-9b05-46acff356eb6 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/a9a3af56-f37a-43d3-9266-7d7a7fee9303" status: 404 len: 111 microversion: 2.1 time: 0.130024 Oct 12 22:00:39.895564 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 220/371] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 12 22:00:39 2022] GET /compute/v2.1/os-floating-ips/a9a3af56-f37a-43d3-9266-7d7a7fee9303 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:39.895564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b0322dce-e4af-4ef8-b5f4-b0bfddf8a678 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.897507 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e570f190-99b1-482c-8e90-6a5008695407 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020948 Oct 12 22:00:39.905275 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 152/372] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:00:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:39.924857 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b0322dce-e4af-4ef8-b5f4-b0bfddf8a678 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/b814be6b-d50a-4942-bb5c-2f63320719ef" status: 202 len: 0 microversion: 2.1 time: 0.034751 Oct 12 22:00:39.925437 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 221/373] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:00:39 2022] DELETE /compute/v2.1/flavors/b814be6b-d50a-4942-bb5c-2f63320719ef => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:39.931039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7e095cb9-9c68-4a33-88a4-cacb18aa08a9 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] Calling method '.version_select at 0x7f5128dbee50>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:39.983013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-7e095cb9-9c68-4a33-88a4-cacb18aa08a9 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a9a3af56-f37a-43d3-9266-7d7a7fee9303 could not be found", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:00:39.985002 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-7e095cb9-9c68-4a33-88a4-cacb18aa08a9 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] HTTP exception thrown: Floating IP not found for ID a9a3af56-f37a-43d3-9266-7d7a7fee9303 Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7e095cb9-9c68-4a33-88a4-cacb18aa08a9 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] Request method failure captured: Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/os-floating-ips/a9a3af56-f37a-43d3-9266-7d7a7fee9303 HTTP/1.1 Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzj-H7xnBOWLBgEbCCyApwBlo1XAdbb_5LPGQiXkU0-jlsT5g9gJFjQiqSGOYJM1avK-pihClJxNmUAuP-NjLn-YSiS8IAelPlcxLELxV1KNzqJ-x6HOtVLYkVjHLh5k6XF1xfEpLjErQOWZAO1z2Exx49ZVQE0Zgpxlvme3TGS512I Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7c422522b8364eee947eb9e6e6804dad Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FloatingIPsTestJSON-236024546 Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:00:39.987460 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:00:39.989290 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c422522b8364eee947eb9e6e6804dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c422522b8364eee947eb9e6e6804dad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7c422522b8364eee947eb9e6e6804dad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7c422522b8364eee947eb9e6e6804dad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:39.989290 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FloatingIPsTestJSON-236024546 Oct 12 22:00:39.989290 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7c422522b8364eee947eb9e6e6804dad Oct 12 22:00:39.989290 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FloatingIPsTestJSON-236024546 Oct 12 22:00:39.989290 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FloatingIPsTestJSON-236024546-project Oct 12 22:00:39.989290 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:39.989290 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:39.989290 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: fb959517747f447fb388f734748592e1 Oct 12 22:00:39.989290 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FloatingIPsTestJSON-236024546-project Oct 12 22:00:39.989290 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:00:39.989290 n-d-861111-1 devstack@n-api.service[120453]: exception: Floating IP not found for ID a9a3af56-f37a-43d3-9266-7d7a7fee9303 Oct 12 22:00:39.989290 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'a9a3af56-f37a-43d3-9266-7d7a7fee9303'} Oct 12 22:00:39.989290 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:00:39.990715 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a9a3af56-f37a-43d3-9266-7d7a7fee9303 could not be found Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c12dfd5-bedc-4ff0-ad7b-55c64707196d'] Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a9a3af56-f37a-43d3-9266-7d7a7fee9303. Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:39.991842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a9a3af56-f37a-43d3-9266-7d7a7fee9303 Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:39.994332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:39.996641 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a9a3af56-f37a-43d3-9266-7d7a7fee9303 Oct 12 22:00:39.996641 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:39.998250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7e095cb9-9c68-4a33-88a4-cacb18aa08a9 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] Returning 404 to user: Floating IP not found for ID a9a3af56-f37a-43d3-9266-7d7a7fee9303 {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:39.999633 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7e095cb9-9c68-4a33-88a4-cacb18aa08a9 tempest-FloatingIPsTestJSON-236024546 tempest-FloatingIPsTestJSON-236024546-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/a9a3af56-f37a-43d3-9266-7d7a7fee9303" status: 404 len: 111 microversion: 2.1 time: 0.072677 Oct 12 22:00:40.004589 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 222/374] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:00:39 2022] DELETE /compute/v2.1/os-floating-ips/a9a3af56-f37a-43d3-9266-7d7a7fee9303 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:40.009243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cdbd32b8-f62e-498c-b1de-a2cff966dbd8 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:40.030842 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cdbd32b8-f62e-498c-b1de-a2cff966dbd8 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.027900 Oct 12 22:00:40.041311 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 223/375] 10.222.0.16 () {58 vars in 1144 bytes} [Wed Oct 12 22:00:40 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:40.053952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-58e724af-bdde-44bd-8b9d-422a35b6738a tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:40.095141 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-58e724af-bdde-44bd-8b9d-422a35b6738a tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.062261 Oct 12 22:00:40.097552 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 224/376] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:40 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:40.110257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-deb272fd-a864-4dcc-a120-9e08e5e1fab6 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:40.120054 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-deb272fd-a864-4dcc-a120-9e08e5e1fab6 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014545 Oct 12 22:00:40.121252 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 225/377] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:00:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:40.125965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-65127988-abce-40b3-b3d6-c4a40e2268b0 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1296293329", "id": "6afcb97b-9bb6-4518-ba6b-c1eb077ea732", "os-flavor-access:is_public": "True"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:40.146026 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-65127988-abce-40b3-b3d6-c4a40e2268b0 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.022857 Oct 12 22:00:40.146835 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 226/378] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:40 2022] POST /compute/v2.1/flavors => generated 507 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:40.161125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-014a2dd4-517b-4da1-b834-9dca033c0a05 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:40.177805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=9,nova_api:DELETE=15,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:40.183561 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-014a2dd4-517b-4da1-b834-9dca033c0a05 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.035436 Oct 12 22:00:40.184250 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 227/379] 10.222.0.16 () {58 vars in 1148 bytes} [Wed Oct 12 22:00:40 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:40.188798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8991125d-5362-4377-9252-4cbd753088bd tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:40.216005 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8991125d-5362-4377-9252-4cbd753088bd tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/6afcb97b-9bb6-4518-ba6b-c1eb077ea732" status: 202 len: 0 microversion: 2.1 time: 0.030345 Oct 12 22:00:40.216802 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 228/380] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:00:40 2022] DELETE /compute/v2.1/flavors/6afcb97b-9bb6-4518-ba6b-c1eb077ea732 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:40.221375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-065b2f49-4c94-441c-a3d2-7044e5821cc2 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:40.237472 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-065b2f49-4c94-441c-a3d2-7044e5821cc2 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.019593 Oct 12 22:00:40.245782 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 229/381] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 12 22:00:40 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:40.251895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-362e4815-e90a-4e2f-82b1-146b16bcc7cb tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:40.258519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49b33813-6977-4c4e-9c42-1f7c9fe8c4dc tempest-FlavorsAccessNegativeTestJSON-1733576132 tempest-FlavorsAccessNegativeTestJSON-1733576132-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b537e3867939409384e41bafff939f58"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:40.261806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-49b33813-6977-4c4e-9c42-1f7c9fe8c4dc tempest-FlavorsAccessNegativeTestJSON-1733576132 tempest-FlavorsAccessNegativeTestJSON-1733576132-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ba687c090a0d4f729910ef8f8bdd824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b537e3867939409384e41bafff939f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49b33813-6977-4c4e-9c42-1f7c9fe8c4dc tempest-FlavorsAccessNegativeTestJSON-1733576132 tempest-FlavorsAccessNegativeTestJSON-1733576132-project] Request method failure captured: Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/flavors/1075988557/action HTTP/1.1 Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 67 Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzj_ioRpWvJOju_fO13TT6XkufOfNWf6ANJgKxXh1ElPwwBnEWDsyk_icAEpH_Yw0p_Mch_GV3QDnRtSA8FZSwTP0D4S4Loud0AVzvKGwiEiFGlo8D9g4kesln5Uz81Kmq68Eh4TxyawjZ_XoIsx45V6xEurarlmEMTxUCGXF11NqjU Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: b537e3867939409384e41bafff939f58 Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1733576132 Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:00:40.266846 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:00:40.268099 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b537e3867939409384e41bafff939f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b537e3867939409384e41bafff939f58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b537e3867939409384e41bafff939f58", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b537e3867939409384e41bafff939f58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:40.268099 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1733576132 Oct 12 22:00:40.268099 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: b537e3867939409384e41bafff939f58 Oct 12 22:00:40.268099 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1733576132 Oct 12 22:00:40.268099 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-FlavorsAccessNegativeTestJSON-1733576132-project Oct 12 22:00:40.268099 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:40.268099 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:40.268099 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: ba687c090a0d4f729910ef8f8bdd824f Oct 12 22:00:40.268099 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1733576132-project Oct 12 22:00:40.268099 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:00:40.268099 n-d-861111-1 devstack@n-api.service[120452]: {"addTenantAccess": {"tenant": "b537e3867939409384e41bafff939f58"}} Oct 12 22:00:40.268099 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '1075988557', 'body': {'addTenantAccess': {'tenant': 'b537e3867939409384e41bafff939f58'}}} Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:00:40.268763 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 12 22:00:40.270237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:40.273189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49b33813-6977-4c4e-9c42-1f7c9fe8c4dc tempest-FlavorsAccessNegativeTestJSON-1733576132 tempest-FlavorsAccessNegativeTestJSON-1733576132-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:40.274237 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-49b33813-6977-4c4e-9c42-1f7c9fe8c4dc tempest-FlavorsAccessNegativeTestJSON-1733576132 tempest-FlavorsAccessNegativeTestJSON-1733576132-project] 10.222.0.16 "POST /compute/v2.1/flavors/1075988557/action" status: 403 len: 130 microversion: 2.1 time: 0.367801 Oct 12 22:00:40.275331 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 153/382] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Oct 12 22:00:39 2022] POST /compute/v2.1/flavors/1075988557/action => generated 130 bytes in 369 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:40.280521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-57d4f803-5449-4aae-9ebf-0e3f05a23326 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:40.289737 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-362e4815-e90a-4e2f-82b1-146b16bcc7cb tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.049549 Oct 12 22:00:40.290059 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-57d4f803-5449-4aae-9ebf-0e3f05a23326 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013080 Oct 12 22:00:40.290521 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 230/383] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:40 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:40.298490 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 154/384] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:00:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:40.302312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a2e85f9d-c1e6-4938-bc8f-bc5a375747a8 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:40.309426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-554af51a-5406-44f2-92a7-b40614eed8d8 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:40.331979 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-554af51a-5406-44f2-92a7-b40614eed8d8 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1539 microversion: 2.1 time: 0.031778 Oct 12 22:00:40.347319 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a2e85f9d-c1e6-4938-bc8f-bc5a375747a8 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1075988557" status: 202 len: 0 microversion: 2.1 time: 0.051487 Oct 12 22:00:40.347319 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 231/385] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 12 22:00:40 2022] DELETE /compute/v2.1/flavors/1075988557 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:40.348114 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 155/386] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:40 2022] GET /compute/v2.1/flavors?marker=452 => generated 1539 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:40.356279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0ca9dba5-471a-41cb-8ef0-3196e547066a tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1268062759", "id": 997006, "os-flavor-access:is_public": "True"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:40.365575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-169ebcfa-b5eb-4bff-b0d5-3521fe578e0e tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:40.400537 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0ca9dba5-471a-41cb-8ef0-3196e547066a tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.1 time: 0.047586 Oct 12 22:00:40.403120 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 232/387] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:40.410343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0b6f5d9f-06c9-457d-b4ee-54a0d66496a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:40.413393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0b6f5d9f-06c9-457d-b4ee-54a0d66496a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:40.420501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b6f5d9f-06c9-457d-b4ee-54a0d66496a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:40.421223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b6f5d9f-06c9-457d-b4ee-54a0d66496a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:40.421845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b6f5d9f-06c9-457d-b4ee-54a0d66496a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:40.422759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b6f5d9f-06c9-457d-b4ee-54a0d66496a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:40.423428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b6f5d9f-06c9-457d-b4ee-54a0d66496a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:40.424054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b6f5d9f-06c9-457d-b4ee-54a0d66496a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:40.433009 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-169ebcfa-b5eb-4bff-b0d5-3521fe578e0e tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6207 microversion: 2.1 time: 0.083301 Oct 12 22:00:40.435053 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 156/388] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:40 2022] GET /compute/v2.1/flavors/detail => generated 6207 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:40.439473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-219d6132-001b-4c13-94f5-9b62da0e9b0b tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:40.446020 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-219d6132-001b-4c13-94f5-9b62da0e9b0b tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/997006" status: 200 len: 402 microversion: 2.1 time: 0.009920 Oct 12 22:00:40.447076 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 157/389] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:40 2022] GET /compute/v2.1/flavors/997006 => generated 402 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:40.458068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9ecf0525-22b3-4d35-97d1-ac51f9cc81ad tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:40.494434 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9ecf0525-22b3-4d35-97d1-ac51f9cc81ad tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6207 microversion: 2.1 time: 0.045695 Oct 12 22:00:40.495433 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 158/390] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:40 2022] GET /compute/v2.1/flavors/detail => generated 6207 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:40.502177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e262d3d0-350c-4af3-99a7-45bbf8176cba tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2128682204", "id": 1803839383, "os-flavor-access:is_public": "False"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:40.530592 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e262d3d0-350c-4af3-99a7-45bbf8176cba tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.033125 Oct 12 22:00:40.531716 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 159/391] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:40 2022] POST /compute/v2.1/flavors => generated 439 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:40.674492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0b6f5d9f-06c9-457d-b4ee-54a0d66496a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:40.689839 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0b6f5d9f-06c9-457d-b4ee-54a0d66496a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1505 microversion: 2.1 time: 0.284529 Oct 12 22:00:40.703348 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 233/392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:40 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1505 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:40.703348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c9fd694b-88d5-4f04-b742-50a7cc2b47c8 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:40.708333 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c9fd694b-88d5-4f04-b742-50a7cc2b47c8 tempest-FlavorsV2TestJSON-284694434 tempest-FlavorsV2TestJSON-284694434-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013914 Oct 12 22:00:40.708333 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 234/393] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:00:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:40.715569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2bf2b26b-0010-4d43-bb93-52159010c18d tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b537e3867939409384e41bafff939f58"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:40.881759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1f0cba46-a22a-4818-b997-c20701a94a49 tempest-FlavorsAdminTestJSON-50423230 tempest-FlavorsAdminTestJSON-50423230-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:40.915757 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1f0cba46-a22a-4818-b997-c20701a94a49 tempest-FlavorsAdminTestJSON-50423230 tempest-FlavorsAdminTestJSON-50423230-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6207 microversion: 2.1 time: 0.382658 Oct 12 22:00:40.917983 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 160/394] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:40 2022] GET /compute/v2.1/flavors/detail => generated 6207 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:40.936741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0c096e80-a12d-4815-9bff-0aac104a3a9c tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:40.962377 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0c096e80-a12d-4815-9bff-0aac104a3a9c tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/997006" status: 202 len: 0 microversion: 2.1 time: 0.029485 Oct 12 22:00:40.965138 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 161/395] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 12 22:00:40 2022] DELETE /compute/v2.1/flavors/997006 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:00:40.978345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4f3353a8-be9c-4f9e-9b90-3a99c8380648 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:41.020678 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4f3353a8-be9c-4f9e-9b90-3a99c8380648 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.052249 Oct 12 22:00:41.023207 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 162/396] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:40 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:41.061281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-92dcabf2-8bfc-4019-9657-48c4556e4692 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-601122248", "id": 665112512, "os-flavor-access:is_public": "False"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:41.092052 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-92dcabf2-8bfc-4019-9657-48c4556e4692 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.049241 Oct 12 22:00:41.093163 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 163/397] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:41 2022] POST /compute/v2.1/flavors => generated 426 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:00:41.099654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-ed301d21-9450-4149-832c-1e31c6f00f18 req-50865895-07f9-4050-904e-22fcb709bc56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1701358b-ffd8-442b-add8-6fa9581ceaa4", "tag": "0bf1a6c0-d01b-4b06-ae76-9244a6b48643"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:41.113437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ed301d21-9450-4149-832c-1e31c6f00f18 req-50865895-07f9-4050-904e-22fcb709bc56 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:41.114712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ed301d21-9450-4149-832c-1e31c6f00f18 req-50865895-07f9-4050-904e-22fcb709bc56 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:41.115382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ed301d21-9450-4149-832c-1e31c6f00f18 req-50865895-07f9-4050-904e-22fcb709bc56 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:41.134731 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-ed301d21-9450-4149-832c-1e31c6f00f18 req-50865895-07f9-4050-904e-22fcb709bc56 service nova] Creating event network-changed:0bf1a6c0-d01b-4b06-ae76-9244a6b48643 for instance 1701358b-ffd8-442b-add8-6fa9581ceaa4 on n-h1-861111-1 Oct 12 22:00:41.147316 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-ed301d21-9450-4149-832c-1e31c6f00f18 req-50865895-07f9-4050-904e-22fcb709bc56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052541 Oct 12 22:00:41.148491 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 164/398] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:41.155917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0bf54fe9-55e9-4222-9bff-95f6111a6db6 tempest-FlavorsAdminTestJSON-50423230 tempest-FlavorsAdminTestJSON-50423230-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "665112512"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:41.174937 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-0bf54fe9-55e9-4222-9bff-95f6111a6db6 tempest-FlavorsAdminTestJSON-50423230 tempest-FlavorsAdminTestJSON-50423230-project] HTTP exception thrown: Flavor 665112512 could not be found. Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0bf54fe9-55e9-4222-9bff-95f6111a6db6 tempest-FlavorsAdminTestJSON-50423230 tempest-FlavorsAdminTestJSON-50423230-project] Request method failure captured: Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 106 Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzkBamijtGpwjyAvm23mSVrycnJSMP2oyA4AmmCS8A7HfoaxlJYJ02bSa6eGXQZyb91loXyh10PWPYbIOIBi0XQM2zXvKKwjHxZSJpEQ0fyO3C62t372wqqmf4v-kjST_vqId2vy_OYSQQQeFazdwWHM7_8jF9XbERe_NO-yz8OAMt4 Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ae5408f2a6d64fde8a3e738485b42c94 Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-FlavorsAdminTestJSON-50423230 Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:00:41.181938 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:00:41.183529 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae5408f2a6d64fde8a3e738485b42c94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae5408f2a6d64fde8a3e738485b42c94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ae5408f2a6d64fde8a3e738485b42c94", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ae5408f2a6d64fde8a3e738485b42c94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:41.183529 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-FlavorsAdminTestJSON-50423230 Oct 12 22:00:41.183529 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ae5408f2a6d64fde8a3e738485b42c94 Oct 12 22:00:41.183529 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-50423230 Oct 12 22:00:41.183529 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-FlavorsAdminTestJSON-50423230-project Oct 12 22:00:41.183529 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:41.183529 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:41.183529 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 62ccbb9721354b139cadacf485103051 Oct 12 22:00:41.183529 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-FlavorsAdminTestJSON-50423230-project Oct 12 22:00:41.183529 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:00:41.183529 n-d-861111-1 devstack@n-api.service[120452]: {"server": {"name": "test", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "665112512"}} Oct 12 22:00:41.183529 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:00:41.183529 n-d-861111-1 devstack@n-api.service[120452]: exception: Flavor 665112512 could not be found. Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '665112512'}}} Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 665112512 could not be found. Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:41.184828 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 665112512 could not be found. Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:41.186192 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:41.188140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:41.188140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:41.188140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:41.188140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 665112512 could not be found. Oct 12 22:00:41.188140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:41.188140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0bf54fe9-55e9-4222-9bff-95f6111a6db6 tempest-FlavorsAdminTestJSON-50423230 tempest-FlavorsAdminTestJSON-50423230-project] Returning 400 to user: Flavor 665112512 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:41.188709 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0bf54fe9-55e9-4222-9bff-95f6111a6db6 tempest-FlavorsAdminTestJSON-50423230 tempest-FlavorsAdminTestJSON-50423230-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.035646 Oct 12 22:00:41.189305 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 165/399] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:41 2022] POST /compute/v2.1/servers => generated 80 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:00:41.198489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-07e51748-20ca-42f0-9c61-e61e902ba6b9 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:41.223524 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-07e51748-20ca-42f0-9c61-e61e902ba6b9 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/665112512" status: 202 len: 0 microversion: 2.1 time: 0.029789 Oct 12 22:00:41.227732 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 166/400] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 12 22:00:41 2022] DELETE /compute/v2.1/flavors/665112512 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:41.236916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9c1d0f75-b44f-4c4c-a228-8672acee7f87 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:41.247675 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2bf2b26b-0010-4d43-bb93-52159010c18d tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1803839383/action" status: 200 len: 97 microversion: 2.1 time: 0.535260 Oct 12 22:00:41.250238 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 235/401] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Oct 12 22:00:40 2022] POST /compute/v2.1/flavors/1803839383/action => generated 97 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:00:41.265718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4bdfe2bd-9f1f-4b6b-892f-2902a6735c47 tempest-FlavorsAccessNegativeTestJSON-1733576132 tempest-FlavorsAccessNegativeTestJSON-1733576132-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b537e3867939409384e41bafff939f58"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:41.274199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4bdfe2bd-9f1f-4b6b-892f-2902a6735c47 tempest-FlavorsAccessNegativeTestJSON-1733576132 tempest-FlavorsAccessNegativeTestJSON-1733576132-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ba687c090a0d4f729910ef8f8bdd824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b537e3867939409384e41bafff939f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4bdfe2bd-9f1f-4b6b-892f-2902a6735c47 tempest-FlavorsAccessNegativeTestJSON-1733576132 tempest-FlavorsAccessNegativeTestJSON-1733576132-project] Request method failure captured: Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/flavors/1803839383/action HTTP/1.1 Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 70 Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzj_ioRpWvJOju_fO13TT6XkufOfNWf6ANJgKxXh1ElPwwBnEWDsyk_icAEpH_Yw0p_Mch_GV3QDnRtSA8FZSwTP0D4S4Loud0AVzvKGwiEiFGlo8D9g4kesln5Uz81Kmq68Eh4TxyawjZ_XoIsx45V6xEurarlmEMTxUCGXF11NqjU Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: b537e3867939409384e41bafff939f58 Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1733576132 Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:00:41.278013 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:00:41.279263 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b537e3867939409384e41bafff939f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b537e3867939409384e41bafff939f58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b537e3867939409384e41bafff939f58", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b537e3867939409384e41bafff939f58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:41.279263 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1733576132 Oct 12 22:00:41.279263 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: b537e3867939409384e41bafff939f58 Oct 12 22:00:41.279263 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1733576132 Oct 12 22:00:41.279263 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FlavorsAccessNegativeTestJSON-1733576132-project Oct 12 22:00:41.279263 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:41.279263 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:41.279263 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: ba687c090a0d4f729910ef8f8bdd824f Oct 12 22:00:41.279263 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1733576132-project Oct 12 22:00:41.279263 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:00:41.279263 n-d-861111-1 devstack@n-api.service[120453]: {"removeTenantAccess": {"tenant": "b537e3867939409384e41bafff939f58"}} Oct 12 22:00:41.279263 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1803839383', 'body': {'removeTenantAccess': {'tenant': 'b537e3867939409384e41bafff939f58'}}} Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi context.can( Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:00:41.279915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 12 22:00:41.281470 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:41.282456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4bdfe2bd-9f1f-4b6b-892f-2902a6735c47 tempest-FlavorsAccessNegativeTestJSON-1733576132 tempest-FlavorsAccessNegativeTestJSON-1733576132-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:41.282456 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4bdfe2bd-9f1f-4b6b-892f-2902a6735c47 tempest-FlavorsAccessNegativeTestJSON-1733576132 tempest-FlavorsAccessNegativeTestJSON-1733576132-project] 10.222.0.16 "POST /compute/v2.1/flavors/1803839383/action" status: 403 len: 133 microversion: 2.1 time: 0.025207 Oct 12 22:00:41.282456 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 236/402] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Oct 12 22:00:41 2022] POST /compute/v2.1/flavors/1803839383/action => generated 133 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:41.283952 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9c1d0f75-b44f-4c4c-a228-8672acee7f87 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.051708 Oct 12 22:00:41.286203 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 167/403] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:41 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:41.292934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f388e4cf-d256-486c-9ccd-543d5249f8b4 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b537e3867939409384e41bafff939f58"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:41.306955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b434544c-097f-49c9-bb24-355890914397 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1415456317", "id": 672434419, "os-flavor-access:is_public": "False"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:41.340421 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b434544c-097f-49c9-bb24-355890914397 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.037931 Oct 12 22:00:41.341082 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 168/404] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:41 2022] POST /compute/v2.1/flavors => generated 412 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:41.356670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-94bf3579-eb05-4d55-86e3-d45f4e6a4768 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2036238249", "id": 15227371, "os-flavor-access:is_public": "True"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:41.389711 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-94bf3579-eb05-4d55-86e3-d45f4e6a4768 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.038669 Oct 12 22:00:41.390706 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 169/405] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:41.406010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4e57f66c-cc41-4f2d-8687-4b82ce859a46 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:41.439471 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4e57f66c-cc41-4f2d-8687-4b82ce859a46 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 844 microversion: 2.1 time: 0.040124 Oct 12 22:00:41.440544 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 170/406] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Oct 12 22:00:41 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 844 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:41.454972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-67cecc08-02f5-451c-ab64-aa5b76010980 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:41.469588 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-67cecc08-02f5-451c-ab64-aa5b76010980 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 844 microversion: 2.1 time: 0.019032 Oct 12 22:00:41.470428 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 171/407] 10.222.0.16 () {58 vars in 1177 bytes} [Wed Oct 12 22:00:41 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 844 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:41.487102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-065e6891-d80b-446e-a08e-35b0529a26b2 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:41.503160 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-065e6891-d80b-446e-a08e-35b0529a26b2 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 844 microversion: 2.1 time: 0.020634 Oct 12 22:00:41.513143 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 172/408] 10.222.0.16 () {58 vars in 1171 bytes} [Wed Oct 12 22:00:41 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 844 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:00:41.517723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-587b2002-74d4-4d55-9da2-710669e23a58 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:41.540066 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-587b2002-74d4-4d55-9da2-710669e23a58 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 844 microversion: 2.1 time: 0.019531 Oct 12 22:00:41.543445 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 173/409] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Oct 12 22:00:41 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 844 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:41.556456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e5427089-5848-4c30-ab28-695d747726c5 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:41.583784 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e5427089-5848-4c30-ab28-695d747726c5 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6213 microversion: 2.1 time: 0.032725 Oct 12 22:00:41.584701 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 174/410] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Oct 12 22:00:41 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6213 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:41.607863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-56a64915-ea58-4372-899e-76c68d6c3f1f tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:41.635301 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-56a64915-ea58-4372-899e-76c68d6c3f1f tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6213 microversion: 2.1 time: 0.032362 Oct 12 22:00:41.636586 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 175/411] 10.222.0.16 () {58 vars in 1175 bytes} [Wed Oct 12 22:00:41 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6213 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:00:41.657582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3e97d35e-9a35-4ce2-b97d-1518b4282d8d tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:41.694727 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3e97d35e-9a35-4ce2-b97d-1518b4282d8d tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6213 microversion: 2.1 time: 0.042300 Oct 12 22:00:41.697991 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 176/412] 10.222.0.16 () {58 vars in 1173 bytes} [Wed Oct 12 22:00:41 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6213 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:00:41.726406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4824a131-7a6e-4897-a127-effc071de295 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:41.727213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4824a131-7a6e-4897-a127-effc071de295 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:41.740572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4824a131-7a6e-4897-a127-effc071de295 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:41.741567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4824a131-7a6e-4897-a127-effc071de295 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:41.742013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4824a131-7a6e-4897-a127-effc071de295 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:41.742992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4824a131-7a6e-4897-a127-effc071de295 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:41.746450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4824a131-7a6e-4897-a127-effc071de295 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:41.748100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4824a131-7a6e-4897-a127-effc071de295 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:41.905676 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f388e4cf-d256-486c-9ccd-543d5249f8b4 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1803839383/action" status: 200 len: 21 microversion: 2.1 time: 0.616990 Oct 12 22:00:41.910138 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 237/413] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Oct 12 22:00:41 2022] POST /compute/v2.1/flavors/1803839383/action => generated 21 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:00:41.918838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4e32e4f0-5aee-496c-8092-a1909d9dac89 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:41.945034 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4e32e4f0-5aee-496c-8092-a1909d9dac89 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6213 microversion: 2.1 time: 0.033212 Oct 12 22:00:41.945986 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 238/414] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Oct 12 22:00:41 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6213 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:41.967722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8e01c09e-67bf-4b49-8d4d-df127f8bb761 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:41.991098 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8e01c09e-67bf-4b49-8d4d-df127f8bb761 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1803839383" status: 202 len: 0 microversion: 2.1 time: 0.043890 Oct 12 22:00:41.995649 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 239/415] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 12 22:00:41 2022] DELETE /compute/v2.1/flavors/1803839383 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:42.007999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4abb02a8-09ef-4717-a590-994861a68124 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:42.056093 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4abb02a8-09ef-4717-a590-994861a68124 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/15227371" status: 202 len: 0 microversion: 2.1 time: 0.058461 Oct 12 22:00:42.061609 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 240/416] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 12 22:00:41 2022] DELETE /compute/v2.1/flavors/15227371 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:42.071129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-002932d6-2c63-4d9b-9964-15c3e68c5df0 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:42.100895 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-002932d6-2c63-4d9b-9964-15c3e68c5df0 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.037596 Oct 12 22:00:42.102030 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 241/417] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:42 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:42.110524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dab23585-f5c8-4d7f-9b6e-ecb4c8c7b694 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:42.137993 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dab23585-f5c8-4d7f-9b6e-ecb4c8c7b694 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.034238 Oct 12 22:00:42.139205 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 242/418] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:42 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:42.144245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3390803b-4a3f-424d-82b7-e7fe8a74404a tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-498855375", "id": 2138670920, "os-flavor-access:is_public": "False"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:42.167487 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3390803b-4a3f-424d-82b7-e7fe8a74404a tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.026611 Oct 12 22:00:42.168877 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 243/419] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:42 2022] POST /compute/v2.1/flavors => generated 438 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:42.174758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-528ccbeb-c7ba-4d3c-99d5-bc6186f50b7d tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:42.196388 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-528ccbeb-c7ba-4d3c-99d5-bc6186f50b7d tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/672434419" status: 202 len: 0 microversion: 2.1 time: 0.026031 Oct 12 22:00:42.200586 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 244/420] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 12 22:00:42 2022] DELETE /compute/v2.1/flavors/672434419 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:42.206061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e11b052-d50b-4d24-8d29-3ec1989121ce tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "705015c52e2146ac82f4c544ce4ae634"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:42.416681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=18 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:42.503329 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-9e11b052-d50b-4d24-8d29-3ec1989121ce tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] HTTP exception thrown: Flavor access not found for 36 / 705015c52e2146ac82f4c544ce4ae634 combination. Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e11b052-d50b-4d24-8d29-3ec1989121ce tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Request method failure captured: Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/flavors/2138670920/action HTTP/1.1 Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 70 Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzkAyAooGFCaLMZIGbOzCrfbXCHC4V5N6fChopWzNm0qOO_UybkmJcY9Jk_QwyQ3U_624McH9M4KoFGD9mXwcIkZ5RvrR66ERNIc3IS4gUHdpzljdxn0FRrdEEJOEX4kkSJ8UuqKOhFzitOii4IB3qy5Hl9TkJ065WcvKZpgiPT1xlY Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: add93c33d1c7451aa58c0acad906b287 Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-957763472 Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:00:42.506535 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:00:42.508395 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/add93c33d1c7451aa58c0acad906b287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/add93c33d1c7451aa58c0acad906b287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_add93c33d1c7451aa58c0acad906b287", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/add93c33d1c7451aa58c0acad906b287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:42.508395 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-957763472 Oct 12 22:00:42.508395 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: add93c33d1c7451aa58c0acad906b287 Oct 12 22:00:42.508395 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-957763472 Oct 12 22:00:42.508395 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin Oct 12 22:00:42.508395 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:42.508395 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:42.508395 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6b0ae278f1ec43abbec5002acd1f567f Oct 12 22:00:42.508395 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin Oct 12 22:00:42.508395 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:00:42.508395 n-d-861111-1 devstack@n-api.service[120453]: {"removeTenantAccess": {"tenant": "705015c52e2146ac82f4c544ce4ae634"}} Oct 12 22:00:42.508395 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: exception: Flavor access not found for 36 / 705015c52e2146ac82f4c544ce4ae634 combination. Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '2138670920', 'body': {'removeTenantAccess': {'tenant': '705015c52e2146ac82f4c544ce4ae634'}}} Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 12 22:00:42.509287 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 36 / 705015c52e2146ac82f4c544ce4ae634 combination. Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 36 / 705015c52e2146ac82f4c544ce4ae634 combination. Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:42.514199 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:42.516615 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:42.516615 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:42.516615 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:42.516615 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:42.516615 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 36 / 705015c52e2146ac82f4c544ce4ae634 combination. Oct 12 22:00:42.516615 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:42.519074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e11b052-d50b-4d24-8d29-3ec1989121ce tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Returning 404 to user: Flavor access not found for 36 / 705015c52e2146ac82f4c544ce4ae634 combination. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:42.520921 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9e11b052-d50b-4d24-8d29-3ec1989121ce tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/2138670920/action" status: 404 len: 124 microversion: 2.1 time: 0.319071 Oct 12 22:00:42.522040 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 245/421] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Oct 12 22:00:42 2022] POST /compute/v2.1/flavors/2138670920/action => generated 124 bytes in 321 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:42.530008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3a4302f5-ccce-472d-b630-61f5241f7197 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:42.560077 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3a4302f5-ccce-472d-b630-61f5241f7197 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.036733 Oct 12 22:00:42.560655 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 246/422] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:42 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:42.572707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e175e18b-c0b0-416f-a8c6-da3ba8ccf9ab tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:42.599720 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e175e18b-c0b0-416f-a8c6-da3ba8ccf9ab tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2138670920" status: 202 len: 0 microversion: 2.1 time: 0.037676 Oct 12 22:00:42.603621 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 247/423] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 12 22:00:42 2022] DELETE /compute/v2.1/flavors/2138670920 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:42.605417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4824a131-7a6e-4897-a127-effc071de295 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:42.608918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2a856d95-a089-43cf-83cf-f7c464187933 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-477704840", "id": 1131815075, "os-flavor-access:is_public": "False"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:42.618169 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4824a131-7a6e-4897-a127-effc071de295 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1505 microversion: 2.1 time: 0.901139 Oct 12 22:00:42.640205 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 177/424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:41 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1505 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:42.652007 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2a856d95-a089-43cf-83cf-f7c464187933 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.046048 Oct 12 22:00:42.654683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f3d2b239-c6c2-459a-8e88-c01c206b4bf9 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:42.660912 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 248/425] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:42 2022] POST /compute/v2.1/flavors => generated 414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:42.665786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-317d8ed8-baaf-4a71-b546-baf065824065 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:42.691378 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-317d8ed8-baaf-4a71-b546-baf065824065 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.028363 Oct 12 22:00:42.692962 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 249/426] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:42 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:42.715476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-32505a0b-e2d9-428e-9b9c-1a21148a4020 tempest-FlavorsAdminTestJSON-50423230 tempest-FlavorsAdminTestJSON-50423230-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:42.738079 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f3d2b239-c6c2-459a-8e88-c01c206b4bf9 tempest-FlavorsAccessNegativeTestJSON-957763472 tempest-FlavorsAccessNegativeTestJSON-957763472-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.093137 Oct 12 22:00:42.740055 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 178/427] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:42 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:42.750401 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-32505a0b-e2d9-428e-9b9c-1a21148a4020 tempest-FlavorsAdminTestJSON-50423230 tempest-FlavorsAdminTestJSON-50423230-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.041679 Oct 12 22:00:42.750983 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 250/428] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:42 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:00:42.783175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e98bce44-af79-4c5a-826c-13fb26b6e4a8 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:42.834741 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e98bce44-af79-4c5a-826c-13fb26b6e4a8 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1131815075" status: 202 len: 0 microversion: 2.1 time: 0.056562 Oct 12 22:00:42.836682 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 179/429] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 12 22:00:42 2022] DELETE /compute/v2.1/flavors/1131815075 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:42.843513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4a27501c-0d70-4ab2-be0f-bed77568521c tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:42.880438 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4a27501c-0d70-4ab2-be0f-bed77568521c tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.040266 Oct 12 22:00:42.885375 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 251/430] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:42 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:42.907704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ed52578a-d6af-43d5-865c-b37ebc57cbb8 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1020633480", "id": 257412098, "os-flavor-access:is_public": "True"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:42.936396 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ed52578a-d6af-43d5-865c-b37ebc57cbb8 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.034217 Oct 12 22:00:42.937488 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 180/431] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:42 2022] POST /compute/v2.1/flavors => generated 411 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:42.949864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c6bae306-09d3-4b09-82a6-1d227668351e tempest-FlavorsAdminTestJSON-50423230 tempest-FlavorsAdminTestJSON-50423230-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:42.984370 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c6bae306-09d3-4b09-82a6-1d227668351e tempest-FlavorsAdminTestJSON-50423230 tempest-FlavorsAdminTestJSON-50423230-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6216 microversion: 2.1 time: 0.038225 Oct 12 22:00:42.984970 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 252/432] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:42 2022] GET /compute/v2.1/flavors/detail => generated 6216 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:43.004619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-75363b77-2efb-4f05-8e02-292ef4cacf72 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:43.024525 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-75363b77-2efb-4f05-8e02-292ef4cacf72 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/257412098" status: 202 len: 0 microversion: 2.1 time: 0.023933 Oct 12 22:00:43.025659 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 181/433] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 12 22:00:42 2022] DELETE /compute/v2.1/flavors/257412098 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:00:43.034284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-08c2425a-babe-4b37-9ab5-d89f823ccfd9 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:43.072802 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-08c2425a-babe-4b37-9ab5-d89f823ccfd9 tempest-FlavorsAdminTestJSON-733841235 tempest-FlavorsAdminTestJSON-733841235-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.042341 Oct 12 22:00:43.078652 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 253/434] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:43 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:43.648018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a9d1fcdd-1952-4170-b85b-48b5da23bafa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:43.655195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a9d1fcdd-1952-4170-b85b-48b5da23bafa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:43.691224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9d1fcdd-1952-4170-b85b-48b5da23bafa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:43.693090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9d1fcdd-1952-4170-b85b-48b5da23bafa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:43.693783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9d1fcdd-1952-4170-b85b-48b5da23bafa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:43.696155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9d1fcdd-1952-4170-b85b-48b5da23bafa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:43.696838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9d1fcdd-1952-4170-b85b-48b5da23bafa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:43.698791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9d1fcdd-1952-4170-b85b-48b5da23bafa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:43.978614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a9d1fcdd-1952-4170-b85b-48b5da23bafa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:43.987893 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a9d1fcdd-1952-4170-b85b-48b5da23bafa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1505 microversion: 2.1 time: 0.348148 Oct 12 22:00:44.007040 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 182/435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:43 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:45.012038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d3ce6688-b91f-4805-8f9d-e60c64f4752d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:45.012637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d3ce6688-b91f-4805-8f9d-e60c64f4752d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:45.030724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3ce6688-b91f-4805-8f9d-e60c64f4752d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:45.031217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3ce6688-b91f-4805-8f9d-e60c64f4752d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:45.031918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3ce6688-b91f-4805-8f9d-e60c64f4752d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:45.032611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3ce6688-b91f-4805-8f9d-e60c64f4752d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:45.033253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3ce6688-b91f-4805-8f9d-e60c64f4752d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:45.033672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3ce6688-b91f-4805-8f9d-e60c64f4752d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:45.265854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d3ce6688-b91f-4805-8f9d-e60c64f4752d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:45.276584 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d3ce6688-b91f-4805-8f9d-e60c64f4752d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1505 microversion: 2.1 time: 0.268576 Oct 12 22:00:45.277467 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 254/436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:45 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1505 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:45.969663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49e3465e-905c-4eab-97c8-361415ec637e tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Calling method '.version_select at 0x7f5128978a60>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:46.011002 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-49e3465e-905c-4eab-97c8-361415ec637e tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] HTTP exception thrown: Image not found. Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49e3465e-905c-4eab-97c8-361415ec637e tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Request method failure captured: Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/images/777a546e-2a5b-4b50-81ef-b748ddc73459/metadata/os_distro HTTP/1.1 Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzkNGW01zsYSho1f-sDIN6VPPP8dzN0P6RJS1pnPHoiOMNGudHsr83cianCj5nPSTQNYs69KntZRnPMiUx0HeUCa_SNXfhedi7m1vKDWsd25umHtPLFv2k68s_-jzLvOLSuWcU9jtZf8dyiUHQ84eHDK3Kody0bFXG79-Gct8rt0Kpw Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: b57ea248557a4765ba8e4d7b7519d8b4 Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:00:46.020591 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:00:46.021819 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b57ea248557a4765ba8e4d7b7519d8b4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:46.021819 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.021819 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: b57ea248557a4765ba8e4d7b7519d8b4 Oct 12 22:00:46.021819 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.021819 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ImagesMetadataNegativeTestJSON-829891498-project Oct 12 22:00:46.021819 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:46.021819 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:46.021819 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: a665e75c0d1e4df8b6c2963ebc8e39ca Oct 12 22:00:46.021819 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-829891498-project Oct 12 22:00:46.021819 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:00:46.021819 n-d-861111-1 devstack@n-api.service[120452]: exception: Image not found. Oct 12 22:00:46.021819 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'image_id': '777a546e-2a5b-4b50-81ef-b748ddc73459', 'id': 'os_distro'} Oct 12 22:00:46.021819 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:00:46.022580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 777a546e-2a5b-4b50-81ef-b748ddc73459 Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:00:46.023628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 777a546e-2a5b-4b50-81ef-b748ddc73459 could not be found. Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:00:46.025345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.026562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49e3465e-905c-4eab-97c8-361415ec637e tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Returning 404 to user: Image not found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:46.027796 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-49e3465e-905c-4eab-97c8-361415ec637e tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] 10.222.0.16 "DELETE /compute/v2.1/images/777a546e-2a5b-4b50-81ef-b748ddc73459/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.722558 Oct 12 22:00:46.027796 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 183/437] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 12 22:00:45 2022] DELETE /compute/v2.1/images/777a546e-2a5b-4b50-81ef-b748ddc73459/metadata/os_distro => generated 62 bytes in 724 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:00:46.032994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5b8cf33d-5562-4177-aecd-14432afec570 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Calling method '.version_select at 0x7f51287ceaf0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:46.076722 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-5b8cf33d-5562-4177-aecd-14432afec570 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] HTTP exception thrown: Image not found. Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5b8cf33d-5562-4177-aecd-14432afec570 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Request method failure captured: Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/images/124e2465-038b-45de-8f57-73ab17bd7a3b/metadata/os_version HTTP/1.1 Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzkNGW01zsYSho1f-sDIN6VPPP8dzN0P6RJS1pnPHoiOMNGudHsr83cianCj5nPSTQNYs69KntZRnPMiUx0HeUCa_SNXfhedi7m1vKDWsd25umHtPLFv2k68s_-jzLvOLSuWcU9jtZf8dyiUHQ84eHDK3Kody0bFXG79-Gct8rt0Kpw Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: b57ea248557a4765ba8e4d7b7519d8b4 Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:00:46.080761 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:00:46.082290 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b57ea248557a4765ba8e4d7b7519d8b4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:46.082290 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.082290 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: b57ea248557a4765ba8e4d7b7519d8b4 Oct 12 22:00:46.082290 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.082290 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesMetadataNegativeTestJSON-829891498-project Oct 12 22:00:46.082290 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:46.082290 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:46.082290 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a665e75c0d1e4df8b6c2963ebc8e39ca Oct 12 22:00:46.082290 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-829891498-project Oct 12 22:00:46.082290 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:00:46.082290 n-d-861111-1 devstack@n-api.service[120453]: exception: Image not found. Oct 12 22:00:46.082290 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'image_id': '124e2465-038b-45de-8f57-73ab17bd7a3b', 'id': 'os_version'} Oct 12 22:00:46.082290 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:00:46.083159 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 124e2465-038b-45de-8f57-73ab17bd7a3b Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:00:46.084370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 124e2465-038b-45de-8f57-73ab17bd7a3b could not be found. Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:00:46.086166 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.087497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5b8cf33d-5562-4177-aecd-14432afec570 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Returning 404 to user: Image not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:46.096677 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5b8cf33d-5562-4177-aecd-14432afec570 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] 10.222.0.16 "GET /compute/v2.1/images/124e2465-038b-45de-8f57-73ab17bd7a3b/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.056417 Oct 12 22:00:46.096677 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 255/438] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 12 22:00:46 2022] GET /compute/v2.1/images/124e2465-038b-45de-8f57-73ab17bd7a3b/metadata/os_version => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:00:46.099364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0107d171-afe6-4843-91e8-8619047cd8d6 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Calling method '.version_select at 0x7f512899f160>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:46.126813 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-0107d171-afe6-4843-91e8-8619047cd8d6 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] HTTP exception thrown: Image not found. Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0107d171-afe6-4843-91e8-8619047cd8d6 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Request method failure captured: Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/images/47a0eca7-08e4-4c7e-8e9f-8e0a70bf4687/metadata HTTP/1.1 Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzkNGW01zsYSho1f-sDIN6VPPP8dzN0P6RJS1pnPHoiOMNGudHsr83cianCj5nPSTQNYs69KntZRnPMiUx0HeUCa_SNXfhedi7m1vKDWsd25umHtPLFv2k68s_-jzLvOLSuWcU9jtZf8dyiUHQ84eHDK3Kody0bFXG79-Gct8rt0Kpw Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: b57ea248557a4765ba8e4d7b7519d8b4 Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:00:46.128875 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:00:46.130068 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b57ea248557a4765ba8e4d7b7519d8b4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:46.130068 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.130068 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: b57ea248557a4765ba8e4d7b7519d8b4 Oct 12 22:00:46.130068 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.130068 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ImagesMetadataNegativeTestJSON-829891498-project Oct 12 22:00:46.130068 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:46.130068 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:46.130068 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: a665e75c0d1e4df8b6c2963ebc8e39ca Oct 12 22:00:46.130068 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-829891498-project Oct 12 22:00:46.130068 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:00:46.130068 n-d-861111-1 devstack@n-api.service[120452]: exception: Image not found. Oct 12 22:00:46.130068 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'image_id': '47a0eca7-08e4-4c7e-8e9f-8e0a70bf4687'} Oct 12 22:00:46.130068 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:00:46.135145 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 47a0eca7-08e4-4c7e-8e9f-8e0a70bf4687 Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:00:46.137648 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 47a0eca7-08e4-4c7e-8e9f-8e0a70bf4687 could not be found. Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:00:46.140698 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.143407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0107d171-afe6-4843-91e8-8619047cd8d6 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Returning 404 to user: Image not found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:46.146296 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0107d171-afe6-4843-91e8-8619047cd8d6 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] 10.222.0.16 "GET /compute/v2.1/images/47a0eca7-08e4-4c7e-8e9f-8e0a70bf4687/metadata" status: 404 len: 62 microversion: 2.1 time: 0.036466 Oct 12 22:00:46.146552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e9b0edcc-4834-476f-8235-845b920f1602 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Action: 'update_all', calling method: .version_select at 0x7f5128767040>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:46.148327 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 184/439] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 12 22:00:46 2022] GET /compute/v2.1/images/47a0eca7-08e4-4c7e-8e9f-8e0a70bf4687/metadata => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:00:46.169773 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-e9b0edcc-4834-476f-8235-845b920f1602 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] HTTP exception thrown: Image not found. Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e9b0edcc-4834-476f-8235-845b920f1602 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Request method failure captured: Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: request: PUT /compute/v2.1/images/1665939b-c7f3-4158-9972-dd3c1fb78067/metadata HTTP/1.1 Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 57 Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzkNGW01zsYSho1f-sDIN6VPPP8dzN0P6RJS1pnPHoiOMNGudHsr83cianCj5nPSTQNYs69KntZRnPMiUx0HeUCa_SNXfhedi7m1vKDWsd25umHtPLFv2k68s_-jzLvOLSuWcU9jtZf8dyiUHQ84eHDK3Kody0bFXG79-Gct8rt0Kpw Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: b57ea248557a4765ba8e4d7b7519d8b4 Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:00:46.171980 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:00:46.173496 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b57ea248557a4765ba8e4d7b7519d8b4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:46.173496 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.173496 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: b57ea248557a4765ba8e4d7b7519d8b4 Oct 12 22:00:46.173496 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.173496 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesMetadataNegativeTestJSON-829891498-project Oct 12 22:00:46.173496 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:46.173496 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:46.173496 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a665e75c0d1e4df8b6c2963ebc8e39ca Oct 12 22:00:46.173496 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-829891498-project Oct 12 22:00:46.173496 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:00:46.173496 n-d-861111-1 devstack@n-api.service[120453]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 12 22:00:46.173496 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:00:46.173496 n-d-861111-1 devstack@n-api.service[120453]: exception: Image not found. Oct 12 22:00:46.173496 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'image_id': '1665939b-c7f3-4158-9972-dd3c1fb78067', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:00:46.174429 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1665939b-c7f3-4158-9972-dd3c1fb78067 Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:00:46.175595 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1665939b-c7f3-4158-9972-dd3c1fb78067 could not be found. Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:46.177370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:00:46.178936 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.180746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e9b0edcc-4834-476f-8235-845b920f1602 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Returning 404 to user: Image not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:46.180746 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e9b0edcc-4834-476f-8235-845b920f1602 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] 10.222.0.16 "PUT /compute/v2.1/images/1665939b-c7f3-4158-9972-dd3c1fb78067/metadata" status: 404 len: 62 microversion: 2.1 time: 0.037383 Oct 12 22:00:46.180746 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 256/440] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:00:46 2022] PUT /compute/v2.1/images/1665939b-c7f3-4158-9972-dd3c1fb78067/metadata => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:00:46.185357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d89bb437-36fc-4ce4-ac81-9b2b23d68c9d tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Action: 'update', calling method: .version_select at 0x7f5128978700>, body: {"meta": {"os_distro": "alt"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:46.214425 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-d89bb437-36fc-4ce4-ac81-9b2b23d68c9d tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] HTTP exception thrown: Image not found. Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d89bb437-36fc-4ce4-ac81-9b2b23d68c9d tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Request method failure captured: Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: request: PUT /compute/v2.1/images/f4e297ab-7610-499d-be4a-071a6b4f86a1/metadata/os_distro HTTP/1.1 Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 30 Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzkNGW01zsYSho1f-sDIN6VPPP8dzN0P6RJS1pnPHoiOMNGudHsr83cianCj5nPSTQNYs69KntZRnPMiUx0HeUCa_SNXfhedi7m1vKDWsd25umHtPLFv2k68s_-jzLvOLSuWcU9jtZf8dyiUHQ84eHDK3Kody0bFXG79-Gct8rt0Kpw Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: b57ea248557a4765ba8e4d7b7519d8b4 Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:00:46.217019 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:00:46.218268 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b57ea248557a4765ba8e4d7b7519d8b4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:46.218268 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.218268 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: b57ea248557a4765ba8e4d7b7519d8b4 Oct 12 22:00:46.218268 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.218268 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ImagesMetadataNegativeTestJSON-829891498-project Oct 12 22:00:46.218268 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:46.218268 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:46.218268 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: a665e75c0d1e4df8b6c2963ebc8e39ca Oct 12 22:00:46.218268 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-829891498-project Oct 12 22:00:46.218268 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:00:46.218268 n-d-861111-1 devstack@n-api.service[120452]: {"meta": {"os_distro": "alt"}} Oct 12 22:00:46.218268 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:00:46.218268 n-d-861111-1 devstack@n-api.service[120452]: exception: Image not found. Oct 12 22:00:46.218268 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'image_id': 'f4e297ab-7610-499d-be4a-071a6b4f86a1', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:00:46.219030 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f4e297ab-7610-499d-be4a-071a6b4f86a1 Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:00:46.220209 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f4e297ab-7610-499d-be4a-071a6b4f86a1 could not be found. Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:46.221190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:00:46.222156 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.225531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d89bb437-36fc-4ce4-ac81-9b2b23d68c9d tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Returning 404 to user: Image not found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:46.225531 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d89bb437-36fc-4ce4-ac81-9b2b23d68c9d tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] 10.222.0.16 "PUT /compute/v2.1/images/f4e297ab-7610-499d-be4a-071a6b4f86a1/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.036955 Oct 12 22:00:46.225531 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 185/441] 10.222.0.16 () {60 vars in 1310 bytes} [Wed Oct 12 22:00:46 2022] PUT /compute/v2.1/images/f4e297ab-7610-499d-be4a-071a6b4f86a1/metadata/os_distro => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:00:46.230365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-80be6aa9-37e6-4be2-bbe3-6d2ca5de1ac2 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Action: 'create', calling method: .version_select at 0x7f51287673a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:46.254287 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-80be6aa9-37e6-4be2-bbe3-6d2ca5de1ac2 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] HTTP exception thrown: Image not found. Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-80be6aa9-37e6-4be2-bbe3-6d2ca5de1ac2 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Request method failure captured: Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/images/7283c1e5-52f6-4293-8f90-f74f606307e1/metadata HTTP/1.1 Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 57 Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzkNGW01zsYSho1f-sDIN6VPPP8dzN0P6RJS1pnPHoiOMNGudHsr83cianCj5nPSTQNYs69KntZRnPMiUx0HeUCa_SNXfhedi7m1vKDWsd25umHtPLFv2k68s_-jzLvOLSuWcU9jtZf8dyiUHQ84eHDK3Kody0bFXG79-Gct8rt0Kpw Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: b57ea248557a4765ba8e4d7b7519d8b4 Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:00:46.256980 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:00:46.258308 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b57ea248557a4765ba8e4d7b7519d8b4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b57ea248557a4765ba8e4d7b7519d8b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:46.258308 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.258308 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: b57ea248557a4765ba8e4d7b7519d8b4 Oct 12 22:00:46.258308 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-829891498 Oct 12 22:00:46.258308 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesMetadataNegativeTestJSON-829891498-project Oct 12 22:00:46.258308 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:46.258308 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:46.258308 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a665e75c0d1e4df8b6c2963ebc8e39ca Oct 12 22:00:46.258308 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-829891498-project Oct 12 22:00:46.258308 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:00:46.258308 n-d-861111-1 devstack@n-api.service[120453]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 12 22:00:46.258308 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:00:46.258308 n-d-861111-1 devstack@n-api.service[120453]: exception: Image not found. Oct 12 22:00:46.258308 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'image_id': '7283c1e5-52f6-4293-8f90-f74f606307e1', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:00:46.259050 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7283c1e5-52f6-4293-8f90-f74f606307e1 Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:00:46.260025 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7283c1e5-52f6-4293-8f90-f74f606307e1 could not be found. Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:46.261029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:00:46.262102 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:46.263219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-80be6aa9-37e6-4be2-bbe3-6d2ca5de1ac2 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] Returning 404 to user: Image not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:46.263219 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-80be6aa9-37e6-4be2-bbe3-6d2ca5de1ac2 tempest-ImagesMetadataNegativeTestJSON-829891498 tempest-ImagesMetadataNegativeTestJSON-829891498-project] 10.222.0.16 "POST /compute/v2.1/images/7283c1e5-52f6-4293-8f90-f74f606307e1/metadata" status: 404 len: 62 microversion: 2.1 time: 0.036710 Oct 12 22:00:46.265015 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 257/442] 10.222.0.16 () {60 vars in 1281 bytes} [Wed Oct 12 22:00:46 2022] POST /compute/v2.1/images/7283c1e5-52f6-4293-8f90-f74f606307e1/metadata => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:00:46.302951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2fec87c8-948c-4b99-ba7f-7fb18831a412 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:46.303507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2fec87c8-948c-4b99-ba7f-7fb18831a412 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:46.307830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=81,nova_api:DELETE=12 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:46.317970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fec87c8-948c-4b99-ba7f-7fb18831a412 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:46.318482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fec87c8-948c-4b99-ba7f-7fb18831a412 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:46.318923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fec87c8-948c-4b99-ba7f-7fb18831a412 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:46.321563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fec87c8-948c-4b99-ba7f-7fb18831a412 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:46.322032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fec87c8-948c-4b99-ba7f-7fb18831a412 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:46.322465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fec87c8-948c-4b99-ba7f-7fb18831a412 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:46.619683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2fec87c8-948c-4b99-ba7f-7fb18831a412 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:46.636249 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2fec87c8-948c-4b99-ba7f-7fb18831a412 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1505 microversion: 2.1 time: 0.337286 Oct 12 22:00:46.637195 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 186/443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:46 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:47.599508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-29a60307-dcae-4eea-a5ed-f4e76a37e616 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Action: 'update', calling method: .version_select at 0x7f5128767430>, body: {"quota_set": {"ram": "5120"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:47.658851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6d380c8f-b1e9-41f4-bd29-e453fd79734e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:47.659500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6d380c8f-b1e9-41f4-bd29-e453fd79734e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:47.666641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d380c8f-b1e9-41f4-bd29-e453fd79734e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:47.666921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d380c8f-b1e9-41f4-bd29-e453fd79734e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:47.667369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d380c8f-b1e9-41f4-bd29-e453fd79734e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:47.668240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d380c8f-b1e9-41f4-bd29-e453fd79734e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:47.668881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d380c8f-b1e9-41f4-bd29-e453fd79734e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:47.669497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d380c8f-b1e9-41f4-bd29-e453fd79734e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:48.174102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6d380c8f-b1e9-41f4-bd29-e453fd79734e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:48.184470 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6d380c8f-b1e9-41f4-bd29-e453fd79734e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1505 microversion: 2.1 time: 0.529091 Oct 12 22:00:48.200514 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 187/444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:47 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1505 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:48.340231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=20,nova_api:INSERT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:48.357229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29a60307-dcae-4eea-a5ed-f4e76a37e616 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:48.357734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29a60307-dcae-4eea-a5ed-f4e76a37e616 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:48.358613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29a60307-dcae-4eea-a5ed-f4e76a37e616 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:48.359530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29a60307-dcae-4eea-a5ed-f4e76a37e616 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:48.360135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29a60307-dcae-4eea-a5ed-f4e76a37e616 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:48.360554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29a60307-dcae-4eea-a5ed-f4e76a37e616 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:48.430242 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-29a60307-dcae-4eea-a5ed-f4e76a37e616 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/0d95b885c78b424197a5495eec63f053" status: 200 len: 148 microversion: 2.57 time: 1.481848 Oct 12 22:00:48.435539 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 258/445] 10.222.0.16 () {62 vars in 1303 bytes} [Wed Oct 12 22:00:46 2022] PUT /compute/v2.1/os-quota-sets/0d95b885c78b424197a5495eec63f053 => generated 148 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:00:48.443319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-05740f64-bcba-44bd-b913-c59a7a35ed0b tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Calling method '.version_select at 0x7f51289784c0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:48.906500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b5893002-f2f1-44f2-b8ea-5bee1a4d915d tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Calling method '.version_select at 0x7f512873ac10>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:48.909149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5893002-f2f1-44f2-b8ea-5bee1a4d915d tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:48.909847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5893002-f2f1-44f2-b8ea-5bee1a4d915d tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:48.910741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5893002-f2f1-44f2-b8ea-5bee1a4d915d tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:48.927524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5893002-f2f1-44f2-b8ea-5bee1a4d915d tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:48.928110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5893002-f2f1-44f2-b8ea-5bee1a4d915d tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:48.929014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5893002-f2f1-44f2-b8ea-5bee1a4d915d tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:48.942243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5893002-f2f1-44f2-b8ea-5bee1a4d915d tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:48.942968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5893002-f2f1-44f2-b8ea-5bee1a4d915d tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:48.943755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5893002-f2f1-44f2-b8ea-5bee1a4d915d tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:48.950992 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b5893002-f2f1-44f2-b8ea-5bee1a4d915d tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.219319 Oct 12 22:00:48.952705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05740f64-bcba-44bd-b913-c59a7a35ed0b tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:48.953849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05740f64-bcba-44bd-b913-c59a7a35ed0b tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:48.954740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05740f64-bcba-44bd-b913-c59a7a35ed0b tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:48.955710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05740f64-bcba-44bd-b913-c59a7a35ed0b tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:48.956552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05740f64-bcba-44bd-b913-c59a7a35ed0b tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:48.957211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05740f64-bcba-44bd-b913-c59a7a35ed0b tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:48.957907 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 259/446] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:00:48.962378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6d2faf34-8495-4b37-9167-0ce06e84e180 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Calling method '.version_select at 0x7f51287ce9d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:48.965082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d2faf34-8495-4b37-9167-0ce06e84e180 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:48.965769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d2faf34-8495-4b37-9167-0ce06e84e180 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:48.966545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d2faf34-8495-4b37-9167-0ce06e84e180 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:48.981414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d2faf34-8495-4b37-9167-0ce06e84e180 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:48.981817 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-05740f64-bcba-44bd-b913-c59a7a35ed0b tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/0d95b885c78b424197a5495eec63f053/detail" status: 200 len: 463 microversion: 2.57 time: 0.543515 Oct 12 22:00:48.981974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d2faf34-8495-4b37-9167-0ce06e84e180 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:48.982434 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 188/447] 10.222.0.16 () {60 vars in 1304 bytes} [Wed Oct 12 22:00:48 2022] GET /compute/v2.1/os-quota-sets/0d95b885c78b424197a5495eec63f053/detail => generated 463 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 22:00:48.982836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d2faf34-8495-4b37-9167-0ce06e84e180 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:49.010218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d2faf34-8495-4b37-9167-0ce06e84e180 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:49.010716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d2faf34-8495-4b37-9167-0ce06e84e180 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:49.011141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d2faf34-8495-4b37-9167-0ce06e84e180 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:49.017800 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6d2faf34-8495-4b37-9167-0ce06e84e180 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-861111-1/servers" status: 200 len: 104 microversion: 2.1 time: 0.058872 Oct 12 22:00:49.018376 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 260/448] 10.222.0.16 () {58 vars in 1212 bytes} [Wed Oct 12 22:00:48 2022] GET /compute/v2.1/os-hypervisors/n-h1-861111-1/servers => generated 104 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:49.032117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-92e389fd-2a3d-4ec9-821f-13363be6bab0 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Calling method '.version_select at 0x7f512899f1f0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:49.036083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92e389fd-2a3d-4ec9-821f-13363be6bab0 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:49.036564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92e389fd-2a3d-4ec9-821f-13363be6bab0 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:49.037028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92e389fd-2a3d-4ec9-821f-13363be6bab0 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:49.053820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92e389fd-2a3d-4ec9-821f-13363be6bab0 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:49.054300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92e389fd-2a3d-4ec9-821f-13363be6bab0 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:49.054732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92e389fd-2a3d-4ec9-821f-13363be6bab0 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:49.066068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92e389fd-2a3d-4ec9-821f-13363be6bab0 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:49.066746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92e389fd-2a3d-4ec9-821f-13363be6bab0 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:49.067172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92e389fd-2a3d-4ec9-821f-13363be6bab0 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:49.073977 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-92e389fd-2a3d-4ec9-821f-13363be6bab0 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.047420 Oct 12 22:00:49.074546 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 189/449] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:00:49.086356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bd0bad89-df50-4246-9f51-2de0e9ba8b67 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Calling method '.version_select at 0x7f5128767790>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:49.088481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd0bad89-df50-4246-9f51-2de0e9ba8b67 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:49.088960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd0bad89-df50-4246-9f51-2de0e9ba8b67 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:49.089561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd0bad89-df50-4246-9f51-2de0e9ba8b67 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:49.103907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd0bad89-df50-4246-9f51-2de0e9ba8b67 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:49.104462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd0bad89-df50-4246-9f51-2de0e9ba8b67 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:49.104952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd0bad89-df50-4246-9f51-2de0e9ba8b67 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:49.112195 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bd0bad89-df50-4246-9f51-2de0e9ba8b67 tempest-HypervisorAdminUnderV252Test-1934577071 tempest-HypervisorAdminUnderV252Test-1934577071-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-861111-1/search" status: 200 len: 104 microversion: 2.1 time: 0.030760 Oct 12 22:00:49.112902 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 261/450] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 12 22:00:49 2022] GET /compute/v2.1/os-hypervisors/n-h1-861111-1/search => generated 104 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:49.211087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-055e8570-7230-41c1-8ad5-d5b615b424fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:49.211735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-055e8570-7230-41c1-8ad5-d5b615b424fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:49.222436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-055e8570-7230-41c1-8ad5-d5b615b424fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:49.223538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-055e8570-7230-41c1-8ad5-d5b615b424fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:49.223973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-055e8570-7230-41c1-8ad5-d5b615b424fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:49.224672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-055e8570-7230-41c1-8ad5-d5b615b424fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:49.225113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-055e8570-7230-41c1-8ad5-d5b615b424fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:49.225669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-055e8570-7230-41c1-8ad5-d5b615b424fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:49.377462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-055e8570-7230-41c1-8ad5-d5b615b424fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:49.387122 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-055e8570-7230-41c1-8ad5-d5b615b424fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1495 microversion: 2.1 time: 0.181482 Oct 12 22:00:49.399868 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 190/451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:49 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1495 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:49.410716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6d031618-515a-4888-962b-03117cf6518b tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '.version_select at 0x7f512873a790>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:49.415469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d031618-515a-4888-962b-03117cf6518b tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:49.415469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d031618-515a-4888-962b-03117cf6518b tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:49.416260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d031618-515a-4888-962b-03117cf6518b tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:49.432994 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6d031618-515a-4888-962b-03117cf6518b tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.025900 Oct 12 22:00:49.433932 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 262/452] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 12 22:00:49 2022] GET /compute/v2.1/os-migrations => generated 400 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:49.447969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ff38c65c-84c7-4bd4-82a6-b5f8febdb31d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:49.448666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ff38c65c-84c7-4bd4-82a6-b5f8febdb31d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:49.454619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff38c65c-84c7-4bd4-82a6-b5f8febdb31d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:49.455103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff38c65c-84c7-4bd4-82a6-b5f8febdb31d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:49.455572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff38c65c-84c7-4bd4-82a6-b5f8febdb31d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:49.456262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff38c65c-84c7-4bd4-82a6-b5f8febdb31d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:49.456709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff38c65c-84c7-4bd4-82a6-b5f8febdb31d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:49.457131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff38c65c-84c7-4bd4-82a6-b5f8febdb31d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:49.598485 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ff38c65c-84c7-4bd4-82a6-b5f8febdb31d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1646 microversion: 2.1 time: 0.153732 Oct 12 22:00:49.599061 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 191/453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:49 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1646 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:49.797633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5fb24fba-e7e6-47d9-84a4-bcc610089563 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Action: 'update', calling method: .version_select at 0x7f512873bdc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:49.898742 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1541277848", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "13df621a-275e-488a-8347-5e43bb46475f"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:49.984956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] validate_networks() for [('13df621a-275e-488a-8347-5e43bb46475f', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:00:50.445971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fb24fba-e7e6-47d9-84a4-bcc610089563 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:50.446502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fb24fba-e7e6-47d9-84a4-bcc610089563 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:50.446876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fb24fba-e7e6-47d9-84a4-bcc610089563 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:50.450921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fb24fba-e7e6-47d9-84a4-bcc610089563 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:50.451443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fb24fba-e7e6-47d9-84a4-bcc610089563 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:50.455350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fb24fba-e7e6-47d9-84a4-bcc610089563 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:50.577168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fb24fba-e7e6-47d9-84a4-bcc610089563 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:50.577657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fb24fba-e7e6-47d9-84a4-bcc610089563 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:50.578097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fb24fba-e7e6-47d9-84a4-bcc610089563 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:50.581015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fb24fba-e7e6-47d9-84a4-bcc610089563 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:50.581513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fb24fba-e7e6-47d9-84a4-bcc610089563 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:50.581989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fb24fba-e7e6-47d9-84a4-bcc610089563 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:50.711887 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5fb24fba-e7e6-47d9-84a4-bcc610089563 tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/0d95b885c78b424197a5495eec63f053?user_id=def823c7109f498e95e387165714f753" status: 200 len: 148 microversion: 2.57 time: 0.918102 Oct 12 22:00:50.712702 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 263/454] 10.222.0.16 () {62 vars in 1384 bytes} [Wed Oct 12 22:00:49 2022] PUT /compute/v2.1/os-quota-sets/0d95b885c78b424197a5495eec63f053?user_id=def823c7109f498e95e387165714f753 => generated 148 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:00:50.726098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-64160f48-e6a4-4778-8e97-dca3f326f2ea tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] Calling method '.version_select at 0x7f51286ef3a0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:50.767310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:00:50.768261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:00:50.768954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:00:50.770171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:00:50.770806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:00:50.791058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:50.791663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:50.792227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:50.793094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:50.793620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:50.794116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:50.832002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Getting quotas for project 61e71a9eeaa044e8aa939548f15a585e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:00:50.850517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Getting quotas for user 1fe98ba1ceec4b849eb45eb46ce4d425 and project 61e71a9eeaa044e8aa939548f15a585e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:00:50.874275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:00:50.880458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:00:50.962018 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5224f9a0-5db6-422a-84c6-a75601c10bc2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.067487 Oct 12 22:00:50.970089 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 192/455] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:00:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:00:50.976242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3f30da41-f754-4461-907f-5bb28e69afdf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:50.977721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3f30da41-f754-4461-907f-5bb28e69afdf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:51.048745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3f30da41-f754-4461-907f-5bb28e69afdf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:51.061108 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3f30da41-f754-4461-907f-5bb28e69afdf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1211 microversion: 2.1 time: 0.088356 Oct 12 22:00:51.071336 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 193/456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:50 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:51.592271 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-64160f48-e6a4-4778-8e97-dca3f326f2ea tempest-QuotasAdminTestV257-1906906312 tempest-QuotasAdminTestV257-1906906312-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/0d95b885c78b424197a5495eec63f053?user_id=def823c7109f498e95e387165714f753" status: 200 len: 190 microversion: 2.57 time: 0.869859 Oct 12 22:00:51.602403 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 264/457] 10.222.0.16 () {60 vars in 1364 bytes} [Wed Oct 12 22:00:50 2022] GET /compute/v2.1/os-quota-sets/0d95b885c78b424197a5495eec63f053?user_id=def823c7109f498e95e387165714f753 => generated 190 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:00:52.086257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-222cef6f-5eb1-4c8f-8030-7dadba343adf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:52.086996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-222cef6f-5eb1-4c8f-8030-7dadba343adf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:52.094224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-222cef6f-5eb1-4c8f-8030-7dadba343adf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:52.094986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-222cef6f-5eb1-4c8f-8030-7dadba343adf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:52.095643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-222cef6f-5eb1-4c8f-8030-7dadba343adf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:52.096519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-222cef6f-5eb1-4c8f-8030-7dadba343adf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:52.096999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-222cef6f-5eb1-4c8f-8030-7dadba343adf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:52.097956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-222cef6f-5eb1-4c8f-8030-7dadba343adf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:52.266417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-222cef6f-5eb1-4c8f-8030-7dadba343adf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:52.282528 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-222cef6f-5eb1-4c8f-8030-7dadba343adf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1207 microversion: 2.1 time: 0.201152 Oct 12 22:00:52.287929 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 194/458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:52 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1207 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:53.005627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-daf7ac5b-bec8-4fd1-8dc1-c11ece023b03 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Calling method '.version_select at 0x7f51286fc1f0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:53.007565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daf7ac5b-bec8-4fd1-8dc1-c11ece023b03 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.008125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daf7ac5b-bec8-4fd1-8dc1-c11ece023b03 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.008666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daf7ac5b-bec8-4fd1-8dc1-c11ece023b03 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.077255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daf7ac5b-bec8-4fd1-8dc1-c11ece023b03 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.077760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daf7ac5b-bec8-4fd1-8dc1-c11ece023b03 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.078200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daf7ac5b-bec8-4fd1-8dc1-c11ece023b03 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.141964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daf7ac5b-bec8-4fd1-8dc1-c11ece023b03 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.143030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daf7ac5b-bec8-4fd1-8dc1-c11ece023b03 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.145690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daf7ac5b-bec8-4fd1-8dc1-c11ece023b03 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.162390 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-daf7ac5b-bec8-4fd1-8dc1-c11ece023b03 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.783636 Oct 12 22:00:53.164048 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 265/459] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:53.178878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-388f81a8-a1bc-4b4f-9b00-82a4b731a1c3 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Calling method '.version_select at 0x7f51286ed280>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:53.186498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388f81a8-a1bc-4b4f-9b00-82a4b731a1c3 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.195332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388f81a8-a1bc-4b4f-9b00-82a4b731a1c3 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.196126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388f81a8-a1bc-4b4f-9b00-82a4b731a1c3 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.236711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388f81a8-a1bc-4b4f-9b00-82a4b731a1c3 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.241173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388f81a8-a1bc-4b4f-9b00-82a4b731a1c3 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.243507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388f81a8-a1bc-4b4f-9b00-82a4b731a1c3 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.277117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388f81a8-a1bc-4b4f-9b00-82a4b731a1c3 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.277886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388f81a8-a1bc-4b4f-9b00-82a4b731a1c3 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.278553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388f81a8-a1bc-4b4f-9b00-82a4b731a1c3 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.298136 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-388f81a8-a1bc-4b4f-9b00-82a4b731a1c3 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.126415 Oct 12 22:00:53.299435 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 266/460] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 12 22:00:53 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:53.313183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6ae29db2-9004-40ed-b358-e26035c93c9b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:53.314173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6ae29db2-9004-40ed-b358-e26035c93c9b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:53.327873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ae29db2-9004-40ed-b358-e26035c93c9b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.328744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ae29db2-9004-40ed-b358-e26035c93c9b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.329721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ae29db2-9004-40ed-b358-e26035c93c9b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.330956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ae29db2-9004-40ed-b358-e26035c93c9b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.332359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ae29db2-9004-40ed-b358-e26035c93c9b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.332982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ae29db2-9004-40ed-b358-e26035c93c9b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.440962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6ae29db2-9004-40ed-b358-e26035c93c9b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:53.453983 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6ae29db2-9004-40ed-b358-e26035c93c9b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1269 microversion: 2.1 time: 0.146641 Oct 12 22:00:53.457266 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 267/461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:53 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1269 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:53.466811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fadcf34f-1bc2-4119-8a49-6f38151fdbef tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Calling method '.version_select at 0x7f512873b700>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:53.471030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fadcf34f-1bc2-4119-8a49-6f38151fdbef tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.474763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fadcf34f-1bc2-4119-8a49-6f38151fdbef tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.475599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fadcf34f-1bc2-4119-8a49-6f38151fdbef tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.484482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:00:53.526653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fadcf34f-1bc2-4119-8a49-6f38151fdbef tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.527107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fadcf34f-1bc2-4119-8a49-6f38151fdbef tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.527793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fadcf34f-1bc2-4119-8a49-6f38151fdbef tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.554330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fadcf34f-1bc2-4119-8a49-6f38151fdbef tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.554916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fadcf34f-1bc2-4119-8a49-6f38151fdbef tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.555461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fadcf34f-1bc2-4119-8a49-6f38151fdbef tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.570461 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fadcf34f-1bc2-4119-8a49-6f38151fdbef tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.108975 Oct 12 22:00:53.573872 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 268/462] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:53.584392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-50a85ebd-0b01-4883-b583-a424b6ed32bd tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Calling method '.version_select at 0x7f512873a670>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:53.590232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50a85ebd-0b01-4883-b583-a424b6ed32bd tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.591530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50a85ebd-0b01-4883-b583-a424b6ed32bd tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.593656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50a85ebd-0b01-4883-b583-a424b6ed32bd tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.637544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50a85ebd-0b01-4883-b583-a424b6ed32bd tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.638733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50a85ebd-0b01-4883-b583-a424b6ed32bd tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.641433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50a85ebd-0b01-4883-b583-a424b6ed32bd tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.653727 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-50a85ebd-0b01-4883-b583-a424b6ed32bd tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.074190 Oct 12 22:00:53.658063 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 269/463] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:00:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:53.679909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a79cd5a1-1202-4e26-984b-56dd309a8f16 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Calling method '.version_select at 0x7f512873a5e0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:53.681947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a79cd5a1-1202-4e26-984b-56dd309a8f16 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.682438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a79cd5a1-1202-4e26-984b-56dd309a8f16 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.682882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a79cd5a1-1202-4e26-984b-56dd309a8f16 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.726642 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a79cd5a1-1202-4e26-984b-56dd309a8f16 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.055444 Oct 12 22:00:53.727562 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 270/464] 10.222.0.16 () {58 vars in 1179 bytes} [Wed Oct 12 22:00:53 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:00:53.740702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a59bed1d-1de2-41c5-9a00-d2391f7d4da1 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Calling method '.version_select at 0x7f512873b310>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:53.742726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a59bed1d-1de2-41c5-9a00-d2391f7d4da1 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.745360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a59bed1d-1de2-41c5-9a00-d2391f7d4da1 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.745997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a59bed1d-1de2-41c5-9a00-d2391f7d4da1 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.776766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a59bed1d-1de2-41c5-9a00-d2391f7d4da1 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.777203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a59bed1d-1de2-41c5-9a00-d2391f7d4da1 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.777639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a59bed1d-1de2-41c5-9a00-d2391f7d4da1 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.804713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a59bed1d-1de2-41c5-9a00-d2391f7d4da1 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.806695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a59bed1d-1de2-41c5-9a00-d2391f7d4da1 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.809324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a59bed1d-1de2-41c5-9a00-d2391f7d4da1 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.829848 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a59bed1d-1de2-41c5-9a00-d2391f7d4da1 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.091723 Oct 12 22:00:53.830916 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 271/465] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:00:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:53.847559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-160216c2-7a5c-46de-b222-ce733c630c1e tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Calling method '.version_select at 0x7f51286ed0d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:53.853348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-160216c2-7a5c-46de-b222-ce733c630c1e tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.855939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-160216c2-7a5c-46de-b222-ce733c630c1e tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.857739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-160216c2-7a5c-46de-b222-ce733c630c1e tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.894904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-160216c2-7a5c-46de-b222-ce733c630c1e tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.895466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-160216c2-7a5c-46de-b222-ce733c630c1e tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.895911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-160216c2-7a5c-46de-b222-ce733c630c1e tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.915008 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-160216c2-7a5c-46de-b222-ce733c630c1e tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.075568 Oct 12 22:00:53.918378 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 272/466] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:00:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:53.932678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6383fec5-1608-4a3f-98ca-d61cadb74c2b tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Calling method '.version_select at 0x7f51286edaf0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:53.934873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6383fec5-1608-4a3f-98ca-d61cadb74c2b tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.935417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6383fec5-1608-4a3f-98ca-d61cadb74c2b tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.938364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ea0c365c-f44d-4389-be8a-297dad5afa8c tempest-InstanceUsageAuditLogNegativeTestJSON-1115579029 tempest-InstanceUsageAuditLogNegativeTestJSON-1115579029-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:53.942970 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-ea0c365c-f44d-4389-be8a-297dad5afa8c tempest-InstanceUsageAuditLogNegativeTestJSON-1115579029 tempest-InstanceUsageAuditLogNegativeTestJSON-1115579029-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 12 22:00:53.944839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6383fec5-1608-4a3f-98ca-d61cadb74c2b tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ea0c365c-f44d-4389-be8a-297dad5afa8c tempest-InstanceUsageAuditLogNegativeTestJSON-1115579029 tempest-InstanceUsageAuditLogNegativeTestJSON-1115579029-project-admin] Request method failure captured: Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzkUyngN2eshXAzc4748nyCE313fwt84YAPMzW87UTwnQH6IBK9H9y8MORed2an6CTajYt8nJJaBVKgaMrCoN7dub_IAlCcxBbkSq5d7iR2mXSH0u5gZmLBNTgL-YplayjgtLM5lUkKyLM0BYn1T3VYLDzpMm79BOg4z0qlGjMpDW7Y Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: e135c0b0bde2467d8bf408a265ada9a3 Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1115579029 Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 22:00:53.956351 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 22:00:53.957811 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e135c0b0bde2467d8bf408a265ada9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e135c0b0bde2467d8bf408a265ada9a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e135c0b0bde2467d8bf408a265ada9a3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e135c0b0bde2467d8bf408a265ada9a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:53.957811 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1115579029 Oct 12 22:00:53.957811 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: e135c0b0bde2467d8bf408a265ada9a3 Oct 12 22:00:53.957811 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1115579029 Oct 12 22:00:53.957811 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1115579029-project-admin Oct 12 22:00:53.957811 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:53.957811 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:53.957811 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 45f522f3145045ba916a71fb4192e4a0 Oct 12 22:00:53.957811 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1115579029-project-admin Oct 12 22:00:53.957811 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:00:53.957811 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid timestamp for date invalid_time Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'invalid_time'} Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:53.958567 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:53.959735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 12 22:00:53.959735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 12 22:00:53.959735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 12 22:00:53.959735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:53.959735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:53.959735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:53.959735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:53.959735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:53.959735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:53.959735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:00:53.959735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:00:53.959735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 12 22:00:53.959735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:53.959735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ea0c365c-f44d-4389-be8a-297dad5afa8c tempest-InstanceUsageAuditLogNegativeTestJSON-1115579029 tempest-InstanceUsageAuditLogNegativeTestJSON-1115579029-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:53.959735 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ea0c365c-f44d-4389-be8a-297dad5afa8c tempest-InstanceUsageAuditLogNegativeTestJSON-1115579029 tempest-InstanceUsageAuditLogNegativeTestJSON-1115579029-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.931203 Oct 12 22:00:53.960966 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 195/467] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 12 22:00:53 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 933 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:00:53.970680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6383fec5-1608-4a3f-98ca-d61cadb74c2b tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:53.971098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6383fec5-1608-4a3f-98ca-d61cadb74c2b tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:53.971694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6383fec5-1608-4a3f-98ca-d61cadb74c2b tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:53.985578 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6383fec5-1608-4a3f-98ca-d61cadb74c2b tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.058158 Oct 12 22:00:53.986200 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 273/468] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:00:53 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:00:54.002497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-95c8711f-bfb3-4777-837b-5c20df96aa90 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Calling method '.version_select at 0x7f51286ed4c0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:54.005621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95c8711f-bfb3-4777-837b-5c20df96aa90 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:54.006225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95c8711f-bfb3-4777-837b-5c20df96aa90 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:54.006530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95c8711f-bfb3-4777-837b-5c20df96aa90 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:54.022701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95c8711f-bfb3-4777-837b-5c20df96aa90 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:54.023601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95c8711f-bfb3-4777-837b-5c20df96aa90 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:54.024184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95c8711f-bfb3-4777-837b-5c20df96aa90 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:54.040531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95c8711f-bfb3-4777-837b-5c20df96aa90 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:54.041376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95c8711f-bfb3-4777-837b-5c20df96aa90 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:54.042026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95c8711f-bfb3-4777-837b-5c20df96aa90 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:54.078650 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-95c8711f-bfb3-4777-837b-5c20df96aa90 tempest-HypervisorAdminTestJSON-264951534 tempest-HypervisorAdminTestJSON-264951534-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.080491 Oct 12 22:00:54.079725 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 274/469] 10.222.0.16 () {58 vars in 1173 bytes} [Wed Oct 12 22:00:53 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:54.177321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-67048fd0-9e65-452b-9367-249b19f634e4 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:54.179998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-67048fd0-9e65-452b-9367-249b19f634e4 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'd33abe6183e04ca3a3e93c9f26379ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d56b5de9514482a5c3b95c5217d53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-67048fd0-9e65-452b-9367-249b19f634e4 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350-project] Request method failure captured: Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzkSvbKHK-Sgt3xtmfI9j1xN20pQsIIs3UD2iJ_jbPoZKzshDKOqGgOAg4V11aTNd1_qGvFePL7pkrEgFrlHNWvLkl-wscah8qH7agiJo-w7X5TTnI8zn1ZA7Ge1RqyzUzp3CrRLJiDgtEo1pC7rT1h1wJ9k_STRGdgT_3vHRrPbUCw Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 27d56b5de9514482a5c3b95c5217d53b Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-986496350 Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:00:54.182035 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:00:54.183350 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/27d56b5de9514482a5c3b95c5217d53b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/27d56b5de9514482a5c3b95c5217d53b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_27d56b5de9514482a5c3b95c5217d53b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/27d56b5de9514482a5c3b95c5217d53b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:54.183350 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-986496350 Oct 12 22:00:54.183350 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 27d56b5de9514482a5c3b95c5217d53b Oct 12 22:00:54.183350 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-986496350 Oct 12 22:00:54.183350 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-986496350-project Oct 12 22:00:54.183350 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:00:54.183350 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:00:54.183350 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: d33abe6183e04ca3a3e93c9f26379ace Oct 12 22:00:54.183350 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-986496350-project Oct 12 22:00:54.183350 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: action_args: {} Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:00:54.183911 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:00:54.185067 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:00:54.185067 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:00:54.185067 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:00:54.185067 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:00:54.185067 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:00:54.185067 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:00:54.185067 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 12 22:00:54.185067 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:54.185067 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:54.185067 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:54.185067 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:54.185067 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:54.185067 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:54.185067 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:00:54.185067 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:00:54.185067 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 12 22:00:54.185067 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:00:54.189846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-67048fd0-9e65-452b-9367-249b19f634e4 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:54.191898 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-67048fd0-9e65-452b-9367-249b19f634e4 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.225660 Oct 12 22:00:54.193198 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 196/470] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 12 22:00:53 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 228 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:54.202158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4e4f5004-de6e-4e01-bc84-de04ab559037 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:54.204257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4e4f5004-de6e-4e01-bc84-de04ab559037 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'd33abe6183e04ca3a3e93c9f26379ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d56b5de9514482a5c3b95c5217d53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4e4f5004-de6e-4e01-bc84-de04ab559037 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350-project] Request method failure captured: Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12%2022:00:54 HTTP/1.1 Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzkSvbKHK-Sgt3xtmfI9j1xN20pQsIIs3UD2iJ_jbPoZKzshDKOqGgOAg4V11aTNd1_qGvFePL7pkrEgFrlHNWvLkl-wscah8qH7agiJo-w7X5TTnI8zn1ZA7Ge1RqyzUzp3CrRLJiDgtEo1pC7rT1h1wJ9k_STRGdgT_3vHRrPbUCw Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 27d56b5de9514482a5c3b95c5217d53b Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-986496350 Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:00:54.208894 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:00:54.210054 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/27d56b5de9514482a5c3b95c5217d53b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/27d56b5de9514482a5c3b95c5217d53b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_27d56b5de9514482a5c3b95c5217d53b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/27d56b5de9514482a5c3b95c5217d53b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:00:54.210054 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-986496350 Oct 12 22:00:54.210054 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 27d56b5de9514482a5c3b95c5217d53b Oct 12 22:00:54.210054 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-986496350 Oct 12 22:00:54.210054 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-986496350-project Oct 12 22:00:54.210054 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:00:54.210054 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:00:54.210054 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: d33abe6183e04ca3a3e93c9f26379ace Oct 12 22:00:54.210054 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-986496350-project Oct 12 22:00:54.210054 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '2022-10-12 22:00:54'} Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:00:54.210689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:00:54.212011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:00:54.212011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:00:54.212011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:00:54.212011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:00:54.212011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:00:54.212011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:00:54.212011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 12 22:00:54.212011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:54.212011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:00:54.212011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:54.212011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:00:54.212011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:00:54.212011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:00:54.212011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:00:54.212011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:00:54.212011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 12 22:00:54.212011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:00:54.215353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4e4f5004-de6e-4e01-bc84-de04ab559037 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:00:54.216957 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4e4f5004-de6e-4e01-bc84-de04ab559037 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350 tempest-InstanceUsageAuditLogNegativeTestJSON-986496350-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12 22:00:54" status: 403 len: 128 microversion: 2.1 time: 0.019388 Oct 12 22:00:54.224139 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 275/471] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 12 22:00:54 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12%2022%3A00%3A54 => generated 128 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:00:54.487272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5e56abd5-96c8-4af5-8fb6-05ef0166449a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:54.489119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5e56abd5-96c8-4af5-8fb6-05ef0166449a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:54.504380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e56abd5-96c8-4af5-8fb6-05ef0166449a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:54.504927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e56abd5-96c8-4af5-8fb6-05ef0166449a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:54.505367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e56abd5-96c8-4af5-8fb6-05ef0166449a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:54.516977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e56abd5-96c8-4af5-8fb6-05ef0166449a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:54.517485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e56abd5-96c8-4af5-8fb6-05ef0166449a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:54.517930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e56abd5-96c8-4af5-8fb6-05ef0166449a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:54.972175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5e56abd5-96c8-4af5-8fb6-05ef0166449a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:54.984872 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5e56abd5-96c8-4af5-8fb6-05ef0166449a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1311 microversion: 2.1 time: 0.501883 Oct 12 22:00:54.985480 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 197/472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:54 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1311 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:56.016019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-743fe482-3d6f-49de-8770-6b98e52ebf5b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:56.017443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-743fe482-3d6f-49de-8770-6b98e52ebf5b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:56.034163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743fe482-3d6f-49de-8770-6b98e52ebf5b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:56.035540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743fe482-3d6f-49de-8770-6b98e52ebf5b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:56.036148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743fe482-3d6f-49de-8770-6b98e52ebf5b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:56.037003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743fe482-3d6f-49de-8770-6b98e52ebf5b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:56.037595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743fe482-3d6f-49de-8770-6b98e52ebf5b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:56.038163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743fe482-3d6f-49de-8770-6b98e52ebf5b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:56.779048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-74f08b87-4c1d-48d5-beca-1f3692197424 tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] Action: 'create', calling method: .version_select at 0x7f5128978940>, body: {"keypair": {"name": "tempest-keypair-569020133", "type": "ssh", "user_id": "3e1907db37c34f5eb9c02aff817a8059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkQSdeyaIIc5hk0JDL1TM8OR/tI4LR8fim8GnkJh6Av4FKrcaXYd7CL9nKSel6jmrDgIMuWKhPTGuksQTyjaO46S2VXV5V0wU+WnbiUjISSXhFRJWK9JHuOsy7ZFHVn6A=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:56.795644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-74f08b87-4c1d-48d5-beca-1f3692197424 tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] Getting quotas for project 5aba8c894b764c9cb0ec8e96f115775a. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:00:56.802293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-74f08b87-4c1d-48d5-beca-1f3692197424 tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] Getting quotas for user 1275fbaacdab4912919e9a66132a0591 and project 5aba8c894b764c9cb0ec8e96f115775a. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:00:56.866309 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-74f08b87-4c1d-48d5-beca-1f3692197424 tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.570643 Oct 12 22:00:56.877447 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 198/473] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 12 22:00:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 584 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 12 22:00:56.892757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d7fe42a6-862b-4307-85af-1ecf9af5188d req-7012862a-5a76-4668-a1e2-2ab45ee00805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3ca739-360b-4a87-8580-717e5eb56c4d", "tag": "2d514d69-05a5-4030-8d63-9876690cb34f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:56.917409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d7fe42a6-862b-4307-85af-1ecf9af5188d req-7012862a-5a76-4668-a1e2-2ab45ee00805 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:56.917891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d7fe42a6-862b-4307-85af-1ecf9af5188d req-7012862a-5a76-4668-a1e2-2ab45ee00805 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:56.918318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d7fe42a6-862b-4307-85af-1ecf9af5188d req-7012862a-5a76-4668-a1e2-2ab45ee00805 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:56.933076 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d7fe42a6-862b-4307-85af-1ecf9af5188d req-7012862a-5a76-4668-a1e2-2ab45ee00805 service nova] Creating event network-changed:2d514d69-05a5-4030-8d63-9876690cb34f for instance bf3ca739-360b-4a87-8580-717e5eb56c4d on n-h1-861111-1 Oct 12 22:00:56.951992 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d7fe42a6-862b-4307-85af-1ecf9af5188d req-7012862a-5a76-4668-a1e2-2ab45ee00805 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071707 Oct 12 22:00:56.956457 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 199/474] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:00:56.970653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d4dc887d-26b7-41e9-870f-9f3ee5d54c78 tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] Action: 'create', calling method: .version_select at 0x7f512891c3a0>, body: {"keypair": {"name": "tempest-keypair-2027150007", "type": "ssh", "user_id": "3e1907db37c34f5eb9c02aff817a8059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgK24g0kXF3mmRcL+YPUa4k70jivcZO263ZpLSnTuUHw4d3VF7uv7qHAE5/b4Dxi21Y7oMBkqtyrsOSw2PlshT7m36/+BkXFrR8spzwe5zpgNG/6LYqfTv1gFfTMbz1IQ=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:57.013788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-d4dc887d-26b7-41e9-870f-9f3ee5d54c78 tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] Getting quotas for project 5aba8c894b764c9cb0ec8e96f115775a. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:00:57.029205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-d4dc887d-26b7-41e9-870f-9f3ee5d54c78 tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] Getting quotas for user 1275fbaacdab4912919e9a66132a0591 and project 5aba8c894b764c9cb0ec8e96f115775a. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:00:57.092636 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d4dc887d-26b7-41e9-870f-9f3ee5d54c78 tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.132643 Oct 12 22:00:57.096448 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 200/475] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 12 22:00:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 22:00:57.115197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-989218d1-788f-43b6-b565-c326d6cbeef5 tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] Calling method '.version_select at 0x7f512899f280>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:57.147270 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-989218d1-788f-43b6-b565-c326d6cbeef5 tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-569020133?user_id=3e1907db37c34f5eb9c02aff817a8059" status: 200 len: 511 microversion: 2.10 time: 0.043376 Oct 12 22:00:57.149637 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 201/476] 10.222.0.16 () {60 vars in 1337 bytes} [Wed Oct 12 22:00:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-569020133?user_id=3e1907db37c34f5eb9c02aff817a8059 => generated 511 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 22:00:57.168778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4528b899-60cd-46cb-9d53-dbf0e7bf85bc tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] Action: 'create', calling method: .version_select at 0x7f512899fd30>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1302964680", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaaXZfxRNCHXH9sDbTYqxu4y3SGuv2gstWr1rghbFjjrNpxTyomuRHPv3gBhXOW6H1AaIflXr2mcu4KpWfeb4ToubNpXZ11yWzoA4qqg/sgwt6P9hXmaKiecmBQ3+wM/Q=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:00:57.202476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-4528b899-60cd-46cb-9d53-dbf0e7bf85bc tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] Getting quotas for project 5aba8c894b764c9cb0ec8e96f115775a. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:00:57.209547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-4528b899-60cd-46cb-9d53-dbf0e7bf85bc tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] Getting quotas for user 1275fbaacdab4912919e9a66132a0591 and project 5aba8c894b764c9cb0ec8e96f115775a. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:00:57.245567 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4528b899-60cd-46cb-9d53-dbf0e7bf85bc tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.086731 Oct 12 22:00:57.246854 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 202/477] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 12 22:00:57 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 89 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 22:00:57.259935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-08a902f0-ae0a-4b88-88bd-5bdb48d9b038 tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] Calling method '.version_select at 0x7f5128a8caf0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:57.275675 n-d-861111-1 devstack@n-api.service[120452]: WARNING oslo_db.sqlalchemy.utils [None req-08a902f0-ae0a-4b88-88bd-5bdb48d9b038 tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 22:00:57.289308 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-08a902f0-ae0a-4b88-88bd-5bdb48d9b038 tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs?user_id=3e1907db37c34f5eb9c02aff817a8059" status: 200 len: 725 microversion: 2.10 time: 0.035509 Oct 12 22:00:57.291143 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 203/478] 10.222.0.16 () {60 vars in 1259 bytes} [Wed Oct 12 22:00:57 2022] GET /compute/v2.1/os-keypairs?user_id=3e1907db37c34f5eb9c02aff817a8059 => generated 725 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 22:00:57.305912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f250371b-73d7-4afb-abff-5ebbcdc34b9d tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] Calling method '.version_select at 0x7f512899f940>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:57.350727 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f250371b-73d7-4afb-abff-5ebbcdc34b9d tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1302964680" status: 204 len: 0 microversion: 2.10 time: 0.051497 Oct 12 22:00:57.351626 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 204/479] 10.222.0.16 () {60 vars in 1325 bytes} [Wed Oct 12 22:00:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1302964680 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 22:00:57.360170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b80b1077-9a4d-4f85-91d2-144c9f057ef4 tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] Calling method '.version_select at 0x7f51289165e0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:57.398733 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b80b1077-9a4d-4f85-91d2-144c9f057ef4 tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027150007?user_id=3e1907db37c34f5eb9c02aff817a8059" status: 204 len: 0 microversion: 2.10 time: 0.042209 Oct 12 22:00:57.399853 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 205/480] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:00:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027150007?user_id=3e1907db37c34f5eb9c02aff817a8059 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:00:57.408597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-895cf98a-6c9b-4307-8cc9-f8988bfedec5 tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] Calling method '.version_select at 0x7f5128901c10>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:57.427571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-743fe482-3d6f-49de-8770-6b98e52ebf5b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:57.443607 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-743fe482-3d6f-49de-8770-6b98e52ebf5b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1311 microversion: 2.1 time: 1.429180 Oct 12 22:00:57.446252 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 276/481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:56 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1311 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:00:57.478309 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-895cf98a-6c9b-4307-8cc9-f8988bfedec5 tempest-KeyPairsV210TestJSON-449082377 tempest-KeyPairsV210TestJSON-449082377-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-569020133?user_id=3e1907db37c34f5eb9c02aff817a8059" status: 204 len: 0 microversion: 2.10 time: 0.073885 Oct 12 22:00:57.479508 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 206/482] 10.222.0.16 () {60 vars in 1340 bytes} [Wed Oct 12 22:00:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-569020133?user_id=3e1907db37c34f5eb9c02aff817a8059 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 22:00:58.473992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3322c2ae-4e1d-4b1f-ac32-1a72cd1b8970 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:00:58.475569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3322c2ae-4e1d-4b1f-ac32-1a72cd1b8970 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:00:58.486271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3322c2ae-4e1d-4b1f-ac32-1a72cd1b8970 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:58.488986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3322c2ae-4e1d-4b1f-ac32-1a72cd1b8970 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:58.493802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3322c2ae-4e1d-4b1f-ac32-1a72cd1b8970 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:58.494843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3322c2ae-4e1d-4b1f-ac32-1a72cd1b8970 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:00:58.501743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3322c2ae-4e1d-4b1f-ac32-1a72cd1b8970 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:00:58.502412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3322c2ae-4e1d-4b1f-ac32-1a72cd1b8970 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:00:59.468208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3322c2ae-4e1d-4b1f-ac32-1a72cd1b8970 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:00:59.507750 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3322c2ae-4e1d-4b1f-ac32-1a72cd1b8970 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1311 microversion: 2.1 time: 1.009275 Oct 12 22:00:59.512637 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 277/483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:00:58 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1311 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:00.538581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9e41b683-33cb-4fe6-bfcf-07f8641f72b4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:00.539600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9e41b683-33cb-4fe6-bfcf-07f8641f72b4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:00.549692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e41b683-33cb-4fe6-bfcf-07f8641f72b4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:00.550257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e41b683-33cb-4fe6-bfcf-07f8641f72b4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:00.550698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e41b683-33cb-4fe6-bfcf-07f8641f72b4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:00.551439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e41b683-33cb-4fe6-bfcf-07f8641f72b4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:00.552102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e41b683-33cb-4fe6-bfcf-07f8641f72b4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:00.552292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e41b683-33cb-4fe6-bfcf-07f8641f72b4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:00.566233 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=72 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:00.815052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:00.962730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9e41b683-33cb-4fe6-bfcf-07f8641f72b4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:00.973075 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9e41b683-33cb-4fe6-bfcf-07f8641f72b4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1311 microversion: 2.1 time: 0.438432 Oct 12 22:01:00.974984 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 207/484] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:00 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1311 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:01.998239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3438c9ab-c03b-40bb-a7b1-1a1aa3824833 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:01.999638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3438c9ab-c03b-40bb-a7b1-1a1aa3824833 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:02.006388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=7 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:02.009494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=68,nova_cell0:UPDATE=12 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:02.021939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3438c9ab-c03b-40bb-a7b1-1a1aa3824833 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:02.022405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3438c9ab-c03b-40bb-a7b1-1a1aa3824833 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:02.022819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3438c9ab-c03b-40bb-a7b1-1a1aa3824833 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:02.023546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3438c9ab-c03b-40bb-a7b1-1a1aa3824833 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:02.024858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3438c9ab-c03b-40bb-a7b1-1a1aa3824833 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:02.025519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3438c9ab-c03b-40bb-a7b1-1a1aa3824833 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:02.418916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-225969d9-55bb-4b34-9bda-87cf2b8aa137 req-6c580d1d-573e-4fdf-9ae9-f3ec8aef78bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3ca739-360b-4a87-8580-717e5eb56c4d", "name": "network-vif-plugged", "status": "completed", "tag": "2d514d69-05a5-4030-8d63-9876690cb34f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:02.441500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-225969d9-55bb-4b34-9bda-87cf2b8aa137 req-6c580d1d-573e-4fdf-9ae9-f3ec8aef78bc service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:02.441988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-225969d9-55bb-4b34-9bda-87cf2b8aa137 req-6c580d1d-573e-4fdf-9ae9-f3ec8aef78bc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:02.442426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-225969d9-55bb-4b34-9bda-87cf2b8aa137 req-6c580d1d-573e-4fdf-9ae9-f3ec8aef78bc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:02.468389 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-225969d9-55bb-4b34-9bda-87cf2b8aa137 req-6c580d1d-573e-4fdf-9ae9-f3ec8aef78bc service nova] Creating event network-vif-plugged:2d514d69-05a5-4030-8d63-9876690cb34f for instance bf3ca739-360b-4a87-8580-717e5eb56c4d on n-h1-861111-1 Oct 12 22:01:02.481110 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-225969d9-55bb-4b34-9bda-87cf2b8aa137 req-6c580d1d-573e-4fdf-9ae9-f3ec8aef78bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068122 Oct 12 22:01:02.483298 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 208/485] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:01:02.586254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3438c9ab-c03b-40bb-a7b1-1a1aa3824833 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:02.602556 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3438c9ab-c03b-40bb-a7b1-1a1aa3824833 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1311 microversion: 2.1 time: 0.607138 Oct 12 22:01:02.607288 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 278/486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:01 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1311 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:02.950821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fd1f3962-5c32-401d-846f-8547a1434673 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] Action: 'create', calling method: .version_select at 0x7f5128916f70>, body: {"pool": null} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:03.631503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4d88e9d4-46fe-4b90-b166-67171cce2daa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:03.633638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4d88e9d4-46fe-4b90-b166-67171cce2daa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:03.646814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d88e9d4-46fe-4b90-b166-67171cce2daa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:03.648158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d88e9d4-46fe-4b90-b166-67171cce2daa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:03.651285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d88e9d4-46fe-4b90-b166-67171cce2daa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:03.653093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d88e9d4-46fe-4b90-b166-67171cce2daa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:03.653923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d88e9d4-46fe-4b90-b166-67171cce2daa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:03.655956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d88e9d4-46fe-4b90-b166-67171cce2daa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:03.993963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4d88e9d4-46fe-4b90-b166-67171cce2daa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:04.004569 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4d88e9d4-46fe-4b90-b166-67171cce2daa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1311 microversion: 2.1 time: 0.378991 Oct 12 22:01:04.008272 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 279/487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:03 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1311 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:04.715953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8229a791-8d60-4e35-8726-5ae6ce3a58dd tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Calling method '.version_select at 0x7f51286d7310>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:04.721236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8229a791-8d60-4e35-8726-5ae6ce3a58dd tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:04.721743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8229a791-8d60-4e35-8726-5ae6ce3a58dd tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:04.723880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8229a791-8d60-4e35-8726-5ae6ce3a58dd tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:04.742307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8229a791-8d60-4e35-8726-5ae6ce3a58dd tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:04.742801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8229a791-8d60-4e35-8726-5ae6ce3a58dd tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:04.743315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8229a791-8d60-4e35-8726-5ae6ce3a58dd tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:04.776636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8229a791-8d60-4e35-8726-5ae6ce3a58dd tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:04.777347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8229a791-8d60-4e35-8726-5ae6ce3a58dd tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:04.779394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8229a791-8d60-4e35-8726-5ae6ce3a58dd tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:04.797962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8229a791-8d60-4e35-8726-5ae6ce3a58dd tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:04.798672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8229a791-8d60-4e35-8726-5ae6ce3a58dd tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:04.799287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8229a791-8d60-4e35-8726-5ae6ce3a58dd tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:04.828919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8229a791-8d60-4e35-8726-5ae6ce3a58dd tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:04.829614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8229a791-8d60-4e35-8726-5ae6ce3a58dd tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:04.830200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8229a791-8d60-4e35-8726-5ae6ce3a58dd tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:04.838573 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8229a791-8d60-4e35-8726-5ae6ce3a58dd tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.502276 Oct 12 22:01:04.840162 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 280/488] 10.222.0.16 () {60 vars in 1243 bytes} [Wed Oct 12 22:01:04 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:01:05.278716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-643797986", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "5ae941bf-bd6f-4323-8749-642d8a0b8a16"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:05.312611 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fd1f3962-5c32-401d-846f-8547a1434673 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.804424 Oct 12 22:01:05.314375 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 209/489] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 12 22:01:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:01:05.447294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] validate_networks() for [('5ae941bf-bd6f-4323-8749-642d8a0b8a16', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:01:05.547124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1888355325", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:05.557053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:05.632501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:01:06.317282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:01:06.317839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:01:06.322109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:01:06.323516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:01:06.324835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:01:06.340251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:06.340987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:06.342102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:06.342999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:06.343876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:06.344475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:06.394110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Getting quotas for project 4981423dcc384a8598796d56100551c4. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:01:06.416798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Getting quotas for user 1a512ddf866d4d36a686ecf9b67a58e9 and project 4981423dcc384a8598796d56100551c4. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:01:06.433620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:01:06.436799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: c6149ecf-bb8a-4f49-b8e8-6c71b862ff02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:01:06.502405 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d6fa6961-b1d3-4c0b-8ae2-2401d52e3926 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.186712 Oct 12 22:01:06.503880 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 210/490] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:01:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:01:06.512973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c6218820-74b9-43c7-8856-9058994bb2a0 tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Calling method '.version_select at 0x7f512899f820>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:06.517964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6218820-74b9-43c7-8856-9058994bb2a0 tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:06.518740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6218820-74b9-43c7-8856-9058994bb2a0 tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:06.519353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6218820-74b9-43c7-8856-9058994bb2a0 tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:06.550526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6218820-74b9-43c7-8856-9058994bb2a0 tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:06.551347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6218820-74b9-43c7-8856-9058994bb2a0 tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:06.551932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6218820-74b9-43c7-8856-9058994bb2a0 tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:06.590485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:01:06.591144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:01:06.592478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:01:06.593063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:01:06.594342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:01:06.598787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:06.615504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6218820-74b9-43c7-8856-9058994bb2a0 tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:06.616010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6218820-74b9-43c7-8856-9058994bb2a0 tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:06.616446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6218820-74b9-43c7-8856-9058994bb2a0 tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:06.631761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6218820-74b9-43c7-8856-9058994bb2a0 tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:06.632647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6218820-74b9-43c7-8856-9058994bb2a0 tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:06.633224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6218820-74b9-43c7-8856-9058994bb2a0 tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:06.656245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:06.657520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:06.661155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:06.664468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:06.665067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:06.667465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:06.692536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6218820-74b9-43c7-8856-9058994bb2a0 tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:06.693284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6218820-74b9-43c7-8856-9058994bb2a0 tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:06.693832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6218820-74b9-43c7-8856-9058994bb2a0 tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:06.703201 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c6218820-74b9-43c7-8856-9058994bb2a0 tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.198111 Oct 12 22:01:06.708414 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 211/491] 10.222.0.16 () {60 vars in 1222 bytes} [Wed Oct 12 22:01:06 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:01:06.715789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-77830def-0f35-4b19-be8c-8ff192395a87 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:06.717042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-77830def-0f35-4b19-be8c-8ff192395a87 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:06.719116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Getting quotas for project 8a51ee9af8d4461ea7deb6c9dcf2522e. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:01:06.730566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77830def-0f35-4b19-be8c-8ff192395a87 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:06.731907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77830def-0f35-4b19-be8c-8ff192395a87 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:06.733465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Getting quotas for user 1e9ee99f0c4f4aec8d001de2c4f7a28c and project 8a51ee9af8d4461ea7deb6c9dcf2522e. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:01:06.734021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77830def-0f35-4b19-be8c-8ff192395a87 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:06.735559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77830def-0f35-4b19-be8c-8ff192395a87 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:06.736146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77830def-0f35-4b19-be8c-8ff192395a87 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:06.736670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77830def-0f35-4b19-be8c-8ff192395a87 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:06.775859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:01:06.786087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:01:06.914468 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.072370 Oct 12 22:01:06.918324 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 281/492] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:01:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:01:07.000989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-81389add-f5c7-40f6-a113-88a2bbca13a8 tempest-NetworksTest-1921564619 tempest-NetworksTest-1921564619-project-admin] Calling method '.version_select at 0x7f51286b5040>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:07.084759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-77830def-0f35-4b19-be8c-8ff192395a87 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:07.139115 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-77830def-0f35-4b19-be8c-8ff192395a87 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1494 microversion: 2.1 time: 0.426782 Oct 12 22:01:07.143449 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 212/493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:06 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1494 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:07.175905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1abd23ad-db11-4d35-93e5-9b4ce6a3b838 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] Action: 'create', calling method: .version_select at 0x7f51289163a0>, body: {"pool": null} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:07.302292 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-81389add-f5c7-40f6-a113-88a2bbca13a8 tempest-NetworksTest-1921564619 tempest-NetworksTest-1921564619-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 6747 microversion: 2.1 time: 0.381873 Oct 12 22:01:07.303335 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 282/494] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:01:06 2022] GET /compute/v2.1/os-networks => generated 6747 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:07.308268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1555558f-f90b-444f-bbff-20f96f746cea tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:07.308995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1555558f-f90b-444f-bbff-20f96f746cea tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: c6149ecf-bb8a-4f49-b8e8-6c71b862ff02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:07.429558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1555558f-f90b-444f-bbff-20f96f746cea tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:07.445231 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1555558f-f90b-444f-bbff-20f96f746cea tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02" status: 200 len: 1222 microversion: 2.1 time: 0.140650 Oct 12 22:01:07.446515 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 283/495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:07 2022] GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 => generated 1222 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:07.454235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-be577481-5ce3-4ba5-9a1c-2ad245781f4b tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Calling method '.version_select at 0x7f51286b5940>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:07.458835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be577481-5ce3-4ba5-9a1c-2ad245781f4b tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:07.459613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be577481-5ce3-4ba5-9a1c-2ad245781f4b tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:07.460204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be577481-5ce3-4ba5-9a1c-2ad245781f4b tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:07.482556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be577481-5ce3-4ba5-9a1c-2ad245781f4b tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:07.483367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be577481-5ce3-4ba5-9a1c-2ad245781f4b tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:07.483992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be577481-5ce3-4ba5-9a1c-2ad245781f4b tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:07.511511 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-be577481-5ce3-4ba5-9a1c-2ad245781f4b tempest-HypervisorAdminV253TestBase-124153983 tempest-HypervisorAdminV253TestBase-124153983-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/37422469-11b9-4eb7-86ea-8943b872a72a" status: 200 len: 792 microversion: 2.53 time: 0.062616 Oct 12 22:01:07.512786 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 284/496] 10.222.0.16 () {60 vars in 1298 bytes} [Wed Oct 12 22:01:07 2022] GET /compute/v2.1/os-hypervisors/37422469-11b9-4eb7-86ea-8943b872a72a => generated 792 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:01:07.532449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d52b0fd2-fa2d-4bcb-913b-abeb0618a8a7 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:07.533518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d52b0fd2-fa2d-4bcb-913b-abeb0618a8a7 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:07.704474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d52b0fd2-fa2d-4bcb-913b-abeb0618a8a7 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9ee99f0c4f4aec8d001de2c4f7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a51ee9af8d4461ea7deb6c9dcf2522e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:07.716824 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d52b0fd2-fa2d-4bcb-913b-abeb0618a8a7 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e" status: 200 len: 1216 microversion: 2.1 time: 0.201728 Oct 12 22:01:07.718855 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 285/497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:07 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e => generated 1216 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:07.726068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02e2845c-c705-4c20-bbdb-c91f83c0ff3f tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:07.727000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-02e2845c-c705-4c20-bbdb-c91f83c0ff3f tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:07.736930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02e2845c-c705-4c20-bbdb-c91f83c0ff3f tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:07.738328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02e2845c-c705-4c20-bbdb-c91f83c0ff3f tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:07.739467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02e2845c-c705-4c20-bbdb-c91f83c0ff3f tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:07.740709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02e2845c-c705-4c20-bbdb-c91f83c0ff3f tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:07.741512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02e2845c-c705-4c20-bbdb-c91f83c0ff3f tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:07.742704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02e2845c-c705-4c20-bbdb-c91f83c0ff3f tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:08.200171 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-02e2845c-c705-4c20-bbdb-c91f83c0ff3f tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1645 microversion: 2.1 time: 0.479748 Oct 12 22:01:08.202855 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 286/498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:07 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1645 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:08.210493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4fd9c87c-45db-4f91-9c8d-a173aa609e7a tempest-NetworksTest-1921564619 tempest-NetworksTest-1921564619-project-admin] Calling method '.version_select at 0x7f51287c8550>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:08.740407 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4fd9c87c-45db-4f91-9c8d-a173aa609e7a tempest-NetworksTest-1921564619 tempest-NetworksTest-1921564619-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks/21b6d064-e8e1-4525-a9dd-3c2b7193f582" status: 200 len: 652 microversion: 2.1 time: 0.536101 Oct 12 22:01:08.741458 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 287/499] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 22:01:08 2022] GET /compute/v2.1/os-networks/21b6d064-e8e1-4525-a9dd-3c2b7193f582 => generated 652 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:08.746384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-df98bdfa-d7f7-4c7b-8d66-fc5b5a8214bb tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:08.747162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-df98bdfa-d7f7-4c7b-8d66-fc5b5a8214bb tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:08.759984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df98bdfa-d7f7-4c7b-8d66-fc5b5a8214bb tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:08.760669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df98bdfa-d7f7-4c7b-8d66-fc5b5a8214bb tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:08.761208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df98bdfa-d7f7-4c7b-8d66-fc5b5a8214bb tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:08.766195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df98bdfa-d7f7-4c7b-8d66-fc5b5a8214bb tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:08.767065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df98bdfa-d7f7-4c7b-8d66-fc5b5a8214bb tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:08.767915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df98bdfa-d7f7-4c7b-8d66-fc5b5a8214bb tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:09.047470 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-df98bdfa-d7f7-4c7b-8d66-fc5b5a8214bb tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1645 microversion: 2.1 time: 0.304733 Oct 12 22:01:09.059199 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 288/500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:08 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1645 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:09.064752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ff40bf5f-7a63-4337-bbc9-8961e9880e95 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:09.068730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ff40bf5f-7a63-4337-bbc9-8961e9880e95 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: c6149ecf-bb8a-4f49-b8e8-6c71b862ff02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:09.091464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff40bf5f-7a63-4337-bbc9-8961e9880e95 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:09.091972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff40bf5f-7a63-4337-bbc9-8961e9880e95 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:09.092418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff40bf5f-7a63-4337-bbc9-8961e9880e95 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:09.093130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff40bf5f-7a63-4337-bbc9-8961e9880e95 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:09.097863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff40bf5f-7a63-4337-bbc9-8961e9880e95 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:09.098506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff40bf5f-7a63-4337-bbc9-8961e9880e95 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:09.421001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ff40bf5f-7a63-4337-bbc9-8961e9880e95 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:09.439118 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ff40bf5f-7a63-4337-bbc9-8961e9880e95 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02" status: 200 len: 1280 microversion: 2.1 time: 0.378739 Oct 12 22:01:09.452693 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 289/501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:09 2022] GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 => generated 1280 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:09.459206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4af0b498-16bf-4ce4-9836-9d5b18034ecb tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:09.463067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4af0b498-16bf-4ce4-9836-9d5b18034ecb tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:09.482855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4af0b498-16bf-4ce4-9836-9d5b18034ecb tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:09.492827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4af0b498-16bf-4ce4-9836-9d5b18034ecb tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:09.493488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4af0b498-16bf-4ce4-9836-9d5b18034ecb tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:09.499545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4af0b498-16bf-4ce4-9836-9d5b18034ecb tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:09.513138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4af0b498-16bf-4ce4-9836-9d5b18034ecb tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:09.513964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4af0b498-16bf-4ce4-9836-9d5b18034ecb tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:09.603639 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1abd23ad-db11-4d35-93e5-9b4ce6a3b838 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.441564 Oct 12 22:01:09.605365 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 213/502] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 12 22:01:07 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:09.611485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dfa682d0-e6ad-44c4-9ad5-8eab391705d7 tempest-NetworksTest-1921564619 tempest-NetworksTest-1921564619-project-admin] Calling method '.version_select at 0x7f5128916040>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:09.692294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4af0b498-16bf-4ce4-9836-9d5b18034ecb tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9ee99f0c4f4aec8d001de2c4f7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a51ee9af8d4461ea7deb6c9dcf2522e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:09.710423 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4af0b498-16bf-4ce4-9836-9d5b18034ecb tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e" status: 200 len: 1286 microversion: 2.1 time: 0.248634 Oct 12 22:01:09.711741 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 290/503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:09 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e => generated 1286 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:09.726542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7af96b1b-c584-40ec-8882-391de1679205 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:09.750990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af96b1b-c584-40ec-8882-391de1679205 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:09.753591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af96b1b-c584-40ec-8882-391de1679205 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:09.758947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af96b1b-c584-40ec-8882-391de1679205 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:09.766020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af96b1b-c584-40ec-8882-391de1679205 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:09.767683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af96b1b-c584-40ec-8882-391de1679205 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:09.770147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af96b1b-c584-40ec-8882-391de1679205 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:09.797995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:09.826277 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7af96b1b-c584-40ec-8882-391de1679205 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.113206 Oct 12 22:01:09.828015 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 291/504] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 12 22:01:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:09.833927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e1092e60-eada-4a72-92c3-adb6dd3aeeae tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] Action: 'create', calling method: .version_select at 0x7f512873b550>, body: {"pool": null} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:09.876379 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dfa682d0-e6ad-44c4-9ad5-8eab391705d7 tempest-NetworksTest-1921564619 tempest-NetworksTest-1921564619-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 6747 microversion: 2.1 time: 0.269651 Oct 12 22:01:09.877639 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 214/505] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:01:09 2022] GET /compute/v2.1/os-networks => generated 6747 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:09.895126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ebcb008c-f61d-44c0-8a0c-b81f2fd40757 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:09.895930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ebcb008c-f61d-44c0-8a0c-b81f2fd40757 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:09.923444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebcb008c-f61d-44c0-8a0c-b81f2fd40757 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:09.924282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebcb008c-f61d-44c0-8a0c-b81f2fd40757 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:09.927157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebcb008c-f61d-44c0-8a0c-b81f2fd40757 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:09.929813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebcb008c-f61d-44c0-8a0c-b81f2fd40757 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:09.931220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebcb008c-f61d-44c0-8a0c-b81f2fd40757 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:09.935088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebcb008c-f61d-44c0-8a0c-b81f2fd40757 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:10.108084 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ebcb008c-f61d-44c0-8a0c-b81f2fd40757 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d/action" status: 202 len: 0 microversion: 2.1 time: 0.227902 Oct 12 22:01:10.109035 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 215/506] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:01:09 2022] POST /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:01:10.117716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d07f0cc7-1557-4b46-9072-e63664c10716 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:10.120025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d07f0cc7-1557-4b46-9072-e63664c10716 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:10.136312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d07f0cc7-1557-4b46-9072-e63664c10716 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:10.136966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d07f0cc7-1557-4b46-9072-e63664c10716 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:10.141734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d07f0cc7-1557-4b46-9072-e63664c10716 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:10.144318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d07f0cc7-1557-4b46-9072-e63664c10716 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:10.144856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d07f0cc7-1557-4b46-9072-e63664c10716 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:10.150081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d07f0cc7-1557-4b46-9072-e63664c10716 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:10.795500 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d07f0cc7-1557-4b46-9072-e63664c10716 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1650 microversion: 2.1 time: 0.681856 Oct 12 22:01:10.797203 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 216/507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:10 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1650 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:01:10.803429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-884bb589-b79e-45e9-a4aa-0ff0e60df2e4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:10.804317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-884bb589-b79e-45e9-a4aa-0ff0e60df2e4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: c6149ecf-bb8a-4f49-b8e8-6c71b862ff02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:10.866065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-884bb589-b79e-45e9-a4aa-0ff0e60df2e4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:10.869050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-884bb589-b79e-45e9-a4aa-0ff0e60df2e4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:10.871755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-884bb589-b79e-45e9-a4aa-0ff0e60df2e4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:10.885913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-884bb589-b79e-45e9-a4aa-0ff0e60df2e4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:10.889189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-884bb589-b79e-45e9-a4aa-0ff0e60df2e4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:10.892293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-884bb589-b79e-45e9-a4aa-0ff0e60df2e4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:11.403999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-884bb589-b79e-45e9-a4aa-0ff0e60df2e4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:11.418518 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-884bb589-b79e-45e9-a4aa-0ff0e60df2e4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02" status: 200 len: 1322 microversion: 2.1 time: 0.620044 Oct 12 22:01:11.421238 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 217/508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:10 2022] GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 => generated 1322 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:11.427267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3e84e78b-4e29-4f19-9c3b-5ab568e16870 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:11.428447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3e84e78b-4e29-4f19-9c3b-5ab568e16870 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:11.435605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e84e78b-4e29-4f19-9c3b-5ab568e16870 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:11.436689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e84e78b-4e29-4f19-9c3b-5ab568e16870 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:11.437439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e84e78b-4e29-4f19-9c3b-5ab568e16870 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:11.438750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e84e78b-4e29-4f19-9c3b-5ab568e16870 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:11.439488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e84e78b-4e29-4f19-9c3b-5ab568e16870 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:11.440130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e84e78b-4e29-4f19-9c3b-5ab568e16870 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:11.709616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3e84e78b-4e29-4f19-9c3b-5ab568e16870 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9ee99f0c4f4aec8d001de2c4f7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a51ee9af8d4461ea7deb6c9dcf2522e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:11.726265 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3e84e78b-4e29-4f19-9c3b-5ab568e16870 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e" status: 200 len: 1316 microversion: 2.1 time: 0.303087 Oct 12 22:01:11.728037 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 218/509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:11 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:11.824765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-64f18fda-a325-4117-a955-20428bd3925e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:11.825361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-64f18fda-a325-4117-a955-20428bd3925e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:11.833715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64f18fda-a325-4117-a955-20428bd3925e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:11.834205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64f18fda-a325-4117-a955-20428bd3925e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:11.834637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64f18fda-a325-4117-a955-20428bd3925e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:11.835365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64f18fda-a325-4117-a955-20428bd3925e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:11.835953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64f18fda-a325-4117-a955-20428bd3925e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:11.836406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64f18fda-a325-4117-a955-20428bd3925e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:12.404485 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-64f18fda-a325-4117-a955-20428bd3925e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1630 microversion: 2.1 time: 0.584790 Oct 12 22:01:12.406419 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 219/510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:11 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1630 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:12.435512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9e8d3cdc-6615-4916-a999-4d540792db03 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861111-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:12.439129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9e8d3cdc-6615-4916-a999-4d540792db03 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:12.446121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e8d3cdc-6615-4916-a999-4d540792db03 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:12.446878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e8d3cdc-6615-4916-a999-4d540792db03 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:12.447535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e8d3cdc-6615-4916-a999-4d540792db03 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:12.448416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e8d3cdc-6615-4916-a999-4d540792db03 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:12.449020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e8d3cdc-6615-4916-a999-4d540792db03 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:12.449594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e8d3cdc-6615-4916-a999-4d540792db03 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:12.536098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-9e8d3cdc-6615-4916-a999-4d540792db03 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lazy-loading 'flavor' on Instance uuid bf3ca739-360b-4a87-8580-717e5eb56c4d {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:01:12.617715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9e8d3cdc-6615-4916-a999-4d540792db03 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Going to try to live migrate instance to n-h2-861111-1 {{(pid=120452) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:01:14.707384 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e1092e60-eada-4a72-92c3-adb6dd3aeeae tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.877179 Oct 12 22:01:14.708308 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 292/511] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 12 22:01:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:14.713930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-065df29e-bdfe-47f8-9440-3fa90e616e9f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:14.715003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-065df29e-bdfe-47f8-9440-3fa90e616e9f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: c6149ecf-bb8a-4f49-b8e8-6c71b862ff02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:14.728315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-065df29e-bdfe-47f8-9440-3fa90e616e9f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:14.728834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-065df29e-bdfe-47f8-9440-3fa90e616e9f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:14.729278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-065df29e-bdfe-47f8-9440-3fa90e616e9f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:14.729992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-065df29e-bdfe-47f8-9440-3fa90e616e9f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:14.731989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-065df29e-bdfe-47f8-9440-3fa90e616e9f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:14.733290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-065df29e-bdfe-47f8-9440-3fa90e616e9f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:15.113645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-065df29e-bdfe-47f8-9440-3fa90e616e9f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:15.129346 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-065df29e-bdfe-47f8-9440-3fa90e616e9f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02" status: 200 len: 1322 microversion: 2.1 time: 0.414995 Oct 12 22:01:15.139763 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 293/512] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:14 2022] GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:15.154238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-608f5e3d-bab5-4648-8093-6c6907e2def0 req-dd925e14-4692-436b-b988-8288e88d3804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6149ecf-bb8a-4f49-b8e8-6c71b862ff02", "tag": "8681c0c6-77b2-4d54-8598-2268da43d266"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:15.184176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-608f5e3d-bab5-4648-8093-6c6907e2def0 req-dd925e14-4692-436b-b988-8288e88d3804 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:15.184951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-608f5e3d-bab5-4648-8093-6c6907e2def0 req-dd925e14-4692-436b-b988-8288e88d3804 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:15.187231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-608f5e3d-bab5-4648-8093-6c6907e2def0 req-dd925e14-4692-436b-b988-8288e88d3804 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:15.204340 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-608f5e3d-bab5-4648-8093-6c6907e2def0 req-dd925e14-4692-436b-b988-8288e88d3804 service nova] Creating event network-changed:8681c0c6-77b2-4d54-8598-2268da43d266 for instance c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 on n-h1-861111-1 Oct 12 22:01:15.210443 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-608f5e3d-bab5-4648-8093-6c6907e2def0 req-dd925e14-4692-436b-b988-8288e88d3804 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068619 Oct 12 22:01:15.211681 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 294/513] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:15.219606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7e2b56fd-1785-4390-b7ba-77907523ca19 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:15.220710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7e2b56fd-1785-4390-b7ba-77907523ca19 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:15.232937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e2b56fd-1785-4390-b7ba-77907523ca19 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:15.235936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e2b56fd-1785-4390-b7ba-77907523ca19 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:15.236664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e2b56fd-1785-4390-b7ba-77907523ca19 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:15.238130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e2b56fd-1785-4390-b7ba-77907523ca19 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:15.239227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e2b56fd-1785-4390-b7ba-77907523ca19 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:15.239847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e2b56fd-1785-4390-b7ba-77907523ca19 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:15.377437 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9e8d3cdc-6615-4916-a999-4d540792db03 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d/action" status: 202 len: 0 microversion: 2.1 time: 2.945497 Oct 12 22:01:15.382605 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 220/514] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:01:12 2022] POST /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d/action => generated 0 bytes in 2953 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:01:15.810586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7e2b56fd-1785-4390-b7ba-77907523ca19 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9ee99f0c4f4aec8d001de2c4f7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a51ee9af8d4461ea7deb6c9dcf2522e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:15.826549 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7e2b56fd-1785-4390-b7ba-77907523ca19 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e" status: 200 len: 1316 microversion: 2.1 time: 0.609156 Oct 12 22:01:15.828440 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 295/515] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:15 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e => generated 1316 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:15.839001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a9575841-6ce4-43c1-8b87-224a74d2563b req-15e8efc2-93ea-4c6f-a6be-14758b682615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93a4e60-4603-474b-9f37-ff08a1d26c3e", "tag": "cde5e7ae-703e-47d2-8fd2-8aae49dbde05"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:15.863016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a9575841-6ce4-43c1-8b87-224a74d2563b req-15e8efc2-93ea-4c6f-a6be-14758b682615 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:15.864351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a9575841-6ce4-43c1-8b87-224a74d2563b req-15e8efc2-93ea-4c6f-a6be-14758b682615 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:15.865791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a9575841-6ce4-43c1-8b87-224a74d2563b req-15e8efc2-93ea-4c6f-a6be-14758b682615 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:15.900968 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a9575841-6ce4-43c1-8b87-224a74d2563b req-15e8efc2-93ea-4c6f-a6be-14758b682615 service nova] Creating event network-changed:cde5e7ae-703e-47d2-8fd2-8aae49dbde05 for instance d93a4e60-4603-474b-9f37-ff08a1d26c3e on n-h1-861111-1 Oct 12 22:01:15.901776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1721309244", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:15.910108 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a9575841-6ce4-43c1-8b87-224a74d2563b req-15e8efc2-93ea-4c6f-a6be-14758b682615 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078518 Oct 12 22:01:15.916380 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 296/516] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:15.931208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c8b89dbb-7eb2-4dca-8192-d044cb48be92 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] Action: 'create', calling method: .version_select at 0x7f512873a1f0>, body: {"pool": null} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:16.003754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:01:16.342067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:01:16.342685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:01:16.343279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:01:16.343862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:01:16.344340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:01:16.356165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:16.356731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:16.357246 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:16.358130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:16.358780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:16.359203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:16.380596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Getting quotas for project feebe9edaa9c4104843143736f570e02. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:01:16.385893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Getting quotas for user 827d63bf6f35482691c64842c594e753 and project feebe9edaa9c4104843143736f570e02. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:01:16.398744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:01:16.401116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:01:16.450364 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c8cf503b-36d1-46b0-ba8f-a383f7abb31f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.066067 Oct 12 22:01:16.450932 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 221/517] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:01:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:01:16.456193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-38798cc5-29c8-4460-88a3-f6b6bf4cbc18 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:16.456963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-38798cc5-29c8-4460-88a3-f6b6bf4cbc18 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:16.464573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38798cc5-29c8-4460-88a3-f6b6bf4cbc18 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:16.465276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38798cc5-29c8-4460-88a3-f6b6bf4cbc18 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:16.465891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38798cc5-29c8-4460-88a3-f6b6bf4cbc18 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:16.466750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38798cc5-29c8-4460-88a3-f6b6bf4cbc18 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:16.467377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38798cc5-29c8-4460-88a3-f6b6bf4cbc18 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:16.467943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38798cc5-29c8-4460-88a3-f6b6bf4cbc18 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:16.843526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-38798cc5-29c8-4460-88a3-f6b6bf4cbc18 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:16.863620 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-38798cc5-29c8-4460-88a3-f6b6bf4cbc18 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1504 microversion: 2.1 time: 0.411255 Oct 12 22:01:16.867805 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 222/518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:16 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1504 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:17.005672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-def781a2-be33-4f8b-888b-3b9d233f4aad tempest-QuotaClassesAdmin257Test-1711382931 tempest-QuotaClassesAdmin257Test-1711382931-project-admin] Calling method '.version_select at 0x7f512899f820>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:17.053059 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-def781a2-be33-4f8b-888b-3b9d233f4aad tempest-QuotaClassesAdmin257Test-1711382931 tempest-QuotaClassesAdmin257Test-1711382931-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.178284 Oct 12 22:01:17.054077 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 223/519] 10.222.0.16 () {60 vars in 1226 bytes} [Wed Oct 12 22:01:16 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:01:17.066624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0208253f-1b45-4fc2-880e-80e8e61b152d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:17.067851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0208253f-1b45-4fc2-880e-80e8e61b152d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: c6149ecf-bb8a-4f49-b8e8-6c71b862ff02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:17.078483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0208253f-1b45-4fc2-880e-80e8e61b152d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:17.078984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0208253f-1b45-4fc2-880e-80e8e61b152d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:17.079531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0208253f-1b45-4fc2-880e-80e8e61b152d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:17.080176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0208253f-1b45-4fc2-880e-80e8e61b152d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:17.080751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0208253f-1b45-4fc2-880e-80e8e61b152d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:17.081217 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0208253f-1b45-4fc2-880e-80e8e61b152d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:17.599743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0208253f-1b45-4fc2-880e-80e8e61b152d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:17.615024 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0208253f-1b45-4fc2-880e-80e8e61b152d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02" status: 200 len: 1322 microversion: 2.1 time: 0.557356 Oct 12 22:01:17.617483 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 224/520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:17 2022] GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 => generated 1322 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:17.641801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4d3f331d-e700-44b2-b11a-02cff4847054 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:17.644084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4d3f331d-e700-44b2-b11a-02cff4847054 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:17.660169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d3f331d-e700-44b2-b11a-02cff4847054 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:17.661872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d3f331d-e700-44b2-b11a-02cff4847054 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:17.662776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d3f331d-e700-44b2-b11a-02cff4847054 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:17.664514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d3f331d-e700-44b2-b11a-02cff4847054 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:17.667038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d3f331d-e700-44b2-b11a-02cff4847054 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:17.667836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d3f331d-e700-44b2-b11a-02cff4847054 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:17.716223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=10 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:17.771102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:17.835332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4d3f331d-e700-44b2-b11a-02cff4847054 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:17.844836 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4d3f331d-e700-44b2-b11a-02cff4847054 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219" status: 200 len: 1271 microversion: 2.1 time: 0.223936 Oct 12 22:01:17.845427 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 225/521] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:17 2022] GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219 => generated 1271 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:17.850581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4086d92a-e4fc-4547-8a6d-8e9d55b54a51 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:17.851192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4086d92a-e4fc-4547-8a6d-8e9d55b54a51 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:17.857277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4086d92a-e4fc-4547-8a6d-8e9d55b54a51 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:17.857758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4086d92a-e4fc-4547-8a6d-8e9d55b54a51 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:17.858192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4086d92a-e4fc-4547-8a6d-8e9d55b54a51 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:17.858917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4086d92a-e4fc-4547-8a6d-8e9d55b54a51 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:17.859397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4086d92a-e4fc-4547-8a6d-8e9d55b54a51 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:17.859831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4086d92a-e4fc-4547-8a6d-8e9d55b54a51 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:18.114207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4086d92a-e4fc-4547-8a6d-8e9d55b54a51 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9ee99f0c4f4aec8d001de2c4f7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a51ee9af8d4461ea7deb6c9dcf2522e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:18.128150 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4086d92a-e4fc-4547-8a6d-8e9d55b54a51 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e" status: 200 len: 1316 microversion: 2.1 time: 0.281166 Oct 12 22:01:18.132386 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 226/522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:17 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:18.139021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-64f0a6e0-cdfb-48d0-b70f-05a5136affcb tempest-QuotaClassesAdmin257Test-1711382931 tempest-QuotaClassesAdmin257Test-1711382931-project-admin] Action: 'update', calling method: .version_select at 0x7f51287fcb80>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:18.336986 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-64f0a6e0-cdfb-48d0-b70f-05a5136affcb tempest-QuotaClassesAdmin257Test-1711382931 tempest-QuotaClassesAdmin257Test-1711382931-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.202790 Oct 12 22:01:18.338044 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 227/523] 10.222.0.16 () {62 vars in 1247 bytes} [Wed Oct 12 22:01:18 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:01:18.349925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-685b3b4f-f297-42ec-b697-bc1177a549ae req-b7db1ac5-d6fe-4ccd-8dfc-162fa05a035b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3ca739-360b-4a87-8580-717e5eb56c4d", "name": "network-vif-unplugged", "status": "completed", "tag": "2d514d69-05a5-4030-8d63-9876690cb34f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:18.378735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-685b3b4f-f297-42ec-b697-bc1177a549ae req-b7db1ac5-d6fe-4ccd-8dfc-162fa05a035b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:18.379707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-685b3b4f-f297-42ec-b697-bc1177a549ae req-b7db1ac5-d6fe-4ccd-8dfc-162fa05a035b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:18.379824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-685b3b4f-f297-42ec-b697-bc1177a549ae req-b7db1ac5-d6fe-4ccd-8dfc-162fa05a035b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:18.403171 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-685b3b4f-f297-42ec-b697-bc1177a549ae req-b7db1ac5-d6fe-4ccd-8dfc-162fa05a035b service nova] Creating event network-vif-unplugged:2d514d69-05a5-4030-8d63-9876690cb34f for instance bf3ca739-360b-4a87-8580-717e5eb56c4d on n-h1-861111-1 Oct 12 22:01:18.417626 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-685b3b4f-f297-42ec-b697-bc1177a549ae req-b7db1ac5-d6fe-4ccd-8dfc-162fa05a035b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074900 Oct 12 22:01:18.419779 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 228/524] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:18.434559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-353a09ac-4090-4915-a421-575b6db751e2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:18.436209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-353a09ac-4090-4915-a421-575b6db751e2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:18.454599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-353a09ac-4090-4915-a421-575b6db751e2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:18.455701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-353a09ac-4090-4915-a421-575b6db751e2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:18.458521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-353a09ac-4090-4915-a421-575b6db751e2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:18.459538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-353a09ac-4090-4915-a421-575b6db751e2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:18.460835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-353a09ac-4090-4915-a421-575b6db751e2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:18.463363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-353a09ac-4090-4915-a421-575b6db751e2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:18.900457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-353a09ac-4090-4915-a421-575b6db751e2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:18.911488 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-353a09ac-4090-4915-a421-575b6db751e2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1504 microversion: 2.1 time: 0.488672 Oct 12 22:01:18.915759 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 229/525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:18 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1504 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:18.923143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a08b26e9-7759-4e68-9ba7-f66ed6ce7bff tempest-QuotaClassesAdmin257Test-1711382931 tempest-QuotaClassesAdmin257Test-1711382931-project-admin] Calling method '.version_select at 0x7f5128744e50>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:18.954071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=45,nova_cell0:UPDATE=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:18.960997 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a08b26e9-7759-4e68-9ba7-f66ed6ce7bff tempest-QuotaClassesAdmin257Test-1711382931 tempest-QuotaClassesAdmin257Test-1711382931-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.044067 Oct 12 22:01:18.969198 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 230/526] 10.222.0.16 () {60 vars in 1226 bytes} [Wed Oct 12 22:01:18 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:01:18.974484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-810e55b6-b72e-4d25-9f72-a37fc5e0a4de tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:18.975375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-810e55b6-b72e-4d25-9f72-a37fc5e0a4de tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: c6149ecf-bb8a-4f49-b8e8-6c71b862ff02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:18.985360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-810e55b6-b72e-4d25-9f72-a37fc5e0a4de tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:18.986931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-810e55b6-b72e-4d25-9f72-a37fc5e0a4de tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:18.987586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-810e55b6-b72e-4d25-9f72-a37fc5e0a4de tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:18.988498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-810e55b6-b72e-4d25-9f72-a37fc5e0a4de tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:18.989297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-810e55b6-b72e-4d25-9f72-a37fc5e0a4de tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:18.989878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-810e55b6-b72e-4d25-9f72-a37fc5e0a4de tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:19.043545 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c8b89dbb-7eb2-4dca-8192-d044cb48be92 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.124710 Oct 12 22:01:19.045007 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 297/527] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 12 22:01:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:19.050432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e6a4ad34-bb20-4d0c-acc6-e3ca2926ea06 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:19.051357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e6a4ad34-bb20-4d0c-acc6-e3ca2926ea06 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:19.072855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6a4ad34-bb20-4d0c-acc6-e3ca2926ea06 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:19.073294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6a4ad34-bb20-4d0c-acc6-e3ca2926ea06 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:19.073735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6a4ad34-bb20-4d0c-acc6-e3ca2926ea06 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:19.074446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6a4ad34-bb20-4d0c-acc6-e3ca2926ea06 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:19.074901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6a4ad34-bb20-4d0c-acc6-e3ca2926ea06 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:19.075359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6a4ad34-bb20-4d0c-acc6-e3ca2926ea06 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:19.184736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e6a4ad34-bb20-4d0c-acc6-e3ca2926ea06 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:19.194539 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e6a4ad34-bb20-4d0c-acc6-e3ca2926ea06 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219" status: 200 len: 1277 microversion: 2.1 time: 0.148315 Oct 12 22:01:19.195855 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 298/528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:19 2022] GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219 => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:19.211226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8f540e0e-456a-4c48-b802-187eae90451b tempest-QuotaClassesAdmin257Test-1711382931 tempest-QuotaClassesAdmin257Test-1711382931-project-admin] Action: 'update', calling method: .version_select at 0x7f51286d7040>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:19.284950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-810e55b6-b72e-4d25-9f72-a37fc5e0a4de tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:19.299793 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-810e55b6-b72e-4d25-9f72-a37fc5e0a4de tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02" status: 200 len: 1322 microversion: 2.1 time: 0.329068 Oct 12 22:01:19.301808 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 231/529] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:18 2022] GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:19.307899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a94f9b5a-5646-467b-8939-dd11a4b99bd2 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] Calling method '.version_select at 0x7f512875c430>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:19.314737 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8f540e0e-456a-4c48-b802-187eae90451b tempest-QuotaClassesAdmin257Test-1711382931 tempest-QuotaClassesAdmin257Test-1711382931-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.117699 Oct 12 22:01:19.316235 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 299/530] 10.222.0.16 () {62 vars in 1247 bytes} [Wed Oct 12 22:01:19 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:01:19.331055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-304839b6-fd16-451a-93ed-6cd45130ad18 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:19.331914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-304839b6-fd16-451a-93ed-6cd45130ad18 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:19.340817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-304839b6-fd16-451a-93ed-6cd45130ad18 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:19.341905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-304839b6-fd16-451a-93ed-6cd45130ad18 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:19.342637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-304839b6-fd16-451a-93ed-6cd45130ad18 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:19.343726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-304839b6-fd16-451a-93ed-6cd45130ad18 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:19.344411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-304839b6-fd16-451a-93ed-6cd45130ad18 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:19.345507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-304839b6-fd16-451a-93ed-6cd45130ad18 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:19.547549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-304839b6-fd16-451a-93ed-6cd45130ad18 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9ee99f0c4f4aec8d001de2c4f7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a51ee9af8d4461ea7deb6c9dcf2522e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:19.560478 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-304839b6-fd16-451a-93ed-6cd45130ad18 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e" status: 200 len: 1316 microversion: 2.1 time: 0.241405 Oct 12 22:01:19.561759 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 300/531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:19 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:19.661240 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a94f9b5a-5646-467b-8939-dd11a4b99bd2 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/f7b6118a-6112-4962-9363-c5972542138a" status: 200 len: 142 microversion: 2.1 time: 0.358249 Oct 12 22:01:19.661823 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 232/532] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 12 22:01:19 2022] GET /compute/v2.1/os-floating-ips/f7b6118a-6112-4962-9363-c5972542138a => generated 142 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:19.675820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0b16f403-a14c-41f1-9b5b-6e63bd1c95f6 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] Calling method '.version_select at 0x7f512866b9d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:19.795887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:19.934108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0c3363c5-51f6-4d2b-9eec-b48eac3aabe0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:19.934718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0c3363c5-51f6-4d2b-9eec-b48eac3aabe0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:19.952161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c3363c5-51f6-4d2b-9eec-b48eac3aabe0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:19.952527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c3363c5-51f6-4d2b-9eec-b48eac3aabe0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:19.952966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c3363c5-51f6-4d2b-9eec-b48eac3aabe0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:19.954188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c3363c5-51f6-4d2b-9eec-b48eac3aabe0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:19.954643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c3363c5-51f6-4d2b-9eec-b48eac3aabe0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:19.955063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c3363c5-51f6-4d2b-9eec-b48eac3aabe0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:20.779604 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0b16f403-a14c-41f1-9b5b-6e63bd1c95f6 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/f7b6118a-6112-4962-9363-c5972542138a" status: 202 len: 0 microversion: 2.1 time: 1.108633 Oct 12 22:01:20.781003 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 301/533] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:01:19 2022] DELETE /compute/v2.1/os-floating-ips/f7b6118a-6112-4962-9363-c5972542138a => generated 0 bytes in 1111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:01:20.788654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-312282e5-efa9-4d70-841d-17003a276a24 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:20.789764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-312282e5-efa9-4d70-841d-17003a276a24 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:20.801549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-312282e5-efa9-4d70-841d-17003a276a24 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:20.802925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-312282e5-efa9-4d70-841d-17003a276a24 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:20.805891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-312282e5-efa9-4d70-841d-17003a276a24 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:20.810520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-312282e5-efa9-4d70-841d-17003a276a24 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:20.811745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-312282e5-efa9-4d70-841d-17003a276a24 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:20.812523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-312282e5-efa9-4d70-841d-17003a276a24 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:20.822172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0c3363c5-51f6-4d2b-9eec-b48eac3aabe0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:20.841448 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0c3363c5-51f6-4d2b-9eec-b48eac3aabe0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1504 microversion: 2.1 time: 0.911238 Oct 12 22:01:20.844265 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 233/534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:19 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1504 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:01:20.862316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cbcb4e82-2337-4c11-9269-c09547a4ca03 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:20.866288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cbcb4e82-2337-4c11-9269-c09547a4ca03 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: c6149ecf-bb8a-4f49-b8e8-6c71b862ff02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:20.883440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbcb4e82-2337-4c11-9269-c09547a4ca03 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:20.884106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbcb4e82-2337-4c11-9269-c09547a4ca03 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:20.884568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbcb4e82-2337-4c11-9269-c09547a4ca03 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:20.885570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbcb4e82-2337-4c11-9269-c09547a4ca03 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:20.886034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbcb4e82-2337-4c11-9269-c09547a4ca03 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:20.886466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbcb4e82-2337-4c11-9269-c09547a4ca03 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:21.378533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cbcb4e82-2337-4c11-9269-c09547a4ca03 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:21.387666 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cbcb4e82-2337-4c11-9269-c09547a4ca03 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02" status: 200 len: 1322 microversion: 2.1 time: 0.541451 Oct 12 22:01:21.391428 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 234/535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:20 2022] GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:21.396793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-312282e5-efa9-4d70-841d-17003a276a24 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:21.402021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-5ca6bba2-f467-467c-8c3c-369e01f4ca2a req-ba061e81-735e-4539-899f-a97d9238cce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6149ecf-bb8a-4f49-b8e8-6c71b862ff02", "name": "network-vif-plugged", "status": "completed", "tag": "8681c0c6-77b2-4d54-8598-2268da43d266"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:21.414925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:UPDATE=7 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:21.415653 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-312282e5-efa9-4d70-841d-17003a276a24 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219" status: 200 len: 1319 microversion: 2.1 time: 0.632678 Oct 12 22:01:21.420988 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 302/536] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:20 2022] GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219 => generated 1319 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:21.428576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5ca6bba2-f467-467c-8c3c-369e01f4ca2a req-ba061e81-735e-4539-899f-a97d9238cce2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:21.429059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5ca6bba2-f467-467c-8c3c-369e01f4ca2a req-ba061e81-735e-4539-899f-a97d9238cce2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:21.432026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5ca6bba2-f467-467c-8c3c-369e01f4ca2a req-ba061e81-735e-4539-899f-a97d9238cce2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:21.450719 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-5ca6bba2-f467-467c-8c3c-369e01f4ca2a req-ba061e81-735e-4539-899f-a97d9238cce2 service nova] Creating event network-vif-plugged:8681c0c6-77b2-4d54-8598-2268da43d266 for instance c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 on n-h1-861111-1 Oct 12 22:01:21.453120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d63d3c6b-bc03-4119-90dd-304915763188 req-e0fd931e-ffd5-441a-98fe-60b1ef296ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3ca739-360b-4a87-8580-717e5eb56c4d", "tag": "2d514d69-05a5-4030-8d63-9876690cb34f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:21.478296 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-5ca6bba2-f467-467c-8c3c-369e01f4ca2a req-ba061e81-735e-4539-899f-a97d9238cce2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078611 Oct 12 22:01:21.478988 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 235/537] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:21.493676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-78625a8e-aa32-49ca-ad0c-a655842892b6 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:21.494413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-78625a8e-aa32-49ca-ad0c-a655842892b6 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:21.506854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d63d3c6b-bc03-4119-90dd-304915763188 req-e0fd931e-ffd5-441a-98fe-60b1ef296ac1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:21.512348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d63d3c6b-bc03-4119-90dd-304915763188 req-e0fd931e-ffd5-441a-98fe-60b1ef296ac1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:21.513240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d63d3c6b-bc03-4119-90dd-304915763188 req-e0fd931e-ffd5-441a-98fe-60b1ef296ac1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:21.527228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78625a8e-aa32-49ca-ad0c-a655842892b6 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:21.528384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78625a8e-aa32-49ca-ad0c-a655842892b6 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:21.528987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78625a8e-aa32-49ca-ad0c-a655842892b6 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:21.529902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78625a8e-aa32-49ca-ad0c-a655842892b6 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:21.531188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78625a8e-aa32-49ca-ad0c-a655842892b6 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:21.531807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78625a8e-aa32-49ca-ad0c-a655842892b6 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:21.576166 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d63d3c6b-bc03-4119-90dd-304915763188 req-e0fd931e-ffd5-441a-98fe-60b1ef296ac1 service nova] Creating event network-changed:2d514d69-05a5-4030-8d63-9876690cb34f for instance bf3ca739-360b-4a87-8580-717e5eb56c4d on n-h1-861111-1 Oct 12 22:01:21.599567 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d63d3c6b-bc03-4119-90dd-304915763188 req-e0fd931e-ffd5-441a-98fe-60b1ef296ac1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161156 Oct 12 22:01:21.604697 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 303/538] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:21.622235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-baf659d4-139e-4b89-973d-eea1795f0e4a tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] Calling method '.version_select at 0x7f51286d7040>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:21.996261 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-baf659d4-139e-4b89-973d-eea1795f0e4a tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.390043 Oct 12 22:01:21.997226 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 304/539] 10.222.0.16 () {58 vars in 1164 bytes} [Wed Oct 12 22:01:21 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:01:22.003829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cee5993d-fbd9-43c4-ba0d-67f560276966 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:22.004570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cee5993d-fbd9-43c4-ba0d-67f560276966 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:22.020698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cee5993d-fbd9-43c4-ba0d-67f560276966 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:22.022551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cee5993d-fbd9-43c4-ba0d-67f560276966 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:22.024362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cee5993d-fbd9-43c4-ba0d-67f560276966 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:22.026576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cee5993d-fbd9-43c4-ba0d-67f560276966 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:22.027292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cee5993d-fbd9-43c4-ba0d-67f560276966 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:22.029813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cee5993d-fbd9-43c4-ba0d-67f560276966 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:22.160538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-78625a8e-aa32-49ca-ad0c-a655842892b6 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9ee99f0c4f4aec8d001de2c4f7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a51ee9af8d4461ea7deb6c9dcf2522e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:22.171088 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-78625a8e-aa32-49ca-ad0c-a655842892b6 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e" status: 200 len: 1316 microversion: 2.1 time: 0.689156 Oct 12 22:01:22.171726 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 236/540] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:21 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e => generated 1316 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:22.188588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dc9c3cdd-8d6b-446a-9cd5-217f2c3c54d8 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] Calling method '.version_select at 0x7f5128722c10>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:22.419338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cee5993d-fbd9-43c4-ba0d-67f560276966 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:22.431674 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cee5993d-fbd9-43c4-ba0d-67f560276966 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1504 microversion: 2.1 time: 0.432512 Oct 12 22:01:22.436370 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 305/541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:21 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1504 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:22.446516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bc3815da-a270-4395-9284-c812c0c967c6 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:22.450888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bc3815da-a270-4395-9284-c812c0c967c6 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: c6149ecf-bb8a-4f49-b8e8-6c71b862ff02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:22.462997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc3815da-a270-4395-9284-c812c0c967c6 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:22.465387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc3815da-a270-4395-9284-c812c0c967c6 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:22.465913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc3815da-a270-4395-9284-c812c0c967c6 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:22.466710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc3815da-a270-4395-9284-c812c0c967c6 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:22.468589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc3815da-a270-4395-9284-c812c0c967c6 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:22.471309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc3815da-a270-4395-9284-c812c0c967c6 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:22.751614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bc3815da-a270-4395-9284-c812c0c967c6 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:22.763597 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bc3815da-a270-4395-9284-c812c0c967c6 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02" status: 200 len: 1322 microversion: 2.1 time: 0.325969 Oct 12 22:01:22.764912 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 306/542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:22 2022] GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:22.783390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ba5975ba-a819-4203-a926-33aabb676b46 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:22.784316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ba5975ba-a819-4203-a926-33aabb676b46 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:22.793158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba5975ba-a819-4203-a926-33aabb676b46 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:22.793994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba5975ba-a819-4203-a926-33aabb676b46 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:22.795102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba5975ba-a819-4203-a926-33aabb676b46 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:22.796061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba5975ba-a819-4203-a926-33aabb676b46 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:22.796744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba5975ba-a819-4203-a926-33aabb676b46 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:22.797399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba5975ba-a819-4203-a926-33aabb676b46 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:22.806241 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dc9c3cdd-8d6b-446a-9cd5-217f2c3c54d8 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.633579 Oct 12 22:01:22.816508 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 237/543] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 12 22:01:22 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:22.822655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dea1ff70-bbae-468b-a20c-04632ce5f460 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] Calling method '.version_select at 0x7f5128735160>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:23.044478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ba5975ba-a819-4203-a926-33aabb676b46 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:23.062330 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ba5975ba-a819-4203-a926-33aabb676b46 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219" status: 200 len: 1319 microversion: 2.1 time: 0.295278 Oct 12 22:01:23.064186 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 307/544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:22 2022] GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:23.197987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-765f941c-c447-46ee-8845-799a7d336460 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:23.199375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-765f941c-c447-46ee-8845-799a7d336460 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:23.211939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-765f941c-c447-46ee-8845-799a7d336460 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:23.212441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-765f941c-c447-46ee-8845-799a7d336460 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:23.218411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-765f941c-c447-46ee-8845-799a7d336460 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:23.219317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-765f941c-c447-46ee-8845-799a7d336460 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:23.219799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-765f941c-c447-46ee-8845-799a7d336460 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:23.220246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-765f941c-c447-46ee-8845-799a7d336460 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:23.901357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-765f941c-c447-46ee-8845-799a7d336460 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9ee99f0c4f4aec8d001de2c4f7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a51ee9af8d4461ea7deb6c9dcf2522e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:23.909660 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-765f941c-c447-46ee-8845-799a7d336460 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e" status: 200 len: 1316 microversion: 2.1 time: 0.719344 Oct 12 22:01:23.927676 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 308/545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:23 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e => generated 1316 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:23.943900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cc6e8cf5-4a29-439e-91f4-564b0a41ae5c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:23.944916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cc6e8cf5-4a29-439e-91f4-564b0a41ae5c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:23.950958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc6e8cf5-4a29-439e-91f4-564b0a41ae5c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:23.960018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc6e8cf5-4a29-439e-91f4-564b0a41ae5c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:23.960473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc6e8cf5-4a29-439e-91f4-564b0a41ae5c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:23.961219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc6e8cf5-4a29-439e-91f4-564b0a41ae5c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:23.961679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc6e8cf5-4a29-439e-91f4-564b0a41ae5c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:23.962107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc6e8cf5-4a29-439e-91f4-564b0a41ae5c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:24.333854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cc6e8cf5-4a29-439e-91f4-564b0a41ae5c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:24.346775 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cc6e8cf5-4a29-439e-91f4-564b0a41ae5c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1504 microversion: 2.1 time: 0.417345 Oct 12 22:01:24.347378 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 309/546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:23 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1504 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:24.360923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-6a5fffef-c023-4c56-a713-6860d25881fe req-27c4d4a0-aae8-4f78-9b29-d3d6022a805c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93a4e60-4603-474b-9f37-ff08a1d26c3e", "name": "network-vif-plugged", "status": "completed", "tag": "cde5e7ae-703e-47d2-8fd2-8aae49dbde05"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:24.391153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6a5fffef-c023-4c56-a713-6860d25881fe req-27c4d4a0-aae8-4f78-9b29-d3d6022a805c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:24.392382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6a5fffef-c023-4c56-a713-6860d25881fe req-27c4d4a0-aae8-4f78-9b29-d3d6022a805c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:24.393314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6a5fffef-c023-4c56-a713-6860d25881fe req-27c4d4a0-aae8-4f78-9b29-d3d6022a805c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:24.406352 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6a5fffef-c023-4c56-a713-6860d25881fe req-27c4d4a0-aae8-4f78-9b29-d3d6022a805c service nova] Creating event network-vif-plugged:cde5e7ae-703e-47d2-8fd2-8aae49dbde05 for instance d93a4e60-4603-474b-9f37-ff08a1d26c3e on n-h1-861111-1 Oct 12 22:01:24.415070 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-6a5fffef-c023-4c56-a713-6860d25881fe req-27c4d4a0-aae8-4f78-9b29-d3d6022a805c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064608 Oct 12 22:01:24.416065 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 310/547] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:24.429248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-84a3ecbb-0d70-4664-bef8-2ebf80d93e81 req-4cac5a4f-01f4-46ee-9a9c-8e611e3fbbd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37440ed5-600e-4a41-80ce-a48643705219", "tag": "1a9a1d71-0ce0-4b2e-8d76-437ca3759607"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:24.454892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-84a3ecbb-0d70-4664-bef8-2ebf80d93e81 req-4cac5a4f-01f4-46ee-9a9c-8e611e3fbbd6 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:24.457697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-84a3ecbb-0d70-4664-bef8-2ebf80d93e81 req-4cac5a4f-01f4-46ee-9a9c-8e611e3fbbd6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:24.460046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-84a3ecbb-0d70-4664-bef8-2ebf80d93e81 req-4cac5a4f-01f4-46ee-9a9c-8e611e3fbbd6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:24.490473 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-84a3ecbb-0d70-4664-bef8-2ebf80d93e81 req-4cac5a4f-01f4-46ee-9a9c-8e611e3fbbd6 service nova] Creating event network-changed:1a9a1d71-0ce0-4b2e-8d76-437ca3759607 for instance 37440ed5-600e-4a41-80ce-a48643705219 on n-h2-861111-1 Oct 12 22:01:24.505845 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-84a3ecbb-0d70-4664-bef8-2ebf80d93e81 req-4cac5a4f-01f4-46ee-9a9c-8e611e3fbbd6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084990 Oct 12 22:01:24.507059 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 311/548] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:24.522258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b090cc54-2d83-4ac6-93de-83dc7c6ae227 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:24.524335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b090cc54-2d83-4ac6-93de-83dc7c6ae227 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: c6149ecf-bb8a-4f49-b8e8-6c71b862ff02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:24.534281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b090cc54-2d83-4ac6-93de-83dc7c6ae227 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:24.535009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b090cc54-2d83-4ac6-93de-83dc7c6ae227 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:24.535688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b090cc54-2d83-4ac6-93de-83dc7c6ae227 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:24.536897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b090cc54-2d83-4ac6-93de-83dc7c6ae227 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:24.537527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b090cc54-2d83-4ac6-93de-83dc7c6ae227 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:24.538392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b090cc54-2d83-4ac6-93de-83dc7c6ae227 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:24.903900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b090cc54-2d83-4ac6-93de-83dc7c6ae227 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:24.911693 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b090cc54-2d83-4ac6-93de-83dc7c6ae227 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02" status: 200 len: 1472 microversion: 2.1 time: 0.402435 Oct 12 22:01:24.912261 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 312/549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:24 2022] GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 => generated 1472 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:24.927898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8ba0168b-2746-4a97-bf60-c798d64f6968 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:24.928822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8ba0168b-2746-4a97-bf60-c798d64f6968 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:24.938190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ba0168b-2746-4a97-bf60-c798d64f6968 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:24.944500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ba0168b-2746-4a97-bf60-c798d64f6968 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:24.945047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ba0168b-2746-4a97-bf60-c798d64f6968 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:24.946362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ba0168b-2746-4a97-bf60-c798d64f6968 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:24.947718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ba0168b-2746-4a97-bf60-c798d64f6968 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:24.956030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ba0168b-2746-4a97-bf60-c798d64f6968 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:25.107735 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dea1ff70-bbae-468b-a20c-04632ce5f460 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/ef7d0f6b-1980-43cb-b4cb-d02da03d96a2" status: 202 len: 0 microversion: 2.1 time: 2.289500 Oct 12 22:01:25.108489 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 238/550] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:01:22 2022] DELETE /compute/v2.1/os-floating-ips/ef7d0f6b-1980-43cb-b4cb-d02da03d96a2 => generated 0 bytes in 2291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:01:25.365601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8ba0168b-2746-4a97-bf60-c798d64f6968 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:25.393569 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8ba0168b-2746-4a97-bf60-c798d64f6968 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219" status: 200 len: 1319 microversion: 2.1 time: 0.467864 Oct 12 22:01:25.394859 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 313/551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:24 2022] GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:25.397618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c5784f30-db75-412c-976e-a0c6c8b42ae9 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:25.398368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c5784f30-db75-412c-976e-a0c6c8b42ae9 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] [instance: 7b947c70-ab01-437a-99e6-2e12f22499e6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:25.406996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02ba6be7-fbf2-4940-9c10-7b53e4506148 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:25.408545 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-c5784f30-db75-412c-976e-a0c6c8b42ae9 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] HTTP exception thrown: Instance 7b947c70-ab01-437a-99e6-2e12f22499e6 could not be found. Oct 12 22:01:25.409603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-02ba6be7-fbf2-4940-9c10-7b53e4506148 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c5784f30-db75-412c-976e-a0c6c8b42ae9 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Request method failure captured: Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/7b947c70-ab01-437a-99e6-2e12f22499e6/action HTTP/1.1 Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 15 Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzkgBcOvZilpTp-Q0MUHMih-ULHv9xaN2mhq_1meDtU4aqy3f4QxmWD1qUdM9ztsvqY1_QZSSjkF_XSNW_TV-OO3N14LwuCvzPeOF9WKQ3yisFuhIc_RVGLJAes0KBTURBfz_SO_zwegcjPsEjBzg1MNBWCj687nj8y7hJspOg8A_4M Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1f79807d8f1b4e7fb30e01db0dab1330 Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-577172057 Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 22:01:25.411841 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 22:01:25.413170 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f79807d8f1b4e7fb30e01db0dab1330"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f79807d8f1b4e7fb30e01db0dab1330"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1f79807d8f1b4e7fb30e01db0dab1330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1f79807d8f1b4e7fb30e01db0dab1330"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:01:25.413170 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersAdminNegativeTestJSON-577172057 Oct 12 22:01:25.413170 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1f79807d8f1b4e7fb30e01db0dab1330 Oct 12 22:01:25.413170 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-577172057 Oct 12 22:01:25.413170 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersAdminNegativeTestJSON-577172057-project-admin Oct 12 22:01:25.413170 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:01:25.413170 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:01:25.413170 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 0e51ae21b8e54fd9a4caf6361a1df67a Oct 12 22:01:25.413170 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersAdminNegativeTestJSON-577172057-project-admin Oct 12 22:01:25.413170 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:01:25.413170 n-d-861111-1 devstack@n-api.service[120452]: {"migrate": {}} Oct 12 22:01:25.413170 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:01:25.413170 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 7b947c70-ab01-437a-99e6-2e12f22499e6 could not be found. Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '7b947c70-ab01-437a-99e6-2e12f22499e6', 'body': {'migrate': {}}} Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b947c70-ab01-437a-99e6-2e12f22499e6 could not be found. Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:01:25.413939 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:01:25.416047 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:01:25.416047 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:01:25.416047 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 12 22:01:25.416047 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 12 22:01:25.416047 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:01:25.416047 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:01:25.416047 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b947c70-ab01-437a-99e6-2e12f22499e6 could not be found. Oct 12 22:01:25.416047 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:25.416047 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:01:25.416047 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:25.416047 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:25.416047 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:01:25.416047 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:01:25.416047 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:01:25.416047 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:01:25.416047 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b947c70-ab01-437a-99e6-2e12f22499e6 could not be found. Oct 12 22:01:25.416047 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:25.418338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c5784f30-db75-412c-976e-a0c6c8b42ae9 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Returning 404 to user: Instance 7b947c70-ab01-437a-99e6-2e12f22499e6 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:01:25.418338 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c5784f30-db75-412c-976e-a0c6c8b42ae9 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7b947c70-ab01-437a-99e6-2e12f22499e6/action" status: 404 len: 111 microversion: 2.1 time: 0.303804 Oct 12 22:01:25.418338 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 239/552] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:01:25 2022] POST /compute/v2.1/servers/7b947c70-ab01-437a-99e6-2e12f22499e6/action => generated 111 bytes in 305 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:01:25.419412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-deed2973-7753-404a-9544-4c091dbccf42 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] Calling method '.version_select at 0x7f51287fcca0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:25.423378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02ba6be7-fbf2-4940-9c10-7b53e4506148 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:25.424620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02ba6be7-fbf2-4940-9c10-7b53e4506148 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:25.425145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02ba6be7-fbf2-4940-9c10-7b53e4506148 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:25.426491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02ba6be7-fbf2-4940-9c10-7b53e4506148 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:25.426691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02ba6be7-fbf2-4940-9c10-7b53e4506148 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:25.427366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02ba6be7-fbf2-4940-9c10-7b53e4506148 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:25.698783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-02ba6be7-fbf2-4940-9c10-7b53e4506148 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9ee99f0c4f4aec8d001de2c4f7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a51ee9af8d4461ea7deb6c9dcf2522e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:25.707839 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-02ba6be7-fbf2-4940-9c10-7b53e4506148 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e" status: 200 len: 1316 microversion: 2.1 time: 0.311539 Oct 12 22:01:25.719659 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 314/553] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:25 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:25.730070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c8fdc368-6660-473c-a4aa-3a08660e7ff4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:25.731041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c8fdc368-6660-473c-a4aa-3a08660e7ff4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:25.737785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8fdc368-6660-473c-a4aa-3a08660e7ff4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:25.738587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8fdc368-6660-473c-a4aa-3a08660e7ff4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:25.739310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8fdc368-6660-473c-a4aa-3a08660e7ff4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:25.740319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8fdc368-6660-473c-a4aa-3a08660e7ff4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:25.740975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8fdc368-6660-473c-a4aa-3a08660e7ff4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:25.741619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8fdc368-6660-473c-a4aa-3a08660e7ff4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:25.989382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c8fdc368-6660-473c-a4aa-3a08660e7ff4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:26.019711 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c8fdc368-6660-473c-a4aa-3a08660e7ff4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1504 microversion: 2.1 time: 0.296280 Oct 12 22:01:26.021583 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 315/554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:25 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:26.030925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1343332702", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:26.176370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] validate_networks() for None {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:01:26.367774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:26.436232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:01:26.437276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:01:26.438133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:01:26.438781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:01:26.439778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:01:26.450559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:26.451217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:26.451676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:26.453732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:26.454358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:26.454788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:26.474496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Getting quotas for project 4981423dcc384a8598796d56100551c4. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:01:26.482094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Getting quotas for user 1a512ddf866d4d36a686ecf9b67a58e9 and project 4981423dcc384a8598796d56100551c4. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:01:26.494104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=7 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:26.495865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:01:26.498486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:01:26.553426 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4aa2e7e3-0c6d-4a25-983c-927f2f64d1cf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530500 Oct 12 22:01:26.559349 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 316/555] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:01:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:01:26.567307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-25de61d6-4d60-4474-bc56-9faecc79ffae tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:26.569673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-25de61d6-4d60-4474-bc56-9faecc79ffae tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:26.588037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25de61d6-4d60-4474-bc56-9faecc79ffae tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:26.590026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25de61d6-4d60-4474-bc56-9faecc79ffae tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:26.590849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25de61d6-4d60-4474-bc56-9faecc79ffae tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:26.592181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25de61d6-4d60-4474-bc56-9faecc79ffae tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:26.593578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25de61d6-4d60-4474-bc56-9faecc79ffae tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:26.594455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25de61d6-4d60-4474-bc56-9faecc79ffae tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:26.641812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:26.833951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-25de61d6-4d60-4474-bc56-9faecc79ffae tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:26.845311 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-25de61d6-4d60-4474-bc56-9faecc79ffae tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219" status: 200 len: 1319 microversion: 2.1 time: 0.284518 Oct 12 22:01:26.847092 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 317/556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:26 2022] GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:26.864290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b63ef04d-8f94-42c7-be9a-e5d0d4dec408 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:26.865052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b63ef04d-8f94-42c7-be9a-e5d0d4dec408 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:26.940749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b63ef04d-8f94-42c7-be9a-e5d0d4dec408 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:26.950325 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b63ef04d-8f94-42c7-be9a-e5d0d4dec408 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 200 len: 1222 microversion: 2.1 time: 0.101668 Oct 12 22:01:26.956113 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 318/557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:26 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:26.968050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-11300554-12d4-489e-b33e-1678040f159f tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:26.968895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-11300554-12d4-489e-b33e-1678040f159f tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:26.983878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11300554-12d4-489e-b33e-1678040f159f tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:26.984558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11300554-12d4-489e-b33e-1678040f159f tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:26.985647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11300554-12d4-489e-b33e-1678040f159f tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:26.987309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11300554-12d4-489e-b33e-1678040f159f tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:26.988165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11300554-12d4-489e-b33e-1678040f159f tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:26.988355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11300554-12d4-489e-b33e-1678040f159f tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:27.171197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-11300554-12d4-489e-b33e-1678040f159f tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9ee99f0c4f4aec8d001de2c4f7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a51ee9af8d4461ea7deb6c9dcf2522e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:27.181932 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-11300554-12d4-489e-b33e-1678040f159f tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e" status: 200 len: 1504 microversion: 2.1 time: 0.222268 Oct 12 22:01:27.195264 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 319/558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:26 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:27.195264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-12216c4d-8e41-4346-a7fb-c7c176152a74 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:27.195264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-12216c4d-8e41-4346-a7fb-c7c176152a74 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:27.203917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12216c4d-8e41-4346-a7fb-c7c176152a74 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:27.203917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12216c4d-8e41-4346-a7fb-c7c176152a74 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:27.203917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12216c4d-8e41-4346-a7fb-c7c176152a74 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:27.203917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12216c4d-8e41-4346-a7fb-c7c176152a74 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:27.204242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12216c4d-8e41-4346-a7fb-c7c176152a74 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:27.204242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12216c4d-8e41-4346-a7fb-c7c176152a74 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:27.340966 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-deed2973-7753-404a-9544-4c091dbccf42 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/cf978c5b-cf1c-4ae6-9b57-14ab976b249d" status: 202 len: 0 microversion: 2.1 time: 1.925500 Oct 12 22:01:27.342124 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 240/559] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:01:25 2022] DELETE /compute/v2.1/os-floating-ips/cf978c5b-cf1c-4ae6-9b57-14ab976b249d => generated 0 bytes in 1927 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:01:27.349411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c1113825-4d60-4960-b394-7a5560f49295 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:27.350711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c1113825-4d60-4960-b394-7a5560f49295 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:27.358017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1113825-4d60-4960-b394-7a5560f49295 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:27.358807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1113825-4d60-4960-b394-7a5560f49295 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:27.359487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1113825-4d60-4960-b394-7a5560f49295 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:27.360446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1113825-4d60-4960-b394-7a5560f49295 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:27.361136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1113825-4d60-4960-b394-7a5560f49295 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:27.361980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1113825-4d60-4960-b394-7a5560f49295 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:27.388765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-12216c4d-8e41-4346-a7fb-c7c176152a74 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:27.398007 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-12216c4d-8e41-4346-a7fb-c7c176152a74 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1504 microversion: 2.1 time: 0.213751 Oct 12 22:01:27.411271 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 320/560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:27 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1504 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:27.411271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4cbba3f1-eee6-4d6b-87e0-8f6250a2e2b0 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] Calling method '.version_select at 0x7f512864f430>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:27.414582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c1113825-4d60-4960-b394-7a5560f49295 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '1e9ee99f0c4f4aec8d001de2c4f7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a51ee9af8d4461ea7deb6c9dcf2522e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:27.419896 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c1113825-4d60-4960-b394-7a5560f49295 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e/os-instance-actions/req-2fb527a2-25f6-4a53-aee1-635ec2708cb9" status: 200 len: 313 microversion: 2.1 time: 0.076519 Oct 12 22:01:27.421136 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 241/561] 10.222.0.16 () {58 vars in 1419 bytes} [Wed Oct 12 22:01:27 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e/os-instance-actions/req-2fb527a2-25f6-4a53-aee1-635ec2708cb9 => generated 313 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:27.436284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d7bb4bc-3f10-44a2-87c2-50bc2f2b9641 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:27.440882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9d7bb4bc-3f10-44a2-87c2-50bc2f2b9641 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:27.449618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d7bb4bc-3f10-44a2-87c2-50bc2f2b9641 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:27.450495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d7bb4bc-3f10-44a2-87c2-50bc2f2b9641 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:27.451261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d7bb4bc-3f10-44a2-87c2-50bc2f2b9641 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:27.452227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d7bb4bc-3f10-44a2-87c2-50bc2f2b9641 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:27.453077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d7bb4bc-3f10-44a2-87c2-50bc2f2b9641 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:27.454031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d7bb4bc-3f10-44a2-87c2-50bc2f2b9641 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:27.646390 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9d7bb4bc-3f10-44a2-87c2-50bc2f2b9641 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "POST /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e/action" status: 202 len: 0 microversion: 2.1 time: 0.213664 Oct 12 22:01:27.662128 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 242/562] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:01:27 2022] POST /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:01:27.678290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-23c41376-23d4-4863-bc17-916ed781e781 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:27.687722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-23c41376-23d4-4863-bc17-916ed781e781 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:27.708243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23c41376-23d4-4863-bc17-916ed781e781 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:27.709042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23c41376-23d4-4863-bc17-916ed781e781 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:27.709960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23c41376-23d4-4863-bc17-916ed781e781 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:27.724198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23c41376-23d4-4863-bc17-916ed781e781 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:27.724816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23c41376-23d4-4863-bc17-916ed781e781 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:27.727479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23c41376-23d4-4863-bc17-916ed781e781 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:28.701229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-23c41376-23d4-4863-bc17-916ed781e781 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9ee99f0c4f4aec8d001de2c4f7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a51ee9af8d4461ea7deb6c9dcf2522e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:28.713366 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-23c41376-23d4-4863-bc17-916ed781e781 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e" status: 200 len: 1506 microversion: 2.1 time: 1.046956 Oct 12 22:01:28.730677 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 243/563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:27 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e => generated 1506 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:28.742783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0eb7155a-e10a-4a14-a9ce-4f7c297076e7 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:28.743685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0eb7155a-e10a-4a14-a9ce-4f7c297076e7 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:28.751167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0eb7155a-e10a-4a14-a9ce-4f7c297076e7 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:28.757465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0eb7155a-e10a-4a14-a9ce-4f7c297076e7 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:28.758257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0eb7155a-e10a-4a14-a9ce-4f7c297076e7 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:28.759392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0eb7155a-e10a-4a14-a9ce-4f7c297076e7 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:28.760679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0eb7155a-e10a-4a14-a9ce-4f7c297076e7 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:28.763829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0eb7155a-e10a-4a14-a9ce-4f7c297076e7 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:28.985378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:29.726459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0eb7155a-e10a-4a14-a9ce-4f7c297076e7 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:29.735675 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0eb7155a-e10a-4a14-a9ce-4f7c297076e7 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219" status: 200 len: 1319 microversion: 2.1 time: 0.998335 Oct 12 22:01:29.743215 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 244/564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:28 2022] GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219 => generated 1319 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:29.748322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b1f2167b-010a-40b1-b47c-fbc57ca68cbf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:29.752552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b1f2167b-010a-40b1-b47c-fbc57ca68cbf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:29.767266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1f2167b-010a-40b1-b47c-fbc57ca68cbf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:29.768048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1f2167b-010a-40b1-b47c-fbc57ca68cbf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:29.768699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1f2167b-010a-40b1-b47c-fbc57ca68cbf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:29.773312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1f2167b-010a-40b1-b47c-fbc57ca68cbf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:29.774110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1f2167b-010a-40b1-b47c-fbc57ca68cbf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:29.775422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1f2167b-010a-40b1-b47c-fbc57ca68cbf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:29.928099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b1f2167b-010a-40b1-b47c-fbc57ca68cbf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:29.942720 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b1f2167b-010a-40b1-b47c-fbc57ca68cbf tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 200 len: 1280 microversion: 2.1 time: 0.196993 Oct 12 22:01:29.944327 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 245/565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:29 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 1280 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:29.955983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-53f8a65c-9819-4fb5-9714-ed3ac80e9cc1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:29.956995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-53f8a65c-9819-4fb5-9714-ed3ac80e9cc1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:29.975148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53f8a65c-9819-4fb5-9714-ed3ac80e9cc1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:29.977833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53f8a65c-9819-4fb5-9714-ed3ac80e9cc1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:29.981083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53f8a65c-9819-4fb5-9714-ed3ac80e9cc1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:29.982075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53f8a65c-9819-4fb5-9714-ed3ac80e9cc1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:29.982747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53f8a65c-9819-4fb5-9714-ed3ac80e9cc1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:29.983437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53f8a65c-9819-4fb5-9714-ed3ac80e9cc1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:30.137747 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4cbba3f1-eee6-4d6b-87e0-8f6250a2e2b0 tempest-FloatingIPDetailsTestJSON-731696619 tempest-FloatingIPDetailsTestJSON-731696619-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/cd7b3022-3283-4c39-97ff-c70ec89f33e9" status: 202 len: 0 microversion: 2.1 time: 2.736820 Oct 12 22:01:30.141756 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 321/566] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:01:27 2022] DELETE /compute/v2.1/os-floating-ips/cd7b3022-3283-4c39-97ff-c70ec89f33e9 => generated 0 bytes in 2739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:01:30.144528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2a4fe5b5-064f-4e85-ae79-34dac9f5fe22 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:30.145365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2a4fe5b5-064f-4e85-ae79-34dac9f5fe22 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:30.174376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a4fe5b5-064f-4e85-ae79-34dac9f5fe22 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:30.175099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a4fe5b5-064f-4e85-ae79-34dac9f5fe22 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:30.176752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a4fe5b5-064f-4e85-ae79-34dac9f5fe22 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:30.177514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a4fe5b5-064f-4e85-ae79-34dac9f5fe22 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:30.177980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a4fe5b5-064f-4e85-ae79-34dac9f5fe22 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:30.178418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a4fe5b5-064f-4e85-ae79-34dac9f5fe22 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:30.549076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2a4fe5b5-064f-4e85-ae79-34dac9f5fe22 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9ee99f0c4f4aec8d001de2c4f7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a51ee9af8d4461ea7deb6c9dcf2522e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:30.557123 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2a4fe5b5-064f-4e85-ae79-34dac9f5fe22 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e" status: 200 len: 1511 microversion: 2.1 time: 0.416877 Oct 12 22:01:30.571506 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 322/567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:30 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e => generated 1511 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:30.769452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02f67ee7-7ebe-4b83-8630-253b479934cb tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:30.770059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-02f67ee7-7ebe-4b83-8630-253b479934cb tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:30.787690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02f67ee7-7ebe-4b83-8630-253b479934cb tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:30.788310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02f67ee7-7ebe-4b83-8630-253b479934cb tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:30.788811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02f67ee7-7ebe-4b83-8630-253b479934cb tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:30.789730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02f67ee7-7ebe-4b83-8630-253b479934cb tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:30.791279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02f67ee7-7ebe-4b83-8630-253b479934cb tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:30.791989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02f67ee7-7ebe-4b83-8630-253b479934cb tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:31.073444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-53f8a65c-9819-4fb5-9714-ed3ac80e9cc1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:31.089396 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-53f8a65c-9819-4fb5-9714-ed3ac80e9cc1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1504 microversion: 2.1 time: 1.141981 Oct 12 22:01:31.097181 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 246/568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:29 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1504 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:31.105112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-77a1d415-bff9-4fc4-936c-fa3e78e8f130 req-ee142243-c21a-4c97-9a93-a77df8131800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37440ed5-600e-4a41-80ce-a48643705219", "name": "network-vif-plugged", "status": "completed", "tag": "1a9a1d71-0ce0-4b2e-8d76-437ca3759607"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:31.121999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-77a1d415-bff9-4fc4-936c-fa3e78e8f130 req-ee142243-c21a-4c97-9a93-a77df8131800 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:31.122877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-77a1d415-bff9-4fc4-936c-fa3e78e8f130 req-ee142243-c21a-4c97-9a93-a77df8131800 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:31.123554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-77a1d415-bff9-4fc4-936c-fa3e78e8f130 req-ee142243-c21a-4c97-9a93-a77df8131800 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:31.156616 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-77a1d415-bff9-4fc4-936c-fa3e78e8f130 req-ee142243-c21a-4c97-9a93-a77df8131800 service nova] Creating event network-vif-plugged:1a9a1d71-0ce0-4b2e-8d76-437ca3759607 for instance 37440ed5-600e-4a41-80ce-a48643705219 on n-h2-861111-1 Oct 12 22:01:31.171271 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-77a1d415-bff9-4fc4-936c-fa3e78e8f130 req-ee142243-c21a-4c97-9a93-a77df8131800 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071430 Oct 12 22:01:31.172238 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 247/569] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:31.185040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b13b3b9f-de19-4539-aec3-fb2a487bf294 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:31.190527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b13b3b9f-de19-4539-aec3-fb2a487bf294 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:31.204949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b13b3b9f-de19-4539-aec3-fb2a487bf294 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:31.208401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b13b3b9f-de19-4539-aec3-fb2a487bf294 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:31.209111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b13b3b9f-de19-4539-aec3-fb2a487bf294 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:31.211564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b13b3b9f-de19-4539-aec3-fb2a487bf294 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:31.212205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b13b3b9f-de19-4539-aec3-fb2a487bf294 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:31.213054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b13b3b9f-de19-4539-aec3-fb2a487bf294 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:31.393207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b13b3b9f-de19-4539-aec3-fb2a487bf294 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:31.426249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-02f67ee7-7ebe-4b83-8630-253b479934cb tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:31.437034 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b13b3b9f-de19-4539-aec3-fb2a487bf294 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 200 len: 1280 microversion: 2.1 time: 0.257192 Oct 12 22:01:31.439876 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 248/570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:31 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 1280 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:31.450208 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-02f67ee7-7ebe-4b83-8630-253b479934cb tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219" status: 200 len: 1319 microversion: 2.1 time: 0.672248 Oct 12 22:01:31.451066 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 323/571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:30 2022] GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219 => generated 1319 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:01:31.586354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ef83f702-173d-4607-a85a-48686c596aa2 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:31.587944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ef83f702-173d-4607-a85a-48686c596aa2 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:31.598738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef83f702-173d-4607-a85a-48686c596aa2 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:31.599259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef83f702-173d-4607-a85a-48686c596aa2 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:31.599696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef83f702-173d-4607-a85a-48686c596aa2 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:31.610715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef83f702-173d-4607-a85a-48686c596aa2 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:31.611901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef83f702-173d-4607-a85a-48686c596aa2 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:31.612515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef83f702-173d-4607-a85a-48686c596aa2 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:31.729987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a6576699-bd5a-4775-9349-33f86757c532 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:31.730488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a6576699-bd5a-4775-9349-33f86757c532 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:31.740832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6576699-bd5a-4775-9349-33f86757c532 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:31.741926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6576699-bd5a-4775-9349-33f86757c532 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:31.742551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6576699-bd5a-4775-9349-33f86757c532 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:31.743613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6576699-bd5a-4775-9349-33f86757c532 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:31.745107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6576699-bd5a-4775-9349-33f86757c532 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:31.749007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6576699-bd5a-4775-9349-33f86757c532 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:31.807411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a6576699-bd5a-4775-9349-33f86757c532 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:01:31.914273 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a6576699-bd5a-4775-9349-33f86757c532 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 204 len: 0 microversion: 2.1 time: 0.187478 Oct 12 22:01:31.915319 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 324/572] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:01:31 2022] DELETE /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:01:32.081524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1189444439", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "512672274", "adminPass": "***", "networks": [{"uuid": "d3fadd76-09d4-4371-a263-cdd334f9f270"}], "security_groups": [{"name": "tempest-securitygroup--1311237933"}], "key_name": "tempest-keypair-922931407", "user_data": "}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:32.117025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ef83f702-173d-4607-a85a-48686c596aa2 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9ee99f0c4f4aec8d001de2c4f7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a51ee9af8d4461ea7deb6c9dcf2522e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:32.129504 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ef83f702-173d-4607-a85a-48686c596aa2 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e" status: 200 len: 1504 microversion: 2.1 time: 0.547057 Oct 12 22:01:32.130296 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 249/573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:31 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e => generated 1504 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:32.134585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0481c7bc-6c80-453f-9e1f-a91589ca9029 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:32.135187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0481c7bc-6c80-453f-9e1f-a91589ca9029 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:32.157683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0481c7bc-6c80-453f-9e1f-a91589ca9029 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:32.162298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0481c7bc-6c80-453f-9e1f-a91589ca9029 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:32.165020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0481c7bc-6c80-453f-9e1f-a91589ca9029 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:32.170633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0481c7bc-6c80-453f-9e1f-a91589ca9029 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:32.171976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0481c7bc-6c80-453f-9e1f-a91589ca9029 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:32.172571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0481c7bc-6c80-453f-9e1f-a91589ca9029 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:32.177876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:32.403072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] validate_networks() for [('d3fadd76-09d4-4371-a263-cdd334f9f270', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:01:32.583225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0481c7bc-6c80-453f-9e1f-a91589ca9029 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:32.592703 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0481c7bc-6c80-453f-9e1f-a91589ca9029 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1479 microversion: 2.1 time: 0.461582 Oct 12 22:01:32.593537 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 250/574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:32 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1479 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:32.612846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7b081716-9c40-4a5c-a4d8-43b3b6107c41 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '.version_select at 0x7f5128717550>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:32.615070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7b081716-9c40-4a5c-a4d8-43b3b6107c41 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:32.646388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b081716-9c40-4a5c-a4d8-43b3b6107c41 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:32.646806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b081716-9c40-4a5c-a4d8-43b3b6107c41 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:32.647262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b081716-9c40-4a5c-a4d8-43b3b6107c41 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:32.648330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b081716-9c40-4a5c-a4d8-43b3b6107c41 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:32.648454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b081716-9c40-4a5c-a4d8-43b3b6107c41 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:32.648836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b081716-9c40-4a5c-a4d8-43b3b6107c41 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:32.732188 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7b081716-9c40-4a5c-a4d8-43b3b6107c41 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.129726 Oct 12 22:01:32.733112 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 251/575] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Oct 12 22:01:32 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e/os-instance-actions => generated 611 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:32.744048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-62bda42f-439d-4e70-bb1b-359774b91110 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:32.745134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-62bda42f-439d-4e70-bb1b-359774b91110 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:32.775971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62bda42f-439d-4e70-bb1b-359774b91110 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:32.777881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62bda42f-439d-4e70-bb1b-359774b91110 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:32.778805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62bda42f-439d-4e70-bb1b-359774b91110 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:32.781448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62bda42f-439d-4e70-bb1b-359774b91110 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:32.782149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62bda42f-439d-4e70-bb1b-359774b91110 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:32.784106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62bda42f-439d-4e70-bb1b-359774b91110 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:33.179000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-62bda42f-439d-4e70-bb1b-359774b91110 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:33.194193 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-62bda42f-439d-4e70-bb1b-359774b91110 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 200 len: 1322 microversion: 2.1 time: 0.459675 Oct 12 22:01:33.194960 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 252/576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:32 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 1322 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:33.199613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f586af11-41b2-4572-a93c-2ff0b4af680f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:33.206199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f586af11-41b2-4572-a93c-2ff0b4af680f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:33.218843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f586af11-41b2-4572-a93c-2ff0b4af680f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:33.219644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f586af11-41b2-4572-a93c-2ff0b4af680f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:33.222279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f586af11-41b2-4572-a93c-2ff0b4af680f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:33.223265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f586af11-41b2-4572-a93c-2ff0b4af680f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:33.224225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f586af11-41b2-4572-a93c-2ff0b4af680f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:33.228049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f586af11-41b2-4572-a93c-2ff0b4af680f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:33.341519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:01:33.342261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:01:33.342871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:01:33.343417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:01:33.343930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:01:33.360132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:33.362783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:33.364079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:33.365015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:33.368468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:33.369048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:33.418845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Getting quotas for project a5e1f0c64d2e4154a3c0749af66adb6a. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:01:33.433190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Getting quotas for user 11b16666035d4646a403d79d83f9a67b and project a5e1f0c64d2e4154a3c0749af66adb6a. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:01:33.466254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:01:33.469056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:01:33.579784 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8f30e2d5-91aa-4015-bee0-6d07de723f69 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.504223 Oct 12 22:01:33.590552 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 325/577] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:01:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:01:33.602914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-098578f6-bb03-4024-b313-8a868355f617 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '.version_select at 0x7f51286d8940>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:33.608664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-098578f6-bb03-4024-b313-8a868355f617 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:33.609467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-098578f6-bb03-4024-b313-8a868355f617 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:33.610675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-098578f6-bb03-4024-b313-8a868355f617 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:33.624518 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-098578f6-bb03-4024-b313-8a868355f617 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 784 microversion: 2.1 time: 0.030813 Oct 12 22:01:33.625390 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 326/578] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 12 22:01:33 2022] GET /compute/v2.1/os-migrations => generated 784 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:33.636216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f9778afb-3b23-4119-9321-c7e2757f8164 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:33.638587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f9778afb-3b23-4119-9321-c7e2757f8164 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:33.657647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9778afb-3b23-4119-9321-c7e2757f8164 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:33.659943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9778afb-3b23-4119-9321-c7e2757f8164 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:33.660640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9778afb-3b23-4119-9321-c7e2757f8164 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:33.661598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9778afb-3b23-4119-9321-c7e2757f8164 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:33.664235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9778afb-3b23-4119-9321-c7e2757f8164 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:33.664886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9778afb-3b23-4119-9321-c7e2757f8164 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:33.680753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f586af11-41b2-4572-a93c-2ff0b4af680f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:33.692001 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f586af11-41b2-4572-a93c-2ff0b4af680f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219" status: 200 len: 1319 microversion: 2.1 time: 0.495782 Oct 12 22:01:33.696809 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 253/579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:33 2022] GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219 => generated 1319 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:33.745091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f9778afb-3b23-4119-9321-c7e2757f8164 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:01:33.870823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1996366389", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "a1135d57-c7e8-447f-a856-6e68b955e716"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:34.033452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] validate_networks() for [('a1135d57-c7e8-447f-a856-6e68b955e716', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:01:34.085321 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f9778afb-3b23-4119-9321-c7e2757f8164 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e" status: 204 len: 0 microversion: 2.1 time: 0.454413 Oct 12 22:01:34.088181 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 327/580] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:01:33 2022] DELETE /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:01:34.099963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d58b7a3a-490e-4fbf-a3dc-e272bc40eeef tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:34.102008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d58b7a3a-490e-4fbf-a3dc-e272bc40eeef tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:34.432402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d58b7a3a-490e-4fbf-a3dc-e272bc40eeef tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:34.444110 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d58b7a3a-490e-4fbf-a3dc-e272bc40eeef tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1262 microversion: 2.1 time: 0.352839 Oct 12 22:01:34.444743 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 328/581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:34 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1262 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:34.476213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e14191b9-4da2-4442-a7c5-77b55906faa2 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:34.478157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e14191b9-4da2-4442-a7c5-77b55906faa2 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:34.490982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e14191b9-4da2-4442-a7c5-77b55906faa2 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:34.491595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e14191b9-4da2-4442-a7c5-77b55906faa2 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:34.494316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e14191b9-4da2-4442-a7c5-77b55906faa2 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:34.495395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e14191b9-4da2-4442-a7c5-77b55906faa2 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:34.496293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e14191b9-4da2-4442-a7c5-77b55906faa2 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:34.497676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e14191b9-4da2-4442-a7c5-77b55906faa2 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:35.618173 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e14191b9-4da2-4442-a7c5-77b55906faa2 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1630 microversion: 2.1 time: 1.170293 Oct 12 22:01:35.635710 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 329/582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:34 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1630 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:35.658701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fa095b5f-2636-4377-a9db-e50d25b5ca4d tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:35.659717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fa095b5f-2636-4377-a9db-e50d25b5ca4d tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:35.670484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa095b5f-2636-4377-a9db-e50d25b5ca4d tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:35.678113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa095b5f-2636-4377-a9db-e50d25b5ca4d tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:35.679793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa095b5f-2636-4377-a9db-e50d25b5ca4d tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:35.681042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa095b5f-2636-4377-a9db-e50d25b5ca4d tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:35.687450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa095b5f-2636-4377-a9db-e50d25b5ca4d tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:35.688063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa095b5f-2636-4377-a9db-e50d25b5ca4d tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:36.671497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fa095b5f-2636-4377-a9db-e50d25b5ca4d tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9ee99f0c4f4aec8d001de2c4f7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a51ee9af8d4461ea7deb6c9dcf2522e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:36.676811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:01:36.677991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:01:36.680900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:01:36.690022 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fa095b5f-2636-4377-a9db-e50d25b5ca4d tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e" status: 200 len: 1510 microversion: 2.1 time: 1.052544 Oct 12 22:01:36.691217 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 330/583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:35 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e => generated 1510 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:36.691931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:01:36.692383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:01:36.697207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9a429228-5655-48dc-8010-c6c61a9bfaa0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:36.698289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9a429228-5655-48dc-8010-c6c61a9bfaa0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:36.711165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:36.713021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:36.713893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:36.714414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a429228-5655-48dc-8010-c6c61a9bfaa0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:36.715475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a429228-5655-48dc-8010-c6c61a9bfaa0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:36.715617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:36.716847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a429228-5655-48dc-8010-c6c61a9bfaa0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:36.717960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:36.718639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:36.719561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a429228-5655-48dc-8010-c6c61a9bfaa0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:36.720291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a429228-5655-48dc-8010-c6c61a9bfaa0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:36.721523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a429228-5655-48dc-8010-c6c61a9bfaa0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:36.811518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Getting quotas for project beef77813aa641769eb3151b41b8e0cf. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:01:36.818655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Getting quotas for user 1c8822d55876445d91f5681781313ce9 and project beef77813aa641769eb3151b41b8e0cf. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:01:36.835976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:01:36.839988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:01:36.904222 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-50b1157f-951c-4fb3-94e2-411fe144b332 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.205977 Oct 12 22:01:36.905466 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 254/584] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 22:01:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3208 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:01:36.911753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-72923cc9-b643-4378-9546-8897e7774f2b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:36.912560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-72923cc9-b643-4378-9546-8897e7774f2b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:36.920065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72923cc9-b643-4378-9546-8897e7774f2b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:36.920884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72923cc9-b643-4378-9546-8897e7774f2b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:36.921689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72923cc9-b643-4378-9546-8897e7774f2b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:36.922760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72923cc9-b643-4378-9546-8897e7774f2b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:36.923933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72923cc9-b643-4378-9546-8897e7774f2b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:36.924771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72923cc9-b643-4378-9546-8897e7774f2b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:37.817867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-72923cc9-b643-4378-9546-8897e7774f2b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:37.830809 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-72923cc9-b643-4378-9546-8897e7774f2b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219" status: 200 len: 1469 microversion: 2.1 time: 0.923366 Oct 12 22:01:37.855468 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 255/585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:36 2022] GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219 => generated 1469 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:37.872338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3f031f10-f693-4ad1-bce8-79ea43495c2b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:37.875045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3f031f10-f693-4ad1-bce8-79ea43495c2b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:37.902620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9a429228-5655-48dc-8010-c6c61a9bfaa0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:37.912126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f031f10-f693-4ad1-bce8-79ea43495c2b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:37.914354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f031f10-f693-4ad1-bce8-79ea43495c2b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:37.917349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f031f10-f693-4ad1-bce8-79ea43495c2b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:37.920648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f031f10-f693-4ad1-bce8-79ea43495c2b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:37.921398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f031f10-f693-4ad1-bce8-79ea43495c2b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:37.921817 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9a429228-5655-48dc-8010-c6c61a9bfaa0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 200 len: 1322 microversion: 2.1 time: 1.226899 Oct 12 22:01:37.923024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f031f10-f693-4ad1-bce8-79ea43495c2b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:37.938883 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 331/586] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:36 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 1322 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:37.944761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-00335272-853a-4f7b-9358-0b06a0ccffb0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Action: 'create', calling method: .version_select at 0x7f51286fcf70>, body: {"keypair": {"name": "tempest-keypair-1903244980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJj+n6aY90binrS7gE61/hEOaJtprbdynB/ctAjoX9LEd0cWnVUyx8/HS9NisC2U8SfGWALoPlh+GxeyvghE2LXQBg9jtXM9GWNx36qvdj5m+IolcXIIauV6JSR88ft0mg=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:37.987575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-00335272-853a-4f7b-9358-0b06a0ccffb0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Getting quotas for project 61e71a9eeaa044e8aa939548f15a585e. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:01:38.003190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-00335272-853a-4f7b-9358-0b06a0ccffb0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Getting quotas for user 1fe98ba1ceec4b849eb45eb46ce4d425 and project 61e71a9eeaa044e8aa939548f15a585e. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:01:38.059472 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-00335272-853a-4f7b-9358-0b06a0ccffb0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118432 Oct 12 22:01:38.061141 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 332/587] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:01:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:38.078365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-5acda3a7-a518-4c70-86e1-fb102e009fcc req-d2be2f48-3761-4210-be12-e68b9f1fef44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b700e31-e4a4-48a5-b49c-2da9e7532344", "tag": "89831056-14d5-4380-84ca-998b43360ac8"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:38.102026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5acda3a7-a518-4c70-86e1-fb102e009fcc req-d2be2f48-3761-4210-be12-e68b9f1fef44 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:38.102523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5acda3a7-a518-4c70-86e1-fb102e009fcc req-d2be2f48-3761-4210-be12-e68b9f1fef44 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:38.102958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5acda3a7-a518-4c70-86e1-fb102e009fcc req-d2be2f48-3761-4210-be12-e68b9f1fef44 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:38.123712 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-5acda3a7-a518-4c70-86e1-fb102e009fcc req-d2be2f48-3761-4210-be12-e68b9f1fef44 service nova] Creating event network-changed:89831056-14d5-4380-84ca-998b43360ac8 for instance 1b700e31-e4a4-48a5-b49c-2da9e7532344 on n-h2-861111-1 Oct 12 22:01:38.136410 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-5acda3a7-a518-4c70-86e1-fb102e009fcc req-d2be2f48-3761-4210-be12-e68b9f1fef44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064791 Oct 12 22:01:38.138864 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 333/588] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:38.146746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4183ca08-86f3-46e1-9c9f-6f0d29ebbde2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:38.152717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4183ca08-86f3-46e1-9c9f-6f0d29ebbde2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:38.165071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4183ca08-86f3-46e1-9c9f-6f0d29ebbde2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:38.169657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4183ca08-86f3-46e1-9c9f-6f0d29ebbde2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:38.171445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4183ca08-86f3-46e1-9c9f-6f0d29ebbde2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:38.172671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4183ca08-86f3-46e1-9c9f-6f0d29ebbde2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:38.175991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4183ca08-86f3-46e1-9c9f-6f0d29ebbde2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:38.176645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4183ca08-86f3-46e1-9c9f-6f0d29ebbde2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:38.317094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3f031f10-f693-4ad1-bce8-79ea43495c2b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:38.328140 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3f031f10-f693-4ad1-bce8-79ea43495c2b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1320 microversion: 2.1 time: 0.470706 Oct 12 22:01:38.333710 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 256/589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:37 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1320 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:38.339920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-04748519-d3f0-4e90-a9e8-4293d2e2e0db tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:38.340817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-04748519-d3f0-4e90-a9e8-4293d2e2e0db tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:38.383821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04748519-d3f0-4e90-a9e8-4293d2e2e0db tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:38.390864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04748519-d3f0-4e90-a9e8-4293d2e2e0db tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:38.401699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04748519-d3f0-4e90-a9e8-4293d2e2e0db tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:38.405684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04748519-d3f0-4e90-a9e8-4293d2e2e0db tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:38.408131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04748519-d3f0-4e90-a9e8-4293d2e2e0db tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:38.410268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04748519-d3f0-4e90-a9e8-4293d2e2e0db tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:38.440355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4183ca08-86f3-46e1-9c9f-6f0d29ebbde2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:38.454728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4183ca08-86f3-46e1-9c9f-6f0d29ebbde2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:38.456217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4183ca08-86f3-46e1-9c9f-6f0d29ebbde2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:38.457336 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4183ca08-86f3-46e1-9c9f-6f0d29ebbde2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1314 microversion: 2.25 time: 0.317279 Oct 12 22:01:38.457888 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 334/590] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:01:38 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:01:38.648229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-04748519-d3f0-4e90-a9e8-4293d2e2e0db tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9ee99f0c4f4aec8d001de2c4f7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a51ee9af8d4461ea7deb6c9dcf2522e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:38.659971 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-04748519-d3f0-4e90-a9e8-4293d2e2e0db tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e" status: 200 len: 1468 microversion: 2.1 time: 0.324821 Oct 12 22:01:38.669837 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 257/591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:38 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e => generated 1468 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:38.682573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-778e25e3-06d5-426e-bf05-3f904580a08b req-c75e2879-6714-4805-99a2-9432a4e4a464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1848e1da-8fef-4d2e-93b0-87af0c4fe39d", "name": "network-vif-deleted", "tag": "6d33ba53-ea2f-4f4f-a7b2-f87a95f5c19e"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:38.705108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-778e25e3-06d5-426e-bf05-3f904580a08b req-c75e2879-6714-4805-99a2-9432a4e4a464 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:38.707193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-778e25e3-06d5-426e-bf05-3f904580a08b req-c75e2879-6714-4805-99a2-9432a4e4a464 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:38.708001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-778e25e3-06d5-426e-bf05-3f904580a08b req-c75e2879-6714-4805-99a2-9432a4e4a464 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:38.728733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c34a71dd-e780-472e-8328-7e14f0f75b61 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1363821007", "block_migration": true, "disk_over_commit": false}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:38.731225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c34a71dd-e780-472e-8328-7e14f0f75b61 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:38.737400 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-778e25e3-06d5-426e-bf05-3f904580a08b req-c75e2879-6714-4805-99a2-9432a4e4a464 service nova] Creating event network-vif-deleted:6d33ba53-ea2f-4f4f-a7b2-f87a95f5c19e for instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d on n-h2-861111-1 Oct 12 22:01:38.746792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c34a71dd-e780-472e-8328-7e14f0f75b61 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:38.747542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c34a71dd-e780-472e-8328-7e14f0f75b61 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:38.747942 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-778e25e3-06d5-426e-bf05-3f904580a08b req-c75e2879-6714-4805-99a2-9432a4e4a464 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076440 Oct 12 22:01:38.748305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c34a71dd-e780-472e-8328-7e14f0f75b61 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:38.749221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c34a71dd-e780-472e-8328-7e14f0f75b61 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:38.749827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c34a71dd-e780-472e-8328-7e14f0f75b61 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:38.750405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c34a71dd-e780-472e-8328-7e14f0f75b61 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:38.751152 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 258/592] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:38.844504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-c34a71dd-e780-472e-8328-7e14f0f75b61 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lazy-loading 'flavor' on Instance uuid 37440ed5-600e-4a41-80ce-a48643705219 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:01:38.876326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c34a71dd-e780-472e-8328-7e14f0f75b61 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Going to try to live migrate instance to tempest-host-1363821007 {{(pid=120453) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:01:38.902057 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-c34a71dd-e780-472e-8328-7e14f0f75b61 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] HTTP exception thrown: Compute host tempest-host-1363821007 could not be found. Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c34a71dd-e780-472e-8328-7e14f0f75b61 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Request method failure captured: Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219/action HTTP/1.1 Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 107 Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzkpu_xmRghD4J3kpLrXRgtvnnUf6Ko-T9MHKx9iL7CiLKfT6rpfjJ6XTTm9qJB3H3GI5q6eGvZG2ZwuTzAFQkEwDku_GsVxXWslK05NojESWdcA4cr1DFNYlaE7FXBkJaD4p_kMi5FFkWaSw4pHydeoOsFGW1h6xTv0drx8EW_hOdw Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: b9f8f90dc72b42a3b8ffb428d4b7c3e9 Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-LiveMigrationNegativeTest-1311132218 Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:01:38.917562 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:01:38.919760 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9f8f90dc72b42a3b8ffb428d4b7c3e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9f8f90dc72b42a3b8ffb428d4b7c3e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9f8f90dc72b42a3b8ffb428d4b7c3e9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9f8f90dc72b42a3b8ffb428d4b7c3e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:01:38.919760 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-LiveMigrationNegativeTest-1311132218 Oct 12 22:01:38.919760 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: b9f8f90dc72b42a3b8ffb428d4b7c3e9 Oct 12 22:01:38.919760 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1311132218 Oct 12 22:01:38.919760 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-LiveMigrationNegativeTest-1311132218-project-admin Oct 12 22:01:38.919760 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:01:38.919760 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:01:38.919760 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6e3924d4088d4714bda424e5524e564a Oct 12 22:01:38.919760 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-LiveMigrationNegativeTest-1311132218-project-admin Oct 12 22:01:38.919760 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:01:38.919760 n-d-861111-1 devstack@n-api.service[120453]: {"os-migrateLive": {"host": "tempest-host-1363821007", "block_migration": true, "disk_over_commit": false}} Oct 12 22:01:38.919760 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: exception: Compute host tempest-host-1363821007 could not be found. Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '37440ed5-600e-4a41-80ce-a48643705219', 'body': {'os-migrateLive': {'host': 'tempest-host-1363821007', 'block_migration': True, 'disk_over_commit': False}}} Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:01:38.920784 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1363821007 could not be found. Oct 12 22:01:38.921854 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1363821007 could not be found. Oct 12 22:01:38.922951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:01:38.924631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:01:38.924631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:01:38.924631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:38.924631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:01:38.924631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:01:38.924631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:01:38.924631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:01:38.924631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1363821007 could not be found. Oct 12 22:01:38.924631 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:01:38.928059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c34a71dd-e780-472e-8328-7e14f0f75b61 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Returning 400 to user: Compute host tempest-host-1363821007 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:01:38.929289 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c34a71dd-e780-472e-8328-7e14f0f75b61 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219/action" status: 400 len: 100 microversion: 2.1 time: 0.470473 Oct 12 22:01:38.930644 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 335/593] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Oct 12 22:01:38 2022] POST /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219/action => generated 100 bytes in 472 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:01:38.948961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d219f83f-adbd-460d-a06c-f17b33786eba tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:38.950863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d219f83f-adbd-460d-a06c-f17b33786eba tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:38.962135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d219f83f-adbd-460d-a06c-f17b33786eba tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:38.965007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d219f83f-adbd-460d-a06c-f17b33786eba tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:38.966361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-958f1ad1-2fa6-4046-a3f2-c13a7559379c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:38.966964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d219f83f-adbd-460d-a06c-f17b33786eba tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:38.967909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d219f83f-adbd-460d-a06c-f17b33786eba tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:38.968664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-958f1ad1-2fa6-4046-a3f2-c13a7559379c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:38.969240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d219f83f-adbd-460d-a06c-f17b33786eba tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:38.970997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d219f83f-adbd-460d-a06c-f17b33786eba tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:38.994947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-958f1ad1-2fa6-4046-a3f2-c13a7559379c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:38.996597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-958f1ad1-2fa6-4046-a3f2-c13a7559379c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:39.001232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-958f1ad1-2fa6-4046-a3f2-c13a7559379c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:39.002193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-958f1ad1-2fa6-4046-a3f2-c13a7559379c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:39.004016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-958f1ad1-2fa6-4046-a3f2-c13a7559379c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:39.004660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-958f1ad1-2fa6-4046-a3f2-c13a7559379c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:39.083829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:39.779368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-958f1ad1-2fa6-4046-a3f2-c13a7559379c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:39.799037 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-958f1ad1-2fa6-4046-a3f2-c13a7559379c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 200 len: 1322 microversion: 2.1 time: 0.841166 Oct 12 22:01:39.801169 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 336/594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:38 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 1322 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:39.806942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d219f83f-adbd-460d-a06c-f17b33786eba tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:39.818388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dcac18a5-cef3-44f9-89e2-15ca79077109 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:39.822433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dcac18a5-cef3-44f9-89e2-15ca79077109 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:39.833384 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d219f83f-adbd-460d-a06c-f17b33786eba tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219" status: 200 len: 1469 microversion: 2.1 time: 0.897912 Oct 12 22:01:39.834019 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 259/595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:38 2022] GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219 => generated 1469 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:39.838201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcac18a5-cef3-44f9-89e2-15ca79077109 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:39.840370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcac18a5-cef3-44f9-89e2-15ca79077109 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:39.841050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcac18a5-cef3-44f9-89e2-15ca79077109 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:39.844281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcac18a5-cef3-44f9-89e2-15ca79077109 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:39.847640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcac18a5-cef3-44f9-89e2-15ca79077109 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:39.848356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcac18a5-cef3-44f9-89e2-15ca79077109 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:39.853254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d49765b0-bf6a-4dc5-a5d9-b2a1b654bec3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:39.854462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d49765b0-bf6a-4dc5-a5d9-b2a1b654bec3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:39.873275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d49765b0-bf6a-4dc5-a5d9-b2a1b654bec3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:39.873722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d49765b0-bf6a-4dc5-a5d9-b2a1b654bec3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:39.874159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d49765b0-bf6a-4dc5-a5d9-b2a1b654bec3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:39.874879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d49765b0-bf6a-4dc5-a5d9-b2a1b654bec3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:39.875389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d49765b0-bf6a-4dc5-a5d9-b2a1b654bec3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:39.875824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d49765b0-bf6a-4dc5-a5d9-b2a1b654bec3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:39.994447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dcac18a5-cef3-44f9-89e2-15ca79077109 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:40.007341 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dcac18a5-cef3-44f9-89e2-15ca79077109 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1320 microversion: 2.1 time: 0.199788 Oct 12 22:01:40.009559 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 337/596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:39 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1320 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:40.160321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-770437783", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "1bfd60f2-0202-40db-8761-3b71d02412dc"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:40.274688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] validate_networks() for [('1bfd60f2-0202-40db-8761-3b71d02412dc', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:01:40.965153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d49765b0-bf6a-4dc5-a5d9-b2a1b654bec3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:40.993080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d49765b0-bf6a-4dc5-a5d9-b2a1b654bec3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:40.995099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d49765b0-bf6a-4dc5-a5d9-b2a1b654bec3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:40.996625 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d49765b0-bf6a-4dc5-a5d9-b2a1b654bec3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1320 microversion: 2.25 time: 1.151362 Oct 12 22:01:41.014192 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 260/597] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:01:39 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1320 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:01:41.027994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8d5b353d-dd63-4c61-8530-782bbbc22090 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:41.052031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8d5b353d-dd63-4c61-8530-782bbbc22090 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] [instance: d93a4e60-4603-474b-9f37-ff08a1d26c3e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:41.070787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d5b353d-dd63-4c61-8530-782bbbc22090 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:41.072591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d5b353d-dd63-4c61-8530-782bbbc22090 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:41.074070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d5b353d-dd63-4c61-8530-782bbbc22090 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:41.075582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d5b353d-dd63-4c61-8530-782bbbc22090 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:41.077196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d5b353d-dd63-4c61-8530-782bbbc22090 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:41.077954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d5b353d-dd63-4c61-8530-782bbbc22090 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:41.137066 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-8d5b353d-dd63-4c61-8530-782bbbc22090 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] HTTP exception thrown: Instance d93a4e60-4603-474b-9f37-ff08a1d26c3e could not be found. Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8d5b353d-dd63-4c61-8530-782bbbc22090 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Request method failure captured: Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e HTTP/1.1 Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzkf1-yn1NU1o5_U2T4wiqqZsIbuJRrqu0Jbk3aULF1F7kAWNH2c4bMshRwc6lI0i1oWi36MxryGgKGbDPZ05XnbF-5r1IO1SvVbkoyQvy46w0a0pl7ye_alJPV580CSpx_Q8hSgW3x-jBEajSprmqkK5ePgij2W1rVTHH6w7f_uI0g Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 8a51ee9af8d4461ea7deb6c9dcf2522e Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-InstanceActionsTestJSON-404681071 Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:01:41.138846 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:01:41.140199 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a51ee9af8d4461ea7deb6c9dcf2522e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a51ee9af8d4461ea7deb6c9dcf2522e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8a51ee9af8d4461ea7deb6c9dcf2522e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8a51ee9af8d4461ea7deb6c9dcf2522e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:01:41.140199 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-InstanceActionsTestJSON-404681071 Oct 12 22:01:41.140199 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 8a51ee9af8d4461ea7deb6c9dcf2522e Oct 12 22:01:41.140199 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-InstanceActionsTestJSON-404681071 Oct 12 22:01:41.140199 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-InstanceActionsTestJSON-404681071-project Oct 12 22:01:41.140199 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:01:41.140199 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:01:41.140199 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 1e9ee99f0c4f4aec8d001de2c4f7a28c Oct 12 22:01:41.140199 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-InstanceActionsTestJSON-404681071-project Oct 12 22:01:41.140199 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:01:41.140199 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance d93a4e60-4603-474b-9f37-ff08a1d26c3e could not be found. Oct 12 22:01:41.140199 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'd93a4e60-4603-474b-9f37-ff08a1d26c3e'} Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93a4e60-4603-474b-9f37-ff08a1d26c3e could not be found. Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:01:41.140964 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93a4e60-4603-474b-9f37-ff08a1d26c3e could not be found. Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93a4e60-4603-474b-9f37-ff08a1d26c3e could not be found. Oct 12 22:01:41.142341 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:41.144518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8d5b353d-dd63-4c61-8530-782bbbc22090 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] Returning 404 to user: Instance d93a4e60-4603-474b-9f37-ff08a1d26c3e could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:01:41.144518 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8d5b353d-dd63-4c61-8530-782bbbc22090 tempest-InstanceActionsTestJSON-404681071 tempest-InstanceActionsTestJSON-404681071-project] 10.222.0.16 "GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e" status: 404 len: 111 microversion: 2.1 time: 0.124917 Oct 12 22:01:41.144518 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 261/598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:41 2022] GET /compute/v2.1/servers/d93a4e60-4603-474b-9f37-ff08a1d26c3e => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:01:41.148364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-497636475", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:41.253582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:01:42.206768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:01:42.207837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:01:42.208447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:01:42.209073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:01:42.209709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:01:42.221971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:42.222358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:42.223030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:42.224271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:42.224941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:42.235325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:42.262048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Getting quotas for project 0905a1286e134e34a55ceaaa6c23718e. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:01:42.269418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Getting quotas for user 7224dcaeabdd4199b9682e99912f7740 and project 0905a1286e134e34a55ceaaa6c23718e. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:01:42.287018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:01:42.290373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:01:42.324739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=10,nova_api:UPDATE=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:42.358493 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-355d0500-d9ff-4bcd-9a4b-cb88a6b0441e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.346621 Oct 12 22:01:42.360531 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 338/599] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:01:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:01:42.366007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-9aa5f721-4958-406f-bb32-e8ba8bf87929 req-ccd188a2-f146-4773-b140-c60af17392b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93a4e60-4603-474b-9f37-ff08a1d26c3e", "name": "network-vif-deleted", "tag": "cde5e7ae-703e-47d2-8fd2-8aae49dbde05"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:42.388331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9aa5f721-4958-406f-bb32-e8ba8bf87929 req-ccd188a2-f146-4773-b140-c60af17392b4 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:42.389964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9aa5f721-4958-406f-bb32-e8ba8bf87929 req-ccd188a2-f146-4773-b140-c60af17392b4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:42.389964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9aa5f721-4958-406f-bb32-e8ba8bf87929 req-ccd188a2-f146-4773-b140-c60af17392b4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:42.433508 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-9aa5f721-4958-406f-bb32-e8ba8bf87929 req-ccd188a2-f146-4773-b140-c60af17392b4 service nova] Creating event network-vif-deleted:cde5e7ae-703e-47d2-8fd2-8aae49dbde05 for instance d93a4e60-4603-474b-9f37-ff08a1d26c3e on n-h1-861111-1 Oct 12 22:01:42.446132 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-9aa5f721-4958-406f-bb32-e8ba8bf87929 req-ccd188a2-f146-4773-b140-c60af17392b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083374 Oct 12 22:01:42.447697 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 339/600] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:42.462260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-03c6847f-17e5-4639-b916-594205eda03a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:42.463419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-03c6847f-17e5-4639-b916-594205eda03a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:42.481255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03c6847f-17e5-4639-b916-594205eda03a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:42.483194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03c6847f-17e5-4639-b916-594205eda03a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:42.484941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03c6847f-17e5-4639-b916-594205eda03a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:42.486616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03c6847f-17e5-4639-b916-594205eda03a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:42.489951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03c6847f-17e5-4639-b916-594205eda03a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:42.490791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03c6847f-17e5-4639-b916-594205eda03a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:42.960035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-03c6847f-17e5-4639-b916-594205eda03a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:42.969913 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-03c6847f-17e5-4639-b916-594205eda03a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 200 len: 1322 microversion: 2.1 time: 0.519729 Oct 12 22:01:42.973699 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 340/601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:42 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 1322 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:42.982854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-32b44a99-ff67-461f-8759-dd51576b59a4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:42.988138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-32b44a99-ff67-461f-8759-dd51576b59a4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:43.015684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32b44a99-ff67-461f-8759-dd51576b59a4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:43.020582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32b44a99-ff67-461f-8759-dd51576b59a4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:43.021364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32b44a99-ff67-461f-8759-dd51576b59a4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:43.022189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32b44a99-ff67-461f-8759-dd51576b59a4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:43.025263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32b44a99-ff67-461f-8759-dd51576b59a4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:43.026571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32b44a99-ff67-461f-8759-dd51576b59a4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:43.078176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:01:43.079171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:01:43.080585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:01:43.081151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:01:43.081799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:01:43.098301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:43.099296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:43.099845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:43.100844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:43.105369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:43.105923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:43.152819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Getting quotas for project feebe9edaa9c4104843143736f570e02. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:01:43.162958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Getting quotas for user 827d63bf6f35482691c64842c594e753 and project feebe9edaa9c4104843143736f570e02. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:01:43.181507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:01:43.184534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:01:43.250968 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-03509da2-9490-4885-9c93-87215cca61ff tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.107516 Oct 12 22:01:43.252968 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 262/602] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:01:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:01:43.259669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-daa64a47-a05c-4dff-97a2-e25e6ed25592 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:43.260559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-daa64a47-a05c-4dff-97a2-e25e6ed25592 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:43.275427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-daa64a47-a05c-4dff-97a2-e25e6ed25592 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:43.278195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-daa64a47-a05c-4dff-97a2-e25e6ed25592 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:43.279860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-daa64a47-a05c-4dff-97a2-e25e6ed25592 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:43.280842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-daa64a47-a05c-4dff-97a2-e25e6ed25592 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:43.281526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-daa64a47-a05c-4dff-97a2-e25e6ed25592 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:43.282167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-daa64a47-a05c-4dff-97a2-e25e6ed25592 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:43.516982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-32b44a99-ff67-461f-8759-dd51576b59a4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:43.532993 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-32b44a99-ff67-461f-8759-dd51576b59a4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1388 microversion: 2.1 time: 0.557267 Oct 12 22:01:43.536964 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 341/603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:42 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1388 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:43.545827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-27cd5139-0c36-455f-b0f4-f1707bf897eb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:43.546450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-27cd5139-0c36-455f-b0f4-f1707bf897eb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:43.558947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27cd5139-0c36-455f-b0f4-f1707bf897eb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:43.559482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27cd5139-0c36-455f-b0f4-f1707bf897eb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:43.560664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27cd5139-0c36-455f-b0f4-f1707bf897eb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:43.561732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27cd5139-0c36-455f-b0f4-f1707bf897eb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:43.562547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27cd5139-0c36-455f-b0f4-f1707bf897eb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:43.563134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27cd5139-0c36-455f-b0f4-f1707bf897eb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:43.717116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-27cd5139-0c36-455f-b0f4-f1707bf897eb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:43.749449 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-27cd5139-0c36-455f-b0f4-f1707bf897eb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 200 len: 1203 microversion: 2.1 time: 0.211164 Oct 12 22:01:43.750092 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 342/604] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:43 2022] GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 1203 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:43.774955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0ee0a324-b8fc-412d-8840-a14d8b6b204b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:43.775809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0ee0a324-b8fc-412d-8840-a14d8b6b204b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:43.899201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0ee0a324-b8fc-412d-8840-a14d8b6b204b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:43.909721 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0ee0a324-b8fc-412d-8840-a14d8b6b204b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 200 len: 1218 microversion: 2.1 time: 0.158216 Oct 12 22:01:43.912690 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 343/605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:43 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:44.000526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a6e0f169-5523-401e-8d9a-1adb884e02e0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:44.001275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a6e0f169-5523-401e-8d9a-1adb884e02e0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:44.013366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6e0f169-5523-401e-8d9a-1adb884e02e0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:44.014007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6e0f169-5523-401e-8d9a-1adb884e02e0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:44.015624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6e0f169-5523-401e-8d9a-1adb884e02e0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:44.016697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6e0f169-5523-401e-8d9a-1adb884e02e0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:44.019939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6e0f169-5523-401e-8d9a-1adb884e02e0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:44.020393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6e0f169-5523-401e-8d9a-1adb884e02e0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:44.245272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a6e0f169-5523-401e-8d9a-1adb884e02e0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:44.253097 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a6e0f169-5523-401e-8d9a-1adb884e02e0 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 200 len: 1322 microversion: 2.1 time: 0.259051 Oct 12 22:01:44.253638 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 344/606] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:43 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:01:44.306879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-daa64a47-a05c-4dff-97a2-e25e6ed25592 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:44.316285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-daa64a47-a05c-4dff-97a2-e25e6ed25592 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:44.317830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-daa64a47-a05c-4dff-97a2-e25e6ed25592 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:44.319027 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-daa64a47-a05c-4dff-97a2-e25e6ed25592 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1362 microversion: 2.25 time: 1.064874 Oct 12 22:01:44.319996 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 263/607] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:01:43 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1362 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:01:44.504058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a240e96c-96ec-475b-8b97-247e5c75f3ff req-ef4190c4-be10-4435-8286-9be0cd16f481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f266cf9-d4aa-4392-ab6c-722b3ef3d26e", "tag": "43b4aff9-14b1-41df-8485-e703d7cb7bea"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:44.516957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a240e96c-96ec-475b-8b97-247e5c75f3ff req-ef4190c4-be10-4435-8286-9be0cd16f481 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:44.517556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a240e96c-96ec-475b-8b97-247e5c75f3ff req-ef4190c4-be10-4435-8286-9be0cd16f481 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:44.518147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a240e96c-96ec-475b-8b97-247e5c75f3ff req-ef4190c4-be10-4435-8286-9be0cd16f481 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:44.536522 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a240e96c-96ec-475b-8b97-247e5c75f3ff req-ef4190c4-be10-4435-8286-9be0cd16f481 service nova] Creating event network-changed:43b4aff9-14b1-41df-8485-e703d7cb7bea for instance 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e on n-h1-861111-1 Oct 12 22:01:44.547184 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a240e96c-96ec-475b-8b97-247e5c75f3ff req-ef4190c4-be10-4435-8286-9be0cd16f481 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045601 Oct 12 22:01:44.549817 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 345/608] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:44.564880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ed4cfdbc-91ec-4224-8907-48edc9403322 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:44.565498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ed4cfdbc-91ec-4224-8907-48edc9403322 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:44.581805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed4cfdbc-91ec-4224-8907-48edc9403322 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:44.583138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed4cfdbc-91ec-4224-8907-48edc9403322 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:44.584459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed4cfdbc-91ec-4224-8907-48edc9403322 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:44.586088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed4cfdbc-91ec-4224-8907-48edc9403322 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:44.588441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed4cfdbc-91ec-4224-8907-48edc9403322 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:44.589108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed4cfdbc-91ec-4224-8907-48edc9403322 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:44.781924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ef8f93de-9e08-4beb-80ad-2072a58d49ed tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:44.783602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ef8f93de-9e08-4beb-80ad-2072a58d49ed tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:44.800321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef8f93de-9e08-4beb-80ad-2072a58d49ed tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:44.804300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef8f93de-9e08-4beb-80ad-2072a58d49ed tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:44.804974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef8f93de-9e08-4beb-80ad-2072a58d49ed tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:44.805872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef8f93de-9e08-4beb-80ad-2072a58d49ed tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:44.806488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef8f93de-9e08-4beb-80ad-2072a58d49ed tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:44.807496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef8f93de-9e08-4beb-80ad-2072a58d49ed tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:44.999583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ef8f93de-9e08-4beb-80ad-2072a58d49ed tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:45.010896 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ef8f93de-9e08-4beb-80ad-2072a58d49ed tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 200 len: 1265 microversion: 2.1 time: 0.237803 Oct 12 22:01:45.011500 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 346/609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:44 2022] GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:01:45.025245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-78ce2616-2f43-482d-80bb-55b468bff495 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:45.026133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-78ce2616-2f43-482d-80bb-55b468bff495 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:45.045253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78ce2616-2f43-482d-80bb-55b468bff495 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:45.045844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78ce2616-2f43-482d-80bb-55b468bff495 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:45.054584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78ce2616-2f43-482d-80bb-55b468bff495 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:45.055482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78ce2616-2f43-482d-80bb-55b468bff495 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:45.056029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78ce2616-2f43-482d-80bb-55b468bff495 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:45.058557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78ce2616-2f43-482d-80bb-55b468bff495 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:45.214825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-78ce2616-2f43-482d-80bb-55b468bff495 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:45.230617 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-78ce2616-2f43-482d-80bb-55b468bff495 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 200 len: 1270 microversion: 2.1 time: 0.215552 Oct 12 22:01:45.233365 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 347/610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:45 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 1270 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:45.239127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-ba5cb70a-2767-4607-8e7e-4ce2c5d9b70e req-05b4c563-8cd5-4aab-9eae-ff25678aa319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b700e31-e4a4-48a5-b49c-2da9e7532344", "name": "network-vif-plugged", "status": "completed", "tag": "89831056-14d5-4380-84ca-998b43360ac8"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:45.260324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ba5cb70a-2767-4607-8e7e-4ce2c5d9b70e req-05b4c563-8cd5-4aab-9eae-ff25678aa319 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:45.263078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ba5cb70a-2767-4607-8e7e-4ce2c5d9b70e req-05b4c563-8cd5-4aab-9eae-ff25678aa319 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:45.265174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ba5cb70a-2767-4607-8e7e-4ce2c5d9b70e req-05b4c563-8cd5-4aab-9eae-ff25678aa319 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:45.297685 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-ba5cb70a-2767-4607-8e7e-4ce2c5d9b70e req-05b4c563-8cd5-4aab-9eae-ff25678aa319 service nova] Creating event network-vif-plugged:89831056-14d5-4380-84ca-998b43360ac8 for instance 1b700e31-e4a4-48a5-b49c-2da9e7532344 on n-h2-861111-1 Oct 12 22:01:45.309490 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-ba5cb70a-2767-4607-8e7e-4ce2c5d9b70e req-05b4c563-8cd5-4aab-9eae-ff25678aa319 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073272 Oct 12 22:01:45.311693 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 348/611] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:45.322138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7c8c6878-89bf-4cec-9961-4ef085201f46 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:45.322830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7c8c6878-89bf-4cec-9961-4ef085201f46 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:45.337793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c8c6878-89bf-4cec-9961-4ef085201f46 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:45.343787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c8c6878-89bf-4cec-9961-4ef085201f46 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:45.344487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c8c6878-89bf-4cec-9961-4ef085201f46 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:45.347283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c8c6878-89bf-4cec-9961-4ef085201f46 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:45.347913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c8c6878-89bf-4cec-9961-4ef085201f46 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:45.348708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c8c6878-89bf-4cec-9961-4ef085201f46 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:45.512398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ed4cfdbc-91ec-4224-8907-48edc9403322 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:45.530996 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ed4cfdbc-91ec-4224-8907-48edc9403322 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1388 microversion: 2.1 time: 0.964359 Oct 12 22:01:45.531958 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 264/612] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:44 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1388 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:45.552199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f0679ba-34ad-4e6e-a709-ca303f263faf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:45.552974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8f0679ba-34ad-4e6e-a709-ca303f263faf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:45.567581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f0679ba-34ad-4e6e-a709-ca303f263faf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:45.568164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f0679ba-34ad-4e6e-a709-ca303f263faf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:45.571260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f0679ba-34ad-4e6e-a709-ca303f263faf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:45.572417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f0679ba-34ad-4e6e-a709-ca303f263faf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:45.573930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f0679ba-34ad-4e6e-a709-ca303f263faf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:45.575060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f0679ba-34ad-4e6e-a709-ca303f263faf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:45.853502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7c8c6878-89bf-4cec-9961-4ef085201f46 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:45.861313 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7c8c6878-89bf-4cec-9961-4ef085201f46 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 200 len: 1322 microversion: 2.1 time: 0.548436 Oct 12 22:01:45.861913 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 349/613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:45 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 1322 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:45.885713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-731c4ec4-f90f-4ed7-a1f5-edbfdab7ea23 req-cfac1d1c-8030-4974-8f11-a0dcdaf29854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a164670-124d-407d-a4d1-940846b45e2d", "tag": "78bf0b61-fcf3-4082-9079-b4ba87319616"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:45.898693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-731c4ec4-f90f-4ed7-a1f5-edbfdab7ea23 req-cfac1d1c-8030-4974-8f11-a0dcdaf29854 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:45.899174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-731c4ec4-f90f-4ed7-a1f5-edbfdab7ea23 req-cfac1d1c-8030-4974-8f11-a0dcdaf29854 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:45.899635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-731c4ec4-f90f-4ed7-a1f5-edbfdab7ea23 req-cfac1d1c-8030-4974-8f11-a0dcdaf29854 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:45.911417 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-731c4ec4-f90f-4ed7-a1f5-edbfdab7ea23 req-cfac1d1c-8030-4974-8f11-a0dcdaf29854 service nova] Creating event network-changed:78bf0b61-fcf3-4082-9079-b4ba87319616 for instance 1a164670-124d-407d-a4d1-940846b45e2d on n-h1-861111-1 Oct 12 22:01:45.916143 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-731c4ec4-f90f-4ed7-a1f5-edbfdab7ea23 req-cfac1d1c-8030-4974-8f11-a0dcdaf29854 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035640 Oct 12 22:01:45.917043 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 350/614] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:46.034504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7070f420-0a66-4f8b-92f7-025d4d29226c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:46.035206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7070f420-0a66-4f8b-92f7-025d4d29226c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:46.046717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7070f420-0a66-4f8b-92f7-025d4d29226c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:46.048023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7070f420-0a66-4f8b-92f7-025d4d29226c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:46.048716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7070f420-0a66-4f8b-92f7-025d4d29226c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:46.049856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7070f420-0a66-4f8b-92f7-025d4d29226c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:46.050569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7070f420-0a66-4f8b-92f7-025d4d29226c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:46.051112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7070f420-0a66-4f8b-92f7-025d4d29226c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:46.118704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f0679ba-34ad-4e6e-a709-ca303f263faf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:46.128397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f0679ba-34ad-4e6e-a709-ca303f263faf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:46.130184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f0679ba-34ad-4e6e-a709-ca303f263faf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:46.131518 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f0679ba-34ad-4e6e-a709-ca303f263faf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1362 microversion: 2.25 time: 0.596144 Oct 12 22:01:46.132161 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 265/615] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:01:45 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1362 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:01:46.256789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-686ee6ee-d561-41f2-aaa0-610a2739f180 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:46.257847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-686ee6ee-d561-41f2-aaa0-610a2739f180 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:46.269404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-686ee6ee-d561-41f2-aaa0-610a2739f180 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:46.270225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-686ee6ee-d561-41f2-aaa0-610a2739f180 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:46.272018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-686ee6ee-d561-41f2-aaa0-610a2739f180 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:46.274285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-686ee6ee-d561-41f2-aaa0-610a2739f180 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:46.276387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-686ee6ee-d561-41f2-aaa0-610a2739f180 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:46.280110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-686ee6ee-d561-41f2-aaa0-610a2739f180 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:46.299693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7070f420-0a66-4f8b-92f7-025d4d29226c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:46.314681 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7070f420-0a66-4f8b-92f7-025d4d29226c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 200 len: 1307 microversion: 2.1 time: 0.282285 Oct 12 22:01:46.315990 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 351/616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:46 2022] GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 1307 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:46.437690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-686ee6ee-d561-41f2-aaa0-610a2739f180 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:46.449013 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-686ee6ee-d561-41f2-aaa0-610a2739f180 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 200 len: 1276 microversion: 2.1 time: 0.196439 Oct 12 22:01:46.450107 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 266/617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:46 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:46.560310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3ecda923-5495-4087-85d9-f154435a0d7c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:46.562673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3ecda923-5495-4087-85d9-f154435a0d7c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:46.569441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ecda923-5495-4087-85d9-f154435a0d7c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:46.569671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ecda923-5495-4087-85d9-f154435a0d7c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:46.570111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ecda923-5495-4087-85d9-f154435a0d7c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:46.570817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ecda923-5495-4087-85d9-f154435a0d7c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:46.571296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ecda923-5495-4087-85d9-f154435a0d7c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:46.571724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ecda923-5495-4087-85d9-f154435a0d7c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:46.726518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3ecda923-5495-4087-85d9-f154435a0d7c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:46.741117 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3ecda923-5495-4087-85d9-f154435a0d7c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1388 microversion: 2.1 time: 0.184785 Oct 12 22:01:46.742238 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 352/618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:46 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1388 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:46.890236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dddd52aa-94b3-4ded-9c67-997cdfb4e7fb tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:46.891707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dddd52aa-94b3-4ded-9c67-997cdfb4e7fb tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:46.901957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dddd52aa-94b3-4ded-9c67-997cdfb4e7fb tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:46.902710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dddd52aa-94b3-4ded-9c67-997cdfb4e7fb tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:46.903358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dddd52aa-94b3-4ded-9c67-997cdfb4e7fb tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:46.905715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dddd52aa-94b3-4ded-9c67-997cdfb4e7fb tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:46.908917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dddd52aa-94b3-4ded-9c67-997cdfb4e7fb tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:46.909547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dddd52aa-94b3-4ded-9c67-997cdfb4e7fb tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:47.159056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cc1309f2-6d01-4959-a056-89f72a294152 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:47.159709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cc1309f2-6d01-4959-a056-89f72a294152 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:47.186299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc1309f2-6d01-4959-a056-89f72a294152 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:47.186806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc1309f2-6d01-4959-a056-89f72a294152 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:47.189631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc1309f2-6d01-4959-a056-89f72a294152 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:47.190784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc1309f2-6d01-4959-a056-89f72a294152 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:47.194039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc1309f2-6d01-4959-a056-89f72a294152 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:47.194821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc1309f2-6d01-4959-a056-89f72a294152 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:47.326450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dddd52aa-94b3-4ded-9c67-997cdfb4e7fb tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:47.344400 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dddd52aa-94b3-4ded-9c67-997cdfb4e7fb tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 200 len: 1322 microversion: 2.1 time: 0.456136 Oct 12 22:01:47.368853 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 267/619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:46 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:47.383322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-809443394", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "13df621a-275e-488a-8347-5e43bb46475f"}], "security_groups": [{"name": "tempest-securitygroup--639265768"}], "key_name": "tempest-keypair-1903244980", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:47.660131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cc1309f2-6d01-4959-a056-89f72a294152 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:47.677110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cc1309f2-6d01-4959-a056-89f72a294152 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:47.679663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cc1309f2-6d01-4959-a056-89f72a294152 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:47.681369 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cc1309f2-6d01-4959-a056-89f72a294152 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1362 microversion: 2.25 time: 0.527560 Oct 12 22:01:47.708795 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 353/620] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:01:47 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1362 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:01:47.716370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ca41a037-97df-474d-a96c-53468a6e8096 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:47.717012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ca41a037-97df-474d-a96c-53468a6e8096 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:47.724627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca41a037-97df-474d-a96c-53468a6e8096 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:47.725225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca41a037-97df-474d-a96c-53468a6e8096 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:47.725735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca41a037-97df-474d-a96c-53468a6e8096 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:47.726503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca41a037-97df-474d-a96c-53468a6e8096 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:47.727328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca41a037-97df-474d-a96c-53468a6e8096 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:47.727973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca41a037-97df-474d-a96c-53468a6e8096 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:47.789835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] validate_networks() for [('13df621a-275e-488a-8347-5e43bb46475f', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:01:48.488218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ca41a037-97df-474d-a96c-53468a6e8096 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:48.534512 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ca41a037-97df-474d-a96c-53468a6e8096 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 200 len: 1307 microversion: 2.1 time: 0.817832 Oct 12 22:01:48.541102 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 354/621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:47 2022] GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 1307 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:48.580291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-58925bd2-b7e7-4f64-a5b3-73eb7efa9159 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:48.581148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-58925bd2-b7e7-4f64-a5b3-73eb7efa9159 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:48.600272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58925bd2-b7e7-4f64-a5b3-73eb7efa9159 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:48.601152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58925bd2-b7e7-4f64-a5b3-73eb7efa9159 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:48.602184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58925bd2-b7e7-4f64-a5b3-73eb7efa9159 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:48.603069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58925bd2-b7e7-4f64-a5b3-73eb7efa9159 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:48.604198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58925bd2-b7e7-4f64-a5b3-73eb7efa9159 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:48.604801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58925bd2-b7e7-4f64-a5b3-73eb7efa9159 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:48.842629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-58925bd2-b7e7-4f64-a5b3-73eb7efa9159 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:48.851867 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-58925bd2-b7e7-4f64-a5b3-73eb7efa9159 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 200 len: 1318 microversion: 2.1 time: 0.308794 Oct 12 22:01:48.852798 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 355/622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:48 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:48.859327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-38a2150f-880f-4f37-a168-60ef513afda5 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:48.861103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-38a2150f-880f-4f37-a168-60ef513afda5 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:48.877491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38a2150f-880f-4f37-a168-60ef513afda5 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:48.877942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38a2150f-880f-4f37-a168-60ef513afda5 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:48.880140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38a2150f-880f-4f37-a168-60ef513afda5 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:48.880861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38a2150f-880f-4f37-a168-60ef513afda5 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:48.881900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38a2150f-880f-4f37-a168-60ef513afda5 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:48.882599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38a2150f-880f-4f37-a168-60ef513afda5 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:48.928210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:01:48.928685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:01:48.929081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:01:48.929533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:01:48.929938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:01:48.941047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:48.941448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:48.941877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:48.942597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:48.943070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:48.943677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:48.975163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Getting quotas for project 61e71a9eeaa044e8aa939548f15a585e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:01:48.982879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Getting quotas for user 1fe98ba1ceec4b849eb45eb46ce4d425 and project 61e71a9eeaa044e8aa939548f15a585e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:01:48.993641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:48.998044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:01:49.000762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:01:49.058797 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-de770eb0-919c-473f-8a6e-cc4012c905e8 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.688609 Oct 12 22:01:49.063338 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 268/623] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:01:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 1690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:01:49.064612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1064e0ef-905f-402a-8f8f-638f623880b1 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51286d48b0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:49.124402 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1064e0ef-905f-402a-8f8f-638f623880b1 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/880862b9-228c-4f16-bc93-6363c7875535" status: 200 len: 662 microversion: 2.1 time: 0.063324 Oct 12 22:01:49.125543 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 269/624] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:01:49 2022] GET /compute/v2.1/images/880862b9-228c-4f16-bc93-6363c7875535 => generated 662 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:49.135645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb29c821-5629-4670-ba42-abf7c2fe051a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:49.136469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eb29c821-5629-4670-ba42-abf7c2fe051a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:49.144769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb29c821-5629-4670-ba42-abf7c2fe051a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:49.145254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb29c821-5629-4670-ba42-abf7c2fe051a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:49.145710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb29c821-5629-4670-ba42-abf7c2fe051a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:49.146380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb29c821-5629-4670-ba42-abf7c2fe051a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:49.147100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb29c821-5629-4670-ba42-abf7c2fe051a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:49.148483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb29c821-5629-4670-ba42-abf7c2fe051a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:49.258491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-38a2150f-880f-4f37-a168-60ef513afda5 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:49.276341 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-38a2150f-880f-4f37-a168-60ef513afda5 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1388 microversion: 2.1 time: 0.422277 Oct 12 22:01:49.276936 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 356/625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:48 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1388 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:49.299164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ebe69a98-fc24-4498-b20d-b79410da143d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:49.299810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ebe69a98-fc24-4498-b20d-b79410da143d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:49.309105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebe69a98-fc24-4498-b20d-b79410da143d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:49.309600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebe69a98-fc24-4498-b20d-b79410da143d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:49.312300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebe69a98-fc24-4498-b20d-b79410da143d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:49.314499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebe69a98-fc24-4498-b20d-b79410da143d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:49.315997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebe69a98-fc24-4498-b20d-b79410da143d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:49.316969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebe69a98-fc24-4498-b20d-b79410da143d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:49.348714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:49.349052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eb29c821-5629-4670-ba42-abf7c2fe051a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:49.363736 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb29c821-5629-4670-ba42-abf7c2fe051a tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 200 len: 1472 microversion: 2.1 time: 0.236923 Oct 12 22:01:49.379574 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 270/626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:49 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 1472 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:49.385277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-94fe855f-c660-4216-8fa4-2230e1a5651e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:49.386325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-94fe855f-c660-4216-8fa4-2230e1a5651e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:49.452902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-94fe855f-c660-4216-8fa4-2230e1a5651e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:49.467065 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-94fe855f-c660-4216-8fa4-2230e1a5651e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1234 microversion: 2.1 time: 0.085798 Oct 12 22:01:49.467676 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 271/627] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:49 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1234 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:49.472257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3a28d090-afd2-42af-a224-1d7d907406fa tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51287fc820>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:49.530332 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3a28d090-afd2-42af-a224-1d7d907406fa tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/880862b9-228c-4f16-bc93-6363c7875535" status: 200 len: 662 microversion: 2.1 time: 0.061497 Oct 12 22:01:49.530907 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 272/628] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:01:49 2022] GET /compute/v2.1/images/880862b9-228c-4f16-bc93-6363c7875535 => generated 662 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:49.545019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-5a6feb06-4ecb-4fad-848a-f88db3ef1419 req-ee8ca4ef-405e-4f6a-9c25-598da3c94a2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad668734-0c34-4d75-b667-0f69f3515d84", "tag": "38c74c93-daa8-4431-99a7-a03e4c6e546f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:49.545276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ebe69a98-fc24-4498-b20d-b79410da143d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:49.556784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ebe69a98-fc24-4498-b20d-b79410da143d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:49.558527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ebe69a98-fc24-4498-b20d-b79410da143d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:49.560036 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ebe69a98-fc24-4498-b20d-b79410da143d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1362 microversion: 2.25 time: 0.266120 Oct 12 22:01:49.561288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5a6feb06-4ecb-4fad-848a-f88db3ef1419 req-ee8ca4ef-405e-4f6a-9c25-598da3c94a2e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:49.562165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5a6feb06-4ecb-4fad-848a-f88db3ef1419 req-ee8ca4ef-405e-4f6a-9c25-598da3c94a2e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:49.562957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5a6feb06-4ecb-4fad-848a-f88db3ef1419 req-ee8ca4ef-405e-4f6a-9c25-598da3c94a2e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:49.574038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:49.575905 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 357/629] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:01:49 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:01:49.577147 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-5a6feb06-4ecb-4fad-848a-f88db3ef1419 req-ee8ca4ef-405e-4f6a-9c25-598da3c94a2e service nova] Creating event network-changed:38c74c93-daa8-4431-99a7-a03e4c6e546f for instance ad668734-0c34-4d75-b667-0f69f3515d84 on n-h1-861111-1 Oct 12 22:01:49.584258 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-5a6feb06-4ecb-4fad-848a-f88db3ef1419 req-ee8ca4ef-405e-4f6a-9c25-598da3c94a2e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045767 Oct 12 22:01:49.584957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a8014c97-daad-44be-ab44-bdc37223e877 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:49.585819 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 273/630] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:49.586293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a8014c97-daad-44be-ab44-bdc37223e877 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:49.592196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0302e0e5-aad1-46b6-b8ed-320fc7b910d4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:49.593475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0302e0e5-aad1-46b6-b8ed-320fc7b910d4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:49.593670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8014c97-daad-44be-ab44-bdc37223e877 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:49.594524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8014c97-daad-44be-ab44-bdc37223e877 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:49.596562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8014c97-daad-44be-ab44-bdc37223e877 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:49.598310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8014c97-daad-44be-ab44-bdc37223e877 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:49.598310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8014c97-daad-44be-ab44-bdc37223e877 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:49.599347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8014c97-daad-44be-ab44-bdc37223e877 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:49.605518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0302e0e5-aad1-46b6-b8ed-320fc7b910d4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:49.606862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0302e0e5-aad1-46b6-b8ed-320fc7b910d4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:49.607333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0302e0e5-aad1-46b6-b8ed-320fc7b910d4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:49.609549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0302e0e5-aad1-46b6-b8ed-320fc7b910d4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:49.610059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0302e0e5-aad1-46b6-b8ed-320fc7b910d4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:49.611376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0302e0e5-aad1-46b6-b8ed-320fc7b910d4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:49.636315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-a8014c97-daad-44be-ab44-bdc37223e877 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Lazy-loading 'flavor' on Instance uuid 1b700e31-e4a4-48a5-b49c-2da9e7532344 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:01:49.756089 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a8014c97-daad-44be-ab44-bdc37223e877 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344/action" status: 202 len: 0 microversion: 2.1 time: 0.178200 Oct 12 22:01:49.757406 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 358/631] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:01:49 2022] POST /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:01:49.781416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c2d25f11-7b5f-4497-afe9-2790ad66cbb9 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:49.783001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c2d25f11-7b5f-4497-afe9-2790ad66cbb9 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:49.791653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d25f11-7b5f-4497-afe9-2790ad66cbb9 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:49.792406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d25f11-7b5f-4497-afe9-2790ad66cbb9 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:49.793202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d25f11-7b5f-4497-afe9-2790ad66cbb9 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:49.794126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d25f11-7b5f-4497-afe9-2790ad66cbb9 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:49.794764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d25f11-7b5f-4497-afe9-2790ad66cbb9 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:49.795645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d25f11-7b5f-4497-afe9-2790ad66cbb9 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:49.998766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0302e0e5-aad1-46b6-b8ed-320fc7b910d4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:50.013133 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0302e0e5-aad1-46b6-b8ed-320fc7b910d4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 200 len: 1307 microversion: 2.1 time: 0.425933 Oct 12 22:01:50.027937 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 274/632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:49 2022] GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 1307 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:50.035336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-60b55405-7097-46f5-87b2-7c79ed56f06d tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:50.036204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-60b55405-7097-46f5-87b2-7c79ed56f06d tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:50.043680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60b55405-7097-46f5-87b2-7c79ed56f06d tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:50.044245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60b55405-7097-46f5-87b2-7c79ed56f06d tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:50.044989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60b55405-7097-46f5-87b2-7c79ed56f06d tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:50.045842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60b55405-7097-46f5-87b2-7c79ed56f06d tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:50.046521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60b55405-7097-46f5-87b2-7c79ed56f06d tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:50.047022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60b55405-7097-46f5-87b2-7c79ed56f06d tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:50.286731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-60b55405-7097-46f5-87b2-7c79ed56f06d tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:50.300618 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-60b55405-7097-46f5-87b2-7c79ed56f06d tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 200 len: 1318 microversion: 2.1 time: 0.271220 Oct 12 22:01:50.301755 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 275/633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:50 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:50.310666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e3b370fe-5462-4dee-bf96-f5f5083a4e39 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:50.311591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e3b370fe-5462-4dee-bf96-f5f5083a4e39 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:50.320000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3b370fe-5462-4dee-bf96-f5f5083a4e39 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:50.321052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3b370fe-5462-4dee-bf96-f5f5083a4e39 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:50.321506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3b370fe-5462-4dee-bf96-f5f5083a4e39 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:50.322249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3b370fe-5462-4dee-bf96-f5f5083a4e39 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:50.322794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3b370fe-5462-4dee-bf96-f5f5083a4e39 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:50.323773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3b370fe-5462-4dee-bf96-f5f5083a4e39 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:50.601273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e3b370fe-5462-4dee-bf96-f5f5083a4e39 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:50.616492 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e3b370fe-5462-4dee-bf96-f5f5083a4e39 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1388 microversion: 2.1 time: 0.310183 Oct 12 22:01:50.619961 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 276/634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:50 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1388 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:50.629110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7d84e727-418a-4767-9aca-47066ff8274b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:50.632173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7d84e727-418a-4767-9aca-47066ff8274b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:50.646719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d84e727-418a-4767-9aca-47066ff8274b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:50.648658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d84e727-418a-4767-9aca-47066ff8274b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:50.652012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d84e727-418a-4767-9aca-47066ff8274b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:50.653128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d84e727-418a-4767-9aca-47066ff8274b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:50.653796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d84e727-418a-4767-9aca-47066ff8274b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:50.655502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d84e727-418a-4767-9aca-47066ff8274b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:50.793362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7d84e727-418a-4767-9aca-47066ff8274b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:50.806984 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7d84e727-418a-4767-9aca-47066ff8274b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1286 microversion: 2.1 time: 0.185680 Oct 12 22:01:50.827030 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 277/635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:50 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1286 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:50.853094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a322dd9b-dc86-484a-ad59-7bf0ac170b14 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:50.854089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a322dd9b-dc86-484a-ad59-7bf0ac170b14 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:50.868906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a322dd9b-dc86-484a-ad59-7bf0ac170b14 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:50.871751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a322dd9b-dc86-484a-ad59-7bf0ac170b14 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:50.872349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a322dd9b-dc86-484a-ad59-7bf0ac170b14 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:50.874836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a322dd9b-dc86-484a-ad59-7bf0ac170b14 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:50.874836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a322dd9b-dc86-484a-ad59-7bf0ac170b14 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:50.877181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a322dd9b-dc86-484a-ad59-7bf0ac170b14 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:51.185286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a322dd9b-dc86-484a-ad59-7bf0ac170b14 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:51.198255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a322dd9b-dc86-484a-ad59-7bf0ac170b14 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:51.203064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a322dd9b-dc86-484a-ad59-7bf0ac170b14 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:51.208437 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a322dd9b-dc86-484a-ad59-7bf0ac170b14 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1362 microversion: 2.25 time: 0.380001 Oct 12 22:01:51.209276 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 278/636] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:01:50 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1362 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:01:51.224305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-83d102b8-dcb5-41dc-a7c9-7ecc7c6fd9df req-6225c827-8358-40f1-af9c-f7ffc1d86ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5574396-f705-4e92-9934-760a5ae961a8", "tag": "f0e5da0c-7fe4-49cd-b408-08f20ae11569"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:51.236975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-83d102b8-dcb5-41dc-a7c9-7ecc7c6fd9df req-6225c827-8358-40f1-af9c-f7ffc1d86ad4 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:51.237457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-83d102b8-dcb5-41dc-a7c9-7ecc7c6fd9df req-6225c827-8358-40f1-af9c-f7ffc1d86ad4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:51.237913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-83d102b8-dcb5-41dc-a7c9-7ecc7c6fd9df req-6225c827-8358-40f1-af9c-f7ffc1d86ad4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:51.258490 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-83d102b8-dcb5-41dc-a7c9-7ecc7c6fd9df req-6225c827-8358-40f1-af9c-f7ffc1d86ad4 service nova] Creating event network-changed:f0e5da0c-7fe4-49cd-b408-08f20ae11569 for instance e5574396-f705-4e92-9934-760a5ae961a8 on n-h1-861111-1 Oct 12 22:01:51.265171 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-83d102b8-dcb5-41dc-a7c9-7ecc7c6fd9df req-6225c827-8358-40f1-af9c-f7ffc1d86ad4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053797 Oct 12 22:01:51.266367 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 279/637] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:51.272817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e6097bd3-f049-4f2c-a413-08c8f1ba233c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:51.274495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e6097bd3-f049-4f2c-a413-08c8f1ba233c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:51.283414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6097bd3-f049-4f2c-a413-08c8f1ba233c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:51.284294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6097bd3-f049-4f2c-a413-08c8f1ba233c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:51.284995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6097bd3-f049-4f2c-a413-08c8f1ba233c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:51.286858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6097bd3-f049-4f2c-a413-08c8f1ba233c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:51.288731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6097bd3-f049-4f2c-a413-08c8f1ba233c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:51.289099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6097bd3-f049-4f2c-a413-08c8f1ba233c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:51.359648 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c2d25f11-7b5f-4497-afe9-2790ad66cbb9 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 200 len: 1631 microversion: 2.1 time: 1.583449 Oct 12 22:01:51.372380 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 359/638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:49 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 1631 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:51.382449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5e6a63db-f0ff-4b3a-bfd5-b7b11e83db42 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51285c2820>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:51.431546 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5e6a63db-f0ff-4b3a-bfd5-b7b11e83db42 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/dec50f18-a989-47e8-983f-92c4c20605bf" status: 200 len: 661 microversion: 2.1 time: 0.057752 Oct 12 22:01:51.432276 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 360/639] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:01:51 2022] GET /compute/v2.1/images/dec50f18-a989-47e8-983f-92c4c20605bf => generated 661 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:51.437131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ac4fcb84-2517-41cd-adb2-0e389ac223fd tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:51.438043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ac4fcb84-2517-41cd-adb2-0e389ac223fd tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:51.445324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac4fcb84-2517-41cd-adb2-0e389ac223fd tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:51.446122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac4fcb84-2517-41cd-adb2-0e389ac223fd tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:51.447427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac4fcb84-2517-41cd-adb2-0e389ac223fd tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:51.448394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac4fcb84-2517-41cd-adb2-0e389ac223fd tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:51.448922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac4fcb84-2517-41cd-adb2-0e389ac223fd tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:51.449457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac4fcb84-2517-41cd-adb2-0e389ac223fd tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:51.514176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e6097bd3-f049-4f2c-a413-08c8f1ba233c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:51.522986 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e6097bd3-f049-4f2c-a413-08c8f1ba233c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 200 len: 1307 microversion: 2.1 time: 0.254587 Oct 12 22:01:51.523591 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 280/640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:51 2022] GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 1307 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:51.529500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7276ba07-50df-4a24-a345-d372ed6390e8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51286d45e0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:51.575225 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7276ba07-50df-4a24-a345-d372ed6390e8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/dec50f18-a989-47e8-983f-92c4c20605bf" status: 200 len: 661 microversion: 2.1 time: 0.049033 Oct 12 22:01:51.583623 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 281/641] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:01:51 2022] GET /compute/v2.1/images/dec50f18-a989-47e8-983f-92c4c20605bf => generated 661 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:51.652150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-03125f8e-4dd0-4276-82f6-40ea79588cad tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:51.653059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-03125f8e-4dd0-4276-82f6-40ea79588cad tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:51.672374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03125f8e-4dd0-4276-82f6-40ea79588cad tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:51.673697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03125f8e-4dd0-4276-82f6-40ea79588cad tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:51.675798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03125f8e-4dd0-4276-82f6-40ea79588cad tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:51.677110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03125f8e-4dd0-4276-82f6-40ea79588cad tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:51.677836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03125f8e-4dd0-4276-82f6-40ea79588cad tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:51.678411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03125f8e-4dd0-4276-82f6-40ea79588cad tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:51.816983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-03125f8e-4dd0-4276-82f6-40ea79588cad tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:51.825213 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-03125f8e-4dd0-4276-82f6-40ea79588cad tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1388 microversion: 2.1 time: 0.184628 Oct 12 22:01:51.825782 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 282/642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:51 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1388 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:01:51.832787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-08eee361-59f5-48d3-8a00-7d3c232dd090 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:51.833388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-08eee361-59f5-48d3-8a00-7d3c232dd090 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:51.839454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08eee361-59f5-48d3-8a00-7d3c232dd090 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:51.839932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08eee361-59f5-48d3-8a00-7d3c232dd090 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:51.840358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08eee361-59f5-48d3-8a00-7d3c232dd090 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:51.841034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08eee361-59f5-48d3-8a00-7d3c232dd090 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:51.841491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08eee361-59f5-48d3-8a00-7d3c232dd090 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:51.841907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08eee361-59f5-48d3-8a00-7d3c232dd090 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:51.859930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ac4fcb84-2517-41cd-adb2-0e389ac223fd tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:51.868823 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ac4fcb84-2517-41cd-adb2-0e389ac223fd tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 200 len: 1318 microversion: 2.1 time: 0.435338 Oct 12 22:01:51.869508 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 361/643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:51 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:51.915276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-08eee361-59f5-48d3-8a00-7d3c232dd090 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:51.923246 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-08eee361-59f5-48d3-8a00-7d3c232dd090 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1292 microversion: 2.1 time: 0.094569 Oct 12 22:01:51.924011 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 283/644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:51 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1292 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:01:52.239280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fc4a28e9-27f0-4011-a09c-6b4652f98295 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:52.240783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fc4a28e9-27f0-4011-a09c-6b4652f98295 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:52.249611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc4a28e9-27f0-4011-a09c-6b4652f98295 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:52.250094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc4a28e9-27f0-4011-a09c-6b4652f98295 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:52.251509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc4a28e9-27f0-4011-a09c-6b4652f98295 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:52.253513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc4a28e9-27f0-4011-a09c-6b4652f98295 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:52.253972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc4a28e9-27f0-4011-a09c-6b4652f98295 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:52.254564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc4a28e9-27f0-4011-a09c-6b4652f98295 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:52.255131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:52.385721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-931493e5-d5a0-47b9-95c7-300e288486d6 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:52.387447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-931493e5-d5a0-47b9-95c7-300e288486d6 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:52.395112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931493e5-d5a0-47b9-95c7-300e288486d6 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:52.396269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931493e5-d5a0-47b9-95c7-300e288486d6 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:52.397161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931493e5-d5a0-47b9-95c7-300e288486d6 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:52.397994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931493e5-d5a0-47b9-95c7-300e288486d6 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:52.398550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931493e5-d5a0-47b9-95c7-300e288486d6 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:52.399114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931493e5-d5a0-47b9-95c7-300e288486d6 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:52.569000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fc4a28e9-27f0-4011-a09c-6b4652f98295 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:52.573975 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-931493e5-d5a0-47b9-95c7-300e288486d6 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 200 len: 1614 microversion: 2.1 time: 0.191833 Oct 12 22:01:52.574619 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 284/645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:52 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 1614 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:01:52.592478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fc4a28e9-27f0-4011-a09c-6b4652f98295 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:52.600662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cafcaa4a-f0d9-42ea-af7e-04bab123da1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:52.601327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cafcaa4a-f0d9-42ea-af7e-04bab123da1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:52.609091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cafcaa4a-f0d9-42ea-af7e-04bab123da1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:52.646176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fc4a28e9-27f0-4011-a09c-6b4652f98295 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:52.646176 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fc4a28e9-27f0-4011-a09c-6b4652f98295 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1362 microversion: 2.25 time: 0.383916 Oct 12 22:01:52.646176 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 362/646] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:01:52 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:01:52.647209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cafcaa4a-f0d9-42ea-af7e-04bab123da1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:52.647209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cafcaa4a-f0d9-42ea-af7e-04bab123da1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:52.647577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a3c4f742-baef-46f8-a455-effc90644903 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:52.647577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a3c4f742-baef-46f8-a455-effc90644903 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:52.648830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cafcaa4a-f0d9-42ea-af7e-04bab123da1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:52.649642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cafcaa4a-f0d9-42ea-af7e-04bab123da1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:52.650294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cafcaa4a-f0d9-42ea-af7e-04bab123da1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:52.660265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3c4f742-baef-46f8-a455-effc90644903 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:52.660852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3c4f742-baef-46f8-a455-effc90644903 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:52.661273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3c4f742-baef-46f8-a455-effc90644903 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:52.662109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3c4f742-baef-46f8-a455-effc90644903 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:52.662816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3c4f742-baef-46f8-a455-effc90644903 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:52.663352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3c4f742-baef-46f8-a455-effc90644903 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:52.825946 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-a3c4f742-baef-46f8-a455-effc90644903 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] HTTP exception thrown: Cannot 'migrate' instance 1b700e31-e4a4-48a5-b49c-2da9e7532344 while it is in vm_state suspended Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a3c4f742-baef-46f8-a455-effc90644903 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Request method failure captured: Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344/action HTTP/1.1 Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 15 Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzkgBcOvZilpTp-Q0MUHMih-ULHv9xaN2mhq_1meDtU4aqy3f4QxmWD1qUdM9ztsvqY1_QZSSjkF_XSNW_TV-OO3N14LwuCvzPeOF9WKQ3yisFuhIc_RVGLJAes0KBTURBfz_SO_zwegcjPsEjBzg1MNBWCj687nj8y7hJspOg8A_4M Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1f79807d8f1b4e7fb30e01db0dab1330 Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-577172057 Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:01:52.827852 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:01:52.829494 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f79807d8f1b4e7fb30e01db0dab1330"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f79807d8f1b4e7fb30e01db0dab1330"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1f79807d8f1b4e7fb30e01db0dab1330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1f79807d8f1b4e7fb30e01db0dab1330"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:01:52.829494 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersAdminNegativeTestJSON-577172057 Oct 12 22:01:52.829494 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1f79807d8f1b4e7fb30e01db0dab1330 Oct 12 22:01:52.829494 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-577172057 Oct 12 22:01:52.829494 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersAdminNegativeTestJSON-577172057-project-admin Oct 12 22:01:52.829494 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:01:52.829494 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:01:52.829494 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 0e51ae21b8e54fd9a4caf6361a1df67a Oct 12 22:01:52.829494 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersAdminNegativeTestJSON-577172057-project-admin Oct 12 22:01:52.829494 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:01:52.829494 n-d-861111-1 devstack@n-api.service[120453]: {"migrate": {}} Oct 12 22:01:52.829494 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:01:52.829494 n-d-861111-1 devstack@n-api.service[120453]: exception: Cannot 'migrate' instance 1b700e31-e4a4-48a5-b49c-2da9e7532344 while it is in vm_state suspended Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1b700e31-e4a4-48a5-b49c-2da9e7532344', 'body': {'migrate': {}}} Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1b700e31-e4a4-48a5-b49c-2da9e7532344 in vm_state suspended. Cannot resize while the instance is in this state. Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:01:52.830481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 1b700e31-e4a4-48a5-b49c-2da9e7532344 while it is in vm_state suspended Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:01:52.836170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:01:52.837342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:01:52.837342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:01:52.837342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 1b700e31-e4a4-48a5-b49c-2da9e7532344 while it is in vm_state suspended Oct 12 22:01:52.837342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:01:52.837342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a3c4f742-baef-46f8-a455-effc90644903 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Returning 409 to user: Cannot 'migrate' instance 1b700e31-e4a4-48a5-b49c-2da9e7532344 while it is in vm_state suspended {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:01:52.837342 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a3c4f742-baef-46f8-a455-effc90644903 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344/action" status: 409 len: 148 microversion: 2.1 time: 0.210524 Oct 12 22:01:52.837342 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 363/647] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:01:52 2022] POST /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344/action => generated 148 bytes in 211 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:01:52.840955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f44f71b1-8a6c-4984-b05f-7b4b3ed767a6 req-88559b41-1d0e-4ddf-b849-ea87bedabfb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f266cf9-d4aa-4392-ab6c-722b3ef3d26e", "name": "network-vif-plugged", "status": "completed", "tag": "43b4aff9-14b1-41df-8485-e703d7cb7bea"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:52.858408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f44f71b1-8a6c-4984-b05f-7b4b3ed767a6 req-88559b41-1d0e-4ddf-b849-ea87bedabfb0 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:52.861702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f44f71b1-8a6c-4984-b05f-7b4b3ed767a6 req-88559b41-1d0e-4ddf-b849-ea87bedabfb0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:52.862164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f44f71b1-8a6c-4984-b05f-7b4b3ed767a6 req-88559b41-1d0e-4ddf-b849-ea87bedabfb0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:52.872301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cafcaa4a-f0d9-42ea-af7e-04bab123da1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:52.885016 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cafcaa4a-f0d9-42ea-af7e-04bab123da1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 200 len: 1307 microversion: 2.1 time: 0.292507 Oct 12 22:01:52.888314 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 285/648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:52 2022] GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 1307 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:52.895298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eba6ddb7-c4f3-4f82-9e33-bcafbb8539d0 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eba6ddb7-c4f3-4f82-9e33-bcafbb8539d0 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Request method failure captured: Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02/action HTTP/1.1 Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 39 Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzkgBcOvZilpTp-Q0MUHMih-ULHv9xaN2mhq_1meDtU4aqy3f4QxmWD1qUdM9ztsvqY1_QZSSjkF_XSNW_TV-OO3N14LwuCvzPeOF9WKQ3yisFuhIc_RVGLJAes0KBTURBfz_SO_zwegcjPsEjBzg1MNBWCj687nj8y7hJspOg8A_4M Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1f79807d8f1b4e7fb30e01db0dab1330 Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-577172057 Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 22:01:52.901447 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 22:01:52.902970 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f79807d8f1b4e7fb30e01db0dab1330"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f79807d8f1b4e7fb30e01db0dab1330"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1f79807d8f1b4e7fb30e01db0dab1330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1f79807d8f1b4e7fb30e01db0dab1330"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:01:52.902970 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersAdminNegativeTestJSON-577172057 Oct 12 22:01:52.902970 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1f79807d8f1b4e7fb30e01db0dab1330 Oct 12 22:01:52.902970 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-577172057 Oct 12 22:01:52.902970 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersAdminNegativeTestJSON-577172057-project-admin Oct 12 22:01:52.902970 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:01:52.902970 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:01:52.902970 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 0e51ae21b8e54fd9a4caf6361a1df67a Oct 12 22:01:52.902970 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersAdminNegativeTestJSON-577172057-project-admin Oct 12 22:01:52.902970 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:01:52.902970 n-d-861111-1 devstack@n-api.service[120452]: {"os-resetState": {"state": "invalid"}} Oct 12 22:01:52.902970 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'c6149ecf-bb8a-4f49-b8e8-6c71b862ff02', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'invalid' Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:01:52.903735 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:01:52.905055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 12 22:01:52.906170 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:52.906246 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f44f71b1-8a6c-4984-b05f-7b4b3ed767a6 req-88559b41-1d0e-4ddf-b849-ea87bedabfb0 service nova] Creating event network-vif-plugged:43b4aff9-14b1-41df-8485-e703d7cb7bea for instance 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e on n-h1-861111-1 Oct 12 22:01:52.909451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eba6ddb7-c4f3-4f82-9e33-bcafbb8539d0 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:01:52.909899 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f44f71b1-8a6c-4984-b05f-7b4b3ed767a6 req-88559b41-1d0e-4ddf-b849-ea87bedabfb0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077893 Oct 12 22:01:52.910637 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eba6ddb7-c4f3-4f82-9e33-bcafbb8539d0 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02/action" status: 400 len: 144 microversion: 2.1 time: 0.020936 Oct 12 22:01:52.911527 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 364/650] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:52.911991 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 286/650] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:01:52 2022] POST /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02/action => generated 144 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:01:52.917285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-09f1dcc8-bf7d-4af5-aae8-6a98253fcbcf tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:52.919437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d00ada02-91a4-4a42-97e4-498d98b28910 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:52.920409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d00ada02-91a4-4a42-97e4-498d98b28910 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:52.929358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-09f1dcc8-bf7d-4af5-aae8-6a98253fcbcf tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:52.930649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d00ada02-91a4-4a42-97e4-498d98b28910 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:52.931830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d00ada02-91a4-4a42-97e4-498d98b28910 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:52.932397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d00ada02-91a4-4a42-97e4-498d98b28910 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:52.933226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d00ada02-91a4-4a42-97e4-498d98b28910 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:52.933817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d00ada02-91a4-4a42-97e4-498d98b28910 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:52.934338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d00ada02-91a4-4a42-97e4-498d98b28910 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:52.966935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09f1dcc8-bf7d-4af5-aae8-6a98253fcbcf tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:52.967687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09f1dcc8-bf7d-4af5-aae8-6a98253fcbcf tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:52.970620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09f1dcc8-bf7d-4af5-aae8-6a98253fcbcf tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:52.971635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09f1dcc8-bf7d-4af5-aae8-6a98253fcbcf tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:52.972613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09f1dcc8-bf7d-4af5-aae8-6a98253fcbcf tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:52.973196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09f1dcc8-bf7d-4af5-aae8-6a98253fcbcf tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:53.185213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-09f1dcc8-bf7d-4af5-aae8-6a98253fcbcf tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:53.194086 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-09f1dcc8-bf7d-4af5-aae8-6a98253fcbcf tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 200 len: 1318 microversion: 2.1 time: 0.281069 Oct 12 22:01:53.195268 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 287/651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:52 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:53.200251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-57bd8663-5d04-480f-b841-1d64f5662705 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-57bd8663-5d04-480f-b841-1d64f5662705 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Request method failure captured: Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02/action HTTP/1.1 Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 31 Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzkgBcOvZilpTp-Q0MUHMih-ULHv9xaN2mhq_1meDtU4aqy3f4QxmWD1qUdM9ztsvqY1_QZSSjkF_XSNW_TV-OO3N14LwuCvzPeOF9WKQ3yisFuhIc_RVGLJAes0KBTURBfz_SO_zwegcjPsEjBzg1MNBWCj687nj8y7hJspOg8A_4M Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1f79807d8f1b4e7fb30e01db0dab1330 Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-577172057 Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 22:01:53.204652 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 22:01:53.205911 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f79807d8f1b4e7fb30e01db0dab1330"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f79807d8f1b4e7fb30e01db0dab1330"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1f79807d8f1b4e7fb30e01db0dab1330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1f79807d8f1b4e7fb30e01db0dab1330"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:01:53.205911 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersAdminNegativeTestJSON-577172057 Oct 12 22:01:53.205911 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1f79807d8f1b4e7fb30e01db0dab1330 Oct 12 22:01:53.205911 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-577172057 Oct 12 22:01:53.205911 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersAdminNegativeTestJSON-577172057-project-admin Oct 12 22:01:53.205911 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:01:53.205911 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:01:53.205911 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 0e51ae21b8e54fd9a4caf6361a1df67a Oct 12 22:01:53.205911 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersAdminNegativeTestJSON-577172057-project-admin Oct 12 22:01:53.205911 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:01:53.205911 n-d-861111-1 devstack@n-api.service[120452]: {"os-resetState": {"state": 1}} Oct 12 22:01:53.205911 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:01:53.205911 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'c6149ecf-bb8a-4f49-b8e8-6c71b862ff02', 'body': {'os-resetState': {'state': 1}}} Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 1 Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:01:53.207110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 12 22:01:53.208596 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:53.213032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-57bd8663-5d04-480f-b841-1d64f5662705 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:01:53.213255 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-57bd8663-5d04-480f-b841-1d64f5662705 tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02/action" status: 400 len: 120 microversion: 2.1 time: 0.016697 Oct 12 22:01:53.214029 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 288/652] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:01:53 2022] POST /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02/action => generated 120 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:01:53.219314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3208a7bc-33d7-43fe-a785-9076c019ae10 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:53.220200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3208a7bc-33d7-43fe-a785-9076c019ae10 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:53.228630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3208a7bc-33d7-43fe-a785-9076c019ae10 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:53.229338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3208a7bc-33d7-43fe-a785-9076c019ae10 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:53.231857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3208a7bc-33d7-43fe-a785-9076c019ae10 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:53.232695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3208a7bc-33d7-43fe-a785-9076c019ae10 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:53.235648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3208a7bc-33d7-43fe-a785-9076c019ae10 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:53.240876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3208a7bc-33d7-43fe-a785-9076c019ae10 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:53.422704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3208a7bc-33d7-43fe-a785-9076c019ae10 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:53.432792 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3208a7bc-33d7-43fe-a785-9076c019ae10 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1359 microversion: 2.1 time: 0.217477 Oct 12 22:01:53.433871 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 289/653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:53 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:53.444552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c5739332-6ef1-423c-a873-153512f9e919 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128663820>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:53.492032 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c5739332-6ef1-423c-a873-153512f9e919 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/118924f1-4225-425e-a86a-d2908313a327" status: 200 len: 661 microversion: 2.1 time: 0.056230 Oct 12 22:01:53.492624 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 290/654] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:01:53 2022] GET /compute/v2.1/images/118924f1-4225-425e-a86a-d2908313a327 => generated 661 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:53.497144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-884ae422-22fc-48bb-9e19-d0f0ecc692de tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:53.499214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-884ae422-22fc-48bb-9e19-d0f0ecc692de tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Failed to fetch instance by id 999 {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 22:01:53.499741 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-884ae422-22fc-48bb-9e19-d0f0ecc692de tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-884ae422-22fc-48bb-9e19-d0f0ecc692de tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Request method failure captured: Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 37 Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzkgBcOvZilpTp-Q0MUHMih-ULHv9xaN2mhq_1meDtU4aqy3f4QxmWD1qUdM9ztsvqY1_QZSSjkF_XSNW_TV-OO3N14LwuCvzPeOF9WKQ3yisFuhIc_RVGLJAes0KBTURBfz_SO_zwegcjPsEjBzg1MNBWCj687nj8y7hJspOg8A_4M Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1f79807d8f1b4e7fb30e01db0dab1330 Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-577172057 Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 22:01:53.501973 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 22:01:53.503297 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f79807d8f1b4e7fb30e01db0dab1330"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f79807d8f1b4e7fb30e01db0dab1330"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1f79807d8f1b4e7fb30e01db0dab1330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1f79807d8f1b4e7fb30e01db0dab1330"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:01:53.503297 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersAdminNegativeTestJSON-577172057 Oct 12 22:01:53.503297 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1f79807d8f1b4e7fb30e01db0dab1330 Oct 12 22:01:53.503297 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-577172057 Oct 12 22:01:53.503297 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersAdminNegativeTestJSON-577172057-project-admin Oct 12 22:01:53.503297 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:01:53.503297 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:01:53.503297 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 0e51ae21b8e54fd9a4caf6361a1df67a Oct 12 22:01:53.503297 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersAdminNegativeTestJSON-577172057-project-admin Oct 12 22:01:53.503297 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:01:53.503297 n-d-861111-1 devstack@n-api.service[120452]: {"os-resetState": {"state": "error"}} Oct 12 22:01:53.503297 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:01:53.503297 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 999 could not be found. Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:01:53.504182 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 12 22:01:53.505626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 22:01:53.505626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:01:53.505626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:01:53.505626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 12 22:01:53.505626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:53.505626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:01:53.505626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:53.505626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:01:53.505626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:01:53.505626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:01:53.505626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:01:53.505626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:01:53.505626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 12 22:01:53.505626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:01:53.505626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-884ae422-22fc-48bb-9e19-d0f0ecc692de tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:01:53.505626 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-884ae422-22fc-48bb-9e19-d0f0ecc692de tempest-ServersAdminNegativeTestJSON-577172057 tempest-ServersAdminNegativeTestJSON-577172057-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.011506 Oct 12 22:01:53.506962 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 291/655] 10.222.0.16 () {60 vars in 1179 bytes} [Wed Oct 12 22:01:53 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:01:53.511119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb656b77-8b43-40c3-8a68-005348c98f36 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512875c5e0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:53.559860 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb656b77-8b43-40c3-8a68-005348c98f36 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/118924f1-4225-425e-a86a-d2908313a327" status: 200 len: 661 microversion: 2.1 time: 0.052939 Oct 12 22:01:53.560892 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 292/656] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:01:53 2022] GET /compute/v2.1/images/118924f1-4225-425e-a86a-d2908313a327 => generated 661 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:53.566755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bd510b84-67e8-450f-85eb-a5ca3441026d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:53.567276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bd510b84-67e8-450f-85eb-a5ca3441026d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:53.576475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd510b84-67e8-450f-85eb-a5ca3441026d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:53.577157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd510b84-67e8-450f-85eb-a5ca3441026d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:53.577768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd510b84-67e8-450f-85eb-a5ca3441026d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:53.578539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd510b84-67e8-450f-85eb-a5ca3441026d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:53.579653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd510b84-67e8-450f-85eb-a5ca3441026d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:53.580285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd510b84-67e8-450f-85eb-a5ca3441026d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:53.609826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d00ada02-91a4-4a42-97e4-498d98b28910 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:53.621171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bd510b84-67e8-450f-85eb-a5ca3441026d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:01:53.627177 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d00ada02-91a4-4a42-97e4-498d98b28910 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1388 microversion: 2.1 time: 0.713916 Oct 12 22:01:53.628404 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 365/657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:52 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1388 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:53.643729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-590708984", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:53.717977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] validate_networks() for None {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:01:53.738731 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bd510b84-67e8-450f-85eb-a5ca3441026d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 204 len: 0 microversion: 2.1 time: 0.176597 Oct 12 22:01:53.740329 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 293/658] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:01:53 2022] DELETE /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:01:53.746510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2fb3a418-ecf3-4bfc-9f8a-ea6e9c76c3bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:53.747489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2fb3a418-ecf3-4bfc-9f8a-ea6e9c76c3bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:53.753512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fb3a418-ecf3-4bfc-9f8a-ea6e9c76c3bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:53.753978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fb3a418-ecf3-4bfc-9f8a-ea6e9c76c3bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:53.754401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fb3a418-ecf3-4bfc-9f8a-ea6e9c76c3bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:53.755693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fb3a418-ecf3-4bfc-9f8a-ea6e9c76c3bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:53.756424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fb3a418-ecf3-4bfc-9f8a-ea6e9c76c3bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:53.756986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fb3a418-ecf3-4bfc-9f8a-ea6e9c76c3bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:53.904285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=30 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:53.906514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2fb3a418-ecf3-4bfc-9f8a-ea6e9c76c3bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:53.914928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2fb3a418-ecf3-4bfc-9f8a-ea6e9c76c3bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:53.916307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2fb3a418-ecf3-4bfc-9f8a-ea6e9c76c3bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:53.917403 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2fb3a418-ecf3-4bfc-9f8a-ea6e9c76c3bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1362 microversion: 2.25 time: 0.175762 Oct 12 22:01:53.917945 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 294/659] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:01:53 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:01:53.922349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c7a3094d-8cab-420d-86c3-519963a1d243 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:53.923505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c7a3094d-8cab-420d-86c3-519963a1d243 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:53.929120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7a3094d-8cab-420d-86c3-519963a1d243 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:53.929596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7a3094d-8cab-420d-86c3-519963a1d243 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:53.930021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7a3094d-8cab-420d-86c3-519963a1d243 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:53.930699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7a3094d-8cab-420d-86c3-519963a1d243 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:53.931141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7a3094d-8cab-420d-86c3-519963a1d243 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:53.931587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7a3094d-8cab-420d-86c3-519963a1d243 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:53.946942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:54.120303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c7a3094d-8cab-420d-86c3-519963a1d243 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:54.131111 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c7a3094d-8cab-420d-86c3-519963a1d243 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 200 len: 1469 microversion: 2.1 time: 0.212110 Oct 12 22:01:54.147078 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 295/660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:53 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 1469 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:54.147078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bd9a3918-ef08-45b6-b678-d0ccd1e0dbfb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:54.147078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bd9a3918-ef08-45b6-b678-d0ccd1e0dbfb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:54.147078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd9a3918-ef08-45b6-b678-d0ccd1e0dbfb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:54.147078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd9a3918-ef08-45b6-b678-d0ccd1e0dbfb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:54.147733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd9a3918-ef08-45b6-b678-d0ccd1e0dbfb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:54.148665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd9a3918-ef08-45b6-b678-d0ccd1e0dbfb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:54.149311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd9a3918-ef08-45b6-b678-d0ccd1e0dbfb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:54.149740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd9a3918-ef08-45b6-b678-d0ccd1e0dbfb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:54.351746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd9a3918-ef08-45b6-b678-d0ccd1e0dbfb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:54.378395 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bd9a3918-ef08-45b6-b678-d0ccd1e0dbfb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 200 len: 1307 microversion: 2.1 time: 0.244984 Oct 12 22:01:54.380226 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 296/661] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:54 2022] GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 1307 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:54.400034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9e5284e8-aca1-4f05-bcec-4c45018538c8 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:54.400489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9e5284e8-aca1-4f05-bcec-4c45018538c8 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:54.408217 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e5284e8-aca1-4f05-bcec-4c45018538c8 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:54.408839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e5284e8-aca1-4f05-bcec-4c45018538c8 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:54.409569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e5284e8-aca1-4f05-bcec-4c45018538c8 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:54.410365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e5284e8-aca1-4f05-bcec-4c45018538c8 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:54.411019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e5284e8-aca1-4f05-bcec-4c45018538c8 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:54.411561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e5284e8-aca1-4f05-bcec-4c45018538c8 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:54.453896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:01:54.455074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:01:54.455874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:01:54.456464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:01:54.457297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:01:54.468202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:54.468851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:54.469497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:54.471057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:54.471711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:54.472302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:54.495156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Getting quotas for project 32006aee9df347b1a5f00c983dddc655. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:01:54.501577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Getting quotas for user 26a287fd11f74fefb1f27455763b8a01 and project 32006aee9df347b1a5f00c983dddc655. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:01:54.515380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:01:54.518622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: cf71b2a6-484b-4e05-80fb-89be6b98546a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:01:54.576149 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2b55d8a3-c959-4c65-96c6-5f888d20ce61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.943214 Oct 12 22:01:54.577148 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 366/662] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:01:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:01:54.583004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4b1bdcb0-e3a6-428d-be57-5224ea7770fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:54.584035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4b1bdcb0-e3a6-428d-be57-5224ea7770fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:54.592248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b1bdcb0-e3a6-428d-be57-5224ea7770fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:54.593660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b1bdcb0-e3a6-428d-be57-5224ea7770fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:54.593818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b1bdcb0-e3a6-428d-be57-5224ea7770fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:54.595497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b1bdcb0-e3a6-428d-be57-5224ea7770fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:54.596256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b1bdcb0-e3a6-428d-be57-5224ea7770fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:54.597510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b1bdcb0-e3a6-428d-be57-5224ea7770fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:54.666424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9e5284e8-aca1-4f05-bcec-4c45018538c8 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:54.676149 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9e5284e8-aca1-4f05-bcec-4c45018538c8 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 200 len: 1318 microversion: 2.1 time: 0.294732 Oct 12 22:01:54.679402 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 297/663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:54 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:54.686939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-98726b89-1ea0-4e2e-96b9-e50166c23dfb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:54.688140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-98726b89-1ea0-4e2e-96b9-e50166c23dfb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:54.701911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98726b89-1ea0-4e2e-96b9-e50166c23dfb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:54.713159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98726b89-1ea0-4e2e-96b9-e50166c23dfb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:54.714167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98726b89-1ea0-4e2e-96b9-e50166c23dfb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:54.715538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98726b89-1ea0-4e2e-96b9-e50166c23dfb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:54.716215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98726b89-1ea0-4e2e-96b9-e50166c23dfb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:54.716855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98726b89-1ea0-4e2e-96b9-e50166c23dfb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:54.911783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-98726b89-1ea0-4e2e-96b9-e50166c23dfb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:54.922843 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-98726b89-1ea0-4e2e-96b9-e50166c23dfb tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1388 microversion: 2.1 time: 0.242252 Oct 12 22:01:54.936930 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 298/664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:54 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1388 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:54.941271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1688048212", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:55.028027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:01:55.122584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b1bdcb0-e3a6-428d-be57-5224ea7770fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:55.136363 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4b1bdcb0-e3a6-428d-be57-5224ea7770fc tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1359 microversion: 2.1 time: 0.557696 Oct 12 22:01:55.136950 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 367/665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:54 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1359 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:55.141650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4b709b96-7d5a-4ec8-a5d3-762c93de79d0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:55.142247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4b709b96-7d5a-4ec8-a5d3-762c93de79d0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:55.160368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b709b96-7d5a-4ec8-a5d3-762c93de79d0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:55.164622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b709b96-7d5a-4ec8-a5d3-762c93de79d0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:55.165094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b709b96-7d5a-4ec8-a5d3-762c93de79d0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:55.165951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b709b96-7d5a-4ec8-a5d3-762c93de79d0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:55.169721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b709b96-7d5a-4ec8-a5d3-762c93de79d0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:55.170280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b709b96-7d5a-4ec8-a5d3-762c93de79d0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:55.334711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:01:55.335691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:01:55.336356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:01:55.336953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:01:55.337764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:01:55.348720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:55.349343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:55.349789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:55.350693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:55.351437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:55.351882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:55.378167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Getting quotas for project 32006aee9df347b1a5f00c983dddc655. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:01:55.385029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Getting quotas for user 26a287fd11f74fefb1f27455763b8a01 and project 32006aee9df347b1a5f00c983dddc655. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:01:55.403592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:01:55.406001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:01:55.485664 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c9825f08-fa00-45fa-b0e1-bec3714c215c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555421 Oct 12 22:01:55.486277 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 299/666] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:01:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:01:55.497226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-3ad28d90-bbc8-43ff-a158-cf38551d8b2c req-b4959633-0225-46cd-8d05-eccc440f3f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a164670-124d-407d-a4d1-940846b45e2d", "name": "network-vif-plugged", "status": "completed", "tag": "78bf0b61-fcf3-4082-9079-b4ba87319616"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:55.511455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3ad28d90-bbc8-43ff-a158-cf38551d8b2c req-b4959633-0225-46cd-8d05-eccc440f3f70 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:55.512786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3ad28d90-bbc8-43ff-a158-cf38551d8b2c req-b4959633-0225-46cd-8d05-eccc440f3f70 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:55.513704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3ad28d90-bbc8-43ff-a158-cf38551d8b2c req-b4959633-0225-46cd-8d05-eccc440f3f70 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:55.530584 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-3ad28d90-bbc8-43ff-a158-cf38551d8b2c req-b4959633-0225-46cd-8d05-eccc440f3f70 service nova] Creating event network-vif-plugged:78bf0b61-fcf3-4082-9079-b4ba87319616 for instance 1a164670-124d-407d-a4d1-940846b45e2d on n-h1-861111-1 Oct 12 22:01:55.537962 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-3ad28d90-bbc8-43ff-a158-cf38551d8b2c req-b4959633-0225-46cd-8d05-eccc440f3f70 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046671 Oct 12 22:01:55.543299 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 300/667] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:55.550115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-efad1120-fc70-4df9-8530-183654956eb2 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:55.551220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-efad1120-fc70-4df9-8530-183654956eb2 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:55.558557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b709b96-7d5a-4ec8-a5d3-762c93de79d0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:55.582413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b709b96-7d5a-4ec8-a5d3-762c93de79d0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:55.592426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efad1120-fc70-4df9-8530-183654956eb2 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:55.595729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b709b96-7d5a-4ec8-a5d3-762c93de79d0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:55.600020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efad1120-fc70-4df9-8530-183654956eb2 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:55.603627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efad1120-fc70-4df9-8530-183654956eb2 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:55.604538 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4b709b96-7d5a-4ec8-a5d3-762c93de79d0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1558 microversion: 2.25 time: 0.466563 Oct 12 22:01:55.606245 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 368/668] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:01:55 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1558 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:01:55.606684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efad1120-fc70-4df9-8530-183654956eb2 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:55.608210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efad1120-fc70-4df9-8530-183654956eb2 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:55.610925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efad1120-fc70-4df9-8530-183654956eb2 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:55.633972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f3b1e9a4-6f18-40f7-bae7-2a936dd5df9e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:55.643712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f3b1e9a4-6f18-40f7-bae7-2a936dd5df9e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:55.683699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3b1e9a4-6f18-40f7-bae7-2a936dd5df9e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:55.684477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3b1e9a4-6f18-40f7-bae7-2a936dd5df9e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:55.685136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3b1e9a4-6f18-40f7-bae7-2a936dd5df9e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:55.686950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3b1e9a4-6f18-40f7-bae7-2a936dd5df9e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:55.703572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3b1e9a4-6f18-40f7-bae7-2a936dd5df9e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:55.704592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3b1e9a4-6f18-40f7-bae7-2a936dd5df9e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:56.052517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-efad1120-fc70-4df9-8530-183654956eb2 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:56.061738 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-efad1120-fc70-4df9-8530-183654956eb2 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 200 len: 1469 microversion: 2.1 time: 0.516844 Oct 12 22:01:56.062706 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 301/669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:55 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 1469 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:56.075384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-008e7ce0-ae62-4670-91aa-886a5e9b11fe tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:56.077191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-008e7ce0-ae62-4670-91aa-886a5e9b11fe tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:56.111847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f3b1e9a4-6f18-40f7-bae7-2a936dd5df9e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:56.133199 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f3b1e9a4-6f18-40f7-bae7-2a936dd5df9e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 200 len: 1307 microversion: 2.1 time: 0.523689 Oct 12 22:01:56.140821 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 369/670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:55 2022] GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 1307 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:56.207460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-008e7ce0-ae62-4670-91aa-886a5e9b11fe tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:56.224980 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-008e7ce0-ae62-4670-91aa-886a5e9b11fe tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1218 microversion: 2.1 time: 0.160733 Oct 12 22:01:56.240121 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 302/671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:56 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1218 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:56.254200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d941b289-f528-4ded-aa8a-03156bc906df tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:56.254777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d941b289-f528-4ded-aa8a-03156bc906df tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:56.273632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d941b289-f528-4ded-aa8a-03156bc906df tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:56.274117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d941b289-f528-4ded-aa8a-03156bc906df tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:56.275560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d941b289-f528-4ded-aa8a-03156bc906df tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:56.276512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d941b289-f528-4ded-aa8a-03156bc906df tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:56.279873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d941b289-f528-4ded-aa8a-03156bc906df tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:56.280993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d941b289-f528-4ded-aa8a-03156bc906df tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:56.555107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2592d793-0806-4a97-a20a-62ff7ef1a8d9 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:56.556790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2592d793-0806-4a97-a20a-62ff7ef1a8d9 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:56.567582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2592d793-0806-4a97-a20a-62ff7ef1a8d9 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:56.568313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2592d793-0806-4a97-a20a-62ff7ef1a8d9 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:56.569125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2592d793-0806-4a97-a20a-62ff7ef1a8d9 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:56.569839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2592d793-0806-4a97-a20a-62ff7ef1a8d9 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:56.570454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2592d793-0806-4a97-a20a-62ff7ef1a8d9 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:56.571034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2592d793-0806-4a97-a20a-62ff7ef1a8d9 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:56.818465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-2592d793-0806-4a97-a20a-62ff7ef1a8d9 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'services' on Instance uuid 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:01:56.881635 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2592d793-0806-4a97-a20a-62ff7ef1a8d9 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 2051 microversion: 2.25 time: 0.739088 Oct 12 22:01:56.905206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d941b289-f528-4ded-aa8a-03156bc906df tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:56.905323 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 370/672] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:01:56 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 2051 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:01:56.910528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6814823f-36fa-4604-bc5c-5ef693866028 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:56.911149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6814823f-36fa-4604-bc5c-5ef693866028 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:56.920953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6814823f-36fa-4604-bc5c-5ef693866028 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:56.921455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6814823f-36fa-4604-bc5c-5ef693866028 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:56.921891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6814823f-36fa-4604-bc5c-5ef693866028 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:56.922646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6814823f-36fa-4604-bc5c-5ef693866028 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:56.923166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6814823f-36fa-4604-bc5c-5ef693866028 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:56.923626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6814823f-36fa-4604-bc5c-5ef693866028 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:56.936771 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d941b289-f528-4ded-aa8a-03156bc906df tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 200 len: 1318 microversion: 2.1 time: 0.683858 Oct 12 22:01:56.938952 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 303/673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:56 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 1318 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:56.967066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-73435c31-240a-480e-9646-23f34facc524 req-804143ad-57ee-4a87-9406-b8b867d471df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d06c998-c0a6-4bb7-8538-9a7b0298b918", "tag": "6a950ceb-e8e8-414f-921b-8239a9d66a46"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:57.028640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-73435c31-240a-480e-9646-23f34facc524 req-804143ad-57ee-4a87-9406-b8b867d471df service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.029520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-73435c31-240a-480e-9646-23f34facc524 req-804143ad-57ee-4a87-9406-b8b867d471df service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.030177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-73435c31-240a-480e-9646-23f34facc524 req-804143ad-57ee-4a87-9406-b8b867d471df service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.049721 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-73435c31-240a-480e-9646-23f34facc524 req-804143ad-57ee-4a87-9406-b8b867d471df service nova] Creating event network-changed:6a950ceb-e8e8-414f-921b-8239a9d66a46 for instance 3d06c998-c0a6-4bb7-8538-9a7b0298b918 on n-h2-861111-1 Oct 12 22:01:57.059495 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-73435c31-240a-480e-9646-23f34facc524 req-804143ad-57ee-4a87-9406-b8b867d471df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118357 Oct 12 22:01:57.060222 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 304/674] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:57.068877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a3c104e8-a1fe-488a-8a9c-2473a809bfd9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:57.070448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a3c104e8-a1fe-488a-8a9c-2473a809bfd9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:57.082593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3c104e8-a1fe-488a-8a9c-2473a809bfd9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.083294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3c104e8-a1fe-488a-8a9c-2473a809bfd9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.085489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3c104e8-a1fe-488a-8a9c-2473a809bfd9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.086710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3c104e8-a1fe-488a-8a9c-2473a809bfd9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.087933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3c104e8-a1fe-488a-8a9c-2473a809bfd9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.088579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3c104e8-a1fe-488a-8a9c-2473a809bfd9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.196018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6814823f-36fa-4604-bc5c-5ef693866028 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:57.205387 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6814823f-36fa-4604-bc5c-5ef693866028 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1388 microversion: 2.1 time: 0.299736 Oct 12 22:01:57.206503 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 371/675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:56 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1388 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:57.213007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e3340162-6902-4d7d-80d5-9e9bd9a0cc46 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:57.213786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e3340162-6902-4d7d-80d5-9e9bd9a0cc46 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:57.220940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3340162-6902-4d7d-80d5-9e9bd9a0cc46 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.221757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3340162-6902-4d7d-80d5-9e9bd9a0cc46 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.222500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3340162-6902-4d7d-80d5-9e9bd9a0cc46 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.223618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3340162-6902-4d7d-80d5-9e9bd9a0cc46 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.224228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3340162-6902-4d7d-80d5-9e9bd9a0cc46 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.224809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3340162-6902-4d7d-80d5-9e9bd9a0cc46 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.458489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-e3340162-6902-4d7d-80d5-9e9bd9a0cc46 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'services' on Instance uuid 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:01:57.479031 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e3340162-6902-4d7d-80d5-9e9bd9a0cc46 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 2051 microversion: 2.25 time: 0.271302 Oct 12 22:01:57.491754 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 372/676] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:01:57 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 2051 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:01:57.502815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-7a564d19-fcae-4690-a06e-e3a75381f80b req-a9ab7cdd-e397-4fa7-8ecc-797cf1eef2dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b700e31-e4a4-48a5-b49c-2da9e7532344", "name": "network-vif-deleted", "tag": "89831056-14d5-4380-84ca-998b43360ac8"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:57.518291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7a564d19-fcae-4690-a06e-e3a75381f80b req-a9ab7cdd-e397-4fa7-8ecc-797cf1eef2dc service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.519307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7a564d19-fcae-4690-a06e-e3a75381f80b req-a9ab7cdd-e397-4fa7-8ecc-797cf1eef2dc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.519893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7a564d19-fcae-4690-a06e-e3a75381f80b req-a9ab7cdd-e397-4fa7-8ecc-797cf1eef2dc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.533842 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-7a564d19-fcae-4690-a06e-e3a75381f80b req-a9ab7cdd-e397-4fa7-8ecc-797cf1eef2dc service nova] Creating event network-vif-deleted:89831056-14d5-4380-84ca-998b43360ac8 for instance 1b700e31-e4a4-48a5-b49c-2da9e7532344 on n-h2-861111-1 Oct 12 22:01:57.540861 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-7a564d19-fcae-4690-a06e-e3a75381f80b req-a9ab7cdd-e397-4fa7-8ecc-797cf1eef2dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047466 Oct 12 22:01:57.542511 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 373/677] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:57.550821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-be89a9e1-8e3c-4acc-b6d1-dbded9786ba4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:57.551758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-be89a9e1-8e3c-4acc-b6d1-dbded9786ba4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:57.559523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be89a9e1-8e3c-4acc-b6d1-dbded9786ba4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.560320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be89a9e1-8e3c-4acc-b6d1-dbded9786ba4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.560915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be89a9e1-8e3c-4acc-b6d1-dbded9786ba4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.561803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be89a9e1-8e3c-4acc-b6d1-dbded9786ba4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.562411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be89a9e1-8e3c-4acc-b6d1-dbded9786ba4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.563093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be89a9e1-8e3c-4acc-b6d1-dbded9786ba4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.584017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a3c104e8-a1fe-488a-8a9c-2473a809bfd9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:57.596671 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a3c104e8-a1fe-488a-8a9c-2473a809bfd9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1359 microversion: 2.1 time: 0.534571 Oct 12 22:01:57.597219 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 305/678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:57 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1359 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:57.610725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9bd5e29b-e2d2-4b84-958b-27a8980ca569 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:57.612155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9bd5e29b-e2d2-4b84-958b-27a8980ca569 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:57.626703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bd5e29b-e2d2-4b84-958b-27a8980ca569 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.627195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bd5e29b-e2d2-4b84-958b-27a8980ca569 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.627654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bd5e29b-e2d2-4b84-958b-27a8980ca569 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.628355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bd5e29b-e2d2-4b84-958b-27a8980ca569 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.628804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bd5e29b-e2d2-4b84-958b-27a8980ca569 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.629284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bd5e29b-e2d2-4b84-958b-27a8980ca569 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.667552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-be89a9e1-8e3c-4acc-b6d1-dbded9786ba4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:57.682572 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-be89a9e1-8e3c-4acc-b6d1-dbded9786ba4 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 200 len: 1427 microversion: 2.1 time: 0.138544 Oct 12 22:01:57.683321 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 374/679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:57 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 1427 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:57.694634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e683540e-c057-423d-94ff-e8d9d38c7a57 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:57.698574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e683540e-c057-423d-94ff-e8d9d38c7a57 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:57.707283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e683540e-c057-423d-94ff-e8d9d38c7a57 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.707956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e683540e-c057-423d-94ff-e8d9d38c7a57 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.708949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e683540e-c057-423d-94ff-e8d9d38c7a57 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.709822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e683540e-c057-423d-94ff-e8d9d38c7a57 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.710465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e683540e-c057-423d-94ff-e8d9d38c7a57 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.711154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e683540e-c057-423d-94ff-e8d9d38c7a57 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.743042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:57.810887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e683540e-c057-423d-94ff-e8d9d38c7a57 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:57.820402 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e683540e-c057-423d-94ff-e8d9d38c7a57 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1270 microversion: 2.1 time: 0.135782 Oct 12 22:01:57.821207 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 375/680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:57 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1270 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:57.825886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aeaa7f09-b80a-409e-b0ba-1ca290d562fb tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:57.829930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aeaa7f09-b80a-409e-b0ba-1ca290d562fb tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.830575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aeaa7f09-b80a-409e-b0ba-1ca290d562fb tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.831180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aeaa7f09-b80a-409e-b0ba-1ca290d562fb tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.832113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aeaa7f09-b80a-409e-b0ba-1ca290d562fb tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.832735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aeaa7f09-b80a-409e-b0ba-1ca290d562fb tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.833318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aeaa7f09-b80a-409e-b0ba-1ca290d562fb tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.860305 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aeaa7f09-b80a-409e-b0ba-1ca290d562fb tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.037842 Oct 12 22:01:57.868175 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 376/681] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Oct 12 22:01:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:01:57.868175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-efd48549-743b-457d-883d-11af096cf90a req-2364559f-838e-4857-8cfa-5938690a61bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5574396-f705-4e92-9934-760a5ae961a8", "name": "network-vif-plugged", "status": "completed", "tag": "f0e5da0c-7fe4-49cd-b408-08f20ae11569"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:57.875686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-efd48549-743b-457d-883d-11af096cf90a req-2364559f-838e-4857-8cfa-5938690a61bc service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.876166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-efd48549-743b-457d-883d-11af096cf90a req-2364559f-838e-4857-8cfa-5938690a61bc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.876595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-efd48549-743b-457d-883d-11af096cf90a req-2364559f-838e-4857-8cfa-5938690a61bc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.888164 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-efd48549-743b-457d-883d-11af096cf90a req-2364559f-838e-4857-8cfa-5938690a61bc service nova] Creating event network-vif-plugged:f0e5da0c-7fe4-49cd-b408-08f20ae11569 for instance e5574396-f705-4e92-9934-760a5ae961a8 on n-h1-861111-1 Oct 12 22:01:57.893664 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-efd48549-743b-457d-883d-11af096cf90a req-2364559f-838e-4857-8cfa-5938690a61bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031312 Oct 12 22:01:57.895067 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 377/682] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:57.902075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48481167-b5e4-4f72-8c3e-cb5c4455a34f tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861111-1", "block_migration": "auto"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:01:57.923797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-48481167-b5e4-4f72-8c3e-cb5c4455a34f tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:57.928397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9bd5e29b-e2d2-4b84-958b-27a8980ca569 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:57.939191 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9bd5e29b-e2d2-4b84-958b-27a8980ca569 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 200 len: 1307 microversion: 2.1 time: 0.337543 Oct 12 22:01:57.939800 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 306/683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:57 2022] GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 1307 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:57.964671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-db9a69bc-5fd1-4576-8a38-02e764ad222b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:57.965280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-db9a69bc-5fd1-4576-8a38-02e764ad222b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:57.965980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48481167-b5e4-4f72-8c3e-cb5c4455a34f tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.967536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48481167-b5e4-4f72-8c3e-cb5c4455a34f tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.969469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48481167-b5e4-4f72-8c3e-cb5c4455a34f tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.970796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48481167-b5e4-4f72-8c3e-cb5c4455a34f tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.971574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db9a69bc-5fd1-4576-8a38-02e764ad222b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.971705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48481167-b5e4-4f72-8c3e-cb5c4455a34f tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.972128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48481167-b5e4-4f72-8c3e-cb5c4455a34f tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.972598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db9a69bc-5fd1-4576-8a38-02e764ad222b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.973376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db9a69bc-5fd1-4576-8a38-02e764ad222b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:57.974267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db9a69bc-5fd1-4576-8a38-02e764ad222b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:57.974976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db9a69bc-5fd1-4576-8a38-02e764ad222b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:57.975765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db9a69bc-5fd1-4576-8a38-02e764ad222b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:58.016870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-48481167-b5e4-4f72-8c3e-cb5c4455a34f tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'flavor' on Instance uuid 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:01:58.030055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-48481167-b5e4-4f72-8c3e-cb5c4455a34f tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Going to try to live migrate instance to n-h2-861111-1 {{(pid=120453) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:01:58.210343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-db9a69bc-5fd1-4576-8a38-02e764ad222b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:58.219694 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-db9a69bc-5fd1-4576-8a38-02e764ad222b tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 200 len: 1318 microversion: 2.1 time: 0.259168 Oct 12 22:01:58.221066 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 307/684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:57 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:58.238604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e53cf421-166d-4a75-a837-bc0017a853e4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:58.239322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e53cf421-166d-4a75-a837-bc0017a853e4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:58.246055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e53cf421-166d-4a75-a837-bc0017a853e4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:58.247057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e53cf421-166d-4a75-a837-bc0017a853e4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:58.248306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e53cf421-166d-4a75-a837-bc0017a853e4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:58.249194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e53cf421-166d-4a75-a837-bc0017a853e4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:58.249795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e53cf421-166d-4a75-a837-bc0017a853e4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:58.250380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e53cf421-166d-4a75-a837-bc0017a853e4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:58.463482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e53cf421-166d-4a75-a837-bc0017a853e4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:58.480795 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e53cf421-166d-4a75-a837-bc0017a853e4 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1586 microversion: 2.1 time: 0.249520 Oct 12 22:01:58.482300 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 308/685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:58 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1586 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:58.505100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-11b6bbdd-6752-48ca-813f-c752efbbd7d6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:58.505662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-11b6bbdd-6752-48ca-813f-c752efbbd7d6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:58.512537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11b6bbdd-6752-48ca-813f-c752efbbd7d6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:58.513206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11b6bbdd-6752-48ca-813f-c752efbbd7d6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:58.523041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11b6bbdd-6752-48ca-813f-c752efbbd7d6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:58.524275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11b6bbdd-6752-48ca-813f-c752efbbd7d6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:58.525486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11b6bbdd-6752-48ca-813f-c752efbbd7d6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:58.526297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11b6bbdd-6752-48ca-813f-c752efbbd7d6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:58.701322 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-11b6bbdd-6752-48ca-813f-c752efbbd7d6 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.201331 Oct 12 22:01:58.701921 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 309/686] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:01:58 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d/os-interface => generated 284 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:01:58.707208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-68efe287-7474-413f-9f70-d62c56159e7c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:58.707855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-68efe287-7474-413f-9f70-d62c56159e7c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:58.716727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68efe287-7474-413f-9f70-d62c56159e7c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:58.717486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68efe287-7474-413f-9f70-d62c56159e7c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:58.720237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68efe287-7474-413f-9f70-d62c56159e7c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:58.721211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68efe287-7474-413f-9f70-d62c56159e7c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:58.721875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68efe287-7474-413f-9f70-d62c56159e7c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:58.722503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68efe287-7474-413f-9f70-d62c56159e7c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:59.059199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-68efe287-7474-413f-9f70-d62c56159e7c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:59.067535 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-68efe287-7474-413f-9f70-d62c56159e7c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1359 microversion: 2.1 time: 0.364445 Oct 12 22:01:59.068536 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 310/687] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:58 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1359 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:59.075088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-913880f0-9695-47d7-945e-27364bc8fa0d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:59.076123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-913880f0-9695-47d7-945e-27364bc8fa0d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:59.083506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-913880f0-9695-47d7-945e-27364bc8fa0d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:59.084028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-913880f0-9695-47d7-945e-27364bc8fa0d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:59.084492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-913880f0-9695-47d7-945e-27364bc8fa0d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:59.085197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-913880f0-9695-47d7-945e-27364bc8fa0d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:59.086192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-913880f0-9695-47d7-945e-27364bc8fa0d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:59.086192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-913880f0-9695-47d7-945e-27364bc8fa0d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:59.233765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-913880f0-9695-47d7-945e-27364bc8fa0d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:59.245183 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-913880f0-9695-47d7-945e-27364bc8fa0d tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 200 len: 1298 microversion: 2.1 time: 0.175194 Oct 12 22:01:59.246093 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 311/688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:59 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 1298 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:59.251901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-94eaabb1-5304-49b2-ba95-9ea56facd50a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:59.253062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-94eaabb1-5304-49b2-ba95-9ea56facd50a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:59.256518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:01:59.261478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94eaabb1-5304-49b2-ba95-9ea56facd50a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:59.262238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94eaabb1-5304-49b2-ba95-9ea56facd50a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:59.263183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94eaabb1-5304-49b2-ba95-9ea56facd50a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:59.264283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94eaabb1-5304-49b2-ba95-9ea56facd50a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:59.265016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94eaabb1-5304-49b2-ba95-9ea56facd50a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:59.265785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94eaabb1-5304-49b2-ba95-9ea56facd50a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:59.406103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-94eaabb1-5304-49b2-ba95-9ea56facd50a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:01:59.415369 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-94eaabb1-5304-49b2-ba95-9ea56facd50a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1270 microversion: 2.1 time: 0.167973 Oct 12 22:01:59.420263 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 312/689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:59 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:01:59.446982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-21babeb3-abab-48d1-85fe-3ef6babc85ef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:01:59.449726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-21babeb3-abab-48d1-85fe-3ef6babc85ef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:01:59.470994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21babeb3-abab-48d1-85fe-3ef6babc85ef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:59.471649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21babeb3-abab-48d1-85fe-3ef6babc85ef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:59.472178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21babeb3-abab-48d1-85fe-3ef6babc85ef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:01:59.473048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21babeb3-abab-48d1-85fe-3ef6babc85ef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:01:59.473538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21babeb3-abab-48d1-85fe-3ef6babc85ef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:01:59.474068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21babeb3-abab-48d1-85fe-3ef6babc85ef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:00.084562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-21babeb3-abab-48d1-85fe-3ef6babc85ef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:00.099400 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-21babeb3-abab-48d1-85fe-3ef6babc85ef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 200 len: 1307 microversion: 2.1 time: 0.662241 Oct 12 22:02:00.100864 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 313/690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:01:59 2022] GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 1307 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:00.106932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-739c830e-1a44-45dc-af6d-d216d3b46fd5 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:00.107843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-739c830e-1a44-45dc-af6d-d216d3b46fd5 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:00.122158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-739c830e-1a44-45dc-af6d-d216d3b46fd5 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:00.122949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-739c830e-1a44-45dc-af6d-d216d3b46fd5 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:00.124064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-739c830e-1a44-45dc-af6d-d216d3b46fd5 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:00.126489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-739c830e-1a44-45dc-af6d-d216d3b46fd5 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:00.126957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-739c830e-1a44-45dc-af6d-d216d3b46fd5 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:00.127418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-739c830e-1a44-45dc-af6d-d216d3b46fd5 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:01.010850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-739c830e-1a44-45dc-af6d-d216d3b46fd5 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:01.032635 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-739c830e-1a44-45dc-af6d-d216d3b46fd5 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 200 len: 1467 microversion: 2.1 time: 0.928364 Oct 12 22:02:01.052000 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 314/691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:00 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 1467 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:01.058263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3fee5b53-2955-43a4-927d-5e1a563c30c9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:01.059480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3fee5b53-2955-43a4-927d-5e1a563c30c9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:01.065706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fee5b53-2955-43a4-927d-5e1a563c30c9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:01.066400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fee5b53-2955-43a4-927d-5e1a563c30c9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:01.066982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fee5b53-2955-43a4-927d-5e1a563c30c9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:01.067888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fee5b53-2955-43a4-927d-5e1a563c30c9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:01.068489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fee5b53-2955-43a4-927d-5e1a563c30c9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:01.069058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fee5b53-2955-43a4-927d-5e1a563c30c9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:01.085927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:01.654439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3fee5b53-2955-43a4-927d-5e1a563c30c9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:01.663522 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3fee5b53-2955-43a4-927d-5e1a563c30c9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1359 microversion: 2.1 time: 0.609160 Oct 12 22:02:01.664783 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 315/692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:01 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1359 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:01.669548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e7980b32-d553-4ec7-b1f6-deb00420f21c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:01.670441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e7980b32-d553-4ec7-b1f6-deb00420f21c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: 1b700e31-e4a4-48a5-b49c-2da9e7532344] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:01.678209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7980b32-d553-4ec7-b1f6-deb00420f21c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:01.678962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7980b32-d553-4ec7-b1f6-deb00420f21c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:01.679646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7980b32-d553-4ec7-b1f6-deb00420f21c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:01.680617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7980b32-d553-4ec7-b1f6-deb00420f21c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:01.681272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7980b32-d553-4ec7-b1f6-deb00420f21c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:01.681930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7980b32-d553-4ec7-b1f6-deb00420f21c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:01.698628 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-e7980b32-d553-4ec7-b1f6-deb00420f21c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] HTTP exception thrown: Instance 1b700e31-e4a4-48a5-b49c-2da9e7532344 could not be found. Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e7980b32-d553-4ec7-b1f6-deb00420f21c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Request method failure captured: Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 HTTP/1.1 Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzkdUuIyiXSjY8a_-NF0l7zyfySZLoB_q8G9pdeX9s73-eDsZKJoUmcHrBjG372RfrhnLZ3J9hktbrnsAVa2Q9Myf0EE--FYwIWGmWIAzNRGynzF66tCXj7Dzg-f3pV51nzAtYqwi6aioPrgzvaXf62QLDm1jCihFC6oAMPKEGwGomw Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 4981423dcc384a8598796d56100551c4 Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1330228189 Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:02:01.700649 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:02:01.701889 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4981423dcc384a8598796d56100551c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4981423dcc384a8598796d56100551c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4981423dcc384a8598796d56100551c4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4981423dcc384a8598796d56100551c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:02:01.701889 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1330228189 Oct 12 22:02:01.701889 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 4981423dcc384a8598796d56100551c4 Oct 12 22:02:01.701889 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1330228189 Oct 12 22:02:01.701889 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersAdminNegativeTestJSON-1330228189-project Oct 12 22:02:01.701889 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:02:01.701889 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:02:01.701889 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 1a512ddf866d4d36a686ecf9b67a58e9 Oct 12 22:02:01.701889 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1330228189-project Oct 12 22:02:01.701889 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:02:01.701889 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 1b700e31-e4a4-48a5-b49c-2da9e7532344 could not be found. Oct 12 22:02:01.701889 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '1b700e31-e4a4-48a5-b49c-2da9e7532344'} Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b700e31-e4a4-48a5-b49c-2da9e7532344 could not be found. Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:02:01.702631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b700e31-e4a4-48a5-b49c-2da9e7532344 could not be found. Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b700e31-e4a4-48a5-b49c-2da9e7532344 could not be found. Oct 12 22:02:01.703922 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:01.706399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e7980b32-d553-4ec7-b1f6-deb00420f21c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Returning 404 to user: Instance 1b700e31-e4a4-48a5-b49c-2da9e7532344 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:02:01.707683 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e7980b32-d553-4ec7-b1f6-deb00420f21c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344" status: 404 len: 111 microversion: 2.1 time: 0.041712 Oct 12 22:02:01.708451 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 316/693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:01 2022] GET /compute/v2.1/servers/1b700e31-e4a4-48a5-b49c-2da9e7532344 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:02:01.713926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c7b0229b-4946-4fa6-89b8-a78ec2fe1c8a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:01.714841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c7b0229b-4946-4fa6-89b8-a78ec2fe1c8a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:01.721977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7b0229b-4946-4fa6-89b8-a78ec2fe1c8a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:01.722771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7b0229b-4946-4fa6-89b8-a78ec2fe1c8a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:01.723491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7b0229b-4946-4fa6-89b8-a78ec2fe1c8a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:01.724535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7b0229b-4946-4fa6-89b8-a78ec2fe1c8a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:01.725272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7b0229b-4946-4fa6-89b8-a78ec2fe1c8a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:01.725897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7b0229b-4946-4fa6-89b8-a78ec2fe1c8a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:01.855399 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-48481167-b5e4-4f72-8c3e-cb5c4455a34f tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e/action" status: 202 len: 0 microversion: 2.25 time: 3.957900 Oct 12 22:02:01.858789 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 378/694] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 12 22:01:57 2022] POST /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e/action => generated 0 bytes in 3963 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:02:01.872632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-27ba6eaf-78ac-45b7-9ea7-3d146c2bf79e req-b47db4cd-22b9-4cca-940f-79dfffa126c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad668734-0c34-4d75-b667-0f69f3515d84", "name": "network-vif-plugged", "status": "completed", "tag": "38c74c93-daa8-4431-99a7-a03e4c6e546f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:01.898596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:01.907888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-27ba6eaf-78ac-45b7-9ea7-3d146c2bf79e req-b47db4cd-22b9-4cca-940f-79dfffa126c8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:01.908363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-27ba6eaf-78ac-45b7-9ea7-3d146c2bf79e req-b47db4cd-22b9-4cca-940f-79dfffa126c8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:01.908763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-27ba6eaf-78ac-45b7-9ea7-3d146c2bf79e req-b47db4cd-22b9-4cca-940f-79dfffa126c8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:01.934323 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-27ba6eaf-78ac-45b7-9ea7-3d146c2bf79e req-b47db4cd-22b9-4cca-940f-79dfffa126c8 service nova] Creating event network-vif-plugged:38c74c93-daa8-4431-99a7-a03e4c6e546f for instance ad668734-0c34-4d75-b667-0f69f3515d84 on n-h1-861111-1 Oct 12 22:02:01.939940 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-27ba6eaf-78ac-45b7-9ea7-3d146c2bf79e req-b47db4cd-22b9-4cca-940f-79dfffa126c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078539 Oct 12 22:02:01.941079 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 379/695] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:01.947893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c8547f8d-909d-49fe-a6e1-415c4592d537 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:01.948702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c8547f8d-909d-49fe-a6e1-415c4592d537 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:01.966783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8547f8d-909d-49fe-a6e1-415c4592d537 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:01.967573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8547f8d-909d-49fe-a6e1-415c4592d537 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:01.968162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8547f8d-909d-49fe-a6e1-415c4592d537 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:01.969009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8547f8d-909d-49fe-a6e1-415c4592d537 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:01.970731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8547f8d-909d-49fe-a6e1-415c4592d537 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:01.971354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8547f8d-909d-49fe-a6e1-415c4592d537 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:02.037772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-c8547f8d-909d-49fe-a6e1-415c4592d537 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lazy-loading 'flavor' on Instance uuid e5574396-f705-4e92-9934-760a5ae961a8 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:02:02.126367 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c8547f8d-909d-49fe-a6e1-415c4592d537 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8/action" status: 202 len: 0 microversion: 2.1 time: 0.182886 Oct 12 22:02:02.128104 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 380/696] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:02:01 2022] POST /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:02:02.149417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-43b00310-38e0-43d7-8092-61ead8152948 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:02.150601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-43b00310-38e0-43d7-8092-61ead8152948 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:02.163726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43b00310-38e0-43d7-8092-61ead8152948 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:02.164495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43b00310-38e0-43d7-8092-61ead8152948 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:02.165294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43b00310-38e0-43d7-8092-61ead8152948 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:02.166490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43b00310-38e0-43d7-8092-61ead8152948 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:02.167196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43b00310-38e0-43d7-8092-61ead8152948 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:02.167926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43b00310-38e0-43d7-8092-61ead8152948 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:02.512013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c7b0229b-4946-4fa6-89b8-a78ec2fe1c8a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:02.527965 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c7b0229b-4946-4fa6-89b8-a78ec2fe1c8a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1318 microversion: 2.1 time: 0.818183 Oct 12 22:02:02.528491 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 317/697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:01 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1318 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:02.533918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-56de9a38-746c-4301-beca-75fe45cfa4a3 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:02.534473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-56de9a38-746c-4301-beca-75fe45cfa4a3 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: c6149ecf-bb8a-4f49-b8e8-6c71b862ff02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:02.549891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56de9a38-746c-4301-beca-75fe45cfa4a3 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:02.550463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56de9a38-746c-4301-beca-75fe45cfa4a3 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:02.550972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56de9a38-746c-4301-beca-75fe45cfa4a3 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:02.551810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56de9a38-746c-4301-beca-75fe45cfa4a3 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:02.552336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56de9a38-746c-4301-beca-75fe45cfa4a3 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:02.552832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56de9a38-746c-4301-beca-75fe45cfa4a3 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:02.599022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-43b00310-38e0-43d7-8092-61ead8152948 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:02.608400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-56de9a38-746c-4301-beca-75fe45cfa4a3 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: c6149ecf-bb8a-4f49-b8e8-6c71b862ff02] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:02:02.615844 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-43b00310-38e0-43d7-8092-61ead8152948 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 200 len: 1307 microversion: 2.1 time: 0.485674 Oct 12 22:02:02.617101 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 381/698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:02 2022] GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 1307 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:02.643400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-79b7d9aa-26c9-4aed-9230-763d1ae387c2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:02.644186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-79b7d9aa-26c9-4aed-9230-763d1ae387c2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:02.668892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b7d9aa-26c9-4aed-9230-763d1ae387c2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:02.671832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b7d9aa-26c9-4aed-9230-763d1ae387c2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:02.675871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b7d9aa-26c9-4aed-9230-763d1ae387c2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:02.677851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b7d9aa-26c9-4aed-9230-763d1ae387c2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:02.679855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b7d9aa-26c9-4aed-9230-763d1ae387c2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:02.680519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b7d9aa-26c9-4aed-9230-763d1ae387c2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:02.859146 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-56de9a38-746c-4301-beca-75fe45cfa4a3 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02" status: 204 len: 0 microversion: 2.1 time: 0.329374 Oct 12 22:02:02.864957 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 318/699] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:02:02 2022] DELETE /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:02:02.870930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d449a13-43a3-4987-bb6c-c0b578cca833 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:02.871976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9d449a13-43a3-4987-bb6c-c0b578cca833 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:02.884373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d449a13-43a3-4987-bb6c-c0b578cca833 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:02.885148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d449a13-43a3-4987-bb6c-c0b578cca833 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:02.885761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d449a13-43a3-4987-bb6c-c0b578cca833 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:02.886795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d449a13-43a3-4987-bb6c-c0b578cca833 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:02.887809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d449a13-43a3-4987-bb6c-c0b578cca833 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:02.888429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d449a13-43a3-4987-bb6c-c0b578cca833 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:03.127890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-79b7d9aa-26c9-4aed-9230-763d1ae387c2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:03.140567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-79b7d9aa-26c9-4aed-9230-763d1ae387c2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:03.142835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-79b7d9aa-26c9-4aed-9230-763d1ae387c2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:03.150335 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-79b7d9aa-26c9-4aed-9230-763d1ae387c2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1568 microversion: 2.25 time: 0.531903 Oct 12 22:02:03.151123 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 382/700] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:02 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1568 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:03.166095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-98468ea6-71ca-4662-ab13-9d8539597b4c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:03.167132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-98468ea6-71ca-4662-ab13-9d8539597b4c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:03.188972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98468ea6-71ca-4662-ab13-9d8539597b4c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:03.189614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98468ea6-71ca-4662-ab13-9d8539597b4c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:03.192154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98468ea6-71ca-4662-ab13-9d8539597b4c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:03.192997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98468ea6-71ca-4662-ab13-9d8539597b4c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:03.193561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98468ea6-71ca-4662-ab13-9d8539597b4c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:03.194091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98468ea6-71ca-4662-ab13-9d8539597b4c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:03.446642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9d449a13-43a3-4987-bb6c-c0b578cca833 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:03.457749 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9d449a13-43a3-4987-bb6c-c0b578cca833 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 200 len: 1458 microversion: 2.1 time: 0.589803 Oct 12 22:02:03.460756 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 319/701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:02 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 1458 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:03.471036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-f407beea-c8a3-4fd1-ac36-82ee61728a50 req-11497555-b31b-455e-aba6-436fdcc4e19d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a164670-124d-407d-a4d1-940846b45e2d", "tag": "78bf0b61-fcf3-4082-9079-b4ba87319616"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:03.489874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f407beea-c8a3-4fd1-ac36-82ee61728a50 req-11497555-b31b-455e-aba6-436fdcc4e19d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:03.490354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f407beea-c8a3-4fd1-ac36-82ee61728a50 req-11497555-b31b-455e-aba6-436fdcc4e19d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:03.490784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f407beea-c8a3-4fd1-ac36-82ee61728a50 req-11497555-b31b-455e-aba6-436fdcc4e19d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:03.514239 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-f407beea-c8a3-4fd1-ac36-82ee61728a50 req-11497555-b31b-455e-aba6-436fdcc4e19d service nova] Creating event network-changed:78bf0b61-fcf3-4082-9079-b4ba87319616 for instance 1a164670-124d-407d-a4d1-940846b45e2d on n-h1-861111-1 Oct 12 22:02:03.533223 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-f407beea-c8a3-4fd1-ac36-82ee61728a50 req-11497555-b31b-455e-aba6-436fdcc4e19d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070849 Oct 12 22:02:03.534009 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 320/702] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:03.538942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a71b0ed3-370e-4cde-8db8-4b59e9755092 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:03.539673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a71b0ed3-370e-4cde-8db8-4b59e9755092 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:03.552755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a71b0ed3-370e-4cde-8db8-4b59e9755092 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:03.553257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a71b0ed3-370e-4cde-8db8-4b59e9755092 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:03.554025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a71b0ed3-370e-4cde-8db8-4b59e9755092 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:03.554403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a71b0ed3-370e-4cde-8db8-4b59e9755092 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:03.554856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a71b0ed3-370e-4cde-8db8-4b59e9755092 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:03.555328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a71b0ed3-370e-4cde-8db8-4b59e9755092 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:03.752433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-98468ea6-71ca-4662-ab13-9d8539597b4c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:03.766425 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-98468ea6-71ca-4662-ab13-9d8539597b4c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1586 microversion: 2.1 time: 0.610088 Oct 12 22:02:03.769190 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 383/703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:03 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1586 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:03.777973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6b958378-d776-47b1-9f32-dcbfdbbfcc3c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:03.778589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6b958378-d776-47b1-9f32-dcbfdbbfcc3c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: c6149ecf-bb8a-4f49-b8e8-6c71b862ff02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:03.793560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b958378-d776-47b1-9f32-dcbfdbbfcc3c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:03.794056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b958378-d776-47b1-9f32-dcbfdbbfcc3c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:03.794488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b958378-d776-47b1-9f32-dcbfdbbfcc3c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:03.798987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b958378-d776-47b1-9f32-dcbfdbbfcc3c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:03.799938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b958378-d776-47b1-9f32-dcbfdbbfcc3c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:03.800442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b958378-d776-47b1-9f32-dcbfdbbfcc3c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:03.905311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a71b0ed3-370e-4cde-8db8-4b59e9755092 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:03.917460 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a71b0ed3-370e-4cde-8db8-4b59e9755092 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1359 microversion: 2.1 time: 0.382330 Oct 12 22:02:03.921305 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 321/704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:03 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1359 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:03.932131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5bac844e-7fae-4648-bfb2-0058c440f10b tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:03.933166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5bac844e-7fae-4648-bfb2-0058c440f10b tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:03.954596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5bac844e-7fae-4648-bfb2-0058c440f10b tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:03.955672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5bac844e-7fae-4648-bfb2-0058c440f10b tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:03.956537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5bac844e-7fae-4648-bfb2-0058c440f10b tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:03.957490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5bac844e-7fae-4648-bfb2-0058c440f10b tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:03.958112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5bac844e-7fae-4648-bfb2-0058c440f10b tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:03.959224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5bac844e-7fae-4648-bfb2-0058c440f10b tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:04.423664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6b958378-d776-47b1-9f32-dcbfdbbfcc3c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:04.439901 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6b958378-d776-47b1-9f32-dcbfdbbfcc3c tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02" status: 200 len: 1478 microversion: 2.1 time: 0.663095 Oct 12 22:02:04.440963 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 384/705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:03 2022] GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 => generated 1478 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:04.452405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-da6e82d5-56ca-4f8e-ae3d-0518cb8a2e91 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:04.452405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-da6e82d5-56ca-4f8e-ae3d-0518cb8a2e91 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:04.465865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da6e82d5-56ca-4f8e-ae3d-0518cb8a2e91 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:04.466608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da6e82d5-56ca-4f8e-ae3d-0518cb8a2e91 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:04.467202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da6e82d5-56ca-4f8e-ae3d-0518cb8a2e91 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:04.468095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da6e82d5-56ca-4f8e-ae3d-0518cb8a2e91 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:04.468749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da6e82d5-56ca-4f8e-ae3d-0518cb8a2e91 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:04.469711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da6e82d5-56ca-4f8e-ae3d-0518cb8a2e91 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:04.512727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:04.567825 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5bac844e-7fae-4648-bfb2-0058c440f10b tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 200 len: 1609 microversion: 2.1 time: 0.643409 Oct 12 22:02:04.568385 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 322/706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:03 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 1609 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:04.575290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9fed28c2-4a42-4235-989d-ff94d0105ecc tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:04.575907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9fed28c2-4a42-4235-989d-ff94d0105ecc tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:04.593379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fed28c2-4a42-4235-989d-ff94d0105ecc tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:04.607669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fed28c2-4a42-4235-989d-ff94d0105ecc tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:04.608750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fed28c2-4a42-4235-989d-ff94d0105ecc tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:04.609727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fed28c2-4a42-4235-989d-ff94d0105ecc tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:04.611724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fed28c2-4a42-4235-989d-ff94d0105ecc tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:04.612346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fed28c2-4a42-4235-989d-ff94d0105ecc tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:04.882956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-da6e82d5-56ca-4f8e-ae3d-0518cb8a2e91 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:04.893509 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-da6e82d5-56ca-4f8e-ae3d-0518cb8a2e91 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1318 microversion: 2.1 time: 0.448933 Oct 12 22:02:04.898209 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 385/707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:04 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:04.911709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-b19af47b-53a6-4e85-8a6f-a5e412e45a9b req-9116bd7d-f9a6-4a64-9d01-2ef1d61646ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d06c998-c0a6-4bb7-8538-9a7b0298b918", "name": "network-vif-plugged", "status": "completed", "tag": "6a950ceb-e8e8-414f-921b-8239a9d66a46"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:04.927490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b19af47b-53a6-4e85-8a6f-a5e412e45a9b req-9116bd7d-f9a6-4a64-9d01-2ef1d61646ed service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:04.928005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b19af47b-53a6-4e85-8a6f-a5e412e45a9b req-9116bd7d-f9a6-4a64-9d01-2ef1d61646ed service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:04.928401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b19af47b-53a6-4e85-8a6f-a5e412e45a9b req-9116bd7d-f9a6-4a64-9d01-2ef1d61646ed service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:04.954632 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-b19af47b-53a6-4e85-8a6f-a5e412e45a9b req-9116bd7d-f9a6-4a64-9d01-2ef1d61646ed service nova] Creating event network-vif-plugged:6a950ceb-e8e8-414f-921b-8239a9d66a46 for instance 3d06c998-c0a6-4bb7-8538-9a7b0298b918 on n-h2-861111-1 Oct 12 22:02:04.961214 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-b19af47b-53a6-4e85-8a6f-a5e412e45a9b req-9116bd7d-f9a6-4a64-9d01-2ef1d61646ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062284 Oct 12 22:02:04.962934 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 386/708] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:04.971897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-65656b74-5cdb-4efa-b979-791f2c542726 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:04.973967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-65656b74-5cdb-4efa-b979-791f2c542726 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:04.985842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65656b74-5cdb-4efa-b979-791f2c542726 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:04.986586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65656b74-5cdb-4efa-b979-791f2c542726 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:04.988527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65656b74-5cdb-4efa-b979-791f2c542726 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:04.989538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65656b74-5cdb-4efa-b979-791f2c542726 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:04.991322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65656b74-5cdb-4efa-b979-791f2c542726 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:04.992522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65656b74-5cdb-4efa-b979-791f2c542726 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:05.200701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9fed28c2-4a42-4235-989d-ff94d0105ecc tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:05.209522 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9fed28c2-4a42-4235-989d-ff94d0105ecc tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 200 len: 1307 microversion: 2.1 time: 0.640099 Oct 12 22:02:05.210106 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 323/709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:04 2022] GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 1307 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:05.232110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d4fd0b05-4d52-434e-894f-a937833bc90e req-dd24087c-9644-45b1-ad2e-8b18019977fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18e1ad2a-6b26-4501-af12-49ad23802b5f", "tag": "e6ed5eb0-d436-4efd-8560-3606d22e1b6e"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:05.242472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d4fd0b05-4d52-434e-894f-a937833bc90e req-dd24087c-9644-45b1-ad2e-8b18019977fa service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:05.242953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d4fd0b05-4d52-434e-894f-a937833bc90e req-dd24087c-9644-45b1-ad2e-8b18019977fa service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:05.243426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d4fd0b05-4d52-434e-894f-a937833bc90e req-dd24087c-9644-45b1-ad2e-8b18019977fa service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:05.258033 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d4fd0b05-4d52-434e-894f-a937833bc90e req-dd24087c-9644-45b1-ad2e-8b18019977fa service nova] Creating event network-changed:e6ed5eb0-d436-4efd-8560-3606d22e1b6e for instance 18e1ad2a-6b26-4501-af12-49ad23802b5f on n-h2-861111-1 Oct 12 22:02:05.263183 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d4fd0b05-4d52-434e-894f-a937833bc90e req-dd24087c-9644-45b1-ad2e-8b18019977fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035896 Oct 12 22:02:05.264042 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 324/710] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:05.359475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-347408185", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:05.387318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:05.415111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-65656b74-5cdb-4efa-b979-791f2c542726 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:05.436798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] validate_networks() for [('9dba552c-f785-4d29-b718-62482e880d74', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:02:05.439377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-65656b74-5cdb-4efa-b979-791f2c542726 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:05.441135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-65656b74-5cdb-4efa-b979-791f2c542726 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:05.442351 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-65656b74-5cdb-4efa-b979-791f2c542726 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1568 microversion: 2.25 time: 0.477834 Oct 12 22:02:05.442913 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 387/711] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:04 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1568 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:05.460162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3bb54d47-1693-4ad0-aab0-52b7f970b494 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:05.466183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bb54d47-1693-4ad0-aab0-52b7f970b494 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:05.466944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bb54d47-1693-4ad0-aab0-52b7f970b494 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:05.467722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bb54d47-1693-4ad0-aab0-52b7f970b494 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:05.468587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bb54d47-1693-4ad0-aab0-52b7f970b494 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:05.470335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bb54d47-1693-4ad0-aab0-52b7f970b494 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:05.471477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bb54d47-1693-4ad0-aab0-52b7f970b494 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:05.516025 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3bb54d47-1693-4ad0-aab0-52b7f970b494 tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.067394 Oct 12 22:02:05.517620 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 388/712] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 12 22:02:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:05.529072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ed8b4386-e966-4eeb-b9bb-227de2f706d9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:05.530064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ed8b4386-e966-4eeb-b9bb-227de2f706d9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:05.544479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed8b4386-e966-4eeb-b9bb-227de2f706d9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:05.544982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed8b4386-e966-4eeb-b9bb-227de2f706d9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:05.545427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed8b4386-e966-4eeb-b9bb-227de2f706d9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:05.548621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed8b4386-e966-4eeb-b9bb-227de2f706d9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:05.549123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed8b4386-e966-4eeb-b9bb-227de2f706d9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:05.549574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed8b4386-e966-4eeb-b9bb-227de2f706d9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:05.934454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ed8b4386-e966-4eeb-b9bb-227de2f706d9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:05.945214 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ed8b4386-e966-4eeb-b9bb-227de2f706d9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1359 microversion: 2.1 time: 0.425772 Oct 12 22:02:05.961433 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 389/713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:05 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1359 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:05.970286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b23ed8d9-5338-43b8-b81b-5fb37500a58f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:05.972796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b23ed8d9-5338-43b8-b81b-5fb37500a58f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: c6149ecf-bb8a-4f49-b8e8-6c71b862ff02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:05.979436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b23ed8d9-5338-43b8-b81b-5fb37500a58f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:05.980476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b23ed8d9-5338-43b8-b81b-5fb37500a58f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:05.981292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b23ed8d9-5338-43b8-b81b-5fb37500a58f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:05.982280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b23ed8d9-5338-43b8-b81b-5fb37500a58f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:05.982952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b23ed8d9-5338-43b8-b81b-5fb37500a58f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:05.983647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b23ed8d9-5338-43b8-b81b-5fb37500a58f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:06.078291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b23ed8d9-5338-43b8-b81b-5fb37500a58f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:06.086310 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b23ed8d9-5338-43b8-b81b-5fb37500a58f tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02" status: 200 len: 1307 microversion: 2.1 time: 0.119809 Oct 12 22:02:06.086894 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 390/714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:05 2022] GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 => generated 1307 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:06.104061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-06a4f026-ca8d-4129-a023-65723ed6010f tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861111-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:06.108692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-06a4f026-ca8d-4129-a023-65723ed6010f tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:06.122784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:02:06.123376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:02:06.123941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:02:06.124460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:02:06.125055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:02:06.128788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06a4f026-ca8d-4129-a023-65723ed6010f tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:06.129285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06a4f026-ca8d-4129-a023-65723ed6010f tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:06.130011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06a4f026-ca8d-4129-a023-65723ed6010f tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:06.130420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06a4f026-ca8d-4129-a023-65723ed6010f tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:06.130876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06a4f026-ca8d-4129-a023-65723ed6010f tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:06.131350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06a4f026-ca8d-4129-a023-65723ed6010f tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:06.137099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=29 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:06.140354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:06.141117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:06.142809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:06.144553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:06.148153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:06.148847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:06.198048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:06.202865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Getting quotas for project b06c433b364c4a3093c13202b785bc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:02:06.210121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Getting quotas for user ad5b2d0e307f4b008479ff4927b77cb2 and project b06c433b364c4a3093c13202b785bc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:02:06.230998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-06a4f026-ca8d-4129-a023-65723ed6010f tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Lazy-loading 'flavor' on Instance uuid e5574396-f705-4e92-9934-760a5ae961a8 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:02:06.232326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:02:06.236335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:02:06.283464 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-06a4f026-ca8d-4129-a023-65723ed6010f tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance e5574396-f705-4e92-9934-760a5ae961a8 while it is in vm_state suspended Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-06a4f026-ca8d-4129-a023-65723ed6010f tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Request method failure captured: Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8/action HTTP/1.1 Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 97 Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzkpu_xmRghD4J3kpLrXRgtvnnUf6Ko-T9MHKx9iL7CiLKfT6rpfjJ6XTTm9qJB3H3GI5q6eGvZG2ZwuTzAFQkEwDku_GsVxXWslK05NojESWdcA4cr1DFNYlaE7FXBkJaD4p_kMi5FFkWaSw4pHydeoOsFGW1h6xTv0drx8EW_hOdw Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: b9f8f90dc72b42a3b8ffb428d4b7c3e9 Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-LiveMigrationNegativeTest-1311132218 Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:02:06.291192 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:02:06.292923 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9f8f90dc72b42a3b8ffb428d4b7c3e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9f8f90dc72b42a3b8ffb428d4b7c3e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9f8f90dc72b42a3b8ffb428d4b7c3e9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9f8f90dc72b42a3b8ffb428d4b7c3e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:02:06.292923 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-LiveMigrationNegativeTest-1311132218 Oct 12 22:02:06.292923 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: b9f8f90dc72b42a3b8ffb428d4b7c3e9 Oct 12 22:02:06.292923 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1311132218 Oct 12 22:02:06.292923 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-LiveMigrationNegativeTest-1311132218-project-admin Oct 12 22:02:06.292923 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:02:06.292923 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:02:06.292923 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6e3924d4088d4714bda424e5524e564a Oct 12 22:02:06.292923 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-LiveMigrationNegativeTest-1311132218-project-admin Oct 12 22:02:06.292923 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:02:06.292923 n-d-861111-1 devstack@n-api.service[120453]: {"os-migrateLive": {"host": "n-h2-861111-1", "block_migration": true, "disk_over_commit": false}} Oct 12 22:02:06.292923 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: exception: Cannot 'os-migrateLive' instance e5574396-f705-4e92-9934-760a5ae961a8 while it is in vm_state suspended Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'e5574396-f705-4e92-9934-760a5ae961a8', 'body': {'os-migrateLive': {'host': 'n-h2-861111-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 12 22:02:06.293840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e5574396-f705-4e92-9934-760a5ae961a8 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:02:06.295075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:02:06.296591 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:02:06.296591 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 22:02:06.296591 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 12 22:02:06.296591 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 22:02:06.296591 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:02:06.296591 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:02:06.296591 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance e5574396-f705-4e92-9934-760a5ae961a8 while it is in vm_state suspended Oct 12 22:02:06.296591 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:06.296591 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:06.296591 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:06.296591 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:06.296591 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:06.296591 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:06.296591 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:02:06.296591 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:02:06.296591 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance e5574396-f705-4e92-9934-760a5ae961a8 while it is in vm_state suspended Oct 12 22:02:06.296591 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:06.300735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-06a4f026-ca8d-4129-a023-65723ed6010f tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance e5574396-f705-4e92-9934-760a5ae961a8 while it is in vm_state suspended {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:02:06.302951 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-06a4f026-ca8d-4129-a023-65723ed6010f tempest-LiveMigrationNegativeTest-1311132218 tempest-LiveMigrationNegativeTest-1311132218-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8/action" status: 409 len: 155 microversion: 2.1 time: 0.214620 Oct 12 22:02:06.305698 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 391/715] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:02:06 2022] POST /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8/action => generated 155 bytes in 218 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:02:06.320613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-e359da05-4a0f-4601-9ff1-0981e2aceea4 req-f21b2601-bea2-4211-91fb-ff0a764a4a50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf71b2a6-484b-4e05-80fb-89be6b98546a", "tag": "e7a4b681-6708-4e63-905c-13cb884689e3"}, {"server_uuid": "6f266cf9-d4aa-4392-ab6c-722b3ef3d26e", "name": "network-vif-unplugged", "status": "completed", "tag": "43b4aff9-14b1-41df-8485-e703d7cb7bea"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:06.336465 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2c6f135a-1da4-4ebf-ab5d-de0f8ca15cd4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.068833 Oct 12 22:02:06.338725 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 325/716] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:02:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:02:06.352831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e359da05-4a0f-4601-9ff1-0981e2aceea4 req-f21b2601-bea2-4211-91fb-ff0a764a4a50 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:06.353484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e359da05-4a0f-4601-9ff1-0981e2aceea4 req-f21b2601-bea2-4211-91fb-ff0a764a4a50 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:06.354173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e359da05-4a0f-4601-9ff1-0981e2aceea4 req-f21b2601-bea2-4211-91fb-ff0a764a4a50 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:06.369970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4ef2327d-6f09-4da4-bf12-6cf98fe69941 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:06.370788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4ef2327d-6f09-4da4-bf12-6cf98fe69941 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:06.384124 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-e359da05-4a0f-4601-9ff1-0981e2aceea4 req-f21b2601-bea2-4211-91fb-ff0a764a4a50 service nova] Creating event network-changed:e7a4b681-6708-4e63-905c-13cb884689e3 for instance cf71b2a6-484b-4e05-80fb-89be6b98546a on n-h2-861111-1 Oct 12 22:02:06.384989 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-e359da05-4a0f-4601-9ff1-0981e2aceea4 req-f21b2601-bea2-4211-91fb-ff0a764a4a50 service nova] Creating event network-vif-unplugged:43b4aff9-14b1-41df-8485-e703d7cb7bea for instance 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e on n-h1-861111-1 Oct 12 22:02:06.397176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ef2327d-6f09-4da4-bf12-6cf98fe69941 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:06.397736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ef2327d-6f09-4da4-bf12-6cf98fe69941 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:06.398188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ef2327d-6f09-4da4-bf12-6cf98fe69941 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:06.402716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ef2327d-6f09-4da4-bf12-6cf98fe69941 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:06.403231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ef2327d-6f09-4da4-bf12-6cf98fe69941 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:06.403674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ef2327d-6f09-4da4-bf12-6cf98fe69941 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:06.408861 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-e359da05-4a0f-4601-9ff1-0981e2aceea4 req-f21b2601-bea2-4211-91fb-ff0a764a4a50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.101326 Oct 12 22:02:06.409856 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 392/717] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:06.419740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c9ea0e82-859c-4fc5-af6c-9aad58a3000f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:06.420454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c9ea0e82-859c-4fc5-af6c-9aad58a3000f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:06.438006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9ea0e82-859c-4fc5-af6c-9aad58a3000f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:06.438524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9ea0e82-859c-4fc5-af6c-9aad58a3000f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:06.441802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9ea0e82-859c-4fc5-af6c-9aad58a3000f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:06.443227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9ea0e82-859c-4fc5-af6c-9aad58a3000f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:06.443884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9ea0e82-859c-4fc5-af6c-9aad58a3000f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:06.444474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9ea0e82-859c-4fc5-af6c-9aad58a3000f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:06.872326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c9ea0e82-859c-4fc5-af6c-9aad58a3000f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:06.885269 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c9ea0e82-859c-4fc5-af6c-9aad58a3000f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 200 len: 1486 microversion: 2.1 time: 0.474176 Oct 12 22:02:06.886785 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 393/718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:06 2022] GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 1486 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:06.896986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e41638b7-f194-4e08-988d-33cd4e148225 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:06.899728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e41638b7-f194-4e08-988d-33cd4e148225 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:06.910384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e41638b7-f194-4e08-988d-33cd4e148225 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:06.915674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e41638b7-f194-4e08-988d-33cd4e148225 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:06.916396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e41638b7-f194-4e08-988d-33cd4e148225 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:06.918075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e41638b7-f194-4e08-988d-33cd4e148225 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:06.927979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e41638b7-f194-4e08-988d-33cd4e148225 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:06.928432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e41638b7-f194-4e08-988d-33cd4e148225 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:07.024541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e41638b7-f194-4e08-988d-33cd4e148225 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:02:07.133159 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e41638b7-f194-4e08-988d-33cd4e148225 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 204 len: 0 microversion: 2.1 time: 0.244719 Oct 12 22:02:07.134593 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 394/719] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:02:06 2022] DELETE /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:02:07.142777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0c6d4f74-edef-4bec-95fd-86c4982e97b2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:07.144979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0c6d4f74-edef-4bec-95fd-86c4982e97b2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:07.154151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c6d4f74-edef-4bec-95fd-86c4982e97b2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:07.155760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c6d4f74-edef-4bec-95fd-86c4982e97b2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:07.157200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c6d4f74-edef-4bec-95fd-86c4982e97b2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:07.158094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c6d4f74-edef-4bec-95fd-86c4982e97b2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:07.158717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c6d4f74-edef-4bec-95fd-86c4982e97b2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:07.159457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c6d4f74-edef-4bec-95fd-86c4982e97b2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:07.206504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4ef2327d-6f09-4da4-bf12-6cf98fe69941 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:07.228437 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4ef2327d-6f09-4da4-bf12-6cf98fe69941 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1318 microversion: 2.1 time: 0.876086 Oct 12 22:02:07.240712 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 326/720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:06 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1318 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:07.259002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c690166b-84fb-4039-b210-3b09df0765cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:07.259620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c690166b-84fb-4039-b210-3b09df0765cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:07.268637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c690166b-84fb-4039-b210-3b09df0765cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:07.269316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c690166b-84fb-4039-b210-3b09df0765cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:07.269762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c690166b-84fb-4039-b210-3b09df0765cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:07.270550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c690166b-84fb-4039-b210-3b09df0765cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:07.271011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c690166b-84fb-4039-b210-3b09df0765cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:07.271469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c690166b-84fb-4039-b210-3b09df0765cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:07.318000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0c6d4f74-edef-4bec-95fd-86c4982e97b2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:07.329300 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0c6d4f74-edef-4bec-95fd-86c4982e97b2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1217 microversion: 2.1 time: 0.191978 Oct 12 22:02:07.339698 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 395/721] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:07 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1217 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:07.348416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2bba207e-1044-4344-8dd3-139a81585a59 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:07.349086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2bba207e-1044-4344-8dd3-139a81585a59 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:07.357945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2bba207e-1044-4344-8dd3-139a81585a59 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:07.358593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2bba207e-1044-4344-8dd3-139a81585a59 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:07.359134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2bba207e-1044-4344-8dd3-139a81585a59 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:07.360521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2bba207e-1044-4344-8dd3-139a81585a59 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:07.361097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2bba207e-1044-4344-8dd3-139a81585a59 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:07.361654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2bba207e-1044-4344-8dd3-139a81585a59 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:07.444950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c690166b-84fb-4039-b210-3b09df0765cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:07.457172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c690166b-84fb-4039-b210-3b09df0765cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:07.460492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c690166b-84fb-4039-b210-3b09df0765cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:07.463977 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c690166b-84fb-4039-b210-3b09df0765cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1568 microversion: 2.25 time: 0.213668 Oct 12 22:02:07.465083 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 327/722] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:07 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:07.477025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-538f0969-9601-44af-aba5-5f137e995017 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:07.478006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-538f0969-9601-44af-aba5-5f137e995017 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:07.489784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-538f0969-9601-44af-aba5-5f137e995017 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:07.492034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-538f0969-9601-44af-aba5-5f137e995017 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:07.493715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-538f0969-9601-44af-aba5-5f137e995017 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:07.494587 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2bba207e-1044-4344-8dd3-139a81585a59 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "POST /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84/action" status: 202 len: 0 microversion: 2.1 time: 0.152623 Oct 12 22:02:07.495960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-538f0969-9601-44af-aba5-5f137e995017 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:07.497265 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 396/723] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:02:07 2022] POST /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:02:07.497984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-538f0969-9601-44af-aba5-5f137e995017 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:07.500875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-538f0969-9601-44af-aba5-5f137e995017 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:07.506224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-27aaeca5-7033-4e87-a3af-ba1fb85a5e44 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:07.507292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-27aaeca5-7033-4e87-a3af-ba1fb85a5e44 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: c6149ecf-bb8a-4f49-b8e8-6c71b862ff02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:07.530490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27aaeca5-7033-4e87-a3af-ba1fb85a5e44 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:07.531090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27aaeca5-7033-4e87-a3af-ba1fb85a5e44 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:07.534117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27aaeca5-7033-4e87-a3af-ba1fb85a5e44 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:07.535024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27aaeca5-7033-4e87-a3af-ba1fb85a5e44 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:07.535644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27aaeca5-7033-4e87-a3af-ba1fb85a5e44 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:07.536187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27aaeca5-7033-4e87-a3af-ba1fb85a5e44 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:07.592980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27aaeca5-7033-4e87-a3af-ba1fb85a5e44 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:07.593622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27aaeca5-7033-4e87-a3af-ba1fb85a5e44 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:07.594956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27aaeca5-7033-4e87-a3af-ba1fb85a5e44 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:07.595571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-27aaeca5-7033-4e87-a3af-ba1fb85a5e44 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lazy-loading 'fault' on Instance uuid c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:02:07.678529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-27aaeca5-7033-4e87-a3af-ba1fb85a5e44 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:07.691604 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-27aaeca5-7033-4e87-a3af-ba1fb85a5e44 tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02" status: 200 len: 1312 microversion: 2.1 time: 0.192096 Oct 12 22:02:07.695042 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 397/724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:07 2022] GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 => generated 1312 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:07.706186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0100b27b-08ec-4b2f-8cc6-cc9630f51f82 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:07.706835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0100b27b-08ec-4b2f-8cc6-cc9630f51f82 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:07.719341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0100b27b-08ec-4b2f-8cc6-cc9630f51f82 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:07.719849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0100b27b-08ec-4b2f-8cc6-cc9630f51f82 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:07.720293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0100b27b-08ec-4b2f-8cc6-cc9630f51f82 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:07.721009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0100b27b-08ec-4b2f-8cc6-cc9630f51f82 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:07.721468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0100b27b-08ec-4b2f-8cc6-cc9630f51f82 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:07.721899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0100b27b-08ec-4b2f-8cc6-cc9630f51f82 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:07.757661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-538f0969-9601-44af-aba5-5f137e995017 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:07.767276 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-538f0969-9601-44af-aba5-5f137e995017 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1359 microversion: 2.1 time: 0.300704 Oct 12 22:02:07.768485 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 328/725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:07 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1359 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:07.774500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-2da19ba5-d91f-49b2-a086-3c611a110646 req-205ac8ce-253a-4db1-b2b3-d88f102b40a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6149ecf-bb8a-4f49-b8e8-6c71b862ff02", "name": "network-vif-deleted", "tag": "8681c0c6-77b2-4d54-8598-2268da43d266"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:07.785175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2da19ba5-d91f-49b2-a086-3c611a110646 req-205ac8ce-253a-4db1-b2b3-d88f102b40a4 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:07.785812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2da19ba5-d91f-49b2-a086-3c611a110646 req-205ac8ce-253a-4db1-b2b3-d88f102b40a4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:07.786309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2da19ba5-d91f-49b2-a086-3c611a110646 req-205ac8ce-253a-4db1-b2b3-d88f102b40a4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:07.807823 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-2da19ba5-d91f-49b2-a086-3c611a110646 req-205ac8ce-253a-4db1-b2b3-d88f102b40a4 service nova] Creating event network-vif-deleted:8681c0c6-77b2-4d54-8598-2268da43d266 for instance c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 on n-h1-861111-1 Oct 12 22:02:07.813134 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-2da19ba5-d91f-49b2-a086-3c611a110646 req-205ac8ce-253a-4db1-b2b3-d88f102b40a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042755 Oct 12 22:02:07.814044 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 329/726] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:07.819344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6d8c7364-ea19-4359-9b22-2055341b3b4f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:07.820041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6d8c7364-ea19-4359-9b22-2055341b3b4f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:07.826330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8c7364-ea19-4359-9b22-2055341b3b4f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:07.826814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8c7364-ea19-4359-9b22-2055341b3b4f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:07.827273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8c7364-ea19-4359-9b22-2055341b3b4f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:07.827976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8c7364-ea19-4359-9b22-2055341b3b4f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:07.829112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8c7364-ea19-4359-9b22-2055341b3b4f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:07.829554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8c7364-ea19-4359-9b22-2055341b3b4f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:07.932396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0100b27b-08ec-4b2f-8cc6-cc9630f51f82 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:07.941823 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0100b27b-08ec-4b2f-8cc6-cc9630f51f82 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 200 len: 1464 microversion: 2.1 time: 0.245378 Oct 12 22:02:07.942733 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 398/727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:07 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 1464 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:08.000864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6d8c7364-ea19-4359-9b22-2055341b3b4f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:08.008820 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6d8c7364-ea19-4359-9b22-2055341b3b4f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 200 len: 1491 microversion: 2.1 time: 0.193384 Oct 12 22:02:08.009702 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 330/728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:07 2022] GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 1491 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:08.252885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-da622c4e-91aa-43b1-b68b-72d31b532158 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:08.253494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-da622c4e-91aa-43b1-b68b-72d31b532158 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:08.261459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da622c4e-91aa-43b1-b68b-72d31b532158 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:08.262286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da622c4e-91aa-43b1-b68b-72d31b532158 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:08.263536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da622c4e-91aa-43b1-b68b-72d31b532158 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:08.264558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da622c4e-91aa-43b1-b68b-72d31b532158 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:08.265318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da622c4e-91aa-43b1-b68b-72d31b532158 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:08.266386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da622c4e-91aa-43b1-b68b-72d31b532158 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:08.353866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8d3375f5-fd29-421d-ba62-f8d28d66b518 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:08.355091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8d3375f5-fd29-421d-ba62-f8d28d66b518 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:08.362007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d3375f5-fd29-421d-ba62-f8d28d66b518 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:08.362988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d3375f5-fd29-421d-ba62-f8d28d66b518 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:08.363533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d3375f5-fd29-421d-ba62-f8d28d66b518 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:08.364307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d3375f5-fd29-421d-ba62-f8d28d66b518 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:08.364943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d3375f5-fd29-421d-ba62-f8d28d66b518 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:08.365353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d3375f5-fd29-421d-ba62-f8d28d66b518 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:08.440675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-da622c4e-91aa-43b1-b68b-72d31b532158 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:08.451270 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-da622c4e-91aa-43b1-b68b-72d31b532158 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1318 microversion: 2.1 time: 0.202175 Oct 12 22:02:08.465656 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 399/729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:08 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:08.497445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-07c5a612-acaa-4f05-899e-f6ffdfd3aac3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:08.498069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-07c5a612-acaa-4f05-899e-f6ffdfd3aac3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:08.500396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8d3375f5-fd29-421d-ba62-f8d28d66b518 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:08.515861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07c5a612-acaa-4f05-899e-f6ffdfd3aac3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:08.516374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07c5a612-acaa-4f05-899e-f6ffdfd3aac3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:08.516785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07c5a612-acaa-4f05-899e-f6ffdfd3aac3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:08.519000 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8d3375f5-fd29-421d-ba62-f8d28d66b518 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1209 microversion: 2.1 time: 0.169844 Oct 12 22:02:08.520098 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 331/730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:08 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1209 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:08.523924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07c5a612-acaa-4f05-899e-f6ffdfd3aac3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:08.524562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-b096fa7f-c11c-49ed-ac22-40537a4f6963 req-b91b5c10-1b6c-4d55-966e-ba369299d23f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f266cf9-d4aa-4392-ab6c-722b3ef3d26e", "tag": "43b4aff9-14b1-41df-8485-e703d7cb7bea"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:08.524733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07c5a612-acaa-4f05-899e-f6ffdfd3aac3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:08.525279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07c5a612-acaa-4f05-899e-f6ffdfd3aac3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:08.535419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b096fa7f-c11c-49ed-ac22-40537a4f6963 req-b91b5c10-1b6c-4d55-966e-ba369299d23f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:08.535907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b096fa7f-c11c-49ed-ac22-40537a4f6963 req-b91b5c10-1b6c-4d55-966e-ba369299d23f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:08.536335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b096fa7f-c11c-49ed-ac22-40537a4f6963 req-b91b5c10-1b6c-4d55-966e-ba369299d23f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:08.552812 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-b096fa7f-c11c-49ed-ac22-40537a4f6963 req-b91b5c10-1b6c-4d55-966e-ba369299d23f service nova] Creating event network-changed:43b4aff9-14b1-41df-8485-e703d7cb7bea for instance 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e on n-h1-861111-1 Oct 12 22:02:08.558035 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-b096fa7f-c11c-49ed-ac22-40537a4f6963 req-b91b5c10-1b6c-4d55-966e-ba369299d23f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036778 Oct 12 22:02:08.561657 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 332/731] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:08.718768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b1eab83a-f6c4-492a-8f52-2d9f5cc73dcc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:08.720182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b1eab83a-f6c4-492a-8f52-2d9f5cc73dcc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: c6149ecf-bb8a-4f49-b8e8-6c71b862ff02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:08.726957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1eab83a-f6c4-492a-8f52-2d9f5cc73dcc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:08.727799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1eab83a-f6c4-492a-8f52-2d9f5cc73dcc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:08.728201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1eab83a-f6c4-492a-8f52-2d9f5cc73dcc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:08.728906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1eab83a-f6c4-492a-8f52-2d9f5cc73dcc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:08.729353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1eab83a-f6c4-492a-8f52-2d9f5cc73dcc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:08.729959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1eab83a-f6c4-492a-8f52-2d9f5cc73dcc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:08.747700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-07c5a612-acaa-4f05-899e-f6ffdfd3aac3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:08.755784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-07c5a612-acaa-4f05-899e-f6ffdfd3aac3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:08.757228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-07c5a612-acaa-4f05-899e-f6ffdfd3aac3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:08.758375 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-07c5a612-acaa-4f05-899e-f6ffdfd3aac3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1568 microversion: 2.25 time: 0.267515 Oct 12 22:02:08.759112 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 400/732] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:08 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1568 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:08.762808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1eab83a-f6c4-492a-8f52-2d9f5cc73dcc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:08.763316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1eab83a-f6c4-492a-8f52-2d9f5cc73dcc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:08.763751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1eab83a-f6c4-492a-8f52-2d9f5cc73dcc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:08.764203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-b1eab83a-f6c4-492a-8f52-2d9f5cc73dcc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lazy-loading 'fault' on Instance uuid c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:02:08.796271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1fe6b130-8b2d-4dd0-bdd9-4a0f73a2f0c0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:08.796903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1fe6b130-8b2d-4dd0-bdd9-4a0f73a2f0c0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:08.806702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fe6b130-8b2d-4dd0-bdd9-4a0f73a2f0c0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:08.810929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b1eab83a-f6c4-492a-8f52-2d9f5cc73dcc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a512ddf866d4d36a686ecf9b67a58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4981423dcc384a8598796d56100551c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:08.813022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fe6b130-8b2d-4dd0-bdd9-4a0f73a2f0c0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:08.818801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fe6b130-8b2d-4dd0-bdd9-4a0f73a2f0c0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:08.819823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fe6b130-8b2d-4dd0-bdd9-4a0f73a2f0c0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:08.820421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fe6b130-8b2d-4dd0-bdd9-4a0f73a2f0c0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:08.823399 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b1eab83a-f6c4-492a-8f52-2d9f5cc73dcc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02" status: 200 len: 1312 microversion: 2.1 time: 0.108808 Oct 12 22:02:08.824010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fe6b130-8b2d-4dd0-bdd9-4a0f73a2f0c0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:08.840256 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 333/733] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:08 2022] GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 => generated 1312 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:08.967548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-251ad109-1fdd-4695-b318-2b8287417961 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:08.968463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-251ad109-1fdd-4695-b318-2b8287417961 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:08.994596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-251ad109-1fdd-4695-b318-2b8287417961 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:08.996182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-251ad109-1fdd-4695-b318-2b8287417961 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:08.996782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-251ad109-1fdd-4695-b318-2b8287417961 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:08.999910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-251ad109-1fdd-4695-b318-2b8287417961 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:09.000618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-251ad109-1fdd-4695-b318-2b8287417961 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:09.003356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-251ad109-1fdd-4695-b318-2b8287417961 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:09.017279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:09.416293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1fe6b130-8b2d-4dd0-bdd9-4a0f73a2f0c0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:09.432497 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1fe6b130-8b2d-4dd0-bdd9-4a0f73a2f0c0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1359 microversion: 2.1 time: 0.639927 Oct 12 22:02:09.437979 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 401/734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:08 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1359 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:09.443138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fd2fb36f-924e-4cb9-a34f-7b5b61c085e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:09.443786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fd2fb36f-924e-4cb9-a34f-7b5b61c085e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:09.464156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd2fb36f-924e-4cb9-a34f-7b5b61c085e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:09.475837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-251ad109-1fdd-4695-b318-2b8287417961 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:09.476374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd2fb36f-924e-4cb9-a34f-7b5b61c085e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:09.476590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd2fb36f-924e-4cb9-a34f-7b5b61c085e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:09.477341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd2fb36f-924e-4cb9-a34f-7b5b61c085e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:09.477803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd2fb36f-924e-4cb9-a34f-7b5b61c085e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:09.478229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd2fb36f-924e-4cb9-a34f-7b5b61c085e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:09.488966 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-251ad109-1fdd-4695-b318-2b8287417961 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 200 len: 1464 microversion: 2.1 time: 0.527133 Oct 12 22:02:09.489537 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 334/735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:08 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 1464 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:09.494515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0314eb9f-e077-4084-abc8-89c2febbe537 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:09.495423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0314eb9f-e077-4084-abc8-89c2febbe537 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:09.503068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0314eb9f-e077-4084-abc8-89c2febbe537 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:09.503788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0314eb9f-e077-4084-abc8-89c2febbe537 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:09.504532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0314eb9f-e077-4084-abc8-89c2febbe537 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:09.505387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0314eb9f-e077-4084-abc8-89c2febbe537 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:09.506020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0314eb9f-e077-4084-abc8-89c2febbe537 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:09.507205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0314eb9f-e077-4084-abc8-89c2febbe537 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:09.674224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0314eb9f-e077-4084-abc8-89c2febbe537 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:09.682720 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0314eb9f-e077-4084-abc8-89c2febbe537 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1318 microversion: 2.1 time: 0.191792 Oct 12 22:02:09.683802 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 335/736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:09 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:09.688671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1b6982d8-4624-4c44-aa3b-08857c43b18c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:09.689333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1b6982d8-4624-4c44-aa3b-08857c43b18c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:09.695560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b6982d8-4624-4c44-aa3b-08857c43b18c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:09.696295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b6982d8-4624-4c44-aa3b-08857c43b18c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:09.696936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b6982d8-4624-4c44-aa3b-08857c43b18c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:09.697824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b6982d8-4624-4c44-aa3b-08857c43b18c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:09.698428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b6982d8-4624-4c44-aa3b-08857c43b18c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:09.699001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b6982d8-4624-4c44-aa3b-08857c43b18c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:09.770145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1b6982d8-4624-4c44-aa3b-08857c43b18c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:09.779792 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1b6982d8-4624-4c44-aa3b-08857c43b18c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1265 microversion: 2.1 time: 0.094664 Oct 12 22:02:09.780567 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 336/737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:09 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:09.786103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6e5604c0-c36b-41c6-8a79-79c8f06bf4a1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:09.786715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6e5604c0-c36b-41c6-8a79-79c8f06bf4a1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:09.792881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e5604c0-c36b-41c6-8a79-79c8f06bf4a1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:09.793375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e5604c0-c36b-41c6-8a79-79c8f06bf4a1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:09.793810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e5604c0-c36b-41c6-8a79-79c8f06bf4a1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:09.794514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e5604c0-c36b-41c6-8a79-79c8f06bf4a1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:09.795155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e5604c0-c36b-41c6-8a79-79c8f06bf4a1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:09.795649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e5604c0-c36b-41c6-8a79-79c8f06bf4a1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:09.935055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6e5604c0-c36b-41c6-8a79-79c8f06bf4a1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:09.947319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6e5604c0-c36b-41c6-8a79-79c8f06bf4a1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:09.949316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6e5604c0-c36b-41c6-8a79-79c8f06bf4a1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:09.950494 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6e5604c0-c36b-41c6-8a79-79c8f06bf4a1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1568 microversion: 2.25 time: 0.168947 Oct 12 22:02:09.952048 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 337/738] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:09 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:09.958021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5566828b-2d3b-47d4-9562-d1b2d8d921dc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:09.958941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5566828b-2d3b-47d4-9562-d1b2d8d921dc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] [instance: c6149ecf-bb8a-4f49-b8e8-6c71b862ff02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:09.969080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5566828b-2d3b-47d4-9562-d1b2d8d921dc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:09.969688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5566828b-2d3b-47d4-9562-d1b2d8d921dc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:09.970325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5566828b-2d3b-47d4-9562-d1b2d8d921dc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:09.971161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5566828b-2d3b-47d4-9562-d1b2d8d921dc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:09.971731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5566828b-2d3b-47d4-9562-d1b2d8d921dc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:09.972386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5566828b-2d3b-47d4-9562-d1b2d8d921dc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:09.988740 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-5566828b-2d3b-47d4-9562-d1b2d8d921dc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] HTTP exception thrown: Instance c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 could not be found. Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5566828b-2d3b-47d4-9562-d1b2d8d921dc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Request method failure captured: Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 HTTP/1.1 Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzkdUuIyiXSjY8a_-NF0l7zyfySZLoB_q8G9pdeX9s73-eDsZKJoUmcHrBjG372RfrhnLZ3J9hktbrnsAVa2Q9Myf0EE--FYwIWGmWIAzNRGynzF66tCXj7Dzg-f3pV51nzAtYqwi6aioPrgzvaXf62QLDm1jCihFC6oAMPKEGwGomw Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 4981423dcc384a8598796d56100551c4 Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1330228189 Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:02:09.990507 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:02:09.992016 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4981423dcc384a8598796d56100551c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4981423dcc384a8598796d56100551c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4981423dcc384a8598796d56100551c4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4981423dcc384a8598796d56100551c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:02:09.992016 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1330228189 Oct 12 22:02:09.992016 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 4981423dcc384a8598796d56100551c4 Oct 12 22:02:09.992016 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1330228189 Oct 12 22:02:09.992016 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersAdminNegativeTestJSON-1330228189-project Oct 12 22:02:09.992016 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:02:09.992016 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:02:09.992016 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 1a512ddf866d4d36a686ecf9b67a58e9 Oct 12 22:02:09.992016 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1330228189-project Oct 12 22:02:09.992016 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:02:09.992016 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 could not be found. Oct 12 22:02:09.992016 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'c6149ecf-bb8a-4f49-b8e8-6c71b862ff02'} Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 could not be found. Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:02:09.992760 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 could not be found. Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 could not be found. Oct 12 22:02:09.993906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:09.994957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5566828b-2d3b-47d4-9562-d1b2d8d921dc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] Returning 404 to user: Instance c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:02:09.994957 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5566828b-2d3b-47d4-9562-d1b2d8d921dc tempest-ServersAdminNegativeTestJSON-1330228189 tempest-ServersAdminNegativeTestJSON-1330228189-project] 10.222.0.16 "GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02" status: 404 len: 111 microversion: 2.1 time: 0.038770 Oct 12 22:02:09.995375 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 338/739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:09 2022] GET /compute/v2.1/servers/c6149ecf-bb8a-4f49-b8e8-6c71b862ff02 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:02:10.089622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fd2fb36f-924e-4cb9-a34f-7b5b61c085e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:10.098273 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fd2fb36f-924e-4cb9-a34f-7b5b61c085e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 200 len: 1471 microversion: 2.1 time: 0.658989 Oct 12 22:02:10.099057 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 402/740] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:09 2022] GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 1471 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:10.121146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-33413f6c-16f2-4676-98b2-046dff4f79a1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-666945634"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:10.125922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-33413f6c-16f2-4676-98b2-046dff4f79a1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:10.132504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33413f6c-16f2-4676-98b2-046dff4f79a1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:10.133237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33413f6c-16f2-4676-98b2-046dff4f79a1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:10.133832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33413f6c-16f2-4676-98b2-046dff4f79a1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:10.134682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33413f6c-16f2-4676-98b2-046dff4f79a1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:10.135383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33413f6c-16f2-4676-98b2-046dff4f79a1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:10.135958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33413f6c-16f2-4676-98b2-046dff4f79a1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:10.462448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d7426240-8650-4f04-9dd1-c713783be616 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:10.463730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d7426240-8650-4f04-9dd1-c713783be616 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:10.476105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7426240-8650-4f04-9dd1-c713783be616 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:10.476676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7426240-8650-4f04-9dd1-c713783be616 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:10.477338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7426240-8650-4f04-9dd1-c713783be616 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:10.480467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7426240-8650-4f04-9dd1-c713783be616 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:10.481100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7426240-8650-4f04-9dd1-c713783be616 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:10.481602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7426240-8650-4f04-9dd1-c713783be616 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:10.504445 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-33413f6c-16f2-4676-98b2-046dff4f79a1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "POST /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84/action" status: 202 len: 0 microversion: 2.1 time: 0.387175 Oct 12 22:02:10.506080 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 339/741] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:02:10 2022] POST /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:02:10.521139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3de5b1d8-9c71-4e4c-997d-32721ff59591 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:10.522063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3de5b1d8-9c71-4e4c-997d-32721ff59591 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:10.529494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3de5b1d8-9c71-4e4c-997d-32721ff59591 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:10.530201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3de5b1d8-9c71-4e4c-997d-32721ff59591 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:10.532245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3de5b1d8-9c71-4e4c-997d-32721ff59591 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:10.534406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3de5b1d8-9c71-4e4c-997d-32721ff59591 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:10.536012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3de5b1d8-9c71-4e4c-997d-32721ff59591 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:10.537770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3de5b1d8-9c71-4e4c-997d-32721ff59591 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:10.725739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3de5b1d8-9c71-4e4c-997d-32721ff59591 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:10.734257 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3de5b1d8-9c71-4e4c-997d-32721ff59591 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 200 len: 1422 microversion: 2.1 time: 0.217185 Oct 12 22:02:10.739292 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 340/742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:10 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 1422 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:10.763571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-60cda4ed-6924-434a-9e84-eef3a4e2d970 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128717c10>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:10.851975 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-60cda4ed-6924-434a-9e84-eef3a4e2d970 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.115593 Oct 12 22:02:10.852762 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 341/743] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:10 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:10.864969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-30ee863e-f019-4052-ae3c-aa2a186714ce req-987e35a8-cead-4b13-9ecd-d501409b69ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5574396-f705-4e92-9934-760a5ae961a8", "name": "network-vif-deleted", "tag": "f0e5da0c-7fe4-49cd-b408-08f20ae11569"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:10.875047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-30ee863e-f019-4052-ae3c-aa2a186714ce req-987e35a8-cead-4b13-9ecd-d501409b69ce service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:10.875797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-30ee863e-f019-4052-ae3c-aa2a186714ce req-987e35a8-cead-4b13-9ecd-d501409b69ce service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:10.876447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-30ee863e-f019-4052-ae3c-aa2a186714ce req-987e35a8-cead-4b13-9ecd-d501409b69ce service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:10.892279 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-30ee863e-f019-4052-ae3c-aa2a186714ce req-987e35a8-cead-4b13-9ecd-d501409b69ce service nova] Creating event network-vif-deleted:f0e5da0c-7fe4-49cd-b408-08f20ae11569 for instance e5574396-f705-4e92-9934-760a5ae961a8 on n-h1-861111-1 Oct 12 22:02:10.897777 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-30ee863e-f019-4052-ae3c-aa2a186714ce req-987e35a8-cead-4b13-9ecd-d501409b69ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043697 Oct 12 22:02:10.898724 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 342/744] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:10.904074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ac638a7b-526f-41df-b0ac-5d1db7b71956 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:10.904767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ac638a7b-526f-41df-b0ac-5d1db7b71956 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:10.911445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac638a7b-526f-41df-b0ac-5d1db7b71956 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:10.911969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac638a7b-526f-41df-b0ac-5d1db7b71956 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:10.912406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac638a7b-526f-41df-b0ac-5d1db7b71956 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:10.913229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac638a7b-526f-41df-b0ac-5d1db7b71956 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:10.914487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac638a7b-526f-41df-b0ac-5d1db7b71956 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:10.914487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac638a7b-526f-41df-b0ac-5d1db7b71956 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:10.954261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d7426240-8650-4f04-9dd1-c713783be616 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:10.963968 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d7426240-8650-4f04-9dd1-c713783be616 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1542 microversion: 2.1 time: 0.507329 Oct 12 22:02:10.964624 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 403/745] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:10 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1542 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:10.971651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dae1e266-549e-45dc-b1bb-6eb8093dcc8e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:10.972659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dae1e266-549e-45dc-b1bb-6eb8093dcc8e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:10.983617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dae1e266-549e-45dc-b1bb-6eb8093dcc8e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:10.984199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dae1e266-549e-45dc-b1bb-6eb8093dcc8e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:10.985362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dae1e266-549e-45dc-b1bb-6eb8093dcc8e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:10.986168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dae1e266-549e-45dc-b1bb-6eb8093dcc8e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:10.986695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dae1e266-549e-45dc-b1bb-6eb8093dcc8e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:10.987203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dae1e266-549e-45dc-b1bb-6eb8093dcc8e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:11.075857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dae1e266-549e-45dc-b1bb-6eb8093dcc8e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:11.086444 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dae1e266-549e-45dc-b1bb-6eb8093dcc8e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1271 microversion: 2.1 time: 0.119821 Oct 12 22:02:11.087022 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 404/746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:10 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:11.092438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3cce6460-4988-4776-a0c0-9ef1e0ce66bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:11.093090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3cce6460-4988-4776-a0c0-9ef1e0ce66bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:11.098948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cce6460-4988-4776-a0c0-9ef1e0ce66bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:11.099478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cce6460-4988-4776-a0c0-9ef1e0ce66bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:11.100077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cce6460-4988-4776-a0c0-9ef1e0ce66bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:11.100923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cce6460-4988-4776-a0c0-9ef1e0ce66bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:11.101547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cce6460-4988-4776-a0c0-9ef1e0ce66bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:11.102115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cce6460-4988-4776-a0c0-9ef1e0ce66bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:11.140802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ac638a7b-526f-41df-b0ac-5d1db7b71956 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:11.152976 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ac638a7b-526f-41df-b0ac-5d1db7b71956 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1318 microversion: 2.1 time: 0.252990 Oct 12 22:02:11.154134 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 343/747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:10 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:11.159848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4b0f699c-9fe5-45c9-a51e-23cd144cd3a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:11.160689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4b0f699c-9fe5-45c9-a51e-23cd144cd3a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:11.166570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b0f699c-9fe5-45c9-a51e-23cd144cd3a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:11.167149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b0f699c-9fe5-45c9-a51e-23cd144cd3a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:11.167884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b0f699c-9fe5-45c9-a51e-23cd144cd3a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:11.168611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b0f699c-9fe5-45c9-a51e-23cd144cd3a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:11.169143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b0f699c-9fe5-45c9-a51e-23cd144cd3a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:11.169686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b0f699c-9fe5-45c9-a51e-23cd144cd3a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:11.282895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3cce6460-4988-4776-a0c0-9ef1e0ce66bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:11.286454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:11.293001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3cce6460-4988-4776-a0c0-9ef1e0ce66bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:11.294459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3cce6460-4988-4776-a0c0-9ef1e0ce66bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:11.295649 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3cce6460-4988-4776-a0c0-9ef1e0ce66bd tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1568 microversion: 2.25 time: 0.207031 Oct 12 22:02:11.296436 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 405/748] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:11 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:11.342155 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4b0f699c-9fe5-45c9-a51e-23cd144cd3a1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.186633 Oct 12 22:02:11.352093 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 344/749] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:02:11 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-interface => generated 284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:11.757480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-df47a736-fa13-4b11-b590-4025b4b23c66 req-b2e9bc96-7fe7-43a5-b161-deafb6ee32a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf71b2a6-484b-4e05-80fb-89be6b98546a", "name": "network-vif-plugged", "status": "completed", "tag": "e7a4b681-6708-4e63-905c-13cb884689e3"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:11.761642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7ef39d35-9017-42b9-89d0-c76b80e27ec3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:11.762256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7ef39d35-9017-42b9-89d0-c76b80e27ec3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:11.779092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ef39d35-9017-42b9-89d0-c76b80e27ec3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:11.779839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ef39d35-9017-42b9-89d0-c76b80e27ec3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:11.780541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ef39d35-9017-42b9-89d0-c76b80e27ec3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:11.781316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ef39d35-9017-42b9-89d0-c76b80e27ec3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:11.781771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ef39d35-9017-42b9-89d0-c76b80e27ec3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:11.782195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ef39d35-9017-42b9-89d0-c76b80e27ec3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:11.788221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-df47a736-fa13-4b11-b590-4025b4b23c66 req-b2e9bc96-7fe7-43a5-b161-deafb6ee32a8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:11.788693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-df47a736-fa13-4b11-b590-4025b4b23c66 req-b2e9bc96-7fe7-43a5-b161-deafb6ee32a8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:11.789303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-df47a736-fa13-4b11-b590-4025b4b23c66 req-b2e9bc96-7fe7-43a5-b161-deafb6ee32a8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:11.802270 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-df47a736-fa13-4b11-b590-4025b4b23c66 req-b2e9bc96-7fe7-43a5-b161-deafb6ee32a8 service nova] Creating event network-vif-plugged:e7a4b681-6708-4e63-905c-13cb884689e3 for instance cf71b2a6-484b-4e05-80fb-89be6b98546a on n-h2-861111-1 Oct 12 22:02:11.807579 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-df47a736-fa13-4b11-b590-4025b4b23c66 req-b2e9bc96-7fe7-43a5-b161-deafb6ee32a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055887 Oct 12 22:02:11.808684 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 406/750] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:11.832802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ef39d35-9017-42b9-89d0-c76b80e27ec3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:11.833622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ef39d35-9017-42b9-89d0-c76b80e27ec3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:11.834155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ef39d35-9017-42b9-89d0-c76b80e27ec3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:11.835096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-7ef39d35-9017-42b9-89d0-c76b80e27ec3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lazy-loading 'fault' on Instance uuid e5574396-f705-4e92-9934-760a5ae961a8 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:02:11.868850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-61b220bb-b919-4dab-b7cc-a7555948b388 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512848edc0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:11.928069 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-61b220bb-b919-4dab-b7cc-a7555948b388 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.063588 Oct 12 22:02:11.928640 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 407/751] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:11 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:11.951551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7ef39d35-9017-42b9-89d0-c76b80e27ec3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:11.961118 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7ef39d35-9017-42b9-89d0-c76b80e27ec3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 200 len: 1308 microversion: 2.1 time: 0.204594 Oct 12 22:02:11.961928 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 345/752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:11 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 1308 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:12.111081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8e6300df-4122-4df0-9b64-f33c56c53da2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:12.111847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8e6300df-4122-4df0-9b64-f33c56c53da2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:12.118193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e6300df-4122-4df0-9b64-f33c56c53da2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:12.118878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e6300df-4122-4df0-9b64-f33c56c53da2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:12.119504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e6300df-4122-4df0-9b64-f33c56c53da2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:12.120395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e6300df-4122-4df0-9b64-f33c56c53da2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:12.121008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e6300df-4122-4df0-9b64-f33c56c53da2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:12.121606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e6300df-4122-4df0-9b64-f33c56c53da2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:12.177815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e3ee9ee4-bf32-492d-9276-bc14095693a2 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:12.178535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e3ee9ee4-bf32-492d-9276-bc14095693a2 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:12.184986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3ee9ee4-bf32-492d-9276-bc14095693a2 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:12.185569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3ee9ee4-bf32-492d-9276-bc14095693a2 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:12.186177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3ee9ee4-bf32-492d-9276-bc14095693a2 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:12.187097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3ee9ee4-bf32-492d-9276-bc14095693a2 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:12.188228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3ee9ee4-bf32-492d-9276-bc14095693a2 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:12.189694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3ee9ee4-bf32-492d-9276-bc14095693a2 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:12.477460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e3ee9ee4-bf32-492d-9276-bc14095693a2 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:12.481142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8e6300df-4122-4df0-9b64-f33c56c53da2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:12.487594 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e3ee9ee4-bf32-492d-9276-bc14095693a2 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1318 microversion: 2.1 time: 0.313664 Oct 12 22:02:12.488890 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 346/753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:12 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:12.494379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6f5922d8-301a-4e7b-8ed1-de98c911dbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:12.495072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6f5922d8-301a-4e7b-8ed1-de98c911dbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:12.502446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f5922d8-301a-4e7b-8ed1-de98c911dbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:12.503331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f5922d8-301a-4e7b-8ed1-de98c911dbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:12.504054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f5922d8-301a-4e7b-8ed1-de98c911dbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:12.505186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f5922d8-301a-4e7b-8ed1-de98c911dbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:12.505646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f5922d8-301a-4e7b-8ed1-de98c911dbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:12.506074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f5922d8-301a-4e7b-8ed1-de98c911dbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:12.506528 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8e6300df-4122-4df0-9b64-f33c56c53da2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1313 microversion: 2.1 time: 0.400416 Oct 12 22:02:12.507378 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 408/754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:12 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:12.736987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6f5922d8-301a-4e7b-8ed1-de98c911dbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:12.746626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6f5922d8-301a-4e7b-8ed1-de98c911dbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:12.748103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6f5922d8-301a-4e7b-8ed1-de98c911dbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:12.755640 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6f5922d8-301a-4e7b-8ed1-de98c911dbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1568 microversion: 2.25 time: 0.259410 Oct 12 22:02:12.761688 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 347/755] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:12 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:12.945405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-215ce9e5-8961-442c-b60f-3efc871e053e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512860b670>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:12.989051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0b96f4c1-fe7e-4475-8a24-9c1873492cb3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:12.989658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0b96f4c1-fe7e-4475-8a24-9c1873492cb3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: e5574396-f705-4e92-9934-760a5ae961a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:12.997419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b96f4c1-fe7e-4475-8a24-9c1873492cb3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:12.997912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b96f4c1-fe7e-4475-8a24-9c1873492cb3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:12.998342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b96f4c1-fe7e-4475-8a24-9c1873492cb3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:12.999044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b96f4c1-fe7e-4475-8a24-9c1873492cb3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:12.999515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b96f4c1-fe7e-4475-8a24-9c1873492cb3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:13.000465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b96f4c1-fe7e-4475-8a24-9c1873492cb3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:13.017703 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-0b96f4c1-fe7e-4475-8a24-9c1873492cb3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] HTTP exception thrown: Instance e5574396-f705-4e92-9934-760a5ae961a8 could not be found. Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0b96f4c1-fe7e-4475-8a24-9c1873492cb3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Request method failure captured: Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 HTTP/1.1 Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzkou8gqLZm8zfPIdNSZ4KzU1MJGoBDqyhI33Q70F9biFuUZpJABafD7TnHZmLYwanRZVFKx9W8u4rOA1R_1O751UFMrq6ggbK3k0HjYT4m1oQTrOu0p8mEPNv0WhrWO1FHy79XAqBSM15miylKCWrSMgQiCTyVQcx-j5j4X5nxqhPk Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: feebe9edaa9c4104843143736f570e02 Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-LiveMigrationNegativeTest-1353154551 Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:02:13.020320 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:02:13.021547 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feebe9edaa9c4104843143736f570e02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feebe9edaa9c4104843143736f570e02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_feebe9edaa9c4104843143736f570e02", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/feebe9edaa9c4104843143736f570e02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:02:13.021547 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-LiveMigrationNegativeTest-1353154551 Oct 12 22:02:13.021547 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: feebe9edaa9c4104843143736f570e02 Oct 12 22:02:13.021547 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1353154551 Oct 12 22:02:13.021547 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-LiveMigrationNegativeTest-1353154551-project Oct 12 22:02:13.021547 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:02:13.021547 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:02:13.021547 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 827d63bf6f35482691c64842c594e753 Oct 12 22:02:13.021547 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-LiveMigrationNegativeTest-1353154551-project Oct 12 22:02:13.021547 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:02:13.021547 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance e5574396-f705-4e92-9934-760a5ae961a8 could not be found. Oct 12 22:02:13.021547 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'e5574396-f705-4e92-9934-760a5ae961a8'} Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5574396-f705-4e92-9934-760a5ae961a8 could not be found. Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:02:13.022271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5574396-f705-4e92-9934-760a5ae961a8 could not be found. Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5574396-f705-4e92-9934-760a5ae961a8 could not be found. Oct 12 22:02:13.023408 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:13.026571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0b96f4c1-fe7e-4475-8a24-9c1873492cb3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Returning 404 to user: Instance e5574396-f705-4e92-9934-760a5ae961a8 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:02:13.027810 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0b96f4c1-fe7e-4475-8a24-9c1873492cb3 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8" status: 404 len: 111 microversion: 2.1 time: 0.042671 Oct 12 22:02:13.028665 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 348/756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:12 2022] GET /compute/v2.1/servers/e5574396-f705-4e92-9934-760a5ae961a8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:02:13.037623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f3e1ca53-5de2-4678-a2ad-a2eeae122617 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:13.038481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f3e1ca53-5de2-4678-a2ad-a2eeae122617 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:13.043060 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-215ce9e5-8961-442c-b60f-3efc871e053e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.099809 Oct 12 22:02:13.047615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3e1ca53-5de2-4678-a2ad-a2eeae122617 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:13.049513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3e1ca53-5de2-4678-a2ad-a2eeae122617 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:13.050394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3e1ca53-5de2-4678-a2ad-a2eeae122617 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:13.051326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3e1ca53-5de2-4678-a2ad-a2eeae122617 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:13.051990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3e1ca53-5de2-4678-a2ad-a2eeae122617 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:13.053249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3e1ca53-5de2-4678-a2ad-a2eeae122617 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:13.071984 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 409/757] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:12 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:13.117045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f3e1ca53-5de2-4678-a2ad-a2eeae122617 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:02:13.121213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-26ccada7-6772-4c22-8caf-b771390a18c0 req-d7f1ecb6-d239-4fdd-8628-a9f87e77229b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d06c998-c0a6-4bb7-8538-9a7b0298b918", "tag": "6a950ceb-e8e8-414f-921b-8239a9d66a46"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:13.157010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-26ccada7-6772-4c22-8caf-b771390a18c0 req-d7f1ecb6-d239-4fdd-8628-a9f87e77229b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:13.157855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-26ccada7-6772-4c22-8caf-b771390a18c0 req-d7f1ecb6-d239-4fdd-8628-a9f87e77229b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:13.158958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-26ccada7-6772-4c22-8caf-b771390a18c0 req-d7f1ecb6-d239-4fdd-8628-a9f87e77229b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:13.190520 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-26ccada7-6772-4c22-8caf-b771390a18c0 req-d7f1ecb6-d239-4fdd-8628-a9f87e77229b service nova] Creating event network-changed:6a950ceb-e8e8-414f-921b-8239a9d66a46 for instance 3d06c998-c0a6-4bb7-8538-9a7b0298b918 on n-h2-861111-1 Oct 12 22:02:13.204748 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-26ccada7-6772-4c22-8caf-b771390a18c0 req-d7f1ecb6-d239-4fdd-8628-a9f87e77229b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086718 Oct 12 22:02:13.206363 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 410/758] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:13.253702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d9cb252c-4f7e-45bf-8d19-3f0cd6532047 req-8eca93e1-5b9a-4eb5-a6b3-f16e1e57f4da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a5599b6-e17a-41b1-80a1-a43e278b013b", "tag": "9b742b79-f5ca-4dd2-a2dd-1e98ca78fe8d"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:13.275827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d9cb252c-4f7e-45bf-8d19-3f0cd6532047 req-8eca93e1-5b9a-4eb5-a6b3-f16e1e57f4da service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:13.279081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d9cb252c-4f7e-45bf-8d19-3f0cd6532047 req-8eca93e1-5b9a-4eb5-a6b3-f16e1e57f4da service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:13.279794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d9cb252c-4f7e-45bf-8d19-3f0cd6532047 req-8eca93e1-5b9a-4eb5-a6b3-f16e1e57f4da service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:13.279919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:13.286143 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f3e1ca53-5de2-4678-a2ad-a2eeae122617 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "DELETE /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219" status: 204 len: 0 microversion: 2.1 time: 0.252552 Oct 12 22:02:13.295742 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 349/759] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:02:13 2022] DELETE /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:02:13.301802 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d9cb252c-4f7e-45bf-8d19-3f0cd6532047 req-8eca93e1-5b9a-4eb5-a6b3-f16e1e57f4da service nova] Creating event network-changed:9b742b79-f5ca-4dd2-a2dd-1e98ca78fe8d for instance 5a5599b6-e17a-41b1-80a1-a43e278b013b on n-h1-861111-1 Oct 12 22:02:13.307956 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d9cb252c-4f7e-45bf-8d19-3f0cd6532047 req-8eca93e1-5b9a-4eb5-a6b3-f16e1e57f4da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057893 Oct 12 22:02:13.310761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e9557c53-65cd-4a00-a308-5642bab9f674 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:13.311550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e9557c53-65cd-4a00-a308-5642bab9f674 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:13.314173 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 411/760] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:13.328703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9557c53-65cd-4a00-a308-5642bab9f674 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:13.330657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9557c53-65cd-4a00-a308-5642bab9f674 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:13.334211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9557c53-65cd-4a00-a308-5642bab9f674 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:13.335119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9557c53-65cd-4a00-a308-5642bab9f674 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:13.336177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9557c53-65cd-4a00-a308-5642bab9f674 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:13.336449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9557c53-65cd-4a00-a308-5642bab9f674 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:13.512964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-60461532-4f4e-4709-89e7-f63127e7d947 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:13.514005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-60461532-4f4e-4709-89e7-f63127e7d947 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:13.527765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60461532-4f4e-4709-89e7-f63127e7d947 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:13.530038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60461532-4f4e-4709-89e7-f63127e7d947 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:13.530662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60461532-4f4e-4709-89e7-f63127e7d947 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:13.533943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60461532-4f4e-4709-89e7-f63127e7d947 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:13.535420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60461532-4f4e-4709-89e7-f63127e7d947 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:13.536026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60461532-4f4e-4709-89e7-f63127e7d947 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:13.812023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e9557c53-65cd-4a00-a308-5642bab9f674 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:13.814341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:13.827052 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e9557c53-65cd-4a00-a308-5642bab9f674 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219" status: 200 len: 1475 microversion: 2.1 time: 0.526293 Oct 12 22:02:13.827612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-60461532-4f4e-4709-89e7-f63127e7d947 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:13.827740 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 350/761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:13 2022] GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219 => generated 1475 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:13.836173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c1f649a3-1bba-4456-b165-fbc963fab786 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:13.839579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c1f649a3-1bba-4456-b165-fbc963fab786 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:13.853682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1f649a3-1bba-4456-b165-fbc963fab786 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:13.855817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1f649a3-1bba-4456-b165-fbc963fab786 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:13.857284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1f649a3-1bba-4456-b165-fbc963fab786 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:13.860855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1f649a3-1bba-4456-b165-fbc963fab786 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:13.861533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1f649a3-1bba-4456-b165-fbc963fab786 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:13.864097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1f649a3-1bba-4456-b165-fbc963fab786 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:13.882774 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-60461532-4f4e-4709-89e7-f63127e7d947 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1318 microversion: 2.1 time: 0.373762 Oct 12 22:02:13.885722 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 412/762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:13 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:13.894846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e6353df1-b038-4c21-b039-e0a56edf48f3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:13.899256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e6353df1-b038-4c21-b039-e0a56edf48f3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:13.910990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6353df1-b038-4c21-b039-e0a56edf48f3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:13.913651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6353df1-b038-4c21-b039-e0a56edf48f3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:13.914282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6353df1-b038-4c21-b039-e0a56edf48f3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:13.915523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6353df1-b038-4c21-b039-e0a56edf48f3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:13.916465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6353df1-b038-4c21-b039-e0a56edf48f3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:13.917115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6353df1-b038-4c21-b039-e0a56edf48f3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:14.192866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c1f649a3-1bba-4456-b165-fbc963fab786 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:14.214270 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c1f649a3-1bba-4456-b165-fbc963fab786 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1313 microversion: 2.1 time: 0.384582 Oct 12 22:02:14.223752 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 351/763] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:13 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:14.226160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-293a9f87-a99a-495e-b707-03266681c2fa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51286b00d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:14.242252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e6353df1-b038-4c21-b039-e0a56edf48f3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:14.254963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e6353df1-b038-4c21-b039-e0a56edf48f3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:14.259986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e6353df1-b038-4c21-b039-e0a56edf48f3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:14.265090 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e6353df1-b038-4c21-b039-e0a56edf48f3 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1568 microversion: 2.25 time: 0.376040 Oct 12 22:02:14.266717 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 413/764] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:13 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1568 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:14.301400 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-293a9f87-a99a-495e-b707-03266681c2fa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.080263 Oct 12 22:02:14.310981 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 352/765] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:14 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:14.854109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5447ae00-e643-413e-b256-97b5bdd13a5f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:14.855177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5447ae00-e643-413e-b256-97b5bdd13a5f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:14.866467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5447ae00-e643-413e-b256-97b5bdd13a5f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:14.867217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5447ae00-e643-413e-b256-97b5bdd13a5f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:14.869206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5447ae00-e643-413e-b256-97b5bdd13a5f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:14.880890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5447ae00-e643-413e-b256-97b5bdd13a5f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:14.881631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5447ae00-e643-413e-b256-97b5bdd13a5f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:14.882274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5447ae00-e643-413e-b256-97b5bdd13a5f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:14.918510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d2f6597f-d4fe-4d5c-87c5-2eb3722ab73c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:14.920443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d2f6597f-d4fe-4d5c-87c5-2eb3722ab73c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:14.932518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2f6597f-d4fe-4d5c-87c5-2eb3722ab73c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:14.946025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2f6597f-d4fe-4d5c-87c5-2eb3722ab73c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:14.947638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2f6597f-d4fe-4d5c-87c5-2eb3722ab73c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:14.953278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2f6597f-d4fe-4d5c-87c5-2eb3722ab73c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:14.953777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2f6597f-d4fe-4d5c-87c5-2eb3722ab73c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:14.954228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2f6597f-d4fe-4d5c-87c5-2eb3722ab73c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:15.348837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d2f6597f-d4fe-4d5c-87c5-2eb3722ab73c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:15.357106 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d2f6597f-d4fe-4d5c-87c5-2eb3722ab73c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1318 microversion: 2.1 time: 0.450112 Oct 12 22:02:15.365223 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 353/766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:14 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:15.369960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2baeda80-6708-40c0-aa18-22879ff115d0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:15.371019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2baeda80-6708-40c0-aa18-22879ff115d0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:15.382187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2baeda80-6708-40c0-aa18-22879ff115d0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:15.391451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2baeda80-6708-40c0-aa18-22879ff115d0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:15.392264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2baeda80-6708-40c0-aa18-22879ff115d0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:15.393221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2baeda80-6708-40c0-aa18-22879ff115d0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:15.393880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2baeda80-6708-40c0-aa18-22879ff115d0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:15.394529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2baeda80-6708-40c0-aa18-22879ff115d0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:15.484971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:15.714861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5447ae00-e643-413e-b256-97b5bdd13a5f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:15.728865 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5447ae00-e643-413e-b256-97b5bdd13a5f tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219" status: 200 len: 1475 microversion: 2.1 time: 0.876724 Oct 12 22:02:15.732990 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 414/767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:14 2022] GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219 => generated 1475 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:15.754683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aceb2136-ccc3-4274-ab0d-a05e74f22538 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:15.758670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aceb2136-ccc3-4274-ab0d-a05e74f22538 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:15.773065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aceb2136-ccc3-4274-ab0d-a05e74f22538 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:15.774532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aceb2136-ccc3-4274-ab0d-a05e74f22538 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:15.777165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aceb2136-ccc3-4274-ab0d-a05e74f22538 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:15.778113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aceb2136-ccc3-4274-ab0d-a05e74f22538 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:15.778951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aceb2136-ccc3-4274-ab0d-a05e74f22538 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:15.780802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aceb2136-ccc3-4274-ab0d-a05e74f22538 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:16.029635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2baeda80-6708-40c0-aa18-22879ff115d0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:16.038188 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2baeda80-6708-40c0-aa18-22879ff115d0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1313 microversion: 2.1 time: 0.671777 Oct 12 22:02:16.051720 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 354/768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:15 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1313 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:16.056666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8111a549-b5b6-4406-b99c-cb124cc6e500 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128653ee0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:16.129502 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8111a549-b5b6-4406-b99c-cb124cc6e500 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.076392 Oct 12 22:02:16.130366 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 355/769] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:16 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:16.389383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ed8e4eb0-f111-47c5-9df2-d8919c4586b6 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:16.390087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ed8e4eb0-f111-47c5-9df2-d8919c4586b6 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:16.392189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:16.393343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=5 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:16.404222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed8e4eb0-f111-47c5-9df2-d8919c4586b6 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:16.407418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed8e4eb0-f111-47c5-9df2-d8919c4586b6 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:16.408096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed8e4eb0-f111-47c5-9df2-d8919c4586b6 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:16.408991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed8e4eb0-f111-47c5-9df2-d8919c4586b6 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:16.411834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed8e4eb0-f111-47c5-9df2-d8919c4586b6 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:16.412459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed8e4eb0-f111-47c5-9df2-d8919c4586b6 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:16.716565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aceb2136-ccc3-4274-ab0d-a05e74f22538 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:16.730946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aceb2136-ccc3-4274-ab0d-a05e74f22538 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:16.732751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aceb2136-ccc3-4274-ab0d-a05e74f22538 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:16.737008 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aceb2136-ccc3-4274-ab0d-a05e74f22538 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1568 microversion: 2.25 time: 1.002966 Oct 12 22:02:16.740646 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 415/770] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:15 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1568 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:16.756082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-8650fcc6-243f-4b01-8054-767ee5b1fdaf req-a66ef8b4-d3d2-4368-87e0-3bc74ee90f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37440ed5-600e-4a41-80ce-a48643705219", "name": "network-vif-deleted", "tag": "1a9a1d71-0ce0-4b2e-8d76-437ca3759607"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:16.778203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8650fcc6-243f-4b01-8054-767ee5b1fdaf req-a66ef8b4-d3d2-4368-87e0-3bc74ee90f0f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:16.779629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8650fcc6-243f-4b01-8054-767ee5b1fdaf req-a66ef8b4-d3d2-4368-87e0-3bc74ee90f0f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:16.780762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8650fcc6-243f-4b01-8054-767ee5b1fdaf req-a66ef8b4-d3d2-4368-87e0-3bc74ee90f0f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:16.816045 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-8650fcc6-243f-4b01-8054-767ee5b1fdaf req-a66ef8b4-d3d2-4368-87e0-3bc74ee90f0f service nova] Creating event network-vif-deleted:1a9a1d71-0ce0-4b2e-8d76-437ca3759607 for instance 37440ed5-600e-4a41-80ce-a48643705219 on n-h2-861111-1 Oct 12 22:02:16.830928 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-8650fcc6-243f-4b01-8054-767ee5b1fdaf req-a66ef8b4-d3d2-4368-87e0-3bc74ee90f0f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084421 Oct 12 22:02:16.833570 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 416/771] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:16.851205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-3cc329c3-cea6-4541-88c4-38f47ee75b6f req-93593dc7-5d09-443c-8983-0430499966d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad668734-0c34-4d75-b667-0f69f3515d84", "name": "network-vif-plugged", "status": "completed", "tag": "38c74c93-daa8-4431-99a7-a03e4c6e546f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:16.872525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3cc329c3-cea6-4541-88c4-38f47ee75b6f req-93593dc7-5d09-443c-8983-0430499966d1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:16.876079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3cc329c3-cea6-4541-88c4-38f47ee75b6f req-93593dc7-5d09-443c-8983-0430499966d1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:16.878142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3cc329c3-cea6-4541-88c4-38f47ee75b6f req-93593dc7-5d09-443c-8983-0430499966d1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:16.902878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ed8e4eb0-f111-47c5-9df2-d8919c4586b6 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:16.907740 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-3cc329c3-cea6-4541-88c4-38f47ee75b6f req-93593dc7-5d09-443c-8983-0430499966d1 service nova] Creating event network-vif-plugged:38c74c93-daa8-4431-99a7-a03e4c6e546f for instance ad668734-0c34-4d75-b667-0f69f3515d84 on n-h1-861111-1 Oct 12 22:02:16.915411 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ed8e4eb0-f111-47c5-9df2-d8919c4586b6 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1318 microversion: 2.1 time: 0.530021 Oct 12 22:02:16.918210 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-3cc329c3-cea6-4541-88c4-38f47ee75b6f req-93593dc7-5d09-443c-8983-0430499966d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081187 Oct 12 22:02:16.918994 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 356/772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:16 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1318 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:16.921807 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 417/773] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:16.931422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6fa82cf4-56ed-4693-9738-46be017221a1 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:16.936668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6fa82cf4-56ed-4693-9738-46be017221a1 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:16.959696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fa82cf4-56ed-4693-9738-46be017221a1 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:16.966728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fa82cf4-56ed-4693-9738-46be017221a1 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:16.968624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fa82cf4-56ed-4693-9738-46be017221a1 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:16.969538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fa82cf4-56ed-4693-9738-46be017221a1 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:16.972441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fa82cf4-56ed-4693-9738-46be017221a1 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:16.973085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fa82cf4-56ed-4693-9738-46be017221a1 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:17.079101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fd3ecb60-e6db-4775-88bf-1097b785f611 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:17.079569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fa82cf4-56ed-4693-9738-46be017221a1 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:17.080175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fa82cf4-56ed-4693-9738-46be017221a1 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:17.081032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fd3ecb60-e6db-4775-88bf-1097b785f611 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:17.081263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fa82cf4-56ed-4693-9738-46be017221a1 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:17.085267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-6fa82cf4-56ed-4693-9738-46be017221a1 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lazy-loading 'fault' on Instance uuid 37440ed5-600e-4a41-80ce-a48643705219 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:02:17.096285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3ecb60-e6db-4775-88bf-1097b785f611 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:17.096819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3ecb60-e6db-4775-88bf-1097b785f611 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:17.097219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3ecb60-e6db-4775-88bf-1097b785f611 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:17.102659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3ecb60-e6db-4775-88bf-1097b785f611 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:17.104815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3ecb60-e6db-4775-88bf-1097b785f611 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:17.105270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3ecb60-e6db-4775-88bf-1097b785f611 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:17.185363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6fa82cf4-56ed-4693-9738-46be017221a1 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827d63bf6f35482691c64842c594e753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feebe9edaa9c4104843143736f570e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:17.200324 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6fa82cf4-56ed-4693-9738-46be017221a1 tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219" status: 200 len: 1309 microversion: 2.1 time: 0.279489 Oct 12 22:02:17.202179 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 357/774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:16 2022] GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219 => generated 1309 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:17.208978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-62a8da15-4d46-4c82-b0c0-41c5b9472160 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512862d820>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:17.295180 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-62a8da15-4d46-4c82-b0c0-41c5b9472160 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.091490 Oct 12 22:02:17.296873 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 358/775] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:17 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:17.579850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fd3ecb60-e6db-4775-88bf-1097b785f611 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:17.592280 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fd3ecb60-e6db-4775-88bf-1097b785f611 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1313 microversion: 2.1 time: 0.519108 Oct 12 22:02:17.595363 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 418/776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:17 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:17.778001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9fe485fb-2467-48d3-9f63-6dcdbb4204b1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:17.778864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9fe485fb-2467-48d3-9f63-6dcdbb4204b1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:17.810702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fe485fb-2467-48d3-9f63-6dcdbb4204b1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:17.811476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fe485fb-2467-48d3-9f63-6dcdbb4204b1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:17.813491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fe485fb-2467-48d3-9f63-6dcdbb4204b1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:17.818448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fe485fb-2467-48d3-9f63-6dcdbb4204b1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:17.819015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fe485fb-2467-48d3-9f63-6dcdbb4204b1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:17.819961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fe485fb-2467-48d3-9f63-6dcdbb4204b1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:17.942541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6c43b984-f6eb-45db-8f97-e6f23bacfbd0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:17.943158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6c43b984-f6eb-45db-8f97-e6f23bacfbd0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:17.962911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c43b984-f6eb-45db-8f97-e6f23bacfbd0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:17.962911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c43b984-f6eb-45db-8f97-e6f23bacfbd0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:17.962911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c43b984-f6eb-45db-8f97-e6f23bacfbd0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:17.962911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c43b984-f6eb-45db-8f97-e6f23bacfbd0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:17.963452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c43b984-f6eb-45db-8f97-e6f23bacfbd0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:17.963452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c43b984-f6eb-45db-8f97-e6f23bacfbd0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:18.199745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6c43b984-f6eb-45db-8f97-e6f23bacfbd0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:18.212729 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6c43b984-f6eb-45db-8f97-e6f23bacfbd0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1318 microversion: 2.1 time: 0.274271 Oct 12 22:02:18.213319 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 419/777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:17 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:18.226060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-19a3ecfb-edee-460d-84b3-1cf7ad8fdf4a tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:18.226678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-19a3ecfb-edee-460d-84b3-1cf7ad8fdf4a tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] [instance: 37440ed5-600e-4a41-80ce-a48643705219] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:18.241106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19a3ecfb-edee-460d-84b3-1cf7ad8fdf4a tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:18.241611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19a3ecfb-edee-460d-84b3-1cf7ad8fdf4a tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:18.242059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19a3ecfb-edee-460d-84b3-1cf7ad8fdf4a tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:18.242776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19a3ecfb-edee-460d-84b3-1cf7ad8fdf4a tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:18.244748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19a3ecfb-edee-460d-84b3-1cf7ad8fdf4a tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:18.246147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19a3ecfb-edee-460d-84b3-1cf7ad8fdf4a tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:18.279444 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-19a3ecfb-edee-460d-84b3-1cf7ad8fdf4a tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] HTTP exception thrown: Instance 37440ed5-600e-4a41-80ce-a48643705219 could not be found. Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-19a3ecfb-edee-460d-84b3-1cf7ad8fdf4a tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Request method failure captured: Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219 HTTP/1.1 Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzkou8gqLZm8zfPIdNSZ4KzU1MJGoBDqyhI33Q70F9biFuUZpJABafD7TnHZmLYwanRZVFKx9W8u4rOA1R_1O751UFMrq6ggbK3k0HjYT4m1oQTrOu0p8mEPNv0WhrWO1FHy79XAqBSM15miylKCWrSMgQiCTyVQcx-j5j4X5nxqhPk Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: feebe9edaa9c4104843143736f570e02 Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-LiveMigrationNegativeTest-1353154551 Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:02:18.286262 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:02:18.287872 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feebe9edaa9c4104843143736f570e02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feebe9edaa9c4104843143736f570e02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_feebe9edaa9c4104843143736f570e02", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/feebe9edaa9c4104843143736f570e02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:02:18.287872 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-LiveMigrationNegativeTest-1353154551 Oct 12 22:02:18.287872 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: feebe9edaa9c4104843143736f570e02 Oct 12 22:02:18.287872 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1353154551 Oct 12 22:02:18.287872 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-LiveMigrationNegativeTest-1353154551-project Oct 12 22:02:18.287872 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:02:18.287872 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:02:18.287872 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 827d63bf6f35482691c64842c594e753 Oct 12 22:02:18.287872 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-LiveMigrationNegativeTest-1353154551-project Oct 12 22:02:18.287872 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:02:18.287872 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 37440ed5-600e-4a41-80ce-a48643705219 could not be found. Oct 12 22:02:18.287872 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '37440ed5-600e-4a41-80ce-a48643705219'} Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37440ed5-600e-4a41-80ce-a48643705219 could not be found. Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:02:18.288636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37440ed5-600e-4a41-80ce-a48643705219 could not be found. Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37440ed5-600e-4a41-80ce-a48643705219 could not be found. Oct 12 22:02:18.289869 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:18.295069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-19a3ecfb-edee-460d-84b3-1cf7ad8fdf4a tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] Returning 404 to user: Instance 37440ed5-600e-4a41-80ce-a48643705219 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:02:18.296111 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-19a3ecfb-edee-460d-84b3-1cf7ad8fdf4a tempest-LiveMigrationNegativeTest-1353154551 tempest-LiveMigrationNegativeTest-1353154551-project] 10.222.0.16 "GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219" status: 404 len: 111 microversion: 2.1 time: 0.074172 Oct 12 22:02:18.298447 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 420/778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:18 2022] GET /compute/v2.1/servers/37440ed5-600e-4a41-80ce-a48643705219 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:02:18.312111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7bc0e27a-4666-40a8-a2b4-8e20f648eb0d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51284f8c10>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:18.407853 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7bc0e27a-4666-40a8-a2b4-8e20f648eb0d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.100174 Oct 12 22:02:18.420330 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 421/779] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:18 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:18.622113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-69710404-7ff6-4f41-93c4-d642ce8a2b80 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:18.623348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-69710404-7ff6-4f41-93c4-d642ce8a2b80 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:18.636360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69710404-7ff6-4f41-93c4-d642ce8a2b80 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:18.637206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69710404-7ff6-4f41-93c4-d642ce8a2b80 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:18.637876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69710404-7ff6-4f41-93c4-d642ce8a2b80 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:18.638823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69710404-7ff6-4f41-93c4-d642ce8a2b80 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:18.639530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69710404-7ff6-4f41-93c4-d642ce8a2b80 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:18.640708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69710404-7ff6-4f41-93c4-d642ce8a2b80 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:18.693451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9fe485fb-2467-48d3-9f63-6dcdbb4204b1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:18.705634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9fe485fb-2467-48d3-9f63-6dcdbb4204b1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:18.725915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9fe485fb-2467-48d3-9f63-6dcdbb4204b1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:18.727362 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9fe485fb-2467-48d3-9f63-6dcdbb4204b1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1558 microversion: 2.25 time: 0.956203 Oct 12 22:02:18.733013 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 359/780] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:17 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1558 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:18.759364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8588e7d3-de0e-478d-83b3-54239c6b1e9a tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '.version_select at 0x7f512864daf0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:18.763197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8588e7d3-de0e-478d-83b3-54239c6b1e9a tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:18.771165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8588e7d3-de0e-478d-83b3-54239c6b1e9a tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:18.772875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8588e7d3-de0e-478d-83b3-54239c6b1e9a tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:18.851173 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8588e7d3-de0e-478d-83b3-54239c6b1e9a tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.093090 Oct 12 22:02:18.856178 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 360/781] 10.222.0.16 () {60 vars in 1184 bytes} [Wed Oct 12 22:02:18 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:18.869611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0ef4c003-1c4b-45f9-9678-39fd47442ef8 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:18.875174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0ef4c003-1c4b-45f9-9678-39fd47442ef8 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:18.898680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ef4c003-1c4b-45f9-9678-39fd47442ef8 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:18.901580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ef4c003-1c4b-45f9-9678-39fd47442ef8 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:18.902230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ef4c003-1c4b-45f9-9678-39fd47442ef8 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:18.907922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ef4c003-1c4b-45f9-9678-39fd47442ef8 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:18.910341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ef4c003-1c4b-45f9-9678-39fd47442ef8 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:18.911040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ef4c003-1c4b-45f9-9678-39fd47442ef8 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:19.194778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-69710404-7ff6-4f41-93c4-d642ce8a2b80 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:19.207273 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-69710404-7ff6-4f41-93c4-d642ce8a2b80 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1313 microversion: 2.1 time: 0.588982 Oct 12 22:02:19.211976 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 422/782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:18 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1313 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:19.227090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-0ef4c003-1c4b-45f9-9678-39fd47442ef8 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'services' on Instance uuid 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:02:19.228061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-fdf123a4-b4e7-4648-8a29-16c20d995bf0 req-5eeed569-776f-4da9-b195-33636eea34e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e1ad2a-6b26-4501-af12-49ad23802b5f", "name": "network-vif-plugged", "status": "completed", "tag": "e6ed5eb0-d436-4efd-8560-3606d22e1b6e"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:19.243859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fdf123a4-b4e7-4648-8a29-16c20d995bf0 req-5eeed569-776f-4da9-b195-33636eea34e4 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:19.244351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fdf123a4-b4e7-4648-8a29-16c20d995bf0 req-5eeed569-776f-4da9-b195-33636eea34e4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:19.244787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fdf123a4-b4e7-4648-8a29-16c20d995bf0 req-5eeed569-776f-4da9-b195-33636eea34e4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:19.283983 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-fdf123a4-b4e7-4648-8a29-16c20d995bf0 req-5eeed569-776f-4da9-b195-33636eea34e4 service nova] Creating event network-vif-plugged:e6ed5eb0-d436-4efd-8560-3606d22e1b6e for instance 18e1ad2a-6b26-4501-af12-49ad23802b5f on n-h2-861111-1 Oct 12 22:02:19.308148 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-fdf123a4-b4e7-4648-8a29-16c20d995bf0 req-5eeed569-776f-4da9-b195-33636eea34e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094331 Oct 12 22:02:19.309321 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 423/783] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:19.329508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9cc855d1-7aa5-400f-aad9-5343f8b252b4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:19.330269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9cc855d1-7aa5-400f-aad9-5343f8b252b4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:19.352937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cc855d1-7aa5-400f-aad9-5343f8b252b4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:19.353438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cc855d1-7aa5-400f-aad9-5343f8b252b4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:19.353878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cc855d1-7aa5-400f-aad9-5343f8b252b4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:19.362926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cc855d1-7aa5-400f-aad9-5343f8b252b4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:19.363889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cc855d1-7aa5-400f-aad9-5343f8b252b4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:19.367153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cc855d1-7aa5-400f-aad9-5343f8b252b4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:19.415553 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0ef4c003-1c4b-45f9-9678-39fd47442ef8 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 2051 microversion: 2.25 time: 0.549843 Oct 12 22:02:19.429666 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 361/784] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:18 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 2051 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:02:19.442275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e1c81447-4d6f-49c1-8e7b-1837b9da7334 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51286d48b0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:19.595491 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e1c81447-4d6f-49c1-8e7b-1837b9da7334 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.157967 Oct 12 22:02:19.596341 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 362/785] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:19 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:19.675821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-915677011", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "a1135d57-c7e8-447f-a856-6e68b955e716"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:19.830756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] validate_networks() for [('a1135d57-c7e8-447f-a856-6e68b955e716', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:02:19.835916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9cc855d1-7aa5-400f-aad9-5343f8b252b4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:19.855006 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9cc855d1-7aa5-400f-aad9-5343f8b252b4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1318 microversion: 2.1 time: 0.542680 Oct 12 22:02:19.855006 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 424/786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:19 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:20.238480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2f5ee1a8-abec-40d9-8a98-c2d4e8dd0814 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:20.251915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2f5ee1a8-abec-40d9-8a98-c2d4e8dd0814 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:20.287127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f5ee1a8-abec-40d9-8a98-c2d4e8dd0814 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:20.296411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f5ee1a8-abec-40d9-8a98-c2d4e8dd0814 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:20.298725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f5ee1a8-abec-40d9-8a98-c2d4e8dd0814 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:20.299663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f5ee1a8-abec-40d9-8a98-c2d4e8dd0814 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:20.303488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f5ee1a8-abec-40d9-8a98-c2d4e8dd0814 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:20.304241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f5ee1a8-abec-40d9-8a98-c2d4e8dd0814 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:20.537013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:02:20.537437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:02:20.537911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:02:20.538442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:02:20.538878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:02:20.564245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:20.565102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:20.565702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:20.566741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:20.567726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:20.568661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:20.620662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Getting quotas for project beef77813aa641769eb3151b41b8e0cf. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:02:20.637390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Getting quotas for user 1c8822d55876445d91f5681781313ce9 and project beef77813aa641769eb3151b41b8e0cf. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:02:20.667989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2f5ee1a8-abec-40d9-8a98-c2d4e8dd0814 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:20.672930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:02:20.678364 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2f5ee1a8-abec-40d9-8a98-c2d4e8dd0814 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1313 microversion: 2.1 time: 0.444534 Oct 12 22:02:20.678950 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 425/787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:20 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:20.679314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:02:20.689070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-45cb8aca-aed4-4e7d-97a6-b884e518730e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51285a2820>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:20.807335 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-45cb8aca-aed4-4e7d-97a6-b884e518730e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.125588 Oct 12 22:02:20.807904 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 426/788] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:20 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:20.833042 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f7fc1469-12b9-4191-ba12-27085616bf39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.161928 Oct 12 22:02:20.838199 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 363/789] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 22:02:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:02:20.861986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2e312520-08ca-4233-bc21-9ad6a573fd73 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:20.863671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2e312520-08ca-4233-bc21-9ad6a573fd73 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:20.878311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-97bb2cba-fcd7-46db-818f-390aa81e6e5c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:20.879347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-97bb2cba-fcd7-46db-818f-390aa81e6e5c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:20.913987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:20.914779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97bb2cba-fcd7-46db-818f-390aa81e6e5c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:20.919193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97bb2cba-fcd7-46db-818f-390aa81e6e5c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:20.922200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97bb2cba-fcd7-46db-818f-390aa81e6e5c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:20.923572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97bb2cba-fcd7-46db-818f-390aa81e6e5c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:20.926114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97bb2cba-fcd7-46db-818f-390aa81e6e5c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:20.930633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97bb2cba-fcd7-46db-818f-390aa81e6e5c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:21.056408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2e312520-08ca-4233-bc21-9ad6a573fd73 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:21.070101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2e312520-08ca-4233-bc21-9ad6a573fd73 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:21.075542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2e312520-08ca-4233-bc21-9ad6a573fd73 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:21.076716 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2e312520-08ca-4233-bc21-9ad6a573fd73 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1261 microversion: 2.25 time: 0.231658 Oct 12 22:02:21.088954 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 427/790] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:20 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1261 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:21.217694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-97bb2cba-fcd7-46db-818f-390aa81e6e5c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:21.242789 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-97bb2cba-fcd7-46db-818f-390aa81e6e5c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1318 microversion: 2.1 time: 0.354694 Oct 12 22:02:21.251620 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 364/791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:20 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:21.341617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-118ccf94-ffa6-4eef-ba9f-2950a63d1c10 req-fd372d04-84fb-4fa0-a56d-f1576846df4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a5599b6-e17a-41b1-80a1-a43e278b013b", "name": "network-vif-plugged", "status": "completed", "tag": "9b742b79-f5ca-4dd2-a2dd-1e98ca78fe8d"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:21.381079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-118ccf94-ffa6-4eef-ba9f-2950a63d1c10 req-fd372d04-84fb-4fa0-a56d-f1576846df4e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:21.381585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-118ccf94-ffa6-4eef-ba9f-2950a63d1c10 req-fd372d04-84fb-4fa0-a56d-f1576846df4e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:21.382023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-118ccf94-ffa6-4eef-ba9f-2950a63d1c10 req-fd372d04-84fb-4fa0-a56d-f1576846df4e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:21.410923 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-118ccf94-ffa6-4eef-ba9f-2950a63d1c10 req-fd372d04-84fb-4fa0-a56d-f1576846df4e service nova] Creating event network-vif-plugged:9b742b79-f5ca-4dd2-a2dd-1e98ca78fe8d for instance 5a5599b6-e17a-41b1-80a1-a43e278b013b on n-h1-861111-1 Oct 12 22:02:21.426565 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-118ccf94-ffa6-4eef-ba9f-2950a63d1c10 req-fd372d04-84fb-4fa0-a56d-f1576846df4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090011 Oct 12 22:02:21.427422 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 428/792] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:21.704145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3c41f19c-3e72-46d6-94bd-2cd0737cecf4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:21.704992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3c41f19c-3e72-46d6-94bd-2cd0737cecf4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:21.715950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c41f19c-3e72-46d6-94bd-2cd0737cecf4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:21.716654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c41f19c-3e72-46d6-94bd-2cd0737cecf4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:21.718170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c41f19c-3e72-46d6-94bd-2cd0737cecf4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:21.721239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c41f19c-3e72-46d6-94bd-2cd0737cecf4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:21.722007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c41f19c-3e72-46d6-94bd-2cd0737cecf4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:21.724258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c41f19c-3e72-46d6-94bd-2cd0737cecf4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:21.825754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1df83e69-5b5d-49ce-83d5-f7a41d972893 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128450c10>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:21.903459 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1df83e69-5b5d-49ce-83d5-f7a41d972893 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.081753 Oct 12 22:02:21.909440 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 429/793] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:21 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:22.103560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-74b3bdc5-4cfa-46aa-862d-7bee02366126 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:22.104312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-74b3bdc5-4cfa-46aa-862d-7bee02366126 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:22.126208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74b3bdc5-4cfa-46aa-862d-7bee02366126 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:22.126749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74b3bdc5-4cfa-46aa-862d-7bee02366126 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:22.127185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74b3bdc5-4cfa-46aa-862d-7bee02366126 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:22.129393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74b3bdc5-4cfa-46aa-862d-7bee02366126 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:22.129393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74b3bdc5-4cfa-46aa-862d-7bee02366126 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:22.129393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74b3bdc5-4cfa-46aa-862d-7bee02366126 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:22.174297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3c41f19c-3e72-46d6-94bd-2cd0737cecf4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:22.191785 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3c41f19c-3e72-46d6-94bd-2cd0737cecf4 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1313 microversion: 2.1 time: 0.492282 Oct 12 22:02:22.193360 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 365/794] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:21 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:22.281625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-22248c5a-4a6d-4314-9dbe-82c8ed57e06a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:22.284003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-22248c5a-4a6d-4314-9dbe-82c8ed57e06a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:22.301357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22248c5a-4a6d-4314-9dbe-82c8ed57e06a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:22.303725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22248c5a-4a6d-4314-9dbe-82c8ed57e06a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:22.307114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22248c5a-4a6d-4314-9dbe-82c8ed57e06a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:22.313246 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22248c5a-4a6d-4314-9dbe-82c8ed57e06a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:22.314113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22248c5a-4a6d-4314-9dbe-82c8ed57e06a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:22.314797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22248c5a-4a6d-4314-9dbe-82c8ed57e06a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:22.382431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-74b3bdc5-4cfa-46aa-862d-7bee02366126 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:22.406678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-74b3bdc5-4cfa-46aa-862d-7bee02366126 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:22.411182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-74b3bdc5-4cfa-46aa-862d-7bee02366126 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:22.412729 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-74b3bdc5-4cfa-46aa-862d-7bee02366126 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1265 microversion: 2.25 time: 0.313667 Oct 12 22:02:22.431748 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 430/795] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:22 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1265 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:22.567593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-22248c5a-4a6d-4314-9dbe-82c8ed57e06a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:22.591449 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-22248c5a-4a6d-4314-9dbe-82c8ed57e06a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1467 microversion: 2.1 time: 0.316735 Oct 12 22:02:22.594371 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 366/796] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:22 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1467 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:22.619918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-da025601-4382-4767-aa9f-803fd3b01571 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:22.620793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-da025601-4382-4767-aa9f-803fd3b01571 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: cf71b2a6-484b-4e05-80fb-89be6b98546a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:22.630954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da025601-4382-4767-aa9f-803fd3b01571 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:22.633468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da025601-4382-4767-aa9f-803fd3b01571 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:22.636639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da025601-4382-4767-aa9f-803fd3b01571 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:22.637606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da025601-4382-4767-aa9f-803fd3b01571 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:22.638267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da025601-4382-4767-aa9f-803fd3b01571 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:22.638867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da025601-4382-4767-aa9f-803fd3b01571 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:22.924920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-97d86c8e-0421-44fc-96e9-569b7bf001f6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512865c040>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:22.994453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-da025601-4382-4767-aa9f-803fd3b01571 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:23.005636 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-da025601-4382-4767-aa9f-803fd3b01571 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a" status: 200 len: 1467 microversion: 2.1 time: 0.390151 Oct 12 22:02:23.012019 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 431/797] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:22 2022] GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a => generated 1467 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:23.036461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eea41929-eabb-4dba-939e-5fcccdd2a710 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1351456419"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:23.037951 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-97d86c8e-0421-44fc-96e9-569b7bf001f6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.117710 Oct 12 22:02:23.039204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eea41929-eabb-4dba-939e-5fcccdd2a710 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: cf71b2a6-484b-4e05-80fb-89be6b98546a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:23.039428 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 367/798] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:22 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:23.059371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eea41929-eabb-4dba-939e-5fcccdd2a710 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:23.060051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eea41929-eabb-4dba-939e-5fcccdd2a710 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:23.060664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eea41929-eabb-4dba-939e-5fcccdd2a710 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:23.061548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eea41929-eabb-4dba-939e-5fcccdd2a710 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:23.062157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eea41929-eabb-4dba-939e-5fcccdd2a710 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:23.065656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eea41929-eabb-4dba-939e-5fcccdd2a710 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:23.244023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f7fc0092-e56f-4b1d-99c2-40ff9c47ef03 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:23.246886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f7fc0092-e56f-4b1d-99c2-40ff9c47ef03 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:23.277004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7fc0092-e56f-4b1d-99c2-40ff9c47ef03 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:23.277700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7fc0092-e56f-4b1d-99c2-40ff9c47ef03 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:23.278962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7fc0092-e56f-4b1d-99c2-40ff9c47ef03 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:23.282011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7fc0092-e56f-4b1d-99c2-40ff9c47ef03 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:23.285567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7fc0092-e56f-4b1d-99c2-40ff9c47ef03 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:23.287399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7fc0092-e56f-4b1d-99c2-40ff9c47ef03 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:23.352935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:23.423724 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eea41929-eabb-4dba-939e-5fcccdd2a710 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "POST /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a/action" status: 202 len: 0 microversion: 2.1 time: 0.376882 Oct 12 22:02:23.430140 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 432/799] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:02:23 2022] POST /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:02:23.460315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cad675c0-f36b-4948-84df-1ad3b92228c1 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51285a2c10>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:23.558043 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cad675c0-f36b-4948-84df-1ad3b92228c1 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1453 microversion: 2.1 time: 0.123246 Oct 12 22:02:23.559577 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 433/800] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:23 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:23.570254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9fb385b2-a71f-4718-82eb-2d3f5f56c07e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:23.585267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9fb385b2-a71f-4718-82eb-2d3f5f56c07e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:23.602599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9fb385b2-a71f-4718-82eb-2d3f5f56c07e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:23.605736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9fb385b2-a71f-4718-82eb-2d3f5f56c07e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:23.606554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9fb385b2-a71f-4718-82eb-2d3f5f56c07e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:23.608945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9fb385b2-a71f-4718-82eb-2d3f5f56c07e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:23.609644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9fb385b2-a71f-4718-82eb-2d3f5f56c07e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:23.610870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9fb385b2-a71f-4718-82eb-2d3f5f56c07e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:23.705581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f7fc0092-e56f-4b1d-99c2-40ff9c47ef03 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:23.713621 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f7fc0092-e56f-4b1d-99c2-40ff9c47ef03 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1499 microversion: 2.1 time: 0.473814 Oct 12 22:02:23.726211 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 368/801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:23 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1499 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:23.770868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f114ccb8-3143-47cc-b2a1-9608fab3ebf2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:23.775955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f114ccb8-3143-47cc-b2a1-9608fab3ebf2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:23.789518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f114ccb8-3143-47cc-b2a1-9608fab3ebf2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:23.790762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f114ccb8-3143-47cc-b2a1-9608fab3ebf2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:23.791467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f114ccb8-3143-47cc-b2a1-9608fab3ebf2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:23.792693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f114ccb8-3143-47cc-b2a1-9608fab3ebf2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:23.793510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f114ccb8-3143-47cc-b2a1-9608fab3ebf2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:23.794209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f114ccb8-3143-47cc-b2a1-9608fab3ebf2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:23.833376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-f114ccb8-3143-47cc-b2a1-9608fab3ebf2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lazy-loading 'flavor' on Instance uuid 5a5599b6-e17a-41b1-80a1-a43e278b013b {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:02:23.906330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9fb385b2-a71f-4718-82eb-2d3f5f56c07e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:23.926461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9fb385b2-a71f-4718-82eb-2d3f5f56c07e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:23.946094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9fb385b2-a71f-4718-82eb-2d3f5f56c07e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:23.947441 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9fb385b2-a71f-4718-82eb-2d3f5f56c07e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1313 microversion: 2.25 time: 0.382081 Oct 12 22:02:23.959360 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 434/802] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:23 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:24.049283 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f114ccb8-3143-47cc-b2a1-9608fab3ebf2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "POST /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b/action" status: 200 len: 32 microversion: 2.1 time: 0.311031 Oct 12 22:02:24.052648 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 369/803] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:02:23 2022] POST /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b/action => generated 32 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:02:24.058558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eb4f91a6-ccec-49bd-a361-80953ba6b865 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51285bbf70>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:24.109623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7c6b317b-0498-4920-b3c5-0ae0d681ac3a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:24.118098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7c6b317b-0498-4920-b3c5-0ae0d681ac3a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:24.169493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6b317b-0498-4920-b3c5-0ae0d681ac3a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:24.176378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6b317b-0498-4920-b3c5-0ae0d681ac3a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:24.181726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6b317b-0498-4920-b3c5-0ae0d681ac3a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:24.183104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6b317b-0498-4920-b3c5-0ae0d681ac3a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:24.188927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6b317b-0498-4920-b3c5-0ae0d681ac3a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:24.189383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6b317b-0498-4920-b3c5-0ae0d681ac3a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:24.218586 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eb4f91a6-ccec-49bd-a361-80953ba6b865 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.163492 Oct 12 22:02:24.219329 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 435/804] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:24 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:24.586170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d03a2a78-20d3-41f0-a4dc-a579a769558d tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512848e670>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:24.623392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7c6b317b-0498-4920-b3c5-0ae0d681ac3a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:24.680190 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7c6b317b-0498-4920-b3c5-0ae0d681ac3a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.607386 Oct 12 22:02:24.685202 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 370/805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:24 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:24.741934 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d03a2a78-20d3-41f0-a4dc-a579a769558d tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1453 microversion: 2.1 time: 0.165642 Oct 12 22:02:24.744866 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 436/806] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:24 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:24.980853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aceb28a3-069f-4a9f-ae63-a67726d4fd75 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:24.981470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-aceb28a3-069f-4a9f-ae63-a67726d4fd75 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:24.996984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aceb28a3-069f-4a9f-ae63-a67726d4fd75 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:24.997502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aceb28a3-069f-4a9f-ae63-a67726d4fd75 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:24.997946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aceb28a3-069f-4a9f-ae63-a67726d4fd75 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:24.998672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aceb28a3-069f-4a9f-ae63-a67726d4fd75 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:24.999133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aceb28a3-069f-4a9f-ae63-a67726d4fd75 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:24.999618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aceb28a3-069f-4a9f-ae63-a67726d4fd75 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:25.018073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:25.454431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1109535325", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:25.575674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] validate_networks() for None {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:02:25.601257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-aceb28a3-069f-4a9f-ae63-a67726d4fd75 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:25.617696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-aceb28a3-069f-4a9f-ae63-a67726d4fd75 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:25.621631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-aceb28a3-069f-4a9f-ae63-a67726d4fd75 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:25.623643 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-aceb28a3-069f-4a9f-ae63-a67726d4fd75 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1361 microversion: 2.25 time: 0.646425 Oct 12 22:02:25.642611 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 371/807] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:24 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1361 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:25.667699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-073ce2cd-b7ae-4a4c-8f79-11549b34ab83 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51287fcdc0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:25.744538 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-073ce2cd-b7ae-4a4c-8f79-11549b34ab83 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.100696 Oct 12 22:02:25.745940 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 372/808] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:25 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:25.762124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0af2f48f-aa55-4248-b895-5cccdd8051ec tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:25.772832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0af2f48f-aa55-4248-b895-5cccdd8051ec tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:25.792811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0af2f48f-aa55-4248-b895-5cccdd8051ec tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:25.793482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0af2f48f-aa55-4248-b895-5cccdd8051ec tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:25.795967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0af2f48f-aa55-4248-b895-5cccdd8051ec tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:25.796947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0af2f48f-aa55-4248-b895-5cccdd8051ec tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:25.797565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0af2f48f-aa55-4248-b895-5cccdd8051ec tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:25.803568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0af2f48f-aa55-4248-b895-5cccdd8051ec tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:26.183889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0af2f48f-aa55-4248-b895-5cccdd8051ec tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:26.198437 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0af2f48f-aa55-4248-b895-5cccdd8051ec tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.452267 Oct 12 22:02:26.199634 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 373/809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:25 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:26.218149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-201c2084-dec6-4dd4-b1f3-2ccf6c1d1dec tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51285ae280>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:26.291168 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-201c2084-dec6-4dd4-b1f3-2ccf6c1d1dec tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1453 microversion: 2.1 time: 0.089884 Oct 12 22:02:26.293067 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 374/810] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:26 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:26.492961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:02:26.494000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:02:26.494767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:02:26.495215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:02:26.495630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:02:26.511384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:26.511857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:26.512569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:26.515989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:26.523382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:26.524109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:26.553927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Getting quotas for project 7d943f8c0c934001b53032564fd00e11. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:02:26.559944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Getting quotas for user cfc7df27bf6f456581abff6e80ab4f64 and project 7d943f8c0c934001b53032564fd00e11. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:02:26.574773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:02:26.578987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:02:26.661458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1763f2b5-e48a-409d-b926-08de5d89d480 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:26.662073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1763f2b5-e48a-409d-b926-08de5d89d480 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:26.670839 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d9851435-51f2-4b94-bcb7-3b6fba97e64c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.552424 Oct 12 22:02:26.682115 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 437/811] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:02:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:02:26.685540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1763f2b5-e48a-409d-b926-08de5d89d480 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:26.689516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1763f2b5-e48a-409d-b926-08de5d89d480 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:26.698080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1763f2b5-e48a-409d-b926-08de5d89d480 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:26.705398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1763f2b5-e48a-409d-b926-08de5d89d480 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:26.706063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1763f2b5-e48a-409d-b926-08de5d89d480 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:26.712533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1763f2b5-e48a-409d-b926-08de5d89d480 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:26.722790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-80c6d8fb-08d8-46f3-b0a3-64f4a2785601 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:26.725721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-80c6d8fb-08d8-46f3-b0a3-64f4a2785601 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:26.898153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-80c6d8fb-08d8-46f3-b0a3-64f4a2785601 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:26.912244 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-80c6d8fb-08d8-46f3-b0a3-64f4a2785601 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1213 microversion: 2.1 time: 0.227775 Oct 12 22:02:26.913826 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 438/812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:26 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1213 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:26.920003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-44996804-f58f-42fc-b47c-f4eafb1d32e2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51285c2280>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:27.016755 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-44996804-f58f-42fc-b47c-f4eafb1d32e2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.097852 Oct 12 22:02:27.017942 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 439/813] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:26 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:27.033870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-9b8aeca1-91e0-4d1d-a701-fef53546227d req-2811cad6-7808-4a44-bbdb-1e7ea2b6ad4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e615f0-f403-426c-a0c9-73cc9b810d10", "tag": "38be05fb-8b40-41e5-b46a-fd8537f3988f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:27.069464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9b8aeca1-91e0-4d1d-a701-fef53546227d req-2811cad6-7808-4a44-bbdb-1e7ea2b6ad4d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:27.070296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9b8aeca1-91e0-4d1d-a701-fef53546227d req-2811cad6-7808-4a44-bbdb-1e7ea2b6ad4d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:27.071028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9b8aeca1-91e0-4d1d-a701-fef53546227d req-2811cad6-7808-4a44-bbdb-1e7ea2b6ad4d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:27.099953 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-9b8aeca1-91e0-4d1d-a701-fef53546227d req-2811cad6-7808-4a44-bbdb-1e7ea2b6ad4d service nova] Creating event network-changed:38be05fb-8b40-41e5-b46a-fd8537f3988f for instance e0e615f0-f403-426c-a0c9-73cc9b810d10 on n-h1-861111-1 Oct 12 22:02:27.119471 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-9b8aeca1-91e0-4d1d-a701-fef53546227d req-2811cad6-7808-4a44-bbdb-1e7ea2b6ad4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099988 Oct 12 22:02:27.121203 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 440/814] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:27.225633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ea43c86c-2fe2-4ab4-8069-45e503bfd90f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:27.233148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ea43c86c-2fe2-4ab4-8069-45e503bfd90f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:27.242635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea43c86c-2fe2-4ab4-8069-45e503bfd90f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:27.244361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea43c86c-2fe2-4ab4-8069-45e503bfd90f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:27.247363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea43c86c-2fe2-4ab4-8069-45e503bfd90f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:27.248260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea43c86c-2fe2-4ab4-8069-45e503bfd90f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:27.251706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea43c86c-2fe2-4ab4-8069-45e503bfd90f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:27.252673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea43c86c-2fe2-4ab4-8069-45e503bfd90f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:27.348795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1763f2b5-e48a-409d-b926-08de5d89d480 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:27.362498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1763f2b5-e48a-409d-b926-08de5d89d480 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:27.365315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1763f2b5-e48a-409d-b926-08de5d89d480 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:27.366524 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1763f2b5-e48a-409d-b926-08de5d89d480 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1361 microversion: 2.25 time: 0.710944 Oct 12 22:02:27.369760 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 375/815] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:26 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1361 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:02:27.377081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-278e438e-67c9-48db-8eeb-6a9be107580a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51285aef70>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:27.495573 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-278e438e-67c9-48db-8eeb-6a9be107580a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1453 microversion: 2.1 time: 0.124412 Oct 12 22:02:27.496182 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 376/816] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:27 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:27.525882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ea43c86c-2fe2-4ab4-8069-45e503bfd90f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:27.538450 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ea43c86c-2fe2-4ab4-8069-45e503bfd90f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.320100 Oct 12 22:02:27.539963 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 441/817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:27 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:27.942199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5ff0b037-12ab-49a9-a0f7-9bf1494348c5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:27.944587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5ff0b037-12ab-49a9-a0f7-9bf1494348c5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:27.963842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ff0b037-12ab-49a9-a0f7-9bf1494348c5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:27.964752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ff0b037-12ab-49a9-a0f7-9bf1494348c5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:27.966285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ff0b037-12ab-49a9-a0f7-9bf1494348c5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:27.969477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ff0b037-12ab-49a9-a0f7-9bf1494348c5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:27.970254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ff0b037-12ab-49a9-a0f7-9bf1494348c5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:27.971158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ff0b037-12ab-49a9-a0f7-9bf1494348c5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:28.039176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4ec48d15-a6b5-4944-9676-dc8c7cd2fbd4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128536a60>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:28.103509 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4ec48d15-a6b5-4944-9676-dc8c7cd2fbd4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.073987 Oct 12 22:02:28.104983 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 442/818] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:28 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:28.142804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5ff0b037-12ab-49a9-a0f7-9bf1494348c5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:28.153482 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5ff0b037-12ab-49a9-a0f7-9bf1494348c5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1265 microversion: 2.1 time: 0.221350 Oct 12 22:02:28.154377 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 377/819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:27 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:28.396054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c59d6f10-9731-406c-98f6-b2589a409ec0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:28.396781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c59d6f10-9731-406c-98f6-b2589a409ec0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:28.403764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c59d6f10-9731-406c-98f6-b2589a409ec0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:28.410750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c59d6f10-9731-406c-98f6-b2589a409ec0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:28.411478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c59d6f10-9731-406c-98f6-b2589a409ec0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:28.412218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c59d6f10-9731-406c-98f6-b2589a409ec0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:28.420996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c59d6f10-9731-406c-98f6-b2589a409ec0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:28.421683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c59d6f10-9731-406c-98f6-b2589a409ec0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:28.512195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0be94982-2c20-4a48-a761-58a5bb1bfc61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512875c160>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:28.571113 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0be94982-2c20-4a48-a761-58a5bb1bfc61 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1453 microversion: 2.1 time: 0.062768 Oct 12 22:02:28.572923 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 378/820] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:28 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1453 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:28.578208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c661bc07-a805-46c4-8cb5-681ced185d2e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:28.578966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c661bc07-a805-46c4-8cb5-681ced185d2e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:28.585547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c661bc07-a805-46c4-8cb5-681ced185d2e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:28.586443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c661bc07-a805-46c4-8cb5-681ced185d2e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:28.587312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c661bc07-a805-46c4-8cb5-681ced185d2e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:28.588228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c661bc07-a805-46c4-8cb5-681ced185d2e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:28.588828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c661bc07-a805-46c4-8cb5-681ced185d2e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:28.589445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c661bc07-a805-46c4-8cb5-681ced185d2e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:28.663023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c59d6f10-9731-406c-98f6-b2589a409ec0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:28.678758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c59d6f10-9731-406c-98f6-b2589a409ec0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:28.680397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c59d6f10-9731-406c-98f6-b2589a409ec0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:28.681564 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c59d6f10-9731-406c-98f6-b2589a409ec0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1361 microversion: 2.25 time: 0.289987 Oct 12 22:02:28.687832 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 443/821] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:28 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1361 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:28.820749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c661bc07-a805-46c4-8cb5-681ced185d2e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:28.847120 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c661bc07-a805-46c4-8cb5-681ced185d2e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.272879 Oct 12 22:02:28.848228 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 379/822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:28 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:29.120423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87e2e6fe-9d9c-4d6b-a3d6-d610b72cc8cb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512848eca0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:29.179806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7827f601-b890-4697-a6a5-12020dddbd05 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:29.180580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7827f601-b890-4697-a6a5-12020dddbd05 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:29.201850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7827f601-b890-4697-a6a5-12020dddbd05 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:29.204448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7827f601-b890-4697-a6a5-12020dddbd05 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:29.207137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7827f601-b890-4697-a6a5-12020dddbd05 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:29.210412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7827f601-b890-4697-a6a5-12020dddbd05 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:29.214687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7827f601-b890-4697-a6a5-12020dddbd05 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:29.216248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7827f601-b890-4697-a6a5-12020dddbd05 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:29.229624 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-87e2e6fe-9d9c-4d6b-a3d6-d610b72cc8cb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.112951 Oct 12 22:02:29.238143 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 444/823] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:29 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:29.425020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7827f601-b890-4697-a6a5-12020dddbd05 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:29.435779 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7827f601-b890-4697-a6a5-12020dddbd05 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1265 microversion: 2.1 time: 0.261765 Oct 12 22:02:29.439630 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 380/824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:29 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:29.593287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c2875017-be53-4001-9f2e-2c269a953cf5 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51285ae3a0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:29.684644 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c2875017-be53-4001-9f2e-2c269a953cf5 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1453 microversion: 2.1 time: 0.101210 Oct 12 22:02:29.685308 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 445/825] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:29 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:29.714024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9f722de6-0d89-423d-b75c-66f82e6ed885 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:29.715066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9f722de6-0d89-423d-b75c-66f82e6ed885 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:29.728103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f722de6-0d89-423d-b75c-66f82e6ed885 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:29.730295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f722de6-0d89-423d-b75c-66f82e6ed885 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:29.731071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f722de6-0d89-423d-b75c-66f82e6ed885 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:29.732910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f722de6-0d89-423d-b75c-66f82e6ed885 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:29.735530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f722de6-0d89-423d-b75c-66f82e6ed885 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:29.736465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f722de6-0d89-423d-b75c-66f82e6ed885 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:29.876338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-07347d21-8efb-4d0f-83f4-eb822f61472f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:29.877287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-07347d21-8efb-4d0f-83f4-eb822f61472f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:29.892796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07347d21-8efb-4d0f-83f4-eb822f61472f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:29.893395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07347d21-8efb-4d0f-83f4-eb822f61472f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:29.893906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07347d21-8efb-4d0f-83f4-eb822f61472f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:29.894604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07347d21-8efb-4d0f-83f4-eb822f61472f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:29.895199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07347d21-8efb-4d0f-83f4-eb822f61472f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:29.899092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07347d21-8efb-4d0f-83f4-eb822f61472f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:30.074321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9f722de6-0d89-423d-b75c-66f82e6ed885 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:30.096680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9f722de6-0d89-423d-b75c-66f82e6ed885 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:30.099978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9f722de6-0d89-423d-b75c-66f82e6ed885 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:30.105245 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9f722de6-0d89-423d-b75c-66f82e6ed885 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1361 microversion: 2.25 time: 0.396137 Oct 12 22:02:30.109764 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 381/826] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:29 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1361 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:30.244640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ff35b55d-3b63-4aa9-b3e6-0560793efd4b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128744280>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:30.301090 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ff35b55d-3b63-4aa9-b3e6-0560793efd4b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.059763 Oct 12 22:02:30.302393 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 382/827] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:30 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:30.464550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-67b5d44e-04b2-4865-b200-3fc97827fec2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:30.465582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-67b5d44e-04b2-4865-b200-3fc97827fec2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:30.476824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67b5d44e-04b2-4865-b200-3fc97827fec2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:30.479706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67b5d44e-04b2-4865-b200-3fc97827fec2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:30.482222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67b5d44e-04b2-4865-b200-3fc97827fec2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:30.483156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67b5d44e-04b2-4865-b200-3fc97827fec2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:30.486464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67b5d44e-04b2-4865-b200-3fc97827fec2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:30.489712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67b5d44e-04b2-4865-b200-3fc97827fec2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:30.540528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-07347d21-8efb-4d0f-83f4-eb822f61472f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:30.554298 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-07347d21-8efb-4d0f-83f4-eb822f61472f tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.683885 Oct 12 22:02:30.580089 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 446/828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:29 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:30.601840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:30.643717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-67b5d44e-04b2-4865-b200-3fc97827fec2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:30.651223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:30.656321 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-67b5d44e-04b2-4865-b200-3fc97827fec2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1271 microversion: 2.1 time: 0.195722 Oct 12 22:02:30.671877 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 383/829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:30 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1271 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:30.701892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-76773172-921f-45e8-b205-b4f86352d118 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51285aea60>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:30.847278 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-76773172-921f-45e8-b205-b4f86352d118 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1453 microversion: 2.1 time: 0.149180 Oct 12 22:02:30.855557 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 447/830] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:30 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:31.139981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-542b3e68-487b-47e1-9bee-691c08036267 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:31.141192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-542b3e68-487b-47e1-9bee-691c08036267 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:31.176569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-542b3e68-487b-47e1-9bee-691c08036267 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:31.182491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-542b3e68-487b-47e1-9bee-691c08036267 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:31.184524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-542b3e68-487b-47e1-9bee-691c08036267 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:31.186362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-542b3e68-487b-47e1-9bee-691c08036267 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:31.190118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-542b3e68-487b-47e1-9bee-691c08036267 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:31.199696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-542b3e68-487b-47e1-9bee-691c08036267 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:31.318718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48e2c2d1-332c-4828-ba6f-71e0012e2d42 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51285e2550>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:31.541030 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-48e2c2d1-332c-4828-ba6f-71e0012e2d42 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1411 microversion: 2.1 time: 0.226745 Oct 12 22:02:31.551048 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 448/831] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:31 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1411 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:31.588085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-00c91af3-e857-444d-8a4e-4586ebb8b2e8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:31.588760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-00c91af3-e857-444d-8a4e-4586ebb8b2e8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:31.596554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00c91af3-e857-444d-8a4e-4586ebb8b2e8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:31.597080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00c91af3-e857-444d-8a4e-4586ebb8b2e8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:31.597523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00c91af3-e857-444d-8a4e-4586ebb8b2e8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:31.598254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00c91af3-e857-444d-8a4e-4586ebb8b2e8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:31.598710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00c91af3-e857-444d-8a4e-4586ebb8b2e8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:31.602954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00c91af3-e857-444d-8a4e-4586ebb8b2e8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:31.648282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-542b3e68-487b-47e1-9bee-691c08036267 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:31.660420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-542b3e68-487b-47e1-9bee-691c08036267 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:31.662970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-542b3e68-487b-47e1-9bee-691c08036267 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:31.665715 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-542b3e68-487b-47e1-9bee-691c08036267 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1361 microversion: 2.25 time: 0.533464 Oct 12 22:02:31.667150 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 384/832] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:31 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1361 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:31.690596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-015fc04c-e0e1-448b-b7b8-bc907becc1d2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:31.693665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-015fc04c-e0e1-448b-b7b8-bc907becc1d2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:31.708266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-015fc04c-e0e1-448b-b7b8-bc907becc1d2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:31.709019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-015fc04c-e0e1-448b-b7b8-bc907becc1d2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:31.709614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-015fc04c-e0e1-448b-b7b8-bc907becc1d2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:31.710499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-015fc04c-e0e1-448b-b7b8-bc907becc1d2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:31.711100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-015fc04c-e0e1-448b-b7b8-bc907becc1d2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:31.713954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-015fc04c-e0e1-448b-b7b8-bc907becc1d2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:31.848116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-015fc04c-e0e1-448b-b7b8-bc907becc1d2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:31.863269 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-015fc04c-e0e1-448b-b7b8-bc907becc1d2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1271 microversion: 2.1 time: 0.183842 Oct 12 22:02:31.875865 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 385/833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:31 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1271 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:31.893182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1d4941b-c43f-495c-912a-2a085eef82ed tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512858f160>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:32.448263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-00c91af3-e857-444d-8a4e-4586ebb8b2e8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:32.465144 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-00c91af3-e857-444d-8a4e-4586ebb8b2e8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.882631 Oct 12 22:02:32.465736 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 449/834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:31 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:32.556960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1952407f-d4bb-4a9d-afa9-d0ada6c3c863 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512860bf70>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:36.544614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:36.911869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=10 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:37.506511 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a1d4941b-c43f-495c-912a-2a085eef82ed tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1453 microversion: 2.1 time: 5.629094 Oct 12 22:02:37.507084 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 386/835] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:31 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1453 bytes in 5630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:37.516077 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1952407f-d4bb-4a9d-afa9-d0ada6c3c863 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1420 microversion: 2.1 time: 4.962809 Oct 12 22:02:37.525953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-5fa4241f-7dbf-496d-9c19-96deae1bb830 req-80901cf6-c2d6-4ce1-95cc-6dd606d4e372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf71b2a6-484b-4e05-80fb-89be6b98546a", "name": "network-vif-plugged", "status": "completed", "tag": "e7a4b681-6708-4e63-905c-13cb884689e3"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:37.528074 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 450/836] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:32 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1420 bytes in 4975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:37.534951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a2ec36d7-1880-4f17-a9ce-e62e6a154f89 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:37.536043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a2ec36d7-1880-4f17-a9ce-e62e6a154f89 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:37.542743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5fa4241f-7dbf-496d-9c19-96deae1bb830 req-80901cf6-c2d6-4ce1-95cc-6dd606d4e372 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:37.544096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5fa4241f-7dbf-496d-9c19-96deae1bb830 req-80901cf6-c2d6-4ce1-95cc-6dd606d4e372 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:37.544779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5fa4241f-7dbf-496d-9c19-96deae1bb830 req-80901cf6-c2d6-4ce1-95cc-6dd606d4e372 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:37.554546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2ec36d7-1880-4f17-a9ce-e62e6a154f89 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:37.555132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2ec36d7-1880-4f17-a9ce-e62e6a154f89 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:37.555523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2ec36d7-1880-4f17-a9ce-e62e6a154f89 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:37.556265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2ec36d7-1880-4f17-a9ce-e62e6a154f89 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:37.557033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2ec36d7-1880-4f17-a9ce-e62e6a154f89 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:37.557477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2ec36d7-1880-4f17-a9ce-e62e6a154f89 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:37.564708 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-5fa4241f-7dbf-496d-9c19-96deae1bb830 req-80901cf6-c2d6-4ce1-95cc-6dd606d4e372 service nova] Creating event network-vif-plugged:e7a4b681-6708-4e63-905c-13cb884689e3 for instance cf71b2a6-484b-4e05-80fb-89be6b98546a on n-h2-861111-1 Oct 12 22:02:37.569860 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-5fa4241f-7dbf-496d-9c19-96deae1bb830 req-80901cf6-c2d6-4ce1-95cc-6dd606d4e372 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058571 Oct 12 22:02:37.570895 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 387/837] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:37.578892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-56b345ff-4d8c-4511-bb6b-72f80dedb4c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:37.579874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-56b345ff-4d8c-4511-bb6b-72f80dedb4c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:37.586067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56b345ff-4d8c-4511-bb6b-72f80dedb4c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:37.586564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56b345ff-4d8c-4511-bb6b-72f80dedb4c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:37.587265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56b345ff-4d8c-4511-bb6b-72f80dedb4c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:37.587991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56b345ff-4d8c-4511-bb6b-72f80dedb4c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:37.589027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56b345ff-4d8c-4511-bb6b-72f80dedb4c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:37.589466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56b345ff-4d8c-4511-bb6b-72f80dedb4c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:37.839572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a2ec36d7-1880-4f17-a9ce-e62e6a154f89 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:37.848933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a2ec36d7-1880-4f17-a9ce-e62e6a154f89 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:37.850455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a2ec36d7-1880-4f17-a9ce-e62e6a154f89 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:37.851627 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a2ec36d7-1880-4f17-a9ce-e62e6a154f89 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1361 microversion: 2.25 time: 0.321111 Oct 12 22:02:37.854039 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 451/838] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:37 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1361 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:37.859206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3540bbd3-f9ce-41ac-83a9-d990664cfe75 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:37.859875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3540bbd3-f9ce-41ac-83a9-d990664cfe75 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:37.869988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-56b345ff-4d8c-4511-bb6b-72f80dedb4c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:37.872499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3540bbd3-f9ce-41ac-83a9-d990664cfe75 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:37.873189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3540bbd3-f9ce-41ac-83a9-d990664cfe75 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:37.873655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3540bbd3-f9ce-41ac-83a9-d990664cfe75 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:37.875055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3540bbd3-f9ce-41ac-83a9-d990664cfe75 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:37.875545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3540bbd3-f9ce-41ac-83a9-d990664cfe75 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:37.875997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3540bbd3-f9ce-41ac-83a9-d990664cfe75 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:37.884815 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-56b345ff-4d8c-4511-bb6b-72f80dedb4c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1313 microversion: 2.1 time: 0.312502 Oct 12 22:02:37.886470 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 388/839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:37 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:37.891799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-23424c59-71c0-4f1a-ae59-82e4a6fb9745 req-136b4da2-5759-4539-825e-4835041dee5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adec1006-780c-4fe7-871a-e4f7addfe159", "tag": "1a376da9-7885-4d84-98d7-e6c54abdca11"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:37.901688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-23424c59-71c0-4f1a-ae59-82e4a6fb9745 req-136b4da2-5759-4539-825e-4835041dee5d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:37.902690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-23424c59-71c0-4f1a-ae59-82e4a6fb9745 req-136b4da2-5759-4539-825e-4835041dee5d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:37.903319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-23424c59-71c0-4f1a-ae59-82e4a6fb9745 req-136b4da2-5759-4539-825e-4835041dee5d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:37.922354 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-23424c59-71c0-4f1a-ae59-82e4a6fb9745 req-136b4da2-5759-4539-825e-4835041dee5d service nova] Creating event network-changed:1a376da9-7885-4d84-98d7-e6c54abdca11 for instance adec1006-780c-4fe7-871a-e4f7addfe159 on n-h1-861111-1 Oct 12 22:02:37.934013 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-23424c59-71c0-4f1a-ae59-82e4a6fb9745 req-136b4da2-5759-4539-825e-4835041dee5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046012 Oct 12 22:02:37.934927 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 389/840] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:37.940590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-78f94b93-74b3-4b8c-8145-882282ac1f68 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128653430>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:38.004869 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-78f94b93-74b3-4b8c-8145-882282ac1f68 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 200 len: 1420 microversion: 2.1 time: 0.067846 Oct 12 22:02:38.005705 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 390/841] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:37 2022] GET /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:38.169859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3540bbd3-f9ce-41ac-83a9-d990664cfe75 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:38.186012 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3540bbd3-f9ce-41ac-83a9-d990664cfe75 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.330190 Oct 12 22:02:38.190475 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 452/842] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:37 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:38.208512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2654a2ab-1de8-4595-b460-42c364e474d1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512866b280>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:38.249654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2e434846-dcac-4d23-b931-c4a0b0a030b9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Action: 'create', calling method: .version_select at 0x7f51286538b0>, body: {"keypair": {"name": "tempest-keypair-1602415162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA0R0BmC1go1bNmh39ekV/9ygmAanGOGa5dZB6AT67jHmnzRxReHo4/A4lPvs+Mav718kvOu/2o10Ouzvqa9X5QeSBUSnoKXrTdc4YXddcY9PaowsWVLVj2o8dZG2FoEw=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:38.278098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-2e434846-dcac-4d23-b931-c4a0b0a030b9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Getting quotas for project 3e56178d67cb48a88f99c741b3c0f2be. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:02:38.298641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-2e434846-dcac-4d23-b931-c4a0b0a030b9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Getting quotas for user 990d936956654370a1c2997120e7231f and project 3e56178d67cb48a88f99c741b3c0f2be. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:02:38.354011 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2e434846-dcac-4d23-b931-c4a0b0a030b9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.347110 Oct 12 22:02:38.354931 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 391/843] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:02:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:38.522700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9c860c2c-b469-4c02-ae6c-5d40e87b1462 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512865cee0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:39.147433 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2654a2ab-1de8-4595-b460-42c364e474d1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 204 len: 0 microversion: 2.1 time: 0.955453 Oct 12 22:02:39.148660 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 453/844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:38 2022] DELETE /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 0 bytes in 957 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:02:39.154740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2b35e391-4227-4404-b5b3-e458ad3d429e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:39.155724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2b35e391-4227-4404-b5b3-e458ad3d429e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:39.171887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b35e391-4227-4404-b5b3-e458ad3d429e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:39.172576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b35e391-4227-4404-b5b3-e458ad3d429e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:39.173228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b35e391-4227-4404-b5b3-e458ad3d429e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:39.176211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b35e391-4227-4404-b5b3-e458ad3d429e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:39.176923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b35e391-4227-4404-b5b3-e458ad3d429e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:39.177533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b35e391-4227-4404-b5b3-e458ad3d429e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:39.261162 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9c860c2c-b469-4c02-ae6c-5d40e87b1462 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1453 microversion: 2.1 time: 0.733490 Oct 12 22:02:39.272796 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 392/845] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:38 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1453 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:39.284287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d220bb4b-c4f0-4ae9-9d78-de2566e2ea39 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:39.286907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d220bb4b-c4f0-4ae9-9d78-de2566e2ea39 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:39.298895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d220bb4b-c4f0-4ae9-9d78-de2566e2ea39 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:39.299771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d220bb4b-c4f0-4ae9-9d78-de2566e2ea39 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:39.300442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d220bb4b-c4f0-4ae9-9d78-de2566e2ea39 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:39.301468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d220bb4b-c4f0-4ae9-9d78-de2566e2ea39 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:39.303087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d220bb4b-c4f0-4ae9-9d78-de2566e2ea39 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:39.303751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d220bb4b-c4f0-4ae9-9d78-de2566e2ea39 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:39.534397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2b35e391-4227-4404-b5b3-e458ad3d429e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:39.542970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2b35e391-4227-4404-b5b3-e458ad3d429e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:39.544467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2b35e391-4227-4404-b5b3-e458ad3d429e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:39.549667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d220bb4b-c4f0-4ae9-9d78-de2566e2ea39 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:39.552863 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2b35e391-4227-4404-b5b3-e458ad3d429e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1361 microversion: 2.25 time: 0.400546 Oct 12 22:02:39.555923 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 454/846] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:39 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1361 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:39.561921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9d709e87-f2e3-4961-9bf0-2f4f5c519e41 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:39.575643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9d709e87-f2e3-4961-9bf0-2f4f5c519e41 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:39.589104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d709e87-f2e3-4961-9bf0-2f4f5c519e41 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:39.591807 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d220bb4b-c4f0-4ae9-9d78-de2566e2ea39 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1313 microversion: 2.1 time: 0.314775 Oct 12 22:02:39.592758 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 393/847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:39 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:39.592933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d709e87-f2e3-4961-9bf0-2f4f5c519e41 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:39.593420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d709e87-f2e3-4961-9bf0-2f4f5c519e41 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:39.594528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d709e87-f2e3-4961-9bf0-2f4f5c519e41 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:39.602811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d709e87-f2e3-4961-9bf0-2f4f5c519e41 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:39.603680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d709e87-f2e3-4961-9bf0-2f4f5c519e41 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:39.614412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fe74fb9a-49e8-460d-b71b-a5e6a71f9ae9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:39.615334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fe74fb9a-49e8-460d-b71b-a5e6a71f9ae9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:39.622632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe74fb9a-49e8-460d-b71b-a5e6a71f9ae9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:39.623521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe74fb9a-49e8-460d-b71b-a5e6a71f9ae9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:39.624727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe74fb9a-49e8-460d-b71b-a5e6a71f9ae9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:39.625640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe74fb9a-49e8-460d-b71b-a5e6a71f9ae9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:39.626650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe74fb9a-49e8-460d-b71b-a5e6a71f9ae9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:39.627296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe74fb9a-49e8-460d-b71b-a5e6a71f9ae9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:39.651983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9d709e87-f2e3-4961-9bf0-2f4f5c519e41 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:02:39.664132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fe74fb9a-49e8-460d-b71b-a5e6a71f9ae9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:02:39.795165 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fe74fb9a-49e8-460d-b71b-a5e6a71f9ae9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 204 len: 0 microversion: 2.1 time: 0.185238 Oct 12 22:02:39.796200 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 394/848] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:02:39 2022] DELETE /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:02:39.812302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-51988fbc-7250-42b6-8690-28b5a19ba7f1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:39.813616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-51988fbc-7250-42b6-8690-28b5a19ba7f1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:39.824088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51988fbc-7250-42b6-8690-28b5a19ba7f1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:39.824850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51988fbc-7250-42b6-8690-28b5a19ba7f1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:39.825510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51988fbc-7250-42b6-8690-28b5a19ba7f1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:39.827954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51988fbc-7250-42b6-8690-28b5a19ba7f1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:39.828594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51988fbc-7250-42b6-8690-28b5a19ba7f1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:39.829224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51988fbc-7250-42b6-8690-28b5a19ba7f1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:39.830825 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9d709e87-f2e3-4961-9bf0-2f4f5c519e41 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 204 len: 0 microversion: 2.1 time: 0.272881 Oct 12 22:02:39.839886 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 455/849] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:02:39 2022] DELETE /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:02:39.858550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a2966c1a-1e31-43ea-b963-a702358dd3b2 req-ef3fd8e9-661f-45f8-9937-1478f89a8ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e615f0-f403-426c-a0c9-73cc9b810d10", "name": "network-vif-plugged", "status": "completed", "tag": "38be05fb-8b40-41e5-b46a-fd8537f3988f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:39.909593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a2966c1a-1e31-43ea-b963-a702358dd3b2 req-ef3fd8e9-661f-45f8-9937-1478f89a8ff2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:39.910077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a2966c1a-1e31-43ea-b963-a702358dd3b2 req-ef3fd8e9-661f-45f8-9937-1478f89a8ff2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:39.910575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a2966c1a-1e31-43ea-b963-a702358dd3b2 req-ef3fd8e9-661f-45f8-9937-1478f89a8ff2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:39.942028 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a2966c1a-1e31-43ea-b963-a702358dd3b2 req-ef3fd8e9-661f-45f8-9937-1478f89a8ff2 service nova] Creating event network-vif-plugged:38be05fb-8b40-41e5-b46a-fd8537f3988f for instance e0e615f0-f403-426c-a0c9-73cc9b810d10 on n-h1-861111-1 Oct 12 22:02:39.960937 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a2966c1a-1e31-43ea-b963-a702358dd3b2 req-ef3fd8e9-661f-45f8-9937-1478f89a8ff2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119056 Oct 12 22:02:39.962414 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 456/850] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:39.971098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e890316d-a4ac-41e8-b84f-f1db3cba8b2e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:39.972043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e890316d-a4ac-41e8-b84f-f1db3cba8b2e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:39.981510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e890316d-a4ac-41e8-b84f-f1db3cba8b2e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:39.982863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e890316d-a4ac-41e8-b84f-f1db3cba8b2e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:39.983725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e890316d-a4ac-41e8-b84f-f1db3cba8b2e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:39.984879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e890316d-a4ac-41e8-b84f-f1db3cba8b2e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:39.985659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e890316d-a4ac-41e8-b84f-f1db3cba8b2e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:39.986303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e890316d-a4ac-41e8-b84f-f1db3cba8b2e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:40.020170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-51988fbc-7250-42b6-8690-28b5a19ba7f1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:40.032929 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-51988fbc-7250-42b6-8690-28b5a19ba7f1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.234301 Oct 12 22:02:40.043185 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 395/851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:39 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:40.080044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1222964572", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "1bfd60f2-0202-40db-8761-3b71d02412dc"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:40.090674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:40.159140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] validate_networks() for [('1bfd60f2-0202-40db-8761-3b71d02412dc', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:02:40.213081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e890316d-a4ac-41e8-b84f-f1db3cba8b2e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:40.228219 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e890316d-a4ac-41e8-b84f-f1db3cba8b2e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1710 microversion: 2.1 time: 0.264341 Oct 12 22:02:40.229992 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 457/852] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:39 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1710 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:40.280113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe0df632-2751-42ce-aa2a-80a326e8ba22 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512866b3a0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:40.359597 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fe0df632-2751-42ce-aa2a-80a326e8ba22 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1453 microversion: 2.1 time: 0.084562 Oct 12 22:02:40.360440 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 458/853] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:40 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:40.588582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-43ebd768-694b-411c-a382-b64f9e2bb3e5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:40.589098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-43ebd768-694b-411c-a382-b64f9e2bb3e5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:40.604561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43ebd768-694b-411c-a382-b64f9e2bb3e5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:40.607809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43ebd768-694b-411c-a382-b64f9e2bb3e5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:40.613302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43ebd768-694b-411c-a382-b64f9e2bb3e5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:40.614925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43ebd768-694b-411c-a382-b64f9e2bb3e5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:40.620250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43ebd768-694b-411c-a382-b64f9e2bb3e5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:40.620881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43ebd768-694b-411c-a382-b64f9e2bb3e5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:40.824157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:02:40.826096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:02:40.827671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:02:40.828541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:02:40.829337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:02:40.844029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:40.845454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:40.846247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:40.848816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:40.849567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:40.850863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:40.895974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Getting quotas for project 0905a1286e134e34a55ceaaa6c23718e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:02:40.904114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Getting quotas for user 7224dcaeabdd4199b9682e99912f7740 and project 0905a1286e134e34a55ceaaa6c23718e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:02:40.926280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:02:40.932898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:02:41.019422 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb6a232b-2640-4289-a1f7-1b86f1355aee tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954347 Oct 12 22:02:41.027457 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 396/854] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:02:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:02:41.032963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3e4adbf7-eef2-44b7-b577-6c5455d5b281 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:41.033956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3e4adbf7-eef2-44b7-b577-6c5455d5b281 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:41.036878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-43ebd768-694b-411c-a382-b64f9e2bb3e5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:41.045716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e4adbf7-eef2-44b7-b577-6c5455d5b281 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:41.046522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e4adbf7-eef2-44b7-b577-6c5455d5b281 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:41.047160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e4adbf7-eef2-44b7-b577-6c5455d5b281 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:41.048547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e4adbf7-eef2-44b7-b577-6c5455d5b281 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:41.049214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e4adbf7-eef2-44b7-b577-6c5455d5b281 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:41.049818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e4adbf7-eef2-44b7-b577-6c5455d5b281 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:41.056231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:41.066897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-43ebd768-694b-411c-a382-b64f9e2bb3e5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:41.077196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-43ebd768-694b-411c-a382-b64f9e2bb3e5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:41.083155 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-43ebd768-694b-411c-a382-b64f9e2bb3e5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1361 microversion: 2.25 time: 0.496751 Oct 12 22:02:41.085869 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 459/855] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:40 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1361 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:41.097503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9bd73ab7-f77f-43a2-8f65-45961fd738ca tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:41.101901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9bd73ab7-f77f-43a2-8f65-45961fd738ca tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:41.215676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9bd73ab7-f77f-43a2-8f65-45961fd738ca tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:41.222863 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9bd73ab7-f77f-43a2-8f65-45961fd738ca tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1208 microversion: 2.1 time: 0.135760 Oct 12 22:02:41.229746 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 460/856] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:41 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1208 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:41.238973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9eb8e4cd-7c2f-4620-bce0-c03da7e6f682 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:41.240267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9eb8e4cd-7c2f-4620-bce0-c03da7e6f682 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:41.261854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eb8e4cd-7c2f-4620-bce0-c03da7e6f682 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:41.262725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eb8e4cd-7c2f-4620-bce0-c03da7e6f682 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:41.263743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eb8e4cd-7c2f-4620-bce0-c03da7e6f682 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:41.264174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eb8e4cd-7c2f-4620-bce0-c03da7e6f682 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:41.264640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eb8e4cd-7c2f-4620-bce0-c03da7e6f682 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:41.265064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eb8e4cd-7c2f-4620-bce0-c03da7e6f682 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:41.387735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3e4adbf7-eef2-44b7-b577-6c5455d5b281 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:41.397776 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3e4adbf7-eef2-44b7-b577-6c5455d5b281 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1313 microversion: 2.1 time: 0.369014 Oct 12 22:02:41.398740 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 397/857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:41 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:41.403878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1831616428", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "aa0cae96-e59b-4fec-88a6-dca6873049ef"}], "security_groups": [{"name": "tempest-securitygroup--1313969607"}], "key_name": "tempest-keypair-1602415162", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:41.542527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9eb8e4cd-7c2f-4620-bce0-c03da7e6f682 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:41.550915 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9eb8e4cd-7c2f-4620-bce0-c03da7e6f682 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.319969 Oct 12 22:02:41.551539 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 461/858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:41 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:41.568281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ecee45f0-7e2a-4bea-9fa0-68c72331bf1b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:41.568926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ecee45f0-7e2a-4bea-9fa0-68c72331bf1b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:41.593496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] validate_networks() for [('aa0cae96-e59b-4fec-88a6-dca6873049ef', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:02:41.608924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecee45f0-7e2a-4bea-9fa0-68c72331bf1b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:41.615874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecee45f0-7e2a-4bea-9fa0-68c72331bf1b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:41.621947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecee45f0-7e2a-4bea-9fa0-68c72331bf1b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:41.622499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecee45f0-7e2a-4bea-9fa0-68c72331bf1b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:41.622975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecee45f0-7e2a-4bea-9fa0-68c72331bf1b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:41.623964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecee45f0-7e2a-4bea-9fa0-68c72331bf1b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:41.855136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ecee45f0-7e2a-4bea-9fa0-68c72331bf1b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:41.864246 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ecee45f0-7e2a-4bea-9fa0-68c72331bf1b tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1710 microversion: 2.1 time: 0.311681 Oct 12 22:02:41.864831 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 462/859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:41 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1710 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:41.876243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-562e3098-c5bc-4af9-bf20-bf6cace357d4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512860b5e0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:41.933377 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-562e3098-c5bc-4af9-bf20-bf6cace357d4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1453 microversion: 2.1 time: 0.067483 Oct 12 22:02:41.933953 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 463/860] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:41 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1453 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:42.113269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6e0d25a7-43a7-49f9-b5f6-805c106940d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:42.114293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6e0d25a7-43a7-49f9-b5f6-805c106940d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:42.121257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e0d25a7-43a7-49f9-b5f6-805c106940d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:42.123008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e0d25a7-43a7-49f9-b5f6-805c106940d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:42.123754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e0d25a7-43a7-49f9-b5f6-805c106940d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:42.124682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e0d25a7-43a7-49f9-b5f6-805c106940d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:42.125351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e0d25a7-43a7-49f9-b5f6-805c106940d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:42.126118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e0d25a7-43a7-49f9-b5f6-805c106940d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:42.149669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:42.225836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:02:42.226349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:02:42.227436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:02:42.227928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:02:42.228615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:02:42.258478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:42.260940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:42.262528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:42.265676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:42.266352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:42.268464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:42.304052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Getting quotas for project 3e56178d67cb48a88f99c741b3c0f2be. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:02:42.310286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Getting quotas for user 990d936956654370a1c2997120e7231f and project 3e56178d67cb48a88f99c741b3c0f2be. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:02:42.327927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:02:42.330868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:02:42.374651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6e0d25a7-43a7-49f9-b5f6-805c106940d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:42.388626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6e0d25a7-43a7-49f9-b5f6-805c106940d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:42.392990 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-74287d3e-c473-45a9-a633-661132439781 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.992632 Oct 12 22:02:42.394888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6e0d25a7-43a7-49f9-b5f6-805c106940d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:42.400523 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6e0d25a7-43a7-49f9-b5f6-805c106940d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1361 microversion: 2.25 time: 0.287587 Oct 12 22:02:42.400702 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 398/861] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:02:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:02:42.401454 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 464/862] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:42 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1361 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:02:42.405945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4ba1b102-2349-4ff5-9736-e1e24c1bb078 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:42.406782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4ba1b102-2349-4ff5-9736-e1e24c1bb078 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:42.411696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-28a18e3a-4637-44b2-ad3d-673178bdbdb5 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:42.412892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-28a18e3a-4637-44b2-ad3d-673178bdbdb5 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:42.414411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ba1b102-2349-4ff5-9736-e1e24c1bb078 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:42.415074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ba1b102-2349-4ff5-9736-e1e24c1bb078 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:42.415791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ba1b102-2349-4ff5-9736-e1e24c1bb078 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:42.416768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ba1b102-2349-4ff5-9736-e1e24c1bb078 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:42.417601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ba1b102-2349-4ff5-9736-e1e24c1bb078 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:42.418262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ba1b102-2349-4ff5-9736-e1e24c1bb078 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:42.525124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-28a18e3a-4637-44b2-ad3d-673178bdbdb5 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:42.530897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4ba1b102-2349-4ff5-9736-e1e24c1bb078 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:42.546310 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-28a18e3a-4637-44b2-ad3d-673178bdbdb5 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1242 microversion: 2.1 time: 0.140936 Oct 12 22:02:42.546704 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 465/863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:42 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1242 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:42.548787 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4ba1b102-2349-4ff5-9736-e1e24c1bb078 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1212 microversion: 2.1 time: 0.145952 Oct 12 22:02:42.551699 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 399/864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:42 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1212 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:42.559962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c829bf33-077e-4946-94e7-75b588ef177d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:42.560605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c829bf33-077e-4946-94e7-75b588ef177d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:42.573239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c829bf33-077e-4946-94e7-75b588ef177d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:42.574488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c829bf33-077e-4946-94e7-75b588ef177d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:42.575295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c829bf33-077e-4946-94e7-75b588ef177d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:42.576012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-34f54942-16af-4132-aaff-50fa879e17f7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:42.576678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c829bf33-077e-4946-94e7-75b588ef177d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:42.576795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-34f54942-16af-4132-aaff-50fa879e17f7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:42.577473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c829bf33-077e-4946-94e7-75b588ef177d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:42.578322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c829bf33-077e-4946-94e7-75b588ef177d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:42.591307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34f54942-16af-4132-aaff-50fa879e17f7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:42.593268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34f54942-16af-4132-aaff-50fa879e17f7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:42.593824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34f54942-16af-4132-aaff-50fa879e17f7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:42.596152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34f54942-16af-4132-aaff-50fa879e17f7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:42.596628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34f54942-16af-4132-aaff-50fa879e17f7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:42.598844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34f54942-16af-4132-aaff-50fa879e17f7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:43.184328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-34f54942-16af-4132-aaff-50fa879e17f7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:43.194906 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-34f54942-16af-4132-aaff-50fa879e17f7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.624830 Oct 12 22:02:43.205456 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 400/865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:42 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:43.227766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a9ae28bb-b17d-4838-8fa9-9cfd32e19dd1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:43.234600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a9ae28bb-b17d-4838-8fa9-9cfd32e19dd1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:43.265741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9ae28bb-b17d-4838-8fa9-9cfd32e19dd1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:43.270601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9ae28bb-b17d-4838-8fa9-9cfd32e19dd1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:43.272094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9ae28bb-b17d-4838-8fa9-9cfd32e19dd1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:43.275595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9ae28bb-b17d-4838-8fa9-9cfd32e19dd1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:43.277176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9ae28bb-b17d-4838-8fa9-9cfd32e19dd1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:43.284685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9ae28bb-b17d-4838-8fa9-9cfd32e19dd1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:43.347119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c829bf33-077e-4946-94e7-75b588ef177d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:43.363366 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c829bf33-077e-4946-94e7-75b588ef177d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1313 microversion: 2.1 time: 0.815543 Oct 12 22:02:43.366019 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 466/866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:42 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1313 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:43.376809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-51a2d117-4e52-4e75-9f6e-a41a4ad1cc82 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51286b5040>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:43.467570 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-51a2d117-4e52-4e75-9f6e-a41a4ad1cc82 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1453 microversion: 2.1 time: 0.098706 Oct 12 22:02:43.469743 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 467/867] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:43 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:43.488203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-39e24c5c-3846-4300-970a-5346a305f1d2 req-0f77f23d-c574-4047-bc4d-ede8a3273fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adec1006-780c-4fe7-871a-e4f7addfe159", "name": "network-vif-plugged", "status": "completed", "tag": "1a376da9-7885-4d84-98d7-e6c54abdca11"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:43.516783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-39e24c5c-3846-4300-970a-5346a305f1d2 req-0f77f23d-c574-4047-bc4d-ede8a3273fb6 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:43.517474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-39e24c5c-3846-4300-970a-5346a305f1d2 req-0f77f23d-c574-4047-bc4d-ede8a3273fb6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:43.518198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-39e24c5c-3846-4300-970a-5346a305f1d2 req-0f77f23d-c574-4047-bc4d-ede8a3273fb6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:43.566662 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-39e24c5c-3846-4300-970a-5346a305f1d2 req-0f77f23d-c574-4047-bc4d-ede8a3273fb6 service nova] Creating event network-vif-plugged:1a376da9-7885-4d84-98d7-e6c54abdca11 for instance adec1006-780c-4fe7-871a-e4f7addfe159 on n-h1-861111-1 Oct 12 22:02:43.582069 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-39e24c5c-3846-4300-970a-5346a305f1d2 req-0f77f23d-c574-4047-bc4d-ede8a3273fb6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106743 Oct 12 22:02:43.583092 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 468/868] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:43.590956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1235703b-5a92-47b1-b769-2084574c1e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:43.593657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1235703b-5a92-47b1-b769-2084574c1e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:43.664125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a9ae28bb-b17d-4838-8fa9-9cfd32e19dd1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:43.669948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1235703b-5a92-47b1-b769-2084574c1e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:43.672045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1235703b-5a92-47b1-b769-2084574c1e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:43.672504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1235703b-5a92-47b1-b769-2084574c1e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:43.673244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1235703b-5a92-47b1-b769-2084574c1e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:43.673709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1235703b-5a92-47b1-b769-2084574c1e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:43.678193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1235703b-5a92-47b1-b769-2084574c1e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:43.679202 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a9ae28bb-b17d-4838-8fa9-9cfd32e19dd1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1710 microversion: 2.1 time: 0.468729 Oct 12 22:02:43.681860 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 401/869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:43 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1710 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:43.693476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0139084a-7d2b-4ce8-944e-6f4c98661e5d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:43.699095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0139084a-7d2b-4ce8-944e-6f4c98661e5d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:43.708545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0139084a-7d2b-4ce8-944e-6f4c98661e5d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:43.709172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0139084a-7d2b-4ce8-944e-6f4c98661e5d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:43.710158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0139084a-7d2b-4ce8-944e-6f4c98661e5d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:43.710970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0139084a-7d2b-4ce8-944e-6f4c98661e5d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:43.711546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0139084a-7d2b-4ce8-944e-6f4c98661e5d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:43.713436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0139084a-7d2b-4ce8-944e-6f4c98661e5d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:43.800803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0139084a-7d2b-4ce8-944e-6f4c98661e5d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:43.809900 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0139084a-7d2b-4ce8-944e-6f4c98661e5d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1260 microversion: 2.1 time: 0.124408 Oct 12 22:02:43.810748 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 402/870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:43 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1260 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:43.817117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eca2373c-b825-41f5-91de-0a1f524dd984 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:43.817950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eca2373c-b825-41f5-91de-0a1f524dd984 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:43.839453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eca2373c-b825-41f5-91de-0a1f524dd984 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:43.840473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eca2373c-b825-41f5-91de-0a1f524dd984 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:43.846426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eca2373c-b825-41f5-91de-0a1f524dd984 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:43.849041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eca2373c-b825-41f5-91de-0a1f524dd984 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:43.850236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eca2373c-b825-41f5-91de-0a1f524dd984 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:43.850912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eca2373c-b825-41f5-91de-0a1f524dd984 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:44.101739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eca2373c-b825-41f5-91de-0a1f524dd984 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:44.113577 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eca2373c-b825-41f5-91de-0a1f524dd984 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1246 microversion: 2.1 time: 0.301068 Oct 12 22:02:44.114507 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 403/871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:43 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1246 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:44.231868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3bd57b5d-d7ba-4811-a35c-ef68b0ad4d18 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:44.233887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3bd57b5d-d7ba-4811-a35c-ef68b0ad4d18 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:44.240827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bd57b5d-d7ba-4811-a35c-ef68b0ad4d18 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:44.241821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bd57b5d-d7ba-4811-a35c-ef68b0ad4d18 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:44.242418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bd57b5d-d7ba-4811-a35c-ef68b0ad4d18 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:44.243570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bd57b5d-d7ba-4811-a35c-ef68b0ad4d18 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:44.244192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bd57b5d-d7ba-4811-a35c-ef68b0ad4d18 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:44.244788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bd57b5d-d7ba-4811-a35c-ef68b0ad4d18 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:44.605021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3bd57b5d-d7ba-4811-a35c-ef68b0ad4d18 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:44.616526 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3bd57b5d-d7ba-4811-a35c-ef68b0ad4d18 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.389195 Oct 12 22:02:44.617377 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 404/872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:44 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:44.622817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3396e76e-d594-40e9-9a29-07086e688bd7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:44.623990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3396e76e-d594-40e9-9a29-07086e688bd7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:44.632771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3396e76e-d594-40e9-9a29-07086e688bd7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:44.633720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3396e76e-d594-40e9-9a29-07086e688bd7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:44.634515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3396e76e-d594-40e9-9a29-07086e688bd7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:44.635565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3396e76e-d594-40e9-9a29-07086e688bd7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:44.636285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3396e76e-d594-40e9-9a29-07086e688bd7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:44.636933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3396e76e-d594-40e9-9a29-07086e688bd7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:44.694003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1235703b-5a92-47b1-b769-2084574c1e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:44.718175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1235703b-5a92-47b1-b769-2084574c1e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:44.720802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1235703b-5a92-47b1-b769-2084574c1e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:44.721981 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1235703b-5a92-47b1-b769-2084574c1e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1361 microversion: 2.25 time: 1.136738 Oct 12 22:02:44.735311 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 469/873] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:43 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1361 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:44.743093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9ae9f1e7-1338-425c-a4b0-1f5e404addaf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51286d8ca0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:44.901836 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9ae9f1e7-1338-425c-a4b0-1f5e404addaf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1453 microversion: 2.1 time: 0.164947 Oct 12 22:02:44.902420 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 470/874] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:44 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:44.921226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d25acf1b-b737-4daa-87e3-40153a573666 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:44.922136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d25acf1b-b737-4daa-87e3-40153a573666 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:44.930018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d25acf1b-b737-4daa-87e3-40153a573666 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:44.931411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d25acf1b-b737-4daa-87e3-40153a573666 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:44.932063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d25acf1b-b737-4daa-87e3-40153a573666 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:44.932955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d25acf1b-b737-4daa-87e3-40153a573666 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:44.933568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d25acf1b-b737-4daa-87e3-40153a573666 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:44.934158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d25acf1b-b737-4daa-87e3-40153a573666 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:44.949194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3396e76e-d594-40e9-9a29-07086e688bd7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:44.961476 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3396e76e-d594-40e9-9a29-07086e688bd7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1313 microversion: 2.1 time: 0.342827 Oct 12 22:02:44.962702 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 405/875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:44 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:44.988710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e4534700-725b-4a52-bac5-7e43ba9f1a3d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:44.989633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e4534700-725b-4a52-bac5-7e43ba9f1a3d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:45.010573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4534700-725b-4a52-bac5-7e43ba9f1a3d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:45.011431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4534700-725b-4a52-bac5-7e43ba9f1a3d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:45.012055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4534700-725b-4a52-bac5-7e43ba9f1a3d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:45.012934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4534700-725b-4a52-bac5-7e43ba9f1a3d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:45.013536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4534700-725b-4a52-bac5-7e43ba9f1a3d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:45.014676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4534700-725b-4a52-bac5-7e43ba9f1a3d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:45.133494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e4534700-725b-4a52-bac5-7e43ba9f1a3d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:45.145573 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e4534700-725b-4a52-bac5-7e43ba9f1a3d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1260 microversion: 2.1 time: 0.168405 Oct 12 22:02:45.163706 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 406/876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:44 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:45.174643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3c0dafad-6b60-4bcc-96d8-8677a79fbff0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:45.177406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3c0dafad-6b60-4bcc-96d8-8677a79fbff0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:45.184626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c0dafad-6b60-4bcc-96d8-8677a79fbff0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:45.185138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c0dafad-6b60-4bcc-96d8-8677a79fbff0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:45.186075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c0dafad-6b60-4bcc-96d8-8677a79fbff0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:45.187225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c0dafad-6b60-4bcc-96d8-8677a79fbff0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:45.187818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c0dafad-6b60-4bcc-96d8-8677a79fbff0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:45.188262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c0dafad-6b60-4bcc-96d8-8677a79fbff0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:45.303948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3c0dafad-6b60-4bcc-96d8-8677a79fbff0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:45.320159 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3c0dafad-6b60-4bcc-96d8-8677a79fbff0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1294 microversion: 2.1 time: 0.153909 Oct 12 22:02:45.325652 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 407/877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:45 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1294 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:45.633351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-ec956335-b12d-409b-b5c5-47ab58ccc2a5 req-6389f240-bd7f-47cc-b976-241ed14fe323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad668734-0c34-4d75-b667-0f69f3515d84", "name": "network-vif-unplugged", "status": "completed", "tag": "38c74c93-daa8-4431-99a7-a03e4c6e546f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:45.653512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ec956335-b12d-409b-b5c5-47ab58ccc2a5 req-6389f240-bd7f-47cc-b976-241ed14fe323 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:45.654598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ec956335-b12d-409b-b5c5-47ab58ccc2a5 req-6389f240-bd7f-47cc-b976-241ed14fe323 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:45.655908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ec956335-b12d-409b-b5c5-47ab58ccc2a5 req-6389f240-bd7f-47cc-b976-241ed14fe323 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:45.669847 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-ec956335-b12d-409b-b5c5-47ab58ccc2a5 req-6389f240-bd7f-47cc-b976-241ed14fe323 service nova] Creating event network-vif-unplugged:38c74c93-daa8-4431-99a7-a03e4c6e546f for instance ad668734-0c34-4d75-b667-0f69f3515d84 on n-h1-861111-1 Oct 12 22:02:45.677671 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-ec956335-b12d-409b-b5c5-47ab58ccc2a5 req-6389f240-bd7f-47cc-b976-241ed14fe323 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047707 Oct 12 22:02:45.678803 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 408/878] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:02:45.709957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-262d2a68-9f84-4468-a422-deb23c06da5d tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:45.711066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-262d2a68-9f84-4468-a422-deb23c06da5d tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:45.720274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-262d2a68-9f84-4468-a422-deb23c06da5d tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:45.721661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-262d2a68-9f84-4468-a422-deb23c06da5d tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:45.726506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-262d2a68-9f84-4468-a422-deb23c06da5d tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:45.727629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-262d2a68-9f84-4468-a422-deb23c06da5d tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:45.728596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-262d2a68-9f84-4468-a422-deb23c06da5d tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:45.729292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-262d2a68-9f84-4468-a422-deb23c06da5d tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:45.742481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d25acf1b-b737-4daa-87e3-40153a573666 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:45.754381 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d25acf1b-b737-4daa-87e3-40153a573666 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1710 microversion: 2.1 time: 0.850716 Oct 12 22:02:45.760333 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 471/879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:44 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1710 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:45.778395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-fe999d47-1b07-4820-b2ad-6d1dd6dd1ecb req-12f09937-b5b0-48a8-9dc6-4a3a5439c1fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad668734-0c34-4d75-b667-0f69f3515d84", "name": "network-vif-deleted", "tag": "38c74c93-daa8-4431-99a7-a03e4c6e546f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:45.801931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fe999d47-1b07-4820-b2ad-6d1dd6dd1ecb req-12f09937-b5b0-48a8-9dc6-4a3a5439c1fb service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:45.805218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fe999d47-1b07-4820-b2ad-6d1dd6dd1ecb req-12f09937-b5b0-48a8-9dc6-4a3a5439c1fb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:45.806153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fe999d47-1b07-4820-b2ad-6d1dd6dd1ecb req-12f09937-b5b0-48a8-9dc6-4a3a5439c1fb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:45.842656 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-fe999d47-1b07-4820-b2ad-6d1dd6dd1ecb req-12f09937-b5b0-48a8-9dc6-4a3a5439c1fb service nova] Creating event network-vif-deleted:38c74c93-daa8-4431-99a7-a03e4c6e546f for instance ad668734-0c34-4d75-b667-0f69f3515d84 on n-h1-861111-1 Oct 12 22:02:45.854388 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-fe999d47-1b07-4820-b2ad-6d1dd6dd1ecb req-12f09937-b5b0-48a8-9dc6-4a3a5439c1fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088561 Oct 12 22:02:45.860930 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 472/880] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:45.879507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-596d2954-2def-4135-8b37-8b540cced3b6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:45.883584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-596d2954-2def-4135-8b37-8b540cced3b6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:45.899411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-596d2954-2def-4135-8b37-8b540cced3b6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:45.900131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-596d2954-2def-4135-8b37-8b540cced3b6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:45.900745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-596d2954-2def-4135-8b37-8b540cced3b6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:45.901648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-596d2954-2def-4135-8b37-8b540cced3b6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:45.903826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-596d2954-2def-4135-8b37-8b540cced3b6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:45.904685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-596d2954-2def-4135-8b37-8b540cced3b6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:46.152196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-262d2a68-9f84-4468-a422-deb23c06da5d tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:46.164604 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-262d2a68-9f84-4468-a422-deb23c06da5d tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.484080 Oct 12 22:02:46.165407 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 409/881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:45 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:46.174197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3ff4b32a-fed2-4080-b4ab-c5573ba42795 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51285a00d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:46.259048 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3ff4b32a-fed2-4080-b4ab-c5573ba42795 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1453 microversion: 2.1 time: 0.091856 Oct 12 22:02:46.259666 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 410/882] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:46 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:46.278870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-30c7c31d-ec1d-4c81-afac-e5d24a85f99e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:46.279266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-30c7c31d-ec1d-4c81-afac-e5d24a85f99e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:46.298293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30c7c31d-ec1d-4c81-afac-e5d24a85f99e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:46.300116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30c7c31d-ec1d-4c81-afac-e5d24a85f99e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:46.300573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30c7c31d-ec1d-4c81-afac-e5d24a85f99e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:46.301274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30c7c31d-ec1d-4c81-afac-e5d24a85f99e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:46.303170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-596d2954-2def-4135-8b37-8b540cced3b6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:46.303375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30c7c31d-ec1d-4c81-afac-e5d24a85f99e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:46.305857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30c7c31d-ec1d-4c81-afac-e5d24a85f99e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:46.318767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-596d2954-2def-4135-8b37-8b540cced3b6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:46.330932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-596d2954-2def-4135-8b37-8b540cced3b6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:46.332968 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-596d2954-2def-4135-8b37-8b540cced3b6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1557 microversion: 2.25 time: 0.469691 Oct 12 22:02:46.338494 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 473/883] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:45 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1557 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:46.358511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-06d5cfad-be7a-4f19-b249-8ef64a1eedf1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:46.368819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-06d5cfad-be7a-4f19-b249-8ef64a1eedf1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:46.384661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06d5cfad-be7a-4f19-b249-8ef64a1eedf1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:46.385438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06d5cfad-be7a-4f19-b249-8ef64a1eedf1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:46.386051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06d5cfad-be7a-4f19-b249-8ef64a1eedf1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:46.386932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06d5cfad-be7a-4f19-b249-8ef64a1eedf1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:46.387735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06d5cfad-be7a-4f19-b249-8ef64a1eedf1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:46.388322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06d5cfad-be7a-4f19-b249-8ef64a1eedf1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:46.769773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-06d5cfad-be7a-4f19-b249-8ef64a1eedf1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:46.782036 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-06d5cfad-be7a-4f19-b249-8ef64a1eedf1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1266 microversion: 2.1 time: 0.441486 Oct 12 22:02:46.784015 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 474/884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:46 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1266 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:46.801401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7c468eb8-64e9-4606-b60a-8f98f00ac0f1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:46.802303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7c468eb8-64e9-4606-b60a-8f98f00ac0f1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:46.819205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c468eb8-64e9-4606-b60a-8f98f00ac0f1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:46.819875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c468eb8-64e9-4606-b60a-8f98f00ac0f1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:46.830952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c468eb8-64e9-4606-b60a-8f98f00ac0f1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:46.831838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c468eb8-64e9-4606-b60a-8f98f00ac0f1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:46.832529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c468eb8-64e9-4606-b60a-8f98f00ac0f1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:46.833028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c468eb8-64e9-4606-b60a-8f98f00ac0f1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:46.943704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7c468eb8-64e9-4606-b60a-8f98f00ac0f1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:46.953240 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7c468eb8-64e9-4606-b60a-8f98f00ac0f1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1300 microversion: 2.1 time: 0.167889 Oct 12 22:02:46.954288 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 475/885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:46 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1300 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:46.970610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bc2b8f9a-b18e-4703-a056-0e44505bcad4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:46.972005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bc2b8f9a-b18e-4703-a056-0e44505bcad4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:46.980489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2b8f9a-b18e-4703-a056-0e44505bcad4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:46.981338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2b8f9a-b18e-4703-a056-0e44505bcad4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:46.981952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2b8f9a-b18e-4703-a056-0e44505bcad4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:46.983650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2b8f9a-b18e-4703-a056-0e44505bcad4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:46.984309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2b8f9a-b18e-4703-a056-0e44505bcad4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:46.984928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2b8f9a-b18e-4703-a056-0e44505bcad4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:47.062291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-30c7c31d-ec1d-4c81-afac-e5d24a85f99e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:47.079657 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-30c7c31d-ec1d-4c81-afac-e5d24a85f99e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1463 microversion: 2.1 time: 0.818814 Oct 12 22:02:47.091263 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 411/886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:46 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1463 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:47.091263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-043e3b4f-0d3e-4f87-822c-461f07a0200c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:47.091263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-043e3b4f-0d3e-4f87-822c-461f07a0200c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:47.126946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-043e3b4f-0d3e-4f87-822c-461f07a0200c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:47.129165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-043e3b4f-0d3e-4f87-822c-461f07a0200c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:47.130056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-043e3b4f-0d3e-4f87-822c-461f07a0200c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:47.130820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-043e3b4f-0d3e-4f87-822c-461f07a0200c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:47.131305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-043e3b4f-0d3e-4f87-822c-461f07a0200c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:47.131738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-043e3b4f-0d3e-4f87-822c-461f07a0200c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:47.223933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-043e3b4f-0d3e-4f87-822c-461f07a0200c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:47.224422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-043e3b4f-0d3e-4f87-822c-461f07a0200c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:47.224862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-043e3b4f-0d3e-4f87-822c-461f07a0200c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:47.225312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-043e3b4f-0d3e-4f87-822c-461f07a0200c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lazy-loading 'fault' on Instance uuid 1a164670-124d-407d-a4d1-940846b45e2d {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:02:47.386869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-043e3b4f-0d3e-4f87-822c-461f07a0200c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b16666035d4646a403d79d83f9a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e1f0c64d2e4154a3c0749af66adb6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:47.400659 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-043e3b4f-0d3e-4f87-822c-461f07a0200c tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 200 len: 1352 microversion: 2.1 time: 0.318885 Oct 12 22:02:47.431767 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 412/887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:47 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 1352 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:47.465876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-bc2b8f9a-b18e-4703-a056-0e44505bcad4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'services' on Instance uuid e0e615f0-f403-426c-a0c9-73cc9b810d10 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:02:47.524980 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bc2b8f9a-b18e-4703-a056-0e44505bcad4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 2049 microversion: 2.25 time: 0.569381 Oct 12 22:02:47.541341 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 476/888] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:46 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 2049 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:47.558949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e557dcb5-afbe-415a-963b-e13803e70628 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:47.560095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e557dcb5-afbe-415a-963b-e13803e70628 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:47.568090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e557dcb5-afbe-415a-963b-e13803e70628 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:47.568848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e557dcb5-afbe-415a-963b-e13803e70628 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:47.569677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e557dcb5-afbe-415a-963b-e13803e70628 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:47.570635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e557dcb5-afbe-415a-963b-e13803e70628 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:47.571436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e557dcb5-afbe-415a-963b-e13803e70628 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:47.572262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e557dcb5-afbe-415a-963b-e13803e70628 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:47.822850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ee5121f2-0dc5-4ab4-8611-8f138dda910d tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:47.824637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ee5121f2-0dc5-4ab4-8611-8f138dda910d tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:47.832198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee5121f2-0dc5-4ab4-8611-8f138dda910d tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:47.833150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee5121f2-0dc5-4ab4-8611-8f138dda910d tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:47.833745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee5121f2-0dc5-4ab4-8611-8f138dda910d tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:47.834616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee5121f2-0dc5-4ab4-8611-8f138dda910d tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:47.835216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee5121f2-0dc5-4ab4-8611-8f138dda910d tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:47.835835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee5121f2-0dc5-4ab4-8611-8f138dda910d tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:47.892264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e557dcb5-afbe-415a-963b-e13803e70628 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:47.907429 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e557dcb5-afbe-415a-963b-e13803e70628 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.357568 Oct 12 22:02:47.909036 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 477/889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:47 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:47.922210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0d45831f-1e52-466c-a379-8d642df89629 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51285e2ca0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:48.079062 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0d45831f-1e52-466c-a379-8d642df89629 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1453 microversion: 2.1 time: 0.161625 Oct 12 22:02:48.080742 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 478/890] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:47 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:48.092384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7cf3ba6a-dd61-4e02-abbf-d73e1f9ef6ac tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:48.094481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7cf3ba6a-dd61-4e02-abbf-d73e1f9ef6ac tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:48.108806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cf3ba6a-dd61-4e02-abbf-d73e1f9ef6ac tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:48.109604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cf3ba6a-dd61-4e02-abbf-d73e1f9ef6ac tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:48.111087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cf3ba6a-dd61-4e02-abbf-d73e1f9ef6ac tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:48.112449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cf3ba6a-dd61-4e02-abbf-d73e1f9ef6ac tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:48.114260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cf3ba6a-dd61-4e02-abbf-d73e1f9ef6ac tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:48.115321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cf3ba6a-dd61-4e02-abbf-d73e1f9ef6ac tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:48.334025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-7cf3ba6a-dd61-4e02-abbf-d73e1f9ef6ac tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'services' on Instance uuid e0e615f0-f403-426c-a0c9-73cc9b810d10 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:02:48.363701 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7cf3ba6a-dd61-4e02-abbf-d73e1f9ef6ac tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 2049 microversion: 2.25 time: 0.280876 Oct 12 22:02:48.372839 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ee5121f2-0dc5-4ab4-8611-8f138dda910d tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1614 microversion: 2.1 time: 0.938821 Oct 12 22:02:48.386765 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 479/891] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:48 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 2049 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:48.386765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-164107a4-854d-47f3-95d7-6338dc4e67b4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:48.386765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-164107a4-854d-47f3-95d7-6338dc4e67b4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:48.397210 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 413/892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:47 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1614 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:48.403193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-164107a4-854d-47f3-95d7-6338dc4e67b4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:48.403720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-164107a4-854d-47f3-95d7-6338dc4e67b4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:48.404007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bf7b227f-252b-4413-9e1a-706ae7030384 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:48.404162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-164107a4-854d-47f3-95d7-6338dc4e67b4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:48.405405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-164107a4-854d-47f3-95d7-6338dc4e67b4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:48.405586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bf7b227f-252b-4413-9e1a-706ae7030384 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:48.405863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-164107a4-854d-47f3-95d7-6338dc4e67b4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:48.406297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-164107a4-854d-47f3-95d7-6338dc4e67b4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:48.412799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf7b227f-252b-4413-9e1a-706ae7030384 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:48.413483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf7b227f-252b-4413-9e1a-706ae7030384 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:48.414144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf7b227f-252b-4413-9e1a-706ae7030384 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:48.414988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf7b227f-252b-4413-9e1a-706ae7030384 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:48.415841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf7b227f-252b-4413-9e1a-706ae7030384 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:48.416420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf7b227f-252b-4413-9e1a-706ae7030384 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:48.573037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bf7b227f-252b-4413-9e1a-706ae7030384 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:48.582344 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bf7b227f-252b-4413-9e1a-706ae7030384 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1300 microversion: 2.1 time: 0.183342 Oct 12 22:02:48.595512 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 414/893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:48 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1300 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:48.595512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-bce4aade-2663-4e60-b538-c5e877b41820 req-bf109220-1cc5-48bd-bd6f-db85afd47fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a164670-124d-407d-a4d1-940846b45e2d", "name": "network-vif-deleted", "tag": "78bf0b61-fcf3-4082-9079-b4ba87319616"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:48.635786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-bce4aade-2663-4e60-b538-c5e877b41820 req-bf109220-1cc5-48bd-bd6f-db85afd47fc6 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:48.636268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-bce4aade-2663-4e60-b538-c5e877b41820 req-bf109220-1cc5-48bd-bd6f-db85afd47fc6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:48.636694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-bce4aade-2663-4e60-b538-c5e877b41820 req-bf109220-1cc5-48bd-bd6f-db85afd47fc6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:48.652310 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-bce4aade-2663-4e60-b538-c5e877b41820 req-bf109220-1cc5-48bd-bd6f-db85afd47fc6 service nova] Creating event network-vif-deleted:78bf0b61-fcf3-4082-9079-b4ba87319616 for instance 1a164670-124d-407d-a4d1-940846b45e2d on n-h1-861111-1 Oct 12 22:02:48.660778 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-bce4aade-2663-4e60-b538-c5e877b41820 req-bf109220-1cc5-48bd-bd6f-db85afd47fc6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072427 Oct 12 22:02:48.661878 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 415/894] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:48.667304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d2c594ee-61d1-4ec9-bba6-943b837f71d3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:48.675308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2c594ee-61d1-4ec9-bba6-943b837f71d3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:48.676720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2c594ee-61d1-4ec9-bba6-943b837f71d3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:48.679849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2c594ee-61d1-4ec9-bba6-943b837f71d3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:48.682027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2c594ee-61d1-4ec9-bba6-943b837f71d3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:48.683983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2c594ee-61d1-4ec9-bba6-943b837f71d3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:48.684590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2c594ee-61d1-4ec9-bba6-943b837f71d3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:48.700593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-164107a4-854d-47f3-95d7-6338dc4e67b4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:48.713178 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-164107a4-854d-47f3-95d7-6338dc4e67b4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1308 microversion: 2.1 time: 0.329664 Oct 12 22:02:48.713846 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 480/895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:48 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1308 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:48.735690 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d2c594ee-61d1-4ec9-bba6-943b837f71d3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.072407 Oct 12 22:02:48.736849 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 416/896] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Oct 12 22:02:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:02:48.738869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-acc1a391-e97c-48e8-afb1-0904cc697385 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:48.739490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-acc1a391-e97c-48e8-afb1-0904cc697385 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:48.742266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-05dcc828-1532-4846-9e37-6f883f3f24f2 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:48.743279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-05dcc828-1532-4846-9e37-6f883f3f24f2 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:48.750075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05dcc828-1532-4846-9e37-6f883f3f24f2 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:48.753856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:48.755343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05dcc828-1532-4846-9e37-6f883f3f24f2 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:48.756182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05dcc828-1532-4846-9e37-6f883f3f24f2 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:48.757264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05dcc828-1532-4846-9e37-6f883f3f24f2 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:48.757842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05dcc828-1532-4846-9e37-6f883f3f24f2 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:48.759929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05dcc828-1532-4846-9e37-6f883f3f24f2 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:48.769514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acc1a391-e97c-48e8-afb1-0904cc697385 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:48.770943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acc1a391-e97c-48e8-afb1-0904cc697385 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:48.774000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acc1a391-e97c-48e8-afb1-0904cc697385 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:48.781894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acc1a391-e97c-48e8-afb1-0904cc697385 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:48.782637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acc1a391-e97c-48e8-afb1-0904cc697385 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:48.783539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acc1a391-e97c-48e8-afb1-0904cc697385 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:48.800968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:48.804593 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-05dcc828-1532-4846-9e37-6f883f3f24f2 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] HTTP exception thrown: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-05dcc828-1532-4846-9e37-6f883f3f24f2 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Request method failure captured: Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d HTTP/1.1 Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzi3KLy8xTG7iLEKjLPpDM_nWqKfwDlc85rWMzsSynyHHjO7IS11Jz0CpCqdnz8tLEnf4Fs-KbmVZoWzqslb1pfSiHYZRn9Nh3U75-JOuzxOK9mQUlMfpWdC-atqfnWLaLWjh_BvE05bsPdiDl99vUIKsISpTaysZJU9rKnuVTrXxd8 Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: a5e1f0c64d2e4154a3c0749af66adb6a Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:02:48.807567 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:02:48.809274 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a5e1f0c64d2e4154a3c0749af66adb6a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:02:48.809274 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:48.809274 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: a5e1f0c64d2e4154a3c0749af66adb6a Oct 12 22:02:48.809274 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:48.809274 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersWithSpecificFlavorTestJSON-721140800-project Oct 12 22:02:48.809274 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:02:48.809274 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:02:48.809274 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11b16666035d4646a403d79d83f9a67b Oct 12 22:02:48.809274 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800-project Oct 12 22:02:48.809274 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:02:48.809274 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. Oct 12 22:02:48.809274 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '1a164670-124d-407d-a4d1-940846b45e2d'} Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:02:48.810055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. Oct 12 22:02:48.811421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:48.816116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-05dcc828-1532-4846-9e37-6f883f3f24f2 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Returning 404 to user: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:02:48.817214 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-05dcc828-1532-4846-9e37-6f883f3f24f2 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 404 len: 111 microversion: 2.1 time: 0.079217 Oct 12 22:02:48.820345 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 417/897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:48 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:02:48.832052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f1a1ce6d-a66b-4dd6-88a9-a54b4b2034ad tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:48.833772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f1a1ce6d-a66b-4dd6-88a9-a54b4b2034ad tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:48.850723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1a1ce6d-a66b-4dd6-88a9-a54b4b2034ad tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:48.852216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1a1ce6d-a66b-4dd6-88a9-a54b4b2034ad tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:48.853638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1a1ce6d-a66b-4dd6-88a9-a54b4b2034ad tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:48.854397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1a1ce6d-a66b-4dd6-88a9-a54b4b2034ad tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:48.854918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1a1ce6d-a66b-4dd6-88a9-a54b4b2034ad tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:48.857882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1a1ce6d-a66b-4dd6-88a9-a54b4b2034ad tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:48.863298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-acc1a391-e97c-48e8-afb1-0904cc697385 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9a66f4d7b25c41869a862712926f24ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b11f85b98b41f380033fce110090be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:48.866661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-acc1a391-e97c-48e8-afb1-0904cc697385 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] flavor_id is None. Assuming migration. {{(pid=120453) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 12 22:02:48.867115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-acc1a391-e97c-48e8-afb1-0904cc697385 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120453) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:02:48.961089 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f1a1ce6d-a66b-4dd6-88a9-a54b4b2034ad tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10/action" status: 202 len: 0 microversion: 2.25 time: 0.139232 Oct 12 22:02:48.966596 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 418/898] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 12 22:02:48 2022] POST /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:02:48.973744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7f9f9293-409e-4700-8008-d89a23a239c7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:48.975068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7f9f9293-409e-4700-8008-d89a23a239c7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:48.984514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f9f9293-409e-4700-8008-d89a23a239c7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:48.985532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f9f9293-409e-4700-8008-d89a23a239c7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:48.986569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f9f9293-409e-4700-8008-d89a23a239c7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:48.988021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f9f9293-409e-4700-8008-d89a23a239c7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:48.988875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f9f9293-409e-4700-8008-d89a23a239c7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:48.989554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f9f9293-409e-4700-8008-d89a23a239c7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:49.011526 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-7f9f9293-409e-4700-8008-d89a23a239c7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] HTTP exception thrown: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7f9f9293-409e-4700-8008-d89a23a239c7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Request method failure captured: Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d HTTP/1.1 Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzi3KLy8xTG7iLEKjLPpDM_nWqKfwDlc85rWMzsSynyHHjO7IS11Jz0CpCqdnz8tLEnf4Fs-KbmVZoWzqslb1pfSiHYZRn9Nh3U75-JOuzxOK9mQUlMfpWdC-atqfnWLaLWjh_BvE05bsPdiDl99vUIKsISpTaysZJU9rKnuVTrXxd8 Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: a5e1f0c64d2e4154a3c0749af66adb6a Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:02:49.014314 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:02:49.015633 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a5e1f0c64d2e4154a3c0749af66adb6a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:02:49.015633 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:49.015633 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: a5e1f0c64d2e4154a3c0749af66adb6a Oct 12 22:02:49.015633 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:49.015633 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersWithSpecificFlavorTestJSON-721140800-project Oct 12 22:02:49.015633 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:02:49.015633 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:02:49.015633 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11b16666035d4646a403d79d83f9a67b Oct 12 22:02:49.015633 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800-project Oct 12 22:02:49.015633 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:02:49.015633 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:49.015633 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '1848e1da-8fef-4d2e-93b0-87af0c4fe39d'} Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:02:49.016467 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:49.017616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:49.022513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7f9f9293-409e-4700-8008-d89a23a239c7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Returning 404 to user: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:02:49.024088 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7f9f9293-409e-4700-8008-d89a23a239c7 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 404 len: 111 microversion: 2.1 time: 0.055119 Oct 12 22:02:49.025234 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 419/899] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:02:48 2022] DELETE /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:02:49.031378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4ddeca63-2d2d-4afa-a5a0-40379d43300e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:49.034489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4ddeca63-2d2d-4afa-a5a0-40379d43300e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:49.041866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ddeca63-2d2d-4afa-a5a0-40379d43300e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:49.043018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ddeca63-2d2d-4afa-a5a0-40379d43300e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:49.043733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ddeca63-2d2d-4afa-a5a0-40379d43300e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:49.055435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ddeca63-2d2d-4afa-a5a0-40379d43300e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:49.056789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ddeca63-2d2d-4afa-a5a0-40379d43300e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:49.057480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ddeca63-2d2d-4afa-a5a0-40379d43300e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:49.255686 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-acc1a391-e97c-48e8-afb1-0904cc697385 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159/action" status: 202 len: 0 microversion: 2.1 time: 0.525682 Oct 12 22:02:49.259266 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 481/900] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:02:48 2022] POST /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:02:49.272344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e2c4a669-1194-47c4-af51-e382f83f130c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:49.272964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e2c4a669-1194-47c4-af51-e382f83f130c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:49.306871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2c4a669-1194-47c4-af51-e382f83f130c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:49.309308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2c4a669-1194-47c4-af51-e382f83f130c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:49.309877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2c4a669-1194-47c4-af51-e382f83f130c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:49.311597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2c4a669-1194-47c4-af51-e382f83f130c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:49.312246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2c4a669-1194-47c4-af51-e382f83f130c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:49.314158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2c4a669-1194-47c4-af51-e382f83f130c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:49.612470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4ddeca63-2d2d-4afa-a5a0-40379d43300e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:49.618106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-e2c4a669-1194-47c4-af51-e382f83f130c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'services' on Instance uuid e0e615f0-f403-426c-a0c9-73cc9b810d10 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:02:49.624363 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4ddeca63-2d2d-4afa-a5a0-40379d43300e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.597755 Oct 12 22:02:49.627207 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 420/901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:49 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:49.631913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd53496a-0702-4f6a-85a8-b9946968c36e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:49.632526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cd53496a-0702-4f6a-85a8-b9946968c36e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:49.645380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd53496a-0702-4f6a-85a8-b9946968c36e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:49.645882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd53496a-0702-4f6a-85a8-b9946968c36e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:49.646324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd53496a-0702-4f6a-85a8-b9946968c36e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:49.647038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd53496a-0702-4f6a-85a8-b9946968c36e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:49.647973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd53496a-0702-4f6a-85a8-b9946968c36e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:49.648143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd53496a-0702-4f6a-85a8-b9946968c36e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:49.651181 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e2c4a669-1194-47c4-af51-e382f83f130c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 2034 microversion: 2.25 time: 0.386122 Oct 12 22:02:49.663821 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 482/902] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:49 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 2034 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:49.678505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1e28520c-801a-4aed-9b4d-74ebe4528dcd tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51285bb4c0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:49.683633 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-cd53496a-0702-4f6a-85a8-b9946968c36e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] HTTP exception thrown: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd53496a-0702-4f6a-85a8-b9946968c36e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Request method failure captured: Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d HTTP/1.1 Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzi3KLy8xTG7iLEKjLPpDM_nWqKfwDlc85rWMzsSynyHHjO7IS11Jz0CpCqdnz8tLEnf4Fs-KbmVZoWzqslb1pfSiHYZRn9Nh3U75-JOuzxOK9mQUlMfpWdC-atqfnWLaLWjh_BvE05bsPdiDl99vUIKsISpTaysZJU9rKnuVTrXxd8 Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: a5e1f0c64d2e4154a3c0749af66adb6a Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:02:49.690780 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:02:49.692402 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a5e1f0c64d2e4154a3c0749af66adb6a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:02:49.692402 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:49.692402 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: a5e1f0c64d2e4154a3c0749af66adb6a Oct 12 22:02:49.692402 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:49.692402 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersWithSpecificFlavorTestJSON-721140800-project Oct 12 22:02:49.692402 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:02:49.692402 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:02:49.692402 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11b16666035d4646a403d79d83f9a67b Oct 12 22:02:49.692402 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800-project Oct 12 22:02:49.692402 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:02:49.692402 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:49.692402 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '1848e1da-8fef-4d2e-93b0-87af0c4fe39d'} Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:02:49.693228 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:49.694374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:49.695449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd53496a-0702-4f6a-85a8-b9946968c36e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Returning 404 to user: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:02:49.695449 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cd53496a-0702-4f6a-85a8-b9946968c36e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 404 len: 111 microversion: 2.1 time: 0.064139 Oct 12 22:02:49.695449 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 421/903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:49 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:02:49.703458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4db41090-f665-4ef9-9b08-27d6a8fd434b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:49.704956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4db41090-f665-4ef9-9b08-27d6a8fd434b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:49.726411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4db41090-f665-4ef9-9b08-27d6a8fd434b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:49.726662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4db41090-f665-4ef9-9b08-27d6a8fd434b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:49.727072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4db41090-f665-4ef9-9b08-27d6a8fd434b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:49.732820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4db41090-f665-4ef9-9b08-27d6a8fd434b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:49.733287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4db41090-f665-4ef9-9b08-27d6a8fd434b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:49.738207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4db41090-f665-4ef9-9b08-27d6a8fd434b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:49.746653 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1e28520c-801a-4aed-9b4d-74ebe4528dcd tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1453 microversion: 2.1 time: 0.081525 Oct 12 22:02:49.755697 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 483/904] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:49 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:49.760343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-c4d53ff0-bcdb-40d5-8cc3-5b819d661c55 req-505d68b1-8cbc-4228-b4f3-39488dcde0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d4b3e47-bbd0-4adc-9173-d7f9ccd96221", "tag": "6ec98f33-ae19-4190-819a-9fe3d4ca011c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:49.778197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c4d53ff0-bcdb-40d5-8cc3-5b819d661c55 req-505d68b1-8cbc-4228-b4f3-39488dcde0d5 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:49.778996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c4d53ff0-bcdb-40d5-8cc3-5b819d661c55 req-505d68b1-8cbc-4228-b4f3-39488dcde0d5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:49.781155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c4d53ff0-bcdb-40d5-8cc3-5b819d661c55 req-505d68b1-8cbc-4228-b4f3-39488dcde0d5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:49.808097 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-c4d53ff0-bcdb-40d5-8cc3-5b819d661c55 req-505d68b1-8cbc-4228-b4f3-39488dcde0d5 service nova] Creating event network-changed:6ec98f33-ae19-4190-819a-9fe3d4ca011c for instance 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 on n-h1-861111-1 Oct 12 22:02:49.821272 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-c4d53ff0-bcdb-40d5-8cc3-5b819d661c55 req-505d68b1-8cbc-4228-b4f3-39488dcde0d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063582 Oct 12 22:02:49.822198 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 484/905] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:49.829294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02d47611-7711-456a-9055-8ad55e31ea13 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:49.830306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-02d47611-7711-456a-9055-8ad55e31ea13 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:49.838201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02d47611-7711-456a-9055-8ad55e31ea13 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:49.838975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02d47611-7711-456a-9055-8ad55e31ea13 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:49.839715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02d47611-7711-456a-9055-8ad55e31ea13 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:49.840659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02d47611-7711-456a-9055-8ad55e31ea13 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:49.841293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02d47611-7711-456a-9055-8ad55e31ea13 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:49.843291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02d47611-7711-456a-9055-8ad55e31ea13 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:49.869456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:50.137449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4db41090-f665-4ef9-9b08-27d6a8fd434b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:50.150504 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4db41090-f665-4ef9-9b08-27d6a8fd434b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1472 microversion: 2.1 time: 0.454339 Oct 12 22:02:50.151179 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 422/906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:49 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1472 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:50.163137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d2aa4dc-1b03-480e-91cb-665ea19cce2c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861111-1", "block_migration": "auto"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:50.169592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5d2aa4dc-1b03-480e-91cb-665ea19cce2c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:50.183881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d2aa4dc-1b03-480e-91cb-665ea19cce2c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:50.184803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d2aa4dc-1b03-480e-91cb-665ea19cce2c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:50.185674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d2aa4dc-1b03-480e-91cb-665ea19cce2c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:50.186752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d2aa4dc-1b03-480e-91cb-665ea19cce2c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:50.187455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d2aa4dc-1b03-480e-91cb-665ea19cce2c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:50.188091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d2aa4dc-1b03-480e-91cb-665ea19cce2c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:50.239786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-5d2aa4dc-1b03-480e-91cb-665ea19cce2c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'flavor' on Instance uuid e0e615f0-f403-426c-a0c9-73cc9b810d10 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:02:50.242999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-02d47611-7711-456a-9055-8ad55e31ea13 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:50.254111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5d2aa4dc-1b03-480e-91cb-665ea19cce2c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Going to try to live migrate instance to n-h2-861111-1 {{(pid=120452) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:02:50.254878 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-02d47611-7711-456a-9055-8ad55e31ea13 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1368 microversion: 2.1 time: 0.431055 Oct 12 22:02:50.255597 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 485/907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:49 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1368 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:50.271291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2f822c98-60e1-446a-ae8e-0b1a490d6ff1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '.version_select at 0x7f51285aeb80>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:50.304941 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2f822c98-60e1-446a-ae8e-0b1a490d6ff1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-922931407" status: 202 len: 0 microversion: 2.1 time: 0.048022 Oct 12 22:02:50.319052 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 486/908] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 12 22:02:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-922931407 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:02:50.333885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cec17bde-028a-4a18-988c-b44a657b9278 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:50.335841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cec17bde-028a-4a18-988c-b44a657b9278 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:50.349745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cec17bde-028a-4a18-988c-b44a657b9278 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:50.350658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cec17bde-028a-4a18-988c-b44a657b9278 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:50.351324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cec17bde-028a-4a18-988c-b44a657b9278 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:50.352389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cec17bde-028a-4a18-988c-b44a657b9278 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:50.353025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cec17bde-028a-4a18-988c-b44a657b9278 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:50.353612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cec17bde-028a-4a18-988c-b44a657b9278 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:50.614433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cec17bde-028a-4a18-988c-b44a657b9278 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:50.625137 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cec17bde-028a-4a18-988c-b44a657b9278 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1308 microversion: 2.1 time: 0.304168 Oct 12 22:02:50.638450 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 487/909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:50 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:50.666277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fcaa61dd-90b9-4c85-83eb-4cd8fe2a0d99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:50.668338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fcaa61dd-90b9-4c85-83eb-4cd8fe2a0d99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:50.675588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcaa61dd-90b9-4c85-83eb-4cd8fe2a0d99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:50.676370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcaa61dd-90b9-4c85-83eb-4cd8fe2a0d99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:50.677022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcaa61dd-90b9-4c85-83eb-4cd8fe2a0d99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:50.677987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcaa61dd-90b9-4c85-83eb-4cd8fe2a0d99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:50.678888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcaa61dd-90b9-4c85-83eb-4cd8fe2a0d99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:50.679578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcaa61dd-90b9-4c85-83eb-4cd8fe2a0d99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:50.941991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fcaa61dd-90b9-4c85-83eb-4cd8fe2a0d99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:50.950623 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fcaa61dd-90b9-4c85-83eb-4cd8fe2a0d99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.290793 Oct 12 22:02:50.967452 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 488/910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:50 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:50.972993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f6e1427b-e33d-48a3-9464-31d6fd80dd65 req-ecd30e5b-022e-4fb2-b083-f71dc6fdcab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7169b167-a2fd-4983-af2e-bcc24daf9b72", "tag": "40bd5146-e5e9-4d7e-aa69-34a079389240"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:50.984501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f6e1427b-e33d-48a3-9464-31d6fd80dd65 req-ecd30e5b-022e-4fb2-b083-f71dc6fdcab2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:50.986065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f6e1427b-e33d-48a3-9464-31d6fd80dd65 req-ecd30e5b-022e-4fb2-b083-f71dc6fdcab2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:50.986719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f6e1427b-e33d-48a3-9464-31d6fd80dd65 req-ecd30e5b-022e-4fb2-b083-f71dc6fdcab2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:51.006633 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f6e1427b-e33d-48a3-9464-31d6fd80dd65 req-ecd30e5b-022e-4fb2-b083-f71dc6fdcab2 service nova] Creating event network-changed:40bd5146-e5e9-4d7e-aa69-34a079389240 for instance 7169b167-a2fd-4983-af2e-bcc24daf9b72 on n-h1-861111-1 Oct 12 22:02:51.016810 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f6e1427b-e33d-48a3-9464-31d6fd80dd65 req-ecd30e5b-022e-4fb2-b083-f71dc6fdcab2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055490 Oct 12 22:02:51.022441 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 489/911] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:51.028918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0d63d8c4-f503-4080-8415-d831dd9ef384 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51285ae040>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:51.121487 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0d63d8c4-f503-4080-8415-d831dd9ef384 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1453 microversion: 2.1 time: 0.097495 Oct 12 22:02:51.122297 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 490/912] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:51 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:51.176947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a35f6b85-e61d-431d-b002-0a99862e307b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:51.178193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a35f6b85-e61d-431d-b002-0a99862e307b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:51.188603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35f6b85-e61d-431d-b002-0a99862e307b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:51.189455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35f6b85-e61d-431d-b002-0a99862e307b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:51.190082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35f6b85-e61d-431d-b002-0a99862e307b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:51.190991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35f6b85-e61d-431d-b002-0a99862e307b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:51.191631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35f6b85-e61d-431d-b002-0a99862e307b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:51.192216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35f6b85-e61d-431d-b002-0a99862e307b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:51.458098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a35f6b85-e61d-431d-b002-0a99862e307b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:51.508475 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a35f6b85-e61d-431d-b002-0a99862e307b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1472 microversion: 2.1 time: 0.331162 Oct 12 22:02:51.523314 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 491/913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:51 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1472 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:51.523314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ed352d45-b4cc-4b9d-ba21-1250ec7ecbdf tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:51.523314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ed352d45-b4cc-4b9d-ba21-1250ec7ecbdf tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:51.552344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed352d45-b4cc-4b9d-ba21-1250ec7ecbdf tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:51.552996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed352d45-b4cc-4b9d-ba21-1250ec7ecbdf tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:51.553661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed352d45-b4cc-4b9d-ba21-1250ec7ecbdf tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:51.556288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed352d45-b4cc-4b9d-ba21-1250ec7ecbdf tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:51.556288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed352d45-b4cc-4b9d-ba21-1250ec7ecbdf tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:51.556288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed352d45-b4cc-4b9d-ba21-1250ec7ecbdf tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:51.996455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ed352d45-b4cc-4b9d-ba21-1250ec7ecbdf tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:52.012001 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ed352d45-b4cc-4b9d-ba21-1250ec7ecbdf tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1368 microversion: 2.1 time: 0.494108 Oct 12 22:02:52.012664 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 492/914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:51 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1368 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:52.034115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7809b4d0-c266-460c-8b9a-429527990b90 tempest-ServersWithSpecificFlavorTestJSON-386270835 tempest-ServersWithSpecificFlavorTestJSON-386270835-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:52.066515 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7809b4d0-c266-460c-8b9a-429527990b90 tempest-ServersWithSpecificFlavorTestJSON-386270835 tempest-ServersWithSpecificFlavorTestJSON-386270835-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1418581079" status: 202 len: 0 microversion: 2.1 time: 0.036476 Oct 12 22:02:52.068041 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 493/915] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 12 22:02:52 2022] DELETE /compute/v2.1/flavors/1418581079 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:02:52.076190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-338a0e10-0dd1-40ff-9922-b13f934eff1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:52.077196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-338a0e10-0dd1-40ff-9922-b13f934eff1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:52.087456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-338a0e10-0dd1-40ff-9922-b13f934eff1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:52.088924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-338a0e10-0dd1-40ff-9922-b13f934eff1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:52.090167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-338a0e10-0dd1-40ff-9922-b13f934eff1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:52.095292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-338a0e10-0dd1-40ff-9922-b13f934eff1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:52.096039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-338a0e10-0dd1-40ff-9922-b13f934eff1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:52.096887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-338a0e10-0dd1-40ff-9922-b13f934eff1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:52.321863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=16 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:52.520274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-338a0e10-0dd1-40ff-9922-b13f934eff1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:52.528694 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-338a0e10-0dd1-40ff-9922-b13f934eff1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1308 microversion: 2.1 time: 0.459294 Oct 12 22:02:52.535470 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 494/916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:52 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1308 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:52.542613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2e366704-9eb6-4659-8775-f1031d6699b6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:52.543563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2e366704-9eb6-4659-8775-f1031d6699b6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:52.551586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:52.554040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e366704-9eb6-4659-8775-f1031d6699b6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:52.554552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e366704-9eb6-4659-8775-f1031d6699b6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:52.554990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e366704-9eb6-4659-8775-f1031d6699b6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:52.556230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e366704-9eb6-4659-8775-f1031d6699b6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:52.556700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e366704-9eb6-4659-8775-f1031d6699b6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:52.557295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e366704-9eb6-4659-8775-f1031d6699b6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:52.749787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2e366704-9eb6-4659-8775-f1031d6699b6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:52.762777 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2e366704-9eb6-4659-8775-f1031d6699b6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.225538 Oct 12 22:02:52.776378 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 495/917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:52 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:52.785064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d3f701f1-591a-4131-a663-699a73cb165d tempest-ServersWithSpecificFlavorTestJSON-386270835 tempest-ServersWithSpecificFlavorTestJSON-386270835-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:52.809988 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d3f701f1-591a-4131-a663-699a73cb165d tempest-ServersWithSpecificFlavorTestJSON-386270835 tempest-ServersWithSpecificFlavorTestJSON-386270835-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5401 microversion: 2.1 time: 0.032401 Oct 12 22:02:52.820678 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 496/918] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:02:52 2022] GET /compute/v2.1/flavors/detail => generated 5401 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:52.820678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-322b60c3-cb1f-43b1-a495-e64601b41f83 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51287679d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:52.864507 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-322b60c3-cb1f-43b1-a495-e64601b41f83 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1462 microversion: 2.1 time: 0.052348 Oct 12 22:02:52.874349 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 497/919] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:52 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1462 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:52.882453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f56afe30-8e4c-41c0-92c2-f315cde553ed tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:52.883165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f56afe30-8e4c-41c0-92c2-f315cde553ed tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:52.890432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f56afe30-8e4c-41c0-92c2-f315cde553ed tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:52.891195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f56afe30-8e4c-41c0-92c2-f315cde553ed tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:52.891662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f56afe30-8e4c-41c0-92c2-f315cde553ed tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:52.892440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f56afe30-8e4c-41c0-92c2-f315cde553ed tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:52.892894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f56afe30-8e4c-41c0-92c2-f315cde553ed tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:52.893314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f56afe30-8e4c-41c0-92c2-f315cde553ed tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:52.940645 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5d2aa4dc-1b03-480e-91cb-665ea19cce2c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10/action" status: 202 len: 0 microversion: 2.25 time: 2.785315 Oct 12 22:02:52.941568 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 423/920] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 12 22:02:50 2022] POST /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10/action => generated 0 bytes in 2789 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:02:52.945990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5c298f86-8afe-4c35-b3a6-1051193d265c tempest-ServersWithSpecificFlavorTestJSON-386270835 tempest-ServersWithSpecificFlavorTestJSON-386270835-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:52.967316 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5c298f86-8afe-4c35-b3a6-1051193d265c tempest-ServersWithSpecificFlavorTestJSON-386270835 tempest-ServersWithSpecificFlavorTestJSON-386270835-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/512672274" status: 202 len: 0 microversion: 2.1 time: 0.024655 Oct 12 22:02:52.968139 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 424/921] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 12 22:02:52 2022] DELETE /compute/v2.1/flavors/512672274 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:02:52.973104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-278dac42-e181-420f-921a-d6fb081e66f3 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512862d1f0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:53.019726 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-278dac42-e181-420f-921a-d6fb081e66f3 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 200 len: 1462 microversion: 2.1 time: 0.050202 Oct 12 22:02:53.020413 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 425/922] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:52 2022] GET /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 1462 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:53.025114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c6469acb-dfa5-49a1-99db-823fca018c22 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:53.025710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c6469acb-dfa5-49a1-99db-823fca018c22 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:53.032726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6469acb-dfa5-49a1-99db-823fca018c22 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.033129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f56afe30-8e4c-41c0-92c2-f315cde553ed tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:53.033268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6469acb-dfa5-49a1-99db-823fca018c22 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.033621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6469acb-dfa5-49a1-99db-823fca018c22 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:53.034319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6469acb-dfa5-49a1-99db-823fca018c22 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.034764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6469acb-dfa5-49a1-99db-823fca018c22 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.035182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6469acb-dfa5-49a1-99db-823fca018c22 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:53.041507 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f56afe30-8e4c-41c0-92c2-f315cde553ed tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1472 microversion: 2.1 time: 0.175356 Oct 12 22:02:53.042079 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 498/923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:52 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1472 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:53.046462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5c2a9fcc-c6c9-4eaa-964e-714ffe3a5580 tempest-ServersWithSpecificFlavorTestJSON-386270835 tempest-ServersWithSpecificFlavorTestJSON-386270835-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:53.066581 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5c2a9fcc-c6c9-4eaa-964e-714ffe3a5580 tempest-ServersWithSpecificFlavorTestJSON-386270835 tempest-ServersWithSpecificFlavorTestJSON-386270835-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023498 Oct 12 22:02:53.067183 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 499/924] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:02:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:53.072390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a35b11b9-af95-44ab-b97a-e32fa5d5b833 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:53.073010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a35b11b9-af95-44ab-b97a-e32fa5d5b833 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:53.084966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35b11b9-af95-44ab-b97a-e32fa5d5b833 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.085892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35b11b9-af95-44ab-b97a-e32fa5d5b833 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.086569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35b11b9-af95-44ab-b97a-e32fa5d5b833 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:53.088161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35b11b9-af95-44ab-b97a-e32fa5d5b833 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.088628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35b11b9-af95-44ab-b97a-e32fa5d5b833 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.089061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35b11b9-af95-44ab-b97a-e32fa5d5b833 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:53.173133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c6469acb-dfa5-49a1-99db-823fca018c22 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:53.183445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c6469acb-dfa5-49a1-99db-823fca018c22 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:53.186800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c6469acb-dfa5-49a1-99db-823fca018c22 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:53.188052 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c6469acb-dfa5-49a1-99db-823fca018c22 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1567 microversion: 2.25 time: 0.166531 Oct 12 22:02:53.189026 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 426/925] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:53 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:53.193670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5574f34e-a150-4a95-b66c-e0724e683d49 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:53.194504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5574f34e-a150-4a95-b66c-e0724e683d49 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: cf71b2a6-484b-4e05-80fb-89be6b98546a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:53.201230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5574f34e-a150-4a95-b66c-e0724e683d49 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.201929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5574f34e-a150-4a95-b66c-e0724e683d49 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.202527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5574f34e-a150-4a95-b66c-e0724e683d49 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:53.203414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5574f34e-a150-4a95-b66c-e0724e683d49 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.204011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5574f34e-a150-4a95-b66c-e0724e683d49 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.204580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5574f34e-a150-4a95-b66c-e0724e683d49 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:53.313665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a35b11b9-af95-44ab-b97a-e32fa5d5b833 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:53.322157 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a35b11b9-af95-44ab-b97a-e32fa5d5b833 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1368 microversion: 2.1 time: 0.253964 Oct 12 22:02:53.342503 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 500/926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:53 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:53.345245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5574f34e-a150-4a95-b66c-e0724e683d49 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:53.349755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f48f7ab5-5edf-4f78-beae-3f53a8ca27b1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:53.350276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f48f7ab5-5edf-4f78-beae-3f53a8ca27b1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:53.353619 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5574f34e-a150-4a95-b66c-e0724e683d49 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a" status: 200 len: 1480 microversion: 2.1 time: 0.163411 Oct 12 22:02:53.354539 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 427/927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:53 2022] GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a => generated 1480 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:53.356299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f48f7ab5-5edf-4f78-beae-3f53a8ca27b1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.356790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f48f7ab5-5edf-4f78-beae-3f53a8ca27b1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.358124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f48f7ab5-5edf-4f78-beae-3f53a8ca27b1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:53.359002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f48f7ab5-5edf-4f78-beae-3f53a8ca27b1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.359524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f48f7ab5-5edf-4f78-beae-3f53a8ca27b1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.359986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f48f7ab5-5edf-4f78-beae-3f53a8ca27b1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:53.376537 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-f48f7ab5-5edf-4f78-beae-3f53a8ca27b1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] HTTP exception thrown: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f48f7ab5-5edf-4f78-beae-3f53a8ca27b1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Request method failure captured: Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d HTTP/1.1 Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzi3KLy8xTG7iLEKjLPpDM_nWqKfwDlc85rWMzsSynyHHjO7IS11Jz0CpCqdnz8tLEnf4Fs-KbmVZoWzqslb1pfSiHYZRn9Nh3U75-JOuzxOK9mQUlMfpWdC-atqfnWLaLWjh_BvE05bsPdiDl99vUIKsISpTaysZJU9rKnuVTrXxd8 Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: a5e1f0c64d2e4154a3c0749af66adb6a Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:02:53.378887 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:02:53.380381 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a5e1f0c64d2e4154a3c0749af66adb6a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:02:53.380381 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:53.380381 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: a5e1f0c64d2e4154a3c0749af66adb6a Oct 12 22:02:53.380381 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:53.380381 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersWithSpecificFlavorTestJSON-721140800-project Oct 12 22:02:53.380381 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:02:53.380381 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:02:53.380381 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 11b16666035d4646a403d79d83f9a67b Oct 12 22:02:53.380381 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800-project Oct 12 22:02:53.380381 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:02:53.380381 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. Oct 12 22:02:53.380381 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1a164670-124d-407d-a4d1-940846b45e2d'} Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:02:53.381170 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. Oct 12 22:02:53.382464 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.383759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f48f7ab5-5edf-4f78-beae-3f53a8ca27b1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Returning 404 to user: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:02:53.383759 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f48f7ab5-5edf-4f78-beae-3f53a8ca27b1 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 404 len: 111 microversion: 2.1 time: 0.036692 Oct 12 22:02:53.383759 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 501/928] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:02:53 2022] DELETE /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:02:53.390538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4be1f21b-6291-4220-94cb-21c3ce6e6b51 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:53.391381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4be1f21b-6291-4220-94cb-21c3ce6e6b51 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1a164670-124d-407d-a4d1-940846b45e2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:53.393233 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:53.398000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4be1f21b-6291-4220-94cb-21c3ce6e6b51 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.398612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4be1f21b-6291-4220-94cb-21c3ce6e6b51 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.399049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4be1f21b-6291-4220-94cb-21c3ce6e6b51 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:53.399790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4be1f21b-6291-4220-94cb-21c3ce6e6b51 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.400258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4be1f21b-6291-4220-94cb-21c3ce6e6b51 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.400717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4be1f21b-6291-4220-94cb-21c3ce6e6b51 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:53.417422 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-4be1f21b-6291-4220-94cb-21c3ce6e6b51 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] HTTP exception thrown: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4be1f21b-6291-4220-94cb-21c3ce6e6b51 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Request method failure captured: Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d HTTP/1.1 Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzi3KLy8xTG7iLEKjLPpDM_nWqKfwDlc85rWMzsSynyHHjO7IS11Jz0CpCqdnz8tLEnf4Fs-KbmVZoWzqslb1pfSiHYZRn9Nh3U75-JOuzxOK9mQUlMfpWdC-atqfnWLaLWjh_BvE05bsPdiDl99vUIKsISpTaysZJU9rKnuVTrXxd8 Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: a5e1f0c64d2e4154a3c0749af66adb6a Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:02:53.418884 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:02:53.420408 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a5e1f0c64d2e4154a3c0749af66adb6a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:02:53.420408 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:53.420408 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: a5e1f0c64d2e4154a3c0749af66adb6a Oct 12 22:02:53.420408 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:53.420408 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersWithSpecificFlavorTestJSON-721140800-project Oct 12 22:02:53.420408 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:02:53.420408 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:02:53.420408 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11b16666035d4646a403d79d83f9a67b Oct 12 22:02:53.420408 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800-project Oct 12 22:02:53.420408 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:02:53.420408 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. Oct 12 22:02:53.420408 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '1a164670-124d-407d-a4d1-940846b45e2d'} Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:02:53.421239 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. Oct 12 22:02:53.422401 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.423454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4be1f21b-6291-4220-94cb-21c3ce6e6b51 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Returning 404 to user: Instance 1a164670-124d-407d-a4d1-940846b45e2d could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:02:53.423454 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4be1f21b-6291-4220-94cb-21c3ce6e6b51 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d" status: 404 len: 111 microversion: 2.1 time: 0.034873 Oct 12 22:02:53.423454 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 428/929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:53 2022] GET /compute/v2.1/servers/1a164670-124d-407d-a4d1-940846b45e2d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:02:53.428956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-977c6a00-7fe8-4c45-a117-bc0bb454392e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:53.429483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-977c6a00-7fe8-4c45-a117-bc0bb454392e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:53.436136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-977c6a00-7fe8-4c45-a117-bc0bb454392e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.436619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-977c6a00-7fe8-4c45-a117-bc0bb454392e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.437042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-977c6a00-7fe8-4c45-a117-bc0bb454392e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:53.437755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-977c6a00-7fe8-4c45-a117-bc0bb454392e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.438200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-977c6a00-7fe8-4c45-a117-bc0bb454392e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.438620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-977c6a00-7fe8-4c45-a117-bc0bb454392e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:53.452511 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-977c6a00-7fe8-4c45-a117-bc0bb454392e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] HTTP exception thrown: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-977c6a00-7fe8-4c45-a117-bc0bb454392e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Request method failure captured: Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d HTTP/1.1 Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzi3KLy8xTG7iLEKjLPpDM_nWqKfwDlc85rWMzsSynyHHjO7IS11Jz0CpCqdnz8tLEnf4Fs-KbmVZoWzqslb1pfSiHYZRn9Nh3U75-JOuzxOK9mQUlMfpWdC-atqfnWLaLWjh_BvE05bsPdiDl99vUIKsISpTaysZJU9rKnuVTrXxd8 Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: a5e1f0c64d2e4154a3c0749af66adb6a Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:02:53.454045 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:02:53.455603 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a5e1f0c64d2e4154a3c0749af66adb6a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:02:53.455603 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:53.455603 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: a5e1f0c64d2e4154a3c0749af66adb6a Oct 12 22:02:53.455603 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:53.455603 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersWithSpecificFlavorTestJSON-721140800-project Oct 12 22:02:53.455603 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:02:53.455603 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:02:53.455603 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 11b16666035d4646a403d79d83f9a67b Oct 12 22:02:53.455603 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800-project Oct 12 22:02:53.455603 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:02:53.455603 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:53.455603 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1848e1da-8fef-4d2e-93b0-87af0c4fe39d'} Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:02:53.456534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:53.457742 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.458938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-977c6a00-7fe8-4c45-a117-bc0bb454392e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Returning 404 to user: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:02:53.458938 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-977c6a00-7fe8-4c45-a117-bc0bb454392e tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 404 len: 111 microversion: 2.1 time: 0.030573 Oct 12 22:02:53.458938 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 502/930] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:02:53 2022] DELETE /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:02:53.465050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c8d8ba5e-f522-4fa1-8779-1539c8555ae0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:53.465666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c8d8ba5e-f522-4fa1-8779-1539c8555ae0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] [instance: 1848e1da-8fef-4d2e-93b0-87af0c4fe39d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:53.472090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8d8ba5e-f522-4fa1-8779-1539c8555ae0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.472571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8d8ba5e-f522-4fa1-8779-1539c8555ae0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.473010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8d8ba5e-f522-4fa1-8779-1539c8555ae0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:53.473697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8d8ba5e-f522-4fa1-8779-1539c8555ae0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.474149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8d8ba5e-f522-4fa1-8779-1539c8555ae0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.474571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8d8ba5e-f522-4fa1-8779-1539c8555ae0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:53.488432 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-c8d8ba5e-f522-4fa1-8779-1539c8555ae0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] HTTP exception thrown: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c8d8ba5e-f522-4fa1-8779-1539c8555ae0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Request method failure captured: Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d HTTP/1.1 Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzi3KLy8xTG7iLEKjLPpDM_nWqKfwDlc85rWMzsSynyHHjO7IS11Jz0CpCqdnz8tLEnf4Fs-KbmVZoWzqslb1pfSiHYZRn9Nh3U75-JOuzxOK9mQUlMfpWdC-atqfnWLaLWjh_BvE05bsPdiDl99vUIKsISpTaysZJU9rKnuVTrXxd8 Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: a5e1f0c64d2e4154a3c0749af66adb6a Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:02:53.489935 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:02:53.491468 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a5e1f0c64d2e4154a3c0749af66adb6a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a5e1f0c64d2e4154a3c0749af66adb6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:02:53.491468 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:53.491468 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: a5e1f0c64d2e4154a3c0749af66adb6a Oct 12 22:02:53.491468 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800 Oct 12 22:02:53.491468 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersWithSpecificFlavorTestJSON-721140800-project Oct 12 22:02:53.491468 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:02:53.491468 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:02:53.491468 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11b16666035d4646a403d79d83f9a67b Oct 12 22:02:53.491468 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-721140800-project Oct 12 22:02:53.491468 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:02:53.491468 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:53.491468 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '1848e1da-8fef-4d2e-93b0-87af0c4fe39d'} Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:02:53.492289 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. Oct 12 22:02:53.493650 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:02:53.494896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c8d8ba5e-f522-4fa1-8779-1539c8555ae0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] Returning 404 to user: Instance 1848e1da-8fef-4d2e-93b0-87af0c4fe39d could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:02:53.494896 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c8d8ba5e-f522-4fa1-8779-1539c8555ae0 tempest-ServersWithSpecificFlavorTestJSON-721140800 tempest-ServersWithSpecificFlavorTestJSON-721140800-project] 10.222.0.16 "GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d" status: 404 len: 111 microversion: 2.1 time: 0.031071 Oct 12 22:02:53.494896 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 429/931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:53 2022] GET /compute/v2.1/servers/1848e1da-8fef-4d2e-93b0-87af0c4fe39d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:02:53.552196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-be1a64a0-ed4d-45e8-a842-2cb9df04cd7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:53.552923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-be1a64a0-ed4d-45e8-a842-2cb9df04cd7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:53.558859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be1a64a0-ed4d-45e8-a842-2cb9df04cd7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.559438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be1a64a0-ed4d-45e8-a842-2cb9df04cd7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.559870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be1a64a0-ed4d-45e8-a842-2cb9df04cd7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:53.560555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be1a64a0-ed4d-45e8-a842-2cb9df04cd7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.561001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be1a64a0-ed4d-45e8-a842-2cb9df04cd7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.561420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be1a64a0-ed4d-45e8-a842-2cb9df04cd7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:53.697570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-be1a64a0-ed4d-45e8-a842-2cb9df04cd7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:53.705691 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-be1a64a0-ed4d-45e8-a842-2cb9df04cd7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1308 microversion: 2.1 time: 0.157466 Oct 12 22:02:53.706260 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 503/932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:53 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1308 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:53.790018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8e1ec934-5937-46c2-a21f-694adde23ea0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:53.790721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8e1ec934-5937-46c2-a21f-694adde23ea0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:53.797429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e1ec934-5937-46c2-a21f-694adde23ea0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.797923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e1ec934-5937-46c2-a21f-694adde23ea0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.798360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e1ec934-5937-46c2-a21f-694adde23ea0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:53.799053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e1ec934-5937-46c2-a21f-694adde23ea0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:53.799535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e1ec934-5937-46c2-a21f-694adde23ea0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:53.799967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e1ec934-5937-46c2-a21f-694adde23ea0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:54.029382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8e1ec934-5937-46c2-a21f-694adde23ea0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:54.037855 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8e1ec934-5937-46c2-a21f-694adde23ea0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.251807 Oct 12 22:02:54.038416 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 430/933] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:53 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:54.064318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f23abf37-2fe8-444d-931b-b3f9fe7f5247 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:54.064960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f23abf37-2fe8-444d-931b-b3f9fe7f5247 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:54.071692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f23abf37-2fe8-444d-931b-b3f9fe7f5247 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:54.072181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f23abf37-2fe8-444d-931b-b3f9fe7f5247 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:54.072629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f23abf37-2fe8-444d-931b-b3f9fe7f5247 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:54.073328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f23abf37-2fe8-444d-931b-b3f9fe7f5247 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:54.073779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f23abf37-2fe8-444d-931b-b3f9fe7f5247 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:54.074204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f23abf37-2fe8-444d-931b-b3f9fe7f5247 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:54.220392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-820ea0c8-dea3-48d0-829c-83a189037289 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:54.221738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-820ea0c8-dea3-48d0-829c-83a189037289 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:54.229427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-820ea0c8-dea3-48d0-829c-83a189037289 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:54.230301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-820ea0c8-dea3-48d0-829c-83a189037289 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:54.231892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-820ea0c8-dea3-48d0-829c-83a189037289 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:54.233340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-820ea0c8-dea3-48d0-829c-83a189037289 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:54.234609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-820ea0c8-dea3-48d0-829c-83a189037289 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:54.235828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-820ea0c8-dea3-48d0-829c-83a189037289 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:54.366745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f23abf37-2fe8-444d-931b-b3f9fe7f5247 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:54.378701 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f23abf37-2fe8-444d-931b-b3f9fe7f5247 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1472 microversion: 2.1 time: 0.317143 Oct 12 22:02:54.388519 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 504/934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:54 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1472 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:54.399021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0606f833-d01c-4f6a-925f-f1051729bac0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:54.400032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0606f833-d01c-4f6a-925f-f1051729bac0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:54.408186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0606f833-d01c-4f6a-925f-f1051729bac0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:54.408681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0606f833-d01c-4f6a-925f-f1051729bac0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:54.409125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0606f833-d01c-4f6a-925f-f1051729bac0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:54.409830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0606f833-d01c-4f6a-925f-f1051729bac0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:54.410418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0606f833-d01c-4f6a-925f-f1051729bac0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:54.410858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0606f833-d01c-4f6a-925f-f1051729bac0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:54.659416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-820ea0c8-dea3-48d0-829c-83a189037289 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:54.669260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-820ea0c8-dea3-48d0-829c-83a189037289 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:54.672305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-820ea0c8-dea3-48d0-829c-83a189037289 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:54.673629 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-820ea0c8-dea3-48d0-829c-83a189037289 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1567 microversion: 2.25 time: 0.458804 Oct 12 22:02:54.674345 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 431/935] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:54 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1567 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:54.679367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5fa8f5d1-3432-4394-8490-3372a0add076 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:54.680284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5fa8f5d1-3432-4394-8490-3372a0add076 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: cf71b2a6-484b-4e05-80fb-89be6b98546a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:54.703561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fa8f5d1-3432-4394-8490-3372a0add076 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:54.704207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fa8f5d1-3432-4394-8490-3372a0add076 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:54.705315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fa8f5d1-3432-4394-8490-3372a0add076 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:54.706155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fa8f5d1-3432-4394-8490-3372a0add076 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:54.706732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fa8f5d1-3432-4394-8490-3372a0add076 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:54.707408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fa8f5d1-3432-4394-8490-3372a0add076 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:54.936944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0606f833-d01c-4f6a-925f-f1051729bac0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:54.945944 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0606f833-d01c-4f6a-925f-f1051729bac0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1368 microversion: 2.1 time: 0.552646 Oct 12 22:02:54.946966 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 505/936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:54 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1368 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:54.952344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8a2f95c5-e5a7-4800-b0ab-aaf6c2f7630c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:54.953056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8a2f95c5-e5a7-4800-b0ab-aaf6c2f7630c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:54.958837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2f95c5-e5a7-4800-b0ab-aaf6c2f7630c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:54.959466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2f95c5-e5a7-4800-b0ab-aaf6c2f7630c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:54.960028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2f95c5-e5a7-4800-b0ab-aaf6c2f7630c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:54.961180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2f95c5-e5a7-4800-b0ab-aaf6c2f7630c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:54.961735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2f95c5-e5a7-4800-b0ab-aaf6c2f7630c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:54.962734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2f95c5-e5a7-4800-b0ab-aaf6c2f7630c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:55.075287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5fa8f5d1-3432-4394-8490-3372a0add076 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:55.083838 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5fa8f5d1-3432-4394-8490-3372a0add076 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a" status: 200 len: 1467 microversion: 2.1 time: 0.408209 Oct 12 22:02:55.084957 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 432/937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:54 2022] GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a => generated 1467 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:55.089870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-a1612fac-a4bb-4fb8-add3-971d28b5bee9 req-f5a0ca7b-bc35-4a6e-8869-9d4ba9ed93de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d4b3e47-bbd0-4adc-9173-d7f9ccd96221", "name": "network-vif-plugged", "status": "completed", "tag": "6ec98f33-ae19-4190-819a-9fe3d4ca011c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:55.100170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a1612fac-a4bb-4fb8-add3-971d28b5bee9 req-f5a0ca7b-bc35-4a6e-8869-9d4ba9ed93de service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:55.100915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a1612fac-a4bb-4fb8-add3-971d28b5bee9 req-f5a0ca7b-bc35-4a6e-8869-9d4ba9ed93de service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:55.101502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a1612fac-a4bb-4fb8-add3-971d28b5bee9 req-f5a0ca7b-bc35-4a6e-8869-9d4ba9ed93de service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:55.114896 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-a1612fac-a4bb-4fb8-add3-971d28b5bee9 req-f5a0ca7b-bc35-4a6e-8869-9d4ba9ed93de service nova] Creating event network-vif-plugged:6ec98f33-ae19-4190-819a-9fe3d4ca011c for instance 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 on n-h1-861111-1 Oct 12 22:02:55.121937 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-a1612fac-a4bb-4fb8-add3-971d28b5bee9 req-f5a0ca7b-bc35-4a6e-8869-9d4ba9ed93de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035110 Oct 12 22:02:55.122769 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 433/938] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:55.131609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83b932ac-e47b-4a06-a9aa-cad75c2c5039 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:55.142169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-83b932ac-e47b-4a06-a9aa-cad75c2c5039 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:55.149770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83b932ac-e47b-4a06-a9aa-cad75c2c5039 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:55.150506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83b932ac-e47b-4a06-a9aa-cad75c2c5039 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:55.151113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83b932ac-e47b-4a06-a9aa-cad75c2c5039 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:55.152006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83b932ac-e47b-4a06-a9aa-cad75c2c5039 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:55.152595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83b932ac-e47b-4a06-a9aa-cad75c2c5039 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:55.154982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83b932ac-e47b-4a06-a9aa-cad75c2c5039 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:55.218425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8a2f95c5-e5a7-4800-b0ab-aaf6c2f7630c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:55.226915 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8a2f95c5-e5a7-4800-b0ab-aaf6c2f7630c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1308 microversion: 2.1 time: 0.278584 Oct 12 22:02:55.228494 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 506/939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:54 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1308 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:55.234173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cbbfb8b4-a874-4544-81d1-98c3f77b3813 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-864225999"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:55.237176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cbbfb8b4-a874-4544-81d1-98c3f77b3813 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:55.258542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbbfb8b4-a874-4544-81d1-98c3f77b3813 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:55.260011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbbfb8b4-a874-4544-81d1-98c3f77b3813 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:55.260682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbbfb8b4-a874-4544-81d1-98c3f77b3813 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:55.262140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbbfb8b4-a874-4544-81d1-98c3f77b3813 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:55.262961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbbfb8b4-a874-4544-81d1-98c3f77b3813 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:55.266703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbbfb8b4-a874-4544-81d1-98c3f77b3813 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:55.527035 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cbbfb8b4-a874-4544-81d1-98c3f77b3813 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "POST /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f/action" status: 202 len: 0 microversion: 2.1 time: 0.296521 Oct 12 22:02:55.528573 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 507/940] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:02:55 2022] POST /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:02:55.538517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-82a53b5c-207d-4fd1-bbf0-7092f23e8df9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:55.539341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-82a53b5c-207d-4fd1-bbf0-7092f23e8df9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:55.546871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82a53b5c-207d-4fd1-bbf0-7092f23e8df9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:55.547462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82a53b5c-207d-4fd1-bbf0-7092f23e8df9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:55.547970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82a53b5c-207d-4fd1-bbf0-7092f23e8df9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:55.548988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82a53b5c-207d-4fd1-bbf0-7092f23e8df9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:55.549510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82a53b5c-207d-4fd1-bbf0-7092f23e8df9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:55.550535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82a53b5c-207d-4fd1-bbf0-7092f23e8df9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:55.580647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-83b932ac-e47b-4a06-a9aa-cad75c2c5039 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:55.593018 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-83b932ac-e47b-4a06-a9aa-cad75c2c5039 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1505 microversion: 2.1 time: 0.468086 Oct 12 22:02:55.611422 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 434/941] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:55 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1505 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:55.618809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c13eea69-a95a-42d7-b853-86c42312b486 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128653d30>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:55.665097 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c13eea69-a95a-42d7-b853-86c42312b486 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.052145 Oct 12 22:02:55.666892 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 435/942] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:55 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:55.702756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2f7358bd-c3da-4e13-aec1-867706c5a33e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:55.703748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f7358bd-c3da-4e13-aec1-867706c5a33e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:55.713102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f7358bd-c3da-4e13-aec1-867706c5a33e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:55.715089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f7358bd-c3da-4e13-aec1-867706c5a33e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:55.715804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f7358bd-c3da-4e13-aec1-867706c5a33e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:55.717017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f7358bd-c3da-4e13-aec1-867706c5a33e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:55.717907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f7358bd-c3da-4e13-aec1-867706c5a33e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:55.718508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f7358bd-c3da-4e13-aec1-867706c5a33e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:55.739620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-82a53b5c-207d-4fd1-bbf0-7092f23e8df9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:55.752806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:55.764581 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-82a53b5c-207d-4fd1-bbf0-7092f23e8df9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1477 microversion: 2.1 time: 0.234017 Oct 12 22:02:55.776946 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 508/943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:55 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1477 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:55.976184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c22edfee-761c-46d1-a3a8-db6e28a214ca tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:55.977182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c22edfee-761c-46d1-a3a8-db6e28a214ca tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:55.984604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c22edfee-761c-46d1-a3a8-db6e28a214ca tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:55.985147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c22edfee-761c-46d1-a3a8-db6e28a214ca tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:55.985638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c22edfee-761c-46d1-a3a8-db6e28a214ca tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:55.986336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c22edfee-761c-46d1-a3a8-db6e28a214ca tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:55.986784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c22edfee-761c-46d1-a3a8-db6e28a214ca tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:55.987385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c22edfee-761c-46d1-a3a8-db6e28a214ca tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:56.134501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c22edfee-761c-46d1-a3a8-db6e28a214ca tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:56.144942 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c22edfee-761c-46d1-a3a8-db6e28a214ca tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1368 microversion: 2.1 time: 0.172754 Oct 12 22:02:56.158872 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 509/944] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:55 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:56.161491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f7358bd-c3da-4e13-aec1-867706c5a33e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:56.172459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f7358bd-c3da-4e13-aec1-867706c5a33e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:56.172992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f7358bd-c3da-4e13-aec1-867706c5a33e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:56.174602 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2f7358bd-c3da-4e13-aec1-867706c5a33e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1567 microversion: 2.25 time: 0.477121 Oct 12 22:02:56.180107 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 436/945] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:55 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1567 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:56.252347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-039fe211-0904-4e27-8018-9b0087d688ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:56.253192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-039fe211-0904-4e27-8018-9b0087d688ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:56.265344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-039fe211-0904-4e27-8018-9b0087d688ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:56.265840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-039fe211-0904-4e27-8018-9b0087d688ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:56.266275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-039fe211-0904-4e27-8018-9b0087d688ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:56.267166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-039fe211-0904-4e27-8018-9b0087d688ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:56.267689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-039fe211-0904-4e27-8018-9b0087d688ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:56.268109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-039fe211-0904-4e27-8018-9b0087d688ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:56.414138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-039fe211-0904-4e27-8018-9b0087d688ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:56.422683 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-039fe211-0904-4e27-8018-9b0087d688ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1308 microversion: 2.1 time: 0.174632 Oct 12 22:02:56.423509 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 510/946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:56 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:56.619867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-61869050-ab65-4ba6-b86a-825cab43d036 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:56.620695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-61869050-ab65-4ba6-b86a-825cab43d036 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:56.630119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61869050-ab65-4ba6-b86a-825cab43d036 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:56.630612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61869050-ab65-4ba6-b86a-825cab43d036 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:56.631045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61869050-ab65-4ba6-b86a-825cab43d036 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:56.631787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61869050-ab65-4ba6-b86a-825cab43d036 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:56.632244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61869050-ab65-4ba6-b86a-825cab43d036 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:56.632670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61869050-ab65-4ba6-b86a-825cab43d036 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:56.681864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c50f8f77-aa47-4aac-aab4-758ba9955978 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51287c89d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:56.739764 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c50f8f77-aa47-4aac-aab4-758ba9955978 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.062160 Oct 12 22:02:56.740884 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 511/947] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:56 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:56.794181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a10f1ad6-9e54-440c-aa8c-fd06b5e1d3a3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:56.795914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a10f1ad6-9e54-440c-aa8c-fd06b5e1d3a3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:56.807027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a10f1ad6-9e54-440c-aa8c-fd06b5e1d3a3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:56.807973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a10f1ad6-9e54-440c-aa8c-fd06b5e1d3a3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:56.808672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a10f1ad6-9e54-440c-aa8c-fd06b5e1d3a3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:56.809597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a10f1ad6-9e54-440c-aa8c-fd06b5e1d3a3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:56.811019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a10f1ad6-9e54-440c-aa8c-fd06b5e1d3a3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:56.811704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a10f1ad6-9e54-440c-aa8c-fd06b5e1d3a3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:56.865973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-61869050-ab65-4ba6-b86a-825cab43d036 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:56.869219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:02:56.880033 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-61869050-ab65-4ba6-b86a-825cab43d036 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1485 microversion: 2.1 time: 0.265054 Oct 12 22:02:56.881784 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 437/948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:56 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1485 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:56.907093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d2cb6d99-ace1-4741-ab52-7bbea647691f req-5fac0914-8fcb-4355-8b37-6b8554067ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e615f0-f403-426c-a0c9-73cc9b810d10", "name": "network-vif-unplugged", "status": "completed", "tag": "38be05fb-8b40-41e5-b46a-fd8537f3988f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:56.939712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d2cb6d99-ace1-4741-ab52-7bbea647691f req-5fac0914-8fcb-4355-8b37-6b8554067ce8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:56.941360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d2cb6d99-ace1-4741-ab52-7bbea647691f req-5fac0914-8fcb-4355-8b37-6b8554067ce8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:56.941999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d2cb6d99-ace1-4741-ab52-7bbea647691f req-5fac0914-8fcb-4355-8b37-6b8554067ce8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:56.960363 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d2cb6d99-ace1-4741-ab52-7bbea647691f req-5fac0914-8fcb-4355-8b37-6b8554067ce8 service nova] Creating event network-vif-unplugged:38be05fb-8b40-41e5-b46a-fd8537f3988f for instance e0e615f0-f403-426c-a0c9-73cc9b810d10 on n-h1-861111-1 Oct 12 22:02:56.967190 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d2cb6d99-ace1-4741-ab52-7bbea647691f req-5fac0914-8fcb-4355-8b37-6b8554067ce8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083059 Oct 12 22:02:56.969362 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 438/949] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:57.016798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a10f1ad6-9e54-440c-aa8c-fd06b5e1d3a3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:57.027268 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a10f1ad6-9e54-440c-aa8c-fd06b5e1d3a3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1477 microversion: 2.1 time: 0.240406 Oct 12 22:02:57.028212 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 512/950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:56 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1477 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:57.029052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1594306876", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:57.104075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] validate_networks() for [('9dba552c-f785-4d29-b718-62482e880d74', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:02:57.172139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c6e9bd26-fc5d-424a-9f81-92c33f6aca51 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:57.172887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c6e9bd26-fc5d-424a-9f81-92c33f6aca51 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:57.183092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6e9bd26-fc5d-424a-9f81-92c33f6aca51 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:57.184293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6e9bd26-fc5d-424a-9f81-92c33f6aca51 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:57.186110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6e9bd26-fc5d-424a-9f81-92c33f6aca51 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:57.187703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6e9bd26-fc5d-424a-9f81-92c33f6aca51 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:57.188389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6e9bd26-fc5d-424a-9f81-92c33f6aca51 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:57.189022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6e9bd26-fc5d-424a-9f81-92c33f6aca51 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:57.434554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c6e9bd26-fc5d-424a-9f81-92c33f6aca51 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:57.455775 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c6e9bd26-fc5d-424a-9f81-92c33f6aca51 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1368 microversion: 2.1 time: 0.290826 Oct 12 22:02:57.471699 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 513/951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:57 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1368 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:57.471699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-68b31364-ae2b-438a-a92d-dc40135dee05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:57.471699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-68b31364-ae2b-438a-a92d-dc40135dee05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:57.477187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68b31364-ae2b-438a-a92d-dc40135dee05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:57.477672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68b31364-ae2b-438a-a92d-dc40135dee05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:57.478279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68b31364-ae2b-438a-a92d-dc40135dee05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:57.478972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68b31364-ae2b-438a-a92d-dc40135dee05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:57.479453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68b31364-ae2b-438a-a92d-dc40135dee05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:57.479877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68b31364-ae2b-438a-a92d-dc40135dee05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:57.750695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:02:57.751526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:02:57.752010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:02:57.752420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:02:57.752969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:02:57.764039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:57.764731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:57.765331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:57.766215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:57.766839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:57.767466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:57.786969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Getting quotas for project b06c433b364c4a3093c13202b785bc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:02:57.792750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Getting quotas for user ad5b2d0e307f4b008479ff4927b77cb2 and project b06c433b364c4a3093c13202b785bc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:02:57.807540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:02:57.809989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:02:57.830546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-68b31364-ae2b-438a-a92d-dc40135dee05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:57.840320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-68b31364-ae2b-438a-a92d-dc40135dee05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:57.844088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-68b31364-ae2b-438a-a92d-dc40135dee05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:57.845933 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-68b31364-ae2b-438a-a92d-dc40135dee05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1567 microversion: 2.25 time: 0.380223 Oct 12 22:02:57.846989 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 514/952] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:57 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1567 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:57.866129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d93a8ccb-56c1-4671-90bc-8f5c001f76aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:57.866785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d93a8ccb-56c1-4671-90bc-8f5c001f76aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:57.871955 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-028836b0-b983-4f28-93ca-7e30f773d19a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.850226 Oct 12 22:02:57.873511 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 439/953] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:02:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:02:57.878520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b94715cc-5ced-4df5-804d-d74da951b741 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128653670>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:57.910559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d93a8ccb-56c1-4671-90bc-8f5c001f76aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:57.911453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d93a8ccb-56c1-4671-90bc-8f5c001f76aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:57.912047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d93a8ccb-56c1-4671-90bc-8f5c001f76aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:57.912962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d93a8ccb-56c1-4671-90bc-8f5c001f76aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:57.914233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d93a8ccb-56c1-4671-90bc-8f5c001f76aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:57.924564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d93a8ccb-56c1-4671-90bc-8f5c001f76aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:57.947587 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b94715cc-5ced-4df5-804d-d74da951b741 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.072678 Oct 12 22:02:57.948230 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 440/954] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:57 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:57.953011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-42772efb-60d4-430f-8383-0090dfd91ba6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:57.953837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-42772efb-60d4-430f-8383-0090dfd91ba6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:58.034981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-42772efb-60d4-430f-8383-0090dfd91ba6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:58.054560 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-42772efb-60d4-430f-8383-0090dfd91ba6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1214 microversion: 2.1 time: 0.103171 Oct 12 22:02:58.054560 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 441/955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:57 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:58.073135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-98079f0d-b465-4057-b109-ee354d75b46e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:58.073853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-98079f0d-b465-4057-b109-ee354d75b46e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:58.082875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98079f0d-b465-4057-b109-ee354d75b46e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:58.083435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98079f0d-b465-4057-b109-ee354d75b46e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:58.083875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98079f0d-b465-4057-b109-ee354d75b46e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:58.084631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98079f0d-b465-4057-b109-ee354d75b46e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:58.085115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98079f0d-b465-4057-b109-ee354d75b46e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:58.085547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98079f0d-b465-4057-b109-ee354d75b46e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:58.270821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-98079f0d-b465-4057-b109-ee354d75b46e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:58.279731 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-98079f0d-b465-4057-b109-ee354d75b46e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1477 microversion: 2.1 time: 0.215286 Oct 12 22:02:58.303223 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 442/956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:58 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1477 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:58.309390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d93a8ccb-56c1-4671-90bc-8f5c001f76aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:58.324490 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d93a8ccb-56c1-4671-90bc-8f5c001f76aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1488 microversion: 2.1 time: 0.475787 Oct 12 22:02:58.325560 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 515/957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:57 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1488 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:58.337585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-fba1d42a-88c9-4a6a-a92d-b1ab3034caba req-0304f299-6295-4d02-9adf-f21f5f394112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf71b2a6-484b-4e05-80fb-89be6b98546a", "name": "network-vif-unplugged", "status": "completed", "tag": "e7a4b681-6708-4e63-905c-13cb884689e3"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:58.354055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-de7f273d-e89d-49e7-8aca-ed288749f17e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:58.354482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fba1d42a-88c9-4a6a-a92d-b1ab3034caba req-0304f299-6295-4d02-9adf-f21f5f394112 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:58.354957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fba1d42a-88c9-4a6a-a92d-b1ab3034caba req-0304f299-6295-4d02-9adf-f21f5f394112 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:58.355411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fba1d42a-88c9-4a6a-a92d-b1ab3034caba req-0304f299-6295-4d02-9adf-f21f5f394112 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:58.361018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de7f273d-e89d-49e7-8aca-ed288749f17e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:58.366941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de7f273d-e89d-49e7-8aca-ed288749f17e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:58.367635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de7f273d-e89d-49e7-8aca-ed288749f17e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:58.388559 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-fba1d42a-88c9-4a6a-a92d-b1ab3034caba req-0304f299-6295-4d02-9adf-f21f5f394112 service nova] Creating event network-vif-unplugged:e7a4b681-6708-4e63-905c-13cb884689e3 for instance cf71b2a6-484b-4e05-80fb-89be6b98546a on n-h2-861111-1 Oct 12 22:02:58.393787 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-fba1d42a-88c9-4a6a-a92d-b1ab3034caba req-0304f299-6295-4d02-9adf-f21f5f394112 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089241 Oct 12 22:02:58.399091 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 443/958] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:58.438164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-de7f273d-e89d-49e7-8aca-ed288749f17e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Going to try to stop instance {{(pid=120453) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 22:02:58.483344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-282b221b-9175-499d-868e-9713d1146f3d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:58.484424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-282b221b-9175-499d-868e-9713d1146f3d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:58.495273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-282b221b-9175-499d-868e-9713d1146f3d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:58.496257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-282b221b-9175-499d-868e-9713d1146f3d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:58.496695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-282b221b-9175-499d-868e-9713d1146f3d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:58.499288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-282b221b-9175-499d-868e-9713d1146f3d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:58.499759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-282b221b-9175-499d-868e-9713d1146f3d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:58.500193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-282b221b-9175-499d-868e-9713d1146f3d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:58.512192 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-de7f273d-e89d-49e7-8aca-ed288749f17e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "POST /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221/action" status: 202 len: 0 microversion: 2.1 time: 0.161686 Oct 12 22:02:58.513158 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 516/959] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:02:58 2022] POST /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:02:58.524603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fd30a328-4caf-47fa-b5dd-c992e364cb80 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:58.525499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fd30a328-4caf-47fa-b5dd-c992e364cb80 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:58.534580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd30a328-4caf-47fa-b5dd-c992e364cb80 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:58.535331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd30a328-4caf-47fa-b5dd-c992e364cb80 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:58.539052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd30a328-4caf-47fa-b5dd-c992e364cb80 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:58.540026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd30a328-4caf-47fa-b5dd-c992e364cb80 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:58.540642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd30a328-4caf-47fa-b5dd-c992e364cb80 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:58.543651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd30a328-4caf-47fa-b5dd-c992e364cb80 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:58.714963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fd30a328-4caf-47fa-b5dd-c992e364cb80 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:58.740731 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fd30a328-4caf-47fa-b5dd-c992e364cb80 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.221833 Oct 12 22:02:58.741914 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 517/960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:58 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:58.824423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-282b221b-9175-499d-868e-9713d1146f3d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:58.836054 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-282b221b-9175-499d-868e-9713d1146f3d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1368 microversion: 2.1 time: 0.357743 Oct 12 22:02:58.836651 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 444/961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:58 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1368 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:58.872023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ea836e98-026e-4a11-b7ab-45de3e3e5f64 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:58.873404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ea836e98-026e-4a11-b7ab-45de3e3e5f64 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:58.884985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea836e98-026e-4a11-b7ab-45de3e3e5f64 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:58.885484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea836e98-026e-4a11-b7ab-45de3e3e5f64 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:58.885920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea836e98-026e-4a11-b7ab-45de3e3e5f64 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:58.887629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea836e98-026e-4a11-b7ab-45de3e3e5f64 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:58.891328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea836e98-026e-4a11-b7ab-45de3e3e5f64 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:58.891940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea836e98-026e-4a11-b7ab-45de3e3e5f64 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:58.963460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-72c1ea89-a3ed-468e-a118-8c23776e6d46 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128653280>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:59.051480 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-72c1ea89-a3ed-468e-a118-8c23776e6d46 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.092119 Oct 12 22:02:59.055853 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 445/962] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:02:58 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:59.063134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-a49bbaca-64e4-4afa-ad59-da5ade396b56 req-f78fc377-8771-472d-8be4-b232ac75707b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e615f0-f403-426c-a0c9-73cc9b810d10", "tag": "38be05fb-8b40-41e5-b46a-fd8537f3988f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:02:59.093026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a49bbaca-64e4-4afa-ad59-da5ade396b56 req-f78fc377-8771-472d-8be4-b232ac75707b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:59.099022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a49bbaca-64e4-4afa-ad59-da5ade396b56 req-f78fc377-8771-472d-8be4-b232ac75707b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:59.099720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a49bbaca-64e4-4afa-ad59-da5ade396b56 req-f78fc377-8771-472d-8be4-b232ac75707b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:59.123365 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-a49bbaca-64e4-4afa-ad59-da5ade396b56 req-f78fc377-8771-472d-8be4-b232ac75707b service nova] Creating event network-changed:38be05fb-8b40-41e5-b46a-fd8537f3988f for instance e0e615f0-f403-426c-a0c9-73cc9b810d10 on n-h1-861111-1 Oct 12 22:02:59.145057 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-a49bbaca-64e4-4afa-ad59-da5ade396b56 req-f78fc377-8771-472d-8be4-b232ac75707b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087633 Oct 12 22:02:59.146909 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 446/963] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:02:59.157702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-345d8c48-b65e-41aa-9718-1237d92bc05a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:59.158938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-345d8c48-b65e-41aa-9718-1237d92bc05a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:59.166935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-345d8c48-b65e-41aa-9718-1237d92bc05a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:59.168402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-345d8c48-b65e-41aa-9718-1237d92bc05a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:59.169049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-345d8c48-b65e-41aa-9718-1237d92bc05a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:59.170861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-345d8c48-b65e-41aa-9718-1237d92bc05a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:59.171508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-345d8c48-b65e-41aa-9718-1237d92bc05a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:59.172889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-345d8c48-b65e-41aa-9718-1237d92bc05a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:59.231540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ea836e98-026e-4a11-b7ab-45de3e3e5f64 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:59.241512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ea836e98-026e-4a11-b7ab-45de3e3e5f64 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:59.243450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ea836e98-026e-4a11-b7ab-45de3e3e5f64 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:59.245018 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ea836e98-026e-4a11-b7ab-45de3e3e5f64 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1567 microversion: 2.25 time: 0.377321 Oct 12 22:02:59.246068 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 518/964] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:02:58 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1567 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:02:59.304996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-345d8c48-b65e-41aa-9718-1237d92bc05a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:59.311121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-86411698-d48d-478c-a804-74c13c10ce31 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:59.312368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-86411698-d48d-478c-a804-74c13c10ce31 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:59.315575 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-345d8c48-b65e-41aa-9718-1237d92bc05a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1266 microversion: 2.1 time: 0.166579 Oct 12 22:02:59.332024 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 447/965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:59 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:02:59.332616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86411698-d48d-478c-a804-74c13c10ce31 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:59.332616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86411698-d48d-478c-a804-74c13c10ce31 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:59.332616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86411698-d48d-478c-a804-74c13c10ce31 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:59.333619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86411698-d48d-478c-a804-74c13c10ce31 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:59.334242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86411698-d48d-478c-a804-74c13c10ce31 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:59.334716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86411698-d48d-478c-a804-74c13c10ce31 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:59.587113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-86411698-d48d-478c-a804-74c13c10ce31 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:02:59.595903 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-86411698-d48d-478c-a804-74c13c10ce31 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1477 microversion: 2.1 time: 0.290092 Oct 12 22:02:59.596963 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 519/966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:59 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1477 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:02:59.773225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-52369718-d3de-4dbf-96fd-ea0fe23cde53 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:59.774130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-52369718-d3de-4dbf-96fd-ea0fe23cde53 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:59.781158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52369718-d3de-4dbf-96fd-ea0fe23cde53 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:59.781942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52369718-d3de-4dbf-96fd-ea0fe23cde53 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:59.782606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52369718-d3de-4dbf-96fd-ea0fe23cde53 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:59.783527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52369718-d3de-4dbf-96fd-ea0fe23cde53 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:59.784213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52369718-d3de-4dbf-96fd-ea0fe23cde53 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:59.784831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52369718-d3de-4dbf-96fd-ea0fe23cde53 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:59.859896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0475d121-70d4-4916-99d0-12d12a0ddffd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:02:59.860858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0475d121-70d4-4916-99d0-12d12a0ddffd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:02:59.873895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0475d121-70d4-4916-99d0-12d12a0ddffd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:59.874926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0475d121-70d4-4916-99d0-12d12a0ddffd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:59.875440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0475d121-70d4-4916-99d0-12d12a0ddffd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:02:59.876286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0475d121-70d4-4916-99d0-12d12a0ddffd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:02:59.876758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0475d121-70d4-4916-99d0-12d12a0ddffd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:02:59.878774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0475d121-70d4-4916-99d0-12d12a0ddffd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:00.063848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-52369718-d3de-4dbf-96fd-ea0fe23cde53 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:00.072958 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-52369718-d3de-4dbf-96fd-ea0fe23cde53 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.309390 Oct 12 22:03:00.073528 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 448/967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:59 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:00.079782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6cf57ac7-dbbd-496d-b9ea-80847faa27aa tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512862db80>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:00.132450 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6cf57ac7-dbbd-496d-b9ea-80847faa27aa tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.057539 Oct 12 22:03:00.132733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0475d121-70d4-4916-99d0-12d12a0ddffd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:00.133465 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 449/968] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:00 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:00.145180 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0475d121-70d4-4916-99d0-12d12a0ddffd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1368 microversion: 2.1 time: 0.289823 Oct 12 22:03:00.145952 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 520/969] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:02:59 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1368 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:00.273937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2b4e2b7c-575e-4915-9b02-af69ba790ec5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:00.274556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2b4e2b7c-575e-4915-9b02-af69ba790ec5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:00.281617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b4e2b7c-575e-4915-9b02-af69ba790ec5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:00.282402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b4e2b7c-575e-4915-9b02-af69ba790ec5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:00.282836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b4e2b7c-575e-4915-9b02-af69ba790ec5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:00.283850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b4e2b7c-575e-4915-9b02-af69ba790ec5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:00.284556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b4e2b7c-575e-4915-9b02-af69ba790ec5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:00.285259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b4e2b7c-575e-4915-9b02-af69ba790ec5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:00.343180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a7ff7966-f6e5-4227-a0a5-e43c9e06aed5 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:00.343996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a7ff7966-f6e5-4227-a0a5-e43c9e06aed5 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:00.351196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7ff7966-f6e5-4227-a0a5-e43c9e06aed5 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:00.351834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7ff7966-f6e5-4227-a0a5-e43c9e06aed5 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:00.352416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7ff7966-f6e5-4227-a0a5-e43c9e06aed5 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:00.353238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7ff7966-f6e5-4227-a0a5-e43c9e06aed5 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:00.353798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7ff7966-f6e5-4227-a0a5-e43c9e06aed5 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:00.354332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7ff7966-f6e5-4227-a0a5-e43c9e06aed5 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:00.422319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a7ff7966-f6e5-4227-a0a5-e43c9e06aed5 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:00.432994 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a7ff7966-f6e5-4227-a0a5-e43c9e06aed5 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1272 microversion: 2.1 time: 0.094450 Oct 12 22:03:00.434209 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 521/970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:00 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1272 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:00.439438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-b73a1f31-c34d-4189-bb68-5debad1b531c req-4ade5227-6163-471e-89f0-bea24e72c4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7169b167-a2fd-4983-af2e-bcc24daf9b72", "name": "network-vif-plugged", "status": "completed", "tag": "40bd5146-e5e9-4d7e-aa69-34a079389240"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:00.449707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b73a1f31-c34d-4189-bb68-5debad1b531c req-4ade5227-6163-471e-89f0-bea24e72c4e8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:00.450365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b73a1f31-c34d-4189-bb68-5debad1b531c req-4ade5227-6163-471e-89f0-bea24e72c4e8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:00.451037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b73a1f31-c34d-4189-bb68-5debad1b531c req-4ade5227-6163-471e-89f0-bea24e72c4e8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:00.464106 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-b73a1f31-c34d-4189-bb68-5debad1b531c req-4ade5227-6163-471e-89f0-bea24e72c4e8 service nova] Creating event network-vif-plugged:40bd5146-e5e9-4d7e-aa69-34a079389240 for instance 7169b167-a2fd-4983-af2e-bcc24daf9b72 on n-h1-861111-1 Oct 12 22:03:00.469696 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-b73a1f31-c34d-4189-bb68-5debad1b531c req-4ade5227-6163-471e-89f0-bea24e72c4e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034053 Oct 12 22:03:00.470950 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 522/971] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:00.614990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2b4e2b7c-575e-4915-9b02-af69ba790ec5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:00.621276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0307305e-ee79-417f-aeb6-3980f6934347 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:00.622293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0307305e-ee79-417f-aeb6-3980f6934347 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:00.630338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2b4e2b7c-575e-4915-9b02-af69ba790ec5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:00.631807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2b4e2b7c-575e-4915-9b02-af69ba790ec5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:00.633019 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2b4e2b7c-575e-4915-9b02-af69ba790ec5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1567 microversion: 2.25 time: 0.362890 Oct 12 22:03:00.635519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0307305e-ee79-417f-aeb6-3980f6934347 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:00.636900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0307305e-ee79-417f-aeb6-3980f6934347 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:00.637541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0307305e-ee79-417f-aeb6-3980f6934347 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:00.639179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0307305e-ee79-417f-aeb6-3980f6934347 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:00.639852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0307305e-ee79-417f-aeb6-3980f6934347 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:00.640491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0307305e-ee79-417f-aeb6-3980f6934347 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:00.643887 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 450/972] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:00 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1567 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:00.948022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0307305e-ee79-417f-aeb6-3980f6934347 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:00.961518 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0307305e-ee79-417f-aeb6-3980f6934347 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1477 microversion: 2.1 time: 0.344689 Oct 12 22:03:00.964608 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 523/973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:00 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1477 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:01.096730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-976de56d-5c50-4f63-8954-442d19d8adef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:01.097342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-976de56d-5c50-4f63-8954-442d19d8adef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:01.110719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-976de56d-5c50-4f63-8954-442d19d8adef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:01.112703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-976de56d-5c50-4f63-8954-442d19d8adef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:01.113223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-976de56d-5c50-4f63-8954-442d19d8adef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:01.114949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-976de56d-5c50-4f63-8954-442d19d8adef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:01.115826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-976de56d-5c50-4f63-8954-442d19d8adef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:01.116322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-976de56d-5c50-4f63-8954-442d19d8adef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:01.149357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8c3fa09f-ba7c-483a-98d8-85dc6b672c7a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128c53820>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:01.202136 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8c3fa09f-ba7c-483a-98d8-85dc6b672c7a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.056882 Oct 12 22:03:01.203319 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 524/974] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:01 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:01.208386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-74886fd8-eeb9-4604-aa5c-35a64e99d3c3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:01.209235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-74886fd8-eeb9-4604-aa5c-35a64e99d3c3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:01.217472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74886fd8-eeb9-4604-aa5c-35a64e99d3c3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:01.218686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74886fd8-eeb9-4604-aa5c-35a64e99d3c3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:01.219583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74886fd8-eeb9-4604-aa5c-35a64e99d3c3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:01.220309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74886fd8-eeb9-4604-aa5c-35a64e99d3c3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:01.220761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74886fd8-eeb9-4604-aa5c-35a64e99d3c3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:01.221186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74886fd8-eeb9-4604-aa5c-35a64e99d3c3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:01.489857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-976de56d-5c50-4f63-8954-442d19d8adef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:01.501984 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-976de56d-5c50-4f63-8954-442d19d8adef tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.409094 Oct 12 22:03:01.502995 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 451/975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:01 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:01.509021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4e8babe3-fcc1-4311-880a-07c40c62f1ac tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:01.509926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4e8babe3-fcc1-4311-880a-07c40c62f1ac tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:01.519096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e8babe3-fcc1-4311-880a-07c40c62f1ac tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:01.519850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e8babe3-fcc1-4311-880a-07c40c62f1ac tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:01.520863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e8babe3-fcc1-4311-880a-07c40c62f1ac tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:01.522799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e8babe3-fcc1-4311-880a-07c40c62f1ac tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:01.523489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e8babe3-fcc1-4311-880a-07c40c62f1ac tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:01.524152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e8babe3-fcc1-4311-880a-07c40c62f1ac tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:01.634576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-74886fd8-eeb9-4604-aa5c-35a64e99d3c3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:01.645356 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-74886fd8-eeb9-4604-aa5c-35a64e99d3c3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1368 microversion: 2.1 time: 0.440723 Oct 12 22:03:01.646488 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 525/976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:01 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1368 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:01.665170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-659091a2-ef1e-471d-83d8-1e36eb637de7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:01.666213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-659091a2-ef1e-471d-83d8-1e36eb637de7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:01.675151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-659091a2-ef1e-471d-83d8-1e36eb637de7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:01.677411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-659091a2-ef1e-471d-83d8-1e36eb637de7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:01.678383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-659091a2-ef1e-471d-83d8-1e36eb637de7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:01.679354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-659091a2-ef1e-471d-83d8-1e36eb637de7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:01.680370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-659091a2-ef1e-471d-83d8-1e36eb637de7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:01.680981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-659091a2-ef1e-471d-83d8-1e36eb637de7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:01.840821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4e8babe3-fcc1-4311-880a-07c40c62f1ac tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:01.857033 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4e8babe3-fcc1-4311-880a-07c40c62f1ac tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1314 microversion: 2.1 time: 0.352676 Oct 12 22:03:01.859793 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 452/977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:01 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:01.988126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c4a231ff-27b7-4a0a-8552-71d4f247058e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:01.988757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c4a231ff-27b7-4a0a-8552-71d4f247058e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:02.003386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4a231ff-27b7-4a0a-8552-71d4f247058e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:02.005313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4a231ff-27b7-4a0a-8552-71d4f247058e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:02.006073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4a231ff-27b7-4a0a-8552-71d4f247058e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:02.007017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4a231ff-27b7-4a0a-8552-71d4f247058e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:02.007703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4a231ff-27b7-4a0a-8552-71d4f247058e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:02.008453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4a231ff-27b7-4a0a-8552-71d4f247058e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:02.022190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-659091a2-ef1e-471d-83d8-1e36eb637de7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:02.031986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-659091a2-ef1e-471d-83d8-1e36eb637de7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:02.033470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-659091a2-ef1e-471d-83d8-1e36eb637de7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:02.034657 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-659091a2-ef1e-471d-83d8-1e36eb637de7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1567 microversion: 2.25 time: 0.376486 Oct 12 22:03:02.042792 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 526/978] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:01 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1567 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:02.050967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d68d7e67-b745-42a1-aa4f-4e6fb230c4e0 req-05c3362f-c61f-40b3-bb62-fc1ec448c145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baa3d69d-dc00-42d4-8d95-14b0a37e08b9", "tag": "e686fc59-e990-4895-9968-98a0f6eea195"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:02.070032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d68d7e67-b745-42a1-aa4f-4e6fb230c4e0 req-05c3362f-c61f-40b3-bb62-fc1ec448c145 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:02.072255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d68d7e67-b745-42a1-aa4f-4e6fb230c4e0 req-05c3362f-c61f-40b3-bb62-fc1ec448c145 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:02.072873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d68d7e67-b745-42a1-aa4f-4e6fb230c4e0 req-05c3362f-c61f-40b3-bb62-fc1ec448c145 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:02.098225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:02.111702 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d68d7e67-b745-42a1-aa4f-4e6fb230c4e0 req-05c3362f-c61f-40b3-bb62-fc1ec448c145 service nova] Creating event network-changed:e686fc59-e990-4895-9968-98a0f6eea195 for instance baa3d69d-dc00-42d4-8d95-14b0a37e08b9 on n-h2-861111-1 Oct 12 22:03:02.116953 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d68d7e67-b745-42a1-aa4f-4e6fb230c4e0 req-05c3362f-c61f-40b3-bb62-fc1ec448c145 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072573 Oct 12 22:03:02.117877 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 527/979] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:02.219372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6ae0931c-e89c-44d7-8a2e-d1d717bd9b8a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512845fdc0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:02.285008 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6ae0931c-e89c-44d7-8a2e-d1d717bd9b8a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.071089 Oct 12 22:03:02.296293 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 528/980] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:02 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:02.363377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c4a231ff-27b7-4a0a-8552-71d4f247058e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:02.373733 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c4a231ff-27b7-4a0a-8552-71d4f247058e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1477 microversion: 2.1 time: 0.391068 Oct 12 22:03:02.386991 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 453/981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:01 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1477 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:02.529321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c9345295-9b71-4d27-805b-4a77ce6240cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:02.530538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c9345295-9b71-4d27-805b-4a77ce6240cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:02.540258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9345295-9b71-4d27-805b-4a77ce6240cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:02.540971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9345295-9b71-4d27-805b-4a77ce6240cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:02.541569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9345295-9b71-4d27-805b-4a77ce6240cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:02.542434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9345295-9b71-4d27-805b-4a77ce6240cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:02.543145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9345295-9b71-4d27-805b-4a77ce6240cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:02.543761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9345295-9b71-4d27-805b-4a77ce6240cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:02.674619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-98f83e66-6eab-4abb-9e64-be2aadf6cece tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:02.675363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-98f83e66-6eab-4abb-9e64-be2aadf6cece tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:02.682414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98f83e66-6eab-4abb-9e64-be2aadf6cece tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:02.683133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98f83e66-6eab-4abb-9e64-be2aadf6cece tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:02.683590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98f83e66-6eab-4abb-9e64-be2aadf6cece tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:02.684281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98f83e66-6eab-4abb-9e64-be2aadf6cece tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:02.684888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98f83e66-6eab-4abb-9e64-be2aadf6cece tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:02.685797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98f83e66-6eab-4abb-9e64-be2aadf6cece tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:02.779964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c9345295-9b71-4d27-805b-4a77ce6240cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:02.790452 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c9345295-9b71-4d27-805b-4a77ce6240cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.264895 Oct 12 22:03:02.791050 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 529/982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:02 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:02.846927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-98f83e66-6eab-4abb-9e64-be2aadf6cece tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:02.855675 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-98f83e66-6eab-4abb-9e64-be2aadf6cece tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1559 microversion: 2.1 time: 0.186023 Oct 12 22:03:02.856846 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 454/983] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:02 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:02.880891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cf00f3c6-9bc2-4bb8-99c9-52cc128db75e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:02.881740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cf00f3c6-9bc2-4bb8-99c9-52cc128db75e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:02.890564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5ac6e6dd-66da-4816-bc44-05276ff74576 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:02.891063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5ac6e6dd-66da-4816-bc44-05276ff74576 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:02.897139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf00f3c6-9bc2-4bb8-99c9-52cc128db75e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:02.897690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf00f3c6-9bc2-4bb8-99c9-52cc128db75e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:02.898134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf00f3c6-9bc2-4bb8-99c9-52cc128db75e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:02.898849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf00f3c6-9bc2-4bb8-99c9-52cc128db75e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:02.899329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf00f3c6-9bc2-4bb8-99c9-52cc128db75e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:02.899762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf00f3c6-9bc2-4bb8-99c9-52cc128db75e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:02.908514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ac6e6dd-66da-4816-bc44-05276ff74576 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:02.909212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ac6e6dd-66da-4816-bc44-05276ff74576 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:02.909712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ac6e6dd-66da-4816-bc44-05276ff74576 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:02.910667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ac6e6dd-66da-4816-bc44-05276ff74576 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:02.911187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ac6e6dd-66da-4816-bc44-05276ff74576 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:02.911869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ac6e6dd-66da-4816-bc44-05276ff74576 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:03.015967 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5ac6e6dd-66da-4816-bc44-05276ff74576 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129737 Oct 12 22:03:03.016554 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 455/984] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:03:02 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:03.069117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8bbb7189-05d2-4702-9c86-616eff8b8143 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:03.070028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8bbb7189-05d2-4702-9c86-616eff8b8143 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:03.077070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bbb7189-05d2-4702-9c86-616eff8b8143 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:03.077596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bbb7189-05d2-4702-9c86-616eff8b8143 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:03.078036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bbb7189-05d2-4702-9c86-616eff8b8143 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:03.078785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bbb7189-05d2-4702-9c86-616eff8b8143 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:03.079265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bbb7189-05d2-4702-9c86-616eff8b8143 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:03.079691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bbb7189-05d2-4702-9c86-616eff8b8143 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:03.229675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8bbb7189-05d2-4702-9c86-616eff8b8143 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:03.240901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8bbb7189-05d2-4702-9c86-616eff8b8143 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:03.242361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8bbb7189-05d2-4702-9c86-616eff8b8143 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:03.243598 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8bbb7189-05d2-4702-9c86-616eff8b8143 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1567 microversion: 2.25 time: 0.178791 Oct 12 22:03:03.244159 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 456/985] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:03 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:03:03.302945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b45b46d5-e625-4844-831b-84ec1d65afbd tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51287fcdc0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:03.348365 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b45b46d5-e625-4844-831b-84ec1d65afbd tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.049270 Oct 12 22:03:03.349089 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 457/986] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:03 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:03.396915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4f8c041f-881c-43cf-a9c0-90905aa26bd6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:03.397524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4f8c041f-881c-43cf-a9c0-90905aa26bd6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:03.405794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f8c041f-881c-43cf-a9c0-90905aa26bd6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:03.405794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f8c041f-881c-43cf-a9c0-90905aa26bd6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:03.405794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f8c041f-881c-43cf-a9c0-90905aa26bd6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:03.406051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f8c041f-881c-43cf-a9c0-90905aa26bd6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:03.406477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f8c041f-881c-43cf-a9c0-90905aa26bd6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:03.406907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f8c041f-881c-43cf-a9c0-90905aa26bd6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:03.552846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4f8c041f-881c-43cf-a9c0-90905aa26bd6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:03.554744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cf00f3c6-9bc2-4bb8-99c9-52cc128db75e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:03.568657 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4f8c041f-881c-43cf-a9c0-90905aa26bd6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1477 microversion: 2.1 time: 0.175633 Oct 12 22:03:03.569247 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 458/987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:03 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1477 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:03.569459 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cf00f3c6-9bc2-4bb8-99c9-52cc128db75e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1314 microversion: 2.1 time: 0.692281 Oct 12 22:03:03.570309 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 530/988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:02 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:03.814322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2f2b0734-9f59-455f-8ff8-76b4dfd8e29a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:03.814984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f2b0734-9f59-455f-8ff8-76b4dfd8e29a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:03.821390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f2b0734-9f59-455f-8ff8-76b4dfd8e29a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:03.822043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f2b0734-9f59-455f-8ff8-76b4dfd8e29a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:03.822577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f2b0734-9f59-455f-8ff8-76b4dfd8e29a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:03.823422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f2b0734-9f59-455f-8ff8-76b4dfd8e29a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:03.823984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f2b0734-9f59-455f-8ff8-76b4dfd8e29a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:03.824506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f2b0734-9f59-455f-8ff8-76b4dfd8e29a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:03.927878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-c328d8df-caf2-405f-9ba6-7319e6b4a801 req-2cb1d925-6bae-4249-a9bb-b0b2f958734c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e1ad2a-6b26-4501-af12-49ad23802b5f", "name": "network-vif-plugged", "status": "completed", "tag": "e6ed5eb0-d436-4efd-8560-3606d22e1b6e"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:03.940742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c328d8df-caf2-405f-9ba6-7319e6b4a801 req-2cb1d925-6bae-4249-a9bb-b0b2f958734c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:03.941723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c328d8df-caf2-405f-9ba6-7319e6b4a801 req-2cb1d925-6bae-4249-a9bb-b0b2f958734c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:03.942371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c328d8df-caf2-405f-9ba6-7319e6b4a801 req-2cb1d925-6bae-4249-a9bb-b0b2f958734c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:03.957556 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-c328d8df-caf2-405f-9ba6-7319e6b4a801 req-2cb1d925-6bae-4249-a9bb-b0b2f958734c service nova] Creating event network-vif-plugged:e6ed5eb0-d436-4efd-8560-3606d22e1b6e for instance 18e1ad2a-6b26-4501-af12-49ad23802b5f on n-h2-861111-1 Oct 12 22:03:03.966002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f2b0734-9f59-455f-8ff8-76b4dfd8e29a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:03.975710 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-c328d8df-caf2-405f-9ba6-7319e6b4a801 req-2cb1d925-6bae-4249-a9bb-b0b2f958734c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049387 Oct 12 22:03:03.977712 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2f2b0734-9f59-455f-8ff8-76b4dfd8e29a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.167458 Oct 12 22:03:03.978553 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 531/989] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:03:03.987162 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 459/990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:03 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:04.270812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ef8ef55e-21f6-443d-89b8-d29290213530 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:04.271455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ef8ef55e-21f6-443d-89b8-d29290213530 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:04.277680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef8ef55e-21f6-443d-89b8-d29290213530 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:04.278165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef8ef55e-21f6-443d-89b8-d29290213530 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:04.278650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef8ef55e-21f6-443d-89b8-d29290213530 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:04.279405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef8ef55e-21f6-443d-89b8-d29290213530 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:04.279866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef8ef55e-21f6-443d-89b8-d29290213530 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:04.280372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef8ef55e-21f6-443d-89b8-d29290213530 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:04.363742 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d581d7cc-b275-4749-9e73-7d1de0b43e30 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512864dee0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:04.408421 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d581d7cc-b275-4749-9e73-7d1de0b43e30 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.048494 Oct 12 22:03:04.409148 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 460/991] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:04 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:04.593770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2626fb7e-c6ae-4c3c-af64-2bc8822d1c36 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:04.594619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2626fb7e-c6ae-4c3c-af64-2bc8822d1c36 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:04.602616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2626fb7e-c6ae-4c3c-af64-2bc8822d1c36 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:04.611090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2626fb7e-c6ae-4c3c-af64-2bc8822d1c36 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:04.612138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2626fb7e-c6ae-4c3c-af64-2bc8822d1c36 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:04.617565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2626fb7e-c6ae-4c3c-af64-2bc8822d1c36 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:04.618936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2626fb7e-c6ae-4c3c-af64-2bc8822d1c36 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:04.619435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2626fb7e-c6ae-4c3c-af64-2bc8822d1c36 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:04.644957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ef8ef55e-21f6-443d-89b8-d29290213530 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:04.661395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ef8ef55e-21f6-443d-89b8-d29290213530 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:04.662854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ef8ef55e-21f6-443d-89b8-d29290213530 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:04.664078 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ef8ef55e-21f6-443d-89b8-d29290213530 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1567 microversion: 2.25 time: 0.397693 Oct 12 22:03:04.668969 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 532/992] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:04 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1567 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:04.674202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-104462c4-026a-4b5d-a6c3-ecb015a8b5ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:04.674815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-104462c4-026a-4b5d-a6c3-ecb015a8b5ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:04.684771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:04.687935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-104462c4-026a-4b5d-a6c3-ecb015a8b5ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:04.688421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-104462c4-026a-4b5d-a6c3-ecb015a8b5ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:04.689038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-104462c4-026a-4b5d-a6c3-ecb015a8b5ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:04.689741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-104462c4-026a-4b5d-a6c3-ecb015a8b5ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:04.690902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-104462c4-026a-4b5d-a6c3-ecb015a8b5ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:04.691735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-104462c4-026a-4b5d-a6c3-ecb015a8b5ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:04.920117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2626fb7e-c6ae-4c3c-af64-2bc8822d1c36 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:04.929734 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2626fb7e-c6ae-4c3c-af64-2bc8822d1c36 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1314 microversion: 2.1 time: 0.340746 Oct 12 22:03:04.930458 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 461/993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:04 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:04.957115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-104462c4-026a-4b5d-a6c3-ecb015a8b5ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:04.966812 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-104462c4-026a-4b5d-a6c3-ecb015a8b5ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1477 microversion: 2.1 time: 0.295507 Oct 12 22:03:04.967614 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 533/994] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:04 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1477 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:05.001991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-565fdf28-ef7c-4e4e-9ce6-25af17e4fdb4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:05.002896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-565fdf28-ef7c-4e4e-9ce6-25af17e4fdb4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:05.018987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-565fdf28-ef7c-4e4e-9ce6-25af17e4fdb4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:05.018987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-565fdf28-ef7c-4e4e-9ce6-25af17e4fdb4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:05.018987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-565fdf28-ef7c-4e4e-9ce6-25af17e4fdb4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:05.018987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-565fdf28-ef7c-4e4e-9ce6-25af17e4fdb4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:05.019590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-565fdf28-ef7c-4e4e-9ce6-25af17e4fdb4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:05.020456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-565fdf28-ef7c-4e4e-9ce6-25af17e4fdb4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:05.027993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-0610eb9a-5e68-44d7-bcfe-043ec866db37 req-28f40807-3d0b-4957-a3bd-2d5e3a366a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7169b167-a2fd-4983-af2e-bcc24daf9b72", "tag": "40bd5146-e5e9-4d7e-aa69-34a079389240"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:05.038186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0610eb9a-5e68-44d7-bcfe-043ec866db37 req-28f40807-3d0b-4957-a3bd-2d5e3a366a1b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:05.038672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0610eb9a-5e68-44d7-bcfe-043ec866db37 req-28f40807-3d0b-4957-a3bd-2d5e3a366a1b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:05.039107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0610eb9a-5e68-44d7-bcfe-043ec866db37 req-28f40807-3d0b-4957-a3bd-2d5e3a366a1b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:05.051388 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-0610eb9a-5e68-44d7-bcfe-043ec866db37 req-28f40807-3d0b-4957-a3bd-2d5e3a366a1b service nova] Creating event network-changed:40bd5146-e5e9-4d7e-aa69-34a079389240 for instance 7169b167-a2fd-4983-af2e-bcc24daf9b72 on n-h1-861111-1 Oct 12 22:03:05.056636 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-0610eb9a-5e68-44d7-bcfe-043ec866db37 req-28f40807-3d0b-4957-a3bd-2d5e3a366a1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032694 Oct 12 22:03:05.057586 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 534/995] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:03:05.283609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-565fdf28-ef7c-4e4e-9ce6-25af17e4fdb4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:05.298645 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-565fdf28-ef7c-4e4e-9ce6-25af17e4fdb4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.300647 Oct 12 22:03:05.299278 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 462/996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:04 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:05.426031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7e72c4f6-db28-4164-93e7-f6cc24708f46 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51285378b0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:05.507199 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7e72c4f6-db28-4164-93e7-f6cc24708f46 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.086321 Oct 12 22:03:05.508800 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 535/997] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:05 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:05.691597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-925735ad-fad8-4151-adbe-2475c1600fba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:05.692161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-925735ad-fad8-4151-adbe-2475c1600fba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:05.703578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-925735ad-fad8-4151-adbe-2475c1600fba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:05.706349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-925735ad-fad8-4151-adbe-2475c1600fba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:05.707215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-925735ad-fad8-4151-adbe-2475c1600fba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:05.708349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-925735ad-fad8-4151-adbe-2475c1600fba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:05.709303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-925735ad-fad8-4151-adbe-2475c1600fba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:05.710385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-925735ad-fad8-4151-adbe-2475c1600fba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:05.748843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:05.915054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-925735ad-fad8-4151-adbe-2475c1600fba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:05.925481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-925735ad-fad8-4151-adbe-2475c1600fba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:05.927177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-925735ad-fad8-4151-adbe-2475c1600fba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:05.928481 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-925735ad-fad8-4151-adbe-2475c1600fba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1567 microversion: 2.25 time: 0.240843 Oct 12 22:03:05.929209 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 463/998] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:05 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:05.954161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0defdae9-f2c3-44ef-b88c-aba1f5144626 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:05.955156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0defdae9-f2c3-44ef-b88c-aba1f5144626 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:05.962344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0defdae9-f2c3-44ef-b88c-aba1f5144626 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:05.963524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0defdae9-f2c3-44ef-b88c-aba1f5144626 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:05.964127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0defdae9-f2c3-44ef-b88c-aba1f5144626 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:05.965017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0defdae9-f2c3-44ef-b88c-aba1f5144626 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:05.965636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0defdae9-f2c3-44ef-b88c-aba1f5144626 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:05.966805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0defdae9-f2c3-44ef-b88c-aba1f5144626 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:05.996564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b0f7fff8-fa8f-4f95-a3c0-7536b6388a79 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:05.997285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b0f7fff8-fa8f-4f95-a3c0-7536b6388a79 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:06.011335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0f7fff8-fa8f-4f95-a3c0-7536b6388a79 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:06.011943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0f7fff8-fa8f-4f95-a3c0-7536b6388a79 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:06.013853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0f7fff8-fa8f-4f95-a3c0-7536b6388a79 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:06.014795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0f7fff8-fa8f-4f95-a3c0-7536b6388a79 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:06.025616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0f7fff8-fa8f-4f95-a3c0-7536b6388a79 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:06.026470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0f7fff8-fa8f-4f95-a3c0-7536b6388a79 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:06.129401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0defdae9-f2c3-44ef-b88c-aba1f5144626 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:06.138984 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0defdae9-f2c3-44ef-b88c-aba1f5144626 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1314 microversion: 2.1 time: 0.189694 Oct 12 22:03:06.139598 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 536/999] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:05 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:06.214404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b0f7fff8-fa8f-4f95-a3c0-7536b6388a79 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:06.224005 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b0f7fff8-fa8f-4f95-a3c0-7536b6388a79 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1477 microversion: 2.1 time: 0.233900 Oct 12 22:03:06.224585 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 464/1000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:05 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1477 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:06.335565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5afb93d8-2eec-480a-9fb8-50f79a892efd tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:06.336199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5afb93d8-2eec-480a-9fb8-50f79a892efd tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:06.355836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5afb93d8-2eec-480a-9fb8-50f79a892efd tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:06.356338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5afb93d8-2eec-480a-9fb8-50f79a892efd tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:06.357421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5afb93d8-2eec-480a-9fb8-50f79a892efd tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:06.358981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5afb93d8-2eec-480a-9fb8-50f79a892efd tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:06.359672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5afb93d8-2eec-480a-9fb8-50f79a892efd tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:06.360101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5afb93d8-2eec-480a-9fb8-50f79a892efd tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:06.525607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4465eaf3-9cb5-4213-86c0-fab8c8573b6b tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128663700>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:06.589075 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4465eaf3-9cb5-4213-86c0-fab8c8573b6b tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.068954 Oct 12 22:03:06.590653 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 465/1001] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:06 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:06.700186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5afb93d8-2eec-480a-9fb8-50f79a892efd tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:06.714043 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5afb93d8-2eec-480a-9fb8-50f79a892efd tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.391728 Oct 12 22:03:06.714633 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 537/1002] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:06 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:06.954526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-92431982-9204-44eb-8353-fd1e98d2861d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:06.955140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-92431982-9204-44eb-8353-fd1e98d2861d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:06.969527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92431982-9204-44eb-8353-fd1e98d2861d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:06.970222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92431982-9204-44eb-8353-fd1e98d2861d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:06.970729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92431982-9204-44eb-8353-fd1e98d2861d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:06.971683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92431982-9204-44eb-8353-fd1e98d2861d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:06.972443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92431982-9204-44eb-8353-fd1e98d2861d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:06.973103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92431982-9204-44eb-8353-fd1e98d2861d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:07.161708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1e55afea-a88a-4b53-9569-87c38818b6e9 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:07.162970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1e55afea-a88a-4b53-9569-87c38818b6e9 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:07.174854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e55afea-a88a-4b53-9569-87c38818b6e9 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:07.175693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e55afea-a88a-4b53-9569-87c38818b6e9 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:07.176131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e55afea-a88a-4b53-9569-87c38818b6e9 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:07.176891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e55afea-a88a-4b53-9569-87c38818b6e9 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:07.177345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e55afea-a88a-4b53-9569-87c38818b6e9 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:07.177762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e55afea-a88a-4b53-9569-87c38818b6e9 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:07.219414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-92431982-9204-44eb-8353-fd1e98d2861d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:07.240094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-92431982-9204-44eb-8353-fd1e98d2861d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:07.244010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-92431982-9204-44eb-8353-fd1e98d2861d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:07.246019 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-92431982-9204-44eb-8353-fd1e98d2861d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1567 microversion: 2.25 time: 0.296190 Oct 12 22:03:07.248538 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 466/1003] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:06 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1567 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:07.253956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c2e9928e-1cd7-41a6-97b2-380a26780706 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:07.254862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c2e9928e-1cd7-41a6-97b2-380a26780706 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:07.261866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2e9928e-1cd7-41a6-97b2-380a26780706 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:07.262694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2e9928e-1cd7-41a6-97b2-380a26780706 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:07.264156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2e9928e-1cd7-41a6-97b2-380a26780706 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:07.265157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2e9928e-1cd7-41a6-97b2-380a26780706 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:07.266247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2e9928e-1cd7-41a6-97b2-380a26780706 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:07.266896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2e9928e-1cd7-41a6-97b2-380a26780706 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:07.367280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1e55afea-a88a-4b53-9569-87c38818b6e9 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:07.374078 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1e55afea-a88a-4b53-9569-87c38818b6e9 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1314 microversion: 2.1 time: 0.216142 Oct 12 22:03:07.374656 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 538/1004] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:07 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:07.483084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c2e9928e-1cd7-41a6-97b2-380a26780706 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:07.491370 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c2e9928e-1cd7-41a6-97b2-380a26780706 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1477 microversion: 2.1 time: 0.240987 Oct 12 22:03:07.491788 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 467/1005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:07 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1477 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:07.605601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c43852b1-62be-4a56-8a27-22cb223b5425 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512880cca0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:07.689022 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c43852b1-62be-4a56-8a27-22cb223b5425 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.087358 Oct 12 22:03:07.690107 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 539/1006] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:07 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:07.738875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d573acee-a7e9-4aa7-bdcd-501d9ca61d5f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:07.739518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d573acee-a7e9-4aa7-bdcd-501d9ca61d5f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:07.748820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d573acee-a7e9-4aa7-bdcd-501d9ca61d5f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:07.749867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d573acee-a7e9-4aa7-bdcd-501d9ca61d5f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:07.750588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d573acee-a7e9-4aa7-bdcd-501d9ca61d5f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:07.751686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d573acee-a7e9-4aa7-bdcd-501d9ca61d5f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:07.752346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d573acee-a7e9-4aa7-bdcd-501d9ca61d5f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:07.753259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d573acee-a7e9-4aa7-bdcd-501d9ca61d5f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:07.988714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:08.044982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:08.082820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48f23798-4bef-4aae-839f-a7d07ffee601 tempest-FlavorMetadataValidation-860092179 tempest-FlavorMetadataValidation-860092179-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-2015001306", "id": 1815543081, "os-flavor-access:is_public": "True"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:08.134413 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-48f23798-4bef-4aae-839f-a7d07ffee601 tempest-FlavorMetadataValidation-860092179 tempest-FlavorMetadataValidation-860092179-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.321218 Oct 12 22:03:08.135322 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 540/1007] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 22:03:07 2022] POST /compute/v2.1/flavors => generated 471 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 22:03:08.155312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-23077835-c75a-43a0-a0ec-297201d28a46 tempest-FlavorMetadataValidation-860092179 tempest-FlavorMetadataValidation-860092179-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:08.163409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d573acee-a7e9-4aa7-bdcd-501d9ca61d5f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:08.177472 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d573acee-a7e9-4aa7-bdcd-501d9ca61d5f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.442736 Oct 12 22:03:08.179928 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 468/1008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:07 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:08.278092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c940544a-2ff8-4921-bce8-7aa7f403e3ee tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:08.279719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c940544a-2ff8-4921-bce8-7aa7f403e3ee tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:08.289153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c940544a-2ff8-4921-bce8-7aa7f403e3ee tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:08.292882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c940544a-2ff8-4921-bce8-7aa7f403e3ee tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:08.293504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c940544a-2ff8-4921-bce8-7aa7f403e3ee tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:08.296622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c940544a-2ff8-4921-bce8-7aa7f403e3ee tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:08.299049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c940544a-2ff8-4921-bce8-7aa7f403e3ee tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:08.300286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c940544a-2ff8-4921-bce8-7aa7f403e3ee tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:08.447471 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-23077835-c75a-43a0-a0ec-297201d28a46 tempest-FlavorMetadataValidation-860092179 tempest-FlavorMetadataValidation-860092179-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1815543081/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.300442 Oct 12 22:03:08.448808 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 541/1009] 10.222.0.16 () {62 vars in 1265 bytes} [Wed Oct 12 22:03:08 2022] POST /compute/v2.1/flavors/1815543081/os-extra_specs => generated 62 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:08.458670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1dd28e88-2215-4805-9503-6cef709663c7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:08.459101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1dd28e88-2215-4805-9503-6cef709663c7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:08.469107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dd28e88-2215-4805-9503-6cef709663c7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:08.469873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dd28e88-2215-4805-9503-6cef709663c7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:08.470508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dd28e88-2215-4805-9503-6cef709663c7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:08.471448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dd28e88-2215-4805-9503-6cef709663c7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:08.473118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dd28e88-2215-4805-9503-6cef709663c7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:08.474034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dd28e88-2215-4805-9503-6cef709663c7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:08.502432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c940544a-2ff8-4921-bce8-7aa7f403e3ee tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:08.515327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c940544a-2ff8-4921-bce8-7aa7f403e3ee tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:08.517645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c940544a-2ff8-4921-bce8-7aa7f403e3ee tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:08.519512 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c940544a-2ff8-4921-bce8-7aa7f403e3ee tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1567 microversion: 2.25 time: 0.246369 Oct 12 22:03:08.520705 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 469/1010] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:08 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:03:08.526933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a08875df-edc0-4fd2-af13-1966086b049a tempest-FlavorMetadataValidation-860092179 tempest-FlavorMetadataValidation-860092179-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:08.576395 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a08875df-edc0-4fd2-af13-1966086b049a tempest-FlavorMetadataValidation-860092179 tempest-FlavorMetadataValidation-860092179-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1815543081" status: 202 len: 0 microversion: 2.86 time: 0.054060 Oct 12 22:03:08.577042 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 470/1011] 10.222.0.16 () {60 vars in 1202 bytes} [Wed Oct 12 22:03:08 2022] DELETE /compute/v2.1/flavors/1815543081 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:03:08.590347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-408f883a-03be-443a-92d6-20f09a673f80 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:08.591707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-408f883a-03be-443a-92d6-20f09a673f80 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:08.602098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-408f883a-03be-443a-92d6-20f09a673f80 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:08.602879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-408f883a-03be-443a-92d6-20f09a673f80 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:08.603605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-408f883a-03be-443a-92d6-20f09a673f80 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:08.604489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-408f883a-03be-443a-92d6-20f09a673f80 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:08.604973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-408f883a-03be-443a-92d6-20f09a673f80 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:08.605539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-408f883a-03be-443a-92d6-20f09a673f80 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:08.696983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1dd28e88-2215-4805-9503-6cef709663c7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:08.709989 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1dd28e88-2215-4805-9503-6cef709663c7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1314 microversion: 2.1 time: 0.258627 Oct 12 22:03:08.710797 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 542/1012] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:08 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:08.722165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-4b52dc53-0d16-4624-a602-14d83111e996 req-d5abcd0b-3143-4783-aac4-230ada54f1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e615f0-f403-426c-a0c9-73cc9b810d10", "name": "network-vif-plugged", "status": "completed", "tag": "38be05fb-8b40-41e5-b46a-fd8537f3988f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:08.733266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4b52dc53-0d16-4624-a602-14d83111e996 req-d5abcd0b-3143-4783-aac4-230ada54f1b8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:08.733815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4b52dc53-0d16-4624-a602-14d83111e996 req-d5abcd0b-3143-4783-aac4-230ada54f1b8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:08.734450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4b52dc53-0d16-4624-a602-14d83111e996 req-d5abcd0b-3143-4783-aac4-230ada54f1b8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:08.746389 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-4b52dc53-0d16-4624-a602-14d83111e996 req-d5abcd0b-3143-4783-aac4-230ada54f1b8 service nova] Creating event network-vif-plugged:38be05fb-8b40-41e5-b46a-fd8537f3988f for instance e0e615f0-f403-426c-a0c9-73cc9b810d10 on n-h1-861111-1 Oct 12 22:03:08.753007 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-4b52dc53-0d16-4624-a602-14d83111e996 req-d5abcd0b-3143-4783-aac4-230ada54f1b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039286 Oct 12 22:03:08.758918 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 543/1013] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:08.765565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-83dc04a7-30ee-4843-bd66-a7678b1813d5 tempest-FlavorMetadataValidation-860092179 tempest-FlavorMetadataValidation-860092179-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:08.789849 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-83dc04a7-30ee-4843-bd66-a7678b1813d5 tempest-FlavorMetadataValidation-860092179 tempest-FlavorMetadataValidation-860092179-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.029304 Oct 12 22:03:08.790819 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 544/1014] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 12 22:03:08 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:08.795592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ad108ca5-e269-4186-988e-c4b8b11e11d4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512880ca60>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:08.846592 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ad108ca5-e269-4186-988e-c4b8b11e11d4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.054412 Oct 12 22:03:08.847721 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 545/1015] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:08 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:08.881042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-408f883a-03be-443a-92d6-20f09a673f80 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:08.891322 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-408f883a-03be-443a-92d6-20f09a673f80 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1477 microversion: 2.1 time: 0.305067 Oct 12 22:03:08.893105 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 471/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:08 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1477 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:09.205670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-908bbf56-adb5-4118-89d3-6b4bd9760dea tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:09.206406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-908bbf56-adb5-4118-89d3-6b4bd9760dea tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:09.214758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-908bbf56-adb5-4118-89d3-6b4bd9760dea tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:09.215527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-908bbf56-adb5-4118-89d3-6b4bd9760dea tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:09.216668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-908bbf56-adb5-4118-89d3-6b4bd9760dea tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:09.217521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-908bbf56-adb5-4118-89d3-6b4bd9760dea tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:09.218139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-908bbf56-adb5-4118-89d3-6b4bd9760dea tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:09.218829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-908bbf56-adb5-4118-89d3-6b4bd9760dea tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:09.380796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-908bbf56-adb5-4118-89d3-6b4bd9760dea tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:09.391268 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-908bbf56-adb5-4118-89d3-6b4bd9760dea tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.189310 Oct 12 22:03:09.392167 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 546/1017] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:09 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:09.553598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1a0653e1-068b-49fd-a7e5-11a155992387 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:09.556338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1a0653e1-068b-49fd-a7e5-11a155992387 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:09.583272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a0653e1-068b-49fd-a7e5-11a155992387 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:09.583272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a0653e1-068b-49fd-a7e5-11a155992387 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:09.584143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a0653e1-068b-49fd-a7e5-11a155992387 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:09.585471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a0653e1-068b-49fd-a7e5-11a155992387 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:09.585471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a0653e1-068b-49fd-a7e5-11a155992387 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:09.585925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a0653e1-068b-49fd-a7e5-11a155992387 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:09.734408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-73c96321-33b4-4c16-a542-0116ed0016f3 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:09.735981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-73c96321-33b4-4c16-a542-0116ed0016f3 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:09.753074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73c96321-33b4-4c16-a542-0116ed0016f3 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:09.754883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73c96321-33b4-4c16-a542-0116ed0016f3 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:09.756391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73c96321-33b4-4c16-a542-0116ed0016f3 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:09.760893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73c96321-33b4-4c16-a542-0116ed0016f3 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:09.764289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73c96321-33b4-4c16-a542-0116ed0016f3 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:09.764901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73c96321-33b4-4c16-a542-0116ed0016f3 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:09.815916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1a0653e1-068b-49fd-a7e5-11a155992387 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:09.824595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1a0653e1-068b-49fd-a7e5-11a155992387 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:09.827813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1a0653e1-068b-49fd-a7e5-11a155992387 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:09.829386 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1a0653e1-068b-49fd-a7e5-11a155992387 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1542 microversion: 2.25 time: 0.280491 Oct 12 22:03:09.830100 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 472/1018] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:09 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1542 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:09.854712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f0339259-13e7-48cc-806b-52e0c76994f1 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '.version_select at 0x7f512864d940>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:09.858861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0339259-13e7-48cc-806b-52e0c76994f1 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:09.859267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0339259-13e7-48cc-806b-52e0c76994f1 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:09.859900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0339259-13e7-48cc-806b-52e0c76994f1 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:09.869958 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f0339259-13e7-48cc-806b-52e0c76994f1 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2364 microversion: 2.25 time: 0.018795 Oct 12 22:03:09.879709 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 473/1019] 10.222.0.16 () {60 vars in 1184 bytes} [Wed Oct 12 22:03:09 2022] GET /compute/v2.1/os-migrations => generated 2364 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:09.886782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-565f3427-0a7a-4dbf-aeca-501e25f68a8a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51286539d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:09.942498 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-565f3427-0a7a-4dbf-aeca-501e25f68a8a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.060470 Oct 12 22:03:09.952105 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 474/1020] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:09 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:09.957251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ba130210-aab4-4b05-ac71-0eddabba4360 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:09.957947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ba130210-aab4-4b05-ac71-0eddabba4360 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:09.965311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba130210-aab4-4b05-ac71-0eddabba4360 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:09.965913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba130210-aab4-4b05-ac71-0eddabba4360 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:09.966410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba130210-aab4-4b05-ac71-0eddabba4360 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:09.967187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba130210-aab4-4b05-ac71-0eddabba4360 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:09.968103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba130210-aab4-4b05-ac71-0eddabba4360 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:09.968739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba130210-aab4-4b05-ac71-0eddabba4360 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:10.046319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-73c96321-33b4-4c16-a542-0116ed0016f3 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:10.062918 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-73c96321-33b4-4c16-a542-0116ed0016f3 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1314 microversion: 2.1 time: 0.333072 Oct 12 22:03:10.064069 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 547/1021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:09 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:10.091794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8c8baff7-8bfe-4ee0-868e-b2b0b9277e86 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:10.092435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8c8baff7-8bfe-4ee0-868e-b2b0b9277e86 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:10.107829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c8baff7-8bfe-4ee0-868e-b2b0b9277e86 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:10.108336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c8baff7-8bfe-4ee0-868e-b2b0b9277e86 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:10.108782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c8baff7-8bfe-4ee0-868e-b2b0b9277e86 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:10.111189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c8baff7-8bfe-4ee0-868e-b2b0b9277e86 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:10.111682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c8baff7-8bfe-4ee0-868e-b2b0b9277e86 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:10.112118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c8baff7-8bfe-4ee0-868e-b2b0b9277e86 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:10.175320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-ba130210-aab4-4b05-ac71-0eddabba4360 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'services' on Instance uuid e0e615f0-f403-426c-a0c9-73cc9b810d10 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:03:10.208296 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ba130210-aab4-4b05-ac71-0eddabba4360 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 2034 microversion: 2.25 time: 0.254752 Oct 12 22:03:10.208881 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 475/1022] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:09 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 2034 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:10.250938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-781f74ba-21fd-4c21-9a33-105ea0c35fea tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Action: 'create', calling method: .version_select at 0x7f512864d550>, body: {"keypair": {"name": "tempest-keypair-1118449018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIq5rsy8St5JXwbziVH/TcBfQkW+JTxPuK90HmdoOudVZoB1QjulPNvRwdTPqFA1Vkvznwovo4TLBYmxSyjTSrg1d7wBrM/HhrLbJdpm4B4WjAOKGTsHP+xUnaaIz6JQA=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:10.260540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:10.271936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-781f74ba-21fd-4c21-9a33-105ea0c35fea tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Getting quotas for project beef77813aa641769eb3151b41b8e0cf. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:03:10.279126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-781f74ba-21fd-4c21-9a33-105ea0c35fea tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Getting quotas for user 1c8822d55876445d91f5681781313ce9 and project beef77813aa641769eb3151b41b8e0cf. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:03:10.322440 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-781f74ba-21fd-4c21-9a33-105ea0c35fea tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.081410 Oct 12 22:03:10.329809 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 476/1023] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 12 22:03:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 22:03:10.358801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8c8baff7-8bfe-4ee0-868e-b2b0b9277e86 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:10.366759 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8c8baff7-8bfe-4ee0-868e-b2b0b9277e86 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1477 microversion: 2.1 time: 0.301472 Oct 12 22:03:10.367438 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 548/1024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:10 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1477 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:10.415051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d9b63a78-f24a-4bc2-9006-ebc84355c01f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:10.415843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d9b63a78-f24a-4bc2-9006-ebc84355c01f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:10.430084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9b63a78-f24a-4bc2-9006-ebc84355c01f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:10.434179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9b63a78-f24a-4bc2-9006-ebc84355c01f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:10.434938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9b63a78-f24a-4bc2-9006-ebc84355c01f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:10.435897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9b63a78-f24a-4bc2-9006-ebc84355c01f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:10.437071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9b63a78-f24a-4bc2-9006-ebc84355c01f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:10.437701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9b63a78-f24a-4bc2-9006-ebc84355c01f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:10.776402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-095aa6cb-0f75-494d-80d3-895480a88e70 req-ec57fa65-b0fe-413f-b271-d1bbd2523ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa3d69d-dc00-42d4-8d95-14b0a37e08b9", "name": "network-vif-plugged", "status": "completed", "tag": "e686fc59-e990-4895-9968-98a0f6eea195"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:10.789129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-095aa6cb-0f75-494d-80d3-895480a88e70 req-ec57fa65-b0fe-413f-b271-d1bbd2523ce9 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:10.789861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-095aa6cb-0f75-494d-80d3-895480a88e70 req-ec57fa65-b0fe-413f-b271-d1bbd2523ce9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:10.790489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-095aa6cb-0f75-494d-80d3-895480a88e70 req-ec57fa65-b0fe-413f-b271-d1bbd2523ce9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:10.793490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d9b63a78-f24a-4bc2-9006-ebc84355c01f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:10.804328 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d9b63a78-f24a-4bc2-9006-ebc84355c01f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.393978 Oct 12 22:03:10.807905 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 477/1025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:10 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:10.813608 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-095aa6cb-0f75-494d-80d3-895480a88e70 req-ec57fa65-b0fe-413f-b271-d1bbd2523ce9 service nova] Creating event network-vif-plugged:e686fc59-e990-4895-9968-98a0f6eea195 for instance baa3d69d-dc00-42d4-8d95-14b0a37e08b9 on n-h2-861111-1 Oct 12 22:03:10.818745 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-095aa6cb-0f75-494d-80d3-895480a88e70 req-ec57fa65-b0fe-413f-b271-d1bbd2523ce9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045994 Oct 12 22:03:10.819585 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 549/1026] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:03:10.959503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-72adde7a-0954-4b31-a12b-411ecef6f11d tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512858fa60>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:11.025742 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-72adde7a-0954-4b31-a12b-411ecef6f11d tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.070122 Oct 12 22:03:11.026706 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 478/1027] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:10 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:11.089899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-adc8d25b-de49-46e6-add3-b0fed7629b05 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:11.090662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-adc8d25b-de49-46e6-add3-b0fed7629b05 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:11.101108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adc8d25b-de49-46e6-add3-b0fed7629b05 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:11.107500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adc8d25b-de49-46e6-add3-b0fed7629b05 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:11.109457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adc8d25b-de49-46e6-add3-b0fed7629b05 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:11.112312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adc8d25b-de49-46e6-add3-b0fed7629b05 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:11.115664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adc8d25b-de49-46e6-add3-b0fed7629b05 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:11.116370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adc8d25b-de49-46e6-add3-b0fed7629b05 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:11.338098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-adc8d25b-de49-46e6-add3-b0fed7629b05 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:11.349149 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-adc8d25b-de49-46e6-add3-b0fed7629b05 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1314 microversion: 2.1 time: 0.264863 Oct 12 22:03:11.356226 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 550/1028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:11 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:11.390378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-28e5613e-e98b-4a5a-ba98-fa903bcd4137 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:11.391089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-28e5613e-e98b-4a5a-ba98-fa903bcd4137 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:11.399744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28e5613e-e98b-4a5a-ba98-fa903bcd4137 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:11.401278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28e5613e-e98b-4a5a-ba98-fa903bcd4137 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:11.401804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28e5613e-e98b-4a5a-ba98-fa903bcd4137 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:11.405616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28e5613e-e98b-4a5a-ba98-fa903bcd4137 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:11.406344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28e5613e-e98b-4a5a-ba98-fa903bcd4137 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:11.407012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28e5613e-e98b-4a5a-ba98-fa903bcd4137 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:11.677882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-28e5613e-e98b-4a5a-ba98-fa903bcd4137 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:11.691777 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-28e5613e-e98b-4a5a-ba98-fa903bcd4137 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1477 microversion: 2.1 time: 0.301586 Oct 12 22:03:11.703806 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 479/1029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:11 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1477 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:11.837979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-13dc3c82-9e83-43bf-861b-3b39198242e2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:11.837979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-13dc3c82-9e83-43bf-861b-3b39198242e2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:11.853845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13dc3c82-9e83-43bf-861b-3b39198242e2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:11.854342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13dc3c82-9e83-43bf-861b-3b39198242e2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:11.854782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13dc3c82-9e83-43bf-861b-3b39198242e2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:11.855515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13dc3c82-9e83-43bf-861b-3b39198242e2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:11.855966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13dc3c82-9e83-43bf-861b-3b39198242e2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:11.856943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13dc3c82-9e83-43bf-861b-3b39198242e2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:12.043450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-20d88fce-9738-44b8-bd82-f7a652019f0a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128524d30>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:12.114343 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-20d88fce-9738-44b8-bd82-f7a652019f0a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.076493 Oct 12 22:03:12.114904 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 480/1030] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:12 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:12.187077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-13dc3c82-9e83-43bf-861b-3b39198242e2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:12.202243 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-13dc3c82-9e83-43bf-861b-3b39198242e2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.373210 Oct 12 22:03:12.203395 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 551/1031] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:11 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:12.395068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cc38a00f-8b31-4d29-9adf-af2b62327365 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:12.396074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cc38a00f-8b31-4d29-9adf-af2b62327365 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:12.409288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc38a00f-8b31-4d29-9adf-af2b62327365 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:12.410080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc38a00f-8b31-4d29-9adf-af2b62327365 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:12.410716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc38a00f-8b31-4d29-9adf-af2b62327365 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:12.411866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc38a00f-8b31-4d29-9adf-af2b62327365 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:12.412502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc38a00f-8b31-4d29-9adf-af2b62327365 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:12.413100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc38a00f-8b31-4d29-9adf-af2b62327365 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:12.678562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cc38a00f-8b31-4d29-9adf-af2b62327365 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:12.687469 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cc38a00f-8b31-4d29-9adf-af2b62327365 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1314 microversion: 2.1 time: 0.298170 Oct 12 22:03:12.700806 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 481/1032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:12 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:12.720511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-68c7ffc2-3079-4b6b-823c-5303b46c2f4a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:12.721627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-68c7ffc2-3079-4b6b-823c-5303b46c2f4a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:12.733575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68c7ffc2-3079-4b6b-823c-5303b46c2f4a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:12.735527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68c7ffc2-3079-4b6b-823c-5303b46c2f4a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:12.736319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68c7ffc2-3079-4b6b-823c-5303b46c2f4a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:12.738828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68c7ffc2-3079-4b6b-823c-5303b46c2f4a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:12.740330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68c7ffc2-3079-4b6b-823c-5303b46c2f4a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:12.740989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68c7ffc2-3079-4b6b-823c-5303b46c2f4a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:12.787194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-775292383", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "a1135d57-c7e8-447f-a856-6e68b955e716"}], "security_groups": [{"name": "tempest-securitygroup--1078520769"}], "key_name": "tempest-keypair-1118449018", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:12.944923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-68c7ffc2-3079-4b6b-823c-5303b46c2f4a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:12.954622 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-68c7ffc2-3079-4b6b-823c-5303b46c2f4a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1477 microversion: 2.1 time: 0.238239 Oct 12 22:03:12.955559 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 552/1033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:12 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1477 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:12.974951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] validate_networks() for [('a1135d57-c7e8-447f-a856-6e68b955e716', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:03:13.130850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-05bd23f9-bb3b-4b31-ae53-3c48b8714eeb tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512a50f5e0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:13.189828 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-05bd23f9-bb3b-4b31-ae53-3c48b8714eeb tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.063181 Oct 12 22:03:13.198015 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 553/1034] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:13 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:13.358543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a96c68cc-eb32-40ce-af2e-b8f952dffc09 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Calling method '.version_select at 0x7f51287c8430>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:13.364851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a96c68cc-eb32-40ce-af2e-b8f952dffc09 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.366082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a96c68cc-eb32-40ce-af2e-b8f952dffc09 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.366996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a96c68cc-eb32-40ce-af2e-b8f952dffc09 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.368397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a96c68cc-eb32-40ce-af2e-b8f952dffc09 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.369224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a96c68cc-eb32-40ce-af2e-b8f952dffc09 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.369962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a96c68cc-eb32-40ce-af2e-b8f952dffc09 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.406073 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a96c68cc-eb32-40ce-af2e-b8f952dffc09 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.206701 Oct 12 22:03:13.406986 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 554/1035] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 12 22:03:13 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:13.414646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e7a91869-9d2b-4f86-bfa2-90aa45ed4a8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:13.415643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e7a91869-9d2b-4f86-bfa2-90aa45ed4a8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:13.424198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7a91869-9d2b-4f86-bfa2-90aa45ed4a8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.424690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7a91869-9d2b-4f86-bfa2-90aa45ed4a8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.425121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7a91869-9d2b-4f86-bfa2-90aa45ed4a8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.425991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7a91869-9d2b-4f86-bfa2-90aa45ed4a8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.426602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7a91869-9d2b-4f86-bfa2-90aa45ed4a8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.427184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7a91869-9d2b-4f86-bfa2-90aa45ed4a8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.448582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:03:13.449124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:03:13.449554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:03:13.450982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:03:13.451448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:03:13.470632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.473461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.473960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.474818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.477416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.477906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.513116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Getting quotas for project beef77813aa641769eb3151b41b8e0cf. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:03:13.519898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Getting quotas for user 1c8822d55876445d91f5681781313ce9 and project beef77813aa641769eb3151b41b8e0cf. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:03:13.533545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:03:13.536149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:03:13.584043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e7a91869-9d2b-4f86-bfa2-90aa45ed4a8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:13.597914 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-93bb4b0b-92ee-42e5-ab05-cf8404d98eae tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 0.814648 Oct 12 22:03:13.598854 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 482/1036] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 22:03:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 12 22:03:13.601541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:13.604474 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e7a91869-9d2b-4f86-bfa2-90aa45ed4a8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.196125 Oct 12 22:03:13.605929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-229a7a27-53ed-427d-aa3e-749b0d72e9db tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Calling method '.version_select at 0x7f51286534c0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:13.615642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-229a7a27-53ed-427d-aa3e-749b0d72e9db tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.615642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-229a7a27-53ed-427d-aa3e-749b0d72e9db tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.615642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-229a7a27-53ed-427d-aa3e-749b0d72e9db tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.615642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-229a7a27-53ed-427d-aa3e-749b0d72e9db tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.616102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-229a7a27-53ed-427d-aa3e-749b0d72e9db tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.616102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-229a7a27-53ed-427d-aa3e-749b0d72e9db tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.623538 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 555/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:13 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:13.629830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-44f6425b-e884-4fa7-8bf2-1c8de3852323 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:13.630789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-44f6425b-e884-4fa7-8bf2-1c8de3852323 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:13.652405 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-229a7a27-53ed-427d-aa3e-749b0d72e9db tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.052279 Oct 12 22:03:13.653014 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 483/1038] 10.222.0.16 () {58 vars in 1139 bytes} [Wed Oct 12 22:03:13 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:13.666119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-54204f12-b644-4b54-9420-9d1a69e8fa85 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Calling method '.version_select at 0x7f51285ae550>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:13.669696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54204f12-b644-4b54-9420-9d1a69e8fa85 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.670242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54204f12-b644-4b54-9420-9d1a69e8fa85 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.670746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54204f12-b644-4b54-9420-9d1a69e8fa85 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.673400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54204f12-b644-4b54-9420-9d1a69e8fa85 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.673400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54204f12-b644-4b54-9420-9d1a69e8fa85 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.673400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54204f12-b644-4b54-9420-9d1a69e8fa85 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.702217 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-54204f12-b644-4b54-9420-9d1a69e8fa85 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.040060 Oct 12 22:03:13.703126 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 484/1039] 10.222.0.16 () {58 vars in 1145 bytes} [Wed Oct 12 22:03:13 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:03:13.716837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-18f36296-6471-4f49-9cfc-d4f41a2299c5 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Calling method '.version_select at 0x7f51285ae5e0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:13.720651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f36296-6471-4f49-9cfc-d4f41a2299c5 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.721328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f36296-6471-4f49-9cfc-d4f41a2299c5 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.722336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f36296-6471-4f49-9cfc-d4f41a2299c5 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.723367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f36296-6471-4f49-9cfc-d4f41a2299c5 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.724002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f36296-6471-4f49-9cfc-d4f41a2299c5 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.724592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f36296-6471-4f49-9cfc-d4f41a2299c5 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.727200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-44f6425b-e884-4fa7-8bf2-1c8de3852323 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:13.736327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-44f6425b-e884-4fa7-8bf2-1c8de3852323 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:13.738092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-44f6425b-e884-4fa7-8bf2-1c8de3852323 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:13.739387 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-44f6425b-e884-4fa7-8bf2-1c8de3852323 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1285 microversion: 2.25 time: 0.114301 Oct 12 22:03:13.740559 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 556/1040] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:13 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:13.746054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-21e0c14f-ab2f-4b04-a8f4-c4c4a04f1bb7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:13.747446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-21e0c14f-ab2f-4b04-a8f4-c4c4a04f1bb7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:13.753097 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-18f36296-6471-4f49-9cfc-d4f41a2299c5 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.040254 Oct 12 22:03:13.754368 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 485/1041] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 12 22:03:13 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:13.755025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21e0c14f-ab2f-4b04-a8f4-c4c4a04f1bb7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.755793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21e0c14f-ab2f-4b04-a8f4-c4c4a04f1bb7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.756455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21e0c14f-ab2f-4b04-a8f4-c4c4a04f1bb7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.757474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21e0c14f-ab2f-4b04-a8f4-c4c4a04f1bb7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.758144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21e0c14f-ab2f-4b04-a8f4-c4c4a04f1bb7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.758799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21e0c14f-ab2f-4b04-a8f4-c4c4a04f1bb7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.773843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-889b2835-557e-44d9-b162-5af0cbacd969 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Calling method '.version_select at 0x7f51285aec10>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:13.777522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-889b2835-557e-44d9-b162-5af0cbacd969 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.778711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-889b2835-557e-44d9-b162-5af0cbacd969 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.779357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-889b2835-557e-44d9-b162-5af0cbacd969 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.780246 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-889b2835-557e-44d9-b162-5af0cbacd969 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.780919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-889b2835-557e-44d9-b162-5af0cbacd969 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.781973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-889b2835-557e-44d9-b162-5af0cbacd969 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.815071 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-889b2835-557e-44d9-b162-5af0cbacd969 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.052521 Oct 12 22:03:13.816275 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 486/1042] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 12 22:03:13 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:13.827893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c68e7584-0b30-420f-b49c-90fdd2aaadba tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Calling method '.version_select at 0x7f5128653dc0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:13.846249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c68e7584-0b30-420f-b49c-90fdd2aaadba tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.846748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c68e7584-0b30-420f-b49c-90fdd2aaadba tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.847221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c68e7584-0b30-420f-b49c-90fdd2aaadba tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.849901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c68e7584-0b30-420f-b49c-90fdd2aaadba tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.850303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c68e7584-0b30-420f-b49c-90fdd2aaadba tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.850731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c68e7584-0b30-420f-b49c-90fdd2aaadba tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.901585 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c68e7584-0b30-420f-b49c-90fdd2aaadba tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.077919 Oct 12 22:03:13.902497 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 487/1043] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 12 22:03:13 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:13.916688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c1521776-7c63-4b49-b2ad-61f532706828 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Calling method '.version_select at 0x7f51286ec040>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:13.933047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1521776-7c63-4b49-b2ad-61f532706828 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.933822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1521776-7c63-4b49-b2ad-61f532706828 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.934659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1521776-7c63-4b49-b2ad-61f532706828 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.955170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1521776-7c63-4b49-b2ad-61f532706828 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:13.955720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1521776-7c63-4b49-b2ad-61f532706828 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:13.956159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1521776-7c63-4b49-b2ad-61f532706828 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:13.963635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-21e0c14f-ab2f-4b04-a8f4-c4c4a04f1bb7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:13.975287 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-21e0c14f-ab2f-4b04-a8f4-c4c4a04f1bb7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1500 microversion: 2.1 time: 0.233491 Oct 12 22:03:13.992228 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 557/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:13 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1500 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:14.009976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-12173e95-e0c3-4ef1-8fae-531888144539 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:14.011224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-12173e95-e0c3-4ef1-8fae-531888144539 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:14.023285 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c1521776-7c63-4b49-b2ad-61f532706828 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h1-861111-1" status: 200 len: 860 microversion: 2.1 time: 0.113079 Oct 12 22:03:14.024136 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 488/1045] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 12 22:03:13 2022] GET /compute/v2.1/os-hosts/n-h1-861111-1 => generated 860 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:14.034311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-58bc195d-bf4c-4cf5-8585-c28c21fa82cb tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:14.034827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12173e95-e0c3-4ef1-8fae-531888144539 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:14.037089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-58bc195d-bf4c-4cf5-8585-c28c21fa82cb tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:14.037607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12173e95-e0c3-4ef1-8fae-531888144539 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:14.038290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12173e95-e0c3-4ef1-8fae-531888144539 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:14.039218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12173e95-e0c3-4ef1-8fae-531888144539 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:14.039912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12173e95-e0c3-4ef1-8fae-531888144539 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:14.040556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12173e95-e0c3-4ef1-8fae-531888144539 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:14.052265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58bc195d-bf4c-4cf5-8585-c28c21fa82cb tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:14.054446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58bc195d-bf4c-4cf5-8585-c28c21fa82cb tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:14.054912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58bc195d-bf4c-4cf5-8585-c28c21fa82cb tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:14.055673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58bc195d-bf4c-4cf5-8585-c28c21fa82cb tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:14.056149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58bc195d-bf4c-4cf5-8585-c28c21fa82cb tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:14.056590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58bc195d-bf4c-4cf5-8585-c28c21fa82cb tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:14.104982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-58bc195d-bf4c-4cf5-8585-c28c21fa82cb tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lazy-loading 'flavor' on Instance uuid baa3d69d-dc00-42d4-8d95-14b0a37e08b9 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:03:14.136941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:14.218503 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-58bc195d-bf4c-4cf5-8585-c28c21fa82cb tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "POST /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9/action" status: 200 len: 32 microversion: 2.1 time: 0.193050 Oct 12 22:03:14.219455 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 489/1046] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:03:14 2022] POST /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9/action => generated 32 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:03:14.225018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-58a60247-53bc-47f6-8942-aa5b28fde9c9 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Calling method '.version_select at 0x7f512864dee0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:14.232620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58a60247-53bc-47f6-8942-aa5b28fde9c9 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:14.233310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58a60247-53bc-47f6-8942-aa5b28fde9c9 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:14.233624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58a60247-53bc-47f6-8942-aa5b28fde9c9 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:14.248094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58a60247-53bc-47f6-8942-aa5b28fde9c9 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:14.248839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58a60247-53bc-47f6-8942-aa5b28fde9c9 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:14.248995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58a60247-53bc-47f6-8942-aa5b28fde9c9 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:14.269676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-12173e95-e0c3-4ef1-8fae-531888144539 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:14.279794 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-12173e95-e0c3-4ef1-8fae-531888144539 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1477 microversion: 2.1 time: 0.286375 Oct 12 22:03:14.280980 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 558/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:13 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1477 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:14.302381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe735e17-25eb-415d-be8c-a8f04e4ce30b tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51283ac040>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:14.309067 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-58a60247-53bc-47f6-8942-aa5b28fde9c9 tempest-HostsAdminTestJSON-1845278349 tempest-HostsAdminTestJSON-1845278349-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h2-861111-1" status: 200 len: 860 microversion: 2.1 time: 0.088197 Oct 12 22:03:14.309886 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 490/1048] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 12 22:03:14 2022] GET /compute/v2.1/os-hosts/n-h2-861111-1 => generated 860 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:14.330208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f3082190-cd6b-4ac9-b2e2-ad85bc9bb2f6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:14.330937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f3082190-cd6b-4ac9-b2e2-ad85bc9bb2f6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:14.343672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3082190-cd6b-4ac9-b2e2-ad85bc9bb2f6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:14.344168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3082190-cd6b-4ac9-b2e2-ad85bc9bb2f6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:14.344611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3082190-cd6b-4ac9-b2e2-ad85bc9bb2f6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:14.345313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3082190-cd6b-4ac9-b2e2-ad85bc9bb2f6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:14.352893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3082190-cd6b-4ac9-b2e2-ad85bc9bb2f6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:14.353252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3082190-cd6b-4ac9-b2e2-ad85bc9bb2f6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:14.401781 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fe735e17-25eb-415d-be8c-a8f04e4ce30b tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.116709 Oct 12 22:03:14.402392 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 559/1049] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:14 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:14.634435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c8325138-9fb0-42e3-a739-a066d42a49ac tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:14.635121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c8325138-9fb0-42e3-a739-a066d42a49ac tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:14.645792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8325138-9fb0-42e3-a739-a066d42a49ac tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:14.646278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8325138-9fb0-42e3-a739-a066d42a49ac tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:14.646712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8325138-9fb0-42e3-a739-a066d42a49ac tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:14.647442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8325138-9fb0-42e3-a739-a066d42a49ac tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:14.647893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8325138-9fb0-42e3-a739-a066d42a49ac tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:14.648315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8325138-9fb0-42e3-a739-a066d42a49ac tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:14.667733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f3082190-cd6b-4ac9-b2e2-ad85bc9bb2f6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:14.682386 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f3082190-cd6b-4ac9-b2e2-ad85bc9bb2f6 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.355917 Oct 12 22:03:14.685538 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 491/1050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:14 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:14.768352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bfa8477d-8f46-4da6-bcc7-258356ed76c0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:14.769163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bfa8477d-8f46-4da6-bcc7-258356ed76c0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:14.781948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfa8477d-8f46-4da6-bcc7-258356ed76c0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:14.782585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfa8477d-8f46-4da6-bcc7-258356ed76c0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:14.783187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfa8477d-8f46-4da6-bcc7-258356ed76c0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:14.784472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfa8477d-8f46-4da6-bcc7-258356ed76c0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:14.787051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfa8477d-8f46-4da6-bcc7-258356ed76c0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:14.789387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfa8477d-8f46-4da6-bcc7-258356ed76c0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:14.901275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c8325138-9fb0-42e3-a739-a066d42a49ac tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:14.913384 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c8325138-9fb0-42e3-a739-a066d42a49ac tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.283237 Oct 12 22:03:14.914348 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 560/1051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:14 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:14.915049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bfa8477d-8f46-4da6-bcc7-258356ed76c0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:14.926117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bfa8477d-8f46-4da6-bcc7-258356ed76c0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:14.928125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bfa8477d-8f46-4da6-bcc7-258356ed76c0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:14.930197 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bfa8477d-8f46-4da6-bcc7-258356ed76c0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1337 microversion: 2.25 time: 0.164895 Oct 12 22:03:14.931067 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 492/1052] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:14 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1337 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:03:15.308259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d817dbb7-38ce-4d32-bb01-ae3ea37d004d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:15.310474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d817dbb7-38ce-4d32-bb01-ae3ea37d004d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:15.317413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d817dbb7-38ce-4d32-bb01-ae3ea37d004d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:15.318324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d817dbb7-38ce-4d32-bb01-ae3ea37d004d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:15.318976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d817dbb7-38ce-4d32-bb01-ae3ea37d004d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:15.320040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d817dbb7-38ce-4d32-bb01-ae3ea37d004d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:15.320775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d817dbb7-38ce-4d32-bb01-ae3ea37d004d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:15.321520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d817dbb7-38ce-4d32-bb01-ae3ea37d004d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:15.423191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-86b8356c-d80d-42f8-9f1e-50330e2db191 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128653ca0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:15.491915 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-86b8356c-d80d-42f8-9f1e-50330e2db191 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.077109 Oct 12 22:03:15.492854 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 493/1053] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:15 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:15.556361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d817dbb7-38ce-4d32-bb01-ae3ea37d004d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:15.565049 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d817dbb7-38ce-4d32-bb01-ae3ea37d004d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1477 microversion: 2.1 time: 0.260906 Oct 12 22:03:15.567304 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 561/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:15 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1477 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:15.710379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-289cc367-5ed5-4e77-a250-fe317c0c8543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:15.712060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-289cc367-5ed5-4e77-a250-fe317c0c8543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:15.720368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-289cc367-5ed5-4e77-a250-fe317c0c8543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:15.720892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-289cc367-5ed5-4e77-a250-fe317c0c8543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:15.721337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-289cc367-5ed5-4e77-a250-fe317c0c8543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:15.723660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-289cc367-5ed5-4e77-a250-fe317c0c8543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:15.724159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-289cc367-5ed5-4e77-a250-fe317c0c8543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:15.724597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-289cc367-5ed5-4e77-a250-fe317c0c8543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:15.935297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-289cc367-5ed5-4e77-a250-fe317c0c8543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:15.948135 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-289cc367-5ed5-4e77-a250-fe317c0c8543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.242111 Oct 12 22:03:15.949500 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 494/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:15 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:15.964964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb30d803-268d-4bc4-90d8-3bc47245608b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:15.966164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eb30d803-268d-4bc4-90d8-3bc47245608b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:15.966316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8df9bbbc-fcf0-4f6b-bce0-bd65d67eb44a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:15.967445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8df9bbbc-fcf0-4f6b-bce0-bd65d67eb44a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:15.977611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb30d803-268d-4bc4-90d8-3bc47245608b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:15.979589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb30d803-268d-4bc4-90d8-3bc47245608b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:15.980597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb30d803-268d-4bc4-90d8-3bc47245608b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:15.981582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb30d803-268d-4bc4-90d8-3bc47245608b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:15.982263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb30d803-268d-4bc4-90d8-3bc47245608b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:15.982923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb30d803-268d-4bc4-90d8-3bc47245608b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:15.986002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8df9bbbc-fcf0-4f6b-bce0-bd65d67eb44a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:15.986843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8df9bbbc-fcf0-4f6b-bce0-bd65d67eb44a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:15.987465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8df9bbbc-fcf0-4f6b-bce0-bd65d67eb44a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:15.988493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8df9bbbc-fcf0-4f6b-bce0-bd65d67eb44a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:15.989100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8df9bbbc-fcf0-4f6b-bce0-bd65d67eb44a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:15.989674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8df9bbbc-fcf0-4f6b-bce0-bd65d67eb44a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:16.069396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eb30d803-268d-4bc4-90d8-3bc47245608b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:16.086096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eb30d803-268d-4bc4-90d8-3bc47245608b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:16.088229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eb30d803-268d-4bc4-90d8-3bc47245608b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:16.089626 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb30d803-268d-4bc4-90d8-3bc47245608b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1343 microversion: 2.25 time: 0.128918 Oct 12 22:03:16.090789 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 495/1056] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:15 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1343 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:16.255063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8df9bbbc-fcf0-4f6b-bce0-bd65d67eb44a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:16.265999 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8df9bbbc-fcf0-4f6b-bce0-bd65d67eb44a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.318369 Oct 12 22:03:16.267110 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 562/1057] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:15 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:16.510398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e3ca939b-2a20-468d-82de-c72c15d2f2d0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51286539d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:16.595559 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e3ca939b-2a20-468d-82de-c72c15d2f2d0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.091410 Oct 12 22:03:16.596521 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 496/1058] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:16 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:16.597198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c7e8e66e-6c39-4bec-acc5-5e5e99d6a45c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:16.612858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c7e8e66e-6c39-4bec-acc5-5e5e99d6a45c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:16.640099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7e8e66e-6c39-4bec-acc5-5e5e99d6a45c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:16.641129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7e8e66e-6c39-4bec-acc5-5e5e99d6a45c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:16.642500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7e8e66e-6c39-4bec-acc5-5e5e99d6a45c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:16.656287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7e8e66e-6c39-4bec-acc5-5e5e99d6a45c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:16.658363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7e8e66e-6c39-4bec-acc5-5e5e99d6a45c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:16.659127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7e8e66e-6c39-4bec-acc5-5e5e99d6a45c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:16.862933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c7e8e66e-6c39-4bec-acc5-5e5e99d6a45c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:16.871693 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c7e8e66e-6c39-4bec-acc5-5e5e99d6a45c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1477 microversion: 2.1 time: 0.279604 Oct 12 22:03:16.875290 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 563/1059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:16 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1477 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:16.978898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7cd80740-09d2-40a6-9af7-44d9547a7cf7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:16.979762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7cd80740-09d2-40a6-9af7-44d9547a7cf7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:16.988082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cd80740-09d2-40a6-9af7-44d9547a7cf7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:16.988841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cd80740-09d2-40a6-9af7-44d9547a7cf7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:16.989457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cd80740-09d2-40a6-9af7-44d9547a7cf7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:16.990565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cd80740-09d2-40a6-9af7-44d9547a7cf7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:16.991470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cd80740-09d2-40a6-9af7-44d9547a7cf7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:16.991902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cd80740-09d2-40a6-9af7-44d9547a7cf7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:17.114261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fbe5fd00-f7b2-4ddb-8645-c7b7c9b67dd7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:17.114871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fbe5fd00-f7b2-4ddb-8645-c7b7c9b67dd7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:17.126613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fbe5fd00-f7b2-4ddb-8645-c7b7c9b67dd7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:17.131149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fbe5fd00-f7b2-4ddb-8645-c7b7c9b67dd7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:17.131777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fbe5fd00-f7b2-4ddb-8645-c7b7c9b67dd7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:17.137131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fbe5fd00-f7b2-4ddb-8645-c7b7c9b67dd7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:17.138644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fbe5fd00-f7b2-4ddb-8645-c7b7c9b67dd7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:17.139283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fbe5fd00-f7b2-4ddb-8645-c7b7c9b67dd7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:17.256830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7cd80740-09d2-40a6-9af7-44d9547a7cf7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:17.268012 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7cd80740-09d2-40a6-9af7-44d9547a7cf7 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.294418 Oct 12 22:03:17.280530 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 497/1060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:16 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:17.280911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fbe5fd00-f7b2-4ddb-8645-c7b7c9b67dd7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:17.293074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fbe5fd00-f7b2-4ddb-8645-c7b7c9b67dd7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:17.294612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fbe5fd00-f7b2-4ddb-8645-c7b7c9b67dd7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:17.300029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-efb28bd5-2632-443a-8f09-7688a4f851b7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:17.300424 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fbe5fd00-f7b2-4ddb-8645-c7b7c9b67dd7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1343 microversion: 2.25 time: 0.190411 Oct 12 22:03:17.300806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-efb28bd5-2632-443a-8f09-7688a4f851b7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:17.316395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efb28bd5-2632-443a-8f09-7688a4f851b7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:17.316891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efb28bd5-2632-443a-8f09-7688a4f851b7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:17.317330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efb28bd5-2632-443a-8f09-7688a4f851b7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:17.322263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efb28bd5-2632-443a-8f09-7688a4f851b7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:17.322525 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 564/1061] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:17 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1343 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:03:17.323034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efb28bd5-2632-443a-8f09-7688a4f851b7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:17.323510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efb28bd5-2632-443a-8f09-7688a4f851b7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:17.612770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-544f9200-33ab-44f4-8fb1-db966b0af92b tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51286fcc10>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:17.650080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-efb28bd5-2632-443a-8f09-7688a4f851b7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:17.661254 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-efb28bd5-2632-443a-8f09-7688a4f851b7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.371639 Oct 12 22:03:17.675270 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 498/1062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:17 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:17.701758 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-544f9200-33ab-44f4-8fb1-db966b0af92b tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.094004 Oct 12 22:03:17.702602 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 565/1063] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:17 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:17.894540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-546394a2-924b-4118-8afc-1d7a1d690f7d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:17.895153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-546394a2-924b-4118-8afc-1d7a1d690f7d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:17.902354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-546394a2-924b-4118-8afc-1d7a1d690f7d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:17.902831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-546394a2-924b-4118-8afc-1d7a1d690f7d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:17.903354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-546394a2-924b-4118-8afc-1d7a1d690f7d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:17.911406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-546394a2-924b-4118-8afc-1d7a1d690f7d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:17.913149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-546394a2-924b-4118-8afc-1d7a1d690f7d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:17.914554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-546394a2-924b-4118-8afc-1d7a1d690f7d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:18.295741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6c04c576-dadc-48ac-954b-b67b4747bfe0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:18.296282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6c04c576-dadc-48ac-954b-b67b4747bfe0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:18.317150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-546394a2-924b-4118-8afc-1d7a1d690f7d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:18.317751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c04c576-dadc-48ac-954b-b67b4747bfe0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:18.318176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c04c576-dadc-48ac-954b-b67b4747bfe0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:18.318804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c04c576-dadc-48ac-954b-b67b4747bfe0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:18.319720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c04c576-dadc-48ac-954b-b67b4747bfe0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:18.320332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c04c576-dadc-48ac-954b-b67b4747bfe0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:18.320923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c04c576-dadc-48ac-954b-b67b4747bfe0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:18.330897 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-546394a2-924b-4118-8afc-1d7a1d690f7d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1476 microversion: 2.1 time: 0.439241 Oct 12 22:03:18.333244 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 499/1064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:17 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1476 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:18.346839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-04a3c49d-2d14-4bdd-aa69-8f8f7ee791d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:18.347497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-04a3c49d-2d14-4bdd-aa69-8f8f7ee791d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:18.361699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a3c49d-2d14-4bdd-aa69-8f8f7ee791d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:18.362198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a3c49d-2d14-4bdd-aa69-8f8f7ee791d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:18.367529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a3c49d-2d14-4bdd-aa69-8f8f7ee791d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:18.368554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a3c49d-2d14-4bdd-aa69-8f8f7ee791d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:18.369184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a3c49d-2d14-4bdd-aa69-8f8f7ee791d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:18.370644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a3c49d-2d14-4bdd-aa69-8f8f7ee791d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:18.520889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-04a3c49d-2d14-4bdd-aa69-8f8f7ee791d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:18.538254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-04a3c49d-2d14-4bdd-aa69-8f8f7ee791d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:18.543322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-04a3c49d-2d14-4bdd-aa69-8f8f7ee791d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:18.546572 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-04a3c49d-2d14-4bdd-aa69-8f8f7ee791d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1343 microversion: 2.25 time: 0.212016 Oct 12 22:03:18.547084 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 500/1065] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:18 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1343 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:18.693754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af98a903-5f71-4dbd-a1d3-867eff90f275 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:18.695868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-af98a903-5f71-4dbd-a1d3-867eff90f275 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:18.713865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af98a903-5f71-4dbd-a1d3-867eff90f275 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:18.714524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af98a903-5f71-4dbd-a1d3-867eff90f275 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:18.716535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af98a903-5f71-4dbd-a1d3-867eff90f275 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:18.719556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af98a903-5f71-4dbd-a1d3-867eff90f275 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:18.721656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af98a903-5f71-4dbd-a1d3-867eff90f275 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:18.722154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af98a903-5f71-4dbd-a1d3-867eff90f275 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:18.732505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6c04c576-dadc-48ac-954b-b67b4747bfe0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:18.744983 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6c04c576-dadc-48ac-954b-b67b4747bfe0 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.453327 Oct 12 22:03:18.745601 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 566/1066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:18 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:18.760512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-78b4b926-90ff-4339-887a-31049827fa7a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51282e6550>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:18.856783 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-78b4b926-90ff-4339-887a-31049827fa7a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.107661 Oct 12 22:03:18.857550 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 567/1067] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:18 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:18.874235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-fab073cc-c96a-4049-a2e6-3c689a7be644 req-7d6a3109-61a8-484a-8aec-6c4f4384501d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adec1006-780c-4fe7-871a-e4f7addfe159", "name": "network-vif-unplugged", "status": "completed", "tag": "1a376da9-7885-4d84-98d7-e6c54abdca11"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:18.910596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fab073cc-c96a-4049-a2e6-3c689a7be644 req-7d6a3109-61a8-484a-8aec-6c4f4384501d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:18.919921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fab073cc-c96a-4049-a2e6-3c689a7be644 req-7d6a3109-61a8-484a-8aec-6c4f4384501d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:18.920382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fab073cc-c96a-4049-a2e6-3c689a7be644 req-7d6a3109-61a8-484a-8aec-6c4f4384501d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:18.942334 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-fab073cc-c96a-4049-a2e6-3c689a7be644 req-7d6a3109-61a8-484a-8aec-6c4f4384501d service nova] Creating event network-vif-unplugged:1a376da9-7885-4d84-98d7-e6c54abdca11 for instance adec1006-780c-4fe7-871a-e4f7addfe159 on n-h2-861111-1 Oct 12 22:03:18.952924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-fab073cc-c96a-4049-a2e6-3c689a7be644 req-7d6a3109-61a8-484a-8aec-6c4f4384501d service nova] Instance adec1006-780c-4fe7-871a-e4f7addfe159 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:03:18.983437 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-fab073cc-c96a-4049-a2e6-3c689a7be644 req-7d6a3109-61a8-484a-8aec-6c4f4384501d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116912 Oct 12 22:03:18.984038 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 568/1068] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:19.174373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-af98a903-5f71-4dbd-a1d3-867eff90f275 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:19.187173 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-af98a903-5f71-4dbd-a1d3-867eff90f275 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.498112 Oct 12 22:03:19.204629 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 501/1069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:18 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:19.252704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ade9e22d-a8c8-4662-8c90-f4e27ead1a68 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Calling method '.version_select at 0x7f5128767f70>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:19.256623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ade9e22d-a8c8-4662-8c90-f4e27ead1a68 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:19.257751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ade9e22d-a8c8-4662-8c90-f4e27ead1a68 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:19.259198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ade9e22d-a8c8-4662-8c90-f4e27ead1a68 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:19.260097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ade9e22d-a8c8-4662-8c90-f4e27ead1a68 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:19.260645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ade9e22d-a8c8-4662-8c90-f4e27ead1a68 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:19.261151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ade9e22d-a8c8-4662-8c90-f4e27ead1a68 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:19.293750 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ade9e22d-a8c8-4662-8c90-f4e27ead1a68 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.307556 Oct 12 22:03:19.294601 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 569/1070] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 12 22:03:18 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:19.361690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-29073d79-d8a3-47ee-8deb-3a1e6fe52cc5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:19.362429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-29073d79-d8a3-47ee-8deb-3a1e6fe52cc5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:19.369608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29073d79-d8a3-47ee-8deb-3a1e6fe52cc5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:19.370450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29073d79-d8a3-47ee-8deb-3a1e6fe52cc5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:19.371291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29073d79-d8a3-47ee-8deb-3a1e6fe52cc5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:19.373292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29073d79-d8a3-47ee-8deb-3a1e6fe52cc5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:19.373988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29073d79-d8a3-47ee-8deb-3a1e6fe52cc5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:19.374729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29073d79-d8a3-47ee-8deb-3a1e6fe52cc5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:19.499782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-13c1a42f-de64-4680-8acc-95b5f7c87571 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Calling method '.version_select at 0x7f51285ae550>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:19.506785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-13c1a42f-de64-4680-8acc-95b5f7c87571 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '4d103732bb444134b33e87e0fee459e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f6f634bf084367973be1a95acfcc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-13c1a42f-de64-4680-8acc-95b5f7c87571 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Request method failure captured: Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzmlCf_T68YBK972BVseX1TjGdaovySESvgEpCFgEQio5QohvJ5OBqG4GGsVstAJIuWYRR2OK-AaHMT67OhB4JMGrtelusc3ZdMzXm73Cj7gIwU229CaEHdCoAanPD32O857DH6rHpVhBbtWRusT2SYZ6dmiKs0vi9EB0is7GbgNbO4 Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: e8f6f634bf084367973be1a95acfcc36 Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:03:19.509690 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:03:19.511428 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e8f6f634bf084367973be1a95acfcc36", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:03:19.511428 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:19.511428 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: e8f6f634bf084367973be1a95acfcc36 Oct 12 22:03:19.511428 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:19.511428 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-HostsAdminNegativeTestJSON-1469796454-project Oct 12 22:03:19.511428 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:03:19.511428 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:03:19.511428 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 4d103732bb444134b33e87e0fee459e2 Oct 12 22:03:19.511428 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1469796454-project Oct 12 22:03:19.511428 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:03:19.511428 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 12 22:03:19.511428 n-d-861111-1 devstack@n-api.service[120452]: action_args: {} Oct 12 22:03:19.511428 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:03:19.512351 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 12 22:03:19.513548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:19.515960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-13c1a42f-de64-4680-8acc-95b5f7c87571 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:03:19.516967 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-13c1a42f-de64-4680-8acc-95b5f7c87571 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.214719 Oct 12 22:03:19.518076 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 502/1071] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 12 22:03:19 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 216 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:03:19.527161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-17c70073-a262-4a79-96ff-0070408b58ca tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Calling method '.version_select at 0x7f5128653550>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:19.529930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-17c70073-a262-4a79-96ff-0070408b58ca tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '4d103732bb444134b33e87e0fee459e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f6f634bf084367973be1a95acfcc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-17c70073-a262-4a79-96ff-0070408b58ca tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Request method failure captured: Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-hosts/n-d-861111-1/reboot HTTP/1.1 Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzmlCf_T68YBK972BVseX1TjGdaovySESvgEpCFgEQio5QohvJ5OBqG4GGsVstAJIuWYRR2OK-AaHMT67OhB4JMGrtelusc3ZdMzXm73Cj7gIwU229CaEHdCoAanPD32O857DH6rHpVhBbtWRusT2SYZ6dmiKs0vi9EB0is7GbgNbO4 Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: e8f6f634bf084367973be1a95acfcc36 Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:03:19.531824 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:03:19.533156 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e8f6f634bf084367973be1a95acfcc36", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:03:19.533156 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:19.533156 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: e8f6f634bf084367973be1a95acfcc36 Oct 12 22:03:19.533156 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:19.533156 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-HostsAdminNegativeTestJSON-1469796454-project Oct 12 22:03:19.533156 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:03:19.533156 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:03:19.533156 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 4d103732bb444134b33e87e0fee459e2 Oct 12 22:03:19.533156 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1469796454-project Oct 12 22:03:19.533156 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:03:19.533156 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 12 22:03:19.533156 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'n-d-861111-1'} Oct 12 22:03:19.533156 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:03:19.533950 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:03:19.535126 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:03:19.535126 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:03:19.535126 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:03:19.535126 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:03:19.535126 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:03:19.535126 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:03:19.535126 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 12 22:03:19.535126 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:19.535126 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:19.535126 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:19.535126 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:19.535126 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:19.535126 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:19.535126 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:03:19.535126 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:03:19.535126 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 12 22:03:19.535126 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:19.537680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-17c70073-a262-4a79-96ff-0070408b58ca tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:03:19.538758 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-17c70073-a262-4a79-96ff-0070408b58ca tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-861111-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.015466 Oct 12 22:03:19.541334 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 503/1072] 10.222.0.16 () {58 vars in 1188 bytes} [Wed Oct 12 22:03:19 2022] GET /compute/v2.1/os-hosts/n-d-861111-1/reboot => generated 111 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:03:19.554908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fd48b4fc-fa25-45e3-bcbb-b4f012c26b94 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Calling method '.version_select at 0x7f51286ecc10>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:19.568322 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-fd48b4fc-fa25-45e3-bcbb-b4f012c26b94 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fd48b4fc-fa25-45e3-bcbb-b4f012c26b94 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Request method failure captured: Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzmm0lfU1BzYsBeav1a-eqbE0sd_pmHMx3D2HiJirdxYwvLl-njQnvnoXtRH-n2FLvzppXyFO36TUbhHVgagFPggwUW3x2KrbLKY_nk3b0iUN5muLL-qNTlQPYMczOSGrA-LRAMDHl_kSDInohK4zIExkpEBMDJQ5m76u7dUi6YmLS0 Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 591208be5ee64b91be898dcd5d10bc22 Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 22:03:19.573713 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 22:03:19.575221 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_591208be5ee64b91be898dcd5d10bc22", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:03:19.575221 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:19.575221 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 591208be5ee64b91be898dcd5d10bc22 Oct 12 22:03:19.575221 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:19.575221 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-HostsAdminNegativeTestJSON-1689194669-project-admin Oct 12 22:03:19.575221 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:03:19.575221 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:03:19.575221 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: b9c6053a5df344a5a8d7d75c2f787ba3 Oct 12 22:03:19.575221 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1689194669-project-admin Oct 12 22:03:19.575221 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:03:19.575221 n-d-861111-1 devstack@n-api.service[120452]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:19.575221 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'nonexistent_hostname'} Oct 12 22:03:19.575221 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:03:19.576505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 12 22:03:19.578083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:03:19.580710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:19.580710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:19.580710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:19.580710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:19.580710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:19.580710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:19.580710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:19.580710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:03:19.580710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:03:19.580710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:19.580710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:19.583782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fd48b4fc-fa25-45e3-bcbb-b4f012c26b94 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:03:19.584891 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fd48b4fc-fa25-45e3-bcbb-b4f012c26b94 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.033887 Oct 12 22:03:19.585680 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 504/1073] 10.222.0.16 () {58 vars in 1212 bytes} [Wed Oct 12 22:03:19 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:03:19.593442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9c903d05-6df3-4994-b897-d325e8f150ba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:19.594469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9c903d05-6df3-4994-b897-d325e8f150ba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:19.600870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c903d05-6df3-4994-b897-d325e8f150ba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:19.601695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c903d05-6df3-4994-b897-d325e8f150ba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:19.602424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c903d05-6df3-4994-b897-d325e8f150ba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:19.604019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c903d05-6df3-4994-b897-d325e8f150ba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:19.604770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c903d05-6df3-4994-b897-d325e8f150ba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:19.605519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c903d05-6df3-4994-b897-d325e8f150ba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:19.778619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-29073d79-d8a3-47ee-8deb-3a1e6fe52cc5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:19.789470 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-29073d79-d8a3-47ee-8deb-3a1e6fe52cc5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1476 microversion: 2.1 time: 0.431688 Oct 12 22:03:19.790733 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 570/1074] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:19 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1476 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:19.802448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4859c79b-8a9e-4879-be18-a2bd13cdd394 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Calling method '.version_select at 0x7f51286fc4c0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:19.804565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4859c79b-8a9e-4879-be18-a2bd13cdd394 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '4d103732bb444134b33e87e0fee459e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f6f634bf084367973be1a95acfcc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4859c79b-8a9e-4879-be18-a2bd13cdd394 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Request method failure captured: Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-hosts/n-d-861111-1 HTTP/1.1 Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzmlCf_T68YBK972BVseX1TjGdaovySESvgEpCFgEQio5QohvJ5OBqG4GGsVstAJIuWYRR2OK-AaHMT67OhB4JMGrtelusc3ZdMzXm73Cj7gIwU229CaEHdCoAanPD32O857DH6rHpVhBbtWRusT2SYZ6dmiKs0vi9EB0is7GbgNbO4 Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: e8f6f634bf084367973be1a95acfcc36 Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:03:19.815000 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:03:19.817539 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e8f6f634bf084367973be1a95acfcc36", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:03:19.817539 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:19.817539 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: e8f6f634bf084367973be1a95acfcc36 Oct 12 22:03:19.817539 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:19.817539 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-HostsAdminNegativeTestJSON-1469796454-project Oct 12 22:03:19.817539 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:03:19.817539 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:03:19.817539 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 4d103732bb444134b33e87e0fee459e2 Oct 12 22:03:19.817539 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1469796454-project Oct 12 22:03:19.817539 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:03:19.817539 n-d-861111-1 devstack@n-api.service[120453]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 12 22:03:19.817539 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'n-d-861111-1'} Oct 12 22:03:19.817539 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:03:19.818444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:03:19.819824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:03:19.819824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:03:19.819824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:03:19.819824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:03:19.819824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:03:19.819824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:03:19.819824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 12 22:03:19.819824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:03:19.819824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:19.819824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:03:19.819824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:19.819824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:19.819824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:19.819824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:03:19.819824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:03:19.819824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 12 22:03:19.819824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:03:19.822233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4859c79b-8a9e-4879-be18-a2bd13cdd394 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:03:19.823311 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4859c79b-8a9e-4879-be18-a2bd13cdd394 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-861111-1" status: 403 len: 109 microversion: 2.1 time: 0.024668 Oct 12 22:03:19.824374 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 571/1075] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 12 22:03:19 2022] GET /compute/v2.1/os-hosts/n-d-861111-1 => generated 109 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:03:19.829568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4909db2c-7793-4c7b-b2b1-59b18c0bf276 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:19.830491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4909db2c-7793-4c7b-b2b1-59b18c0bf276 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:19.838123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4909db2c-7793-4c7b-b2b1-59b18c0bf276 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:19.839063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4909db2c-7793-4c7b-b2b1-59b18c0bf276 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:19.840019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4909db2c-7793-4c7b-b2b1-59b18c0bf276 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:19.841550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4909db2c-7793-4c7b-b2b1-59b18c0bf276 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:19.842230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4909db2c-7793-4c7b-b2b1-59b18c0bf276 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:19.842864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4909db2c-7793-4c7b-b2b1-59b18c0bf276 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:20.153475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4909db2c-7793-4c7b-b2b1-59b18c0bf276 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:20.161706 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4909db2c-7793-4c7b-b2b1-59b18c0bf276 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.336082 Oct 12 22:03:20.166042 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 572/1076] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:19 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:20.174447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-374284b1-47a2-41d3-8511-37ff9de11b91 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Calling method '.version_select at 0x7f51288cdb80>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:20.186954 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-374284b1-47a2-41d3-8511-37ff9de11b91 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-374284b1-47a2-41d3-8511-37ff9de11b91 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Request method failure captured: Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzmm0lfU1BzYsBeav1a-eqbE0sd_pmHMx3D2HiJirdxYwvLl-njQnvnoXtRH-n2FLvzppXyFO36TUbhHVgagFPggwUW3x2KrbLKY_nk3b0iUN5muLL-qNTlQPYMczOSGrA-LRAMDHl_kSDInohK4zIExkpEBMDJQ5m76u7dUi6YmLS0 Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 591208be5ee64b91be898dcd5d10bc22 Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:03:20.188877 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:03:20.190290 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_591208be5ee64b91be898dcd5d10bc22", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:03:20.190290 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.190290 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 591208be5ee64b91be898dcd5d10bc22 Oct 12 22:03:20.190290 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.190290 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-HostsAdminNegativeTestJSON-1689194669-project-admin Oct 12 22:03:20.190290 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:03:20.190290 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:03:20.190290 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: b9c6053a5df344a5a8d7d75c2f787ba3 Oct 12 22:03:20.190290 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1689194669-project-admin Oct 12 22:03:20.190290 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:03:20.190290 n-d-861111-1 devstack@n-api.service[120453]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.190290 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'nonexistent_hostname'} Oct 12 22:03:20.190290 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.191082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.192237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.196167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-374284b1-47a2-41d3-8511-37ff9de11b91 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:03:20.197316 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-374284b1-47a2-41d3-8511-37ff9de11b91 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.028991 Oct 12 22:03:20.198112 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 573/1077] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Oct 12 22:03:20 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:03:20.203052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-931c9f1b-7bd5-453a-a651-7fc7e5b4525d tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51286fc1f0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:20.222342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9c903d05-6df3-4994-b897-d325e8f150ba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:20.235811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9c903d05-6df3-4994-b897-d325e8f150ba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:20.242815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9c903d05-6df3-4994-b897-d325e8f150ba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:20.244027 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9c903d05-6df3-4994-b897-d325e8f150ba tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1411 microversion: 2.25 time: 0.657157 Oct 12 22:03:20.244660 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 505/1078] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:19 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1411 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:20.262415 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-931c9f1b-7bd5-453a-a651-7fc7e5b4525d tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.063011 Oct 12 22:03:20.263110 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 574/1079] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:20 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:20.270632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e8557a5a-96b2-4cc1-84b0-da430d2bbb8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:20.271493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a44fca5b-6db8-4e38-b054-4d4a61b08242 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Calling method '.version_select at 0x7f512858fca0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:20.273003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a44fca5b-6db8-4e38-b054-4d4a61b08242 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '4d103732bb444134b33e87e0fee459e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f6f634bf084367973be1a95acfcc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a44fca5b-6db8-4e38-b054-4d4a61b08242 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Request method failure captured: Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-hosts/n-d-861111-1/shutdown HTTP/1.1 Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzmlCf_T68YBK972BVseX1TjGdaovySESvgEpCFgEQio5QohvJ5OBqG4GGsVstAJIuWYRR2OK-AaHMT67OhB4JMGrtelusc3ZdMzXm73Cj7gIwU229CaEHdCoAanPD32O857DH6rHpVhBbtWRusT2SYZ6dmiKs0vi9EB0is7GbgNbO4 Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: e8f6f634bf084367973be1a95acfcc36 Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:03:20.274599 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:03:20.276212 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e8f6f634bf084367973be1a95acfcc36", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:03:20.276212 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:20.276212 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: e8f6f634bf084367973be1a95acfcc36 Oct 12 22:03:20.276212 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:20.276212 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-HostsAdminNegativeTestJSON-1469796454-project Oct 12 22:03:20.276212 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:03:20.276212 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:03:20.276212 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 4d103732bb444134b33e87e0fee459e2 Oct 12 22:03:20.276212 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1469796454-project Oct 12 22:03:20.276212 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:03:20.276212 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 12 22:03:20.276212 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'n-d-861111-1'} Oct 12 22:03:20.276212 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:03:20.277152 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:03:20.278548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:03:20.278548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:03:20.278548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:03:20.278548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:03:20.278548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:03:20.278548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:03:20.278548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 12 22:03:20.278548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.278548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:20.278548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.278548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.278548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.278548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.278548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:03:20.278548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:03:20.278548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 12 22:03:20.278548 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.280167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e8557a5a-96b2-4cc1-84b0-da430d2bbb8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:20.280785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a44fca5b-6db8-4e38-b054-4d4a61b08242 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:03:20.281938 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a44fca5b-6db8-4e38-b054-4d4a61b08242 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-861111-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.021372 Oct 12 22:03:20.282657 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 506/1080] 10.222.0.16 () {58 vars in 1194 bytes} [Wed Oct 12 22:03:20 2022] GET /compute/v2.1/os-hosts/n-d-861111-1/shutdown => generated 113 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:03:20.293956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-230a0634-db88-42b0-917b-97b2bf83c4db tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Calling method '.version_select at 0x7f5128653280>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:20.299538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8557a5a-96b2-4cc1-84b0-da430d2bbb8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:20.300031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8557a5a-96b2-4cc1-84b0-da430d2bbb8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:20.300471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8557a5a-96b2-4cc1-84b0-da430d2bbb8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:20.301177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8557a5a-96b2-4cc1-84b0-da430d2bbb8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:20.303149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8557a5a-96b2-4cc1-84b0-da430d2bbb8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:20.305104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8557a5a-96b2-4cc1-84b0-da430d2bbb8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:20.311987 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-230a0634-db88-42b0-917b-97b2bf83c4db tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-230a0634-db88-42b0-917b-97b2bf83c4db tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Request method failure captured: Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzmm0lfU1BzYsBeav1a-eqbE0sd_pmHMx3D2HiJirdxYwvLl-njQnvnoXtRH-n2FLvzppXyFO36TUbhHVgagFPggwUW3x2KrbLKY_nk3b0iUN5muLL-qNTlQPYMczOSGrA-LRAMDHl_kSDInohK4zIExkpEBMDJQ5m76u7dUi6YmLS0 Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 591208be5ee64b91be898dcd5d10bc22 Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 22:03:20.315216 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 22:03:20.316597 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_591208be5ee64b91be898dcd5d10bc22", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:03:20.316597 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.316597 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 591208be5ee64b91be898dcd5d10bc22 Oct 12 22:03:20.316597 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.316597 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-HostsAdminNegativeTestJSON-1689194669-project-admin Oct 12 22:03:20.316597 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:03:20.316597 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:03:20.316597 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: b9c6053a5df344a5a8d7d75c2f787ba3 Oct 12 22:03:20.316597 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1689194669-project-admin Oct 12 22:03:20.316597 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:03:20.316597 n-d-861111-1 devstack@n-api.service[120452]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.316597 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'nonexistent_hostname'} Oct 12 22:03:20.316597 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:03:20.317384 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 12 22:03:20.318480 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:03:20.322039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.322039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.322039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:20.322039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.322039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.322039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.322039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.322039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:03:20.322039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:03:20.322039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.322039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.322039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-230a0634-db88-42b0-917b-97b2bf83c4db tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:03:20.322039 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-230a0634-db88-42b0-917b-97b2bf83c4db tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.027336 Oct 12 22:03:20.322039 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 507/1081] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 12 22:03:20 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:03:20.328129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49a6fe17-7032-4e89-8cb3-99e860d29d73 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Calling method '.version_select at 0x7f5128663d30>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:20.329909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-49a6fe17-7032-4e89-8cb3-99e860d29d73 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '4d103732bb444134b33e87e0fee459e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f6f634bf084367973be1a95acfcc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49a6fe17-7032-4e89-8cb3-99e860d29d73 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Request method failure captured: Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-hosts/n-d-861111-1/startup HTTP/1.1 Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzmlCf_T68YBK972BVseX1TjGdaovySESvgEpCFgEQio5QohvJ5OBqG4GGsVstAJIuWYRR2OK-AaHMT67OhB4JMGrtelusc3ZdMzXm73Cj7gIwU229CaEHdCoAanPD32O857DH6rHpVhBbtWRusT2SYZ6dmiKs0vi9EB0is7GbgNbO4 Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: e8f6f634bf084367973be1a95acfcc36 Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:03:20.331592 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:03:20.332868 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e8f6f634bf084367973be1a95acfcc36", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:03:20.332868 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:20.332868 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: e8f6f634bf084367973be1a95acfcc36 Oct 12 22:03:20.332868 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:20.332868 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-HostsAdminNegativeTestJSON-1469796454-project Oct 12 22:03:20.332868 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:03:20.332868 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:03:20.332868 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 4d103732bb444134b33e87e0fee459e2 Oct 12 22:03:20.332868 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1469796454-project Oct 12 22:03:20.332868 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:03:20.332868 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 12 22:03:20.332868 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'n-d-861111-1'} Oct 12 22:03:20.332868 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:03:20.333636 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:03:20.334856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:03:20.334856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:03:20.334856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:03:20.334856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:03:20.334856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:03:20.334856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:03:20.334856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 12 22:03:20.334856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.334856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:20.334856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.334856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.334856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.334856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.334856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:03:20.334856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:03:20.334856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 12 22:03:20.334856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.338851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49a6fe17-7032-4e89-8cb3-99e860d29d73 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:03:20.338851 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-49a6fe17-7032-4e89-8cb3-99e860d29d73 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-861111-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.010230 Oct 12 22:03:20.338851 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 508/1082] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Oct 12 22:03:20 2022] GET /compute/v2.1/os-hosts/n-d-861111-1/startup => generated 110 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:03:20.345985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-486a933f-6de5-4431-923a-ac59f22a85d5 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Calling method '.version_select at 0x7f51286ecd30>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:20.356010 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-486a933f-6de5-4431-923a-ac59f22a85d5 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-486a933f-6de5-4431-923a-ac59f22a85d5 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Request method failure captured: Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzmm0lfU1BzYsBeav1a-eqbE0sd_pmHMx3D2HiJirdxYwvLl-njQnvnoXtRH-n2FLvzppXyFO36TUbhHVgagFPggwUW3x2KrbLKY_nk3b0iUN5muLL-qNTlQPYMczOSGrA-LRAMDHl_kSDInohK4zIExkpEBMDJQ5m76u7dUi6YmLS0 Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 591208be5ee64b91be898dcd5d10bc22 Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 22:03:20.361102 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 22:03:20.364334 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_591208be5ee64b91be898dcd5d10bc22", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:03:20.364334 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.364334 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 591208be5ee64b91be898dcd5d10bc22 Oct 12 22:03:20.364334 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.364334 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-HostsAdminNegativeTestJSON-1689194669-project-admin Oct 12 22:03:20.364334 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:03:20.364334 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:03:20.364334 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: b9c6053a5df344a5a8d7d75c2f787ba3 Oct 12 22:03:20.364334 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1689194669-project-admin Oct 12 22:03:20.364334 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:03:20.364334 n-d-861111-1 devstack@n-api.service[120452]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.364334 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'nonexistent_hostname'} Oct 12 22:03:20.364334 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:03:20.365273 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 12 22:03:20.366385 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:03:20.372173 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.372173 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.372173 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:20.372173 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.372173 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.372173 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.372173 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.372173 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:03:20.372173 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:03:20.372173 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.372173 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.372173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-486a933f-6de5-4431-923a-ac59f22a85d5 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:03:20.372173 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-486a933f-6de5-4431-923a-ac59f22a85d5 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.021487 Oct 12 22:03:20.372173 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 509/1083] 10.222.0.16 () {58 vars in 1215 bytes} [Wed Oct 12 22:03:20 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:03:20.397029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5582cc90-9ce2-41ed-87e4-ff57efab4b57 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Action: 'update', calling method: .version_select at 0x7f5128653a60>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5582cc90-9ce2-41ed-87e4-ff57efab4b57 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Request method failure captured: Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: request: PUT /compute/v2.1/os-hosts/n-d-861111-1 HTTP/1.1 Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 51 Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzmm0lfU1BzYsBeav1a-eqbE0sd_pmHMx3D2HiJirdxYwvLl-njQnvnoXtRH-n2FLvzppXyFO36TUbhHVgagFPggwUW3x2KrbLKY_nk3b0iUN5muLL-qNTlQPYMczOSGrA-LRAMDHl_kSDInohK4zIExkpEBMDJQ5m76u7dUi6YmLS0 Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 591208be5ee64b91be898dcd5d10bc22 Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 22:03:20.411473 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 22:03:20.412876 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_591208be5ee64b91be898dcd5d10bc22", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:03:20.412876 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.412876 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 591208be5ee64b91be898dcd5d10bc22 Oct 12 22:03:20.412876 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.412876 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-HostsAdminNegativeTestJSON-1689194669-project-admin Oct 12 22:03:20.412876 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:03:20.412876 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:03:20.412876 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: b9c6053a5df344a5a8d7d75c2f787ba3 Oct 12 22:03:20.412876 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1689194669-project-admin Oct 12 22:03:20.412876 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:03:20.412876 n-d-861111-1 devstack@n-api.service[120452]: {"status": "enable", "maintenance_mode": "invalid"} Oct 12 22:03:20.412876 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:03:20.412876 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'n-d-861111-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'disable', Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'Enable', Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'Disable', Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance: Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'invalid' Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.413786 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.415398 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.420628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.420628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:03:20.420628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:03:20.420628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 22:03:20.420628 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.420628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5582cc90-9ce2-41ed-87e4-ff57efab4b57 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:03:20.420628 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5582cc90-9ce2-41ed-87e4-ff57efab4b57 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-861111-1" status: 400 len: 199 microversion: 2.1 time: 0.041083 Oct 12 22:03:20.420628 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 510/1084] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 12 22:03:20 2022] PUT /compute/v2.1/os-hosts/n-d-861111-1 => generated 199 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:03:20.426412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-7586a81b-dd36-4b44-b357-9fd8d3e2e4f5 req-ef594e4b-7bab-4f2b-ab21-c17708c3ec9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "247e0252-3374-40b8-85f3-995d2031867d", "tag": "319c47c2-57cf-461d-8a9e-adf8c461cb1d"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:20.440918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7586a81b-dd36-4b44-b357-9fd8d3e2e4f5 req-ef594e4b-7bab-4f2b-ab21-c17708c3ec9b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:20.441400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7586a81b-dd36-4b44-b357-9fd8d3e2e4f5 req-ef594e4b-7bab-4f2b-ab21-c17708c3ec9b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:20.441829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7586a81b-dd36-4b44-b357-9fd8d3e2e4f5 req-ef594e4b-7bab-4f2b-ab21-c17708c3ec9b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:20.455585 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-7586a81b-dd36-4b44-b357-9fd8d3e2e4f5 req-ef594e4b-7bab-4f2b-ab21-c17708c3ec9b service nova] Creating event network-changed:319c47c2-57cf-461d-8a9e-adf8c461cb1d for instance 247e0252-3374-40b8-85f3-995d2031867d on n-h1-861111-1 Oct 12 22:03:20.463812 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-7586a81b-dd36-4b44-b357-9fd8d3e2e4f5 req-ef594e4b-7bab-4f2b-ab21-c17708c3ec9b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041890 Oct 12 22:03:20.466165 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 511/1085] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:20.471904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dc11e5d4-13db-40dc-9a74-a5da86322781 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Action: 'update', calling method: .version_select at 0x7f51285ae280>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dc11e5d4-13db-40dc-9a74-a5da86322781 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Request method failure captured: Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: request: PUT /compute/v2.1/os-hosts/n-d-861111-1 HTTP/1.1 Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 51 Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzmm0lfU1BzYsBeav1a-eqbE0sd_pmHMx3D2HiJirdxYwvLl-njQnvnoXtRH-n2FLvzppXyFO36TUbhHVgagFPggwUW3x2KrbLKY_nk3b0iUN5muLL-qNTlQPYMczOSGrA-LRAMDHl_kSDInohK4zIExkpEBMDJQ5m76u7dUi6YmLS0 Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 591208be5ee64b91be898dcd5d10bc22 Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 22:03:20.478591 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 22:03:20.479982 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_591208be5ee64b91be898dcd5d10bc22", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:03:20.479982 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.479982 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 591208be5ee64b91be898dcd5d10bc22 Oct 12 22:03:20.479982 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.479982 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-HostsAdminNegativeTestJSON-1689194669-project-admin Oct 12 22:03:20.479982 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:03:20.479982 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:03:20.479982 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: b9c6053a5df344a5a8d7d75c2f787ba3 Oct 12 22:03:20.479982 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1689194669-project-admin Oct 12 22:03:20.479982 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:03:20.479982 n-d-861111-1 devstack@n-api.service[120452]: {"status": "invalid", "maintenance_mode": "enable"} Oct 12 22:03:20.479982 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:03:20.479982 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'n-d-861111-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'disable', Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'Enable', Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'Disable', Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance: Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'invalid' Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.480794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.482813 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.486039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.486039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:03:20.486039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:03:20.486039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 22:03:20.486039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.487593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dc11e5d4-13db-40dc-9a74-a5da86322781 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:03:20.488669 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dc11e5d4-13db-40dc-9a74-a5da86322781 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-861111-1" status: 400 len: 189 microversion: 2.1 time: 0.021233 Oct 12 22:03:20.489614 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 512/1086] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 12 22:03:20 2022] PUT /compute/v2.1/os-hosts/n-d-861111-1 => generated 189 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:03:20.499989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fc0accc6-5a93-4c6d-87a6-84b7ed1ccce3 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Action: 'update', calling method: .version_select at 0x7f51286b0940>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:20.507381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fc0accc6-5a93-4c6d-87a6-84b7ed1ccce3 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '4d103732bb444134b33e87e0fee459e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f6f634bf084367973be1a95acfcc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fc0accc6-5a93-4c6d-87a6-84b7ed1ccce3 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Request method failure captured: Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: request: PUT /compute/v2.1/os-hosts/n-d-861111-1 HTTP/1.1 Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 50 Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzmlCf_T68YBK972BVseX1TjGdaovySESvgEpCFgEQio5QohvJ5OBqG4GGsVstAJIuWYRR2OK-AaHMT67OhB4JMGrtelusc3ZdMzXm73Cj7gIwU229CaEHdCoAanPD32O857DH6rHpVhBbtWRusT2SYZ6dmiKs0vi9EB0is7GbgNbO4 Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: e8f6f634bf084367973be1a95acfcc36 Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:03:20.509278 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:03:20.510556 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e8f6f634bf084367973be1a95acfcc36", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e8f6f634bf084367973be1a95acfcc36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:03:20.510556 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:20.510556 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: e8f6f634bf084367973be1a95acfcc36 Oct 12 22:03:20.510556 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1469796454 Oct 12 22:03:20.510556 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-HostsAdminNegativeTestJSON-1469796454-project Oct 12 22:03:20.510556 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:03:20.510556 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:03:20.510556 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 4d103732bb444134b33e87e0fee459e2 Oct 12 22:03:20.510556 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1469796454-project Oct 12 22:03:20.510556 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:03:20.510556 n-d-861111-1 devstack@n-api.service[120452]: {"status": "enable", "maintenance_mode": "enable"} Oct 12 22:03:20.510556 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:03:20.510556 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 12 22:03:20.510556 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'n-d-861111-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:03:20.511561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 12 22:03:20.513626 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.516505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fc0accc6-5a93-4c6d-87a6-84b7ed1ccce3 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:03:20.517484 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fc0accc6-5a93-4c6d-87a6-84b7ed1ccce3 tempest-HostsAdminNegativeTestJSON-1469796454 tempest-HostsAdminNegativeTestJSON-1469796454-project] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-861111-1" status: 403 len: 111 microversion: 2.1 time: 0.022642 Oct 12 22:03:20.522159 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 513/1087] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 12 22:03:20 2022] PUT /compute/v2.1/os-hosts/n-d-861111-1 => generated 111 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:03:20.530844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-89e09de7-a88f-469a-b3f8-1d468de284f3 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Action: 'update', calling method: .version_select at 0x7f51286b0040>, body: {"status": null, "maintenance_mode": null} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-89e09de7-a88f-469a-b3f8-1d468de284f3 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Request method failure captured: Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: request: PUT /compute/v2.1/os-hosts/n-d-861111-1 HTTP/1.1 Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 42 Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzmm0lfU1BzYsBeav1a-eqbE0sd_pmHMx3D2HiJirdxYwvLl-njQnvnoXtRH-n2FLvzppXyFO36TUbhHVgagFPggwUW3x2KrbLKY_nk3b0iUN5muLL-qNTlQPYMczOSGrA-LRAMDHl_kSDInohK4zIExkpEBMDJQ5m76u7dUi6YmLS0 Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 591208be5ee64b91be898dcd5d10bc22 Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 22:03:20.535363 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 22:03:20.536970 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_591208be5ee64b91be898dcd5d10bc22", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:03:20.536970 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.536970 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 591208be5ee64b91be898dcd5d10bc22 Oct 12 22:03:20.536970 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.536970 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-HostsAdminNegativeTestJSON-1689194669-project-admin Oct 12 22:03:20.536970 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:03:20.536970 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:03:20.536970 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: b9c6053a5df344a5a8d7d75c2f787ba3 Oct 12 22:03:20.536970 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1689194669-project-admin Oct 12 22:03:20.536970 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:03:20.536970 n-d-861111-1 devstack@n-api.service[120452]: {"status": null, "maintenance_mode": null} Oct 12 22:03:20.536970 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:03:20.536970 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 12 22:03:20.536970 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'n-d-861111-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'disable', Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'Enable', Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'Disable', Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance: Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi None Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.538013 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.541836 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.543316 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:03:20.543316 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:03:20.543316 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 12 22:03:20.543316 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.545079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-89e09de7-a88f-469a-b3f8-1d468de284f3 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:03:20.546155 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-89e09de7-a88f-469a-b3f8-1d468de284f3 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-861111-1" status: 400 len: 127 microversion: 2.1 time: 0.022816 Oct 12 22:03:20.552005 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 514/1088] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 12 22:03:20 2022] PUT /compute/v2.1/os-hosts/n-d-861111-1 => generated 127 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:03:20.557208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4a901439-2e0b-4710-aaa8-266ee8e1d907 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Action: 'update', calling method: .version_select at 0x7f5128663280>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:20.563657 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.hosts [None req-4a901439-2e0b-4710-aaa8-266ee8e1d907 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Enabling host nonexistent_hostname. Oct 12 22:03:20.583405 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-4a901439-2e0b-4710-aaa8-266ee8e1d907 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4a901439-2e0b-4710-aaa8-266ee8e1d907 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Request method failure captured: Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 50 Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzmm0lfU1BzYsBeav1a-eqbE0sd_pmHMx3D2HiJirdxYwvLl-njQnvnoXtRH-n2FLvzppXyFO36TUbhHVgagFPggwUW3x2KrbLKY_nk3b0iUN5muLL-qNTlQPYMczOSGrA-LRAMDHl_kSDInohK4zIExkpEBMDJQ5m76u7dUi6YmLS0 Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 591208be5ee64b91be898dcd5d10bc22 Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 22:03:20.585626 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 22:03:20.587215 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_591208be5ee64b91be898dcd5d10bc22", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/591208be5ee64b91be898dcd5d10bc22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:03:20.587215 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.587215 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 591208be5ee64b91be898dcd5d10bc22 Oct 12 22:03:20.587215 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1689194669 Oct 12 22:03:20.587215 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-HostsAdminNegativeTestJSON-1689194669-project-admin Oct 12 22:03:20.587215 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:03:20.587215 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:03:20.587215 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: b9c6053a5df344a5a8d7d75c2f787ba3 Oct 12 22:03:20.587215 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1689194669-project-admin Oct 12 22:03:20.587215 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:03:20.587215 n-d-861111-1 devstack@n-api.service[120452]: {"status": "enable", "maintenance_mode": "enable"} Oct 12 22:03:20.587215 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:03:20.587215 n-d-861111-1 devstack@n-api.service[120452]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.587215 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 22:03:20.588271 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:03:20.589365 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 12 22:03:20.590584 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 12 22:03:20.590584 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 12 22:03:20.590584 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:03:20.590584 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.590584 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.590584 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:03:20.590584 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.590584 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:03:20.590584 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:03:20.590584 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:03:20.590584 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:03:20.590584 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:03:20.590584 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:03:20.590584 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:03:20.590584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4a901439-2e0b-4710-aaa8-266ee8e1d907 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:03:20.591516 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4a901439-2e0b-4710-aaa8-266ee8e1d907 tempest-HostsAdminNegativeTestJSON-1689194669 tempest-HostsAdminNegativeTestJSON-1689194669-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.036733 Oct 12 22:03:20.598344 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 515/1089] 10.222.0.16 () {60 vars in 1211 bytes} [Wed Oct 12 22:03:20 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:03:20.683057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e8557a5a-96b2-4cc1-84b0-da430d2bbb8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:20.698086 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e8557a5a-96b2-4cc1-84b0-da430d2bbb8a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.429801 Oct 12 22:03:20.699018 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 575/1090] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:20 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:20.819194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3f52ccc6-f887-439b-96b5-dc0163a5d00c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:20.820046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3f52ccc6-f887-439b-96b5-dc0163a5d00c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:20.861696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f52ccc6-f887-439b-96b5-dc0163a5d00c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:20.867941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f52ccc6-f887-439b-96b5-dc0163a5d00c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:20.869317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f52ccc6-f887-439b-96b5-dc0163a5d00c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:20.875561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f52ccc6-f887-439b-96b5-dc0163a5d00c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:20.876733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f52ccc6-f887-439b-96b5-dc0163a5d00c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:20.879897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f52ccc6-f887-439b-96b5-dc0163a5d00c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:21.020761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-88947d5c-26ee-482a-b2eb-dd906d4d1109 req-0e4482d7-9a1e-43ec-ab6f-385b851ffa36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adec1006-780c-4fe7-871a-e4f7addfe159", "tag": "1a376da9-7885-4d84-98d7-e6c54abdca11"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:21.044262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-88947d5c-26ee-482a-b2eb-dd906d4d1109 req-0e4482d7-9a1e-43ec-ab6f-385b851ffa36 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:21.045664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-88947d5c-26ee-482a-b2eb-dd906d4d1109 req-0e4482d7-9a1e-43ec-ab6f-385b851ffa36 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:21.046520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-88947d5c-26ee-482a-b2eb-dd906d4d1109 req-0e4482d7-9a1e-43ec-ab6f-385b851ffa36 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:21.078274 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-88947d5c-26ee-482a-b2eb-dd906d4d1109 req-0e4482d7-9a1e-43ec-ab6f-385b851ffa36 service nova] Creating event network-changed:1a376da9-7885-4d84-98d7-e6c54abdca11 for instance adec1006-780c-4fe7-871a-e4f7addfe159 on n-h2-861111-1 Oct 12 22:03:21.099059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-88947d5c-26ee-482a-b2eb-dd906d4d1109 req-0e4482d7-9a1e-43ec-ab6f-385b851ffa36 service nova] Instance adec1006-780c-4fe7-871a-e4f7addfe159 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:03:21.112894 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-88947d5c-26ee-482a-b2eb-dd906d4d1109 req-0e4482d7-9a1e-43ec-ab6f-385b851ffa36 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095850 Oct 12 22:03:21.119557 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 576/1091] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:21.161595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3f52ccc6-f887-439b-96b5-dc0163a5d00c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:21.175680 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3f52ccc6-f887-439b-96b5-dc0163a5d00c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1476 microversion: 2.1 time: 0.364100 Oct 12 22:03:21.177760 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 516/1092] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:20 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1476 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:21.190165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-150727ab-0d81-45fb-96e5-770e45a4b05c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:21.191571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-150727ab-0d81-45fb-96e5-770e45a4b05c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:21.203569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-150727ab-0d81-45fb-96e5-770e45a4b05c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:21.204494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-150727ab-0d81-45fb-96e5-770e45a4b05c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:21.205104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-150727ab-0d81-45fb-96e5-770e45a4b05c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:21.205980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-150727ab-0d81-45fb-96e5-770e45a4b05c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:21.206750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-150727ab-0d81-45fb-96e5-770e45a4b05c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:21.208065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-150727ab-0d81-45fb-96e5-770e45a4b05c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:21.276685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b3bc8911-7dee-466d-99d9-b83c877c829b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:21.277322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b3bc8911-7dee-466d-99d9-b83c877c829b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:21.284974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3bc8911-7dee-466d-99d9-b83c877c829b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:21.285928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3bc8911-7dee-466d-99d9-b83c877c829b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:21.286899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3bc8911-7dee-466d-99d9-b83c877c829b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:21.288128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3bc8911-7dee-466d-99d9-b83c877c829b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:21.288779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3bc8911-7dee-466d-99d9-b83c877c829b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:21.290881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3bc8911-7dee-466d-99d9-b83c877c829b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:21.423781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-150727ab-0d81-45fb-96e5-770e45a4b05c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:21.436971 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-150727ab-0d81-45fb-96e5-770e45a4b05c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.250856 Oct 12 22:03:21.453380 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 577/1093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:21 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:21.464089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3043a799-18ee-4e99-be1b-b7db604b458a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128a71160>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:21.497766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b3bc8911-7dee-466d-99d9-b83c877c829b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:21.507311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b3bc8911-7dee-466d-99d9-b83c877c829b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:21.509064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b3bc8911-7dee-466d-99d9-b83c877c829b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:21.510452 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b3bc8911-7dee-466d-99d9-b83c877c829b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1411 microversion: 2.25 time: 0.240172 Oct 12 22:03:21.511517 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 517/1094] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:21 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1411 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:21.531408 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3043a799-18ee-4e99-be1b-b7db604b458a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1452 microversion: 2.1 time: 0.075723 Oct 12 22:03:21.533140 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 578/1095] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:21 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:21.726315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-21a5751e-df22-4496-9f0f-86471ebf55d2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:21.727282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-21a5751e-df22-4496-9f0f-86471ebf55d2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:21.730749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:21.739387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21a5751e-df22-4496-9f0f-86471ebf55d2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:21.740445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21a5751e-df22-4496-9f0f-86471ebf55d2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:21.741567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21a5751e-df22-4496-9f0f-86471ebf55d2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:21.742790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21a5751e-df22-4496-9f0f-86471ebf55d2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:21.744366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21a5751e-df22-4496-9f0f-86471ebf55d2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:21.744966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21a5751e-df22-4496-9f0f-86471ebf55d2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:21.913351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-21a5751e-df22-4496-9f0f-86471ebf55d2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:21.922339 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-21a5751e-df22-4496-9f0f-86471ebf55d2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.200068 Oct 12 22:03:21.923228 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 518/1096] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:21 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:22.204413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b59631f-af59-4417-9be9-5162bfe1b607 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:22.205655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8b59631f-af59-4417-9be9-5162bfe1b607 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:22.218793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b59631f-af59-4417-9be9-5162bfe1b607 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:22.220636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b59631f-af59-4417-9be9-5162bfe1b607 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:22.221857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b59631f-af59-4417-9be9-5162bfe1b607 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:22.225067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b59631f-af59-4417-9be9-5162bfe1b607 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:22.228180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b59631f-af59-4417-9be9-5162bfe1b607 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:22.228737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b59631f-af59-4417-9be9-5162bfe1b607 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:22.466275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eee8326a-0bbd-42d6-a2af-c0e18b60282e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:22.466905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eee8326a-0bbd-42d6-a2af-c0e18b60282e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:22.474262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eee8326a-0bbd-42d6-a2af-c0e18b60282e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:22.475003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eee8326a-0bbd-42d6-a2af-c0e18b60282e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:22.475641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eee8326a-0bbd-42d6-a2af-c0e18b60282e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:22.476707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eee8326a-0bbd-42d6-a2af-c0e18b60282e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:22.477320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eee8326a-0bbd-42d6-a2af-c0e18b60282e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:22.477913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eee8326a-0bbd-42d6-a2af-c0e18b60282e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:22.536294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b59631f-af59-4417-9be9-5162bfe1b607 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:22.575425 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8b59631f-af59-4417-9be9-5162bfe1b607 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1474 microversion: 2.1 time: 0.374875 Oct 12 22:03:22.576171 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 579/1097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:22 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1474 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:22.582181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-079a4ae3-105a-468a-9dcf-b602f6565dbf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:22.583207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-079a4ae3-105a-468a-9dcf-b602f6565dbf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:22.590764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-079a4ae3-105a-468a-9dcf-b602f6565dbf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:22.598753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-079a4ae3-105a-468a-9dcf-b602f6565dbf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:22.601060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-079a4ae3-105a-468a-9dcf-b602f6565dbf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:22.602392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-079a4ae3-105a-468a-9dcf-b602f6565dbf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:22.602816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-079a4ae3-105a-468a-9dcf-b602f6565dbf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:22.603302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-079a4ae3-105a-468a-9dcf-b602f6565dbf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:22.825606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-079a4ae3-105a-468a-9dcf-b602f6565dbf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:22.842668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eee8326a-0bbd-42d6-a2af-c0e18b60282e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:22.844920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:22.853754 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eee8326a-0bbd-42d6-a2af-c0e18b60282e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.391311 Oct 12 22:03:22.854350 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 519/1098] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:22 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:22.860886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-079a4ae3-105a-468a-9dcf-b602f6565dbf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:22.865672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-079a4ae3-105a-468a-9dcf-b602f6565dbf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:22.869716 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-079a4ae3-105a-468a-9dcf-b602f6565dbf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1411 microversion: 2.25 time: 0.291875 Oct 12 22:03:22.870995 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 580/1099] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:22 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1411 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:22.882311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-82d5ebf0-01b1-4601-bf23-2003e10b2cc3 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51286b0e50>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:22.947659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e0d472d9-6a4d-48f0-bf57-85e80db5e82f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:22.947939 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-82d5ebf0-01b1-4601-bf23-2003e10b2cc3 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1461 microversion: 2.1 time: 0.072849 Oct 12 22:03:22.948441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e0d472d9-6a4d-48f0-bf57-85e80db5e82f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:22.949009 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 520/1100] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:22 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1461 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:22.958144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0d472d9-6a4d-48f0-bf57-85e80db5e82f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:22.959088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0d472d9-6a4d-48f0-bf57-85e80db5e82f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:22.959827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0d472d9-6a4d-48f0-bf57-85e80db5e82f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:22.963490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0d472d9-6a4d-48f0-bf57-85e80db5e82f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:22.964085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0d472d9-6a4d-48f0-bf57-85e80db5e82f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:22.964593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0d472d9-6a4d-48f0-bf57-85e80db5e82f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:22.971730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b19657bc-85d4-4420-b5e7-de012512e78d tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128524dc0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:23.034447 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b19657bc-85d4-4420-b5e7-de012512e78d tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 200 len: 1461 microversion: 2.1 time: 0.072475 Oct 12 22:03:23.035364 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 521/1101] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:22 2022] GET /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 1461 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:23.050028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6f1ab29f-6f5d-45e7-a731-c7ff05356d56 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:23.050934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6f1ab29f-6f5d-45e7-a731-c7ff05356d56 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:23.058695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f1ab29f-6f5d-45e7-a731-c7ff05356d56 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:23.059564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f1ab29f-6f5d-45e7-a731-c7ff05356d56 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:23.060008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f1ab29f-6f5d-45e7-a731-c7ff05356d56 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:23.060749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f1ab29f-6f5d-45e7-a731-c7ff05356d56 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:23.061236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f1ab29f-6f5d-45e7-a731-c7ff05356d56 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:23.061664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f1ab29f-6f5d-45e7-a731-c7ff05356d56 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:23.186869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e0d472d9-6a4d-48f0-bf57-85e80db5e82f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:23.190423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:23.195314 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e0d472d9-6a4d-48f0-bf57-85e80db5e82f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.251486 Oct 12 22:03:23.196260 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 581/1102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:22 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:23.224745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6f1ab29f-6f5d-45e7-a731-c7ff05356d56 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:23.233223 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6f1ab29f-6f5d-45e7-a731-c7ff05356d56 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1480 microversion: 2.1 time: 0.187098 Oct 12 22:03:23.233844 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 522/1103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:23 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1480 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:23.599502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-91125fd4-1013-4a7a-887e-2a07bccd7ed0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:23.600068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-91125fd4-1013-4a7a-887e-2a07bccd7ed0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:23.606939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91125fd4-1013-4a7a-887e-2a07bccd7ed0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:23.607475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91125fd4-1013-4a7a-887e-2a07bccd7ed0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:23.607910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91125fd4-1013-4a7a-887e-2a07bccd7ed0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:23.608612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91125fd4-1013-4a7a-887e-2a07bccd7ed0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:23.609050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91125fd4-1013-4a7a-887e-2a07bccd7ed0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:23.609490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91125fd4-1013-4a7a-887e-2a07bccd7ed0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:23.734071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:23.746112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-91125fd4-1013-4a7a-887e-2a07bccd7ed0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:23.754270 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-91125fd4-1013-4a7a-887e-2a07bccd7ed0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1474 microversion: 2.1 time: 0.159107 Oct 12 22:03:23.755013 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 582/1104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:23 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1474 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:23.881714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1eaa78d9-c1a6-445c-81c1-3b0119d6bddd tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:23.882334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1eaa78d9-c1a6-445c-81c1-3b0119d6bddd tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:23.884696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=10 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:23.885692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=12 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:23.892006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eaa78d9-c1a6-445c-81c1-3b0119d6bddd tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:23.892497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eaa78d9-c1a6-445c-81c1-3b0119d6bddd tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:23.892933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eaa78d9-c1a6-445c-81c1-3b0119d6bddd tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:23.893632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eaa78d9-c1a6-445c-81c1-3b0119d6bddd tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:23.894741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eaa78d9-c1a6-445c-81c1-3b0119d6bddd tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:23.895172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eaa78d9-c1a6-445c-81c1-3b0119d6bddd tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:23.904502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b4d30780-05b5-428e-bead-f1c0e6d77d7f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:23.905338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b4d30780-05b5-428e-bead-f1c0e6d77d7f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:23.913162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4d30780-05b5-428e-bead-f1c0e6d77d7f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:23.913772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4d30780-05b5-428e-bead-f1c0e6d77d7f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:23.914562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4d30780-05b5-428e-bead-f1c0e6d77d7f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:23.915623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4d30780-05b5-428e-bead-f1c0e6d77d7f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:23.916511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4d30780-05b5-428e-bead-f1c0e6d77d7f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:23.917034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4d30780-05b5-428e-bead-f1c0e6d77d7f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:24.043944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1eaa78d9-c1a6-445c-81c1-3b0119d6bddd tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:24.052902 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1eaa78d9-c1a6-445c-81c1-3b0119d6bddd tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.175135 Oct 12 22:03:24.053606 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 523/1105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:23 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:24.064959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b4d30780-05b5-428e-bead-f1c0e6d77d7f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:24.095304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b4d30780-05b5-428e-bead-f1c0e6d77d7f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:24.096826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b4d30780-05b5-428e-bead-f1c0e6d77d7f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:24.097996 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b4d30780-05b5-428e-bead-f1c0e6d77d7f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1411 microversion: 2.25 time: 0.197725 Oct 12 22:03:24.098555 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 583/1106] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:23 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1411 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:03:24.219107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02059c0a-13e2-4263-b9f1-4d2a007a7c70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:24.219864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-02059c0a-13e2-4263-b9f1-4d2a007a7c70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:24.221926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:24.227140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02059c0a-13e2-4263-b9f1-4d2a007a7c70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:24.227723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02059c0a-13e2-4263-b9f1-4d2a007a7c70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:24.228221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02059c0a-13e2-4263-b9f1-4d2a007a7c70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:24.229047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02059c0a-13e2-4263-b9f1-4d2a007a7c70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:24.229510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02059c0a-13e2-4263-b9f1-4d2a007a7c70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:24.229932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02059c0a-13e2-4263-b9f1-4d2a007a7c70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:24.256700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-90306da4-d377-4233-8781-cd6e5db151c5 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] Calling method '.version_select at 0x7f5128d72c10>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:24.258550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90306da4-d377-4233-8781-cd6e5db151c5 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:24.259130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90306da4-d377-4233-8781-cd6e5db151c5 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:24.259641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90306da4-d377-4233-8781-cd6e5db151c5 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:24.274471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90306da4-d377-4233-8781-cd6e5db151c5 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:24.274869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90306da4-d377-4233-8781-cd6e5db151c5 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:24.275332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90306da4-d377-4233-8781-cd6e5db151c5 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:24.285281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90306da4-d377-4233-8781-cd6e5db151c5 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:24.285753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90306da4-d377-4233-8781-cd6e5db151c5 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:24.286183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90306da4-d377-4233-8781-cd6e5db151c5 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:24.291939 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-90306da4-d377-4233-8781-cd6e5db151c5 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.149765 Oct 12 22:03:24.292516 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 524/1107] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 12 22:03:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:03:24.296924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a6dab2ab-fbaa-473d-be6d-f1d5a68b5ab0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:24.297724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a6dab2ab-fbaa-473d-be6d-f1d5a68b5ab0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:24.303525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6dab2ab-fbaa-473d-be6d-f1d5a68b5ab0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:24.304008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6dab2ab-fbaa-473d-be6d-f1d5a68b5ab0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:24.304436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6dab2ab-fbaa-473d-be6d-f1d5a68b5ab0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:24.305131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6dab2ab-fbaa-473d-be6d-f1d5a68b5ab0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:24.305578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6dab2ab-fbaa-473d-be6d-f1d5a68b5ab0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:24.306000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6dab2ab-fbaa-473d-be6d-f1d5a68b5ab0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:24.367644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-02059c0a-13e2-4263-b9f1-4d2a007a7c70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:24.376126 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-02059c0a-13e2-4263-b9f1-4d2a007a7c70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.161037 Oct 12 22:03:24.377015 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 584/1108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:24 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:24.381383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-93f8ceae-34e7-4754-b257-e3cb25a4f886 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] Calling method '.version_select at 0x7f51286fc550>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:24.383139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93f8ceae-34e7-4754-b257-e3cb25a4f886 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:24.383636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93f8ceae-34e7-4754-b257-e3cb25a4f886 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:24.384059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93f8ceae-34e7-4754-b257-e3cb25a4f886 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:24.398545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93f8ceae-34e7-4754-b257-e3cb25a4f886 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:24.399278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93f8ceae-34e7-4754-b257-e3cb25a4f886 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:24.399875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93f8ceae-34e7-4754-b257-e3cb25a4f886 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:24.406182 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-93f8ceae-34e7-4754-b257-e3cb25a4f886 tempest-HypervisorAdminV228Test-1965409839 tempest-HypervisorAdminV228Test-1965409839-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.028177 Oct 12 22:03:24.406774 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 585/1109] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 12 22:03:24 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:03:24.458642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a6dab2ab-fbaa-473d-be6d-f1d5a68b5ab0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:24.466910 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a6dab2ab-fbaa-473d-be6d-f1d5a68b5ab0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1480 microversion: 2.1 time: 0.173422 Oct 12 22:03:24.467507 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 525/1110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:24 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1480 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:24.779514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e98ff2a-b93b-4f05-96a5-d6a0fc5b4d73 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:24.780129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9e98ff2a-b93b-4f05-96a5-d6a0fc5b4d73 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:24.787534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e98ff2a-b93b-4f05-96a5-d6a0fc5b4d73 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:24.787957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e98ff2a-b93b-4f05-96a5-d6a0fc5b4d73 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:24.788389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e98ff2a-b93b-4f05-96a5-d6a0fc5b4d73 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:24.789077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e98ff2a-b93b-4f05-96a5-d6a0fc5b4d73 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:24.789790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e98ff2a-b93b-4f05-96a5-d6a0fc5b4d73 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:24.790217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e98ff2a-b93b-4f05-96a5-d6a0fc5b4d73 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:24.927159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9e98ff2a-b93b-4f05-96a5-d6a0fc5b4d73 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:24.936367 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9e98ff2a-b93b-4f05-96a5-d6a0fc5b4d73 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1474 microversion: 2.1 time: 0.162109 Oct 12 22:03:24.937303 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 586/1111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:24 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1474 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:25.077261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e3a7d277-4604-43c2-90e9-8d115d74a9db tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:25.078033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e3a7d277-4604-43c2-90e9-8d115d74a9db tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:25.085176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3a7d277-4604-43c2-90e9-8d115d74a9db tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:25.085766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3a7d277-4604-43c2-90e9-8d115d74a9db tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:25.086285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3a7d277-4604-43c2-90e9-8d115d74a9db tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:25.087379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3a7d277-4604-43c2-90e9-8d115d74a9db tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:25.087929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3a7d277-4604-43c2-90e9-8d115d74a9db tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:25.088449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3a7d277-4604-43c2-90e9-8d115d74a9db tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:25.122736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b2c4ab7-0b9e-45fd-943f-2cb4a7166d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:25.123682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8b2c4ab7-0b9e-45fd-943f-2cb4a7166d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:25.130717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b2c4ab7-0b9e-45fd-943f-2cb4a7166d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:25.131204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b2c4ab7-0b9e-45fd-943f-2cb4a7166d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:25.131662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b2c4ab7-0b9e-45fd-943f-2cb4a7166d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:25.132368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b2c4ab7-0b9e-45fd-943f-2cb4a7166d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:25.132819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b2c4ab7-0b9e-45fd-943f-2cb4a7166d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:25.133244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b2c4ab7-0b9e-45fd-943f-2cb4a7166d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:25.264451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e3a7d277-4604-43c2-90e9-8d115d74a9db tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:25.272531 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e3a7d277-4604-43c2-90e9-8d115d74a9db tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.199221 Oct 12 22:03:25.273105 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 526/1112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:25 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:25.290801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b2c4ab7-0b9e-45fd-943f-2cb4a7166d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:25.303360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b2c4ab7-0b9e-45fd-943f-2cb4a7166d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:25.304827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b2c4ab7-0b9e-45fd-943f-2cb4a7166d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:25.306192 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8b2c4ab7-0b9e-45fd-943f-2cb4a7166d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1411 microversion: 2.25 time: 0.187762 Oct 12 22:03:25.306918 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 587/1113] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:25 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1411 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:25.401491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-66a64223-dbd3-416c-a602-62c75cec2ad2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:25.402181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-66a64223-dbd3-416c-a602-62c75cec2ad2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:25.409250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66a64223-dbd3-416c-a602-62c75cec2ad2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:25.413452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66a64223-dbd3-416c-a602-62c75cec2ad2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:25.416718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66a64223-dbd3-416c-a602-62c75cec2ad2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:25.417682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66a64223-dbd3-416c-a602-62c75cec2ad2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:25.418953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66a64223-dbd3-416c-a602-62c75cec2ad2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:25.423679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66a64223-dbd3-416c-a602-62c75cec2ad2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:25.492968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fcdc7ed4-b3b0-40f1-b174-36529666f1d8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:25.494176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fcdc7ed4-b3b0-40f1-b174-36529666f1d8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:25.505599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcdc7ed4-b3b0-40f1-b174-36529666f1d8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:25.506705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcdc7ed4-b3b0-40f1-b174-36529666f1d8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:25.508342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcdc7ed4-b3b0-40f1-b174-36529666f1d8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:25.511267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcdc7ed4-b3b0-40f1-b174-36529666f1d8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:25.513963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcdc7ed4-b3b0-40f1-b174-36529666f1d8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:25.514619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcdc7ed4-b3b0-40f1-b174-36529666f1d8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:25.703279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-66a64223-dbd3-416c-a602-62c75cec2ad2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:25.711772 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-66a64223-dbd3-416c-a602-62c75cec2ad2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.314497 Oct 12 22:03:25.712358 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 527/1114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:25 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:25.735311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fcdc7ed4-b3b0-40f1-b174-36529666f1d8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:25.743018 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fcdc7ed4-b3b0-40f1-b174-36529666f1d8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1467 microversion: 2.1 time: 0.256804 Oct 12 22:03:25.743625 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 588/1115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:25 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1467 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:25.768546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5284de0a-02fb-4bd8-94cb-8406be938fa4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-789300915"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:25.771389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5284de0a-02fb-4bd8-94cb-8406be938fa4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: cf71b2a6-484b-4e05-80fb-89be6b98546a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:25.779402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5284de0a-02fb-4bd8-94cb-8406be938fa4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:25.780024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5284de0a-02fb-4bd8-94cb-8406be938fa4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:25.780535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5284de0a-02fb-4bd8-94cb-8406be938fa4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:25.781317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5284de0a-02fb-4bd8-94cb-8406be938fa4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:25.781947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5284de0a-02fb-4bd8-94cb-8406be938fa4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:25.782377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5284de0a-02fb-4bd8-94cb-8406be938fa4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:25.959166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1821213e-8e1f-4016-a6eb-8cd36cbf51c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:25.959894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1821213e-8e1f-4016-a6eb-8cd36cbf51c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:25.968059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1821213e-8e1f-4016-a6eb-8cd36cbf51c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:25.968964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1821213e-8e1f-4016-a6eb-8cd36cbf51c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:25.969631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1821213e-8e1f-4016-a6eb-8cd36cbf51c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:25.970523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1821213e-8e1f-4016-a6eb-8cd36cbf51c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:25.971043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1821213e-8e1f-4016-a6eb-8cd36cbf51c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:25.971704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1821213e-8e1f-4016-a6eb-8cd36cbf51c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:25.991286 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5284de0a-02fb-4bd8-94cb-8406be938fa4 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "POST /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a/action" status: 202 len: 0 microversion: 2.1 time: 0.228398 Oct 12 22:03:25.991940 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 528/1116] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:03:25 2022] POST /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:03:26.002714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-19ac34c8-3a20-443b-9dcb-c30a0ba7173b tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51286ecc10>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:26.061460 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-19ac34c8-3a20-443b-9dcb-c30a0ba7173b tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5" status: 200 len: 1452 microversion: 2.1 time: 0.062684 Oct 12 22:03:26.062744 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 529/1117] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:25 2022] GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5 => generated 1452 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:26.143879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1821213e-8e1f-4016-a6eb-8cd36cbf51c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:26.153943 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1821213e-8e1f-4016-a6eb-8cd36cbf51c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1471 microversion: 2.1 time: 0.198615 Oct 12 22:03:26.154615 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 589/1118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:25 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:26.177925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-47ccb2d0-f011-4a87-b679-e67837ca5601 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:26.178692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-47ccb2d0-f011-4a87-b679-e67837ca5601 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:26.185844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ccb2d0-f011-4a87-b679-e67837ca5601 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:26.186327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ccb2d0-f011-4a87-b679-e67837ca5601 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:26.186760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ccb2d0-f011-4a87-b679-e67837ca5601 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:26.187478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ccb2d0-f011-4a87-b679-e67837ca5601 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:26.187926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ccb2d0-f011-4a87-b679-e67837ca5601 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:26.188378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ccb2d0-f011-4a87-b679-e67837ca5601 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:26.252865 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-47ccb2d0-f011-4a87-b679-e67837ca5601 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "POST /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159/action" status: 204 len: 0 microversion: 2.1 time: 0.080002 Oct 12 22:03:26.253501 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 530/1119] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:03:26 2022] POST /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:03:26.262867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-45f8d041-bcb8-4482-9d29-97df1c54bed3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:26.263739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-45f8d041-bcb8-4482-9d29-97df1c54bed3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:26.270862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45f8d041-bcb8-4482-9d29-97df1c54bed3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:26.272209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45f8d041-bcb8-4482-9d29-97df1c54bed3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:26.272684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45f8d041-bcb8-4482-9d29-97df1c54bed3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:26.274627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45f8d041-bcb8-4482-9d29-97df1c54bed3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:26.275016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45f8d041-bcb8-4482-9d29-97df1c54bed3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:26.275641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45f8d041-bcb8-4482-9d29-97df1c54bed3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:26.300077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-530478f5-2e3a-4295-ab6f-e9c37674a543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:26.301563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-530478f5-2e3a-4295-ab6f-e9c37674a543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:26.311634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-530478f5-2e3a-4295-ab6f-e9c37674a543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:26.311634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-530478f5-2e3a-4295-ab6f-e9c37674a543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:26.311832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-530478f5-2e3a-4295-ab6f-e9c37674a543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:26.312799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-530478f5-2e3a-4295-ab6f-e9c37674a543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:26.313426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-530478f5-2e3a-4295-ab6f-e9c37674a543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:26.313859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-530478f5-2e3a-4295-ab6f-e9c37674a543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:26.466960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-530478f5-2e3a-4295-ab6f-e9c37674a543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:26.476649 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-530478f5-2e3a-4295-ab6f-e9c37674a543 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.184706 Oct 12 22:03:26.477707 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 531/1120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:26 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:26.484903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8225a7c3-6c54-460b-acc5-2258052fa58e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:26.486281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8225a7c3-6c54-460b-acc5-2258052fa58e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:26.496190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8225a7c3-6c54-460b-acc5-2258052fa58e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:26.497377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8225a7c3-6c54-460b-acc5-2258052fa58e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:26.497829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8225a7c3-6c54-460b-acc5-2258052fa58e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:26.498846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8225a7c3-6c54-460b-acc5-2258052fa58e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:26.499350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8225a7c3-6c54-460b-acc5-2258052fa58e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:26.499787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8225a7c3-6c54-460b-acc5-2258052fa58e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:26.555903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-45f8d041-bcb8-4482-9d29-97df1c54bed3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:26.565059 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-45f8d041-bcb8-4482-9d29-97df1c54bed3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1471 microversion: 2.1 time: 0.307192 Oct 12 22:03:26.573959 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 590/1121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:26 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1471 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:26.651843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8225a7c3-6c54-460b-acc5-2258052fa58e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:26.661119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8225a7c3-6c54-460b-acc5-2258052fa58e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:26.662892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8225a7c3-6c54-460b-acc5-2258052fa58e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:26.664099 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8225a7c3-6c54-460b-acc5-2258052fa58e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1411 microversion: 2.25 time: 0.185226 Oct 12 22:03:26.679206 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 532/1122] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:26 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1411 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:26.739107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b2acd3f1-d87a-49df-a60f-a6a655e23312 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:26.739944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b2acd3f1-d87a-49df-a60f-a6a655e23312 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:26.747889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2acd3f1-d87a-49df-a60f-a6a655e23312 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:26.748641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2acd3f1-d87a-49df-a60f-a6a655e23312 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:26.749381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2acd3f1-d87a-49df-a60f-a6a655e23312 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:26.750313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2acd3f1-d87a-49df-a60f-a6a655e23312 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:26.750984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2acd3f1-d87a-49df-a60f-a6a655e23312 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:26.751710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2acd3f1-d87a-49df-a60f-a6a655e23312 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:26.998629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b2acd3f1-d87a-49df-a60f-a6a655e23312 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:27.003965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-8100347c-9b05-4e6b-8b88-b2f531f24dab req-6a138eb8-0b0d-4334-b742-561a8bdff40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adec1006-780c-4fe7-871a-e4f7addfe159", "name": "network-vif-plugged", "status": "completed", "tag": "1a376da9-7885-4d84-98d7-e6c54abdca11"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:27.007787 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b2acd3f1-d87a-49df-a60f-a6a655e23312 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.275643 Oct 12 22:03:27.012512 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 591/1123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:26 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:27.014492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8100347c-9b05-4e6b-8b88-b2f531f24dab req-6a138eb8-0b0d-4334-b742-561a8bdff40a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:27.014639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8100347c-9b05-4e6b-8b88-b2f531f24dab req-6a138eb8-0b0d-4334-b742-561a8bdff40a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:27.015026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8100347c-9b05-4e6b-8b88-b2f531f24dab req-6a138eb8-0b0d-4334-b742-561a8bdff40a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:27.029085 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-8100347c-9b05-4e6b-8b88-b2f531f24dab req-6a138eb8-0b0d-4334-b742-561a8bdff40a service nova] Creating event network-vif-plugged:1a376da9-7885-4d84-98d7-e6c54abdca11 for instance adec1006-780c-4fe7-871a-e4f7addfe159 on n-h2-861111-1 Oct 12 22:03:27.035214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-8100347c-9b05-4e6b-8b88-b2f531f24dab req-6a138eb8-0b0d-4334-b742-561a8bdff40a service nova] Instance adec1006-780c-4fe7-871a-e4f7addfe159 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:03:27.047090 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-8100347c-9b05-4e6b-8b88-b2f531f24dab req-6a138eb8-0b0d-4334-b742-561a8bdff40a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046667 Oct 12 22:03:27.048052 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 533/1124] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:03:27.077872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1f4d6292-67ba-4507-9d09-a5914fbb0cb2 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51283ac4c0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:27.135016 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1f4d6292-67ba-4507-9d09-a5914fbb0cb2 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5" status: 200 len: 1452 microversion: 2.1 time: 0.061546 Oct 12 22:03:27.135854 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 592/1125] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:27 2022] GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5 => generated 1452 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:27.500486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-307a17ef-e509-4a63-8b7d-5ec48316f920 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:27.501321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-307a17ef-e509-4a63-8b7d-5ec48316f920 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:27.507869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-307a17ef-e509-4a63-8b7d-5ec48316f920 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:27.508364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-307a17ef-e509-4a63-8b7d-5ec48316f920 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:27.508805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-307a17ef-e509-4a63-8b7d-5ec48316f920 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:27.509506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-307a17ef-e509-4a63-8b7d-5ec48316f920 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:27.510468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-307a17ef-e509-4a63-8b7d-5ec48316f920 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:27.510981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-307a17ef-e509-4a63-8b7d-5ec48316f920 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:27.565165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8bf39874-a8c2-4191-a89b-a140de587af2 tempest-InstanceUsageAuditLogTestJSON-1310083231 tempest-InstanceUsageAuditLogTestJSON-1310083231-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:27.588316 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8bf39874-a8c2-4191-a89b-a140de587af2 tempest-InstanceUsageAuditLogTestJSON-1310083231 tempest-InstanceUsageAuditLogTestJSON-1310083231-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12 22:03:27" status: 200 len: 318 microversion: 2.1 time: 0.144601 Oct 12 22:03:27.588984 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 534/1126] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 12 22:03:27 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12%2022%3A03%3A27 => generated 318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:27.594108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eae131bd-fef6-4a49-afc7-b24da3192dd9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:27.594930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eae131bd-fef6-4a49-afc7-b24da3192dd9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:27.600893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eae131bd-fef6-4a49-afc7-b24da3192dd9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:27.601716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eae131bd-fef6-4a49-afc7-b24da3192dd9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:27.601832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eae131bd-fef6-4a49-afc7-b24da3192dd9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:27.602461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eae131bd-fef6-4a49-afc7-b24da3192dd9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:27.602909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eae131bd-fef6-4a49-afc7-b24da3192dd9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:27.603353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eae131bd-fef6-4a49-afc7-b24da3192dd9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:27.655255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-307a17ef-e509-4a63-8b7d-5ec48316f920 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:27.663278 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-307a17ef-e509-4a63-8b7d-5ec48316f920 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.167096 Oct 12 22:03:27.663782 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 593/1127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:27 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:27.667986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e9218a0-94b9-4a68-8e1c-1e1471f7f02d tempest-InstanceUsageAuditLogTestJSON-1310083231 tempest-InstanceUsageAuditLogTestJSON-1310083231-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:27.687725 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9e9218a0-94b9-4a68-8e1c-1e1471f7f02d tempest-InstanceUsageAuditLogTestJSON-1310083231 tempest-InstanceUsageAuditLogTestJSON-1310083231-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.022900 Oct 12 22:03:27.688285 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 594/1128] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 12 22:03:27 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:27.692752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3317b594-023c-4c05-9a7c-ed00d519bc44 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:27.693357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3317b594-023c-4c05-9a7c-ed00d519bc44 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:27.701474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3317b594-023c-4c05-9a7c-ed00d519bc44 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:27.702124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3317b594-023c-4c05-9a7c-ed00d519bc44 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:27.702570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3317b594-023c-4c05-9a7c-ed00d519bc44 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:27.703464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3317b594-023c-4c05-9a7c-ed00d519bc44 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:27.703918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3317b594-023c-4c05-9a7c-ed00d519bc44 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:27.704517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3317b594-023c-4c05-9a7c-ed00d519bc44 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:27.744004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eae131bd-fef6-4a49-afc7-b24da3192dd9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:27.752220 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eae131bd-fef6-4a49-afc7-b24da3192dd9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1471 microversion: 2.1 time: 0.162189 Oct 12 22:03:27.752808 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 535/1129] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:27 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:27.862785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3317b594-023c-4c05-9a7c-ed00d519bc44 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:27.871495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3317b594-023c-4c05-9a7c-ed00d519bc44 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:27.872950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3317b594-023c-4c05-9a7c-ed00d519bc44 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:27.874067 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3317b594-023c-4c05-9a7c-ed00d519bc44 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1411 microversion: 2.25 time: 0.184891 Oct 12 22:03:27.874637 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 595/1130] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:27 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1411 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:28.037611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c8ac1c06-18d5-4843-a8b2-d737f2cc85e3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:28.038367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c8ac1c06-18d5-4843-a8b2-d737f2cc85e3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:28.045140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8ac1c06-18d5-4843-a8b2-d737f2cc85e3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:28.045631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8ac1c06-18d5-4843-a8b2-d737f2cc85e3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:28.046066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8ac1c06-18d5-4843-a8b2-d737f2cc85e3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:28.046959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8ac1c06-18d5-4843-a8b2-d737f2cc85e3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:28.047443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8ac1c06-18d5-4843-a8b2-d737f2cc85e3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:28.059741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8ac1c06-18d5-4843-a8b2-d737f2cc85e3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:28.150547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8884c903-42a7-43d2-8af1-33fa3635fe30 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51283ac820>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:28.199043 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8884c903-42a7-43d2-8af1-33fa3635fe30 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5" status: 200 len: 1452 microversion: 2.1 time: 0.052282 Oct 12 22:03:28.200278 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 596/1131] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:28 2022] GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5 => generated 1452 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:28.247870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c8ac1c06-18d5-4843-a8b2-d737f2cc85e3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:28.255796 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c8ac1c06-18d5-4843-a8b2-d737f2cc85e3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1498 microversion: 2.1 time: 0.222548 Oct 12 22:03:28.256531 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 536/1132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:28 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1498 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:28.687177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d44141a5-561f-44f1-9264-e62bd4adf512 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:28.687856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d44141a5-561f-44f1-9264-e62bd4adf512 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:28.694210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d44141a5-561f-44f1-9264-e62bd4adf512 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:28.694891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d44141a5-561f-44f1-9264-e62bd4adf512 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:28.695354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d44141a5-561f-44f1-9264-e62bd4adf512 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:28.696048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d44141a5-561f-44f1-9264-e62bd4adf512 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:28.696555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d44141a5-561f-44f1-9264-e62bd4adf512 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:28.696924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d44141a5-561f-44f1-9264-e62bd4adf512 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:28.776823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-61e0eccf-0898-42f2-9b1c-2f91bd314668 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:28.777989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-61e0eccf-0898-42f2-9b1c-2f91bd314668 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:28.784871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61e0eccf-0898-42f2-9b1c-2f91bd314668 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:28.785473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61e0eccf-0898-42f2-9b1c-2f91bd314668 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:28.785983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61e0eccf-0898-42f2-9b1c-2f91bd314668 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:28.786686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61e0eccf-0898-42f2-9b1c-2f91bd314668 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:28.787137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61e0eccf-0898-42f2-9b1c-2f91bd314668 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:28.787585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61e0eccf-0898-42f2-9b1c-2f91bd314668 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:28.878682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d44141a5-561f-44f1-9264-e62bd4adf512 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:28.888237 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d44141a5-561f-44f1-9264-e62bd4adf512 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.206085 Oct 12 22:03:28.902210 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 597/1133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:28 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:28.909107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4199dce1-bc56-4b21-a72d-07bdc951455e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:28.910939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4199dce1-bc56-4b21-a72d-07bdc951455e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:28.927083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-61e0eccf-0898-42f2-9b1c-2f91bd314668 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:28.931484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4199dce1-bc56-4b21-a72d-07bdc951455e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:28.937071 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-61e0eccf-0898-42f2-9b1c-2f91bd314668 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1463 microversion: 2.1 time: 0.164087 Oct 12 22:03:28.937713 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 537/1134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:28 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1463 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:28.938026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4199dce1-bc56-4b21-a72d-07bdc951455e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:28.938719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4199dce1-bc56-4b21-a72d-07bdc951455e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:28.939684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4199dce1-bc56-4b21-a72d-07bdc951455e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:28.940156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4199dce1-bc56-4b21-a72d-07bdc951455e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:28.940586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4199dce1-bc56-4b21-a72d-07bdc951455e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:28.959997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e5dac327-d18e-45b4-8090-488681f6e140 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:28.960864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e5dac327-d18e-45b4-8090-488681f6e140 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:28.969148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5dac327-d18e-45b4-8090-488681f6e140 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:28.969686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5dac327-d18e-45b4-8090-488681f6e140 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:28.970126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5dac327-d18e-45b4-8090-488681f6e140 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:28.970996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5dac327-d18e-45b4-8090-488681f6e140 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:28.971654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5dac327-d18e-45b4-8090-488681f6e140 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:28.972234 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5dac327-d18e-45b4-8090-488681f6e140 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:28.977011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:29.094252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4199dce1-bc56-4b21-a72d-07bdc951455e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:29.102751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4199dce1-bc56-4b21-a72d-07bdc951455e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:29.104349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4199dce1-bc56-4b21-a72d-07bdc951455e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:29.106079 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4199dce1-bc56-4b21-a72d-07bdc951455e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1411 microversion: 2.25 time: 0.204122 Oct 12 22:03:29.106726 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 598/1135] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:28 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1411 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:29.119472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-eab582b9-f2f0-4810-a9a6-1bcc944e2eca req-10e7d104-9f4d-4ab8-9b6a-430390af4e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "247e0252-3374-40b8-85f3-995d2031867d", "name": "network-vif-plugged", "status": "completed", "tag": "319c47c2-57cf-461d-8a9e-adf8c461cb1d"}, {"server_uuid": "18e1ad2a-6b26-4501-af12-49ad23802b5f", "name": "network-vif-unplugged", "status": "completed", "tag": "e6ed5eb0-d436-4efd-8560-3606d22e1b6e"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:29.121677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-eab582b9-f2f0-4810-a9a6-1bcc944e2eca req-10e7d104-9f4d-4ab8-9b6a-430390af4e26 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:29.122161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-eab582b9-f2f0-4810-a9a6-1bcc944e2eca req-10e7d104-9f4d-4ab8-9b6a-430390af4e26 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:29.122597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-eab582b9-f2f0-4810-a9a6-1bcc944e2eca req-10e7d104-9f4d-4ab8-9b6a-430390af4e26 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:29.135459 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-eab582b9-f2f0-4810-a9a6-1bcc944e2eca req-10e7d104-9f4d-4ab8-9b6a-430390af4e26 service nova] Creating event network-vif-plugged:319c47c2-57cf-461d-8a9e-adf8c461cb1d for instance 247e0252-3374-40b8-85f3-995d2031867d on n-h1-861111-1 Oct 12 22:03:29.136197 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-eab582b9-f2f0-4810-a9a6-1bcc944e2eca req-10e7d104-9f4d-4ab8-9b6a-430390af4e26 service nova] Creating event network-vif-unplugged:e6ed5eb0-d436-4efd-8560-3606d22e1b6e for instance 18e1ad2a-6b26-4501-af12-49ad23802b5f on n-h2-861111-1 Oct 12 22:03:29.144946 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-eab582b9-f2f0-4810-a9a6-1bcc944e2eca req-10e7d104-9f4d-4ab8-9b6a-430390af4e26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.036976 Oct 12 22:03:29.145569 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 599/1136] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:29.163049 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e5dac327-d18e-45b4-8090-488681f6e140 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1614 microversion: 2.1 time: 0.207274 Oct 12 22:03:29.163665 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 538/1137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:28 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1614 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:29.197580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8abe1cf3-96ee-4cec-83ed-ad3cd70efcd7 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Calling method '.version_select at 0x7f51285533a0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:29.203439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8abe1cf3-96ee-4cec-83ed-ad3cd70efcd7 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:29.204258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8abe1cf3-96ee-4cec-83ed-ad3cd70efcd7 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:29.204935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8abe1cf3-96ee-4cec-83ed-ad3cd70efcd7 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:29.215957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a0a1a2c4-9779-4751-8b27-eec7ce87e785 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51286b0a60>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:29.216111 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8abe1cf3-96ee-4cec-83ed-ad3cd70efcd7 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.1 time: 0.023959 Oct 12 22:03:29.216746 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 600/1138] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 12 22:03:29 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:29.271423 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a0a1a2c4-9779-4751-8b27-eec7ce87e785 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5" status: 200 len: 1452 microversion: 2.1 time: 0.059620 Oct 12 22:03:29.272321 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 539/1139] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:29 2022] GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5 => generated 1452 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:29.280616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8a589c0e-ef07-4418-8022-b516a38ef1f6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:29.281344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8a589c0e-ef07-4418-8022-b516a38ef1f6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:29.283283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:29.291100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a589c0e-ef07-4418-8022-b516a38ef1f6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:29.291793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a589c0e-ef07-4418-8022-b516a38ef1f6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:29.292229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a589c0e-ef07-4418-8022-b516a38ef1f6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:29.292921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a589c0e-ef07-4418-8022-b516a38ef1f6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:29.293972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a589c0e-ef07-4418-8022-b516a38ef1f6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:29.294391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a589c0e-ef07-4418-8022-b516a38ef1f6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:29.368926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1033866569", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:29.426885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:03:29.463797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8a589c0e-ef07-4418-8022-b516a38ef1f6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:29.472359 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8a589c0e-ef07-4418-8022-b516a38ef1f6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 200 len: 1475 microversion: 2.1 time: 0.195788 Oct 12 22:03:29.473025 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 601/1140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:29 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 1475 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:29.495565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-81954685-cbe0-468f-93eb-e571ae3f0765 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1153787007"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:29.515349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-81954685-cbe0-468f-93eb-e571ae3f0765 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:29.522303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81954685-cbe0-468f-93eb-e571ae3f0765 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:29.522797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81954685-cbe0-468f-93eb-e571ae3f0765 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:29.523263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81954685-cbe0-468f-93eb-e571ae3f0765 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:29.524608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81954685-cbe0-468f-93eb-e571ae3f0765 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:29.525072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81954685-cbe0-468f-93eb-e571ae3f0765 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:29.525503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81954685-cbe0-468f-93eb-e571ae3f0765 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:29.665716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:03:29.666329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:03:29.666984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:03:29.667574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:03:29.668264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:03:29.687911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:29.688399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:29.688839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:29.689567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:29.690186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:29.690791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:29.694340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:29.708380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Getting quotas for project 7d943f8c0c934001b53032564fd00e11. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:03:29.713843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Getting quotas for user cfc7df27bf6f456581abff6e80ab4f64 and project 7d943f8c0c934001b53032564fd00e11. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:03:29.727873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:03:29.730201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:03:29.746727 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-81954685-cbe0-468f-93eb-e571ae3f0765 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "POST /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221/action" status: 202 len: 0 microversion: 2.1 time: 0.254419 Oct 12 22:03:29.753929 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 602/1141] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:03:29 2022] POST /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:03:29.766145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-54b4e064-e99b-4306-94ee-2046f4819839 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128537d30>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:29.797253 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-435eb8f1-b78b-4c54-8897-c7ed94d2ca9a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.432319 Oct 12 22:03:29.798793 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 540/1142] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:03:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:03:29.809296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fc0c717b-5074-42d6-a03b-2d883f77f1fa tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:29.809945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fc0c717b-5074-42d6-a03b-2d883f77f1fa tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:29.851907 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-54b4e064-e99b-4306-94ee-2046f4819839 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad" status: 200 len: 1412 microversion: 2.1 time: 0.096561 Oct 12 22:03:29.852669 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 603/1143] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:29 2022] GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:29.894312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fc0c717b-5074-42d6-a03b-2d883f77f1fa tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:29.901243 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fc0c717b-5074-42d6-a03b-2d883f77f1fa tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1213 microversion: 2.1 time: 0.096367 Oct 12 22:03:29.901814 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 541/1144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:29 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:29.923899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8d681102-832f-4d69-a4a7-02913f464d95 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:29.924683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8d681102-832f-4d69-a4a7-02913f464d95 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:29.932383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d681102-832f-4d69-a4a7-02913f464d95 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:29.933381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d681102-832f-4d69-a4a7-02913f464d95 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:29.934069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d681102-832f-4d69-a4a7-02913f464d95 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:29.934930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d681102-832f-4d69-a4a7-02913f464d95 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:29.935573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d681102-832f-4d69-a4a7-02913f464d95 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:29.936160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d681102-832f-4d69-a4a7-02913f464d95 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:30.083094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8d681102-832f-4d69-a4a7-02913f464d95 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:30.092916 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8d681102-832f-4d69-a4a7-02913f464d95 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.180206 Oct 12 22:03:30.093557 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 604/1145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:29 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:30.131463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-883ff9ae-b332-4005-82d2-b3c89c1621fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:30.132361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-883ff9ae-b332-4005-82d2-b3c89c1621fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:30.139231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-883ff9ae-b332-4005-82d2-b3c89c1621fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:30.139829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-883ff9ae-b332-4005-82d2-b3c89c1621fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:30.140346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-883ff9ae-b332-4005-82d2-b3c89c1621fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:30.141150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-883ff9ae-b332-4005-82d2-b3c89c1621fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:30.141673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-883ff9ae-b332-4005-82d2-b3c89c1621fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:30.142424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-883ff9ae-b332-4005-82d2-b3c89c1621fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:30.287875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f9d789ca-8730-47e9-a4b4-8ebf659a65c6 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51286fc430>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:30.297737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-883ff9ae-b332-4005-82d2-b3c89c1621fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:30.308663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-883ff9ae-b332-4005-82d2-b3c89c1621fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:30.310101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-883ff9ae-b332-4005-82d2-b3c89c1621fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:30.311217 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-883ff9ae-b332-4005-82d2-b3c89c1621fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1411 microversion: 2.25 time: 0.183806 Oct 12 22:03:30.311967 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 542/1146] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:30 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1411 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:30.335493 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f9d789ca-8730-47e9-a4b4-8ebf659a65c6 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5" status: 200 len: 1452 microversion: 2.1 time: 0.052139 Oct 12 22:03:30.336315 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 605/1147] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:30 2022] GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5 => generated 1452 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:30.868177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9d046a06-3ad1-49c3-9cc2-a42334bdbe0b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128303c10>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:30.921573 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9d046a06-3ad1-49c3-9cc2-a42334bdbe0b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad" status: 200 len: 1412 microversion: 2.1 time: 0.058065 Oct 12 22:03:30.922885 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 606/1148] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:30 2022] GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad => generated 1412 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:30.927733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9b6750c8-07be-4a25-92c9-637e42c24fee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:30.928626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9b6750c8-07be-4a25-92c9-637e42c24fee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:30.935487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b6750c8-07be-4a25-92c9-637e42c24fee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:30.936194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b6750c8-07be-4a25-92c9-637e42c24fee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:30.937027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b6750c8-07be-4a25-92c9-637e42c24fee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:30.937889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b6750c8-07be-4a25-92c9-637e42c24fee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:30.938495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b6750c8-07be-4a25-92c9-637e42c24fee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:30.939072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b6750c8-07be-4a25-92c9-637e42c24fee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:31.012939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9b6750c8-07be-4a25-92c9-637e42c24fee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:31.020340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6181af85-ca1c-45e0-ba10-5b2e1df697c5 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Calling method '.version_select at 0x7f5128717280>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:31.021300 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9b6750c8-07be-4a25-92c9-637e42c24fee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1265 microversion: 2.1 time: 0.097147 Oct 12 22:03:31.021865 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 607/1149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:30 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:31.088399 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6181af85-ca1c-45e0-ba10-5b2e1df697c5 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/fef0794a81644cdc8c04920296eed40e" status: 200 len: 371 microversion: 2.1 time: 0.228942 Oct 12 22:03:31.088986 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 543/1150] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 12 22:03:30 2022] GET /compute/v2.1/os-quota-sets/fef0794a81644cdc8c04920296eed40e => generated 371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:31.101221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-98b5bdbc-ed16-482b-8a2f-20dd7838009c tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Action: 'update', calling method: .version_select at 0x7f51282f5a60>, body: {"quota_set": {"ram": "5120"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:31.116060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-62fce0be-8f8d-486a-a3b7-50176233e80e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:31.116702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-62fce0be-8f8d-486a-a3b7-50176233e80e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:31.122865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62fce0be-8f8d-486a-a3b7-50176233e80e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:31.123399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62fce0be-8f8d-486a-a3b7-50176233e80e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:31.123835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62fce0be-8f8d-486a-a3b7-50176233e80e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:31.124522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62fce0be-8f8d-486a-a3b7-50176233e80e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:31.125627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62fce0be-8f8d-486a-a3b7-50176233e80e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:31.126243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62fce0be-8f8d-486a-a3b7-50176233e80e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:31.173388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98b5bdbc-ed16-482b-8a2f-20dd7838009c tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:31.173981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98b5bdbc-ed16-482b-8a2f-20dd7838009c tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:31.174598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98b5bdbc-ed16-482b-8a2f-20dd7838009c tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:31.175450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98b5bdbc-ed16-482b-8a2f-20dd7838009c tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:31.175967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98b5bdbc-ed16-482b-8a2f-20dd7838009c tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:31.176398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98b5bdbc-ed16-482b-8a2f-20dd7838009c tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:31.231479 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-98b5bdbc-ed16-482b-8a2f-20dd7838009c tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/fef0794a81644cdc8c04920296eed40e" status: 200 len: 328 microversion: 2.1 time: 0.133181 Oct 12 22:03:31.232482 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 608/1151] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 12 22:03:31 2022] PUT /compute/v2.1/os-quota-sets/fef0794a81644cdc8c04920296eed40e => generated 328 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:31.243434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6c5332bf-533b-422c-9348-2e350435f1ec tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:31.256851 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6c5332bf-533b-422c-9348-2e350435f1ec tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-quota-sets/fef0794a81644cdc8c04920296eed40e" status: 202 len: 0 microversion: 2.1 time: 0.017026 Oct 12 22:03:31.258204 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 609/1152] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:03:31 2022] DELETE /compute/v2.1/os-quota-sets/fef0794a81644cdc8c04920296eed40e => generated 0 bytes in 19 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:03:31.266176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7554c8d0-e9ed-4639-a57d-828e7d4f8c0e tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Calling method '.version_select at 0x7f51286fc4c0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:31.273347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-62fce0be-8f8d-486a-a3b7-50176233e80e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:31.283360 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-62fce0be-8f8d-486a-a3b7-50176233e80e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.171511 Oct 12 22:03:31.295892 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 544/1153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:31 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:31.335991 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7554c8d0-e9ed-4639-a57d-828e7d4f8c0e tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/fef0794a81644cdc8c04920296eed40e" status: 200 len: 371 microversion: 2.1 time: 0.073566 Oct 12 22:03:31.336828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f2b2ef75-d7f9-4415-a276-311fa7b9076b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:31.343121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f2b2ef75-d7f9-4415-a276-311fa7b9076b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:31.343220 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 610/1154] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 12 22:03:31 2022] GET /compute/v2.1/os-quota-sets/fef0794a81644cdc8c04920296eed40e => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:03:31.343333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2b2ef75-d7f9-4415-a276-311fa7b9076b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:31.343948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2b2ef75-d7f9-4415-a276-311fa7b9076b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:31.344397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2b2ef75-d7f9-4415-a276-311fa7b9076b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:31.346788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2b2ef75-d7f9-4415-a276-311fa7b9076b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:31.347282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2b2ef75-d7f9-4415-a276-311fa7b9076b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:31.347727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2b2ef75-d7f9-4415-a276-311fa7b9076b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:31.351196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b7b6c8a1-5589-40d9-a71e-2701e53a5cd2 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51283aca60>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:31.403058 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b7b6c8a1-5589-40d9-a71e-2701e53a5cd2 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5" status: 200 len: 1452 microversion: 2.1 time: 0.055657 Oct 12 22:03:31.403740 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 611/1155] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:31 2022] GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5 => generated 1452 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:31.504793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3ee71c7a-a5e5-43e1-af9b-48b9ec24e28c tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Calling method '.version_select at 0x7f51285378b0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:31.533905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f2b2ef75-d7f9-4415-a276-311fa7b9076b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:31.543924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f2b2ef75-d7f9-4415-a276-311fa7b9076b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:31.546044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f2b2ef75-d7f9-4415-a276-311fa7b9076b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:31.548623 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f2b2ef75-d7f9-4415-a276-311fa7b9076b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1607 microversion: 2.25 time: 0.215598 Oct 12 22:03:31.549610 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 545/1156] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:31 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1607 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:03:31.576014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9120c1b4-f743-456e-9e7a-dd421e6bc9fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:31.576764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9120c1b4-f743-456e-9e7a-dd421e6bc9fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:31.583295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9120c1b4-f743-456e-9e7a-dd421e6bc9fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:31.584048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9120c1b4-f743-456e-9e7a-dd421e6bc9fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:31.584681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9120c1b4-f743-456e-9e7a-dd421e6bc9fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:31.585550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9120c1b4-f743-456e-9e7a-dd421e6bc9fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:31.586173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9120c1b4-f743-456e-9e7a-dd421e6bc9fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:31.587008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9120c1b4-f743-456e-9e7a-dd421e6bc9fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:31.677237 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9120c1b4-f743-456e-9e7a-dd421e6bc9fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.106894 Oct 12 22:03:31.677949 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 546/1157] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 12 22:03:31 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:03:31.738448 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3ee71c7a-a5e5-43e1-af9b-48b9ec24e28c tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/af225fbf51134fed96fbb5ef019e39f3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.240174 Oct 12 22:03:31.739325 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 612/1158] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 12 22:03:31 2022] GET /compute/v2.1/os-quota-sets/af225fbf51134fed96fbb5ef019e39f3/defaults => generated 371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:03:31.937697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8196cb3d-12d2-4a9e-a129-994553a9a237 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512862d0d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:31.954966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2742a4d8-6dbb-43d1-8b14-155969f43e81 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Action: 'update', calling method: .version_select at 0x7f51285371f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:32.006091 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8196cb3d-12d2-4a9e-a129-994553a9a237 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad" status: 200 len: 1412 microversion: 2.1 time: 0.072753 Oct 12 22:03:32.006989 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 547/1159] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:31 2022] GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad => generated 1412 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:32.044884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e5ccad07-ff3b-4c7e-894d-00ef77e731c1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:32.045641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e5ccad07-ff3b-4c7e-894d-00ef77e731c1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:32.052160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5ccad07-ff3b-4c7e-894d-00ef77e731c1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:32.052961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5ccad07-ff3b-4c7e-894d-00ef77e731c1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:32.053602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5ccad07-ff3b-4c7e-894d-00ef77e731c1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:32.054526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5ccad07-ff3b-4c7e-894d-00ef77e731c1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:32.055188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5ccad07-ff3b-4c7e-894d-00ef77e731c1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:32.055875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5ccad07-ff3b-4c7e-894d-00ef77e731c1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:32.142703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2742a4d8-6dbb-43d1-8b14-155969f43e81 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:32.143191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2742a4d8-6dbb-43d1-8b14-155969f43e81 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:32.143830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2742a4d8-6dbb-43d1-8b14-155969f43e81 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:32.144727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2742a4d8-6dbb-43d1-8b14-155969f43e81 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:32.146151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2742a4d8-6dbb-43d1-8b14-155969f43e81 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:32.146754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2742a4d8-6dbb-43d1-8b14-155969f43e81 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:32.254808 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2742a4d8-6dbb-43d1-8b14-155969f43e81 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/a8e2cabe3649429d850d5d75db2b4e3a" status: 200 len: 328 microversion: 2.1 time: 0.306622 Oct 12 22:03:32.256191 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 613/1160] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 12 22:03:31 2022] PUT /compute/v2.1/os-quota-sets/a8e2cabe3649429d850d5d75db2b4e3a => generated 328 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:32.286863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-42cec22c-61c1-4c8d-b09a-a6fbb847c6cd tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Calling method '.version_select at 0x7f5128ac2f70>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:32.298704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e5ccad07-ff3b-4c7e-894d-00ef77e731c1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:32.306685 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e5ccad07-ff3b-4c7e-894d-00ef77e731c1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1313 microversion: 2.1 time: 0.265649 Oct 12 22:03:32.307291 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 548/1161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:32 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:32.321011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-37b3e311-ce52-4e9f-bcfb-96478c77dd26 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:32.321903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-37b3e311-ce52-4e9f-bcfb-96478c77dd26 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:32.338881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37b3e311-ce52-4e9f-bcfb-96478c77dd26 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:32.353218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37b3e311-ce52-4e9f-bcfb-96478c77dd26 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:32.353700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37b3e311-ce52-4e9f-bcfb-96478c77dd26 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:32.356934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37b3e311-ce52-4e9f-bcfb-96478c77dd26 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:32.358576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37b3e311-ce52-4e9f-bcfb-96478c77dd26 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:32.359515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37b3e311-ce52-4e9f-bcfb-96478c77dd26 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:32.399337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42cec22c-61c1-4c8d-b09a-a6fbb847c6cd tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:32.399918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42cec22c-61c1-4c8d-b09a-a6fbb847c6cd tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:32.400224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42cec22c-61c1-4c8d-b09a-a6fbb847c6cd tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:32.400934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42cec22c-61c1-4c8d-b09a-a6fbb847c6cd tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:32.401381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42cec22c-61c1-4c8d-b09a-a6fbb847c6cd tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:32.401793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42cec22c-61c1-4c8d-b09a-a6fbb847c6cd tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:32.433064 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-42cec22c-61c1-4c8d-b09a-a6fbb847c6cd tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/a8e2cabe3649429d850d5d75db2b4e3a/detail" status: 200 len: 916 microversion: 2.1 time: 0.153169 Oct 12 22:03:32.433934 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 614/1162] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:03:32 2022] GET /compute/v2.1/os-quota-sets/a8e2cabe3649429d850d5d75db2b4e3a/detail => generated 916 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:32.438914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-85cca818-5bd3-444e-ac1c-8851431b800a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128537af0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:32.496693 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-85cca818-5bd3-444e-ac1c-8851431b800a tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5" status: 200 len: 1452 microversion: 2.1 time: 0.059799 Oct 12 22:03:32.498278 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 615/1163] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:32 2022] GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5 => generated 1452 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:32.682771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-37b3e311-ce52-4e9f-bcfb-96478c77dd26 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:32.687635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f7a7f7d5-6f0e-431d-9ace-c1b0683c82f6 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Action: 'update', calling method: .version_select at 0x7f51286fc280>, body: {"quota_set": {"ram": "2048"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:32.690763 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-37b3e311-ce52-4e9f-bcfb-96478c77dd26 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.382477 Oct 12 22:03:32.691368 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 549/1164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:32 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:32.780101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a7f7d5-6f0e-431d-9ace-c1b0683c82f6 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:32.780895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a7f7d5-6f0e-431d-9ace-c1b0683c82f6 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:32.781760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a7f7d5-6f0e-431d-9ace-c1b0683c82f6 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:32.783164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a7f7d5-6f0e-431d-9ace-c1b0683c82f6 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:32.784457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a7f7d5-6f0e-431d-9ace-c1b0683c82f6 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:32.785401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a7f7d5-6f0e-431d-9ace-c1b0683c82f6 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:32.841392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a7f7d5-6f0e-431d-9ace-c1b0683c82f6 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:32.842275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a7f7d5-6f0e-431d-9ace-c1b0683c82f6 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:32.842401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a7f7d5-6f0e-431d-9ace-c1b0683c82f6 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:32.843091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a7f7d5-6f0e-431d-9ace-c1b0683c82f6 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:32.843580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a7f7d5-6f0e-431d-9ace-c1b0683c82f6 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:32.844013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a7f7d5-6f0e-431d-9ace-c1b0683c82f6 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:32.924337 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f7a7f7d5-6f0e-431d-9ace-c1b0683c82f6 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/a8e2cabe3649429d850d5d75db2b4e3a?user_id=3d6bf1ede4a2470eb58e868034cdd312" status: 200 len: 328 microversion: 2.1 time: 0.242678 Oct 12 22:03:32.925290 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 616/1165] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:03:32 2022] PUT /compute/v2.1/os-quota-sets/a8e2cabe3649429d850d5d75db2b4e3a?user_id=3d6bf1ede4a2470eb58e868034cdd312 => generated 328 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:32.938229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7ee0d7b1-782c-40f2-978b-dcac502ebfa9 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Calling method '.version_select at 0x7f51287221f0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:33.023266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-72defac8-375b-4bb0-a8e5-404bfbe9b85f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128304940>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:33.106440 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-72defac8-375b-4bb0-a8e5-404bfbe9b85f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad" status: 200 len: 1412 microversion: 2.1 time: 0.087764 Oct 12 22:03:33.107340 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 617/1166] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:33 2022] GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad => generated 1412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:33.119874 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7ee0d7b1-782c-40f2-978b-dcac502ebfa9 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/a8e2cabe3649429d850d5d75db2b4e3a?user_id=3d6bf1ede4a2470eb58e868034cdd312" status: 200 len: 370 microversion: 2.1 time: 0.186190 Oct 12 22:03:33.120560 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 550/1167] 10.222.0.16 () {58 vars in 1323 bytes} [Wed Oct 12 22:03:32 2022] GET /compute/v2.1/os-quota-sets/a8e2cabe3649429d850d5d75db2b4e3a?user_id=3d6bf1ede4a2470eb58e868034cdd312 => generated 370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:33.331351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c5e6a0f6-356a-4056-b21d-050996fb1f3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:33.332146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c5e6a0f6-356a-4056-b21d-050996fb1f3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:33.335159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:33.344209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5e6a0f6-356a-4056-b21d-050996fb1f3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:33.351003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5e6a0f6-356a-4056-b21d-050996fb1f3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:33.351949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5e6a0f6-356a-4056-b21d-050996fb1f3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:33.352701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5e6a0f6-356a-4056-b21d-050996fb1f3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:33.353166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5e6a0f6-356a-4056-b21d-050996fb1f3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:33.353599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5e6a0f6-356a-4056-b21d-050996fb1f3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:33.465283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-fdf1bda9-cd8c-4c3b-b2ca-233f9ff19b4e req-88b896cf-4939-49e7-b9f4-1f61dcf85bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf71b2a6-484b-4e05-80fb-89be6b98546a", "name": "network-vif-plugged", "status": "completed", "tag": "e7a4b681-6708-4e63-905c-13cb884689e3"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:33.516045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fdf1bda9-cd8c-4c3b-b2ca-233f9ff19b4e req-88b896cf-4939-49e7-b9f4-1f61dcf85bd1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:33.516530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fdf1bda9-cd8c-4c3b-b2ca-233f9ff19b4e req-88b896cf-4939-49e7-b9f4-1f61dcf85bd1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:33.516962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fdf1bda9-cd8c-4c3b-b2ca-233f9ff19b4e req-88b896cf-4939-49e7-b9f4-1f61dcf85bd1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:33.548436 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-fdf1bda9-cd8c-4c3b-b2ca-233f9ff19b4e req-88b896cf-4939-49e7-b9f4-1f61dcf85bd1 service nova] Creating event network-vif-plugged:e7a4b681-6708-4e63-905c-13cb884689e3 for instance cf71b2a6-484b-4e05-80fb-89be6b98546a on n-h2-861111-1 Oct 12 22:03:33.562512 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-fdf1bda9-cd8c-4c3b-b2ca-233f9ff19b4e req-88b896cf-4939-49e7-b9f4-1f61dcf85bd1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102229 Oct 12 22:03:33.563126 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 551/1168] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:03:33.579548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-20d87a5f-81f1-492c-9405-88c0a3b35279 req-39939204-328a-4a03-a939-3106884a9360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48128c05-1d65-46fb-accf-2dd2981a742b", "tag": "51d433b5-9d81-423f-86a9-27412dea934c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:33.597667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-20d87a5f-81f1-492c-9405-88c0a3b35279 req-39939204-328a-4a03-a939-3106884a9360 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:33.598448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-20d87a5f-81f1-492c-9405-88c0a3b35279 req-39939204-328a-4a03-a939-3106884a9360 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:33.599037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-20d87a5f-81f1-492c-9405-88c0a3b35279 req-39939204-328a-4a03-a939-3106884a9360 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:33.630072 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-20d87a5f-81f1-492c-9405-88c0a3b35279 req-39939204-328a-4a03-a939-3106884a9360 service nova] Creating event network-changed:51d433b5-9d81-423f-86a9-27412dea934c for instance 48128c05-1d65-46fb-accf-2dd2981a742b on n-h1-861111-1 Oct 12 22:03:33.640506 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-20d87a5f-81f1-492c-9405-88c0a3b35279 req-39939204-328a-4a03-a939-3106884a9360 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075798 Oct 12 22:03:33.650924 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 552/1169] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:33.663375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a934bd47-bcbf-44dd-a7e5-2e275e1bf4ed tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512875c040>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:33.751366 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a934bd47-bcbf-44dd-a7e5-2e275e1bf4ed tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5" status: 200 len: 1452 microversion: 2.1 time: 0.098288 Oct 12 22:03:33.751949 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 553/1170] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:33 2022] GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5 => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:33.766243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3a54ea34-9633-45ac-a908-cacf72cc9378 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:33.768571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3a54ea34-9633-45ac-a908-cacf72cc9378 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:33.787689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a54ea34-9633-45ac-a908-cacf72cc9378 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:33.789510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a54ea34-9633-45ac-a908-cacf72cc9378 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:33.790988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a54ea34-9633-45ac-a908-cacf72cc9378 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:33.794347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a54ea34-9633-45ac-a908-cacf72cc9378 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:33.794999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a54ea34-9633-45ac-a908-cacf72cc9378 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:33.797995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a54ea34-9633-45ac-a908-cacf72cc9378 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:33.921916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c5e6a0f6-356a-4056-b21d-050996fb1f3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:33.933276 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c5e6a0f6-356a-4056-b21d-050996fb1f3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1313 microversion: 2.1 time: 0.606313 Oct 12 22:03:33.949052 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 618/1171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:33 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1313 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:33.949052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-036e79e9-d3ac-445d-b073-af29a5a63903 req-bdfac1b6-a093-4f40-b93a-9e18dced437c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "247e0252-3374-40b8-85f3-995d2031867d", "tag": "319c47c2-57cf-461d-8a9e-adf8c461cb1d"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:33.967559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-036e79e9-d3ac-445d-b073-af29a5a63903 req-bdfac1b6-a093-4f40-b93a-9e18dced437c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:33.968031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-036e79e9-d3ac-445d-b073-af29a5a63903 req-bdfac1b6-a093-4f40-b93a-9e18dced437c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:33.969051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-036e79e9-d3ac-445d-b073-af29a5a63903 req-bdfac1b6-a093-4f40-b93a-9e18dced437c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:33.992725 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-036e79e9-d3ac-445d-b073-af29a5a63903 req-bdfac1b6-a093-4f40-b93a-9e18dced437c service nova] Creating event network-changed:319c47c2-57cf-461d-8a9e-adf8c461cb1d for instance 247e0252-3374-40b8-85f3-995d2031867d on n-h1-861111-1 Oct 12 22:03:33.998000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3a54ea34-9633-45ac-a908-cacf72cc9378 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:34.003415 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-036e79e9-d3ac-445d-b073-af29a5a63903 req-bdfac1b6-a093-4f40-b93a-9e18dced437c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064641 Oct 12 22:03:34.006901 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 619/1172] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:34.007824 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3a54ea34-9633-45ac-a908-cacf72cc9378 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.253019 Oct 12 22:03:34.011196 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 554/1173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:33 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:34.024120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f9f37a48-348d-4e69-96bc-9c258a52c11e tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Calling method '.version_select at 0x7f5128303790>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:34.123143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-591062fb-518b-465c-b1c0-975b16232715 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128722af0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:34.187400 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-591062fb-518b-465c-b1c0-975b16232715 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad" status: 200 len: 1412 microversion: 2.1 time: 0.068784 Oct 12 22:03:34.189408 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 555/1174] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:34 2022] GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad => generated 1412 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:34.432406 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f9f37a48-348d-4e69-96bc-9c258a52c11e tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/af225fbf51134fed96fbb5ef019e39f3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.424170 Oct 12 22:03:34.435597 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 620/1175] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 12 22:03:34 2022] GET /compute/v2.1/os-quota-sets/af225fbf51134fed96fbb5ef019e39f3/defaults => generated 371 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:34.447910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ddc707db-bc99-4f3a-a1ea-7f6939345a70 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Action: 'update', calling method: .version_select at 0x7f51287445e0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:34.534658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddc707db-bc99-4f3a-a1ea-7f6939345a70 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:34.535280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddc707db-bc99-4f3a-a1ea-7f6939345a70 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:34.536045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddc707db-bc99-4f3a-a1ea-7f6939345a70 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:34.536884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddc707db-bc99-4f3a-a1ea-7f6939345a70 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:34.537663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddc707db-bc99-4f3a-a1ea-7f6939345a70 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:34.538198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddc707db-bc99-4f3a-a1ea-7f6939345a70 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:34.639272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:34.766362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2516185c-c339-42cf-a87f-169dc26c7fdf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51286fc5e0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:34.822243 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ddc707db-bc99-4f3a-a1ea-7f6939345a70 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/af225fbf51134fed96fbb5ef019e39f3" status: 200 len: 329 microversion: 2.1 time: 0.378300 Oct 12 22:03:34.830870 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 556/1176] 10.222.0.16 () {60 vars in 1263 bytes} [Wed Oct 12 22:03:34 2022] PUT /compute/v2.1/os-quota-sets/af225fbf51134fed96fbb5ef019e39f3 => generated 329 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:34.836268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a892cb7d-e8ae-4b3d-90a8-9493286c2925 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Action: 'update', calling method: .version_select at 0x7f51286ed550>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:34.843748 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2516185c-c339-42cf-a87f-169dc26c7fdf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5" status: 200 len: 1452 microversion: 2.1 time: 0.081602 Oct 12 22:03:34.844957 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 621/1177] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:34 2022] GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5 => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:34.926360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a892cb7d-e8ae-4b3d-90a8-9493286c2925 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:34.926940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a892cb7d-e8ae-4b3d-90a8-9493286c2925 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:34.927496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a892cb7d-e8ae-4b3d-90a8-9493286c2925 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:34.928287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a892cb7d-e8ae-4b3d-90a8-9493286c2925 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:34.928806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a892cb7d-e8ae-4b3d-90a8-9493286c2925 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:34.929302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a892cb7d-e8ae-4b3d-90a8-9493286c2925 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:34.957346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fef9217e-39cd-42f3-b187-4e69699a5c6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:34.958087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fef9217e-39cd-42f3-b187-4e69699a5c6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:34.983403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fef9217e-39cd-42f3-b187-4e69699a5c6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:34.984242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fef9217e-39cd-42f3-b187-4e69699a5c6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:34.986586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fef9217e-39cd-42f3-b187-4e69699a5c6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:34.989971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fef9217e-39cd-42f3-b187-4e69699a5c6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:34.990896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fef9217e-39cd-42f3-b187-4e69699a5c6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:34.993067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fef9217e-39cd-42f3-b187-4e69699a5c6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:35.243207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fef9217e-39cd-42f3-b187-4e69699a5c6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:35.254457 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fef9217e-39cd-42f3-b187-4e69699a5c6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1313 microversion: 2.1 time: 0.301628 Oct 12 22:03:35.264779 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 622/1178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:34 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:35.278931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a60a08f2-8a1a-44b0-84c1-9b8fbba4137e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:35.279582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a60a08f2-8a1a-44b0-84c1-9b8fbba4137e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:35.300822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a60a08f2-8a1a-44b0-84c1-9b8fbba4137e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:35.301429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a60a08f2-8a1a-44b0-84c1-9b8fbba4137e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:35.301890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a60a08f2-8a1a-44b0-84c1-9b8fbba4137e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:35.302645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a60a08f2-8a1a-44b0-84c1-9b8fbba4137e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:35.303104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a60a08f2-8a1a-44b0-84c1-9b8fbba4137e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:35.304146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a60a08f2-8a1a-44b0-84c1-9b8fbba4137e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:35.473672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a60a08f2-8a1a-44b0-84c1-9b8fbba4137e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:35.484074 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a60a08f2-8a1a-44b0-84c1-9b8fbba4137e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.217356 Oct 12 22:03:35.484697 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 623/1179] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:35 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:35.503018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2b50c708-8998-4f39-acf5-5e39a7f2d6a5 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51283128b0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:35.523146 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a892cb7d-e8ae-4b3d-90a8-9493286c2925 tempest-QuotasAdminTestJSON-2022325337 tempest-QuotasAdminTestJSON-2022325337-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/af225fbf51134fed96fbb5ef019e39f3" status: 200 len: 329 microversion: 2.1 time: 0.691033 Oct 12 22:03:35.527690 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 557/1180] 10.222.0.16 () {60 vars in 1263 bytes} [Wed Oct 12 22:03:34 2022] PUT /compute/v2.1/os-quota-sets/af225fbf51134fed96fbb5ef019e39f3 => generated 329 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:35.590841 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2b50c708-8998-4f39-acf5-5e39a7f2d6a5 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad" status: 200 len: 1412 microversion: 2.1 time: 0.102401 Oct 12 22:03:35.592505 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 624/1181] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:35 2022] GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:35.606326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-1d51f11a-b28c-4a17-bde8-61e32b522178 req-d1ab6675-ff21-4d83-888f-f4688650ced8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d4b3e47-bbd0-4adc-9173-d7f9ccd96221", "name": "network-vif-plugged", "status": "completed", "tag": "6ec98f33-ae19-4190-819a-9fe3d4ca011c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:35.619807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1d51f11a-b28c-4a17-bde8-61e32b522178 req-d1ab6675-ff21-4d83-888f-f4688650ced8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:35.620546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1d51f11a-b28c-4a17-bde8-61e32b522178 req-d1ab6675-ff21-4d83-888f-f4688650ced8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:35.621029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1d51f11a-b28c-4a17-bde8-61e32b522178 req-d1ab6675-ff21-4d83-888f-f4688650ced8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:35.645081 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-1d51f11a-b28c-4a17-bde8-61e32b522178 req-d1ab6675-ff21-4d83-888f-f4688650ced8 service nova] Creating event network-vif-plugged:6ec98f33-ae19-4190-819a-9fe3d4ca011c for instance 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 on n-h1-861111-1 Oct 12 22:03:35.654434 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-1d51f11a-b28c-4a17-bde8-61e32b522178 req-d1ab6675-ff21-4d83-888f-f4688650ced8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052256 Oct 12 22:03:35.655936 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 558/1182] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:35.859581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a1d0a300-94f5-4543-a046-45f0ccb98b69 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128312940>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:35.948194 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a1d0a300-94f5-4543-a046-45f0ccb98b69 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5" status: 200 len: 1452 microversion: 2.1 time: 0.092661 Oct 12 22:03:35.949739 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 625/1183] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:35 2022] GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5 => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:36.279897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b9907ca8-42f5-4b13-93bd-fb621b8f51e9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:36.280813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b9907ca8-42f5-4b13-93bd-fb621b8f51e9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:36.294944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9907ca8-42f5-4b13-93bd-fb621b8f51e9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:36.295509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9907ca8-42f5-4b13-93bd-fb621b8f51e9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:36.296062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9907ca8-42f5-4b13-93bd-fb621b8f51e9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:36.298251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9907ca8-42f5-4b13-93bd-fb621b8f51e9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:36.299014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9907ca8-42f5-4b13-93bd-fb621b8f51e9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:36.300411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9907ca8-42f5-4b13-93bd-fb621b8f51e9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:36.514220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-251e83df-b088-44f6-a57e-9bd28a1aea0b tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:36.515168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-251e83df-b088-44f6-a57e-9bd28a1aea0b tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:36.537124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-251e83df-b088-44f6-a57e-9bd28a1aea0b tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:36.538940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-251e83df-b088-44f6-a57e-9bd28a1aea0b tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:36.539810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-251e83df-b088-44f6-a57e-9bd28a1aea0b tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:36.541408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-251e83df-b088-44f6-a57e-9bd28a1aea0b tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:36.542093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-251e83df-b088-44f6-a57e-9bd28a1aea0b tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:36.542791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-251e83df-b088-44f6-a57e-9bd28a1aea0b tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:36.570994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b9907ca8-42f5-4b13-93bd-fb621b8f51e9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:36.594915 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b9907ca8-42f5-4b13-93bd-fb621b8f51e9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1313 microversion: 2.1 time: 0.318163 Oct 12 22:03:36.595652 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 559/1184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:36 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:36.624948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5cfda0d4-0f33-4061-af77-164c5203b916 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51287441f0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:36.745690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-251e83df-b088-44f6-a57e-9bd28a1aea0b tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:36.785951 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-251e83df-b088-44f6-a57e-9bd28a1aea0b tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.278380 Oct 12 22:03:36.788718 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 626/1185] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:36 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:36.919018 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5cfda0d4-0f33-4061-af77-164c5203b916 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad" status: 200 len: 1412 microversion: 2.1 time: 0.303089 Oct 12 22:03:36.927980 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 560/1186] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:36 2022] GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad => generated 1412 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:36.968068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4bd5fc92-c1ba-4ff3-a26e-86b9f618e107 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51282e6ee0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:37.623880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a4e7ea6e-da39-4fa1-9a1a-0577afaf0917 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:37.624904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a4e7ea6e-da39-4fa1-9a1a-0577afaf0917 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:37.634969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4e7ea6e-da39-4fa1-9a1a-0577afaf0917 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:37.645054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4e7ea6e-da39-4fa1-9a1a-0577afaf0917 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:37.647301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4e7ea6e-da39-4fa1-9a1a-0577afaf0917 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:37.650453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4e7ea6e-da39-4fa1-9a1a-0577afaf0917 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:37.660786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4e7ea6e-da39-4fa1-9a1a-0577afaf0917 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:37.661516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4e7ea6e-da39-4fa1-9a1a-0577afaf0917 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:38.047531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a4e7ea6e-da39-4fa1-9a1a-0577afaf0917 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:38.082764 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a4e7ea6e-da39-4fa1-9a1a-0577afaf0917 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1313 microversion: 2.1 time: 0.464108 Oct 12 22:03:38.096316 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 561/1187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:37 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:38.113223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b9a879c1-f72f-42bd-9cd4-90b99b58fd25 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:38.114249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b9a879c1-f72f-42bd-9cd4-90b99b58fd25 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:38.130645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9a879c1-f72f-42bd-9cd4-90b99b58fd25 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:38.132044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9a879c1-f72f-42bd-9cd4-90b99b58fd25 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:38.133110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9a879c1-f72f-42bd-9cd4-90b99b58fd25 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:38.134650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9a879c1-f72f-42bd-9cd4-90b99b58fd25 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:38.135681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9a879c1-f72f-42bd-9cd4-90b99b58fd25 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:38.136840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9a879c1-f72f-42bd-9cd4-90b99b58fd25 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:38.428465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b9a879c1-f72f-42bd-9cd4-90b99b58fd25 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:38.446848 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b9a879c1-f72f-42bd-9cd4-90b99b58fd25 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.348581 Oct 12 22:03:38.447493 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 562/1188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:38 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:38.485615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ab0724b0-82bc-4594-bc0b-47dae8ff9fb2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51286ed550>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:42.865695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=11 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:42.924299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=36 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:44.941892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:45.507562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=86 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:46.231153 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4bd5fc92-c1ba-4ff3-a26e-86b9f618e107 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5" status: 200 len: 1452 microversion: 2.1 time: 9.270218 Oct 12 22:03:46.233752 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 627/1189] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:36 2022] GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5 => generated 1452 bytes in 9274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:46.239423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-551d8212-800f-4011-9172-d2470b6c3efe tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:46.240040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-551d8212-800f-4011-9172-d2470b6c3efe tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:46.240431 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ab0724b0-82bc-4594-bc0b-47dae8ff9fb2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad" status: 200 len: 1421 microversion: 2.1 time: 7.762784 Oct 12 22:03:46.241272 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 563/1190] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:38 2022] GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad => generated 1421 bytes in 7793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:46.246757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-551d8212-800f-4011-9172-d2470b6c3efe tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:46.247271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-551d8212-800f-4011-9172-d2470b6c3efe tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:46.247727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-551d8212-800f-4011-9172-d2470b6c3efe tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:46.248593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-551d8212-800f-4011-9172-d2470b6c3efe tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:46.249190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-551d8212-800f-4011-9172-d2470b6c3efe tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:46.249826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-551d8212-800f-4011-9172-d2470b6c3efe tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:46.250766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-3c009423-2a43-44b7-bb7d-0c19f10ed0cb req-1f9a23e3-ed7a-4c69-a3e1-e0be3bab706e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48128c05-1d65-46fb-accf-2dd2981a742b", "name": "network-vif-plugged", "status": "completed", "tag": "51d433b5-9d81-423f-86a9-27412dea934c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:46.266065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=23,nova_api:UPDATE=14 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:46.269047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3c009423-2a43-44b7-bb7d-0c19f10ed0cb req-1f9a23e3-ed7a-4c69-a3e1-e0be3bab706e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:46.269529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3c009423-2a43-44b7-bb7d-0c19f10ed0cb req-1f9a23e3-ed7a-4c69-a3e1-e0be3bab706e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:46.269961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3c009423-2a43-44b7-bb7d-0c19f10ed0cb req-1f9a23e3-ed7a-4c69-a3e1-e0be3bab706e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:46.285192 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-3c009423-2a43-44b7-bb7d-0c19f10ed0cb req-1f9a23e3-ed7a-4c69-a3e1-e0be3bab706e service nova] Creating event network-vif-plugged:51d433b5-9d81-423f-86a9-27412dea934c for instance 48128c05-1d65-46fb-accf-2dd2981a742b on n-h1-861111-1 Oct 12 22:03:46.291692 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-3c009423-2a43-44b7-bb7d-0c19f10ed0cb req-1f9a23e3-ed7a-4c69-a3e1-e0be3bab706e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049041 Oct 12 22:03:46.292828 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 564/1191] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:46.300939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bbe31d7d-96c3-4b0d-8af2-4709f234013a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:46.302011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bbe31d7d-96c3-4b0d-8af2-4709f234013a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:46.308768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbe31d7d-96c3-4b0d-8af2-4709f234013a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:46.309477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbe31d7d-96c3-4b0d-8af2-4709f234013a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:46.310075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbe31d7d-96c3-4b0d-8af2-4709f234013a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:46.310771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbe31d7d-96c3-4b0d-8af2-4709f234013a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:46.311418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbe31d7d-96c3-4b0d-8af2-4709f234013a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:46.312001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbe31d7d-96c3-4b0d-8af2-4709f234013a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:46.406878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-551d8212-800f-4011-9172-d2470b6c3efe tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:46.415029 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-551d8212-800f-4011-9172-d2470b6c3efe tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1313 microversion: 2.1 time: 0.180275 Oct 12 22:03:46.418510 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 628/1192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:46 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:46.423353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-346e94fe-310f-4f9b-bc5d-751b69c8bbbe tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:46.432285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-346e94fe-310f-4f9b-bc5d-751b69c8bbbe tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:46.451465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-346e94fe-310f-4f9b-bc5d-751b69c8bbbe tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:46.452126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-346e94fe-310f-4f9b-bc5d-751b69c8bbbe tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:46.452812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-346e94fe-310f-4f9b-bc5d-751b69c8bbbe tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:46.453760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-346e94fe-310f-4f9b-bc5d-751b69c8bbbe tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:46.454316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-346e94fe-310f-4f9b-bc5d-751b69c8bbbe tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:46.454846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-346e94fe-310f-4f9b-bc5d-751b69c8bbbe tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:46.499924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bbe31d7d-96c3-4b0d-8af2-4709f234013a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:46.508728 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bbe31d7d-96c3-4b0d-8af2-4709f234013a tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.211770 Oct 12 22:03:46.509621 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 565/1193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:46 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:46.647187 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-346e94fe-310f-4f9b-bc5d-751b69c8bbbe tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1812 microversion: 2.1 time: 0.225505 Oct 12 22:03:46.647964 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 629/1194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:46 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1812 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:46.655093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d14cc9eb-218b-4ca5-a804-dab6507f9715 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "004eb58b-998a-49a7-9a4d-e5e74b862b36"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:46.665093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d14cc9eb-218b-4ca5-a804-dab6507f9715 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:46.677304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d14cc9eb-218b-4ca5-a804-dab6507f9715 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:46.677986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d14cc9eb-218b-4ca5-a804-dab6507f9715 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:46.678630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d14cc9eb-218b-4ca5-a804-dab6507f9715 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:46.679733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d14cc9eb-218b-4ca5-a804-dab6507f9715 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:46.681143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d14cc9eb-218b-4ca5-a804-dab6507f9715 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:46.681782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d14cc9eb-218b-4ca5-a804-dab6507f9715 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:46.692053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b2025fe4-5228-475a-a327-aa37d9394f54 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1100623846", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": "none"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:46.781630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b2025fe4-5228-475a-a327-aa37d9394f54 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:03:46.782138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b2025fe4-5228-475a-a327-aa37d9394f54 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:03:46.782620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b2025fe4-5228-475a-a327-aa37d9394f54 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:03:46.783035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b2025fe4-5228-475a-a327-aa37d9394f54 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:03:46.783491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b2025fe4-5228-475a-a327-aa37d9394f54 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:03:46.802140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2025fe4-5228-475a-a327-aa37d9394f54 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:46.802698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2025fe4-5228-475a-a327-aa37d9394f54 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:46.803147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2025fe4-5228-475a-a327-aa37d9394f54 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:46.803909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2025fe4-5228-475a-a327-aa37d9394f54 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:46.804365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2025fe4-5228-475a-a327-aa37d9394f54 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:46.804922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2025fe4-5228-475a-a327-aa37d9394f54 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:46.826320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-b2025fe4-5228-475a-a327-aa37d9394f54 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Getting quotas for project e3ba376928ba479ea6877d929da0010f. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:03:46.831580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-b2025fe4-5228-475a-a327-aa37d9394f54 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Getting quotas for user f3c07d95f55d4146bef62c66263df813 and project e3ba376928ba479ea6877d929da0010f. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:03:46.846566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b2025fe4-5228-475a-a327-aa37d9394f54 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:03:46.849154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b2025fe4-5228-475a-a327-aa37d9394f54 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:03:46.906396 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b2025fe4-5228-475a-a327-aa37d9394f54 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.395268 Oct 12 22:03:46.907891 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 566/1195] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 22:03:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 397 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:03:46.913121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f8ad6e12-52e0-4464-98a2-8d74e358454b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128722e50>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:46.985440 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f8ad6e12-52e0-4464-98a2-8d74e358454b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad" status: 200 len: 1421 microversion: 2.1 time: 0.076349 Oct 12 22:03:46.986006 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 567/1196] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:46 2022] GET /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad => generated 1421 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:46.994306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8970e280-d3f9-43f2-801e-253ddd9e950c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:47.001884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8970e280-d3f9-43f2-801e-253ddd9e950c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:47.006062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8970e280-d3f9-43f2-801e-253ddd9e950c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:47.007353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8970e280-d3f9-43f2-801e-253ddd9e950c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:47.008881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8970e280-d3f9-43f2-801e-253ddd9e950c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:47.009353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8970e280-d3f9-43f2-801e-253ddd9e950c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:47.009777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8970e280-d3f9-43f2-801e-253ddd9e950c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:47.040807 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8970e280-d3f9-43f2-801e-253ddd9e950c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.051637 Oct 12 22:03:47.041433 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 568/1197] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 12 22:03:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:47.053834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7b451dbe-bfc1-4913-9db9-54b6cd9bf371 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:47.056331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7b451dbe-bfc1-4913-9db9-54b6cd9bf371 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:47.144891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7b451dbe-bfc1-4913-9db9-54b6cd9bf371 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:47.154486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7b451dbe-bfc1-4913-9db9-54b6cd9bf371 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:47.156241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7b451dbe-bfc1-4913-9db9-54b6cd9bf371 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:47.165661 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7b451dbe-bfc1-4913-9db9-54b6cd9bf371 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "PUT /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1359 microversion: 2.75 time: 0.115640 Oct 12 22:03:47.166405 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 569/1198] 10.222.0.16 () {62 vars in 1297 bytes} [Wed Oct 12 22:03:47 2022] PUT /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1359 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:47.172952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4b5cff7e-2f43-4477-8055-68c6136684b0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128722160>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:47.194396 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d14cc9eb-218b-4ca5-a804-dab6507f9715 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "POST /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.544702 Oct 12 22:03:47.197062 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 630/1199] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 22:03:46 2022] POST /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments => generated 194 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:47.230286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4cd7761c-f687-46a5-8ae7-0409bef612f1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:47.234296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4cd7761c-f687-46a5-8ae7-0409bef612f1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:47.346127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4cd7761c-f687-46a5-8ae7-0409bef612f1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:47.355116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4cd7761c-f687-46a5-8ae7-0409bef612f1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:47.356982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4cd7761c-f687-46a5-8ae7-0409bef612f1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:47.372303 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4cd7761c-f687-46a5-8ae7-0409bef612f1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1359 microversion: 2.75 time: 0.173722 Oct 12 22:03:47.373948 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 631/1200] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:47 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:47.381094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3f163a96-3913-4a75-8bd2-313269c43533 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512c58b5e0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:48.519101 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4b5cff7e-2f43-4477-8055-68c6136684b0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad" status: 204 len: 0 microversion: 2.1 time: 1.351222 Oct 12 22:03:48.525877 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 570/1201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:47 2022] DELETE /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad => generated 0 bytes in 1354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:03:48.534832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7ebe4e31-4c46-4d59-a34c-31a0e95229f3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:48.536111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7ebe4e31-4c46-4d59-a34c-31a0e95229f3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:48.555716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ebe4e31-4c46-4d59-a34c-31a0e95229f3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:48.556408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ebe4e31-4c46-4d59-a34c-31a0e95229f3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:48.559752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ebe4e31-4c46-4d59-a34c-31a0e95229f3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:48.560651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ebe4e31-4c46-4d59-a34c-31a0e95229f3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:48.562469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ebe4e31-4c46-4d59-a34c-31a0e95229f3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:48.565862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ebe4e31-4c46-4d59-a34c-31a0e95229f3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:48.574234 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3f163a96-3913-4a75-8bd2-313269c43533 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5" status: 200 len: 1452 microversion: 2.1 time: 1.198094 Oct 12 22:03:48.574840 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 632/1202] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:47 2022] GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5 => generated 1452 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:48.596856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f51653bc-3e3a-485e-bc0e-faa07c917edc tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:48.600030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f51653bc-3e3a-485e-bc0e-faa07c917edc tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:48.610759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f51653bc-3e3a-485e-bc0e-faa07c917edc tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:48.611198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f51653bc-3e3a-485e-bc0e-faa07c917edc tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:48.611670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f51653bc-3e3a-485e-bc0e-faa07c917edc tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:48.612379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f51653bc-3e3a-485e-bc0e-faa07c917edc tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:48.612841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f51653bc-3e3a-485e-bc0e-faa07c917edc tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:48.613269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f51653bc-3e3a-485e-bc0e-faa07c917edc tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:48.871064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f51653bc-3e3a-485e-bc0e-faa07c917edc tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:48.871285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7ebe4e31-4c46-4d59-a34c-31a0e95229f3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:48.881789 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f51653bc-3e3a-485e-bc0e-faa07c917edc tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.288635 Oct 12 22:03:48.883794 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 633/1203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:48 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:48.884353 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7ebe4e31-4c46-4d59-a34c-31a0e95229f3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1463 microversion: 2.1 time: 0.356429 Oct 12 22:03:48.885190 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 571/1204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:48 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1463 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:48.894110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ea1f640b-ce1e-4f3a-be51-947f82355c47 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:48.896136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ea1f640b-ce1e-4f3a-be51-947f82355c47 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:48.900764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-951e2497-8324-4369-a517-0a26c2f4b176 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:48.901547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-951e2497-8324-4369-a517-0a26c2f4b176 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:48.908645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea1f640b-ce1e-4f3a-be51-947f82355c47 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:48.911889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea1f640b-ce1e-4f3a-be51-947f82355c47 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:48.912315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-951e2497-8324-4369-a517-0a26c2f4b176 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:48.912446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea1f640b-ce1e-4f3a-be51-947f82355c47 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:48.913095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-951e2497-8324-4369-a517-0a26c2f4b176 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:48.913240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea1f640b-ce1e-4f3a-be51-947f82355c47 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:48.913586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea1f640b-ce1e-4f3a-be51-947f82355c47 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:48.913995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-951e2497-8324-4369-a517-0a26c2f4b176 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:48.914125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea1f640b-ce1e-4f3a-be51-947f82355c47 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:48.915009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-951e2497-8324-4369-a517-0a26c2f4b176 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:48.915763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-951e2497-8324-4369-a517-0a26c2f4b176 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:48.916377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-951e2497-8324-4369-a517-0a26c2f4b176 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:48.945172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-951e2497-8324-4369-a517-0a26c2f4b176 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:03:49.012615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:49.080650 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-951e2497-8324-4369-a517-0a26c2f4b176 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 204 len: 0 microversion: 2.1 time: 0.192410 Oct 12 22:03:49.081254 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 634/1205] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:03:48 2022] DELETE /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:03:49.081962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ea1f640b-ce1e-4f3a-be51-947f82355c47 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:49.092426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bf064504-15e0-4947-bb0a-250ccad92877 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:49.112132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ea1f640b-ce1e-4f3a-be51-947f82355c47 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:49.114012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ea1f640b-ce1e-4f3a-be51-947f82355c47 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:49.121559 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ea1f640b-ce1e-4f3a-be51-947f82355c47 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1411 microversion: 2.75 time: 0.234462 Oct 12 22:03:49.122345 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 572/1206] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:48 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1411 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:49.136713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bf064504-15e0-4947-bb0a-250ccad92877 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:49.142983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf064504-15e0-4947-bb0a-250ccad92877 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:49.146032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf064504-15e0-4947-bb0a-250ccad92877 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:49.146489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf064504-15e0-4947-bb0a-250ccad92877 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:49.147533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf064504-15e0-4947-bb0a-250ccad92877 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:49.148872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf064504-15e0-4947-bb0a-250ccad92877 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:49.150067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf064504-15e0-4947-bb0a-250ccad92877 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:49.270057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bf064504-15e0-4947-bb0a-250ccad92877 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:49.279430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bf064504-15e0-4947-bb0a-250ccad92877 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Old instance type m1.heat2, new instance type m1.heat {{(pid=120453) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:03:49.289954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-bf064504-15e0-4947-bb0a-250ccad92877 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:03:49.290379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-bf064504-15e0-4947-bb0a-250ccad92877 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:03:49.291034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-bf064504-15e0-4947-bb0a-250ccad92877 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:03:49.291530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-bf064504-15e0-4947-bb0a-250ccad92877 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:03:49.291954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-bf064504-15e0-4947-bb0a-250ccad92877 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:03:49.297021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1711393630", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "1bfd60f2-0202-40db-8761-3b71d02412dc"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:49.367222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] validate_networks() for [('1bfd60f2-0202-40db-8761-3b71d02412dc', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:03:49.448979 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bf064504-15e0-4947-bb0a-250ccad92877 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "POST /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b/action" status: 202 len: 0 microversion: 2.1 time: 0.362615 Oct 12 22:03:49.450614 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 635/1207] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:03:49 2022] POST /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:03:49.458690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ecb97426-ff58-4cc7-80b3-9caa808950a7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:49.459629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ecb97426-ff58-4cc7-80b3-9caa808950a7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:49.468281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecb97426-ff58-4cc7-80b3-9caa808950a7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:49.468998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecb97426-ff58-4cc7-80b3-9caa808950a7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:49.469638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecb97426-ff58-4cc7-80b3-9caa808950a7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:49.470527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecb97426-ff58-4cc7-80b3-9caa808950a7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:49.471664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecb97426-ff58-4cc7-80b3-9caa808950a7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:49.472256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecb97426-ff58-4cc7-80b3-9caa808950a7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:49.621034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ecb97426-ff58-4cc7-80b3-9caa808950a7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:49.631751 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ecb97426-ff58-4cc7-80b3-9caa808950a7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1472 microversion: 2.1 time: 0.177228 Oct 12 22:03:49.632787 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 636/1208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:49 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1472 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:49.655065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-653b9d26-a44a-4aca-9134-186007289f2c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512c583dc0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:49.713810 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-653b9d26-a44a-4aca-9134-186007289f2c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5" status: 200 len: 1461 microversion: 2.1 time: 0.064902 Oct 12 22:03:49.714985 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 637/1209] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:49 2022] GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5 => generated 1461 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:49.732374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-75c999d4-16e4-485f-bbaa-0385d0b15568 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51282a4dc0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:49.810597 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-75c999d4-16e4-485f-bbaa-0385d0b15568 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5" status: 200 len: 1461 microversion: 2.1 time: 0.086076 Oct 12 22:03:49.814701 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 638/1210] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:49 2022] GET /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5 => generated 1461 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:49.832283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-335083cc-d0dd-464d-a863-a81a1e6af9de tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:49.833271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-335083cc-d0dd-464d-a863-a81a1e6af9de tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: cf71b2a6-484b-4e05-80fb-89be6b98546a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:49.844272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-335083cc-d0dd-464d-a863-a81a1e6af9de tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:49.845473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-335083cc-d0dd-464d-a863-a81a1e6af9de tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:49.847545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-335083cc-d0dd-464d-a863-a81a1e6af9de tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:49.848791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-335083cc-d0dd-464d-a863-a81a1e6af9de tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:49.850501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-335083cc-d0dd-464d-a863-a81a1e6af9de tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:49.854384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-335083cc-d0dd-464d-a863-a81a1e6af9de tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:49.996140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:03:49.996755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:03:49.997032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:03:49.997619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:03:49.998058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:03:50.007680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:50.008169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:50.008607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:50.009339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:50.009926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:50.010377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:50.019890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:50.033621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Getting quotas for project 0905a1286e134e34a55ceaaa6c23718e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:03:50.039312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Getting quotas for user 7224dcaeabdd4199b9682e99912f7740 and project 0905a1286e134e34a55ceaaa6c23718e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:03:50.052040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-335083cc-d0dd-464d-a863-a81a1e6af9de tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:50.054000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:03:50.057131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:03:50.061733 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-335083cc-d0dd-464d-a863-a81a1e6af9de tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a" status: 200 len: 1480 microversion: 2.1 time: 0.236015 Oct 12 22:03:50.062839 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 639/1211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:49 2022] GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a => generated 1480 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:50.067625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-46a5c02b-b97d-45d6-a6ce-008e27dffbd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdcc2a17-ec8b-40a7-87ae-d3442afa562c", "device": "/dev/xvdb"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:50.070783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-46a5c02b-b97d-45d6-a6ce-008e27dffbd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:50.078221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46a5c02b-b97d-45d6-a6ce-008e27dffbd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:50.078806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46a5c02b-b97d-45d6-a6ce-008e27dffbd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:50.079342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46a5c02b-b97d-45d6-a6ce-008e27dffbd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:50.080193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46a5c02b-b97d-45d6-a6ce-008e27dffbd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:50.080864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46a5c02b-b97d-45d6-a6ce-008e27dffbd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:50.081509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46a5c02b-b97d-45d6-a6ce-008e27dffbd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:50.141968 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a269b90b-1c88-4695-acc5-f234f4a66d7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.849236 Oct 12 22:03:50.145041 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 573/1212] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:03:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:03:50.151672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d47dbbb0-fd1d-4390-8912-dc6cf31c4aa2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:50.156203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d47dbbb0-fd1d-4390-8912-dc6cf31c4aa2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:50.165699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d47dbbb0-fd1d-4390-8912-dc6cf31c4aa2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:50.166468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d47dbbb0-fd1d-4390-8912-dc6cf31c4aa2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:50.168664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d47dbbb0-fd1d-4390-8912-dc6cf31c4aa2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:50.169567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d47dbbb0-fd1d-4390-8912-dc6cf31c4aa2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:50.170116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d47dbbb0-fd1d-4390-8912-dc6cf31c4aa2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:50.170754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d47dbbb0-fd1d-4390-8912-dc6cf31c4aa2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:50.352227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d47dbbb0-fd1d-4390-8912-dc6cf31c4aa2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:50.361650 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d47dbbb0-fd1d-4390-8912-dc6cf31c4aa2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1486 microversion: 2.1 time: 0.215378 Oct 12 22:03:50.365465 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 574/1213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:50 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1486 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:50.376827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-93374111-38be-4fcd-b5da-a018ed2f2735 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:50.377465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-93374111-38be-4fcd-b5da-a018ed2f2735 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:50.453260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-93374111-38be-4fcd-b5da-a018ed2f2735 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:50.462004 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-93374111-38be-4fcd-b5da-a018ed2f2735 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8" status: 200 len: 1208 microversion: 2.1 time: 0.093360 Oct 12 22:03:50.464403 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 575/1214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:50 2022] GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 => generated 1208 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:50.472030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-614166df-d227-456d-9c13-18056f8feef6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:50.472675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-614166df-d227-456d-9c13-18056f8feef6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:50.480777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-614166df-d227-456d-9c13-18056f8feef6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:50.481378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-614166df-d227-456d-9c13-18056f8feef6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:50.481821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-614166df-d227-456d-9c13-18056f8feef6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:50.484021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-614166df-d227-456d-9c13-18056f8feef6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:50.484653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-614166df-d227-456d-9c13-18056f8feef6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:50.485322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-614166df-d227-456d-9c13-18056f8feef6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:50.625710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-614166df-d227-456d-9c13-18056f8feef6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:50.642346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-614166df-d227-456d-9c13-18056f8feef6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:50.644009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-614166df-d227-456d-9c13-18056f8feef6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:50.665218 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-614166df-d227-456d-9c13-18056f8feef6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1411 microversion: 2.75 time: 0.197584 Oct 12 22:03:50.667740 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 576/1215] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:50 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1411 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:50.676979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-38e5f68e-000a-4634-9358-aa5e2a3fa2f8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:50.679654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-38e5f68e-000a-4634-9358-aa5e2a3fa2f8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:50.695714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38e5f68e-000a-4634-9358-aa5e2a3fa2f8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:50.696507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38e5f68e-000a-4634-9358-aa5e2a3fa2f8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:50.697737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38e5f68e-000a-4634-9358-aa5e2a3fa2f8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:50.700282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38e5f68e-000a-4634-9358-aa5e2a3fa2f8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:50.702539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38e5f68e-000a-4634-9358-aa5e2a3fa2f8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:50.708509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38e5f68e-000a-4634-9358-aa5e2a3fa2f8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:50.862180 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-38e5f68e-000a-4634-9358-aa5e2a3fa2f8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "POST /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9/action" status: 202 len: 0 microversion: 2.1 time: 0.192782 Oct 12 22:03:50.863022 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 577/1216] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:03:50 2022] POST /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:03:50.879714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2194591c-ec3f-4d89-992f-ef67186db58e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:50.880683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2194591c-ec3f-4d89-992f-ef67186db58e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:50.893561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2194591c-ec3f-4d89-992f-ef67186db58e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:50.894219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2194591c-ec3f-4d89-992f-ef67186db58e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:50.894673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2194591c-ec3f-4d89-992f-ef67186db58e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:50.895639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2194591c-ec3f-4d89-992f-ef67186db58e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:50.896103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2194591c-ec3f-4d89-992f-ef67186db58e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:50.896537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2194591c-ec3f-4d89-992f-ef67186db58e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:51.164264 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-46a5c02b-b97d-45d6-a6ce-008e27dffbd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "POST /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.099998 Oct 12 22:03:51.171635 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 640/1217] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 22:03:50 2022] POST /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments => generated 194 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:51.186169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d21198a5-edfe-4879-8126-e856aec79d34 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:51.188126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d21198a5-edfe-4879-8126-e856aec79d34 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:51.202900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d21198a5-edfe-4879-8126-e856aec79d34 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:51.215222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d21198a5-edfe-4879-8126-e856aec79d34 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:51.221310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d21198a5-edfe-4879-8126-e856aec79d34 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:51.222177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d21198a5-edfe-4879-8126-e856aec79d34 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:51.222910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d21198a5-edfe-4879-8126-e856aec79d34 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:51.223613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d21198a5-edfe-4879-8126-e856aec79d34 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:51.299674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2194591c-ec3f-4d89-992f-ef67186db58e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:51.313298 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2194591c-ec3f-4d89-992f-ef67186db58e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1472 microversion: 2.1 time: 0.446720 Oct 12 22:03:51.315365 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 578/1218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:50 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1472 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:51.322597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a227c4eb-b94c-41ec-ad7a-53b9cea4490f tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:51.324498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a227c4eb-b94c-41ec-ad7a-53b9cea4490f tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: cf71b2a6-484b-4e05-80fb-89be6b98546a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:51.334435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a227c4eb-b94c-41ec-ad7a-53b9cea4490f tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:51.336467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a227c4eb-b94c-41ec-ad7a-53b9cea4490f tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:51.337165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a227c4eb-b94c-41ec-ad7a-53b9cea4490f tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:51.338125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a227c4eb-b94c-41ec-ad7a-53b9cea4490f tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:51.338762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a227c4eb-b94c-41ec-ad7a-53b9cea4490f tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:51.339791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a227c4eb-b94c-41ec-ad7a-53b9cea4490f tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:51.485715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d21198a5-edfe-4879-8126-e856aec79d34 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:51.494176 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d21198a5-edfe-4879-8126-e856aec79d34 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1494 microversion: 2.1 time: 0.321147 Oct 12 22:03:51.519092 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 641/1219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:51 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1494 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:51.529620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-9522a152-4c27-44d5-b7a5-dbeb998413f0 req-0784369d-46b3-486f-ae34-eb36ad3318e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d4b3e47-bbd0-4adc-9173-d7f9ccd96221", "name": "network-vif-unplugged", "status": "completed", "tag": "6ec98f33-ae19-4190-819a-9fe3d4ca011c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:51.545136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9522a152-4c27-44d5-b7a5-dbeb998413f0 req-0784369d-46b3-486f-ae34-eb36ad3318e8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:51.545959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9522a152-4c27-44d5-b7a5-dbeb998413f0 req-0784369d-46b3-486f-ae34-eb36ad3318e8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:51.546450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9522a152-4c27-44d5-b7a5-dbeb998413f0 req-0784369d-46b3-486f-ae34-eb36ad3318e8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:51.582029 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-9522a152-4c27-44d5-b7a5-dbeb998413f0 req-0784369d-46b3-486f-ae34-eb36ad3318e8 service nova] Creating event network-vif-unplugged:6ec98f33-ae19-4190-819a-9fe3d4ca011c for instance 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 on n-h1-861111-1 Oct 12 22:03:51.590669 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-9522a152-4c27-44d5-b7a5-dbeb998413f0 req-0784369d-46b3-486f-ae34-eb36ad3318e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073328 Oct 12 22:03:51.594267 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 642/1220] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:51.602285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f3513189-2bb4-41a1-b469-48cf3b11c4ab tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:51.602993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f3513189-2bb4-41a1-b469-48cf3b11c4ab tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:51.605510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a227c4eb-b94c-41ec-ad7a-53b9cea4490f tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:51.610497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3513189-2bb4-41a1-b469-48cf3b11c4ab tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:51.610988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3513189-2bb4-41a1-b469-48cf3b11c4ab tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:51.611456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3513189-2bb4-41a1-b469-48cf3b11c4ab tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:51.612504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3513189-2bb4-41a1-b469-48cf3b11c4ab tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:51.612969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3513189-2bb4-41a1-b469-48cf3b11c4ab tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:51.613194 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a227c4eb-b94c-41ec-ad7a-53b9cea4490f tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a" status: 200 len: 1467 microversion: 2.1 time: 0.296591 Oct 12 22:03:51.613399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3513189-2bb4-41a1-b469-48cf3b11c4ab tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:51.613958 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 579/1221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:51 2022] GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a => generated 1467 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:51.640780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7283124e-5d26-4889-a404-fdc767cba643 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128735ee0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:51.714833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f3513189-2bb4-41a1-b469-48cf3b11c4ab tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:51.723072 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f3513189-2bb4-41a1-b469-48cf3b11c4ab tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8" status: 200 len: 1204 microversion: 2.1 time: 0.127489 Oct 12 22:03:51.724054 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 643/1222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:51 2022] GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 => generated 1204 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:51.729432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c4cd76a8-0acb-4227-9dea-4c31e0cfd5a4 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:51.730317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c4cd76a8-0acb-4227-9dea-4c31e0cfd5a4 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:51.736933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4cd76a8-0acb-4227-9dea-4c31e0cfd5a4 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:51.737985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4cd76a8-0acb-4227-9dea-4c31e0cfd5a4 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:51.738583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4cd76a8-0acb-4227-9dea-4c31e0cfd5a4 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:51.739477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4cd76a8-0acb-4227-9dea-4c31e0cfd5a4 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:51.740091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4cd76a8-0acb-4227-9dea-4c31e0cfd5a4 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:51.740673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4cd76a8-0acb-4227-9dea-4c31e0cfd5a4 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:51.800240 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7283124e-5d26-4889-a404-fdc767cba643 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images?changes-since=2022-10-12T22%3A01%3A52Z" status: 200 len: 1901 microversion: 2.1 time: 0.163292 Oct 12 22:03:51.801198 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 580/1223] 10.222.0.16 () {58 vars in 1199 bytes} [Wed Oct 12 22:03:51 2022] GET /compute/v2.1/images?changes-since=2022-10-12T22%3A01%3A52Z => generated 1901 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:51.806210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-3843ef30-9145-497f-bc06-20b318473aaf req-d0e29907-86c7-44f6-b1e4-1f2d34ff1129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d4b3e47-bbd0-4adc-9173-d7f9ccd96221", "name": "network-vif-deleted", "tag": "6ec98f33-ae19-4190-819a-9fe3d4ca011c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:51.818849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3843ef30-9145-497f-bc06-20b318473aaf req-d0e29907-86c7-44f6-b1e4-1f2d34ff1129 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:51.819494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3843ef30-9145-497f-bc06-20b318473aaf req-d0e29907-86c7-44f6-b1e4-1f2d34ff1129 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:51.819934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3843ef30-9145-497f-bc06-20b318473aaf req-d0e29907-86c7-44f6-b1e4-1f2d34ff1129 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:51.835408 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-3843ef30-9145-497f-bc06-20b318473aaf req-d0e29907-86c7-44f6-b1e4-1f2d34ff1129 service nova] Creating event network-vif-deleted:6ec98f33-ae19-4190-819a-9fe3d4ca011c for instance 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 on n-h1-861111-1 Oct 12 22:03:51.843056 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-3843ef30-9145-497f-bc06-20b318473aaf req-d0e29907-86c7-44f6-b1e4-1f2d34ff1129 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040509 Oct 12 22:03:51.843723 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 581/1224] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:51.852467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-10c76ad8-bba7-42e9-9ac9-fb720758407c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128717e50>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:51.891400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c4cd76a8-0acb-4227-9dea-4c31e0cfd5a4 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:51.900811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c4cd76a8-0acb-4227-9dea-4c31e0cfd5a4 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:51.902936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c4cd76a8-0acb-4227-9dea-4c31e0cfd5a4 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:51.911852 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c4cd76a8-0acb-4227-9dea-4c31e0cfd5a4 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1417 microversion: 2.75 time: 0.186447 Oct 12 22:03:51.913434 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 644/1225] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:51 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1417 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:52.000230 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-10c76ad8-bba7-42e9-9ac9-fb720758407c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1156408787" status: 200 len: 485 microversion: 2.1 time: 0.152013 Oct 12 22:03:52.009353 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 582/1226] 10.222.0.16 () {58 vars in 1231 bytes} [Wed Oct 12 22:03:51 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1156408787 => generated 485 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:52.014243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4dd09d22-8276-49b6-906e-c1c3a49b802f tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512c49ba60>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:52.115988 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4dd09d22-8276-49b6-906e-c1c3a49b802f tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images?server=cf71b2a6-484b-4e05-80fb-89be6b98546a" status: 200 len: 957 microversion: 2.1 time: 0.105729 Oct 12 22:03:52.116649 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 645/1227] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 12 22:03:52 2022] GET /compute/v2.1/images?server=cf71b2a6-484b-4e05-80fb-89be6b98546a => generated 957 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:03:52.130141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-08ac383f-b156-4640-83bd-745787609e18 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51287355e0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:52.253275 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-08ac383f-b156-4640-83bd-745787609e18 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 484 microversion: 2.1 time: 0.126680 Oct 12 22:03:52.254272 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 583/1228] 10.222.0.16 () {58 vars in 1317 bytes} [Wed Oct 12 22:03:52 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 484 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:52.267085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c20fa25e-2975-4dd7-9201-e0b8fcd7504d tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128304790>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:52.341821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2cf09652-1f61-4fac-8902-d966a7c9ac36 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:52.342615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2cf09652-1f61-4fac-8902-d966a7c9ac36 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:52.349973 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c20fa25e-2975-4dd7-9201-e0b8fcd7504d tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 484 microversion: 2.1 time: 0.087546 Oct 12 22:03:52.350985 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 646/1229] 10.222.0.16 () {58 vars in 1303 bytes} [Wed Oct 12 22:03:52 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 484 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:03:52.361764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cf09652-1f61-4fac-8902-d966a7c9ac36 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:52.363192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cf09652-1f61-4fac-8902-d966a7c9ac36 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:52.363846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cf09652-1f61-4fac-8902-d966a7c9ac36 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:52.364475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d8b0941f-d0f3-42d0-b3d6-92488ccfd104 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51282a2dc0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:52.365549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cf09652-1f61-4fac-8902-d966a7c9ac36 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:52.366176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cf09652-1f61-4fac-8902-d966a7c9ac36 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:52.366755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cf09652-1f61-4fac-8902-d966a7c9ac36 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:52.486200 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d8b0941f-d0f3-42d0-b3d6-92488ccfd104 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.126046 Oct 12 22:03:52.487432 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 647/1230] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 12 22:03:52 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:52.504058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d105dabc-be7a-44a6-9c39-e3589ea406a0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512c529f70>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:52.520698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2cf09652-1f61-4fac-8902-d966a7c9ac36 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:52.532202 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2cf09652-1f61-4fac-8902-d966a7c9ac36 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1472 microversion: 2.1 time: 0.195906 Oct 12 22:03:52.533158 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 584/1231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:52 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1472 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:52.548480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eaef7abf-2555-4ada-a686-5a505bc1b9e2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:52.549100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eaef7abf-2555-4ada-a686-5a505bc1b9e2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:52.555301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eaef7abf-2555-4ada-a686-5a505bc1b9e2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:52.555797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eaef7abf-2555-4ada-a686-5a505bc1b9e2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:52.556337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eaef7abf-2555-4ada-a686-5a505bc1b9e2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:52.557316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eaef7abf-2555-4ada-a686-5a505bc1b9e2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:52.557587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eaef7abf-2555-4ada-a686-5a505bc1b9e2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:52.558460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eaef7abf-2555-4ada-a686-5a505bc1b9e2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:52.571461 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d105dabc-be7a-44a6-9c39-e3589ea406a0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.071236 Oct 12 22:03:52.572112 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 648/1232] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 12 22:03:52 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:52.584954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0273be5c-e079-4a24-80be-c76434f63180 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512c49bee0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:52.673787 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0273be5c-e079-4a24-80be-c76434f63180 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.092413 Oct 12 22:03:52.680542 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 649/1233] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:03:52 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:03:52.694275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e9dedce8-5e3b-4fdf-88fa-2fef92388ca6 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512c583160>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:52.900835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eaef7abf-2555-4ada-a686-5a505bc1b9e2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:52.912155 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eaef7abf-2555-4ada-a686-5a505bc1b9e2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1494 microversion: 2.1 time: 0.368148 Oct 12 22:03:52.914786 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 585/1234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:52 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1494 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:52.922539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3bc56b69-0d4a-4c1d-9d56-457260bea9ae tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:52.925274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3bc56b69-0d4a-4c1d-9d56-457260bea9ae tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:52.942991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bc56b69-0d4a-4c1d-9d56-457260bea9ae tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:52.943965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bc56b69-0d4a-4c1d-9d56-457260bea9ae tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:52.944631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bc56b69-0d4a-4c1d-9d56-457260bea9ae tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:52.946031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bc56b69-0d4a-4c1d-9d56-457260bea9ae tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:52.946965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bc56b69-0d4a-4c1d-9d56-457260bea9ae tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:52.947660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bc56b69-0d4a-4c1d-9d56-457260bea9ae tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:52.964258 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e9dedce8-5e3b-4fdf-88fa-2fef92388ca6 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/detail?changes-since=2022-10-12T22%3A01%3A46Z" status: 200 len: 6326 microversion: 2.1 time: 0.273093 Oct 12 22:03:52.971637 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 650/1235] 10.222.0.16 () {58 vars in 1220 bytes} [Wed Oct 12 22:03:52 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-12T22%3A01%3A46Z => generated 6326 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:52.991472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7f4982c8-b200-4382-97a4-0f90e89aaa6e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:52.992717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7f4982c8-b200-4382-97a4-0f90e89aaa6e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:53.001058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f4982c8-b200-4382-97a4-0f90e89aaa6e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:53.002127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f4982c8-b200-4382-97a4-0f90e89aaa6e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:53.002935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f4982c8-b200-4382-97a4-0f90e89aaa6e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:53.004338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f4982c8-b200-4382-97a4-0f90e89aaa6e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:53.005015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f4982c8-b200-4382-97a4-0f90e89aaa6e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:53.005670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f4982c8-b200-4382-97a4-0f90e89aaa6e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:53.061185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3bc56b69-0d4a-4c1d-9d56-457260bea9ae tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:53.072053 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3bc56b69-0d4a-4c1d-9d56-457260bea9ae tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8" status: 200 len: 1278 microversion: 2.1 time: 0.155858 Oct 12 22:03:53.073849 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 586/1236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:52 2022] GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:53.078755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e0b33855-eb12-4349-9c0a-c4d5ff348590 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51287178b0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:53.141124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7f4982c8-b200-4382-97a4-0f90e89aaa6e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:53.149325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7f4982c8-b200-4382-97a4-0f90e89aaa6e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:53.150809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7f4982c8-b200-4382-97a4-0f90e89aaa6e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:53.166217 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7f4982c8-b200-4382-97a4-0f90e89aaa6e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1417 microversion: 2.75 time: 0.193393 Oct 12 22:03:53.166837 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 651/1237] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:52 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1417 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:53.195869 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e0b33855-eb12-4349-9c0a-c4d5ff348590 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1156408787" status: 200 len: 665 microversion: 2.1 time: 0.121043 Oct 12 22:03:53.196529 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 587/1238] 10.222.0.16 () {58 vars in 1252 bytes} [Wed Oct 12 22:03:53 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1156408787 => generated 665 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:53.213483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1212bd46-67ca-4e86-968a-ed951bb65e91 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512c46bd30>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:53.270436 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1212bd46-67ca-4e86-968a-ed951bb65e91 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1464 microversion: 2.1 time: 0.061577 Oct 12 22:03:53.271814 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 652/1239] 10.222.0.16 () {58 vars in 1338 bytes} [Wed Oct 12 22:03:53 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1464 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:53.288105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7e2b2a93-8b0e-4ba0-aa76-8951fb043c14 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128735550>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:53.342985 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7e2b2a93-8b0e-4ba0-aa76-8951fb043c14 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1464 microversion: 2.1 time: 0.059059 Oct 12 22:03:53.344217 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 588/1240] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Oct 12 22:03:53 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1464 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:53.360179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b6e885c3-a429-47e9-9706-f151124e7433 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512c529f70>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:53.450110 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b6e885c3-a429-47e9-9706-f151124e7433 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7101 microversion: 2.1 time: 0.093941 Oct 12 22:03:53.463630 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 653/1241] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 12 22:03:53 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7101 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:53.470872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-81ccf3c6-52ff-489c-800c-89e2ab22e68b tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128722d30>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:53.560105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d25e9f89-f971-44d8-b9d2-679ed039c828 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:53.561176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d25e9f89-f971-44d8-b9d2-679ed039c828 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:53.575345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d25e9f89-f971-44d8-b9d2-679ed039c828 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:53.579026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d25e9f89-f971-44d8-b9d2-679ed039c828 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:53.579673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d25e9f89-f971-44d8-b9d2-679ed039c828 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:53.580707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d25e9f89-f971-44d8-b9d2-679ed039c828 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:53.583591 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-81ccf3c6-52ff-489c-800c-89e2ab22e68b tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.115721 Oct 12 22:03:53.583833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d25e9f89-f971-44d8-b9d2-679ed039c828 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:53.584475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d25e9f89-f971-44d8-b9d2-679ed039c828 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:53.585631 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 589/1242] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 12 22:03:53 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:53.621853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9369735a-267f-4951-a4a5-363d8eb253ee tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128717160>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:53.698218 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9369735a-267f-4951-a4a5-363d8eb253ee tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/d1e68057-c368-47a5-ab06-787819be7f9c" status: 200 len: 784 microversion: 2.1 time: 0.085979 Oct 12 22:03:53.699329 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 590/1243] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:03:53 2022] GET /compute/v2.1/images/d1e68057-c368-47a5-ab06-787819be7f9c => generated 784 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:53.716802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3a27356a-f0cd-4956-bf62-7e624f3bbd6c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128653430>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:53.800305 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3a27356a-f0cd-4956-bf62-7e624f3bbd6c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.087691 Oct 12 22:03:53.800879 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 591/1244] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 12 22:03:53 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:53.820858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1bdb3f56-267e-4c42-a98f-ad6da8068252 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f5128717a60>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:53.863066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d25e9f89-f971-44d8-b9d2-679ed039c828 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:53.879328 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d25e9f89-f971-44d8-b9d2-679ed039c828 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.322269 Oct 12 22:03:53.880110 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 654/1245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:53 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:53.937542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e4049039-947d-4606-9c82-6f72bb648520 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:53.938485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e4049039-947d-4606-9c82-6f72bb648520 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:53.954490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4049039-947d-4606-9c82-6f72bb648520 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:53.955060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4049039-947d-4606-9c82-6f72bb648520 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:53.955571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4049039-947d-4606-9c82-6f72bb648520 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:53.956228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4049039-947d-4606-9c82-6f72bb648520 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:53.956840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4049039-947d-4606-9c82-6f72bb648520 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:53.957414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4049039-947d-4606-9c82-6f72bb648520 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:54.188131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e4049039-947d-4606-9c82-6f72bb648520 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:54.200072 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e4049039-947d-4606-9c82-6f72bb648520 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1494 microversion: 2.1 time: 0.266584 Oct 12 22:03:54.201021 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 655/1246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:53 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1494 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:54.205727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-53ffa7a1-848a-46bc-9b8c-fbedcf5512f7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:54.206410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-53ffa7a1-848a-46bc-9b8c-fbedcf5512f7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:54.212856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53ffa7a1-848a-46bc-9b8c-fbedcf5512f7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:54.213767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53ffa7a1-848a-46bc-9b8c-fbedcf5512f7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:54.214262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53ffa7a1-848a-46bc-9b8c-fbedcf5512f7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:54.215036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53ffa7a1-848a-46bc-9b8c-fbedcf5512f7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:54.215571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53ffa7a1-848a-46bc-9b8c-fbedcf5512f7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:54.216200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53ffa7a1-848a-46bc-9b8c-fbedcf5512f7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:54.392277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-53ffa7a1-848a-46bc-9b8c-fbedcf5512f7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:54.402576 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-53ffa7a1-848a-46bc-9b8c-fbedcf5512f7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8" status: 200 len: 1308 microversion: 2.1 time: 0.200207 Oct 12 22:03:54.403408 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 656/1247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:54 2022] GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 => generated 1308 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:54.408667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-25b2e4b8-6504-4dc4-9a7c-184e3046b738 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:54.409442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-25b2e4b8-6504-4dc4-9a7c-184e3046b738 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:54.416165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25b2e4b8-6504-4dc4-9a7c-184e3046b738 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:54.416940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25b2e4b8-6504-4dc4-9a7c-184e3046b738 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:54.417544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25b2e4b8-6504-4dc4-9a7c-184e3046b738 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:54.418675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25b2e4b8-6504-4dc4-9a7c-184e3046b738 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:54.419440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25b2e4b8-6504-4dc4-9a7c-184e3046b738 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:54.420068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25b2e4b8-6504-4dc4-9a7c-184e3046b738 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:54.483253 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1bdb3f56-267e-4c42-a98f-ad6da8068252 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "DELETE /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5" status: 204 len: 0 microversion: 2.1 time: 0.666380 Oct 12 22:03:54.483915 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 592/1248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:53 2022] DELETE /compute/v2.1/images/66959d60-62b4-4b5a-b033-55355d733fe5 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:03:54.492059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b3ecf7ed-100b-4d94-93a0-a30a75d86c17 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51287225e0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:54.495836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-25b2e4b8-6504-4dc4-9a7c-184e3046b738 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:54.521394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-25b2e4b8-6504-4dc4-9a7c-184e3046b738 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:54.522752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-25b2e4b8-6504-4dc4-9a7c-184e3046b738 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:54.539395 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-25b2e4b8-6504-4dc4-9a7c-184e3046b738 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1417 microversion: 2.75 time: 0.134570 Oct 12 22:03:54.540064 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 657/1249] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:54 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1417 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:54.909257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-43fbe1dc-e19a-4e05-9470-1b29054dbb8c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:54.911258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-43fbe1dc-e19a-4e05-9470-1b29054dbb8c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:54.931982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43fbe1dc-e19a-4e05-9470-1b29054dbb8c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:54.934137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43fbe1dc-e19a-4e05-9470-1b29054dbb8c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:54.935900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43fbe1dc-e19a-4e05-9470-1b29054dbb8c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:54.937952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43fbe1dc-e19a-4e05-9470-1b29054dbb8c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:54.941280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43fbe1dc-e19a-4e05-9470-1b29054dbb8c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:54.941990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43fbe1dc-e19a-4e05-9470-1b29054dbb8c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:55.246043 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b3ecf7ed-100b-4d94-93a0-a30a75d86c17 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "DELETE /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b" status: 204 len: 0 microversion: 2.1 time: 0.757576 Oct 12 22:03:55.246882 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 593/1250] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:54 2022] DELETE /compute/v2.1/images/34863858-d258-44d7-ba73-1d915a4d518b => generated 0 bytes in 759 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:03:55.252874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-e6bfe30c-6cc7-42f5-8fa7-26f73a93edf3 req-b8761408-6275-46da-bc87-2f2bea322716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ce6878-173f-47f8-ab81-3c60803702b8", "tag": "7986b344-6016-4f6c-9d7d-12efc709af4c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:55.273449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e6bfe30c-6cc7-42f5-8fa7-26f73a93edf3 req-b8761408-6275-46da-bc87-2f2bea322716 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:55.274342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e6bfe30c-6cc7-42f5-8fa7-26f73a93edf3 req-b8761408-6275-46da-bc87-2f2bea322716 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:55.274934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e6bfe30c-6cc7-42f5-8fa7-26f73a93edf3 req-b8761408-6275-46da-bc87-2f2bea322716 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:55.300151 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-e6bfe30c-6cc7-42f5-8fa7-26f73a93edf3 req-b8761408-6275-46da-bc87-2f2bea322716 service nova] Creating event network-changed:7986b344-6016-4f6c-9d7d-12efc709af4c for instance 75ce6878-173f-47f8-ab81-3c60803702b8 on n-h1-861111-1 Oct 12 22:03:55.303389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-43fbe1dc-e19a-4e05-9470-1b29054dbb8c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:55.318277 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-e6bfe30c-6cc7-42f5-8fa7-26f73a93edf3 req-b8761408-6275-46da-bc87-2f2bea322716 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068830 Oct 12 22:03:55.319087 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 594/1251] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:55.322374 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-43fbe1dc-e19a-4e05-9470-1b29054dbb8c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.420093 Oct 12 22:03:55.339313 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 658/1252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:54 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:55.340037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a8e83027-5442-47aa-bef8-e1a71dcce5da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:55.340037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a8e83027-5442-47aa-bef8-e1a71dcce5da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:55.340037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8e83027-5442-47aa-bef8-e1a71dcce5da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:55.340037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8e83027-5442-47aa-bef8-e1a71dcce5da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:55.340372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8e83027-5442-47aa-bef8-e1a71dcce5da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:55.340476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6db441ce-a9c7-41af-8f71-a4331231f6d3 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512c49bee0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:55.340575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8e83027-5442-47aa-bef8-e1a71dcce5da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:55.340575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8e83027-5442-47aa-bef8-e1a71dcce5da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:55.340575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8e83027-5442-47aa-bef8-e1a71dcce5da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:55.585451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a8e83027-5442-47aa-bef8-e1a71dcce5da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:55.597088 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a8e83027-5442-47aa-bef8-e1a71dcce5da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1494 microversion: 2.1 time: 0.276945 Oct 12 22:03:55.613377 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 595/1253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:55 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1494 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:55.613377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d7d8c46a-cfe3-4826-bee6-13e76567420d req-ac84a0bd-dac6-491f-8593-425bc9730860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf71b2a6-484b-4e05-80fb-89be6b98546a", "name": "network-vif-unplugged", "status": "completed", "tag": "e7a4b681-6708-4e63-905c-13cb884689e3"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:55.628946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d7d8c46a-cfe3-4826-bee6-13e76567420d req-ac84a0bd-dac6-491f-8593-425bc9730860 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:55.631955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d7d8c46a-cfe3-4826-bee6-13e76567420d req-ac84a0bd-dac6-491f-8593-425bc9730860 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:55.632500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d7d8c46a-cfe3-4826-bee6-13e76567420d req-ac84a0bd-dac6-491f-8593-425bc9730860 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:55.648638 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d7d8c46a-cfe3-4826-bee6-13e76567420d req-ac84a0bd-dac6-491f-8593-425bc9730860 service nova] Creating event network-vif-unplugged:e7a4b681-6708-4e63-905c-13cb884689e3 for instance cf71b2a6-484b-4e05-80fb-89be6b98546a on n-h2-861111-1 Oct 12 22:03:55.657751 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d7d8c46a-cfe3-4826-bee6-13e76567420d req-ac84a0bd-dac6-491f-8593-425bc9730860 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053997 Oct 12 22:03:55.658583 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 596/1254] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:03:55.667981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3fc8bf2b-db63-477c-ba74-b78f66debafe tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:55.669442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3fc8bf2b-db63-477c-ba74-b78f66debafe tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:55.676554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fc8bf2b-db63-477c-ba74-b78f66debafe tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:55.677333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fc8bf2b-db63-477c-ba74-b78f66debafe tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:55.677983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fc8bf2b-db63-477c-ba74-b78f66debafe tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:55.679028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fc8bf2b-db63-477c-ba74-b78f66debafe tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:55.679680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fc8bf2b-db63-477c-ba74-b78f66debafe tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:55.680492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fc8bf2b-db63-477c-ba74-b78f66debafe tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:55.908410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3fc8bf2b-db63-477c-ba74-b78f66debafe tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:55.919336 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3fc8bf2b-db63-477c-ba74-b78f66debafe tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8" status: 200 len: 1308 microversion: 2.1 time: 0.258367 Oct 12 22:03:55.920070 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 597/1255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:55 2022] GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 => generated 1308 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:55.937213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0e751c35-750c-40f5-84f7-89f2cb787775 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:55.938216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0e751c35-750c-40f5-84f7-89f2cb787775 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:55.946830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e751c35-750c-40f5-84f7-89f2cb787775 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:55.949082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e751c35-750c-40f5-84f7-89f2cb787775 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:55.949760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e751c35-750c-40f5-84f7-89f2cb787775 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:55.950554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e751c35-750c-40f5-84f7-89f2cb787775 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:55.951083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e751c35-750c-40f5-84f7-89f2cb787775 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:55.951654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e751c35-750c-40f5-84f7-89f2cb787775 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:55.968470 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6db441ce-a9c7-41af-8f71-a4331231f6d3 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "DELETE /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2" status: 204 len: 0 microversion: 2.1 time: 0.641460 Oct 12 22:03:55.969201 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 659/1256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:55 2022] DELETE /compute/v2.1/images/1c2789f4-bbf5-42f3-9aaa-3ee057493fe2 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:03:55.976938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-790c04f5-9bbe-4eb3-94a1-f394332c284e tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:55.977515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-790c04f5-9bbe-4eb3-94a1-f394332c284e tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:55.983644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-790c04f5-9bbe-4eb3-94a1-f394332c284e tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:55.984396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-790c04f5-9bbe-4eb3-94a1-f394332c284e tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:55.984916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-790c04f5-9bbe-4eb3-94a1-f394332c284e tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:55.985688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-790c04f5-9bbe-4eb3-94a1-f394332c284e tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:55.986237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-790c04f5-9bbe-4eb3-94a1-f394332c284e tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:55.986736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-790c04f5-9bbe-4eb3-94a1-f394332c284e tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:55.990997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:56.019327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-790c04f5-9bbe-4eb3-94a1-f394332c284e tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:03:56.025392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0e751c35-750c-40f5-84f7-89f2cb787775 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:56.034747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0e751c35-750c-40f5-84f7-89f2cb787775 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:56.036582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0e751c35-750c-40f5-84f7-89f2cb787775 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:56.042770 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0e751c35-750c-40f5-84f7-89f2cb787775 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1417 microversion: 2.75 time: 0.112444 Oct 12 22:03:56.046346 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 598/1257] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:55 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1417 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:03:56.098788 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-790c04f5-9bbe-4eb3-94a1-f394332c284e tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "DELETE /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 204 len: 0 microversion: 2.1 time: 0.125169 Oct 12 22:03:56.099298 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 660/1258] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:03:55 2022] DELETE /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:03:56.107486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d0247fdd-b290-4450-b30a-e2e0672feaa9 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:56.108106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d0247fdd-b290-4450-b30a-e2e0672feaa9 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:56.114369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0247fdd-b290-4450-b30a-e2e0672feaa9 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:56.114865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0247fdd-b290-4450-b30a-e2e0672feaa9 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:56.115333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0247fdd-b290-4450-b30a-e2e0672feaa9 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:56.116036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0247fdd-b290-4450-b30a-e2e0672feaa9 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:56.116490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0247fdd-b290-4450-b30a-e2e0672feaa9 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:56.116918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0247fdd-b290-4450-b30a-e2e0672feaa9 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:56.249455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d0247fdd-b290-4450-b30a-e2e0672feaa9 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:56.257264 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d0247fdd-b290-4450-b30a-e2e0672feaa9 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1473 microversion: 2.1 time: 0.153698 Oct 12 22:03:56.257845 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 599/1259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:56 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1473 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:56.346664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5b706952-1e95-4215-942b-36a6699af616 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:56.347385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5b706952-1e95-4215-942b-36a6699af616 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:56.353519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b706952-1e95-4215-942b-36a6699af616 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:56.353932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b706952-1e95-4215-942b-36a6699af616 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:56.354367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b706952-1e95-4215-942b-36a6699af616 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:56.355059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b706952-1e95-4215-942b-36a6699af616 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:56.355541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b706952-1e95-4215-942b-36a6699af616 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:56.355968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b706952-1e95-4215-942b-36a6699af616 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:56.484323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5b706952-1e95-4215-942b-36a6699af616 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:56.491927 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5b706952-1e95-4215-942b-36a6699af616 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.149510 Oct 12 22:03:56.492491 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 661/1260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:56 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:56.625935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c10a8bdc-bef2-41f2-9f8d-9c30e07861c1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:56.626457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c10a8bdc-bef2-41f2-9f8d-9c30e07861c1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:56.632602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c10a8bdc-bef2-41f2-9f8d-9c30e07861c1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:56.633098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c10a8bdc-bef2-41f2-9f8d-9c30e07861c1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:56.633534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c10a8bdc-bef2-41f2-9f8d-9c30e07861c1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:56.634238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c10a8bdc-bef2-41f2-9f8d-9c30e07861c1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:56.634690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c10a8bdc-bef2-41f2-9f8d-9c30e07861c1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:56.635117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c10a8bdc-bef2-41f2-9f8d-9c30e07861c1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:56.768513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c10a8bdc-bef2-41f2-9f8d-9c30e07861c1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:56.778622 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c10a8bdc-bef2-41f2-9f8d-9c30e07861c1 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1494 microversion: 2.1 time: 0.156641 Oct 12 22:03:56.779203 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 600/1261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:56 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1494 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:56.944319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-98ec348e-9587-41b5-a77d-8d326ef50bd6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:56.944849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-98ec348e-9587-41b5-a77d-8d326ef50bd6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:56.951839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98ec348e-9587-41b5-a77d-8d326ef50bd6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:56.952316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98ec348e-9587-41b5-a77d-8d326ef50bd6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:56.952745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98ec348e-9587-41b5-a77d-8d326ef50bd6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:56.953436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98ec348e-9587-41b5-a77d-8d326ef50bd6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:56.953884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98ec348e-9587-41b5-a77d-8d326ef50bd6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:56.954302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98ec348e-9587-41b5-a77d-8d326ef50bd6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:57.070629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b687b85e-987d-455c-b787-a7478914e061 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:57.071021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b687b85e-987d-455c-b787-a7478914e061 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:57.081795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b687b85e-987d-455c-b787-a7478914e061 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:57.082299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b687b85e-987d-455c-b787-a7478914e061 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:57.083137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b687b85e-987d-455c-b787-a7478914e061 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:57.083502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b687b85e-987d-455c-b787-a7478914e061 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:57.083960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b687b85e-987d-455c-b787-a7478914e061 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:57.084415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b687b85e-987d-455c-b787-a7478914e061 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:57.098086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-98ec348e-9587-41b5-a77d-8d326ef50bd6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:57.108891 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-98ec348e-9587-41b5-a77d-8d326ef50bd6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8" status: 200 len: 1308 microversion: 2.1 time: 0.168422 Oct 12 22:03:57.125484 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 662/1262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:56 2022] GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 => generated 1308 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:57.174337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b687b85e-987d-455c-b787-a7478914e061 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:57.183582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b687b85e-987d-455c-b787-a7478914e061 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:57.185271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b687b85e-987d-455c-b787-a7478914e061 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:57.190535 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b687b85e-987d-455c-b787-a7478914e061 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1417 microversion: 2.75 time: 0.124105 Oct 12 22:03:57.199422 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 601/1263] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:57 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1417 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:03:57.280998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8bb6c0e4-af10-4054-b71c-c4c1f7007ca0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:57.281869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8bb6c0e4-af10-4054-b71c-c4c1f7007ca0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:57.287786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8bb6c0e4-af10-4054-b71c-c4c1f7007ca0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:57.288447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8bb6c0e4-af10-4054-b71c-c4c1f7007ca0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:57.289072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8bb6c0e4-af10-4054-b71c-c4c1f7007ca0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:57.289937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8bb6c0e4-af10-4054-b71c-c4c1f7007ca0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:57.290394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8bb6c0e4-af10-4054-b71c-c4c1f7007ca0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:57.290822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8bb6c0e4-af10-4054-b71c-c4c1f7007ca0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:57.350795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:57.425828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8bb6c0e4-af10-4054-b71c-c4c1f7007ca0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:57.434385 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8bb6c0e4-af10-4054-b71c-c4c1f7007ca0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1473 microversion: 2.1 time: 0.157241 Oct 12 22:03:57.450413 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 663/1264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:57 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1473 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:57.514662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7c9ab5cb-6617-479d-8404-d59422fd5e9b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:57.515362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7c9ab5cb-6617-479d-8404-d59422fd5e9b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:57.518353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:57.522449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c9ab5cb-6617-479d-8404-d59422fd5e9b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:57.522939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c9ab5cb-6617-479d-8404-d59422fd5e9b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:57.523412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c9ab5cb-6617-479d-8404-d59422fd5e9b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:57.524111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c9ab5cb-6617-479d-8404-d59422fd5e9b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:57.524571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c9ab5cb-6617-479d-8404-d59422fd5e9b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:57.524998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c9ab5cb-6617-479d-8404-d59422fd5e9b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:57.543981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:57.659870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7c9ab5cb-6617-479d-8404-d59422fd5e9b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:57.668139 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7c9ab5cb-6617-479d-8404-d59422fd5e9b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.158090 Oct 12 22:03:57.668709 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 602/1265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:57 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:57.802199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7d0c9a85-c6d5-49df-bf19-46c1012991da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:57.802914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7d0c9a85-c6d5-49df-bf19-46c1012991da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:57.809756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d0c9a85-c6d5-49df-bf19-46c1012991da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:57.810250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d0c9a85-c6d5-49df-bf19-46c1012991da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:57.810854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d0c9a85-c6d5-49df-bf19-46c1012991da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:57.811601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d0c9a85-c6d5-49df-bf19-46c1012991da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:57.812050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d0c9a85-c6d5-49df-bf19-46c1012991da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:57.812472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d0c9a85-c6d5-49df-bf19-46c1012991da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:57.956313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7d0c9a85-c6d5-49df-bf19-46c1012991da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:57.964430 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7d0c9a85-c6d5-49df-bf19-46c1012991da tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1494 microversion: 2.1 time: 0.166188 Oct 12 22:03:57.965194 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 664/1266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:57 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1494 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:58.133203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2f4fc573-983d-4c9d-a079-dc2c3b4d2609 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:58.133812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f4fc573-983d-4c9d-a079-dc2c3b4d2609 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:58.140937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f4fc573-983d-4c9d-a079-dc2c3b4d2609 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:58.141414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f4fc573-983d-4c9d-a079-dc2c3b4d2609 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:58.141837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f4fc573-983d-4c9d-a079-dc2c3b4d2609 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:58.142523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f4fc573-983d-4c9d-a079-dc2c3b4d2609 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:58.142968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f4fc573-983d-4c9d-a079-dc2c3b4d2609 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:58.143415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f4fc573-983d-4c9d-a079-dc2c3b4d2609 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:58.218550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d0732b60-d9fe-4f60-8b2e-7dc31a56d306 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:58.220420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d0732b60-d9fe-4f60-8b2e-7dc31a56d306 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:58.226581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0732b60-d9fe-4f60-8b2e-7dc31a56d306 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:58.227285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0732b60-d9fe-4f60-8b2e-7dc31a56d306 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:58.227817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0732b60-d9fe-4f60-8b2e-7dc31a56d306 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:58.228507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0732b60-d9fe-4f60-8b2e-7dc31a56d306 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:58.228956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0732b60-d9fe-4f60-8b2e-7dc31a56d306 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:58.229375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0732b60-d9fe-4f60-8b2e-7dc31a56d306 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:58.277605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f4fc573-983d-4c9d-a079-dc2c3b4d2609 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:58.285719 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2f4fc573-983d-4c9d-a079-dc2c3b4d2609 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8" status: 200 len: 1308 microversion: 2.1 time: 0.156388 Oct 12 22:03:58.286416 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 603/1267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:58 2022] GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 => generated 1308 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:58.295824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d0732b60-d9fe-4f60-8b2e-7dc31a56d306 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:58.304201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d0732b60-d9fe-4f60-8b2e-7dc31a56d306 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:58.305652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d0732b60-d9fe-4f60-8b2e-7dc31a56d306 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:58.311038 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d0732b60-d9fe-4f60-8b2e-7dc31a56d306 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1438 microversion: 2.75 time: 0.096941 Oct 12 22:03:58.311662 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 665/1268] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:58 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1438 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:03:58.338542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:03:58.341462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:58.347447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:58.347929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:58.348365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:58.349063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:58.349614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:58.350044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:58.430110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:03:58.430528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:03:58.430995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:03:58.431427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:03:58.431833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:03:58.458540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8e39329e-d7c4-4340-b1c9-029657034624 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:58.459272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8e39329e-d7c4-4340-b1c9-029657034624 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:58.465765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e39329e-d7c4-4340-b1c9-029657034624 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:58.466359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e39329e-d7c4-4340-b1c9-029657034624 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:58.466856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e39329e-d7c4-4340-b1c9-029657034624 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:58.467736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e39329e-d7c4-4340-b1c9-029657034624 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:58.468327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e39329e-d7c4-4340-b1c9-029657034624 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:58.468815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e39329e-d7c4-4340-b1c9-029657034624 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:58.496908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:58.503097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:58.503735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:58.504213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:58.505004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:58.505915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:58.506229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:58.581632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:58.598068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:58.600520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:58.610248 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e2d5db67-7c89-40fd-a25c-011749d5d2dc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "POST /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b/action" status: 202 len: 1495 microversion: 2.75 time: 0.275777 Oct 12 22:03:58.611875 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 604/1269] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 12 22:03:58 2022] POST /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b/action => generated 1495 bytes in 278 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 12 22:03:58.626158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8e39329e-d7c4-4340-b1c9-029657034624 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:58.637738 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8e39329e-d7c4-4340-b1c9-029657034624 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1473 microversion: 2.1 time: 0.182996 Oct 12 22:03:58.638310 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 666/1270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:58 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1473 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:58.641401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-74b53eb0-8e40-49c9-ba6d-200601ea731a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:58.642192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-74b53eb0-8e40-49c9-ba6d-200601ea731a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:58.650214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74b53eb0-8e40-49c9-ba6d-200601ea731a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:58.651870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74b53eb0-8e40-49c9-ba6d-200601ea731a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:58.652667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74b53eb0-8e40-49c9-ba6d-200601ea731a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:58.653721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74b53eb0-8e40-49c9-ba6d-200601ea731a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:58.654262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74b53eb0-8e40-49c9-ba6d-200601ea731a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:58.654691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74b53eb0-8e40-49c9-ba6d-200601ea731a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:58.691184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e570753c-9192-4967-a6c0-41bbbe850684 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:58.692021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e570753c-9192-4967-a6c0-41bbbe850684 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:58.699194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e570753c-9192-4967-a6c0-41bbbe850684 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:58.699879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e570753c-9192-4967-a6c0-41bbbe850684 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:58.700419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e570753c-9192-4967-a6c0-41bbbe850684 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:58.701502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e570753c-9192-4967-a6c0-41bbbe850684 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:58.702097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e570753c-9192-4967-a6c0-41bbbe850684 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:58.705190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e570753c-9192-4967-a6c0-41bbbe850684 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:58.732332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-74b53eb0-8e40-49c9-ba6d-200601ea731a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:58.742354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-74b53eb0-8e40-49c9-ba6d-200601ea731a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:58.744640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-74b53eb0-8e40-49c9-ba6d-200601ea731a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:58.757101 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-74b53eb0-8e40-49c9-ba6d-200601ea731a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.117884 Oct 12 22:03:58.758540 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 605/1271] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:58 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:03:58.851681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e570753c-9192-4967-a6c0-41bbbe850684 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:58.859421 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e570753c-9192-4967-a6c0-41bbbe850684 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.172157 Oct 12 22:03:58.859979 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 667/1272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:58 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:03:58.987773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-733e7d35-9dbd-4d08-9d64-55233fc2bdd2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:58.988492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-733e7d35-9dbd-4d08-9d64-55233fc2bdd2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:58.994437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-733e7d35-9dbd-4d08-9d64-55233fc2bdd2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:58.995002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-733e7d35-9dbd-4d08-9d64-55233fc2bdd2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:58.995540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-733e7d35-9dbd-4d08-9d64-55233fc2bdd2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:58.996298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-733e7d35-9dbd-4d08-9d64-55233fc2bdd2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:58.996751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-733e7d35-9dbd-4d08-9d64-55233fc2bdd2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:58.997220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-733e7d35-9dbd-4d08-9d64-55233fc2bdd2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:59.162146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-733e7d35-9dbd-4d08-9d64-55233fc2bdd2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:59.170573 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-733e7d35-9dbd-4d08-9d64-55233fc2bdd2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1494 microversion: 2.1 time: 0.186687 Oct 12 22:03:59.171146 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 606/1273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:58 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1494 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:59.310092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f49cdec7-c2f8-4c2e-8697-2105b44cdb11 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:59.311463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f49cdec7-c2f8-4c2e-8697-2105b44cdb11 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:59.320608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f49cdec7-c2f8-4c2e-8697-2105b44cdb11 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:59.323688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f49cdec7-c2f8-4c2e-8697-2105b44cdb11 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:59.324524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f49cdec7-c2f8-4c2e-8697-2105b44cdb11 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:59.325414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f49cdec7-c2f8-4c2e-8697-2105b44cdb11 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:59.326181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f49cdec7-c2f8-4c2e-8697-2105b44cdb11 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:59.326762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f49cdec7-c2f8-4c2e-8697-2105b44cdb11 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:59.485239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f49cdec7-c2f8-4c2e-8697-2105b44cdb11 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:59.497117 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f49cdec7-c2f8-4c2e-8697-2105b44cdb11 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8" status: 200 len: 1308 microversion: 2.1 time: 0.191794 Oct 12 22:03:59.497708 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 668/1274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:59 2022] GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 => generated 1308 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:59.662024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7ffd9097-8355-4db6-8728-f678ffaaa270 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:59.662763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7ffd9097-8355-4db6-8728-f678ffaaa270 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:59.669370 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ffd9097-8355-4db6-8728-f678ffaaa270 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:59.670086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ffd9097-8355-4db6-8728-f678ffaaa270 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:59.670731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ffd9097-8355-4db6-8728-f678ffaaa270 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:59.671618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ffd9097-8355-4db6-8728-f678ffaaa270 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:59.672070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ffd9097-8355-4db6-8728-f678ffaaa270 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:59.672491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ffd9097-8355-4db6-8728-f678ffaaa270 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:59.787807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ecfd6a69-be34-4e44-9483-e25f69acc4d1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:59.788412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ecfd6a69-be34-4e44-9483-e25f69acc4d1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:59.795012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecfd6a69-be34-4e44-9483-e25f69acc4d1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:59.795546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecfd6a69-be34-4e44-9483-e25f69acc4d1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:59.795980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecfd6a69-be34-4e44-9483-e25f69acc4d1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:59.796664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecfd6a69-be34-4e44-9483-e25f69acc4d1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:59.797110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecfd6a69-be34-4e44-9483-e25f69acc4d1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:59.797595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecfd6a69-be34-4e44-9483-e25f69acc4d1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:59.813293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7ffd9097-8355-4db6-8728-f678ffaaa270 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:59.822674 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7ffd9097-8355-4db6-8728-f678ffaaa270 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1473 microversion: 2.1 time: 0.165304 Oct 12 22:03:59.823829 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 607/1275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:59 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1473 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:03:59.870090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ecfd6a69-be34-4e44-9483-e25f69acc4d1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:59.879581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ecfd6a69-be34-4e44-9483-e25f69acc4d1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:59.881316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ecfd6a69-be34-4e44-9483-e25f69acc4d1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:03:59.883273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3e68c6a9-645d-42cd-ae7d-69244e9f5458 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:03:59.883669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:03:59.884094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3e68c6a9-645d-42cd-ae7d-69244e9f5458 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:03:59.889508 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ecfd6a69-be34-4e44-9483-e25f69acc4d1 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.105736 Oct 12 22:03:59.891290 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 669/1276] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:03:59 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:03:59.892014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e68c6a9-645d-42cd-ae7d-69244e9f5458 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:59.892947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e68c6a9-645d-42cd-ae7d-69244e9f5458 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:59.893491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e68c6a9-645d-42cd-ae7d-69244e9f5458 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:03:59.894258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e68c6a9-645d-42cd-ae7d-69244e9f5458 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:03:59.894913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e68c6a9-645d-42cd-ae7d-69244e9f5458 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:03:59.895454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e68c6a9-645d-42cd-ae7d-69244e9f5458 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:00.020083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:00.193817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cc16ca76-2079-4ebc-bbbd-86a325259cef tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:00.194337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cc16ca76-2079-4ebc-bbbd-86a325259cef tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:00.202615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc16ca76-2079-4ebc-bbbd-86a325259cef tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:00.203104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc16ca76-2079-4ebc-bbbd-86a325259cef tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:00.203562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc16ca76-2079-4ebc-bbbd-86a325259cef tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:00.204263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc16ca76-2079-4ebc-bbbd-86a325259cef tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:00.204713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc16ca76-2079-4ebc-bbbd-86a325259cef tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:00.205140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc16ca76-2079-4ebc-bbbd-86a325259cef tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:00.339260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cc16ca76-2079-4ebc-bbbd-86a325259cef tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:00.347415 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cc16ca76-2079-4ebc-bbbd-86a325259cef tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1500 microversion: 2.1 time: 0.157591 Oct 12 22:04:00.348076 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 670/1277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:00 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:00.376445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1b0d229f-c9c5-42ba-9a20-7daee71dcd02 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:00.377016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1b0d229f-c9c5-42ba-9a20-7daee71dcd02 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:00.381027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3e68c6a9-645d-42cd-ae7d-69244e9f5458 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:00.383050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b0d229f-c9c5-42ba-9a20-7daee71dcd02 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:00.383781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b0d229f-c9c5-42ba-9a20-7daee71dcd02 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:00.384294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b0d229f-c9c5-42ba-9a20-7daee71dcd02 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:00.385197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b0d229f-c9c5-42ba-9a20-7daee71dcd02 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:00.386177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b0d229f-c9c5-42ba-9a20-7daee71dcd02 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:00.386788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b0d229f-c9c5-42ba-9a20-7daee71dcd02 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:00.389714 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3e68c6a9-645d-42cd-ae7d-69244e9f5458 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.511583 Oct 12 22:04:00.390292 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 608/1278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:03:59 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:00.411913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1b0d229f-c9c5-42ba-9a20-7daee71dcd02 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:04:00.487859 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1b0d229f-c9c5-42ba-9a20-7daee71dcd02 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "DELETE /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 204 len: 0 microversion: 2.1 time: 0.114780 Oct 12 22:04:00.488452 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 671/1279] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:04:00 2022] DELETE /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:04:00.497574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-650afcc1-ec33-47bf-942f-c8f74b4c4981 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:00.498191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-650afcc1-ec33-47bf-942f-c8f74b4c4981 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:00.500026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=16 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:00.505203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-650afcc1-ec33-47bf-942f-c8f74b4c4981 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:00.505712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-650afcc1-ec33-47bf-942f-c8f74b4c4981 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:00.506152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-650afcc1-ec33-47bf-942f-c8f74b4c4981 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:00.506850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-650afcc1-ec33-47bf-942f-c8f74b4c4981 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:00.507331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-650afcc1-ec33-47bf-942f-c8f74b4c4981 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:00.507760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-650afcc1-ec33-47bf-942f-c8f74b4c4981 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:00.521360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cbcf6f2d-1f9f-464a-893f-f7e528f77b84 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:00.522424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cbcf6f2d-1f9f-464a-893f-f7e528f77b84 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:00.528485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbcf6f2d-1f9f-464a-893f-f7e528f77b84 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:00.528972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbcf6f2d-1f9f-464a-893f-f7e528f77b84 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:00.529429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbcf6f2d-1f9f-464a-893f-f7e528f77b84 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:00.530153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbcf6f2d-1f9f-464a-893f-f7e528f77b84 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:00.530604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbcf6f2d-1f9f-464a-893f-f7e528f77b84 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:00.531021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbcf6f2d-1f9f-464a-893f-f7e528f77b84 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:00.664010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cbcf6f2d-1f9f-464a-893f-f7e528f77b84 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:00.672642 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cbcf6f2d-1f9f-464a-893f-f7e528f77b84 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8" status: 200 len: 1308 microversion: 2.1 time: 0.155200 Oct 12 22:04:00.677785 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 672/1280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:00 2022] GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 => generated 1308 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:00.741559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-ad058a86-6780-433d-bda1-a40c0bdaf2ef req-b5ac59dd-f6e1-47d5-837d-fa0c2a9f41d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e1ad2a-6b26-4501-af12-49ad23802b5f", "name": "network-vif-deleted", "tag": "e6ed5eb0-d436-4efd-8560-3606d22e1b6e"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:00.746282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-650afcc1-ec33-47bf-942f-c8f74b4c4981 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:00.751360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ad058a86-6780-433d-bda1-a40c0bdaf2ef req-b5ac59dd-f6e1-47d5-837d-fa0c2a9f41d5 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:00.751915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ad058a86-6780-433d-bda1-a40c0bdaf2ef req-b5ac59dd-f6e1-47d5-837d-fa0c2a9f41d5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:00.752350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ad058a86-6780-433d-bda1-a40c0bdaf2ef req-b5ac59dd-f6e1-47d5-837d-fa0c2a9f41d5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:00.754336 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-650afcc1-ec33-47bf-942f-c8f74b4c4981 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.261201 Oct 12 22:04:00.754924 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 609/1281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:00 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:00.769741 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-ad058a86-6780-433d-bda1-a40c0bdaf2ef req-b5ac59dd-f6e1-47d5-837d-fa0c2a9f41d5 service nova] Creating event network-vif-deleted:e6ed5eb0-d436-4efd-8560-3606d22e1b6e for instance 18e1ad2a-6b26-4501-af12-49ad23802b5f on n-h2-861111-1 Oct 12 22:04:00.774700 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-ad058a86-6780-433d-bda1-a40c0bdaf2ef req-b5ac59dd-f6e1-47d5-837d-fa0c2a9f41d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036902 Oct 12 22:04:00.775321 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 673/1282] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:04:00.846849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4d9d3d1c-5e90-4800-9580-8f47b0359fc8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:00.847469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4d9d3d1c-5e90-4800-9580-8f47b0359fc8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:00.853929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d9d3d1c-5e90-4800-9580-8f47b0359fc8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:00.854457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d9d3d1c-5e90-4800-9580-8f47b0359fc8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:00.854896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d9d3d1c-5e90-4800-9580-8f47b0359fc8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:00.855715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d9d3d1c-5e90-4800-9580-8f47b0359fc8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:00.856250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d9d3d1c-5e90-4800-9580-8f47b0359fc8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:00.856741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d9d3d1c-5e90-4800-9580-8f47b0359fc8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:00.917796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-19316997-e28b-4a7e-b41e-842ea5d61d72 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:00.918711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-19316997-e28b-4a7e-b41e-842ea5d61d72 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:00.918829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4d9d3d1c-5e90-4800-9580-8f47b0359fc8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:00.925100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19316997-e28b-4a7e-b41e-842ea5d61d72 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:00.925589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19316997-e28b-4a7e-b41e-842ea5d61d72 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:00.926027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19316997-e28b-4a7e-b41e-842ea5d61d72 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:00.926726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19316997-e28b-4a7e-b41e-842ea5d61d72 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:00.926824 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4d9d3d1c-5e90-4800-9580-8f47b0359fc8 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1431 microversion: 2.1 time: 0.083776 Oct 12 22:04:00.927182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19316997-e28b-4a7e-b41e-842ea5d61d72 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:00.938322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19316997-e28b-4a7e-b41e-842ea5d61d72 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:00.938616 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 610/1283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:00 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1431 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:00.938708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:00.996222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-19316997-e28b-4a7e-b41e-842ea5d61d72 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:01.004971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-19316997-e28b-4a7e-b41e-842ea5d61d72 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:01.006439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-19316997-e28b-4a7e-b41e-842ea5d61d72 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:01.015210 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-19316997-e28b-4a7e-b41e-842ea5d61d72 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.101918 Oct 12 22:04:01.016188 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 674/1284] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:00 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:04:01.221061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-af01db17-4827-452f-a1ba-979bcc42ec76 req-97a7ecdf-e483-4287-aeef-6bf82992f806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ce6878-173f-47f8-ab81-3c60803702b8", "name": "network-vif-plugged", "status": "completed", "tag": "7986b344-6016-4f6c-9d7d-12efc709af4c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:01.231360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-af01db17-4827-452f-a1ba-979bcc42ec76 req-97a7ecdf-e483-4287-aeef-6bf82992f806 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:01.231844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-af01db17-4827-452f-a1ba-979bcc42ec76 req-97a7ecdf-e483-4287-aeef-6bf82992f806 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:01.232275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-af01db17-4827-452f-a1ba-979bcc42ec76 req-97a7ecdf-e483-4287-aeef-6bf82992f806 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:01.243642 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-af01db17-4827-452f-a1ba-979bcc42ec76 req-97a7ecdf-e483-4287-aeef-6bf82992f806 service nova] Creating event network-vif-plugged:7986b344-6016-4f6c-9d7d-12efc709af4c for instance 75ce6878-173f-47f8-ab81-3c60803702b8 on n-h1-861111-1 Oct 12 22:04:01.248989 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-af01db17-4827-452f-a1ba-979bcc42ec76 req-97a7ecdf-e483-4287-aeef-6bf82992f806 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032346 Oct 12 22:04:01.249578 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 611/1285] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:01.412802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-269e5eb1-3d02-448a-ba1e-e5d95f77cb77 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:01.413424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-269e5eb1-3d02-448a-ba1e-e5d95f77cb77 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:01.420683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-269e5eb1-3d02-448a-ba1e-e5d95f77cb77 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:01.421170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-269e5eb1-3d02-448a-ba1e-e5d95f77cb77 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:01.421611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-269e5eb1-3d02-448a-ba1e-e5d95f77cb77 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:01.422304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-269e5eb1-3d02-448a-ba1e-e5d95f77cb77 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:01.422759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-269e5eb1-3d02-448a-ba1e-e5d95f77cb77 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:01.423183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-269e5eb1-3d02-448a-ba1e-e5d95f77cb77 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:01.550708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-269e5eb1-3d02-448a-ba1e-e5d95f77cb77 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:01.559043 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-269e5eb1-3d02-448a-ba1e-e5d95f77cb77 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.150133 Oct 12 22:04:01.559636 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 675/1286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:01 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:01.694970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-416ff48b-fcb0-40a3-9e12-9a7b67c784d9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:01.695749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-416ff48b-fcb0-40a3-9e12-9a7b67c784d9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:01.701838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-416ff48b-fcb0-40a3-9e12-9a7b67c784d9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:01.702321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-416ff48b-fcb0-40a3-9e12-9a7b67c784d9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:01.702756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-416ff48b-fcb0-40a3-9e12-9a7b67c784d9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:01.703473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-416ff48b-fcb0-40a3-9e12-9a7b67c784d9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:01.703925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-416ff48b-fcb0-40a3-9e12-9a7b67c784d9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:01.704349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-416ff48b-fcb0-40a3-9e12-9a7b67c784d9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:01.778415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-22d0fcba-0332-4da2-8831-b46c731f369c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:01.779029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-22d0fcba-0332-4da2-8831-b46c731f369c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:01.784906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22d0fcba-0332-4da2-8831-b46c731f369c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:01.785539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22d0fcba-0332-4da2-8831-b46c731f369c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:01.785814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22d0fcba-0332-4da2-8831-b46c731f369c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:01.786506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22d0fcba-0332-4da2-8831-b46c731f369c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:01.786957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22d0fcba-0332-4da2-8831-b46c731f369c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:01.787409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22d0fcba-0332-4da2-8831-b46c731f369c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:01.836499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-416ff48b-fcb0-40a3-9e12-9a7b67c784d9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:01.844712 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-416ff48b-fcb0-40a3-9e12-9a7b67c784d9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8" status: 200 len: 1308 microversion: 2.1 time: 0.153993 Oct 12 22:04:01.845278 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 612/1287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:01 2022] GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 => generated 1308 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:01.913326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-22d0fcba-0332-4da2-8831-b46c731f369c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:01.921660 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-22d0fcba-0332-4da2-8831-b46c731f369c tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.147627 Oct 12 22:04:01.922227 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 676/1288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:01 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:01.950869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3b038b41-8fed-42ec-9c7d-e7d4ee176fdf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:01.951508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3b038b41-8fed-42ec-9c7d-e7d4ee176fdf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:01.957529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b038b41-8fed-42ec-9c7d-e7d4ee176fdf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:01.958009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b038b41-8fed-42ec-9c7d-e7d4ee176fdf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:01.958445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b038b41-8fed-42ec-9c7d-e7d4ee176fdf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:01.959162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b038b41-8fed-42ec-9c7d-e7d4ee176fdf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:01.959642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b038b41-8fed-42ec-9c7d-e7d4ee176fdf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:01.960066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b038b41-8fed-42ec-9c7d-e7d4ee176fdf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:02.025401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3b038b41-8fed-42ec-9c7d-e7d4ee176fdf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:02.033647 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3b038b41-8fed-42ec-9c7d-e7d4ee176fdf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1431 microversion: 2.1 time: 0.086710 Oct 12 22:04:02.034212 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 613/1289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:01 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1431 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:02.044125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4a5675a2-be9d-4bfd-accc-89747a234b27 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:02.044816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4a5675a2-be9d-4bfd-accc-89747a234b27 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:02.050786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a5675a2-be9d-4bfd-accc-89747a234b27 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:02.051290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a5675a2-be9d-4bfd-accc-89747a234b27 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:02.051724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a5675a2-be9d-4bfd-accc-89747a234b27 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:02.052412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a5675a2-be9d-4bfd-accc-89747a234b27 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:02.052855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a5675a2-be9d-4bfd-accc-89747a234b27 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:02.053273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a5675a2-be9d-4bfd-accc-89747a234b27 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:02.115903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4a5675a2-be9d-4bfd-accc-89747a234b27 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:02.124079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4a5675a2-be9d-4bfd-accc-89747a234b27 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:02.125583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4a5675a2-be9d-4bfd-accc-89747a234b27 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:02.130340 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4a5675a2-be9d-4bfd-accc-89747a234b27 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.091051 Oct 12 22:04:02.130892 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 677/1290] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:02 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:02.581777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0d0fe49f-e95d-4506-a375-73b20ac54cc2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:02.582341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0d0fe49f-e95d-4506-a375-73b20ac54cc2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:02.589588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d0fe49f-e95d-4506-a375-73b20ac54cc2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:02.590070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d0fe49f-e95d-4506-a375-73b20ac54cc2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:02.590509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d0fe49f-e95d-4506-a375-73b20ac54cc2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:02.591553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d0fe49f-e95d-4506-a375-73b20ac54cc2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:02.591684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d0fe49f-e95d-4506-a375-73b20ac54cc2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:02.592108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d0fe49f-e95d-4506-a375-73b20ac54cc2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:02.720115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0d0fe49f-e95d-4506-a375-73b20ac54cc2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:02.727718 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0d0fe49f-e95d-4506-a375-73b20ac54cc2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.149996 Oct 12 22:04:02.728289 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 614/1291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:02 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:02.868420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ce502347-abbe-44c1-b148-a57f599067cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:02.868949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ce502347-abbe-44c1-b148-a57f599067cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:02.875654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce502347-abbe-44c1-b148-a57f599067cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:02.876129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce502347-abbe-44c1-b148-a57f599067cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:02.876556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce502347-abbe-44c1-b148-a57f599067cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:02.877228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce502347-abbe-44c1-b148-a57f599067cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:02.877675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce502347-abbe-44c1-b148-a57f599067cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:02.878091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce502347-abbe-44c1-b148-a57f599067cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:02.944403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0953a20b-7f83-4e92-ab86-4b9b71f80cc8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:02.945010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0953a20b-7f83-4e92-ab86-4b9b71f80cc8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:02.951483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0953a20b-7f83-4e92-ab86-4b9b71f80cc8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:02.952064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0953a20b-7f83-4e92-ab86-4b9b71f80cc8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:02.952382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0953a20b-7f83-4e92-ab86-4b9b71f80cc8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:02.953106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0953a20b-7f83-4e92-ab86-4b9b71f80cc8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:02.953587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0953a20b-7f83-4e92-ab86-4b9b71f80cc8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:02.954007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0953a20b-7f83-4e92-ab86-4b9b71f80cc8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:03.009102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ce502347-abbe-44c1-b148-a57f599067cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:03.017534 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ce502347-abbe-44c1-b148-a57f599067cf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8" status: 200 len: 1308 microversion: 2.1 time: 0.152930 Oct 12 22:04:03.031589 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 678/1292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:02 2022] GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 => generated 1308 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:03.058191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a01b15ea-b83d-4581-9aae-6cff593f61d3 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:03.059147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a01b15ea-b83d-4581-9aae-6cff593f61d3 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:03.074828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a01b15ea-b83d-4581-9aae-6cff593f61d3 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:03.074828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a01b15ea-b83d-4581-9aae-6cff593f61d3 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:03.074828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a01b15ea-b83d-4581-9aae-6cff593f61d3 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:03.074828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a01b15ea-b83d-4581-9aae-6cff593f61d3 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:03.075180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a01b15ea-b83d-4581-9aae-6cff593f61d3 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:03.075180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a01b15ea-b83d-4581-9aae-6cff593f61d3 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:03.090112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0953a20b-7f83-4e92-ab86-4b9b71f80cc8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:03.097839 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0953a20b-7f83-4e92-ab86-4b9b71f80cc8 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1506 microversion: 2.1 time: 0.157344 Oct 12 22:04:03.098401 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 615/1293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:02 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:03.132668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a01b15ea-b83d-4581-9aae-6cff593f61d3 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:03.141086 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a01b15ea-b83d-4581-9aae-6cff593f61d3 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1431 microversion: 2.1 time: 0.087791 Oct 12 22:04:03.141569 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 679/1294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:03 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1431 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:03.157866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fdbbb06f-8b8e-46a5-b672-24af87d395e7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:03.158469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fdbbb06f-8b8e-46a5-b672-24af87d395e7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:03.164214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fdbbb06f-8b8e-46a5-b672-24af87d395e7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:03.164695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fdbbb06f-8b8e-46a5-b672-24af87d395e7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:03.165126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fdbbb06f-8b8e-46a5-b672-24af87d395e7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:03.165810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fdbbb06f-8b8e-46a5-b672-24af87d395e7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:03.166257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fdbbb06f-8b8e-46a5-b672-24af87d395e7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:03.166990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fdbbb06f-8b8e-46a5-b672-24af87d395e7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:03.247059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fdbbb06f-8b8e-46a5-b672-24af87d395e7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:03.255853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fdbbb06f-8b8e-46a5-b672-24af87d395e7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:03.258367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fdbbb06f-8b8e-46a5-b672-24af87d395e7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:03.265326 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fdbbb06f-8b8e-46a5-b672-24af87d395e7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.111216 Oct 12 22:04:03.265786 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 616/1295] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:03 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:03.373941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48b7c2c3-02b0-4d1c-97e5-8ec0b8c3074b tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8798ca19-4c0f-41ac-a07f-c327704c4f4b"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:03.376489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-48b7c2c3-02b0-4d1c-97e5-8ec0b8c3074b tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:03.382493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b7c2c3-02b0-4d1c-97e5-8ec0b8c3074b tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:03.382944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b7c2c3-02b0-4d1c-97e5-8ec0b8c3074b tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:03.383417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b7c2c3-02b0-4d1c-97e5-8ec0b8c3074b tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:03.384104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b7c2c3-02b0-4d1c-97e5-8ec0b8c3074b tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:03.384554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b7c2c3-02b0-4d1c-97e5-8ec0b8c3074b tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:03.384974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b7c2c3-02b0-4d1c-97e5-8ec0b8c3074b tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:03.555935 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-48b7c2c3-02b0-4d1c-97e5-8ec0b8c3074b tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] HTTP exception thrown: Volume 8798ca19-4c0f-41ac-a07f-c327704c4f4b could not be found. Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48b7c2c3-02b0-4d1c-97e5-8ec0b8c3074b tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Request method failure captured: Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: request: PUT /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments/004eb58b-998a-49a7-9a4d-e5e74b862b36 HTTP/1.1 Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 74 Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzl914zYMwbBTEX8H3qKsvJhXtJIyskEArt9doVCclqiuTJXEEiO4ZxXP89zRvuZscbwfe8r1iTSUn3J3VcNameo9MenZL0LwAmYMa-3Z3H6ljbZYrAgGzlr65msIwrGNxn7BpOap0YG3TxjwN3IbEZQY0oir0K22bHEpKjv5Kvlu8I Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 833bbe9db25a48bc9724f6e392dd6a81 Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-VolumesAdminNegativeTest-1069867481 Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:04:03.575466 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:04:03.577178 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/833bbe9db25a48bc9724f6e392dd6a81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/833bbe9db25a48bc9724f6e392dd6a81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_833bbe9db25a48bc9724f6e392dd6a81", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/833bbe9db25a48bc9724f6e392dd6a81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:04:03.577178 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-VolumesAdminNegativeTest-1069867481 Oct 12 22:04:03.577178 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 833bbe9db25a48bc9724f6e392dd6a81 Oct 12 22:04:03.577178 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1069867481 Oct 12 22:04:03.577178 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-VolumesAdminNegativeTest-1069867481-project-admin Oct 12 22:04:03.577178 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:04:03.577178 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:04:03.577178 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 784a5d090fa64b4a8539c3093c98aa1d Oct 12 22:04:03.577178 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-VolumesAdminNegativeTest-1069867481-project-admin Oct 12 22:04:03.577178 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:04:03.577178 n-d-861111-1 devstack@n-api.service[120453]: {"volumeAttachment": {"volumeId": "8798ca19-4c0f-41ac-a07f-c327704c4f4b"}} Oct 12 22:04:03.577178 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:04:03.577178 n-d-861111-1 devstack@n-api.service[120453]: exception: Volume 8798ca19-4c0f-41ac-a07f-c327704c4f4b could not be found. Oct 12 22:04:03.578294 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'server_id': '7169b167-a2fd-4983-af2e-bcc24daf9b72', 'id': '004eb58b-998a-49a7-9a4d-e5e74b862b36', 'body': {'volumeAttachment': {'volumeId': '8798ca19-4c0f-41ac-a07f-c327704c4f4b'}}} Oct 12 22:04:03.578294 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:04:03.578294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:03.578294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:04:03.578294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:04:03.578294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:04:03.578294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:04:03.578294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:04:03.578294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:04:03.578294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:04:03.578294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:04:03.578294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:04:03.578294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:04:03.578294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:04:03.578294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:04:03.578294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:04:03.578294 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8798ca19-4c0f-41ac-a07f-c327704c4f4b could not be found. (HTTP 404) (Request-ID: req-a77fd390-5079-4305-8c5f-d9a9c7e85b9f) Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:04:03.579497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8798ca19-4c0f-41ac-a07f-c327704c4f4b could not be found. Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:04:03.580831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 8798ca19-4c0f-41ac-a07f-c327704c4f4b could not be found. Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8798ca19-4c0f-41ac-a07f-c327704c4f4b could not be found. Oct 12 22:04:03.582242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:03.583935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48b7c2c3-02b0-4d1c-97e5-8ec0b8c3074b tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Returning 400 to user: Volume 8798ca19-4c0f-41ac-a07f-c327704c4f4b could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:04:03.583935 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-48b7c2c3-02b0-4d1c-97e5-8ec0b8c3074b tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments/004eb58b-998a-49a7-9a4d-e5e74b862b36" status: 400 len: 107 microversion: 2.1 time: 0.318680 Oct 12 22:04:03.583935 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 680/1296] 10.222.0.16 () {60 vars in 1433 bytes} [Wed Oct 12 22:04:03 2022] PUT /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments/004eb58b-998a-49a7-9a4d-e5e74b862b36 => generated 107 bytes in 320 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 12 22:04:03.648700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-88a3ea8a-1544-4d87-bca5-fef2ecc98c7f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:03.649206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-88a3ea8a-1544-4d87-bca5-fef2ecc98c7f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:03.656959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88a3ea8a-1544-4d87-bca5-fef2ecc98c7f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:03.657590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88a3ea8a-1544-4d87-bca5-fef2ecc98c7f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:03.658120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88a3ea8a-1544-4d87-bca5-fef2ecc98c7f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:03.658841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88a3ea8a-1544-4d87-bca5-fef2ecc98c7f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:03.659339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88a3ea8a-1544-4d87-bca5-fef2ecc98c7f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:03.659780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88a3ea8a-1544-4d87-bca5-fef2ecc98c7f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:03.726966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:03.751405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a9b98e30-c57e-4d06-a156-901fecc70d6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:03.752496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a9b98e30-c57e-4d06-a156-901fecc70d6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:03.760990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9b98e30-c57e-4d06-a156-901fecc70d6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:03.764273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9b98e30-c57e-4d06-a156-901fecc70d6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:03.764943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9b98e30-c57e-4d06-a156-901fecc70d6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:03.766446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9b98e30-c57e-4d06-a156-901fecc70d6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:03.767073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9b98e30-c57e-4d06-a156-901fecc70d6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:03.767692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9b98e30-c57e-4d06-a156-901fecc70d6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:03.880896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-88a3ea8a-1544-4d87-bca5-fef2ecc98c7f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lazy-loading 'services' on Instance uuid 7169b167-a2fd-4983-af2e-bcc24daf9b72 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:03.921966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a9b98e30-c57e-4d06-a156-901fecc70d6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:03.929828 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a9b98e30-c57e-4d06-a156-901fecc70d6e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.182794 Oct 12 22:04:03.930394 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 681/1297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:03 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:03.993588 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-88a3ea8a-1544-4d87-bca5-fef2ecc98c7f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments/004eb58b-998a-49a7-9a4d-e5e74b862b36" status: 202 len: 0 microversion: 2.1 time: 0.348991 Oct 12 22:04:03.995033 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 617/1298] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 22:04:03 2022] DELETE /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments/004eb58b-998a-49a7-9a4d-e5e74b862b36 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:04:04.003527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fa010de8-3a0b-41d7-b15b-9a649a215a21 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:04.005774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fa010de8-3a0b-41d7-b15b-9a649a215a21 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:04.013083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa010de8-3a0b-41d7-b15b-9a649a215a21 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.013575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa010de8-3a0b-41d7-b15b-9a649a215a21 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.014193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa010de8-3a0b-41d7-b15b-9a649a215a21 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:04.014896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa010de8-3a0b-41d7-b15b-9a649a215a21 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.015383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa010de8-3a0b-41d7-b15b-9a649a215a21 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.015882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa010de8-3a0b-41d7-b15b-9a649a215a21 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:04.041452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1aaff16f-193d-48e5-8d62-a520be1cdcc0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:04.042348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1aaff16f-193d-48e5-8d62-a520be1cdcc0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:04.047162 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fa010de8-3a0b-41d7-b15b-9a649a215a21 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047812 Oct 12 22:04:04.048051 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 682/1299] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:04:03 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:04.055517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1aaff16f-193d-48e5-8d62-a520be1cdcc0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.056099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1aaff16f-193d-48e5-8d62-a520be1cdcc0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.056541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1aaff16f-193d-48e5-8d62-a520be1cdcc0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:04.057766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1aaff16f-193d-48e5-8d62-a520be1cdcc0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.058216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1aaff16f-193d-48e5-8d62-a520be1cdcc0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.058663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1aaff16f-193d-48e5-8d62-a520be1cdcc0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:04.124031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2c2ac2a0-fcab-4e9d-a14d-944c4d8c5b99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:04.125133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2c2ac2a0-fcab-4e9d-a14d-944c4d8c5b99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:04.132136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c2ac2a0-fcab-4e9d-a14d-944c4d8c5b99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.133498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c2ac2a0-fcab-4e9d-a14d-944c4d8c5b99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.134169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c2ac2a0-fcab-4e9d-a14d-944c4d8c5b99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:04.135714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c2ac2a0-fcab-4e9d-a14d-944c4d8c5b99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.136534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c2ac2a0-fcab-4e9d-a14d-944c4d8c5b99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.137069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c2ac2a0-fcab-4e9d-a14d-944c4d8c5b99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:04.239659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2c2ac2a0-fcab-4e9d-a14d-944c4d8c5b99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:04.249898 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2c2ac2a0-fcab-4e9d-a14d-944c4d8c5b99 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1464 microversion: 2.1 time: 0.132642 Oct 12 22:04:04.264766 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 683/1300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:04 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1464 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:04.272030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-024aab5b-3a62-406f-b87d-c4c2baa93401 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:04.272953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-024aab5b-3a62-406f-b87d-c4c2baa93401 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:04.279964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024aab5b-3a62-406f-b87d-c4c2baa93401 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.281461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024aab5b-3a62-406f-b87d-c4c2baa93401 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.282315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024aab5b-3a62-406f-b87d-c4c2baa93401 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:04.283993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024aab5b-3a62-406f-b87d-c4c2baa93401 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.284737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024aab5b-3a62-406f-b87d-c4c2baa93401 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.285582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024aab5b-3a62-406f-b87d-c4c2baa93401 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:04.325664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024aab5b-3a62-406f-b87d-c4c2baa93401 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.326334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024aab5b-3a62-406f-b87d-c4c2baa93401 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.326842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024aab5b-3a62-406f-b87d-c4c2baa93401 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:04.327404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-024aab5b-3a62-406f-b87d-c4c2baa93401 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lazy-loading 'fault' on Instance uuid 18e1ad2a-6b26-4501-af12-49ad23802b5f {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:04.372349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-024aab5b-3a62-406f-b87d-c4c2baa93401 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:04.380290 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-024aab5b-3a62-406f-b87d-c4c2baa93401 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 200 len: 1308 microversion: 2.1 time: 0.113880 Oct 12 22:04:04.381106 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 684/1301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:04 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 1308 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:04.399125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3ee6854f-d37b-4ca2-9cb0-42887f6af6f7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:04.399795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3ee6854f-d37b-4ca2-9cb0-42887f6af6f7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:04.405851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ee6854f-d37b-4ca2-9cb0-42887f6af6f7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.406334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ee6854f-d37b-4ca2-9cb0-42887f6af6f7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.407848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ee6854f-d37b-4ca2-9cb0-42887f6af6f7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:04.408944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ee6854f-d37b-4ca2-9cb0-42887f6af6f7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.409512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1aaff16f-193d-48e5-8d62-a520be1cdcc0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:04.409803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ee6854f-d37b-4ca2-9cb0-42887f6af6f7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.410336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ee6854f-d37b-4ca2-9cb0-42887f6af6f7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:04.417802 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1aaff16f-193d-48e5-8d62-a520be1cdcc0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8" status: 200 len: 1488 microversion: 2.1 time: 0.380652 Oct 12 22:04:04.418373 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 618/1302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:04 2022] GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 => generated 1488 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:04.423005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-667e1221-a530-405b-80c4-d55d6e987d98 req-18bdf927-ff02-4705-9172-06450558efb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa3d69d-dc00-42d4-8d95-14b0a37e08b9", "name": "network-vif-deleted", "tag": "e686fc59-e990-4895-9968-98a0f6eea195"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:04.432957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-667e1221-a530-405b-80c4-d55d6e987d98 req-18bdf927-ff02-4705-9172-06450558efb7 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.433766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-667e1221-a530-405b-80c4-d55d6e987d98 req-18bdf927-ff02-4705-9172-06450558efb7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.434372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-667e1221-a530-405b-80c4-d55d6e987d98 req-18bdf927-ff02-4705-9172-06450558efb7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:04.446408 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-667e1221-a530-405b-80c4-d55d6e987d98 req-18bdf927-ff02-4705-9172-06450558efb7 service nova] Creating event network-vif-deleted:e686fc59-e990-4895-9968-98a0f6eea195 for instance baa3d69d-dc00-42d4-8d95-14b0a37e08b9 on n-h2-861111-1 Oct 12 22:04:04.451683 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-667e1221-a530-405b-80c4-d55d6e987d98 req-18bdf927-ff02-4705-9172-06450558efb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032027 Oct 12 22:04:04.452592 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 619/1303] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:04.457755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-50c601d2-10c9-4ee9-aa17-52686d40c30e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:04.458359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-50c601d2-10c9-4ee9-aa17-52686d40c30e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:04.464952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50c601d2-10c9-4ee9-aa17-52686d40c30e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.466176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50c601d2-10c9-4ee9-aa17-52686d40c30e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.467119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50c601d2-10c9-4ee9-aa17-52686d40c30e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:04.468079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50c601d2-10c9-4ee9-aa17-52686d40c30e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.471495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50c601d2-10c9-4ee9-aa17-52686d40c30e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.472155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50c601d2-10c9-4ee9-aa17-52686d40c30e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:04.500420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-50c601d2-10c9-4ee9-aa17-52686d40c30e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lazy-loading 'flavor' on Instance uuid 75ce6878-173f-47f8-ab81-3c60803702b8 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:04.501366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3ee6854f-d37b-4ca2-9cb0-42887f6af6f7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:04.513540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3ee6854f-d37b-4ca2-9cb0-42887f6af6f7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:04.514990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3ee6854f-d37b-4ca2-9cb0-42887f6af6f7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:04.520449 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3ee6854f-d37b-4ca2-9cb0-42887f6af6f7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.138326 Oct 12 22:04:04.521234 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 685/1304] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:04 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:04.590205 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-50c601d2-10c9-4ee9-aa17-52686d40c30e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "POST /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8/action" status: 202 len: 0 microversion: 2.1 time: 0.136255 Oct 12 22:04:04.590848 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 620/1305] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:04:04 2022] POST /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:04:04.599857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-875be052-cd1b-47d6-a146-eb9af125adb7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:04.600874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-875be052-cd1b-47d6-a146-eb9af125adb7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:04.609831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-875be052-cd1b-47d6-a146-eb9af125adb7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.610406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-875be052-cd1b-47d6-a146-eb9af125adb7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.610915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-875be052-cd1b-47d6-a146-eb9af125adb7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:04.613018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-875be052-cd1b-47d6-a146-eb9af125adb7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.614060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-875be052-cd1b-47d6-a146-eb9af125adb7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.614686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-875be052-cd1b-47d6-a146-eb9af125adb7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:04.775525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-875be052-cd1b-47d6-a146-eb9af125adb7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:04.785485 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-875be052-cd1b-47d6-a146-eb9af125adb7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8" status: 200 len: 1496 microversion: 2.1 time: 0.188864 Oct 12 22:04:04.786120 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 686/1306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:04 2022] GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 => generated 1496 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:04.953976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6e45e70a-8015-4023-a6b4-d1c589e09182 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:04.954816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6e45e70a-8015-4023-a6b4-d1c589e09182 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:04.961543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e45e70a-8015-4023-a6b4-d1c589e09182 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.962026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e45e70a-8015-4023-a6b4-d1c589e09182 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.962878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e45e70a-8015-4023-a6b4-d1c589e09182 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:04.963662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e45e70a-8015-4023-a6b4-d1c589e09182 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:04.964301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e45e70a-8015-4023-a6b4-d1c589e09182 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:04.964739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e45e70a-8015-4023-a6b4-d1c589e09182 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:05.062308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5fec543d-e6dd-484e-80a7-dbe69d10f231 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:05.065368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5fec543d-e6dd-484e-80a7-dbe69d10f231 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:05.073186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fec543d-e6dd-484e-80a7-dbe69d10f231 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:05.073912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fec543d-e6dd-484e-80a7-dbe69d10f231 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:05.074343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fec543d-e6dd-484e-80a7-dbe69d10f231 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:05.075041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fec543d-e6dd-484e-80a7-dbe69d10f231 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:05.075513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fec543d-e6dd-484e-80a7-dbe69d10f231 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:05.075936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fec543d-e6dd-484e-80a7-dbe69d10f231 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:05.115044 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5fec543d-e6dd-484e-80a7-dbe69d10f231 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058167 Oct 12 22:04:05.115657 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 687/1307] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:04:05 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:05.163300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6e45e70a-8015-4023-a6b4-d1c589e09182 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:05.174285 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6e45e70a-8015-4023-a6b4-d1c589e09182 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.224723 Oct 12 22:04:05.174813 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 621/1308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:04 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:05.274074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-388edf2f-4a96-427b-ba32-13dbd853d581 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:05.274690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-388edf2f-4a96-427b-ba32-13dbd853d581 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:05.281918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388edf2f-4a96-427b-ba32-13dbd853d581 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:05.282584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388edf2f-4a96-427b-ba32-13dbd853d581 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:05.283197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388edf2f-4a96-427b-ba32-13dbd853d581 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:05.284266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388edf2f-4a96-427b-ba32-13dbd853d581 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:05.284876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388edf2f-4a96-427b-ba32-13dbd853d581 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:05.285453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388edf2f-4a96-427b-ba32-13dbd853d581 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:05.319406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388edf2f-4a96-427b-ba32-13dbd853d581 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:05.319893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388edf2f-4a96-427b-ba32-13dbd853d581 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:05.320330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-388edf2f-4a96-427b-ba32-13dbd853d581 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:05.320777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-388edf2f-4a96-427b-ba32-13dbd853d581 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lazy-loading 'fault' on Instance uuid baa3d69d-dc00-42d4-8d95-14b0a37e08b9 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:05.364179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-388edf2f-4a96-427b-ba32-13dbd853d581 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:05.372195 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-388edf2f-4a96-427b-ba32-13dbd853d581 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1304 microversion: 2.1 time: 0.102205 Oct 12 22:04:05.372810 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 688/1309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:05 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:05.405059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2c72374a-085d-4ed3-975e-aa615f72dcbb tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:05.405679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2c72374a-085d-4ed3-975e-aa615f72dcbb tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: 18e1ad2a-6b26-4501-af12-49ad23802b5f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:05.411789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c72374a-085d-4ed3-975e-aa615f72dcbb tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:05.412296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c72374a-085d-4ed3-975e-aa615f72dcbb tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:05.412736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c72374a-085d-4ed3-975e-aa615f72dcbb tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:05.413448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c72374a-085d-4ed3-975e-aa615f72dcbb tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:05.413900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c72374a-085d-4ed3-975e-aa615f72dcbb tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:05.414327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c72374a-085d-4ed3-975e-aa615f72dcbb tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:05.430942 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-2c72374a-085d-4ed3-975e-aa615f72dcbb tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] HTTP exception thrown: Instance 18e1ad2a-6b26-4501-af12-49ad23802b5f could not be found. Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2c72374a-085d-4ed3-975e-aa615f72dcbb tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Request method failure captured: Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f HTTP/1.1 Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzlJfp-kLtjwMRJ0CAygwOE7IC7hzQ-TLXh5Y5NKAuCIEldsfH1g84lutHopIeuAbCTqUyHqX6pTwGmdFzg_05Cc6SzyhKZmIFF58LWkW2sSRBVqrIcLl9IJCNZJf2XnXe-evsJMoksOaz2o25-w9Yov4Lm8FMDM2eobT21DIHZemzM Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 32006aee9df347b1a5f00c983dddc655 Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ListImageFiltersTestJSON-374006964 Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:04:05.433166 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:04:05.434827 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/32006aee9df347b1a5f00c983dddc655"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/32006aee9df347b1a5f00c983dddc655"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_32006aee9df347b1a5f00c983dddc655", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/32006aee9df347b1a5f00c983dddc655"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:04:05.434827 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ListImageFiltersTestJSON-374006964 Oct 12 22:04:05.434827 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 32006aee9df347b1a5f00c983dddc655 Oct 12 22:04:05.434827 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-374006964 Oct 12 22:04:05.434827 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ListImageFiltersTestJSON-374006964-project Oct 12 22:04:05.434827 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:04:05.434827 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:04:05.434827 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 26a287fd11f74fefb1f27455763b8a01 Oct 12 22:04:05.434827 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ListImageFiltersTestJSON-374006964-project Oct 12 22:04:05.434827 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:04:05.434827 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 18e1ad2a-6b26-4501-af12-49ad23802b5f could not be found. Oct 12 22:04:05.434827 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '18e1ad2a-6b26-4501-af12-49ad23802b5f'} Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18e1ad2a-6b26-4501-af12-49ad23802b5f could not be found. Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:04:05.435777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18e1ad2a-6b26-4501-af12-49ad23802b5f could not be found. Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18e1ad2a-6b26-4501-af12-49ad23802b5f could not be found. Oct 12 22:04:05.437237 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:04:05.438932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2c72374a-085d-4ed3-975e-aa615f72dcbb tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Returning 404 to user: Instance 18e1ad2a-6b26-4501-af12-49ad23802b5f could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:04:05.438932 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2c72374a-085d-4ed3-975e-aa615f72dcbb tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f" status: 404 len: 111 microversion: 2.1 time: 0.034079 Oct 12 22:04:05.438932 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 622/1310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:05 2022] GET /compute/v2.1/servers/18e1ad2a-6b26-4501-af12-49ad23802b5f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:04:05.443284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5992d880-1237-4fdd-83de-3720611bfec0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:05.443796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5992d880-1237-4fdd-83de-3720611bfec0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: cf71b2a6-484b-4e05-80fb-89be6b98546a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:05.450463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5992d880-1237-4fdd-83de-3720611bfec0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:05.450981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5992d880-1237-4fdd-83de-3720611bfec0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:05.451431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5992d880-1237-4fdd-83de-3720611bfec0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:05.452226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5992d880-1237-4fdd-83de-3720611bfec0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:05.452695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5992d880-1237-4fdd-83de-3720611bfec0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:05.453127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5992d880-1237-4fdd-83de-3720611bfec0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:05.481128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5992d880-1237-4fdd-83de-3720611bfec0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: cf71b2a6-484b-4e05-80fb-89be6b98546a] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:04:05.506362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:05.550609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8248cdb3-079c-4239-b96d-265c51cdc1e5 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:05.551581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8248cdb3-079c-4239-b96d-265c51cdc1e5 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:05.558800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8248cdb3-079c-4239-b96d-265c51cdc1e5 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:05.559496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8248cdb3-079c-4239-b96d-265c51cdc1e5 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:05.560049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8248cdb3-079c-4239-b96d-265c51cdc1e5 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:05.560881 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5992d880-1237-4fdd-83de-3720611bfec0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a" status: 204 len: 0 microversion: 2.1 time: 0.121191 Oct 12 22:04:05.561190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8248cdb3-079c-4239-b96d-265c51cdc1e5 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:05.561680 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 689/1311] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:04:05 2022] DELETE /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:04:05.561818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8248cdb3-079c-4239-b96d-265c51cdc1e5 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:05.562232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8248cdb3-079c-4239-b96d-265c51cdc1e5 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:05.569783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-932fb95e-18c7-470d-9df9-5970813d51a1 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:05.570753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-932fb95e-18c7-470d-9df9-5970813d51a1 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: cf71b2a6-484b-4e05-80fb-89be6b98546a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:05.577425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-932fb95e-18c7-470d-9df9-5970813d51a1 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:05.578115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-932fb95e-18c7-470d-9df9-5970813d51a1 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:05.578719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-932fb95e-18c7-470d-9df9-5970813d51a1 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:05.579597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-932fb95e-18c7-470d-9df9-5970813d51a1 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:05.580052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-932fb95e-18c7-470d-9df9-5970813d51a1 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:05.580483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-932fb95e-18c7-470d-9df9-5970813d51a1 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:05.631136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8248cdb3-079c-4239-b96d-265c51cdc1e5 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:05.639785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8248cdb3-079c-4239-b96d-265c51cdc1e5 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:05.641330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8248cdb3-079c-4239-b96d-265c51cdc1e5 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:05.646429 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8248cdb3-079c-4239-b96d-265c51cdc1e5 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.099510 Oct 12 22:04:05.646901 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 623/1312] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:05 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:05.717942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-932fb95e-18c7-470d-9df9-5970813d51a1 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:05.726286 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-932fb95e-18c7-470d-9df9-5970813d51a1 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a" status: 200 len: 1473 microversion: 2.1 time: 0.160587 Oct 12 22:04:05.726803 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 690/1313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:05 2022] GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a => generated 1473 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:05.810368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5adcd2f9-ee52-43a5-9914-45f7c660b8a0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:05.810981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5adcd2f9-ee52-43a5-9914-45f7c660b8a0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:05.816963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5adcd2f9-ee52-43a5-9914-45f7c660b8a0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:05.817442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5adcd2f9-ee52-43a5-9914-45f7c660b8a0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:05.817874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5adcd2f9-ee52-43a5-9914-45f7c660b8a0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:05.818563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5adcd2f9-ee52-43a5-9914-45f7c660b8a0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:05.819014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5adcd2f9-ee52-43a5-9914-45f7c660b8a0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:05.819466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5adcd2f9-ee52-43a5-9914-45f7c660b8a0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:05.951228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5adcd2f9-ee52-43a5-9914-45f7c660b8a0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:05.958934 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5adcd2f9-ee52-43a5-9914-45f7c660b8a0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8" status: 200 len: 1479 microversion: 2.1 time: 0.152882 Oct 12 22:04:05.959538 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 624/1314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:05 2022] GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 => generated 1479 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:05.982794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d812a2e3-a66e-4b8a-bd17-3c759ef3ce7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1797654098"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:05.985308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d812a2e3-a66e-4b8a-bd17-3c759ef3ce7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:05.991428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d812a2e3-a66e-4b8a-bd17-3c759ef3ce7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:05.991992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d812a2e3-a66e-4b8a-bd17-3c759ef3ce7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:05.992499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d812a2e3-a66e-4b8a-bd17-3c759ef3ce7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:05.993267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d812a2e3-a66e-4b8a-bd17-3c759ef3ce7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:05.993793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d812a2e3-a66e-4b8a-bd17-3c759ef3ce7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:05.994287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d812a2e3-a66e-4b8a-bd17-3c759ef3ce7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:06.128092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-29648423-4c95-4625-bf6b-27f7f1f4280d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:06.130383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-29648423-4c95-4625-bf6b-27f7f1f4280d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:06.137871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29648423-4c95-4625-bf6b-27f7f1f4280d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:06.138949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29648423-4c95-4625-bf6b-27f7f1f4280d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:06.139631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29648423-4c95-4625-bf6b-27f7f1f4280d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:06.140622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29648423-4c95-4625-bf6b-27f7f1f4280d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:06.141288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29648423-4c95-4625-bf6b-27f7f1f4280d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:06.141938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29648423-4c95-4625-bf6b-27f7f1f4280d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:06.177522 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-29648423-4c95-4625-bf6b-27f7f1f4280d tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053401 Oct 12 22:04:06.178904 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 625/1315] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:04:06 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:06.195728 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d812a2e3-a66e-4b8a-bd17-3c759ef3ce7f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "POST /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8/action" status: 202 len: 0 microversion: 2.1 time: 0.217137 Oct 12 22:04:06.196721 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 691/1316] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:04:05 2022] POST /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:04:06.197368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7f6a23e0-df36-4930-a944-cc3f5a7c425b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:06.198186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7f6a23e0-df36-4930-a944-cc3f5a7c425b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:06.204763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f6a23e0-df36-4930-a944-cc3f5a7c425b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:06.205248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f6a23e0-df36-4930-a944-cc3f5a7c425b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:06.205680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f6a23e0-df36-4930-a944-cc3f5a7c425b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:06.206381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f6a23e0-df36-4930-a944-cc3f5a7c425b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:06.206832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f6a23e0-df36-4930-a944-cc3f5a7c425b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:06.207271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f6a23e0-df36-4930-a944-cc3f5a7c425b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:06.209701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6ff67aa4-06c4-4419-996e-0708147267be tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512c40f940>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:06.276385 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6ff67aa4-06c4-4419-996e-0708147267be tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.071872 Oct 12 22:04:06.277500 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 692/1317] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:06 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:06.370322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7f6a23e0-df36-4930-a944-cc3f5a7c425b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:06.378123 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7f6a23e0-df36-4930-a944-cc3f5a7c425b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.184990 Oct 12 22:04:06.378704 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 626/1318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:06 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:06.396153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-90685099-874d-41c0-8222-537cd8e5d854 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:06.397625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-90685099-874d-41c0-8222-537cd8e5d854 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:06.405748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90685099-874d-41c0-8222-537cd8e5d854 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:06.406689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90685099-874d-41c0-8222-537cd8e5d854 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:06.407226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90685099-874d-41c0-8222-537cd8e5d854 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:06.408097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90685099-874d-41c0-8222-537cd8e5d854 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:06.408707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90685099-874d-41c0-8222-537cd8e5d854 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:06.409240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90685099-874d-41c0-8222-537cd8e5d854 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:06.441958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90685099-874d-41c0-8222-537cd8e5d854 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:06.442441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90685099-874d-41c0-8222-537cd8e5d854 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:06.442877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90685099-874d-41c0-8222-537cd8e5d854 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:06.443351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-90685099-874d-41c0-8222-537cd8e5d854 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lazy-loading 'fault' on Instance uuid baa3d69d-dc00-42d4-8d95-14b0a37e08b9 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:06.487977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-90685099-874d-41c0-8222-537cd8e5d854 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:06.495866 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-90685099-874d-41c0-8222-537cd8e5d854 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 200 len: 1304 microversion: 2.1 time: 0.104024 Oct 12 22:04:06.496463 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 693/1319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:06 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:06.676345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-44a7ee97-60de-4535-9926-54a565309c07 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:06.677237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-44a7ee97-60de-4535-9926-54a565309c07 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:06.692168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44a7ee97-60de-4535-9926-54a565309c07 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:06.692769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44a7ee97-60de-4535-9926-54a565309c07 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:06.693214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44a7ee97-60de-4535-9926-54a565309c07 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:06.693932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44a7ee97-60de-4535-9926-54a565309c07 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:06.694387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44a7ee97-60de-4535-9926-54a565309c07 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:06.694817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44a7ee97-60de-4535-9926-54a565309c07 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:06.750357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-294e9e10-4277-4317-9c5a-b5232cc4b660 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:06.751323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-294e9e10-4277-4317-9c5a-b5232cc4b660 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: cf71b2a6-484b-4e05-80fb-89be6b98546a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:06.758000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-294e9e10-4277-4317-9c5a-b5232cc4b660 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:06.758801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-294e9e10-4277-4317-9c5a-b5232cc4b660 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:06.759766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-294e9e10-4277-4317-9c5a-b5232cc4b660 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:06.760817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-294e9e10-4277-4317-9c5a-b5232cc4b660 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:06.761446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-294e9e10-4277-4317-9c5a-b5232cc4b660 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:06.761975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-294e9e10-4277-4317-9c5a-b5232cc4b660 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:06.788074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-44a7ee97-60de-4535-9926-54a565309c07 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:06.804269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-44a7ee97-60de-4535-9926-54a565309c07 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:06.805921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-44a7ee97-60de-4535-9926-54a565309c07 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:06.814476 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-44a7ee97-60de-4535-9926-54a565309c07 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.143853 Oct 12 22:04:06.815781 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 627/1320] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:06 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:06.922899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-294e9e10-4277-4317-9c5a-b5232cc4b660 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:06.930682 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-294e9e10-4277-4317-9c5a-b5232cc4b660 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a" status: 200 len: 1473 microversion: 2.1 time: 0.184632 Oct 12 22:04:06.931280 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 694/1321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:06 2022] GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a => generated 1473 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:07.191500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c07aaf2d-53e0-4b71-aa38-31a1b5614cc4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:07.193665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c07aaf2d-53e0-4b71-aa38-31a1b5614cc4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:07.200057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c07aaf2d-53e0-4b71-aa38-31a1b5614cc4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:07.200536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c07aaf2d-53e0-4b71-aa38-31a1b5614cc4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:07.200961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c07aaf2d-53e0-4b71-aa38-31a1b5614cc4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:07.201654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c07aaf2d-53e0-4b71-aa38-31a1b5614cc4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:07.202099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c07aaf2d-53e0-4b71-aa38-31a1b5614cc4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:07.202517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c07aaf2d-53e0-4b71-aa38-31a1b5614cc4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:07.235940 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c07aaf2d-53e0-4b71-aa38-31a1b5614cc4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048467 Oct 12 22:04:07.236519 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 628/1322] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:04:07 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:07.293007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5b58be51-6326-42d2-9dbc-c32b82cac8c2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512c3ab280>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:07.336571 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5b58be51-6326-42d2-9dbc-c32b82cac8c2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.047748 Oct 12 22:04:07.337311 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 695/1323] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:07 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:07.406431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-17953de1-52c6-4416-aa74-8a92551d22a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:07.407048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-17953de1-52c6-4416-aa74-8a92551d22a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:07.414711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17953de1-52c6-4416-aa74-8a92551d22a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:07.415507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17953de1-52c6-4416-aa74-8a92551d22a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:07.416087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17953de1-52c6-4416-aa74-8a92551d22a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:07.418048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17953de1-52c6-4416-aa74-8a92551d22a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:07.418714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17953de1-52c6-4416-aa74-8a92551d22a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:07.419313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17953de1-52c6-4416-aa74-8a92551d22a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:07.498889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-362f9cd7-1a68-4d69-b9e5-b6d335aaa7dc tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:07.500748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-362f9cd7-1a68-4d69-b9e5-b6d335aaa7dc tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:07.508220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-362f9cd7-1a68-4d69-b9e5-b6d335aaa7dc tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:07.508722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-362f9cd7-1a68-4d69-b9e5-b6d335aaa7dc tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:07.509337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-362f9cd7-1a68-4d69-b9e5-b6d335aaa7dc tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:07.510602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-362f9cd7-1a68-4d69-b9e5-b6d335aaa7dc tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:07.511209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-362f9cd7-1a68-4d69-b9e5-b6d335aaa7dc tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:07.511668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-362f9cd7-1a68-4d69-b9e5-b6d335aaa7dc tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:07.585305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-17953de1-52c6-4416-aa74-8a92551d22a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:07.596005 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-17953de1-52c6-4416-aa74-8a92551d22a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.195886 Oct 12 22:04:07.597001 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 629/1324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:07 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:07.614550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aacba1ee-b549-4153-8349-01e7bafb6080 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:07.615432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-aacba1ee-b549-4153-8349-01e7bafb6080 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: baa3d69d-dc00-42d4-8d95-14b0a37e08b9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:07.621406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aacba1ee-b549-4153-8349-01e7bafb6080 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:07.622000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aacba1ee-b549-4153-8349-01e7bafb6080 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:07.622449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aacba1ee-b549-4153-8349-01e7bafb6080 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:07.623339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aacba1ee-b549-4153-8349-01e7bafb6080 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:07.624144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aacba1ee-b549-4153-8349-01e7bafb6080 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:07.624725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aacba1ee-b549-4153-8349-01e7bafb6080 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:07.639191 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-aacba1ee-b549-4153-8349-01e7bafb6080 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] HTTP exception thrown: Instance baa3d69d-dc00-42d4-8d95-14b0a37e08b9 could not be found. Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aacba1ee-b549-4153-8349-01e7bafb6080 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Request method failure captured: Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 HTTP/1.1 Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzlcg6yahUveKaNJHG0_fBJl72GyuKTwPZIo3EwB5f3oFElsYffpMdn3ZS8hvDvO08xumq1Fysc_ZALiaveqOlcKSbFqgDFtWfWRqPdUaa4FPpWX5Qo37jp-MzplFy1T-jY0vdg6FrklLbkk1-n19CSykCTC24WlL9xs0Z0L1H09bAc Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: b06c433b364c4a3093c13202b785bc1e Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerRescueTestJSON-795272125 Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:04:07.641120 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:04:07.642695 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b06c433b364c4a3093c13202b785bc1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b06c433b364c4a3093c13202b785bc1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b06c433b364c4a3093c13202b785bc1e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b06c433b364c4a3093c13202b785bc1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:04:07.642695 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerRescueTestJSON-795272125 Oct 12 22:04:07.642695 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: b06c433b364c4a3093c13202b785bc1e Oct 12 22:04:07.642695 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerRescueTestJSON-795272125 Oct 12 22:04:07.642695 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerRescueTestJSON-795272125-project Oct 12 22:04:07.642695 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:04:07.642695 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:04:07.642695 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: ad5b2d0e307f4b008479ff4927b77cb2 Oct 12 22:04:07.642695 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerRescueTestJSON-795272125-project Oct 12 22:04:07.642695 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:04:07.642695 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance baa3d69d-dc00-42d4-8d95-14b0a37e08b9 could not be found. Oct 12 22:04:07.642695 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'baa3d69d-dc00-42d4-8d95-14b0a37e08b9'} Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baa3d69d-dc00-42d4-8d95-14b0a37e08b9 could not be found. Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:04:07.643645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baa3d69d-dc00-42d4-8d95-14b0a37e08b9 could not be found. Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baa3d69d-dc00-42d4-8d95-14b0a37e08b9 could not be found. Oct 12 22:04:07.645140 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:04:07.646674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aacba1ee-b549-4153-8349-01e7bafb6080 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Returning 404 to user: Instance baa3d69d-dc00-42d4-8d95-14b0a37e08b9 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:04:07.646674 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-aacba1ee-b549-4153-8349-01e7bafb6080 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9" status: 404 len: 111 microversion: 2.1 time: 0.044410 Oct 12 22:04:07.646674 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 630/1325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:07 2022] GET /compute/v2.1/servers/baa3d69d-dc00-42d4-8d95-14b0a37e08b9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:04:07.651829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b26a4da-5a21-4964-97b0-e765c4f13074 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:07.652369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6b26a4da-5a21-4964-97b0-e765c4f13074 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:07.659192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b26a4da-5a21-4964-97b0-e765c4f13074 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:07.659711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b26a4da-5a21-4964-97b0-e765c4f13074 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:07.660144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b26a4da-5a21-4964-97b0-e765c4f13074 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:07.660851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b26a4da-5a21-4964-97b0-e765c4f13074 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:07.661303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b26a4da-5a21-4964-97b0-e765c4f13074 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:07.661731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b26a4da-5a21-4964-97b0-e765c4f13074 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:07.669661 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-362f9cd7-1a68-4d69-b9e5-b6d335aaa7dc tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1858 microversion: 2.1 time: 0.174448 Oct 12 22:04:07.670739 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 696/1326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:07 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1858 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:07.689604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6b26a4da-5a21-4964-97b0-e765c4f13074 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:04:07.692564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e9797617-30bd-4fc5-91fe-1ca60265136c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-861111-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:07.695218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e9797617-30bd-4fc5-91fe-1ca60265136c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:07.701591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9797617-30bd-4fc5-91fe-1ca60265136c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:07.702080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9797617-30bd-4fc5-91fe-1ca60265136c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:07.702518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9797617-30bd-4fc5-91fe-1ca60265136c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:07.703212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9797617-30bd-4fc5-91fe-1ca60265136c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:07.703692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9797617-30bd-4fc5-91fe-1ca60265136c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:07.704112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9797617-30bd-4fc5-91fe-1ca60265136c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:07.730604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-e9797617-30bd-4fc5-91fe-1ca60265136c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lazy-loading 'flavor' on Instance uuid 3d06c998-c0a6-4bb7-8538-9a7b0298b918 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:07.743344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e9797617-30bd-4fc5-91fe-1ca60265136c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Going to try to live migrate instance to n-h1-861111-1 {{(pid=120453) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:04:07.804691 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6b26a4da-5a21-4964-97b0-e765c4f13074 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 204 len: 0 microversion: 2.1 time: 0.156871 Oct 12 22:04:07.808782 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 631/1327] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:04:07 2022] DELETE /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:04:07.814754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-903cdf54-7e63-483f-ae3d-465cc929bd3e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:07.815941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-903cdf54-7e63-483f-ae3d-465cc929bd3e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:07.822092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-903cdf54-7e63-483f-ae3d-465cc929bd3e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:07.822606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-903cdf54-7e63-483f-ae3d-465cc929bd3e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:07.823036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-903cdf54-7e63-483f-ae3d-465cc929bd3e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:07.823849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-903cdf54-7e63-483f-ae3d-465cc929bd3e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:07.824297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-903cdf54-7e63-483f-ae3d-465cc929bd3e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:07.824717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-903cdf54-7e63-483f-ae3d-465cc929bd3e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:07.830198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:07.979739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-903cdf54-7e63-483f-ae3d-465cc929bd3e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:07.988892 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-903cdf54-7e63-483f-ae3d-465cc929bd3e tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1491 microversion: 2.1 time: 0.178489 Oct 12 22:04:07.989460 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 632/1328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:07 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1491 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:07.994930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-15cc0ce5-1e34-4056-8e33-208105a3695a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:07.995454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-15cc0ce5-1e34-4056-8e33-208105a3695a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:08.001393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15cc0ce5-1e34-4056-8e33-208105a3695a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:08.001888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15cc0ce5-1e34-4056-8e33-208105a3695a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:08.002324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15cc0ce5-1e34-4056-8e33-208105a3695a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:08.003000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15cc0ce5-1e34-4056-8e33-208105a3695a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:08.003501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15cc0ce5-1e34-4056-8e33-208105a3695a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:08.003931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15cc0ce5-1e34-4056-8e33-208105a3695a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:08.084266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-15cc0ce5-1e34-4056-8e33-208105a3695a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:08.092923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-15cc0ce5-1e34-4056-8e33-208105a3695a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:08.094521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-15cc0ce5-1e34-4056-8e33-208105a3695a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:08.099821 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-15cc0ce5-1e34-4056-8e33-208105a3695a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.109410 Oct 12 22:04:08.100704 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 633/1329] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:07 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:08.118231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1cf9e05c-5aff-453f-88ff-8b05b0db6e41 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:08.119163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1cf9e05c-5aff-453f-88ff-8b05b0db6e41 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: cf71b2a6-484b-4e05-80fb-89be6b98546a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:08.127449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cf9e05c-5aff-453f-88ff-8b05b0db6e41 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:08.127889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cf9e05c-5aff-453f-88ff-8b05b0db6e41 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:08.128418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cf9e05c-5aff-453f-88ff-8b05b0db6e41 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:08.129416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cf9e05c-5aff-453f-88ff-8b05b0db6e41 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:08.129873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cf9e05c-5aff-453f-88ff-8b05b0db6e41 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:08.130346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cf9e05c-5aff-453f-88ff-8b05b0db6e41 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:08.271834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1cf9e05c-5aff-453f-88ff-8b05b0db6e41 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:08.279770 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1cf9e05c-5aff-453f-88ff-8b05b0db6e41 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a" status: 200 len: 1473 microversion: 2.1 time: 0.166493 Oct 12 22:04:08.280343 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 634/1330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:08 2022] GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a => generated 1473 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:08.284889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1bbce25-0b4d-4eb6-a359-e880bf6982af tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:08.287113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a1bbce25-0b4d-4eb6-a359-e880bf6982af tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:08.293674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1bbce25-0b4d-4eb6-a359-e880bf6982af tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:08.294337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1bbce25-0b4d-4eb6-a359-e880bf6982af tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:08.294970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1bbce25-0b4d-4eb6-a359-e880bf6982af tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:08.295882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1bbce25-0b4d-4eb6-a359-e880bf6982af tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:08.296506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1bbce25-0b4d-4eb6-a359-e880bf6982af tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:08.296936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1bbce25-0b4d-4eb6-a359-e880bf6982af tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:08.331352 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a1bbce25-0b4d-4eb6-a359-e880bf6982af tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049758 Oct 12 22:04:08.332304 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 635/1331] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:04:08 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:08.355478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-89cb61ea-41e2-45bd-a577-90f98a5d4c2c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512841c820>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:08.410738 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-89cb61ea-41e2-45bd-a577-90f98a5d4c2c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.062303 Oct 12 22:04:08.411320 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 636/1332] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:08 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:08.619879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3cfe765f-e006-41a2-8ea9-bf324c052d4d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:08.620502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3cfe765f-e006-41a2-8ea9-bf324c052d4d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:08.626775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3cfe765f-e006-41a2-8ea9-bf324c052d4d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:08.627287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3cfe765f-e006-41a2-8ea9-bf324c052d4d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:08.627732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3cfe765f-e006-41a2-8ea9-bf324c052d4d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:08.628430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3cfe765f-e006-41a2-8ea9-bf324c052d4d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:08.628885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3cfe765f-e006-41a2-8ea9-bf324c052d4d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:08.629311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3cfe765f-e006-41a2-8ea9-bf324c052d4d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:08.815230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3cfe765f-e006-41a2-8ea9-bf324c052d4d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:08.824261 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3cfe765f-e006-41a2-8ea9-bf324c052d4d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.208221 Oct 12 22:04:08.824873 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 637/1333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:08 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:09.014170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-03e34cf8-3538-4c5e-9d14-284c8bb0e3be tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:09.014776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-03e34cf8-3538-4c5e-9d14-284c8bb0e3be tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:09.020722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03e34cf8-3538-4c5e-9d14-284c8bb0e3be tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:09.021203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03e34cf8-3538-4c5e-9d14-284c8bb0e3be tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:09.021637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03e34cf8-3538-4c5e-9d14-284c8bb0e3be tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:09.022322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03e34cf8-3538-4c5e-9d14-284c8bb0e3be tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:09.022768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03e34cf8-3538-4c5e-9d14-284c8bb0e3be tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:09.023191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03e34cf8-3538-4c5e-9d14-284c8bb0e3be tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:09.268106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-03e34cf8-3538-4c5e-9d14-284c8bb0e3be tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:09.276149 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-03e34cf8-3538-4c5e-9d14-284c8bb0e3be tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1491 microversion: 2.1 time: 0.266272 Oct 12 22:04:09.291179 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 638/1334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:09 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1491 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:09.292430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d20fad28-80ed-4aa7-8740-8134f574ec26 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:09.293747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d20fad28-80ed-4aa7-8740-8134f574ec26 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:09.300642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d20fad28-80ed-4aa7-8740-8134f574ec26 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:09.301220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d20fad28-80ed-4aa7-8740-8134f574ec26 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:09.301667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d20fad28-80ed-4aa7-8740-8134f574ec26 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:09.302381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d20fad28-80ed-4aa7-8740-8134f574ec26 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:09.302884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d20fad28-80ed-4aa7-8740-8134f574ec26 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:09.303923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d20fad28-80ed-4aa7-8740-8134f574ec26 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:09.385449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d20fad28-80ed-4aa7-8740-8134f574ec26 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:09.393456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d20fad28-80ed-4aa7-8740-8134f574ec26 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:09.394916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d20fad28-80ed-4aa7-8740-8134f574ec26 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:09.399817 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d20fad28-80ed-4aa7-8740-8134f574ec26 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.121614 Oct 12 22:04:09.400910 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 639/1335] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:09 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:09.415156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e707aa13-438e-4c18-93d6-5115406edadf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:09.416415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e707aa13-438e-4c18-93d6-5115406edadf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: cf71b2a6-484b-4e05-80fb-89be6b98546a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:09.423429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e707aa13-438e-4c18-93d6-5115406edadf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:09.424151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e707aa13-438e-4c18-93d6-5115406edadf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:09.424724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e707aa13-438e-4c18-93d6-5115406edadf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:09.425839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e707aa13-438e-4c18-93d6-5115406edadf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:09.426183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e707aa13-438e-4c18-93d6-5115406edadf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:09.426743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e707aa13-438e-4c18-93d6-5115406edadf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:09.690766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e707aa13-438e-4c18-93d6-5115406edadf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:09.701685 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e707aa13-438e-4c18-93d6-5115406edadf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a" status: 200 len: 1473 microversion: 2.1 time: 0.299602 Oct 12 22:04:09.702276 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 640/1336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:09 2022] GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a => generated 1473 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:09.707696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-70293934-341d-479d-bdc8-d01fa0c6b4dd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:09.710306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-70293934-341d-479d-bdc8-d01fa0c6b4dd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:09.716358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:09.718364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70293934-341d-479d-bdc8-d01fa0c6b4dd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:09.719054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70293934-341d-479d-bdc8-d01fa0c6b4dd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:09.719940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70293934-341d-479d-bdc8-d01fa0c6b4dd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:09.720927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70293934-341d-479d-bdc8-d01fa0c6b4dd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:09.721379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70293934-341d-479d-bdc8-d01fa0c6b4dd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:09.721801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70293934-341d-479d-bdc8-d01fa0c6b4dd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:09.754697 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-70293934-341d-479d-bdc8-d01fa0c6b4dd tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050764 Oct 12 22:04:09.755569 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 641/1337] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:04:09 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:09.760483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c8d0ac6e-e846-4589-8d6c-b14d0fdb9e4d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128411700>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:09.808308 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c8d0ac6e-e846-4589-8d6c-b14d0fdb9e4d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.051553 Oct 12 22:04:09.808882 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 642/1338] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:09 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:09.816491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-0f3d1a27-a138-462f-b9ac-179ed30ff33f req-c361b189-a396-4833-972b-dbd83f8aa1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf71b2a6-484b-4e05-80fb-89be6b98546a", "name": "network-vif-deleted", "tag": "e7a4b681-6708-4e63-905c-13cb884689e3"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:09.824054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0f3d1a27-a138-462f-b9ac-179ed30ff33f req-c361b189-a396-4833-972b-dbd83f8aa1d4 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:09.824839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0f3d1a27-a138-462f-b9ac-179ed30ff33f req-c361b189-a396-4833-972b-dbd83f8aa1d4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:09.825040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0f3d1a27-a138-462f-b9ac-179ed30ff33f req-c361b189-a396-4833-972b-dbd83f8aa1d4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:09.835360 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-0f3d1a27-a138-462f-b9ac-179ed30ff33f req-c361b189-a396-4833-972b-dbd83f8aa1d4 service nova] Creating event network-vif-deleted:e7a4b681-6708-4e63-905c-13cb884689e3 for instance cf71b2a6-484b-4e05-80fb-89be6b98546a on n-h2-861111-1 Oct 12 22:04:09.840941 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-0f3d1a27-a138-462f-b9ac-179ed30ff33f req-c361b189-a396-4833-972b-dbd83f8aa1d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030915 Oct 12 22:04:09.841839 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 643/1339] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:09.846732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b974dd0c-baa4-429e-b648-ca70aa7e4491 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:09.847522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b974dd0c-baa4-429e-b648-ca70aa7e4491 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:09.853384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b974dd0c-baa4-429e-b648-ca70aa7e4491 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:09.853893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b974dd0c-baa4-429e-b648-ca70aa7e4491 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:09.854316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b974dd0c-baa4-429e-b648-ca70aa7e4491 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:09.854998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b974dd0c-baa4-429e-b648-ca70aa7e4491 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:09.855465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b974dd0c-baa4-429e-b648-ca70aa7e4491 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:09.855884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b974dd0c-baa4-429e-b648-ca70aa7e4491 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:09.992035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b974dd0c-baa4-429e-b648-ca70aa7e4491 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:10.000440 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b974dd0c-baa4-429e-b648-ca70aa7e4491 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.157451 Oct 12 22:04:10.001014 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 644/1340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:09 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:10.301359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eed0e6a3-84e7-40ae-aac2-32ae90f278a2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:10.301970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eed0e6a3-84e7-40ae-aac2-32ae90f278a2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:10.308833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eed0e6a3-84e7-40ae-aac2-32ae90f278a2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:10.309391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eed0e6a3-84e7-40ae-aac2-32ae90f278a2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:10.312793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eed0e6a3-84e7-40ae-aac2-32ae90f278a2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:10.312793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eed0e6a3-84e7-40ae-aac2-32ae90f278a2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:10.312793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eed0e6a3-84e7-40ae-aac2-32ae90f278a2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:10.312793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eed0e6a3-84e7-40ae-aac2-32ae90f278a2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:10.444715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eed0e6a3-84e7-40ae-aac2-32ae90f278a2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:10.452415 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eed0e6a3-84e7-40ae-aac2-32ae90f278a2 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1491 microversion: 2.1 time: 0.154881 Oct 12 22:04:10.452966 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 645/1341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:10 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1491 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:10.457292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-200c1907-fdcf-422b-8f38-b702a87d55cc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:10.457884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-200c1907-fdcf-422b-8f38-b702a87d55cc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:10.463487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-200c1907-fdcf-422b-8f38-b702a87d55cc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:10.463966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-200c1907-fdcf-422b-8f38-b702a87d55cc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:10.464396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-200c1907-fdcf-422b-8f38-b702a87d55cc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:10.465081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-200c1907-fdcf-422b-8f38-b702a87d55cc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:10.465526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-200c1907-fdcf-422b-8f38-b702a87d55cc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:10.465944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-200c1907-fdcf-422b-8f38-b702a87d55cc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:10.528326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-200c1907-fdcf-422b-8f38-b702a87d55cc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:10.536218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-200c1907-fdcf-422b-8f38-b702a87d55cc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:10.537749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-200c1907-fdcf-422b-8f38-b702a87d55cc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:10.542780 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-200c1907-fdcf-422b-8f38-b702a87d55cc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.088893 Oct 12 22:04:10.543369 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 646/1342] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:10 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:10.727417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4381a8d0-8809-4204-a4c3-14cdd2573101 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:10.728028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4381a8d0-8809-4204-a4c3-14cdd2573101 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: cf71b2a6-484b-4e05-80fb-89be6b98546a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:10.740106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4381a8d0-8809-4204-a4c3-14cdd2573101 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:10.741776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4381a8d0-8809-4204-a4c3-14cdd2573101 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:10.744988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4381a8d0-8809-4204-a4c3-14cdd2573101 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:10.746046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4381a8d0-8809-4204-a4c3-14cdd2573101 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:10.746726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4381a8d0-8809-4204-a4c3-14cdd2573101 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:10.747503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4381a8d0-8809-4204-a4c3-14cdd2573101 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:10.806504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4381a8d0-8809-4204-a4c3-14cdd2573101 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:10.807101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4381a8d0-8809-4204-a4c3-14cdd2573101 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:10.807638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4381a8d0-8809-4204-a4c3-14cdd2573101 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:10.808153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-4381a8d0-8809-4204-a4c3-14cdd2573101 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lazy-loading 'fault' on Instance uuid cf71b2a6-484b-4e05-80fb-89be6b98546a {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:10.880510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4381a8d0-8809-4204-a4c3-14cdd2573101 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a287fd11f74fefb1f27455763b8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32006aee9df347b1a5f00c983dddc655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:10.892374 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4381a8d0-8809-4204-a4c3-14cdd2573101 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a" status: 200 len: 1307 microversion: 2.1 time: 0.169077 Oct 12 22:04:10.904545 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 647/1343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:10 2022] GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a => generated 1307 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:10.904545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3d50be0b-96c5-4774-a150-00912d6211e8 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:10.904545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3d50be0b-96c5-4774-a150-00912d6211e8 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:10.912195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d50be0b-96c5-4774-a150-00912d6211e8 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:10.912195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d50be0b-96c5-4774-a150-00912d6211e8 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:10.912195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d50be0b-96c5-4774-a150-00912d6211e8 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:10.912658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d50be0b-96c5-4774-a150-00912d6211e8 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:10.913305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d50be0b-96c5-4774-a150-00912d6211e8 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:10.913741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d50be0b-96c5-4774-a150-00912d6211e8 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:10.948801 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3d50be0b-96c5-4774-a150-00912d6211e8 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053678 Oct 12 22:04:10.949689 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 648/1344] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:04:10 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:04:10.954525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e0fb8d82-2b21-486d-b118-1ec8abcb7fc9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128411670>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:11.013557 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e0fb8d82-2b21-486d-b118-1ec8abcb7fc9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.062598 Oct 12 22:04:11.014645 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 649/1345] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:10 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:11.020301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e19d8c78-eeec-4683-85ba-6f71f3abafe6 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:11.021297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e19d8c78-eeec-4683-85ba-6f71f3abafe6 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:11.029097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e19d8c78-eeec-4683-85ba-6f71f3abafe6 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:11.029643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e19d8c78-eeec-4683-85ba-6f71f3abafe6 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:11.030586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e19d8c78-eeec-4683-85ba-6f71f3abafe6 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:11.031338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e19d8c78-eeec-4683-85ba-6f71f3abafe6 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:11.031799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e19d8c78-eeec-4683-85ba-6f71f3abafe6 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:11.032226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e19d8c78-eeec-4683-85ba-6f71f3abafe6 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:11.247114 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e9797617-30bd-4fc5-91fe-1ca60265136c tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/action" status: 202 len: 0 microversion: 2.1 time: 3.557758 Oct 12 22:04:11.251974 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 697/1346] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:04:07 2022] POST /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/action => generated 0 bytes in 3561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:04:11.260581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0300f2a3-bb3e-42f2-8a96-3993fee98e23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:11.261863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0300f2a3-bb3e-42f2-8a96-3993fee98e23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:11.269229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0300f2a3-bb3e-42f2-8a96-3993fee98e23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:11.269699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0300f2a3-bb3e-42f2-8a96-3993fee98e23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:11.270217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0300f2a3-bb3e-42f2-8a96-3993fee98e23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:11.270941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0300f2a3-bb3e-42f2-8a96-3993fee98e23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:11.271436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0300f2a3-bb3e-42f2-8a96-3993fee98e23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:11.272122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0300f2a3-bb3e-42f2-8a96-3993fee98e23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:11.382227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-e19d8c78-eeec-4683-85ba-6f71f3abafe6 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'services' on Instance uuid 247e0252-3374-40b8-85f3-995d2031867d {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:11.397959 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e19d8c78-eeec-4683-85ba-6f71f3abafe6 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 2344 microversion: 2.25 time: 0.381479 Oct 12 22:04:11.399035 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 650/1347] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:11 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 2344 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:11.404477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2026535617", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "aa0cae96-e59b-4fec-88a6-dca6873049ef"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:11.456125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0300f2a3-bb3e-42f2-8a96-3993fee98e23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:11.476032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] validate_networks() for [('aa0cae96-e59b-4fec-88a6-dca6873049ef', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:04:11.480050 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0300f2a3-bb3e-42f2-8a96-3993fee98e23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.219211 Oct 12 22:04:11.480711 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 698/1348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:11 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:11.487143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-41eec447-e585-4b59-86ea-8f59198cf878 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:11.487787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-41eec447-e585-4b59-86ea-8f59198cf878 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:11.504153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41eec447-e585-4b59-86ea-8f59198cf878 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:11.504649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41eec447-e585-4b59-86ea-8f59198cf878 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:11.505087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41eec447-e585-4b59-86ea-8f59198cf878 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:11.505829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41eec447-e585-4b59-86ea-8f59198cf878 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:11.506278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41eec447-e585-4b59-86ea-8f59198cf878 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:11.506700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41eec447-e585-4b59-86ea-8f59198cf878 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:11.774831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-41eec447-e585-4b59-86ea-8f59198cf878 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:11.783767 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-41eec447-e585-4b59-86ea-8f59198cf878 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.300673 Oct 12 22:04:11.799943 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 699/1349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:11 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:11.809030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-deb32237-440a-402c-a142-a541431eb76c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:11.813011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-deb32237-440a-402c-a142-a541431eb76c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:11.813749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-deb32237-440a-402c-a142-a541431eb76c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:11.814420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-deb32237-440a-402c-a142-a541431eb76c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:11.815596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-deb32237-440a-402c-a142-a541431eb76c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:11.816292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-deb32237-440a-402c-a142-a541431eb76c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:11.816929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-deb32237-440a-402c-a142-a541431eb76c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:11.852837 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-deb32237-440a-402c-a142-a541431eb76c tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.051620 Oct 12 22:04:11.862360 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 700/1350] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Oct 12 22:04:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:04:11.868119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d149b150-012a-40b2-8d8e-38403a2c5587 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:11.869770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d149b150-012a-40b2-8d8e-38403a2c5587 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:11.877223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d149b150-012a-40b2-8d8e-38403a2c5587 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:11.877926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d149b150-012a-40b2-8d8e-38403a2c5587 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:11.878586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d149b150-012a-40b2-8d8e-38403a2c5587 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:11.880144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d149b150-012a-40b2-8d8e-38403a2c5587 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:11.880838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d149b150-012a-40b2-8d8e-38403a2c5587 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:11.881469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d149b150-012a-40b2-8d8e-38403a2c5587 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:11.917963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d149b150-012a-40b2-8d8e-38403a2c5587 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:11.918959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d149b150-012a-40b2-8d8e-38403a2c5587 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:11.919649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d149b150-012a-40b2-8d8e-38403a2c5587 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:11.920305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-d149b150-012a-40b2-8d8e-38403a2c5587 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lazy-loading 'fault' on Instance uuid 5a5599b6-e17a-41b1-80a1-a43e278b013b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:12.000765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d149b150-012a-40b2-8d8e-38403a2c5587 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5b2d0e307f4b008479ff4927b77cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06c433b364c4a3093c13202b785bc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:12.009346 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d149b150-012a-40b2-8d8e-38403a2c5587 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 200 len: 1303 microversion: 2.1 time: 0.145696 Oct 12 22:04:12.009936 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 701/1351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:11 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 1303 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:12.018211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a25895fb-12aa-4627-aaeb-50998542df1f req-7b497539-3059-430a-acb5-a14ec5c02e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ce6878-173f-47f8-ab81-3c60803702b8", "name": "network-vif-plugged", "status": "completed", "tag": "7986b344-6016-4f6c-9d7d-12efc709af4c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:12.044654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a25895fb-12aa-4627-aaeb-50998542df1f req-7b497539-3059-430a-acb5-a14ec5c02e0a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:12.045135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a25895fb-12aa-4627-aaeb-50998542df1f req-7b497539-3059-430a-acb5-a14ec5c02e0a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:12.045564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a25895fb-12aa-4627-aaeb-50998542df1f req-7b497539-3059-430a-acb5-a14ec5c02e0a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:12.061975 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a25895fb-12aa-4627-aaeb-50998542df1f req-7b497539-3059-430a-acb5-a14ec5c02e0a service nova] Creating event network-vif-plugged:7986b344-6016-4f6c-9d7d-12efc709af4c for instance 75ce6878-173f-47f8-ab81-3c60803702b8 on n-h1-861111-1 Oct 12 22:04:12.068308 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a25895fb-12aa-4627-aaeb-50998542df1f req-7b497539-3059-430a-acb5-a14ec5c02e0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053403 Oct 12 22:04:12.073782 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 702/1352] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:12.079704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4c145983-eac4-4054-9837-b7a402a6d323 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:12.080220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4c145983-eac4-4054-9837-b7a402a6d323 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:12.095895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c145983-eac4-4054-9837-b7a402a6d323 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:12.096605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c145983-eac4-4054-9837-b7a402a6d323 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:12.097329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c145983-eac4-4054-9837-b7a402a6d323 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:12.098208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c145983-eac4-4054-9837-b7a402a6d323 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:12.098822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c145983-eac4-4054-9837-b7a402a6d323 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:12.099439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c145983-eac4-4054-9837-b7a402a6d323 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:12.186956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4c145983-eac4-4054-9837-b7a402a6d323 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:12.199773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4c145983-eac4-4054-9837-b7a402a6d323 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:12.202394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4c145983-eac4-4054-9837-b7a402a6d323 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:12.209014 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4c145983-eac4-4054-9837-b7a402a6d323 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.133744 Oct 12 22:04:12.210076 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 703/1353] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:12 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:12.216689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb5c8d4b-5442-45c8-a321-7a2183095faf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:12.217614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cb5c8d4b-5442-45c8-a321-7a2183095faf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] [instance: cf71b2a6-484b-4e05-80fb-89be6b98546a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:12.225390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb5c8d4b-5442-45c8-a321-7a2183095faf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:12.226237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb5c8d4b-5442-45c8-a321-7a2183095faf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:12.226901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb5c8d4b-5442-45c8-a321-7a2183095faf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:12.227890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb5c8d4b-5442-45c8-a321-7a2183095faf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:12.228975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb5c8d4b-5442-45c8-a321-7a2183095faf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:12.229611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb5c8d4b-5442-45c8-a321-7a2183095faf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:12.250205 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-cb5c8d4b-5442-45c8-a321-7a2183095faf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] HTTP exception thrown: Instance cf71b2a6-484b-4e05-80fb-89be6b98546a could not be found. Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb5c8d4b-5442-45c8-a321-7a2183095faf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Request method failure captured: Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a HTTP/1.1 Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlJfp-kLtjwMRJ0CAygwOE7IC7hzQ-TLXh5Y5NKAuCIEldsfH1g84lutHopIeuAbCTqUyHqX6pTwGmdFzg_05Cc6SzyhKZmIFF58LWkW2sSRBVqrIcLl9IJCNZJf2XnXe-evsJMoksOaz2o25-w9Yov4Lm8FMDM2eobT21DIHZemzM Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 32006aee9df347b1a5f00c983dddc655 Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ListImageFiltersTestJSON-374006964 Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:04:12.252822 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:04:12.254137 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/32006aee9df347b1a5f00c983dddc655"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/32006aee9df347b1a5f00c983dddc655"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_32006aee9df347b1a5f00c983dddc655", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/32006aee9df347b1a5f00c983dddc655"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:04:12.254137 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ListImageFiltersTestJSON-374006964 Oct 12 22:04:12.254137 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 32006aee9df347b1a5f00c983dddc655 Oct 12 22:04:12.254137 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-374006964 Oct 12 22:04:12.254137 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ListImageFiltersTestJSON-374006964-project Oct 12 22:04:12.254137 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:04:12.254137 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:04:12.254137 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 26a287fd11f74fefb1f27455763b8a01 Oct 12 22:04:12.254137 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ListImageFiltersTestJSON-374006964-project Oct 12 22:04:12.254137 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:04:12.254137 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance cf71b2a6-484b-4e05-80fb-89be6b98546a could not be found. Oct 12 22:04:12.254137 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'cf71b2a6-484b-4e05-80fb-89be6b98546a'} Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf71b2a6-484b-4e05-80fb-89be6b98546a could not be found. Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:04:12.254890 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf71b2a6-484b-4e05-80fb-89be6b98546a could not be found. Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf71b2a6-484b-4e05-80fb-89be6b98546a could not be found. Oct 12 22:04:12.256097 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:12.261080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb5c8d4b-5442-45c8-a321-7a2183095faf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Returning 404 to user: Instance cf71b2a6-484b-4e05-80fb-89be6b98546a could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:04:12.262218 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cb5c8d4b-5442-45c8-a321-7a2183095faf tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a" status: 404 len: 111 microversion: 2.1 time: 0.049990 Oct 12 22:04:12.263145 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 704/1354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:12 2022] GET /compute/v2.1/servers/cf71b2a6-484b-4e05-80fb-89be6b98546a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:04:12.268406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d6c6f3ad-6a6d-4634-977d-50ae7da0e18d req-bf9c23b9-fa00-423c-b694-c48129e06d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a5599b6-e17a-41b1-80a1-a43e278b013b", "name": "network-vif-deleted", "tag": "9b742b79-f5ca-4dd2-a2dd-1e98ca78fe8d"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:12.277494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:12.286989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d6c6f3ad-6a6d-4634-977d-50ae7da0e18d req-bf9c23b9-fa00-423c-b694-c48129e06d5b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:12.287959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d6c6f3ad-6a6d-4634-977d-50ae7da0e18d req-bf9c23b9-fa00-423c-b694-c48129e06d5b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:12.288638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d6c6f3ad-6a6d-4634-977d-50ae7da0e18d req-bf9c23b9-fa00-423c-b694-c48129e06d5b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:12.306049 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d6c6f3ad-6a6d-4634-977d-50ae7da0e18d req-bf9c23b9-fa00-423c-b694-c48129e06d5b service nova] Creating event network-vif-deleted:9b742b79-f5ca-4dd2-a2dd-1e98ca78fe8d for instance 5a5599b6-e17a-41b1-80a1-a43e278b013b on n-h1-861111-1 Oct 12 22:04:12.315367 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d6c6f3ad-6a6d-4634-977d-50ae7da0e18d req-bf9c23b9-fa00-423c-b694-c48129e06d5b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050595 Oct 12 22:04:12.316732 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 705/1355] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:12.328673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-00762e32-bdf2-48ab-88aa-215e22a4fbf4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512841f670>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:12.427191 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-00762e32-bdf2-48ab-88aa-215e22a4fbf4 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.108031 Oct 12 22:04:12.427893 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 706/1356] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:12 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:12.440571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0899a4ce-9a47-4677-b3b5-8f09eeb6fcc0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f512827f040>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:12.880060 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0899a4ce-9a47-4677-b3b5-8f09eeb6fcc0 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "DELETE /compute/v2.1/images/118924f1-4225-425e-a86a-d2908313a327" status: 204 len: 0 microversion: 2.1 time: 0.444053 Oct 12 22:04:12.880842 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 707/1357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:12 2022] DELETE /compute/v2.1/images/118924f1-4225-425e-a86a-d2908313a327 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:04:12.888318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-125df143-e9f0-4554-8ac9-aee81d7ff93e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:12.889150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-125df143-e9f0-4554-8ac9-aee81d7ff93e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:12.902128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-125df143-e9f0-4554-8ac9-aee81d7ff93e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:12.907359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-125df143-e9f0-4554-8ac9-aee81d7ff93e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:12.907959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-125df143-e9f0-4554-8ac9-aee81d7ff93e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:12.908763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-125df143-e9f0-4554-8ac9-aee81d7ff93e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:12.909301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-125df143-e9f0-4554-8ac9-aee81d7ff93e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:12.909831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-125df143-e9f0-4554-8ac9-aee81d7ff93e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:12.913080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:13.052525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:04:13.053720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:04:13.054442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:04:13.055182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:04:13.056172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:04:13.074888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:13.076967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:13.078932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:13.080385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:13.081974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:13.082489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:13.126787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Getting quotas for project 3e56178d67cb48a88f99c741b3c0f2be. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:04:13.137874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Getting quotas for user 990d936956654370a1c2997120e7231f and project 3e56178d67cb48a88f99c741b3c0f2be. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:04:13.138245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-125df143-e9f0-4554-8ac9-aee81d7ff93e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:13.152644 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-125df143-e9f0-4554-8ac9-aee81d7ff93e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.270402 Oct 12 22:04:13.153521 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 708/1358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:12 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:13.170076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:04:13.171353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-27195df0-bc92-4377-a5c5-f2c7c54b72e6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:13.171974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-27195df0-bc92-4377-a5c5-f2c7c54b72e6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:13.173097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:04:13.178122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27195df0-bc92-4377-a5c5-f2c7c54b72e6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:13.178547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27195df0-bc92-4377-a5c5-f2c7c54b72e6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:13.178985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27195df0-bc92-4377-a5c5-f2c7c54b72e6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:13.179703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27195df0-bc92-4377-a5c5-f2c7c54b72e6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:13.180150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27195df0-bc92-4377-a5c5-f2c7c54b72e6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:13.180569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27195df0-bc92-4377-a5c5-f2c7c54b72e6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:13.232479 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b622e50d-e4f8-41a6-a156-57700ecf5ec7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.831942 Oct 12 22:04:13.233431 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 651/1359] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:04:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:04:13.240508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0055e750-f64d-4284-bd48-22f33fcd0d47 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51283a9ca0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:13.401639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-27195df0-bc92-4377-a5c5-f2c7c54b72e6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:13.412044 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-27195df0-bc92-4377-a5c5-f2c7c54b72e6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.257359 Oct 12 22:04:13.413082 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 709/1360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:13 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:13.425404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-97f9c15a-a452-43d7-89ad-d32192bc6425 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:13.426606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-97f9c15a-a452-43d7-89ad-d32192bc6425 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] [instance: 5a5599b6-e17a-41b1-80a1-a43e278b013b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:13.433504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97f9c15a-a452-43d7-89ad-d32192bc6425 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:13.434251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97f9c15a-a452-43d7-89ad-d32192bc6425 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:13.434938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97f9c15a-a452-43d7-89ad-d32192bc6425 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:13.435910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97f9c15a-a452-43d7-89ad-d32192bc6425 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:13.438478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97f9c15a-a452-43d7-89ad-d32192bc6425 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:13.439193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97f9c15a-a452-43d7-89ad-d32192bc6425 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:13.456423 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-97f9c15a-a452-43d7-89ad-d32192bc6425 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] HTTP exception thrown: Instance 5a5599b6-e17a-41b1-80a1-a43e278b013b could not be found. Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-97f9c15a-a452-43d7-89ad-d32192bc6425 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Request method failure captured: Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b HTTP/1.1 Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlcg6yahUveKaNJHG0_fBJl72GyuKTwPZIo3EwB5f3oFElsYffpMdn3ZS8hvDvO08xumq1Fysc_ZALiaveqOlcKSbFqgDFtWfWRqPdUaa4FPpWX5Qo37jp-MzplFy1T-jY0vdg6FrklLbkk1-n19CSykCTC24WlL9xs0Z0L1H09bAc Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: b06c433b364c4a3093c13202b785bc1e Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerRescueTestJSON-795272125 Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:04:13.458476 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:04:13.460033 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b06c433b364c4a3093c13202b785bc1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b06c433b364c4a3093c13202b785bc1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b06c433b364c4a3093c13202b785bc1e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b06c433b364c4a3093c13202b785bc1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:04:13.460033 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerRescueTestJSON-795272125 Oct 12 22:04:13.460033 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: b06c433b364c4a3093c13202b785bc1e Oct 12 22:04:13.460033 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerRescueTestJSON-795272125 Oct 12 22:04:13.460033 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerRescueTestJSON-795272125-project Oct 12 22:04:13.460033 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:04:13.460033 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:04:13.460033 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: ad5b2d0e307f4b008479ff4927b77cb2 Oct 12 22:04:13.460033 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerRescueTestJSON-795272125-project Oct 12 22:04:13.460033 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:04:13.460033 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 5a5599b6-e17a-41b1-80a1-a43e278b013b could not be found. Oct 12 22:04:13.460033 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '5a5599b6-e17a-41b1-80a1-a43e278b013b'} Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a5599b6-e17a-41b1-80a1-a43e278b013b could not be found. Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:04:13.461158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a5599b6-e17a-41b1-80a1-a43e278b013b could not be found. Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a5599b6-e17a-41b1-80a1-a43e278b013b could not be found. Oct 12 22:04:13.462381 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:13.465613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-97f9c15a-a452-43d7-89ad-d32192bc6425 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] Returning 404 to user: Instance 5a5599b6-e17a-41b1-80a1-a43e278b013b could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:04:13.466673 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-97f9c15a-a452-43d7-89ad-d32192bc6425 tempest-ServerRescueTestJSON-795272125 tempest-ServerRescueTestJSON-795272125-project] 10.222.0.16 "GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b" status: 404 len: 111 microversion: 2.1 time: 0.045984 Oct 12 22:04:13.471536 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 710/1361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:13 2022] GET /compute/v2.1/servers/5a5599b6-e17a-41b1-80a1-a43e278b013b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:04:13.477561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-25d991ab-7e10-4a73-924f-33e9d1f044c3 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:13.478597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-25d991ab-7e10-4a73-924f-33e9d1f044c3 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:13.485535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25d991ab-7e10-4a73-924f-33e9d1f044c3 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:13.486331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25d991ab-7e10-4a73-924f-33e9d1f044c3 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:13.486981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25d991ab-7e10-4a73-924f-33e9d1f044c3 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:13.487986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25d991ab-7e10-4a73-924f-33e9d1f044c3 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:13.488687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25d991ab-7e10-4a73-924f-33e9d1f044c3 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:13.489324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25d991ab-7e10-4a73-924f-33e9d1f044c3 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:13.613197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-25d991ab-7e10-4a73-924f-33e9d1f044c3 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:13.635147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-25d991ab-7e10-4a73-924f-33e9d1f044c3 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:13.642755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-25d991ab-7e10-4a73-924f-33e9d1f044c3 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:13.660118 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-25d991ab-7e10-4a73-924f-33e9d1f044c3 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.186965 Oct 12 22:04:13.677868 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 711/1362] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:13 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:13.690055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-694d9c07-3113-4e27-bfc9-23abc2da194a tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:13.701355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-694d9c07-3113-4e27-bfc9-23abc2da194a tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:13.777346 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0055e750-f64d-4284-bd48-22f33fcd0d47 tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "DELETE /compute/v2.1/images/dec50f18-a989-47e8-983f-92c4c20605bf" status: 204 len: 0 microversion: 2.1 time: 0.542782 Oct 12 22:04:13.781440 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 652/1363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:13 2022] DELETE /compute/v2.1/images/dec50f18-a989-47e8-983f-92c4c20605bf => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:04:13.786385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bff64bfe-2788-41a8-952e-c242925226a5 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128411d30>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:13.868739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-694d9c07-3113-4e27-bfc9-23abc2da194a tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:13.877052 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-694d9c07-3113-4e27-bfc9-23abc2da194a tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 200 len: 1218 microversion: 2.1 time: 0.197952 Oct 12 22:04:13.877686 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 712/1364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:13 2022] GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 1218 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:13.898681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-03ea41fe-fb01-47a3-b698-41c4395ca78c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] Calling method '.version_select at 0x7f51282731f0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:13.899884 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bff64bfe-2788-41a8-952e-c242925226a5 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.116926 Oct 12 22:04:13.908724 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 653/1365] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:13 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:14.177968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-490b1982-bb07-4b6a-90c7-b0e9176880c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:14.179030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-490b1982-bb07-4b6a-90c7-b0e9176880c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:14.199061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-490b1982-bb07-4b6a-90c7-b0e9176880c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:14.199621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-490b1982-bb07-4b6a-90c7-b0e9176880c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:14.204289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-490b1982-bb07-4b6a-90c7-b0e9176880c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:14.207095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-490b1982-bb07-4b6a-90c7-b0e9176880c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:14.207622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-490b1982-bb07-4b6a-90c7-b0e9176880c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:14.208059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-490b1982-bb07-4b6a-90c7-b0e9176880c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:14.265009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:14.463701 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-03ea41fe-fb01-47a3-b698-41c4395ca78c tempest-ListImageFiltersTestJSON-374006964 tempest-ListImageFiltersTestJSON-374006964-project] 10.222.0.16 "DELETE /compute/v2.1/images/880862b9-228c-4f16-bc93-6363c7875535" status: 204 len: 0 microversion: 2.1 time: 0.577002 Oct 12 22:04:14.464371 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 713/1366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:13 2022] DELETE /compute/v2.1/images/880862b9-228c-4f16-bc93-6363c7875535 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:04:14.469584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-63512c7b-0208-4ca0-8bfc-e0de63f368ac tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:14.470680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-63512c7b-0208-4ca0-8bfc-e0de63f368ac tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:14.486368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63512c7b-0208-4ca0-8bfc-e0de63f368ac tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:14.487165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63512c7b-0208-4ca0-8bfc-e0de63f368ac tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:14.487850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63512c7b-0208-4ca0-8bfc-e0de63f368ac tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:14.488787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63512c7b-0208-4ca0-8bfc-e0de63f368ac tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:14.489430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63512c7b-0208-4ca0-8bfc-e0de63f368ac tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:14.490111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63512c7b-0208-4ca0-8bfc-e0de63f368ac tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:14.645419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-490b1982-bb07-4b6a-90c7-b0e9176880c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:14.657247 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-490b1982-bb07-4b6a-90c7-b0e9176880c3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.482339 Oct 12 22:04:14.657247 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 654/1367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:14 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:14.695268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-21253982-b258-4cb8-a5f6-0f2ecb0cbb1e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:14.696776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-21253982-b258-4cb8-a5f6-0f2ecb0cbb1e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:14.707866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21253982-b258-4cb8-a5f6-0f2ecb0cbb1e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:14.709475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21253982-b258-4cb8-a5f6-0f2ecb0cbb1e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:14.710020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21253982-b258-4cb8-a5f6-0f2ecb0cbb1e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:14.710833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21253982-b258-4cb8-a5f6-0f2ecb0cbb1e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:14.711773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21253982-b258-4cb8-a5f6-0f2ecb0cbb1e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:14.712447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21253982-b258-4cb8-a5f6-0f2ecb0cbb1e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:14.741950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-63512c7b-0208-4ca0-8bfc-e0de63f368ac tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:14.803963 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-63512c7b-0208-4ca0-8bfc-e0de63f368ac tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.338317 Oct 12 22:04:14.816663 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 714/1368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:14 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:14.908866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1201a5b3-4ff4-491b-8f8a-1baf0a20d015 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:14.914062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1201a5b3-4ff4-491b-8f8a-1baf0a20d015 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:14.933514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1201a5b3-4ff4-491b-8f8a-1baf0a20d015 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:14.934040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1201a5b3-4ff4-491b-8f8a-1baf0a20d015 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:14.934540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1201a5b3-4ff4-491b-8f8a-1baf0a20d015 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:14.937262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1201a5b3-4ff4-491b-8f8a-1baf0a20d015 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:14.937262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1201a5b3-4ff4-491b-8f8a-1baf0a20d015 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:14.937262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1201a5b3-4ff4-491b-8f8a-1baf0a20d015 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:14.955857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-21253982-b258-4cb8-a5f6-0f2ecb0cbb1e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:14.966927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-21253982-b258-4cb8-a5f6-0f2ecb0cbb1e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:14.968419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-21253982-b258-4cb8-a5f6-0f2ecb0cbb1e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:14.981239 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-21253982-b258-4cb8-a5f6-0f2ecb0cbb1e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.290773 Oct 12 22:04:14.984689 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 655/1369] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:14 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:14.996648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-39f4e4c6-86cf-4823-a0a2-e3921ff79609 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51283a9dc0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:15.080578 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-39f4e4c6-86cf-4823-a0a2-e3921ff79609 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.094586 Oct 12 22:04:15.081167 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 656/1370] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:14 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:15.093170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5215787e-2994-4e2e-9fc0-40d5147e8193 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c93e44df-144e-46c1-abe3-f589a8798e21", "device": "/dev/xvdb"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:15.096464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5215787e-2994-4e2e-9fc0-40d5147e8193 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:15.115647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5215787e-2994-4e2e-9fc0-40d5147e8193 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:15.116160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5215787e-2994-4e2e-9fc0-40d5147e8193 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:15.116603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5215787e-2994-4e2e-9fc0-40d5147e8193 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:15.117322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5215787e-2994-4e2e-9fc0-40d5147e8193 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:15.117776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5215787e-2994-4e2e-9fc0-40d5147e8193 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:15.118195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5215787e-2994-4e2e-9fc0-40d5147e8193 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:15.507645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1201a5b3-4ff4-491b-8f8a-1baf0a20d015 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:15.524173 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1201a5b3-4ff4-491b-8f8a-1baf0a20d015 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 200 len: 1270 microversion: 2.1 time: 0.623313 Oct 12 22:04:15.544261 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 715/1371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:14 2022] GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 1270 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:15.681145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-516b2e7a-07b3-4f83-a44c-33307e4019cd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:15.681958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-516b2e7a-07b3-4f83-a44c-33307e4019cd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:15.691918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-516b2e7a-07b3-4f83-a44c-33307e4019cd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:15.694085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-516b2e7a-07b3-4f83-a44c-33307e4019cd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:15.695477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-516b2e7a-07b3-4f83-a44c-33307e4019cd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:15.697103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-516b2e7a-07b3-4f83-a44c-33307e4019cd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:15.698440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-516b2e7a-07b3-4f83-a44c-33307e4019cd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:15.700027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-516b2e7a-07b3-4f83-a44c-33307e4019cd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:15.790190 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5215787e-2994-4e2e-9fc0-40d5147e8193 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "POST /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.705384 Oct 12 22:04:15.791166 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 657/1372] 10.222.0.16 () {62 vars in 1364 bytes} [Wed Oct 12 22:04:15 2022] POST /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments => generated 194 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:04:15.832115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-459e9340-a4df-40d1-af0a-bedaf31888b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:15.832947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-459e9340-a4df-40d1-af0a-bedaf31888b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:15.863507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-459e9340-a4df-40d1-af0a-bedaf31888b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:15.864048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-459e9340-a4df-40d1-af0a-bedaf31888b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:15.864503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-459e9340-a4df-40d1-af0a-bedaf31888b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:15.874131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-459e9340-a4df-40d1-af0a-bedaf31888b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:15.874650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-459e9340-a4df-40d1-af0a-bedaf31888b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:15.879587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-459e9340-a4df-40d1-af0a-bedaf31888b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:15.957768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-516b2e7a-07b3-4f83-a44c-33307e4019cd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:15.971411 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-516b2e7a-07b3-4f83-a44c-33307e4019cd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.294554 Oct 12 22:04:15.974237 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 716/1373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:15 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:16.011915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a1b10bf6-d4e3-443c-8d4f-7ececdae9ab6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:16.012899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a1b10bf6-d4e3-443c-8d4f-7ececdae9ab6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:16.020696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1b10bf6-d4e3-443c-8d4f-7ececdae9ab6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:16.022926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1b10bf6-d4e3-443c-8d4f-7ececdae9ab6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:16.026382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1b10bf6-d4e3-443c-8d4f-7ececdae9ab6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:16.027869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1b10bf6-d4e3-443c-8d4f-7ececdae9ab6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:16.031609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1b10bf6-d4e3-443c-8d4f-7ececdae9ab6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:16.032589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1b10bf6-d4e3-443c-8d4f-7ececdae9ab6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:16.212450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a1b10bf6-d4e3-443c-8d4f-7ececdae9ab6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:16.230614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a1b10bf6-d4e3-443c-8d4f-7ececdae9ab6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:16.232742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a1b10bf6-d4e3-443c-8d4f-7ececdae9ab6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:16.245990 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a1b10bf6-d4e3-443c-8d4f-7ececdae9ab6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.234951 Oct 12 22:04:16.247176 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 717/1374] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:16 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:16.257473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3bc57ec2-a59e-4364-aa79-6b9810ca066e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128292160>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:16.335084 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3bc57ec2-a59e-4364-aa79-6b9810ca066e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.083976 Oct 12 22:04:16.343964 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 718/1375] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:16 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:16.554977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6590af1f-2464-4ee9-aa6f-1d265c29529f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:16.559087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6590af1f-2464-4ee9-aa6f-1d265c29529f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:16.571598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6590af1f-2464-4ee9-aa6f-1d265c29529f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:16.572637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6590af1f-2464-4ee9-aa6f-1d265c29529f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:16.573301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6590af1f-2464-4ee9-aa6f-1d265c29529f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:16.574003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6590af1f-2464-4ee9-aa6f-1d265c29529f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:16.574450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6590af1f-2464-4ee9-aa6f-1d265c29529f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:16.574871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6590af1f-2464-4ee9-aa6f-1d265c29529f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:16.629715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-459e9340-a4df-40d1-af0a-bedaf31888b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:16.639690 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-459e9340-a4df-40d1-af0a-bedaf31888b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.812666 Oct 12 22:04:16.644202 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 658/1376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:15 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:16.737065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6590af1f-2464-4ee9-aa6f-1d265c29529f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:16.748486 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6590af1f-2464-4ee9-aa6f-1d265c29529f tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 200 len: 1276 microversion: 2.1 time: 0.198390 Oct 12 22:04:16.769813 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 719/1377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:16 2022] GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 1276 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:16.998213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f0a34b34-9693-412b-8c72-37a604789c47 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:16.999003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f0a34b34-9693-412b-8c72-37a604789c47 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:17.010773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0a34b34-9693-412b-8c72-37a604789c47 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:17.019846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0a34b34-9693-412b-8c72-37a604789c47 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:17.020432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0a34b34-9693-412b-8c72-37a604789c47 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:17.021279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0a34b34-9693-412b-8c72-37a604789c47 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:17.021861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0a34b34-9693-412b-8c72-37a604789c47 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:17.030916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0a34b34-9693-412b-8c72-37a604789c47 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:17.328772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ad0a36e5-e795-44eb-9902-a179258cbadd tempest-ListImagesTestJSON-1811050965 tempest-ListImagesTestJSON-1811050965-project] Calling method '.version_select at 0x7f5128292b80>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:17.388349 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ad0a36e5-e795-44eb-9902-a179258cbadd tempest-ListImagesTestJSON-1811050965 tempest-ListImagesTestJSON-1811050965-project] 10.222.0.16 "GET /compute/v2.1/images/d1e68057-c368-47a5-ab06-787819be7f9c" status: 200 len: 784 microversion: 2.1 time: 0.330153 Oct 12 22:04:17.395560 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 720/1378] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:17 2022] GET /compute/v2.1/images/d1e68057-c368-47a5-ab06-787819be7f9c => generated 784 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:04:17.401121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-711aaace-2f50-4bb7-b169-2d18d8990865 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:17.401929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-711aaace-2f50-4bb7-b169-2d18d8990865 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:17.413465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-711aaace-2f50-4bb7-b169-2d18d8990865 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:17.423989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-711aaace-2f50-4bb7-b169-2d18d8990865 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:17.424703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-711aaace-2f50-4bb7-b169-2d18d8990865 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:17.425610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-711aaace-2f50-4bb7-b169-2d18d8990865 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:17.426220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-711aaace-2f50-4bb7-b169-2d18d8990865 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:17.426800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-711aaace-2f50-4bb7-b169-2d18d8990865 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:17.510441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f0a34b34-9693-412b-8c72-37a604789c47 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:17.524329 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f0a34b34-9693-412b-8c72-37a604789c47 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.530096 Oct 12 22:04:17.527608 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 659/1379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:16 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:17.541549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-475f3ff2-8fb7-4ff9-a4e3-99264e9f0f5a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512841c670>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:17.557687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-711aaace-2f50-4bb7-b169-2d18d8990865 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:17.572267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-711aaace-2f50-4bb7-b169-2d18d8990865 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:17.573713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-711aaace-2f50-4bb7-b169-2d18d8990865 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:17.583963 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-711aaace-2f50-4bb7-b169-2d18d8990865 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.187081 Oct 12 22:04:17.591551 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 721/1380] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:17 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:17.611663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5ad9ef0e-684a-4b22-a3b9-e81adab2723d tempest-ListImagesTestJSON-1811050965 tempest-ListImagesTestJSON-1811050965-project] Calling method '.version_select at 0x7f512827f430>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:17.628659 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-475f3ff2-8fb7-4ff9-a4e3-99264e9f0f5a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.098384 Oct 12 22:04:17.630853 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 660/1381] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:17 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:17.669702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f7d08e34-f243-48aa-bdc2-a55f3da100ce tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:17.670470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f7d08e34-f243-48aa-bdc2-a55f3da100ce tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:17.686087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7d08e34-f243-48aa-bdc2-a55f3da100ce tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:17.686595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7d08e34-f243-48aa-bdc2-a55f3da100ce tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:17.687799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7d08e34-f243-48aa-bdc2-a55f3da100ce tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:17.689965 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5ad9ef0e-684a-4b22-a3b9-e81adab2723d tempest-ListImagesTestJSON-1811050965 tempest-ListImagesTestJSON-1811050965-project] 10.222.0.16 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.097119 Oct 12 22:04:17.690466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7d08e34-f243-48aa-bdc2-a55f3da100ce tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:17.691181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7d08e34-f243-48aa-bdc2-a55f3da100ce tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:17.691838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7d08e34-f243-48aa-bdc2-a55f3da100ce tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:17.699712 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 722/1382] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 12 22:04:17 2022] GET /compute/v2.1/images => generated 445 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:17.707068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6916e8fa-b998-4869-8a80-7602424fb66d tempest-ListImagesTestJSON-1811050965 tempest-ListImagesTestJSON-1811050965-project] Calling method '.version_select at 0x7f512c36a700>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:17.793643 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6916e8fa-b998-4869-8a80-7602424fb66d tempest-ListImagesTestJSON-1811050965 tempest-ListImagesTestJSON-1811050965-project] 10.222.0.16 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.092771 Oct 12 22:04:17.794221 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 723/1383] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 12 22:04:17 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:17.821129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0d98e3f0-f2f8-406f-8e8e-3e988351cb10 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:17.823429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0d98e3f0-f2f8-406f-8e8e-3e988351cb10 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:17.836107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d98e3f0-f2f8-406f-8e8e-3e988351cb10 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:17.844152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d98e3f0-f2f8-406f-8e8e-3e988351cb10 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:17.846158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d98e3f0-f2f8-406f-8e8e-3e988351cb10 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:17.850738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d98e3f0-f2f8-406f-8e8e-3e988351cb10 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:17.851460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d98e3f0-f2f8-406f-8e8e-3e988351cb10 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:17.852153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d98e3f0-f2f8-406f-8e8e-3e988351cb10 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:17.973832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0d98e3f0-f2f8-406f-8e8e-3e988351cb10 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:17.984532 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0d98e3f0-f2f8-406f-8e8e-3e988351cb10 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 200 len: 1276 microversion: 2.1 time: 0.178396 Oct 12 22:04:18.001262 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 724/1384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:17 2022] GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 1276 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:18.554011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-32a6ee8a-fb35-4411-864f-8a891d2cba7e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:18.554927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-32a6ee8a-fb35-4411-864f-8a891d2cba7e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:18.568646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32a6ee8a-fb35-4411-864f-8a891d2cba7e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:18.573839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32a6ee8a-fb35-4411-864f-8a891d2cba7e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:18.574783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32a6ee8a-fb35-4411-864f-8a891d2cba7e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:18.578665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32a6ee8a-fb35-4411-864f-8a891d2cba7e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:18.580126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32a6ee8a-fb35-4411-864f-8a891d2cba7e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:18.580791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32a6ee8a-fb35-4411-864f-8a891d2cba7e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:18.647888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f7d08e34-f243-48aa-bdc2-a55f3da100ce tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:18.662567 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f7d08e34-f243-48aa-bdc2-a55f3da100ce tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.997431 Oct 12 22:04:18.664386 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 661/1385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:17 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:18.680944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-363af9fe-e2c4-4e2c-8933-27f3b8944970 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:18.689582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-363af9fe-e2c4-4e2c-8933-27f3b8944970 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:18.715264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-363af9fe-e2c4-4e2c-8933-27f3b8944970 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:18.716075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-363af9fe-e2c4-4e2c-8933-27f3b8944970 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:18.716677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-363af9fe-e2c4-4e2c-8933-27f3b8944970 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:18.717551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-363af9fe-e2c4-4e2c-8933-27f3b8944970 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:18.718158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-363af9fe-e2c4-4e2c-8933-27f3b8944970 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:18.721554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-363af9fe-e2c4-4e2c-8933-27f3b8944970 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:19.191152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-363af9fe-e2c4-4e2c-8933-27f3b8944970 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:19.200160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-363af9fe-e2c4-4e2c-8933-27f3b8944970 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:19.201608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-363af9fe-e2c4-4e2c-8933-27f3b8944970 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:19.231415 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-363af9fe-e2c4-4e2c-8933-27f3b8944970 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.565798 Oct 12 22:04:19.232009 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 662/1386] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:18 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:19.255196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-16fad04a-fd54-442b-8cbe-9d50f17fe964 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512839b430>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:19.361905 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-16fad04a-fd54-442b-8cbe-9d50f17fe964 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.119228 Oct 12 22:04:19.371192 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 663/1387] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:19 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:19.377040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5836e0f0-1c68-4b15-9eb3-e146c83f18e3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:19.378241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-32a6ee8a-fb35-4411-864f-8a891d2cba7e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:19.378478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5836e0f0-1c68-4b15-9eb3-e146c83f18e3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:19.386434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5836e0f0-1c68-4b15-9eb3-e146c83f18e3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:19.387149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5836e0f0-1c68-4b15-9eb3-e146c83f18e3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:19.388977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5836e0f0-1c68-4b15-9eb3-e146c83f18e3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:19.392145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5836e0f0-1c68-4b15-9eb3-e146c83f18e3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:19.392808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5836e0f0-1c68-4b15-9eb3-e146c83f18e3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:19.393632 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-32a6ee8a-fb35-4411-864f-8a891d2cba7e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.841574 Oct 12 22:04:19.394262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5836e0f0-1c68-4b15-9eb3-e146c83f18e3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:19.397993 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 725/1388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:18 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:19.692157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-175bcdcf-95f0-4f5e-8cf0-d6c1ae2c3f05 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:19.693167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-175bcdcf-95f0-4f5e-8cf0-d6c1ae2c3f05 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:19.711931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-175bcdcf-95f0-4f5e-8cf0-d6c1ae2c3f05 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:19.713589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-175bcdcf-95f0-4f5e-8cf0-d6c1ae2c3f05 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:19.718170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-175bcdcf-95f0-4f5e-8cf0-d6c1ae2c3f05 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:19.719160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-175bcdcf-95f0-4f5e-8cf0-d6c1ae2c3f05 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:19.720321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-175bcdcf-95f0-4f5e-8cf0-d6c1ae2c3f05 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:19.725081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-175bcdcf-95f0-4f5e-8cf0-d6c1ae2c3f05 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:20.273927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-175bcdcf-95f0-4f5e-8cf0-d6c1ae2c3f05 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:20.297913 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-175bcdcf-95f0-4f5e-8cf0-d6c1ae2c3f05 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.608766 Oct 12 22:04:20.301939 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 726/1389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:19 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:20.309784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5836e0f0-1c68-4b15-9eb3-e146c83f18e3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:20.316567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8025e4b4-8df8-41ae-a1b4-57ecc850a60a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:20.319726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8025e4b4-8df8-41ae-a1b4-57ecc850a60a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:20.321279 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5836e0f0-1c68-4b15-9eb3-e146c83f18e3 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 200 len: 1318 microversion: 2.1 time: 0.946100 Oct 12 22:04:20.321938 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 664/1390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:19 2022] GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 1318 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:20.347513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8025e4b4-8df8-41ae-a1b4-57ecc850a60a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:20.349762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8025e4b4-8df8-41ae-a1b4-57ecc850a60a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:20.350440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8025e4b4-8df8-41ae-a1b4-57ecc850a60a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:20.354692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8025e4b4-8df8-41ae-a1b4-57ecc850a60a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:20.358611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8025e4b4-8df8-41ae-a1b4-57ecc850a60a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:20.359365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8025e4b4-8df8-41ae-a1b4-57ecc850a60a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:20.378903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-991e2009-a7a5-4872-bac0-11b9126898f0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512836f700>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:20.468025 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-991e2009-a7a5-4872-bac0-11b9126898f0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.092851 Oct 12 22:04:20.474383 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 665/1391] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:20 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:20.480697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-05bb2042-95ab-4d69-9dea-d7c6f81063ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:20.482741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-05bb2042-95ab-4d69-9dea-d7c6f81063ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:20.498420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8025e4b4-8df8-41ae-a1b4-57ecc850a60a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:20.502131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05bb2042-95ab-4d69-9dea-d7c6f81063ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:20.502824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05bb2042-95ab-4d69-9dea-d7c6f81063ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:20.503454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05bb2042-95ab-4d69-9dea-d7c6f81063ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:20.506231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05bb2042-95ab-4d69-9dea-d7c6f81063ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:20.506857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05bb2042-95ab-4d69-9dea-d7c6f81063ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:20.507215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8025e4b4-8df8-41ae-a1b4-57ecc850a60a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:20.508705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8025e4b4-8df8-41ae-a1b4-57ecc850a60a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:20.509143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05bb2042-95ab-4d69-9dea-d7c6f81063ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:20.541757 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8025e4b4-8df8-41ae-a1b4-57ecc850a60a tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.234826 Oct 12 22:04:20.546522 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 727/1392] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:20 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:20.657574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f7885754-79e3-4b7e-be5c-105b4f9a35f6 req-888d3641-7edc-4da5-8e87-b776872d188e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4202eff-421b-4ea2-985b-ef6ef6c041b0", "tag": "b0e47c3a-b0d0-4fa8-9e41-9bf2c7140edc"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:20.694928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f7885754-79e3-4b7e-be5c-105b4f9a35f6 req-888d3641-7edc-4da5-8e87-b776872d188e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:20.698961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f7885754-79e3-4b7e-be5c-105b4f9a35f6 req-888d3641-7edc-4da5-8e87-b776872d188e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:20.705508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f7885754-79e3-4b7e-be5c-105b4f9a35f6 req-888d3641-7edc-4da5-8e87-b776872d188e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:20.746099 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f7885754-79e3-4b7e-be5c-105b4f9a35f6 req-888d3641-7edc-4da5-8e87-b776872d188e service nova] Creating event network-changed:b0e47c3a-b0d0-4fa8-9e41-9bf2c7140edc for instance d4202eff-421b-4ea2-985b-ef6ef6c041b0 on n-h1-861111-1 Oct 12 22:04:20.781002 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f7885754-79e3-4b7e-be5c-105b4f9a35f6 req-888d3641-7edc-4da5-8e87-b776872d188e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128561 Oct 12 22:04:20.789521 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 728/1393] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:20.986298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-05bb2042-95ab-4d69-9dea-d7c6f81063ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:21.005800 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-05bb2042-95ab-4d69-9dea-d7c6f81063ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.530238 Oct 12 22:04:21.006786 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 666/1394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:20 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:21.327145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b65a0b92-f9c6-4b37-9e2c-ec06ab5a4c2c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:21.327887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b65a0b92-f9c6-4b37-9e2c-ec06ab5a4c2c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:21.340374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b65a0b92-f9c6-4b37-9e2c-ec06ab5a4c2c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:21.344417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b65a0b92-f9c6-4b37-9e2c-ec06ab5a4c2c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:21.345116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b65a0b92-f9c6-4b37-9e2c-ec06ab5a4c2c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:21.346072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b65a0b92-f9c6-4b37-9e2c-ec06ab5a4c2c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:21.346767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b65a0b92-f9c6-4b37-9e2c-ec06ab5a4c2c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:21.347445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b65a0b92-f9c6-4b37-9e2c-ec06ab5a4c2c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:21.349718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a29147b3-c70c-4207-932d-ed6f1d224f91 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:21.350339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a29147b3-c70c-4207-932d-ed6f1d224f91 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:21.364738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a29147b3-c70c-4207-932d-ed6f1d224f91 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:21.365236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a29147b3-c70c-4207-932d-ed6f1d224f91 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:21.366184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a29147b3-c70c-4207-932d-ed6f1d224f91 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:21.370112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a29147b3-c70c-4207-932d-ed6f1d224f91 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:21.370623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a29147b3-c70c-4207-932d-ed6f1d224f91 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:21.371066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a29147b3-c70c-4207-932d-ed6f1d224f91 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:21.719192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a29147b3-c70c-4207-932d-ed6f1d224f91 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:21.729189 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a29147b3-c70c-4207-932d-ed6f1d224f91 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 200 len: 1318 microversion: 2.1 time: 0.383227 Oct 12 22:04:21.730046 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 667/1395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:21 2022] GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:21.737296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2fd8598f-e24c-4de1-93b9-f11abd362bf7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51283a95e0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:21.831019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:21.838641 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2fd8598f-e24c-4de1-93b9-f11abd362bf7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.106763 Oct 12 22:04:21.845968 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 668/1396] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:21 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:21.857755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a905af40-9a33-40d5-9ab2-ef00a32fe6a7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:21.859797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a905af40-9a33-40d5-9ab2-ef00a32fe6a7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:21.873990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a905af40-9a33-40d5-9ab2-ef00a32fe6a7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:21.878390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a905af40-9a33-40d5-9ab2-ef00a32fe6a7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:21.879865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a905af40-9a33-40d5-9ab2-ef00a32fe6a7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:21.883456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a905af40-9a33-40d5-9ab2-ef00a32fe6a7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:21.883956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a905af40-9a33-40d5-9ab2-ef00a32fe6a7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:21.884431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a905af40-9a33-40d5-9ab2-ef00a32fe6a7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:22.035176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a905af40-9a33-40d5-9ab2-ef00a32fe6a7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:22.049810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a905af40-9a33-40d5-9ab2-ef00a32fe6a7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:22.051601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a905af40-9a33-40d5-9ab2-ef00a32fe6a7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:22.058373 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a905af40-9a33-40d5-9ab2-ef00a32fe6a7 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.210987 Oct 12 22:04:22.071263 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 669/1397] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:21 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:22.092567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-46638d7c-edd9-47a3-b462-8deafa520333 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:22.096621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-46638d7c-edd9-47a3-b462-8deafa520333 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:22.114847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46638d7c-edd9-47a3-b462-8deafa520333 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:22.116336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46638d7c-edd9-47a3-b462-8deafa520333 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:22.117678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46638d7c-edd9-47a3-b462-8deafa520333 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:22.120999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46638d7c-edd9-47a3-b462-8deafa520333 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:22.121681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46638d7c-edd9-47a3-b462-8deafa520333 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:22.122128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46638d7c-edd9-47a3-b462-8deafa520333 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:22.323488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-46638d7c-edd9-47a3-b462-8deafa520333 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:22.331899 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-46638d7c-edd9-47a3-b462-8deafa520333 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.271492 Oct 12 22:04:22.332849 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 670/1398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:22 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:22.429071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b65a0b92-f9c6-4b37-9e2c-ec06ab5a4c2c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:22.451379 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b65a0b92-f9c6-4b37-9e2c-ec06ab5a4c2c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 1.118212 Oct 12 22:04:22.453663 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 729/1399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:21 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:22.756133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5f94690f-8d73-44be-b290-bad2d98ea9a4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:22.763139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5f94690f-8d73-44be-b290-bad2d98ea9a4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:22.782472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f94690f-8d73-44be-b290-bad2d98ea9a4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:22.783319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f94690f-8d73-44be-b290-bad2d98ea9a4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:22.784511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f94690f-8d73-44be-b290-bad2d98ea9a4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:22.788475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f94690f-8d73-44be-b290-bad2d98ea9a4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:22.789398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f94690f-8d73-44be-b290-bad2d98ea9a4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:22.790049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f94690f-8d73-44be-b290-bad2d98ea9a4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:22.867777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-22c20ea0-ebe1-4876-b3b4-e1e3e69c162b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512826c5e0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:22.966935 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-22c20ea0-ebe1-4876-b3b4-e1e3e69c162b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.110425 Oct 12 22:04:22.968480 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 730/1400] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:22 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:23.088001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5700e581-2f8d-44d9-8991-5d1b9da8e354 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:23.089258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5700e581-2f8d-44d9-8991-5d1b9da8e354 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:23.103024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:23.104013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5700e581-2f8d-44d9-8991-5d1b9da8e354 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:23.110200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5700e581-2f8d-44d9-8991-5d1b9da8e354 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:23.111960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5700e581-2f8d-44d9-8991-5d1b9da8e354 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:23.113056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5700e581-2f8d-44d9-8991-5d1b9da8e354 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:23.115881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5700e581-2f8d-44d9-8991-5d1b9da8e354 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:23.117029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5700e581-2f8d-44d9-8991-5d1b9da8e354 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:23.154513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:23.203872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5f94690f-8d73-44be-b290-bad2d98ea9a4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:23.220983 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5f94690f-8d73-44be-b290-bad2d98ea9a4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 200 len: 1318 microversion: 2.1 time: 0.468990 Oct 12 22:04:23.221560 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 671/1401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:22 2022] GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:23.248301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5700e581-2f8d-44d9-8991-5d1b9da8e354 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:23.258146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5700e581-2f8d-44d9-8991-5d1b9da8e354 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:23.260532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5700e581-2f8d-44d9-8991-5d1b9da8e354 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:23.269277 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5700e581-2f8d-44d9-8991-5d1b9da8e354 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.185153 Oct 12 22:04:23.279425 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 731/1402] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:23 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:23.355850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9cf3ab6f-fec1-4dab-b152-dbfd6774a944 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:23.356469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9cf3ab6f-fec1-4dab-b152-dbfd6774a944 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:23.362914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf3ab6f-fec1-4dab-b152-dbfd6774a944 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:23.363213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf3ab6f-fec1-4dab-b152-dbfd6774a944 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:23.363672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf3ab6f-fec1-4dab-b152-dbfd6774a944 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:23.364373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf3ab6f-fec1-4dab-b152-dbfd6774a944 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:23.364817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf3ab6f-fec1-4dab-b152-dbfd6774a944 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:23.365238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf3ab6f-fec1-4dab-b152-dbfd6774a944 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:23.481185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2af45232-715a-4fc4-8643-8a69e7cc2d6e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:23.482144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2af45232-715a-4fc4-8643-8a69e7cc2d6e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:23.501045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2af45232-715a-4fc4-8643-8a69e7cc2d6e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:23.503059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2af45232-715a-4fc4-8643-8a69e7cc2d6e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:23.505662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2af45232-715a-4fc4-8643-8a69e7cc2d6e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:23.509082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2af45232-715a-4fc4-8643-8a69e7cc2d6e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:23.512244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2af45232-715a-4fc4-8643-8a69e7cc2d6e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:23.516507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2af45232-715a-4fc4-8643-8a69e7cc2d6e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:23.806760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9cf3ab6f-fec1-4dab-b152-dbfd6774a944 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:23.818216 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9cf3ab6f-fec1-4dab-b152-dbfd6774a944 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.466012 Oct 12 22:04:23.824835 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 672/1403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:23 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:23.871886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2af45232-715a-4fc4-8643-8a69e7cc2d6e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:23.874586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:23.883759 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2af45232-715a-4fc4-8643-8a69e7cc2d6e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.408347 Oct 12 22:04:23.897829 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 732/1404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:23 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:23.986211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-36a5ae95-d215-435f-91a5-4d071918e36c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51283a9160>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:24.246777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aecd9c03-5406-474c-b7b0-6feb257413c9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:24.247668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aecd9c03-5406-474c-b7b0-6feb257413c9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:24.277128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aecd9c03-5406-474c-b7b0-6feb257413c9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:24.280582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aecd9c03-5406-474c-b7b0-6feb257413c9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:24.281292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aecd9c03-5406-474c-b7b0-6feb257413c9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:24.282404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aecd9c03-5406-474c-b7b0-6feb257413c9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:24.286132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aecd9c03-5406-474c-b7b0-6feb257413c9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:24.287013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aecd9c03-5406-474c-b7b0-6feb257413c9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:24.302262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:24.513409 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-36a5ae95-d215-435f-91a5-4d071918e36c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.533431 Oct 12 22:04:24.522344 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 673/1405] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:23 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:24.536333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-09e416e6-25ea-4d99-a3a1-16df6db33aee tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:24.536965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-09e416e6-25ea-4d99-a3a1-16df6db33aee tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:24.548533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aecd9c03-5406-474c-b7b0-6feb257413c9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:24.559694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09e416e6-25ea-4d99-a3a1-16df6db33aee tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:24.562000 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aecd9c03-5406-474c-b7b0-6feb257413c9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 200 len: 1318 microversion: 2.1 time: 0.322067 Oct 12 22:04:24.562363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09e416e6-25ea-4d99-a3a1-16df6db33aee tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:24.562926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09e416e6-25ea-4d99-a3a1-16df6db33aee tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:24.580196 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 733/1406] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:24 2022] GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:24.581492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09e416e6-25ea-4d99-a3a1-16df6db33aee tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:24.582394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09e416e6-25ea-4d99-a3a1-16df6db33aee tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:24.583223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09e416e6-25ea-4d99-a3a1-16df6db33aee tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:24.663074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-09e416e6-25ea-4d99-a3a1-16df6db33aee tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:24.674610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-09e416e6-25ea-4d99-a3a1-16df6db33aee tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:24.677210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-09e416e6-25ea-4d99-a3a1-16df6db33aee tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:24.684350 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-09e416e6-25ea-4d99-a3a1-16df6db33aee tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.160248 Oct 12 22:04:24.685241 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 674/1407] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:24 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:24.845552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f8bdc370-814a-4ee8-9dcb-e45291515c3c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:24.846357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f8bdc370-814a-4ee8-9dcb-e45291515c3c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:24.857935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8bdc370-814a-4ee8-9dcb-e45291515c3c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:24.859368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8bdc370-814a-4ee8-9dcb-e45291515c3c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:24.860545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8bdc370-814a-4ee8-9dcb-e45291515c3c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:24.862223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8bdc370-814a-4ee8-9dcb-e45291515c3c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:24.864779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8bdc370-814a-4ee8-9dcb-e45291515c3c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:24.865468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8bdc370-814a-4ee8-9dcb-e45291515c3c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:25.158125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1464234974", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "a5d0fefb-45eb-4df3-8086-9e2ed6f8144e"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:25.282728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] validate_networks() for [('a5d0fefb-45eb-4df3-8086-9e2ed6f8144e', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:04:25.593799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f8bdc370-814a-4ee8-9dcb-e45291515c3c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:25.603407 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f8bdc370-814a-4ee8-9dcb-e45291515c3c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1477 microversion: 2.1 time: 0.762508 Oct 12 22:04:25.604671 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 734/1408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:24 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1477 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:25.621349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a251dbab-f873-48d7-b97f-eb2a94f4d6b6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:25.622212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a251dbab-f873-48d7-b97f-eb2a94f4d6b6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:25.636759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a251dbab-f873-48d7-b97f-eb2a94f4d6b6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:25.637493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a251dbab-f873-48d7-b97f-eb2a94f4d6b6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:25.638083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a251dbab-f873-48d7-b97f-eb2a94f4d6b6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:25.639143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a251dbab-f873-48d7-b97f-eb2a94f4d6b6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:25.642028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a251dbab-f873-48d7-b97f-eb2a94f4d6b6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:25.642814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a251dbab-f873-48d7-b97f-eb2a94f4d6b6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:25.973382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:04:25.973382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:04:25.973382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:04:25.973382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:04:25.973382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:04:25.973939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:25.973939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:25.973939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:25.973939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:25.974385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:25.974385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:26.022883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Getting quotas for project f0051e5f43b7403cbb4c29a00bb73513. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:04:26.053147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Getting quotas for user 11d42d1fe957461e9fb85d0823ad5866 and project f0051e5f43b7403cbb4c29a00bb73513. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:04:26.060457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a251dbab-f873-48d7-b97f-eb2a94f4d6b6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:26.078356 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a251dbab-f873-48d7-b97f-eb2a94f4d6b6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.472389 Oct 12 22:04:26.080352 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 735/1409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:25 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:26.088015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c5ccfbd2-4756-455b-be0e-9959ffdbb5db tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512827f3a0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:26.108581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:04:26.110919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:04:26.148937 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c5ccfbd2-4756-455b-be0e-9959ffdbb5db tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.067145 Oct 12 22:04:26.150245 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 736/1410] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:26 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:26.156189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-33b61e26-8c98-47e3-8f9d-2bf2ca39f941 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:26.156990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-33b61e26-8c98-47e3-8f9d-2bf2ca39f941 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:26.163960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33b61e26-8c98-47e3-8f9d-2bf2ca39f941 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:26.166045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33b61e26-8c98-47e3-8f9d-2bf2ca39f941 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:26.166688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33b61e26-8c98-47e3-8f9d-2bf2ca39f941 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:26.167663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33b61e26-8c98-47e3-8f9d-2bf2ca39f941 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:26.168267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33b61e26-8c98-47e3-8f9d-2bf2ca39f941 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:26.168862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33b61e26-8c98-47e3-8f9d-2bf2ca39f941 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:26.234887 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-accbbdd2-bece-4f32-9aed-1121a776725f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.366890 Oct 12 22:04:26.238869 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 675/1411] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:04:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:04:26.245642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7660cece-1121-46a2-a316-28cd0b0368cf tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:26.246558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7660cece-1121-46a2-a316-28cd0b0368cf tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:26.267757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7660cece-1121-46a2-a316-28cd0b0368cf tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:26.269387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7660cece-1121-46a2-a316-28cd0b0368cf tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:26.271937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7660cece-1121-46a2-a316-28cd0b0368cf tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:26.272946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7660cece-1121-46a2-a316-28cd0b0368cf tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:26.273579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7660cece-1121-46a2-a316-28cd0b0368cf tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:26.276835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7660cece-1121-46a2-a316-28cd0b0368cf tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:26.350347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:26.486516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-33b61e26-8c98-47e3-8f9d-2bf2ca39f941 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:26.499911 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-33b61e26-8c98-47e3-8f9d-2bf2ca39f941 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 200 len: 1318 microversion: 2.1 time: 0.344910 Oct 12 22:04:26.502967 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 737/1412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:26 2022] GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:26.533905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1622401980", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "a5d0fefb-45eb-4df3-8086-9e2ed6f8144e"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:26.539971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7660cece-1121-46a2-a316-28cd0b0368cf tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:26.560491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7660cece-1121-46a2-a316-28cd0b0368cf tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:26.565849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7660cece-1121-46a2-a316-28cd0b0368cf tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:26.589187 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7660cece-1121-46a2-a316-28cd0b0368cf tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1447 microversion: 2.75 time: 0.348689 Oct 12 22:04:26.593984 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 676/1413] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:26 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1447 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:26.628557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-865aa906-7dc8-4e3b-976f-016ed0b76aab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:26.629178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-865aa906-7dc8-4e3b-976f-016ed0b76aab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:26.639573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-865aa906-7dc8-4e3b-976f-016ed0b76aab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:26.640076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-865aa906-7dc8-4e3b-976f-016ed0b76aab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:26.649114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-865aa906-7dc8-4e3b-976f-016ed0b76aab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:26.656604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-865aa906-7dc8-4e3b-976f-016ed0b76aab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:26.657112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-865aa906-7dc8-4e3b-976f-016ed0b76aab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:26.657569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-865aa906-7dc8-4e3b-976f-016ed0b76aab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:26.690297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] validate_networks() for [('a5d0fefb-45eb-4df3-8086-9e2ed6f8144e', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:04:26.915679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-865aa906-7dc8-4e3b-976f-016ed0b76aab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:26.935406 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-865aa906-7dc8-4e3b-976f-016ed0b76aab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1476 microversion: 2.1 time: 0.307693 Oct 12 22:04:26.936036 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 677/1414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:26 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1476 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:27.111612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cf4e45a9-169e-4df2-890c-7222563185ed tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:27.112227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cf4e45a9-169e-4df2-890c-7222563185ed tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:27.137801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf4e45a9-169e-4df2-890c-7222563185ed tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:27.142319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf4e45a9-169e-4df2-890c-7222563185ed tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:27.142809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf4e45a9-169e-4df2-890c-7222563185ed tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:27.147012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf4e45a9-169e-4df2-890c-7222563185ed tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:27.147544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf4e45a9-169e-4df2-890c-7222563185ed tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:27.148735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf4e45a9-169e-4df2-890c-7222563185ed tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:27.671396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cf4e45a9-169e-4df2-890c-7222563185ed tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:27.685674 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cf4e45a9-169e-4df2-890c-7222563185ed tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.578120 Oct 12 22:04:27.700863 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 678/1415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:27 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:27.716384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c9b36835-95f1-4299-9053-16c7a450703d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128340dc0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:27.816992 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c9b36835-95f1-4299-9053-16c7a450703d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.114658 Oct 12 22:04:27.818333 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 679/1416] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:27 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:27.831662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7685120e-7c33-495c-bfa1-e4c6c4f2a413 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:27.834274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7685120e-7c33-495c-bfa1-e4c6c4f2a413 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:27.848734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7685120e-7c33-495c-bfa1-e4c6c4f2a413 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:27.851692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7685120e-7c33-495c-bfa1-e4c6c4f2a413 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:27.852350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7685120e-7c33-495c-bfa1-e4c6c4f2a413 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:27.855365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7685120e-7c33-495c-bfa1-e4c6c4f2a413 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:27.856028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7685120e-7c33-495c-bfa1-e4c6c4f2a413 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:27.856638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7685120e-7c33-495c-bfa1-e4c6c4f2a413 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:28.054528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:04:28.056776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:04:28.057958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:04:28.070670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:04:28.072210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:04:28.113310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:28.115835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:28.116490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:28.117438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:28.119714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:28.120325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:28.164630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Getting quotas for project f0051e5f43b7403cbb4c29a00bb73513. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:04:28.172708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Getting quotas for user 11d42d1fe957461e9fb85d0823ad5866 and project f0051e5f43b7403cbb4c29a00bb73513. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:04:28.187793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:04:28.190923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 747a8555-8993-47b3-a6de-2f32f025e240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:04:28.277374 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-236cf821-2f02-4410-b3a2-92be4e861202 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.770508 Oct 12 22:04:28.278643 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 738/1417] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:04:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:04:28.297031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e6ea4d16-cb48-4413-8bf8-6653cbf97c95 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:28.297839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e6ea4d16-cb48-4413-8bf8-6653cbf97c95 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:28.313243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6ea4d16-cb48-4413-8bf8-6653cbf97c95 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:28.314042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6ea4d16-cb48-4413-8bf8-6653cbf97c95 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:28.314653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6ea4d16-cb48-4413-8bf8-6653cbf97c95 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:28.315626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6ea4d16-cb48-4413-8bf8-6653cbf97c95 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:28.316264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6ea4d16-cb48-4413-8bf8-6653cbf97c95 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:28.316898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6ea4d16-cb48-4413-8bf8-6653cbf97c95 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:28.431913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7685120e-7c33-495c-bfa1-e4c6c4f2a413 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:28.457292 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7685120e-7c33-495c-bfa1-e4c6c4f2a413 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 200 len: 1318 microversion: 2.1 time: 0.636355 Oct 12 22:04:28.469252 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 680/1418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:27 2022] GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 1318 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:28.487725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b0365b7a-67e7-44a7-930b-4c6cd6677e69 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:28.488701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b0365b7a-67e7-44a7-930b-4c6cd6677e69 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:28.498771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:28.507723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0365b7a-67e7-44a7-930b-4c6cd6677e69 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:28.515064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0365b7a-67e7-44a7-930b-4c6cd6677e69 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:28.516843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0365b7a-67e7-44a7-930b-4c6cd6677e69 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:28.517718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0365b7a-67e7-44a7-930b-4c6cd6677e69 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:28.521937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e6ea4d16-cb48-4413-8bf8-6653cbf97c95 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:28.522698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0365b7a-67e7-44a7-930b-4c6cd6677e69 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:28.523382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0365b7a-67e7-44a7-930b-4c6cd6677e69 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:28.533689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e6ea4d16-cb48-4413-8bf8-6653cbf97c95 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:28.535159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e6ea4d16-cb48-4413-8bf8-6653cbf97c95 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:28.560277 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e6ea4d16-cb48-4413-8bf8-6653cbf97c95 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1453 microversion: 2.75 time: 0.280314 Oct 12 22:04:28.576864 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 739/1419] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:28 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1453 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:28.593597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1253951365", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "451", "networks": [{"uuid": "a5d0fefb-45eb-4df3-8086-9e2ed6f8144e"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:28.729131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] validate_networks() for [('a5d0fefb-45eb-4df3-8086-9e2ed6f8144e', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:04:29.240999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b0365b7a-67e7-44a7-930b-4c6cd6677e69 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:29.254182 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b0365b7a-67e7-44a7-930b-4c6cd6677e69 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1474 microversion: 2.1 time: 0.783121 Oct 12 22:04:29.263061 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 681/1420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:28 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1474 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:29.269824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-a032f946-0f61-4946-80cf-b4bb62836679 req-0e74f69f-9c47-417c-92e7-f67a921fc10b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48128c05-1d65-46fb-accf-2dd2981a742b", "name": "network-vif-unplugged", "status": "completed", "tag": "51d433b5-9d81-423f-86a9-27412dea934c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:29.310520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a032f946-0f61-4946-80cf-b4bb62836679 req-0e74f69f-9c47-417c-92e7-f67a921fc10b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:29.318160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a032f946-0f61-4946-80cf-b4bb62836679 req-0e74f69f-9c47-417c-92e7-f67a921fc10b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:29.319999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a032f946-0f61-4946-80cf-b4bb62836679 req-0e74f69f-9c47-417c-92e7-f67a921fc10b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:29.346374 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-a032f946-0f61-4946-80cf-b4bb62836679 req-0e74f69f-9c47-417c-92e7-f67a921fc10b service nova] Creating event network-vif-unplugged:51d433b5-9d81-423f-86a9-27412dea934c for instance 48128c05-1d65-46fb-accf-2dd2981a742b on n-h1-861111-1 Oct 12 22:04:29.383783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-a032f946-0f61-4946-80cf-b4bb62836679 req-0e74f69f-9c47-417c-92e7-f67a921fc10b service nova] Instance 48128c05-1d65-46fb-accf-2dd2981a742b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:04:29.398186 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-a032f946-0f61-4946-80cf-b4bb62836679 req-0e74f69f-9c47-417c-92e7-f67a921fc10b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133292 Oct 12 22:04:29.403032 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 682/1421] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:29.423627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-52a27cc2-967e-4fe5-a0f4-7634905e42b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:29.426206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-52a27cc2-967e-4fe5-a0f4-7634905e42b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:29.444980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52a27cc2-967e-4fe5-a0f4-7634905e42b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:29.447228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52a27cc2-967e-4fe5-a0f4-7634905e42b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:29.449220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52a27cc2-967e-4fe5-a0f4-7634905e42b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:29.450453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52a27cc2-967e-4fe5-a0f4-7634905e42b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:29.452115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52a27cc2-967e-4fe5-a0f4-7634905e42b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:29.453716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52a27cc2-967e-4fe5-a0f4-7634905e42b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:29.854687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:04:29.855759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:04:29.856391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:04:29.857106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:04:29.857671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:04:29.874642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:29.875528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:29.877725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:29.880685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:29.881373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:29.882996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:29.939779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Getting quotas for project f0051e5f43b7403cbb4c29a00bb73513. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:04:29.953595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Getting quotas for user 11d42d1fe957461e9fb85d0823ad5866 and project f0051e5f43b7403cbb4c29a00bb73513. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:04:29.993155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:04:30.001284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:04:30.122739 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-194eff1a-a414-4960-b8cb-7d1d1683e7db tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.543576 Oct 12 22:04:30.123713 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 740/1422] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:04:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:04:30.148368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8423b035-6935-4d7f-bb5b-63cfd30b237d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512822a3a0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:30.275398 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8423b035-6935-4d7f-bb5b-63cfd30b237d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.138865 Oct 12 22:04:30.276319 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 741/1423] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:30 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:30.288315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-42559f17-8c89-4665-969e-3fc97543af7e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:30.290950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-42559f17-8c89-4665-969e-3fc97543af7e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:30.307860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42559f17-8c89-4665-969e-3fc97543af7e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:30.308612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42559f17-8c89-4665-969e-3fc97543af7e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:30.309201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42559f17-8c89-4665-969e-3fc97543af7e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:30.311179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42559f17-8c89-4665-969e-3fc97543af7e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:30.316964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42559f17-8c89-4665-969e-3fc97543af7e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:30.317618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42559f17-8c89-4665-969e-3fc97543af7e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:30.366042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-52a27cc2-967e-4fe5-a0f4-7634905e42b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:30.383457 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-52a27cc2-967e-4fe5-a0f4-7634905e42b2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.978857 Oct 12 22:04:30.388024 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 683/1424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:29 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:30.403501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-be2fad2b-aa67-404a-a74e-8229180fb929 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:30.428449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-be2fad2b-aa67-404a-a74e-8229180fb929 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:30.447435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be2fad2b-aa67-404a-a74e-8229180fb929 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:30.455969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be2fad2b-aa67-404a-a74e-8229180fb929 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:30.456582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be2fad2b-aa67-404a-a74e-8229180fb929 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:30.461309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be2fad2b-aa67-404a-a74e-8229180fb929 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:30.461953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be2fad2b-aa67-404a-a74e-8229180fb929 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:30.462489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be2fad2b-aa67-404a-a74e-8229180fb929 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:30.707644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-be2fad2b-aa67-404a-a74e-8229180fb929 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:30.720386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-be2fad2b-aa67-404a-a74e-8229180fb929 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:30.732617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-be2fad2b-aa67-404a-a74e-8229180fb929 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:30.747538 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-be2fad2b-aa67-404a-a74e-8229180fb929 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1453 microversion: 2.75 time: 0.352469 Oct 12 22:04:30.748663 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 684/1425] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:30 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1453 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:30.754395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-42559f17-8c89-4665-969e-3fc97543af7e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:30.755066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-683ccf89-ce46-4c2f-a7f5-45869cc86a99 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:30.755889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-683ccf89-ce46-4c2f-a7f5-45869cc86a99 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:30.763639 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-42559f17-8c89-4665-969e-3fc97543af7e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 200 len: 1318 microversion: 2.1 time: 0.484941 Oct 12 22:04:30.768156 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 742/1426] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:30 2022] GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:30.792686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6807fba6-2929-4253-82e7-ddfe2698b191 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:30.799281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6807fba6-2929-4253-82e7-ddfe2698b191 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:30.826547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6807fba6-2929-4253-82e7-ddfe2698b191 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:30.828476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6807fba6-2929-4253-82e7-ddfe2698b191 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:30.830360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6807fba6-2929-4253-82e7-ddfe2698b191 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:30.832140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6807fba6-2929-4253-82e7-ddfe2698b191 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:30.842678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6807fba6-2929-4253-82e7-ddfe2698b191 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:30.847637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6807fba6-2929-4253-82e7-ddfe2698b191 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:30.925917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-683ccf89-ce46-4c2f-a7f5-45869cc86a99 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:30.945326 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-683ccf89-ce46-4c2f-a7f5-45869cc86a99 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1221 microversion: 2.1 time: 0.195261 Oct 12 22:04:30.945929 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 685/1427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:30 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1221 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:31.305438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af135774-e37b-4275-9fa9-a40c64e91246 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512836f5e0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:31.338138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6807fba6-2929-4253-82e7-ddfe2698b191 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:31.355217 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6807fba6-2929-4253-82e7-ddfe2698b191 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1471 microversion: 2.1 time: 0.585592 Oct 12 22:04:31.371267 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 743/1428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:30 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1471 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:31.393495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1833147c-c0b8-45cd-bb17-4577f25ba30c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:31.394105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1833147c-c0b8-45cd-bb17-4577f25ba30c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:31.396214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:31.432218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1833147c-c0b8-45cd-bb17-4577f25ba30c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:31.433659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1833147c-c0b8-45cd-bb17-4577f25ba30c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:31.434660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1833147c-c0b8-45cd-bb17-4577f25ba30c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:31.435627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1833147c-c0b8-45cd-bb17-4577f25ba30c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:31.436248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1833147c-c0b8-45cd-bb17-4577f25ba30c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:31.436852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1833147c-c0b8-45cd-bb17-4577f25ba30c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:31.441087 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-af135774-e37b-4275-9fa9-a40c64e91246 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.140390 Oct 12 22:04:31.445062 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 686/1429] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:31 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:31.460303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-002e026d-699f-4a2f-906d-457aa0402b03 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:31.474350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-002e026d-699f-4a2f-906d-457aa0402b03 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:31.498199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-002e026d-699f-4a2f-906d-457aa0402b03 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:31.516399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-002e026d-699f-4a2f-906d-457aa0402b03 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:31.518230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-002e026d-699f-4a2f-906d-457aa0402b03 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:31.525292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-002e026d-699f-4a2f-906d-457aa0402b03 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:31.526086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-002e026d-699f-4a2f-906d-457aa0402b03 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:31.532618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-002e026d-699f-4a2f-906d-457aa0402b03 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:31.566752 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1833147c-c0b8-45cd-bb17-4577f25ba30c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "POST /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b/action" status: 204 len: 0 microversion: 2.1 time: 0.183616 Oct 12 22:04:31.572271 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 744/1430] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:04:31 2022] POST /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b/action => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:04:31.593656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a0cebca8-94d9-4dd3-a0bb-a90ae31f84f4 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:31.595893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a0cebca8-94d9-4dd3-a0bb-a90ae31f84f4 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:31.612596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0cebca8-94d9-4dd3-a0bb-a90ae31f84f4 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:31.615422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0cebca8-94d9-4dd3-a0bb-a90ae31f84f4 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:31.617408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0cebca8-94d9-4dd3-a0bb-a90ae31f84f4 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:31.620789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0cebca8-94d9-4dd3-a0bb-a90ae31f84f4 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:31.624760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0cebca8-94d9-4dd3-a0bb-a90ae31f84f4 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:31.642037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0cebca8-94d9-4dd3-a0bb-a90ae31f84f4 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:31.917072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a0cebca8-94d9-4dd3-a0bb-a90ae31f84f4 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:31.931391 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a0cebca8-94d9-4dd3-a0bb-a90ae31f84f4 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1471 microversion: 2.1 time: 0.353334 Oct 12 22:04:31.932987 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 745/1431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:31 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1471 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:31.938797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-2c76e479-6287-4da2-8002-4761afb8d057 req-82527e8e-d93d-42da-9bb3-1115b82d1c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4202eff-421b-4ea2-985b-ef6ef6c041b0", "name": "network-vif-plugged", "status": "completed", "tag": "b0e47c3a-b0d0-4fa8-9e41-9bf2c7140edc"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:31.952166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2c76e479-6287-4da2-8002-4761afb8d057 req-82527e8e-d93d-42da-9bb3-1115b82d1c4d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:31.953404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2c76e479-6287-4da2-8002-4761afb8d057 req-82527e8e-d93d-42da-9bb3-1115b82d1c4d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:31.954033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2c76e479-6287-4da2-8002-4761afb8d057 req-82527e8e-d93d-42da-9bb3-1115b82d1c4d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:32.001114 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-2c76e479-6287-4da2-8002-4761afb8d057 req-82527e8e-d93d-42da-9bb3-1115b82d1c4d service nova] Creating event network-vif-plugged:b0e47c3a-b0d0-4fa8-9e41-9bf2c7140edc for instance d4202eff-421b-4ea2-985b-ef6ef6c041b0 on n-h1-861111-1 Oct 12 22:04:32.025354 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-2c76e479-6287-4da2-8002-4761afb8d057 req-82527e8e-d93d-42da-9bb3-1115b82d1c4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085090 Oct 12 22:04:32.029782 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 746/1432] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:32.053573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b90ce5f1-080e-4df9-b034-364a0c8ff662 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:32.063753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b90ce5f1-080e-4df9-b034-364a0c8ff662 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:32.077647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b90ce5f1-080e-4df9-b034-364a0c8ff662 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:32.078138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b90ce5f1-080e-4df9-b034-364a0c8ff662 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:32.078579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b90ce5f1-080e-4df9-b034-364a0c8ff662 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:32.090437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b90ce5f1-080e-4df9-b034-364a0c8ff662 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:32.091080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b90ce5f1-080e-4df9-b034-364a0c8ff662 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:32.091569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b90ce5f1-080e-4df9-b034-364a0c8ff662 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:32.273438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b90ce5f1-080e-4df9-b034-364a0c8ff662 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:32.293898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b90ce5f1-080e-4df9-b034-364a0c8ff662 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:32.297917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b90ce5f1-080e-4df9-b034-364a0c8ff662 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:32.310942 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b90ce5f1-080e-4df9-b034-364a0c8ff662 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1438 microversion: 2.75 time: 0.275930 Oct 12 22:04:32.312433 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 747/1433] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:32 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1438 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:32.317370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b56e1e38-cc99-4ec7-be15-c082e0ab10d9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:32.318041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b56e1e38-cc99-4ec7-be15-c082e0ab10d9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:32.338413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b56e1e38-cc99-4ec7-be15-c082e0ab10d9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:32.339831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b56e1e38-cc99-4ec7-be15-c082e0ab10d9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:32.340687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b56e1e38-cc99-4ec7-be15-c082e0ab10d9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:32.346853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b56e1e38-cc99-4ec7-be15-c082e0ab10d9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:32.349448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b56e1e38-cc99-4ec7-be15-c082e0ab10d9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:32.350169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b56e1e38-cc99-4ec7-be15-c082e0ab10d9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:32.789156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b56e1e38-cc99-4ec7-be15-c082e0ab10d9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:32.797233 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b56e1e38-cc99-4ec7-be15-c082e0ab10d9 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 200 len: 1318 microversion: 2.1 time: 0.484228 Oct 12 22:04:32.799755 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 748/1434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:32 2022] GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:32.806220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a6726602-53ca-49f0-bae7-bafd37293d63 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:32.807874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a6726602-53ca-49f0-bae7-bafd37293d63 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:32.829456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6726602-53ca-49f0-bae7-bafd37293d63 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:32.830728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6726602-53ca-49f0-bae7-bafd37293d63 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:32.831412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6726602-53ca-49f0-bae7-bafd37293d63 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:32.832927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6726602-53ca-49f0-bae7-bafd37293d63 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:32.833557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6726602-53ca-49f0-bae7-bafd37293d63 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:32.834148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6726602-53ca-49f0-bae7-bafd37293d63 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:32.946672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a6726602-53ca-49f0-bae7-bafd37293d63 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:32.955392 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a6726602-53ca-49f0-bae7-bafd37293d63 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1273 microversion: 2.1 time: 0.154376 Oct 12 22:04:32.955984 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 749/1435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:32 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:33.291965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:33.297621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:33.325610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:33.330029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:33.334013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:33.335654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:33.337734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-002e026d-699f-4a2f-906d-457aa0402b03 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:33.341131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:33.344788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:33.370024 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-002e026d-699f-4a2f-906d-457aa0402b03 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 1.922389 Oct 12 22:04:33.375337 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 687/1436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:31 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:33.388155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5b155b6c-59fb-4e56-8a56-f6cb2388b303 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51283a9430>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:33.476206 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5b155b6c-59fb-4e56-8a56-f6cb2388b303 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.096031 Oct 12 22:04:33.478284 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 688/1437] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:33 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:33.487709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4e45075f-fda8-4da3-9403-3134dfdefa94 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:33.488610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4e45075f-fda8-4da3-9403-3134dfdefa94 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:33.514265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e45075f-fda8-4da3-9403-3134dfdefa94 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:33.516562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e45075f-fda8-4da3-9403-3134dfdefa94 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:33.517209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e45075f-fda8-4da3-9403-3134dfdefa94 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:33.519289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e45075f-fda8-4da3-9403-3134dfdefa94 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:33.521383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e45075f-fda8-4da3-9403-3134dfdefa94 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:33.524725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e45075f-fda8-4da3-9403-3134dfdefa94 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:33.581026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:04:33.584160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:04:33.586136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:04:33.588459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:04:33.589110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:04:33.715956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:33.736951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:33.737778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:33.738961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:33.740168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:33.740731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:33.741488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:33.898401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:34.002769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:34.030794 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cdd1fe79-5792-48c1-aab7-ac824a3e83d5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b/action" status: 202 len: 1942 microversion: 2.75 time: 1.068073 Oct 12 22:04:34.032247 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 750/1438] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 12 22:04:32 2022] POST /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b/action => generated 1942 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 12 22:04:34.037421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a2607408-064e-4b0e-951e-5b994d9a2c09 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:34.038393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a2607408-064e-4b0e-951e-5b994d9a2c09 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:34.045812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2607408-064e-4b0e-951e-5b994d9a2c09 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:34.046648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2607408-064e-4b0e-951e-5b994d9a2c09 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:34.047549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2607408-064e-4b0e-951e-5b994d9a2c09 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:34.049880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2607408-064e-4b0e-951e-5b994d9a2c09 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:34.050681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2607408-064e-4b0e-951e-5b994d9a2c09 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:34.051419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2607408-064e-4b0e-951e-5b994d9a2c09 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:34.279673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4e45075f-fda8-4da3-9403-3134dfdefa94 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:34.296310 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4e45075f-fda8-4da3-9403-3134dfdefa94 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1471 microversion: 2.1 time: 0.816330 Oct 12 22:04:34.299614 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 689/1439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:33 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1471 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:34.312033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b7d9eafe-6ce1-43b8-baa7-f6a95fc6d388 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:34.312939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b7d9eafe-6ce1-43b8-baa7-f6a95fc6d388 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:34.331974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7d9eafe-6ce1-43b8-baa7-f6a95fc6d388 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:34.333333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7d9eafe-6ce1-43b8-baa7-f6a95fc6d388 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:34.335296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7d9eafe-6ce1-43b8-baa7-f6a95fc6d388 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:34.337914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7d9eafe-6ce1-43b8-baa7-f6a95fc6d388 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:34.339055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7d9eafe-6ce1-43b8-baa7-f6a95fc6d388 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:34.340760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7d9eafe-6ce1-43b8-baa7-f6a95fc6d388 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:34.517321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b7d9eafe-6ce1-43b8-baa7-f6a95fc6d388 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:34.528171 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b7d9eafe-6ce1-43b8-baa7-f6a95fc6d388 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1281 microversion: 2.1 time: 0.227001 Oct 12 22:04:34.531367 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 690/1440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:34 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1281 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:34.544342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8018e26c-a633-465c-994d-0447d35a7520 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:34.545651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8018e26c-a633-465c-994d-0447d35a7520 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:34.560322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8018e26c-a633-465c-994d-0447d35a7520 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:34.561119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8018e26c-a633-465c-994d-0447d35a7520 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:34.563486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8018e26c-a633-465c-994d-0447d35a7520 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:34.564431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8018e26c-a633-465c-994d-0447d35a7520 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:34.566207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8018e26c-a633-465c-994d-0447d35a7520 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:34.568955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8018e26c-a633-465c-994d-0447d35a7520 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:34.617168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a2607408-064e-4b0e-951e-5b994d9a2c09 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:34.632364 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a2607408-064e-4b0e-951e-5b994d9a2c09 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 200 len: 1318 microversion: 2.1 time: 0.596415 Oct 12 22:04:34.633489 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 751/1441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:34 2022] GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 1318 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:34.639617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c3cc5760-170d-4be2-bf8b-b3cf861eca72 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:34.643990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c3cc5760-170d-4be2-bf8b-b3cf861eca72 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:34.661171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3cc5760-170d-4be2-bf8b-b3cf861eca72 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:34.661928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3cc5760-170d-4be2-bf8b-b3cf861eca72 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:34.662526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3cc5760-170d-4be2-bf8b-b3cf861eca72 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:34.663441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3cc5760-170d-4be2-bf8b-b3cf861eca72 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:34.664050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3cc5760-170d-4be2-bf8b-b3cf861eca72 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:34.664658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3cc5760-170d-4be2-bf8b-b3cf861eca72 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:34.833531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-8018e26c-a633-465c-994d-0447d35a7520 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:34.878666 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8018e26c-a633-465c-994d-0447d35a7520 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1929 microversion: 2.75 time: 0.344893 Oct 12 22:04:34.879287 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 691/1442] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:34 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1929 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:34.891879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b643f64f-fb06-4256-b91b-5d741e9a9f52 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512836f0d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:34.963864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c3cc5760-170d-4be2-bf8b-b3cf861eca72 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:34.976975 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c3cc5760-170d-4be2-bf8b-b3cf861eca72 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.338855 Oct 12 22:04:34.979372 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 752/1443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:34 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:34.984617 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b643f64f-fb06-4256-b91b-5d741e9a9f52 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.104268 Oct 12 22:04:34.985170 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 692/1444] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:34 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:34.992811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f0e6cb9b-11ab-4c59-a4b5-f6e70fe85d76 req-af33780b-554e-4235-9797-13240bf01df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48128c05-1d65-46fb-accf-2dd2981a742b", "name": "network-vif-plugged", "status": "completed", "tag": "51d433b5-9d81-423f-86a9-27412dea934c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:35.021111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f0e6cb9b-11ab-4c59-a4b5-f6e70fe85d76 req-af33780b-554e-4235-9797-13240bf01df5 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:35.022004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f0e6cb9b-11ab-4c59-a4b5-f6e70fe85d76 req-af33780b-554e-4235-9797-13240bf01df5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:35.022680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f0e6cb9b-11ab-4c59-a4b5-f6e70fe85d76 req-af33780b-554e-4235-9797-13240bf01df5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:35.322110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-28440b69-f0b2-4ee2-bd86-f9f3d652d143 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:35.322986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-28440b69-f0b2-4ee2-bd86-f9f3d652d143 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:35.338769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28440b69-f0b2-4ee2-bd86-f9f3d652d143 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:35.343029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28440b69-f0b2-4ee2-bd86-f9f3d652d143 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:35.346242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28440b69-f0b2-4ee2-bd86-f9f3d652d143 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:35.350099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28440b69-f0b2-4ee2-bd86-f9f3d652d143 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:35.351740 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f0e6cb9b-11ab-4c59-a4b5-f6e70fe85d76 req-af33780b-554e-4235-9797-13240bf01df5 service nova] Creating event network-vif-plugged:51d433b5-9d81-423f-86a9-27412dea934c for instance 48128c05-1d65-46fb-accf-2dd2981a742b on n-h1-861111-1 Oct 12 22:04:35.353247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28440b69-f0b2-4ee2-bd86-f9f3d652d143 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:35.356993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28440b69-f0b2-4ee2-bd86-f9f3d652d143 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:35.360067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-f0e6cb9b-11ab-4c59-a4b5-f6e70fe85d76 req-af33780b-554e-4235-9797-13240bf01df5 service nova] Instance 48128c05-1d65-46fb-accf-2dd2981a742b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:04:35.367316 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f0e6cb9b-11ab-4c59-a4b5-f6e70fe85d76 req-af33780b-554e-4235-9797-13240bf01df5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.386458 Oct 12 22:04:35.368758 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 753/1445] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:35.557997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-afc50a4e-54a2-47de-a4d1-ea5686003ebf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:35.560627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-afc50a4e-54a2-47de-a4d1-ea5686003ebf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:35.573394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-afc50a4e-54a2-47de-a4d1-ea5686003ebf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:35.574752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-afc50a4e-54a2-47de-a4d1-ea5686003ebf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:35.575214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-afc50a4e-54a2-47de-a4d1-ea5686003ebf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:35.576741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-afc50a4e-54a2-47de-a4d1-ea5686003ebf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:35.577456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-afc50a4e-54a2-47de-a4d1-ea5686003ebf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:35.577984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-afc50a4e-54a2-47de-a4d1-ea5686003ebf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:35.673558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-afc50a4e-54a2-47de-a4d1-ea5686003ebf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:35.691771 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-afc50a4e-54a2-47de-a4d1-ea5686003ebf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1279 microversion: 2.1 time: 0.139603 Oct 12 22:04:35.712714 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 754/1446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:35 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1279 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:35.717921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d88a50b6-dbd1-4664-85f0-f990916ec02e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:35.718550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d88a50b6-dbd1-4664-85f0-f990916ec02e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:35.737002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d88a50b6-dbd1-4664-85f0-f990916ec02e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:35.737506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d88a50b6-dbd1-4664-85f0-f990916ec02e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:35.737948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d88a50b6-dbd1-4664-85f0-f990916ec02e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:35.738776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d88a50b6-dbd1-4664-85f0-f990916ec02e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:35.741504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d88a50b6-dbd1-4664-85f0-f990916ec02e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:35.742047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d88a50b6-dbd1-4664-85f0-f990916ec02e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:35.988472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d88a50b6-dbd1-4664-85f0-f990916ec02e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:35.996588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:36.012010 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d88a50b6-dbd1-4664-85f0-f990916ec02e tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 200 len: 1508 microversion: 2.1 time: 0.296700 Oct 12 22:04:36.034752 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 755/1447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:35 2022] GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 1508 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:36.040406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5cfca759-fc54-4342-b138-9a664bcd4597 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:36.041009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5cfca759-fc54-4342-b138-9a664bcd4597 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:36.048580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cfca759-fc54-4342-b138-9a664bcd4597 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:36.050304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cfca759-fc54-4342-b138-9a664bcd4597 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:36.050759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cfca759-fc54-4342-b138-9a664bcd4597 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:36.052504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cfca759-fc54-4342-b138-9a664bcd4597 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:36.052853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cfca759-fc54-4342-b138-9a664bcd4597 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:36.053971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cfca759-fc54-4342-b138-9a664bcd4597 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:36.274939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-5cfca759-fc54-4342-b138-9a664bcd4597 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:36.318401 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5cfca759-fc54-4342-b138-9a664bcd4597 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1929 microversion: 2.75 time: 0.282281 Oct 12 22:04:36.319932 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 756/1448] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:36 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1929 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:36.325647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-06bb4276-0e1a-4e0b-a511-2fd37f41cd58 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128312430>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:36.404974 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-06bb4276-0e1a-4e0b-a511-2fd37f41cd58 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1438 microversion: 2.1 time: 0.083197 Oct 12 22:04:36.405436 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 757/1449] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:36 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1438 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:36.410811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-55b56451-e720-45a1-bd28-70f85333b9f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:36.411458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-55b56451-e720-45a1-bd28-70f85333b9f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:36.446299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55b56451-e720-45a1-bd28-70f85333b9f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:36.446789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55b56451-e720-45a1-bd28-70f85333b9f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:36.447254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55b56451-e720-45a1-bd28-70f85333b9f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:36.447968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55b56451-e720-45a1-bd28-70f85333b9f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:36.448421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55b56451-e720-45a1-bd28-70f85333b9f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:36.448847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55b56451-e720-45a1-bd28-70f85333b9f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:36.754389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-28440b69-f0b2-4ee2-bd86-f9f3d652d143 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:36.764339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-55b56451-e720-45a1-bd28-70f85333b9f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:36.765502 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-28440b69-f0b2-4ee2-bd86-f9f3d652d143 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1471 microversion: 2.1 time: 1.447279 Oct 12 22:04:36.767465 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 693/1450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:35 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1471 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:36.776118 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-55b56451-e720-45a1-bd28-70f85333b9f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.368947 Oct 12 22:04:36.791492 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 758/1451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:36 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:36.793501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-58dbd8d9-e0bf-472d-b8fc-1960a1b71327 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:36.793501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-58dbd8d9-e0bf-472d-b8fc-1960a1b71327 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:36.815530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58dbd8d9-e0bf-472d-b8fc-1960a1b71327 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:36.816201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58dbd8d9-e0bf-472d-b8fc-1960a1b71327 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:36.816654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58dbd8d9-e0bf-472d-b8fc-1960a1b71327 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:36.817383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58dbd8d9-e0bf-472d-b8fc-1960a1b71327 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:36.817844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58dbd8d9-e0bf-472d-b8fc-1960a1b71327 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:36.818276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58dbd8d9-e0bf-472d-b8fc-1960a1b71327 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:37.063044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-39c4ed75-9ef8-4dc8-b67a-f21b40ed8c9f req-1db0d826-ff54-4380-a8dc-8baf0622541f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d06c998-c0a6-4bb7-8538-9a7b0298b918", "name": "network-vif-unplugged", "status": "completed", "tag": "6a950ceb-e8e8-414f-921b-8239a9d66a46"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:37.079421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-39c4ed75-9ef8-4dc8-b67a-f21b40ed8c9f req-1db0d826-ff54-4380-a8dc-8baf0622541f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:37.080726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-39c4ed75-9ef8-4dc8-b67a-f21b40ed8c9f req-1db0d826-ff54-4380-a8dc-8baf0622541f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:37.081168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-39c4ed75-9ef8-4dc8-b67a-f21b40ed8c9f req-1db0d826-ff54-4380-a8dc-8baf0622541f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:37.106943 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-39c4ed75-9ef8-4dc8-b67a-f21b40ed8c9f req-1db0d826-ff54-4380-a8dc-8baf0622541f service nova] Creating event network-vif-unplugged:6a950ceb-e8e8-414f-921b-8239a9d66a46 for instance 3d06c998-c0a6-4bb7-8538-9a7b0298b918 on n-h2-861111-1 Oct 12 22:04:37.119736 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-39c4ed75-9ef8-4dc8-b67a-f21b40ed8c9f req-1db0d826-ff54-4380-a8dc-8baf0622541f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.232775 Oct 12 22:04:37.124159 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 759/1452] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:04:37.193002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-58dbd8d9-e0bf-472d-b8fc-1960a1b71327 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:37.202625 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-58dbd8d9-e0bf-472d-b8fc-1960a1b71327 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1279 microversion: 2.1 time: 0.431666 Oct 12 22:04:37.206683 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 694/1453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:36 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1279 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:37.351353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-580620ac-d21c-4d4f-a777-7385ce536411 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:37.352190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-580620ac-d21c-4d4f-a777-7385ce536411 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:37.369734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-580620ac-d21c-4d4f-a777-7385ce536411 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:37.374958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-580620ac-d21c-4d4f-a777-7385ce536411 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:37.375679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-580620ac-d21c-4d4f-a777-7385ce536411 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:37.376540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-580620ac-d21c-4d4f-a777-7385ce536411 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:37.378580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-580620ac-d21c-4d4f-a777-7385ce536411 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:37.379280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-580620ac-d21c-4d4f-a777-7385ce536411 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:37.419917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ae7fec04-8a28-40cf-b5f3-227bd8df8120 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512837b670>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:37.492066 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ae7fec04-8a28-40cf-b5f3-227bd8df8120 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1447 microversion: 2.1 time: 0.076274 Oct 12 22:04:37.498036 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 695/1454] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:37 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1447 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:37.532629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d37f944f-523c-4ca5-bf02-14dade43cfbf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512834e8b0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:37.622669 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d37f944f-523c-4ca5-bf02-14dade43cfbf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 200 len: 1447 microversion: 2.1 time: 0.115249 Oct 12 22:04:37.624197 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 696/1455] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:04:37 2022] GET /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 1447 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:37.659935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e97c0460-9298-4b66-b248-dd59e2fd566d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128323820>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:37.669430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-580620ac-d21c-4d4f-a777-7385ce536411 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:37.743678 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-580620ac-d21c-4d4f-a777-7385ce536411 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1929 microversion: 2.75 time: 0.395181 Oct 12 22:04:37.747911 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 760/1456] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:37 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1929 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:37.806384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5c8b7567-35fe-4702-8d7b-dcab670f5097 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:37.808126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5c8b7567-35fe-4702-8d7b-dcab670f5097 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:37.824659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c8b7567-35fe-4702-8d7b-dcab670f5097 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:37.829308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c8b7567-35fe-4702-8d7b-dcab670f5097 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:37.829793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c8b7567-35fe-4702-8d7b-dcab670f5097 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:37.831333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c8b7567-35fe-4702-8d7b-dcab670f5097 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:37.832589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c8b7567-35fe-4702-8d7b-dcab670f5097 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:37.833039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c8b7567-35fe-4702-8d7b-dcab670f5097 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:38.494898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5c8b7567-35fe-4702-8d7b-dcab670f5097 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:38.513600 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5c8b7567-35fe-4702-8d7b-dcab670f5097 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1471 microversion: 2.1 time: 0.711873 Oct 12 22:04:38.527314 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 761/1457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:37 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1471 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:38.554474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4b06303b-2f26-4863-b19d-494121a51a19 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:38.555919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4b06303b-2f26-4863-b19d-494121a51a19 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:38.591718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b06303b-2f26-4863-b19d-494121a51a19 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:38.598047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b06303b-2f26-4863-b19d-494121a51a19 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:38.600271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b06303b-2f26-4863-b19d-494121a51a19 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:38.606533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b06303b-2f26-4863-b19d-494121a51a19 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:38.607715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b06303b-2f26-4863-b19d-494121a51a19 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:38.612927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b06303b-2f26-4863-b19d-494121a51a19 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:38.737620 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e97c0460-9298-4b66-b248-dd59e2fd566d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 204 len: 0 microversion: 2.1 time: 1.101580 Oct 12 22:04:38.740437 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 697/1458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:37 2022] DELETE /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 0 bytes in 1106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:04:38.746294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-65c779d7-77e0-4874-ab65-59c5a018399e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:38.748229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-65c779d7-77e0-4874-ab65-59c5a018399e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:38.762992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65c779d7-77e0-4874-ab65-59c5a018399e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:38.763512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65c779d7-77e0-4874-ab65-59c5a018399e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:38.763944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65c779d7-77e0-4874-ab65-59c5a018399e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:38.771050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65c779d7-77e0-4874-ab65-59c5a018399e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:38.772857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65c779d7-77e0-4874-ab65-59c5a018399e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:38.774564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65c779d7-77e0-4874-ab65-59c5a018399e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:38.987564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-65c779d7-77e0-4874-ab65-59c5a018399e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:39.000935 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-65c779d7-77e0-4874-ab65-59c5a018399e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1279 microversion: 2.1 time: 0.259105 Oct 12 22:04:39.001788 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 698/1459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:38 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1279 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:39.008661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ac3bc264-1da3-40a7-a6c8-214510c556c8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:39.010558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ac3bc264-1da3-40a7-a6c8-214510c556c8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:39.024009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3bc264-1da3-40a7-a6c8-214510c556c8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:39.032006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3bc264-1da3-40a7-a6c8-214510c556c8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:39.032701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3bc264-1da3-40a7-a6c8-214510c556c8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:39.033506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3bc264-1da3-40a7-a6c8-214510c556c8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:39.034090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3bc264-1da3-40a7-a6c8-214510c556c8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:39.034552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3bc264-1da3-40a7-a6c8-214510c556c8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:39.062046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b06303b-2f26-4863-b19d-494121a51a19 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:39.075668 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4b06303b-2f26-4863-b19d-494121a51a19 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.554666 Oct 12 22:04:39.076737 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 762/1460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:38 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:39.096465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ac3bc264-1da3-40a7-a6c8-214510c556c8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:04:39.115862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-36d3356e-b597-4d89-9060-4617f7113955 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:39.116621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-36d3356e-b597-4d89-9060-4617f7113955 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:39.130792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36d3356e-b597-4d89-9060-4617f7113955 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:39.132597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36d3356e-b597-4d89-9060-4617f7113955 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:39.135650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36d3356e-b597-4d89-9060-4617f7113955 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:39.136706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36d3356e-b597-4d89-9060-4617f7113955 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:39.137861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36d3356e-b597-4d89-9060-4617f7113955 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:39.139182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36d3356e-b597-4d89-9060-4617f7113955 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:39.169410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:39.236860 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ac3bc264-1da3-40a7-a6c8-214510c556c8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8" status: 204 len: 0 microversion: 2.1 time: 0.233658 Oct 12 22:04:39.237504 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 699/1461] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:04:39 2022] DELETE /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:04:39.255046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1ffcce7f-d44f-46d7-8bf0-3e91bea7df82 tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c3898d8e-13e2-4cd3-b0e0-e78e313858f0"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:39.264795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1ffcce7f-d44f-46d7-8bf0-3e91bea7df82 tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:39.276953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ffcce7f-d44f-46d7-8bf0-3e91bea7df82 tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:39.280064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ffcce7f-d44f-46d7-8bf0-3e91bea7df82 tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:39.282532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ffcce7f-d44f-46d7-8bf0-3e91bea7df82 tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:39.284422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ffcce7f-d44f-46d7-8bf0-3e91bea7df82 tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:39.285053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ffcce7f-d44f-46d7-8bf0-3e91bea7df82 tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:39.286381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ffcce7f-d44f-46d7-8bf0-3e91bea7df82 tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:39.398849 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-1ffcce7f-d44f-46d7-8bf0-3e91bea7df82 tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] HTTP exception thrown: Volume 6fc96bf8-a59c-4972-b98b-fdbbd212841a could not be found. Oct 12 22:04:39.420180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-36d3356e-b597-4d89-9060-4617f7113955 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1ffcce7f-d44f-46d7-8bf0-3e91bea7df82 tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Request method failure captured: Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: request: PUT /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0/os-volume_attachments/6fc96bf8-a59c-4972-b98b-fdbbd212841a HTTP/1.1 Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 74 Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzl914zYMwbBTEX8H3qKsvJhXtJIyskEArt9doVCclqiuTJXEEiO4ZxXP89zRvuZscbwfe8r1iTSUn3J3VcNameo9MenZL0LwAmYMa-3Z3H6ljbZYrAgGzlr65msIwrGNxn7BpOap0YG3TxjwN3IbEZQY0oir0K22bHEpKjv5Kvlu8I Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 833bbe9db25a48bc9724f6e392dd6a81 Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesAdminNegativeTest-1069867481 Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 22:04:39.421821 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 22:04:39.423524 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/833bbe9db25a48bc9724f6e392dd6a81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/833bbe9db25a48bc9724f6e392dd6a81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_833bbe9db25a48bc9724f6e392dd6a81", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/833bbe9db25a48bc9724f6e392dd6a81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:04:39.423524 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-VolumesAdminNegativeTest-1069867481 Oct 12 22:04:39.423524 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 833bbe9db25a48bc9724f6e392dd6a81 Oct 12 22:04:39.423524 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1069867481 Oct 12 22:04:39.423524 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-VolumesAdminNegativeTest-1069867481-project-admin Oct 12 22:04:39.423524 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:04:39.423524 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:04:39.423524 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 784a5d090fa64b4a8539c3093c98aa1d Oct 12 22:04:39.423524 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-VolumesAdminNegativeTest-1069867481-project-admin Oct 12 22:04:39.423524 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:04:39.423524 n-d-861111-1 devstack@n-api.service[120452]: {"volumeAttachment": {"volumeId": "c3898d8e-13e2-4cd3-b0e0-e78e313858f0"}} Oct 12 22:04:39.423524 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:04:39.423524 n-d-861111-1 devstack@n-api.service[120452]: exception: Volume 6fc96bf8-a59c-4972-b98b-fdbbd212841a could not be found. Oct 12 22:04:39.424565 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'server_id': 'd4202eff-421b-4ea2-985b-ef6ef6c041b0', 'id': '6fc96bf8-a59c-4972-b98b-fdbbd212841a', 'body': {'volumeAttachment': {'volumeId': 'c3898d8e-13e2-4cd3-b0e0-e78e313858f0'}}} Oct 12 22:04:39.424565 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:04:39.424565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:39.424565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:04:39.424565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:04:39.424565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:04:39.424565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:04:39.424565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:04:39.424565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:04:39.424565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:04:39.424565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:04:39.424565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:04:39.424565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:04:39.424565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:04:39.424565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:04:39.424565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:04:39.424565 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6fc96bf8-a59c-4972-b98b-fdbbd212841a could not be found. (HTTP 404) (Request-ID: req-fe577785-d935-4387-8302-35e03bbf3333) Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:04:39.426378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6fc96bf8-a59c-4972-b98b-fdbbd212841a could not be found. Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:04:39.429089 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6fc96bf8-a59c-4972-b98b-fdbbd212841a could not be found. Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6fc96bf8-a59c-4972-b98b-fdbbd212841a could not be found. Oct 12 22:04:39.430979 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:04:39.433642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1ffcce7f-d44f-46d7-8bf0-3e91bea7df82 tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] Returning 404 to user: Volume 6fc96bf8-a59c-4972-b98b-fdbbd212841a could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:04:39.434429 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1ffcce7f-d44f-46d7-8bf0-3e91bea7df82 tempest-VolumesAdminNegativeTest-1069867481 tempest-VolumesAdminNegativeTest-1069867481-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0/os-volume_attachments/6fc96bf8-a59c-4972-b98b-fdbbd212841a" status: 404 len: 109 microversion: 2.1 time: 0.195850 Oct 12 22:04:39.435481 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 700/1462] 10.222.0.16 () {60 vars in 1433 bytes} [Wed Oct 12 22:04:39 2022] PUT /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0/os-volume_attachments/6fc96bf8-a59c-4972-b98b-fdbbd212841a => generated 109 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:04:39.440717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-9e21a977-5c4b-4f1b-86c4-8786d9169673 req-9445016c-1259-4ba3-a3c3-a59ff46e4c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d06c998-c0a6-4bb7-8538-9a7b0298b918", "tag": "6a950ceb-e8e8-414f-921b-8239a9d66a46"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:39.469966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9e21a977-5c4b-4f1b-86c4-8786d9169673 req-9445016c-1259-4ba3-a3c3-a59ff46e4c17 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:39.470836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9e21a977-5c4b-4f1b-86c4-8786d9169673 req-9445016c-1259-4ba3-a3c3-a59ff46e4c17 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:39.471810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9e21a977-5c4b-4f1b-86c4-8786d9169673 req-9445016c-1259-4ba3-a3c3-a59ff46e4c17 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:39.478712 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-36d3356e-b597-4d89-9060-4617f7113955 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1929 microversion: 2.75 time: 0.400449 Oct 12 22:04:39.485744 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 763/1463] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:39 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1929 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:39.490653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-43733254", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "1bfd60f2-0202-40db-8761-3b71d02412dc"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:39.498739 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-9e21a977-5c4b-4f1b-86c4-8786d9169673 req-9445016c-1259-4ba3-a3c3-a59ff46e4c17 service nova] Creating event network-changed:6a950ceb-e8e8-414f-921b-8239a9d66a46 for instance 3d06c998-c0a6-4bb7-8538-9a7b0298b918 on n-h2-861111-1 Oct 12 22:04:39.510250 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-9e21a977-5c4b-4f1b-86c4-8786d9169673 req-9445016c-1259-4ba3-a3c3-a59ff46e4c17 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073286 Oct 12 22:04:39.511286 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 701/1464] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:39.542175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-840da589-0514-4ed7-9428-a0f2d2c11576 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:39.543567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-840da589-0514-4ed7-9428-a0f2d2c11576 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:39.557777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-840da589-0514-4ed7-9428-a0f2d2c11576 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:39.560745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-840da589-0514-4ed7-9428-a0f2d2c11576 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:39.561624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-840da589-0514-4ed7-9428-a0f2d2c11576 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:39.567457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-840da589-0514-4ed7-9428-a0f2d2c11576 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:39.568087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-840da589-0514-4ed7-9428-a0f2d2c11576 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:39.569043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-840da589-0514-4ed7-9428-a0f2d2c11576 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:39.658266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] validate_networks() for [('1bfd60f2-0202-40db-8761-3b71d02412dc', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:04:39.900119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:39.974601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=12 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:40.472097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-840da589-0514-4ed7-9428-a0f2d2c11576 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:40.482620 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-840da589-0514-4ed7-9428-a0f2d2c11576 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1463 microversion: 2.1 time: 0.945170 Oct 12 22:04:40.483680 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 702/1465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:39 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1463 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:40.488641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2793ec0c-5dcb-40f5-a67b-b1fe22003f75 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:40.489246 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2793ec0c-5dcb-40f5-a67b-b1fe22003f75 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:40.513075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2793ec0c-5dcb-40f5-a67b-b1fe22003f75 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:40.513807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2793ec0c-5dcb-40f5-a67b-b1fe22003f75 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:40.514736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2793ec0c-5dcb-40f5-a67b-b1fe22003f75 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:40.515667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2793ec0c-5dcb-40f5-a67b-b1fe22003f75 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:40.516285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2793ec0c-5dcb-40f5-a67b-b1fe22003f75 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:40.516870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2793ec0c-5dcb-40f5-a67b-b1fe22003f75 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:40.931215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:40.958177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2793ec0c-5dcb-40f5-a67b-b1fe22003f75 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:40.988879 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2793ec0c-5dcb-40f5-a67b-b1fe22003f75 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1321 microversion: 2.1 time: 0.504035 Oct 12 22:04:40.989806 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 703/1466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:40 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1321 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:41.002823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0b4cb749-17c6-4b12-a60d-05d9190ccab9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:41.004327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0b4cb749-17c6-4b12-a60d-05d9190ccab9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:41.015923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b4cb749-17c6-4b12-a60d-05d9190ccab9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:41.016672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b4cb749-17c6-4b12-a60d-05d9190ccab9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:41.017874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b4cb749-17c6-4b12-a60d-05d9190ccab9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:41.020373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b4cb749-17c6-4b12-a60d-05d9190ccab9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:41.021021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b4cb749-17c6-4b12-a60d-05d9190ccab9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:41.021604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b4cb749-17c6-4b12-a60d-05d9190ccab9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:41.362857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:04:41.363453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:04:41.364079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:04:41.364506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:04:41.365012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:04:41.382119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:41.383095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:41.386400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:41.387546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:41.388140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:41.388668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:41.415091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Getting quotas for project 0905a1286e134e34a55ceaaa6c23718e. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:04:41.421004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Getting quotas for user 7224dcaeabdd4199b9682e99912f7740 and project 0905a1286e134e34a55ceaaa6c23718e. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:04:41.438905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:04:41.441623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:04:41.476068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0b4cb749-17c6-4b12-a60d-05d9190ccab9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:41.488698 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0b4cb749-17c6-4b12-a60d-05d9190ccab9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.497528 Oct 12 22:04:41.494026 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 704/1467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:40 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:41.509377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3e39c56d-67f5-44a5-afb5-c5f420093d23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:41.520327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3e39c56d-67f5-44a5-afb5-c5f420093d23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:41.528940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e39c56d-67f5-44a5-afb5-c5f420093d23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:41.529782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e39c56d-67f5-44a5-afb5-c5f420093d23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:41.530481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e39c56d-67f5-44a5-afb5-c5f420093d23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:41.531432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e39c56d-67f5-44a5-afb5-c5f420093d23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:41.532037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e39c56d-67f5-44a5-afb5-c5f420093d23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:41.537195 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-59e465d0-b02f-426a-afe8-5db14f9b785b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.050282 Oct 12 22:04:41.537849 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 764/1468] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:04:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:04:41.546484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e39c56d-67f5-44a5-afb5-c5f420093d23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:41.548956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4c8e80f1-13ce-433c-bc8c-e1b0da467181 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:41.549572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4c8e80f1-13ce-433c-bc8c-e1b0da467181 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:41.571549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c8e80f1-13ce-433c-bc8c-e1b0da467181 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:41.572011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c8e80f1-13ce-433c-bc8c-e1b0da467181 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:41.572624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c8e80f1-13ce-433c-bc8c-e1b0da467181 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:41.578182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c8e80f1-13ce-433c-bc8c-e1b0da467181 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:41.579100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c8e80f1-13ce-433c-bc8c-e1b0da467181 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:41.579706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c8e80f1-13ce-433c-bc8c-e1b0da467181 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:41.928446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-4c8e80f1-13ce-433c-bc8c-e1b0da467181 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:41.966791 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4c8e80f1-13ce-433c-bc8c-e1b0da467181 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1929 microversion: 2.75 time: 0.427897 Oct 12 22:04:41.967670 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 765/1469] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:41 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1929 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:41.982792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5d34db74-c963-4635-ba26-068b9e575789 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:41.983811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5d34db74-c963-4635-ba26-068b9e575789 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:41.991752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d34db74-c963-4635-ba26-068b9e575789 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:41.993145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d34db74-c963-4635-ba26-068b9e575789 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:41.996429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d34db74-c963-4635-ba26-068b9e575789 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:41.997297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d34db74-c963-4635-ba26-068b9e575789 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:41.997882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d34db74-c963-4635-ba26-068b9e575789 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:42.008298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d34db74-c963-4635-ba26-068b9e575789 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:42.098047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3e39c56d-67f5-44a5-afb5-c5f420093d23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:42.140674 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3e39c56d-67f5-44a5-afb5-c5f420093d23 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1463 microversion: 2.1 time: 0.643196 Oct 12 22:04:42.141276 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 705/1470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:41 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1463 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:42.165189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b17dfa96-002f-4150-b501-ce2da6d9db26 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:42.165189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b17dfa96-002f-4150-b501-ce2da6d9db26 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:42.366187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b17dfa96-002f-4150-b501-ce2da6d9db26 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:42.377548 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b17dfa96-002f-4150-b501-ce2da6d9db26 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 200 len: 1206 microversion: 2.1 time: 0.235204 Oct 12 22:04:42.380072 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 706/1471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:42 2022] GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 1206 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:42.495220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-52e748b0-aa8c-4ba0-bcde-316683e8fa6e req-fc253f05-0506-4e0d-a7cf-e3cfe1293cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6", "tag": "4c86b396-60e9-4162-9c59-e36739bc7fa3"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:42.510680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-52e748b0-aa8c-4ba0-bcde-316683e8fa6e req-fc253f05-0506-4e0d-a7cf-e3cfe1293cb8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:42.511821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-52e748b0-aa8c-4ba0-bcde-316683e8fa6e req-fc253f05-0506-4e0d-a7cf-e3cfe1293cb8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:42.513274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-52e748b0-aa8c-4ba0-bcde-316683e8fa6e req-fc253f05-0506-4e0d-a7cf-e3cfe1293cb8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:42.527437 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-52e748b0-aa8c-4ba0-bcde-316683e8fa6e req-fc253f05-0506-4e0d-a7cf-e3cfe1293cb8 service nova] Creating event network-changed:4c86b396-60e9-4162-9c59-e36739bc7fa3 for instance 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 on n-h2-861111-1 Oct 12 22:04:42.532815 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-52e748b0-aa8c-4ba0-bcde-316683e8fa6e req-fc253f05-0506-4e0d-a7cf-e3cfe1293cb8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149798 Oct 12 22:04:42.533943 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 707/1472] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:42.540646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-edc1efba-cacb-4230-a858-5acceb29d2d3 req-9d9d4ffd-1e2f-4315-8c72-fb32eefc4c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ce6878-173f-47f8-ab81-3c60803702b8", "name": "network-vif-unplugged", "status": "completed", "tag": "7986b344-6016-4f6c-9d7d-12efc709af4c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:42.553852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-edc1efba-cacb-4230-a858-5acceb29d2d3 req-9d9d4ffd-1e2f-4315-8c72-fb32eefc4c60 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:42.554787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-edc1efba-cacb-4230-a858-5acceb29d2d3 req-9d9d4ffd-1e2f-4315-8c72-fb32eefc4c60 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:42.555728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-edc1efba-cacb-4230-a858-5acceb29d2d3 req-9d9d4ffd-1e2f-4315-8c72-fb32eefc4c60 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:42.573655 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-edc1efba-cacb-4230-a858-5acceb29d2d3 req-9d9d4ffd-1e2f-4315-8c72-fb32eefc4c60 service nova] Creating event network-vif-unplugged:7986b344-6016-4f6c-9d7d-12efc709af4c for instance 75ce6878-173f-47f8-ab81-3c60803702b8 on n-h1-861111-1 Oct 12 22:04:42.580005 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-edc1efba-cacb-4230-a858-5acceb29d2d3 req-9d9d4ffd-1e2f-4315-8c72-fb32eefc4c60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044272 Oct 12 22:04:42.581603 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 708/1473] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:42.589473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4175fd13-221c-4eb2-96aa-1ddbe30f2d8c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:42.590361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4175fd13-221c-4eb2-96aa-1ddbe30f2d8c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:42.598792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-5d34db74-c963-4635-ba26-068b9e575789 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'services' on Instance uuid 247e0252-3374-40b8-85f3-995d2031867d {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:42.606719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4175fd13-221c-4eb2-96aa-1ddbe30f2d8c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:42.607324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4175fd13-221c-4eb2-96aa-1ddbe30f2d8c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:42.607774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4175fd13-221c-4eb2-96aa-1ddbe30f2d8c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:42.608681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4175fd13-221c-4eb2-96aa-1ddbe30f2d8c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:42.611904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4175fd13-221c-4eb2-96aa-1ddbe30f2d8c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:42.613031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4175fd13-221c-4eb2-96aa-1ddbe30f2d8c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:42.646086 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5d34db74-c963-4635-ba26-068b9e575789 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 2422 microversion: 2.25 time: 0.673439 Oct 12 22:04:42.647853 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 766/1474] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:41 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 2422 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:42.657924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-412bb1b2-3400-4fb2-bd8e-b6f772c9a97c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Action: 'create', calling method: .version_select at 0x7f512c5830d0>, body: {"keypair": {"name": "tempest-keypair-3597662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD92AkQbhaQw1qmMrEr4upFRE9dOWQxeGBYHrWGRWLlXCJ6thz0t2dG7G3aPzgKbTuo7cExRnEdaL1ocEbH3J0BiZwef+Ppv46UULDOok8rK6QBJiNZRZM92zubpHayC5w=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:42.696923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-412bb1b2-3400-4fb2-bd8e-b6f772c9a97c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Getting quotas for project 7d943f8c0c934001b53032564fd00e11. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:04:42.732974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-412bb1b2-3400-4fb2-bd8e-b6f772c9a97c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Getting quotas for user cfc7df27bf6f456581abff6e80ab4f64 and project 7d943f8c0c934001b53032564fd00e11. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:04:42.800103 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-412bb1b2-3400-4fb2-bd8e-b6f772c9a97c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.149540 Oct 12 22:04:42.806718 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 767/1475] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:04:42 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:42.806718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6ea33e0c-f503-45fa-ada1-5da65b397de5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:42.807011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6ea33e0c-f503-45fa-ada1-5da65b397de5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:42.824990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ea33e0c-f503-45fa-ada1-5da65b397de5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:42.825623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ea33e0c-f503-45fa-ada1-5da65b397de5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:42.826238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ea33e0c-f503-45fa-ada1-5da65b397de5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:42.827050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ea33e0c-f503-45fa-ada1-5da65b397de5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:42.827637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ea33e0c-f503-45fa-ada1-5da65b397de5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:42.828158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ea33e0c-f503-45fa-ada1-5da65b397de5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:42.863719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:43.174472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4175fd13-221c-4eb2-96aa-1ddbe30f2d8c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:43.193648 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4175fd13-221c-4eb2-96aa-1ddbe30f2d8c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1321 microversion: 2.1 time: 0.607555 Oct 12 22:04:43.217669 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 709/1476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:42 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1321 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:43.228921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b3752bfd-6dce-4c4d-a853-4fe2b3c202a4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861111-1", "block_migration": "auto"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:43.232368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b3752bfd-6dce-4c4d-a853-4fe2b3c202a4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:43.240260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3752bfd-6dce-4c4d-a853-4fe2b3c202a4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:43.240975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3752bfd-6dce-4c4d-a853-4fe2b3c202a4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:43.243058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3752bfd-6dce-4c4d-a853-4fe2b3c202a4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:43.244143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3752bfd-6dce-4c4d-a853-4fe2b3c202a4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:43.245089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3752bfd-6dce-4c4d-a853-4fe2b3c202a4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:43.246069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3752bfd-6dce-4c4d-a853-4fe2b3c202a4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:43.295453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-b3752bfd-6dce-4c4d-a853-4fe2b3c202a4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'flavor' on Instance uuid 247e0252-3374-40b8-85f3-995d2031867d {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:43.311841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b3752bfd-6dce-4c4d-a853-4fe2b3c202a4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Going to try to live migrate instance to n-h2-861111-1 {{(pid=120452) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:04:43.430923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6ea33e0c-f503-45fa-ada1-5da65b397de5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:43.469674 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6ea33e0c-f503-45fa-ada1-5da65b397de5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.663169 Oct 12 22:04:43.472939 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 768/1477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:42 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:43.487680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a289e564-bf82-4d9d-a3af-4f18303d6bed req-8b1c3bd1-2334-40cd-9863-d529693f1f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9", "tag": "c95c69b7-41e0-40e1-92f0-c4a3c4dc67ff"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:43.502057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a289e564-bf82-4d9d-a3af-4f18303d6bed req-8b1c3bd1-2334-40cd-9863-d529693f1f31 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:43.502958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a289e564-bf82-4d9d-a3af-4f18303d6bed req-8b1c3bd1-2334-40cd-9863-d529693f1f31 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:43.503590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a289e564-bf82-4d9d-a3af-4f18303d6bed req-8b1c3bd1-2334-40cd-9863-d529693f1f31 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:43.522040 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a289e564-bf82-4d9d-a3af-4f18303d6bed req-8b1c3bd1-2334-40cd-9863-d529693f1f31 service nova] Creating event network-changed:c95c69b7-41e0-40e1-92f0-c4a3c4dc67ff for instance 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 on n-h1-861111-1 Oct 12 22:04:43.530820 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a289e564-bf82-4d9d-a3af-4f18303d6bed req-8b1c3bd1-2334-40cd-9863-d529693f1f31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054326 Oct 12 22:04:43.531950 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 769/1478] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:43.555510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ea5af663-ab2a-4a1f-8d79-a7e39b45f092 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:43.558540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ea5af663-ab2a-4a1f-8d79-a7e39b45f092 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:43.577153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea5af663-ab2a-4a1f-8d79-a7e39b45f092 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:43.577845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea5af663-ab2a-4a1f-8d79-a7e39b45f092 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:43.578626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea5af663-ab2a-4a1f-8d79-a7e39b45f092 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:43.592548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea5af663-ab2a-4a1f-8d79-a7e39b45f092 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:43.596572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea5af663-ab2a-4a1f-8d79-a7e39b45f092 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:43.600139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea5af663-ab2a-4a1f-8d79-a7e39b45f092 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:43.660564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ea5af663-ab2a-4a1f-8d79-a7e39b45f092 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:04:43.847217 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ea5af663-ab2a-4a1f-8d79-a7e39b45f092 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 204 len: 0 microversion: 2.1 time: 0.313442 Oct 12 22:04:43.850825 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 770/1479] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:04:43 2022] DELETE /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:04:43.857333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6785bf7e-51ff-473b-978d-42cbd687f7af tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:43.858040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6785bf7e-51ff-473b-978d-42cbd687f7af tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:43.874312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6785bf7e-51ff-473b-978d-42cbd687f7af tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:43.875095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6785bf7e-51ff-473b-978d-42cbd687f7af tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:43.878947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6785bf7e-51ff-473b-978d-42cbd687f7af tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:43.879894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6785bf7e-51ff-473b-978d-42cbd687f7af tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:43.880510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6785bf7e-51ff-473b-978d-42cbd687f7af tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:43.881098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6785bf7e-51ff-473b-978d-42cbd687f7af tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:44.062798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-6785bf7e-51ff-473b-978d-42cbd687f7af tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:44.104292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:44.107227 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6785bf7e-51ff-473b-978d-42cbd687f7af tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1929 microversion: 2.75 time: 0.257896 Oct 12 22:04:44.120413 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 771/1480] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:43 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1929 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:44.125507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a341ff08-5943-48c8-8307-919b692c983a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:44.130596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a341ff08-5943-48c8-8307-919b692c983a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:44.163620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a341ff08-5943-48c8-8307-919b692c983a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:44.165923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a341ff08-5943-48c8-8307-919b692c983a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:44.167628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a341ff08-5943-48c8-8307-919b692c983a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:44.168801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a341ff08-5943-48c8-8307-919b692c983a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:44.170837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a341ff08-5943-48c8-8307-919b692c983a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:44.171485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a341ff08-5943-48c8-8307-919b692c983a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:44.258970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a341ff08-5943-48c8-8307-919b692c983a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:44.269284 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a341ff08-5943-48c8-8307-919b692c983a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 200 len: 1266 microversion: 2.1 time: 0.146123 Oct 12 22:04:44.272340 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 772/1481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:44 2022] GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:44.281021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fdad5bf5-0e96-46e2-b797-b3b3d2fe30b4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:44.282285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fdad5bf5-0e96-46e2-b797-b3b3d2fe30b4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:44.292112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdad5bf5-0e96-46e2-b797-b3b3d2fe30b4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:44.293188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdad5bf5-0e96-46e2-b797-b3b3d2fe30b4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:44.293446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdad5bf5-0e96-46e2-b797-b3b3d2fe30b4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:44.294225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdad5bf5-0e96-46e2-b797-b3b3d2fe30b4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:44.294752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdad5bf5-0e96-46e2-b797-b3b3d2fe30b4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:44.295263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdad5bf5-0e96-46e2-b797-b3b3d2fe30b4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:44.460359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fdad5bf5-0e96-46e2-b797-b3b3d2fe30b4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:44.470094 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fdad5bf5-0e96-46e2-b797-b3b3d2fe30b4 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 200 len: 1514 microversion: 2.1 time: 0.194606 Oct 12 22:04:44.483260 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 773/1482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:44 2022] GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:44.483260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4b9a5762-14ac-4cf3-aba6-da5729a11a9f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:44.483260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4b9a5762-14ac-4cf3-aba6-da5729a11a9f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:44.483260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b9a5762-14ac-4cf3-aba6-da5729a11a9f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:44.483749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b9a5762-14ac-4cf3-aba6-da5729a11a9f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:44.483749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b9a5762-14ac-4cf3-aba6-da5729a11a9f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:44.484420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b9a5762-14ac-4cf3-aba6-da5729a11a9f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:44.485055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b9a5762-14ac-4cf3-aba6-da5729a11a9f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:44.485657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b9a5762-14ac-4cf3-aba6-da5729a11a9f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:44.629113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b9a5762-14ac-4cf3-aba6-da5729a11a9f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:44.638430 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4b9a5762-14ac-4cf3-aba6-da5729a11a9f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1321 microversion: 2.1 time: 0.166400 Oct 12 22:04:44.639009 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 774/1483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:44 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:44.640288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4b9a5762-14ac-4cf3-aba6-da5729a11a9f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:44.641321 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4b9a5762-14ac-4cf3-aba6-da5729a11a9f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001339 Oct 12 22:04:44.641752 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 775/1484] 10.222.0.16 () {56 vars in 886 bytes} [Wed Oct 12 22:04:44 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 22:04:44.646411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f6d0d388-6811-4cf3-837f-41122d875996 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:44.647220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f6d0d388-6811-4cf3-837f-41122d875996 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:44.655649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6d0d388-6811-4cf3-837f-41122d875996 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:44.656463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6d0d388-6811-4cf3-837f-41122d875996 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:44.657097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6d0d388-6811-4cf3-837f-41122d875996 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:44.657829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6d0d388-6811-4cf3-837f-41122d875996 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:44.658458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6d0d388-6811-4cf3-837f-41122d875996 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:44.659369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6d0d388-6811-4cf3-837f-41122d875996 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:45.501059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f6d0d388-6811-4cf3-837f-41122d875996 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:45.513296 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f6d0d388-6811-4cf3-837f-41122d875996 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.870392 Oct 12 22:04:45.518074 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 776/1485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:44 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:45.522827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-16fef3b9-1baa-488d-a660-f6be74047704 req-55708462-9c3b-4bd9-be90-ec773d5e0ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "747a8555-8993-47b3-a6de-2f32f025e240", "tag": "5cd49275-a219-45d2-abdc-6dac2bc36141"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:45.561736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-16fef3b9-1baa-488d-a660-f6be74047704 req-55708462-9c3b-4bd9-be90-ec773d5e0ff8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:45.565408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-16fef3b9-1baa-488d-a660-f6be74047704 req-55708462-9c3b-4bd9-be90-ec773d5e0ff8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:45.565857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-16fef3b9-1baa-488d-a660-f6be74047704 req-55708462-9c3b-4bd9-be90-ec773d5e0ff8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:45.584009 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-16fef3b9-1baa-488d-a660-f6be74047704 req-55708462-9c3b-4bd9-be90-ec773d5e0ff8 service nova] Creating event network-changed:5cd49275-a219-45d2-abdc-6dac2bc36141 for instance 747a8555-8993-47b3-a6de-2f32f025e240 on n-h2-861111-1 Oct 12 22:04:45.599271 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-16fef3b9-1baa-488d-a660-f6be74047704 req-55708462-9c3b-4bd9-be90-ec773d5e0ff8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079763 Oct 12 22:04:45.602652 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 777/1486] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:45.615743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9a4d44df-b5c6-4b7f-9142-3bf79dae928d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:45.616626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9a4d44df-b5c6-4b7f-9142-3bf79dae928d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:45.623262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a4d44df-b5c6-4b7f-9142-3bf79dae928d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:45.623968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a4d44df-b5c6-4b7f-9142-3bf79dae928d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:45.624564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a4d44df-b5c6-4b7f-9142-3bf79dae928d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:45.625462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a4d44df-b5c6-4b7f-9142-3bf79dae928d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:45.626099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a4d44df-b5c6-4b7f-9142-3bf79dae928d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:45.626714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a4d44df-b5c6-4b7f-9142-3bf79dae928d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:45.777008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-9a4d44df-b5c6-4b7f-9142-3bf79dae928d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:45.804557 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9a4d44df-b5c6-4b7f-9142-3bf79dae928d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1929 microversion: 2.75 time: 0.199059 Oct 12 22:04:45.805460 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 778/1487] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:45 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1929 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:45.810318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-89cd571e-46b5-42a6-9a50-0870d08f2b65 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:45.810959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-89cd571e-46b5-42a6-9a50-0870d08f2b65 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:45.817324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89cd571e-46b5-42a6-9a50-0870d08f2b65 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:45.817884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89cd571e-46b5-42a6-9a50-0870d08f2b65 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:45.818399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89cd571e-46b5-42a6-9a50-0870d08f2b65 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:45.819185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89cd571e-46b5-42a6-9a50-0870d08f2b65 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:45.819875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89cd571e-46b5-42a6-9a50-0870d08f2b65 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:45.820378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89cd571e-46b5-42a6-9a50-0870d08f2b65 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:45.927315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-89cd571e-46b5-42a6-9a50-0870d08f2b65 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:45.935921 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-89cd571e-46b5-42a6-9a50-0870d08f2b65 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 200 len: 1264 microversion: 2.1 time: 0.129272 Oct 12 22:04:45.936502 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 779/1488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:45 2022] GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 1264 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:45.941138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5d734482-1b25-447f-8f88-a30c6e1d7bfe tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:45.941937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5d734482-1b25-447f-8f88-a30c6e1d7bfe tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:45.948984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d734482-1b25-447f-8f88-a30c6e1d7bfe tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:45.949710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d734482-1b25-447f-8f88-a30c6e1d7bfe tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:45.950312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d734482-1b25-447f-8f88-a30c6e1d7bfe tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:45.951163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d734482-1b25-447f-8f88-a30c6e1d7bfe tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:45.951797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d734482-1b25-447f-8f88-a30c6e1d7bfe tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:45.952363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d734482-1b25-447f-8f88-a30c6e1d7bfe tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:46.183987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5d734482-1b25-447f-8f88-a30c6e1d7bfe tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:46.192293 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5d734482-1b25-447f-8f88-a30c6e1d7bfe tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 200 len: 1514 microversion: 2.1 time: 0.254592 Oct 12 22:04:46.206183 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 780/1489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:45 2022] GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 1514 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:46.212109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d699a63b-cb79-4338-80a8-b175c2aacc88 req-d5a1d4be-8901-431f-9d3b-ad4b59ffb16e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ce6878-173f-47f8-ab81-3c60803702b8", "name": "network-vif-deleted", "tag": "7986b344-6016-4f6c-9d7d-12efc709af4c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:46.222329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d699a63b-cb79-4338-80a8-b175c2aacc88 req-d5a1d4be-8901-431f-9d3b-ad4b59ffb16e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:46.223040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d699a63b-cb79-4338-80a8-b175c2aacc88 req-d5a1d4be-8901-431f-9d3b-ad4b59ffb16e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:46.223678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d699a63b-cb79-4338-80a8-b175c2aacc88 req-d5a1d4be-8901-431f-9d3b-ad4b59ffb16e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:46.236407 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d699a63b-cb79-4338-80a8-b175c2aacc88 req-d5a1d4be-8901-431f-9d3b-ad4b59ffb16e service nova] Creating event network-vif-deleted:7986b344-6016-4f6c-9d7d-12efc709af4c for instance 75ce6878-173f-47f8-ab81-3c60803702b8 on n-h1-861111-1 Oct 12 22:04:46.241539 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d699a63b-cb79-4338-80a8-b175c2aacc88 req-d5a1d4be-8901-431f-9d3b-ad4b59ffb16e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033706 Oct 12 22:04:46.242152 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 781/1490] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:46.247805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a2eb203b-f042-490f-8566-c21fe548ff50 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Calling method '.version_select at 0x7f51282dee50>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:46.251494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2eb203b-f042-490f-8566-c21fe548ff50 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:46.252191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2eb203b-f042-490f-8566-c21fe548ff50 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:46.252872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2eb203b-f042-490f-8566-c21fe548ff50 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:46.265311 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a2eb203b-f042-490f-8566-c21fe548ff50 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3057 microversion: 2.1 time: 0.021142 Oct 12 22:04:46.266516 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 782/1491] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 12 22:04:46 2022] GET /compute/v2.1/os-migrations => generated 3057 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:46.271293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-519bcac9-2a0d-410b-b209-c603a20cce1a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:46.272216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-519bcac9-2a0d-410b-b209-c603a20cce1a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:46.279160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-519bcac9-2a0d-410b-b209-c603a20cce1a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:46.279672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-519bcac9-2a0d-410b-b209-c603a20cce1a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:46.280096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-519bcac9-2a0d-410b-b209-c603a20cce1a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:46.280966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-519bcac9-2a0d-410b-b209-c603a20cce1a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:46.281580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-519bcac9-2a0d-410b-b209-c603a20cce1a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:46.282153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-519bcac9-2a0d-410b-b209-c603a20cce1a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:46.481390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-519bcac9-2a0d-410b-b209-c603a20cce1a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:46.489604 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-519bcac9-2a0d-410b-b209-c603a20cce1a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1321 microversion: 2.1 time: 0.221892 Oct 12 22:04:46.490388 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 783/1492] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:46 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:46.505440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d2d9a4d1-3266-4387-a2ac-c15f4ed4e339 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:46.512961 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d2d9a4d1-3266-4387-a2ac-c15f4ed4e339 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011165 Oct 12 22:04:46.513790 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 784/1493] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:04:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:46.528641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3a234697-f83e-4ab6-bde7-20f602343402 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-2027049620", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:46.553007 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3a234697-f83e-4ab6-bde7-20f602343402 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.028009 Oct 12 22:04:46.561484 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 785/1494] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Oct 12 22:04:46 2022] POST /compute/v2.1/flavors => generated 499 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:46.561484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-60f98b5b-dfee-4a05-8c6d-369583f4d223 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:46.561484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-60f98b5b-dfee-4a05-8c6d-369583f4d223 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:46.565807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60f98b5b-dfee-4a05-8c6d-369583f4d223 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:46.566325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60f98b5b-dfee-4a05-8c6d-369583f4d223 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:46.566758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60f98b5b-dfee-4a05-8c6d-369583f4d223 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:46.567494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60f98b5b-dfee-4a05-8c6d-369583f4d223 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:46.567947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60f98b5b-dfee-4a05-8c6d-369583f4d223 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:46.568395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60f98b5b-dfee-4a05-8c6d-369583f4d223 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:46.874724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-60f98b5b-dfee-4a05-8c6d-369583f4d223 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:46.885391 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-60f98b5b-dfee-4a05-8c6d-369583f4d223 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.330337 Oct 12 22:04:46.900283 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 786/1495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:46 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:46.911554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-27414500-381b-48de-b5fa-0dc8af6be0d4 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:46.924012 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-27414500-381b-48de-b5fa-0dc8af6be0d4 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017864 Oct 12 22:04:46.924640 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 787/1496] 10.222.0.16 () {58 vars in 1182 bytes} [Wed Oct 12 22:04:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:04:46.929209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-28e96de0-8989-4583-8232-5cc677c7f07e tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:46.930351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-28e96de0-8989-4583-8232-5cc677c7f07e tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:46.942074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28e96de0-8989-4583-8232-5cc677c7f07e tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:46.942834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28e96de0-8989-4583-8232-5cc677c7f07e tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:46.944351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28e96de0-8989-4583-8232-5cc677c7f07e tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:46.945225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28e96de0-8989-4583-8232-5cc677c7f07e tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:46.946390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28e96de0-8989-4583-8232-5cc677c7f07e tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:46.946982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28e96de0-8989-4583-8232-5cc677c7f07e tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:47.125638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-28e96de0-8989-4583-8232-5cc677c7f07e tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:47.148412 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-28e96de0-8989-4583-8232-5cc677c7f07e tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1929 microversion: 2.75 time: 0.222696 Oct 12 22:04:47.149342 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 788/1497] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:46 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1929 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:47.182532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-851eb536-1a7a-48b6-b672-c974f94fe0aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:47.183442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-851eb536-1a7a-48b6-b672-c974f94fe0aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:47.190938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-851eb536-1a7a-48b6-b672-c974f94fe0aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:47.191863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-851eb536-1a7a-48b6-b672-c974f94fe0aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:47.192480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-851eb536-1a7a-48b6-b672-c974f94fe0aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:47.194609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-851eb536-1a7a-48b6-b672-c974f94fe0aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:47.195322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-851eb536-1a7a-48b6-b672-c974f94fe0aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:47.195953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-851eb536-1a7a-48b6-b672-c974f94fe0aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:47.232905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:47.393528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-851eb536-1a7a-48b6-b672-c974f94fe0aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:47.401569 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-851eb536-1a7a-48b6-b672-c974f94fe0aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 200 len: 1264 microversion: 2.1 time: 0.224292 Oct 12 22:04:47.415870 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 789/1498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:47 2022] GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 1264 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:47.423981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1245594867", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "5ae2613b-be75-44b9-b3e6-c50dcadc181a"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:47.499781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] validate_networks() for None {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:04:48.422913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:04:48.424072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:04:48.424654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:04:48.425153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:04:48.425571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:04:48.436351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:48.436834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:48.437266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:48.437986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:48.438435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:48.438856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:48.457289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Getting quotas for project 7d943f8c0c934001b53032564fd00e11. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:04:48.462977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Getting quotas for user cfc7df27bf6f456581abff6e80ab4f64 and project 7d943f8c0c934001b53032564fd00e11. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:04:48.475828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:04:48.478179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:04:48.527226 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dbd79bb8-4ce9-4b82-b8d6-e639ab43e6b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110040 Oct 12 22:04:48.528088 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 790/1499] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:04:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:04:48.532426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5af3dff0-4424-4ba7-9417-e87e236f783b tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:48.533026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5af3dff0-4424-4ba7-9417-e87e236f783b tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: d4202eff-421b-4ea2-985b-ef6ef6c041b0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:48.540561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5af3dff0-4424-4ba7-9417-e87e236f783b tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:48.541092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5af3dff0-4424-4ba7-9417-e87e236f783b tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:48.541526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5af3dff0-4424-4ba7-9417-e87e236f783b tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:48.542263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5af3dff0-4424-4ba7-9417-e87e236f783b tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:48.542711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5af3dff0-4424-4ba7-9417-e87e236f783b tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:48.543133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5af3dff0-4424-4ba7-9417-e87e236f783b tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:48.557162 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-5af3dff0-4424-4ba7-9417-e87e236f783b tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] HTTP exception thrown: Instance d4202eff-421b-4ea2-985b-ef6ef6c041b0 could not be found. Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5af3dff0-4424-4ba7-9417-e87e236f783b tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Request method failure captured: Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 HTTP/1.1 Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlyS74uZzFhw2kiHu5K_OCtU7DKMCMR7DLV-s516vo1AknQUnvJtK7sMKb6lScKg2_GVpsj9fFhY69Pa6JnE5gbhBfkgfrW3m-J9ImF9hoqkFDRydpQiKT5jbGE0OQPnmS3SjlRP9ve73ji_TblFDti45G6InXkNaP57lUaW6KxRSM Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 3e56178d67cb48a88f99c741b3c0f2be Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-VolumesAdminNegativeTest-575945794 Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:04:48.559147 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:04:48.561265 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e56178d67cb48a88f99c741b3c0f2be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e56178d67cb48a88f99c741b3c0f2be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3e56178d67cb48a88f99c741b3c0f2be", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3e56178d67cb48a88f99c741b3c0f2be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:04:48.561265 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-VolumesAdminNegativeTest-575945794 Oct 12 22:04:48.561265 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 3e56178d67cb48a88f99c741b3c0f2be Oct 12 22:04:48.561265 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-575945794 Oct 12 22:04:48.561265 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-VolumesAdminNegativeTest-575945794-project Oct 12 22:04:48.561265 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:04:48.561265 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:04:48.561265 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 990d936956654370a1c2997120e7231f Oct 12 22:04:48.561265 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-VolumesAdminNegativeTest-575945794-project Oct 12 22:04:48.561265 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:04:48.561265 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance d4202eff-421b-4ea2-985b-ef6ef6c041b0 could not be found. Oct 12 22:04:48.561265 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'd4202eff-421b-4ea2-985b-ef6ef6c041b0'} Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4202eff-421b-4ea2-985b-ef6ef6c041b0 could not be found. Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:04:48.562227 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4202eff-421b-4ea2-985b-ef6ef6c041b0 could not be found. Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4202eff-421b-4ea2-985b-ef6ef6c041b0 could not be found. Oct 12 22:04:48.564458 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:48.566150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5af3dff0-4424-4ba7-9417-e87e236f783b tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Returning 404 to user: Instance d4202eff-421b-4ea2-985b-ef6ef6c041b0 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:04:48.566150 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5af3dff0-4424-4ba7-9417-e87e236f783b tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0" status: 404 len: 111 microversion: 2.1 time: 0.031927 Oct 12 22:04:48.566150 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 791/1500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:48 2022] GET /compute/v2.1/servers/d4202eff-421b-4ea2-985b-ef6ef6c041b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:04:48.572175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-24fabde1-0b1d-4029-8637-3723bba2611e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:48.573927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-24fabde1-0b1d-4029-8637-3723bba2611e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:48.584135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24fabde1-0b1d-4029-8637-3723bba2611e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:48.584753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24fabde1-0b1d-4029-8637-3723bba2611e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:48.587194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24fabde1-0b1d-4029-8637-3723bba2611e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:48.588080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24fabde1-0b1d-4029-8637-3723bba2611e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:48.588734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24fabde1-0b1d-4029-8637-3723bba2611e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:48.589335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24fabde1-0b1d-4029-8637-3723bba2611e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:49.302899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-24fabde1-0b1d-4029-8637-3723bba2611e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:49.314964 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-24fabde1-0b1d-4029-8637-3723bba2611e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1321 microversion: 2.1 time: 0.749399 Oct 12 22:04:49.319605 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 792/1501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:48 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1321 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:49.327912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-657d91af-2c88-47a9-9b24-bd6ea47c0064 req-26641491-d2d3-4856-8821-d19a772f4842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4202eff-421b-4ea2-985b-ef6ef6c041b0", "name": "network-vif-deleted", "tag": "b0e47c3a-b0d0-4fa8-9e41-9bf2c7140edc"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:49.356348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-657d91af-2c88-47a9-9b24-bd6ea47c0064 req-26641491-d2d3-4856-8821-d19a772f4842 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:49.356893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-657d91af-2c88-47a9-9b24-bd6ea47c0064 req-26641491-d2d3-4856-8821-d19a772f4842 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:49.357347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-657d91af-2c88-47a9-9b24-bd6ea47c0064 req-26641491-d2d3-4856-8821-d19a772f4842 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:49.394024 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-657d91af-2c88-47a9-9b24-bd6ea47c0064 req-26641491-d2d3-4856-8821-d19a772f4842 service nova] Creating event network-vif-deleted:b0e47c3a-b0d0-4fa8-9e41-9bf2c7140edc for instance d4202eff-421b-4ea2-985b-ef6ef6c041b0 on n-h1-861111-1 Oct 12 22:04:49.405319 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-657d91af-2c88-47a9-9b24-bd6ea47c0064 req-26641491-d2d3-4856-8821-d19a772f4842 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081875 Oct 12 22:04:49.408302 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 793/1502] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:49.415956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-71a022b7-1ea3-4afd-900a-2a2b336d6e3b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:49.416668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-71a022b7-1ea3-4afd-900a-2a2b336d6e3b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:49.437754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71a022b7-1ea3-4afd-900a-2a2b336d6e3b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:49.441418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71a022b7-1ea3-4afd-900a-2a2b336d6e3b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:49.442130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71a022b7-1ea3-4afd-900a-2a2b336d6e3b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:49.446234 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71a022b7-1ea3-4afd-900a-2a2b336d6e3b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:49.447110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71a022b7-1ea3-4afd-900a-2a2b336d6e3b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:49.447760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71a022b7-1ea3-4afd-900a-2a2b336d6e3b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:50.193133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-71a022b7-1ea3-4afd-900a-2a2b336d6e3b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:50.213933 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-71a022b7-1ea3-4afd-900a-2a2b336d6e3b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.800937 Oct 12 22:04:50.214911 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 794/1503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:49 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:50.231353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-15c367ec-1482-416d-98d7-8116a7933875 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:50.231995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-15c367ec-1482-416d-98d7-8116a7933875 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:50.246805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15c367ec-1482-416d-98d7-8116a7933875 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:50.247349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15c367ec-1482-416d-98d7-8116a7933875 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:50.247793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15c367ec-1482-416d-98d7-8116a7933875 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:50.248510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15c367ec-1482-416d-98d7-8116a7933875 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:50.248969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15c367ec-1482-416d-98d7-8116a7933875 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:50.249399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15c367ec-1482-416d-98d7-8116a7933875 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:50.340541 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b3752bfd-6dce-4c4d-a853-4fe2b3c202a4 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/action" status: 202 len: 0 microversion: 2.25 time: 7.121298 Oct 12 22:04:50.341485 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 710/1504] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 12 22:04:43 2022] POST /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/action => generated 0 bytes in 7123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:04:50.346385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-415efff7-c513-4666-a637-8d23d47cfad0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:50.347271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-415efff7-c513-4666-a637-8d23d47cfad0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:50.364106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-415efff7-c513-4666-a637-8d23d47cfad0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:50.364911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-415efff7-c513-4666-a637-8d23d47cfad0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:50.365510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-415efff7-c513-4666-a637-8d23d47cfad0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:50.366577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-415efff7-c513-4666-a637-8d23d47cfad0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:50.367306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-415efff7-c513-4666-a637-8d23d47cfad0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:50.367918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-415efff7-c513-4666-a637-8d23d47cfad0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:50.550330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-15c367ec-1482-416d-98d7-8116a7933875 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:50.568627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-415efff7-c513-4666-a637-8d23d47cfad0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:50.584033 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-415efff7-c513-4666-a637-8d23d47cfad0 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 200 len: 1306 microversion: 2.1 time: 0.239297 Oct 12 22:04:50.584839 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 711/1505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:50 2022] GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 1306 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:50.591181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c8c79fd8-2eb5-4327-b823-bd858773dcab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:50.592227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c8c79fd8-2eb5-4327-b823-bd858773dcab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:50.612277 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-15c367ec-1482-416d-98d7-8116a7933875 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1929 microversion: 2.75 time: 0.395745 Oct 12 22:04:50.628119 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 795/1506] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:50 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1929 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:50.629113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8c79fd8-2eb5-4327-b823-bd858773dcab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:50.645667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8c79fd8-2eb5-4327-b823-bd858773dcab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:50.647310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8c79fd8-2eb5-4327-b823-bd858773dcab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:50.651945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8c79fd8-2eb5-4327-b823-bd858773dcab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:50.653210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8c79fd8-2eb5-4327-b823-bd858773dcab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:50.654101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8c79fd8-2eb5-4327-b823-bd858773dcab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:50.657253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-45804aef-6c69-4554-b2c6-ebf90c6f4068 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:50.660506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-45804aef-6c69-4554-b2c6-ebf90c6f4068 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:50.680981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45804aef-6c69-4554-b2c6-ebf90c6f4068 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:50.681725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45804aef-6c69-4554-b2c6-ebf90c6f4068 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:50.682815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45804aef-6c69-4554-b2c6-ebf90c6f4068 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:50.684528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45804aef-6c69-4554-b2c6-ebf90c6f4068 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:50.686803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45804aef-6c69-4554-b2c6-ebf90c6f4068 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:50.687560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45804aef-6c69-4554-b2c6-ebf90c6f4068 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:50.790088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c8c79fd8-2eb5-4327-b823-bd858773dcab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:50.802090 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c8c79fd8-2eb5-4327-b823-bd858773dcab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1331 microversion: 2.1 time: 0.214397 Oct 12 22:04:50.802889 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 712/1507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:50 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1331 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:50.826560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4477331e-3716-4c1e-ba30-b99f519cf9d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:50.827422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4477331e-3716-4c1e-ba30-b99f519cf9d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:50.833944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4477331e-3716-4c1e-ba30-b99f519cf9d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:50.834652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4477331e-3716-4c1e-ba30-b99f519cf9d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:50.835282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4477331e-3716-4c1e-ba30-b99f519cf9d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:50.836824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4477331e-3716-4c1e-ba30-b99f519cf9d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:50.837479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4477331e-3716-4c1e-ba30-b99f519cf9d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:50.838100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4477331e-3716-4c1e-ba30-b99f519cf9d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:51.108917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4477331e-3716-4c1e-ba30-b99f519cf9d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:51.121606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4477331e-3716-4c1e-ba30-b99f519cf9d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:51.123508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4477331e-3716-4c1e-ba30-b99f519cf9d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:51.125200 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4477331e-3716-4c1e-ba30-b99f519cf9d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 0.311065 Oct 12 22:04:51.126329 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 713/1508] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:50 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:51.241912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-badd0f54-a5da-48b0-b456-0bb81233fec7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:51.242683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-badd0f54-a5da-48b0-b456-0bb81233fec7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:51.252989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-badd0f54-a5da-48b0-b456-0bb81233fec7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:51.253721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-badd0f54-a5da-48b0-b456-0bb81233fec7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:51.261762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-badd0f54-a5da-48b0-b456-0bb81233fec7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:51.262591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-badd0f54-a5da-48b0-b456-0bb81233fec7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:51.263460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-badd0f54-a5da-48b0-b456-0bb81233fec7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:51.264156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-badd0f54-a5da-48b0-b456-0bb81233fec7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:51.485680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-badd0f54-a5da-48b0-b456-0bb81233fec7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:51.497837 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-badd0f54-a5da-48b0-b456-0bb81233fec7 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.259763 Oct 12 22:04:51.512351 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 714/1509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:51 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:51.519791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-45804aef-6c69-4554-b2c6-ebf90c6f4068 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:51.528629 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-45804aef-6c69-4554-b2c6-ebf90c6f4068 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1321 microversion: 2.1 time: 0.898108 Oct 12 22:04:51.529220 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 796/1510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:50 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1321 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:51.612271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ac720875-7564-4761-8518-5e98d5cafc25 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:51.613139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ac720875-7564-4761-8518-5e98d5cafc25 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:51.622956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac720875-7564-4761-8518-5e98d5cafc25 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:51.627650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac720875-7564-4761-8518-5e98d5cafc25 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:51.628099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac720875-7564-4761-8518-5e98d5cafc25 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:51.628822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac720875-7564-4761-8518-5e98d5cafc25 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:51.629271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac720875-7564-4761-8518-5e98d5cafc25 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:51.629693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac720875-7564-4761-8518-5e98d5cafc25 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:51.646448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-26636d65-ba66-4157-b403-941980df852f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:51.647695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-26636d65-ba66-4157-b403-941980df852f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:51.657101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26636d65-ba66-4157-b403-941980df852f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:51.659835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26636d65-ba66-4157-b403-941980df852f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:51.660486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26636d65-ba66-4157-b403-941980df852f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:51.670286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26636d65-ba66-4157-b403-941980df852f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:51.671024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26636d65-ba66-4157-b403-941980df852f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:51.671686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26636d65-ba66-4157-b403-941980df852f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:51.898195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ac720875-7564-4761-8518-5e98d5cafc25 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:51.916648 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ac720875-7564-4761-8518-5e98d5cafc25 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 200 len: 1306 microversion: 2.1 time: 0.308181 Oct 12 22:04:51.931789 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 715/1511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:51 2022] GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 1306 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:51.938167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-02fa93ca-60bb-489a-aabf-96de8cfb8bd2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:51.939067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-02fa93ca-60bb-489a-aabf-96de8cfb8bd2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:51.953836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02fa93ca-60bb-489a-aabf-96de8cfb8bd2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:51.956509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02fa93ca-60bb-489a-aabf-96de8cfb8bd2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:51.959493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02fa93ca-60bb-489a-aabf-96de8cfb8bd2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:51.960699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02fa93ca-60bb-489a-aabf-96de8cfb8bd2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:51.961869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02fa93ca-60bb-489a-aabf-96de8cfb8bd2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:51.965715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02fa93ca-60bb-489a-aabf-96de8cfb8bd2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:52.077130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-02fa93ca-60bb-489a-aabf-96de8cfb8bd2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:52.088050 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-02fa93ca-60bb-489a-aabf-96de8cfb8bd2 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1337 microversion: 2.1 time: 0.155032 Oct 12 22:04:52.099815 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 716/1512] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:51 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1337 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:52.224963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-796b85d8-9b98-422c-bfaa-2c246280eac1 req-3f6b6000-9b29-40be-a2b4-827a8cb76f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6", "name": "network-vif-plugged", "status": "completed", "tag": "4c86b396-60e9-4162-9c59-e36739bc7fa3"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:52.240418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-796b85d8-9b98-422c-bfaa-2c246280eac1 req-3f6b6000-9b29-40be-a2b4-827a8cb76f4d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:52.241267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-796b85d8-9b98-422c-bfaa-2c246280eac1 req-3f6b6000-9b29-40be-a2b4-827a8cb76f4d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:52.242651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-796b85d8-9b98-422c-bfaa-2c246280eac1 req-3f6b6000-9b29-40be-a2b4-827a8cb76f4d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:52.270906 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-796b85d8-9b98-422c-bfaa-2c246280eac1 req-3f6b6000-9b29-40be-a2b4-827a8cb76f4d service nova] Creating event network-vif-plugged:4c86b396-60e9-4162-9c59-e36739bc7fa3 for instance 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 on n-h2-861111-1 Oct 12 22:04:52.287749 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-796b85d8-9b98-422c-bfaa-2c246280eac1 req-3f6b6000-9b29-40be-a2b4-827a8cb76f4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154004 Oct 12 22:04:52.291723 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 717/1513] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:52.305401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-189c6dbb-5768-4c86-a4a4-769377c98da9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:52.306801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-189c6dbb-5768-4c86-a4a4-769377c98da9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:52.315043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-189c6dbb-5768-4c86-a4a4-769377c98da9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:52.316453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-189c6dbb-5768-4c86-a4a4-769377c98da9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:52.317292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-189c6dbb-5768-4c86-a4a4-769377c98da9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:52.318384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-189c6dbb-5768-4c86-a4a4-769377c98da9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:52.319203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-189c6dbb-5768-4c86-a4a4-769377c98da9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:52.320902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-189c6dbb-5768-4c86-a4a4-769377c98da9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:52.326957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:52.377760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:52.380686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-26636d65-ba66-4157-b403-941980df852f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:52.421050 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-26636d65-ba66-4157-b403-941980df852f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1929 microversion: 2.75 time: 0.777574 Oct 12 22:04:52.421050 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 797/1514] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:51 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1929 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:52.524928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-128b099b-8d23-4291-b925-146ccb5bbaaf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:52.525645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-128b099b-8d23-4291-b925-146ccb5bbaaf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:52.537777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-128b099b-8d23-4291-b925-146ccb5bbaaf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:52.538483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-128b099b-8d23-4291-b925-146ccb5bbaaf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:52.539660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-128b099b-8d23-4291-b925-146ccb5bbaaf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:52.540536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-128b099b-8d23-4291-b925-146ccb5bbaaf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:52.544593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-128b099b-8d23-4291-b925-146ccb5bbaaf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:52.545386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-128b099b-8d23-4291-b925-146ccb5bbaaf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:52.612649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-189c6dbb-5768-4c86-a4a4-769377c98da9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:52.628250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-189c6dbb-5768-4c86-a4a4-769377c98da9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:52.629969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-189c6dbb-5768-4c86-a4a4-769377c98da9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:52.633890 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-189c6dbb-5768-4c86-a4a4-769377c98da9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 0.340128 Oct 12 22:04:52.648772 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 718/1515] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:52 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:52.668480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-40990725-f82a-4b81-bf07-8881b74e2df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:52.669817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-40990725-f82a-4b81-bf07-8881b74e2df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:52.676621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40990725-f82a-4b81-bf07-8881b74e2df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:52.677339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40990725-f82a-4b81-bf07-8881b74e2df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:52.678691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40990725-f82a-4b81-bf07-8881b74e2df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:52.680303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40990725-f82a-4b81-bf07-8881b74e2df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:52.680937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40990725-f82a-4b81-bf07-8881b74e2df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:52.681480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40990725-f82a-4b81-bf07-8881b74e2df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:52.934615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-40990725-f82a-4b81-bf07-8881b74e2df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:52.942594 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-40990725-f82a-4b81-bf07-8881b74e2df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1321 microversion: 2.1 time: 0.283976 Oct 12 22:04:52.943174 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 719/1516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:52 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:52.955316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-59120f23-eb4e-4ec3-9c10-dd1cad0a1787 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:52.958875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-59120f23-eb4e-4ec3-9c10-dd1cad0a1787 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:52.969506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59120f23-eb4e-4ec3-9c10-dd1cad0a1787 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:52.973381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59120f23-eb4e-4ec3-9c10-dd1cad0a1787 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:52.974006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59120f23-eb4e-4ec3-9c10-dd1cad0a1787 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:52.974887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59120f23-eb4e-4ec3-9c10-dd1cad0a1787 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:52.975524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59120f23-eb4e-4ec3-9c10-dd1cad0a1787 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:52.976123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59120f23-eb4e-4ec3-9c10-dd1cad0a1787 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:53.202859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-59120f23-eb4e-4ec3-9c10-dd1cad0a1787 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:53.206607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-128b099b-8d23-4291-b925-146ccb5bbaaf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:53.213157 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-59120f23-eb4e-4ec3-9c10-dd1cad0a1787 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 200 len: 1306 microversion: 2.1 time: 0.263496 Oct 12 22:04:53.214943 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 720/1517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:52 2022] GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 1306 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:53.220322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7687520d-db5b-4f42-b096-a3083faa4a6d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:53.221183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7687520d-db5b-4f42-b096-a3083faa4a6d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:53.228154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7687520d-db5b-4f42-b096-a3083faa4a6d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:53.228942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7687520d-db5b-4f42-b096-a3083faa4a6d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:53.229602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7687520d-db5b-4f42-b096-a3083faa4a6d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:53.230262 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-128b099b-8d23-4291-b925-146ccb5bbaaf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.709533 Oct 12 22:04:53.230588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7687520d-db5b-4f42-b096-a3083faa4a6d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:53.230965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7687520d-db5b-4f42-b096-a3083faa4a6d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:53.231173 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 798/1518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:52 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:53.231816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7687520d-db5b-4f42-b096-a3083faa4a6d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:53.307586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7687520d-db5b-4f42-b096-a3083faa4a6d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:53.317128 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7687520d-db5b-4f42-b096-a3083faa4a6d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1337 microversion: 2.1 time: 0.100487 Oct 12 22:04:53.323190 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 721/1519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:53 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1337 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:53.452776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ad548da5-9bb1-4cf0-ab24-4c879b8c83f3 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:53.453862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ad548da5-9bb1-4cf0-ab24-4c879b8c83f3 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:53.461822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad548da5-9bb1-4cf0-ab24-4c879b8c83f3 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:53.462611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad548da5-9bb1-4cf0-ab24-4c879b8c83f3 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:53.463540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad548da5-9bb1-4cf0-ab24-4c879b8c83f3 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:53.465636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad548da5-9bb1-4cf0-ab24-4c879b8c83f3 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:53.465636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad548da5-9bb1-4cf0-ab24-4c879b8c83f3 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:53.465636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad548da5-9bb1-4cf0-ab24-4c879b8c83f3 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:53.602472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-ad548da5-9bb1-4cf0-ab24-4c879b8c83f3 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:53.637944 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ad548da5-9bb1-4cf0-ab24-4c879b8c83f3 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1929 microversion: 2.75 time: 0.188867 Oct 12 22:04:53.639589 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 799/1520] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:53 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1929 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:53.665726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fbb0fe2d-22a3-4038-8f01-1d05fc7e22f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:53.667744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fbb0fe2d-22a3-4038-8f01-1d05fc7e22f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:53.678070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fbb0fe2d-22a3-4038-8f01-1d05fc7e22f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:53.679152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fbb0fe2d-22a3-4038-8f01-1d05fc7e22f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:53.679982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fbb0fe2d-22a3-4038-8f01-1d05fc7e22f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:53.681169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fbb0fe2d-22a3-4038-8f01-1d05fc7e22f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:53.681846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fbb0fe2d-22a3-4038-8f01-1d05fc7e22f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:53.682981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fbb0fe2d-22a3-4038-8f01-1d05fc7e22f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:53.932318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a35bec82-6573-462e-8e7f-70ee306ff535 req-6036dc5a-f973-4956-a81e-d4c21a0f5add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88fef870-22a8-43e7-afb9-5612edbce136", "tag": "8fa5803d-652c-4259-8fef-98474172e507"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:53.943649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a35bec82-6573-462e-8e7f-70ee306ff535 req-6036dc5a-f973-4956-a81e-d4c21a0f5add service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:53.944429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a35bec82-6573-462e-8e7f-70ee306ff535 req-6036dc5a-f973-4956-a81e-d4c21a0f5add service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:53.945576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a35bec82-6573-462e-8e7f-70ee306ff535 req-6036dc5a-f973-4956-a81e-d4c21a0f5add service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:53.955933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fbb0fe2d-22a3-4038-8f01-1d05fc7e22f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:53.988996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fbb0fe2d-22a3-4038-8f01-1d05fc7e22f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:53.990434 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a35bec82-6573-462e-8e7f-70ee306ff535 req-6036dc5a-f973-4956-a81e-d4c21a0f5add service nova] Creating event network-changed:8fa5803d-652c-4259-8fef-98474172e507 for instance 88fef870-22a8-43e7-afb9-5612edbce136 on n-h1-861111-1 Oct 12 22:04:53.993156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fbb0fe2d-22a3-4038-8f01-1d05fc7e22f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:53.997305 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fbb0fe2d-22a3-4038-8f01-1d05fc7e22f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 0.335955 Oct 12 22:04:53.998167 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 722/1521] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:53 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:54.016647 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a35bec82-6573-462e-8e7f-70ee306ff535 req-6036dc5a-f973-4956-a81e-d4c21a0f5add service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080356 Oct 12 22:04:54.017155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1441f4d9-95db-47e3-b716-11933496bea1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:54.017931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1441f4d9-95db-47e3-b716-11933496bea1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:54.021312 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 800/1522] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:54.042655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1441f4d9-95db-47e3-b716-11933496bea1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:54.043579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1441f4d9-95db-47e3-b716-11933496bea1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:54.045154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1441f4d9-95db-47e3-b716-11933496bea1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:54.053180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1441f4d9-95db-47e3-b716-11933496bea1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:54.060359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1441f4d9-95db-47e3-b716-11933496bea1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:54.061173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1441f4d9-95db-47e3-b716-11933496bea1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:54.199380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f690aa9a-0093-4dc1-a752-91767f9f6d88 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:54.200079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f690aa9a-0093-4dc1-a752-91767f9f6d88 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:54.212753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f690aa9a-0093-4dc1-a752-91767f9f6d88 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:54.213423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f690aa9a-0093-4dc1-a752-91767f9f6d88 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:54.214504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f690aa9a-0093-4dc1-a752-91767f9f6d88 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:54.215438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f690aa9a-0093-4dc1-a752-91767f9f6d88 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:54.216746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f690aa9a-0093-4dc1-a752-91767f9f6d88 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:54.217427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f690aa9a-0093-4dc1-a752-91767f9f6d88 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:54.252136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f690aa9a-0093-4dc1-a752-91767f9f6d88 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:04:54.458945 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f690aa9a-0093-4dc1-a752-91767f9f6d88 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 204 len: 0 microversion: 2.1 time: 0.261477 Oct 12 22:04:54.464024 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 801/1523] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:04:54 2022] DELETE /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:04:54.474910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b1971fbb-bbe0-4626-ae7f-03a16831d0d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:54.477045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b1971fbb-bbe0-4626-ae7f-03a16831d0d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:54.488458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1971fbb-bbe0-4626-ae7f-03a16831d0d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:54.489329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1971fbb-bbe0-4626-ae7f-03a16831d0d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:54.489948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1971fbb-bbe0-4626-ae7f-03a16831d0d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:54.490944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1971fbb-bbe0-4626-ae7f-03a16831d0d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:54.506206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1971fbb-bbe0-4626-ae7f-03a16831d0d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:54.508853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1971fbb-bbe0-4626-ae7f-03a16831d0d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:54.829688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b1971fbb-bbe0-4626-ae7f-03a16831d0d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:54.839827 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b1971fbb-bbe0-4626-ae7f-03a16831d0d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 200 len: 1306 microversion: 2.1 time: 0.372681 Oct 12 22:04:54.840818 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 802/1524] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:54 2022] GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 1306 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:54.845403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a7283280-7e22-4a97-a789-da40bf379380 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:54.846071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a7283280-7e22-4a97-a789-da40bf379380 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:54.852466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7283280-7e22-4a97-a789-da40bf379380 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:54.853061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7283280-7e22-4a97-a789-da40bf379380 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:54.853593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7283280-7e22-4a97-a789-da40bf379380 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:54.854386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7283280-7e22-4a97-a789-da40bf379380 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:54.854938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7283280-7e22-4a97-a789-da40bf379380 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:54.855519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7283280-7e22-4a97-a789-da40bf379380 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:54.976390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1441f4d9-95db-47e3-b716-11933496bea1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:54.985190 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1441f4d9-95db-47e3-b716-11933496bea1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1321 microversion: 2.1 time: 0.984672 Oct 12 22:04:54.986957 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 723/1525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:53 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1321 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:54.996134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fed0cac1-d949-40b9-b226-8e73bf947be7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:54.997243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fed0cac1-d949-40b9-b226-8e73bf947be7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:55.013107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fed0cac1-d949-40b9-b226-8e73bf947be7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:55.017315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fed0cac1-d949-40b9-b226-8e73bf947be7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:55.018077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fed0cac1-d949-40b9-b226-8e73bf947be7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:55.019085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fed0cac1-d949-40b9-b226-8e73bf947be7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:55.021851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fed0cac1-d949-40b9-b226-8e73bf947be7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:55.024530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fed0cac1-d949-40b9-b226-8e73bf947be7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:55.028938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a7283280-7e22-4a97-a789-da40bf379380 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:55.039975 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a7283280-7e22-4a97-a789-da40bf379380 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.197061 Oct 12 22:04:55.051095 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 803/1526] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:54 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:55.062432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-92c80217-e0be-4d8e-8058-45d188f9cf1e req-8fe4ca44-fb55-4936-ab43-025a3949f079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9", "name": "network-vif-plugged", "status": "completed", "tag": "c95c69b7-41e0-40e1-92f0-c4a3c4dc67ff"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:55.077159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-92c80217-e0be-4d8e-8058-45d188f9cf1e req-8fe4ca44-fb55-4936-ab43-025a3949f079 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:55.077755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-92c80217-e0be-4d8e-8058-45d188f9cf1e req-8fe4ca44-fb55-4936-ab43-025a3949f079 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:55.078352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-92c80217-e0be-4d8e-8058-45d188f9cf1e req-8fe4ca44-fb55-4936-ab43-025a3949f079 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:55.097831 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-92c80217-e0be-4d8e-8058-45d188f9cf1e req-8fe4ca44-fb55-4936-ab43-025a3949f079 service nova] Creating event network-vif-plugged:c95c69b7-41e0-40e1-92f0-c4a3c4dc67ff for instance 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 on n-h1-861111-1 Oct 12 22:04:55.111793 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-92c80217-e0be-4d8e-8058-45d188f9cf1e req-8fe4ca44-fb55-4936-ab43-025a3949f079 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058489 Oct 12 22:04:55.113587 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 804/1527] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:55.119745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-be4ea141-af4d-4aa4-a38d-6826c2e4fe4a tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:55.120653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-be4ea141-af4d-4aa4-a38d-6826c2e4fe4a tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:55.127854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be4ea141-af4d-4aa4-a38d-6826c2e4fe4a tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:55.128522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be4ea141-af4d-4aa4-a38d-6826c2e4fe4a tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:55.129041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be4ea141-af4d-4aa4-a38d-6826c2e4fe4a tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:55.130132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be4ea141-af4d-4aa4-a38d-6826c2e4fe4a tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:55.130565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be4ea141-af4d-4aa4-a38d-6826c2e4fe4a tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:55.131120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be4ea141-af4d-4aa4-a38d-6826c2e4fe4a tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:55.337569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-be4ea141-af4d-4aa4-a38d-6826c2e4fe4a tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:55.348239 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-be4ea141-af4d-4aa4-a38d-6826c2e4fe4a tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1683 microversion: 2.1 time: 0.233288 Oct 12 22:04:55.349443 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 805/1528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:55 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1683 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:55.356427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-56bfe133-d72f-45a3-835c-959d3162eaf8 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:55.357411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-56bfe133-d72f-45a3-835c-959d3162eaf8 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:55.365897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56bfe133-d72f-45a3-835c-959d3162eaf8 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:55.366744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56bfe133-d72f-45a3-835c-959d3162eaf8 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:55.367529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56bfe133-d72f-45a3-835c-959d3162eaf8 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:55.368505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56bfe133-d72f-45a3-835c-959d3162eaf8 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:55.369345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56bfe133-d72f-45a3-835c-959d3162eaf8 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:55.370019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56bfe133-d72f-45a3-835c-959d3162eaf8 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:55.396138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:55.423513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fed0cac1-d949-40b9-b226-8e73bf947be7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:55.438735 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fed0cac1-d949-40b9-b226-8e73bf947be7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1379 microversion: 2.1 time: 0.450403 Oct 12 22:04:55.439367 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 724/1529] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:54 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1379 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:55.458378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-62962620-c721-4f50-afee-bdcb728476f8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:55.458990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-62962620-c721-4f50-afee-bdcb728476f8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:55.469308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-56bfe133-d72f-45a3-835c-959d3162eaf8 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:55.488150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62962620-c721-4f50-afee-bdcb728476f8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:55.488702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62962620-c721-4f50-afee-bdcb728476f8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:55.489360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62962620-c721-4f50-afee-bdcb728476f8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:55.490143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62962620-c721-4f50-afee-bdcb728476f8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:55.490612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62962620-c721-4f50-afee-bdcb728476f8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:55.492732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:55.492892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62962620-c721-4f50-afee-bdcb728476f8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:55.497786 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-56bfe133-d72f-45a3-835c-959d3162eaf8 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1929 microversion: 2.75 time: 0.146276 Oct 12 22:04:55.509423 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 806/1530] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:55 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1929 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:55.868218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b87ccbe6-125c-4a92-b41a-ac9fa411091c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:55.868619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b87ccbe6-125c-4a92-b41a-ac9fa411091c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:55.875524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b87ccbe6-125c-4a92-b41a-ac9fa411091c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:55.876032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b87ccbe6-125c-4a92-b41a-ac9fa411091c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:55.876687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b87ccbe6-125c-4a92-b41a-ac9fa411091c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:55.877369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b87ccbe6-125c-4a92-b41a-ac9fa411091c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:55.878300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b87ccbe6-125c-4a92-b41a-ac9fa411091c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:55.878300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b87ccbe6-125c-4a92-b41a-ac9fa411091c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:55.961376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-62962620-c721-4f50-afee-bdcb728476f8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:55.972545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-62962620-c721-4f50-afee-bdcb728476f8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:55.974099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-62962620-c721-4f50-afee-bdcb728476f8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:55.975562 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-62962620-c721-4f50-afee-bdcb728476f8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 0.521048 Oct 12 22:04:55.994830 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 725/1531] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:55 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:56.012976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-98919341-da25-4d2a-bb2c-352728098d7c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:56.013610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-98919341-da25-4d2a-bb2c-352728098d7c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:56.021413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98919341-da25-4d2a-bb2c-352728098d7c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:56.022167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98919341-da25-4d2a-bb2c-352728098d7c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:56.022798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98919341-da25-4d2a-bb2c-352728098d7c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:56.024311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98919341-da25-4d2a-bb2c-352728098d7c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:56.024925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98919341-da25-4d2a-bb2c-352728098d7c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:56.025701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98919341-da25-4d2a-bb2c-352728098d7c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:56.340821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b87ccbe6-125c-4a92-b41a-ac9fa411091c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:56.353719 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b87ccbe6-125c-4a92-b41a-ac9fa411091c tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 200 len: 1306 microversion: 2.1 time: 0.489224 Oct 12 22:04:56.363985 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 807/1532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:55 2022] GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 1306 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:56.375023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd592338-61d4-42ff-b965-edb5c04c82c4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:56.375965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dd592338-61d4-42ff-b965-edb5c04c82c4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:56.388570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd592338-61d4-42ff-b965-edb5c04c82c4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:56.389149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd592338-61d4-42ff-b965-edb5c04c82c4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:56.390578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd592338-61d4-42ff-b965-edb5c04c82c4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:56.391475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd592338-61d4-42ff-b965-edb5c04c82c4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:56.393499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd592338-61d4-42ff-b965-edb5c04c82c4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:56.394019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd592338-61d4-42ff-b965-edb5c04c82c4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:56.507970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-98919341-da25-4d2a-bb2c-352728098d7c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:56.525923 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-98919341-da25-4d2a-bb2c-352728098d7c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1321 microversion: 2.1 time: 0.516600 Oct 12 22:04:56.548801 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 726/1533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:56 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1321 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:56.557155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4980a13d-941e-4a0b-94b6-6aad4736f763 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:56.558102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4980a13d-941e-4a0b-94b6-6aad4736f763 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:56.568248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4980a13d-941e-4a0b-94b6-6aad4736f763 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:56.569008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4980a13d-941e-4a0b-94b6-6aad4736f763 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:56.569665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4980a13d-941e-4a0b-94b6-6aad4736f763 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:56.570838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4980a13d-941e-4a0b-94b6-6aad4736f763 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:56.571537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4980a13d-941e-4a0b-94b6-6aad4736f763 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:56.572276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4980a13d-941e-4a0b-94b6-6aad4736f763 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:56.704530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dd592338-61d4-42ff-b965-edb5c04c82c4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:56.713841 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dd592338-61d4-42ff-b965-edb5c04c82c4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.348672 Oct 12 22:04:56.728098 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 808/1534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:56 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:56.736748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-830fee67-7191-490f-8ee1-4e8098f607b9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:56.737668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-830fee67-7191-490f-8ee1-4e8098f607b9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:56.745408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-830fee67-7191-490f-8ee1-4e8098f607b9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:56.746132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-830fee67-7191-490f-8ee1-4e8098f607b9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:56.746736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-830fee67-7191-490f-8ee1-4e8098f607b9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:56.747672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-830fee67-7191-490f-8ee1-4e8098f607b9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:56.748599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-830fee67-7191-490f-8ee1-4e8098f607b9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:56.749249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-830fee67-7191-490f-8ee1-4e8098f607b9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:56.920484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4980a13d-941e-4a0b-94b6-6aad4736f763 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:56.931434 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4980a13d-941e-4a0b-94b6-6aad4736f763 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1683 microversion: 2.1 time: 0.379081 Oct 12 22:04:56.932689 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 727/1535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:56 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1683 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:56.937765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e41e9d40-7fcc-49ae-9320-c975fbd925aa tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:56.939020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e41e9d40-7fcc-49ae-9320-c975fbd925aa tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:56.950776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e41e9d40-7fcc-49ae-9320-c975fbd925aa tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:56.952372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e41e9d40-7fcc-49ae-9320-c975fbd925aa tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:56.953226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e41e9d40-7fcc-49ae-9320-c975fbd925aa tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:56.955045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e41e9d40-7fcc-49ae-9320-c975fbd925aa tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:56.956822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e41e9d40-7fcc-49ae-9320-c975fbd925aa tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:56.957486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e41e9d40-7fcc-49ae-9320-c975fbd925aa tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:57.057420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-e41e9d40-7fcc-49ae-9320-c975fbd925aa tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:57.074086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-830fee67-7191-490f-8ee1-4e8098f607b9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:57.081402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:57.082974 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-830fee67-7191-490f-8ee1-4e8098f607b9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1379 microversion: 2.1 time: 0.353541 Oct 12 22:04:57.090420 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e41e9d40-7fcc-49ae-9320-c975fbd925aa tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1929 microversion: 2.75 time: 0.155789 Oct 12 22:04:57.091684 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 728/1536] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:56 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1929 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:57.092761 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 809/1537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:56 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1379 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:57.097249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1a5930d6-70b7-48fa-a2ba-911b408df70c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:57.098133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1a5930d6-70b7-48fa-a2ba-911b408df70c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:57.121356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a5930d6-70b7-48fa-a2ba-911b408df70c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:57.122100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a5930d6-70b7-48fa-a2ba-911b408df70c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:57.122711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a5930d6-70b7-48fa-a2ba-911b408df70c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:57.123685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a5930d6-70b7-48fa-a2ba-911b408df70c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:57.124367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a5930d6-70b7-48fa-a2ba-911b408df70c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:57.125174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a5930d6-70b7-48fa-a2ba-911b408df70c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:57.146556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-b0ce3324-2e60-40f4-a43c-3dd5049c7457 req-26299829-bcff-4c36-8138-038ff005409b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "747a8555-8993-47b3-a6de-2f32f025e240", "name": "network-vif-plugged", "status": "completed", "tag": "5cd49275-a219-45d2-abdc-6dac2bc36141"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:57.169127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b0ce3324-2e60-40f4-a43c-3dd5049c7457 req-26299829-bcff-4c36-8138-038ff005409b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:57.169607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b0ce3324-2e60-40f4-a43c-3dd5049c7457 req-26299829-bcff-4c36-8138-038ff005409b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:57.170035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b0ce3324-2e60-40f4-a43c-3dd5049c7457 req-26299829-bcff-4c36-8138-038ff005409b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:57.182049 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-b0ce3324-2e60-40f4-a43c-3dd5049c7457 req-26299829-bcff-4c36-8138-038ff005409b service nova] Creating event network-vif-plugged:5cd49275-a219-45d2-abdc-6dac2bc36141 for instance 747a8555-8993-47b3-a6de-2f32f025e240 on n-h2-861111-1 Oct 12 22:04:57.187598 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-b0ce3324-2e60-40f4-a43c-3dd5049c7457 req-26299829-bcff-4c36-8138-038ff005409b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047272 Oct 12 22:04:57.188830 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 810/1538] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:57.392232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0f670025-5435-4075-97ec-1b7ba549049b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:57.393028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0f670025-5435-4075-97ec-1b7ba549049b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:57.411027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f670025-5435-4075-97ec-1b7ba549049b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:57.412539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f670025-5435-4075-97ec-1b7ba549049b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:57.413836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f670025-5435-4075-97ec-1b7ba549049b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:57.414700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f670025-5435-4075-97ec-1b7ba549049b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:57.415335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f670025-5435-4075-97ec-1b7ba549049b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:57.416165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f670025-5435-4075-97ec-1b7ba549049b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:57.469469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1a5930d6-70b7-48fa-a2ba-911b408df70c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:57.484936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1a5930d6-70b7-48fa-a2ba-911b408df70c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:57.488142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1a5930d6-70b7-48fa-a2ba-911b408df70c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:57.494922 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1a5930d6-70b7-48fa-a2ba-911b408df70c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 0.396899 Oct 12 22:04:57.507785 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 729/1539] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:57 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:57.518584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-3a8d014a-8d5b-4af5-84d0-6105b3bde741 req-be1bb4d4-cf02-4ab8-8fbc-965c5cde6d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae4e25e-f720-42f5-aaa1-eac6492e37d3", "tag": "17538477-fced-4d99-b30b-5724d63d3744"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:57.528855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3a8d014a-8d5b-4af5-84d0-6105b3bde741 req-be1bb4d4-cf02-4ab8-8fbc-965c5cde6d9b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:57.529274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3a8d014a-8d5b-4af5-84d0-6105b3bde741 req-be1bb4d4-cf02-4ab8-8fbc-965c5cde6d9b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:57.529779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3a8d014a-8d5b-4af5-84d0-6105b3bde741 req-be1bb4d4-cf02-4ab8-8fbc-965c5cde6d9b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:57.544577 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-3a8d014a-8d5b-4af5-84d0-6105b3bde741 req-be1bb4d4-cf02-4ab8-8fbc-965c5cde6d9b service nova] Creating event network-changed:17538477-fced-4d99-b30b-5724d63d3744 for instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 on n-h1-861111-1 Oct 12 22:04:57.550616 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-3a8d014a-8d5b-4af5-84d0-6105b3bde741 req-be1bb4d4-cf02-4ab8-8fbc-965c5cde6d9b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041232 Oct 12 22:04:57.554158 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 730/1540] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:57.568980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-442c94d4-0784-4767-ae25-73c26b77e64d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:57.570832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-442c94d4-0784-4767-ae25-73c26b77e64d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:57.584097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-442c94d4-0784-4767-ae25-73c26b77e64d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:57.584884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-442c94d4-0784-4767-ae25-73c26b77e64d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:57.586453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-442c94d4-0784-4767-ae25-73c26b77e64d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:57.587731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-442c94d4-0784-4767-ae25-73c26b77e64d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:57.588677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-442c94d4-0784-4767-ae25-73c26b77e64d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:57.589455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-442c94d4-0784-4767-ae25-73c26b77e64d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:57.626196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0f670025-5435-4075-97ec-1b7ba549049b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:57.637294 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0f670025-5435-4075-97ec-1b7ba549049b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 200 len: 1306 microversion: 2.1 time: 0.257078 Oct 12 22:04:57.638927 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 811/1541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:57 2022] GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 1306 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:57.741450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-647cf076-5f18-48b8-abbd-a863e01c7a9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:57.742322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-647cf076-5f18-48b8-abbd-a863e01c7a9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:57.748894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-647cf076-5f18-48b8-abbd-a863e01c7a9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:57.749713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-647cf076-5f18-48b8-abbd-a863e01c7a9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:57.750144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-647cf076-5f18-48b8-abbd-a863e01c7a9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:57.751022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-647cf076-5f18-48b8-abbd-a863e01c7a9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:57.751696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-647cf076-5f18-48b8-abbd-a863e01c7a9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:57.752117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-647cf076-5f18-48b8-abbd-a863e01c7a9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:57.842146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-442c94d4-0784-4767-ae25-73c26b77e64d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:57.859513 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-442c94d4-0784-4767-ae25-73c26b77e64d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1321 microversion: 2.1 time: 0.302955 Oct 12 22:04:57.873797 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 731/1542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:57 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:57.946128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-647cf076-5f18-48b8-abbd-a863e01c7a9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:57.957204 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-647cf076-5f18-48b8-abbd-a863e01c7a9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.219489 Oct 12 22:04:57.959198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a58cb729-ba25-481c-8983-4e5369e056a1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:57.960769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a58cb729-ba25-481c-8983-4e5369e056a1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:57.971644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a58cb729-ba25-481c-8983-4e5369e056a1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:57.974326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a58cb729-ba25-481c-8983-4e5369e056a1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:57.975714 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 812/1543] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:57 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:57.978290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a58cb729-ba25-481c-8983-4e5369e056a1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:57.979280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a58cb729-ba25-481c-8983-4e5369e056a1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:57.979881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a58cb729-ba25-481c-8983-4e5369e056a1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:57.980248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a58cb729-ba25-481c-8983-4e5369e056a1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:58.102021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a58cb729-ba25-481c-8983-4e5369e056a1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990d936956654370a1c2997120e7231f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e56178d67cb48a88f99c741b3c0f2be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:58.107973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d5462dd1-565e-494b-a9d8-4434a6fd28d7 req-35cd1515-58da-4dc8-be47-a0a650295cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7169b167-a2fd-4983-af2e-bcc24daf9b72", "name": "network-vif-deleted", "tag": "40bd5146-e5e9-4d7e-aa69-34a079389240"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:04:58.118629 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a58cb729-ba25-481c-8983-4e5369e056a1 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 200 len: 1615 microversion: 2.1 time: 0.164437 Oct 12 22:04:58.122095 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 732/1544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:57 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 1615 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:04:58.127348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d5462dd1-565e-494b-a9d8-4434a6fd28d7 req-35cd1515-58da-4dc8-be47-a0a650295cb7 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:58.128148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d5462dd1-565e-494b-a9d8-4434a6fd28d7 req-35cd1515-58da-4dc8-be47-a0a650295cb7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:58.128916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d5462dd1-565e-494b-a9d8-4434a6fd28d7 req-35cd1515-58da-4dc8-be47-a0a650295cb7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:58.136065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6c5ac79c-dfc6-4f9a-896d-ef7c126b534e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:58.136615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6c5ac79c-dfc6-4f9a-896d-ef7c126b534e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:58.146939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c5ac79c-dfc6-4f9a-896d-ef7c126b534e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:58.151019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c5ac79c-dfc6-4f9a-896d-ef7c126b534e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:58.151672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c5ac79c-dfc6-4f9a-896d-ef7c126b534e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:58.152586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c5ac79c-dfc6-4f9a-896d-ef7c126b534e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:58.153190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c5ac79c-dfc6-4f9a-896d-ef7c126b534e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:58.153783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c5ac79c-dfc6-4f9a-896d-ef7c126b534e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:58.158146 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d5462dd1-565e-494b-a9d8-4434a6fd28d7 req-35cd1515-58da-4dc8-be47-a0a650295cb7 service nova] Creating event network-vif-deleted:40bd5146-e5e9-4d7e-aa69-34a079389240 for instance 7169b167-a2fd-4983-af2e-bcc24daf9b72 on n-h1-861111-1 Oct 12 22:04:58.170707 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d5462dd1-565e-494b-a9d8-4434a6fd28d7 req-35cd1515-58da-4dc8-be47-a0a650295cb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073745 Oct 12 22:04:58.175389 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 813/1545] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:04:58.188183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0a86d16a-9205-49e2-9665-67c2c3b2235d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:58.189045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0a86d16a-9205-49e2-9665-67c2c3b2235d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:58.201807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a86d16a-9205-49e2-9665-67c2c3b2235d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:58.202315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a86d16a-9205-49e2-9665-67c2c3b2235d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:58.202762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a86d16a-9205-49e2-9665-67c2c3b2235d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:58.203551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a86d16a-9205-49e2-9665-67c2c3b2235d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:58.204023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a86d16a-9205-49e2-9665-67c2c3b2235d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:58.204460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a86d16a-9205-49e2-9665-67c2c3b2235d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:58.370474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-0a86d16a-9205-49e2-9665-67c2c3b2235d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:58.391017 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0a86d16a-9205-49e2-9665-67c2c3b2235d tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1929 microversion: 2.75 time: 0.213046 Oct 12 22:04:58.406421 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 814/1546] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:58 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1929 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:58.525413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e1239884-aea9-41c1-9910-7a69fbc37a49 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:58.527231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e1239884-aea9-41c1-9910-7a69fbc37a49 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:58.540374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:58.541395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=16 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:58.544401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1239884-aea9-41c1-9910-7a69fbc37a49 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:58.549437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1239884-aea9-41c1-9910-7a69fbc37a49 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:58.550097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1239884-aea9-41c1-9910-7a69fbc37a49 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:58.551065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1239884-aea9-41c1-9910-7a69fbc37a49 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:58.551772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1239884-aea9-41c1-9910-7a69fbc37a49 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:58.552805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1239884-aea9-41c1-9910-7a69fbc37a49 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:58.857058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e1239884-aea9-41c1-9910-7a69fbc37a49 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:58.867436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e1239884-aea9-41c1-9910-7a69fbc37a49 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:58.870693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e1239884-aea9-41c1-9910-7a69fbc37a49 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:58.881387 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e1239884-aea9-41c1-9910-7a69fbc37a49 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 0.351413 Oct 12 22:04:58.882323 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 815/1547] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:58 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:58.892798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5a661729-4907-431e-8ca0-3a9f86b4ba14 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:58.895691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5a661729-4907-431e-8ca0-3a9f86b4ba14 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:58.914773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a661729-4907-431e-8ca0-3a9f86b4ba14 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:58.915454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a661729-4907-431e-8ca0-3a9f86b4ba14 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:58.915900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a661729-4907-431e-8ca0-3a9f86b4ba14 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:58.916621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a661729-4907-431e-8ca0-3a9f86b4ba14 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:58.919920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a661729-4907-431e-8ca0-3a9f86b4ba14 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:58.921911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a661729-4907-431e-8ca0-3a9f86b4ba14 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:58.937403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6c5ac79c-dfc6-4f9a-896d-ef7c126b534e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:58.945348 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6c5ac79c-dfc6-4f9a-896d-ef7c126b534e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1379 microversion: 2.1 time: 0.821909 Oct 12 22:04:58.975634 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 733/1548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:58 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1379 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:58.983347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c18050af-890c-409d-a52c-c23d2258bd9a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:58.985198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c18050af-890c-409d-a52c-c23d2258bd9a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:59.009596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c18050af-890c-409d-a52c-c23d2258bd9a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:59.010443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c18050af-890c-409d-a52c-c23d2258bd9a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:59.011295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c18050af-890c-409d-a52c-c23d2258bd9a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:59.012820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c18050af-890c-409d-a52c-c23d2258bd9a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:59.013572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c18050af-890c-409d-a52c-c23d2258bd9a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:59.014199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c18050af-890c-409d-a52c-c23d2258bd9a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:59.153573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5a661729-4907-431e-8ca0-3a9f86b4ba14 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:59.168608 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5a661729-4907-431e-8ca0-3a9f86b4ba14 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 200 len: 1306 microversion: 2.1 time: 0.284101 Oct 12 22:04:59.176458 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 816/1549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:58 2022] GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 1306 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:59.191967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c1fceecb-22c1-4367-9ea1-a7006f1b14fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:59.201228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c1fceecb-22c1-4367-9ea1-a7006f1b14fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:59.209200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1fceecb-22c1-4367-9ea1-a7006f1b14fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:59.210044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1fceecb-22c1-4367-9ea1-a7006f1b14fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:59.211468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1fceecb-22c1-4367-9ea1-a7006f1b14fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:59.214546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1fceecb-22c1-4367-9ea1-a7006f1b14fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:59.216754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1fceecb-22c1-4367-9ea1-a7006f1b14fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:59.218607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1fceecb-22c1-4367-9ea1-a7006f1b14fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:59.552537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c1fceecb-22c1-4367-9ea1-a7006f1b14fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:59.562588 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c1fceecb-22c1-4367-9ea1-a7006f1b14fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.384871 Oct 12 22:04:59.564652 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 817/1550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:59 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:59.572636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b5c52b64-6701-429a-9ae7-0f4c3af3a7d0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:59.573428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b5c52b64-6701-429a-9ae7-0f4c3af3a7d0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] [instance: 7169b167-a2fd-4983-af2e-bcc24daf9b72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:59.595542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5c52b64-6701-429a-9ae7-0f4c3af3a7d0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:59.596229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5c52b64-6701-429a-9ae7-0f4c3af3a7d0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:59.596668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5c52b64-6701-429a-9ae7-0f4c3af3a7d0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:59.597378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5c52b64-6701-429a-9ae7-0f4c3af3a7d0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:59.598165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5c52b64-6701-429a-9ae7-0f4c3af3a7d0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:59.598598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5c52b64-6701-429a-9ae7-0f4c3af3a7d0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:59.618460 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-b5c52b64-6701-429a-9ae7-0f4c3af3a7d0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] HTTP exception thrown: Instance 7169b167-a2fd-4983-af2e-bcc24daf9b72 could not be found. Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b5c52b64-6701-429a-9ae7-0f4c3af3a7d0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Request method failure captured: Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 HTTP/1.1 Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlyS74uZzFhw2kiHu5K_OCtU7DKMCMR7DLV-s516vo1AknQUnvJtK7sMKb6lScKg2_GVpsj9fFhY69Pa6JnE5gbhBfkgfrW3m-J9ImF9hoqkFDRydpQiKT5jbGE0OQPnmS3SjlRP9ve73ji_TblFDti45G6InXkNaP57lUaW6KxRSM Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 3e56178d67cb48a88f99c741b3c0f2be Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-VolumesAdminNegativeTest-575945794 Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:04:59.628755 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:04:59.630420 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e56178d67cb48a88f99c741b3c0f2be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e56178d67cb48a88f99c741b3c0f2be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3e56178d67cb48a88f99c741b3c0f2be", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3e56178d67cb48a88f99c741b3c0f2be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:04:59.630420 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-VolumesAdminNegativeTest-575945794 Oct 12 22:04:59.630420 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 3e56178d67cb48a88f99c741b3c0f2be Oct 12 22:04:59.630420 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-575945794 Oct 12 22:04:59.630420 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-VolumesAdminNegativeTest-575945794-project Oct 12 22:04:59.630420 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:04:59.630420 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:04:59.630420 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 990d936956654370a1c2997120e7231f Oct 12 22:04:59.630420 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-VolumesAdminNegativeTest-575945794-project Oct 12 22:04:59.630420 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:04:59.630420 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 7169b167-a2fd-4983-af2e-bcc24daf9b72 could not be found. Oct 12 22:04:59.630420 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '7169b167-a2fd-4983-af2e-bcc24daf9b72'} Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7169b167-a2fd-4983-af2e-bcc24daf9b72 could not be found. Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:04:59.631334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7169b167-a2fd-4983-af2e-bcc24daf9b72 could not be found. Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7169b167-a2fd-4983-af2e-bcc24daf9b72 could not be found. Oct 12 22:04:59.633409 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:04:59.636893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b5c52b64-6701-429a-9ae7-0f4c3af3a7d0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Returning 404 to user: Instance 7169b167-a2fd-4983-af2e-bcc24daf9b72 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:04:59.644514 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b5c52b64-6701-429a-9ae7-0f4c3af3a7d0 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72" status: 404 len: 111 microversion: 2.1 time: 0.077632 Oct 12 22:04:59.645532 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 818/1551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:59 2022] GET /compute/v2.1/servers/7169b167-a2fd-4983-af2e-bcc24daf9b72 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:04:59.659604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b4fd4e99-b8f0-43ff-b280-a0da8e5cc277 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:59.660444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b4fd4e99-b8f0-43ff-b280-a0da8e5cc277 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:59.674314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4fd4e99-b8f0-43ff-b280-a0da8e5cc277 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:59.676908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4fd4e99-b8f0-43ff-b280-a0da8e5cc277 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:59.677535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4fd4e99-b8f0-43ff-b280-a0da8e5cc277 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:59.678778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4fd4e99-b8f0-43ff-b280-a0da8e5cc277 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:59.679824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4fd4e99-b8f0-43ff-b280-a0da8e5cc277 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:59.683890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4fd4e99-b8f0-43ff-b280-a0da8e5cc277 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:59.793944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c18050af-890c-409d-a52c-c23d2258bd9a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:04:59.804082 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c18050af-890c-409d-a52c-c23d2258bd9a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1511 microversion: 2.1 time: 0.824645 Oct 12 22:04:59.804999 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 734/1552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:58 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1511 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:04:59.819271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6611f57a-4179-424f-9734-f2f9d6664ac7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] Calling method '.version_select at 0x7f5128323820>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:59.863334 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6611f57a-4179-424f-9734-f2f9d6664ac7 tempest-VolumesAdminNegativeTest-575945794 tempest-VolumesAdminNegativeTest-575945794-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602415162" status: 202 len: 0 microversion: 2.1 time: 0.050995 Oct 12 22:04:59.864098 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 735/1553] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 12 22:04:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602415162 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:04:59.873517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dbc102ab-33bf-419f-997c-3756cc82f05b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:59.879337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dbc102ab-33bf-419f-997c-3756cc82f05b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:04:59.896831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dbc102ab-33bf-419f-997c-3756cc82f05b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:59.897696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dbc102ab-33bf-419f-997c-3756cc82f05b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:59.898425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dbc102ab-33bf-419f-997c-3756cc82f05b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:59.899392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dbc102ab-33bf-419f-997c-3756cc82f05b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:04:59.900072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dbc102ab-33bf-419f-997c-3756cc82f05b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:04:59.900715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dbc102ab-33bf-419f-997c-3756cc82f05b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:04:59.907457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:04:59.939212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-b4fd4e99-b8f0-43ff-b280-a0da8e5cc277 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:04:59.983309 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b4fd4e99-b8f0-43ff-b280-a0da8e5cc277 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1929 microversion: 2.75 time: 0.333958 Oct 12 22:04:59.984645 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 819/1554] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:59 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1929 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:04:59.994039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-77960582-d72a-4a29-80da-f7805fd9ccdb tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:04:59.996598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-77960582-d72a-4a29-80da-f7805fd9ccdb tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:00.008434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77960582-d72a-4a29-80da-f7805fd9ccdb tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:00.011305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77960582-d72a-4a29-80da-f7805fd9ccdb tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:00.011993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77960582-d72a-4a29-80da-f7805fd9ccdb tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:00.013003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77960582-d72a-4a29-80da-f7805fd9ccdb tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:00.017739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77960582-d72a-4a29-80da-f7805fd9ccdb tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:00.018483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77960582-d72a-4a29-80da-f7805fd9ccdb tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:00.272527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-77960582-d72a-4a29-80da-f7805fd9ccdb tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:00.283450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-77960582-d72a-4a29-80da-f7805fd9ccdb tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:00.285436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-77960582-d72a-4a29-80da-f7805fd9ccdb tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:00.288281 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-77960582-d72a-4a29-80da-f7805fd9ccdb tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 0.301103 Oct 12 22:05:00.289486 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 820/1555] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:04:59 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:00.296172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c15bd468-15c5-4a04-a14a-1af65cdcaeba tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:00.297079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c15bd468-15c5-4a04-a14a-1af65cdcaeba tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:00.310512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15bd468-15c5-4a04-a14a-1af65cdcaeba tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:00.311129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15bd468-15c5-4a04-a14a-1af65cdcaeba tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:00.311651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15bd468-15c5-4a04-a14a-1af65cdcaeba tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:00.312425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15bd468-15c5-4a04-a14a-1af65cdcaeba tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:00.312946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15bd468-15c5-4a04-a14a-1af65cdcaeba tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:00.313437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15bd468-15c5-4a04-a14a-1af65cdcaeba tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:00.425714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dbc102ab-33bf-419f-997c-3756cc82f05b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:00.443441 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dbc102ab-33bf-419f-997c-3756cc82f05b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1511 microversion: 2.1 time: 0.576467 Oct 12 22:05:00.447447 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 736/1556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:04:59 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1511 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:00.456544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6ad5ca99-9d0a-4a41-ab49-e25c2bd4eb18 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:00.457394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6ad5ca99-9d0a-4a41-ab49-e25c2bd4eb18 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:00.464979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ad5ca99-9d0a-4a41-ab49-e25c2bd4eb18 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:00.465464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ad5ca99-9d0a-4a41-ab49-e25c2bd4eb18 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:00.468272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ad5ca99-9d0a-4a41-ab49-e25c2bd4eb18 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:00.468272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ad5ca99-9d0a-4a41-ab49-e25c2bd4eb18 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:00.468438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ad5ca99-9d0a-4a41-ab49-e25c2bd4eb18 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:00.468814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ad5ca99-9d0a-4a41-ab49-e25c2bd4eb18 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:00.865317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6ad5ca99-9d0a-4a41-ab49-e25c2bd4eb18 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:00.876057 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6ad5ca99-9d0a-4a41-ab49-e25c2bd4eb18 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 200 len: 1306 microversion: 2.1 time: 0.423408 Oct 12 22:05:00.879054 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 737/1557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:00 2022] GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 1306 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:00.885886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e50950f8-32d5-44f7-adba-6e544dc9111e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:00.887000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e50950f8-32d5-44f7-adba-6e544dc9111e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 747a8555-8993-47b3-a6de-2f32f025e240] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:00.898517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e50950f8-32d5-44f7-adba-6e544dc9111e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:00.899337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e50950f8-32d5-44f7-adba-6e544dc9111e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:00.899974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e50950f8-32d5-44f7-adba-6e544dc9111e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:00.900887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e50950f8-32d5-44f7-adba-6e544dc9111e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:00.901541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e50950f8-32d5-44f7-adba-6e544dc9111e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:00.902341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e50950f8-32d5-44f7-adba-6e544dc9111e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:00.956655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c15bd468-15c5-4a04-a14a-1af65cdcaeba tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:00.965730 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c15bd468-15c5-4a04-a14a-1af65cdcaeba tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1379 microversion: 2.1 time: 0.675116 Oct 12 22:05:00.966748 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 821/1558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:00 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1379 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:00.971688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-435a2aaa-8f25-48c3-9f0a-5092739fc55d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:00.972477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-435a2aaa-8f25-48c3-9f0a-5092739fc55d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:00.979503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-435a2aaa-8f25-48c3-9f0a-5092739fc55d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:00.980232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-435a2aaa-8f25-48c3-9f0a-5092739fc55d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:00.980985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-435a2aaa-8f25-48c3-9f0a-5092739fc55d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:00.982208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-435a2aaa-8f25-48c3-9f0a-5092739fc55d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:00.982562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-435a2aaa-8f25-48c3-9f0a-5092739fc55d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:00.982987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-435a2aaa-8f25-48c3-9f0a-5092739fc55d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:01.131461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-435a2aaa-8f25-48c3-9f0a-5092739fc55d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:01.140304 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-435a2aaa-8f25-48c3-9f0a-5092739fc55d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1717 microversion: 2.1 time: 0.172283 Oct 12 22:05:01.140953 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 822/1559] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:00 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1717 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:01.145611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-70727f77-7dbb-4e6b-9ece-68f9896568d2 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:01.146398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-70727f77-7dbb-4e6b-9ece-68f9896568d2 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:01.153199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70727f77-7dbb-4e6b-9ece-68f9896568d2 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:01.153940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70727f77-7dbb-4e6b-9ece-68f9896568d2 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:01.154571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70727f77-7dbb-4e6b-9ece-68f9896568d2 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:01.155378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70727f77-7dbb-4e6b-9ece-68f9896568d2 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:01.155893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70727f77-7dbb-4e6b-9ece-68f9896568d2 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:01.157066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70727f77-7dbb-4e6b-9ece-68f9896568d2 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:01.243147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-70727f77-7dbb-4e6b-9ece-68f9896568d2 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:05:01.247281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:01.264248 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-70727f77-7dbb-4e6b-9ece-68f9896568d2 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1929 microversion: 2.75 time: 0.122054 Oct 12 22:05:01.267413 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 823/1560] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:01 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1929 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:01.316435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-81efb04c-a2c6-4be8-ae6d-d1805d3273f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:01.317068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-81efb04c-a2c6-4be8-ae6d-d1805d3273f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:01.323457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81efb04c-a2c6-4be8-ae6d-d1805d3273f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:01.323956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81efb04c-a2c6-4be8-ae6d-d1805d3273f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:01.324456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81efb04c-a2c6-4be8-ae6d-d1805d3273f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:01.325582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81efb04c-a2c6-4be8-ae6d-d1805d3273f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:01.326345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81efb04c-a2c6-4be8-ae6d-d1805d3273f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:01.326766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81efb04c-a2c6-4be8-ae6d-d1805d3273f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:01.433134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e50950f8-32d5-44f7-adba-6e544dc9111e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:01.448909 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e50950f8-32d5-44f7-adba-6e544dc9111e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240" status: 200 len: 1512 microversion: 2.1 time: 0.568302 Oct 12 22:05:01.449519 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 738/1561] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:00 2022] GET /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240 => generated 1512 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:01.473870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-12fb72ac-0641-4971-b98e-21269e3d633f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:01.480796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-12fb72ac-0641-4971-b98e-21269e3d633f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:01.482162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-12fb72ac-0641-4971-b98e-21269e3d633f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:01.497807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12fb72ac-0641-4971-b98e-21269e3d633f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:01.498552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12fb72ac-0641-4971-b98e-21269e3d633f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:01.499208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12fb72ac-0641-4971-b98e-21269e3d633f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:01.500155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12fb72ac-0641-4971-b98e-21269e3d633f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:01.500851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12fb72ac-0641-4971-b98e-21269e3d633f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:01.501514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12fb72ac-0641-4971-b98e-21269e3d633f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:01.513561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-81efb04c-a2c6-4be8-ae6d-d1805d3273f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:01.534651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-81efb04c-a2c6-4be8-ae6d-d1805d3273f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:01.536519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-81efb04c-a2c6-4be8-ae6d-d1805d3273f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:01.537757 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-81efb04c-a2c6-4be8-ae6d-d1805d3273f4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 0.225506 Oct 12 22:05:01.538323 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 824/1562] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:01 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:01.630136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.multi_cell_list [None req-12fb72ac-0641-4971-b98e-21269e3d633f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:05:01.771711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-12fb72ac-0641-4971-b98e-21269e3d633f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:01.780993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12fb72ac-0641-4971-b98e-21269e3d633f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:01.781697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12fb72ac-0641-4971-b98e-21269e3d633f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:01.782291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12fb72ac-0641-4971-b98e-21269e3d633f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:01.902457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-83557ca4-2c5b-40e7-a09e-1a1abe17a670 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:01.903321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-83557ca4-2c5b-40e7-a09e-1a1abe17a670 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:01.910994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83557ca4-2c5b-40e7-a09e-1a1abe17a670 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:01.912852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83557ca4-2c5b-40e7-a09e-1a1abe17a670 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:01.913524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83557ca4-2c5b-40e7-a09e-1a1abe17a670 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:01.914408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83557ca4-2c5b-40e7-a09e-1a1abe17a670 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:01.915165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83557ca4-2c5b-40e7-a09e-1a1abe17a670 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:01.915776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83557ca4-2c5b-40e7-a09e-1a1abe17a670 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:02.161896 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-12fb72ac-0641-4971-b98e-21269e3d633f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.692071 Oct 12 22:05:02.164031 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 739/1563] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 12 22:05:01 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:02.169050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-97494c01-660e-4afd-85d3-7de2e0ae76ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:02.169859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-97494c01-660e-4afd-85d3-7de2e0ae76ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:02.184548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97494c01-660e-4afd-85d3-7de2e0ae76ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:02.185045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97494c01-660e-4afd-85d3-7de2e0ae76ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:02.185479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97494c01-660e-4afd-85d3-7de2e0ae76ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:02.186189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97494c01-660e-4afd-85d3-7de2e0ae76ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:02.186642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97494c01-660e-4afd-85d3-7de2e0ae76ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:02.187068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97494c01-660e-4afd-85d3-7de2e0ae76ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:02.236062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-83557ca4-2c5b-40e7-a09e-1a1abe17a670 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:02.247196 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-83557ca4-2c5b-40e7-a09e-1a1abe17a670 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 200 len: 1306 microversion: 2.1 time: 0.349062 Oct 12 22:05:02.249320 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 825/1564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:01 2022] GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 1306 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:05:02.273271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-fbf7ae2b-3938-4a59-ad0f-044635f18257 req-54a385b8-9a61-46fd-af02-c77214e414ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88fef870-22a8-43e7-afb9-5612edbce136", "name": "network-vif-plugged", "status": "completed", "tag": "8fa5803d-652c-4259-8fef-98474172e507"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:02.285220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fbf7ae2b-3938-4a59-ad0f-044635f18257 req-54a385b8-9a61-46fd-af02-c77214e414ab service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:02.286062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fbf7ae2b-3938-4a59-ad0f-044635f18257 req-54a385b8-9a61-46fd-af02-c77214e414ab service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:02.286720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fbf7ae2b-3938-4a59-ad0f-044635f18257 req-54a385b8-9a61-46fd-af02-c77214e414ab service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:02.319497 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-fbf7ae2b-3938-4a59-ad0f-044635f18257 req-54a385b8-9a61-46fd-af02-c77214e414ab service nova] Creating event network-vif-plugged:8fa5803d-652c-4259-8fef-98474172e507 for instance 88fef870-22a8-43e7-afb9-5612edbce136 on n-h1-861111-1 Oct 12 22:05:02.374443 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-fbf7ae2b-3938-4a59-ad0f-044635f18257 req-54a385b8-9a61-46fd-af02-c77214e414ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120084 Oct 12 22:05:02.381390 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 826/1565] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:02.405716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6cf8acfe-aea6-4262-927f-c75430641bc9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:02.410265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6cf8acfe-aea6-4262-927f-c75430641bc9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:02.447939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf8acfe-aea6-4262-927f-c75430641bc9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:02.451067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf8acfe-aea6-4262-927f-c75430641bc9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:02.452717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf8acfe-aea6-4262-927f-c75430641bc9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:02.455716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf8acfe-aea6-4262-927f-c75430641bc9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:02.457419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf8acfe-aea6-4262-927f-c75430641bc9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:02.458129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf8acfe-aea6-4262-927f-c75430641bc9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:02.579047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-97494c01-660e-4afd-85d3-7de2e0ae76ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:02.604758 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-97494c01-660e-4afd-85d3-7de2e0ae76ac tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1379 microversion: 2.1 time: 0.437895 Oct 12 22:05:02.607067 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 740/1566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:02 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1379 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:02.615164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-194bc6e7-c7b1-4f92-890e-951e9802384b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:02.621553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-194bc6e7-c7b1-4f92-890e-951e9802384b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:02.623335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-194bc6e7-c7b1-4f92-890e-951e9802384b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1464234974', 'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:02.629867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-194bc6e7-c7b1-4f92-890e-951e9802384b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:02.630938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-194bc6e7-c7b1-4f92-890e-951e9802384b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:02.631636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-194bc6e7-c7b1-4f92-890e-951e9802384b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:02.633989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-194bc6e7-c7b1-4f92-890e-951e9802384b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:02.634734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-194bc6e7-c7b1-4f92-890e-951e9802384b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:02.635403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-194bc6e7-c7b1-4f92-890e-951e9802384b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:02.810141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6cf8acfe-aea6-4262-927f-c75430641bc9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:02.834078 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6cf8acfe-aea6-4262-927f-c75430641bc9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1707 microversion: 2.1 time: 0.446985 Oct 12 22:05:02.840734 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 827/1567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:02 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1707 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:02.845903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c0bb66d3-aaae-440c-9ab2-d82adcb7e9e5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:02.846530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c0bb66d3-aaae-440c-9ab2-d82adcb7e9e5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:02.862849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0bb66d3-aaae-440c-9ab2-d82adcb7e9e5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:02.863410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0bb66d3-aaae-440c-9ab2-d82adcb7e9e5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:02.881201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0bb66d3-aaae-440c-9ab2-d82adcb7e9e5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:02.882972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0bb66d3-aaae-440c-9ab2-d82adcb7e9e5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:02.888029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0bb66d3-aaae-440c-9ab2-d82adcb7e9e5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:02.888526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0bb66d3-aaae-440c-9ab2-d82adcb7e9e5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:02.965317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.multi_cell_list [None req-194bc6e7-c7b1-4f92-890e-951e9802384b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:05:03.070245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-c0bb66d3-aaae-440c-9ab2-d82adcb7e9e5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:05:03.094220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-194bc6e7-c7b1-4f92-890e-951e9802384b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:03.100141 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c0bb66d3-aaae-440c-9ab2-d82adcb7e9e5 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1947 microversion: 2.75 time: 0.258614 Oct 12 22:05:03.100550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-194bc6e7-c7b1-4f92-890e-951e9802384b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:03.101588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-194bc6e7-c7b1-4f92-890e-951e9802384b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:03.102090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-194bc6e7-c7b1-4f92-890e-951e9802384b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:03.103007 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 828/1568] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:02 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1947 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:03.120488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e6e5f739-874d-424e-829e-8576bdfe47c5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:03.121518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e6e5f739-874d-424e-829e-8576bdfe47c5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:03.137902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6e5f739-874d-424e-829e-8576bdfe47c5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:03.139150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6e5f739-874d-424e-829e-8576bdfe47c5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:03.139634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6e5f739-874d-424e-829e-8576bdfe47c5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:03.140360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6e5f739-874d-424e-829e-8576bdfe47c5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:03.140819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6e5f739-874d-424e-829e-8576bdfe47c5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:03.141245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6e5f739-874d-424e-829e-8576bdfe47c5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:03.359300 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-194bc6e7-c7b1-4f92-890e-951e9802384b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1464234974" status: 200 len: 1514 microversion: 2.1 time: 0.749197 Oct 12 22:05:03.359990 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 741/1569] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:05:02 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1464234974 => generated 1514 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:03.365461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7909c8f4-5267-4c40-9a36-88f9ef9cfdc1 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '.version_select at 0x7f512841c280>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:03.371471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7909c8f4-5267-4c40-9a36-88f9ef9cfdc1 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:03.372395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7909c8f4-5267-4c40-9a36-88f9ef9cfdc1 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:03.373458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7909c8f4-5267-4c40-9a36-88f9ef9cfdc1 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:03.390426 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7909c8f4-5267-4c40-9a36-88f9ef9cfdc1 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3104 microversion: 2.1 time: 0.029105 Oct 12 22:05:03.392047 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 742/1570] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 12 22:05:03 2022] GET /compute/v2.1/os-migrations => generated 3104 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:03.397940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-38b87c2c-f88e-47db-916a-dcfb5c23f35e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:03.399171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-38b87c2c-f88e-47db-916a-dcfb5c23f35e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:03.407774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38b87c2c-f88e-47db-916a-dcfb5c23f35e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:03.408619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38b87c2c-f88e-47db-916a-dcfb5c23f35e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:03.409647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38b87c2c-f88e-47db-916a-dcfb5c23f35e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:03.410944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38b87c2c-f88e-47db-916a-dcfb5c23f35e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:03.411708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38b87c2c-f88e-47db-916a-dcfb5c23f35e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:03.412637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38b87c2c-f88e-47db-916a-dcfb5c23f35e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:03.428915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e6e5f739-874d-424e-829e-8576bdfe47c5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:03.440420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e6e5f739-874d-424e-829e-8576bdfe47c5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:03.444294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e6e5f739-874d-424e-829e-8576bdfe47c5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:03.446684 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e6e5f739-874d-424e-829e-8576bdfe47c5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 0.342185 Oct 12 22:05:03.461016 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 829/1571] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:03 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:03.472859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a20abfb7-f6a5-43cd-9c9e-3639bb0135eb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:03.478756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a20abfb7-f6a5-43cd-9c9e-3639bb0135eb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:03.479934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a20abfb7-f6a5-43cd-9c9e-3639bb0135eb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:03.488072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a20abfb7-f6a5-43cd-9c9e-3639bb0135eb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:03.488812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a20abfb7-f6a5-43cd-9c9e-3639bb0135eb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:03.489401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a20abfb7-f6a5-43cd-9c9e-3639bb0135eb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:03.490469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a20abfb7-f6a5-43cd-9c9e-3639bb0135eb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:03.491080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a20abfb7-f6a5-43cd-9c9e-3639bb0135eb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:03.492294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a20abfb7-f6a5-43cd-9c9e-3639bb0135eb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:03.634160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-a20abfb7-f6a5-43cd-9c9e-3639bb0135eb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:05:03.757000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a20abfb7-f6a5-43cd-9c9e-3639bb0135eb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:03.776782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a20abfb7-f6a5-43cd-9c9e-3639bb0135eb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:03.777114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a20abfb7-f6a5-43cd-9c9e-3639bb0135eb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:03.777468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a20abfb7-f6a5-43cd-9c9e-3639bb0135eb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:04.076284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-38b87c2c-f88e-47db-916a-dcfb5c23f35e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:04.091906 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-38b87c2c-f88e-47db-916a-dcfb5c23f35e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 200 len: 1306 microversion: 2.1 time: 0.698082 Oct 12 22:05:04.093029 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 743/1572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:03 2022] GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 1306 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:04.094647 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a20abfb7-f6a5-43cd-9c9e-3639bb0135eb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.632026 Oct 12 22:05:04.095620 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 830/1573] 10.222.0.16 () {58 vars in 1173 bytes} [Wed Oct 12 22:05:03 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:04.098574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-47c5029c-afa6-4979-88f0-a17abc904a9d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:04.099380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-47c5029c-afa6-4979-88f0-a17abc904a9d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:04.112083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47c5029c-afa6-4979-88f0-a17abc904a9d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:04.115824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47c5029c-afa6-4979-88f0-a17abc904a9d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:04.117079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47c5029c-afa6-4979-88f0-a17abc904a9d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:04.121088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe7bf95f-32f9-4373-91ed-9dbad6241e6a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:04.121442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47c5029c-afa6-4979-88f0-a17abc904a9d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:04.121719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fe7bf95f-32f9-4373-91ed-9dbad6241e6a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:04.122378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47c5029c-afa6-4979-88f0-a17abc904a9d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:04.122822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47c5029c-afa6-4979-88f0-a17abc904a9d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:04.150543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe7bf95f-32f9-4373-91ed-9dbad6241e6a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:04.151038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe7bf95f-32f9-4373-91ed-9dbad6241e6a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:04.154515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe7bf95f-32f9-4373-91ed-9dbad6241e6a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:04.155648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe7bf95f-32f9-4373-91ed-9dbad6241e6a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:04.155824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe7bf95f-32f9-4373-91ed-9dbad6241e6a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:04.158602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe7bf95f-32f9-4373-91ed-9dbad6241e6a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:04.476593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fe7bf95f-32f9-4373-91ed-9dbad6241e6a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:04.486305 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fe7bf95f-32f9-4373-91ed-9dbad6241e6a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1379 microversion: 2.1 time: 0.389551 Oct 12 22:05:04.488104 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 831/1574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:04 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1379 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:04.494110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aec242b1-2705-490c-a01f-f4f58a51a63c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:04.497663 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-47c5029c-afa6-4979-88f0-a17abc904a9d tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1858 microversion: 2.1 time: 0.403227 Oct 12 22:05:04.500498 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 744/1575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:04 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1858 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:04.502270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aec242b1-2705-490c-a01f-f4f58a51a63c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:04.502987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.compute.servers [None req-aec242b1-2705-490c-a01f-f4f58a51a63c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Removing options 'limit' from query {{(pid=120453) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 12 22:05:04.504141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aec242b1-2705-490c-a01f-f4f58a51a63c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:04.509260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f62c5bac-f20a-4ab4-ac65-ec83bb9e1a1f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:04.510096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f62c5bac-f20a-4ab4-ac65-ec83bb9e1a1f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:04.510934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aec242b1-2705-490c-a01f-f4f58a51a63c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:04.511820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aec242b1-2705-490c-a01f-f4f58a51a63c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:04.513308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aec242b1-2705-490c-a01f-f4f58a51a63c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:04.514285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aec242b1-2705-490c-a01f-f4f58a51a63c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:04.515363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aec242b1-2705-490c-a01f-f4f58a51a63c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:04.516034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aec242b1-2705-490c-a01f-f4f58a51a63c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:04.519350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f62c5bac-f20a-4ab4-ac65-ec83bb9e1a1f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:04.520232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f62c5bac-f20a-4ab4-ac65-ec83bb9e1a1f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:04.520851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f62c5bac-f20a-4ab4-ac65-ec83bb9e1a1f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:04.521811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f62c5bac-f20a-4ab4-ac65-ec83bb9e1a1f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:04.522454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f62c5bac-f20a-4ab4-ac65-ec83bb9e1a1f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:04.523623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f62c5bac-f20a-4ab4-ac65-ec83bb9e1a1f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:04.652111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aec242b1-2705-490c-a01f-f4f58a51a63c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:04.664940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aec242b1-2705-490c-a01f-f4f58a51a63c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:04.665748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aec242b1-2705-490c-a01f-f4f58a51a63c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:04.666472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aec242b1-2705-490c-a01f-f4f58a51a63c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:04.681406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-f62c5bac-f20a-4ab4-ac65-ec83bb9e1a1f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:05:04.708981 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f62c5bac-f20a-4ab4-ac65-ec83bb9e1a1f tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1935 microversion: 2.75 time: 0.207449 Oct 12 22:05:04.711588 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 745/1576] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:04 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1935 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:04.718744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-02cb073a-bc60-4dd4-8a99-7fe86fa4d478 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:04.728163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-02cb073a-bc60-4dd4-8a99-7fe86fa4d478 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:04.737669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02cb073a-bc60-4dd4-8a99-7fe86fa4d478 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:04.738350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02cb073a-bc60-4dd4-8a99-7fe86fa4d478 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:04.743438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02cb073a-bc60-4dd4-8a99-7fe86fa4d478 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:04.744337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02cb073a-bc60-4dd4-8a99-7fe86fa4d478 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:04.751901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02cb073a-bc60-4dd4-8a99-7fe86fa4d478 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:04.752468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02cb073a-bc60-4dd4-8a99-7fe86fa4d478 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:04.970519 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aec242b1-2705-490c-a01f-f4f58a51a63c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.479928 Oct 12 22:05:04.971464 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 832/1577] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 12 22:05:04 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:04.978635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-80a61c3e-4fcb-4e93-88af-d46134849004 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:04.980322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-80a61c3e-4fcb-4e93-88af-d46134849004 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:04.990760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80a61c3e-4fcb-4e93-88af-d46134849004 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:04.991717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80a61c3e-4fcb-4e93-88af-d46134849004 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:04.992429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80a61c3e-4fcb-4e93-88af-d46134849004 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:04.997525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80a61c3e-4fcb-4e93-88af-d46134849004 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:04.998789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80a61c3e-4fcb-4e93-88af-d46134849004 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:04.999509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80a61c3e-4fcb-4e93-88af-d46134849004 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:05.049488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-02cb073a-bc60-4dd4-8a99-7fe86fa4d478 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:05.064593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-02cb073a-bc60-4dd4-8a99-7fe86fa4d478 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:05.070020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-02cb073a-bc60-4dd4-8a99-7fe86fa4d478 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:05.072596 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-02cb073a-bc60-4dd4-8a99-7fe86fa4d478 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 0.357726 Oct 12 22:05:05.073398 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 746/1578] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:04 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:05.078423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0c5e402e-5daf-4928-9d1a-9cd6bd30e1b5 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:05.085636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0c5e402e-5daf-4928-9d1a-9cd6bd30e1b5 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:05.086689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0c5e402e-5daf-4928-9d1a-9cd6bd30e1b5 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:05.096764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c5e402e-5daf-4928-9d1a-9cd6bd30e1b5 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:05.097508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c5e402e-5daf-4928-9d1a-9cd6bd30e1b5 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:05.098139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c5e402e-5daf-4928-9d1a-9cd6bd30e1b5 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:05.099033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c5e402e-5daf-4928-9d1a-9cd6bd30e1b5 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:05.099707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c5e402e-5daf-4928-9d1a-9cd6bd30e1b5 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:05.100307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c5e402e-5daf-4928-9d1a-9cd6bd30e1b5 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:05.262685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.multi_cell_list [None req-0c5e402e-5daf-4928-9d1a-9cd6bd30e1b5 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:05:05.310535 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-80a61c3e-4fcb-4e93-88af-d46134849004 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1858 microversion: 2.1 time: 0.333522 Oct 12 22:05:05.313554 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 833/1579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:04 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1858 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:05.326448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-58823912-5927-4b50-937d-382e5b40f96d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:05.327690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-58823912-5927-4b50-937d-382e5b40f96d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:05.345609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58823912-5927-4b50-937d-382e5b40f96d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:05.347151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58823912-5927-4b50-937d-382e5b40f96d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:05.348364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58823912-5927-4b50-937d-382e5b40f96d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:05.353687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58823912-5927-4b50-937d-382e5b40f96d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:05.354528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58823912-5927-4b50-937d-382e5b40f96d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:05.356568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58823912-5927-4b50-937d-382e5b40f96d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:05.575802 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0c5e402e-5daf-4928-9d1a-9cd6bd30e1b5 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.500717 Oct 12 22:05:05.577259 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 747/1580] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:05:05 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:05.582394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0d4e137d-d403-4c07-9e96-92efde5feb36 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:05.583086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0d4e137d-d403-4c07-9e96-92efde5feb36 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:05.592161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d4e137d-d403-4c07-9e96-92efde5feb36 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:05.592864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d4e137d-d403-4c07-9e96-92efde5feb36 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:05.593698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d4e137d-d403-4c07-9e96-92efde5feb36 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:05.597568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d4e137d-d403-4c07-9e96-92efde5feb36 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:05.599126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d4e137d-d403-4c07-9e96-92efde5feb36 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:05.599787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d4e137d-d403-4c07-9e96-92efde5feb36 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:05.747556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-0d4e137d-d403-4c07-9e96-92efde5feb36 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lazy-loading 'services' on Instance uuid 3d06c998-c0a6-4bb7-8538-9a7b0298b918 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:05:05.769356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-58823912-5927-4b50-937d-382e5b40f96d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:05.783073 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-58823912-5927-4b50-937d-382e5b40f96d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 200 len: 1485 microversion: 2.1 time: 0.465176 Oct 12 22:05:05.784088 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 834/1581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:05 2022] GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 1485 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:05.806608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-be4576f7-e798-452c-addb-ba73e58bf45f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:05.807260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-be4576f7-e798-452c-addb-ba73e58bf45f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:05.845624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be4576f7-e798-452c-addb-ba73e58bf45f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:05.846826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be4576f7-e798-452c-addb-ba73e58bf45f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:05.847299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be4576f7-e798-452c-addb-ba73e58bf45f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:05.848041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be4576f7-e798-452c-addb-ba73e58bf45f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:05.852349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be4576f7-e798-452c-addb-ba73e58bf45f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:05.852842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be4576f7-e798-452c-addb-ba73e58bf45f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:05.935288 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0d4e137d-d403-4c07-9e96-92efde5feb36 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments/cdcc2a17-ec8b-40a7-87ae-d3442afa562c" status: 202 len: 0 microversion: 2.1 time: 0.356218 Oct 12 22:05:05.936622 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 748/1582] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 22:05:05 2022] DELETE /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments/cdcc2a17-ec8b-40a7-87ae-d3442afa562c => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:05:05.945547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-267eed2b-dc05-4668-873b-75d9942db324 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:05.953049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-267eed2b-dc05-4668-873b-75d9942db324 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:05.954079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.compute.servers [None req-267eed2b-dc05-4668-873b-75d9942db324 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Removing options 'limit' from query {{(pid=120452) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 12 22:05:05.956279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-267eed2b-dc05-4668-873b-75d9942db324 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:05.964708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-267eed2b-dc05-4668-873b-75d9942db324 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:05.965590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-267eed2b-dc05-4668-873b-75d9942db324 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:05.966148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-267eed2b-dc05-4668-873b-75d9942db324 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:05.967014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-267eed2b-dc05-4668-873b-75d9942db324 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:05.967617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-267eed2b-dc05-4668-873b-75d9942db324 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:05.969317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-267eed2b-dc05-4668-873b-75d9942db324 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:06.144807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.multi_cell_list [None req-267eed2b-dc05-4668-873b-75d9942db324 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:05:06.269774 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-267eed2b-dc05-4668-873b-75d9942db324 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.331111 Oct 12 22:05:06.277075 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 749/1583] 10.222.0.16 () {58 vars in 1150 bytes} [Wed Oct 12 22:05:05 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:06.281936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e967d4fc-a8bf-406f-bd8a-89f15eabdee1 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:06.289336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e967d4fc-a8bf-406f-bd8a-89f15eabdee1 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:06.302245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e967d4fc-a8bf-406f-bd8a-89f15eabdee1 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:06.305283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e967d4fc-a8bf-406f-bd8a-89f15eabdee1 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:06.305868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e967d4fc-a8bf-406f-bd8a-89f15eabdee1 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:06.306876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e967d4fc-a8bf-406f-bd8a-89f15eabdee1 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:06.309244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e967d4fc-a8bf-406f-bd8a-89f15eabdee1 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:06.309953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e967d4fc-a8bf-406f-bd8a-89f15eabdee1 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:06.351874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:06.388622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-be4576f7-e798-452c-addb-ba73e58bf45f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:06.404755 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-be4576f7-e798-452c-addb-ba73e58bf45f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1379 microversion: 2.1 time: 0.619559 Oct 12 22:05:06.407889 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 835/1584] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:05 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1379 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:06.428567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-50859112-7c22-423b-b456-155581c51999 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-31454492"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:06.433979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-50859112-7c22-423b-b456-155581c51999 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:06.447066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50859112-7c22-423b-b456-155581c51999 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:06.447970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50859112-7c22-423b-b456-155581c51999 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:06.455303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50859112-7c22-423b-b456-155581c51999 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:06.456382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50859112-7c22-423b-b456-155581c51999 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:06.457058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50859112-7c22-423b-b456-155581c51999 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:06.457721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50859112-7c22-423b-b456-155581c51999 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:06.545909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-e967d4fc-a8bf-406f-bd8a-89f15eabdee1 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:05:06.589554 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e967d4fc-a8bf-406f-bd8a-89f15eabdee1 tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1935 microversion: 2.75 time: 0.307268 Oct 12 22:05:06.590536 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 750/1585] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:06 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1935 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:06.600214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b068112b-3ef1-4ade-a3f2-c4379946eea2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:06.606243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b068112b-3ef1-4ade-a3f2-c4379946eea2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:06.620171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b068112b-3ef1-4ade-a3f2-c4379946eea2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:06.622668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b068112b-3ef1-4ade-a3f2-c4379946eea2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:06.623354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b068112b-3ef1-4ade-a3f2-c4379946eea2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:06.624286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b068112b-3ef1-4ade-a3f2-c4379946eea2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:06.627528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b068112b-3ef1-4ade-a3f2-c4379946eea2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:06.628596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b068112b-3ef1-4ade-a3f2-c4379946eea2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:06.701572 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b068112b-3ef1-4ade-a3f2-c4379946eea2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109912 Oct 12 22:05:06.706898 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 751/1586] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:05:06 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:06.718557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6711ffdf-25ae-4d2a-b8a3-a2251abc8cb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:06.719525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6711ffdf-25ae-4d2a-b8a3-a2251abc8cb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:06.739657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6711ffdf-25ae-4d2a-b8a3-a2251abc8cb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:06.744526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6711ffdf-25ae-4d2a-b8a3-a2251abc8cb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:06.745199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6711ffdf-25ae-4d2a-b8a3-a2251abc8cb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:06.748836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6711ffdf-25ae-4d2a-b8a3-a2251abc8cb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:06.752176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6711ffdf-25ae-4d2a-b8a3-a2251abc8cb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:06.760751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6711ffdf-25ae-4d2a-b8a3-a2251abc8cb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:07.006526 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-50859112-7c22-423b-b456-155581c51999 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "POST /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136/action" status: 202 len: 0 microversion: 2.1 time: 0.597104 Oct 12 22:05:07.010887 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 836/1587] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:05:06 2022] POST /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:05:07.024970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a6a7b1c7-318b-4b55-8fdd-ba1cb57a8df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:07.037301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a6a7b1c7-318b-4b55-8fdd-ba1cb57a8df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:07.038105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a6a7b1c7-318b-4b55-8fdd-ba1cb57a8df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:07.050904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6a7b1c7-318b-4b55-8fdd-ba1cb57a8df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:07.055747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6a7b1c7-318b-4b55-8fdd-ba1cb57a8df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:07.056473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6a7b1c7-318b-4b55-8fdd-ba1cb57a8df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:07.057460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6a7b1c7-318b-4b55-8fdd-ba1cb57a8df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:07.058081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6a7b1c7-318b-4b55-8fdd-ba1cb57a8df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:07.058674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6a7b1c7-318b-4b55-8fdd-ba1cb57a8df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:07.329599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-a6a7b1c7-318b-4b55-8fdd-ba1cb57a8df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:05:07.427808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6711ffdf-25ae-4d2a-b8a3-a2251abc8cb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:07.439866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6711ffdf-25ae-4d2a-b8a3-a2251abc8cb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:07.449475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6711ffdf-25ae-4d2a-b8a3-a2251abc8cb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:07.451757 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6711ffdf-25ae-4d2a-b8a3-a2251abc8cb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 0.743589 Oct 12 22:05:07.452655 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 752/1588] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:06 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:07.463902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-a441e015-aaac-4066-8c1d-9582ce469e66 req-7f9ce39f-0924-4606-b5a7-e483f5f81bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae4e25e-f720-42f5-aaa1-eac6492e37d3", "name": "network-vif-plugged", "status": "completed", "tag": "17538477-fced-4d99-b30b-5724d63d3744"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:07.492120 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a6a7b1c7-318b-4b55-8fdd-ba1cb57a8df3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.478925 Oct 12 22:05:07.493580 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 837/1589] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 12 22:05:07 2022] GET /compute/v2.1/servers => generated 1012 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:07.499181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-efafc419-d1be-4d50-826d-d0921c5c1896 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128861af0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:07.503395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a441e015-aaac-4066-8c1d-9582ce469e66 req-7f9ce39f-0924-4606-b5a7-e483f5f81bf8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:07.512285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a441e015-aaac-4066-8c1d-9582ce469e66 req-7f9ce39f-0924-4606-b5a7-e483f5f81bf8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:07.514324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a441e015-aaac-4066-8c1d-9582ce469e66 req-7f9ce39f-0924-4606-b5a7-e483f5f81bf8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:07.531977 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-a441e015-aaac-4066-8c1d-9582ce469e66 req-7f9ce39f-0924-4606-b5a7-e483f5f81bf8 service nova] Creating event network-vif-plugged:17538477-fced-4d99-b30b-5724d63d3744 for instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 on n-h1-861111-1 Oct 12 22:05:07.539212 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-a441e015-aaac-4066-8c1d-9582ce469e66 req-7f9ce39f-0924-4606-b5a7-e483f5f81bf8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079937 Oct 12 22:05:07.545513 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 753/1590] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:07.572909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f7289c6a-fb9f-4a29-87b8-5e2b2c4f5345 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:07.573608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f7289c6a-fb9f-4a29-87b8-5e2b2c4f5345 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:07.598031 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-efafc419-d1be-4d50-826d-d0921c5c1896 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be" status: 200 len: 1410 microversion: 2.1 time: 0.103220 Oct 12 22:05:07.598580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7289c6a-fb9f-4a29-87b8-5e2b2c4f5345 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:07.600543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7289c6a-fb9f-4a29-87b8-5e2b2c4f5345 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:07.601808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7289c6a-fb9f-4a29-87b8-5e2b2c4f5345 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:07.604486 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 838/1591] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:05:07 2022] GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be => generated 1410 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:07.606344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7289c6a-fb9f-4a29-87b8-5e2b2c4f5345 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:07.607008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7289c6a-fb9f-4a29-87b8-5e2b2c4f5345 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:07.608461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7289c6a-fb9f-4a29-87b8-5e2b2c4f5345 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:07.612074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7c883fd1-0921-40ed-bfeb-95765d87288a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:07.657392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7c883fd1-0921-40ed-bfeb-95765d87288a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:07.658167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7c883fd1-0921-40ed-bfeb-95765d87288a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:07.690889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c883fd1-0921-40ed-bfeb-95765d87288a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:07.694329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c883fd1-0921-40ed-bfeb-95765d87288a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:07.696610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c883fd1-0921-40ed-bfeb-95765d87288a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:07.700269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c883fd1-0921-40ed-bfeb-95765d87288a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:07.705109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c883fd1-0921-40ed-bfeb-95765d87288a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:07.705768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c883fd1-0921-40ed-bfeb-95765d87288a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:07.996956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-7c883fd1-0921-40ed-bfeb-95765d87288a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:05:08.018791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:08.122534 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7c883fd1-0921-40ed-bfeb-95765d87288a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.510689 Oct 12 22:05:08.128687 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 839/1592] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:05:07 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:08.134602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2236bdf3-8e29-43f6-94d7-ed98814e552c tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:08.135393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2236bdf3-8e29-43f6-94d7-ed98814e552c tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:08.144095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2236bdf3-8e29-43f6-94d7-ed98814e552c tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:08.144594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2236bdf3-8e29-43f6-94d7-ed98814e552c tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:08.145036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2236bdf3-8e29-43f6-94d7-ed98814e552c tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:08.145751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2236bdf3-8e29-43f6-94d7-ed98814e552c tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:08.146204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2236bdf3-8e29-43f6-94d7-ed98814e552c tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:08.146765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2236bdf3-8e29-43f6-94d7-ed98814e552c tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:08.435815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f7289c6a-fb9f-4a29-87b8-5e2b2c4f5345 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:08.450817 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f7289c6a-fb9f-4a29-87b8-5e2b2c4f5345 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1379 microversion: 2.1 time: 0.903719 Oct 12 22:05:08.452483 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 754/1593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:07 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1379 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:08.609170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-2236bdf3-8e29-43f6-94d7-ed98814e552c tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] Lazy-loading 'services' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:05:08.655754 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2236bdf3-8e29-43f6-94d7-ed98814e552c tempest-ServersAdmin275Test-393749910 tempest-ServersAdmin275Test-393749910-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1920 microversion: 2.75 time: 0.525774 Oct 12 22:05:08.656571 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 840/1594] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:08 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1920 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:08.667080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e4373268-06a2-4ad4-b95e-4e63be5ea748 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:08.679539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e4373268-06a2-4ad4-b95e-4e63be5ea748 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:08.680129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.compute.servers [None req-e4373268-06a2-4ad4-b95e-4e63be5ea748 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Removing options 'limit' from query {{(pid=120453) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 12 22:05:08.684302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e4373268-06a2-4ad4-b95e-4e63be5ea748 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:08.721168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4373268-06a2-4ad4-b95e-4e63be5ea748 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:08.724950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4373268-06a2-4ad4-b95e-4e63be5ea748 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:08.732008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4373268-06a2-4ad4-b95e-4e63be5ea748 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:08.732838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4373268-06a2-4ad4-b95e-4e63be5ea748 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:08.735645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4373268-06a2-4ad4-b95e-4e63be5ea748 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:08.736125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4373268-06a2-4ad4-b95e-4e63be5ea748 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:08.835701 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e4373268-06a2-4ad4-b95e-4e63be5ea748 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.177288 Oct 12 22:05:08.845070 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 841/1595] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 12 22:05:08 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:08.850503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7a2a03ec-181b-475d-aa7d-599a73b4d64f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:08.852886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7a2a03ec-181b-475d-aa7d-599a73b4d64f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:08.871040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a2a03ec-181b-475d-aa7d-599a73b4d64f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:08.871558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a2a03ec-181b-475d-aa7d-599a73b4d64f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:08.871993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a2a03ec-181b-475d-aa7d-599a73b4d64f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:08.873459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a2a03ec-181b-475d-aa7d-599a73b4d64f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:08.874949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a2a03ec-181b-475d-aa7d-599a73b4d64f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:08.875416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a2a03ec-181b-475d-aa7d-599a73b4d64f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:08.909667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f897f0b3-8da6-48d5-a22d-82a2cb9bd034 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:08.912162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f897f0b3-8da6-48d5-a22d-82a2cb9bd034 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:08.929870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f897f0b3-8da6-48d5-a22d-82a2cb9bd034 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:08.930779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f897f0b3-8da6-48d5-a22d-82a2cb9bd034 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:08.931476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f897f0b3-8da6-48d5-a22d-82a2cb9bd034 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:08.932455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f897f0b3-8da6-48d5-a22d-82a2cb9bd034 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:08.933154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f897f0b3-8da6-48d5-a22d-82a2cb9bd034 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:08.933829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f897f0b3-8da6-48d5-a22d-82a2cb9bd034 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:08.974196 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f897f0b3-8da6-48d5-a22d-82a2cb9bd034 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.520474 Oct 12 22:05:08.975380 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 755/1596] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:05:08 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments => generated 197 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:08.980369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ac533555-5481-4b9f-bad5-ac0d799d2d43 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512c576c10>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:09.031538 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ac533555-5481-4b9f-bad5-ac0d799d2d43 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be" status: 200 len: 1410 microversion: 2.1 time: 0.054849 Oct 12 22:05:09.042468 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 756/1597] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:05:08 2022] GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be => generated 1410 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:09.047436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7e6d7db8-381e-49cc-9303-ab945388f66e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:09.047938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7e6d7db8-381e-49cc-9303-ab945388f66e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:09.055101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e6d7db8-381e-49cc-9303-ab945388f66e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:09.055706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e6d7db8-381e-49cc-9303-ab945388f66e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:09.056151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e6d7db8-381e-49cc-9303-ab945388f66e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:09.056859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e6d7db8-381e-49cc-9303-ab945388f66e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:09.057333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e6d7db8-381e-49cc-9303-ab945388f66e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:09.058906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e6d7db8-381e-49cc-9303-ab945388f66e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:09.090345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7e6d7db8-381e-49cc-9303-ab945388f66e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:05:09.211483 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7e6d7db8-381e-49cc-9303-ab945388f66e tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 204 len: 0 microversion: 2.75 time: 0.167498 Oct 12 22:05:09.212261 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 757/1598] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:05:09 2022] DELETE /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:05:09.218207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-71c23b3f-e48e-413f-b0f5-a1e26bb117d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:09.235669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-71c23b3f-e48e-413f-b0f5-a1e26bb117d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:09.236653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-71c23b3f-e48e-413f-b0f5-a1e26bb117d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1464234974', 'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:09.244175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c23b3f-e48e-413f-b0f5-a1e26bb117d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:09.250750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c23b3f-e48e-413f-b0f5-a1e26bb117d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:09.251399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c23b3f-e48e-413f-b0f5-a1e26bb117d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:09.252332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c23b3f-e48e-413f-b0f5-a1e26bb117d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:09.253074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c23b3f-e48e-413f-b0f5-a1e26bb117d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:09.253613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c23b3f-e48e-413f-b0f5-a1e26bb117d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:09.334328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7a2a03ec-181b-475d-aa7d-599a73b4d64f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:09.362569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7a2a03ec-181b-475d-aa7d-599a73b4d64f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:09.393956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7a2a03ec-181b-475d-aa7d-599a73b4d64f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:09.395223 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7a2a03ec-181b-475d-aa7d-599a73b4d64f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 0.554780 Oct 12 22:05:09.402703 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 842/1599] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:08 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:09.420144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-42a590e5-19a4-4adc-b9ad-2b833c3d36bd tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:09.428089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-42a590e5-19a4-4adc-b9ad-2b833c3d36bd tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:09.445589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42a590e5-19a4-4adc-b9ad-2b833c3d36bd tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:09.446391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42a590e5-19a4-4adc-b9ad-2b833c3d36bd tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:09.446831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42a590e5-19a4-4adc-b9ad-2b833c3d36bd tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:09.447627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42a590e5-19a4-4adc-b9ad-2b833c3d36bd tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:09.448084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42a590e5-19a4-4adc-b9ad-2b833c3d36bd tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:09.448513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42a590e5-19a4-4adc-b9ad-2b833c3d36bd tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:09.458037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.multi_cell_list [None req-71c23b3f-e48e-413f-b0f5-a1e26bb117d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:05:09.566890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-42a590e5-19a4-4adc-b9ad-2b833c3d36bd tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:09.578194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-42a590e5-19a4-4adc-b9ad-2b833c3d36bd tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:09.580507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-42a590e5-19a4-4adc-b9ad-2b833c3d36bd tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:09.586186 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-71c23b3f-e48e-413f-b0f5-a1e26bb117d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1464234974" status: 200 len: 346 microversion: 2.1 time: 0.372445 Oct 12 22:05:09.588083 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-42a590e5-19a4-4adc-b9ad-2b833c3d36bd tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1444 microversion: 2.75 time: 0.175324 Oct 12 22:05:09.588959 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 843/1600] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:09 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1444 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:09.592299 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 758/1601] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 12 22:05:09 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1464234974 => generated 346 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:09.594642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a77b8f45-2d9d-4e54-9295-8fe318b40e5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:09.595463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a77b8f45-2d9d-4e54-9295-8fe318b40e5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:09.603916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a77b8f45-2d9d-4e54-9295-8fe318b40e5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:09.604805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a77b8f45-2d9d-4e54-9295-8fe318b40e5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:09.605408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a77b8f45-2d9d-4e54-9295-8fe318b40e5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:09.606306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a77b8f45-2d9d-4e54-9295-8fe318b40e5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:09.607160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a77b8f45-2d9d-4e54-9295-8fe318b40e5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:09.615968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a77b8f45-2d9d-4e54-9295-8fe318b40e5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:09.720571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ebeb3ea1-4929-4648-ad9a-067a1ee45ffd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Action: 'create', calling method: .version_select at 0x7f512c5765e0>, body: {"keypair": {"name": "tempest-keypair-1774593784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDs7wasbBMhZKQGAYWs/Th4YbfAyUJ1fOPdHhozN9ANKj+CuxP11fOUxOEzT9dxqeRrfvaZI+Bqe8Mx4YB4LOePa12HGReZ/OTr5m1Tmrl9j7DDbQSZj+u78kE+LzHZ3Bg=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:09.752412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-ebeb3ea1-4929-4648-ad9a-067a1ee45ffd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Getting quotas for project 68913d260d084ce4a8e29daf4783c0bc. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:05:09.783405 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-ebeb3ea1-4929-4648-ad9a-067a1ee45ffd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Getting quotas for user 13c74a78e82f4e72a7d1f7b133074f5a and project 68913d260d084ce4a8e29daf4783c0bc. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:05:09.838146 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ebeb3ea1-4929-4648-ad9a-067a1ee45ffd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.244565 Oct 12 22:05:09.839035 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 759/1602] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:05:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:09.845338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6ec2307b-264c-4a2a-b410-f7dc06aacd97 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:09.865361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ec2307b-264c-4a2a-b410-f7dc06aacd97 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:09.865954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ec2307b-264c-4a2a-b410-f7dc06aacd97 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:09.867110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ec2307b-264c-4a2a-b410-f7dc06aacd97 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:10.030283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a77b8f45-2d9d-4e54-9295-8fe318b40e5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:10.037143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6ec2307b-264c-4a2a-b410-f7dc06aacd97 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Going to try to stop instance {{(pid=120452) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 22:05:10.039880 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a77b8f45-2d9d-4e54-9295-8fe318b40e5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1379 microversion: 2.1 time: 0.449724 Oct 12 22:05:10.043066 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 844/1603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:09 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1379 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:10.077671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c671c79c-a299-42a7-a688-996a469bc17a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:10.080382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c671c79c-a299-42a7-a688-996a469bc17a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:10.108588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c671c79c-a299-42a7-a688-996a469bc17a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:10.109444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c671c79c-a299-42a7-a688-996a469bc17a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:10.112043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c671c79c-a299-42a7-a688-996a469bc17a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:10.113074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c671c79c-a299-42a7-a688-996a469bc17a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:10.115224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c671c79c-a299-42a7-a688-996a469bc17a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:10.126508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c671c79c-a299-42a7-a688-996a469bc17a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:10.146246 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6ec2307b-264c-4a2a-b410-f7dc06aacd97 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "POST /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6/action" status: 202 len: 0 microversion: 2.1 time: 0.302089 Oct 12 22:05:10.146920 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 760/1604] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:05:09 2022] POST /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:05:10.171418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a8bfd74-bb2b-42b3-a0a4-23391137f4e1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512834ee50>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:10.228197 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c671c79c-a299-42a7-a688-996a469bc17a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181005 Oct 12 22:05:10.234452 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 845/1605] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:05:10 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:10.244224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cfd1298c-9e48-4701-830e-2e3cc2e61307 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:10.246358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cfd1298c-9e48-4701-830e-2e3cc2e61307 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:10.247198 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7a8bfd74-bb2b-42b3-a0a4-23391137f4e1 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be" status: 200 len: 1410 microversion: 2.1 time: 0.095814 Oct 12 22:05:10.251016 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 761/1606] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:05:10 2022] GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be => generated 1410 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:10.267037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfd1298c-9e48-4701-830e-2e3cc2e61307 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:10.267915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfd1298c-9e48-4701-830e-2e3cc2e61307 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:10.268480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfd1298c-9e48-4701-830e-2e3cc2e61307 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:10.269309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfd1298c-9e48-4701-830e-2e3cc2e61307 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:10.269882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfd1298c-9e48-4701-830e-2e3cc2e61307 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:10.270421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfd1298c-9e48-4701-830e-2e3cc2e61307 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:10.427960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-53cdfaff-8de0-41de-84c6-a3191936121e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:10.428762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-53cdfaff-8de0-41de-84c6-a3191936121e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:10.444613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53cdfaff-8de0-41de-84c6-a3191936121e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:10.445299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53cdfaff-8de0-41de-84c6-a3191936121e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:10.445905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53cdfaff-8de0-41de-84c6-a3191936121e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:10.446809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53cdfaff-8de0-41de-84c6-a3191936121e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:10.448904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53cdfaff-8de0-41de-84c6-a3191936121e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:10.449516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53cdfaff-8de0-41de-84c6-a3191936121e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:10.573546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cfd1298c-9e48-4701-830e-2e3cc2e61307 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:10.591026 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cfd1298c-9e48-4701-830e-2e3cc2e61307 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1521 microversion: 2.1 time: 0.345643 Oct 12 22:05:10.598115 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 846/1607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:10 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:10.621033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-389a1d47-3d2d-44d5-8472-382121b4d3a6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:10.622275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-389a1d47-3d2d-44d5-8472-382121b4d3a6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:10.629783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-389a1d47-3d2d-44d5-8472-382121b4d3a6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:10.630572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-389a1d47-3d2d-44d5-8472-382121b4d3a6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:10.631586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-389a1d47-3d2d-44d5-8472-382121b4d3a6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:10.632602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-389a1d47-3d2d-44d5-8472-382121b4d3a6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:10.633272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-389a1d47-3d2d-44d5-8472-382121b4d3a6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:10.633865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-389a1d47-3d2d-44d5-8472-382121b4d3a6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:10.743645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-389a1d47-3d2d-44d5-8472-382121b4d3a6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:10.752165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-389a1d47-3d2d-44d5-8472-382121b4d3a6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:10.754726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-389a1d47-3d2d-44d5-8472-382121b4d3a6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:10.760221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:10.761977 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-389a1d47-3d2d-44d5-8472-382121b4d3a6 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1444 microversion: 2.75 time: 0.145530 Oct 12 22:05:10.776751 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 847/1608] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:10 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:10.921730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-53cdfaff-8de0-41de-84c6-a3191936121e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:10.943511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-53cdfaff-8de0-41de-84c6-a3191936121e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:10.949794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-53cdfaff-8de0-41de-84c6-a3191936121e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:10.952097 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-53cdfaff-8de0-41de-84c6-a3191936121e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 0.529043 Oct 12 22:05:10.954789 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 762/1609] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:10 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:05:11.067887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a1c069f8-ac7b-4395-8a59-ee3061150415 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:11.069519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a1c069f8-ac7b-4395-8a59-ee3061150415 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:11.080135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1c069f8-ac7b-4395-8a59-ee3061150415 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:11.081836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1c069f8-ac7b-4395-8a59-ee3061150415 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:11.083202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1c069f8-ac7b-4395-8a59-ee3061150415 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:11.084929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1c069f8-ac7b-4395-8a59-ee3061150415 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:11.087555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1c069f8-ac7b-4395-8a59-ee3061150415 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:11.088588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1c069f8-ac7b-4395-8a59-ee3061150415 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:11.176097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-78423335-85c9-46b5-8571-1203927aeb2a req-20bc4309-82e1-423c-8c0c-fc13c9c967d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "247e0252-3374-40b8-85f3-995d2031867d", "name": "network-vif-unplugged", "status": "completed", "tag": "319c47c2-57cf-461d-8a9e-adf8c461cb1d"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:11.202638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-78423335-85c9-46b5-8571-1203927aeb2a req-20bc4309-82e1-423c-8c0c-fc13c9c967d2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:11.203377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-78423335-85c9-46b5-8571-1203927aeb2a req-20bc4309-82e1-423c-8c0c-fc13c9c967d2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:11.204231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-78423335-85c9-46b5-8571-1203927aeb2a req-20bc4309-82e1-423c-8c0c-fc13c9c967d2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:11.245446 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-78423335-85c9-46b5-8571-1203927aeb2a req-20bc4309-82e1-423c-8c0c-fc13c9c967d2 service nova] Creating event network-vif-unplugged:319c47c2-57cf-461d-8a9e-adf8c461cb1d for instance 247e0252-3374-40b8-85f3-995d2031867d on n-h1-861111-1 Oct 12 22:05:11.256949 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-78423335-85c9-46b5-8571-1203927aeb2a req-20bc4309-82e1-423c-8c0c-fc13c9c967d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087346 Oct 12 22:05:11.262157 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 763/1610] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:05:11.274727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ca43c295-f111-4afe-9385-a0cb17107b54 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:11.279065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ca43c295-f111-4afe-9385-a0cb17107b54 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:11.293358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca43c295-f111-4afe-9385-a0cb17107b54 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:11.295797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca43c295-f111-4afe-9385-a0cb17107b54 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:11.298016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca43c295-f111-4afe-9385-a0cb17107b54 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:11.299219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca43c295-f111-4afe-9385-a0cb17107b54 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:11.299851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca43c295-f111-4afe-9385-a0cb17107b54 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:11.301536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca43c295-f111-4afe-9385-a0cb17107b54 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:11.363146 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ca43c295-f111-4afe-9385-a0cb17107b54 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099734 Oct 12 22:05:11.368962 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 764/1611] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:05:11 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:11.375161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7adea720-6a0d-4496-8930-8db797616643 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51283715e0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:11.469770 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7adea720-6a0d-4496-8930-8db797616643 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be" status: 200 len: 1410 microversion: 2.1 time: 0.099339 Oct 12 22:05:11.470872 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 765/1612] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:05:11 2022] GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be => generated 1410 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:11.611281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8ae6a559-bfd2-4a11-a1ea-0f145918aaeb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:11.612240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8ae6a559-bfd2-4a11-a1ea-0f145918aaeb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:11.626968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ae6a559-bfd2-4a11-a1ea-0f145918aaeb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:11.630671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ae6a559-bfd2-4a11-a1ea-0f145918aaeb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:11.633391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ae6a559-bfd2-4a11-a1ea-0f145918aaeb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:11.635832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ae6a559-bfd2-4a11-a1ea-0f145918aaeb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:11.638164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ae6a559-bfd2-4a11-a1ea-0f145918aaeb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:11.641724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ae6a559-bfd2-4a11-a1ea-0f145918aaeb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:11.689948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a1c069f8-ac7b-4395-8a59-ee3061150415 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:11.722831 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a1c069f8-ac7b-4395-8a59-ee3061150415 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1529 microversion: 2.1 time: 0.659513 Oct 12 22:05:11.726156 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 848/1613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:11 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1529 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:11.775597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-555a24c4-bb49-4b8e-92d1-7ed544e3574a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:11.776377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-555a24c4-bb49-4b8e-92d1-7ed544e3574a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:11.797090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-555a24c4-bb49-4b8e-92d1-7ed544e3574a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:11.797636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-555a24c4-bb49-4b8e-92d1-7ed544e3574a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:11.798121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-555a24c4-bb49-4b8e-92d1-7ed544e3574a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:11.798846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-555a24c4-bb49-4b8e-92d1-7ed544e3574a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:11.799334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-555a24c4-bb49-4b8e-92d1-7ed544e3574a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:11.799769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-555a24c4-bb49-4b8e-92d1-7ed544e3574a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:12.046673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8ae6a559-bfd2-4a11-a1ea-0f145918aaeb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:12.076853 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8ae6a559-bfd2-4a11-a1ea-0f145918aaeb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1521 microversion: 2.1 time: 0.474195 Oct 12 22:05:12.077890 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 766/1614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:11 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:12.098242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b09111d3-64da-4430-be4c-93095b099910 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:12.100824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b09111d3-64da-4430-be4c-93095b099910 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:12.122630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b09111d3-64da-4430-be4c-93095b099910 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:12.123141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b09111d3-64da-4430-be4c-93095b099910 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:12.123609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b09111d3-64da-4430-be4c-93095b099910 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:12.129904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b09111d3-64da-4430-be4c-93095b099910 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:12.139926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b09111d3-64da-4430-be4c-93095b099910 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:12.140687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b09111d3-64da-4430-be4c-93095b099910 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:12.296248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b09111d3-64da-4430-be4c-93095b099910 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:12.312688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b09111d3-64da-4430-be4c-93095b099910 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:12.314168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b09111d3-64da-4430-be4c-93095b099910 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:12.317696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:12.333173 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b09111d3-64da-4430-be4c-93095b099910 tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1444 microversion: 2.75 time: 0.251396 Oct 12 22:05:12.334196 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 767/1615] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:12 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1444 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:12.351720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-da2b4eaa-f682-433d-8a77-aa7b6763a1a6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:12.356731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-da2b4eaa-f682-433d-8a77-aa7b6763a1a6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:12.372812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da2b4eaa-f682-433d-8a77-aa7b6763a1a6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:12.373317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da2b4eaa-f682-433d-8a77-aa7b6763a1a6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:12.373755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da2b4eaa-f682-433d-8a77-aa7b6763a1a6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:12.381176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da2b4eaa-f682-433d-8a77-aa7b6763a1a6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:12.382449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da2b4eaa-f682-433d-8a77-aa7b6763a1a6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:12.398381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da2b4eaa-f682-433d-8a77-aa7b6763a1a6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:12.675737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-555a24c4-bb49-4b8e-92d1-7ed544e3574a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:12.687720 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-555a24c4-bb49-4b8e-92d1-7ed544e3574a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1529 microversion: 2.1 time: 0.942239 Oct 12 22:05:12.691792 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 849/1616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:11 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1529 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:12.705289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-05ea5649-f72e-432c-82ad-fdf381cc8178 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:12.720189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-05ea5649-f72e-432c-82ad-fdf381cc8178 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:12.735777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05ea5649-f72e-432c-82ad-fdf381cc8178 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:12.740715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05ea5649-f72e-432c-82ad-fdf381cc8178 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:12.741467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05ea5649-f72e-432c-82ad-fdf381cc8178 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:12.742411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05ea5649-f72e-432c-82ad-fdf381cc8178 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:12.743034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05ea5649-f72e-432c-82ad-fdf381cc8178 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:12.745370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05ea5649-f72e-432c-82ad-fdf381cc8178 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:12.792112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-da2b4eaa-f682-433d-8a77-aa7b6763a1a6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:12.802229 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-05ea5649-f72e-432c-82ad-fdf381cc8178 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106689 Oct 12 22:05:12.803720 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 850/1617] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:05:12 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:12.808855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-32d66185-5d10-428b-bb99-ff76b1d590ff tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51286d7040>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:12.810605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-da2b4eaa-f682-433d-8a77-aa7b6763a1a6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:12.812182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-da2b4eaa-f682-433d-8a77-aa7b6763a1a6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:12.813860 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-da2b4eaa-f682-433d-8a77-aa7b6763a1a6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 0.473723 Oct 12 22:05:12.814822 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 768/1618] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:12 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:12.834119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-61e3dcb4-3d6a-4c2f-8415-117f418b0094 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:12.868816 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-61e3dcb4-3d6a-4c2f-8415-117f418b0094 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/5ae2613b-be75-44b9-b3e6-c50dcadc181a" status: 202 len: 0 microversion: 2.1 time: 0.052601 Oct 12 22:05:12.873812 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 769/1619] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:05:12 2022] DELETE /compute/v2.1/flavors/5ae2613b-be75-44b9-b3e6-c50dcadc181a => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:05:12.875815 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-32d66185-5d10-428b-bb99-ff76b1d590ff tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be" status: 200 len: 1410 microversion: 2.1 time: 0.070810 Oct 12 22:05:12.885130 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 851/1620] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:05:12 2022] GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be => generated 1410 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:12.899132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-608833b7-6f9f-4d2e-961c-b70797eef24b tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:12.935784 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-608833b7-6f9f-4d2e-961c-b70797eef24b tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060148 Oct 12 22:05:12.942041 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 770/1621] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:05:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:12.960894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-439990f2-5786-4bcc-aff0-ac0bc6370e04 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:12.963043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-439990f2-5786-4bcc-aff0-ac0bc6370e04 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:12.971997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-439990f2-5786-4bcc-aff0-ac0bc6370e04 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:12.973438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-439990f2-5786-4bcc-aff0-ac0bc6370e04 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:12.974051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-439990f2-5786-4bcc-aff0-ac0bc6370e04 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:12.974952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-439990f2-5786-4bcc-aff0-ac0bc6370e04 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:12.975656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-439990f2-5786-4bcc-aff0-ac0bc6370e04 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:12.976276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-439990f2-5786-4bcc-aff0-ac0bc6370e04 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:13.006475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-439990f2-5786-4bcc-aff0-ac0bc6370e04 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:13.014448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-439990f2-5786-4bcc-aff0-ac0bc6370e04 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Old instance type tempest-test_resize_flavor_-2027049620, new instance type m1.heat {{(pid=120453) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:05:13.021986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-439990f2-5786-4bcc-aff0-ac0bc6370e04 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:05:13.022446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-439990f2-5786-4bcc-aff0-ac0bc6370e04 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:05:13.022926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-439990f2-5786-4bcc-aff0-ac0bc6370e04 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:05:13.023374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-439990f2-5786-4bcc-aff0-ac0bc6370e04 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:05:13.023850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-439990f2-5786-4bcc-aff0-ac0bc6370e04 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:05:13.101385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-455e2b40-a73f-41fe-a4d7-88d039e707d8 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:13.102399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-455e2b40-a73f-41fe-a4d7-88d039e707d8 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:13.112686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-455e2b40-a73f-41fe-a4d7-88d039e707d8 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:13.121820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-455e2b40-a73f-41fe-a4d7-88d039e707d8 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:13.122390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-455e2b40-a73f-41fe-a4d7-88d039e707d8 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:13.123280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-455e2b40-a73f-41fe-a4d7-88d039e707d8 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:13.123863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-455e2b40-a73f-41fe-a4d7-88d039e707d8 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:13.124402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-455e2b40-a73f-41fe-a4d7-88d039e707d8 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:13.202263 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-439990f2-5786-4bcc-aff0-ac0bc6370e04 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "POST /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3/action" status: 202 len: 0 microversion: 2.1 time: 0.245659 Oct 12 22:05:13.202884 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 852/1622] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:05:12 2022] POST /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:05:13.207727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:13.215681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4bc40911-f5e0-46ac-82c7-11405e49ef65 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:13.216313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4bc40911-f5e0-46ac-82c7-11405e49ef65 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:13.256971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bc40911-f5e0-46ac-82c7-11405e49ef65 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:13.257473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bc40911-f5e0-46ac-82c7-11405e49ef65 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:13.261624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bc40911-f5e0-46ac-82c7-11405e49ef65 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:13.262559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bc40911-f5e0-46ac-82c7-11405e49ef65 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:13.265194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bc40911-f5e0-46ac-82c7-11405e49ef65 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:13.265650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bc40911-f5e0-46ac-82c7-11405e49ef65 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:13.562479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-455e2b40-a73f-41fe-a4d7-88d039e707d8 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:13.588626 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-455e2b40-a73f-41fe-a4d7-88d039e707d8 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1521 microversion: 2.1 time: 0.491954 Oct 12 22:05:13.597870 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 771/1623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:13 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1521 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:13.610516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-1046e617-2ad3-4675-a59c-9355aba58799 req-c4c3336c-8d55-4388-a61a-8cdba7fa1d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "247e0252-3374-40b8-85f3-995d2031867d", "tag": "319c47c2-57cf-461d-8a9e-adf8c461cb1d"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:13.656829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1046e617-2ad3-4675-a59c-9355aba58799 req-c4c3336c-8d55-4388-a61a-8cdba7fa1d63 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:13.659875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1046e617-2ad3-4675-a59c-9355aba58799 req-c4c3336c-8d55-4388-a61a-8cdba7fa1d63 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:13.664456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1046e617-2ad3-4675-a59c-9355aba58799 req-c4c3336c-8d55-4388-a61a-8cdba7fa1d63 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:13.712550 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-1046e617-2ad3-4675-a59c-9355aba58799 req-c4c3336c-8d55-4388-a61a-8cdba7fa1d63 service nova] Creating event network-changed:319c47c2-57cf-461d-8a9e-adf8c461cb1d for instance 247e0252-3374-40b8-85f3-995d2031867d on n-h1-861111-1 Oct 12 22:05:13.739309 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-1046e617-2ad3-4675-a59c-9355aba58799 req-c4c3336c-8d55-4388-a61a-8cdba7fa1d63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139003 Oct 12 22:05:13.744947 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 772/1624] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:13.756704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4bc40911-f5e0-46ac-82c7-11405e49ef65 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:13.765946 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4bc40911-f5e0-46ac-82c7-11405e49ef65 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1538 microversion: 2.1 time: 0.554067 Oct 12 22:05:13.769387 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 853/1625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:13 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1538 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:13.780413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f82c4f56-3377-45cf-b155-4da088e7e0fc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:13.781556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f82c4f56-3377-45cf-b155-4da088e7e0fc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:13.811491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f82c4f56-3377-45cf-b155-4da088e7e0fc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:13.815873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1ffd1773-8606-45f0-a46e-4f8a6b818e2d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:13.818315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1ffd1773-8606-45f0-a46e-4f8a6b818e2d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:13.827116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f82c4f56-3377-45cf-b155-4da088e7e0fc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:13.827997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f82c4f56-3377-45cf-b155-4da088e7e0fc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:13.829697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f82c4f56-3377-45cf-b155-4da088e7e0fc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:13.833006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ffd1773-8606-45f0-a46e-4f8a6b818e2d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:13.833829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f82c4f56-3377-45cf-b155-4da088e7e0fc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:13.834181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f82c4f56-3377-45cf-b155-4da088e7e0fc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:13.840553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ffd1773-8606-45f0-a46e-4f8a6b818e2d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:13.841324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ffd1773-8606-45f0-a46e-4f8a6b818e2d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:13.842316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ffd1773-8606-45f0-a46e-4f8a6b818e2d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:13.843000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ffd1773-8606-45f0-a46e-4f8a6b818e2d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:13.843684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ffd1773-8606-45f0-a46e-4f8a6b818e2d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:13.914475 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1ffd1773-8606-45f0-a46e-4f8a6b818e2d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102874 Oct 12 22:05:13.915547 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 854/1626] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:05:13 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:05:13.935337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7abca8cb-d7ac-4221-b4d1-ad8ca2a39579 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:13.936504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7abca8cb-d7ac-4221-b4d1-ad8ca2a39579 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:13.952939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7abca8cb-d7ac-4221-b4d1-ad8ca2a39579 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:13.955844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7abca8cb-d7ac-4221-b4d1-ad8ca2a39579 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:13.956767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7abca8cb-d7ac-4221-b4d1-ad8ca2a39579 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:13.957750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7abca8cb-d7ac-4221-b4d1-ad8ca2a39579 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:13.960623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7abca8cb-d7ac-4221-b4d1-ad8ca2a39579 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:13.963430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7abca8cb-d7ac-4221-b4d1-ad8ca2a39579 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:13.973290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f82c4f56-3377-45cf-b155-4da088e7e0fc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:13.974755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f82c4f56-3377-45cf-b155-4da088e7e0fc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:13.975522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f82c4f56-3377-45cf-b155-4da088e7e0fc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:13.976791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-f82c4f56-3377-45cf-b155-4da088e7e0fc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lazy-loading 'fault' on Instance uuid eca9aa95-2d08-4109-be79-3c62ccec155b {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:05:14.205070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f82c4f56-3377-45cf-b155-4da088e7e0fc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:14.217198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f82c4f56-3377-45cf-b155-4da088e7e0fc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:14.221899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f82c4f56-3377-45cf-b155-4da088e7e0fc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c07d95f55d4146bef62c66263df813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba376928ba479ea6877d929da0010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:14.230034 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f82c4f56-3377-45cf-b155-4da088e7e0fc tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 200 len: 1449 microversion: 2.75 time: 0.482298 Oct 12 22:05:14.231456 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 773/1627] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:13 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 1449 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:14.237215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-009e8fd7-773c-42ef-b9d3-719cbdfdc5d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512c364af0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:14.369779 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-009e8fd7-773c-42ef-b9d3-719cbdfdc5d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be" status: 200 len: 1410 microversion: 2.1 time: 0.135810 Oct 12 22:05:14.370665 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 774/1628] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:05:14 2022] GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be => generated 1410 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:14.623270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6bee572d-e1c8-4b32-9397-da1baae2a054 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:14.624449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6bee572d-e1c8-4b32-9397-da1baae2a054 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:14.646016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bee572d-e1c8-4b32-9397-da1baae2a054 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:14.646838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bee572d-e1c8-4b32-9397-da1baae2a054 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:14.648654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:14.650746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bee572d-e1c8-4b32-9397-da1baae2a054 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:14.651921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bee572d-e1c8-4b32-9397-da1baae2a054 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:14.653295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bee572d-e1c8-4b32-9397-da1baae2a054 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:14.656089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bee572d-e1c8-4b32-9397-da1baae2a054 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:15.027955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7abca8cb-d7ac-4221-b4d1-ad8ca2a39579 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:15.031788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:15.046699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7abca8cb-d7ac-4221-b4d1-ad8ca2a39579 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:15.054408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7abca8cb-d7ac-4221-b4d1-ad8ca2a39579 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:15.064161 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7abca8cb-d7ac-4221-b4d1-ad8ca2a39579 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 1.146211 Oct 12 22:05:15.064928 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 855/1629] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:13 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:15.069866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-58aeaa18-9884-46ee-9af4-16a8e89702eb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:15.084024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-58aeaa18-9884-46ee-9af4-16a8e89702eb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:15.113136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58aeaa18-9884-46ee-9af4-16a8e89702eb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:15.113980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58aeaa18-9884-46ee-9af4-16a8e89702eb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:15.114553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58aeaa18-9884-46ee-9af4-16a8e89702eb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:15.115418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58aeaa18-9884-46ee-9af4-16a8e89702eb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:15.116034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58aeaa18-9884-46ee-9af4-16a8e89702eb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:15.117053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58aeaa18-9884-46ee-9af4-16a8e89702eb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:15.294067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6bee572d-e1c8-4b32-9397-da1baae2a054 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:15.320237 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6bee572d-e1c8-4b32-9397-da1baae2a054 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1521 microversion: 2.1 time: 0.699864 Oct 12 22:05:15.354385 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 775/1630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:14 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1521 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:15.382022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f1693433-3083-401a-9657-cff2213b26e0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:15.389344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f1693433-3083-401a-9657-cff2213b26e0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:15.421916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1693433-3083-401a-9657-cff2213b26e0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:15.423430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1693433-3083-401a-9657-cff2213b26e0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:15.425615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1693433-3083-401a-9657-cff2213b26e0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:15.428739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1693433-3083-401a-9657-cff2213b26e0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:15.431684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1693433-3083-401a-9657-cff2213b26e0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:15.433710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1693433-3083-401a-9657-cff2213b26e0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:15.520694 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f1693433-3083-401a-9657-cff2213b26e0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164863 Oct 12 22:05:15.535845 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 776/1631] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:05:15 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:15.551060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6753190e-3fec-49be-9e0f-062ef7e5c95b tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:15.551828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6753190e-3fec-49be-9e0f-062ef7e5c95b tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] [instance: eca9aa95-2d08-4109-be79-3c62ccec155b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:15.575877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-58aeaa18-9884-46ee-9af4-16a8e89702eb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:15.579931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6753190e-3fec-49be-9e0f-062ef7e5c95b tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:15.580113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6753190e-3fec-49be-9e0f-062ef7e5c95b tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:15.585946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6753190e-3fec-49be-9e0f-062ef7e5c95b tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:15.586710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6753190e-3fec-49be-9e0f-062ef7e5c95b tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:15.587196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6753190e-3fec-49be-9e0f-062ef7e5c95b tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:15.587669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6753190e-3fec-49be-9e0f-062ef7e5c95b tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:15.589178 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-58aeaa18-9884-46ee-9af4-16a8e89702eb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1538 microversion: 2.1 time: 0.522938 Oct 12 22:05:15.589899 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 856/1632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:15 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1538 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:15.604311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6cdc20e3-391d-492b-a1de-0f5bdc8c3b3b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51286d84c0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:15.676979 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-6753190e-3fec-49be-9e0f-062ef7e5c95b tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] HTTP exception thrown: Instance eca9aa95-2d08-4109-be79-3c62ccec155b could not be found. Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6753190e-3fec-49be-9e0f-062ef7e5c95b tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Request method failure captured: Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b HTTP/1.1 Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzm78SnrIB1Rs_L3lEkgnaVbXT0PDTSK1dByPCf40tQXHhTZlQNVsC1uRPYzYW9KovlnvBZYC4fNDAPRC13AkhKfko_a7XvhArWjC3GM8kz692r-g7FhA0jdgy2dyeKo_moxwbymNHTqSIFNAzmYl8XEW8IX-7SYyly1KVuCeO1p2zY Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: X-Openstack-Nova-Api-Version: 2.75 Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: e3ba376928ba479ea6877d929da0010f Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersAdmin275Test-1581668142 Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:05:15.684363 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:05:15.685979 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e3ba376928ba479ea6877d929da0010f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e3ba376928ba479ea6877d929da0010f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e3ba376928ba479ea6877d929da0010f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e3ba376928ba479ea6877d929da0010f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:05:15.685979 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersAdmin275Test-1581668142 Oct 12 22:05:15.685979 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: e3ba376928ba479ea6877d929da0010f Oct 12 22:05:15.685979 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersAdmin275Test-1581668142 Oct 12 22:05:15.685979 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersAdmin275Test-1581668142-project Oct 12 22:05:15.685979 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:05:15.685979 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:05:15.685979 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: f3c07d95f55d4146bef62c66263df813 Oct 12 22:05:15.685979 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersAdmin275Test-1581668142-project Oct 12 22:05:15.685979 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:05:15.685979 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance eca9aa95-2d08-4109-be79-3c62ccec155b could not be found. Oct 12 22:05:15.685979 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'eca9aa95-2d08-4109-be79-3c62ccec155b'} Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca9aa95-2d08-4109-be79-3c62ccec155b could not be found. Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:05:15.686936 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca9aa95-2d08-4109-be79-3c62ccec155b could not be found. Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca9aa95-2d08-4109-be79-3c62ccec155b could not be found. Oct 12 22:05:15.689643 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:05:15.691307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6753190e-3fec-49be-9e0f-062ef7e5c95b tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] Returning 404 to user: Instance eca9aa95-2d08-4109-be79-3c62ccec155b could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:05:15.691307 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6753190e-3fec-49be-9e0f-062ef7e5c95b tempest-ServersAdmin275Test-1581668142 tempest-ServersAdmin275Test-1581668142-project] 10.222.0.16 "GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b" status: 404 len: 111 microversion: 2.75 time: 0.146549 Oct 12 22:05:15.691307 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 777/1633] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:15 2022] GET /compute/v2.1/servers/eca9aa95-2d08-4109-be79-3c62ccec155b => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:05:15.710433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1806814529", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce6dd748-e52a-46d1-938f-29e5070fa849"}], "security_groups": [{"name": "tempest-securitygroup--1056991942"}], "key_name": "tempest-keypair-1774593784", "user_data": "}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:15.735632 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6cdc20e3-391d-492b-a1de-0f5bdc8c3b3b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be" status: 200 len: 1410 microversion: 2.1 time: 0.144511 Oct 12 22:05:15.737321 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 857/1634] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:05:15 2022] GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be => generated 1410 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:16.001195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] validate_networks() for [('ce6dd748-e52a-46d1-938f-29e5070fa849', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:05:16.093725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c6f45392-cec7-408c-a7aa-e12a995feb5a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:16.097975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c6f45392-cec7-408c-a7aa-e12a995feb5a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:16.121004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6f45392-cec7-408c-a7aa-e12a995feb5a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:16.121716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6f45392-cec7-408c-a7aa-e12a995feb5a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:16.122363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6f45392-cec7-408c-a7aa-e12a995feb5a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:16.123283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6f45392-cec7-408c-a7aa-e12a995feb5a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:16.123900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6f45392-cec7-408c-a7aa-e12a995feb5a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:16.124488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6f45392-cec7-408c-a7aa-e12a995feb5a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:16.573725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c6f45392-cec7-408c-a7aa-e12a995feb5a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:16.583068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c6f45392-cec7-408c-a7aa-e12a995feb5a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:16.598771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c6f45392-cec7-408c-a7aa-e12a995feb5a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:16.606104 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c6f45392-cec7-408c-a7aa-e12a995feb5a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 0.513713 Oct 12 22:05:16.609865 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 858/1635] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:16 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:16.624619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-506a9672-9425-4427-8f7a-58962dfa7cc3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:16.630202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-506a9672-9425-4427-8f7a-58962dfa7cc3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:16.643809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-506a9672-9425-4427-8f7a-58962dfa7cc3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:16.644298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-506a9672-9425-4427-8f7a-58962dfa7cc3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:16.645055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-506a9672-9425-4427-8f7a-58962dfa7cc3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:16.647848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-506a9672-9425-4427-8f7a-58962dfa7cc3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:16.648492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-506a9672-9425-4427-8f7a-58962dfa7cc3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:16.649112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-506a9672-9425-4427-8f7a-58962dfa7cc3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:17.227127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:05:17.228192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:05:17.228701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:05:17.229117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:05:17.229571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:05:17.246706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:17.247207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:17.247681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:17.256341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:17.257804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:17.258046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:17.328339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Getting quotas for project 68913d260d084ce4a8e29daf4783c0bc. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:05:17.349458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Getting quotas for user 13c74a78e82f4e72a7d1f7b133074f5a and project 68913d260d084ce4a8e29daf4783c0bc. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:05:17.398774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:05:17.410404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:05:17.542190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-506a9672-9425-4427-8f7a-58962dfa7cc3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:17.585868 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-506a9672-9425-4427-8f7a-58962dfa7cc3 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1521 microversion: 2.1 time: 0.974626 Oct 12 22:05:17.586493 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 859/1636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:16 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1521 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:17.595314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-694ed011-9847-492c-ae40-07397c758d9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:17.597949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-694ed011-9847-492c-ae40-07397c758d9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:17.621637 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c0025991-6a5a-484c-9304-365ba324ba46 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.928295 Oct 12 22:05:17.630974 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 778/1637] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:05:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:05:17.633333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-694ed011-9847-492c-ae40-07397c758d9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:17.634062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-694ed011-9847-492c-ae40-07397c758d9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:17.634681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-694ed011-9847-492c-ae40-07397c758d9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:17.640415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d1240ed8-cb67-433d-b8e6-820ebe76c609 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:17.641397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-694ed011-9847-492c-ae40-07397c758d9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:17.642043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-694ed011-9847-492c-ae40-07397c758d9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:17.642658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-694ed011-9847-492c-ae40-07397c758d9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:17.643854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d1240ed8-cb67-433d-b8e6-820ebe76c609 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:17.692985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1240ed8-cb67-433d-b8e6-820ebe76c609 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:17.694066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1240ed8-cb67-433d-b8e6-820ebe76c609 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:17.694798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1240ed8-cb67-433d-b8e6-820ebe76c609 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:17.697348 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-694ed011-9847-492c-ae40-07397c758d9a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109818 Oct 12 22:05:17.698327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1240ed8-cb67-433d-b8e6-820ebe76c609 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:17.698946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1240ed8-cb67-433d-b8e6-820ebe76c609 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:17.703366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1240ed8-cb67-433d-b8e6-820ebe76c609 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:17.705188 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 860/1638] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:05:17 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:05:17.790900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-90754a86-3256-44b2-b963-5f0bb6b8b448 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51286b5c10>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:17.935194 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-90754a86-3256-44b2-b963-5f0bb6b8b448 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be" status: 200 len: 1410 microversion: 2.1 time: 0.214898 Oct 12 22:05:17.968225 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 861/1639] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:05:17 2022] GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be => generated 1410 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:18.007378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2cfcf76b-17ca-4cfa-b294-46cc0d445069 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:18.008097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2cfcf76b-17ca-4cfa-b294-46cc0d445069 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:18.208943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2cfcf76b-17ca-4cfa-b294-46cc0d445069 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:18.224145 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2cfcf76b-17ca-4cfa-b294-46cc0d445069 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72" status: 200 len: 1242 microversion: 2.1 time: 0.250247 Oct 12 22:05:18.226588 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 862/1640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:17 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 => generated 1242 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:18.263632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1792487f-21b5-43f5-ada2-e789a63b4da7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:18.264424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1792487f-21b5-43f5-ada2-e789a63b4da7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:18.306019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1792487f-21b5-43f5-ada2-e789a63b4da7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:18.306648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1792487f-21b5-43f5-ada2-e789a63b4da7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:18.306957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1792487f-21b5-43f5-ada2-e789a63b4da7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:18.307727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1792487f-21b5-43f5-ada2-e789a63b4da7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:18.308182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1792487f-21b5-43f5-ada2-e789a63b4da7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:18.308698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1792487f-21b5-43f5-ada2-e789a63b4da7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:18.522816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d1240ed8-cb67-433d-b8e6-820ebe76c609 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:18.532731 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d1240ed8-cb67-433d-b8e6-820ebe76c609 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1538 microversion: 2.1 time: 0.900506 Oct 12 22:05:18.542907 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 779/1641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:17 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1538 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:18.570219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-2acf5c5a-964b-48d7-b320-e49cfe7c9f64 req-3562e3bd-da69-413d-a639-d6327937ac9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88fef870-22a8-43e7-afb9-5612edbce136", "name": "network-vif-plugged", "status": "completed", "tag": "8fa5803d-652c-4259-8fef-98474172e507"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:18.627095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2acf5c5a-964b-48d7-b320-e49cfe7c9f64 req-3562e3bd-da69-413d-a639-d6327937ac9d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:18.630774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2acf5c5a-964b-48d7-b320-e49cfe7c9f64 req-3562e3bd-da69-413d-a639-d6327937ac9d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:18.631423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2acf5c5a-964b-48d7-b320-e49cfe7c9f64 req-3562e3bd-da69-413d-a639-d6327937ac9d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:18.684802 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-2acf5c5a-964b-48d7-b320-e49cfe7c9f64 req-3562e3bd-da69-413d-a639-d6327937ac9d service nova] Creating event network-vif-plugged:8fa5803d-652c-4259-8fef-98474172e507 for instance 88fef870-22a8-43e7-afb9-5612edbce136 on n-h1-861111-1 Oct 12 22:05:18.706273 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-2acf5c5a-964b-48d7-b320-e49cfe7c9f64 req-3562e3bd-da69-413d-a639-d6327937ac9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159646 Oct 12 22:05:18.715397 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 780/1642] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:18.744808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1423f269-6ac4-4d8e-8c21-3d1c8ed4889a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:18.748614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=10 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:18.749814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1423f269-6ac4-4d8e-8c21-3d1c8ed4889a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:18.794311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1423f269-6ac4-4d8e-8c21-3d1c8ed4889a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:18.795641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1423f269-6ac4-4d8e-8c21-3d1c8ed4889a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:18.799780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1423f269-6ac4-4d8e-8c21-3d1c8ed4889a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:18.802909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1423f269-6ac4-4d8e-8c21-3d1c8ed4889a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:18.806832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1423f269-6ac4-4d8e-8c21-3d1c8ed4889a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:18.810667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1423f269-6ac4-4d8e-8c21-3d1c8ed4889a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:19.623538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1792487f-21b5-43f5-ada2-e789a63b4da7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:19.636973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1792487f-21b5-43f5-ada2-e789a63b4da7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:19.643089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1792487f-21b5-43f5-ada2-e789a63b4da7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:19.651647 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1792487f-21b5-43f5-ada2-e789a63b4da7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 1.422338 Oct 12 22:05:19.652559 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 863/1643] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:18 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:19.667841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-910f8f68-c532-47c0-89f8-ca44f2d68a29 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51285a21f0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:19.796927 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-910f8f68-c532-47c0-89f8-ca44f2d68a29 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be" status: 200 len: 1410 microversion: 2.1 time: 0.137477 Oct 12 22:05:19.797930 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 864/1644] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:05:19 2022] GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be => generated 1410 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:19.804565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-416d25f6-e3ae-4d6f-b010-99c184410c0b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:19.805190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-416d25f6-e3ae-4d6f-b010-99c184410c0b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:19.828841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-416d25f6-e3ae-4d6f-b010-99c184410c0b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:19.831949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-416d25f6-e3ae-4d6f-b010-99c184410c0b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:19.836234 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-416d25f6-e3ae-4d6f-b010-99c184410c0b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:19.837260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-416d25f6-e3ae-4d6f-b010-99c184410c0b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:19.837905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-416d25f6-e3ae-4d6f-b010-99c184410c0b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:19.838511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-416d25f6-e3ae-4d6f-b010-99c184410c0b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:20.032858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-416d25f6-e3ae-4d6f-b010-99c184410c0b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:20.046432 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-416d25f6-e3ae-4d6f-b010-99c184410c0b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72" status: 200 len: 1294 microversion: 2.1 time: 0.244292 Oct 12 22:05:20.047173 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 865/1645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:19 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 => generated 1294 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:20.060008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-912f10cf-027c-4d04-9fce-4fdb80b253f5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:20.068232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-912f10cf-027c-4d04-9fce-4fdb80b253f5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:20.082228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-912f10cf-027c-4d04-9fce-4fdb80b253f5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:20.083020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-912f10cf-027c-4d04-9fce-4fdb80b253f5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:20.084970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-912f10cf-027c-4d04-9fce-4fdb80b253f5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:20.087589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-912f10cf-027c-4d04-9fce-4fdb80b253f5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:20.088295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-912f10cf-027c-4d04-9fce-4fdb80b253f5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:20.088966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-912f10cf-027c-4d04-9fce-4fdb80b253f5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:20.536052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1423f269-6ac4-4d8e-8c21-3d1c8ed4889a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:20.545280 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1423f269-6ac4-4d8e-8c21-3d1c8ed4889a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1521 microversion: 2.1 time: 1.827206 Oct 12 22:05:20.545802 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 781/1646] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:18 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1521 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:20.682511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a913a1b8-e9f7-4df6-9396-8097175095d1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:20.683252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a913a1b8-e9f7-4df6-9396-8097175095d1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:20.707948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a913a1b8-e9f7-4df6-9396-8097175095d1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:20.709708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a913a1b8-e9f7-4df6-9396-8097175095d1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:20.710448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a913a1b8-e9f7-4df6-9396-8097175095d1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:20.713004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a913a1b8-e9f7-4df6-9396-8097175095d1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:20.714810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a913a1b8-e9f7-4df6-9396-8097175095d1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:20.715618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a913a1b8-e9f7-4df6-9396-8097175095d1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:20.762347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-912f10cf-027c-4d04-9fce-4fdb80b253f5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:20.784912 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-912f10cf-027c-4d04-9fce-4fdb80b253f5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1538 microversion: 2.1 time: 0.729140 Oct 12 22:05:20.788768 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 866/1647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:20 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1538 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:20.830093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c1b8e567-f7b1-4847-bfbb-18ebbd18b6aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51286b5160>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:21.255976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a913a1b8-e9f7-4df6-9396-8097175095d1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:21.273782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a913a1b8-e9f7-4df6-9396-8097175095d1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:21.278074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a913a1b8-e9f7-4df6-9396-8097175095d1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:21.282717 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a913a1b8-e9f7-4df6-9396-8097175095d1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 0.604419 Oct 12 22:05:21.287132 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 782/1648] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:20 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:05:21.308636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-972f0dbd-9c82-4baa-b06c-bd184c0c4c5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:21.312481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-972f0dbd-9c82-4baa-b06c-bd184c0c4c5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:21.332048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-972f0dbd-9c82-4baa-b06c-bd184c0c4c5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:21.334011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-972f0dbd-9c82-4baa-b06c-bd184c0c4c5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:21.335677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-972f0dbd-9c82-4baa-b06c-bd184c0c4c5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:21.337219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-972f0dbd-9c82-4baa-b06c-bd184c0c4c5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:21.340440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-972f0dbd-9c82-4baa-b06c-bd184c0c4c5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:21.341161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-972f0dbd-9c82-4baa-b06c-bd184c0c4c5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:21.566276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-972f0dbd-9c82-4baa-b06c-bd184c0c4c5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:21.583253 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-972f0dbd-9c82-4baa-b06c-bd184c0c4c5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72" status: 200 len: 1300 microversion: 2.1 time: 0.293555 Oct 12 22:05:21.600716 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 783/1649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:21 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 => generated 1300 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:21.621558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a24a30d6-740c-4336-94a7-c0126878abcb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:21.622375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a24a30d6-740c-4336-94a7-c0126878abcb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:21.640496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a24a30d6-740c-4336-94a7-c0126878abcb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:21.643476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a24a30d6-740c-4336-94a7-c0126878abcb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:21.646693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a24a30d6-740c-4336-94a7-c0126878abcb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:21.652523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a24a30d6-740c-4336-94a7-c0126878abcb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:21.653303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a24a30d6-740c-4336-94a7-c0126878abcb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:21.656351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a24a30d6-740c-4336-94a7-c0126878abcb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:22.362114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a24a30d6-740c-4336-94a7-c0126878abcb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:22.374812 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a24a30d6-740c-4336-94a7-c0126878abcb tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1521 microversion: 2.1 time: 0.785203 Oct 12 22:05:22.377058 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 784/1650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:21 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1521 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:22.382885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cbb8ca6b-cdec-452e-9103-a7055e7f1641 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:22.384074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cbb8ca6b-cdec-452e-9103-a7055e7f1641 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:22.390464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbb8ca6b-cdec-452e-9103-a7055e7f1641 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:22.391200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbb8ca6b-cdec-452e-9103-a7055e7f1641 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:22.392113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbb8ca6b-cdec-452e-9103-a7055e7f1641 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:22.393202 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbb8ca6b-cdec-452e-9103-a7055e7f1641 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:22.393884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbb8ca6b-cdec-452e-9103-a7055e7f1641 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:22.394532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbb8ca6b-cdec-452e-9103-a7055e7f1641 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:23.434901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cbb8ca6b-cdec-452e-9103-a7055e7f1641 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:23.446022 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cbb8ca6b-cdec-452e-9103-a7055e7f1641 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1543 microversion: 2.1 time: 1.067689 Oct 12 22:05:23.446612 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 785/1651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:22 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1543 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:23.478130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-85bc018a-f9c1-4de4-8bdb-a5f06a314dc1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:23.479027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-85bc018a-f9c1-4de4-8bdb-a5f06a314dc1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:23.486342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85bc018a-f9c1-4de4-8bdb-a5f06a314dc1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:23.487059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85bc018a-f9c1-4de4-8bdb-a5f06a314dc1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:23.487761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85bc018a-f9c1-4de4-8bdb-a5f06a314dc1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:23.488655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85bc018a-f9c1-4de4-8bdb-a5f06a314dc1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:23.489276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85bc018a-f9c1-4de4-8bdb-a5f06a314dc1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:23.489904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85bc018a-f9c1-4de4-8bdb-a5f06a314dc1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:24.506732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-85bc018a-f9c1-4de4-8bdb-a5f06a314dc1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:24.537225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-85bc018a-f9c1-4de4-8bdb-a5f06a314dc1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:24.540011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-85bc018a-f9c1-4de4-8bdb-a5f06a314dc1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:24.541563 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-85bc018a-f9c1-4de4-8bdb-a5f06a314dc1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1814 microversion: 2.25 time: 1.067837 Oct 12 22:05:24.560461 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 786/1652] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:23 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1814 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:24.573542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f79eb45-a630-4897-b607-751579dd18c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:24.574385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8f79eb45-a630-4897-b607-751579dd18c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:24.589302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f79eb45-a630-4897-b607-751579dd18c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:24.591055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f79eb45-a630-4897-b607-751579dd18c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:24.591713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f79eb45-a630-4897-b607-751579dd18c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:24.592740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f79eb45-a630-4897-b607-751579dd18c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:24.593356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f79eb45-a630-4897-b607-751579dd18c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:24.593966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f79eb45-a630-4897-b607-751579dd18c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:25.134800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f79eb45-a630-4897-b607-751579dd18c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:25.163173 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f79eb45-a630-4897-b607-751579dd18c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72" status: 200 len: 1368 microversion: 2.1 time: 0.596197 Oct 12 22:05:25.167082 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 787/1653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:24 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 => generated 1368 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:25.182600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ef9ea253-5833-4c0c-9b9a-b61062f5e60b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:25.183340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ef9ea253-5833-4c0c-9b9a-b61062f5e60b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:25.202584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef9ea253-5833-4c0c-9b9a-b61062f5e60b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:25.203699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef9ea253-5833-4c0c-9b9a-b61062f5e60b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:25.205906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef9ea253-5833-4c0c-9b9a-b61062f5e60b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:25.206924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef9ea253-5833-4c0c-9b9a-b61062f5e60b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:25.209235 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef9ea253-5833-4c0c-9b9a-b61062f5e60b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:25.212346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef9ea253-5833-4c0c-9b9a-b61062f5e60b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:25.854291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ef9ea253-5833-4c0c-9b9a-b61062f5e60b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:25.887591 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ef9ea253-5833-4c0c-9b9a-b61062f5e60b tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1521 microversion: 2.1 time: 0.718821 Oct 12 22:05:25.896020 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 788/1654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:25 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1521 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:25.904028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8bca5049-2c5f-46f2-a77e-0fd80ad464f1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:25.906852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8bca5049-2c5f-46f2-a77e-0fd80ad464f1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:25.929763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bca5049-2c5f-46f2-a77e-0fd80ad464f1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:25.934706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bca5049-2c5f-46f2-a77e-0fd80ad464f1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:25.935900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bca5049-2c5f-46f2-a77e-0fd80ad464f1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:25.937061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bca5049-2c5f-46f2-a77e-0fd80ad464f1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:25.939325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bca5049-2c5f-46f2-a77e-0fd80ad464f1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:25.943894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bca5049-2c5f-46f2-a77e-0fd80ad464f1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:26.559684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8bca5049-2c5f-46f2-a77e-0fd80ad464f1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:26.576213 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8bca5049-2c5f-46f2-a77e-0fd80ad464f1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1543 microversion: 2.1 time: 0.676707 Oct 12 22:05:26.577409 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 789/1655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:25 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1543 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:26.958830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-301812370", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:27.284225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=12 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:27.377591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=14 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:28.218794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:30.081048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=37 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:30.776412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=42 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:32.069708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:05:32.089044 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c1b8e567-f7b1-4847-bfbb-18ebbd18b6aa tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be" status: 200 len: 1419 microversion: 2.1 time: 11.279223 Oct 12 22:05:32.089813 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 867/1656] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:05:20 2022] GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be => generated 1419 bytes in 11281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:32.102070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-67b61e15-212c-409b-ae36-69a0c0f0fbcc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:32.102688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-67b61e15-212c-409b-ae36-69a0c0f0fbcc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:32.115538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67b61e15-212c-409b-ae36-69a0c0f0fbcc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:32.116036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67b61e15-212c-409b-ae36-69a0c0f0fbcc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:32.116497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67b61e15-212c-409b-ae36-69a0c0f0fbcc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:32.117206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67b61e15-212c-409b-ae36-69a0c0f0fbcc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:32.117651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67b61e15-212c-409b-ae36-69a0c0f0fbcc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:32.120853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67b61e15-212c-409b-ae36-69a0c0f0fbcc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:32.267393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-67b61e15-212c-409b-ae36-69a0c0f0fbcc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:32.277535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-67b61e15-212c-409b-ae36-69a0c0f0fbcc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:32.278987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-67b61e15-212c-409b-ae36-69a0c0f0fbcc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:32.280215 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-67b61e15-212c-409b-ae36-69a0c0f0fbcc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1804 microversion: 2.25 time: 0.189296 Oct 12 22:05:32.284742 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 868/1657] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:32 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1804 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:32.291383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-08f4cc3e-cdaa-4c33-a602-9ca116aba634 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:32.292130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-08f4cc3e-cdaa-4c33-a602-9ca116aba634 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:32.299040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08f4cc3e-cdaa-4c33-a602-9ca116aba634 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:32.300413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08f4cc3e-cdaa-4c33-a602-9ca116aba634 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:32.301314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08f4cc3e-cdaa-4c33-a602-9ca116aba634 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:32.302138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08f4cc3e-cdaa-4c33-a602-9ca116aba634 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:32.303498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08f4cc3e-cdaa-4c33-a602-9ca116aba634 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:32.305181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08f4cc3e-cdaa-4c33-a602-9ca116aba634 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:32.310632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:05:32.311146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:05:32.312109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:05:32.314207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:05:32.314809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:05:32.328018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:32.329023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:32.329634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:32.330701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:32.331369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:32.331983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:32.352043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Getting quotas for project 509ad64c9d1b4b7cae75ad66440ab755. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:05:32.359592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Getting quotas for user 4b5283be2f8f45e0afb31a99a030cd36 and project 509ad64c9d1b4b7cae75ad66440ab755. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:05:32.374056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:05:32.377313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:05:32.435460 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e84fde45-eea0-4fc8-ab8b-e0ced179375a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.856776 Oct 12 22:05:32.436209 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 790/1658] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:05:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 5858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:05:32.441597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-9a9cbe90-2f1d-4ef8-8d9c-9334564acc58 req-26cef5c6-be61-4608-ab00-441b94896517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe4575c-4bfa-4907-80a1-6cbfeb246f72", "tag": "91f7b233-578e-4e47-81c2-cc982b4b0605"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:32.456734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9a9cbe90-2f1d-4ef8-8d9c-9334564acc58 req-26cef5c6-be61-4608-ab00-441b94896517 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:32.457295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9a9cbe90-2f1d-4ef8-8d9c-9334564acc58 req-26cef5c6-be61-4608-ab00-441b94896517 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:32.457794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9a9cbe90-2f1d-4ef8-8d9c-9334564acc58 req-26cef5c6-be61-4608-ab00-441b94896517 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:32.470252 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-9a9cbe90-2f1d-4ef8-8d9c-9334564acc58 req-26cef5c6-be61-4608-ab00-441b94896517 service nova] Creating event network-changed:91f7b233-578e-4e47-81c2-cc982b4b0605 for instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 on n-h2-861111-1 Oct 12 22:05:32.478053 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-9a9cbe90-2f1d-4ef8-8d9c-9334564acc58 req-26cef5c6-be61-4608-ab00-441b94896517 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039968 Oct 12 22:05:32.478892 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 791/1659] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:32.483689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-08f4cc3e-cdaa-4c33-a602-9ca116aba634 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:32.506848 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-08f4cc3e-cdaa-4c33-a602-9ca116aba634 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72" status: 200 len: 1368 microversion: 2.1 time: 0.220693 Oct 12 22:05:32.510865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5c969cae-ab67-40b9-90d1-76ab91f16223 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:32.511611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5c969cae-ab67-40b9-90d1-76ab91f16223 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:32.512200 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 869/1660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:32 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:32.518725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3b42b791-ac3e-4d60-a68d-2f441436e984 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:32.519764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3b42b791-ac3e-4d60-a68d-2f441436e984 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:32.522732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c969cae-ab67-40b9-90d1-76ab91f16223 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:32.523160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c969cae-ab67-40b9-90d1-76ab91f16223 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:32.523936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c969cae-ab67-40b9-90d1-76ab91f16223 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:32.524835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c969cae-ab67-40b9-90d1-76ab91f16223 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:32.526517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c969cae-ab67-40b9-90d1-76ab91f16223 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:32.528021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c969cae-ab67-40b9-90d1-76ab91f16223 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:32.541722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b42b791-ac3e-4d60-a68d-2f441436e984 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:32.542499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b42b791-ac3e-4d60-a68d-2f441436e984 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:32.543196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b42b791-ac3e-4d60-a68d-2f441436e984 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:32.545349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b42b791-ac3e-4d60-a68d-2f441436e984 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:32.549142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b42b791-ac3e-4d60-a68d-2f441436e984 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:32.550110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b42b791-ac3e-4d60-a68d-2f441436e984 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:32.580714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:32.781652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3b42b791-ac3e-4d60-a68d-2f441436e984 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:32.791406 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3b42b791-ac3e-4d60-a68d-2f441436e984 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1543 microversion: 2.1 time: 0.277284 Oct 12 22:05:32.792276 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 870/1661] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:32 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1543 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:32.804734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5c969cae-ab67-40b9-90d1-76ab91f16223 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:32.819540 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5c969cae-ab67-40b9-90d1-76ab91f16223 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1498 microversion: 2.1 time: 0.339082 Oct 12 22:05:32.820131 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 792/1662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:32 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1498 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:32.830648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd3076d7-f302-4dd1-847e-985987d972c8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51288e5940>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:32.911764 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cd3076d7-f302-4dd1-847e-985987d972c8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be" status: 200 len: 1419 microversion: 2.1 time: 0.090204 Oct 12 22:05:32.912780 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 793/1663] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:05:32 2022] GET /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be => generated 1419 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:32.934234 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7fc71709-eb05-45b8-8ac5-dd1acc3e399e tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '.version_select at 0x7f512875cb80>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:32.938782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fc71709-eb05-45b8-8ac5-dd1acc3e399e tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:32.939573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fc71709-eb05-45b8-8ac5-dd1acc3e399e tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:32.940260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fc71709-eb05-45b8-8ac5-dd1acc3e399e tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:32.967642 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7fc71709-eb05-45b8-8ac5-dd1acc3e399e tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3802 microversion: 2.25 time: 0.053581 Oct 12 22:05:32.969824 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 794/1664] 10.222.0.16 () {60 vars in 1184 bytes} [Wed Oct 12 22:05:32 2022] GET /compute/v2.1/os-migrations => generated 3802 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:32.983081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-2a665aa3-1abf-448e-b293-46ef6f8f8ed9 req-dac97cd0-2cb0-4131-97c7-f5ebcb85b1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe4575c-4bfa-4907-80a1-6cbfeb246f72", "name": "network-vif-plugged", "status": "completed", "tag": "91f7b233-578e-4e47-81c2-cc982b4b0605"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:33.028644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2a665aa3-1abf-448e-b293-46ef6f8f8ed9 req-dac97cd0-2cb0-4131-97c7-f5ebcb85b1d5 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:33.029134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2a665aa3-1abf-448e-b293-46ef6f8f8ed9 req-dac97cd0-2cb0-4131-97c7-f5ebcb85b1d5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:33.029566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2a665aa3-1abf-448e-b293-46ef6f8f8ed9 req-dac97cd0-2cb0-4131-97c7-f5ebcb85b1d5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:33.030074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-528943935", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:33.056182 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-2a665aa3-1abf-448e-b293-46ef6f8f8ed9 req-dac97cd0-2cb0-4131-97c7-f5ebcb85b1d5 service nova] Creating event network-vif-plugged:91f7b233-578e-4e47-81c2-cc982b4b0605 for instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 on n-h2-861111-1 Oct 12 22:05:33.069328 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-2a665aa3-1abf-448e-b293-46ef6f8f8ed9 req-dac97cd0-2cb0-4131-97c7-f5ebcb85b1d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092345 Oct 12 22:05:33.070205 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 795/1665] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:33.078963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c70e36e9-e11a-473a-9a93-a0e4fdf58e26 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:33.079890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c70e36e9-e11a-473a-9a93-a0e4fdf58e26 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:33.141063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] validate_networks() for None {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:05:33.191016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c70e36e9-e11a-473a-9a93-a0e4fdf58e26 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:33.198737 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c70e36e9-e11a-473a-9a93-a0e4fdf58e26 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1213 microversion: 2.1 time: 0.124885 Oct 12 22:05:33.199982 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 796/1666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:33 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:33.205794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c0d14406-88f5-40c6-8717-c90d21453bb7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:33.211642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c0d14406-88f5-40c6-8717-c90d21453bb7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:33.212540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c0d14406-88f5-40c6-8717-c90d21453bb7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:33.218683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0d14406-88f5-40c6-8717-c90d21453bb7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:33.219278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0d14406-88f5-40c6-8717-c90d21453bb7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:33.220656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0d14406-88f5-40c6-8717-c90d21453bb7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:33.221769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0d14406-88f5-40c6-8717-c90d21453bb7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:33.222704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0d14406-88f5-40c6-8717-c90d21453bb7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:33.223232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0d14406-88f5-40c6-8717-c90d21453bb7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:33.262116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.multi_cell_list [None req-c0d14406-88f5-40c6-8717-c90d21453bb7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:05:33.297971 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c0d14406-88f5-40c6-8717-c90d21453bb7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.095803 Oct 12 22:05:33.298705 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 797/1667] 10.222.0.16 () {58 vars in 1154 bytes} [Wed Oct 12 22:05:33 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:33.304271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dab44c85-8e83-42de-ab1f-d3cfbd4cdbfd tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:33.305030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dab44c85-8e83-42de-ab1f-d3cfbd4cdbfd tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:33.311503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dab44c85-8e83-42de-ab1f-d3cfbd4cdbfd tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:33.312095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dab44c85-8e83-42de-ab1f-d3cfbd4cdbfd tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:33.312856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dab44c85-8e83-42de-ab1f-d3cfbd4cdbfd tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:33.313769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dab44c85-8e83-42de-ab1f-d3cfbd4cdbfd tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:33.314395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dab44c85-8e83-42de-ab1f-d3cfbd4cdbfd tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:33.315053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dab44c85-8e83-42de-ab1f-d3cfbd4cdbfd tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:33.476217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:05:33.476653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:05:33.477139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:05:33.477547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:05:33.477960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:05:33.487935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:33.488685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:33.489284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:33.490225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:33.490866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:33.491375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:33.517119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Getting quotas for project cb320231db494313a74874b542b1a99f. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:05:33.526811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Getting quotas for user 7e19d242c6f84fafbc30b676b1a0e08e and project cb320231db494313a74874b542b1a99f. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:05:33.545507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-dab44c85-8e83-42de-ab1f-d3cfbd4cdbfd tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'services' on Instance uuid 247e0252-3374-40b8-85f3-995d2031867d {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:05:33.555997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:05:33.559451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:05:33.562272 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dab44c85-8e83-42de-ab1f-d3cfbd4cdbfd tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 2422 microversion: 2.25 time: 0.262137 Oct 12 22:05:33.563437 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 798/1668] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:33 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 2422 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:33.568876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1522551566", "imageRef": "b3e07e6e-3aff-474d-9ddf-dbde3ec934be", "flavorRef": "452", "networks": [{"uuid": "1bfd60f2-0202-40db-8761-3b71d02412dc"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:33.610501 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4a7c498f-5ea9-4e75-b1bb-c72c94d8e8af tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816938 Oct 12 22:05:33.611474 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 871/1669] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:05:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:05:33.616817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7362a63f-50fd-40bf-9195-2d3a85a80030 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:33.623984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7362a63f-50fd-40bf-9195-2d3a85a80030 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:33.624245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7362a63f-50fd-40bf-9195-2d3a85a80030 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:33.624588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7362a63f-50fd-40bf-9195-2d3a85a80030 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:33.647487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] validate_networks() for [('1bfd60f2-0202-40db-8761-3b71d02412dc', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:05:33.670788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7362a63f-50fd-40bf-9195-2d3a85a80030 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Going to try to start instance {{(pid=120453) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 22:05:33.762524 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7362a63f-50fd-40bf-9195-2d3a85a80030 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "POST /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6/action" status: 202 len: 0 microversion: 2.1 time: 0.149657 Oct 12 22:05:33.764540 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 872/1670] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:05:33 2022] POST /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:05:33.790169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0ef495ae-7a04-4266-8b15-f82890371f79 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:33.790928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0ef495ae-7a04-4266-8b15-f82890371f79 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:33.797354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ef495ae-7a04-4266-8b15-f82890371f79 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:33.798006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ef495ae-7a04-4266-8b15-f82890371f79 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:33.798459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ef495ae-7a04-4266-8b15-f82890371f79 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:33.799185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ef495ae-7a04-4266-8b15-f82890371f79 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:33.799677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ef495ae-7a04-4266-8b15-f82890371f79 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:33.800104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ef495ae-7a04-4266-8b15-f82890371f79 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:33.976043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0ef495ae-7a04-4266-8b15-f82890371f79 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:33.985419 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0ef495ae-7a04-4266-8b15-f82890371f79 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72" status: 200 len: 1368 microversion: 2.1 time: 0.205850 Oct 12 22:05:33.985998 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 873/1671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:33 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:33.993991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-743671ed-ef70-4ace-9976-8be2b1894013 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:33.994742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-743671ed-ef70-4ace-9976-8be2b1894013 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:34.001975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743671ed-ef70-4ace-9976-8be2b1894013 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:34.002859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743671ed-ef70-4ace-9976-8be2b1894013 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:34.004227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743671ed-ef70-4ace-9976-8be2b1894013 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:34.005167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743671ed-ef70-4ace-9976-8be2b1894013 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:34.006336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743671ed-ef70-4ace-9976-8be2b1894013 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:34.007828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743671ed-ef70-4ace-9976-8be2b1894013 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:34.200709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:05:34.205918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:05:34.212383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:05:34.213006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:05:34.213606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:05:34.216460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:34.228197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-743671ed-ef70-4ace-9976-8be2b1894013 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'services' on Instance uuid 247e0252-3374-40b8-85f3-995d2031867d {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:05:34.228813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:34.229154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:34.229667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:34.230456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:34.230905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:34.231534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:34.250626 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-743671ed-ef70-4ace-9976-8be2b1894013 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 2422 microversion: 2.25 time: 0.262318 Oct 12 22:05:34.251380 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 874/1672] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:05:33 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 2422 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:05:34.267299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-848ff485-73d1-493a-912a-c2d299b3756c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:34.267299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-848ff485-73d1-493a-912a-c2d299b3756c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:34.283387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Getting quotas for project 0905a1286e134e34a55ceaaa6c23718e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:05:34.313504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Getting quotas for user 7224dcaeabdd4199b9682e99912f7740 and project 0905a1286e134e34a55ceaaa6c23718e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:05:34.328403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:05:34.331094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e07e6e-3aff-474d-9ddf-dbde3ec934be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:05:34.377565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-848ff485-73d1-493a-912a-c2d299b3756c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:34.377565 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-848ff485-73d1-493a-912a-c2d299b3756c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1216 microversion: 2.1 time: 0.124846 Oct 12 22:05:34.380481 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 875/1673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:34 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1216 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:34.386154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dc1664d0-ccff-4e7c-a049-aa94e63f1edf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:34.386906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dc1664d0-ccff-4e7c-a049-aa94e63f1edf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:34.393372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc1664d0-ccff-4e7c-a049-aa94e63f1edf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:34.393987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc1664d0-ccff-4e7c-a049-aa94e63f1edf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:34.394549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc1664d0-ccff-4e7c-a049-aa94e63f1edf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:34.404872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc1664d0-ccff-4e7c-a049-aa94e63f1edf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:34.405756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc1664d0-ccff-4e7c-a049-aa94e63f1edf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:34.406523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc1664d0-ccff-4e7c-a049-aa94e63f1edf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:34.427551 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-77ff633a-5986-4873-b217-b9c3c3be5572 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.856310 Oct 12 22:05:34.428557 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 799/1674] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:05:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:05:34.441593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6e227f4b-c4f4-4963-b230-40716da631b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:34.444499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6e227f4b-c4f4-4963-b230-40716da631b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:34.454425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e227f4b-c4f4-4963-b230-40716da631b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:34.455953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e227f4b-c4f4-4963-b230-40716da631b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:34.461334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e227f4b-c4f4-4963-b230-40716da631b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:34.463962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e227f4b-c4f4-4963-b230-40716da631b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:34.464512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e227f4b-c4f4-4963-b230-40716da631b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:34.465094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e227f4b-c4f4-4963-b230-40716da631b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:34.733921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dc1664d0-ccff-4e7c-a049-aa94e63f1edf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:34.745032 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dc1664d0-ccff-4e7c-a049-aa94e63f1edf tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1507 microversion: 2.1 time: 0.363343 Oct 12 22:05:34.745597 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 876/1675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:34 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:34.761891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-49ce88d5-fb4c-43c7-b957-f854f14002be tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:34.762325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-49ce88d5-fb4c-43c7-b957-f854f14002be tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:34.776326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49ce88d5-fb4c-43c7-b957-f854f14002be tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:34.780194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49ce88d5-fb4c-43c7-b957-f854f14002be tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:34.780194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49ce88d5-fb4c-43c7-b957-f854f14002be tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:34.780194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49ce88d5-fb4c-43c7-b957-f854f14002be tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:34.780194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49ce88d5-fb4c-43c7-b957-f854f14002be tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:34.780869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49ce88d5-fb4c-43c7-b957-f854f14002be tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:34.935613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-49ce88d5-fb4c-43c7-b957-f854f14002be tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:34.944946 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-49ce88d5-fb4c-43c7-b957-f854f14002be tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1271 microversion: 2.1 time: 0.194598 Oct 12 22:05:34.946207 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 877/1676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:34 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1271 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:34.951613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b8ce9419-8552-4612-ac96-22a570b9e9c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:34.952405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b8ce9419-8552-4612-ac96-22a570b9e9c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:34.959615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8ce9419-8552-4612-ac96-22a570b9e9c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:34.961023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8ce9419-8552-4612-ac96-22a570b9e9c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:34.961697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8ce9419-8552-4612-ac96-22a570b9e9c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:34.962651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8ce9419-8552-4612-ac96-22a570b9e9c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:34.963363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8ce9419-8552-4612-ac96-22a570b9e9c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:34.964042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8ce9419-8552-4612-ac96-22a570b9e9c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:35.126898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-b8ce9419-8552-4612-ac96-22a570b9e9c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lazy-loading 'services' on Instance uuid 247e0252-3374-40b8-85f3-995d2031867d {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:05:35.311478 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b8ce9419-8552-4612-ac96-22a570b9e9c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments/c93e44df-144e-46c1-abe3-f589a8798e21" status: 202 len: 0 microversion: 2.25 time: 0.363629 Oct 12 22:05:35.316656 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 878/1677] 10.222.0.16 () {60 vars in 1457 bytes} [Wed Oct 12 22:05:34 2022] DELETE /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments/c93e44df-144e-46c1-abe3-f589a8798e21 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:05:35.323098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0f82e0ad-9299-4470-bf15-5522aa55ed70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:35.323993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0f82e0ad-9299-4470-bf15-5522aa55ed70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:35.328368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6e227f4b-c4f4-4963-b230-40716da631b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:35.330863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f82e0ad-9299-4470-bf15-5522aa55ed70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:35.331427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f82e0ad-9299-4470-bf15-5522aa55ed70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:35.332141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f82e0ad-9299-4470-bf15-5522aa55ed70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:35.332554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f82e0ad-9299-4470-bf15-5522aa55ed70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:35.333022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f82e0ad-9299-4470-bf15-5522aa55ed70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:35.333418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f82e0ad-9299-4470-bf15-5522aa55ed70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:35.341970 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6e227f4b-c4f4-4963-b230-40716da631b0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1543 microversion: 2.1 time: 0.911613 Oct 12 22:05:35.344091 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 800/1678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:34 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1543 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:35.363752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-37907a8e-fe3b-41f2-bebb-566df2722070 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:35.368072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-37907a8e-fe3b-41f2-bebb-566df2722070 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:35.385896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37907a8e-fe3b-41f2-bebb-566df2722070 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:35.386828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37907a8e-fe3b-41f2-bebb-566df2722070 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:35.387552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37907a8e-fe3b-41f2-bebb-566df2722070 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:35.388540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37907a8e-fe3b-41f2-bebb-566df2722070 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:35.389189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37907a8e-fe3b-41f2-bebb-566df2722070 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:35.389826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37907a8e-fe3b-41f2-bebb-566df2722070 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:35.418927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0f82e0ad-9299-4470-bf15-5522aa55ed70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:35.429357 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0f82e0ad-9299-4470-bf15-5522aa55ed70 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1212 microversion: 2.1 time: 0.111109 Oct 12 22:05:35.429949 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 879/1679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:35 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1212 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:35.437522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4584d7a4-fee5-4481-ae7c-165c2dd2cb87 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:35.439703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4584d7a4-fee5-4481-ae7c-165c2dd2cb87 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:35.452798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4584d7a4-fee5-4481-ae7c-165c2dd2cb87 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:35.453549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4584d7a4-fee5-4481-ae7c-165c2dd2cb87 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:35.453993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4584d7a4-fee5-4481-ae7c-165c2dd2cb87 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:35.454700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4584d7a4-fee5-4481-ae7c-165c2dd2cb87 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:35.455438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4584d7a4-fee5-4481-ae7c-165c2dd2cb87 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:35.455847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4584d7a4-fee5-4481-ae7c-165c2dd2cb87 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:35.489227 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4584d7a4-fee5-4481-ae7c-165c2dd2cb87 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.056716 Oct 12 22:05:35.491453 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 880/1680] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:05:35 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:05:35.496197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7298556f-509a-4464-ad53-b9c3a51c9dd7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:35.496816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7298556f-509a-4464-ad53-b9c3a51c9dd7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:35.503192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7298556f-509a-4464-ad53-b9c3a51c9dd7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:35.503712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7298556f-509a-4464-ad53-b9c3a51c9dd7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:35.504153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7298556f-509a-4464-ad53-b9c3a51c9dd7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:35.504853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7298556f-509a-4464-ad53-b9c3a51c9dd7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:35.505306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7298556f-509a-4464-ad53-b9c3a51c9dd7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:35.506328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7298556f-509a-4464-ad53-b9c3a51c9dd7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:35.632989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7298556f-509a-4464-ad53-b9c3a51c9dd7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:35.649739 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7298556f-509a-4464-ad53-b9c3a51c9dd7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1268 microversion: 2.1 time: 0.156947 Oct 12 22:05:35.650465 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 881/1681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:35 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:35.774411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-30afcaf3-c96e-4a07-8795-8285966fce50 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:35.775033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-30afcaf3-c96e-4a07-8795-8285966fce50 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:35.785460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30afcaf3-c96e-4a07-8795-8285966fce50 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:35.786376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30afcaf3-c96e-4a07-8795-8285966fce50 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:35.786510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30afcaf3-c96e-4a07-8795-8285966fce50 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:35.787748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30afcaf3-c96e-4a07-8795-8285966fce50 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:35.788204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30afcaf3-c96e-4a07-8795-8285966fce50 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:35.788642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30afcaf3-c96e-4a07-8795-8285966fce50 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:35.812284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-37907a8e-fe3b-41f2-bebb-566df2722070 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:35.825257 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-37907a8e-fe3b-41f2-bebb-566df2722070 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72" status: 200 len: 1558 microversion: 2.1 time: 0.479885 Oct 12 22:05:35.836993 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 801/1682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:35 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 => generated 1558 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:35.853071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f1201563-cd0d-450c-8476-8f6cfa9a698b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:35.853635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f1201563-cd0d-450c-8476-8f6cfa9a698b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:35.871039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1201563-cd0d-450c-8476-8f6cfa9a698b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:35.875801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1201563-cd0d-450c-8476-8f6cfa9a698b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:35.876277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1201563-cd0d-450c-8476-8f6cfa9a698b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:35.877728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1201563-cd0d-450c-8476-8f6cfa9a698b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:35.878460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1201563-cd0d-450c-8476-8f6cfa9a698b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:35.878984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1201563-cd0d-450c-8476-8f6cfa9a698b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:35.952350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-30afcaf3-c96e-4a07-8795-8285966fce50 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:35.964523 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-30afcaf3-c96e-4a07-8795-8285966fce50 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1507 microversion: 2.1 time: 0.193719 Oct 12 22:05:35.971358 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 882/1683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:35 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:35.971358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eaa4078b-7411-4a99-9f99-c180ece85b70 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:35.971358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eaa4078b-7411-4a99-9f99-c180ece85b70 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:35.978904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaa4078b-7411-4a99-9f99-c180ece85b70 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:35.982012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaa4078b-7411-4a99-9f99-c180ece85b70 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:35.982522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaa4078b-7411-4a99-9f99-c180ece85b70 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:35.983446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaa4078b-7411-4a99-9f99-c180ece85b70 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:35.983919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaa4078b-7411-4a99-9f99-c180ece85b70 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:35.984624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaa4078b-7411-4a99-9f99-c180ece85b70 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:36.059649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eaa4078b-7411-4a99-9f99-c180ece85b70 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:36.067622 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f1201563-cd0d-450c-8476-8f6cfa9a698b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.218502 Oct 12 22:05:36.068560 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 802/1684] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:05:35 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-interface => generated 284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:05:36.084442 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eaa4078b-7411-4a99-9f99-c180ece85b70 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1271 microversion: 2.1 time: 0.102475 Oct 12 22:05:36.085898 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 883/1685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:35 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1271 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:36.369557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fcedba15-ce76-4b7f-bf75-79bb72ce043a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:36.370971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fcedba15-ce76-4b7f-bf75-79bb72ce043a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:36.379599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcedba15-ce76-4b7f-bf75-79bb72ce043a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:36.381494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcedba15-ce76-4b7f-bf75-79bb72ce043a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:36.382126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcedba15-ce76-4b7f-bf75-79bb72ce043a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:36.383027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcedba15-ce76-4b7f-bf75-79bb72ce043a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:36.383964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcedba15-ce76-4b7f-bf75-79bb72ce043a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:36.384953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcedba15-ce76-4b7f-bf75-79bb72ce043a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:36.453240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e990ab8d-e241-4124-9459-e1566a97207d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:36.454514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e990ab8d-e241-4124-9459-e1566a97207d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:36.465562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e990ab8d-e241-4124-9459-e1566a97207d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:36.466619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e990ab8d-e241-4124-9459-e1566a97207d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:36.468362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e990ab8d-e241-4124-9459-e1566a97207d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:36.472434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e990ab8d-e241-4124-9459-e1566a97207d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:36.473472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e990ab8d-e241-4124-9459-e1566a97207d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:36.474109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e990ab8d-e241-4124-9459-e1566a97207d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:36.480970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:36.593654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e990ab8d-e241-4124-9459-e1566a97207d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:36.604497 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e990ab8d-e241-4124-9459-e1566a97207d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1260 microversion: 2.1 time: 0.155528 Oct 12 22:05:36.605971 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 884/1686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:36 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:36.612825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2a7b94cb-4dc9-4e29-8f64-a28bdbf4cbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:36.615599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2a7b94cb-4dc9-4e29-8f64-a28bdbf4cbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:36.622476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a7b94cb-4dc9-4e29-8f64-a28bdbf4cbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:36.623351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a7b94cb-4dc9-4e29-8f64-a28bdbf4cbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:36.624243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a7b94cb-4dc9-4e29-8f64-a28bdbf4cbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:36.625186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a7b94cb-4dc9-4e29-8f64-a28bdbf4cbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:36.625852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a7b94cb-4dc9-4e29-8f64-a28bdbf4cbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:36.626523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a7b94cb-4dc9-4e29-8f64-a28bdbf4cbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:36.669908 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2a7b94cb-4dc9-4e29-8f64-a28bdbf4cbaa tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.062594 Oct 12 22:05:36.671497 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 885/1687] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:05:36 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:05:36.678648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-2f5ec1fe-8bb6-4714-bf2f-67938cb3a2a9 req-b3bf0e00-c1f5-4df8-9437-81e178f66e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88fef870-22a8-43e7-afb9-5612edbce136", "name": "network-vif-unplugged", "status": "completed", "tag": "8fa5803d-652c-4259-8fef-98474172e507"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:36.719762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2f5ec1fe-8bb6-4714-bf2f-67938cb3a2a9 req-b3bf0e00-c1f5-4df8-9437-81e178f66e7b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:36.719960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2f5ec1fe-8bb6-4714-bf2f-67938cb3a2a9 req-b3bf0e00-c1f5-4df8-9437-81e178f66e7b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:36.720223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2f5ec1fe-8bb6-4714-bf2f-67938cb3a2a9 req-b3bf0e00-c1f5-4df8-9437-81e178f66e7b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:36.738164 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-2f5ec1fe-8bb6-4714-bf2f-67938cb3a2a9 req-b3bf0e00-c1f5-4df8-9437-81e178f66e7b service nova] Creating event network-vif-unplugged:8fa5803d-652c-4259-8fef-98474172e507 for instance 88fef870-22a8-43e7-afb9-5612edbce136 on n-h1-861111-1 Oct 12 22:05:36.746465 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-2f5ec1fe-8bb6-4714-bf2f-67938cb3a2a9 req-b3bf0e00-c1f5-4df8-9437-81e178f66e7b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073292 Oct 12 22:05:36.747269 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 886/1688] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:36.752572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-de60a8ac-abfe-42e4-acf9-a2ccc31c6034 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:36.753271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-de60a8ac-abfe-42e4-acf9-a2ccc31c6034 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:36.762442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de60a8ac-abfe-42e4-acf9-a2ccc31c6034 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:36.763357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de60a8ac-abfe-42e4-acf9-a2ccc31c6034 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:36.763357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de60a8ac-abfe-42e4-acf9-a2ccc31c6034 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:36.763987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de60a8ac-abfe-42e4-acf9-a2ccc31c6034 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:36.764745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de60a8ac-abfe-42e4-acf9-a2ccc31c6034 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:36.765019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de60a8ac-abfe-42e4-acf9-a2ccc31c6034 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:36.885614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-de60a8ac-abfe-42e4-acf9-a2ccc31c6034 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:36.896591 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-de60a8ac-abfe-42e4-acf9-a2ccc31c6034 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1274 microversion: 2.1 time: 0.147655 Oct 12 22:05:36.897179 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 887/1689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:36 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1274 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:36.972906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fcedba15-ce76-4b7f-bf75-79bb72ce043a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:36.981401 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fcedba15-ce76-4b7f-bf75-79bb72ce043a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1543 microversion: 2.1 time: 0.619196 Oct 12 22:05:36.984733 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 803/1690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:36 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1543 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:36.999959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7fafaf19-177a-4a37-a39c-aa244f4bc6a1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:37.000583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7fafaf19-177a-4a37-a39c-aa244f4bc6a1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:37.008257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fafaf19-177a-4a37-a39c-aa244f4bc6a1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:37.008746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fafaf19-177a-4a37-a39c-aa244f4bc6a1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:37.009192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fafaf19-177a-4a37-a39c-aa244f4bc6a1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:37.009911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fafaf19-177a-4a37-a39c-aa244f4bc6a1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:37.010368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fafaf19-177a-4a37-a39c-aa244f4bc6a1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:37.010798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fafaf19-177a-4a37-a39c-aa244f4bc6a1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:37.113078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-87cbb83e-dc7f-4650-b822-19b140f0c317 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:37.113796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-87cbb83e-dc7f-4650-b822-19b140f0c317 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:37.126013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-87cbb83e-dc7f-4650-b822-19b140f0c317 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:37.127391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-87cbb83e-dc7f-4650-b822-19b140f0c317 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:37.131049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-87cbb83e-dc7f-4650-b822-19b140f0c317 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:37.132643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-87cbb83e-dc7f-4650-b822-19b140f0c317 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:37.133874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-87cbb83e-dc7f-4650-b822-19b140f0c317 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:37.134385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-87cbb83e-dc7f-4650-b822-19b140f0c317 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:37.292008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7fafaf19-177a-4a37-a39c-aa244f4bc6a1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:37.305550 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7fafaf19-177a-4a37-a39c-aa244f4bc6a1 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1511 microversion: 2.1 time: 0.315712 Oct 12 22:05:37.305550 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 888/1691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:36 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1511 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:37.334594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-932e77c0-e165-4b26-b353-3fbbe1aaf4ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:37.350018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-932e77c0-e165-4b26-b353-3fbbe1aaf4ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:37.350479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.compute.servers [None req-932e77c0-e165-4b26-b353-3fbbe1aaf4ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Removing options 'limit' from query {{(pid=120453) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 12 22:05:37.354122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-932e77c0-e165-4b26-b353-3fbbe1aaf4ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:37.359941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-932e77c0-e165-4b26-b353-3fbbe1aaf4ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:37.360445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-932e77c0-e165-4b26-b353-3fbbe1aaf4ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:37.360892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-932e77c0-e165-4b26-b353-3fbbe1aaf4ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:37.370214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-932e77c0-e165-4b26-b353-3fbbe1aaf4ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:37.373039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-932e77c0-e165-4b26-b353-3fbbe1aaf4ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:37.373581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-932e77c0-e165-4b26-b353-3fbbe1aaf4ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:37.378806 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-932e77c0-e165-4b26-b353-3fbbe1aaf4ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.050477 Oct 12 22:05:37.383153 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 889/1692] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 12 22:05:37 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:05:37.403049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-55f9f537-b580-4382-9417-810b9f5e91f2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:37.404574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-55f9f537-b580-4382-9417-810b9f5e91f2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:37.425423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55f9f537-b580-4382-9417-810b9f5e91f2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:37.427509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55f9f537-b580-4382-9417-810b9f5e91f2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:37.428934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55f9f537-b580-4382-9417-810b9f5e91f2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:37.434383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55f9f537-b580-4382-9417-810b9f5e91f2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:37.434961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55f9f537-b580-4382-9417-810b9f5e91f2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:37.436264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55f9f537-b580-4382-9417-810b9f5e91f2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:37.779430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-87cbb83e-dc7f-4650-b822-19b140f0c317 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:37.797593 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-87cbb83e-dc7f-4650-b822-19b140f0c317 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1313 microversion: 2.1 time: 0.688743 Oct 12 22:05:37.812814 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 804/1693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:37 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1313 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:05:37.820717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5c51e50f-a73d-4579-a242-aa11b1eba87b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:37.821686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5c51e50f-a73d-4579-a242-aa11b1eba87b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:37.828445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c51e50f-a73d-4579-a242-aa11b1eba87b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:37.829325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c51e50f-a73d-4579-a242-aa11b1eba87b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:37.830023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c51e50f-a73d-4579-a242-aa11b1eba87b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:37.831009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c51e50f-a73d-4579-a242-aa11b1eba87b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:37.831748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c51e50f-a73d-4579-a242-aa11b1eba87b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:37.832420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c51e50f-a73d-4579-a242-aa11b1eba87b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:37.984687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5c51e50f-a73d-4579-a242-aa11b1eba87b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:38.009234 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5c51e50f-a73d-4579-a242-aa11b1eba87b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1260 microversion: 2.1 time: 0.193413 Oct 12 22:05:38.010181 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 805/1694] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:37 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:38.030221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e6d9b914-f33f-4a06-92fa-5376d648691e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:38.042097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e6d9b914-f33f-4a06-92fa-5376d648691e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:38.092293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6d9b914-f33f-4a06-92fa-5376d648691e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:38.093272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6d9b914-f33f-4a06-92fa-5376d648691e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:38.097086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6d9b914-f33f-4a06-92fa-5376d648691e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:38.097992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6d9b914-f33f-4a06-92fa-5376d648691e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:38.100470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6d9b914-f33f-4a06-92fa-5376d648691e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:38.101590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6d9b914-f33f-4a06-92fa-5376d648691e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:38.186317 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e6d9b914-f33f-4a06-92fa-5376d648691e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.173770 Oct 12 22:05:38.191892 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 806/1695] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:05:38 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:05:38.201613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-588772af-f2e8-445d-89cd-71ce3cd547ae tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:38.210339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-588772af-f2e8-445d-89cd-71ce3cd547ae tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:38.217092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-588772af-f2e8-445d-89cd-71ce3cd547ae tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:38.220956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-588772af-f2e8-445d-89cd-71ce3cd547ae tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:38.221817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-588772af-f2e8-445d-89cd-71ce3cd547ae tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:38.222830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-588772af-f2e8-445d-89cd-71ce3cd547ae tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:38.229280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-588772af-f2e8-445d-89cd-71ce3cd547ae tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:38.230059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-588772af-f2e8-445d-89cd-71ce3cd547ae tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:38.273950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-55f9f537-b580-4382-9417-810b9f5e91f2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:38.283859 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-55f9f537-b580-4382-9417-810b9f5e91f2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1511 microversion: 2.1 time: 0.894715 Oct 12 22:05:38.302817 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 890/1696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:37 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1511 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:38.317630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe862fe9-fc50-46ec-b09d-a7f336a1c086 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:38.318289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fe862fe9-fc50-46ec-b09d-a7f336a1c086 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:38.338369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe862fe9-fc50-46ec-b09d-a7f336a1c086 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:38.338865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe862fe9-fc50-46ec-b09d-a7f336a1c086 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:38.343439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe862fe9-fc50-46ec-b09d-a7f336a1c086 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:38.344387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe862fe9-fc50-46ec-b09d-a7f336a1c086 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:38.344881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe862fe9-fc50-46ec-b09d-a7f336a1c086 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:38.345457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe862fe9-fc50-46ec-b09d-a7f336a1c086 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:38.729506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fe862fe9-fc50-46ec-b09d-a7f336a1c086 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:38.740055 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fe862fe9-fc50-46ec-b09d-a7f336a1c086 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1543 microversion: 2.1 time: 0.435395 Oct 12 22:05:38.740649 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 891/1697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:38 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1543 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:38.755073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-26d1552a-ac88-4f11-9beb-962ac4fb7617 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:38.756248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-26d1552a-ac88-4f11-9beb-962ac4fb7617 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 747a8555-8993-47b3-a6de-2f32f025e240] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:38.770005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26d1552a-ac88-4f11-9beb-962ac4fb7617 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:38.771110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26d1552a-ac88-4f11-9beb-962ac4fb7617 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:38.773657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26d1552a-ac88-4f11-9beb-962ac4fb7617 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:38.774603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26d1552a-ac88-4f11-9beb-962ac4fb7617 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:38.776727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26d1552a-ac88-4f11-9beb-962ac4fb7617 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:38.777345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26d1552a-ac88-4f11-9beb-962ac4fb7617 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:38.882031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-588772af-f2e8-445d-89cd-71ce3cd547ae tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:38.899406 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-588772af-f2e8-445d-89cd-71ce3cd547ae tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1316 microversion: 2.1 time: 0.706035 Oct 12 22:05:38.903280 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 807/1698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:38 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1316 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:38.904845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-416021b5-597d-49dd-a6c8-f4d6ed8d1a40 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:38.905456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-416021b5-597d-49dd-a6c8-f4d6ed8d1a40 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:38.917398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-416021b5-597d-49dd-a6c8-f4d6ed8d1a40 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:38.918154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-416021b5-597d-49dd-a6c8-f4d6ed8d1a40 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:38.918782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-416021b5-597d-49dd-a6c8-f4d6ed8d1a40 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:38.919712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-416021b5-597d-49dd-a6c8-f4d6ed8d1a40 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:38.920165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-416021b5-597d-49dd-a6c8-f4d6ed8d1a40 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:38.920589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-416021b5-597d-49dd-a6c8-f4d6ed8d1a40 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:39.304122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-26d1552a-ac88-4f11-9beb-962ac4fb7617 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:39.317307 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-26d1552a-ac88-4f11-9beb-962ac4fb7617 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240" status: 200 len: 1512 microversion: 2.1 time: 0.575547 Oct 12 22:05:39.340862 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 892/1699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:38 2022] GET /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240 => generated 1512 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:39.360716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5c0c1372-b8b5-415c-b104-288e4f5b1241 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:39.361342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5c0c1372-b8b5-415c-b104-288e4f5b1241 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:39.375440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c0c1372-b8b5-415c-b104-288e4f5b1241 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:39.375931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c0c1372-b8b5-415c-b104-288e4f5b1241 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:39.376369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c0c1372-b8b5-415c-b104-288e4f5b1241 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:39.377069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c0c1372-b8b5-415c-b104-288e4f5b1241 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:39.380825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c0c1372-b8b5-415c-b104-288e4f5b1241 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:39.381546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c0c1372-b8b5-415c-b104-288e4f5b1241 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:39.490929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5c0c1372-b8b5-415c-b104-288e4f5b1241 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:39.509336 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5c0c1372-b8b5-415c-b104-288e4f5b1241 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1266 microversion: 2.1 time: 0.167119 Oct 12 22:05:39.523270 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 893/1700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:39 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:39.523270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-3b9d549d-c605-40ee-8198-2847e5ba0b7e req-d6133446-ede9-435d-8452-917c25383093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe4575c-4bfa-4907-80a1-6cbfeb246f72", "tag": "91f7b233-578e-4e47-81c2-cc982b4b0605"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:39.569108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3b9d549d-c605-40ee-8198-2847e5ba0b7e req-d6133446-ede9-435d-8452-917c25383093 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:39.577250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3b9d549d-c605-40ee-8198-2847e5ba0b7e req-d6133446-ede9-435d-8452-917c25383093 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:39.577832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3b9d549d-c605-40ee-8198-2847e5ba0b7e req-d6133446-ede9-435d-8452-917c25383093 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:39.631662 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-3b9d549d-c605-40ee-8198-2847e5ba0b7e req-d6133446-ede9-435d-8452-917c25383093 service nova] Creating event network-changed:91f7b233-578e-4e47-81c2-cc982b4b0605 for instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 on n-h2-861111-1 Oct 12 22:05:39.666267 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-3b9d549d-c605-40ee-8198-2847e5ba0b7e req-d6133446-ede9-435d-8452-917c25383093 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154648 Oct 12 22:05:39.672321 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 894/1701] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:39.687394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-88bc55e7-23b8-49e7-a83a-28429c6929f6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:39.710928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-88bc55e7-23b8-49e7-a83a-28429c6929f6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:39.745635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88bc55e7-23b8-49e7-a83a-28429c6929f6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:39.750029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88bc55e7-23b8-49e7-a83a-28429c6929f6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:39.750783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88bc55e7-23b8-49e7-a83a-28429c6929f6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:39.751786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88bc55e7-23b8-49e7-a83a-28429c6929f6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:39.752463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88bc55e7-23b8-49e7-a83a-28429c6929f6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:39.754027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88bc55e7-23b8-49e7-a83a-28429c6929f6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:39.893042 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-88bc55e7-23b8-49e7-a83a-28429c6929f6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.218643 Oct 12 22:05:39.895793 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 895/1702] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:05:39 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:05:39.907721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-57fb8658-d5f5-4a49-a341-f765422b0e7a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:39.910229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-57fb8658-d5f5-4a49-a341-f765422b0e7a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:39.928428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57fb8658-d5f5-4a49-a341-f765422b0e7a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:39.928957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57fb8658-d5f5-4a49-a341-f765422b0e7a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:39.932772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57fb8658-d5f5-4a49-a341-f765422b0e7a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:39.933927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57fb8658-d5f5-4a49-a341-f765422b0e7a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:39.934903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57fb8658-d5f5-4a49-a341-f765422b0e7a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:39.935369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57fb8658-d5f5-4a49-a341-f765422b0e7a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:40.349911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-416021b5-597d-49dd-a6c8-f4d6ed8d1a40 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:40.358127 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-416021b5-597d-49dd-a6c8-f4d6ed8d1a40 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1313 microversion: 2.1 time: 1.456759 Oct 12 22:05:40.365435 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 808/1703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:38 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1313 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:40.380840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a2ff38a7-26b8-4377-9c70-32bce9a890d5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:40.381762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a2ff38a7-26b8-4377-9c70-32bce9a890d5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:40.405997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2ff38a7-26b8-4377-9c70-32bce9a890d5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:40.406868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2ff38a7-26b8-4377-9c70-32bce9a890d5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:40.407552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2ff38a7-26b8-4377-9c70-32bce9a890d5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:40.408512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2ff38a7-26b8-4377-9c70-32bce9a890d5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:40.409197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2ff38a7-26b8-4377-9c70-32bce9a890d5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:40.409816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2ff38a7-26b8-4377-9c70-32bce9a890d5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:40.434168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-57fb8658-d5f5-4a49-a341-f765422b0e7a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:40.447332 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-57fb8658-d5f5-4a49-a341-f765422b0e7a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1511 microversion: 2.1 time: 0.547273 Oct 12 22:05:40.449179 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 896/1704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:39 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1511 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:40.458455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8ee7c32a-6d23-40d5-9980-e3ff4325cb69 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:40.462100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8ee7c32a-6d23-40d5-9980-e3ff4325cb69 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:40.478899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee7c32a-6d23-40d5-9980-e3ff4325cb69 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:40.479554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee7c32a-6d23-40d5-9980-e3ff4325cb69 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:40.480070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee7c32a-6d23-40d5-9980-e3ff4325cb69 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:40.482143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee7c32a-6d23-40d5-9980-e3ff4325cb69 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:40.483192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee7c32a-6d23-40d5-9980-e3ff4325cb69 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:40.484518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee7c32a-6d23-40d5-9980-e3ff4325cb69 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:40.946871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8ee7c32a-6d23-40d5-9980-e3ff4325cb69 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:40.964375 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8ee7c32a-6d23-40d5-9980-e3ff4325cb69 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1316 microversion: 2.1 time: 0.509862 Oct 12 22:05:40.965466 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 897/1705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:40 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1316 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:40.978874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-53ba2695-d7b3-4c27-a894-fa02340379ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:40.999217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-53ba2695-d7b3-4c27-a894-fa02340379ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:40.999569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-53ba2695-d7b3-4c27-a894-fa02340379ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:41.438279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53ba2695-d7b3-4c27-a894-fa02340379ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:41.440206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53ba2695-d7b3-4c27-a894-fa02340379ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:41.440916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53ba2695-d7b3-4c27-a894-fa02340379ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:41.441829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53ba2695-d7b3-4c27-a894-fa02340379ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:41.442613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53ba2695-d7b3-4c27-a894-fa02340379ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:41.444210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53ba2695-d7b3-4c27-a894-fa02340379ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:41.734539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-53ba2695-d7b3-4c27-a894-fa02340379ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:05:42.005179 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-53ba2695-d7b3-4c27-a894-fa02340379ad tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 346 microversion: 2.1 time: 1.038350 Oct 12 22:05:42.008160 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 898/1706] 10.222.0.16 () {58 vars in 1154 bytes} [Wed Oct 12 22:05:40 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 346 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:42.034705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6d1a39b9-c802-4d9e-9e3d-92adb497dff5 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:42.040001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6d1a39b9-c802-4d9e-9e3d-92adb497dff5 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:42.058470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d1a39b9-c802-4d9e-9e3d-92adb497dff5 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:42.059115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d1a39b9-c802-4d9e-9e3d-92adb497dff5 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:42.064135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d1a39b9-c802-4d9e-9e3d-92adb497dff5 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:42.067799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d1a39b9-c802-4d9e-9e3d-92adb497dff5 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:42.068963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d1a39b9-c802-4d9e-9e3d-92adb497dff5 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:42.069744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d1a39b9-c802-4d9e-9e3d-92adb497dff5 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:42.486434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a2ff38a7-26b8-4377-9c70-32bce9a890d5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:42.507628 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a2ff38a7-26b8-4377-9c70-32bce9a890d5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1542 microversion: 2.1 time: 2.140676 Oct 12 22:05:42.528839 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 809/1707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:40 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1542 bytes in 2163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:42.547228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2cee21e1-950f-4283-ad87-4ceb028df53a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:42.564161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2cee21e1-950f-4283-ad87-4ceb028df53a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:42.585752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cee21e1-950f-4283-ad87-4ceb028df53a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:42.587518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cee21e1-950f-4283-ad87-4ceb028df53a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:42.588370 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cee21e1-950f-4283-ad87-4ceb028df53a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:42.589347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cee21e1-950f-4283-ad87-4ceb028df53a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:42.589976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cee21e1-950f-4283-ad87-4ceb028df53a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:42.590613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cee21e1-950f-4283-ad87-4ceb028df53a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:42.667993 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2cee21e1-950f-4283-ad87-4ceb028df53a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.137391 Oct 12 22:05:42.668594 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 810/1708] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:05:42 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:05:42.684811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-461cbd9c-25ba-4f81-a459-63e6fa73fd83 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:42.685452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-461cbd9c-25ba-4f81-a459-63e6fa73fd83 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:42.700866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-461cbd9c-25ba-4f81-a459-63e6fa73fd83 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:42.701669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-461cbd9c-25ba-4f81-a459-63e6fa73fd83 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:42.702325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-461cbd9c-25ba-4f81-a459-63e6fa73fd83 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:42.703255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-461cbd9c-25ba-4f81-a459-63e6fa73fd83 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:42.704241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-461cbd9c-25ba-4f81-a459-63e6fa73fd83 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:42.708175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-461cbd9c-25ba-4f81-a459-63e6fa73fd83 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:42.820433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6d1a39b9-c802-4d9e-9e3d-92adb497dff5 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:42.838923 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6d1a39b9-c802-4d9e-9e3d-92adb497dff5 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1308 microversion: 2.1 time: 0.829369 Oct 12 22:05:42.840154 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 899/1709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:42 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1308 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:42.851218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4ab6b7b4-decc-4894-af82-191a7c0e9289 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:42.854348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4ab6b7b4-decc-4894-af82-191a7c0e9289 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:42.871737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ab6b7b4-decc-4894-af82-191a7c0e9289 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:42.874111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ab6b7b4-decc-4894-af82-191a7c0e9289 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:42.875882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ab6b7b4-decc-4894-af82-191a7c0e9289 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:42.876674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ab6b7b4-decc-4894-af82-191a7c0e9289 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:42.881654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ab6b7b4-decc-4894-af82-191a7c0e9289 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:42.881654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ab6b7b4-decc-4894-af82-191a7c0e9289 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:43.267995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4ab6b7b4-decc-4894-af82-191a7c0e9289 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:43.280047 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4ab6b7b4-decc-4894-af82-191a7c0e9289 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1316 microversion: 2.1 time: 0.438611 Oct 12 22:05:43.283007 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 900/1710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:42 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1316 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:43.295486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b3ab4068-70d8-404b-93fa-2545f045f673 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:43.296349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b3ab4068-70d8-404b-93fa-2545f045f673 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:43.315059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3ab4068-70d8-404b-93fa-2545f045f673 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:43.315873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3ab4068-70d8-404b-93fa-2545f045f673 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:43.318750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3ab4068-70d8-404b-93fa-2545f045f673 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:43.321945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3ab4068-70d8-404b-93fa-2545f045f673 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:43.322768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3ab4068-70d8-404b-93fa-2545f045f673 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:43.325213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3ab4068-70d8-404b-93fa-2545f045f673 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:43.499300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-461cbd9c-25ba-4f81-a459-63e6fa73fd83 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:43.511123 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-461cbd9c-25ba-4f81-a459-63e6fa73fd83 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1313 microversion: 2.1 time: 0.841450 Oct 12 22:05:43.512003 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 811/1711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:42 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1313 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:43.523227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-5964f8cb-77ff-4bd5-958d-fa70362e0950 req-c95155f5-5698-4f51-b47d-4c0130e12520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae4e25e-f720-42f5-aaa1-eac6492e37d3", "name": "network-vif-unplugged", "status": "completed", "tag": "17538477-fced-4d99-b30b-5724d63d3744"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:43.554220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5964f8cb-77ff-4bd5-958d-fa70362e0950 req-c95155f5-5698-4f51-b47d-4c0130e12520 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:43.555644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5964f8cb-77ff-4bd5-958d-fa70362e0950 req-c95155f5-5698-4f51-b47d-4c0130e12520 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:43.556274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5964f8cb-77ff-4bd5-958d-fa70362e0950 req-c95155f5-5698-4f51-b47d-4c0130e12520 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:43.587135 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-5964f8cb-77ff-4bd5-958d-fa70362e0950 req-c95155f5-5698-4f51-b47d-4c0130e12520 service nova] Creating event network-vif-unplugged:17538477-fced-4d99-b30b-5724d63d3744 for instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 on n-h2-861111-1 Oct 12 22:05:43.605637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-5964f8cb-77ff-4bd5-958d-fa70362e0950 req-c95155f5-5698-4f51-b47d-4c0130e12520 service nova] Instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:05:43.643775 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-5964f8cb-77ff-4bd5-958d-fa70362e0950 req-c95155f5-5698-4f51-b47d-4c0130e12520 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124682 Oct 12 22:05:43.644705 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 812/1712] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:43.657457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-47b0e131-a6fd-4128-b07d-52327362d759 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:43.671813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-47b0e131-a6fd-4128-b07d-52327362d759 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:43.679194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b0e131-a6fd-4128-b07d-52327362d759 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:43.679975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b0e131-a6fd-4128-b07d-52327362d759 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:43.680723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b0e131-a6fd-4128-b07d-52327362d759 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:43.683541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b0e131-a6fd-4128-b07d-52327362d759 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:43.684197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b0e131-a6fd-4128-b07d-52327362d759 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:43.691842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b0e131-a6fd-4128-b07d-52327362d759 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:43.746623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b3ab4068-70d8-404b-93fa-2545f045f673 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:43.751025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:43.758410 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b3ab4068-70d8-404b-93fa-2545f045f673 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1511 microversion: 2.1 time: 0.472776 Oct 12 22:05:43.771997 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 901/1713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:43 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1511 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:43.785918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e65b90e4-43c9-4a4e-ac28-f03e63a0be06 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:43.789732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e65b90e4-43c9-4a4e-ac28-f03e63a0be06 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:43.833104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e65b90e4-43c9-4a4e-ac28-f03e63a0be06 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:43.833975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e65b90e4-43c9-4a4e-ac28-f03e63a0be06 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:43.843938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e65b90e4-43c9-4a4e-ac28-f03e63a0be06 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:43.844873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e65b90e4-43c9-4a4e-ac28-f03e63a0be06 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:43.845465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e65b90e4-43c9-4a4e-ac28-f03e63a0be06 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:43.846017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e65b90e4-43c9-4a4e-ac28-f03e63a0be06 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:43.929773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:43.944543 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e65b90e4-43c9-4a4e-ac28-f03e63a0be06 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.171187 Oct 12 22:05:43.955121 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 902/1714] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:05:43 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:05:43.963839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-33fa95f9-ca76-4c5d-a276-f17fcc4954cc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:43.968180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-33fa95f9-ca76-4c5d-a276-f17fcc4954cc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 747a8555-8993-47b3-a6de-2f32f025e240] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:43.981388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33fa95f9-ca76-4c5d-a276-f17fcc4954cc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:43.982393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33fa95f9-ca76-4c5d-a276-f17fcc4954cc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:43.983166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33fa95f9-ca76-4c5d-a276-f17fcc4954cc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:43.984168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33fa95f9-ca76-4c5d-a276-f17fcc4954cc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:43.984854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33fa95f9-ca76-4c5d-a276-f17fcc4954cc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:43.985501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33fa95f9-ca76-4c5d-a276-f17fcc4954cc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:44.241955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:44.278245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-33fa95f9-ca76-4c5d-a276-f17fcc4954cc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:44.298681 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-33fa95f9-ca76-4c5d-a276-f17fcc4954cc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240" status: 200 len: 1512 microversion: 2.1 time: 0.342080 Oct 12 22:05:44.299788 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 903/1715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:43 2022] GET /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240 => generated 1512 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:44.321143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=14 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:44.323430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7a3557d3-acf0-4ce7-94e6-da339b9cfbc8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:44.324052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7a3557d3-acf0-4ce7-94e6-da339b9cfbc8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:44.357370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a3557d3-acf0-4ce7-94e6-da339b9cfbc8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:44.357883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a3557d3-acf0-4ce7-94e6-da339b9cfbc8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:44.358322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a3557d3-acf0-4ce7-94e6-da339b9cfbc8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:44.364670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a3557d3-acf0-4ce7-94e6-da339b9cfbc8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:44.365531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a3557d3-acf0-4ce7-94e6-da339b9cfbc8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:44.366255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a3557d3-acf0-4ce7-94e6-da339b9cfbc8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:44.400251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=8 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:44.473118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-47b0e131-a6fd-4128-b07d-52327362d759 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:44.488287 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-47b0e131-a6fd-4128-b07d-52327362d759 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1542 microversion: 2.1 time: 0.842287 Oct 12 22:05:44.490571 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 813/1716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:43 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1542 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:44.504231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-0220bed0-dbea-48f4-b27f-07dfec9df66f req-6d6d1b8f-1ca2-4976-8c8f-adf58ef2874a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef20289-f683-41c1-8a71-b632098119c7", "tag": "a80001d4-8ef9-4f37-9c36-558312053557"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:44.551774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0220bed0-dbea-48f4-b27f-07dfec9df66f req-6d6d1b8f-1ca2-4976-8c8f-adf58ef2874a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:44.553231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0220bed0-dbea-48f4-b27f-07dfec9df66f req-6d6d1b8f-1ca2-4976-8c8f-adf58ef2874a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:44.553853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0220bed0-dbea-48f4-b27f-07dfec9df66f req-6d6d1b8f-1ca2-4976-8c8f-adf58ef2874a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:44.575014 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-0220bed0-dbea-48f4-b27f-07dfec9df66f req-6d6d1b8f-1ca2-4976-8c8f-adf58ef2874a service nova] Creating event network-changed:a80001d4-8ef9-4f37-9c36-558312053557 for instance 6ef20289-f683-41c1-8a71-b632098119c7 on n-h1-861111-1 Oct 12 22:05:44.583528 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-0220bed0-dbea-48f4-b27f-07dfec9df66f req-6d6d1b8f-1ca2-4976-8c8f-adf58ef2874a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082764 Oct 12 22:05:44.587725 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 814/1717] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:44.593443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e79bcbb9-6d26-47c1-b17a-2add7554d22e tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:44.600540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e79bcbb9-6d26-47c1-b17a-2add7554d22e tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:44.613620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e79bcbb9-6d26-47c1-b17a-2add7554d22e tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:44.621240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e79bcbb9-6d26-47c1-b17a-2add7554d22e tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:44.622052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e79bcbb9-6d26-47c1-b17a-2add7554d22e tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:44.622990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e79bcbb9-6d26-47c1-b17a-2add7554d22e tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:44.624031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e79bcbb9-6d26-47c1-b17a-2add7554d22e tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:44.624623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e79bcbb9-6d26-47c1-b17a-2add7554d22e tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:44.625648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7a3557d3-acf0-4ce7-94e6-da339b9cfbc8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:44.636994 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7a3557d3-acf0-4ce7-94e6-da339b9cfbc8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1308 microversion: 2.1 time: 0.324880 Oct 12 22:05:44.654056 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 904/1718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:44 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1308 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:44.654056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b6be24ba-781c-4376-aab0-f7ad10b8d719 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:44.654056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b6be24ba-781c-4376-aab0-f7ad10b8d719 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:44.666623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6be24ba-781c-4376-aab0-f7ad10b8d719 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:44.667473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6be24ba-781c-4376-aab0-f7ad10b8d719 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:44.668828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6be24ba-781c-4376-aab0-f7ad10b8d719 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:44.670699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6be24ba-781c-4376-aab0-f7ad10b8d719 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:44.671317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6be24ba-781c-4376-aab0-f7ad10b8d719 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:44.674441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6be24ba-781c-4376-aab0-f7ad10b8d719 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:45.268587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b6be24ba-781c-4376-aab0-f7ad10b8d719 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:45.294300 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b6be24ba-781c-4376-aab0-f7ad10b8d719 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1511 microversion: 2.1 time: 0.647581 Oct 12 22:05:45.296660 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 905/1719] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:44 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1511 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:45.316712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-003b225d-edd2-4024-9ad9-0354043775fb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:45.320073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-003b225d-edd2-4024-9ad9-0354043775fb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:45.341295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-003b225d-edd2-4024-9ad9-0354043775fb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:45.342259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-003b225d-edd2-4024-9ad9-0354043775fb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:45.342939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-003b225d-edd2-4024-9ad9-0354043775fb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:45.343947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-003b225d-edd2-4024-9ad9-0354043775fb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:45.344639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-003b225d-edd2-4024-9ad9-0354043775fb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:45.345450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-003b225d-edd2-4024-9ad9-0354043775fb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:45.724714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-003b225d-edd2-4024-9ad9-0354043775fb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:45.761631 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-003b225d-edd2-4024-9ad9-0354043775fb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1313 microversion: 2.1 time: 0.455158 Oct 12 22:05:45.778710 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 906/1720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:45 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:45.778710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f361184a-1039-4ef7-95d9-f1c163b812e6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:45.779653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e79bcbb9-6d26-47c1-b17a-2add7554d22e tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:45.783317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f361184a-1039-4ef7-95d9-f1c163b812e6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:45.795800 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e79bcbb9-6d26-47c1-b17a-2add7554d22e tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1316 microversion: 2.1 time: 1.202594 Oct 12 22:05:45.804421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f361184a-1039-4ef7-95d9-f1c163b812e6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:45.808035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f361184a-1039-4ef7-95d9-f1c163b812e6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:45.808527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f361184a-1039-4ef7-95d9-f1c163b812e6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:45.809973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f361184a-1039-4ef7-95d9-f1c163b812e6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:45.810464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f361184a-1039-4ef7-95d9-f1c163b812e6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:45.810906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f361184a-1039-4ef7-95d9-f1c163b812e6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:45.814644 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 815/1721] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:44 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1316 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:45.827997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fd322410-b145-415f-af6e-f3a753edec15 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:45.878121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fd322410-b145-415f-af6e-f3a753edec15 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:45.879653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fd322410-b145-415f-af6e-f3a753edec15 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:45.897538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd322410-b145-415f-af6e-f3a753edec15 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:45.900352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd322410-b145-415f-af6e-f3a753edec15 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:45.900352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd322410-b145-415f-af6e-f3a753edec15 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:45.902462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd322410-b145-415f-af6e-f3a753edec15 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:45.905158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd322410-b145-415f-af6e-f3a753edec15 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:45.906127 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f361184a-1039-4ef7-95d9-f1c163b812e6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.141621 Oct 12 22:05:45.906853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd322410-b145-415f-af6e-f3a753edec15 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:45.917697 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 907/1722] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:05:45 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d/os-volume_attachments => generated 25 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:45.939043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-70cdd4ba-551d-4571-900a-9c4c02be93ff tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:45.947304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-70cdd4ba-551d-4571-900a-9c4c02be93ff tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:45.957593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70cdd4ba-551d-4571-900a-9c4c02be93ff tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:45.958119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70cdd4ba-551d-4571-900a-9c4c02be93ff tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:45.963749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70cdd4ba-551d-4571-900a-9c4c02be93ff tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:45.966443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70cdd4ba-551d-4571-900a-9c4c02be93ff tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:45.967953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70cdd4ba-551d-4571-900a-9c4c02be93ff tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:45.968498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70cdd4ba-551d-4571-900a-9c4c02be93ff tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:46.206559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.multi_cell_list [None req-fd322410-b145-415f-af6e-f3a753edec15 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:05:46.389663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fd322410-b145-415f-af6e-f3a753edec15 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:46.406313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd322410-b145-415f-af6e-f3a753edec15 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:46.406884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd322410-b145-415f-af6e-f3a753edec15 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:46.408837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd322410-b145-415f-af6e-f3a753edec15 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:46.540902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-70cdd4ba-551d-4571-900a-9c4c02be93ff tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:46.565871 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-70cdd4ba-551d-4571-900a-9c4c02be93ff tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1542 microversion: 2.1 time: 0.645412 Oct 12 22:05:46.571171 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 908/1723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:45 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1542 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:46.581463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6cf1d201-230b-4c4b-bfc1-55bc68be1abf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:46.582083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6cf1d201-230b-4c4b-bfc1-55bc68be1abf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:46.598499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf1d201-230b-4c4b-bfc1-55bc68be1abf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:46.599579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf1d201-230b-4c4b-bfc1-55bc68be1abf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:46.600028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf1d201-230b-4c4b-bfc1-55bc68be1abf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:46.604369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf1d201-230b-4c4b-bfc1-55bc68be1abf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:46.604845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf1d201-230b-4c4b-bfc1-55bc68be1abf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:46.605282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf1d201-230b-4c4b-bfc1-55bc68be1abf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:46.967689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6cf1d201-230b-4c4b-bfc1-55bc68be1abf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:46.981209 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6cf1d201-230b-4c4b-bfc1-55bc68be1abf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1308 microversion: 2.1 time: 0.408103 Oct 12 22:05:46.983898 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 909/1724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:46 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1308 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:46.995001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-90f40878-0c11-4c97-82d6-d8ce3399e6c2 req-c963d40b-2719-488c-9997-d1e6fe8be755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c959e4d2-bad7-4b6f-967b-b10e0b1719d8", "tag": "a616a035-3557-43db-817b-5c5ee008485a"}, {"name": "network-changed", "server_uuid": "0a0bc29c-b01a-4913-b58d-0f0368eeaa52", "tag": "8f924ca4-6121-4359-b81c-8b01b45de897"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:47.014737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-90f40878-0c11-4c97-82d6-d8ce3399e6c2 req-c963d40b-2719-488c-9997-d1e6fe8be755 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:47.015319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-90f40878-0c11-4c97-82d6-d8ce3399e6c2 req-c963d40b-2719-488c-9997-d1e6fe8be755 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:47.015763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-90f40878-0c11-4c97-82d6-d8ce3399e6c2 req-c963d40b-2719-488c-9997-d1e6fe8be755 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:47.048437 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-90f40878-0c11-4c97-82d6-d8ce3399e6c2 req-c963d40b-2719-488c-9997-d1e6fe8be755 service nova] Creating event network-changed:a616a035-3557-43db-817b-5c5ee008485a for instance c959e4d2-bad7-4b6f-967b-b10e0b1719d8 on n-h1-861111-1 Oct 12 22:05:47.048970 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-90f40878-0c11-4c97-82d6-d8ce3399e6c2 req-c963d40b-2719-488c-9997-d1e6fe8be755 service nova] Creating event network-changed:8f924ca4-6121-4359-b81c-8b01b45de897 for instance 0a0bc29c-b01a-4913-b58d-0f0368eeaa52 on n-h1-861111-1 Oct 12 22:05:47.062562 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-90f40878-0c11-4c97-82d6-d8ce3399e6c2 req-c963d40b-2719-488c-9997-d1e6fe8be755 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077528 Oct 12 22:05:47.068320 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 910/1725] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:47.076430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-51c95bde-be28-4bb5-8804-cb0e724f7eea tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:47.077162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-51c95bde-be28-4bb5-8804-cb0e724f7eea tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:47.091551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:47.097974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51c95bde-be28-4bb5-8804-cb0e724f7eea tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:47.098499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51c95bde-be28-4bb5-8804-cb0e724f7eea tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:47.098975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51c95bde-be28-4bb5-8804-cb0e724f7eea tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:47.099846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51c95bde-be28-4bb5-8804-cb0e724f7eea tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:47.100307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51c95bde-be28-4bb5-8804-cb0e724f7eea tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:47.100740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51c95bde-be28-4bb5-8804-cb0e724f7eea tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:47.545646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-51c95bde-be28-4bb5-8804-cb0e724f7eea tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:47.555344 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-51c95bde-be28-4bb5-8804-cb0e724f7eea tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1313 microversion: 2.1 time: 0.485751 Oct 12 22:05:47.576209 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 911/1726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:47 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:47.581458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5044992b-5056-43aa-8191-a4afe4a0e8c7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:47.589400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5044992b-5056-43aa-8191-a4afe4a0e8c7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:47.601346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5044992b-5056-43aa-8191-a4afe4a0e8c7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:47.604984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5044992b-5056-43aa-8191-a4afe4a0e8c7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:47.605657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5044992b-5056-43aa-8191-a4afe4a0e8c7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:47.606858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5044992b-5056-43aa-8191-a4afe4a0e8c7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:47.607522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5044992b-5056-43aa-8191-a4afe4a0e8c7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:47.608061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5044992b-5056-43aa-8191-a4afe4a0e8c7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:47.769729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5044992b-5056-43aa-8191-a4afe4a0e8c7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:47.783634 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5044992b-5056-43aa-8191-a4afe4a0e8c7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1316 microversion: 2.1 time: 0.206001 Oct 12 22:05:47.785239 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 912/1727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:47 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:47.790802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-53acd2a9-7051-43ac-8acb-b288e1520d8d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:47.791765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-53acd2a9-7051-43ac-8acb-b288e1520d8d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:47.798462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53acd2a9-7051-43ac-8acb-b288e1520d8d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:47.799313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53acd2a9-7051-43ac-8acb-b288e1520d8d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:47.800038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53acd2a9-7051-43ac-8acb-b288e1520d8d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:47.800982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53acd2a9-7051-43ac-8acb-b288e1520d8d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:47.801667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53acd2a9-7051-43ac-8acb-b288e1520d8d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:47.802439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53acd2a9-7051-43ac-8acb-b288e1520d8d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:47.836004 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fd322410-b145-415f-af6e-f3a753edec15 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 2.015612 Oct 12 22:05:47.837848 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 816/1728] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:05:45 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:47.869093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cba769e4-c849-452d-8d65-0ba2ab260708 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:47.874586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cba769e4-c849-452d-8d65-0ba2ab260708 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:47.883396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cba769e4-c849-452d-8d65-0ba2ab260708 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:48.032509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-53acd2a9-7051-43ac-8acb-b288e1520d8d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:48.054436 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-53acd2a9-7051-43ac-8acb-b288e1520d8d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1542 microversion: 2.1 time: 0.267788 Oct 12 22:05:48.055045 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 913/1729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:47 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1542 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:48.059944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-42618ba1-d2bc-41ff-b38a-752175c6694e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:48.060820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-42618ba1-d2bc-41ff-b38a-752175c6694e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:48.068277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42618ba1-d2bc-41ff-b38a-752175c6694e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:48.069187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42618ba1-d2bc-41ff-b38a-752175c6694e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:48.069623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42618ba1-d2bc-41ff-b38a-752175c6694e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:48.070330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42618ba1-d2bc-41ff-b38a-752175c6694e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:48.070775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42618ba1-d2bc-41ff-b38a-752175c6694e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:48.071192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42618ba1-d2bc-41ff-b38a-752175c6694e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:48.172357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cba769e4-c849-452d-8d65-0ba2ab260708 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:48.173870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cba769e4-c849-452d-8d65-0ba2ab260708 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:48.174694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cba769e4-c849-452d-8d65-0ba2ab260708 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:48.176049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cba769e4-c849-452d-8d65-0ba2ab260708 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:48.177210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cba769e4-c849-452d-8d65-0ba2ab260708 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:48.178256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cba769e4-c849-452d-8d65-0ba2ab260708 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:48.263486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-42618ba1-d2bc-41ff-b38a-752175c6694e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:48.281997 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-42618ba1-d2bc-41ff-b38a-752175c6694e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1308 microversion: 2.1 time: 0.225686 Oct 12 22:05:48.282718 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 914/1730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:48 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:48.315369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.multi_cell_list [None req-cba769e4-c849-452d-8d65-0ba2ab260708 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:05:48.425248 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cba769e4-c849-452d-8d65-0ba2ab260708 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.559883 Oct 12 22:05:48.427555 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 817/1731] 10.222.0.16 () {58 vars in 1150 bytes} [Wed Oct 12 22:05:47 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:05:48.441777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e68f9e9d-d1f0-44d0-805f-1294a6f4e36d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:48.451376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e68f9e9d-d1f0-44d0-805f-1294a6f4e36d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:48.455956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e68f9e9d-d1f0-44d0-805f-1294a6f4e36d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:48.496462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e68f9e9d-d1f0-44d0-805f-1294a6f4e36d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:48.496970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e68f9e9d-d1f0-44d0-805f-1294a6f4e36d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:48.502651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e68f9e9d-d1f0-44d0-805f-1294a6f4e36d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:48.506746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e68f9e9d-d1f0-44d0-805f-1294a6f4e36d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:48.510432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e68f9e9d-d1f0-44d0-805f-1294a6f4e36d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:48.512849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e68f9e9d-d1f0-44d0-805f-1294a6f4e36d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:48.591887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-815f2a42-3631-4275-bf06-d82bc127acbc tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:48.592940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-815f2a42-3631-4275-bf06-d82bc127acbc tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:48.613351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-815f2a42-3631-4275-bf06-d82bc127acbc tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:48.614042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-815f2a42-3631-4275-bf06-d82bc127acbc tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:48.615040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-815f2a42-3631-4275-bf06-d82bc127acbc tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:48.618782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-815f2a42-3631-4275-bf06-d82bc127acbc tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:48.621311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-815f2a42-3631-4275-bf06-d82bc127acbc tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:48.622214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-815f2a42-3631-4275-bf06-d82bc127acbc tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:48.757697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-e68f9e9d-d1f0-44d0-805f-1294a6f4e36d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:05:48.921603 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e68f9e9d-d1f0-44d0-805f-1294a6f4e36d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.484025 Oct 12 22:05:48.931014 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 915/1732] 10.222.0.16 () {58 vars in 1212 bytes} [Wed Oct 12 22:05:48 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:05:48.937056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d40ce796-781f-43cc-8eed-6cdae14fbd26 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:48.939607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d40ce796-781f-43cc-8eed-6cdae14fbd26 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:48.946862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d40ce796-781f-43cc-8eed-6cdae14fbd26 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:48.947461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d40ce796-781f-43cc-8eed-6cdae14fbd26 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:48.947904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d40ce796-781f-43cc-8eed-6cdae14fbd26 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:48.948880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d40ce796-781f-43cc-8eed-6cdae14fbd26 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:48.949280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d40ce796-781f-43cc-8eed-6cdae14fbd26 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:48.949879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d40ce796-781f-43cc-8eed-6cdae14fbd26 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:49.037332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-815f2a42-3631-4275-bf06-d82bc127acbc tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:49.051072 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-815f2a42-3631-4275-bf06-d82bc127acbc tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1313 microversion: 2.1 time: 0.464103 Oct 12 22:05:49.052580 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 818/1733] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:48 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:05:49.057685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c5c52cf7-dd6e-470a-ab92-6e464c7db08f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:49.070735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c5c52cf7-dd6e-470a-ab92-6e464c7db08f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:49.081303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c5c52cf7-dd6e-470a-ab92-6e464c7db08f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:49.099640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5c52cf7-dd6e-470a-ab92-6e464c7db08f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:49.101976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5c52cf7-dd6e-470a-ab92-6e464c7db08f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:49.111065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5c52cf7-dd6e-470a-ab92-6e464c7db08f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:49.115043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5c52cf7-dd6e-470a-ab92-6e464c7db08f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:49.115762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5c52cf7-dd6e-470a-ab92-6e464c7db08f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:49.117667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5c52cf7-dd6e-470a-ab92-6e464c7db08f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:49.152801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d40ce796-781f-43cc-8eed-6cdae14fbd26 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:49.170308 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d40ce796-781f-43cc-8eed-6cdae14fbd26 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1316 microversion: 2.1 time: 0.237015 Oct 12 22:05:49.170963 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 916/1734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:48 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1316 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:49.187299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-937b3805-d834-4a40-9915-3f4b813d8f09 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:49.187848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-937b3805-d834-4a40-9915-3f4b813d8f09 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:49.225553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-937b3805-d834-4a40-9915-3f4b813d8f09 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:49.226205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-937b3805-d834-4a40-9915-3f4b813d8f09 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:49.226660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-937b3805-d834-4a40-9915-3f4b813d8f09 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:49.236099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-937b3805-d834-4a40-9915-3f4b813d8f09 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:49.236725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-937b3805-d834-4a40-9915-3f4b813d8f09 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:49.237177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-937b3805-d834-4a40-9915-3f4b813d8f09 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:49.364820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.multi_cell_list [None req-c5c52cf7-dd6e-470a-ab92-6e464c7db08f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:05:49.507537 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c5c52cf7-dd6e-470a-ab92-6e464c7db08f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.449604 Oct 12 22:05:49.508307 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 819/1735] 10.222.0.16 () {58 vars in 1196 bytes} [Wed Oct 12 22:05:49 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:49.523142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-27d206b2-4460-417e-ac7b-bc96cac4dc78 req-3fa6fe25-ff10-4541-9171-34fb26c6eacd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae4e25e-f720-42f5-aaa1-eac6492e37d3", "tag": "17538477-fced-4d99-b30b-5724d63d3744"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:49.557575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-27d206b2-4460-417e-ac7b-bc96cac4dc78 req-3fa6fe25-ff10-4541-9171-34fb26c6eacd service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:49.558060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-27d206b2-4460-417e-ac7b-bc96cac4dc78 req-3fa6fe25-ff10-4541-9171-34fb26c6eacd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:49.558940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-27d206b2-4460-417e-ac7b-bc96cac4dc78 req-3fa6fe25-ff10-4541-9171-34fb26c6eacd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:49.609775 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-27d206b2-4460-417e-ac7b-bc96cac4dc78 req-3fa6fe25-ff10-4541-9171-34fb26c6eacd service nova] Creating event network-changed:17538477-fced-4d99-b30b-5724d63d3744 for instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 on n-h2-861111-1 Oct 12 22:05:49.618932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-27d206b2-4460-417e-ac7b-bc96cac4dc78 req-3fa6fe25-ff10-4541-9171-34fb26c6eacd service nova] Instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:05:49.635171 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-27d206b2-4460-417e-ac7b-bc96cac4dc78 req-3fa6fe25-ff10-4541-9171-34fb26c6eacd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124900 Oct 12 22:05:49.639738 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 820/1736] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:49.652880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-80ed3bad-38f3-449a-8b9f-b87b8e9b116f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:49.654118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-80ed3bad-38f3-449a-8b9f-b87b8e9b116f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:49.670934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80ed3bad-38f3-449a-8b9f-b87b8e9b116f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:49.674621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80ed3bad-38f3-449a-8b9f-b87b8e9b116f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:49.675113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80ed3bad-38f3-449a-8b9f-b87b8e9b116f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:49.677088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80ed3bad-38f3-449a-8b9f-b87b8e9b116f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:49.677088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80ed3bad-38f3-449a-8b9f-b87b8e9b116f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:49.677088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80ed3bad-38f3-449a-8b9f-b87b8e9b116f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:49.705985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-937b3805-d834-4a40-9915-3f4b813d8f09 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:49.721642 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-937b3805-d834-4a40-9915-3f4b813d8f09 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1474 microversion: 2.1 time: 0.546131 Oct 12 22:05:49.740673 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 917/1737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:49 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1474 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:49.752090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-98352a0b-aba2-40b9-bf8b-7af9ce440fd6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:49.760856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-98352a0b-aba2-40b9-bf8b-7af9ce440fd6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:49.761513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-98352a0b-aba2-40b9-bf8b-7af9ce440fd6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'name': '1464234974', 'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:49.799813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98352a0b-aba2-40b9-bf8b-7af9ce440fd6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:49.800304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98352a0b-aba2-40b9-bf8b-7af9ce440fd6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:49.800747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98352a0b-aba2-40b9-bf8b-7af9ce440fd6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:49.801477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98352a0b-aba2-40b9-bf8b-7af9ce440fd6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:49.802027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98352a0b-aba2-40b9-bf8b-7af9ce440fd6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:49.802488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98352a0b-aba2-40b9-bf8b-7af9ce440fd6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:50.049158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-98352a0b-aba2-40b9-bf8b-7af9ce440fd6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:05:50.075980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-80ed3bad-38f3-449a-8b9f-b87b8e9b116f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:50.084182 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-80ed3bad-38f3-449a-8b9f-b87b8e9b116f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1308 microversion: 2.1 time: 0.442803 Oct 12 22:05:50.085001 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 821/1738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:49 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1308 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:50.100650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-902ef30a-64b1-49d5-809e-24b2643ce242 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:50.101534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-902ef30a-64b1-49d5-809e-24b2643ce242 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:50.116374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-902ef30a-64b1-49d5-809e-24b2643ce242 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:50.117120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-902ef30a-64b1-49d5-809e-24b2643ce242 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:50.117743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-902ef30a-64b1-49d5-809e-24b2643ce242 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:50.118612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-902ef30a-64b1-49d5-809e-24b2643ce242 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:50.119227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-902ef30a-64b1-49d5-809e-24b2643ce242 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:50.119832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-902ef30a-64b1-49d5-809e-24b2643ce242 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:50.159277 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-98352a0b-aba2-40b9-bf8b-7af9ce440fd6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers?name=1464234974" status: 200 len: 346 microversion: 2.1 time: 0.417035 Oct 12 22:05:50.160819 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 918/1739] 10.222.0.16 () {58 vars in 1156 bytes} [Wed Oct 12 22:05:49 2022] GET /compute/v2.1/servers?name=1464234974 => generated 346 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:50.174453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3b328c80-9bf5-4acf-aa9d-949f52e91912 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:50.180139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3b328c80-9bf5-4acf-aa9d-949f52e91912 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:50.180886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3b328c80-9bf5-4acf-aa9d-949f52e91912 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:50.186237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b328c80-9bf5-4acf-aa9d-949f52e91912 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:50.186788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b328c80-9bf5-4acf-aa9d-949f52e91912 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:50.189072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b328c80-9bf5-4acf-aa9d-949f52e91912 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:50.189906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b328c80-9bf5-4acf-aa9d-949f52e91912 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:50.190448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b328c80-9bf5-4acf-aa9d-949f52e91912 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:50.193452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b328c80-9bf5-4acf-aa9d-949f52e91912 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:50.282689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-902ef30a-64b1-49d5-809e-24b2643ce242 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:50.292775 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-902ef30a-64b1-49d5-809e-24b2643ce242 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1313 microversion: 2.1 time: 0.196364 Oct 12 22:05:50.293356 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 822/1740] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:50 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:50.295176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-3b328c80-9bf5-4acf-aa9d-949f52e91912 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:05:50.298207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:50.307777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fe44be62-db78-48a5-acf0-d8533298e892 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:50.308963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fe44be62-db78-48a5-acf0-d8533298e892 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:50.315560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe44be62-db78-48a5-acf0-d8533298e892 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:50.316046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe44be62-db78-48a5-acf0-d8533298e892 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:50.316483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe44be62-db78-48a5-acf0-d8533298e892 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:50.317241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe44be62-db78-48a5-acf0-d8533298e892 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:50.318386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe44be62-db78-48a5-acf0-d8533298e892 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:50.318838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe44be62-db78-48a5-acf0-d8533298e892 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:50.358154 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3b328c80-9bf5-4acf-aa9d-949f52e91912 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.188363 Oct 12 22:05:50.359216 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 919/1741] 10.222.0.16 () {58 vars in 1154 bytes} [Wed Oct 12 22:05:50 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:05:50.374073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c6be5230-1ee4-48e2-9c74-bbf953ffe1bc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:50.379201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c6be5230-1ee4-48e2-9c74-bbf953ffe1bc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:50.381219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c6be5230-1ee4-48e2-9c74-bbf953ffe1bc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-146423497', 'deleted': False, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:05:50.391806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6be5230-1ee4-48e2-9c74-bbf953ffe1bc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:50.392664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6be5230-1ee4-48e2-9c74-bbf953ffe1bc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:50.394152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6be5230-1ee4-48e2-9c74-bbf953ffe1bc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:50.394877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6be5230-1ee4-48e2-9c74-bbf953ffe1bc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:50.396029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6be5230-1ee4-48e2-9c74-bbf953ffe1bc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:50.396562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6be5230-1ee4-48e2-9c74-bbf953ffe1bc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:50.480471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fe44be62-db78-48a5-acf0-d8533298e892 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:50.491162 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fe44be62-db78-48a5-acf0-d8533298e892 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1316 microversion: 2.1 time: 0.196255 Oct 12 22:05:50.495277 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 823/1742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:50 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1316 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:50.510577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-c6be5230-1ee4-48e2-9c74-bbf953ffe1bc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:05:50.747941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d2106c48-faa8-419c-b7cf-65a6742718d9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:50.748563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d2106c48-faa8-419c-b7cf-65a6742718d9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:50.771722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2106c48-faa8-419c-b7cf-65a6742718d9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:50.771722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2106c48-faa8-419c-b7cf-65a6742718d9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:50.771722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2106c48-faa8-419c-b7cf-65a6742718d9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:50.771722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2106c48-faa8-419c-b7cf-65a6742718d9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:50.772765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2106c48-faa8-419c-b7cf-65a6742718d9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:50.772765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2106c48-faa8-419c-b7cf-65a6742718d9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:50.790311 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c6be5230-1ee4-48e2-9c74-bbf953ffe1bc tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-146423497" status: 200 len: 346 microversion: 2.1 time: 0.422109 Oct 12 22:05:50.791597 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 920/1743] 10.222.0.16 () {58 vars in 1228 bytes} [Wed Oct 12 22:05:50 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-146423497 => generated 346 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:05:50.804169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-27f532b6-e336-4f45-a419-916134316c07 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:50.804505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-27f532b6-e336-4f45-a419-916134316c07 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:50.811391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27f532b6-e336-4f45-a419-916134316c07 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:50.811808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27f532b6-e336-4f45-a419-916134316c07 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:50.812237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27f532b6-e336-4f45-a419-916134316c07 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:50.812935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27f532b6-e336-4f45-a419-916134316c07 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:50.813380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27f532b6-e336-4f45-a419-916134316c07 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:50.813805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27f532b6-e336-4f45-a419-916134316c07 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:50.846546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-27f532b6-e336-4f45-a419-916134316c07 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:05:50.957630 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-27f532b6-e336-4f45-a419-916134316c07 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "DELETE /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 204 len: 0 microversion: 2.1 time: 0.157026 Oct 12 22:05:50.958265 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 921/1744] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:05:50 2022] DELETE /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:05:50.967355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e00ec4e1-cea9-4205-968f-f0ab26469ed0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:50.968824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e00ec4e1-cea9-4205-968f-f0ab26469ed0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:50.969967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d2106c48-faa8-419c-b7cf-65a6742718d9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:50.983729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e00ec4e1-cea9-4205-968f-f0ab26469ed0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:50.987180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e00ec4e1-cea9-4205-968f-f0ab26469ed0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:50.987669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e00ec4e1-cea9-4205-968f-f0ab26469ed0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:50.988426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e00ec4e1-cea9-4205-968f-f0ab26469ed0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:50.988894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e00ec4e1-cea9-4205-968f-f0ab26469ed0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:50.989870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e00ec4e1-cea9-4205-968f-f0ab26469ed0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:50.998183 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d2106c48-faa8-419c-b7cf-65a6742718d9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1474 microversion: 2.1 time: 0.254111 Oct 12 22:05:50.999951 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 824/1745] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:50 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1474 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:51.071223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1999440682", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "13df621a-275e-488a-8347-5e43bb46475f"}], "block_device_mapping_v2": [{"uuid": "eb660ccc-7cc1-42fb-b160-d52a685d79ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:51.183966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] validate_networks() for [('13df621a-275e-488a-8347-5e43bb46475f', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:05:51.258248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e00ec4e1-cea9-4205-968f-f0ab26469ed0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:51.279672 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e00ec4e1-cea9-4205-968f-f0ab26469ed0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1517 microversion: 2.1 time: 0.316688 Oct 12 22:05:51.293414 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 922/1746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:50 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1517 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:51.293414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2d9416eb-c669-4eb8-ba17-655900b706e8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:51.293414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2d9416eb-c669-4eb8-ba17-655900b706e8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:51.308397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d9416eb-c669-4eb8-ba17-655900b706e8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:51.317609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d9416eb-c669-4eb8-ba17-655900b706e8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:51.318167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d9416eb-c669-4eb8-ba17-655900b706e8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:51.319122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d9416eb-c669-4eb8-ba17-655900b706e8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:51.319648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d9416eb-c669-4eb8-ba17-655900b706e8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:51.320095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d9416eb-c669-4eb8-ba17-655900b706e8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:51.574897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2d9416eb-c669-4eb8-ba17-655900b706e8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:51.595784 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2d9416eb-c669-4eb8-ba17-655900b706e8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1308 microversion: 2.1 time: 0.310940 Oct 12 22:05:51.596738 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 923/1747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:51 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1308 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:51.601919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-abfe3a51-6eff-4e3a-b024-5560cd3e7b62 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:51.602537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-abfe3a51-6eff-4e3a-b024-5560cd3e7b62 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:51.617601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abfe3a51-6eff-4e3a-b024-5560cd3e7b62 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:51.618174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abfe3a51-6eff-4e3a-b024-5560cd3e7b62 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:51.618621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abfe3a51-6eff-4e3a-b024-5560cd3e7b62 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:51.619451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abfe3a51-6eff-4e3a-b024-5560cd3e7b62 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:51.619944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abfe3a51-6eff-4e3a-b024-5560cd3e7b62 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:51.620379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abfe3a51-6eff-4e3a-b024-5560cd3e7b62 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:51.829329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:05:51.829750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:05:51.830225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:05:51.830778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:05:51.831204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:05:51.849559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:51.851913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:51.854376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:51.855514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:51.857662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:51.858476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:51.895900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Getting quotas for project 61e71a9eeaa044e8aa939548f15a585e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:05:51.914720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Getting quotas for user 1fe98ba1ceec4b849eb45eb46ce4d425 and project 61e71a9eeaa044e8aa939548f15a585e. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:05:51.953459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-abfe3a51-6eff-4e3a-b024-5560cd3e7b62 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:51.968026 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-abfe3a51-6eff-4e3a-b024-5560cd3e7b62 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1313 microversion: 2.1 time: 0.369877 Oct 12 22:05:51.984099 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 924/1748] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:51 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:51.994470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f3eeaf2e-acf5-4ce5-9a2a-149c5fbe5f06 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:51.995117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f3eeaf2e-acf5-4ce5-9a2a-149c5fbe5f06 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:52.002696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3eeaf2e-acf5-4ce5-9a2a-149c5fbe5f06 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:52.008612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3eeaf2e-acf5-4ce5-9a2a-149c5fbe5f06 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:52.008612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3eeaf2e-acf5-4ce5-9a2a-149c5fbe5f06 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:52.008612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3eeaf2e-acf5-4ce5-9a2a-149c5fbe5f06 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:52.008612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3eeaf2e-acf5-4ce5-9a2a-149c5fbe5f06 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:52.009231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3eeaf2e-acf5-4ce5-9a2a-149c5fbe5f06 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:52.054544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:05:52.057263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb660ccc-7cc1-42fb-b160-d52a685d79ec',volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:05:52.225170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f3eeaf2e-acf5-4ce5-9a2a-149c5fbe5f06 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:52.236578 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f3eeaf2e-acf5-4ce5-9a2a-149c5fbe5f06 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1316 microversion: 2.1 time: 0.251271 Oct 12 22:05:52.248524 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 925/1749] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:51 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:52.248524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0ee5ded7-16f3-4d8d-ac76-9c632c0ecacb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:52.248524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0ee5ded7-16f3-4d8d-ac76-9c632c0ecacb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:52.256504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ee5ded7-16f3-4d8d-ac76-9c632c0ecacb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:52.256504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ee5ded7-16f3-4d8d-ac76-9c632c0ecacb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:52.256504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ee5ded7-16f3-4d8d-ac76-9c632c0ecacb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:52.256504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ee5ded7-16f3-4d8d-ac76-9c632c0ecacb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:52.256947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ee5ded7-16f3-4d8d-ac76-9c632c0ecacb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:52.256947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ee5ded7-16f3-4d8d-ac76-9c632c0ecacb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:52.375016 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3137e27d-cf5a-49dd-97b4-a520ff31c76d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.310669 Oct 12 22:05:52.384649 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 825/1750] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:05:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:05:52.413604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3b352abb-e56b-44c6-ae8b-7c31864f30d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:52.417687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3b352abb-e56b-44c6-ae8b-7c31864f30d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:52.435556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b352abb-e56b-44c6-ae8b-7c31864f30d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:52.437756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b352abb-e56b-44c6-ae8b-7c31864f30d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:52.454660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b352abb-e56b-44c6-ae8b-7c31864f30d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:52.456026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b352abb-e56b-44c6-ae8b-7c31864f30d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:52.458000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b352abb-e56b-44c6-ae8b-7c31864f30d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:52.461518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b352abb-e56b-44c6-ae8b-7c31864f30d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:52.906055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0ee5ded7-16f3-4d8d-ac76-9c632c0ecacb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:52.920748 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0ee5ded7-16f3-4d8d-ac76-9c632c0ecacb tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1474 microversion: 2.1 time: 0.681506 Oct 12 22:05:52.921361 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 926/1751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:52 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1474 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:52.951737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b4e4cafd-ad9b-4e3f-9218-99d5ed8f63c2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:52.952387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b4e4cafd-ad9b-4e3f-9218-99d5ed8f63c2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:53.022739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3b352abb-e56b-44c6-ae8b-7c31864f30d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:53.036820 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3b352abb-e56b-44c6-ae8b-7c31864f30d4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1517 microversion: 2.1 time: 0.646589 Oct 12 22:05:53.038019 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 826/1752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:52 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1517 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:53.048267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb01fa99-b02c-4b4e-8b42-09556b49020e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:53.049687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eb01fa99-b02c-4b4e-8b42-09556b49020e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:53.051622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b4e4cafd-ad9b-4e3f-9218-99d5ed8f63c2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:53.063316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb01fa99-b02c-4b4e-8b42-09556b49020e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:53.068106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb01fa99-b02c-4b4e-8b42-09556b49020e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:53.068631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb01fa99-b02c-4b4e-8b42-09556b49020e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:53.069649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb01fa99-b02c-4b4e-8b42-09556b49020e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:53.070210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb01fa99-b02c-4b4e-8b42-09556b49020e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:53.070758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb01fa99-b02c-4b4e-8b42-09556b49020e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:53.076374 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b4e4cafd-ad9b-4e3f-9218-99d5ed8f63c2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1053 microversion: 2.1 time: 0.151430 Oct 12 22:05:53.076974 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 927/1753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:52 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1053 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:53.088175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-233ffbdd-b43d-47a8-9334-de7023898b13 req-4acfc49d-b83a-4f33-816a-95cc0e0c6f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c959e4d2-bad7-4b6f-967b-b10e0b1719d8", "name": "network-vif-plugged", "status": "completed", "tag": "a616a035-3557-43db-817b-5c5ee008485a"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:53.112469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-233ffbdd-b43d-47a8-9334-de7023898b13 req-4acfc49d-b83a-4f33-816a-95cc0e0c6f59 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:53.112947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-233ffbdd-b43d-47a8-9334-de7023898b13 req-4acfc49d-b83a-4f33-816a-95cc0e0c6f59 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:53.113403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-233ffbdd-b43d-47a8-9334-de7023898b13 req-4acfc49d-b83a-4f33-816a-95cc0e0c6f59 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:53.128742 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-233ffbdd-b43d-47a8-9334-de7023898b13 req-4acfc49d-b83a-4f33-816a-95cc0e0c6f59 service nova] Creating event network-vif-plugged:a616a035-3557-43db-817b-5c5ee008485a for instance c959e4d2-bad7-4b6f-967b-b10e0b1719d8 on n-h1-861111-1 Oct 12 22:05:53.138648 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-233ffbdd-b43d-47a8-9334-de7023898b13 req-4acfc49d-b83a-4f33-816a-95cc0e0c6f59 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056399 Oct 12 22:05:53.139867 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 928/1754] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:53.146002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d171fb54-ffe0-427d-908b-d6b7a7393763 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:53.146979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d171fb54-ffe0-427d-908b-d6b7a7393763 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:53.154441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d171fb54-ffe0-427d-908b-d6b7a7393763 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:53.155196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d171fb54-ffe0-427d-908b-d6b7a7393763 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:53.155832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d171fb54-ffe0-427d-908b-d6b7a7393763 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:53.156735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d171fb54-ffe0-427d-908b-d6b7a7393763 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:53.157560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d171fb54-ffe0-427d-908b-d6b7a7393763 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:53.158211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d171fb54-ffe0-427d-908b-d6b7a7393763 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:53.301774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eb01fa99-b02c-4b4e-8b42-09556b49020e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:53.318331 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb01fa99-b02c-4b4e-8b42-09556b49020e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1308 microversion: 2.1 time: 0.272810 Oct 12 22:05:53.321135 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 827/1755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:53 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1308 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:53.330002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9ca9fd1c-c642-4688-bdf5-03af965499d7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:53.330852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9ca9fd1c-c642-4688-bdf5-03af965499d7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:53.339215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ca9fd1c-c642-4688-bdf5-03af965499d7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:53.339934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ca9fd1c-c642-4688-bdf5-03af965499d7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:53.340681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ca9fd1c-c642-4688-bdf5-03af965499d7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:53.342434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ca9fd1c-c642-4688-bdf5-03af965499d7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:53.343424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ca9fd1c-c642-4688-bdf5-03af965499d7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:53.344395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ca9fd1c-c642-4688-bdf5-03af965499d7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:53.418847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d171fb54-ffe0-427d-908b-d6b7a7393763 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:53.428508 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d171fb54-ffe0-427d-908b-d6b7a7393763 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1313 microversion: 2.1 time: 0.287022 Oct 12 22:05:53.429628 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 929/1756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:53 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:53.518768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9ca9fd1c-c642-4688-bdf5-03af965499d7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:53.528142 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9ca9fd1c-c642-4688-bdf5-03af965499d7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1316 microversion: 2.1 time: 0.205760 Oct 12 22:05:53.528721 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 828/1757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:53 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1316 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:53.947754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f0ab3117-5c74-4f0e-baea-0d0e5ac05e3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:53.948829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f0ab3117-5c74-4f0e-baea-0d0e5ac05e3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:53.956883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0ab3117-5c74-4f0e-baea-0d0e5ac05e3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:53.957589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0ab3117-5c74-4f0e-baea-0d0e5ac05e3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:53.958336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0ab3117-5c74-4f0e-baea-0d0e5ac05e3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:53.959194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0ab3117-5c74-4f0e-baea-0d0e5ac05e3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:53.959685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0ab3117-5c74-4f0e-baea-0d0e5ac05e3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:53.960499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0ab3117-5c74-4f0e-baea-0d0e5ac05e3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:54.059604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c1053404-d9e3-4d1e-a28f-d2583f55bdb6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:54.060643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c1053404-d9e3-4d1e-a28f-d2583f55bdb6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:54.069156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1053404-d9e3-4d1e-a28f-d2583f55bdb6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:54.070127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1053404-d9e3-4d1e-a28f-d2583f55bdb6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:54.070743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1053404-d9e3-4d1e-a28f-d2583f55bdb6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:54.072020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1053404-d9e3-4d1e-a28f-d2583f55bdb6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:54.072891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1053404-d9e3-4d1e-a28f-d2583f55bdb6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:54.073500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1053404-d9e3-4d1e-a28f-d2583f55bdb6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:54.117880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f0ab3117-5c74-4f0e-baea-0d0e5ac05e3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:54.126555 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f0ab3117-5c74-4f0e-baea-0d0e5ac05e3e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1471 microversion: 2.1 time: 0.184214 Oct 12 22:05:54.127448 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 930/1758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:53 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1471 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:54.132827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-032d24e9-9a5e-49b0-bfb6-349b6f5cdf1d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:54.133474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-032d24e9-9a5e-49b0-bfb6-349b6f5cdf1d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:54.139462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-032d24e9-9a5e-49b0-bfb6-349b6f5cdf1d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:54.140149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-032d24e9-9a5e-49b0-bfb6-349b6f5cdf1d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:54.140776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-032d24e9-9a5e-49b0-bfb6-349b6f5cdf1d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:54.141650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-032d24e9-9a5e-49b0-bfb6-349b6f5cdf1d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:54.142394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-032d24e9-9a5e-49b0-bfb6-349b6f5cdf1d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:54.142988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-032d24e9-9a5e-49b0-bfb6-349b6f5cdf1d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:54.208371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-032d24e9-9a5e-49b0-bfb6-349b6f5cdf1d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:54.218669 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-032d24e9-9a5e-49b0-bfb6-349b6f5cdf1d tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1151 microversion: 2.1 time: 0.090101 Oct 12 22:05:54.229046 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 931/1759] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:54 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1151 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:54.231079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c1053404-d9e3-4d1e-a28f-d2583f55bdb6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:54.234497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7a8063ff-f295-48fb-bcc2-46890217707c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:54.235044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7a8063ff-f295-48fb-bcc2-46890217707c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:54.239761 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c1053404-d9e3-4d1e-a28f-d2583f55bdb6 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1517 microversion: 2.1 time: 0.183457 Oct 12 22:05:54.243615 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 829/1760] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:54 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:05:54.248576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a8063ff-f295-48fb-bcc2-46890217707c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:54.249076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a8063ff-f295-48fb-bcc2-46890217707c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:54.249554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a8063ff-f295-48fb-bcc2-46890217707c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:54.250270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a8063ff-f295-48fb-bcc2-46890217707c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:54.250735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a8063ff-f295-48fb-bcc2-46890217707c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:54.251171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a8063ff-f295-48fb-bcc2-46890217707c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:54.289659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a8063ff-f295-48fb-bcc2-46890217707c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:54.290174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a8063ff-f295-48fb-bcc2-46890217707c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:54.290641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a8063ff-f295-48fb-bcc2-46890217707c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:54.291404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a8063ff-f295-48fb-bcc2-46890217707c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:54.291867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a8063ff-f295-48fb-bcc2-46890217707c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:54.292292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a8063ff-f295-48fb-bcc2-46890217707c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:54.318138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-7a8063ff-f295-48fb-bcc2-46890217707c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Getting quotas for project 7d943f8c0c934001b53032564fd00e11. Resources: {'ram', 'cores'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:05:54.323466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-7a8063ff-f295-48fb-bcc2-46890217707c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Getting quotas for user cfc7df27bf6f456581abff6e80ab4f64 and project 7d943f8c0c934001b53032564fd00e11. Resources: {'ram', 'cores'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:05:54.342007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4a81861c-69c5-4b1c-881e-9fc304fa528f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:54.342624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4a81861c-69c5-4b1c-881e-9fc304fa528f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:54.364944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a81861c-69c5-4b1c-881e-9fc304fa528f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:54.365356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a81861c-69c5-4b1c-881e-9fc304fa528f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:54.366010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a81861c-69c5-4b1c-881e-9fc304fa528f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:54.366708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a81861c-69c5-4b1c-881e-9fc304fa528f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:54.370641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a81861c-69c5-4b1c-881e-9fc304fa528f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:54.371085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a81861c-69c5-4b1c-881e-9fc304fa528f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:54.378197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:54.423752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:54.484343 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7a8063ff-f295-48fb-bcc2-46890217707c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "POST /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3/action" status: 202 len: 0 microversion: 2.1 time: 0.253956 Oct 12 22:05:54.484966 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 932/1761] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:05:54 2022] POST /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:05:54.496479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8385e401-87aa-4e53-b0e9-7a59d3e37a0f tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:54.500121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8385e401-87aa-4e53-b0e9-7a59d3e37a0f tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:54.516888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8385e401-87aa-4e53-b0e9-7a59d3e37a0f tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:54.517413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8385e401-87aa-4e53-b0e9-7a59d3e37a0f tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:54.517844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8385e401-87aa-4e53-b0e9-7a59d3e37a0f tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:54.523107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8385e401-87aa-4e53-b0e9-7a59d3e37a0f tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:54.523686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8385e401-87aa-4e53-b0e9-7a59d3e37a0f tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:54.524141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8385e401-87aa-4e53-b0e9-7a59d3e37a0f tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:54.840397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4a81861c-69c5-4b1c-881e-9fc304fa528f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:54.858739 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4a81861c-69c5-4b1c-881e-9fc304fa528f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1308 microversion: 2.1 time: 0.520458 Oct 12 22:05:54.859661 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 830/1762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:54 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1308 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:54.864489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3977f8d0-b3ce-40cd-99d9-c863489c60ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:54.865296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3977f8d0-b3ce-40cd-99d9-c863489c60ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:54.877297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8385e401-87aa-4e53-b0e9-7a59d3e37a0f tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:54.880000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3977f8d0-b3ce-40cd-99d9-c863489c60ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:54.881634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3977f8d0-b3ce-40cd-99d9-c863489c60ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:54.882356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3977f8d0-b3ce-40cd-99d9-c863489c60ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:54.883287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3977f8d0-b3ce-40cd-99d9-c863489c60ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:54.885511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3977f8d0-b3ce-40cd-99d9-c863489c60ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:54.886214 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8385e401-87aa-4e53-b0e9-7a59d3e37a0f tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1313 microversion: 2.1 time: 0.400033 Oct 12 22:05:54.899411 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 933/1763] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:54 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:54.900256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-90d0cd87-ebf4-442c-b651-102601652bf7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:54.900844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3977f8d0-b3ce-40cd-99d9-c863489c60ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:54.908741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-90d0cd87-ebf4-442c-b651-102601652bf7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:54.923197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90d0cd87-ebf4-442c-b651-102601652bf7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:54.923715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90d0cd87-ebf4-442c-b651-102601652bf7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:54.924152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90d0cd87-ebf4-442c-b651-102601652bf7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:54.924858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90d0cd87-ebf4-442c-b651-102601652bf7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:54.925312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90d0cd87-ebf4-442c-b651-102601652bf7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:54.925736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90d0cd87-ebf4-442c-b651-102601652bf7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:55.181506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-90d0cd87-ebf4-442c-b651-102601652bf7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:55.189826 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-90d0cd87-ebf4-442c-b651-102601652bf7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1316 microversion: 2.1 time: 0.299128 Oct 12 22:05:55.190369 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 934/1764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:54 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:55.253918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9d300b66-e48f-463e-9be6-637c0504b1f4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:55.254573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9d300b66-e48f-463e-9be6-637c0504b1f4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:55.265690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d300b66-e48f-463e-9be6-637c0504b1f4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:55.266179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d300b66-e48f-463e-9be6-637c0504b1f4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:55.266613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d300b66-e48f-463e-9be6-637c0504b1f4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:55.271387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d300b66-e48f-463e-9be6-637c0504b1f4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:55.271888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d300b66-e48f-463e-9be6-637c0504b1f4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:55.272340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d300b66-e48f-463e-9be6-637c0504b1f4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:55.387851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3977f8d0-b3ce-40cd-99d9-c863489c60ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:55.405995 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3977f8d0-b3ce-40cd-99d9-c863489c60ca tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1470 microversion: 2.1 time: 0.544144 Oct 12 22:05:55.423160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9d300b66-e48f-463e-9be6-637c0504b1f4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:55.424306 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9d300b66-e48f-463e-9be6-637c0504b1f4 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1169 microversion: 2.1 time: 0.173994 Oct 12 22:05:55.425267 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 935/1765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:55 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1169 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:05:55.425971 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 831/1766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:54 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1470 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:55.431153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8bfd48d7-52b4-4b26-9b69-314c19d0bb41 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:55.431834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8bfd48d7-52b4-4b26-9b69-314c19d0bb41 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:55.432219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-20e0594b-2aa3-4ab4-9162-895cd3ebec92 req-1aa4fd5d-36d3-4412-b771-ce3e96e9ba43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae4e25e-f720-42f5-aaa1-eac6492e37d3", "name": "network-vif-plugged", "status": "completed", "tag": "17538477-fced-4d99-b30b-5724d63d3744"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:55.446094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8bfd48d7-52b4-4b26-9b69-314c19d0bb41 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:55.446633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8bfd48d7-52b4-4b26-9b69-314c19d0bb41 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:55.447652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-20e0594b-2aa3-4ab4-9162-895cd3ebec92 req-1aa4fd5d-36d3-4412-b771-ce3e96e9ba43 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:55.448217 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-20e0594b-2aa3-4ab4-9162-895cd3ebec92 req-1aa4fd5d-36d3-4412-b771-ce3e96e9ba43 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:55.449210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8bfd48d7-52b4-4b26-9b69-314c19d0bb41 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:55.449348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-20e0594b-2aa3-4ab4-9162-895cd3ebec92 req-1aa4fd5d-36d3-4412-b771-ce3e96e9ba43 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:55.449976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8bfd48d7-52b4-4b26-9b69-314c19d0bb41 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:55.451989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8bfd48d7-52b4-4b26-9b69-314c19d0bb41 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:55.452458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8bfd48d7-52b4-4b26-9b69-314c19d0bb41 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:55.462537 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-20e0594b-2aa3-4ab4-9162-895cd3ebec92 req-1aa4fd5d-36d3-4412-b771-ce3e96e9ba43 service nova] Creating event network-vif-plugged:17538477-fced-4d99-b30b-5724d63d3744 for instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 on n-h2-861111-1 Oct 12 22:05:55.469026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-20e0594b-2aa3-4ab4-9162-895cd3ebec92 req-1aa4fd5d-36d3-4412-b771-ce3e96e9ba43 service nova] Instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:05:55.480608 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-20e0594b-2aa3-4ab4-9162-895cd3ebec92 req-1aa4fd5d-36d3-4412-b771-ce3e96e9ba43 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052407 Oct 12 22:05:55.481550 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 832/1767] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:55.742881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8bfd48d7-52b4-4b26-9b69-314c19d0bb41 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:55.781796 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8bfd48d7-52b4-4b26-9b69-314c19d0bb41 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1517 microversion: 2.1 time: 0.355436 Oct 12 22:05:55.782611 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 936/1768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:55 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1517 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:55.885643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-de9eacc4-19ae-41dc-8177-dd87ff61f7a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:55.887378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-de9eacc4-19ae-41dc-8177-dd87ff61f7a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:55.898687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de9eacc4-19ae-41dc-8177-dd87ff61f7a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:55.904123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de9eacc4-19ae-41dc-8177-dd87ff61f7a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:55.905142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de9eacc4-19ae-41dc-8177-dd87ff61f7a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:55.906182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de9eacc4-19ae-41dc-8177-dd87ff61f7a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:55.906981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de9eacc4-19ae-41dc-8177-dd87ff61f7a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:55.907765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de9eacc4-19ae-41dc-8177-dd87ff61f7a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:55.917090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1fe5359f-270b-45df-9249-bb554089daba tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:55.917720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1fe5359f-270b-45df-9249-bb554089daba tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:55.925651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fe5359f-270b-45df-9249-bb554089daba tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:55.926148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fe5359f-270b-45df-9249-bb554089daba tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:55.927211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fe5359f-270b-45df-9249-bb554089daba tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:55.927969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fe5359f-270b-45df-9249-bb554089daba tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:55.928424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fe5359f-270b-45df-9249-bb554089daba tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:55.928852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fe5359f-270b-45df-9249-bb554089daba tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:56.416800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1fe5359f-270b-45df-9249-bb554089daba tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:56.444549 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1fe5359f-270b-45df-9249-bb554089daba tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1313 microversion: 2.1 time: 0.531239 Oct 12 22:05:56.460405 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 937/1769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:55 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1313 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:56.469907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-44354248-1252-43ee-9e40-b52616def551 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:56.470787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-44354248-1252-43ee-9e40-b52616def551 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:56.486178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44354248-1252-43ee-9e40-b52616def551 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:56.486967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44354248-1252-43ee-9e40-b52616def551 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:56.487619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44354248-1252-43ee-9e40-b52616def551 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:56.490514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44354248-1252-43ee-9e40-b52616def551 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:56.490992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44354248-1252-43ee-9e40-b52616def551 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:56.491460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44354248-1252-43ee-9e40-b52616def551 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:56.728316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-de9eacc4-19ae-41dc-8177-dd87ff61f7a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:56.740066 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-de9eacc4-19ae-41dc-8177-dd87ff61f7a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1308 microversion: 2.1 time: 0.859110 Oct 12 22:05:56.773586 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 833/1770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:55 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1308 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:56.779068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-555a5c74-d9e5-4fde-8d2e-307172dcda0f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:56.779791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-555a5c74-d9e5-4fde-8d2e-307172dcda0f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:56.786689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-555a5c74-d9e5-4fde-8d2e-307172dcda0f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:56.787567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-555a5c74-d9e5-4fde-8d2e-307172dcda0f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:56.791857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-555a5c74-d9e5-4fde-8d2e-307172dcda0f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:56.792735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-555a5c74-d9e5-4fde-8d2e-307172dcda0f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:56.793320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-555a5c74-d9e5-4fde-8d2e-307172dcda0f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:56.793871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-555a5c74-d9e5-4fde-8d2e-307172dcda0f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:56.882253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-44354248-1252-43ee-9e40-b52616def551 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:56.890786 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-44354248-1252-43ee-9e40-b52616def551 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1316 microversion: 2.1 time: 0.428941 Oct 12 22:05:56.891625 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 938/1771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:56 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:56.912558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ba20ff7e-e351-4c14-bd41-5891c46b4e35 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:56.912558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ba20ff7e-e351-4c14-bd41-5891c46b4e35 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:56.934091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba20ff7e-e351-4c14-bd41-5891c46b4e35 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:56.934679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba20ff7e-e351-4c14-bd41-5891c46b4e35 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:56.935167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba20ff7e-e351-4c14-bd41-5891c46b4e35 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:56.935949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba20ff7e-e351-4c14-bd41-5891c46b4e35 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:56.936411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba20ff7e-e351-4c14-bd41-5891c46b4e35 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:56.936951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba20ff7e-e351-4c14-bd41-5891c46b4e35 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:57.040815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ba20ff7e-e351-4c14-bd41-5891c46b4e35 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:57.066140 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ba20ff7e-e351-4c14-bd41-5891c46b4e35 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1169 microversion: 2.1 time: 0.157199 Oct 12 22:05:57.069810 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 939/1772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:56 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1169 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:57.077053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f7714178-f0d8-4a48-9061-aa03da5bd9aa tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:57.078124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f7714178-f0d8-4a48-9061-aa03da5bd9aa tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:57.100872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7714178-f0d8-4a48-9061-aa03da5bd9aa tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:57.102275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7714178-f0d8-4a48-9061-aa03da5bd9aa tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:57.104998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7714178-f0d8-4a48-9061-aa03da5bd9aa tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:57.106025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7714178-f0d8-4a48-9061-aa03da5bd9aa tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:57.106970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7714178-f0d8-4a48-9061-aa03da5bd9aa tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:57.107716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7714178-f0d8-4a48-9061-aa03da5bd9aa tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:57.341442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f7714178-f0d8-4a48-9061-aa03da5bd9aa tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:57.349978 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f7714178-f0d8-4a48-9061-aa03da5bd9aa tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1517 microversion: 2.1 time: 0.278077 Oct 12 22:05:57.351485 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 940/1773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:57 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1517 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:57.438264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-555a5c74-d9e5-4fde-8d2e-307172dcda0f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:57.453613 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-555a5c74-d9e5-4fde-8d2e-307172dcda0f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1470 microversion: 2.1 time: 0.677279 Oct 12 22:05:57.455343 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 834/1774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:56 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1470 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:57.477939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-701ac652-04c8-4422-94f4-bcfbf45877a5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:57.479201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-701ac652-04c8-4422-94f4-bcfbf45877a5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:57.486005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-701ac652-04c8-4422-94f4-bcfbf45877a5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:57.486716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-701ac652-04c8-4422-94f4-bcfbf45877a5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:57.487366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-701ac652-04c8-4422-94f4-bcfbf45877a5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:57.488272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-701ac652-04c8-4422-94f4-bcfbf45877a5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:57.489452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-701ac652-04c8-4422-94f4-bcfbf45877a5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:57.490048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-701ac652-04c8-4422-94f4-bcfbf45877a5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:57.504463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-bcfb365c-2ff6-434f-a27d-5db6173ed81f req-89471e8d-0128-434c-b3eb-0a1ce0097099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0bc29c-b01a-4913-b58d-0f0368eeaa52", "name": "network-vif-plugged", "status": "completed", "tag": "8f924ca4-6121-4359-b81c-8b01b45de897"}, {"server_uuid": "951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9", "name": "network-vif-unplugged", "status": "completed", "tag": "c95c69b7-41e0-40e1-92f0-c4a3c4dc67ff"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:57.519791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-bcfb365c-2ff6-434f-a27d-5db6173ed81f req-89471e8d-0128-434c-b3eb-0a1ce0097099 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:57.520739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-bcfb365c-2ff6-434f-a27d-5db6173ed81f req-89471e8d-0128-434c-b3eb-0a1ce0097099 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:57.521395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-bcfb365c-2ff6-434f-a27d-5db6173ed81f req-89471e8d-0128-434c-b3eb-0a1ce0097099 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:57.556819 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-bcfb365c-2ff6-434f-a27d-5db6173ed81f req-89471e8d-0128-434c-b3eb-0a1ce0097099 service nova] Creating event network-vif-plugged:8f924ca4-6121-4359-b81c-8b01b45de897 for instance 0a0bc29c-b01a-4913-b58d-0f0368eeaa52 on n-h1-861111-1 Oct 12 22:05:57.557668 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-bcfb365c-2ff6-434f-a27d-5db6173ed81f req-89471e8d-0128-434c-b3eb-0a1ce0097099 service nova] Creating event network-vif-unplugged:c95c69b7-41e0-40e1-92f0-c4a3c4dc67ff for instance 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 on n-h1-861111-1 Oct 12 22:05:57.574203 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-bcfb365c-2ff6-434f-a27d-5db6173ed81f req-89471e8d-0128-434c-b3eb-0a1ce0097099 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.070679 Oct 12 22:05:57.578907 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 835/1775] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:05:57.731900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-701ac652-04c8-4422-94f4-bcfbf45877a5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:57.744899 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-701ac652-04c8-4422-94f4-bcfbf45877a5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1463 microversion: 2.1 time: 0.276304 Oct 12 22:05:57.749405 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 941/1776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:57 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1463 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:57.783769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c8f30755-5447-4b73-8d26-35e2ba717fde tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:57.785713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c8f30755-5447-4b73-8d26-35e2ba717fde tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:57.792817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:57.795774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8f30755-5447-4b73-8d26-35e2ba717fde tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:57.798106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8f30755-5447-4b73-8d26-35e2ba717fde tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:57.799287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8f30755-5447-4b73-8d26-35e2ba717fde tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:57.800536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8f30755-5447-4b73-8d26-35e2ba717fde tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:57.801236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8f30755-5447-4b73-8d26-35e2ba717fde tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:57.801890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8f30755-5447-4b73-8d26-35e2ba717fde tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:58.053317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3fda71d7-5688-4e8e-8a46-f59af2cc1fc0 tempest-TenantUsagesTestJSON-5073152 tempest-TenantUsagesTestJSON-5073152-project-admin] Calling method '.version_select at 0x7f51285bb5e0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:58.090809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fda71d7-5688-4e8e-8a46-f59af2cc1fc0 tempest-TenantUsagesTestJSON-5073152 tempest-TenantUsagesTestJSON-5073152-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:58.091597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fda71d7-5688-4e8e-8a46-f59af2cc1fc0 tempest-TenantUsagesTestJSON-5073152 tempest-TenantUsagesTestJSON-5073152-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:58.092219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fda71d7-5688-4e8e-8a46-f59af2cc1fc0 tempest-TenantUsagesTestJSON-5073152 tempest-TenantUsagesTestJSON-5073152-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:58.124883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fda71d7-5688-4e8e-8a46-f59af2cc1fc0 tempest-TenantUsagesTestJSON-5073152 tempest-TenantUsagesTestJSON-5073152-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:58.125618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fda71d7-5688-4e8e-8a46-f59af2cc1fc0 tempest-TenantUsagesTestJSON-5073152 tempest-TenantUsagesTestJSON-5073152-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:58.126225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fda71d7-5688-4e8e-8a46-f59af2cc1fc0 tempest-TenantUsagesTestJSON-5073152 tempest-TenantUsagesTestJSON-5073152-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:58.145946 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3fda71d7-5688-4e8e-8a46-f59af2cc1fc0 tempest-TenantUsagesTestJSON-5073152 tempest-TenantUsagesTestJSON-5073152-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/509ad64c9d1b4b7cae75ad66440ab755?start=2022-10-11T22%3A05%3A57.772492&end=2022-10-13T22%3A05%3A57.772492" status: 200 len: 699 microversion: 2.1 time: 0.369800 Oct 12 22:05:58.157100 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 942/1777] 10.222.0.16 () {58 vars in 1412 bytes} [Wed Oct 12 22:05:57 2022] GET /compute/v2.1/os-simple-tenant-usage/509ad64c9d1b4b7cae75ad66440ab755?start=2022-10-11T22%3A05%3A57.772492&end=2022-10-13T22%3A05%3A57.772492 => generated 699 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:05:58.162989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-33b3e5a0-26da-486d-877b-3dcddbda9ecf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:58.163639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-33b3e5a0-26da-486d-877b-3dcddbda9ecf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:58.170167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33b3e5a0-26da-486d-877b-3dcddbda9ecf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:58.170899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33b3e5a0-26da-486d-877b-3dcddbda9ecf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:58.171540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33b3e5a0-26da-486d-877b-3dcddbda9ecf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:58.172439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33b3e5a0-26da-486d-877b-3dcddbda9ecf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:58.173060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33b3e5a0-26da-486d-877b-3dcddbda9ecf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:58.173668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33b3e5a0-26da-486d-877b-3dcddbda9ecf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:58.381117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c8f30755-5447-4b73-8d26-35e2ba717fde tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:58.395722 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c8f30755-5447-4b73-8d26-35e2ba717fde tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1308 microversion: 2.1 time: 0.622727 Oct 12 22:05:58.397158 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 836/1778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:57 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1308 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:58.401890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-419159fe-9898-4d74-8f4b-00559becf003 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:58.403685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-419159fe-9898-4d74-8f4b-00559becf003 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:58.414337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-419159fe-9898-4d74-8f4b-00559becf003 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:58.417069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-419159fe-9898-4d74-8f4b-00559becf003 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:58.421230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-419159fe-9898-4d74-8f4b-00559becf003 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:58.422374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-419159fe-9898-4d74-8f4b-00559becf003 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:58.424673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-419159fe-9898-4d74-8f4b-00559becf003 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:58.426890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-419159fe-9898-4d74-8f4b-00559becf003 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:58.478719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-33b3e5a0-26da-486d-877b-3dcddbda9ecf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:58.493356 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-33b3e5a0-26da-486d-877b-3dcddbda9ecf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1316 microversion: 2.1 time: 0.334780 Oct 12 22:05:58.508812 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 943/1779] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:58 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1316 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:58.516980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b932d01d-6ce7-4e74-a497-b5097fb03bcb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '.version_select at 0x7f51284f84c0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:58.529055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b932d01d-6ce7-4e74-a497-b5097fb03bcb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:58.529838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b932d01d-6ce7-4e74-a497-b5097fb03bcb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:58.530474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b932d01d-6ce7-4e74-a497-b5097fb03bcb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:58.552552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b932d01d-6ce7-4e74-a497-b5097fb03bcb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:58.553055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b932d01d-6ce7-4e74-a497-b5097fb03bcb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:58.553499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b932d01d-6ce7-4e74-a497-b5097fb03bcb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:58.576704 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b932d01d-6ce7-4e74-a497-b5097fb03bcb tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/509ad64c9d1b4b7cae75ad66440ab755?start=2022-10-11T22%3A05%3A57.772492&end=2022-10-13T22%3A05%3A57.772492" status: 200 len: 695 microversion: 2.1 time: 0.066162 Oct 12 22:05:58.588016 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 944/1780] 10.222.0.16 () {58 vars in 1412 bytes} [Wed Oct 12 22:05:58 2022] GET /compute/v2.1/os-simple-tenant-usage/509ad64c9d1b4b7cae75ad66440ab755?start=2022-10-11T22%3A05%3A57.772492&end=2022-10-13T22%3A05%3A57.772492 => generated 695 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:58.593289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-476a68eb-ee8a-4b0e-8a15-1c77ce6c2c53 req-ae1436db-3ea6-40d9-90b2-c4548735a519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9", "name": "network-vif-deleted", "tag": "c95c69b7-41e0-40e1-92f0-c4a3c4dc67ff"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:58.620775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-476a68eb-ee8a-4b0e-8a15-1c77ce6c2c53 req-ae1436db-3ea6-40d9-90b2-c4548735a519 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:58.621607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-476a68eb-ee8a-4b0e-8a15-1c77ce6c2c53 req-ae1436db-3ea6-40d9-90b2-c4548735a519 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:58.622257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-476a68eb-ee8a-4b0e-8a15-1c77ce6c2c53 req-ae1436db-3ea6-40d9-90b2-c4548735a519 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:58.659800 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-476a68eb-ee8a-4b0e-8a15-1c77ce6c2c53 req-ae1436db-3ea6-40d9-90b2-c4548735a519 service nova] Creating event network-vif-deleted:c95c69b7-41e0-40e1-92f0-c4a3c4dc67ff for instance 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 on n-h1-861111-1 Oct 12 22:05:58.675138 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-476a68eb-ee8a-4b0e-8a15-1c77ce6c2c53 req-ae1436db-3ea6-40d9-90b2-c4548735a519 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084398 Oct 12 22:05:58.675861 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 945/1781] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:05:58.694757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-041df601-1649-4b04-bbcd-2a7153b40eb2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:58.698079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-041df601-1649-4b04-bbcd-2a7153b40eb2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:58.745105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-041df601-1649-4b04-bbcd-2a7153b40eb2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:58.756689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-041df601-1649-4b04-bbcd-2a7153b40eb2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:58.758801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-041df601-1649-4b04-bbcd-2a7153b40eb2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:58.760219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-041df601-1649-4b04-bbcd-2a7153b40eb2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:58.761154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-041df601-1649-4b04-bbcd-2a7153b40eb2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:58.763162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-041df601-1649-4b04-bbcd-2a7153b40eb2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:58.889047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-419159fe-9898-4d74-8f4b-00559becf003 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:58.899850 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-419159fe-9898-4d74-8f4b-00559becf003 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1211 microversion: 2.1 time: 0.501406 Oct 12 22:05:58.900046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-041df601-1649-4b04-bbcd-2a7153b40eb2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:58.900781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-041df601-1649-4b04-bbcd-2a7153b40eb2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:58.901320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-041df601-1649-4b04-bbcd-2a7153b40eb2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:58.901877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-041df601-1649-4b04-bbcd-2a7153b40eb2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lazy-loading 'fault' on Instance uuid 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:05:58.905375 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 837/1782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:58 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1211 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:58.912510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-34a4a636-1de0-4837-8b95-c317a7179c48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:58.913387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-34a4a636-1de0-4837-8b95-c317a7179c48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:58.925013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34a4a636-1de0-4837-8b95-c317a7179c48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:58.925769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34a4a636-1de0-4837-8b95-c317a7179c48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:58.926847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34a4a636-1de0-4837-8b95-c317a7179c48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:58.930388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34a4a636-1de0-4837-8b95-c317a7179c48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:58.930941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34a4a636-1de0-4837-8b95-c317a7179c48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:58.931492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34a4a636-1de0-4837-8b95-c317a7179c48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:58.979751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-041df601-1649-4b04-bbcd-2a7153b40eb2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:58.997748 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-041df601-1649-4b04-bbcd-2a7153b40eb2 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1311 microversion: 2.1 time: 0.320308 Oct 12 22:05:58.998456 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 946/1783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:58 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1311 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:59.044662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4ccabc88-e4cb-446e-a5b7-2494f478a080 tempest-TenantUsagesTestJSON-5073152 tempest-TenantUsagesTestJSON-5073152-project-admin] Calling method '.version_select at 0x7f512860b940>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:59.063789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ccabc88-e4cb-446e-a5b7-2494f478a080 tempest-TenantUsagesTestJSON-5073152 tempest-TenantUsagesTestJSON-5073152-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:59.064292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ccabc88-e4cb-446e-a5b7-2494f478a080 tempest-TenantUsagesTestJSON-5073152 tempest-TenantUsagesTestJSON-5073152-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:59.064743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ccabc88-e4cb-446e-a5b7-2494f478a080 tempest-TenantUsagesTestJSON-5073152 tempest-TenantUsagesTestJSON-5073152-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:59.083993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=20 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:59.104112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ccabc88-e4cb-446e-a5b7-2494f478a080 tempest-TenantUsagesTestJSON-5073152 tempest-TenantUsagesTestJSON-5073152-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:59.104608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ccabc88-e4cb-446e-a5b7-2494f478a080 tempest-TenantUsagesTestJSON-5073152 tempest-TenantUsagesTestJSON-5073152-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:59.106209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ccabc88-e4cb-446e-a5b7-2494f478a080 tempest-TenantUsagesTestJSON-5073152 tempest-TenantUsagesTestJSON-5073152-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:59.230785 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4ccabc88-e4cb-446e-a5b7-2494f478a080 tempest-TenantUsagesTestJSON-5073152 tempest-TenantUsagesTestJSON-5073152-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T22%3A05%3A57.772492&end=2022-10-13T22%3A05%3A57.772492&detailed=1" status: 200 len: 19333 microversion: 2.1 time: 0.211483 Oct 12 22:05:59.244576 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 947/1784] 10.222.0.16 () {58 vars in 1335 bytes} [Wed Oct 12 22:05:58 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T22%3A05%3A57.772492&end=2022-10-13T22%3A05%3A57.772492&detailed=1 => generated 19333 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:05:59.282641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aa0b3c81-d9b6-4faa-9be2-36b8d1bee989 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:59.283777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aa0b3c81-d9b6-4faa-9be2-36b8d1bee989 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:59.294117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa0b3c81-d9b6-4faa-9be2-36b8d1bee989 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:59.295142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa0b3c81-d9b6-4faa-9be2-36b8d1bee989 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:59.295858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa0b3c81-d9b6-4faa-9be2-36b8d1bee989 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:59.296814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa0b3c81-d9b6-4faa-9be2-36b8d1bee989 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:59.297510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa0b3c81-d9b6-4faa-9be2-36b8d1bee989 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:59.298167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa0b3c81-d9b6-4faa-9be2-36b8d1bee989 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:59.343908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-34a4a636-1de0-4837-8b95-c317a7179c48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:59.354983 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-34a4a636-1de0-4837-8b95-c317a7179c48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1470 microversion: 2.1 time: 0.448055 Oct 12 22:05:59.357254 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 838/1785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:58 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1470 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:59.368452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aa0b3c81-d9b6-4faa-9be2-36b8d1bee989 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:05:59.421703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d7392c82-85f6-4058-9a2f-f29a38906802 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:59.422551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d7392c82-85f6-4058-9a2f-f29a38906802 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:59.435781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7392c82-85f6-4058-9a2f-f29a38906802 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:59.436287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7392c82-85f6-4058-9a2f-f29a38906802 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:59.438556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7392c82-85f6-4058-9a2f-f29a38906802 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:59.439596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7392c82-85f6-4058-9a2f-f29a38906802 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:59.441665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7392c82-85f6-4058-9a2f-f29a38906802 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:59.443732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7392c82-85f6-4058-9a2f-f29a38906802 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:59.532111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:59.566309 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aa0b3c81-d9b6-4faa-9be2-36b8d1bee989 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 204 len: 0 microversion: 2.1 time: 0.289458 Oct 12 22:05:59.566873 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 948/1786] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:05:59 2022] DELETE /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:05:59.576141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-00845b2f-1aeb-4cdf-93bd-cea6bfafc8cb tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:59.576875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-00845b2f-1aeb-4cdf-93bd-cea6bfafc8cb tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:59.592419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00845b2f-1aeb-4cdf-93bd-cea6bfafc8cb tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:59.592919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00845b2f-1aeb-4cdf-93bd-cea6bfafc8cb tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:59.593365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00845b2f-1aeb-4cdf-93bd-cea6bfafc8cb tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:59.594079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00845b2f-1aeb-4cdf-93bd-cea6bfafc8cb tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:59.594533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00845b2f-1aeb-4cdf-93bd-cea6bfafc8cb tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:59.594975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00845b2f-1aeb-4cdf-93bd-cea6bfafc8cb tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:59.823026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-00845b2f-1aeb-4cdf-93bd-cea6bfafc8cb tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:59.829266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:05:59.848290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d7392c82-85f6-4058-9a2f-f29a38906802 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:05:59.854113 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-00845b2f-1aeb-4cdf-93bd-cea6bfafc8cb tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1466 microversion: 2.1 time: 0.271427 Oct 12 22:05:59.857282 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d7392c82-85f6-4058-9a2f-f29a38906802 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1308 microversion: 2.1 time: 0.440366 Oct 12 22:05:59.858035 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 949/1787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:59 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1466 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:59.859647 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 839/1788] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:59 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1308 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:05:59.868190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d81754a6-75f7-435c-b8b2-b801f7f758d5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:05:59.874132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d81754a6-75f7-435c-b8b2-b801f7f758d5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:59.878705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4786d00a-d970-4d93-a916-27b2245f9d54 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1360417693", "metadata": {"image_type": "test"}}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:05:59.884091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d81754a6-75f7-435c-b8b2-b801f7f758d5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:59.884599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d81754a6-75f7-435c-b8b2-b801f7f758d5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:59.885044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d81754a6-75f7-435c-b8b2-b801f7f758d5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:59.885763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d81754a6-75f7-435c-b8b2-b801f7f758d5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:59.886225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d81754a6-75f7-435c-b8b2-b801f7f758d5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:59.886659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d81754a6-75f7-435c-b8b2-b801f7f758d5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:59.891222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4786d00a-d970-4d93-a916-27b2245f9d54 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:05:59.904469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4786d00a-d970-4d93-a916-27b2245f9d54 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:59.904964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4786d00a-d970-4d93-a916-27b2245f9d54 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:59.905418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4786d00a-d970-4d93-a916-27b2245f9d54 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:59.906122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4786d00a-d970-4d93-a916-27b2245f9d54 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:05:59.906578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4786d00a-d970-4d93-a916-27b2245f9d54 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:05:59.907010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4786d00a-d970-4d93-a916-27b2245f9d54 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:05:59.998609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-4786d00a-d970-4d93-a916-27b2245f9d54 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Getting quotas for project cb320231db494313a74874b542b1a99f. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:06:00.008183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-4786d00a-d970-4d93-a916-27b2245f9d54 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Getting quotas for user 7e19d242c6f84fafbc30b676b1a0e08e and project cb320231db494313a74874b542b1a99f. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:06:00.179776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d81754a6-75f7-435c-b8b2-b801f7f758d5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:00.189842 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d81754a6-75f7-435c-b8b2-b801f7f758d5 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1469 microversion: 2.1 time: 0.330490 Oct 12 22:06:00.190629 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 950/1789] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:05:59 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1469 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:00.218366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c4103b0d-7101-4245-9e12-f7fdd73f1c3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:00.220429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c4103b0d-7101-4245-9e12-f7fdd73f1c3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:00.228697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4103b0d-7101-4245-9e12-f7fdd73f1c3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:00.229490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4103b0d-7101-4245-9e12-f7fdd73f1c3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:00.230210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4103b0d-7101-4245-9e12-f7fdd73f1c3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:00.231121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4103b0d-7101-4245-9e12-f7fdd73f1c3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:00.231716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4103b0d-7101-4245-9e12-f7fdd73f1c3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:00.232241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4103b0d-7101-4245-9e12-f7fdd73f1c3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:00.414132 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4786d00a-d970-4d93-a916-27b2245f9d54 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "POST /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52/action" status: 202 len: 0 microversion: 2.1 time: 0.539584 Oct 12 22:06:00.414826 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 840/1790] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:05:59 2022] POST /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:06:00.416683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c4103b0d-7101-4245-9e12-f7fdd73f1c3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:00.421318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0973673f-64bd-4038-bf73-e46f2247196e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:00.422117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0973673f-64bd-4038-bf73-e46f2247196e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:00.429143 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c4103b0d-7101-4245-9e12-f7fdd73f1c3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1211 microversion: 2.1 time: 0.224229 Oct 12 22:06:00.429734 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 951/1791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:00 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1211 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:00.443631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b68d5587-05d2-4d3e-8253-3eece78848e3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:00.443631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b68d5587-05d2-4d3e-8253-3eece78848e3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:00.444092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0973673f-64bd-4038-bf73-e46f2247196e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:00.445053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0973673f-64bd-4038-bf73-e46f2247196e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:00.445832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0973673f-64bd-4038-bf73-e46f2247196e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:00.446853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0973673f-64bd-4038-bf73-e46f2247196e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:00.448824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0973673f-64bd-4038-bf73-e46f2247196e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:00.449634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0973673f-64bd-4038-bf73-e46f2247196e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:00.462047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b68d5587-05d2-4d3e-8253-3eece78848e3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:00.462577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b68d5587-05d2-4d3e-8253-3eece78848e3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:00.465810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b68d5587-05d2-4d3e-8253-3eece78848e3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:00.468078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b68d5587-05d2-4d3e-8253-3eece78848e3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:00.468570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b68d5587-05d2-4d3e-8253-3eece78848e3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:00.469008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b68d5587-05d2-4d3e-8253-3eece78848e3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:00.534390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0973673f-64bd-4038-bf73-e46f2247196e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:00.537477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0973673f-64bd-4038-bf73-e46f2247196e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:00.539268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0973673f-64bd-4038-bf73-e46f2247196e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:00.542765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-0973673f-64bd-4038-bf73-e46f2247196e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lazy-loading 'fault' on Instance uuid 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:06:00.683396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0973673f-64bd-4038-bf73-e46f2247196e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:00.699412 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0973673f-64bd-4038-bf73-e46f2247196e tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 200 len: 1311 microversion: 2.1 time: 0.282927 Oct 12 22:06:00.701484 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 841/1792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:00 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 1311 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:00.711442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a48568a2-99a2-4aec-8be0-6e388adeb192 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f51285ae9d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:00.746245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b68d5587-05d2-4d3e-8253-3eece78848e3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:00.771116 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b68d5587-05d2-4d3e-8253-3eece78848e3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1470 microversion: 2.1 time: 0.339443 Oct 12 22:06:00.773009 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 952/1793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:00 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1470 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:00.778929 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a48568a2-99a2-4aec-8be0-6e388adeb192 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.075212 Oct 12 22:06:00.787444 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 842/1794] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:00 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:00.796218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-752026b8-2609-459d-b1fb-988ef5577a09 req-ea174944-4a55-49b9-bb00-003d7bedac92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef20289-f683-41c1-8a71-b632098119c7", "name": "network-vif-plugged", "status": "completed", "tag": "a80001d4-8ef9-4f37-9c36-558312053557"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:00.830572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-752026b8-2609-459d-b1fb-988ef5577a09 req-ea174944-4a55-49b9-bb00-003d7bedac92 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:00.832970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-752026b8-2609-459d-b1fb-988ef5577a09 req-ea174944-4a55-49b9-bb00-003d7bedac92 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:00.834275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-752026b8-2609-459d-b1fb-988ef5577a09 req-ea174944-4a55-49b9-bb00-003d7bedac92 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:00.838360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-9cf4e3b3-c476-4845-8fdd-531a3d897a0d req-bef9f4d0-c19f-445f-a9ad-b008aae32c52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98da0461-39ce-4bc1-9c42-66d635a94fcd", "tag": "24945106-d2fe-4fa8-b8ef-52b83a547ea5"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:00.863447 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-752026b8-2609-459d-b1fb-988ef5577a09 req-ea174944-4a55-49b9-bb00-003d7bedac92 service nova] Creating event network-vif-plugged:a80001d4-8ef9-4f37-9c36-558312053557 for instance 6ef20289-f683-41c1-8a71-b632098119c7 on n-h1-861111-1 Oct 12 22:06:00.870548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9cf4e3b3-c476-4845-8fdd-531a3d897a0d req-bef9f4d0-c19f-445f-a9ad-b008aae32c52 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:00.871402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9cf4e3b3-c476-4845-8fdd-531a3d897a0d req-bef9f4d0-c19f-445f-a9ad-b008aae32c52 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:00.874973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9cf4e3b3-c476-4845-8fdd-531a3d897a0d req-bef9f4d0-c19f-445f-a9ad-b008aae32c52 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:00.879094 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-752026b8-2609-459d-b1fb-988ef5577a09 req-ea174944-4a55-49b9-bb00-003d7bedac92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096620 Oct 12 22:06:00.881441 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 953/1795] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:00.896504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e893622c-d9ce-4fe9-94a9-657a3cbf9762 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:00.898773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e893622c-d9ce-4fe9-94a9-657a3cbf9762 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:00.928514 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-9cf4e3b3-c476-4845-8fdd-531a3d897a0d req-bef9f4d0-c19f-445f-a9ad-b008aae32c52 service nova] Creating event network-changed:24945106-d2fe-4fa8-b8ef-52b83a547ea5 for instance 98da0461-39ce-4bc1-9c42-66d635a94fcd on n-h2-861111-1 Oct 12 22:06:00.937508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e893622c-d9ce-4fe9-94a9-657a3cbf9762 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:00.937508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e893622c-d9ce-4fe9-94a9-657a3cbf9762 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:00.938029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e893622c-d9ce-4fe9-94a9-657a3cbf9762 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:00.942838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e893622c-d9ce-4fe9-94a9-657a3cbf9762 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:00.943353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e893622c-d9ce-4fe9-94a9-657a3cbf9762 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:00.943643 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-9cf4e3b3-c476-4845-8fdd-531a3d897a0d req-bef9f4d0-c19f-445f-a9ad-b008aae32c52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109806 Oct 12 22:06:00.943834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e893622c-d9ce-4fe9-94a9-657a3cbf9762 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:00.945500 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 843/1796] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:01.177053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e893622c-d9ce-4fe9-94a9-657a3cbf9762 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:01.189356 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e893622c-d9ce-4fe9-94a9-657a3cbf9762 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1308 microversion: 2.1 time: 0.305192 Oct 12 22:06:01.189966 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 954/1797] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:00 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1308 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:01.225087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-abdf27da-4c55-4568-b80f-795e16feef08 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:01.225822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-abdf27da-4c55-4568-b80f-795e16feef08 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:01.234694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abdf27da-4c55-4568-b80f-795e16feef08 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:01.235193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abdf27da-4c55-4568-b80f-795e16feef08 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:01.237159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abdf27da-4c55-4568-b80f-795e16feef08 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:01.237886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abdf27da-4c55-4568-b80f-795e16feef08 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:01.238344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abdf27da-4c55-4568-b80f-795e16feef08 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:01.239360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abdf27da-4c55-4568-b80f-795e16feef08 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:01.456835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e907dec6-4344-4e69-b54d-96928682b266 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:01.458966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e907dec6-4344-4e69-b54d-96928682b266 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:01.470475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e907dec6-4344-4e69-b54d-96928682b266 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:01.471809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e907dec6-4344-4e69-b54d-96928682b266 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:01.472614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e907dec6-4344-4e69-b54d-96928682b266 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:01.474226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e907dec6-4344-4e69-b54d-96928682b266 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:01.474849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e907dec6-4344-4e69-b54d-96928682b266 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:01.475514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e907dec6-4344-4e69-b54d-96928682b266 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:01.546100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-abdf27da-4c55-4568-b80f-795e16feef08 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:01.557722 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-abdf27da-4c55-4568-b80f-795e16feef08 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1469 microversion: 2.1 time: 0.343414 Oct 12 22:06:01.558447 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 844/1798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:01 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1469 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:01.724423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f8c381f7-68c5-487c-9b8b-01ec4c56725c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:01.725147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f8c381f7-68c5-487c-9b8b-01ec4c56725c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:01.736121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8c381f7-68c5-487c-9b8b-01ec4c56725c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:01.736638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8c381f7-68c5-487c-9b8b-01ec4c56725c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:01.737499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8c381f7-68c5-487c-9b8b-01ec4c56725c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:01.738233 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8c381f7-68c5-487c-9b8b-01ec4c56725c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:01.742796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8c381f7-68c5-487c-9b8b-01ec4c56725c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:01.743464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8c381f7-68c5-487c-9b8b-01ec4c56725c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:01.792670 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-f8c381f7-68c5-487c-9b8b-01ec4c56725c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] HTTP exception thrown: Instance 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 could not be found. Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f8c381f7-68c5-487c-9b8b-01ec4c56725c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Request method failure captured: Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 HTTP/1.1 Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRznoxnVxikVWukTEwCOIJicYCRnweBF0UdOBpS7ApkHM3G1B384Hh466oBKRhH9N8Abuu6Bm5IcHpJhRzCI14DpXyVveyyYSOzWCwM9efdUbp7XLCn7EGQgA8SnU73ChDpuCTSJTRQTvRtLpLS7rGHp1usRONARhr6BxDirkVF_w6iI Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: f0051e5f43b7403cbb4c29a00bb73513 Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ListServerFiltersTestJSON-411369961 Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:06:01.794456 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:06:01.796294 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f0051e5f43b7403cbb4c29a00bb73513"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f0051e5f43b7403cbb4c29a00bb73513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f0051e5f43b7403cbb4c29a00bb73513", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f0051e5f43b7403cbb4c29a00bb73513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:06:01.796294 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ListServerFiltersTestJSON-411369961 Oct 12 22:06:01.796294 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: f0051e5f43b7403cbb4c29a00bb73513 Oct 12 22:06:01.796294 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-411369961 Oct 12 22:06:01.796294 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ListServerFiltersTestJSON-411369961-project Oct 12 22:06:01.796294 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:06:01.796294 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:06:01.796294 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11d42d1fe957461e9fb85d0823ad5866 Oct 12 22:06:01.796294 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ListServerFiltersTestJSON-411369961-project Oct 12 22:06:01.796294 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:06:01.796294 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 could not be found. Oct 12 22:06:01.796294 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9'} Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 could not be found. Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:06:01.797364 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 could not be found. Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 could not be found. Oct 12 22:06:01.799036 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:01.802617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f8c381f7-68c5-487c-9b8b-01ec4c56725c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Returning 404 to user: Instance 951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:06:01.802617 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f8c381f7-68c5-487c-9b8b-01ec4c56725c tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9" status: 404 len: 111 microversion: 2.1 time: 0.076243 Oct 12 22:06:01.802617 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 845/1799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:01 2022] GET /compute/v2.1/servers/951dadf2-7b4b-44d6-a5cc-0369bb6d7cd9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:06:01.805011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e6f16e82-60a0-4f2e-b195-c64c8db62142 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f5128744310>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:01.812880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e907dec6-4344-4e69-b54d-96928682b266 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:01.837068 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e907dec6-4344-4e69-b54d-96928682b266 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1211 microversion: 2.1 time: 0.384262 Oct 12 22:06:01.842728 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 955/1800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:01 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1211 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:01.861208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b62747c-8df7-480c-8029-95e7c0523fff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:01.862371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8b62747c-8df7-480c-8029-95e7c0523fff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 747a8555-8993-47b3-a6de-2f32f025e240] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:01.877274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b62747c-8df7-480c-8029-95e7c0523fff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:01.877860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:01.883781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b62747c-8df7-480c-8029-95e7c0523fff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:01.884524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b62747c-8df7-480c-8029-95e7c0523fff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:01.886088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b62747c-8df7-480c-8029-95e7c0523fff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:01.886763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b62747c-8df7-480c-8029-95e7c0523fff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:01.891764 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e6f16e82-60a0-4f2e-b195-c64c8db62142 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.092669 Oct 12 22:06:01.892621 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 846/1801] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:01 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:01.902384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b62747c-8df7-480c-8029-95e7c0523fff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:01.904978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-873872da-5546-4053-af38-fef1474f866c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:01.909249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-873872da-5546-4053-af38-fef1474f866c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:01.923537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-873872da-5546-4053-af38-fef1474f866c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:01.924026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-873872da-5546-4053-af38-fef1474f866c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:01.924462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-873872da-5546-4053-af38-fef1474f866c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:01.930290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-873872da-5546-4053-af38-fef1474f866c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:01.930969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-873872da-5546-4053-af38-fef1474f866c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:01.931267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-873872da-5546-4053-af38-fef1474f866c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:01.935441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8b62747c-8df7-480c-8029-95e7c0523fff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 747a8555-8993-47b3-a6de-2f32f025e240] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:06:01.950438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:02.092937 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8b62747c-8df7-480c-8029-95e7c0523fff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "DELETE /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240" status: 204 len: 0 microversion: 2.1 time: 0.242275 Oct 12 22:06:02.099712 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 956/1802] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:06:01 2022] DELETE /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:06:02.115881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-420b3190-9f4a-4645-a671-54162626961f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:02.119170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-420b3190-9f4a-4645-a671-54162626961f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 747a8555-8993-47b3-a6de-2f32f025e240] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:02.135913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-420b3190-9f4a-4645-a671-54162626961f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:02.138100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-420b3190-9f4a-4645-a671-54162626961f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:02.138949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-420b3190-9f4a-4645-a671-54162626961f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:02.141579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-420b3190-9f4a-4645-a671-54162626961f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:02.142085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-420b3190-9f4a-4645-a671-54162626961f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:02.143714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-420b3190-9f4a-4645-a671-54162626961f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:02.439124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-420b3190-9f4a-4645-a671-54162626961f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:02.448957 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-420b3190-9f4a-4645-a671-54162626961f tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240" status: 200 len: 1518 microversion: 2.1 time: 0.347514 Oct 12 22:06:02.449937 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 957/1803] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:02 2022] GET /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240 => generated 1518 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:02.471285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d0857237-7764-449a-9993-416c4fcd455a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:02.472783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d0857237-7764-449a-9993-416c4fcd455a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:02.481867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0857237-7764-449a-9993-416c4fcd455a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:02.482912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0857237-7764-449a-9993-416c4fcd455a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:02.483866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0857237-7764-449a-9993-416c4fcd455a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:02.484759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0857237-7764-449a-9993-416c4fcd455a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:02.485368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0857237-7764-449a-9993-416c4fcd455a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:02.485959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0857237-7764-449a-9993-416c4fcd455a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:02.535943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-873872da-5546-4053-af38-fef1474f866c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:02.544043 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-873872da-5546-4053-af38-fef1474f866c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1536 microversion: 2.1 time: 0.650269 Oct 12 22:06:02.547935 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 847/1804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:01 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1536 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:02.553245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-b51f5794-847c-4b0d-8bbd-733c4a1577ae req-e5cc2a5f-e4a3-4804-80c6-1bf605f62a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae4e25e-f720-42f5-aaa1-eac6492e37d3", "name": "network-vif-unplugged", "status": "completed", "tag": "17538477-fced-4d99-b30b-5724d63d3744"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:02.562379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b51f5794-847c-4b0d-8bbd-733c4a1577ae req-e5cc2a5f-e4a3-4804-80c6-1bf605f62a9c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:02.563073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b51f5794-847c-4b0d-8bbd-733c4a1577ae req-e5cc2a5f-e4a3-4804-80c6-1bf605f62a9c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:02.563707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b51f5794-847c-4b0d-8bbd-733c4a1577ae req-e5cc2a5f-e4a3-4804-80c6-1bf605f62a9c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:02.576190 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-b51f5794-847c-4b0d-8bbd-733c4a1577ae req-e5cc2a5f-e4a3-4804-80c6-1bf605f62a9c service nova] Creating event network-vif-unplugged:17538477-fced-4d99-b30b-5724d63d3744 for instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 on n-h1-861111-1 Oct 12 22:06:02.582434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-b51f5794-847c-4b0d-8bbd-733c4a1577ae req-e5cc2a5f-e4a3-4804-80c6-1bf605f62a9c service nova] Instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:06:02.594317 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-b51f5794-847c-4b0d-8bbd-733c4a1577ae req-e5cc2a5f-e4a3-4804-80c6-1bf605f62a9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044887 Oct 12 22:06:02.595175 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 848/1805] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:02.601041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-335c3db4-afaa-41d7-9367-5513e4c04d72 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:02.602049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-335c3db4-afaa-41d7-9367-5513e4c04d72 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:02.609410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-335c3db4-afaa-41d7-9367-5513e4c04d72 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:02.610066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-335c3db4-afaa-41d7-9367-5513e4c04d72 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:02.610943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-335c3db4-afaa-41d7-9367-5513e4c04d72 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:02.611895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-335c3db4-afaa-41d7-9367-5513e4c04d72 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:02.612522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-335c3db4-afaa-41d7-9367-5513e4c04d72 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:02.613153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-335c3db4-afaa-41d7-9367-5513e4c04d72 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:02.635697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:02.725519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d0857237-7764-449a-9993-416c4fcd455a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:02.735980 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d0857237-7764-449a-9993-416c4fcd455a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1308 microversion: 2.1 time: 0.272414 Oct 12 22:06:02.740970 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 958/1806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:02 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1308 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:02.838436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-335c3db4-afaa-41d7-9367-5513e4c04d72 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:02.849561 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-335c3db4-afaa-41d7-9367-5513e4c04d72 tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1469 microversion: 2.1 time: 0.252888 Oct 12 22:06:02.850592 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 849/1807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:02 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1469 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:02.866769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-39c05583-d668-4a1f-a9d1-814eb05448be tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:02.868617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-39c05583-d668-4a1f-a9d1-814eb05448be tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:02.881621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39c05583-d668-4a1f-a9d1-814eb05448be tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:02.882804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39c05583-d668-4a1f-a9d1-814eb05448be tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:02.883538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39c05583-d668-4a1f-a9d1-814eb05448be tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:02.884455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39c05583-d668-4a1f-a9d1-814eb05448be tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:02.886422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39c05583-d668-4a1f-a9d1-814eb05448be tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:02.887033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39c05583-d668-4a1f-a9d1-814eb05448be tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:02.915956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a50e5477-fee1-49ef-bc15-3a6bba8a3e2a tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f51286b05e0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:03.029042 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a50e5477-fee1-49ef-bc15-3a6bba8a3e2a tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.121627 Oct 12 22:06:03.039854 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 850/1808] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:02 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:03.052168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-b461062d-03ec-4f74-9354-64aa37d18e3d req-2d4149c9-f1af-4d69-8af0-f39bce100b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c959e4d2-bad7-4b6f-967b-b10e0b1719d8", "name": "network-vif-deleted", "tag": "a616a035-3557-43db-817b-5c5ee008485a"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:03.058117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:03.083129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b461062d-03ec-4f74-9354-64aa37d18e3d req-2d4149c9-f1af-4d69-8af0-f39bce100b46 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:03.086466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b461062d-03ec-4f74-9354-64aa37d18e3d req-2d4149c9-f1af-4d69-8af0-f39bce100b46 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:03.087764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b461062d-03ec-4f74-9354-64aa37d18e3d req-2d4149c9-f1af-4d69-8af0-f39bce100b46 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:03.107029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-39c05583-d668-4a1f-a9d1-814eb05448be tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:03.116377 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-b461062d-03ec-4f74-9354-64aa37d18e3d req-2d4149c9-f1af-4d69-8af0-f39bce100b46 service nova] Creating event network-vif-deleted:a616a035-3557-43db-817b-5c5ee008485a for instance c959e4d2-bad7-4b6f-967b-b10e0b1719d8 on n-h1-861111-1 Oct 12 22:06:03.118077 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-39c05583-d668-4a1f-a9d1-814eb05448be tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1211 microversion: 2.1 time: 0.256601 Oct 12 22:06:03.131272 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 959/1809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:02 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1211 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:03.132389 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-b461062d-03ec-4f74-9354-64aa37d18e3d req-2d4149c9-f1af-4d69-8af0-f39bce100b46 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088985 Oct 12 22:06:03.135803 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 851/1810] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:03.472364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4842c4cb-1d9a-4042-a1d2-7c0c9bed386d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:03.473649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4842c4cb-1d9a-4042-a1d2-7c0c9bed386d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 747a8555-8993-47b3-a6de-2f32f025e240] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:03.480259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4842c4cb-1d9a-4042-a1d2-7c0c9bed386d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:03.480749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4842c4cb-1d9a-4042-a1d2-7c0c9bed386d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:03.481189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4842c4cb-1d9a-4042-a1d2-7c0c9bed386d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:03.482264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4842c4cb-1d9a-4042-a1d2-7c0c9bed386d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:03.482400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4842c4cb-1d9a-4042-a1d2-7c0c9bed386d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:03.482753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4842c4cb-1d9a-4042-a1d2-7c0c9bed386d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:03.572643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-caa793ad-217d-4cd1-be36-92cbd42f5e43 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:03.573422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-caa793ad-217d-4cd1-be36-92cbd42f5e43 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:03.579962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caa793ad-217d-4cd1-be36-92cbd42f5e43 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:03.580448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caa793ad-217d-4cd1-be36-92cbd42f5e43 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:03.580883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caa793ad-217d-4cd1-be36-92cbd42f5e43 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:03.581586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caa793ad-217d-4cd1-be36-92cbd42f5e43 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:03.582031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caa793ad-217d-4cd1-be36-92cbd42f5e43 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:03.582492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caa793ad-217d-4cd1-be36-92cbd42f5e43 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:03.633034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4842c4cb-1d9a-4042-a1d2-7c0c9bed386d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:03.641436 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4842c4cb-1d9a-4042-a1d2-7c0c9bed386d tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240" status: 200 len: 1518 microversion: 2.1 time: 0.172845 Oct 12 22:06:03.642563 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 960/1811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:03 2022] GET /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240 => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:03.734490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-caa793ad-217d-4cd1-be36-92cbd42f5e43 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:03.742410 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-caa793ad-217d-4cd1-be36-92cbd42f5e43 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1536 microversion: 2.1 time: 0.175984 Oct 12 22:06:03.742983 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 852/1812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:03 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1536 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:03.769004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cd42542a-8076-42ba-a9ea-b6326acdb0bb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:03.770328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cd42542a-8076-42ba-a9ea-b6326acdb0bb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:03.777497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd42542a-8076-42ba-a9ea-b6326acdb0bb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:03.778201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd42542a-8076-42ba-a9ea-b6326acdb0bb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:03.778833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd42542a-8076-42ba-a9ea-b6326acdb0bb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:03.779764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd42542a-8076-42ba-a9ea-b6326acdb0bb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:03.780399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd42542a-8076-42ba-a9ea-b6326acdb0bb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:03.781065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd42542a-8076-42ba-a9ea-b6326acdb0bb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:03.874830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a6851f4e-f6e3-4ab5-819a-24fc05a4acfe tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:03.875541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a6851f4e-f6e3-4ab5-819a-24fc05a4acfe tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:03.882590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6851f4e-f6e3-4ab5-819a-24fc05a4acfe tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:03.883638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6851f4e-f6e3-4ab5-819a-24fc05a4acfe tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:03.885615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6851f4e-f6e3-4ab5-819a-24fc05a4acfe tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:03.886544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6851f4e-f6e3-4ab5-819a-24fc05a4acfe tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:03.887168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6851f4e-f6e3-4ab5-819a-24fc05a4acfe tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:03.887788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6851f4e-f6e3-4ab5-819a-24fc05a4acfe tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:03.937251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6851f4e-f6e3-4ab5-819a-24fc05a4acfe tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:03.938043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6851f4e-f6e3-4ab5-819a-24fc05a4acfe tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:03.942145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6851f4e-f6e3-4ab5-819a-24fc05a4acfe tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:03.942843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-a6851f4e-f6e3-4ab5-819a-24fc05a4acfe tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lazy-loading 'fault' on Instance uuid c959e4d2-bad7-4b6f-967b-b10e0b1719d8 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:06:03.977733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cd42542a-8076-42ba-a9ea-b6326acdb0bb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:03.987382 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cd42542a-8076-42ba-a9ea-b6326acdb0bb tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1487 microversion: 2.1 time: 0.228495 Oct 12 22:06:04.000112 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 961/1813] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:03 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1487 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:04.014428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ee8b929a-af1c-4f36-bd9a-21346f8cf2c3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:04.015205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ee8b929a-af1c-4f36-bd9a-21346f8cf2c3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:04.023448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee8b929a-af1c-4f36-bd9a-21346f8cf2c3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:04.024247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee8b929a-af1c-4f36-bd9a-21346f8cf2c3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:04.024989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee8b929a-af1c-4f36-bd9a-21346f8cf2c3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:04.025958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee8b929a-af1c-4f36-bd9a-21346f8cf2c3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:04.026432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee8b929a-af1c-4f36-bd9a-21346f8cf2c3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:04.026989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee8b929a-af1c-4f36-bd9a-21346f8cf2c3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:04.034512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a6851f4e-f6e3-4ab5-819a-24fc05a4acfe tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5283be2f8f45e0afb31a99a030cd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509ad64c9d1b4b7cae75ad66440ab755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:04.048803 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a6851f4e-f6e3-4ab5-819a-24fc05a4acfe tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 200 len: 1303 microversion: 2.1 time: 0.178404 Oct 12 22:06:04.050825 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 853/1814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:03 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 1303 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:04.056553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-020748e5-f518-4ede-aa5d-03ca24ef504b tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512395c040>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:04.070718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ee8b929a-af1c-4f36-bd9a-21346f8cf2c3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:06:04.163775 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ee8b929a-af1c-4f36-bd9a-21346f8cf2c3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 204 len: 0 microversion: 2.1 time: 0.154100 Oct 12 22:06:04.164500 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 962/1815] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:06:04 2022] DELETE /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:06:04.170358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5a1f791c-35bf-46f8-ab54-f1177ee7da62 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:04.171156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5a1f791c-35bf-46f8-ab54-f1177ee7da62 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:04.177481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a1f791c-35bf-46f8-ab54-f1177ee7da62 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:04.178341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a1f791c-35bf-46f8-ab54-f1177ee7da62 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:04.178782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a1f791c-35bf-46f8-ab54-f1177ee7da62 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:04.179503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a1f791c-35bf-46f8-ab54-f1177ee7da62 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:04.180122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a1f791c-35bf-46f8-ab54-f1177ee7da62 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:04.180680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a1f791c-35bf-46f8-ab54-f1177ee7da62 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:04.283524 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-020748e5-f518-4ede-aa5d-03ca24ef504b tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.230390 Oct 12 22:06:04.291389 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 854/1816] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:04 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:04.291389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a5a19fa8-5b4f-4f74-b0d1-478d15ded404 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:04.291389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a5a19fa8-5b4f-4f74-b0d1-478d15ded404 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:04.296071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5a19fa8-5b4f-4f74-b0d1-478d15ded404 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:04.296749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5a19fa8-5b4f-4f74-b0d1-478d15ded404 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:04.297222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5a19fa8-5b4f-4f74-b0d1-478d15ded404 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:04.297932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5a19fa8-5b4f-4f74-b0d1-478d15ded404 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:04.298384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5a19fa8-5b4f-4f74-b0d1-478d15ded404 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:04.298808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5a19fa8-5b4f-4f74-b0d1-478d15ded404 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:04.340349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5a1f791c-35bf-46f8-ab54-f1177ee7da62 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:04.344279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:04.349616 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5a1f791c-35bf-46f8-ab54-f1177ee7da62 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1199 microversion: 2.1 time: 0.183797 Oct 12 22:06:04.350232 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 963/1817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:04 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1199 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:04.447803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a5a19fa8-5b4f-4f74-b0d1-478d15ded404 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:04.455458 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a5a19fa8-5b4f-4f74-b0d1-478d15ded404 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1493 microversion: 2.1 time: 0.170285 Oct 12 22:06:04.456022 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 855/1818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:04 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1493 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:04.615358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-49a49d6a-161d-4aff-b574-691fa17a02b5 req-647dc940-b940-447b-a96b-6383f03afe8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae4e25e-f720-42f5-aaa1-eac6492e37d3", "tag": "17538477-fced-4d99-b30b-5724d63d3744"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:04.626037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-49a49d6a-161d-4aff-b574-691fa17a02b5 req-647dc940-b940-447b-a96b-6383f03afe8c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:04.626515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-49a49d6a-161d-4aff-b574-691fa17a02b5 req-647dc940-b940-447b-a96b-6383f03afe8c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:04.626944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-49a49d6a-161d-4aff-b574-691fa17a02b5 req-647dc940-b940-447b-a96b-6383f03afe8c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:04.641678 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-49a49d6a-161d-4aff-b574-691fa17a02b5 req-647dc940-b940-447b-a96b-6383f03afe8c service nova] Creating event network-changed:17538477-fced-4d99-b30b-5724d63d3744 for instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 on n-h1-861111-1 Oct 12 22:06:04.647791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-49a49d6a-161d-4aff-b574-691fa17a02b5 req-647dc940-b940-447b-a96b-6383f03afe8c service nova] Instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:06:04.658508 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-49a49d6a-161d-4aff-b574-691fa17a02b5 req-647dc940-b940-447b-a96b-6383f03afe8c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047669 Oct 12 22:06:04.659442 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 964/1819] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:04.666201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fc8b8909-1a9f-4f70-900b-fe97e86a6941 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:04.666817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fc8b8909-1a9f-4f70-900b-fe97e86a6941 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 747a8555-8993-47b3-a6de-2f32f025e240] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:04.674768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fc8b8909-1a9f-4f70-900b-fe97e86a6941 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:04.675852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fc8b8909-1a9f-4f70-900b-fe97e86a6941 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:04.677924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fc8b8909-1a9f-4f70-900b-fe97e86a6941 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:04.679384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fc8b8909-1a9f-4f70-900b-fe97e86a6941 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:04.680407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fc8b8909-1a9f-4f70-900b-fe97e86a6941 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:04.681905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fc8b8909-1a9f-4f70-900b-fe97e86a6941 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:04.771671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-50d2bf96-4968-4789-a81f-bc0e974a9e22 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:04.773099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-50d2bf96-4968-4789-a81f-bc0e974a9e22 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:04.781428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50d2bf96-4968-4789-a81f-bc0e974a9e22 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:04.782142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50d2bf96-4968-4789-a81f-bc0e974a9e22 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:04.782583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50d2bf96-4968-4789-a81f-bc0e974a9e22 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:04.783321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50d2bf96-4968-4789-a81f-bc0e974a9e22 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:04.783785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50d2bf96-4968-4789-a81f-bc0e974a9e22 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:04.784220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50d2bf96-4968-4789-a81f-bc0e974a9e22 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:04.858212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fc8b8909-1a9f-4f70-900b-fe97e86a6941 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:04.869282 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fc8b8909-1a9f-4f70-900b-fe97e86a6941 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240" status: 200 len: 1518 microversion: 2.1 time: 0.207165 Oct 12 22:06:04.870551 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 856/1820] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:04 2022] GET /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240 => generated 1518 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:04.965525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-50d2bf96-4968-4789-a81f-bc0e974a9e22 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:04.976776 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-50d2bf96-4968-4789-a81f-bc0e974a9e22 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1536 microversion: 2.1 time: 0.213464 Oct 12 22:06:04.991263 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 965/1821] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:04 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1536 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:05.076418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-de83a80f-1013-4256-a1de-8a81a7d5fe1a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:05.077187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-de83a80f-1013-4256-a1de-8a81a7d5fe1a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] [instance: c959e4d2-bad7-4b6f-967b-b10e0b1719d8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:05.089665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de83a80f-1013-4256-a1de-8a81a7d5fe1a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:05.090176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de83a80f-1013-4256-a1de-8a81a7d5fe1a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:05.090629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de83a80f-1013-4256-a1de-8a81a7d5fe1a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:05.091656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de83a80f-1013-4256-a1de-8a81a7d5fe1a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:05.092125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de83a80f-1013-4256-a1de-8a81a7d5fe1a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:05.092829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de83a80f-1013-4256-a1de-8a81a7d5fe1a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:05.109677 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-de83a80f-1013-4256-a1de-8a81a7d5fe1a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] HTTP exception thrown: Instance c959e4d2-bad7-4b6f-967b-b10e0b1719d8 could not be found. Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-de83a80f-1013-4256-a1de-8a81a7d5fe1a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Request method failure captured: Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 HTTP/1.1 Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzojeKmffzDTAZ2ydlwlXfu6WKfUT-fFgOj0YwA1_-wrUaiilENdScJQnipJ87Sn8TZACRleNR21f3Gibj36hSvXd27Zi4SpKy2vOZ0XUssyoAADKvTzz-k1gUjHCCb9f6TFjsuNfWmPMZthY-INjDzHRk9e3cSUYZfwyXLOS6IFVdc Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 509ad64c9d1b4b7cae75ad66440ab755 Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TenantUsagesTestJSON-1398294185 Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:06:05.112466 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:06:05.114558 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/509ad64c9d1b4b7cae75ad66440ab755"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/509ad64c9d1b4b7cae75ad66440ab755"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_509ad64c9d1b4b7cae75ad66440ab755", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/509ad64c9d1b4b7cae75ad66440ab755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:06:05.114558 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TenantUsagesTestJSON-1398294185 Oct 12 22:06:05.114558 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 509ad64c9d1b4b7cae75ad66440ab755 Oct 12 22:06:05.114558 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1398294185 Oct 12 22:06:05.114558 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TenantUsagesTestJSON-1398294185-project Oct 12 22:06:05.114558 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:06:05.114558 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:06:05.114558 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 4b5283be2f8f45e0afb31a99a030cd36 Oct 12 22:06:05.114558 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TenantUsagesTestJSON-1398294185-project Oct 12 22:06:05.114558 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:06:05.114558 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance c959e4d2-bad7-4b6f-967b-b10e0b1719d8 could not be found. Oct 12 22:06:05.114558 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'c959e4d2-bad7-4b6f-967b-b10e0b1719d8'} Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c959e4d2-bad7-4b6f-967b-b10e0b1719d8 could not be found. Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:06:05.115798 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c959e4d2-bad7-4b6f-967b-b10e0b1719d8 could not be found. Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c959e4d2-bad7-4b6f-967b-b10e0b1719d8 could not be found. Oct 12 22:06:05.117203 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:05.118418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-de83a80f-1013-4256-a1de-8a81a7d5fe1a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] Returning 404 to user: Instance c959e4d2-bad7-4b6f-967b-b10e0b1719d8 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:06:05.118418 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-de83a80f-1013-4256-a1de-8a81a7d5fe1a tempest-TenantUsagesTestJSON-1398294185 tempest-TenantUsagesTestJSON-1398294185-project] 10.222.0.16 "GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8" status: 404 len: 111 microversion: 2.1 time: 0.045164 Oct 12 22:06:05.122571 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 857/1822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:05 2022] GET /compute/v2.1/servers/c959e4d2-bad7-4b6f-967b-b10e0b1719d8 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:06:05.302721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b1bafa2d-6474-4b97-947a-62c3d015630b tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f51283559d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:05.375505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d9ca1f8b-e4df-4e91-9f44-f9034091bf9f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:05.376793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d9ca1f8b-e4df-4e91-9f44-f9034091bf9f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:05.384149 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b1bafa2d-6474-4b97-947a-62c3d015630b tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.088639 Oct 12 22:06:05.384842 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 966/1823] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:05 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:05.394107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ca1f8b-e4df-4e91-9f44-f9034091bf9f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:05.395502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ca1f8b-e4df-4e91-9f44-f9034091bf9f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:05.396366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ca1f8b-e4df-4e91-9f44-f9034091bf9f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:05.397304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ca1f8b-e4df-4e91-9f44-f9034091bf9f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:05.398658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ca1f8b-e4df-4e91-9f44-f9034091bf9f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:05.399369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ca1f8b-e4df-4e91-9f44-f9034091bf9f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:05.480139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dbc4e7ac-cd67-4335-a735-287082ef1f0f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:05.481195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dbc4e7ac-cd67-4335-a735-287082ef1f0f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:05.487754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbc4e7ac-cd67-4335-a735-287082ef1f0f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:05.491386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbc4e7ac-cd67-4335-a735-287082ef1f0f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:05.493319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbc4e7ac-cd67-4335-a735-287082ef1f0f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:05.495096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbc4e7ac-cd67-4335-a735-287082ef1f0f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:05.495955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbc4e7ac-cd67-4335-a735-287082ef1f0f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:05.498017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbc4e7ac-cd67-4335-a735-287082ef1f0f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:05.764812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dbc4e7ac-cd67-4335-a735-287082ef1f0f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:05.776010 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dbc4e7ac-cd67-4335-a735-287082ef1f0f tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1493 microversion: 2.1 time: 0.299843 Oct 12 22:06:05.778600 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 967/1824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:05 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1493 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:06:05.895209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f52d6f48-0ffc-4f7b-a561-d832fc132de0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:05.897993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f52d6f48-0ffc-4f7b-a561-d832fc132de0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 747a8555-8993-47b3-a6de-2f32f025e240] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:05.908215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f52d6f48-0ffc-4f7b-a561-d832fc132de0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:05.908825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f52d6f48-0ffc-4f7b-a561-d832fc132de0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:05.912765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f52d6f48-0ffc-4f7b-a561-d832fc132de0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:05.913565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f52d6f48-0ffc-4f7b-a561-d832fc132de0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:05.915955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f52d6f48-0ffc-4f7b-a561-d832fc132de0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:05.916712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f52d6f48-0ffc-4f7b-a561-d832fc132de0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:05.991178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d9ca1f8b-e4df-4e91-9f44-f9034091bf9f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:06.000430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f52d6f48-0ffc-4f7b-a561-d832fc132de0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:06.004903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f52d6f48-0ffc-4f7b-a561-d832fc132de0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:06.005533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f52d6f48-0ffc-4f7b-a561-d832fc132de0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:06.006174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-f52d6f48-0ffc-4f7b-a561-d832fc132de0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lazy-loading 'fault' on Instance uuid 747a8555-8993-47b3-a6de-2f32f025e240 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:06:06.006396 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d9ca1f8b-e4df-4e91-9f44-f9034091bf9f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1199 microversion: 2.1 time: 0.631572 Oct 12 22:06:06.012281 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 858/1825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:05 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1199 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:06:06.017372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-86c07453-0085-4014-ae39-9c45c2a59ae6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:06.022865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-86c07453-0085-4014-ae39-9c45c2a59ae6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:06.033902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86c07453-0085-4014-ae39-9c45c2a59ae6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:06.034765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86c07453-0085-4014-ae39-9c45c2a59ae6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:06.036011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86c07453-0085-4014-ae39-9c45c2a59ae6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:06.036935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86c07453-0085-4014-ae39-9c45c2a59ae6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:06.043312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86c07453-0085-4014-ae39-9c45c2a59ae6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:06.043992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86c07453-0085-4014-ae39-9c45c2a59ae6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:06.108915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f52d6f48-0ffc-4f7b-a561-d832fc132de0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:06.119865 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f52d6f48-0ffc-4f7b-a561-d832fc132de0 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240" status: 200 len: 1311 microversion: 2.1 time: 0.226513 Oct 12 22:06:06.122956 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 968/1826] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:05 2022] GET /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240 => generated 1311 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:06.337753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-86c07453-0085-4014-ae39-9c45c2a59ae6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:06.348115 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-86c07453-0085-4014-ae39-9c45c2a59ae6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1536 microversion: 2.1 time: 0.334228 Oct 12 22:06:06.349534 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 859/1827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:06 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1536 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:06.399766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6d2a012d-00a4-4a31-828e-6c3e8a96316a tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512c58bd30>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:06.454736 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6d2a012d-00a4-4a31-828e-6c3e8a96316a tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.058744 Oct 12 22:06:06.455502 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 969/1828] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:06 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:06.707799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-2edba875-a8eb-4067-a88d-a11b1a73314c req-4fd8b849-6bcf-4240-8010-0b6efaf2949c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "747a8555-8993-47b3-a6de-2f32f025e240", "name": "network-vif-deleted", "tag": "5cd49275-a219-45d2-abdc-6dac2bc36141"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:06.740050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2edba875-a8eb-4067-a88d-a11b1a73314c req-4fd8b849-6bcf-4240-8010-0b6efaf2949c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:06.740540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2edba875-a8eb-4067-a88d-a11b1a73314c req-4fd8b849-6bcf-4240-8010-0b6efaf2949c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:06.740974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2edba875-a8eb-4067-a88d-a11b1a73314c req-4fd8b849-6bcf-4240-8010-0b6efaf2949c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:06.752398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-359a4f15-0a11-4bd0-95f5-0478ec64374b req-35904e09-3f1f-4747-a387-3b4be723c9ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0bc29c-b01a-4913-b58d-0f0368eeaa52", "name": "network-vif-plugged", "status": "completed", "tag": "8f924ca4-6121-4359-b81c-8b01b45de897"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:06.787016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-359a4f15-0a11-4bd0-95f5-0478ec64374b req-35904e09-3f1f-4747-a387-3b4be723c9ea service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:06.787525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-359a4f15-0a11-4bd0-95f5-0478ec64374b req-35904e09-3f1f-4747-a387-3b4be723c9ea service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:06.787960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-359a4f15-0a11-4bd0-95f5-0478ec64374b req-35904e09-3f1f-4747-a387-3b4be723c9ea service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:06.793195 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-2edba875-a8eb-4067-a88d-a11b1a73314c req-4fd8b849-6bcf-4240-8010-0b6efaf2949c service nova] Creating event network-vif-deleted:5cd49275-a219-45d2-abdc-6dac2bc36141 for instance 747a8555-8993-47b3-a6de-2f32f025e240 on n-h2-861111-1 Oct 12 22:06:06.805962 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-2edba875-a8eb-4067-a88d-a11b1a73314c req-4fd8b849-6bcf-4240-8010-0b6efaf2949c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102009 Oct 12 22:06:06.811821 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 860/1829] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:06.827453 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-359a4f15-0a11-4bd0-95f5-0478ec64374b req-35904e09-3f1f-4747-a387-3b4be723c9ea service nova] Creating event network-vif-plugged:8f924ca4-6121-4359-b81c-8b01b45de897 for instance 0a0bc29c-b01a-4913-b58d-0f0368eeaa52 on n-h1-861111-1 Oct 12 22:06:06.830919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-65d3776d-292d-4715-8a8d-c96de23b733b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:06.834882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-65d3776d-292d-4715-8a8d-c96de23b733b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:06.837684 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-359a4f15-0a11-4bd0-95f5-0478ec64374b req-35904e09-3f1f-4747-a387-3b4be723c9ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089507 Oct 12 22:06:06.839466 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 970/1830] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:06:06.869989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65d3776d-292d-4715-8a8d-c96de23b733b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:06.870530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65d3776d-292d-4715-8a8d-c96de23b733b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:06.870989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65d3776d-292d-4715-8a8d-c96de23b733b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:06.889416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65d3776d-292d-4715-8a8d-c96de23b733b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:06.889873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65d3776d-292d-4715-8a8d-c96de23b733b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:06.890201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65d3776d-292d-4715-8a8d-c96de23b733b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:07.034799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1c049e9c-efc1-4552-a8c7-490a27b4c3f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:07.036098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1c049e9c-efc1-4552-a8c7-490a27b4c3f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:07.048733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c049e9c-efc1-4552-a8c7-490a27b4c3f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:07.049225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c049e9c-efc1-4552-a8c7-490a27b4c3f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:07.054002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c049e9c-efc1-4552-a8c7-490a27b4c3f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:07.054760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c049e9c-efc1-4552-a8c7-490a27b4c3f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:07.055225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c049e9c-efc1-4552-a8c7-490a27b4c3f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:07.057408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c049e9c-efc1-4552-a8c7-490a27b4c3f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:07.417107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-65d3776d-292d-4715-8a8d-c96de23b733b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:07.432014 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-65d3776d-292d-4715-8a8d-c96de23b733b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1493 microversion: 2.1 time: 0.617891 Oct 12 22:06:07.433437 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 861/1831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:06 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1493 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:07.446521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3771bd7d-d7ac-4d25-b77d-c23f4ab3edf4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:07.447585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3771bd7d-d7ac-4d25-b77d-c23f4ab3edf4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 747a8555-8993-47b3-a6de-2f32f025e240] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:07.463016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3771bd7d-d7ac-4d25-b77d-c23f4ab3edf4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:07.463811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3771bd7d-d7ac-4d25-b77d-c23f4ab3edf4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:07.464473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3771bd7d-d7ac-4d25-b77d-c23f4ab3edf4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:07.465362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3771bd7d-d7ac-4d25-b77d-c23f4ab3edf4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:07.466876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3771bd7d-d7ac-4d25-b77d-c23f4ab3edf4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:07.470455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3771bd7d-d7ac-4d25-b77d-c23f4ab3edf4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:07.501071 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-3771bd7d-d7ac-4d25-b77d-c23f4ab3edf4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] HTTP exception thrown: Instance 747a8555-8993-47b3-a6de-2f32f025e240 could not be found. Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3771bd7d-d7ac-4d25-b77d-c23f4ab3edf4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Request method failure captured: Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240 HTTP/1.1 Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRznoxnVxikVWukTEwCOIJicYCRnweBF0UdOBpS7ApkHM3G1B384Hh466oBKRhH9N8Abuu6Bm5IcHpJhRzCI14DpXyVveyyYSOzWCwM9efdUbp7XLCn7EGQgA8SnU73ChDpuCTSJTRQTvRtLpLS7rGHp1usRONARhr6BxDirkVF_w6iI Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: f0051e5f43b7403cbb4c29a00bb73513 Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ListServerFiltersTestJSON-411369961 Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:06:07.503035 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:06:07.505434 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f0051e5f43b7403cbb4c29a00bb73513"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f0051e5f43b7403cbb4c29a00bb73513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f0051e5f43b7403cbb4c29a00bb73513", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f0051e5f43b7403cbb4c29a00bb73513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:06:07.505434 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ListServerFiltersTestJSON-411369961 Oct 12 22:06:07.505434 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: f0051e5f43b7403cbb4c29a00bb73513 Oct 12 22:06:07.505434 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-411369961 Oct 12 22:06:07.505434 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ListServerFiltersTestJSON-411369961-project Oct 12 22:06:07.505434 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:06:07.505434 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:06:07.505434 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11d42d1fe957461e9fb85d0823ad5866 Oct 12 22:06:07.505434 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ListServerFiltersTestJSON-411369961-project Oct 12 22:06:07.505434 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:06:07.505434 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 747a8555-8993-47b3-a6de-2f32f025e240 could not be found. Oct 12 22:06:07.505434 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '747a8555-8993-47b3-a6de-2f32f025e240'} Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 747a8555-8993-47b3-a6de-2f32f025e240 could not be found. Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:06:07.506256 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 747a8555-8993-47b3-a6de-2f32f025e240 could not be found. Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 747a8555-8993-47b3-a6de-2f32f025e240 could not be found. Oct 12 22:06:07.507624 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:07.510309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3771bd7d-d7ac-4d25-b77d-c23f4ab3edf4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Returning 404 to user: Instance 747a8555-8993-47b3-a6de-2f32f025e240 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:06:07.511425 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3771bd7d-d7ac-4d25-b77d-c23f4ab3edf4 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240" status: 404 len: 111 microversion: 2.1 time: 0.075582 Oct 12 22:06:07.519283 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 862/1832] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:07 2022] GET /compute/v2.1/servers/747a8555-8993-47b3-a6de-2f32f025e240 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:06:07.525722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8bc45f06-3dde-4ffb-87e2-217f17455675 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:07.527948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8bc45f06-3dde-4ffb-87e2-217f17455675 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:07.539207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bc45f06-3dde-4ffb-87e2-217f17455675 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:07.540384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bc45f06-3dde-4ffb-87e2-217f17455675 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:07.540937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bc45f06-3dde-4ffb-87e2-217f17455675 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:07.542511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bc45f06-3dde-4ffb-87e2-217f17455675 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:07.543900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bc45f06-3dde-4ffb-87e2-217f17455675 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:07.544554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bc45f06-3dde-4ffb-87e2-217f17455675 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:07.729984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1c049e9c-efc1-4552-a8c7-490a27b4c3f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:07.745356 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1c049e9c-efc1-4552-a8c7-490a27b4c3f1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1199 microversion: 2.1 time: 0.716364 Oct 12 22:06:07.748354 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 971/1833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:07 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1199 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:06:07.774703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-890e632a-d8f5-4abf-889b-3c0f5afea723 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f5128553f70>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:07.861724 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-890e632a-d8f5-4abf-889b-3c0f5afea723 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.112244 Oct 12 22:06:07.870382 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 972/1834] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:07 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:07.882345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-255b32b6-5ddd-43a8-afe7-9f75d189b32a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:07.882864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-255b32b6-5ddd-43a8-afe7-9f75d189b32a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:07.890614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-255b32b6-5ddd-43a8-afe7-9f75d189b32a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:07.891104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-255b32b6-5ddd-43a8-afe7-9f75d189b32a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:07.895721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-255b32b6-5ddd-43a8-afe7-9f75d189b32a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:07.897240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-255b32b6-5ddd-43a8-afe7-9f75d189b32a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:07.899738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-255b32b6-5ddd-43a8-afe7-9f75d189b32a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:07.902195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-255b32b6-5ddd-43a8-afe7-9f75d189b32a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:07.972191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-255b32b6-5ddd-43a8-afe7-9f75d189b32a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:06:08.167705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8bc45f06-3dde-4ffb-87e2-217f17455675 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:08.183573 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8bc45f06-3dde-4ffb-87e2-217f17455675 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1529 microversion: 2.1 time: 0.656489 Oct 12 22:06:08.184499 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 863/1835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:07 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1529 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:08.222722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-89f069e7-d6d2-4ab5-a8f9-2768dfa30ec8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:08.228332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-89f069e7-d6d2-4ab5-a8f9-2768dfa30ec8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:08.253571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89f069e7-d6d2-4ab5-a8f9-2768dfa30ec8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:08.254826 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-255b32b6-5ddd-43a8-afe7-9f75d189b32a tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 204 len: 0 microversion: 2.1 time: 0.388789 Oct 12 22:06:08.257289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89f069e7-d6d2-4ab5-a8f9-2768dfa30ec8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:08.257775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89f069e7-d6d2-4ab5-a8f9-2768dfa30ec8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:08.258269 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 973/1836] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:06:07 2022] DELETE /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:06:08.265789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89f069e7-d6d2-4ab5-a8f9-2768dfa30ec8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:08.266292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89f069e7-d6d2-4ab5-a8f9-2768dfa30ec8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:08.271836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-827fcec5-20d6-435a-aff6-09b391220318 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:08.274995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-827fcec5-20d6-435a-aff6-09b391220318 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:08.276152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89f069e7-d6d2-4ab5-a8f9-2768dfa30ec8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:08.291789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-827fcec5-20d6-435a-aff6-09b391220318 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:08.291789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-827fcec5-20d6-435a-aff6-09b391220318 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:08.291789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-827fcec5-20d6-435a-aff6-09b391220318 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:08.291789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-827fcec5-20d6-435a-aff6-09b391220318 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:08.292191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-827fcec5-20d6-435a-aff6-09b391220318 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:08.292191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-827fcec5-20d6-435a-aff6-09b391220318 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:08.606829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-827fcec5-20d6-435a-aff6-09b391220318 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:08.616158 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-827fcec5-20d6-435a-aff6-09b391220318 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1517 microversion: 2.1 time: 0.353499 Oct 12 22:06:08.616969 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 974/1837] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:08 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1517 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:08.639268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5a632fe9-9497-48d1-854f-1fb0b56e8536 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:08.640130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5a632fe9-9497-48d1-854f-1fb0b56e8536 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:08.646557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a632fe9-9497-48d1-854f-1fb0b56e8536 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:08.647322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a632fe9-9497-48d1-854f-1fb0b56e8536 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:08.647948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a632fe9-9497-48d1-854f-1fb0b56e8536 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:08.649630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a632fe9-9497-48d1-854f-1fb0b56e8536 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:08.650519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a632fe9-9497-48d1-854f-1fb0b56e8536 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:08.651126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a632fe9-9497-48d1-854f-1fb0b56e8536 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:08.801745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5a632fe9-9497-48d1-854f-1fb0b56e8536 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:08.812650 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5a632fe9-9497-48d1-854f-1fb0b56e8536 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1293 microversion: 2.1 time: 0.182890 Oct 12 22:06:08.835491 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 975/1838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:08 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1293 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:08.844604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cbd07a85-e311-4753-b4ba-bcf85cc1f5f0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:08.845621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cbd07a85-e311-4753-b4ba-bcf85cc1f5f0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:08.862948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-89f069e7-d6d2-4ab5-a8f9-2768dfa30ec8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:08.867641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbd07a85-e311-4753-b4ba-bcf85cc1f5f0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:08.870412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbd07a85-e311-4753-b4ba-bcf85cc1f5f0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:08.870883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbd07a85-e311-4753-b4ba-bcf85cc1f5f0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:08.873794 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-89f069e7-d6d2-4ab5-a8f9-2768dfa30ec8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1529 microversion: 2.1 time: 0.665225 Oct 12 22:06:08.874475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbd07a85-e311-4753-b4ba-bcf85cc1f5f0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:08.874978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbd07a85-e311-4753-b4ba-bcf85cc1f5f0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:08.875461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbd07a85-e311-4753-b4ba-bcf85cc1f5f0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:08.878546 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 864/1839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:08 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1529 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:08.891723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-7cd1653f-da3e-4abf-b086-d5a68e3895d4 req-5dc30890-7e04-4ddb-af95-10913902eba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef20289-f683-41c1-8a71-b632098119c7", "name": "network-vif-deleted", "tag": "a80001d4-8ef9-4f37-9c36-558312053557"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:08.929600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7cd1653f-da3e-4abf-b086-d5a68e3895d4 req-5dc30890-7e04-4ddb-af95-10913902eba1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:08.930100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7cd1653f-da3e-4abf-b086-d5a68e3895d4 req-5dc30890-7e04-4ddb-af95-10913902eba1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:08.930546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7cd1653f-da3e-4abf-b086-d5a68e3895d4 req-5dc30890-7e04-4ddb-af95-10913902eba1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:08.975656 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-7cd1653f-da3e-4abf-b086-d5a68e3895d4 req-5dc30890-7e04-4ddb-af95-10913902eba1 service nova] Creating event network-vif-deleted:a80001d4-8ef9-4f37-9c36-558312053557 for instance 6ef20289-f683-41c1-8a71-b632098119c7 on n-h1-861111-1 Oct 12 22:06:08.997230 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-7cd1653f-da3e-4abf-b086-d5a68e3895d4 req-5dc30890-7e04-4ddb-af95-10913902eba1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113841 Oct 12 22:06:08.997993 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 865/1840] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:09.017645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-883c533d-d53d-4fb8-88cc-658f3988573f tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512c3bc940>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:09.124179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:09.244666 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-883c533d-d53d-4fb8-88cc-658f3988573f tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.241493 Oct 12 22:06:09.245329 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 866/1841] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:08 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:09.263726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dbb0922c-1112-4bcb-9734-a4bd93d1a8f9 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:09.278742 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-dbb0922c-1112-4bcb-9734-a4bd93d1a8f9 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] HTTP exception thrown: Flavor 5ae2613b-be75-44b9-b3e6-c50dcadc181a could not be found. Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dbb0922c-1112-4bcb-9734-a4bd93d1a8f9 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Request method failure captured: Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/flavors/5ae2613b-be75-44b9-b3e6-c50dcadc181a HTTP/1.1 Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzlwvMOyE3oSTD8VWBaoXblNbgyVPxVWxRQivimwsGKxVZ44uVCdRxxidMNmL30Lu7VID6rT0z7rJQAqV_N9hOQJ3WhobW5j1oqe_08n8E6bhEA96X95ZLleIRFlTEhwnoLCXDGYxQf_AwtacKbYC9vPCI48ctyfd7AzojdFrJ3sebQ Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: d7b11f85b98b41f380033fce110090be Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-MigrationsAdminTest-203229595 Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 22:06:09.297510 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 22:06:09.299147 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7b11f85b98b41f380033fce110090be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7b11f85b98b41f380033fce110090be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d7b11f85b98b41f380033fce110090be", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d7b11f85b98b41f380033fce110090be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:06:09.299147 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-MigrationsAdminTest-203229595 Oct 12 22:06:09.299147 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: d7b11f85b98b41f380033fce110090be Oct 12 22:06:09.299147 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-MigrationsAdminTest-203229595 Oct 12 22:06:09.299147 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-MigrationsAdminTest-203229595-project-admin Oct 12 22:06:09.299147 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:06:09.299147 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:06:09.299147 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 9a66f4d7b25c41869a862712926f24ef Oct 12 22:06:09.299147 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-MigrationsAdminTest-203229595-project-admin Oct 12 22:06:09.299147 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:06:09.299147 n-d-861111-1 devstack@n-api.service[120452]: exception: Flavor 5ae2613b-be75-44b9-b3e6-c50dcadc181a could not be found. Oct 12 22:06:09.299147 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '5ae2613b-be75-44b9-b3e6-c50dcadc181a'} Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 5ae2613b-be75-44b9-b3e6-c50dcadc181a could not be found. Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:09.300098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 5ae2613b-be75-44b9-b3e6-c50dcadc181a could not be found. Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 5ae2613b-be75-44b9-b3e6-c50dcadc181a could not be found. Oct 12 22:06:09.301619 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:09.310926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dbb0922c-1112-4bcb-9734-a4bd93d1a8f9 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Returning 404 to user: Flavor 5ae2613b-be75-44b9-b3e6-c50dcadc181a could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:06:09.312966 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dbb0922c-1112-4bcb-9734-a4bd93d1a8f9 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/5ae2613b-be75-44b9-b3e6-c50dcadc181a" status: 404 len: 109 microversion: 2.1 time: 0.066534 Oct 12 22:06:09.316181 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 867/1842] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:06:09 2022] DELETE /compute/v2.1/flavors/5ae2613b-be75-44b9-b3e6-c50dcadc181a => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:06:09.332658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cbd07a85-e311-4753-b4ba-bcf85cc1f5f0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:09.349140 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cbd07a85-e311-4753-b4ba-bcf85cc1f5f0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1199 microversion: 2.1 time: 0.512406 Oct 12 22:06:09.355856 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 976/1843] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:08 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1199 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:09.478058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1585667080", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:09.579815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:06:09.643980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1d20bf79-52af-41ea-aad1-c18c1267a059 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:09.645274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1d20bf79-52af-41ea-aad1-c18c1267a059 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:09.666054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d20bf79-52af-41ea-aad1-c18c1267a059 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:09.666545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d20bf79-52af-41ea-aad1-c18c1267a059 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:09.669431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d20bf79-52af-41ea-aad1-c18c1267a059 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:09.679427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d20bf79-52af-41ea-aad1-c18c1267a059 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:09.680330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d20bf79-52af-41ea-aad1-c18c1267a059 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:09.681006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d20bf79-52af-41ea-aad1-c18c1267a059 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:09.950604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:06:09.951805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:06:09.953765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:06:09.954477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:06:09.956355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:06:09.984269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:09.987538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:09.989967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:09.991300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:09.993681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:09.995201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:10.064819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Getting quotas for project 7d943f8c0c934001b53032564fd00e11. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:06:10.078870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Getting quotas for user cfc7df27bf6f456581abff6e80ab4f64 and project 7d943f8c0c934001b53032564fd00e11. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:06:10.079137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1d20bf79-52af-41ea-aad1-c18c1267a059 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:10.089687 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1d20bf79-52af-41ea-aad1-c18c1267a059 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1517 microversion: 2.1 time: 0.450161 Oct 12 22:06:10.091810 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 977/1844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:09 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1517 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:06:10.098253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bced2ef9-1630-41db-a89d-4c85b2fc4ce9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:10.099142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bced2ef9-1630-41db-a89d-4c85b2fc4ce9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:10.109009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bced2ef9-1630-41db-a89d-4c85b2fc4ce9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:10.109758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bced2ef9-1630-41db-a89d-4c85b2fc4ce9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:10.110429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bced2ef9-1630-41db-a89d-4c85b2fc4ce9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:10.119552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:06:10.119891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bced2ef9-1630-41db-a89d-4c85b2fc4ce9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:10.120667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bced2ef9-1630-41db-a89d-4c85b2fc4ce9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:10.121297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bced2ef9-1630-41db-a89d-4c85b2fc4ce9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:10.124211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:06:10.200759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bced2ef9-1630-41db-a89d-4c85b2fc4ce9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:10.201563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bced2ef9-1630-41db-a89d-4c85b2fc4ce9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:10.202298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bced2ef9-1630-41db-a89d-4c85b2fc4ce9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:10.203567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-bced2ef9-1630-41db-a89d-4c85b2fc4ce9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lazy-loading 'fault' on Instance uuid 6ef20289-f683-41c1-8a71-b632098119c7 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:06:10.262722 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-55a6a172-9a36-4966-8dc1-7fa8af63fac3 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790298 Oct 12 22:06:10.270372 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 868/1845] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:06:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:06:10.286464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-47735a50-387d-45ba-ac61-21236126c261 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512c3bc3a0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:10.358879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bced2ef9-1630-41db-a89d-4c85b2fc4ce9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:10.367962 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bced2ef9-1630-41db-a89d-4c85b2fc4ce9 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 200 len: 1298 microversion: 2.1 time: 0.274228 Oct 12 22:06:10.370766 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 978/1846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:10 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 1298 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:10.373845 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-47735a50-387d-45ba-ac61-21236126c261 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.091264 Oct 12 22:06:10.374905 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 869/1847] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:10 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:10.380399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd3ae75c-45e7-4ef7-8977-ebe17cf956fe tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:10.382186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dd3ae75c-45e7-4ef7-8977-ebe17cf956fe tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:10.392828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ca8eb34a-f9a3-47f6-9f7e-6750412b934f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:10.393765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ca8eb34a-f9a3-47f6-9f7e-6750412b934f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:10.426417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca8eb34a-f9a3-47f6-9f7e-6750412b934f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:10.429289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca8eb34a-f9a3-47f6-9f7e-6750412b934f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:10.431769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca8eb34a-f9a3-47f6-9f7e-6750412b934f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:10.432688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca8eb34a-f9a3-47f6-9f7e-6750412b934f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:10.438536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca8eb34a-f9a3-47f6-9f7e-6750412b934f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:10.440645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca8eb34a-f9a3-47f6-9f7e-6750412b934f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:10.489815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dd3ae75c-45e7-4ef7-8977-ebe17cf956fe tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:10.498448 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dd3ae75c-45e7-4ef7-8977-ebe17cf956fe tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1213 microversion: 2.1 time: 0.126461 Oct 12 22:06:10.505824 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 979/1848] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:10 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1213 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:10.772814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ca8eb34a-f9a3-47f6-9f7e-6750412b934f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:10.803944 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ca8eb34a-f9a3-47f6-9f7e-6750412b934f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1199 microversion: 2.1 time: 0.427915 Oct 12 22:06:10.807116 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 870/1849] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:10 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1199 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:10.881912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-520ec603-94b8-4567-b697-142716e5b9e3 req-c3f7f13a-c363-434d-8991-a91dbdaabfc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae4e25e-f720-42f5-aaa1-eac6492e37d3", "name": "network-vif-plugged", "status": "completed", "tag": "17538477-fced-4d99-b30b-5724d63d3744"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:10.914557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-520ec603-94b8-4567-b697-142716e5b9e3 req-c3f7f13a-c363-434d-8991-a91dbdaabfc4 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:10.915030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-520ec603-94b8-4567-b697-142716e5b9e3 req-c3f7f13a-c363-434d-8991-a91dbdaabfc4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:10.916110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-520ec603-94b8-4567-b697-142716e5b9e3 req-c3f7f13a-c363-434d-8991-a91dbdaabfc4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:10.947884 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-520ec603-94b8-4567-b697-142716e5b9e3 req-c3f7f13a-c363-434d-8991-a91dbdaabfc4 service nova] Creating event network-vif-plugged:17538477-fced-4d99-b30b-5724d63d3744 for instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 on n-h1-861111-1 Oct 12 22:06:10.965867 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-520ec603-94b8-4567-b697-142716e5b9e3 req-c3f7f13a-c363-434d-8991-a91dbdaabfc4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091917 Oct 12 22:06:10.968344 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 871/1850] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:11.067335 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2ac35ca9-e116-4a25-94e5-41ea6f7548d3 tempest-TenantUsagesNegativeTestJSON-457027643 tempest-TenantUsagesNegativeTestJSON-457027643-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-11T22%3A06%3A10.766369&end=2022-10-13T22%3A06%3A10.766369" status: 404 len: 112 microversion: - time: 0.295567 Oct 12 22:06:11.068457 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 980/1851] 10.222.0.16 () {58 vars in 1316 bytes} [Wed Oct 12 22:06:10 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-11T22%3A06%3A10.766369&end=2022-10-13T22%3A06%3A10.766369 => generated 112 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 22:06:11.078805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-02aab31b-3861-41ca-b757-853927ab90ea tempest-TenantUsagesNegativeTestJSON-457027643 tempest-TenantUsagesNegativeTestJSON-457027643-project-admin] Calling method '.version_select at 0x7f5123919e50>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:11.095258 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-02aab31b-3861-41ca-b757-853927ab90ea tempest-TenantUsagesNegativeTestJSON-457027643 tempest-TenantUsagesNegativeTestJSON-457027643-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-02aab31b-3861-41ca-b757-853927ab90ea tempest-TenantUsagesNegativeTestJSON-457027643 tempest-TenantUsagesNegativeTestJSON-457027643-project-admin] Request method failure captured: Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-simple-tenant-usage/782c834075764e0695084601f9eb671f?start=2022-10-13T22%3A06%3A10.766369&end=2022-10-11T22%3A06%3A10.766369 HTTP/1.1 Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzpSbFnzVNO5fEqAMlbxBhC2W0NqOd_6HWk80tTpcHxyc6RMTuAwmqmXRmEdPR87kDgvk6bRKlDQWQD4wgQqk4uXGNPw6Y4zfxw1l00bVfxjRMa4bAmR1FAFMyK_6OLbYeUAl1h2GRtYKVMTlDdNlewreP2OHWiQtN8KsLUfYTMdXy4 Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 8bfa41ce88df4fd5ad51c7efcbc4ed00 Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-457027643 Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 22:06:11.100033 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 22:06:11.101733 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8bfa41ce88df4fd5ad51c7efcbc4ed00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8bfa41ce88df4fd5ad51c7efcbc4ed00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8bfa41ce88df4fd5ad51c7efcbc4ed00", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8bfa41ce88df4fd5ad51c7efcbc4ed00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:06:11.101733 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-457027643 Oct 12 22:06:11.101733 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 8bfa41ce88df4fd5ad51c7efcbc4ed00 Oct 12 22:06:11.101733 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-457027643 Oct 12 22:06:11.101733 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TenantUsagesNegativeTestJSON-457027643-project-admin Oct 12 22:06:11.101733 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:06:11.101733 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:06:11.101733 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 546a04e0e5b44d5e98c5da1dc76a73aa Oct 12 22:06:11.101733 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-457027643-project-admin Oct 12 22:06:11.101733 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:06:11.101733 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid start time. The start time cannot occur after the end time. Oct 12 22:06:11.101733 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '782c834075764e0695084601f9eb671f'} Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 12 22:06:11.102716 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 12 22:06:11.104130 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:11.104130 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:11.104130 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:11.104130 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:11.104130 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:11.104130 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:11.104130 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:06:11.104130 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:06:11.104130 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 12 22:06:11.104130 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:11.106112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-02aab31b-3861-41ca-b757-853927ab90ea tempest-TenantUsagesNegativeTestJSON-457027643 tempest-TenantUsagesNegativeTestJSON-457027643-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:06:11.107693 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-02aab31b-3861-41ca-b757-853927ab90ea tempest-TenantUsagesNegativeTestJSON-457027643 tempest-TenantUsagesNegativeTestJSON-457027643-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/782c834075764e0695084601f9eb671f?start=2022-10-13T22%3A06%3A10.766369&end=2022-10-11T22%3A06%3A10.766369" status: 400 len: 111 microversion: 2.1 time: 0.032687 Oct 12 22:06:11.108575 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 872/1852] 10.222.0.16 () {58 vars in 1412 bytes} [Wed Oct 12 22:06:11 2022] GET /compute/v2.1/os-simple-tenant-usage/782c834075764e0695084601f9eb671f?start=2022-10-13T22%3A06%3A10.766369&end=2022-10-11T22%3A06%3A10.766369 => generated 111 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:06:11.118664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-12c993b8-c9af-4133-b711-51f03c1bc545 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:11.119372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-12c993b8-c9af-4133-b711-51f03c1bc545 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:11.140543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12c993b8-c9af-4133-b711-51f03c1bc545 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:11.141037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12c993b8-c9af-4133-b711-51f03c1bc545 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:11.147845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12c993b8-c9af-4133-b711-51f03c1bc545 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:11.148824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12c993b8-c9af-4133-b711-51f03c1bc545 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:11.149452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12c993b8-c9af-4133-b711-51f03c1bc545 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:11.150077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12c993b8-c9af-4133-b711-51f03c1bc545 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:11.255713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-12c993b8-c9af-4133-b711-51f03c1bc545 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:11.266674 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-12c993b8-c9af-4133-b711-51f03c1bc545 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1475 microversion: 2.1 time: 0.152042 Oct 12 22:06:11.283083 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 981/1853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:11 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1475 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:11.364559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-cc073d87-4243-48d4-89eb-ccd34b69d17c req-0b8e3b69-0700-44a1-af90-988f7e92032f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6", "name": "network-vif-deleted", "tag": "4c86b396-60e9-4162-9c59-e36739bc7fa3"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:11.387669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cc073d87-4243-48d4-89eb-ccd34b69d17c req-0b8e3b69-0700-44a1-af90-988f7e92032f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:11.395118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cc073d87-4243-48d4-89eb-ccd34b69d17c req-0b8e3b69-0700-44a1-af90-988f7e92032f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:11.395646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cc073d87-4243-48d4-89eb-ccd34b69d17c req-0b8e3b69-0700-44a1-af90-988f7e92032f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:11.416048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8313f3ff-570e-4b3a-a416-f58740aed3ff tempest-TenantUsagesNegativeTestJSON-1988376305 tempest-TenantUsagesNegativeTestJSON-1988376305-project] Calling method '.version_select at 0x7f512392d550>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:11.419880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8313f3ff-570e-4b3a-a416-f58740aed3ff tempest-TenantUsagesNegativeTestJSON-1988376305 tempest-TenantUsagesNegativeTestJSON-1988376305-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'b0209a0d60d04d06b1296e8a1aed2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c834075764e0695084601f9eb671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8313f3ff-570e-4b3a-a416-f58740aed3ff tempest-TenantUsagesNegativeTestJSON-1988376305 tempest-TenantUsagesNegativeTestJSON-1988376305-project] Request method failure captured: Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T22%3A06%3A10.766369&end=2022-10-13T22%3A06%3A10.766369&detailed=1 HTTP/1.1 Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzpRLcu4EZMGb6mI-egwO4tbEy_4GpcFcfkcVaYrxenoE-pMvqgBUFdQ4dm29_SGx-AntbzalwmgyoUrP1Jtbmv1EIiEG4jBRUOmLxWfw65iwX33HLA3F328prkirCZRyDUH_g6s6CZFhrRMN6-MwiFMxuvz0XT9LA3HX6-gg-Y6LOI Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 782c834075764e0695084601f9eb671f Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1988376305 Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:06:11.428483 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:06:11.430000 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/782c834075764e0695084601f9eb671f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/782c834075764e0695084601f9eb671f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_782c834075764e0695084601f9eb671f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/782c834075764e0695084601f9eb671f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:06:11.430000 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1988376305 Oct 12 22:06:11.430000 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 782c834075764e0695084601f9eb671f Oct 12 22:06:11.430000 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1988376305 Oct 12 22:06:11.430000 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TenantUsagesNegativeTestJSON-1988376305-project Oct 12 22:06:11.430000 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:06:11.430000 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:06:11.430000 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: b0209a0d60d04d06b1296e8a1aed2bd1 Oct 12 22:06:11.430000 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1988376305-project Oct 12 22:06:11.430000 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:06:11.430000 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 12 22:06:11.430000 n-d-861111-1 devstack@n-api.service[120452]: action_args: {} Oct 12 22:06:11.430000 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:06:11.430912 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:06:11.432389 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:06:11.433751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 12 22:06:11.433751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:11.438179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8313f3ff-570e-4b3a-a416-f58740aed3ff tempest-TenantUsagesNegativeTestJSON-1988376305 tempest-TenantUsagesNegativeTestJSON-1988376305-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:06:11.439444 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8313f3ff-570e-4b3a-a416-f58740aed3ff tempest-TenantUsagesNegativeTestJSON-1988376305 tempest-TenantUsagesNegativeTestJSON-1988376305-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T22%3A06%3A10.766369&end=2022-10-13T22%3A06%3A10.766369&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.317837 Oct 12 22:06:11.442076 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 873/1854] 10.222.0.16 () {58 vars in 1335 bytes} [Wed Oct 12 22:06:11 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T22%3A06%3A10.766369&end=2022-10-13T22%3A06%3A10.766369&detailed=1 => generated 123 bytes in 327 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:06:11.446109 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-cc073d87-4243-48d4-89eb-ccd34b69d17c req-0b8e3b69-0700-44a1-af90-988f7e92032f service nova] Creating event network-vif-deleted:4c86b396-60e9-4162-9c59-e36739bc7fa3 for instance 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 on n-h2-861111-1 Oct 12 22:06:11.456523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f0ec2b8e-ffbe-48cb-bb86-9e68757ead48 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512392d670>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:11.458987 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-cc073d87-4243-48d4-89eb-ccd34b69d17c req-0b8e3b69-0700-44a1-af90-988f7e92032f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096766 Oct 12 22:06:11.459924 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 982/1855] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:06:11.479630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3bd33ba3-716c-49a0-8923-01ddd734a039 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:11.481394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3bd33ba3-716c-49a0-8923-01ddd734a039 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:11.497832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bd33ba3-716c-49a0-8923-01ddd734a039 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:11.498647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bd33ba3-716c-49a0-8923-01ddd734a039 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:11.499463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bd33ba3-716c-49a0-8923-01ddd734a039 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:11.500539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bd33ba3-716c-49a0-8923-01ddd734a039 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:11.503765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bd33ba3-716c-49a0-8923-01ddd734a039 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:11.505036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bd33ba3-716c-49a0-8923-01ddd734a039 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:11.542333 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f0ec2b8e-ffbe-48cb-bb86-9e68757ead48 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.094850 Oct 12 22:06:11.544270 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 874/1856] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:11 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:11.550308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aeb9970e-e77f-4d53-9b87-c7684425e9bd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:11.552165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-aeb9970e-e77f-4d53-9b87-c7684425e9bd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:11.554894 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-3bd33ba3-716c-49a0-8923-01ddd734a039 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. Oct 12 22:06:11.559116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aeb9970e-e77f-4d53-9b87-c7684425e9bd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:11.559924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aeb9970e-e77f-4d53-9b87-c7684425e9bd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:11.560589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aeb9970e-e77f-4d53-9b87-c7684425e9bd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3bd33ba3-716c-49a0-8923-01ddd734a039 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 HTTP/1.1 Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:06:11.561193 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:06:11.563394 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:06:11.563394 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:06:11.563394 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:06:11.563394 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:06:11.563394 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:06:11.563394 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:06:11.563394 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:06:11.563394 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:06:11.563394 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:06:11.563394 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:06:11.563394 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. Oct 12 22:06:11.563394 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '6ef20289-f683-41c1-8a71-b632098119c7'} Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:06:11.564285 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. Oct 12 22:06:11.567448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:11.569887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3bd33ba3-716c-49a0-8923-01ddd734a039 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:06:11.569887 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3bd33ba3-716c-49a0-8923-01ddd734a039 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 404 len: 111 microversion: 2.1 time: 0.101577 Oct 12 22:06:11.571111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aeb9970e-e77f-4d53-9b87-c7684425e9bd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:11.571888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aeb9970e-e77f-4d53-9b87-c7684425e9bd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:11.572482 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 983/1857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:11 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:06:11.572928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aeb9970e-e77f-4d53-9b87-c7684425e9bd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:11.587015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-00cb24c7-b3c3-41e9-a4f1-d37f1dd1bc93 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51285bba60>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:11.728276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-aeb9970e-e77f-4d53-9b87-c7684425e9bd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:11.742264 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-aeb9970e-e77f-4d53-9b87-c7684425e9bd tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1265 microversion: 2.1 time: 0.195971 Oct 12 22:06:11.743458 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 875/1858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:11 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:11.829183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-61011e72-7871-4ddd-a931-8fdb62049dbb tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:11.829929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-61011e72-7871-4ddd-a931-8fdb62049dbb tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:11.843927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61011e72-7871-4ddd-a931-8fdb62049dbb tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:11.850413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61011e72-7871-4ddd-a931-8fdb62049dbb tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:11.852905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61011e72-7871-4ddd-a931-8fdb62049dbb tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:11.853683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61011e72-7871-4ddd-a931-8fdb62049dbb tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:11.856377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61011e72-7871-4ddd-a931-8fdb62049dbb tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:11.861289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61011e72-7871-4ddd-a931-8fdb62049dbb tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:12.208355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-61011e72-7871-4ddd-a931-8fdb62049dbb tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:12.217605 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-61011e72-7871-4ddd-a931-8fdb62049dbb tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1199 microversion: 2.1 time: 0.393384 Oct 12 22:06:12.218396 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 876/1859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:11 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1199 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:12.296674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d2d231cf-78ce-4ad5-a813-11ec0f5114f7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:12.297462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d2d231cf-78ce-4ad5-a813-11ec0f5114f7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:12.338410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2d231cf-78ce-4ad5-a813-11ec0f5114f7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:12.339206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2d231cf-78ce-4ad5-a813-11ec0f5114f7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:12.342472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2d231cf-78ce-4ad5-a813-11ec0f5114f7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:12.344450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2d231cf-78ce-4ad5-a813-11ec0f5114f7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:12.346104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2d231cf-78ce-4ad5-a813-11ec0f5114f7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:12.365979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2d231cf-78ce-4ad5-a813-11ec0f5114f7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:12.460651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2d231cf-78ce-4ad5-a813-11ec0f5114f7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:12.461409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2d231cf-78ce-4ad5-a813-11ec0f5114f7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:12.462031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2d231cf-78ce-4ad5-a813-11ec0f5114f7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:12.462658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-d2d231cf-78ce-4ad5-a813-11ec0f5114f7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lazy-loading 'fault' on Instance uuid 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:06:12.578726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d2d231cf-78ce-4ad5-a813-11ec0f5114f7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d42d1fe957461e9fb85d0823ad5866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0051e5f43b7403cbb4c29a00bb73513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:12.583307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:12.597221 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d2d231cf-78ce-4ad5-a813-11ec0f5114f7 tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 200 len: 1311 microversion: 2.1 time: 0.304883 Oct 12 22:06:12.599057 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 877/1860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:12 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 1311 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:12.605377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c12fa096-7326-4d2b-844b-05e7b6415cd5 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f5123919670>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:13.834213 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-00cb24c7-b3c3-41e9-a4f1-d37f1dd1bc93 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be" status: 204 len: 0 microversion: 2.1 time: 2.258663 Oct 12 22:06:13.841167 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 984/1861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:11 2022] DELETE /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be => generated 0 bytes in 2265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:06:13.880314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1a335ae2-4a7e-45ba-879d-2f402d07b11f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:13.880314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1a335ae2-4a7e-45ba-879d-2f402d07b11f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:13.898459 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c12fa096-7326-4d2b-844b-05e7b6415cd5 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 1.294135 Oct 12 22:06:13.902389 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 878/1862] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:12 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:13.914285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a335ae2-4a7e-45ba-879d-2f402d07b11f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:13.915308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a335ae2-4a7e-45ba-879d-2f402d07b11f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:13.915947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a335ae2-4a7e-45ba-879d-2f402d07b11f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:13.916683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a335ae2-4a7e-45ba-879d-2f402d07b11f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:13.918379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a335ae2-4a7e-45ba-879d-2f402d07b11f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:13.920602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a335ae2-4a7e-45ba-879d-2f402d07b11f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:13.921241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a34b8635-7fb8-4a29-ac91-5f395b93f839 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:13.927016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a34b8635-7fb8-4a29-ac91-5f395b93f839 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:13.974158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a34b8635-7fb8-4a29-ac91-5f395b93f839 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:13.974932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a34b8635-7fb8-4a29-ac91-5f395b93f839 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:13.976996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a34b8635-7fb8-4a29-ac91-5f395b93f839 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:13.981918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a34b8635-7fb8-4a29-ac91-5f395b93f839 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:13.987656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a34b8635-7fb8-4a29-ac91-5f395b93f839 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:13.990273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a34b8635-7fb8-4a29-ac91-5f395b93f839 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:14.123903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a335ae2-4a7e-45ba-879d-2f402d07b11f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:14.140655 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1a335ae2-4a7e-45ba-879d-2f402d07b11f tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1271 microversion: 2.1 time: 0.301044 Oct 12 22:06:14.143632 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 985/1863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:13 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1271 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:14.158125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1f05e95d-40a3-4e8d-b14e-2639d18b52ff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:14.159144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1f05e95d-40a3-4e8d-b14e-2639d18b52ff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] [instance: 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:14.181936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f05e95d-40a3-4e8d-b14e-2639d18b52ff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:14.184388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f05e95d-40a3-4e8d-b14e-2639d18b52ff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:14.185173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f05e95d-40a3-4e8d-b14e-2639d18b52ff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:14.187110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f05e95d-40a3-4e8d-b14e-2639d18b52ff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:14.189022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f05e95d-40a3-4e8d-b14e-2639d18b52ff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:14.192305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f05e95d-40a3-4e8d-b14e-2639d18b52ff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:14.224532 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-1f05e95d-40a3-4e8d-b14e-2639d18b52ff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] HTTP exception thrown: Instance 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 could not be found. Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1f05e95d-40a3-4e8d-b14e-2639d18b52ff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Request method failure captured: Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 HTTP/1.1 Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRznoxnVxikVWukTEwCOIJicYCRnweBF0UdOBpS7ApkHM3G1B384Hh466oBKRhH9N8Abuu6Bm5IcHpJhRzCI14DpXyVveyyYSOzWCwM9efdUbp7XLCn7EGQgA8SnU73ChDpuCTSJTRQTvRtLpLS7rGHp1usRONARhr6BxDirkVF_w6iI Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: f0051e5f43b7403cbb4c29a00bb73513 Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ListServerFiltersTestJSON-411369961 Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:06:14.227365 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:06:14.229961 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f0051e5f43b7403cbb4c29a00bb73513"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f0051e5f43b7403cbb4c29a00bb73513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f0051e5f43b7403cbb4c29a00bb73513", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f0051e5f43b7403cbb4c29a00bb73513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:06:14.229961 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ListServerFiltersTestJSON-411369961 Oct 12 22:06:14.229961 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: f0051e5f43b7403cbb4c29a00bb73513 Oct 12 22:06:14.229961 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-411369961 Oct 12 22:06:14.229961 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ListServerFiltersTestJSON-411369961-project Oct 12 22:06:14.229961 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:06:14.229961 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:06:14.229961 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 11d42d1fe957461e9fb85d0823ad5866 Oct 12 22:06:14.229961 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ListServerFiltersTestJSON-411369961-project Oct 12 22:06:14.229961 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:06:14.229961 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 could not be found. Oct 12 22:06:14.229961 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6'} Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 could not be found. Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:06:14.231169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 could not be found. Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 could not be found. Oct 12 22:06:14.236395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:14.241569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1f05e95d-40a3-4e8d-b14e-2639d18b52ff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] Returning 404 to user: Instance 8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:06:14.242788 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1f05e95d-40a3-4e8d-b14e-2639d18b52ff tempest-ListServerFiltersTestJSON-411369961 tempest-ListServerFiltersTestJSON-411369961-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6" status: 404 len: 111 microversion: 2.1 time: 0.096249 Oct 12 22:06:14.244216 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 986/1864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:14 2022] GET /compute/v2.1/servers/8bd2ac0a-8bf2-411c-85b3-ace40b8c3fc6 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:06:14.250798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c7626f4e-dee2-4f07-bc15-d9f06a5b06ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:14.251791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c7626f4e-dee2-4f07-bc15-d9f06a5b06ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:14.273286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7626f4e-dee2-4f07-bc15-d9f06a5b06ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:14.274330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7626f4e-dee2-4f07-bc15-d9f06a5b06ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:14.275956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7626f4e-dee2-4f07-bc15-d9f06a5b06ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:14.277147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7626f4e-dee2-4f07-bc15-d9f06a5b06ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:14.278413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7626f4e-dee2-4f07-bc15-d9f06a5b06ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:14.279338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7626f4e-dee2-4f07-bc15-d9f06a5b06ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:14.286168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:14.326054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c7626f4e-dee2-4f07-bc15-d9f06a5b06ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:06:14.549789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:14.560540 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c7626f4e-dee2-4f07-bc15-d9f06a5b06ec tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 204 len: 0 microversion: 2.1 time: 0.311897 Oct 12 22:06:14.562126 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 987/1865] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:06:14 2022] DELETE /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:06:14.591207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a34b8635-7fb8-4a29-ac91-5f395b93f839 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:14.610585 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a34b8635-7fb8-4a29-ac91-5f395b93f839 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1199 microversion: 2.1 time: 0.702792 Oct 12 22:06:14.617550 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 879/1866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:13 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1199 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:14.876485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-428567390", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "1bfd60f2-0202-40db-8761-3b71d02412dc"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:14.917677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8be69754-8779-41e9-b03b-3f5e0bd1cb6c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512392dd30>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:15.073420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] validate_networks() for [('1bfd60f2-0202-40db-8761-3b71d02412dc', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:06:15.074269 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8be69754-8779-41e9-b03b-3f5e0bd1cb6c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.150327 Oct 12 22:06:15.074269 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 880/1867] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:14 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:15.185951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d56e68e3-0bc1-42e0-a59f-62062791fd48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:15.186851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d56e68e3-0bc1-42e0-a59f-62062791fd48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:15.198242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d56e68e3-0bc1-42e0-a59f-62062791fd48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:15.201743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d56e68e3-0bc1-42e0-a59f-62062791fd48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:15.203584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d56e68e3-0bc1-42e0-a59f-62062791fd48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:15.207575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d56e68e3-0bc1-42e0-a59f-62062791fd48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:15.208278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d56e68e3-0bc1-42e0-a59f-62062791fd48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:15.208913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d56e68e3-0bc1-42e0-a59f-62062791fd48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:15.605059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d56e68e3-0bc1-42e0-a59f-62062791fd48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:15.613765 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d56e68e3-0bc1-42e0-a59f-62062791fd48 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1313 microversion: 2.1 time: 0.431773 Oct 12 22:06:15.625884 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 881/1868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:15 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:15.645103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f7730528-65fc-4acc-b664-ff071b400fd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:15.646060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f7730528-65fc-4acc-b664-ff071b400fd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:15.655692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7730528-65fc-4acc-b664-ff071b400fd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:15.657125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7730528-65fc-4acc-b664-ff071b400fd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:15.657820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7730528-65fc-4acc-b664-ff071b400fd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:15.658723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7730528-65fc-4acc-b664-ff071b400fd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:15.659508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7730528-65fc-4acc-b664-ff071b400fd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:15.660218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7730528-65fc-4acc-b664-ff071b400fd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:16.798146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:06:16.798664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:06:16.799253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:06:16.799727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:06:16.800239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:06:16.819471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:16.822630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:16.823145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:16.824894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:16.836241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:16.836740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:16.906244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Getting quotas for project 0905a1286e134e34a55ceaaa6c23718e. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:06:16.912115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f7730528-65fc-4acc-b664-ff071b400fd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:16.920091 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f7730528-65fc-4acc-b664-ff071b400fd2 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1199 microversion: 2.1 time: 1.281760 Oct 12 22:06:16.923260 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 882/1869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:15 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1199 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:16.928890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7fe9a3b1-7739-4494-a5d0-96f3770aecd2 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512392dee0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:16.941945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Getting quotas for user 7224dcaeabdd4199b9682e99912f7740 and project 0905a1286e134e34a55ceaaa6c23718e. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:06:16.981397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:06:16.985631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:06:17.010570 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7fe9a3b1-7739-4494-a5d0-96f3770aecd2 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.086000 Oct 12 22:06:17.011386 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 883/1870] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:16 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:17.022756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-a2876506-1b04-40e9-a32c-d795f2d9108e req-c764a3b5-a451-4c8c-9d38-fcb70277c40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98da0461-39ce-4bc1-9c42-66d635a94fcd", "name": "network-vif-plugged", "status": "completed", "tag": "24945106-d2fe-4fa8-b8ef-52b83a547ea5"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:17.036955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:17.061691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a2876506-1b04-40e9-a32c-d795f2d9108e req-c764a3b5-a451-4c8c-9d38-fcb70277c40d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:17.067538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a2876506-1b04-40e9-a32c-d795f2d9108e req-c764a3b5-a451-4c8c-9d38-fcb70277c40d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:17.068225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a2876506-1b04-40e9-a32c-d795f2d9108e req-c764a3b5-a451-4c8c-9d38-fcb70277c40d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:17.098396 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-a2876506-1b04-40e9-a32c-d795f2d9108e req-c764a3b5-a451-4c8c-9d38-fcb70277c40d service nova] Creating event network-vif-plugged:24945106-d2fe-4fa8-b8ef-52b83a547ea5 for instance 98da0461-39ce-4bc1-9c42-66d635a94fcd on n-h2-861111-1 Oct 12 22:06:17.113304 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-a2876506-1b04-40e9-a32c-d795f2d9108e req-c764a3b5-a451-4c8c-9d38-fcb70277c40d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100482 Oct 12 22:06:17.116535 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 884/1871] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:17.135896 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-11425c78-e847-4374-8b09-10ca6c0f8596 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.266076 Oct 12 22:06:17.139256 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 988/1872] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:06:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:06:17.140812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1c1003d5-1751-46ab-a95f-ac17b23594b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:17.145063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1c1003d5-1751-46ab-a95f-ac17b23594b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:17.151331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b18a11b-ed9d-4227-b920-5dfe02a86e3d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:17.152550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8b18a11b-ed9d-4227-b920-5dfe02a86e3d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:17.166083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c1003d5-1751-46ab-a95f-ac17b23594b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:17.172311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c1003d5-1751-46ab-a95f-ac17b23594b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:17.175639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c1003d5-1751-46ab-a95f-ac17b23594b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:17.176754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c1003d5-1751-46ab-a95f-ac17b23594b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:17.178368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c1003d5-1751-46ab-a95f-ac17b23594b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:17.181236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c1003d5-1751-46ab-a95f-ac17b23594b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:17.430593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b18a11b-ed9d-4227-b920-5dfe02a86e3d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:17.452293 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8b18a11b-ed9d-4227-b920-5dfe02a86e3d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1207 microversion: 2.1 time: 0.294615 Oct 12 22:06:17.452970 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 989/1873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:17 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1207 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:06:17.466893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1691724460", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a1135d57-c7e8-447f-a856-6e68b955e716"}], "block_device_mapping_v2": [{"uuid": "e566c5dd-28d6-44a8-9579-560f3fa342b9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:17.600971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] validate_networks() for [('a1135d57-c7e8-447f-a856-6e68b955e716', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:06:17.639008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1c1003d5-1751-46ab-a95f-ac17b23594b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:17.651613 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1c1003d5-1751-46ab-a95f-ac17b23594b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1313 microversion: 2.1 time: 0.530683 Oct 12 22:06:17.652196 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 885/1874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:17 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1313 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:17.945074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c6661e18-f642-4473-9343-f1959fa18b5f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:17.946610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c6661e18-f642-4473-9343-f1959fa18b5f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:17.962429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6661e18-f642-4473-9343-f1959fa18b5f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:17.969068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6661e18-f642-4473-9343-f1959fa18b5f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:17.972119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6661e18-f642-4473-9343-f1959fa18b5f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:17.974261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6661e18-f642-4473-9343-f1959fa18b5f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:17.976148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6661e18-f642-4473-9343-f1959fa18b5f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:17.978758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6661e18-f642-4473-9343-f1959fa18b5f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:18.605300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c6661e18-f642-4473-9343-f1959fa18b5f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:18.615964 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c6661e18-f642-4473-9343-f1959fa18b5f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1199 microversion: 2.1 time: 0.675614 Oct 12 22:06:18.621682 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 886/1875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:17 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1199 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:06:18.639917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-37f79038-199b-4be3-8506-6904ea377185 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512841cca0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:18.729427 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-37f79038-199b-4be3-8506-6904ea377185 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.106103 Oct 12 22:06:18.735658 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 887/1876] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:18 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:18.747341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-32d6adc9-5749-4187-9630-9a08b2a5e9d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:18.748342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-32d6adc9-5749-4187-9630-9a08b2a5e9d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:18.770262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32d6adc9-5749-4187-9630-9a08b2a5e9d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:18.771043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32d6adc9-5749-4187-9630-9a08b2a5e9d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:18.771681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32d6adc9-5749-4187-9630-9a08b2a5e9d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:18.772612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32d6adc9-5749-4187-9630-9a08b2a5e9d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:18.773837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32d6adc9-5749-4187-9630-9a08b2a5e9d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:18.774438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32d6adc9-5749-4187-9630-9a08b2a5e9d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:18.969490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-32d6adc9-5749-4187-9630-9a08b2a5e9d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:18.984896 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-32d6adc9-5749-4187-9630-9a08b2a5e9d3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1259 microversion: 2.1 time: 0.247799 Oct 12 22:06:18.985487 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 888/1877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:18 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1259 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:18.999539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-45276249-67b2-4d9e-8602-0cf8479cecaa req-7f2587b8-9627-4e49-84b8-3d7c7c60f30b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15055486-69c3-4d87-99da-927949deea8a", "tag": "fec38738-06d0-4ba1-b408-8e99dc334dea"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:19.051993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-45276249-67b2-4d9e-8602-0cf8479cecaa req-7f2587b8-9627-4e49-84b8-3d7c7c60f30b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:19.052485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-45276249-67b2-4d9e-8602-0cf8479cecaa req-7f2587b8-9627-4e49-84b8-3d7c7c60f30b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:19.052943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-45276249-67b2-4d9e-8602-0cf8479cecaa req-7f2587b8-9627-4e49-84b8-3d7c7c60f30b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:19.086573 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-45276249-67b2-4d9e-8602-0cf8479cecaa req-7f2587b8-9627-4e49-84b8-3d7c7c60f30b service nova] Creating event network-changed:fec38738-06d0-4ba1-b408-8e99dc334dea for instance 15055486-69c3-4d87-99da-927949deea8a on n-h1-861111-1 Oct 12 22:06:19.108368 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-45276249-67b2-4d9e-8602-0cf8479cecaa req-7f2587b8-9627-4e49-84b8-3d7c7c60f30b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111557 Oct 12 22:06:19.109394 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 889/1878] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:19.117066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-db3e9c5a-4449-4b4e-8308-9b58558b9ef8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:19.118036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-db3e9c5a-4449-4b4e-8308-9b58558b9ef8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:19.125183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db3e9c5a-4449-4b4e-8308-9b58558b9ef8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:19.130692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db3e9c5a-4449-4b4e-8308-9b58558b9ef8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:19.131301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db3e9c5a-4449-4b4e-8308-9b58558b9ef8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:19.139790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db3e9c5a-4449-4b4e-8308-9b58558b9ef8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:19.140329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db3e9c5a-4449-4b4e-8308-9b58558b9ef8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:19.140811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db3e9c5a-4449-4b4e-8308-9b58558b9ef8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:19.495334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-db3e9c5a-4449-4b4e-8308-9b58558b9ef8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:19.511407 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-db3e9c5a-4449-4b4e-8308-9b58558b9ef8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1313 microversion: 2.1 time: 0.400406 Oct 12 22:06:19.516701 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 890/1879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:19 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:19.604545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-2d19d23d-481a-4cc0-ab49-3784640bba1a req-f24b61bd-3315-4fb7-bac6-d5433dceccda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88fef870-22a8-43e7-afb9-5612edbce136", "name": "network-vif-deleted", "tag": "8fa5803d-652c-4259-8fef-98474172e507"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:19.619205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2d19d23d-481a-4cc0-ab49-3784640bba1a req-f24b61bd-3315-4fb7-bac6-d5433dceccda service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:19.620316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2d19d23d-481a-4cc0-ab49-3784640bba1a req-f24b61bd-3315-4fb7-bac6-d5433dceccda service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:19.620954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2d19d23d-481a-4cc0-ab49-3784640bba1a req-f24b61bd-3315-4fb7-bac6-d5433dceccda service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:19.700626 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-2d19d23d-481a-4cc0-ab49-3784640bba1a req-f24b61bd-3315-4fb7-bac6-d5433dceccda service nova] Creating event network-vif-deleted:8fa5803d-652c-4259-8fef-98474172e507 for instance 88fef870-22a8-43e7-afb9-5612edbce136 on n-h1-861111-1 Oct 12 22:06:19.716074 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-2d19d23d-481a-4cc0-ab49-3784640bba1a req-f24b61bd-3315-4fb7-bac6-d5433dceccda service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117571 Oct 12 22:06:19.721192 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 891/1880] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:19.721813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:06:19.722907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:06:19.723309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:06:19.723730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:06:19.724147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:06:19.737689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:19.744871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-63fd0973-6277-4484-b843-71a0b724b448 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:19.745226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:19.745705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:19.746529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:19.747009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:19.747495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:19.748466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-63fd0973-6277-4484-b843-71a0b724b448 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:19.761456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63fd0973-6277-4484-b843-71a0b724b448 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:19.767015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63fd0973-6277-4484-b843-71a0b724b448 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:19.768396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63fd0973-6277-4484-b843-71a0b724b448 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:19.773072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63fd0973-6277-4484-b843-71a0b724b448 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:19.773819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63fd0973-6277-4484-b843-71a0b724b448 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:19.774500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63fd0973-6277-4484-b843-71a0b724b448 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:19.786244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Getting quotas for project beef77813aa641769eb3151b41b8e0cf. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:06:19.797940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Getting quotas for user 1c8822d55876445d91f5681781313ce9 and project beef77813aa641769eb3151b41b8e0cf. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:06:19.901874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:06:19.904407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e566c5dd-28d6-44a8-9579-560f3fa342b9',volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:06:20.037732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:20.102824 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f7bf8b32-18e4-46b2-a94a-f3cf9b841efe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.638732 Oct 12 22:06:20.104047 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 990/1881] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 22:06:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2644 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:06:20.105264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:20.132146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-68630a20-d154-47c7-911b-24a8618ebde9 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512875aca0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:20.191560 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-68630a20-d154-47c7-911b-24a8618ebde9 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.084455 Oct 12 22:06:20.192671 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 991/1882] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:20 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:20.198820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5b290d39-8087-476c-a303-3a38a6c00971 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:20.199783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5b290d39-8087-476c-a303-3a38a6c00971 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:20.206559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b290d39-8087-476c-a303-3a38a6c00971 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:20.207326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b290d39-8087-476c-a303-3a38a6c00971 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:20.207964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b290d39-8087-476c-a303-3a38a6c00971 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:20.208841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b290d39-8087-476c-a303-3a38a6c00971 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:20.209760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b290d39-8087-476c-a303-3a38a6c00971 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:20.210357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b290d39-8087-476c-a303-3a38a6c00971 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:20.287901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-63fd0973-6277-4484-b843-71a0b724b448 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:20.300327 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-63fd0973-6277-4484-b843-71a0b724b448 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1382 microversion: 2.1 time: 0.574508 Oct 12 22:06:20.300926 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 892/1883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:19 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1382 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:20.307997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c97dd767-a76c-4b17-b235-0865f0c5041d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:20.308635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c97dd767-a76c-4b17-b235-0865f0c5041d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:20.349808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5b290d39-8087-476c-a303-3a38a6c00971 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:20.370291 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5b290d39-8087-476c-a303-3a38a6c00971 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1259 microversion: 2.1 time: 0.175650 Oct 12 22:06:20.383292 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 992/1884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:20 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:20.415747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c97dd767-a76c-4b17-b235-0865f0c5041d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:20.424936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c97dd767-a76c-4b17-b235-0865f0c5041d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:20.433484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c97dd767-a76c-4b17-b235-0865f0c5041d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:20.439641 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c97dd767-a76c-4b17-b235-0865f0c5041d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1104 microversion: 2.25 time: 0.135768 Oct 12 22:06:20.440763 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 893/1885] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:20 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1104 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:20.543289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3c9432a8-5715-4ce5-aff4-bfff3ba9d307 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:20.544097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3c9432a8-5715-4ce5-aff4-bfff3ba9d307 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:20.566854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c9432a8-5715-4ce5-aff4-bfff3ba9d307 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:20.568498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c9432a8-5715-4ce5-aff4-bfff3ba9d307 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:20.569300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c9432a8-5715-4ce5-aff4-bfff3ba9d307 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:20.570448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c9432a8-5715-4ce5-aff4-bfff3ba9d307 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:20.571210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c9432a8-5715-4ce5-aff4-bfff3ba9d307 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:20.571988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c9432a8-5715-4ce5-aff4-bfff3ba9d307 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:20.954366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-96176420-8b69-4c6f-a601-f9aec66ed717 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:20.954984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-96176420-8b69-4c6f-a601-f9aec66ed717 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:20.969915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96176420-8b69-4c6f-a601-f9aec66ed717 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:20.971869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96176420-8b69-4c6f-a601-f9aec66ed717 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:20.973108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96176420-8b69-4c6f-a601-f9aec66ed717 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:20.984427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96176420-8b69-4c6f-a601-f9aec66ed717 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:20.984824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96176420-8b69-4c6f-a601-f9aec66ed717 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:20.989755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96176420-8b69-4c6f-a601-f9aec66ed717 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:21.236057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3c9432a8-5715-4ce5-aff4-bfff3ba9d307 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:21.271367 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3c9432a8-5715-4ce5-aff4-bfff3ba9d307 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1313 microversion: 2.1 time: 0.718104 Oct 12 22:06:21.273535 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 894/1886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:20 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1313 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:06:21.297781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0c937806-bbf8-4424-9668-171a7aa03f2c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f51285243a0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:21.418257 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0c937806-bbf8-4424-9668-171a7aa03f2c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.143532 Oct 12 22:06:21.419303 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 895/1887] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:21 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:21.430241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1f9f20b5-81e7-48f6-971d-951048fa0d4b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:21.431033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1f9f20b5-81e7-48f6-971d-951048fa0d4b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:21.453347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f9f20b5-81e7-48f6-971d-951048fa0d4b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:21.455912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f9f20b5-81e7-48f6-971d-951048fa0d4b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:21.458117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f9f20b5-81e7-48f6-971d-951048fa0d4b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:21.459042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f9f20b5-81e7-48f6-971d-951048fa0d4b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:21.460916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f9f20b5-81e7-48f6-971d-951048fa0d4b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:21.461522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f9f20b5-81e7-48f6-971d-951048fa0d4b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:21.603435 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-96176420-8b69-4c6f-a601-f9aec66ed717 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1533 microversion: 2.1 time: 1.231004 Oct 12 22:06:21.606841 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 993/1888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:20 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1533 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:21.618247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f529d734-c6a3-4391-b0a4-f41530164701 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:21.619119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f529d734-c6a3-4391-b0a4-f41530164701 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:21.631750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f529d734-c6a3-4391-b0a4-f41530164701 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:21.632490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f529d734-c6a3-4391-b0a4-f41530164701 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:21.633154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f529d734-c6a3-4391-b0a4-f41530164701 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:21.634119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f529d734-c6a3-4391-b0a4-f41530164701 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:21.634784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f529d734-c6a3-4391-b0a4-f41530164701 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:21.635467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f529d734-c6a3-4391-b0a4-f41530164701 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:21.686683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1f9f20b5-81e7-48f6-971d-951048fa0d4b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:21.721793 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1f9f20b5-81e7-48f6-971d-951048fa0d4b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1265 microversion: 2.1 time: 0.298654 Oct 12 22:06:21.725521 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 896/1889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:21 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:21.757756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-192e0df6-48f9-4f2a-b7f8-30f426e95621 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:21.761559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-192e0df6-48f9-4f2a-b7f8-30f426e95621 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:21.788616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-192e0df6-48f9-4f2a-b7f8-30f426e95621 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:21.803048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-192e0df6-48f9-4f2a-b7f8-30f426e95621 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:21.804241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-192e0df6-48f9-4f2a-b7f8-30f426e95621 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:21.805730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-192e0df6-48f9-4f2a-b7f8-30f426e95621 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:21.808982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-192e0df6-48f9-4f2a-b7f8-30f426e95621 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:21.814821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-192e0df6-48f9-4f2a-b7f8-30f426e95621 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:21.981793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f529d734-c6a3-4391-b0a4-f41530164701 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:22.000203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f529d734-c6a3-4391-b0a4-f41530164701 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:22.004670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f529d734-c6a3-4391-b0a4-f41530164701 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:22.007067 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f529d734-c6a3-4391-b0a4-f41530164701 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1233 microversion: 2.25 time: 0.398266 Oct 12 22:06:22.011573 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 994/1890] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:21 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1233 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:22.310414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-45a8f359-1a5f-4ee9-8daa-e5bb2ffeddc0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:22.311078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-45a8f359-1a5f-4ee9-8daa-e5bb2ffeddc0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:22.327809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45a8f359-1a5f-4ee9-8daa-e5bb2ffeddc0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:22.329636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45a8f359-1a5f-4ee9-8daa-e5bb2ffeddc0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:22.330083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45a8f359-1a5f-4ee9-8daa-e5bb2ffeddc0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:22.334859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45a8f359-1a5f-4ee9-8daa-e5bb2ffeddc0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:22.337158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45a8f359-1a5f-4ee9-8daa-e5bb2ffeddc0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:22.337627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45a8f359-1a5f-4ee9-8daa-e5bb2ffeddc0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:22.339734 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-192e0df6-48f9-4f2a-b7f8-30f426e95621 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1533 microversion: 2.1 time: 0.611367 Oct 12 22:06:22.346576 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 897/1891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:21 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1533 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:22.379500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-47ffbf77-b2da-4a71-8884-48af1e69decf tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:22.388813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ffbf77-b2da-4a71-8884-48af1e69decf tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:22.393274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ffbf77-b2da-4a71-8884-48af1e69decf tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:22.394056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ffbf77-b2da-4a71-8884-48af1e69decf tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:22.396133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ffbf77-b2da-4a71-8884-48af1e69decf tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:22.400685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ffbf77-b2da-4a71-8884-48af1e69decf tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:22.401465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ffbf77-b2da-4a71-8884-48af1e69decf tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:22.471351 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-47ffbf77-b2da-4a71-8884-48af1e69decf tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.101615 Oct 12 22:06:22.472712 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 898/1892] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 12 22:06:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:06:22.484934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4d7a250d-5e2b-4ea3-879b-877ff67b79f4 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f5123954f70>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:22.559973 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4d7a250d-5e2b-4ea3-879b-877ff67b79f4 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.085926 Oct 12 22:06:22.560976 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 899/1893] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:22 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:22.575849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-245b7f06-4ff6-44b8-9bda-1398bca8073e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-861111-1", "block_migration": false, "disk_over_commit": false}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:22.578840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-245b7f06-4ff6-44b8-9bda-1398bca8073e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:22.600018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-245b7f06-4ff6-44b8-9bda-1398bca8073e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:22.600518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-245b7f06-4ff6-44b8-9bda-1398bca8073e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:22.600969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-245b7f06-4ff6-44b8-9bda-1398bca8073e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:22.601677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-245b7f06-4ff6-44b8-9bda-1398bca8073e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:22.602129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-245b7f06-4ff6-44b8-9bda-1398bca8073e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:22.602561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-245b7f06-4ff6-44b8-9bda-1398bca8073e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:22.646251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-245b7f06-4ff6-44b8-9bda-1398bca8073e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lazy-loading 'flavor' on Instance uuid 98da0461-39ce-4bc1-9c42-66d635a94fcd {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:06:22.672094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-245b7f06-4ff6-44b8-9bda-1398bca8073e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Going to try to live migrate instance to n-h1-861111-1 {{(pid=120452) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:06:23.121601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-45a8f359-1a5f-4ee9-8daa-e5bb2ffeddc0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:23.133930 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-45a8f359-1a5f-4ee9-8daa-e5bb2ffeddc0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1313 microversion: 2.1 time: 0.840221 Oct 12 22:06:23.150280 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 995/1894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:22 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1313 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:06:23.168416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f216c1ca-6984-4f79-80a5-6cbe8272bb21 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:23.169334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f216c1ca-6984-4f79-80a5-6cbe8272bb21 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:23.180573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f216c1ca-6984-4f79-80a5-6cbe8272bb21 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:23.181887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f216c1ca-6984-4f79-80a5-6cbe8272bb21 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:23.182623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f216c1ca-6984-4f79-80a5-6cbe8272bb21 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:23.183668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f216c1ca-6984-4f79-80a5-6cbe8272bb21 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:23.193535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f216c1ca-6984-4f79-80a5-6cbe8272bb21 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:23.194403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f216c1ca-6984-4f79-80a5-6cbe8272bb21 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:23.362285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f216c1ca-6984-4f79-80a5-6cbe8272bb21 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:23.382244 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f216c1ca-6984-4f79-80a5-6cbe8272bb21 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1265 microversion: 2.1 time: 0.228404 Oct 12 22:06:23.387066 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 996/1895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:23 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:23.396026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-64bc97a8-f801-4bf1-b6ec-71136d367e46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:23.399543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-64bc97a8-f801-4bf1-b6ec-71136d367e46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:23.438543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64bc97a8-f801-4bf1-b6ec-71136d367e46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:23.440397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64bc97a8-f801-4bf1-b6ec-71136d367e46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:23.441088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64bc97a8-f801-4bf1-b6ec-71136d367e46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:23.444250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64bc97a8-f801-4bf1-b6ec-71136d367e46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:23.447591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64bc97a8-f801-4bf1-b6ec-71136d367e46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:23.449480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64bc97a8-f801-4bf1-b6ec-71136d367e46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:23.654972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-64bc97a8-f801-4bf1-b6ec-71136d367e46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:23.760048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-64bc97a8-f801-4bf1-b6ec-71136d367e46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:23.762021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-64bc97a8-f801-4bf1-b6ec-71136d367e46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:23.763448 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-64bc97a8-f801-4bf1-b6ec-71136d367e46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1251 microversion: 2.25 time: 0.374854 Oct 12 22:06:23.764250 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 997/1896] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:23 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1251 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:23.769414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-22688c7b-4ed1-43da-8ac4-c90584a26176 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f51282b0670>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:23.859461 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-22688c7b-4ed1-43da-8ac4-c90584a26176 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.093605 Oct 12 22:06:23.860218 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 998/1897] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:23 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:24.163194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a533f885-4307-4c74-a584-88cc0ad81da0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:24.164863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a533f885-4307-4c74-a584-88cc0ad81da0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:24.202999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a533f885-4307-4c74-a584-88cc0ad81da0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:24.203949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a533f885-4307-4c74-a584-88cc0ad81da0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:24.205172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a533f885-4307-4c74-a584-88cc0ad81da0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:24.206194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a533f885-4307-4c74-a584-88cc0ad81da0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:24.207933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a533f885-4307-4c74-a584-88cc0ad81da0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:24.208640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a533f885-4307-4c74-a584-88cc0ad81da0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:24.679330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a533f885-4307-4c74-a584-88cc0ad81da0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:24.698659 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a533f885-4307-4c74-a584-88cc0ad81da0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1313 microversion: 2.1 time: 0.541112 Oct 12 22:06:24.699674 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 999/1898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:24 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1313 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:06:24.715050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-15842e8a-b434-45d7-b8c8-7d112b455f8e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:24.718733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-15842e8a-b434-45d7-b8c8-7d112b455f8e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:24.741293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15842e8a-b434-45d7-b8c8-7d112b455f8e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:24.742290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15842e8a-b434-45d7-b8c8-7d112b455f8e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:24.743473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15842e8a-b434-45d7-b8c8-7d112b455f8e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:24.744857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15842e8a-b434-45d7-b8c8-7d112b455f8e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:24.745796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15842e8a-b434-45d7-b8c8-7d112b455f8e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:24.746380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15842e8a-b434-45d7-b8c8-7d112b455f8e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:25.704324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-15842e8a-b434-45d7-b8c8-7d112b455f8e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:25.716824 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-15842e8a-b434-45d7-b8c8-7d112b455f8e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1307 microversion: 2.1 time: 1.012429 Oct 12 22:06:25.735508 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1000/1899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:24 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1307 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:25.744911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-03c0b0fc-9bbb-4e57-ad8c-f7c8092547c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:25.752046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-03c0b0fc-9bbb-4e57-ad8c-f7c8092547c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:25.780795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03c0b0fc-9bbb-4e57-ad8c-f7c8092547c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:25.787980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03c0b0fc-9bbb-4e57-ad8c-f7c8092547c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:25.788854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03c0b0fc-9bbb-4e57-ad8c-f7c8092547c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:25.789780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03c0b0fc-9bbb-4e57-ad8c-f7c8092547c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:25.790592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03c0b0fc-9bbb-4e57-ad8c-f7c8092547c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:25.791201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03c0b0fc-9bbb-4e57-ad8c-f7c8092547c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:26.190455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-03c0b0fc-9bbb-4e57-ad8c-f7c8092547c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:26.204132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-03c0b0fc-9bbb-4e57-ad8c-f7c8092547c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:26.209740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-03c0b0fc-9bbb-4e57-ad8c-f7c8092547c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:26.213292 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-03c0b0fc-9bbb-4e57-ad8c-f7c8092547c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1293 microversion: 2.25 time: 0.476394 Oct 12 22:06:26.214700 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1001/1900] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:25 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1293 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:26.226280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a1931c53-63e8-4d1e-9d4f-8266265ddac1 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512c431b80>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:26.304856 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a1931c53-63e8-4d1e-9d4f-8266265ddac1 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.088333 Oct 12 22:06:26.305761 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1002/1901] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:26 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:26.313786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a07972e2-a28f-463f-abaa-8e3f67195fd1 req-72b13cc3-9a3c-4612-9751-539f0263c536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15055486-69c3-4d87-99da-927949deea8a", "name": "network-vif-plugged", "status": "completed", "tag": "fec38738-06d0-4ba1-b408-8e99dc334dea"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:26.338166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a07972e2-a28f-463f-abaa-8e3f67195fd1 req-72b13cc3-9a3c-4612-9751-539f0263c536 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:26.338969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a07972e2-a28f-463f-abaa-8e3f67195fd1 req-72b13cc3-9a3c-4612-9751-539f0263c536 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:26.339637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a07972e2-a28f-463f-abaa-8e3f67195fd1 req-72b13cc3-9a3c-4612-9751-539f0263c536 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:26.382698 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a07972e2-a28f-463f-abaa-8e3f67195fd1 req-72b13cc3-9a3c-4612-9751-539f0263c536 service nova] Creating event network-vif-plugged:fec38738-06d0-4ba1-b408-8e99dc334dea for instance 15055486-69c3-4d87-99da-927949deea8a on n-h1-861111-1 Oct 12 22:06:26.388735 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a07972e2-a28f-463f-abaa-8e3f67195fd1 req-72b13cc3-9a3c-4612-9751-539f0263c536 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081131 Oct 12 22:06:26.390052 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1003/1902] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:26.397342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-51ef50bf-0aaa-4f67-9182-0aeb5d3d6f27 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:26.398670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-51ef50bf-0aaa-4f67-9182-0aeb5d3d6f27 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:26.408734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51ef50bf-0aaa-4f67-9182-0aeb5d3d6f27 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:26.410226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51ef50bf-0aaa-4f67-9182-0aeb5d3d6f27 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:26.410837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51ef50bf-0aaa-4f67-9182-0aeb5d3d6f27 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:26.411744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51ef50bf-0aaa-4f67-9182-0aeb5d3d6f27 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:26.412431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51ef50bf-0aaa-4f67-9182-0aeb5d3d6f27 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:26.413165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51ef50bf-0aaa-4f67-9182-0aeb5d3d6f27 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:26.466011 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-245b7f06-4ff6-44b8-9bda-1398bca8073e tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd/action" status: 202 len: 0 microversion: 2.1 time: 3.903542 Oct 12 22:06:26.471556 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 900/1903] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:06:22 2022] POST /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd/action => generated 0 bytes in 3910 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:06:26.490821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-617d0a33-f3ff-4c5c-8779-33906e2d9639 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:26.491768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-617d0a33-f3ff-4c5c-8779-33906e2d9639 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:26.517885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-617d0a33-f3ff-4c5c-8779-33906e2d9639 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:26.520802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-617d0a33-f3ff-4c5c-8779-33906e2d9639 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:26.523168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-617d0a33-f3ff-4c5c-8779-33906e2d9639 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:26.527953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-617d0a33-f3ff-4c5c-8779-33906e2d9639 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:26.530782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-617d0a33-f3ff-4c5c-8779-33906e2d9639 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:26.533243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-617d0a33-f3ff-4c5c-8779-33906e2d9639 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:27.674667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-617d0a33-f3ff-4c5c-8779-33906e2d9639 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:27.684919 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-617d0a33-f3ff-4c5c-8779-33906e2d9639 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 1.210828 Oct 12 22:06:27.685472 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 901/1904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:26 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:27.711447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e2a1129f-3659-4887-8aaa-91f3e084932e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:27.712321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e2a1129f-3659-4887-8aaa-91f3e084932e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:27.738281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2a1129f-3659-4887-8aaa-91f3e084932e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:27.739081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2a1129f-3659-4887-8aaa-91f3e084932e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:27.739696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2a1129f-3659-4887-8aaa-91f3e084932e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:27.740570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2a1129f-3659-4887-8aaa-91f3e084932e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:27.741201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2a1129f-3659-4887-8aaa-91f3e084932e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:27.751977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2a1129f-3659-4887-8aaa-91f3e084932e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:27.761358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:27.821306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-51ef50bf-0aaa-4f67-9182-0aeb5d3d6f27 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:27.838414 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-51ef50bf-0aaa-4f67-9182-0aeb5d3d6f27 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1313 microversion: 2.1 time: 1.444282 Oct 12 22:06:27.858468 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1004/1905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:26 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1313 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:27.875507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a5f4ee7c-d5f6-4726-9ca8-226508692a67 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:27.879054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a5f4ee7c-d5f6-4726-9ca8-226508692a67 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:27.894465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5f4ee7c-d5f6-4726-9ca8-226508692a67 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:27.895341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5f4ee7c-d5f6-4726-9ca8-226508692a67 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:27.895962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5f4ee7c-d5f6-4726-9ca8-226508692a67 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:27.897236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5f4ee7c-d5f6-4726-9ca8-226508692a67 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:27.899805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5f4ee7c-d5f6-4726-9ca8-226508692a67 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:27.900471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5f4ee7c-d5f6-4726-9ca8-226508692a67 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:28.220655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a5f4ee7c-d5f6-4726-9ca8-226508692a67 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:28.236509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a5f4ee7c-d5f6-4726-9ca8-226508692a67 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:28.238646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a5f4ee7c-d5f6-4726-9ca8-226508692a67 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:28.248114 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a5f4ee7c-d5f6-4726-9ca8-226508692a67 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1293 microversion: 2.25 time: 0.387059 Oct 12 22:06:28.248729 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1005/1906] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:27 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1293 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:28.274175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-17a96fc0-888d-4569-8b94-422e14f2b69d tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f5128355f70>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:28.366543 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-17a96fc0-888d-4569-8b94-422e14f2b69d tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.096103 Oct 12 22:06:28.375840 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1006/1907] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:28 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:28.453452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e2a1129f-3659-4887-8aaa-91f3e084932e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:28.467885 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e2a1129f-3659-4887-8aaa-91f3e084932e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1307 microversion: 2.1 time: 0.771401 Oct 12 22:06:28.469054 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 902/1908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:27 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1307 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:28.716693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6dbded0b-0e02-4fb1-ad70-886cf5676769 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:28.717730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6dbded0b-0e02-4fb1-ad70-886cf5676769 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:28.730934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dbded0b-0e02-4fb1-ad70-886cf5676769 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:28.731723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dbded0b-0e02-4fb1-ad70-886cf5676769 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:28.732385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dbded0b-0e02-4fb1-ad70-886cf5676769 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:28.733349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dbded0b-0e02-4fb1-ad70-886cf5676769 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:28.734038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dbded0b-0e02-4fb1-ad70-886cf5676769 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:28.740745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dbded0b-0e02-4fb1-ad70-886cf5676769 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:28.868140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d5edaada-3087-4529-9856-c542d87c4e59 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:28.869344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d5edaada-3087-4529-9856-c542d87c4e59 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:28.889675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5edaada-3087-4529-9856-c542d87c4e59 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:28.890563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5edaada-3087-4529-9856-c542d87c4e59 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:28.891221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5edaada-3087-4529-9856-c542d87c4e59 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:28.892216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5edaada-3087-4529-9856-c542d87c4e59 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:28.892892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5edaada-3087-4529-9856-c542d87c4e59 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:28.893605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5edaada-3087-4529-9856-c542d87c4e59 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:29.546121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6dbded0b-0e02-4fb1-ad70-886cf5676769 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:29.556051 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6dbded0b-0e02-4fb1-ad70-886cf5676769 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 0.843203 Oct 12 22:06:29.568558 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1007/1909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:28 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:29.578656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-39e69f92-540a-484f-a222-137446872bb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:29.580455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-39e69f92-540a-484f-a222-137446872bb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:29.599446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39e69f92-540a-484f-a222-137446872bb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:29.605807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39e69f92-540a-484f-a222-137446872bb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:29.606518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39e69f92-540a-484f-a222-137446872bb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:29.607474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39e69f92-540a-484f-a222-137446872bb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:29.610535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39e69f92-540a-484f-a222-137446872bb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:29.614101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39e69f92-540a-484f-a222-137446872bb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:29.748671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d5edaada-3087-4529-9856-c542d87c4e59 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:29.769773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:29.780425 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d5edaada-3087-4529-9856-c542d87c4e59 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1313 microversion: 2.1 time: 0.918254 Oct 12 22:06:29.783807 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 903/1910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:28 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1313 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:06:29.808759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c87ef6cf-e63e-46a4-b98e-b254c4084c6f tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512396b0d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:29.821695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=16 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:29.905553 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c87ef6cf-e63e-46a4-b98e-b254c4084c6f tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.114261 Oct 12 22:06:29.907819 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 904/1911] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:29 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:29.917097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9838e9f6-ca66-4ac9-9ceb-8b40452cbe1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:29.920549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9838e9f6-ca66-4ac9-9ceb-8b40452cbe1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:29.947148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9838e9f6-ca66-4ac9-9ceb-8b40452cbe1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:29.947977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9838e9f6-ca66-4ac9-9ceb-8b40452cbe1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:29.948632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9838e9f6-ca66-4ac9-9ceb-8b40452cbe1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:29.949648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9838e9f6-ca66-4ac9-9ceb-8b40452cbe1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:29.950324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9838e9f6-ca66-4ac9-9ceb-8b40452cbe1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:29.950972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9838e9f6-ca66-4ac9-9ceb-8b40452cbe1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:30.174171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-39e69f92-540a-484f-a222-137446872bb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:30.216936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-39e69f92-540a-484f-a222-137446872bb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:30.228427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-39e69f92-540a-484f-a222-137446872bb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:30.242548 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-39e69f92-540a-484f-a222-137446872bb0 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1293 microversion: 2.25 time: 0.665979 Oct 12 22:06:30.247715 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1008/1912] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:29 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1293 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:30.272947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f40fcfbd-df96-4a53-9e75-b25819e3873d req-037f1f54-7de8-440e-aa6b-2d5685dc1855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "556ed054-4ef4-4561-9b46-8380cf091bb2", "tag": "815d5143-86f7-421c-bd6d-f4db0bad30f2"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:30.315722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f40fcfbd-df96-4a53-9e75-b25819e3873d req-037f1f54-7de8-440e-aa6b-2d5685dc1855 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:30.319572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f40fcfbd-df96-4a53-9e75-b25819e3873d req-037f1f54-7de8-440e-aa6b-2d5685dc1855 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:30.320050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f40fcfbd-df96-4a53-9e75-b25819e3873d req-037f1f54-7de8-440e-aa6b-2d5685dc1855 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:30.329154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:30.354370 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f40fcfbd-df96-4a53-9e75-b25819e3873d req-037f1f54-7de8-440e-aa6b-2d5685dc1855 service nova] Creating event network-changed:815d5143-86f7-421c-bd6d-f4db0bad30f2 for instance 556ed054-4ef4-4561-9b46-8380cf091bb2 on n-h1-861111-1 Oct 12 22:06:30.366805 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f40fcfbd-df96-4a53-9e75-b25819e3873d req-037f1f54-7de8-440e-aa6b-2d5685dc1855 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114177 Oct 12 22:06:30.367470 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1009/1913] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:30.420903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:30.587803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6e5a02f6-8693-4540-a908-5285c21551fa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:30.588511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6e5a02f6-8693-4540-a908-5285c21551fa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:30.600685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e5a02f6-8693-4540-a908-5285c21551fa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:30.601209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e5a02f6-8693-4540-a908-5285c21551fa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:30.601662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e5a02f6-8693-4540-a908-5285c21551fa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:30.602399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e5a02f6-8693-4540-a908-5285c21551fa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:30.605127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e5a02f6-8693-4540-a908-5285c21551fa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:30.605600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e5a02f6-8693-4540-a908-5285c21551fa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:31.180170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6e5a02f6-8693-4540-a908-5285c21551fa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:31.193916 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6e5a02f6-8693-4540-a908-5285c21551fa tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 0.610770 Oct 12 22:06:31.199213 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1010/1914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:30 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:31.214128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-292afe6e-80e4-4346-8855-0305a7a36aa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:31.216232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-292afe6e-80e4-4346-8855-0305a7a36aa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:31.267753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-292afe6e-80e4-4346-8855-0305a7a36aa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:31.273310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-292afe6e-80e4-4346-8855-0305a7a36aa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:31.276418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-292afe6e-80e4-4346-8855-0305a7a36aa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:31.277887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-292afe6e-80e4-4346-8855-0305a7a36aa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:31.278536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-292afe6e-80e4-4346-8855-0305a7a36aa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:31.280775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-292afe6e-80e4-4346-8855-0305a7a36aa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:31.314669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9838e9f6-ca66-4ac9-9ceb-8b40452cbe1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:31.342675 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9838e9f6-ca66-4ac9-9ceb-8b40452cbe1b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1307 microversion: 2.1 time: 1.421705 Oct 12 22:06:31.343705 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 905/1915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:29 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1307 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:31.366561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5caa3669-5079-4395-8140-159937faf244 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f51238e59d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:31.525766 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5caa3669-5079-4395-8140-159937faf244 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.179269 Oct 12 22:06:31.526548 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 906/1916] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:31 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:31.555283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7e1a9a7a-d218-40f0-9eea-939a7a80e5bf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:31.561161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7e1a9a7a-d218-40f0-9eea-939a7a80e5bf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:31.583337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e1a9a7a-d218-40f0-9eea-939a7a80e5bf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:31.591634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e1a9a7a-d218-40f0-9eea-939a7a80e5bf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:31.592287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e1a9a7a-d218-40f0-9eea-939a7a80e5bf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:31.593228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e1a9a7a-d218-40f0-9eea-939a7a80e5bf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:31.594051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e1a9a7a-d218-40f0-9eea-939a7a80e5bf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:31.594817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e1a9a7a-d218-40f0-9eea-939a7a80e5bf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:31.967554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-292afe6e-80e4-4346-8855-0305a7a36aa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:31.978670 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-292afe6e-80e4-4346-8855-0305a7a36aa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1462 microversion: 2.1 time: 0.777958 Oct 12 22:06:31.979300 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1011/1917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:31 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1462 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:32.014439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d46c9b93-68ca-4f2f-bf32-9d25469d06fb tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:32.015229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d46c9b93-68ca-4f2f-bf32-9d25469d06fb tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:32.034503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d46c9b93-68ca-4f2f-bf32-9d25469d06fb tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:32.037144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d46c9b93-68ca-4f2f-bf32-9d25469d06fb tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:32.042711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d46c9b93-68ca-4f2f-bf32-9d25469d06fb tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:32.043813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d46c9b93-68ca-4f2f-bf32-9d25469d06fb tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:32.048795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d46c9b93-68ca-4f2f-bf32-9d25469d06fb tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:32.049475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d46c9b93-68ca-4f2f-bf32-9d25469d06fb tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:32.394414 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d46c9b93-68ca-4f2f-bf32-9d25469d06fb tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1613 microversion: 2.1 time: 0.391648 Oct 12 22:06:32.400407 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1012/1918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:32 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1613 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:06:32.417674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1bc0bdae-ea99-49e8-ad04-13d848159df9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:32.418502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1bc0bdae-ea99-49e8-ad04-13d848159df9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:32.427544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:32.449437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bc0bdae-ea99-49e8-ad04-13d848159df9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:32.457190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bc0bdae-ea99-49e8-ad04-13d848159df9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:32.458818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bc0bdae-ea99-49e8-ad04-13d848159df9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:32.459891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bc0bdae-ea99-49e8-ad04-13d848159df9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:32.460369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bc0bdae-ea99-49e8-ad04-13d848159df9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:32.460808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bc0bdae-ea99-49e8-ad04-13d848159df9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:32.778702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e1a9a7a-d218-40f0-9eea-939a7a80e5bf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:32.797814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1bc0bdae-ea99-49e8-ad04-13d848159df9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:32.807051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e1a9a7a-d218-40f0-9eea-939a7a80e5bf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:32.811136 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1bc0bdae-ea99-49e8-ad04-13d848159df9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 0.409365 Oct 12 22:06:32.814192 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1013/1919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:32 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:32.815296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e1a9a7a-d218-40f0-9eea-939a7a80e5bf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:32.817776 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7e1a9a7a-d218-40f0-9eea-939a7a80e5bf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1293 microversion: 2.25 time: 1.287087 Oct 12 22:06:32.821486 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 907/1920] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:31 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1293 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:32.832471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9cda8aaa-a1af-40d1-8968-eaa59881f3e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:32.834938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fb5200a9-72aa-4519-b0b8-0ccdd5caf488 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:32.835977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9cda8aaa-a1af-40d1-8968-eaa59881f3e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:32.836780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fb5200a9-72aa-4519-b0b8-0ccdd5caf488 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:32.853119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cda8aaa-a1af-40d1-8968-eaa59881f3e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:32.863350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5200a9-72aa-4519-b0b8-0ccdd5caf488 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:32.863988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cda8aaa-a1af-40d1-8968-eaa59881f3e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:32.864465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cda8aaa-a1af-40d1-8968-eaa59881f3e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:32.865584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5200a9-72aa-4519-b0b8-0ccdd5caf488 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:32.866405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cda8aaa-a1af-40d1-8968-eaa59881f3e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:32.866879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cda8aaa-a1af-40d1-8968-eaa59881f3e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:32.867357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cda8aaa-a1af-40d1-8968-eaa59881f3e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:32.867909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5200a9-72aa-4519-b0b8-0ccdd5caf488 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:32.869959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5200a9-72aa-4519-b0b8-0ccdd5caf488 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:32.873544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5200a9-72aa-4519-b0b8-0ccdd5caf488 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:32.874558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5200a9-72aa-4519-b0b8-0ccdd5caf488 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:33.102109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fb5200a9-72aa-4519-b0b8-0ccdd5caf488 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9a66f4d7b25c41869a862712926f24ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b11f85b98b41f380033fce110090be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:33.103166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fb5200a9-72aa-4519-b0b8-0ccdd5caf488 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] [instance: 15055486-69c3-4d87-99da-927949deea8a] flavor_id is None. Assuming migration. {{(pid=120452) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 12 22:06:33.106560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fb5200a9-72aa-4519-b0b8-0ccdd5caf488 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] [instance: 15055486-69c3-4d87-99da-927949deea8a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120452) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:06:33.249777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9cda8aaa-a1af-40d1-8968-eaa59881f3e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:33.263822 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9cda8aaa-a1af-40d1-8968-eaa59881f3e7 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1307 microversion: 2.1 time: 0.448503 Oct 12 22:06:33.273368 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1014/1921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:32 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1307 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:33.280560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ec375a24-8d78-44db-b5a7-fdda7bac424f tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f5128fa9d30>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:33.395647 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ec375a24-8d78-44db-b5a7-fdda7bac424f tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1422 microversion: 2.1 time: 0.120907 Oct 12 22:06:33.396725 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1015/1922] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:33 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1422 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:33.649774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-b32d4cfb-119b-42d1-b9f1-9570b0580aff req-47384940-defa-421f-a698-a685d37c2cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325466ea-d13d-4204-89f6-7c5deb99cd61", "tag": "e81cfc4b-c2b5-45e3-9fb2-a58a934b6b9b"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:33.683096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b32d4cfb-119b-42d1-b9f1-9570b0580aff req-47384940-defa-421f-a698-a685d37c2cb2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:33.684251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b32d4cfb-119b-42d1-b9f1-9570b0580aff req-47384940-defa-421f-a698-a685d37c2cb2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:33.685101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b32d4cfb-119b-42d1-b9f1-9570b0580aff req-47384940-defa-421f-a698-a685d37c2cb2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:33.705064 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-b32d4cfb-119b-42d1-b9f1-9570b0580aff req-47384940-defa-421f-a698-a685d37c2cb2 service nova] Creating event network-changed:e81cfc4b-c2b5-45e3-9fb2-a58a934b6b9b for instance 325466ea-d13d-4204-89f6-7c5deb99cd61 on n-h2-861111-1 Oct 12 22:06:33.715948 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-b32d4cfb-119b-42d1-b9f1-9570b0580aff req-47384940-defa-421f-a698-a685d37c2cb2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072645 Oct 12 22:06:33.717837 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1016/1923] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:34.348072 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fb5200a9-72aa-4519-b0b8-0ccdd5caf488 tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a/action" status: 202 len: 0 microversion: 2.1 time: 1.524429 Oct 12 22:06:34.351403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-00c9b310-5a09-4ee0-8090-a4d04b38f903 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:34.352128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-00c9b310-5a09-4ee0-8090-a4d04b38f903 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:34.352785 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 908/1924] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:06:32 2022] POST /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a/action => generated 0 bytes in 1530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:06:34.374828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00c9b310-5a09-4ee0-8090-a4d04b38f903 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:34.388154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bdd0ae13-3f0f-4448-ad72-7ed264ebcfef tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:34.388776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bdd0ae13-3f0f-4448-ad72-7ed264ebcfef tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:34.396185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00c9b310-5a09-4ee0-8090-a4d04b38f903 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:34.397741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00c9b310-5a09-4ee0-8090-a4d04b38f903 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:34.410534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdd0ae13-3f0f-4448-ad72-7ed264ebcfef tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:34.411046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00c9b310-5a09-4ee0-8090-a4d04b38f903 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:34.411886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdd0ae13-3f0f-4448-ad72-7ed264ebcfef tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:34.413393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00c9b310-5a09-4ee0-8090-a4d04b38f903 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:34.414079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdd0ae13-3f0f-4448-ad72-7ed264ebcfef tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:34.415161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00c9b310-5a09-4ee0-8090-a4d04b38f903 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:34.416996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdd0ae13-3f0f-4448-ad72-7ed264ebcfef tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:34.417504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdd0ae13-3f0f-4448-ad72-7ed264ebcfef tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:34.417942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdd0ae13-3f0f-4448-ad72-7ed264ebcfef tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:35.005287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-00c9b310-5a09-4ee0-8090-a4d04b38f903 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:35.016792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-00c9b310-5a09-4ee0-8090-a4d04b38f903 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:35.027968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-00c9b310-5a09-4ee0-8090-a4d04b38f903 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:35.032340 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-00c9b310-5a09-4ee0-8090-a4d04b38f903 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1293 microversion: 2.25 time: 1.189159 Oct 12 22:06:35.039127 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1017/1925] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:33 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1293 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:35.044210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e7c0b56e-3b6f-4de8-91fa-b71bbb81de8d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:35.048235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e7c0b56e-3b6f-4de8-91fa-b71bbb81de8d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:35.064725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7c0b56e-3b6f-4de8-91fa-b71bbb81de8d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:35.065550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7c0b56e-3b6f-4de8-91fa-b71bbb81de8d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:35.065993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7c0b56e-3b6f-4de8-91fa-b71bbb81de8d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:35.066721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7c0b56e-3b6f-4de8-91fa-b71bbb81de8d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:35.067203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7c0b56e-3b6f-4de8-91fa-b71bbb81de8d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:35.073220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7c0b56e-3b6f-4de8-91fa-b71bbb81de8d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:35.307343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bdd0ae13-3f0f-4448-ad72-7ed264ebcfef tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:35.332778 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bdd0ae13-3f0f-4448-ad72-7ed264ebcfef tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 0.973091 Oct 12 22:06:35.341806 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 909/1926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:34 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:35.386989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ef2a44fe-f13f-40f3-8a54-4375ec15cfa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:35.387753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ef2a44fe-f13f-40f3-8a54-4375ec15cfa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:35.401294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef2a44fe-f13f-40f3-8a54-4375ec15cfa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:35.401812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef2a44fe-f13f-40f3-8a54-4375ec15cfa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:35.402230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef2a44fe-f13f-40f3-8a54-4375ec15cfa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:35.402952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef2a44fe-f13f-40f3-8a54-4375ec15cfa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:35.403479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef2a44fe-f13f-40f3-8a54-4375ec15cfa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:35.403914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef2a44fe-f13f-40f3-8a54-4375ec15cfa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:35.591636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e7c0b56e-3b6f-4de8-91fa-b71bbb81de8d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:35.602328 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e7c0b56e-3b6f-4de8-91fa-b71bbb81de8d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1307 microversion: 2.1 time: 0.561795 Oct 12 22:06:35.608270 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1018/1927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:35 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1307 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:35.622534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-24645a16-d7c1-4b94-88b4-4070d23de978 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f51285bba60>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:35.705650 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-24645a16-d7c1-4b94-88b4-4070d23de978 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1431 microversion: 2.1 time: 0.095883 Oct 12 22:06:35.711387 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1019/1928] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:35 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1431 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:35.733618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-34f437a2-1c4a-4de0-ad18-21d42c23bb9b tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512c46b430>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:35.809559 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-34f437a2-1c4a-4de0-ad18-21d42c23bb9b tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 200 len: 1431 microversion: 2.1 time: 0.093076 Oct 12 22:06:35.810641 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1020/1929] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:35 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 1431 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:35.824400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ca55066d-7d03-4166-b945-45090e7c16e1 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:35.825260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ca55066d-7d03-4166-b945-45090e7c16e1 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:35.839343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca55066d-7d03-4166-b945-45090e7c16e1 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:35.840149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca55066d-7d03-4166-b945-45090e7c16e1 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:35.840758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca55066d-7d03-4166-b945-45090e7c16e1 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:35.841652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca55066d-7d03-4166-b945-45090e7c16e1 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:35.842311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca55066d-7d03-4166-b945-45090e7c16e1 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:35.842916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca55066d-7d03-4166-b945-45090e7c16e1 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:36.145037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ef2a44fe-f13f-40f3-8a54-4375ec15cfa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:36.162181 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ef2a44fe-f13f-40f3-8a54-4375ec15cfa5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1471 microversion: 2.1 time: 0.788870 Oct 12 22:06:36.177504 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 910/1930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:35 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1471 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:36.205077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dae4a792-24a8-474b-8b9b-c3c0d516ecf8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:36.211042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dae4a792-24a8-474b-8b9b-c3c0d516ecf8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:36.248373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dae4a792-24a8-474b-8b9b-c3c0d516ecf8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:36.249993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dae4a792-24a8-474b-8b9b-c3c0d516ecf8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:36.255061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dae4a792-24a8-474b-8b9b-c3c0d516ecf8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:36.260379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dae4a792-24a8-474b-8b9b-c3c0d516ecf8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:36.262493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dae4a792-24a8-474b-8b9b-c3c0d516ecf8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:36.263872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dae4a792-24a8-474b-8b9b-c3c0d516ecf8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:36.637737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ca55066d-7d03-4166-b945-45090e7c16e1 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:36.651965 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ca55066d-7d03-4166-b945-45090e7c16e1 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1479 microversion: 2.1 time: 0.831261 Oct 12 22:06:36.662281 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1021/1931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:35 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1479 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:06:36.667528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fdbaf963-818f-4959-a73f-5705b3944dc5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:36.668855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fdbaf963-818f-4959-a73f-5705b3944dc5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:36.682136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdbaf963-818f-4959-a73f-5705b3944dc5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:36.687973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdbaf963-818f-4959-a73f-5705b3944dc5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:36.688645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdbaf963-818f-4959-a73f-5705b3944dc5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:36.689636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdbaf963-818f-4959-a73f-5705b3944dc5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:36.690633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdbaf963-818f-4959-a73f-5705b3944dc5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:36.691285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdbaf963-818f-4959-a73f-5705b3944dc5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:37.176032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fdbaf963-818f-4959-a73f-5705b3944dc5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:37.193813 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fdbaf963-818f-4959-a73f-5705b3944dc5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 0.530037 Oct 12 22:06:37.195835 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1022/1932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:36 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:37.226354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-67ae9a9a-e48a-4857-936a-1090b80f18a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:37.228429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-67ae9a9a-e48a-4857-936a-1090b80f18a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:37.244740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67ae9a9a-e48a-4857-936a-1090b80f18a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:37.248309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67ae9a9a-e48a-4857-936a-1090b80f18a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:37.248973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67ae9a9a-e48a-4857-936a-1090b80f18a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:37.250718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67ae9a9a-e48a-4857-936a-1090b80f18a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:37.251446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67ae9a9a-e48a-4857-936a-1090b80f18a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:37.254455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67ae9a9a-e48a-4857-936a-1090b80f18a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:37.341465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dae4a792-24a8-474b-8b9b-c3c0d516ecf8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:37.360715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dae4a792-24a8-474b-8b9b-c3c0d516ecf8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:37.368316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dae4a792-24a8-474b-8b9b-c3c0d516ecf8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:37.370006 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dae4a792-24a8-474b-8b9b-c3c0d516ecf8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1293 microversion: 2.25 time: 1.191285 Oct 12 22:06:37.371123 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 911/1933] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:36 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1293 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:37.379077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1e251913-cd8c-4b3a-b799-2e9bdce8e7a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:37.383137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1e251913-cd8c-4b3a-b799-2e9bdce8e7a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:37.401001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e251913-cd8c-4b3a-b799-2e9bdce8e7a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:37.401789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e251913-cd8c-4b3a-b799-2e9bdce8e7a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:37.402765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e251913-cd8c-4b3a-b799-2e9bdce8e7a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:37.405158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e251913-cd8c-4b3a-b799-2e9bdce8e7a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:37.407035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e251913-cd8c-4b3a-b799-2e9bdce8e7a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:37.409705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e251913-cd8c-4b3a-b799-2e9bdce8e7a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:37.771704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-67ae9a9a-e48a-4857-936a-1090b80f18a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:37.790843 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-67ae9a9a-e48a-4857-936a-1090b80f18a3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1307 microversion: 2.1 time: 0.574520 Oct 12 22:06:37.791662 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1023/1934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:37 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1307 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:37.823956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-55a0ba6a-403d-492a-820b-f151d021d273 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:37.827681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-55a0ba6a-403d-492a-820b-f151d021d273 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:37.859401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55a0ba6a-403d-492a-820b-f151d021d273 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:37.860580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55a0ba6a-403d-492a-820b-f151d021d273 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:37.862733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55a0ba6a-403d-492a-820b-f151d021d273 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:37.864692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55a0ba6a-403d-492a-820b-f151d021d273 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:37.866899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55a0ba6a-403d-492a-820b-f151d021d273 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:37.868195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55a0ba6a-403d-492a-820b-f151d021d273 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:38.443720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1e251913-cd8c-4b3a-b799-2e9bdce8e7a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:38.474671 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1e251913-cd8c-4b3a-b799-2e9bdce8e7a0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1471 microversion: 2.1 time: 1.102105 Oct 12 22:06:38.482110 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 912/1935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:37 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1471 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:38.497819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aef4bd9e-9d25-490b-961f-8789b77e020f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:38.505848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-aef4bd9e-9d25-490b-961f-8789b77e020f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:38.525470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aef4bd9e-9d25-490b-961f-8789b77e020f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:38.530362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aef4bd9e-9d25-490b-961f-8789b77e020f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:38.539903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aef4bd9e-9d25-490b-961f-8789b77e020f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:38.540926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aef4bd9e-9d25-490b-961f-8789b77e020f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:38.541874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aef4bd9e-9d25-490b-961f-8789b77e020f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:38.542409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aef4bd9e-9d25-490b-961f-8789b77e020f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:38.679884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-55a0ba6a-403d-492a-820b-f151d021d273 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:38.707687 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-55a0ba6a-403d-492a-820b-f151d021d273 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1466 microversion: 2.1 time: 0.907203 Oct 12 22:06:38.733679 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1024/1936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:37 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1466 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:38.750460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c7c22405-b8e8-4f5c-881b-603a05014f8c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:38.752388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c7c22405-b8e8-4f5c-881b-603a05014f8c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:38.767368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7c22405-b8e8-4f5c-881b-603a05014f8c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:38.768376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7c22405-b8e8-4f5c-881b-603a05014f8c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:38.770263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7c22405-b8e8-4f5c-881b-603a05014f8c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:38.772509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7c22405-b8e8-4f5c-881b-603a05014f8c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:38.775971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7c22405-b8e8-4f5c-881b-603a05014f8c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:38.777461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7c22405-b8e8-4f5c-881b-603a05014f8c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:39.641031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c7c22405-b8e8-4f5c-881b-603a05014f8c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:39.656505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c7c22405-b8e8-4f5c-881b-603a05014f8c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:39.658029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c7c22405-b8e8-4f5c-881b-603a05014f8c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:39.663500 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c7c22405-b8e8-4f5c-881b-603a05014f8c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1281 microversion: 2.25 time: 0.928509 Oct 12 22:06:39.668020 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1025/1937] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:38 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1281 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:39.680061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-befef58e-6867-4c97-82e2-0b090059cb35 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512c3d0700>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:39.730722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-aef4bd9e-9d25-490b-961f-8789b77e020f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:39.749878 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-aef4bd9e-9d25-490b-961f-8789b77e020f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 1.266291 Oct 12 22:06:39.750610 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 913/1938] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:38 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:39.774539 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-befef58e-6867-4c97-82e2-0b090059cb35 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/d1e68057-c368-47a5-ab06-787819be7f9c" status: 200 len: 784 microversion: 2.1 time: 0.104987 Oct 12 22:06:39.790328 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1026/1939] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:39 2022] GET /compute/v2.1/images/d1e68057-c368-47a5-ab06-787819be7f9c => generated 784 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:39.804245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a25c753b-0e61-4c01-b35d-8d4b58d00999 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:39.805232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a25c753b-0e61-4c01-b35d-8d4b58d00999 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:39.827520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a25c753b-0e61-4c01-b35d-8d4b58d00999 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:39.828550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a25c753b-0e61-4c01-b35d-8d4b58d00999 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:39.829268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a25c753b-0e61-4c01-b35d-8d4b58d00999 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:39.831005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a25c753b-0e61-4c01-b35d-8d4b58d00999 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:39.832006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a25c753b-0e61-4c01-b35d-8d4b58d00999 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:39.832690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a25c753b-0e61-4c01-b35d-8d4b58d00999 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:40.003553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f2643c85-d9e6-4429-8559-f7d3ece774a2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:40.004167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f2643c85-d9e6-4429-8559-f7d3ece774a2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:40.011682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2643c85-d9e6-4429-8559-f7d3ece774a2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:40.020026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2643c85-d9e6-4429-8559-f7d3ece774a2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:40.020869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2643c85-d9e6-4429-8559-f7d3ece774a2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:40.021848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2643c85-d9e6-4429-8559-f7d3ece774a2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:40.022524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2643c85-d9e6-4429-8559-f7d3ece774a2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:40.023185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2643c85-d9e6-4429-8559-f7d3ece774a2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:40.348772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a25c753b-0e61-4c01-b35d-8d4b58d00999 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:40.365420 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a25c753b-0e61-4c01-b35d-8d4b58d00999 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1471 microversion: 2.1 time: 0.572342 Oct 12 22:06:40.368516 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1027/1940] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:39 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1471 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:40.402179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-25a71d06-3c91-4151-ace2-b58eb648c1d1 req-c9168185-5e0b-4b30-9cad-897207fafa1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0bc29c-b01a-4913-b58d-0f0368eeaa52", "name": "network-vif-unplugged", "status": "completed", "tag": "8f924ca4-6121-4359-b81c-8b01b45de897"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:40.425993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-25a71d06-3c91-4151-ace2-b58eb648c1d1 req-c9168185-5e0b-4b30-9cad-897207fafa1f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:40.427575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-25a71d06-3c91-4151-ace2-b58eb648c1d1 req-c9168185-5e0b-4b30-9cad-897207fafa1f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:40.428036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-25a71d06-3c91-4151-ace2-b58eb648c1d1 req-c9168185-5e0b-4b30-9cad-897207fafa1f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:40.462441 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-25a71d06-3c91-4151-ace2-b58eb648c1d1 req-c9168185-5e0b-4b30-9cad-897207fafa1f service nova] Creating event network-vif-unplugged:8f924ca4-6121-4359-b81c-8b01b45de897 for instance 0a0bc29c-b01a-4913-b58d-0f0368eeaa52 on n-h1-861111-1 Oct 12 22:06:40.476511 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-25a71d06-3c91-4151-ace2-b58eb648c1d1 req-c9168185-5e0b-4b30-9cad-897207fafa1f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085252 Oct 12 22:06:40.478995 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1028/1941] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:40.493143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ccfd6432-2135-41fd-a4c9-cefb68e3464d tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:40.511868 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ccfd6432-2135-41fd-a4c9-cefb68e3464d tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030523 Oct 12 22:06:40.512480 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1029/1942] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:06:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:40.523880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:40.532915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f8a92e44-f8df-4212-9973-f46e6dbe2346 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512c583b80>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:40.544875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f2643c85-d9e6-4429-8559-f7d3ece774a2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:40.561069 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f2643c85-d9e6-4429-8559-f7d3ece774a2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1307 microversion: 2.1 time: 0.809414 Oct 12 22:06:40.580608 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 914/1943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:39 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1307 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:40.698697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8facf26b-52c6-4142-8cf8-e64379c12408 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:40.699430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8facf26b-52c6-4142-8cf8-e64379c12408 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:40.713352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8facf26b-52c6-4142-8cf8-e64379c12408 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:40.713852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8facf26b-52c6-4142-8cf8-e64379c12408 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:40.714297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8facf26b-52c6-4142-8cf8-e64379c12408 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:40.722477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8facf26b-52c6-4142-8cf8-e64379c12408 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:40.722989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8facf26b-52c6-4142-8cf8-e64379c12408 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:40.723469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8facf26b-52c6-4142-8cf8-e64379c12408 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:41.588345 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f8a92e44-f8df-4212-9973-f46e6dbe2346 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "DELETE /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 204 len: 0 microversion: 2.1 time: 1.064811 Oct 12 22:06:41.589082 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1030/1944] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:40 2022] DELETE /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 0 bytes in 1067 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:06:41.595808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8facf26b-52c6-4142-8cf8-e64379c12408 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:41.605475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6cf0fb1b-e9a3-48e8-9ec5-bb7048c8a40e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:41.608501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6cf0fb1b-e9a3-48e8-9ec5-bb7048c8a40e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:41.611219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8facf26b-52c6-4142-8cf8-e64379c12408 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:41.631431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8facf26b-52c6-4142-8cf8-e64379c12408 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:41.634195 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8facf26b-52c6-4142-8cf8-e64379c12408 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1281 microversion: 2.25 time: 0.940411 Oct 12 22:06:41.637674 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 915/1945] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:40 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1281 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:41.638447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf0fb1b-e9a3-48e8-9ec5-bb7048c8a40e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:41.639113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf0fb1b-e9a3-48e8-9ec5-bb7048c8a40e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:41.639803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf0fb1b-e9a3-48e8-9ec5-bb7048c8a40e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:41.640861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf0fb1b-e9a3-48e8-9ec5-bb7048c8a40e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:41.641666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf0fb1b-e9a3-48e8-9ec5-bb7048c8a40e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:41.642112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cf0fb1b-e9a3-48e8-9ec5-bb7048c8a40e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:41.650443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bace6bde-12ac-4559-9f9f-64a360a1f101 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:41.651057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bace6bde-12ac-4559-9f9f-64a360a1f101 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:41.679901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bace6bde-12ac-4559-9f9f-64a360a1f101 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:41.681512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bace6bde-12ac-4559-9f9f-64a360a1f101 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:41.682372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bace6bde-12ac-4559-9f9f-64a360a1f101 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:41.689067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bace6bde-12ac-4559-9f9f-64a360a1f101 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:41.690831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bace6bde-12ac-4559-9f9f-64a360a1f101 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:41.694379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bace6bde-12ac-4559-9f9f-64a360a1f101 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:42.073791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6cf0fb1b-e9a3-48e8-9ec5-bb7048c8a40e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:42.089898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bace6bde-12ac-4559-9f9f-64a360a1f101 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:42.098438 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6cf0fb1b-e9a3-48e8-9ec5-bb7048c8a40e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 0.501111 Oct 12 22:06:42.101701 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bace6bde-12ac-4559-9f9f-64a360a1f101 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1476 microversion: 2.1 time: 0.461669 Oct 12 22:06:42.116770 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 916/1946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:41 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1476 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:42.133900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2accd350-7f69-4f12-a6e6-4c9401c6bf43 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:42.134795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2accd350-7f69-4f12-a6e6-4c9401c6bf43 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:42.136727 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1031/1947] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:41 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:42.150485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2accd350-7f69-4f12-a6e6-4c9401c6bf43 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:42.152707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9b2b8192-77d7-48fe-96b4-8d0254402177 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512c5831f0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:42.155194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2accd350-7f69-4f12-a6e6-4c9401c6bf43 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:42.156743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2accd350-7f69-4f12-a6e6-4c9401c6bf43 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:42.158150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2accd350-7f69-4f12-a6e6-4c9401c6bf43 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:42.159516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2accd350-7f69-4f12-a6e6-4c9401c6bf43 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:42.160856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2accd350-7f69-4f12-a6e6-4c9401c6bf43 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:42.203994 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-9b2b8192-77d7-48fe-96b4-8d0254402177 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] HTTP exception thrown: Image not found. Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9b2b8192-77d7-48fe-96b4-8d0254402177 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Request method failure captured: Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe HTTP/1.1 Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzonFVs5MkZQx3DAO4DrE_uu4E1c1_xWu4dY1HBkkCJslTtp_084qZ_eCmPiDjr5rRj1v9KIleCfzKlbOJtWgHklyceW46DxzZwCSdXioS_3YBea0FpD0un4B10OFnjci2W8Wa0CjT7yuXrPfc3FadVzQBUgu89klRccHubREEldnzA Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: cb320231db494313a74874b542b1a99f Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesOneServerTestJSON-482211743 Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:06:42.222360 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:06:42.224516 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb320231db494313a74874b542b1a99f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb320231db494313a74874b542b1a99f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb320231db494313a74874b542b1a99f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb320231db494313a74874b542b1a99f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:06:42.224516 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesOneServerTestJSON-482211743 Oct 12 22:06:42.224516 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: cb320231db494313a74874b542b1a99f Oct 12 22:06:42.224516 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-482211743 Oct 12 22:06:42.224516 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesOneServerTestJSON-482211743-project Oct 12 22:06:42.224516 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:06:42.224516 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:06:42.224516 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7e19d242c6f84fafbc30b676b1a0e08e Oct 12 22:06:42.224516 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesOneServerTestJSON-482211743-project Oct 12 22:06:42.224516 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:06:42.224516 n-d-861111-1 devstack@n-api.service[120453]: exception: Image not found. Oct 12 22:06:42.224516 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1725ca6c-2486-47a7-b804-ce3d1b0afdbe'} Oct 12 22:06:42.224516 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:06:42.225866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1725ca6c-2486-47a7-b804-ce3d1b0afdbe Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:06:42.228377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1725ca6c-2486-47a7-b804-ce3d1b0afdbe could not be found. Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:06:42.233726 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:06:42.238983 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:06:42.238983 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:06:42.238983 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 12 22:06:42.238983 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:06:42.238983 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:06:42.238983 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:42.238983 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:42.238983 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:42.238983 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:42.238983 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:42.238983 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:42.238983 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:06:42.238983 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:06:42.238983 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:06:42.238983 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:42.242311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9b2b8192-77d7-48fe-96b4-8d0254402177 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Returning 404 to user: Image not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:06:42.244160 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9b2b8192-77d7-48fe-96b4-8d0254402177 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 404 len: 62 microversion: 2.1 time: 0.105940 Oct 12 22:06:42.247146 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1032/1948] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:42 2022] GET /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 62 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:06:42.273128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3cd06b42-5fc4-4c3d-9b94-a60b109d1d1c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-2098527358"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:42.297664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3cd06b42-5fc4-4c3d-9b94-a60b109d1d1c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:42.315774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cd06b42-5fc4-4c3d-9b94-a60b109d1d1c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:42.323779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cd06b42-5fc4-4c3d-9b94-a60b109d1d1c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:42.325145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cd06b42-5fc4-4c3d-9b94-a60b109d1d1c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:42.326382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cd06b42-5fc4-4c3d-9b94-a60b109d1d1c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:42.328332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cd06b42-5fc4-4c3d-9b94-a60b109d1d1c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:42.330460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cd06b42-5fc4-4c3d-9b94-a60b109d1d1c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:42.832666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:42.855571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2accd350-7f69-4f12-a6e6-4c9401c6bf43 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:42.869999 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2accd350-7f69-4f12-a6e6-4c9401c6bf43 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1307 microversion: 2.1 time: 0.746797 Oct 12 22:06:42.871302 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 917/1949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:42 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1307 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:42.883415 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3cd06b42-5fc4-4c3d-9b94-a60b109d1d1c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "POST /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52/action" status: 202 len: 0 microversion: 2.1 time: 0.625723 Oct 12 22:06:42.883786 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1033/1950] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:06:42 2022] POST /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52/action => generated 0 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:06:42.897996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8361fb33-c16a-4855-9f78-568243ceae9b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:42.899706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8361fb33-c16a-4855-9f78-568243ceae9b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:42.916833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8361fb33-c16a-4855-9f78-568243ceae9b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:42.918366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8361fb33-c16a-4855-9f78-568243ceae9b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:42.920049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8361fb33-c16a-4855-9f78-568243ceae9b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:42.920978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8361fb33-c16a-4855-9f78-568243ceae9b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:42.923596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8361fb33-c16a-4855-9f78-568243ceae9b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:42.924343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8361fb33-c16a-4855-9f78-568243ceae9b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:42.925070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-637b2521-195d-40b8-b30b-2431b1e95ad8 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f51282e2af0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:43.037272 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-637b2521-195d-40b8-b30b-2431b1e95ad8 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df" status: 200 len: 1427 microversion: 2.1 time: 0.132566 Oct 12 22:06:43.037978 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 918/1951] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:42 2022] GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df => generated 1427 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:43.128997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2018ad66-71cd-430c-9be6-70f6de18d72e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:43.130215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2018ad66-71cd-430c-9be6-70f6de18d72e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:43.145501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2018ad66-71cd-430c-9be6-70f6de18d72e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:43.147663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2018ad66-71cd-430c-9be6-70f6de18d72e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:43.150420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2018ad66-71cd-430c-9be6-70f6de18d72e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:43.151384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2018ad66-71cd-430c-9be6-70f6de18d72e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:43.154666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2018ad66-71cd-430c-9be6-70f6de18d72e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:43.157358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2018ad66-71cd-430c-9be6-70f6de18d72e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:43.341483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8361fb33-c16a-4855-9f78-568243ceae9b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:43.354450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8361fb33-c16a-4855-9f78-568243ceae9b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:43.360991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8361fb33-c16a-4855-9f78-568243ceae9b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:43.364414 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8361fb33-c16a-4855-9f78-568243ceae9b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1281 microversion: 2.25 time: 0.479172 Oct 12 22:06:43.368328 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1034/1952] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:42 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1281 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:43.403623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c83b41d6-5c98-429a-8ad7-26e6503dc38b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:43.412172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c83b41d6-5c98-429a-8ad7-26e6503dc38b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:43.441342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c83b41d6-5c98-429a-8ad7-26e6503dc38b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:43.442768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c83b41d6-5c98-429a-8ad7-26e6503dc38b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:43.443426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c83b41d6-5c98-429a-8ad7-26e6503dc38b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:43.444424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c83b41d6-5c98-429a-8ad7-26e6503dc38b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:43.445050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c83b41d6-5c98-429a-8ad7-26e6503dc38b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:43.445648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c83b41d6-5c98-429a-8ad7-26e6503dc38b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:43.614871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2018ad66-71cd-430c-9be6-70f6de18d72e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:43.623667 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2018ad66-71cd-430c-9be6-70f6de18d72e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 0.499846 Oct 12 22:06:43.633458 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 919/1953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:43 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:06:43.633458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-5715a4b9-47ab-4ee2-bf47-3550cf65eb0b req-7e3700b6-66a7-46d2-bd86-292657231cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "556ed054-4ef4-4561-9b46-8380cf091bb2", "name": "network-vif-plugged", "status": "completed", "tag": "815d5143-86f7-421c-bd6d-f4db0bad30f2"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:43.697645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5715a4b9-47ab-4ee2-bf47-3550cf65eb0b req-7e3700b6-66a7-46d2-bd86-292657231cc8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:43.698175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5715a4b9-47ab-4ee2-bf47-3550cf65eb0b req-7e3700b6-66a7-46d2-bd86-292657231cc8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:43.698546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5715a4b9-47ab-4ee2-bf47-3550cf65eb0b req-7e3700b6-66a7-46d2-bd86-292657231cc8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:43.708233 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:43.736258 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-5715a4b9-47ab-4ee2-bf47-3550cf65eb0b req-7e3700b6-66a7-46d2-bd86-292657231cc8 service nova] Creating event network-vif-plugged:815d5143-86f7-421c-bd6d-f4db0bad30f2 for instance 556ed054-4ef4-4561-9b46-8380cf091bb2 on n-h1-861111-1 Oct 12 22:06:43.743937 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-5715a4b9-47ab-4ee2-bf47-3550cf65eb0b req-7e3700b6-66a7-46d2-bd86-292657231cc8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117331 Oct 12 22:06:43.746110 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 920/1954] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:43.839880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c83b41d6-5c98-429a-8ad7-26e6503dc38b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:43.848913 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c83b41d6-5c98-429a-8ad7-26e6503dc38b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1476 microversion: 2.1 time: 0.478570 Oct 12 22:06:43.851891 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1035/1955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:43 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1476 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:43.885369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1108411713", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "98fd53ad-7751-4489-a42d-3d61dadc600b"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:43.901905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fcc3eaf3-6408-48fc-b26a-90415992a864 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:43.902488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fcc3eaf3-6408-48fc-b26a-90415992a864 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:43.930495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcc3eaf3-6408-48fc-b26a-90415992a864 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:43.931229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcc3eaf3-6408-48fc-b26a-90415992a864 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:43.931795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcc3eaf3-6408-48fc-b26a-90415992a864 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:43.932813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcc3eaf3-6408-48fc-b26a-90415992a864 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:43.933548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcc3eaf3-6408-48fc-b26a-90415992a864 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:43.934146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcc3eaf3-6408-48fc-b26a-90415992a864 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:44.040837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] validate_networks() for [('98fd53ad-7751-4489-a42d-3d61dadc600b', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:06:44.394709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fcc3eaf3-6408-48fc-b26a-90415992a864 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:44.421265 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fcc3eaf3-6408-48fc-b26a-90415992a864 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1307 microversion: 2.1 time: 0.523644 Oct 12 22:06:44.435312 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1036/1956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:43 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1307 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:06:44.440379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b98ee34-901d-4c57-8600-144a4e2afcc7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512c383ca0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:44.547213 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8b98ee34-901d-4c57-8600-144a4e2afcc7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df" status: 200 len: 1427 microversion: 2.1 time: 0.121371 Oct 12 22:06:44.548929 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1037/1957] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:44 2022] GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:44.574248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-37abf53d-17ea-444e-be49-f0b92af91a13 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:44.574892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-37abf53d-17ea-444e-be49-f0b92af91a13 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:44.595146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37abf53d-17ea-444e-be49-f0b92af91a13 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:44.597076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37abf53d-17ea-444e-be49-f0b92af91a13 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:44.598195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37abf53d-17ea-444e-be49-f0b92af91a13 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:44.601610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37abf53d-17ea-444e-be49-f0b92af91a13 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:44.603269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37abf53d-17ea-444e-be49-f0b92af91a13 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:44.603915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37abf53d-17ea-444e-be49-f0b92af91a13 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:44.887580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:06:44.888588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:06:44.889067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:06:44.889473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:06:44.890160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:06:44.905203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:44.905784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:44.906350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:44.907099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:44.907623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:44.908165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:44.939256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Getting quotas for project 04e80cd4201d427189c6f50ca7e9532a. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:06:44.943941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-37abf53d-17ea-444e-be49-f0b92af91a13 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:44.950551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Getting quotas for user 5536917f69c1495b9363dc8704154aa8 and project 04e80cd4201d427189c6f50ca7e9532a. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:06:44.963050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-37abf53d-17ea-444e-be49-f0b92af91a13 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:44.968706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Going to run 2 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:06:44.972485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 7ad6eb67-f30e-4da4-8c4d-5b69d7f54d3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:06:44.973252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-37abf53d-17ea-444e-be49-f0b92af91a13 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:44.981964 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-37abf53d-17ea-444e-be49-f0b92af91a13 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1281 microversion: 2.25 time: 0.431884 Oct 12 22:06:44.982720 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1038/1958] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:44 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1281 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:44.991016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1b021456-98c2-48eb-8ac0-abd94c587336 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:44.991995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1b021456-98c2-48eb-8ac0-abd94c587336 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:45.008677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b021456-98c2-48eb-8ac0-abd94c587336 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:45.017254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b021456-98c2-48eb-8ac0-abd94c587336 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:45.018809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b021456-98c2-48eb-8ac0-abd94c587336 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:45.021781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b021456-98c2-48eb-8ac0-abd94c587336 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:45.025140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b021456-98c2-48eb-8ac0-abd94c587336 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:45.026210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b021456-98c2-48eb-8ac0-abd94c587336 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:45.063059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=7ad6eb67-f30e-4da4-8c4d-5b69d7f54d3d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:06:45.186117 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a3916755-044d-45de-86b1-c0d4dc478ab0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.438569 Oct 12 22:06:45.189610 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 921/1959] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:06:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:06:45.204106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d1a2354c-102e-496a-b77c-6cef4568e528 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:45.204933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d1a2354c-102e-496a-b77c-6cef4568e528 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:45.246175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1a2354c-102e-496a-b77c-6cef4568e528 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:45.246724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1a2354c-102e-496a-b77c-6cef4568e528 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:45.247175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1a2354c-102e-496a-b77c-6cef4568e528 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:45.254211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1a2354c-102e-496a-b77c-6cef4568e528 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:45.258685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1a2354c-102e-496a-b77c-6cef4568e528 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:45.260434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1a2354c-102e-496a-b77c-6cef4568e528 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:45.286217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1b021456-98c2-48eb-8ac0-abd94c587336 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:45.297304 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1b021456-98c2-48eb-8ac0-abd94c587336 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 0.311695 Oct 12 22:06:45.297904 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1039/1960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:44 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:45.305944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ca024fa4-8f1f-44ad-a6fa-a00c417644ee tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:45.312130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ca024fa4-8f1f-44ad-a6fa-a00c417644ee tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:45.313186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ca024fa4-8f1f-44ad-a6fa-a00c417644ee tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Searching by: {'deleted': False, 'project_id': '04e80cd4201d427189c6f50ca7e9532a'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:06:45.332482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca024fa4-8f1f-44ad-a6fa-a00c417644ee tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:45.333254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca024fa4-8f1f-44ad-a6fa-a00c417644ee tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:45.333858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca024fa4-8f1f-44ad-a6fa-a00c417644ee tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:45.335956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca024fa4-8f1f-44ad-a6fa-a00c417644ee tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:45.337495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca024fa4-8f1f-44ad-a6fa-a00c417644ee tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:45.338125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca024fa4-8f1f-44ad-a6fa-a00c417644ee tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:45.370876 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ca024fa4-8f1f-44ad-a6fa-a00c417644ee tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.071107 Oct 12 22:06:45.379610 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1040/1961] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 12 22:06:45 2022] GET /compute/v2.1/servers => generated 677 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:45.387785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-da2ed90f-ed47-4a43-8ae5-5992ad6aecf9 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:45.388420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-da2ed90f-ed47-4a43-8ae5-5992ad6aecf9 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:45.482652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-da2ed90f-ed47-4a43-8ae5-5992ad6aecf9 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:45.491724 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-da2ed90f-ed47-4a43-8ae5-5992ad6aecf9 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5" status: 200 len: 1220 microversion: 2.1 time: 0.107749 Oct 12 22:06:45.493838 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1041/1962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:45 2022] GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5 => generated 1220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:45.528271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ba91ec9c-4d3c-44fa-aa7a-cc855ccc8953 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:45.529461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ba91ec9c-4d3c-44fa-aa7a-cc855ccc8953 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:45.537578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba91ec9c-4d3c-44fa-aa7a-cc855ccc8953 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:45.538197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba91ec9c-4d3c-44fa-aa7a-cc855ccc8953 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:45.538983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba91ec9c-4d3c-44fa-aa7a-cc855ccc8953 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:45.539905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba91ec9c-4d3c-44fa-aa7a-cc855ccc8953 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:45.540663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba91ec9c-4d3c-44fa-aa7a-cc855ccc8953 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:45.541328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba91ec9c-4d3c-44fa-aa7a-cc855ccc8953 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:45.735272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d1a2354c-102e-496a-b77c-6cef4568e528 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:45.762545 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d1a2354c-102e-496a-b77c-6cef4568e528 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1476 microversion: 2.1 time: 0.569761 Oct 12 22:06:45.764796 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 922/1963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:45 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1476 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:45.774665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8236b28d-07dc-4529-ba64-3004d4d43293 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512391caf0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:45.891832 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8236b28d-07dc-4529-ba64-3004d4d43293 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df" status: 200 len: 1427 microversion: 2.1 time: 0.125615 Oct 12 22:06:45.901012 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 923/1964] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:45 2022] GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:45.965974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ba91ec9c-4d3c-44fa-aa7a-cc855ccc8953 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:45.978830 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ba91ec9c-4d3c-44fa-aa7a-cc855ccc8953 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1307 microversion: 2.1 time: 0.483485 Oct 12 22:06:45.983853 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1042/1965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:45 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1307 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:46.048823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4d82fb6a-0877-44bd-b876-f4ed54b7041b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:46.049316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4d82fb6a-0877-44bd-b876-f4ed54b7041b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:46.067317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d82fb6a-0877-44bd-b876-f4ed54b7041b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:46.069153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d82fb6a-0877-44bd-b876-f4ed54b7041b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:46.070904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d82fb6a-0877-44bd-b876-f4ed54b7041b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:46.071930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d82fb6a-0877-44bd-b876-f4ed54b7041b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:46.073820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d82fb6a-0877-44bd-b876-f4ed54b7041b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:46.075903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d82fb6a-0877-44bd-b876-f4ed54b7041b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:46.321171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4d82fb6a-0877-44bd-b876-f4ed54b7041b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:46.332102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4d82fb6a-0877-44bd-b876-f4ed54b7041b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:46.342830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4d82fb6a-0877-44bd-b876-f4ed54b7041b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:46.344223 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4d82fb6a-0877-44bd-b876-f4ed54b7041b tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1281 microversion: 2.25 time: 0.323864 Oct 12 22:06:46.345270 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 924/1966] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:46 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1281 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:46.357442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c3aee4c3-21b7-4f7f-98b3-b7b77aeced06 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:46.377226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c3aee4c3-21b7-4f7f-98b3-b7b77aeced06 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:46.427888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3aee4c3-21b7-4f7f-98b3-b7b77aeced06 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:46.430931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3aee4c3-21b7-4f7f-98b3-b7b77aeced06 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:46.431508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3aee4c3-21b7-4f7f-98b3-b7b77aeced06 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:46.433372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3aee4c3-21b7-4f7f-98b3-b7b77aeced06 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:46.434169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3aee4c3-21b7-4f7f-98b3-b7b77aeced06 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:46.438447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3aee4c3-21b7-4f7f-98b3-b7b77aeced06 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:46.551591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6becc2a1-f4c1-4222-8906-5e31fa70a8b2 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:46.552798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6becc2a1-f4c1-4222-8906-5e31fa70a8b2 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:46.720269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6becc2a1-f4c1-4222-8906-5e31fa70a8b2 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:46.733538 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6becc2a1-f4c1-4222-8906-5e31fa70a8b2 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5" status: 200 len: 1220 microversion: 2.1 time: 0.213882 Oct 12 22:06:46.735139 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 925/1967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:46 2022] GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5 => generated 1220 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:46.762765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c3aee4c3-21b7-4f7f-98b3-b7b77aeced06 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:46.772363 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c3aee4c3-21b7-4f7f-98b3-b7b77aeced06 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 0.448771 Oct 12 22:06:46.774787 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1043/1968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:46 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:06:46.800099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-88dde057-c727-4d09-a585-55a2f4893c00 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:46.802195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-88dde057-c727-4d09-a585-55a2f4893c00 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:46.872477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88dde057-c727-4d09-a585-55a2f4893c00 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:46.882448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88dde057-c727-4d09-a585-55a2f4893c00 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.054s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:46.884373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88dde057-c727-4d09-a585-55a2f4893c00 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:46.886858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88dde057-c727-4d09-a585-55a2f4893c00 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:46.897495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88dde057-c727-4d09-a585-55a2f4893c00 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:46.898076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88dde057-c727-4d09-a585-55a2f4893c00 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:46.922251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e2841b26-6c8b-4e51-a47b-e77468b79403 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512840b1f0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:47.016326 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e2841b26-6c8b-4e51-a47b-e77468b79403 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df" status: 200 len: 1427 microversion: 2.1 time: 0.108521 Oct 12 22:06:47.017476 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1044/1969] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:46 2022] GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:47.035355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-76f523bb-5d4a-4095-ac59-ad3a5cba3da3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:47.038632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-76f523bb-5d4a-4095-ac59-ad3a5cba3da3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:47.062078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76f523bb-5d4a-4095-ac59-ad3a5cba3da3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:47.062910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76f523bb-5d4a-4095-ac59-ad3a5cba3da3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:47.063812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76f523bb-5d4a-4095-ac59-ad3a5cba3da3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:47.065904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76f523bb-5d4a-4095-ac59-ad3a5cba3da3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:47.066652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76f523bb-5d4a-4095-ac59-ad3a5cba3da3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:47.068388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76f523bb-5d4a-4095-ac59-ad3a5cba3da3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:47.329738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-88dde057-c727-4d09-a585-55a2f4893c00 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:47.362014 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-88dde057-c727-4d09-a585-55a2f4893c00 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1476 microversion: 2.1 time: 0.570315 Oct 12 22:06:47.369599 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 926/1970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:46 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1476 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:47.386814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-083dde07-2527-4b69-8a3f-62b140c48ac8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:47.387825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-083dde07-2527-4b69-8a3f-62b140c48ac8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:47.395092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:47.397286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-083dde07-2527-4b69-8a3f-62b140c48ac8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:47.397822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-083dde07-2527-4b69-8a3f-62b140c48ac8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:47.398392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-083dde07-2527-4b69-8a3f-62b140c48ac8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:47.399319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-083dde07-2527-4b69-8a3f-62b140c48ac8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:47.400195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-083dde07-2527-4b69-8a3f-62b140c48ac8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:47.400842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-083dde07-2527-4b69-8a3f-62b140c48ac8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:47.456069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-76f523bb-5d4a-4095-ac59-ad3a5cba3da3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:47.469600 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-76f523bb-5d4a-4095-ac59-ad3a5cba3da3 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1486 microversion: 2.1 time: 0.448008 Oct 12 22:06:47.470208 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1045/1971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:47 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1486 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:47.508933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-324adc15-4c81-4ea5-8dd7-26191e3b4582 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-350008436"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:47.512339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-324adc15-4c81-4ea5-8dd7-26191e3b4582 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:47.521623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-324adc15-4c81-4ea5-8dd7-26191e3b4582 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:47.522496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-324adc15-4c81-4ea5-8dd7-26191e3b4582 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:47.523162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-324adc15-4c81-4ea5-8dd7-26191e3b4582 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:47.524999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-324adc15-4c81-4ea5-8dd7-26191e3b4582 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:47.525874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-324adc15-4c81-4ea5-8dd7-26191e3b4582 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:47.526520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-324adc15-4c81-4ea5-8dd7-26191e3b4582 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:47.822105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-083dde07-2527-4b69-8a3f-62b140c48ac8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:47.836265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-083dde07-2527-4b69-8a3f-62b140c48ac8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:47.843538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-083dde07-2527-4b69-8a3f-62b140c48ac8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:47.846167 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-083dde07-2527-4b69-8a3f-62b140c48ac8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1281 microversion: 2.25 time: 0.464368 Oct 12 22:06:47.862105 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 927/1972] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:47 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1281 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:47.895390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd6c2c68-b47b-4c57-896a-c6c069b9f962 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:47.900591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cd6c2c68-b47b-4c57-896a-c6c069b9f962 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:47.920644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd6c2c68-b47b-4c57-896a-c6c069b9f962 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:47.921133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd6c2c68-b47b-4c57-896a-c6c069b9f962 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:47.921575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd6c2c68-b47b-4c57-896a-c6c069b9f962 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:47.939500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd6c2c68-b47b-4c57-896a-c6c069b9f962 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:47.940558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd6c2c68-b47b-4c57-896a-c6c069b9f962 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:47.941268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd6c2c68-b47b-4c57-896a-c6c069b9f962 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:48.114919 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-324adc15-4c81-4ea5-8dd7-26191e3b4582 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "POST /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2/action" status: 202 len: 0 microversion: 2.1 time: 0.618376 Oct 12 22:06:48.115648 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1046/1973] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:06:47 2022] POST /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:06:48.138744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-da39368a-eb28-41bc-9d46-b1e9c26a4087 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:48.173031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-da39368a-eb28-41bc-9d46-b1e9c26a4087 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:48.186349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da39368a-eb28-41bc-9d46-b1e9c26a4087 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:48.186718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da39368a-eb28-41bc-9d46-b1e9c26a4087 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:48.187424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da39368a-eb28-41bc-9d46-b1e9c26a4087 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:48.188307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da39368a-eb28-41bc-9d46-b1e9c26a4087 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:48.188932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da39368a-eb28-41bc-9d46-b1e9c26a4087 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:48.190120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da39368a-eb28-41bc-9d46-b1e9c26a4087 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:48.195493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cd6c2c68-b47b-4c57-896a-c6c069b9f962 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:48.215020 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cd6c2c68-b47b-4c57-896a-c6c069b9f962 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5" status: 200 len: 1216 microversion: 2.1 time: 0.349283 Oct 12 22:06:48.232415 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 928/1974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:47 2022] GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5 => generated 1216 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:48.257535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d978d14f-3332-4643-9d40-382046ae4d3c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512395c040>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:48.556524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-da39368a-eb28-41bc-9d46-b1e9c26a4087 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:48.564385 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d978d14f-3332-4643-9d40-382046ae4d3c tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df" status: 200 len: 1427 microversion: 2.1 time: 0.330797 Oct 12 22:06:48.566758 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 929/1975] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:48 2022] GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df => generated 1427 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:48.589737 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-da39368a-eb28-41bc-9d46-b1e9c26a4087 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 0.446018 Oct 12 22:06:48.591416 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1047/1976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:48 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:48.593322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d9a86a65-8012-47cc-b341-e9c97c8d9e52 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5123836a60>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:48.609052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8a7e6bef-531a-4d98-a909-24b0c96b7e4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:48.609938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8a7e6bef-531a-4d98-a909-24b0c96b7e4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:48.625562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a7e6bef-531a-4d98-a909-24b0c96b7e4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:48.626896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a7e6bef-531a-4d98-a909-24b0c96b7e4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:48.627580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a7e6bef-531a-4d98-a909-24b0c96b7e4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:48.628499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a7e6bef-531a-4d98-a909-24b0c96b7e4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:48.630137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a7e6bef-531a-4d98-a909-24b0c96b7e4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:48.630743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a7e6bef-531a-4d98-a909-24b0c96b7e4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:48.748100 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d9a86a65-8012-47cc-b341-e9c97c8d9e52 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/dc9008d5-a96d-413d-acc8-034c1cf72a5b" status: 200 len: 1411 microversion: 2.1 time: 0.172410 Oct 12 22:06:48.748822 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 930/1977] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:48 2022] GET /compute/v2.1/images/dc9008d5-a96d-413d-acc8-034c1cf72a5b => generated 1411 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:48.766236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d850d5a3-3cd3-4ff9-92ce-43ea1088c26b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51238cf4c0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:48.860616 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d850d5a3-3cd3-4ff9-92ce-43ea1088c26b tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/dc9008d5-a96d-413d-acc8-034c1cf72a5b" status: 200 len: 1411 microversion: 2.1 time: 0.098369 Oct 12 22:06:48.864525 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 931/1978] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:48 2022] GET /compute/v2.1/images/dc9008d5-a96d-413d-acc8-034c1cf72a5b => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:06:48.895281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7e596104-4124-4b97-909e-9c9865ed9fac tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:48.898819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7e596104-4124-4b97-909e-9c9865ed9fac tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:48.915973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e596104-4124-4b97-909e-9c9865ed9fac tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:48.917272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e596104-4124-4b97-909e-9c9865ed9fac tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:48.917926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e596104-4124-4b97-909e-9c9865ed9fac tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:48.918880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e596104-4124-4b97-909e-9c9865ed9fac tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:48.919575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e596104-4124-4b97-909e-9c9865ed9fac tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:48.920208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e596104-4124-4b97-909e-9c9865ed9fac tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:48.945172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8a7e6bef-531a-4d98-a909-24b0c96b7e4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:48.958886 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8a7e6bef-531a-4d98-a909-24b0c96b7e4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1476 microversion: 2.1 time: 0.366065 Oct 12 22:06:48.960422 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1048/1979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:48 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1476 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:48.966908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd827c78-b645-47ea-be2e-e802a744d479 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5128292dc0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:49.340177 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dd827c78-b645-47ea-be2e-e802a744d479 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/images/dc9008d5-a96d-413d-acc8-034c1cf72a5b" status: 204 len: 0 microversion: 2.1 time: 0.377863 Oct 12 22:06:49.340852 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1049/1980] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:48 2022] DELETE /compute/v2.1/images/dc9008d5-a96d-413d-acc8-034c1cf72a5b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:06:49.351045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9c5730fe-c9e0-417c-9e95-607581c26342 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:49.352003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9c5730fe-c9e0-417c-9e95-607581c26342 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:49.375957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c5730fe-c9e0-417c-9e95-607581c26342 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:49.381621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c5730fe-c9e0-417c-9e95-607581c26342 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:49.382377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c5730fe-c9e0-417c-9e95-607581c26342 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:49.385147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c5730fe-c9e0-417c-9e95-607581c26342 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:49.387130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c5730fe-c9e0-417c-9e95-607581c26342 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:49.389925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c5730fe-c9e0-417c-9e95-607581c26342 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:49.631727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9c5730fe-c9e0-417c-9e95-607581c26342 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:49.652224 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9c5730fe-c9e0-417c-9e95-607581c26342 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5" status: 200 len: 1272 microversion: 2.1 time: 0.306201 Oct 12 22:06:49.674478 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1050/1981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:49 2022] GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5 => generated 1272 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:49.706839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f71d3f9c-8aeb-498e-a29a-215a877a649d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51282a2820>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:49.709739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e596104-4124-4b97-909e-9c9865ed9fac tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:49.724900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e596104-4124-4b97-909e-9c9865ed9fac tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:49.730541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e596104-4124-4b97-909e-9c9865ed9fac tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:49.732770 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7e596104-4124-4b97-909e-9c9865ed9fac tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1281 microversion: 2.25 time: 0.858459 Oct 12 22:06:49.736857 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 932/1982] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:48 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1281 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:49.745280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a02495cb-1202-4068-94f3-d2b80d1cddb5 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f5123836dc0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:49.784106 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-f71d3f9c-8aeb-498e-a29a-215a877a649d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Image not found. Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f71d3f9c-8aeb-498e-a29a-215a877a649d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/images/dc9008d5-a96d-413d-acc8-034c1cf72a5b HTTP/1.1 Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:06:49.795006 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:06:49.796979 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:06:49.796979 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:06:49.796979 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:06:49.796979 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:06:49.796979 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:06:49.796979 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:06:49.796979 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:06:49.796979 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:06:49.796979 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:06:49.796979 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:06:49.796979 n-d-861111-1 devstack@n-api.service[120453]: exception: Image not found. Oct 12 22:06:49.796979 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'dc9008d5-a96d-413d-acc8-034c1cf72a5b'} Oct 12 22:06:49.796979 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:06:49.796979 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID dc9008d5-a96d-413d-acc8-034c1cf72a5b Oct 12 22:06:49.798177 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:06:49.800067 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dc9008d5-a96d-413d-acc8-034c1cf72a5b could not be found. Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:06:49.801779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:06:49.803471 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:06:49.803471 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:06:49.803471 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 12 22:06:49.803471 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:06:49.803471 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:06:49.803471 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:49.803471 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:49.803471 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:49.803471 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:49.803471 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:49.803471 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:49.803471 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:06:49.803471 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:06:49.803471 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:06:49.803471 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:06:49.808001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f71d3f9c-8aeb-498e-a29a-215a877a649d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Image not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:06:49.810330 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f71d3f9c-8aeb-498e-a29a-215a877a649d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/images/dc9008d5-a96d-413d-acc8-034c1cf72a5b" status: 404 len: 62 microversion: 2.1 time: 0.134495 Oct 12 22:06:49.813445 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1051/1983] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:49 2022] GET /compute/v2.1/images/dc9008d5-a96d-413d-acc8-034c1cf72a5b => generated 62 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:06:49.824555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-461c5b80-8e6c-4c2b-a05b-4dbe3f8ed735 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:49.828254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-461c5b80-8e6c-4c2b-a05b-4dbe3f8ed735 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:49.842253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-461c5b80-8e6c-4c2b-a05b-4dbe3f8ed735 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:49.843450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-461c5b80-8e6c-4c2b-a05b-4dbe3f8ed735 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:49.846603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-461c5b80-8e6c-4c2b-a05b-4dbe3f8ed735 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:49.848632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-461c5b80-8e6c-4c2b-a05b-4dbe3f8ed735 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:49.849289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-461c5b80-8e6c-4c2b-a05b-4dbe3f8ed735 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:49.851474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-461c5b80-8e6c-4c2b-a05b-4dbe3f8ed735 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:49.937350 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a02495cb-1202-4068-94f3-d2b80d1cddb5 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df" status: 200 len: 1427 microversion: 2.1 time: 0.196506 Oct 12 22:06:49.938074 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 933/1984] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:49 2022] GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df => generated 1427 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:49.954665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7cbff0bd-1b16-4aab-8037-f9e867074113 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:49.957806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7cbff0bd-1b16-4aab-8037-f9e867074113 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:49.989261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cbff0bd-1b16-4aab-8037-f9e867074113 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:49.992460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cbff0bd-1b16-4aab-8037-f9e867074113 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:49.993081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cbff0bd-1b16-4aab-8037-f9e867074113 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:49.994867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cbff0bd-1b16-4aab-8037-f9e867074113 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:49.995522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cbff0bd-1b16-4aab-8037-f9e867074113 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:49.999797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cbff0bd-1b16-4aab-8037-f9e867074113 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:50.183368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-461c5b80-8e6c-4c2b-a05b-4dbe3f8ed735 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:50.201629 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-461c5b80-8e6c-4c2b-a05b-4dbe3f8ed735 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 0.385030 Oct 12 22:06:50.202948 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1052/1985] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:49 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:50.223511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-988dd307-2f84-4724-aa18-a73c7235ccd0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:50.225622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-988dd307-2f84-4724-aa18-a73c7235ccd0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:50.255597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-988dd307-2f84-4724-aa18-a73c7235ccd0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:50.257407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-988dd307-2f84-4724-aa18-a73c7235ccd0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:50.262777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-988dd307-2f84-4724-aa18-a73c7235ccd0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:50.263925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-988dd307-2f84-4724-aa18-a73c7235ccd0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:50.266419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-988dd307-2f84-4724-aa18-a73c7235ccd0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:50.267172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-988dd307-2f84-4724-aa18-a73c7235ccd0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:50.585747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-988dd307-2f84-4724-aa18-a73c7235ccd0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:50.600673 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-988dd307-2f84-4724-aa18-a73c7235ccd0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1476 microversion: 2.1 time: 0.388368 Oct 12 22:06:50.604058 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1053/1986] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:50 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1476 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:50.693141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-35fdc7aa-8024-4c13-b9d1-875472758e09 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:50.693804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-35fdc7aa-8024-4c13-b9d1-875472758e09 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:50.708886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35fdc7aa-8024-4c13-b9d1-875472758e09 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:50.711504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35fdc7aa-8024-4c13-b9d1-875472758e09 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:50.712473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35fdc7aa-8024-4c13-b9d1-875472758e09 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:50.715204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35fdc7aa-8024-4c13-b9d1-875472758e09 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:50.715715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35fdc7aa-8024-4c13-b9d1-875472758e09 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:50.716159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35fdc7aa-8024-4c13-b9d1-875472758e09 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:50.794283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:50.854302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-35fdc7aa-8024-4c13-b9d1-875472758e09 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:50.865933 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-35fdc7aa-8024-4c13-b9d1-875472758e09 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5" status: 200 len: 1290 microversion: 2.1 time: 0.178275 Oct 12 22:06:50.867158 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1054/1987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:50 2022] GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5 => generated 1290 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:50.880383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f5d5c974-2c12-406a-acc5-2072446a7e37 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:50.881869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f5d5c974-2c12-406a-acc5-2072446a7e37 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:50.897202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5d5c974-2c12-406a-acc5-2072446a7e37 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:50.897682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5d5c974-2c12-406a-acc5-2072446a7e37 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:50.898336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5d5c974-2c12-406a-acc5-2072446a7e37 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:50.899279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5d5c974-2c12-406a-acc5-2072446a7e37 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:50.899861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5d5c974-2c12-406a-acc5-2072446a7e37 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:50.900602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5d5c974-2c12-406a-acc5-2072446a7e37 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:51.184193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f5d5c974-2c12-406a-acc5-2072446a7e37 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:51.202984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f5d5c974-2c12-406a-acc5-2072446a7e37 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:51.206094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f5d5c974-2c12-406a-acc5-2072446a7e37 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:51.215092 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f5d5c974-2c12-406a-acc5-2072446a7e37 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1281 microversion: 2.25 time: 0.346406 Oct 12 22:06:51.234548 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1055/1988] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:50 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1281 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:51.249544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-956c3fbc-1736-40fd-a849-45b228138ab3 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512c383a60>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:51.341616 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-956c3fbc-1736-40fd-a849-45b228138ab3 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df" status: 200 len: 1427 microversion: 2.1 time: 0.105719 Oct 12 22:06:51.343211 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1056/1989] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:51 2022] GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:51.363411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bf91cce6-bfb9-42b4-bf57-ff7032f78fff tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:51.364258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bf91cce6-bfb9-42b4-bf57-ff7032f78fff tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:51.391881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf91cce6-bfb9-42b4-bf57-ff7032f78fff tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:51.399111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf91cce6-bfb9-42b4-bf57-ff7032f78fff tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:51.399111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf91cce6-bfb9-42b4-bf57-ff7032f78fff tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:51.402984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf91cce6-bfb9-42b4-bf57-ff7032f78fff tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:51.406183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf91cce6-bfb9-42b4-bf57-ff7032f78fff tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:51.408840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf91cce6-bfb9-42b4-bf57-ff7032f78fff tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:52.055867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bf91cce6-bfb9-42b4-bf57-ff7032f78fff tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:52.072509 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bf91cce6-bfb9-42b4-bf57-ff7032f78fff tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 0.726262 Oct 12 22:06:52.113465 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1057/1990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:51 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:52.137848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7e28d437-7e60-45a3-b5cf-cae676c3e9c7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:52.140264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7e28d437-7e60-45a3-b5cf-cae676c3e9c7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:52.165586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e28d437-7e60-45a3-b5cf-cae676c3e9c7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:52.166094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e28d437-7e60-45a3-b5cf-cae676c3e9c7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:52.166535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e28d437-7e60-45a3-b5cf-cae676c3e9c7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:52.175286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e28d437-7e60-45a3-b5cf-cae676c3e9c7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:52.178846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e28d437-7e60-45a3-b5cf-cae676c3e9c7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:52.180577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e28d437-7e60-45a3-b5cf-cae676c3e9c7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:52.296657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7cbff0bd-1b16-4aab-8037-f9e867074113 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:52.360541 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7cbff0bd-1b16-4aab-8037-f9e867074113 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1504 microversion: 2.1 time: 2.415024 Oct 12 22:06:52.366498 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 934/1991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:49 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1504 bytes in 2427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:52.392816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c5adf5ab-05b2-40f5-a04f-4fbae88fa254 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:52.394580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c5adf5ab-05b2-40f5-a04f-4fbae88fa254 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:52.433367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5adf5ab-05b2-40f5-a04f-4fbae88fa254 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:52.436749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5adf5ab-05b2-40f5-a04f-4fbae88fa254 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:52.438848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5adf5ab-05b2-40f5-a04f-4fbae88fa254 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:52.443149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5adf5ab-05b2-40f5-a04f-4fbae88fa254 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:52.447832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5adf5ab-05b2-40f5-a04f-4fbae88fa254 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:52.449361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5adf5ab-05b2-40f5-a04f-4fbae88fa254 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:52.944107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c5adf5ab-05b2-40f5-a04f-4fbae88fa254 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:52.956256 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c5adf5ab-05b2-40f5-a04f-4fbae88fa254 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5" status: 200 len: 1278 microversion: 2.1 time: 0.583732 Oct 12 22:06:52.983538 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 935/1992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:52 2022] GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5 => generated 1278 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:53.002250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6af582c0-2536-4640-90b0-7ae292f92c71 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:53.011096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6af582c0-2536-4640-90b0-7ae292f92c71 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:53.026847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7e28d437-7e60-45a3-b5cf-cae676c3e9c7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:53.032553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6af582c0-2536-4640-90b0-7ae292f92c71 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:53.033629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6af582c0-2536-4640-90b0-7ae292f92c71 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:53.039287 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7e28d437-7e60-45a3-b5cf-cae676c3e9c7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1476 microversion: 2.1 time: 0.920449 Oct 12 22:06:53.042557 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1058/1993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:52 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1476 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:53.051976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6af582c0-2536-4640-90b0-7ae292f92c71 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:53.052879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6af582c0-2536-4640-90b0-7ae292f92c71 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:53.053390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6af582c0-2536-4640-90b0-7ae292f92c71 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:53.053849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6af582c0-2536-4640-90b0-7ae292f92c71 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:53.056631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-34e609cc-2b59-4581-a4bc-26680b37deab tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f5128209dc0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:53.219647 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-34e609cc-2b59-4581-a4bc-26680b37deab tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df" status: 200 len: 1427 microversion: 2.1 time: 0.173134 Oct 12 22:06:53.222735 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1059/1994] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:53 2022] GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df => generated 1427 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:53.239646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9766d758-523a-450b-86bc-62b96b67be6a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:53.240733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9766d758-523a-450b-86bc-62b96b67be6a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:53.284866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9766d758-523a-450b-86bc-62b96b67be6a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:53.285890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9766d758-523a-450b-86bc-62b96b67be6a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:53.286576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9766d758-523a-450b-86bc-62b96b67be6a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:53.288125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9766d758-523a-450b-86bc-62b96b67be6a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:53.290837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9766d758-523a-450b-86bc-62b96b67be6a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:53.292994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9766d758-523a-450b-86bc-62b96b67be6a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:53.889640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6af582c0-2536-4640-90b0-7ae292f92c71 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:53.921934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6af582c0-2536-4640-90b0-7ae292f92c71 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:53.929011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6af582c0-2536-4640-90b0-7ae292f92c71 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:53.934225 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6af582c0-2536-4640-90b0-7ae292f92c71 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1281 microversion: 2.25 time: 0.949242 Oct 12 22:06:53.940888 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 936/1995] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:52 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1281 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:53.950676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-553d9589-648b-431c-823c-315c8c92b521 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:53.951875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-553d9589-648b-431c-823c-315c8c92b521 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:53.968151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-553d9589-648b-431c-823c-315c8c92b521 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:53.969173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-553d9589-648b-431c-823c-315c8c92b521 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:53.969883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-553d9589-648b-431c-823c-315c8c92b521 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:53.990341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-553d9589-648b-431c-823c-315c8c92b521 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:54.000733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-553d9589-648b-431c-823c-315c8c92b521 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:54.008369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-553d9589-648b-431c-823c-315c8c92b521 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:54.926383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:55.101720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-553d9589-648b-431c-823c-315c8c92b521 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:55.110749 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-553d9589-648b-431c-823c-315c8c92b521 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1486 microversion: 2.1 time: 1.168342 Oct 12 22:06:55.130971 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 937/1996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:53 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1486 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:55.159174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6ac4e118-141f-47af-a2b3-9233855b8e21 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:55.170423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6ac4e118-141f-47af-a2b3-9233855b8e21 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:55.219734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ac4e118-141f-47af-a2b3-9233855b8e21 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:55.221996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9766d758-523a-450b-86bc-62b96b67be6a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:55.223937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ac4e118-141f-47af-a2b3-9233855b8e21 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:55.227219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ac4e118-141f-47af-a2b3-9233855b8e21 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:55.228232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ac4e118-141f-47af-a2b3-9233855b8e21 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:55.234012 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9766d758-523a-450b-86bc-62b96b67be6a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 2.008113 Oct 12 22:06:55.234604 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1060/1997] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:53 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:55.245033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ac4e118-141f-47af-a2b3-9233855b8e21 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:55.245546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ac4e118-141f-47af-a2b3-9233855b8e21 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:55.258787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-3af54a04-77b2-4e64-bed4-a5add01afc16 req-7c23672d-5750-4318-ac15-c6307f505b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98da0461-39ce-4bc1-9c42-66d635a94fcd", "name": "network-vif-unplugged", "status": "completed", "tag": "24945106-d2fe-4fa8-b8ef-52b83a547ea5"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:55.297991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3af54a04-77b2-4e64-bed4-a5add01afc16 req-7c23672d-5750-4318-ac15-c6307f505b2f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:55.299125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3af54a04-77b2-4e64-bed4-a5add01afc16 req-7c23672d-5750-4318-ac15-c6307f505b2f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:55.299592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3af54a04-77b2-4e64-bed4-a5add01afc16 req-7c23672d-5750-4318-ac15-c6307f505b2f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:55.349940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:55.360329 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6ac4e118-141f-47af-a2b3-9233855b8e21 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/ips" status: 200 len: 150 microversion: 2.1 time: 0.227915 Oct 12 22:06:55.363960 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 938/1998] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 22:06:55 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/ips => generated 150 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:55.367354 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-3af54a04-77b2-4e64-bed4-a5add01afc16 req-7c23672d-5750-4318-ac15-c6307f505b2f service nova] Creating event network-vif-unplugged:24945106-d2fe-4fa8-b8ef-52b83a547ea5 for instance 98da0461-39ce-4bc1-9c42-66d635a94fcd on n-h2-861111-1 Oct 12 22:06:55.374478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-330c8dfb-21e3-4cd7-8517-c7f98809f4d3 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:55.377532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-330c8dfb-21e3-4cd7-8517-c7f98809f4d3 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:55.390925 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-3af54a04-77b2-4e64-bed4-a5add01afc16 req-7c23672d-5750-4318-ac15-c6307f505b2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142349 Oct 12 22:06:55.396006 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1061/1999] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:55.404521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330c8dfb-21e3-4cd7-8517-c7f98809f4d3 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:55.405441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330c8dfb-21e3-4cd7-8517-c7f98809f4d3 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:55.406133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330c8dfb-21e3-4cd7-8517-c7f98809f4d3 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:55.411470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330c8dfb-21e3-4cd7-8517-c7f98809f4d3 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:55.412280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330c8dfb-21e3-4cd7-8517-c7f98809f4d3 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:55.412966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330c8dfb-21e3-4cd7-8517-c7f98809f4d3 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:55.419288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0a0ced31-13b7-478f-9a61-06471c31d26c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:55.420124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0a0ced31-13b7-478f-9a61-06471c31d26c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:55.450187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a0ced31-13b7-478f-9a61-06471c31d26c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:55.454984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a0ced31-13b7-478f-9a61-06471c31d26c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:55.457510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a0ced31-13b7-478f-9a61-06471c31d26c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:55.460215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a0ced31-13b7-478f-9a61-06471c31d26c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:55.466495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a0ced31-13b7-478f-9a61-06471c31d26c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:55.467076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a0ced31-13b7-478f-9a61-06471c31d26c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:55.503625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:55.741230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-330c8dfb-21e3-4cd7-8517-c7f98809f4d3 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:55.752593 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-330c8dfb-21e3-4cd7-8517-c7f98809f4d3 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5" status: 200 len: 1278 microversion: 2.1 time: 0.383680 Oct 12 22:06:55.759276 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 939/2000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:55 2022] GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5 => generated 1278 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:55.763285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-50036ba3-3250-4ee9-a856-2185afe817dd tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512382b430>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:55.918592 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-50036ba3-3250-4ee9-a856-2185afe817dd tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df" status: 200 len: 1427 microversion: 2.1 time: 0.154124 Oct 12 22:06:55.919672 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 940/2001] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:55 2022] GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df => generated 1427 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:55.924940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-4ed5553d-9da3-4d86-b469-d16f996d1bd6 req-01ffc530-9a50-49bc-9e43-58ff063ffc2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325466ea-d13d-4204-89f6-7c5deb99cd61", "name": "network-vif-plugged", "status": "completed", "tag": "e81cfc4b-c2b5-45e3-9fb2-a58a934b6b9b"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:55.971636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0a0ced31-13b7-478f-9a61-06471c31d26c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:55.984078 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0a0ced31-13b7-478f-9a61-06471c31d26c tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1476 microversion: 2.1 time: 0.584914 Oct 12 22:06:55.984835 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1062/2002] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:55 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1476 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:55.988088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4ed5553d-9da3-4d86-b469-d16f996d1bd6 req-01ffc530-9a50-49bc-9e43-58ff063ffc2f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:55.991839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4ed5553d-9da3-4d86-b469-d16f996d1bd6 req-01ffc530-9a50-49bc-9e43-58ff063ffc2f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:55.995868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4ed5553d-9da3-4d86-b469-d16f996d1bd6 req-01ffc530-9a50-49bc-9e43-58ff063ffc2f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:56.003425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3d6857ab-582a-43af-a459-b412de5d44c9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:56.005582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3d6857ab-582a-43af-a459-b412de5d44c9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:56.029907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d6857ab-582a-43af-a459-b412de5d44c9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:56.037126 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-4ed5553d-9da3-4d86-b469-d16f996d1bd6 req-01ffc530-9a50-49bc-9e43-58ff063ffc2f service nova] Creating event network-vif-plugged:e81cfc4b-c2b5-45e3-9fb2-a58a934b6b9b for instance 325466ea-d13d-4204-89f6-7c5deb99cd61 on n-h2-861111-1 Oct 12 22:06:56.038122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d6857ab-582a-43af-a459-b412de5d44c9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:56.039073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d6857ab-582a-43af-a459-b412de5d44c9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:56.040044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d6857ab-582a-43af-a459-b412de5d44c9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:56.041583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d6857ab-582a-43af-a459-b412de5d44c9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:56.043914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d6857ab-582a-43af-a459-b412de5d44c9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:56.054736 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-4ed5553d-9da3-4d86-b469-d16f996d1bd6 req-01ffc530-9a50-49bc-9e43-58ff063ffc2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133054 Oct 12 22:06:56.055822 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 941/2003] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:56.080447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4c126341-ba01-40d1-a240-4f221cfb353a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:56.081363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4c126341-ba01-40d1-a240-4f221cfb353a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:56.108979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c126341-ba01-40d1-a240-4f221cfb353a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:56.110533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c126341-ba01-40d1-a240-4f221cfb353a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:56.111891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c126341-ba01-40d1-a240-4f221cfb353a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:56.112883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c126341-ba01-40d1-a240-4f221cfb353a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:56.113381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c126341-ba01-40d1-a240-4f221cfb353a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:56.113719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c126341-ba01-40d1-a240-4f221cfb353a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:56.213756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4c126341-ba01-40d1-a240-4f221cfb353a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:06:56.490518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3d6857ab-582a-43af-a459-b412de5d44c9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:56.510291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3d6857ab-582a-43af-a459-b412de5d44c9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:56.523842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3d6857ab-582a-43af-a459-b412de5d44c9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:56.526747 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3d6857ab-582a-43af-a459-b412de5d44c9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1281 microversion: 2.25 time: 0.540499 Oct 12 22:06:56.529993 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1063/2004] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:55 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1281 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:56.537159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c0bf8d11-473b-4686-9cec-8db95dd09097 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:56.538256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c0bf8d11-473b-4686-9cec-8db95dd09097 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:56.555872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0bf8d11-473b-4686-9cec-8db95dd09097 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:56.557286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0bf8d11-473b-4686-9cec-8db95dd09097 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:56.558428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0bf8d11-473b-4686-9cec-8db95dd09097 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:56.559751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0bf8d11-473b-4686-9cec-8db95dd09097 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:56.560638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0bf8d11-473b-4686-9cec-8db95dd09097 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:56.561380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0bf8d11-473b-4686-9cec-8db95dd09097 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:56.570110 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4c126341-ba01-40d1-a240-4f221cfb353a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 204 len: 0 microversion: 2.1 time: 0.512445 Oct 12 22:06:56.571535 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 942/2005] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:06:56 2022] DELETE /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:06:56.590751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a3f9831d-da10-4482-88e8-3937a60de954 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f5123836160>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:56.677321 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-a3f9831d-da10-4482-88e8-3937a60de954 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Image not found. Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a3f9831d-da10-4482-88e8-3937a60de954 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/images/dc9008d5-a96d-413d-acc8-034c1cf72a5b HTTP/1.1 Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:06:56.681401 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:06:56.683149 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:06:56.683149 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:06:56.683149 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:06:56.683149 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:06:56.683149 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:06:56.683149 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:06:56.683149 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:06:56.683149 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:06:56.683149 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:06:56.683149 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:06:56.683149 n-d-861111-1 devstack@n-api.service[120452]: exception: Image not found. Oct 12 22:06:56.683149 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'dc9008d5-a96d-413d-acc8-034c1cf72a5b'} Oct 12 22:06:56.683149 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:06:56.683149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image dc9008d5-a96d-413d-acc8-034c1cf72a5b to delete Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:56.685022 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dc9008d5-a96d-413d-acc8-034c1cf72a5b could not be found. Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:06:56.687590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:06:56.690023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:06:56.690023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:06:56.690023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:56.690023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:06:56.690023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:56.690023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:06:56.690023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:06:56.690023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:06:56.690023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:06:56.690023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:06:56.690023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:06:56.690023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:06:56.694173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a3f9831d-da10-4482-88e8-3937a60de954 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Image not found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:06:56.699949 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a3f9831d-da10-4482-88e8-3937a60de954 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/images/dc9008d5-a96d-413d-acc8-034c1cf72a5b" status: 404 len: 62 microversion: 2.1 time: 0.117228 Oct 12 22:06:56.701246 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 943/2006] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:56 2022] DELETE /compute/v2.1/images/dc9008d5-a96d-413d-acc8-034c1cf72a5b => generated 62 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:06:56.797009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4c2fea81-37cb-48cf-b5a4-49d33dd6664a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:56.798077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4c2fea81-37cb-48cf-b5a4-49d33dd6664a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:56.818409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:56.823540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c2fea81-37cb-48cf-b5a4-49d33dd6664a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:56.827681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c2fea81-37cb-48cf-b5a4-49d33dd6664a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:56.828708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c2fea81-37cb-48cf-b5a4-49d33dd6664a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:56.831206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c2fea81-37cb-48cf-b5a4-49d33dd6664a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:56.833266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c2fea81-37cb-48cf-b5a4-49d33dd6664a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:56.834329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c2fea81-37cb-48cf-b5a4-49d33dd6664a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:56.931535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4c2fea81-37cb-48cf-b5a4-49d33dd6664a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:06:57.069227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:06:57.110508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c0bf8d11-473b-4686-9cec-8db95dd09097 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:57.122818 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c0bf8d11-473b-4686-9cec-8db95dd09097 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 0.591402 Oct 12 22:06:57.139289 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1064/2007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:56 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:57.152754 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.compute.api [None req-4c2fea81-37cb-48cf-b5a4-49d33dd6664a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Instance is already in deleting state, ignoring this request Oct 12 22:06:57.152754 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4c2fea81-37cb-48cf-b5a4-49d33dd6664a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 204 len: 0 microversion: 2.1 time: 0.446967 Oct 12 22:06:57.162456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-83a63499-46a5-4ec6-a25b-eed22e991c9b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:57.162746 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 944/2008] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:06:56 2022] DELETE /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:06:57.170798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-83a63499-46a5-4ec6-a25b-eed22e991c9b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:57.183080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0aae6f43-79e0-4054-b22c-d8ca24c69dc7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f51237e1700>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:57.194946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83a63499-46a5-4ec6-a25b-eed22e991c9b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:57.202381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83a63499-46a5-4ec6-a25b-eed22e991c9b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:57.203042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83a63499-46a5-4ec6-a25b-eed22e991c9b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:57.206603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83a63499-46a5-4ec6-a25b-eed22e991c9b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:57.207593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83a63499-46a5-4ec6-a25b-eed22e991c9b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:57.208797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83a63499-46a5-4ec6-a25b-eed22e991c9b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:57.533574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-83a63499-46a5-4ec6-a25b-eed22e991c9b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:57.545039 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-83a63499-46a5-4ec6-a25b-eed22e991c9b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5" status: 200 len: 1320 microversion: 2.1 time: 0.405263 Oct 12 22:06:57.560125 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1065/2009] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:57 2022] GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5 => generated 1320 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:57.571097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e815caae-f3e0-4661-9960-ed90557cff52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:57.572101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e815caae-f3e0-4661-9960-ed90557cff52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:57.581067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e815caae-f3e0-4661-9960-ed90557cff52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:57.582832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e815caae-f3e0-4661-9960-ed90557cff52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:57.583531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e815caae-f3e0-4661-9960-ed90557cff52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:57.584763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e815caae-f3e0-4661-9960-ed90557cff52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:57.585739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e815caae-f3e0-4661-9960-ed90557cff52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:57.586367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e815caae-f3e0-4661-9960-ed90557cff52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:57.868658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e815caae-f3e0-4661-9960-ed90557cff52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:57.884559 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e815caae-f3e0-4661-9960-ed90557cff52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1476 microversion: 2.1 time: 0.322586 Oct 12 22:06:57.885408 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1066/2010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:57 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1476 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:57.903161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f16b0b14-f47c-4518-9b40-8c2cc9dbac7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:57.903821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f16b0b14-f47c-4518-9b40-8c2cc9dbac7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:57.918188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f16b0b14-f47c-4518-9b40-8c2cc9dbac7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:57.918819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f16b0b14-f47c-4518-9b40-8c2cc9dbac7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:57.919278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f16b0b14-f47c-4518-9b40-8c2cc9dbac7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:57.920004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f16b0b14-f47c-4518-9b40-8c2cc9dbac7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:57.920457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f16b0b14-f47c-4518-9b40-8c2cc9dbac7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:57.920887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f16b0b14-f47c-4518-9b40-8c2cc9dbac7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:58.268557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f16b0b14-f47c-4518-9b40-8c2cc9dbac7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:58.285652 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f16b0b14-f47c-4518-9b40-8c2cc9dbac7e tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1492 microversion: 2.1 time: 0.387469 Oct 12 22:06:58.291524 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1067/2011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:57 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1492 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:58.301821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-38e7529a-d250-405e-9e5b-73fd542fa595 req-65672040-aa50-40d8-84b2-5efe854b8f4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ad6eb67-f30e-4da4-8c4d-5b69d7f54d3d", "tag": "304ce487-f459-4010-9f68-e18af787eb41"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:58.325363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-38e7529a-d250-405e-9e5b-73fd542fa595 req-65672040-aa50-40d8-84b2-5efe854b8f4e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:58.325906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-38e7529a-d250-405e-9e5b-73fd542fa595 req-65672040-aa50-40d8-84b2-5efe854b8f4e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:58.326379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-38e7529a-d250-405e-9e5b-73fd542fa595 req-65672040-aa50-40d8-84b2-5efe854b8f4e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:58.364568 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-38e7529a-d250-405e-9e5b-73fd542fa595 req-65672040-aa50-40d8-84b2-5efe854b8f4e service nova] Creating event network-changed:304ce487-f459-4010-9f68-e18af787eb41 for instance 7ad6eb67-f30e-4da4-8c4d-5b69d7f54d3d on n-h1-861111-1 Oct 12 22:06:58.371364 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-38e7529a-d250-405e-9e5b-73fd542fa595 req-65672040-aa50-40d8-84b2-5efe854b8f4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078044 Oct 12 22:06:58.372498 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1068/2012] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:58.379718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-863346bf-2cd8-4438-a91e-f987866a4b26 req-e80dc70f-e877-42f1-aefa-28ace83c19e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98da0461-39ce-4bc1-9c42-66d635a94fcd", "tag": "24945106-d2fe-4fa8-b8ef-52b83a547ea5"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:58.394944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-863346bf-2cd8-4438-a91e-f987866a4b26 req-e80dc70f-e877-42f1-aefa-28ace83c19e8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:58.395963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-863346bf-2cd8-4438-a91e-f987866a4b26 req-e80dc70f-e877-42f1-aefa-28ace83c19e8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:58.396923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-863346bf-2cd8-4438-a91e-f987866a4b26 req-e80dc70f-e877-42f1-aefa-28ace83c19e8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:58.421529 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-863346bf-2cd8-4438-a91e-f987866a4b26 req-e80dc70f-e877-42f1-aefa-28ace83c19e8 service nova] Creating event network-changed:24945106-d2fe-4fa8-b8ef-52b83a547ea5 for instance 98da0461-39ce-4bc1-9c42-66d635a94fcd on n-h2-861111-1 Oct 12 22:06:58.427832 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-863346bf-2cd8-4438-a91e-f987866a4b26 req-e80dc70f-e877-42f1-aefa-28ace83c19e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053504 Oct 12 22:06:58.428912 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1069/2013] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:06:58.453808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-16ab1674-3dd9-4091-bff9-ee9ae51d861e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:58.457962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-16ab1674-3dd9-4091-bff9-ee9ae51d861e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:58.468186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16ab1674-3dd9-4091-bff9-ee9ae51d861e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:58.469077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16ab1674-3dd9-4091-bff9-ee9ae51d861e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:58.472056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16ab1674-3dd9-4091-bff9-ee9ae51d861e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:58.473375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16ab1674-3dd9-4091-bff9-ee9ae51d861e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:58.474198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16ab1674-3dd9-4091-bff9-ee9ae51d861e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:58.474860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16ab1674-3dd9-4091-bff9-ee9ae51d861e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:59.149399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-16ab1674-3dd9-4091-bff9-ee9ae51d861e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:59.170091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-16ab1674-3dd9-4091-bff9-ee9ae51d861e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:59.175276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-16ab1674-3dd9-4091-bff9-ee9ae51d861e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:59.177040 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-16ab1674-3dd9-4091-bff9-ee9ae51d861e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1281 microversion: 2.25 time: 0.737394 Oct 12 22:06:59.178431 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1070/2014] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:06:58 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1281 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:06:59.183912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5f909384-699d-4668-9927-cbcfed15988f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:06:59.184978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5f909384-699d-4668-9927-cbcfed15988f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:06:59.194674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f909384-699d-4668-9927-cbcfed15988f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:59.195728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f909384-699d-4668-9927-cbcfed15988f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:59.196443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f909384-699d-4668-9927-cbcfed15988f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:59.197603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f909384-699d-4668-9927-cbcfed15988f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:59.198853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f909384-699d-4668-9927-cbcfed15988f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:59.200335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f909384-699d-4668-9927-cbcfed15988f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:06:59.926037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5f909384-699d-4668-9927-cbcfed15988f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:06:59.936438 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5f909384-699d-4668-9927-cbcfed15988f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 0.756382 Oct 12 22:06:59.947262 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1071/2015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:06:59 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:06:59.959843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-2f08bb19-37ce-4274-9c15-d1da7ebf29b2 req-69d1a912-7daa-4c5e-8d27-230879318228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0bc29c-b01a-4913-b58d-0f0368eeaa52", "name": "network-vif-plugged", "status": "completed", "tag": "8f924ca4-6121-4359-b81c-8b01b45de897"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:06:59.988139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2f08bb19-37ce-4274-9c15-d1da7ebf29b2 req-69d1a912-7daa-4c5e-8d27-230879318228 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:06:59.988646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2f08bb19-37ce-4274-9c15-d1da7ebf29b2 req-69d1a912-7daa-4c5e-8d27-230879318228 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:06:59.989093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2f08bb19-37ce-4274-9c15-d1da7ebf29b2 req-69d1a912-7daa-4c5e-8d27-230879318228 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:00.018564 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-2f08bb19-37ce-4274-9c15-d1da7ebf29b2 req-69d1a912-7daa-4c5e-8d27-230879318228 service nova] Creating event network-vif-plugged:8f924ca4-6121-4359-b81c-8b01b45de897 for instance 0a0bc29c-b01a-4913-b58d-0f0368eeaa52 on n-h1-861111-1 Oct 12 22:07:00.028007 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-2f08bb19-37ce-4274-9c15-d1da7ebf29b2 req-69d1a912-7daa-4c5e-8d27-230879318228 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089379 Oct 12 22:07:00.028864 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1072/2016] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:00.045384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d38b4280-0fc0-4c88-a1a5-05244d721083 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f8206e7-dd62-47f9-87fc-d9656a73db92"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:00.051476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d38b4280-0fc0-4c88-a1a5-05244d721083 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:00.079787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d38b4280-0fc0-4c88-a1a5-05244d721083 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:00.080346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d38b4280-0fc0-4c88-a1a5-05244d721083 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:00.080804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d38b4280-0fc0-4c88-a1a5-05244d721083 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:00.081561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d38b4280-0fc0-4c88-a1a5-05244d721083 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:00.082019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d38b4280-0fc0-4c88-a1a5-05244d721083 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:00.082451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d38b4280-0fc0-4c88-a1a5-05244d721083 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:00.693273 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d38b4280-0fc0-4c88-a1a5-05244d721083 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "POST /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.659214 Oct 12 22:07:00.707443 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1073/2017] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 22:07:00 2022] POST /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments => generated 194 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:00.741507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3dc5b756-45b9-4657-a843-c5e204d08487 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:00.743879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3dc5b756-45b9-4657-a843-c5e204d08487 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:00.793960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3dc5b756-45b9-4657-a843-c5e204d08487 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:00.794476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3dc5b756-45b9-4657-a843-c5e204d08487 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:00.794928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3dc5b756-45b9-4657-a843-c5e204d08487 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:00.796151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3dc5b756-45b9-4657-a843-c5e204d08487 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:00.796151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3dc5b756-45b9-4657-a843-c5e204d08487 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:00.818290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3dc5b756-45b9-4657-a843-c5e204d08487 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:00.875906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:01.319063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3dc5b756-45b9-4657-a843-c5e204d08487 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:01.342752 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3dc5b756-45b9-4657-a843-c5e204d08487 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5" status: 200 len: 1320 microversion: 2.1 time: 0.627862 Oct 12 22:07:01.343881 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1074/2018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:00 2022] GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5 => generated 1320 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:01.363784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f39109cd-981a-4c69-b4a3-c1be2bdbb82d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:01.370416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f39109cd-981a-4c69-b4a3-c1be2bdbb82d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:01.400055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f39109cd-981a-4c69-b4a3-c1be2bdbb82d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:01.400927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f39109cd-981a-4c69-b4a3-c1be2bdbb82d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:01.408821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f39109cd-981a-4c69-b4a3-c1be2bdbb82d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:01.410206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f39109cd-981a-4c69-b4a3-c1be2bdbb82d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:01.410936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f39109cd-981a-4c69-b4a3-c1be2bdbb82d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:01.411624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f39109cd-981a-4c69-b4a3-c1be2bdbb82d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:01.801902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f39109cd-981a-4c69-b4a3-c1be2bdbb82d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:01.828697 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f39109cd-981a-4c69-b4a3-c1be2bdbb82d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1476 microversion: 2.1 time: 0.475881 Oct 12 22:07:01.835336 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1075/2019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:01 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1476 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:01.840830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-08734c51-fabc-4a97-8d3c-188560791c88 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:01.843900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-08734c51-fabc-4a97-8d3c-188560791c88 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:01.864274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08734c51-fabc-4a97-8d3c-188560791c88 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:01.872565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08734c51-fabc-4a97-8d3c-188560791c88 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:01.873493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08734c51-fabc-4a97-8d3c-188560791c88 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:01.877989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08734c51-fabc-4a97-8d3c-188560791c88 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:01.878673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08734c51-fabc-4a97-8d3c-188560791c88 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:01.879247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08734c51-fabc-4a97-8d3c-188560791c88 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:02.004677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08734c51-fabc-4a97-8d3c-188560791c88 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:02.006687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08734c51-fabc-4a97-8d3c-188560791c88 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:02.007173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08734c51-fabc-4a97-8d3c-188560791c88 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:02.012371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-08734c51-fabc-4a97-8d3c-188560791c88 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lazy-loading 'fault' on Instance uuid 556ed054-4ef4-4561-9b46-8380cf091bb2 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:07:02.114815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-08734c51-fabc-4a97-8d3c-188560791c88 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224dcaeabdd4199b9682e99912f7740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0905a1286e134e34a55ceaaa6c23718e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:02.138359 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-08734c51-fabc-4a97-8d3c-188560791c88 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 200 len: 1297 microversion: 2.1 time: 0.298475 Oct 12 22:07:02.149241 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1076/2020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:01 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 1297 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:02.153491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0929a9d9-501e-42a5-92cc-e75879f9c81d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:02.155860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0929a9d9-501e-42a5-92cc-e75879f9c81d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:02.181481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0929a9d9-501e-42a5-92cc-e75879f9c81d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:02.183468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0929a9d9-501e-42a5-92cc-e75879f9c81d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:02.183905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0929a9d9-501e-42a5-92cc-e75879f9c81d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:02.193101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0929a9d9-501e-42a5-92cc-e75879f9c81d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:02.195460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0929a9d9-501e-42a5-92cc-e75879f9c81d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:02.196643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0929a9d9-501e-42a5-92cc-e75879f9c81d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:02.682068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0929a9d9-501e-42a5-92cc-e75879f9c81d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:02.700692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0929a9d9-501e-42a5-92cc-e75879f9c81d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:02.705941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0929a9d9-501e-42a5-92cc-e75879f9c81d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:02.725029 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0929a9d9-501e-42a5-92cc-e75879f9c81d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1476 microversion: 2.25 time: 0.577113 Oct 12 22:07:02.727120 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1077/2021] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:02 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1476 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:02.744141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f1813632-795e-4808-8771-4e7ee10d1b00 req-cc269777-5b1c-4027-b048-84ced9d783c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "556ed054-4ef4-4561-9b46-8380cf091bb2", "name": "network-vif-deleted", "tag": "815d5143-86f7-421c-bd6d-f4db0bad30f2"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:02.807682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f1813632-795e-4808-8771-4e7ee10d1b00 req-cc269777-5b1c-4027-b048-84ced9d783c8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:02.808337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f1813632-795e-4808-8771-4e7ee10d1b00 req-cc269777-5b1c-4027-b048-84ced9d783c8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:02.808632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f1813632-795e-4808-8771-4e7ee10d1b00 req-cc269777-5b1c-4027-b048-84ced9d783c8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:02.843764 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f1813632-795e-4808-8771-4e7ee10d1b00 req-cc269777-5b1c-4027-b048-84ced9d783c8 service nova] Creating event network-vif-deleted:815d5143-86f7-421c-bd6d-f4db0bad30f2 for instance 556ed054-4ef4-4561-9b46-8380cf091bb2 on n-h1-861111-1 Oct 12 22:07:02.855458 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f1813632-795e-4808-8771-4e7ee10d1b00 req-cc269777-5b1c-4027-b048-84ced9d783c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124029 Oct 12 22:07:02.856375 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1078/2022] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:02.867890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8ee4ca25-fef5-4875-b59e-437db4499a6b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:02.870242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8ee4ca25-fef5-4875-b59e-437db4499a6b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:02.885362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee4ca25-fef5-4875-b59e-437db4499a6b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:02.885839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee4ca25-fef5-4875-b59e-437db4499a6b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:02.886383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee4ca25-fef5-4875-b59e-437db4499a6b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:02.887134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee4ca25-fef5-4875-b59e-437db4499a6b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:02.887617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee4ca25-fef5-4875-b59e-437db4499a6b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:02.888235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee4ca25-fef5-4875-b59e-437db4499a6b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:03.323922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8ee4ca25-fef5-4875-b59e-437db4499a6b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:03.344080 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8ee4ca25-fef5-4875-b59e-437db4499a6b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 0.478027 Oct 12 22:07:03.349308 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1079/2023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:02 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:03.364574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-50931310-d608-4e26-b5bc-766a8c50524b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:03.368764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-50931310-d608-4e26-b5bc-766a8c50524b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:03.391788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50931310-d608-4e26-b5bc-766a8c50524b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:03.392721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50931310-d608-4e26-b5bc-766a8c50524b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:03.393415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50931310-d608-4e26-b5bc-766a8c50524b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:03.394453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50931310-d608-4e26-b5bc-766a8c50524b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:03.395012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50931310-d608-4e26-b5bc-766a8c50524b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:03.395690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50931310-d608-4e26-b5bc-766a8c50524b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:03.619296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-50931310-d608-4e26-b5bc-766a8c50524b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:03.632388 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-50931310-d608-4e26-b5bc-766a8c50524b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5" status: 200 len: 1320 microversion: 2.1 time: 0.281541 Oct 12 22:07:03.633915 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1080/2024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:03 2022] GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5 => generated 1320 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:03.639396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-4757af86-f778-4a9f-bf59-152f73c2968d req-af1036f3-eda3-4ff8-83d8-7318efc662d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041bb415-1452-4d7f-9a45-5c8592816cf5", "tag": "4938ca12-9234-4ba1-9d52-dc286559ab04"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:03.652269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4757af86-f778-4a9f-bf59-152f73c2968d req-af1036f3-eda3-4ff8-83d8-7318efc662d0 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:03.653621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4757af86-f778-4a9f-bf59-152f73c2968d req-af1036f3-eda3-4ff8-83d8-7318efc662d0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:03.654243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4757af86-f778-4a9f-bf59-152f73c2968d req-af1036f3-eda3-4ff8-83d8-7318efc662d0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:03.670185 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-4757af86-f778-4a9f-bf59-152f73c2968d req-af1036f3-eda3-4ff8-83d8-7318efc662d0 service nova] Creating event network-changed:4938ca12-9234-4ba1-9d52-dc286559ab04 for instance 041bb415-1452-4d7f-9a45-5c8592816cf5 on n-h1-861111-1 Oct 12 22:07:03.677320 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-4757af86-f778-4a9f-bf59-152f73c2968d req-af1036f3-eda3-4ff8-83d8-7318efc662d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041508 Oct 12 22:07:03.683384 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1081/2025] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:04.065667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-80392526-f22e-4384-b634-7aeceff0237d tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:04.066559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-80392526-f22e-4384-b634-7aeceff0237d tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:04.074956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80392526-f22e-4384-b634-7aeceff0237d tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:04.078562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80392526-f22e-4384-b634-7aeceff0237d tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:04.079183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80392526-f22e-4384-b634-7aeceff0237d tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:04.088395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80392526-f22e-4384-b634-7aeceff0237d tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:04.090368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80392526-f22e-4384-b634-7aeceff0237d tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:04.090368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80392526-f22e-4384-b634-7aeceff0237d tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:04.795126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-80392526-f22e-4384-b634-7aeceff0237d tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'services' on Instance uuid 325466ea-d13d-4204-89f6-7c5deb99cd61 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:07:04.869452 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-80392526-f22e-4384-b634-7aeceff0237d tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1969 microversion: 2.25 time: 1.183325 Oct 12 22:07:04.881384 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1082/2026] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:03 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1969 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:04.896191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-be537a80-f38c-438e-97ef-d6db4b5eed3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:04.896842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-be537a80-f38c-438e-97ef-d6db4b5eed3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:04.943164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be537a80-f38c-438e-97ef-d6db4b5eed3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:04.947952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be537a80-f38c-438e-97ef-d6db4b5eed3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:04.948425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be537a80-f38c-438e-97ef-d6db4b5eed3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:04.949182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be537a80-f38c-438e-97ef-d6db4b5eed3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:04.949642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be537a80-f38c-438e-97ef-d6db4b5eed3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:04.950081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be537a80-f38c-438e-97ef-d6db4b5eed3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:05.474022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-be537a80-f38c-438e-97ef-d6db4b5eed3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:05.489778 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-be537a80-f38c-438e-97ef-d6db4b5eed3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1476 microversion: 2.1 time: 0.611466 Oct 12 22:07:05.491133 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1083/2027] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:04 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1476 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:05.520888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-158cfc0f-3a4c-4380-a146-af1e23e757a6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:05.523005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-158cfc0f-3a4c-4380-a146-af1e23e757a6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 556ed054-4ef4-4561-9b46-8380cf091bb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:05.548660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-158cfc0f-3a4c-4380-a146-af1e23e757a6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:05.552543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-158cfc0f-3a4c-4380-a146-af1e23e757a6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:05.553332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-158cfc0f-3a4c-4380-a146-af1e23e757a6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:05.556783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-158cfc0f-3a4c-4380-a146-af1e23e757a6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:05.557481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-158cfc0f-3a4c-4380-a146-af1e23e757a6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:05.559701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-158cfc0f-3a4c-4380-a146-af1e23e757a6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:05.619190 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-158cfc0f-3a4c-4380-a146-af1e23e757a6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Instance 556ed054-4ef4-4561-9b46-8380cf091bb2 could not be found. Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-158cfc0f-3a4c-4380-a146-af1e23e757a6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 HTTP/1.1 Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:07:05.623788 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:07:05.627230 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:05.627230 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:07:05.627230 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:05.627230 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:05.627230 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:05.627230 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:07:05.627230 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:07:05.627230 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:07:05.627230 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:05.627230 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:07:05.627230 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 556ed054-4ef4-4561-9b46-8380cf091bb2 could not be found. Oct 12 22:07:05.627230 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '556ed054-4ef4-4561-9b46-8380cf091bb2'} Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556ed054-4ef4-4561-9b46-8380cf091bb2 could not be found. Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:05.628540 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556ed054-4ef4-4561-9b46-8380cf091bb2 could not be found. Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556ed054-4ef4-4561-9b46-8380cf091bb2 could not be found. Oct 12 22:07:05.631651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:05.636817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-158cfc0f-3a4c-4380-a146-af1e23e757a6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Instance 556ed054-4ef4-4561-9b46-8380cf091bb2 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:05.639268 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-158cfc0f-3a4c-4380-a146-af1e23e757a6 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2" status: 404 len: 111 microversion: 2.1 time: 0.145808 Oct 12 22:07:05.647386 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1084/2028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:05 2022] GET /compute/v2.1/servers/556ed054-4ef4-4561-9b46-8380cf091bb2 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:07:05.656232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e9dd3f5d-dcf2-4525-bac9-df4cbf647b44 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:05.658789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e9dd3f5d-dcf2-4525-bac9-df4cbf647b44 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:05.663093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:05.711536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9dd3f5d-dcf2-4525-bac9-df4cbf647b44 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:05.720526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9dd3f5d-dcf2-4525-bac9-df4cbf647b44 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:05.722301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9dd3f5d-dcf2-4525-bac9-df4cbf647b44 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:05.725527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9dd3f5d-dcf2-4525-bac9-df4cbf647b44 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:05.728633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9dd3f5d-dcf2-4525-bac9-df4cbf647b44 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:05.731866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9dd3f5d-dcf2-4525-bac9-df4cbf647b44 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:06.008102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e9dd3f5d-dcf2-4525-bac9-df4cbf647b44 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:06.025178 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e9dd3f5d-dcf2-4525-bac9-df4cbf647b44 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 0.374169 Oct 12 22:07:06.026387 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1085/2029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:05 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:06.038544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-39eb726b-5860-4298-b240-85342f95a769 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:06.040949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-39eb726b-5860-4298-b240-85342f95a769 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:06.051871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39eb726b-5860-4298-b240-85342f95a769 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:06.052642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39eb726b-5860-4298-b240-85342f95a769 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:06.053473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39eb726b-5860-4298-b240-85342f95a769 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:06.054977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39eb726b-5860-4298-b240-85342f95a769 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:06.055727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39eb726b-5860-4298-b240-85342f95a769 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:06.056331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39eb726b-5860-4298-b240-85342f95a769 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:06.489575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-39eb726b-5860-4298-b240-85342f95a769 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:06.498447 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-39eb726b-5860-4298-b240-85342f95a769 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5" status: 200 len: 1320 microversion: 2.1 time: 0.470037 Oct 12 22:07:06.499045 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1086/2030] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:06 2022] GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5 => generated 1320 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:06.544871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-84ce0bcd-7356-49b9-8e76-5bc2f4738bd3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:06.547961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-84ce0bcd-7356-49b9-8e76-5bc2f4738bd3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:06.580424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84ce0bcd-7356-49b9-8e76-5bc2f4738bd3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:06.581189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84ce0bcd-7356-49b9-8e76-5bc2f4738bd3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:06.581821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84ce0bcd-7356-49b9-8e76-5bc2f4738bd3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:06.582949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84ce0bcd-7356-49b9-8e76-5bc2f4738bd3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:06.584661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84ce0bcd-7356-49b9-8e76-5bc2f4738bd3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:06.585313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84ce0bcd-7356-49b9-8e76-5bc2f4738bd3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:06.820984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:06.873841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-84ce0bcd-7356-49b9-8e76-5bc2f4738bd3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'services' on Instance uuid 325466ea-d13d-4204-89f6-7c5deb99cd61 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:07:06.914604 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-84ce0bcd-7356-49b9-8e76-5bc2f4738bd3 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1969 microversion: 2.25 time: 0.385234 Oct 12 22:07:06.916158 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1087/2031] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:06 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1969 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:06.931384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-50c35532-a0aa-4a7c-a6c8-0785db47e35d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:06.932159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-50c35532-a0aa-4a7c-a6c8-0785db47e35d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:06.944372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50c35532-a0aa-4a7c-a6c8-0785db47e35d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:06.946336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50c35532-a0aa-4a7c-a6c8-0785db47e35d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:06.947129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50c35532-a0aa-4a7c-a6c8-0785db47e35d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:06.953137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50c35532-a0aa-4a7c-a6c8-0785db47e35d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:06.953832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50c35532-a0aa-4a7c-a6c8-0785db47e35d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:06.955123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50c35532-a0aa-4a7c-a6c8-0785db47e35d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:06.985061 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-50c35532-a0aa-4a7c-a6c8-0785db47e35d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-50c35532-a0aa-4a7c-a6c8-0785db47e35d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 HTTP/1.1 Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:07:06.989235 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:07:06.990969 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:06.990969 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:07:06.990969 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:06.990969 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:06.990969 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:06.990969 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:07:06.990969 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:07:06.990969 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:07:06.990969 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:06.990969 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:07:06.990969 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. Oct 12 22:07:06.990969 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '6ef20289-f683-41c1-8a71-b632098119c7'} Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:06.992098 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. Oct 12 22:07:06.993690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:06.998341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-50c35532-a0aa-4a7c-a6c8-0785db47e35d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:07.004448 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-50c35532-a0aa-4a7c-a6c8-0785db47e35d tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 404 len: 111 microversion: 2.1 time: 0.087170 Oct 12 22:07:07.005314 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1088/2032] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:07:06 2022] DELETE /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:07:07.010942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-2bbd02b1-c578-47e2-aa35-fd9db1436c6c req-53fe888b-a833-4779-8639-f3c7fe8cee43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad6eb67-f30e-4da4-8c4d-5b69d7f54d3d", "name": "network-vif-plugged", "status": "completed", "tag": "304ce487-f459-4010-9f68-e18af787eb41"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:07.038820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2bbd02b1-c578-47e2-aa35-fd9db1436c6c req-53fe888b-a833-4779-8639-f3c7fe8cee43 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:07.039761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2bbd02b1-c578-47e2-aa35-fd9db1436c6c req-53fe888b-a833-4779-8639-f3c7fe8cee43 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:07.042052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2bbd02b1-c578-47e2-aa35-fd9db1436c6c req-53fe888b-a833-4779-8639-f3c7fe8cee43 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:07.070664 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-2bbd02b1-c578-47e2-aa35-fd9db1436c6c req-53fe888b-a833-4779-8639-f3c7fe8cee43 service nova] Creating event network-vif-plugged:304ce487-f459-4010-9f68-e18af787eb41 for instance 7ad6eb67-f30e-4da4-8c4d-5b69d7f54d3d on n-h1-861111-1 Oct 12 22:07:07.081628 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-2bbd02b1-c578-47e2-aa35-fd9db1436c6c req-53fe888b-a833-4779-8639-f3c7fe8cee43 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074910 Oct 12 22:07:07.085915 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1089/2033] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:07.099767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6b3b4f0b-6b51-49ef-93a4-4955ca39caf1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:07.100485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6b3b4f0b-6b51-49ef-93a4-4955ca39caf1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:07.116513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b3b4f0b-6b51-49ef-93a4-4955ca39caf1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:07.117015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b3b4f0b-6b51-49ef-93a4-4955ca39caf1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:07.117470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b3b4f0b-6b51-49ef-93a4-4955ca39caf1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:07.118185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b3b4f0b-6b51-49ef-93a4-4955ca39caf1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:07.124895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b3b4f0b-6b51-49ef-93a4-4955ca39caf1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:07.125355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b3b4f0b-6b51-49ef-93a4-4955ca39caf1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:07.226197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:07.424686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6b3b4f0b-6b51-49ef-93a4-4955ca39caf1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:07.439407 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6b3b4f0b-6b51-49ef-93a4-4955ca39caf1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1475 microversion: 2.1 time: 0.349296 Oct 12 22:07:07.440370 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1090/2034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:07 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1475 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:07.445144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a6b2ef01-4611-4e2b-a4ed-c7ebe6a74110 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:07.448934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6b2ef01-4611-4e2b-a4ed-c7ebe6a74110 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:07.449484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6b2ef01-4611-4e2b-a4ed-c7ebe6a74110 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:07.449925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6b2ef01-4611-4e2b-a4ed-c7ebe6a74110 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:07.450811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6b2ef01-4611-4e2b-a4ed-c7ebe6a74110 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:07.451303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6b2ef01-4611-4e2b-a4ed-c7ebe6a74110 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:07.451717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6b2ef01-4611-4e2b-a4ed-c7ebe6a74110 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:07.484340 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a6b2ef01-4611-4e2b-a4ed-c7ebe6a74110 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.043075 Oct 12 22:07:07.485423 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1091/2035] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Oct 12 22:07:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:07:07.490223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-142deca7-8417-4a55-8df0-f20a8f7f4bdf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:07.490979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-142deca7-8417-4a55-8df0-f20a8f7f4bdf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 6ef20289-f683-41c1-8a71-b632098119c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:07.498846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-142deca7-8417-4a55-8df0-f20a8f7f4bdf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:07.499742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-142deca7-8417-4a55-8df0-f20a8f7f4bdf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:07.502311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-142deca7-8417-4a55-8df0-f20a8f7f4bdf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:07.502311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-142deca7-8417-4a55-8df0-f20a8f7f4bdf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:07.502311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-142deca7-8417-4a55-8df0-f20a8f7f4bdf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:07.502311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-142deca7-8417-4a55-8df0-f20a8f7f4bdf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:07.538090 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-142deca7-8417-4a55-8df0-f20a8f7f4bdf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-142deca7-8417-4a55-8df0-f20a8f7f4bdf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 HTTP/1.1 Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:07:07.540162 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:07:07.541853 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:07.541853 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:07:07.541853 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:07.541853 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:07.541853 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:07.541853 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:07:07.541853 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:07:07.541853 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:07:07.541853 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:07.541853 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:07:07.541853 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. Oct 12 22:07:07.541853 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '6ef20289-f683-41c1-8a71-b632098119c7'} Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:07.542829 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. Oct 12 22:07:07.544400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:07.545817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-142deca7-8417-4a55-8df0-f20a8f7f4bdf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Instance 6ef20289-f683-41c1-8a71-b632098119c7 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:07.545817 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-142deca7-8417-4a55-8df0-f20a8f7f4bdf tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7" status: 404 len: 111 microversion: 2.1 time: 0.056935 Oct 12 22:07:07.548888 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1092/2036] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:07 2022] GET /compute/v2.1/servers/6ef20289-f683-41c1-8a71-b632098119c7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:07:07.572383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-13320005-c09a-46c9-8934-e35f45f8c74b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:07.584191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-13320005-c09a-46c9-8934-e35f45f8c74b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:07.593158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13320005-c09a-46c9-8934-e35f45f8c74b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:07.593653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13320005-c09a-46c9-8934-e35f45f8c74b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:07.597740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13320005-c09a-46c9-8934-e35f45f8c74b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:07.598292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13320005-c09a-46c9-8934-e35f45f8c74b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:07.599204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13320005-c09a-46c9-8934-e35f45f8c74b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:07.604596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13320005-c09a-46c9-8934-e35f45f8c74b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:08.032594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-13320005-c09a-46c9-8934-e35f45f8c74b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:08.048845 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-13320005-c09a-46c9-8934-e35f45f8c74b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1392 microversion: 2.1 time: 0.486607 Oct 12 22:07:08.052178 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1093/2037] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:07 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1392 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:08.062978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-ed6cb0db-1eeb-44f6-8312-fc0bdab1f1e3 req-f04ec921-81d3-49a0-8892-5dcf1bc09d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15055486-69c3-4d87-99da-927949deea8a", "name": "network-vif-unplugged", "status": "completed", "tag": "fec38738-06d0-4ba1-b408-8e99dc334dea"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:08.084656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ed6cb0db-1eeb-44f6-8312-fc0bdab1f1e3 req-f04ec921-81d3-49a0-8892-5dcf1bc09d51 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:08.089317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ed6cb0db-1eeb-44f6-8312-fc0bdab1f1e3 req-f04ec921-81d3-49a0-8892-5dcf1bc09d51 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:08.089848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ed6cb0db-1eeb-44f6-8312-fc0bdab1f1e3 req-f04ec921-81d3-49a0-8892-5dcf1bc09d51 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:08.122258 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-ed6cb0db-1eeb-44f6-8312-fc0bdab1f1e3 req-f04ec921-81d3-49a0-8892-5dcf1bc09d51 service nova] Creating event network-vif-unplugged:fec38738-06d0-4ba1-b408-8e99dc334dea for instance 15055486-69c3-4d87-99da-927949deea8a on n-h2-861111-1 Oct 12 22:07:08.139908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-ed6cb0db-1eeb-44f6-8312-fc0bdab1f1e3 req-f04ec921-81d3-49a0-8892-5dcf1bc09d51 service nova] Instance 15055486-69c3-4d87-99da-927949deea8a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:07:08.176549 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-ed6cb0db-1eeb-44f6-8312-fc0bdab1f1e3 req-f04ec921-81d3-49a0-8892-5dcf1bc09d51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122993 Oct 12 22:07:08.177493 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1094/2038] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:08.182575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-652e2678-94b4-4280-b0e7-07d09377b5cf tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-861111-1", "block_migration": "auto"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:08.185160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-652e2678-94b4-4280-b0e7-07d09377b5cf tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:08.212630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-652e2678-94b4-4280-b0e7-07d09377b5cf tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:08.213144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-652e2678-94b4-4280-b0e7-07d09377b5cf tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:08.213575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-652e2678-94b4-4280-b0e7-07d09377b5cf tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:08.214288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-652e2678-94b4-4280-b0e7-07d09377b5cf tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:08.214742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-652e2678-94b4-4280-b0e7-07d09377b5cf tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:08.215172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-652e2678-94b4-4280-b0e7-07d09377b5cf tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:08.226787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:08.284849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-652e2678-94b4-4280-b0e7-07d09377b5cf tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'flavor' on Instance uuid 325466ea-d13d-4204-89f6-7c5deb99cd61 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:07:08.302724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-652e2678-94b4-4280-b0e7-07d09377b5cf tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Going to try to live migrate instance to n-h1-861111-1 {{(pid=120453) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:07:13.146591 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-652e2678-94b4-4280-b0e7-07d09377b5cf tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61/action" status: 202 len: 0 microversion: 2.25 time: 4.967819 Oct 12 22:07:13.147663 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1095/2039] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 12 22:07:08 2022] POST /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61/action => generated 0 bytes in 4969 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:07:13.152517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-70fd60f7-1a68-4d62-abf6-45bca2c2151b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:13.153229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-70fd60f7-1a68-4d62-abf6-45bca2c2151b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:13.181496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70fd60f7-1a68-4d62-abf6-45bca2c2151b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:13.182092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70fd60f7-1a68-4d62-abf6-45bca2c2151b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:13.182534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70fd60f7-1a68-4d62-abf6-45bca2c2151b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:13.183276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70fd60f7-1a68-4d62-abf6-45bca2c2151b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:13.183818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70fd60f7-1a68-4d62-abf6-45bca2c2151b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:13.191873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70fd60f7-1a68-4d62-abf6-45bca2c2151b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:13.614100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-70fd60f7-1a68-4d62-abf6-45bca2c2151b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:13.624900 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-70fd60f7-1a68-4d62-abf6-45bca2c2151b tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5" status: 200 len: 1320 microversion: 2.1 time: 0.475995 Oct 12 22:07:13.627693 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1096/2040] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:13 2022] GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5 => generated 1320 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:13.637476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ec2c4e62-0221-4ecd-9150-b4f9edc117b2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51235738b0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:13.998342 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0aae6f43-79e0-4054-b22c-d8ca24c69dc7 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df" status: 200 len: 1427 microversion: 2.1 time: 16.832224 Oct 12 22:07:13.998978 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 945/2041] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:06:57 2022] GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df => generated 1427 bytes in 16835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:14.015467 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-ec2c4e62-0221-4ecd-9150-b4f9edc117b2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Image not found. Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ec2c4e62-0221-4ecd-9150-b4f9edc117b2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be HTTP/1.1 Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:07:14.017976 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:07:14.019879 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:14.019879 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:07:14.019879 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:14.019879 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:14.019879 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:14.019879 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:07:14.019879 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:07:14.019879 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:07:14.019879 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:14.019879 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:07:14.019879 n-d-861111-1 devstack@n-api.service[120453]: exception: Image not found. Oct 12 22:07:14.019879 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'b3e07e6e-3aff-474d-9ddf-dbde3ec934be'} Oct 12 22:07:14.019879 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:14.019879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b3e07e6e-3aff-474d-9ddf-dbde3ec934be to delete Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.020858 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b3e07e6e-3aff-474d-9ddf-dbde3ec934be could not be found. Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:14.022186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:07:14.023578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:07:14.023578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:07:14.023578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.023578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:14.023578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.023578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:14.023578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:14.023578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:14.023578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:14.023578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:14.023578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:07:14.023578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.026049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9620aaee-788c-4a8a-980f-fbc5b1ff268b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:14.026268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9620aaee-788c-4a8a-980f-fbc5b1ff268b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:14.026630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ec2c4e62-0221-4ecd-9150-b4f9edc117b2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Image not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:14.027753 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ec2c4e62-0221-4ecd-9150-b4f9edc117b2 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be" status: 404 len: 62 microversion: 2.1 time: 0.398898 Oct 12 22:07:14.028547 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1097/2042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:13 2022] DELETE /compute/v2.1/images/b3e07e6e-3aff-474d-9ddf-dbde3ec934be => generated 62 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:07:14.035847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d46b86e5-e2d2-462f-9d27-3524a85502d1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:14.037157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9620aaee-788c-4a8a-980f-fbc5b1ff268b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.037941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9620aaee-788c-4a8a-980f-fbc5b1ff268b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.038548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9620aaee-788c-4a8a-980f-fbc5b1ff268b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.039472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9620aaee-788c-4a8a-980f-fbc5b1ff268b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.040160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9620aaee-788c-4a8a-980f-fbc5b1ff268b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.040808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9620aaee-788c-4a8a-980f-fbc5b1ff268b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.041216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d46b86e5-e2d2-462f-9d27-3524a85502d1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:14.053357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d46b86e5-e2d2-462f-9d27-3524a85502d1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.053866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d46b86e5-e2d2-462f-9d27-3524a85502d1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.054313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d46b86e5-e2d2-462f-9d27-3524a85502d1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.055152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d46b86e5-e2d2-462f-9d27-3524a85502d1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.055632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d46b86e5-e2d2-462f-9d27-3524a85502d1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.056057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d46b86e5-e2d2-462f-9d27-3524a85502d1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.216807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d46b86e5-e2d2-462f-9d27-3524a85502d1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:14.226134 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d46b86e5-e2d2-462f-9d27-3524a85502d1 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1382 microversion: 2.1 time: 0.194991 Oct 12 22:07:14.226742 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1098/2043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:14 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1382 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:14.231857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-0dbbf9f3-5495-4e96-9519-80d7b363c7c0 req-a6c98c7c-b0a1-4f11-a14f-f91116527dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15055486-69c3-4d87-99da-927949deea8a", "tag": "fec38738-06d0-4ba1-b408-8e99dc334dea"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:14.239268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9620aaee-788c-4a8a-980f-fbc5b1ff268b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:14.244437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0dbbf9f3-5495-4e96-9519-80d7b363c7c0 req-a6c98c7c-b0a1-4f11-a14f-f91116527dc2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.245194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0dbbf9f3-5495-4e96-9519-80d7b363c7c0 req-a6c98c7c-b0a1-4f11-a14f-f91116527dc2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.246003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0dbbf9f3-5495-4e96-9519-80d7b363c7c0 req-a6c98c7c-b0a1-4f11-a14f-f91116527dc2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.248795 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9620aaee-788c-4a8a-980f-fbc5b1ff268b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1473 microversion: 2.1 time: 0.245747 Oct 12 22:07:14.249357 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 946/2044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:14 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1473 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:14.259529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-dda4e640-effa-47de-b6ab-e3af4a4b1dfd req-bdb39a67-2775-4fe4-8994-a8ebb3da9617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041bb415-1452-4d7f-9a45-5c8592816cf5", "name": "network-vif-plugged", "status": "completed", "tag": "4938ca12-9234-4ba1-9d52-dc286559ab04"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:14.272753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dda4e640-effa-47de-b6ab-e3af4a4b1dfd req-bdb39a67-2775-4fe4-8994-a8ebb3da9617 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.272753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dda4e640-effa-47de-b6ab-e3af4a4b1dfd req-bdb39a67-2775-4fe4-8994-a8ebb3da9617 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.272753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dda4e640-effa-47de-b6ab-e3af4a4b1dfd req-bdb39a67-2775-4fe4-8994-a8ebb3da9617 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.277995 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-0dbbf9f3-5495-4e96-9519-80d7b363c7c0 req-a6c98c7c-b0a1-4f11-a14f-f91116527dc2 service nova] Creating event network-changed:fec38738-06d0-4ba1-b408-8e99dc334dea for instance 15055486-69c3-4d87-99da-927949deea8a on n-h2-861111-1 Oct 12 22:07:14.285271 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-dda4e640-effa-47de-b6ab-e3af4a4b1dfd req-bdb39a67-2775-4fe4-8994-a8ebb3da9617 service nova] Creating event network-vif-plugged:4938ca12-9234-4ba1-9d52-dc286559ab04 for instance 041bb415-1452-4d7f-9a45-5c8592816cf5 on n-h1-861111-1 Oct 12 22:07:14.286464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-0dbbf9f3-5495-4e96-9519-80d7b363c7c0 req-a6c98c7c-b0a1-4f11-a14f-f91116527dc2 service nova] Instance 15055486-69c3-4d87-99da-927949deea8a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:07:14.290706 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-dda4e640-effa-47de-b6ab-e3af4a4b1dfd req-bdb39a67-2775-4fe4-8994-a8ebb3da9617 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039158 Oct 12 22:07:14.291610 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 947/2045] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:14.297423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2209bd28-52c5-404f-9ae9-097b0fbe2cb9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:14.298123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2209bd28-52c5-404f-9ae9-097b0fbe2cb9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:14.306346 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-0dbbf9f3-5495-4e96-9519-80d7b363c7c0 req-a6c98c7c-b0a1-4f11-a14f-f91116527dc2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078078 Oct 12 22:07:14.307547 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1099/2046] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:14.312740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f809e8c9-3b7c-4e07-876c-af22f73eda81 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:14.314335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f809e8c9-3b7c-4e07-876c-af22f73eda81 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:14.320928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2209bd28-52c5-404f-9ae9-097b0fbe2cb9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.321536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2209bd28-52c5-404f-9ae9-097b0fbe2cb9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.321989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2209bd28-52c5-404f-9ae9-097b0fbe2cb9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.322182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f809e8c9-3b7c-4e07-876c-af22f73eda81 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.322691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2209bd28-52c5-404f-9ae9-097b0fbe2cb9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.323022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f809e8c9-3b7c-4e07-876c-af22f73eda81 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.323276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2209bd28-52c5-404f-9ae9-097b0fbe2cb9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.323564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2209bd28-52c5-404f-9ae9-097b0fbe2cb9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.323959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f809e8c9-3b7c-4e07-876c-af22f73eda81 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.324678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f809e8c9-3b7c-4e07-876c-af22f73eda81 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.325274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f809e8c9-3b7c-4e07-876c-af22f73eda81 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.325716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f809e8c9-3b7c-4e07-876c-af22f73eda81 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.342454 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-f809e8c9-3b7c-4e07-876c-af22f73eda81 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Instance 88fef870-22a8-43e7-afb9-5612edbce136 could not be found. Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f809e8c9-3b7c-4e07-876c-af22f73eda81 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 HTTP/1.1 Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:07:14.344327 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:07:14.345868 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:14.345868 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:07:14.345868 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:14.345868 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:14.345868 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:14.345868 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:07:14.345868 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:07:14.345868 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:07:14.345868 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:14.345868 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:07:14.345868 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 88fef870-22a8-43e7-afb9-5612edbce136 could not be found. Oct 12 22:07:14.345868 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '88fef870-22a8-43e7-afb9-5612edbce136'} Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88fef870-22a8-43e7-afb9-5612edbce136 could not be found. Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:14.346687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88fef870-22a8-43e7-afb9-5612edbce136 could not be found. Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88fef870-22a8-43e7-afb9-5612edbce136 could not be found. Oct 12 22:07:14.348055 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.350217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f809e8c9-3b7c-4e07-876c-af22f73eda81 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Instance 88fef870-22a8-43e7-afb9-5612edbce136 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:14.350217 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f809e8c9-3b7c-4e07-876c-af22f73eda81 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 404 len: 111 microversion: 2.1 time: 0.036896 Oct 12 22:07:14.350217 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1100/2047] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:07:14 2022] DELETE /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:07:14.350721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-751b7a08-0fb1-47ba-89d0-d78c8d276674 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '.version_select at 0x7f51235a2d30>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:14.354344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-751b7a08-0fb1-47ba-89d0-d78c8d276674 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.354855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-751b7a08-0fb1-47ba-89d0-d78c8d276674 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.355313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-751b7a08-0fb1-47ba-89d0-d78c8d276674 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.371605 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-751b7a08-0fb1-47ba-89d0-d78c8d276674 tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 4662 microversion: 2.1 time: 0.024304 Oct 12 22:07:14.372377 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1101/2048] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 12 22:07:14 2022] GET /compute/v2.1/os-migrations => generated 4662 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:14.379667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-db4f7702-5ead-48d1-b6b2-555ef3754d60 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:14.379667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-db4f7702-5ead-48d1-b6b2-555ef3754d60 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 88fef870-22a8-43e7-afb9-5612edbce136] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:14.394536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-db4f7702-5ead-48d1-b6b2-555ef3754d60 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.395119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-db4f7702-5ead-48d1-b6b2-555ef3754d60 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.395530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-db4f7702-5ead-48d1-b6b2-555ef3754d60 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.399827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-db4f7702-5ead-48d1-b6b2-555ef3754d60 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.400719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-db4f7702-5ead-48d1-b6b2-555ef3754d60 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.401175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-db4f7702-5ead-48d1-b6b2-555ef3754d60 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.428791 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-db4f7702-5ead-48d1-b6b2-555ef3754d60 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Instance 88fef870-22a8-43e7-afb9-5612edbce136 could not be found. Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-db4f7702-5ead-48d1-b6b2-555ef3754d60 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 HTTP/1.1 Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:07:14.430363 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:07:14.432354 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:14.432354 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:07:14.432354 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:14.432354 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:14.432354 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:14.432354 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:07:14.432354 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:07:14.432354 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:07:14.432354 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:14.432354 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:07:14.432354 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 88fef870-22a8-43e7-afb9-5612edbce136 could not be found. Oct 12 22:07:14.432354 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '88fef870-22a8-43e7-afb9-5612edbce136'} Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88fef870-22a8-43e7-afb9-5612edbce136 could not be found. Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:14.434118 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88fef870-22a8-43e7-afb9-5612edbce136 could not be found. Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88fef870-22a8-43e7-afb9-5612edbce136 could not be found. Oct 12 22:07:14.436999 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.439767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-db4f7702-5ead-48d1-b6b2-555ef3754d60 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Instance 88fef870-22a8-43e7-afb9-5612edbce136 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:14.439767 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-db4f7702-5ead-48d1-b6b2-555ef3754d60 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136" status: 404 len: 111 microversion: 2.1 time: 0.065398 Oct 12 22:07:14.444979 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1102/2049] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:14 2022] GET /compute/v2.1/servers/88fef870-22a8-43e7-afb9-5612edbce136 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:07:14.453148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1ed24ec4-5999-4761-aea5-11d294c00fae tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:14.454794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1ed24ec4-5999-4761-aea5-11d294c00fae tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:14.465149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ed24ec4-5999-4761-aea5-11d294c00fae tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.465975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ed24ec4-5999-4761-aea5-11d294c00fae tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.466737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ed24ec4-5999-4761-aea5-11d294c00fae tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.467749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ed24ec4-5999-4761-aea5-11d294c00fae tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.468416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ed24ec4-5999-4761-aea5-11d294c00fae tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.469073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ed24ec4-5999-4761-aea5-11d294c00fae tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.629265 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1ed24ec4-5999-4761-aea5-11d294c00fae tempest-LiveMigrationTest-1913112900 tempest-LiveMigrationTest-1913112900-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1533 microversion: 2.1 time: 0.182681 Oct 12 22:07:14.630457 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1103/2050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:14 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1533 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:14.633287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2209bd28-52c5-404f-9ae9-097b0fbe2cb9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:14.640790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1ed07196-0d1d-4c54-b9da-41c7ac62c6de tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f512c3ab430>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:14.642621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2209bd28-52c5-404f-9ae9-097b0fbe2cb9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:14.644061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2209bd28-52c5-404f-9ae9-097b0fbe2cb9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:14.660219 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2209bd28-52c5-404f-9ae9-097b0fbe2cb9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.365708 Oct 12 22:07:14.660219 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 948/2051] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:14 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:14.664817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ec7c7eb7-ae8c-468e-bb99-cffa61550e59 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:14.665539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ec7c7eb7-ae8c-468e-bb99-cffa61550e59 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:14.672173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec7c7eb7-ae8c-468e-bb99-cffa61550e59 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.672776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec7c7eb7-ae8c-468e-bb99-cffa61550e59 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.673430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec7c7eb7-ae8c-468e-bb99-cffa61550e59 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.674234 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec7c7eb7-ae8c-468e-bb99-cffa61550e59 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.674791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec7c7eb7-ae8c-468e-bb99-cffa61550e59 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.675371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec7c7eb7-ae8c-468e-bb99-cffa61550e59 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.683069 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-1ed07196-0d1d-4c54-b9da-41c7ac62c6de tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Image not found. Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1ed07196-0d1d-4c54-b9da-41c7ac62c6de tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 HTTP/1.1 Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:07:14.684867 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:07:14.686687 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:14.686687 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:07:14.686687 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:14.686687 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:14.686687 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:14.686687 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:07:14.686687 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:07:14.686687 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:07:14.686687 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:14.686687 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:07:14.686687 n-d-861111-1 devstack@n-api.service[120453]: exception: Image not found. Oct 12 22:07:14.686687 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '78843950-1709-416e-8adc-b0f1b0cb36d6'} Oct 12 22:07:14.686687 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:14.686687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 78843950-1709-416e-8adc-b0f1b0cb36d6 to delete Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.691369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 78843950-1709-416e-8adc-b0f1b0cb36d6 could not be found. Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:14.692922 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:07:14.694646 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:07:14.694646 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:07:14.694646 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.694646 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:14.694646 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.694646 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:14.694646 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:14.694646 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:14.694646 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:14.694646 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:14.694646 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:07:14.694646 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.694646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1ed07196-0d1d-4c54-b9da-41c7ac62c6de tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Image not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:14.694646 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1ed07196-0d1d-4c54-b9da-41c7ac62c6de tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6" status: 404 len: 62 microversion: 2.1 time: 0.054716 Oct 12 22:07:14.694646 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1104/2052] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:14 2022] DELETE /compute/v2.1/images/78843950-1709-416e-8adc-b0f1b0cb36d6 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:07:14.706244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3a22ac86-023f-4d90-922d-1301a7dc2a25 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:14.706499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3a22ac86-023f-4d90-922d-1301a7dc2a25 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:14.717731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a22ac86-023f-4d90-922d-1301a7dc2a25 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.718544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a22ac86-023f-4d90-922d-1301a7dc2a25 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.723649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a22ac86-023f-4d90-922d-1301a7dc2a25 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.724657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a22ac86-023f-4d90-922d-1301a7dc2a25 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.725275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a22ac86-023f-4d90-922d-1301a7dc2a25 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.725875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a22ac86-023f-4d90-922d-1301a7dc2a25 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.754168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3a22ac86-023f-4d90-922d-1301a7dc2a25 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:07:14.863953 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3a22ac86-023f-4d90-922d-1301a7dc2a25 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "DELETE /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 204 len: 0 microversion: 2.1 time: 0.169993 Oct 12 22:07:14.867344 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1105/2053] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:07:14 2022] DELETE /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:07:14.875077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d11a56bb-6357-4ecd-bd75-974a746ce9de tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:14.875860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d11a56bb-6357-4ecd-bd75-974a746ce9de tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:14.883541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d11a56bb-6357-4ecd-bd75-974a746ce9de tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.884109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d11a56bb-6357-4ecd-bd75-974a746ce9de tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.884640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d11a56bb-6357-4ecd-bd75-974a746ce9de tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.885412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d11a56bb-6357-4ecd-bd75-974a746ce9de tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.885965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d11a56bb-6357-4ecd-bd75-974a746ce9de tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.886603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d11a56bb-6357-4ecd-bd75-974a746ce9de tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.902656 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-d11a56bb-6357-4ecd-bd75-974a746ce9de tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Instance 75ce6878-173f-47f8-ab81-3c60803702b8 could not be found. Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d11a56bb-6357-4ecd-bd75-974a746ce9de tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 HTTP/1.1 Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:07:14.905090 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:07:14.906899 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:14.906899 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:07:14.906899 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:14.906899 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:14.906899 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:14.906899 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:07:14.906899 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:07:14.906899 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:07:14.906899 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:14.906899 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:07:14.906899 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 75ce6878-173f-47f8-ab81-3c60803702b8 could not be found. Oct 12 22:07:14.906899 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '75ce6878-173f-47f8-ab81-3c60803702b8'} Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ce6878-173f-47f8-ab81-3c60803702b8 could not be found. Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:14.907877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ce6878-173f-47f8-ab81-3c60803702b8 could not be found. Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ce6878-173f-47f8-ab81-3c60803702b8 could not be found. Oct 12 22:07:14.909237 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:14.910660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d11a56bb-6357-4ecd-bd75-974a746ce9de tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Instance 75ce6878-173f-47f8-ab81-3c60803702b8 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:14.910660 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d11a56bb-6357-4ecd-bd75-974a746ce9de tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8" status: 404 len: 111 microversion: 2.1 time: 0.037961 Oct 12 22:07:14.910660 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1106/2054] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:07:14 2022] DELETE /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:07:14.912326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b2947cf4-2762-4760-9780-36ba8ae8ab2b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:14.913484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b2947cf4-2762-4760-9780-36ba8ae8ab2b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:14.920027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2947cf4-2762-4760-9780-36ba8ae8ab2b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.920513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2947cf4-2762-4760-9780-36ba8ae8ab2b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.921053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2947cf4-2762-4760-9780-36ba8ae8ab2b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:14.921755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2947cf4-2762-4760-9780-36ba8ae8ab2b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:14.922838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2947cf4-2762-4760-9780-36ba8ae8ab2b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:14.923820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2947cf4-2762-4760-9780-36ba8ae8ab2b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:15.005043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ec7c7eb7-ae8c-468e-bb99-cffa61550e59 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:15.014213 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ec7c7eb7-ae8c-468e-bb99-cffa61550e59 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5" status: 200 len: 1320 microversion: 2.1 time: 0.352879 Oct 12 22:07:15.017626 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 949/2055] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:14 2022] GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5 => generated 1320 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:15.024129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f4404df1-1da8-494c-9da1-0b05cbfd9574 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:15.024743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f4404df1-1da8-494c-9da1-0b05cbfd9574 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 75ce6878-173f-47f8-ab81-3c60803702b8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:15.041587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4404df1-1da8-494c-9da1-0b05cbfd9574 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:15.042449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4404df1-1da8-494c-9da1-0b05cbfd9574 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:15.042955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4404df1-1da8-494c-9da1-0b05cbfd9574 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:15.044194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4404df1-1da8-494c-9da1-0b05cbfd9574 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:15.044726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4404df1-1da8-494c-9da1-0b05cbfd9574 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:15.045231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4404df1-1da8-494c-9da1-0b05cbfd9574 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:15.060759 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-f4404df1-1da8-494c-9da1-0b05cbfd9574 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Instance 75ce6878-173f-47f8-ab81-3c60803702b8 could not be found. Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f4404df1-1da8-494c-9da1-0b05cbfd9574 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 HTTP/1.1 Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:07:15.062555 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:07:15.064322 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:15.064322 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.064322 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:15.064322 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.064322 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:15.064322 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:07:15.064322 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:07:15.064322 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:07:15.064322 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:15.064322 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:07:15.064322 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 75ce6878-173f-47f8-ab81-3c60803702b8 could not be found. Oct 12 22:07:15.064322 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '75ce6878-173f-47f8-ab81-3c60803702b8'} Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ce6878-173f-47f8-ab81-3c60803702b8 could not be found. Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:15.065197 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ce6878-173f-47f8-ab81-3c60803702b8 could not be found. Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ce6878-173f-47f8-ab81-3c60803702b8 could not be found. Oct 12 22:07:15.066654 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.068044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f4404df1-1da8-494c-9da1-0b05cbfd9574 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Instance 75ce6878-173f-47f8-ab81-3c60803702b8 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:15.068044 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f4404df1-1da8-494c-9da1-0b05cbfd9574 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8" status: 404 len: 111 microversion: 2.1 time: 0.045443 Oct 12 22:07:15.068044 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 950/2056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:15 2022] GET /compute/v2.1/servers/75ce6878-173f-47f8-ab81-3c60803702b8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:07:15.070895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-96fec8a3-2297-40aa-884e-1116aa08d833 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f512379e8b0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:15.104887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b2947cf4-2762-4760-9780-36ba8ae8ab2b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:15.114068 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b2947cf4-2762-4760-9780-36ba8ae8ab2b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1388 microversion: 2.1 time: 0.205252 Oct 12 22:07:15.128372 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1107/2057] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:14 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1388 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:15.135412 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-96fec8a3-2297-40aa-884e-1116aa08d833 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df" status: 200 len: 1436 microversion: 2.1 time: 0.069553 Oct 12 22:07:15.143274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c0198908-7107-4441-82ac-f827a8088469 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51235a2c10>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:15.143686 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 951/2058] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:07:15 2022] GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df => generated 1436 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:15.161275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ef44bf75-e327-4533-8401-23f667037064 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f5123954a60>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:15.166599 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-c0198908-7107-4441-82ac-f827a8088469 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Image not found. Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c0198908-7107-4441-82ac-f827a8088469 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad HTTP/1.1 Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:07:15.168919 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:07:15.170716 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:15.170716 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.170716 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:15.170716 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.170716 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:15.170716 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:07:15.170716 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:07:15.170716 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:07:15.170716 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:15.170716 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:07:15.170716 n-d-861111-1 devstack@n-api.service[120453]: exception: Image not found. Oct 12 22:07:15.170716 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'e385ea3a-e3cb-4a94-91f1-e5fabb46abad'} Oct 12 22:07:15.170716 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:15.170716 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e385ea3a-e3cb-4a94-91f1-e5fabb46abad to delete Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.172132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e385ea3a-e3cb-4a94-91f1-e5fabb46abad could not be found. Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:15.173508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:07:15.174990 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:07:15.174990 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:07:15.174990 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.174990 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:15.174990 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.174990 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.174990 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:15.174990 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:15.174990 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:15.174990 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:15.174990 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:07:15.174990 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.174990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c0198908-7107-4441-82ac-f827a8088469 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Image not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:15.174990 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c0198908-7107-4441-82ac-f827a8088469 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad" status: 404 len: 62 microversion: 2.1 time: 0.041556 Oct 12 22:07:15.174990 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1108/2059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:15 2022] DELETE /compute/v2.1/images/e385ea3a-e3cb-4a94-91f1-e5fabb46abad => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:07:15.181758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fef09069-3396-4f4c-abbf-d2a5506634b8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:15.182249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fef09069-3396-4f4c-abbf-d2a5506634b8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:15.192548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fef09069-3396-4f4c-abbf-d2a5506634b8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:15.193408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fef09069-3396-4f4c-abbf-d2a5506634b8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:15.194431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fef09069-3396-4f4c-abbf-d2a5506634b8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:15.196547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fef09069-3396-4f4c-abbf-d2a5506634b8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:15.197257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fef09069-3396-4f4c-abbf-d2a5506634b8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:15.198571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fef09069-3396-4f4c-abbf-d2a5506634b8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:15.222540 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ef44bf75-e327-4533-8401-23f667037064 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df" status: 200 len: 1436 microversion: 2.1 time: 0.068290 Oct 12 22:07:15.232346 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 952/2060] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:07:15 2022] GET /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df => generated 1436 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:15.232601 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-fef09069-3396-4f4c-abbf-d2a5506634b8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Instance 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 could not be found. Oct 12 22:07:15.237578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-93e8c3d6-1cdd-4736-8b2c-9f742e446a91 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:15.238201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-93e8c3d6-1cdd-4736-8b2c-9f742e446a91 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fef09069-3396-4f4c-abbf-d2a5506634b8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 HTTP/1.1 Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:07:15.240028 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:07:15.241588 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:15.241588 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.241588 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:15.241588 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.241588 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:15.241588 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:07:15.241588 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:07:15.241588 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:07:15.241588 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:15.241588 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:07:15.241588 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 could not be found. Oct 12 22:07:15.241588 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1d4b3e47-bbd0-4adc-9173-d7f9ccd96221'} Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 could not be found. Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:15.242417 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 could not be found. Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 could not be found. Oct 12 22:07:15.244401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.247064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fef09069-3396-4f4c-abbf-d2a5506634b8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Instance 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:15.247064 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fef09069-3396-4f4c-abbf-d2a5506634b8 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 404 len: 111 microversion: 2.1 time: 0.064793 Oct 12 22:07:15.247064 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1109/2061] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:07:15 2022] DELETE /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:07:15.251132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f346eb70-b1ea-4057-9995-bda2718a0a03 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:15.251798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f346eb70-b1ea-4057-9995-bda2718a0a03 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:15.254472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93e8c3d6-1cdd-4736-8b2c-9f742e446a91 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:15.255088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93e8c3d6-1cdd-4736-8b2c-9f742e446a91 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:15.255813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93e8c3d6-1cdd-4736-8b2c-9f742e446a91 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:15.256769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93e8c3d6-1cdd-4736-8b2c-9f742e446a91 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:15.257476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93e8c3d6-1cdd-4736-8b2c-9f742e446a91 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:15.259834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f346eb70-b1ea-4057-9995-bda2718a0a03 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:15.260338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f346eb70-b1ea-4057-9995-bda2718a0a03 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:15.260788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f346eb70-b1ea-4057-9995-bda2718a0a03 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:15.261555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f346eb70-b1ea-4057-9995-bda2718a0a03 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:15.262014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f346eb70-b1ea-4057-9995-bda2718a0a03 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:15.262889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f346eb70-b1ea-4057-9995-bda2718a0a03 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:15.272438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93e8c3d6-1cdd-4736-8b2c-9f742e446a91 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:15.283478 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-f346eb70-b1ea-4057-9995-bda2718a0a03 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Instance 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 could not be found. Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f346eb70-b1ea-4057-9995-bda2718a0a03 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 HTTP/1.1 Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:07:15.285061 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:07:15.300068 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:15.300068 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.300068 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:15.300068 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.300068 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:15.300068 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:07:15.300068 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:07:15.300068 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:07:15.300068 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:15.300068 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:07:15.300068 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 could not be found. Oct 12 22:07:15.300068 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1d4b3e47-bbd0-4adc-9173-d7f9ccd96221'} Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 could not be found. Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:15.307495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 could not be found. Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 could not be found. Oct 12 22:07:15.311705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.330316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f346eb70-b1ea-4057-9995-bda2718a0a03 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Instance 1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:15.330316 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f346eb70-b1ea-4057-9995-bda2718a0a03 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221" status: 404 len: 111 microversion: 2.1 time: 0.040666 Oct 12 22:07:15.330316 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1110/2062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:15 2022] GET /compute/v2.1/servers/1d4b3e47-bbd0-4adc-9173-d7f9ccd96221 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:07:15.330316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e4617fc6-cd03-4501-95f0-77e2ad1796ab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:15.330316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e4617fc6-cd03-4501-95f0-77e2ad1796ab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:15.330794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4617fc6-cd03-4501-95f0-77e2ad1796ab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:15.330794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4617fc6-cd03-4501-95f0-77e2ad1796ab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:15.330794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4617fc6-cd03-4501-95f0-77e2ad1796ab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:15.330794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4617fc6-cd03-4501-95f0-77e2ad1796ab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:15.331231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4617fc6-cd03-4501-95f0-77e2ad1796ab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:15.331231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4617fc6-cd03-4501-95f0-77e2ad1796ab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:15.467791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e4617fc6-cd03-4501-95f0-77e2ad1796ab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:15.475774 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e4617fc6-cd03-4501-95f0-77e2ad1796ab tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1473 microversion: 2.1 time: 0.186302 Oct 12 22:07:15.491508 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1111/2063] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:15 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1473 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:15.494423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-93e8c3d6-1cdd-4736-8b2c-9f742e446a91 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:15.497033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8167c2b7-ad95-4979-864f-2bc7f1a49b23 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '.version_select at 0x7f51235730d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:15.502864 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-93e8c3d6-1cdd-4736-8b2c-9f742e446a91 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1466 microversion: 2.1 time: 0.269175 Oct 12 22:07:15.505319 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 953/2064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:15 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1466 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:15.531414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-593f5e04-c0f7-49d4-8873-72000a5d3ff2 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f51238e5040>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:15.537811 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-8167c2b7-ad95-4979-864f-2bc7f1a49b23 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Image not found. Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8167c2b7-ad95-4979-864f-2bc7f1a49b23 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 HTTP/1.1 Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:07:15.539639 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:07:15.541428 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:15.541428 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.541428 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:15.541428 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.541428 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:15.541428 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:07:15.541428 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:07:15.541428 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:07:15.541428 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:15.541428 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:07:15.541428 n-d-861111-1 devstack@n-api.service[120453]: exception: Image not found. Oct 12 22:07:15.541428 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'b2782a52-f361-4e5a-ac33-f4bac974b943'} Oct 12 22:07:15.541428 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:15.541428 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b2782a52-f361-4e5a-ac33-f4bac974b943 to delete Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.545762 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b2782a52-f361-4e5a-ac33-f4bac974b943 could not be found. Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:15.548016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:07:15.549879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:07:15.549879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:07:15.549879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.549879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:15.549879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.549879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.549879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:15.549879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:15.549879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:15.549879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:15.549879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:07:15.549879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.549879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8167c2b7-ad95-4979-864f-2bc7f1a49b23 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Image not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:15.549879 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8167c2b7-ad95-4979-864f-2bc7f1a49b23 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943" status: 404 len: 62 microversion: 2.1 time: 0.048193 Oct 12 22:07:15.549879 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1112/2065] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:15 2022] DELETE /compute/v2.1/images/b2782a52-f361-4e5a-ac33-f4bac974b943 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:07:15.552750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1d3aba65-bf62-47c8-a8aa-d780a29df552 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:15.552750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1d3aba65-bf62-47c8-a8aa-d780a29df552 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:15.561972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d3aba65-bf62-47c8-a8aa-d780a29df552 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:15.562496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d3aba65-bf62-47c8-a8aa-d780a29df552 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:15.562967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d3aba65-bf62-47c8-a8aa-d780a29df552 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:15.563745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d3aba65-bf62-47c8-a8aa-d780a29df552 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:15.564208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d3aba65-bf62-47c8-a8aa-d780a29df552 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:15.564650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d3aba65-bf62-47c8-a8aa-d780a29df552 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:15.580406 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-1d3aba65-bf62-47c8-a8aa-d780a29df552 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Instance ad668734-0c34-4d75-b667-0f69f3515d84 could not be found. Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1d3aba65-bf62-47c8-a8aa-d780a29df552 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 HTTP/1.1 Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:07:15.582033 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:07:15.584155 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:15.584155 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.584155 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:15.584155 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.584155 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:15.584155 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:07:15.584155 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:07:15.584155 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:07:15.584155 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:15.584155 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:07:15.584155 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance ad668734-0c34-4d75-b667-0f69f3515d84 could not be found. Oct 12 22:07:15.584155 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'ad668734-0c34-4d75-b667-0f69f3515d84'} Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad668734-0c34-4d75-b667-0f69f3515d84 could not be found. Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:15.585248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad668734-0c34-4d75-b667-0f69f3515d84 could not be found. Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad668734-0c34-4d75-b667-0f69f3515d84 could not be found. Oct 12 22:07:15.588169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.590179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1d3aba65-bf62-47c8-a8aa-d780a29df552 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Instance ad668734-0c34-4d75-b667-0f69f3515d84 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:15.590179 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1d3aba65-bf62-47c8-a8aa-d780a29df552 tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 404 len: 111 microversion: 2.1 time: 0.037529 Oct 12 22:07:15.590179 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1113/2066] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:07:15 2022] DELETE /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:07:15.604739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-07db9d04-fe62-4187-8912-e7777fff346a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:15.605358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-07db9d04-fe62-4187-8912-e7777fff346a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] [instance: ad668734-0c34-4d75-b667-0f69f3515d84] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:15.624025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07db9d04-fe62-4187-8912-e7777fff346a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:15.624526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07db9d04-fe62-4187-8912-e7777fff346a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:15.624974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07db9d04-fe62-4187-8912-e7777fff346a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:15.625737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07db9d04-fe62-4187-8912-e7777fff346a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:15.626199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07db9d04-fe62-4187-8912-e7777fff346a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:15.626636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07db9d04-fe62-4187-8912-e7777fff346a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:15.653766 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-07db9d04-fe62-4187-8912-e7777fff346a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] HTTP exception thrown: Instance ad668734-0c34-4d75-b667-0f69f3515d84 could not be found. Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-07db9d04-fe62-4187-8912-e7777fff346a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Request method failure captured: Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 HTTP/1.1 Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlDrS5hhWR0n5uKuNU91AEOnGcsh_mg1r2HmvQQfuSzfJ1MpRb3ltRvzl739dfgDvps7Py0Qd3uINztiPJ43CW75ED42S9ifMouOJMzI2kiWXtAmGLGAYTII_-TwJ8xE8UG4EnJ47ENAWDuZLWUNfu0C9XnDvlMpy1Fu2JGaswAZNo Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:07:15.660194 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:07:15.661906 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0905a1286e134e34a55ceaaa6c23718e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0905a1286e134e34a55ceaaa6c23718e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:15.661906 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.661906 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0905a1286e134e34a55ceaaa6c23718e Oct 12 22:07:15.661906 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesTestJSON-206384738 Oct 12 22:07:15.661906 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:15.661906 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:07:15.661906 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:07:15.661906 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7224dcaeabdd4199b9682e99912f7740 Oct 12 22:07:15.661906 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesTestJSON-206384738-project Oct 12 22:07:15.661906 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:07:15.661906 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance ad668734-0c34-4d75-b667-0f69f3515d84 could not be found. Oct 12 22:07:15.661906 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'ad668734-0c34-4d75-b667-0f69f3515d84'} Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad668734-0c34-4d75-b667-0f69f3515d84 could not be found. Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:15.662951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad668734-0c34-4d75-b667-0f69f3515d84 could not be found. Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad668734-0c34-4d75-b667-0f69f3515d84 could not be found. Oct 12 22:07:15.664562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:15.665992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-07db9d04-fe62-4187-8912-e7777fff346a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] Returning 404 to user: Instance ad668734-0c34-4d75-b667-0f69f3515d84 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:15.665992 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-07db9d04-fe62-4187-8912-e7777fff346a tempest-ImagesTestJSON-206384738 tempest-ImagesTestJSON-206384738-project] 10.222.0.16 "GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84" status: 404 len: 111 microversion: 2.1 time: 0.060812 Oct 12 22:07:15.666935 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1114/2067] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:15 2022] GET /compute/v2.1/servers/ad668734-0c34-4d75-b667-0f69f3515d84 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:07:15.687735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4bd4bbda-bd2d-4332-820b-a5f2a757c802 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:15.688492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4bd4bbda-bd2d-4332-820b-a5f2a757c802 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:15.697503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bd4bbda-bd2d-4332-820b-a5f2a757c802 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:15.698580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bd4bbda-bd2d-4332-820b-a5f2a757c802 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:15.699982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bd4bbda-bd2d-4332-820b-a5f2a757c802 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:15.701129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bd4bbda-bd2d-4332-820b-a5f2a757c802 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:15.701851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bd4bbda-bd2d-4332-820b-a5f2a757c802 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:15.703267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bd4bbda-bd2d-4332-820b-a5f2a757c802 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:15.888760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4bd4bbda-bd2d-4332-820b-a5f2a757c802 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:15.900079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4bd4bbda-bd2d-4332-820b-a5f2a757c802 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:15.901570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4bd4bbda-bd2d-4332-820b-a5f2a757c802 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:15.902857 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4bd4bbda-bd2d-4332-820b-a5f2a757c802 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.219399 Oct 12 22:07:15.903780 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1115/2068] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:15 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:16.040558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3bb6e265-ea9d-4484-9d98-eb50e329414e tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:16.041185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3bb6e265-ea9d-4484-9d98-eb50e329414e tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:16.055539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bb6e265-ea9d-4484-9d98-eb50e329414e tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:16.056047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bb6e265-ea9d-4484-9d98-eb50e329414e tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:16.056491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bb6e265-ea9d-4484-9d98-eb50e329414e tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:16.057207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bb6e265-ea9d-4484-9d98-eb50e329414e tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:16.057670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bb6e265-ea9d-4484-9d98-eb50e329414e tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:16.058105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3bb6e265-ea9d-4484-9d98-eb50e329414e tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:16.233232 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-593f5e04-c0f7-49d4-8873-72000a5d3ff2 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "DELETE /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df" status: 204 len: 0 microversion: 2.1 time: 0.709226 Oct 12 22:07:16.234421 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 954/2069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:15 2022] DELETE /compute/v2.1/images/f3728790-a646-44b7-9d6d-ba2be954d7df => generated 0 bytes in 711 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:07:16.247490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dfe05496-e951-4674-ba3f-258aab710b23 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:16.250320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dfe05496-e951-4674-ba3f-258aab710b23 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:16.259215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe05496-e951-4674-ba3f-258aab710b23 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:16.259811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe05496-e951-4674-ba3f-258aab710b23 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:16.260374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe05496-e951-4674-ba3f-258aab710b23 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:16.261308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe05496-e951-4674-ba3f-258aab710b23 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:16.261993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe05496-e951-4674-ba3f-258aab710b23 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:16.262488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe05496-e951-4674-ba3f-258aab710b23 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:16.305917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3bb6e265-ea9d-4484-9d98-eb50e329414e tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:16.318491 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3bb6e265-ea9d-4484-9d98-eb50e329414e tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5" status: 200 len: 1320 microversion: 2.1 time: 0.281701 Oct 12 22:07:16.320200 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1116/2070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:16 2022] GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5 => generated 1320 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:07:16.541612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dfe05496-e951-4674-ba3f-258aab710b23 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:16.544022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0745f2d4-b42a-41a1-b7a6-443f0cab0ce3 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Action: 'create', calling method: .version_select at 0x7f512c4310d0>, body: {"keypair": {"name": "tempest-keypair-1786249007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/dtMKxeA1hTbmSRN2OKgno8WH+IeAEyWwZpskKJaaKZ15Jt/8scqymX/httEU0UostdLarDJh9Y5XInLKQR1hSvDjmu4UBjW2zvMeXHHn+np4rOATVoAtq24gBGmVnjA=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:16.552734 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dfe05496-e951-4674-ba3f-258aab710b23 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1388 microversion: 2.1 time: 0.312077 Oct 12 22:07:16.553661 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 955/2071] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:16 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1388 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:16.565704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0fdf135b-a53b-494f-9b70-91bcd668bb7d tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '.version_select at 0x7f51237899d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:16.592520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-0745f2d4-b42a-41a1-b7a6-443f0cab0ce3 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Getting quotas for project ebf3c61412cf43f691e7af5d26e740bd. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:07:16.600254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-0745f2d4-b42a-41a1-b7a6-443f0cab0ce3 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Getting quotas for user 4d9e20674549401c89b9d264d1167f3a and project ebf3c61412cf43f691e7af5d26e740bd. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:07:16.614078 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-0fdf135b-a53b-494f-9b70-91bcd668bb7d tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] HTTP exception thrown: Image not found. Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0fdf135b-a53b-494f-9b70-91bcd668bb7d tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Request method failure captured: Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe HTTP/1.1 Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzonFVs5MkZQx3DAO4DrE_uu4E1c1_xWu4dY1HBkkCJslTtp_084qZ_eCmPiDjr5rRj1v9KIleCfzKlbOJtWgHklyceW46DxzZwCSdXioS_3YBea0FpD0un4B10OFnjci2W8Wa0CjT7yuXrPfc3FadVzQBUgu89klRccHubREEldnzA Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: cb320231db494313a74874b542b1a99f Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ImagesOneServerTestJSON-482211743 Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:07:16.616055 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:07:16.617877 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb320231db494313a74874b542b1a99f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb320231db494313a74874b542b1a99f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb320231db494313a74874b542b1a99f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb320231db494313a74874b542b1a99f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:16.617877 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ImagesOneServerTestJSON-482211743 Oct 12 22:07:16.617877 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: cb320231db494313a74874b542b1a99f Oct 12 22:07:16.617877 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-482211743 Oct 12 22:07:16.617877 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ImagesOneServerTestJSON-482211743-project Oct 12 22:07:16.617877 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:07:16.617877 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:07:16.617877 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7e19d242c6f84fafbc30b676b1a0e08e Oct 12 22:07:16.617877 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ImagesOneServerTestJSON-482211743-project Oct 12 22:07:16.617877 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:07:16.617877 n-d-861111-1 devstack@n-api.service[120452]: exception: Image not found. Oct 12 22:07:16.617877 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '1725ca6c-2486-47a7-b804-ce3d1b0afdbe'} Oct 12 22:07:16.617877 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1725ca6c-2486-47a7-b804-ce3d1b0afdbe to delete Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:16.618852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1725ca6c-2486-47a7-b804-ce3d1b0afdbe could not be found. Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:16.620207 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:16.622260 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:07:16.622260 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:07:16.622260 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:07:16.622260 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:16.622260 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:16.622260 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:16.622260 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:16.622260 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:16.622260 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:16.622260 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:16.622260 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:16.622260 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:07:16.622260 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:16.622260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0fdf135b-a53b-494f-9b70-91bcd668bb7d tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Returning 404 to user: Image not found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:16.622260 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0fdf135b-a53b-494f-9b70-91bcd668bb7d tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "DELETE /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe" status: 404 len: 62 microversion: 2.1 time: 0.062433 Oct 12 22:07:16.623762 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 956/2072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:16 2022] DELETE /compute/v2.1/images/1725ca6c-2486-47a7-b804-ce3d1b0afdbe => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:07:16.630414 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0745f2d4-b42a-41a1-b7a6-443f0cab0ce3 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.308706 Oct 12 22:07:16.631147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2981336c-9a1a-473f-aac8-95022f707c24 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:16.631703 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1117/2073] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:07:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:16.637040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c20e4c2a-d977-4091-9a8a-493d1e3e0a30 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:16.637736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c20e4c2a-d977-4091-9a8a-493d1e3e0a30 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:16.642548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2981336c-9a1a-473f-aac8-95022f707c24 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:16.652266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c20e4c2a-d977-4091-9a8a-493d1e3e0a30 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:16.653130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2981336c-9a1a-473f-aac8-95022f707c24 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:16.653631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2981336c-9a1a-473f-aac8-95022f707c24 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:16.654075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2981336c-9a1a-473f-aac8-95022f707c24 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:16.654943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c20e4c2a-d977-4091-9a8a-493d1e3e0a30 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:16.655081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2981336c-9a1a-473f-aac8-95022f707c24 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:16.655528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2981336c-9a1a-473f-aac8-95022f707c24 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:16.655930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c20e4c2a-d977-4091-9a8a-493d1e3e0a30 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:16.656158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2981336c-9a1a-473f-aac8-95022f707c24 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:16.660142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c20e4c2a-d977-4091-9a8a-493d1e3e0a30 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:16.661441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c20e4c2a-d977-4091-9a8a-493d1e3e0a30 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:16.662230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c20e4c2a-d977-4091-9a8a-493d1e3e0a30 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:16.700446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c20e4c2a-d977-4091-9a8a-493d1e3e0a30 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:07:16.704534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:16.799841 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c20e4c2a-d977-4091-9a8a-493d1e3e0a30 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 204 len: 0 microversion: 2.1 time: 0.166544 Oct 12 22:07:16.800965 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1118/2074] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:07:16 2022] DELETE /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:07:16.811543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-587ca85b-5c16-4309-b51b-c52b4f44f994 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:16.812268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-587ca85b-5c16-4309-b51b-c52b4f44f994 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:16.828163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-587ca85b-5c16-4309-b51b-c52b4f44f994 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:16.828793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-587ca85b-5c16-4309-b51b-c52b4f44f994 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:16.829253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-587ca85b-5c16-4309-b51b-c52b4f44f994 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:16.830001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-587ca85b-5c16-4309-b51b-c52b4f44f994 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:16.830468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-587ca85b-5c16-4309-b51b-c52b4f44f994 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:16.831615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-587ca85b-5c16-4309-b51b-c52b4f44f994 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:17.133272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2981336c-9a1a-473f-aac8-95022f707c24 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:17.148149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-587ca85b-5c16-4309-b51b-c52b4f44f994 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:17.156041 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-587ca85b-5c16-4309-b51b-c52b4f44f994 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1472 microversion: 2.1 time: 0.350923 Oct 12 22:07:17.160103 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1119/2075] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:16 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1472 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:07:17.166318 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2981336c-9a1a-473f-aac8-95022f707c24 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1473 microversion: 2.1 time: 0.540973 Oct 12 22:07:17.167530 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 957/2076] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:16 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1473 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:17.173236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4dd6c402-a03e-446a-ad96-e2206f5c7c6c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:17.174079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4dd6c402-a03e-446a-ad96-e2206f5c7c6c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:17.194924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4dd6c402-a03e-446a-ad96-e2206f5c7c6c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:17.195366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4dd6c402-a03e-446a-ad96-e2206f5c7c6c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:17.195747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4dd6c402-a03e-446a-ad96-e2206f5c7c6c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:17.196540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4dd6c402-a03e-446a-ad96-e2206f5c7c6c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:17.196880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4dd6c402-a03e-446a-ad96-e2206f5c7c6c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:17.197306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4dd6c402-a03e-446a-ad96-e2206f5c7c6c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:17.238669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-8c54b152-502c-4127-ae53-e4d1c00bdcb8 req-58144305-ca27-4f62-acb6-3c74aa02af44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98da0461-39ce-4bc1-9c42-66d635a94fcd", "name": "network-vif-deleted", "tag": "24945106-d2fe-4fa8-b8ef-52b83a547ea5"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:17.248212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8c54b152-502c-4127-ae53-e4d1c00bdcb8 req-58144305-ca27-4f62-acb6-3c74aa02af44 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:17.248679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8c54b152-502c-4127-ae53-e4d1c00bdcb8 req-58144305-ca27-4f62-acb6-3c74aa02af44 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:17.249101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8c54b152-502c-4127-ae53-e4d1c00bdcb8 req-58144305-ca27-4f62-acb6-3c74aa02af44 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:17.260163 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-8c54b152-502c-4127-ae53-e4d1c00bdcb8 req-58144305-ca27-4f62-acb6-3c74aa02af44 service nova] Creating event network-vif-deleted:24945106-d2fe-4fa8-b8ef-52b83a547ea5 for instance 98da0461-39ce-4bc1-9c42-66d635a94fcd on n-h1-861111-1 Oct 12 22:07:17.264919 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-8c54b152-502c-4127-ae53-e4d1c00bdcb8 req-58144305-ca27-4f62-acb6-3c74aa02af44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030290 Oct 12 22:07:17.265496 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 958/2077] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:17.345767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-017c9487-cb7e-4949-bc6d-e4a03f5d48f0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:17.346632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-017c9487-cb7e-4949-bc6d-e4a03f5d48f0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:17.353990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-017c9487-cb7e-4949-bc6d-e4a03f5d48f0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:17.354521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-017c9487-cb7e-4949-bc6d-e4a03f5d48f0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:17.354966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-017c9487-cb7e-4949-bc6d-e4a03f5d48f0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:17.355712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-017c9487-cb7e-4949-bc6d-e4a03f5d48f0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:17.356169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-017c9487-cb7e-4949-bc6d-e4a03f5d48f0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:17.356817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-017c9487-cb7e-4949-bc6d-e4a03f5d48f0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:17.458650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:17.503085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4dd6c402-a03e-446a-ad96-e2206f5c7c6c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:17.520691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4dd6c402-a03e-446a-ad96-e2206f5c7c6c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:17.524913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4dd6c402-a03e-446a-ad96-e2206f5c7c6c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:17.529970 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4dd6c402-a03e-446a-ad96-e2206f5c7c6c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.364890 Oct 12 22:07:17.530601 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1120/2078] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:17 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:17.598509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e2a303c2-9bf8-416a-a6c0-f073fb71f197 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:17.607176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e2a303c2-9bf8-416a-a6c0-f073fb71f197 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:17.625103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2a303c2-9bf8-416a-a6c0-f073fb71f197 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:17.626238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2a303c2-9bf8-416a-a6c0-f073fb71f197 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:17.626746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2a303c2-9bf8-416a-a6c0-f073fb71f197 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:17.627504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2a303c2-9bf8-416a-a6c0-f073fb71f197 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:17.628000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2a303c2-9bf8-416a-a6c0-f073fb71f197 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:17.628426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2a303c2-9bf8-416a-a6c0-f073fb71f197 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:17.654328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-017c9487-cb7e-4949-bc6d-e4a03f5d48f0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:17.682001 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-017c9487-cb7e-4949-bc6d-e4a03f5d48f0 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5" status: 200 len: 1507 microversion: 2.1 time: 0.340948 Oct 12 22:07:17.697750 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 959/2079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:17 2022] GET /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5 => generated 1507 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:17.706476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e4e46b56-134c-4efc-933d-60cccb164812 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:17.707105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e4e46b56-134c-4efc-933d-60cccb164812 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 7ad6eb67-f30e-4da4-8c4d-5b69d7f54d3d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:17.713689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4e46b56-134c-4efc-933d-60cccb164812 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:17.714234 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4e46b56-134c-4efc-933d-60cccb164812 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:17.715015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4e46b56-134c-4efc-933d-60cccb164812 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:17.716178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4e46b56-134c-4efc-933d-60cccb164812 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:17.716701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4e46b56-134c-4efc-933d-60cccb164812 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:17.717175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4e46b56-134c-4efc-933d-60cccb164812 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:17.787148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e2a303c2-9bf8-416a-a6c0-f073fb71f197 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:17.805359 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e2a303c2-9bf8-416a-a6c0-f073fb71f197 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1346 microversion: 2.1 time: 0.216289 Oct 12 22:07:17.822830 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1121/2080] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:17 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1346 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:18.185565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9c94e1b3-7f0b-49f2-b6bf-64c354a2ec13 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:18.186985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9c94e1b3-7f0b-49f2-b6bf-64c354a2ec13 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:18.211888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c94e1b3-7f0b-49f2-b6bf-64c354a2ec13 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:18.213146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c94e1b3-7f0b-49f2-b6bf-64c354a2ec13 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:18.215491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c94e1b3-7f0b-49f2-b6bf-64c354a2ec13 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:18.221079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c94e1b3-7f0b-49f2-b6bf-64c354a2ec13 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:18.223175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c94e1b3-7f0b-49f2-b6bf-64c354a2ec13 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:18.224609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c94e1b3-7f0b-49f2-b6bf-64c354a2ec13 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:18.229533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e4e46b56-134c-4efc-933d-60cccb164812 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:18.240916 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e4e46b56-134c-4efc-933d-60cccb164812 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/7ad6eb67-f30e-4da4-8c4d-5b69d7f54d3d" status: 200 len: 1508 microversion: 2.1 time: 0.538889 Oct 12 22:07:18.242678 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 960/2081] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:17 2022] GET /compute/v2.1/servers/7ad6eb67-f30e-4da4-8c4d-5b69d7f54d3d => generated 1508 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:07:18.248904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd104e1b-8500-4716-8a40-12cf678bd613 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:18.252500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cd104e1b-8500-4716-8a40-12cf678bd613 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:18.259736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd104e1b-8500-4716-8a40-12cf678bd613 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:18.260587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd104e1b-8500-4716-8a40-12cf678bd613 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:18.261271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd104e1b-8500-4716-8a40-12cf678bd613 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:18.262230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd104e1b-8500-4716-8a40-12cf678bd613 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:18.262906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd104e1b-8500-4716-8a40-12cf678bd613 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:18.263625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd104e1b-8500-4716-8a40-12cf678bd613 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:18.534402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cd104e1b-8500-4716-8a40-12cf678bd613 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:18.550961 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cd104e1b-8500-4716-8a40-12cf678bd613 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1470 microversion: 2.1 time: 0.306203 Oct 12 22:07:18.553075 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 961/2082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:18 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1470 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:18.560979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2c545931-7ca5-41b3-a5b6-91dbfa6258af tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:18.562008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2c545931-7ca5-41b3-a5b6-91dbfa6258af tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 7ad6eb67-f30e-4da4-8c4d-5b69d7f54d3d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:18.571565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c545931-7ca5-41b3-a5b6-91dbfa6258af tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:18.573013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c545931-7ca5-41b3-a5b6-91dbfa6258af tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:18.573698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c545931-7ca5-41b3-a5b6-91dbfa6258af tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:18.575000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c545931-7ca5-41b3-a5b6-91dbfa6258af tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:18.575846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c545931-7ca5-41b3-a5b6-91dbfa6258af tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:18.582054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c545931-7ca5-41b3-a5b6-91dbfa6258af tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:18.643575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2c545931-7ca5-41b3-a5b6-91dbfa6258af tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 7ad6eb67-f30e-4da4-8c4d-5b69d7f54d3d] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:07:18.846594 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2c545931-7ca5-41b3-a5b6-91dbfa6258af tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7ad6eb67-f30e-4da4-8c4d-5b69d7f54d3d" status: 204 len: 0 microversion: 2.1 time: 0.291180 Oct 12 22:07:18.849268 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 962/2083] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:07:18 2022] DELETE /compute/v2.1/servers/7ad6eb67-f30e-4da4-8c4d-5b69d7f54d3d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:07:18.863163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-b9b985e6-a96a-468f-9b29-481a300263cb req-54618c85-3f10-4e05-8e28-59c3d7b87f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0bc29c-b01a-4913-b58d-0f0368eeaa52", "name": "network-vif-unplugged", "status": "completed", "tag": "8f924ca4-6121-4359-b81c-8b01b45de897"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:18.887554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b9b985e6-a96a-468f-9b29-481a300263cb req-54618c85-3f10-4e05-8e28-59c3d7b87f59 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:18.888032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b9b985e6-a96a-468f-9b29-481a300263cb req-54618c85-3f10-4e05-8e28-59c3d7b87f59 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:18.896534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b9b985e6-a96a-468f-9b29-481a300263cb req-54618c85-3f10-4e05-8e28-59c3d7b87f59 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:18.918299 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-b9b985e6-a96a-468f-9b29-481a300263cb req-54618c85-3f10-4e05-8e28-59c3d7b87f59 service nova] Creating event network-vif-unplugged:8f924ca4-6121-4359-b81c-8b01b45de897 for instance 0a0bc29c-b01a-4913-b58d-0f0368eeaa52 on n-h1-861111-1 Oct 12 22:07:18.928430 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-b9b985e6-a96a-468f-9b29-481a300263cb req-54618c85-3f10-4e05-8e28-59c3d7b87f59 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075990 Oct 12 22:07:18.932013 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 963/2084] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:18.936685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9c94e1b3-7f0b-49f2-b6bf-64c354a2ec13 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:18.941642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0335ae52-5faf-4874-a45f-8fb5ae2cf29e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:18.943071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0335ae52-5faf-4874-a45f-8fb5ae2cf29e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:18.950459 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9c94e1b3-7f0b-49f2-b6bf-64c354a2ec13 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1472 microversion: 2.1 time: 0.769691 Oct 12 22:07:18.953002 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1122/2085] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:18 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1472 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:07:18.974559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0335ae52-5faf-4874-a45f-8fb5ae2cf29e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:18.974848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-76e3deb4-145e-4223-be3d-63e3e602bba0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:18.975262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-76e3deb4-145e-4223-be3d-63e3e602bba0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:18.976658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0335ae52-5faf-4874-a45f-8fb5ae2cf29e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:18.977876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0335ae52-5faf-4874-a45f-8fb5ae2cf29e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:18.978898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0335ae52-5faf-4874-a45f-8fb5ae2cf29e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:18.979866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0335ae52-5faf-4874-a45f-8fb5ae2cf29e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:18.981031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0335ae52-5faf-4874-a45f-8fb5ae2cf29e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:18.985311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76e3deb4-145e-4223-be3d-63e3e602bba0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:18.986138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76e3deb4-145e-4223-be3d-63e3e602bba0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:18.988700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76e3deb4-145e-4223-be3d-63e3e602bba0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:18.989609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76e3deb4-145e-4223-be3d-63e3e602bba0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:18.991172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76e3deb4-145e-4223-be3d-63e3e602bba0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:18.991790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76e3deb4-145e-4223-be3d-63e3e602bba0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:19.223107 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-76e3deb4-145e-4223-be3d-63e3e602bba0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "POST /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a/action" status: 202 len: 0 microversion: 2.1 time: 0.263959 Oct 12 22:07:19.224254 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1123/2086] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:07:18 2022] POST /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:07:19.231683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-66955993-f43d-405d-9a0a-19d77b314629 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:19.232650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-66955993-f43d-405d-9a0a-19d77b314629 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:19.245303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66955993-f43d-405d-9a0a-19d77b314629 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:19.248289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66955993-f43d-405d-9a0a-19d77b314629 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:19.248933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66955993-f43d-405d-9a0a-19d77b314629 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:19.251860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66955993-f43d-405d-9a0a-19d77b314629 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:19.253247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66955993-f43d-405d-9a0a-19d77b314629 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:19.254690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66955993-f43d-405d-9a0a-19d77b314629 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:19.255161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0335ae52-5faf-4874-a45f-8fb5ae2cf29e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:19.263635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0335ae52-5faf-4874-a45f-8fb5ae2cf29e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:19.265093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0335ae52-5faf-4874-a45f-8fb5ae2cf29e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:19.266310 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0335ae52-5faf-4874-a45f-8fb5ae2cf29e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.332725 Oct 12 22:07:19.266868 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 964/2087] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:18 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:19.295814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d7797135-cbee-4201-b0ed-91e0003ded66 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:19.296388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d7797135-cbee-4201-b0ed-91e0003ded66 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:19.307398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7797135-cbee-4201-b0ed-91e0003ded66 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:19.329544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7797135-cbee-4201-b0ed-91e0003ded66 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:19.330153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7797135-cbee-4201-b0ed-91e0003ded66 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:19.331204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7797135-cbee-4201-b0ed-91e0003ded66 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:19.332698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7797135-cbee-4201-b0ed-91e0003ded66 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:19.333139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7797135-cbee-4201-b0ed-91e0003ded66 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:19.367594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d7797135-cbee-4201-b0ed-91e0003ded66 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 041bb415-1452-4d7f-9a45-5c8592816cf5] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:07:19.445029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:19.482390 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d7797135-cbee-4201-b0ed-91e0003ded66 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "DELETE /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5" status: 204 len: 0 microversion: 2.1 time: 0.205156 Oct 12 22:07:19.483408 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 965/2088] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:07:19 2022] DELETE /compute/v2.1/servers/041bb415-1452-4d7f-9a45-5c8592816cf5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:07:19.495031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b3300a77-1683-4ce8-87de-2e6d9157ec4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:19.496908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b3300a77-1683-4ce8-87de-2e6d9157ec4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:19.503909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3300a77-1683-4ce8-87de-2e6d9157ec4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:19.504659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3300a77-1683-4ce8-87de-2e6d9157ec4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:19.505292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3300a77-1683-4ce8-87de-2e6d9157ec4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:19.506173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3300a77-1683-4ce8-87de-2e6d9157ec4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:19.506801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3300a77-1683-4ce8-87de-2e6d9157ec4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:19.507476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3300a77-1683-4ce8-87de-2e6d9157ec4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:19.749561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b3300a77-1683-4ce8-87de-2e6d9157ec4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:19.760314 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b3300a77-1683-4ce8-87de-2e6d9157ec4e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1469 microversion: 2.1 time: 0.274657 Oct 12 22:07:19.764031 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 966/2089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:19 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1469 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:19.776431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-538076699", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "98fd53ad-7751-4489-a42d-3d61dadc600b"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:19.815685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-66955993-f43d-405d-9a0a-19d77b314629 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:19.824587 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-66955993-f43d-405d-9a0a-19d77b314629 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1184 microversion: 2.1 time: 0.598119 Oct 12 22:07:19.825178 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1124/2090] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:19 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1184 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:19.892061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] validate_networks() for [('98fd53ad-7751-4489-a42d-3d61dadc600b', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:07:19.981001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-97145e9e-083a-4152-84c8-e5dce82c7df8 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:19.981639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-97145e9e-083a-4152-84c8-e5dce82c7df8 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:19.983926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:19.995202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97145e9e-083a-4152-84c8-e5dce82c7df8 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:19.995754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97145e9e-083a-4152-84c8-e5dce82c7df8 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:19.996296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97145e9e-083a-4152-84c8-e5dce82c7df8 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:19.997470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97145e9e-083a-4152-84c8-e5dce82c7df8 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:19.997470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97145e9e-083a-4152-84c8-e5dce82c7df8 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:19.998182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97145e9e-083a-4152-84c8-e5dce82c7df8 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:20.268740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-97145e9e-083a-4152-84c8-e5dce82c7df8 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:20.281722 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-97145e9e-083a-4152-84c8-e5dce82c7df8 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1472 microversion: 2.1 time: 0.304852 Oct 12 22:07:20.282524 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1125/2091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:19 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1472 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:07:20.295901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c0a88036-6958-4271-9ea5-b5fd9cff8fe7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:20.296837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c0a88036-6958-4271-9ea5-b5fd9cff8fe7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:20.312041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0a88036-6958-4271-9ea5-b5fd9cff8fe7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:20.313004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0a88036-6958-4271-9ea5-b5fd9cff8fe7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:20.313716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0a88036-6958-4271-9ea5-b5fd9cff8fe7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:20.315907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0a88036-6958-4271-9ea5-b5fd9cff8fe7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:20.320393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0a88036-6958-4271-9ea5-b5fd9cff8fe7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:20.321111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0a88036-6958-4271-9ea5-b5fd9cff8fe7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:20.601653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c0a88036-6958-4271-9ea5-b5fd9cff8fe7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:20.612015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c0a88036-6958-4271-9ea5-b5fd9cff8fe7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:20.625808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c0a88036-6958-4271-9ea5-b5fd9cff8fe7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:20.627542 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c0a88036-6958-4271-9ea5-b5fd9cff8fe7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.335757 Oct 12 22:07:20.628677 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1126/2092] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:20 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:20.792792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-300b0de0-d6d7-4d6e-8ce4-25e3d45c0651 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:20.793730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-300b0de0-d6d7-4d6e-8ce4-25e3d45c0651 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:20.809468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-300b0de0-d6d7-4d6e-8ce4-25e3d45c0651 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:20.810354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-300b0de0-d6d7-4d6e-8ce4-25e3d45c0651 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:20.811032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-300b0de0-d6d7-4d6e-8ce4-25e3d45c0651 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:20.811988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-300b0de0-d6d7-4d6e-8ce4-25e3d45c0651 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:20.812715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-300b0de0-d6d7-4d6e-8ce4-25e3d45c0651 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:20.813278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-300b0de0-d6d7-4d6e-8ce4-25e3d45c0651 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:21.298192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-300b0de0-d6d7-4d6e-8ce4-25e3d45c0651 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:21.308239 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-300b0de0-d6d7-4d6e-8ce4-25e3d45c0651 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1469 microversion: 2.1 time: 0.519239 Oct 12 22:07:21.313504 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1127/2093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:20 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1469 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:07:21.320855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-92e00a08-26bd-4593-8ab4-cbeb70eac912 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:21.325073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-92e00a08-26bd-4593-8ab4-cbeb70eac912 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:21.332669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92e00a08-26bd-4593-8ab4-cbeb70eac912 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:21.334182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92e00a08-26bd-4593-8ab4-cbeb70eac912 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:21.334787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92e00a08-26bd-4593-8ab4-cbeb70eac912 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:21.335740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92e00a08-26bd-4593-8ab4-cbeb70eac912 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:21.336361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92e00a08-26bd-4593-8ab4-cbeb70eac912 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:21.337051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92e00a08-26bd-4593-8ab4-cbeb70eac912 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:21.477910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-92e00a08-26bd-4593-8ab4-cbeb70eac912 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:21.495488 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-92e00a08-26bd-4593-8ab4-cbeb70eac912 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1184 microversion: 2.1 time: 0.180760 Oct 12 22:07:21.510200 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1128/2094] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:21 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1184 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:21.522432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d9e64ecb-17d5-48b7-a098-8f7659ceafe2 req-60e50aa9-0020-41fb-8d47-a10b06095efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15055486-69c3-4d87-99da-927949deea8a", "name": "network-vif-plugged", "status": "completed", "tag": "fec38738-06d0-4ba1-b408-8e99dc334dea"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:21.556190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d9e64ecb-17d5-48b7-a098-8f7659ceafe2 req-60e50aa9-0020-41fb-8d47-a10b06095efa service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:21.556822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d9e64ecb-17d5-48b7-a098-8f7659ceafe2 req-60e50aa9-0020-41fb-8d47-a10b06095efa service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:21.557344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d9e64ecb-17d5-48b7-a098-8f7659ceafe2 req-60e50aa9-0020-41fb-8d47-a10b06095efa service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:21.588000 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d9e64ecb-17d5-48b7-a098-8f7659ceafe2 req-60e50aa9-0020-41fb-8d47-a10b06095efa service nova] Creating event network-vif-plugged:fec38738-06d0-4ba1-b408-8e99dc334dea for instance 15055486-69c3-4d87-99da-927949deea8a on n-h2-861111-1 Oct 12 22:07:21.588847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:07:21.592957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:07:21.593754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:07:21.594922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:07:21.596051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:07:21.603620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-d9e64ecb-17d5-48b7-a098-8f7659ceafe2 req-60e50aa9-0020-41fb-8d47-a10b06095efa service nova] Instance 15055486-69c3-4d87-99da-927949deea8a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:07:21.628463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:21.629230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:21.629820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:21.633722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:21.634412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:21.635020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:21.643611 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d9e64ecb-17d5-48b7-a098-8f7659ceafe2 req-60e50aa9-0020-41fb-8d47-a10b06095efa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125848 Oct 12 22:07:21.644987 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1129/2095] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:21.657389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0e9a90b1-56e4-489d-badb-e5a43d375283 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:21.663672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0e9a90b1-56e4-489d-badb-e5a43d375283 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:21.678456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e9a90b1-56e4-489d-badb-e5a43d375283 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:21.681504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e9a90b1-56e4-489d-badb-e5a43d375283 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:21.682060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e9a90b1-56e4-489d-badb-e5a43d375283 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:21.684935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e9a90b1-56e4-489d-badb-e5a43d375283 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:21.686327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e9a90b1-56e4-489d-badb-e5a43d375283 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:21.686862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e9a90b1-56e4-489d-badb-e5a43d375283 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:21.700931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Getting quotas for project 04e80cd4201d427189c6f50ca7e9532a. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:07:21.711497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Getting quotas for user 5536917f69c1495b9363dc8704154aa8 and project 04e80cd4201d427189c6f50ca7e9532a. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:07:21.738494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Going to run 2 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:07:21.740895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 29bd3420-7cb1-4a2d-9e61-815d446f1a92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:07:21.779345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=29bd3420-7cb1-4a2d-9e61-815d446f1a92,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:07:21.848796 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-08d04340-82a4-4860-9fb8-28f5d23a3828 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.083644 Oct 12 22:07:21.852977 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 967/2096] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:07:19 2022] POST /compute/v2.1/servers => generated 32 bytes in 2088 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:07:21.858957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-97046733-3a92-4462-8ad7-f3a1429a2c39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:21.859791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-97046733-3a92-4462-8ad7-f3a1429a2c39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:21.870406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97046733-3a92-4462-8ad7-f3a1429a2c39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:21.871908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97046733-3a92-4462-8ad7-f3a1429a2c39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:21.872649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97046733-3a92-4462-8ad7-f3a1429a2c39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:21.873593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97046733-3a92-4462-8ad7-f3a1429a2c39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:21.874360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97046733-3a92-4462-8ad7-f3a1429a2c39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:21.875036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97046733-3a92-4462-8ad7-f3a1429a2c39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:22.199108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0e9a90b1-56e4-489d-badb-e5a43d375283 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:22.212036 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0e9a90b1-56e4-489d-badb-e5a43d375283 tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1430 microversion: 2.1 time: 0.564436 Oct 12 22:07:22.218964 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1130/2097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:21 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1430 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:22.234773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-77ee923e-0968-4404-b69d-712369587663 req-45f30f86-5a40-425b-8c34-446e439fe804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0bc29c-b01a-4913-b58d-0f0368eeaa52", "name": "network-vif-deleted", "tag": "8f924ca4-6121-4359-b81c-8b01b45de897"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:22.259073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-77ee923e-0968-4404-b69d-712369587663 req-45f30f86-5a40-425b-8c34-446e439fe804 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:22.259507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-77ee923e-0968-4404-b69d-712369587663 req-45f30f86-5a40-425b-8c34-446e439fe804 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:22.259957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-77ee923e-0968-4404-b69d-712369587663 req-45f30f86-5a40-425b-8c34-446e439fe804 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:22.290431 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-77ee923e-0968-4404-b69d-712369587663 req-45f30f86-5a40-425b-8c34-446e439fe804 service nova] Creating event network-vif-deleted:8f924ca4-6121-4359-b81c-8b01b45de897 for instance 0a0bc29c-b01a-4913-b58d-0f0368eeaa52 on n-h1-861111-1 Oct 12 22:07:22.311953 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-77ee923e-0968-4404-b69d-712369587663 req-45f30f86-5a40-425b-8c34-446e439fe804 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091058 Oct 12 22:07:22.315012 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1131/2098] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:22.341753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6ba1f957-0cf5-4445-b33d-7d1c4a772ef8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:22.375051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6ba1f957-0cf5-4445-b33d-7d1c4a772ef8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:22.375991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6ba1f957-0cf5-4445-b33d-7d1c4a772ef8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Searching by: {'deleted': False, 'project_id': '04e80cd4201d427189c6f50ca7e9532a'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:07:22.420001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ba1f957-0cf5-4445-b33d-7d1c4a772ef8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:22.420521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ba1f957-0cf5-4445-b33d-7d1c4a772ef8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:22.420974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ba1f957-0cf5-4445-b33d-7d1c4a772ef8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:22.422022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ba1f957-0cf5-4445-b33d-7d1c4a772ef8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:22.422259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ba1f957-0cf5-4445-b33d-7d1c4a772ef8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:22.431056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ba1f957-0cf5-4445-b33d-7d1c4a772ef8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:22.490258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-6ba1f957-0cf5-4445-b33d-7d1c4a772ef8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:07:22.609169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:22.624034 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6ba1f957-0cf5-4445-b33d-7d1c4a772ef8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.301395 Oct 12 22:07:22.625113 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1132/2099] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 12 22:07:22 2022] GET /compute/v2.1/servers => generated 1335 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:22.646542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fd3a358f-1410-4a35-a76b-cf60aba4ad55 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:22.651138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fd3a358f-1410-4a35-a76b-cf60aba4ad55 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:22.682466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-97046733-3a92-4462-8ad7-f3a1429a2c39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:22.695802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3a358f-1410-4a35-a76b-cf60aba4ad55 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:22.701121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3a358f-1410-4a35-a76b-cf60aba4ad55 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:22.702447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3a358f-1410-4a35-a76b-cf60aba4ad55 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:22.704196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3a358f-1410-4a35-a76b-cf60aba4ad55 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:22.705649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3a358f-1410-4a35-a76b-cf60aba4ad55 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:22.706030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-97046733-3a92-4462-8ad7-f3a1429a2c39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:22.708003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-97046733-3a92-4462-8ad7-f3a1429a2c39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:22.708563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3a358f-1410-4a35-a76b-cf60aba4ad55 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:22.715987 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-97046733-3a92-4462-8ad7-f3a1429a2c39 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.861667 Oct 12 22:07:22.737006 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 968/2100] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:21 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:22.754264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b2a13110-c8c6-4274-a870-1a2e98897d15 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:22.755361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b2a13110-c8c6-4274-a870-1a2e98897d15 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:22.767749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2a13110-c8c6-4274-a870-1a2e98897d15 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:22.770357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2a13110-c8c6-4274-a870-1a2e98897d15 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:22.771744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2a13110-c8c6-4274-a870-1a2e98897d15 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:22.772812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2a13110-c8c6-4274-a870-1a2e98897d15 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:22.775848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2a13110-c8c6-4274-a870-1a2e98897d15 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:22.776565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2a13110-c8c6-4274-a870-1a2e98897d15 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:22.901922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b2a13110-c8c6-4274-a870-1a2e98897d15 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:22.910845 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b2a13110-c8c6-4274-a870-1a2e98897d15 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1184 microversion: 2.1 time: 0.172575 Oct 12 22:07:22.925340 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 969/2101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:22 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1184 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:22.925340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-02d7af74-4815-4fff-b4aa-c89c8486b435 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:22.925340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-02d7af74-4815-4fff-b4aa-c89c8486b435 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:23.040443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-02d7af74-4815-4fff-b4aa-c89c8486b435 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:23.057357 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-02d7af74-4815-4fff-b4aa-c89c8486b435 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d" status: 200 len: 1217 microversion: 2.1 time: 0.143915 Oct 12 22:07:23.059400 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 970/2102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:22 2022] GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d => generated 1217 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:23.245350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-54e29e07-178e-4a20-8481-f6a62c858daf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:23.246112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-54e29e07-178e-4a20-8481-f6a62c858daf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:23.261626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54e29e07-178e-4a20-8481-f6a62c858daf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:23.281859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54e29e07-178e-4a20-8481-f6a62c858daf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:23.286597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54e29e07-178e-4a20-8481-f6a62c858daf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:23.287667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54e29e07-178e-4a20-8481-f6a62c858daf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:23.291133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54e29e07-178e-4a20-8481-f6a62c858daf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:23.298261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54e29e07-178e-4a20-8481-f6a62c858daf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:23.347091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fd3a358f-1410-4a35-a76b-cf60aba4ad55 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:23.356154 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fd3a358f-1410-4a35-a76b-cf60aba4ad55 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1469 microversion: 2.1 time: 0.724542 Oct 12 22:07:23.376159 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1133/2103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:22 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1469 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:23.396609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-75844e87-7e1a-4df3-9473-6bdf31a1c552 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Action: 'create', calling method: .version_select at 0x7f512355b940>, body: {"keypair": {"name": "tempest-keypair-1142826161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMdGVhU2cpBM/u8ueW9yJjXm2uBwVSpTTVJ+9q4bQKNfQpsHjd3feunMj1eFKpX8jASSRHmjc6LovadOmlgZt++OI6JqQzg3cuhkoSYdryRdnwvY2fBfQznCrkZ8LMFEg=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:23.413998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54e29e07-178e-4a20-8481-f6a62c858daf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:23.416135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54e29e07-178e-4a20-8481-f6a62c858daf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:23.416809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54e29e07-178e-4a20-8481-f6a62c858daf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:23.421300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-54e29e07-178e-4a20-8481-f6a62c858daf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lazy-loading 'fault' on Instance uuid 0a0bc29c-b01a-4913-b58d-0f0368eeaa52 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:07:23.432601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-75844e87-7e1a-4df3-9473-6bdf31a1c552 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Getting quotas for project 68913d260d084ce4a8e29daf4783c0bc. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:07:23.440988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-75844e87-7e1a-4df3-9473-6bdf31a1c552 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Getting quotas for user 13c74a78e82f4e72a7d1f7b133074f5a and project 68913d260d084ce4a8e29daf4783c0bc. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:07:23.490725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-54e29e07-178e-4a20-8481-f6a62c858daf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e19d242c6f84fafbc30b676b1a0e08e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb320231db494313a74874b542b1a99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:23.491738 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-75844e87-7e1a-4df3-9473-6bdf31a1c552 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113933 Oct 12 22:07:23.499026 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1134/2104] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:07:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:23.499788 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-54e29e07-178e-4a20-8481-f6a62c858daf tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 200 len: 1306 microversion: 2.1 time: 0.259228 Oct 12 22:07:23.503390 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 971/2105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:23 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 1306 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:23.744439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eca91e40-d0e6-443d-ae30-34e1a3acf3d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:23.745572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eca91e40-d0e6-443d-ae30-34e1a3acf3d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:23.757180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eca91e40-d0e6-443d-ae30-34e1a3acf3d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:23.758065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eca91e40-d0e6-443d-ae30-34e1a3acf3d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:23.767974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eca91e40-d0e6-443d-ae30-34e1a3acf3d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:23.769062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eca91e40-d0e6-443d-ae30-34e1a3acf3d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:23.769542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eca91e40-d0e6-443d-ae30-34e1a3acf3d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:23.770070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eca91e40-d0e6-443d-ae30-34e1a3acf3d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:23.942559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-66b6b9d6-4e90-485a-816e-5cbfda326383 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:23.944958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-66b6b9d6-4e90-485a-816e-5cbfda326383 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:23.961700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66b6b9d6-4e90-485a-816e-5cbfda326383 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:23.962495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66b6b9d6-4e90-485a-816e-5cbfda326383 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:23.964245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66b6b9d6-4e90-485a-816e-5cbfda326383 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:23.965278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66b6b9d6-4e90-485a-816e-5cbfda326383 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:23.966789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66b6b9d6-4e90-485a-816e-5cbfda326383 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:23.969483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66b6b9d6-4e90-485a-816e-5cbfda326383 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:24.141693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-66b6b9d6-4e90-485a-816e-5cbfda326383 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:24.155569 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-66b6b9d6-4e90-485a-816e-5cbfda326383 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1184 microversion: 2.1 time: 0.218784 Oct 12 22:07:24.155569 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 972/2106] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:23 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1184 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:07:24.184673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5860764e-d4e9-42b4-9c6f-b0235b451020 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:24.187140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5860764e-d4e9-42b4-9c6f-b0235b451020 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:24.198947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5860764e-d4e9-42b4-9c6f-b0235b451020 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:24.202011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5860764e-d4e9-42b4-9c6f-b0235b451020 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:24.202704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5860764e-d4e9-42b4-9c6f-b0235b451020 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:24.205914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5860764e-d4e9-42b4-9c6f-b0235b451020 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:24.206707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5860764e-d4e9-42b4-9c6f-b0235b451020 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:24.207867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5860764e-d4e9-42b4-9c6f-b0235b451020 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:24.350037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5860764e-d4e9-42b4-9c6f-b0235b451020 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:24.365793 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5860764e-d4e9-42b4-9c6f-b0235b451020 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d" status: 200 len: 1213 microversion: 2.1 time: 0.190490 Oct 12 22:07:24.368698 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 973/2107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:24 2022] GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d => generated 1213 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:24.398366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-151b9c9f-fa2c-4cfa-a785-cf25995569b8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:24.400159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-151b9c9f-fa2c-4cfa-a785-cf25995569b8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:24.417288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-151b9c9f-fa2c-4cfa-a785-cf25995569b8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:24.419897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-151b9c9f-fa2c-4cfa-a785-cf25995569b8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:24.421482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-151b9c9f-fa2c-4cfa-a785-cf25995569b8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:24.423859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-151b9c9f-fa2c-4cfa-a785-cf25995569b8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:24.424636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-151b9c9f-fa2c-4cfa-a785-cf25995569b8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:24.425847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-151b9c9f-fa2c-4cfa-a785-cf25995569b8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:24.824593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-151b9c9f-fa2c-4cfa-a785-cf25995569b8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:24.837262 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-151b9c9f-fa2c-4cfa-a785-cf25995569b8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1469 microversion: 2.1 time: 0.446812 Oct 12 22:07:24.841727 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 974/2108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:24 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1469 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:07:24.849909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-450bb44a-2817-411e-bb87-ea71bf9479bd tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:24.850467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-450bb44a-2817-411e-bb87-ea71bf9479bd tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] [instance: 0a0bc29c-b01a-4913-b58d-0f0368eeaa52] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:24.859985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-450bb44a-2817-411e-bb87-ea71bf9479bd tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:24.861543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-450bb44a-2817-411e-bb87-ea71bf9479bd tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:24.862176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-450bb44a-2817-411e-bb87-ea71bf9479bd tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:24.864447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eca91e40-d0e6-443d-ae30-34e1a3acf3d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:24.869981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-450bb44a-2817-411e-bb87-ea71bf9479bd tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:24.872013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-450bb44a-2817-411e-bb87-ea71bf9479bd tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:24.872721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-450bb44a-2817-411e-bb87-ea71bf9479bd tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:24.883255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eca91e40-d0e6-443d-ae30-34e1a3acf3d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:24.889148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eca91e40-d0e6-443d-ae30-34e1a3acf3d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:24.890421 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eca91e40-d0e6-443d-ae30-34e1a3acf3d6 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 1.150829 Oct 12 22:07:24.899757 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1135/2109] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:23 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:24.904801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-6cdb1385-1b8d-4e45-884e-0a8046d2e5a0 req-2f99c30d-b1fe-4d2a-8d18-54df41ff869e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad6eb67-f30e-4da4-8c4d-5b69d7f54d3d", "name": "network-vif-deleted", "tag": "304ce487-f459-4010-9f68-e18af787eb41"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:24.933550 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-450bb44a-2817-411e-bb87-ea71bf9479bd tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] HTTP exception thrown: Instance 0a0bc29c-b01a-4913-b58d-0f0368eeaa52 could not be found. Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-450bb44a-2817-411e-bb87-ea71bf9479bd tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Request method failure captured: Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 HTTP/1.1 Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzonFVs5MkZQx3DAO4DrE_uu4E1c1_xWu4dY1HBkkCJslTtp_084qZ_eCmPiDjr5rRj1v9KIleCfzKlbOJtWgHklyceW46DxzZwCSdXioS_3YBea0FpD0un4B10OFnjci2W8Wa0CjT7yuXrPfc3FadVzQBUgu89klRccHubREEldnzA Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: cb320231db494313a74874b542b1a99f Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ImagesOneServerTestJSON-482211743 Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:07:24.938422 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:07:24.940486 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb320231db494313a74874b542b1a99f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb320231db494313a74874b542b1a99f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb320231db494313a74874b542b1a99f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb320231db494313a74874b542b1a99f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:24.940486 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ImagesOneServerTestJSON-482211743 Oct 12 22:07:24.940486 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: cb320231db494313a74874b542b1a99f Oct 12 22:07:24.940486 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-482211743 Oct 12 22:07:24.940486 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ImagesOneServerTestJSON-482211743-project Oct 12 22:07:24.940486 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:07:24.940486 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:07:24.940486 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7e19d242c6f84fafbc30b676b1a0e08e Oct 12 22:07:24.940486 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ImagesOneServerTestJSON-482211743-project Oct 12 22:07:24.940486 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:07:24.940486 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 0a0bc29c-b01a-4913-b58d-0f0368eeaa52 could not be found. Oct 12 22:07:24.940486 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '0a0bc29c-b01a-4913-b58d-0f0368eeaa52'} Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a0bc29c-b01a-4913-b58d-0f0368eeaa52 could not be found. Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:24.941606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a0bc29c-b01a-4913-b58d-0f0368eeaa52 could not be found. Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a0bc29c-b01a-4913-b58d-0f0368eeaa52 could not be found. Oct 12 22:07:24.943917 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:24.945710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-450bb44a-2817-411e-bb87-ea71bf9479bd tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] Returning 404 to user: Instance 0a0bc29c-b01a-4913-b58d-0f0368eeaa52 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:24.945710 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-450bb44a-2817-411e-bb87-ea71bf9479bd tempest-ImagesOneServerTestJSON-482211743 tempest-ImagesOneServerTestJSON-482211743-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52" status: 404 len: 111 microversion: 2.1 time: 0.097239 Oct 12 22:07:24.945710 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 975/2110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:24 2022] GET /compute/v2.1/servers/0a0bc29c-b01a-4913-b58d-0f0368eeaa52 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:07:24.950211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6cdb1385-1b8d-4e45-884e-0a8046d2e5a0 req-2f99c30d-b1fe-4d2a-8d18-54df41ff869e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:24.951337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6cdb1385-1b8d-4e45-884e-0a8046d2e5a0 req-2f99c30d-b1fe-4d2a-8d18-54df41ff869e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:24.952192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6cdb1385-1b8d-4e45-884e-0a8046d2e5a0 req-2f99c30d-b1fe-4d2a-8d18-54df41ff869e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:24.974063 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6cdb1385-1b8d-4e45-884e-0a8046d2e5a0 req-2f99c30d-b1fe-4d2a-8d18-54df41ff869e service nova] Creating event network-vif-deleted:304ce487-f459-4010-9f68-e18af787eb41 for instance 7ad6eb67-f30e-4da4-8c4d-5b69d7f54d3d on n-h1-861111-1 Oct 12 22:07:24.997268 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-6cdb1385-1b8d-4e45-884e-0a8046d2e5a0 req-2f99c30d-b1fe-4d2a-8d18-54df41ff869e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095910 Oct 12 22:07:24.997895 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1136/2111] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:25.185113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6c9617c7-d281-48a5-bd7b-b98580f20040 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:25.185758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6c9617c7-d281-48a5-bd7b-b98580f20040 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:25.192514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c9617c7-d281-48a5-bd7b-b98580f20040 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:25.193281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c9617c7-d281-48a5-bd7b-b98580f20040 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:25.193890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c9617c7-d281-48a5-bd7b-b98580f20040 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:25.195018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c9617c7-d281-48a5-bd7b-b98580f20040 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:25.195671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c9617c7-d281-48a5-bd7b-b98580f20040 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:25.196460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c9617c7-d281-48a5-bd7b-b98580f20040 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:25.295140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d0005317-e132-45b3-999b-1dc1de8bf2c4 req-dfc34d71-b0de-40e1-8c65-815ad20cbd6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041bb415-1452-4d7f-9a45-5c8592816cf5", "name": "network-vif-deleted", "tag": "4938ca12-9234-4ba1-9d52-dc286559ab04"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:25.309015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6c9617c7-d281-48a5-bd7b-b98580f20040 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:25.320146 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6c9617c7-d281-48a5-bd7b-b98580f20040 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 200 len: 1184 microversion: 2.1 time: 0.136743 Oct 12 22:07:25.322166 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 976/2112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:25 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 1184 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:25.325285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d0005317-e132-45b3-999b-1dc1de8bf2c4 req-dfc34d71-b0de-40e1-8c65-815ad20cbd6e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:25.331925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d0005317-e132-45b3-999b-1dc1de8bf2c4 req-dfc34d71-b0de-40e1-8c65-815ad20cbd6e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:25.332599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d0005317-e132-45b3-999b-1dc1de8bf2c4 req-dfc34d71-b0de-40e1-8c65-815ad20cbd6e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:25.355696 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d0005317-e132-45b3-999b-1dc1de8bf2c4 req-dfc34d71-b0de-40e1-8c65-815ad20cbd6e service nova] Creating event network-vif-deleted:4938ca12-9234-4ba1-9d52-dc286559ab04 for instance 041bb415-1452-4d7f-9a45-5c8592816cf5 on n-h1-861111-1 Oct 12 22:07:25.372055 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d0005317-e132-45b3-999b-1dc1de8bf2c4 req-dfc34d71-b0de-40e1-8c65-815ad20cbd6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080805 Oct 12 22:07:25.373259 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1137/2113] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:25.397134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3e61a094-0a86-41a6-9ce5-bf79d3535299 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:25.398180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3e61a094-0a86-41a6-9ce5-bf79d3535299 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:25.408074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e61a094-0a86-41a6-9ce5-bf79d3535299 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:25.412183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e61a094-0a86-41a6-9ce5-bf79d3535299 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:25.412885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e61a094-0a86-41a6-9ce5-bf79d3535299 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:25.413840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e61a094-0a86-41a6-9ce5-bf79d3535299 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:25.416608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e61a094-0a86-41a6-9ce5-bf79d3535299 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:25.417383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e61a094-0a86-41a6-9ce5-bf79d3535299 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:25.525102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-556356610", "imageRef": "7e0d8ff0-d581-47ff-a27f-62466321adde", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "11865406-94c7-4d22-a4da-1de23c713979"}], "security_groups": [{"name": "tempest-securitygroup--211779724"}], "key_name": "tempest-keypair-1786249007", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:25.694974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3e61a094-0a86-41a6-9ce5-bf79d3535299 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:25.717707 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3e61a094-0a86-41a6-9ce5-bf79d3535299 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d" status: 200 len: 1269 microversion: 2.1 time: 0.322379 Oct 12 22:07:25.722809 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 977/2114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:25 2022] GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d => generated 1269 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:25.854720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] validate_networks() for [('11865406-94c7-4d22-a4da-1de23c713979', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:07:26.437897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-700321af-80f1-40e6-9d76-29e169babf6b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:26.438542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-700321af-80f1-40e6-9d76-29e169babf6b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:26.455539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-700321af-80f1-40e6-9d76-29e169babf6b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:26.456400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-700321af-80f1-40e6-9d76-29e169babf6b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:26.456943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-700321af-80f1-40e6-9d76-29e169babf6b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:26.457668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-700321af-80f1-40e6-9d76-29e169babf6b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:26.458125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-700321af-80f1-40e6-9d76-29e169babf6b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:26.458799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-700321af-80f1-40e6-9d76-29e169babf6b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:27.070307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-700321af-80f1-40e6-9d76-29e169babf6b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:27.081154 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-700321af-80f1-40e6-9d76-29e169babf6b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1469 microversion: 2.1 time: 1.215952 Oct 12 22:07:27.086389 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 978/2115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:25 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1469 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:27.095072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c7741203-fc5a-46fa-a6ce-2cf0dc473845 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:27.095926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c7741203-fc5a-46fa-a6ce-2cf0dc473845 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:27.112737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7741203-fc5a-46fa-a6ce-2cf0dc473845 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:27.113429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7741203-fc5a-46fa-a6ce-2cf0dc473845 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:27.114156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7741203-fc5a-46fa-a6ce-2cf0dc473845 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:27.115064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7741203-fc5a-46fa-a6ce-2cf0dc473845 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:27.115738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7741203-fc5a-46fa-a6ce-2cf0dc473845 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:27.116335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7741203-fc5a-46fa-a6ce-2cf0dc473845 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:27.704990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:07:27.706525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:07:27.709188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:07:27.709904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:07:27.710534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:07:27.736953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:27.738076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:27.738879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:27.739944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:27.740771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:27.741409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:27.773707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c7741203-fc5a-46fa-a6ce-2cf0dc473845 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:27.789937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c7741203-fc5a-46fa-a6ce-2cf0dc473845 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:27.791529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Getting quotas for project ebf3c61412cf43f691e7af5d26e740bd. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:07:27.800440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c7741203-fc5a-46fa-a6ce-2cf0dc473845 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:27.802020 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c7741203-fc5a-46fa-a6ce-2cf0dc473845 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.714246 Oct 12 22:07:27.805056 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 979/2116] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:27 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:27.813752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2bdf6221-ceaa-4fc8-95a8-94eaef4f68fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:27.814736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2bdf6221-ceaa-4fc8-95a8-94eaef4f68fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 98da0461-39ce-4bc1-9c42-66d635a94fcd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:27.825296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Getting quotas for user 4d9e20674549401c89b9d264d1167f3a and project ebf3c61412cf43f691e7af5d26e740bd. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:07:27.854197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2bdf6221-ceaa-4fc8-95a8-94eaef4f68fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:27.854323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2bdf6221-ceaa-4fc8-95a8-94eaef4f68fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:27.855961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2bdf6221-ceaa-4fc8-95a8-94eaef4f68fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:27.858661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2bdf6221-ceaa-4fc8-95a8-94eaef4f68fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:27.859306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2bdf6221-ceaa-4fc8-95a8-94eaef4f68fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:27.861585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2bdf6221-ceaa-4fc8-95a8-94eaef4f68fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:27.864095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:07:27.872004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7e0d8ff0-d581-47ff-a27f-62466321adde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:07:27.902486 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-2bdf6221-ceaa-4fc8-95a8-94eaef4f68fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] HTTP exception thrown: Instance 98da0461-39ce-4bc1-9c42-66d635a94fcd could not be found. Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2bdf6221-ceaa-4fc8-95a8-94eaef4f68fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Request method failure captured: Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd HTTP/1.1 Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzjWa7fW4cCWMnkS2ihtgUCglzU38ChAzYORmM7Dbu9VoPpmuOcvF68E2HOkgVWjtO59JzvrNcPt6cpEPfgvTwc8u3yOUJpSVFhJvxoJSFOpL6COZC7hUepcrA4h6-wO_W4qNSt17id_hM0-SJoaXsiZjl3SD74vmQRJZQN-oA7sWak Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 61e71a9eeaa044e8aa939548f15a585e Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-LiveMigrationTest-68417645 Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:07:27.911638 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:07:27.913516 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61e71a9eeaa044e8aa939548f15a585e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61e71a9eeaa044e8aa939548f15a585e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_61e71a9eeaa044e8aa939548f15a585e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/61e71a9eeaa044e8aa939548f15a585e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:27.913516 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-LiveMigrationTest-68417645 Oct 12 22:07:27.913516 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 61e71a9eeaa044e8aa939548f15a585e Oct 12 22:07:27.913516 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-LiveMigrationTest-68417645 Oct 12 22:07:27.913516 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-LiveMigrationTest-68417645-project Oct 12 22:07:27.913516 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:07:27.913516 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:07:27.913516 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 1fe98ba1ceec4b849eb45eb46ce4d425 Oct 12 22:07:27.913516 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-LiveMigrationTest-68417645-project Oct 12 22:07:27.913516 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:07:27.913516 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 98da0461-39ce-4bc1-9c42-66d635a94fcd could not be found. Oct 12 22:07:27.913516 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '98da0461-39ce-4bc1-9c42-66d635a94fcd'} Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98da0461-39ce-4bc1-9c42-66d635a94fcd could not be found. Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:27.914577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98da0461-39ce-4bc1-9c42-66d635a94fcd could not be found. Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98da0461-39ce-4bc1-9c42-66d635a94fcd could not be found. Oct 12 22:07:27.916263 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:27.917708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2bdf6221-ceaa-4fc8-95a8-94eaef4f68fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Returning 404 to user: Instance 98da0461-39ce-4bc1-9c42-66d635a94fcd could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:27.918938 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2bdf6221-ceaa-4fc8-95a8-94eaef4f68fd tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd" status: 404 len: 111 microversion: 2.1 time: 0.105687 Oct 12 22:07:27.919282 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 980/2117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:27 2022] GET /compute/v2.1/servers/98da0461-39ce-4bc1-9c42-66d635a94fcd => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:07:27.957105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-95df2ae5-94eb-405a-aac9-58702a9bed36 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:27.957799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-95df2ae5-94eb-405a-aac9-58702a9bed36 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:27.985816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95df2ae5-94eb-405a-aac9-58702a9bed36 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:27.986321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95df2ae5-94eb-405a-aac9-58702a9bed36 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:27.991470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95df2ae5-94eb-405a-aac9-58702a9bed36 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:28.000567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95df2ae5-94eb-405a-aac9-58702a9bed36 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:28.001118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95df2ae5-94eb-405a-aac9-58702a9bed36 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:28.001553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95df2ae5-94eb-405a-aac9-58702a9bed36 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:28.076457 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3be476ce-8165-4888-bfd4-cc948785d7ae tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.556024 Oct 12 22:07:28.077119 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1138/2118] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:07:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 2558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:07:28.110240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-284d8718-e2bf-4b45-bb29-264e962927ee req-31067314-1638-4b3e-bc6a-0cfd801ccf2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15055486-69c3-4d87-99da-927949deea8a", "name": "network-vif-unplugged", "status": "completed", "tag": "fec38738-06d0-4ba1-b408-8e99dc334dea"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:28.164516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-284d8718-e2bf-4b45-bb29-264e962927ee req-31067314-1638-4b3e-bc6a-0cfd801ccf2c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:28.165273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-284d8718-e2bf-4b45-bb29-264e962927ee req-31067314-1638-4b3e-bc6a-0cfd801ccf2c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:28.169115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-284d8718-e2bf-4b45-bb29-264e962927ee req-31067314-1638-4b3e-bc6a-0cfd801ccf2c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:28.222089 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-284d8718-e2bf-4b45-bb29-264e962927ee req-31067314-1638-4b3e-bc6a-0cfd801ccf2c service nova] Creating event network-vif-unplugged:fec38738-06d0-4ba1-b408-8e99dc334dea for instance 15055486-69c3-4d87-99da-927949deea8a on n-h1-861111-1 Oct 12 22:07:28.246955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-284d8718-e2bf-4b45-bb29-264e962927ee req-31067314-1638-4b3e-bc6a-0cfd801ccf2c service nova] Instance 15055486-69c3-4d87-99da-927949deea8a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:07:28.301797 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-284d8718-e2bf-4b45-bb29-264e962927ee req-31067314-1638-4b3e-bc6a-0cfd801ccf2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.212258 Oct 12 22:07:28.307300 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1139/2119] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:28.315951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1c60c202-cafe-418d-aac5-2b8910644f23 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:28.316685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1c60c202-cafe-418d-aac5-2b8910644f23 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:28.457477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-95df2ae5-94eb-405a-aac9-58702a9bed36 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:28.476534 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-95df2ae5-94eb-405a-aac9-58702a9bed36 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d" status: 200 len: 1275 microversion: 2.1 time: 0.555602 Oct 12 22:07:28.479575 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 981/2120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:27 2022] GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d => generated 1275 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:28.479742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1c60c202-cafe-418d-aac5-2b8910644f23 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:28.488117 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1c60c202-cafe-418d-aac5-2b8910644f23 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1245 microversion: 2.1 time: 0.179320 Oct 12 22:07:28.499633 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1140/2121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:28 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1245 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:28.502492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7cfb89ce-627d-4796-a5f3-38d157f1cf3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:28.515753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7cfb89ce-627d-4796-a5f3-38d157f1cf3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:28.535694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:28.537709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cfb89ce-627d-4796-a5f3-38d157f1cf3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:28.538442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cfb89ce-627d-4796-a5f3-38d157f1cf3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:28.539223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cfb89ce-627d-4796-a5f3-38d157f1cf3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:28.540264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cfb89ce-627d-4796-a5f3-38d157f1cf3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:28.548505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cfb89ce-627d-4796-a5f3-38d157f1cf3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:28.551228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7cfb89ce-627d-4796-a5f3-38d157f1cf3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:28.829961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-00f6db04-d193-49a0-8666-d05ec89effab tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:28.831203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-00f6db04-d193-49a0-8666-d05ec89effab tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:28.850402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00f6db04-d193-49a0-8666-d05ec89effab tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:28.851219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00f6db04-d193-49a0-8666-d05ec89effab tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:28.852816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00f6db04-d193-49a0-8666-d05ec89effab tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:28.855696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00f6db04-d193-49a0-8666-d05ec89effab tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:28.856515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00f6db04-d193-49a0-8666-d05ec89effab tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:28.857914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00f6db04-d193-49a0-8666-d05ec89effab tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:29.266486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7cfb89ce-627d-4796-a5f3-38d157f1cf3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:29.281316 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7cfb89ce-627d-4796-a5f3-38d157f1cf3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1469 microversion: 2.1 time: 0.799334 Oct 12 22:07:29.281776 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 982/2122] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:28 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1469 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:29.507371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-25b42654-77bd-486e-8cda-56c589c1fe76 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:29.508446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-25b42654-77bd-486e-8cda-56c589c1fe76 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:29.527584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25b42654-77bd-486e-8cda-56c589c1fe76 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:29.529776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25b42654-77bd-486e-8cda-56c589c1fe76 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:29.542599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25b42654-77bd-486e-8cda-56c589c1fe76 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:29.546253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25b42654-77bd-486e-8cda-56c589c1fe76 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:29.549786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25b42654-77bd-486e-8cda-56c589c1fe76 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:29.550693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25b42654-77bd-486e-8cda-56c589c1fe76 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:29.599874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-00f6db04-d193-49a0-8666-d05ec89effab tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:29.614981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-00f6db04-d193-49a0-8666-d05ec89effab tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:29.616167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-00f6db04-d193-49a0-8666-d05ec89effab tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:29.628769 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-00f6db04-d193-49a0-8666-d05ec89effab tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.802537 Oct 12 22:07:29.629415 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1141/2123] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:28 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:07:29.655736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3629e901-b4e9-443c-8d93-d92ed1997ac1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:29.660868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3629e901-b4e9-443c-8d93-d92ed1997ac1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:29.692853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3629e901-b4e9-443c-8d93-d92ed1997ac1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:29.693385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3629e901-b4e9-443c-8d93-d92ed1997ac1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:29.693847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3629e901-b4e9-443c-8d93-d92ed1997ac1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:29.703802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3629e901-b4e9-443c-8d93-d92ed1997ac1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:29.706501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3629e901-b4e9-443c-8d93-d92ed1997ac1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:29.711406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3629e901-b4e9-443c-8d93-d92ed1997ac1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:29.829072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-25b42654-77bd-486e-8cda-56c589c1fe76 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:29.840677 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-25b42654-77bd-486e-8cda-56c589c1fe76 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d" status: 200 len: 1275 microversion: 2.1 time: 0.337970 Oct 12 22:07:29.845788 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 983/2124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:29 2022] GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d => generated 1275 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:07:29.949776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3629e901-b4e9-443c-8d93-d92ed1997ac1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:29.964838 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3629e901-b4e9-443c-8d93-d92ed1997ac1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1297 microversion: 2.1 time: 0.333134 Oct 12 22:07:29.969838 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1142/2125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:29 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1297 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:29.983420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2090438292", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce6dd748-e52a-46d1-938f-29e5070fa849"}], "security_groups": [{"name": "tempest-securitygroup--1210736939"}], "key_name": "tempest-keypair-1142826161", "user_data": "}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:30.306471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] validate_networks() for [('ce6dd748-e52a-46d1-938f-29e5070fa849', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:07:30.386890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b177c8c6-ad6e-40ba-8f99-648b1081e436 tempest-AbsoluteLimitsTestJSON-390202438 tempest-AbsoluteLimitsTestJSON-390202438-project] Calling method '.version_select at 0x7f512377f4c0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:30.412313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b177c8c6-ad6e-40ba-8f99-648b1081e436 tempest-AbsoluteLimitsTestJSON-390202438 tempest-AbsoluteLimitsTestJSON-390202438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:30.414531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b177c8c6-ad6e-40ba-8f99-648b1081e436 tempest-AbsoluteLimitsTestJSON-390202438 tempest-AbsoluteLimitsTestJSON-390202438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:30.417017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b177c8c6-ad6e-40ba-8f99-648b1081e436 tempest-AbsoluteLimitsTestJSON-390202438 tempest-AbsoluteLimitsTestJSON-390202438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:30.419656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b177c8c6-ad6e-40ba-8f99-648b1081e436 tempest-AbsoluteLimitsTestJSON-390202438 tempest-AbsoluteLimitsTestJSON-390202438-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:30.423062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b177c8c6-ad6e-40ba-8f99-648b1081e436 tempest-AbsoluteLimitsTestJSON-390202438 tempest-AbsoluteLimitsTestJSON-390202438-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:30.423951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b177c8c6-ad6e-40ba-8f99-648b1081e436 tempest-AbsoluteLimitsTestJSON-390202438 tempest-AbsoluteLimitsTestJSON-390202438-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:30.450140 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b177c8c6-ad6e-40ba-8f99-648b1081e436 tempest-AbsoluteLimitsTestJSON-390202438 tempest-AbsoluteLimitsTestJSON-390202438-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.582386 Oct 12 22:07:30.451527 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 984/2126] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 12 22:07:29 2022] GET /compute/v2.1/limits => generated 511 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:30.457329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4bf62620-37f1-473d-93f0-c13b7d348ed6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:30.458428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4bf62620-37f1-473d-93f0-c13b7d348ed6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:30.470487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bf62620-37f1-473d-93f0-c13b7d348ed6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:30.471464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bf62620-37f1-473d-93f0-c13b7d348ed6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:30.472361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bf62620-37f1-473d-93f0-c13b7d348ed6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:30.473432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bf62620-37f1-473d-93f0-c13b7d348ed6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:30.474250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bf62620-37f1-473d-93f0-c13b7d348ed6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:30.475031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bf62620-37f1-473d-93f0-c13b7d348ed6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:31.347981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:07:31.348598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:07:31.348908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:07:31.349402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:07:31.349824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:07:31.365329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:31.365832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:31.371452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:31.371452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:31.371452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:31.371452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:31.420648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Getting quotas for project 68913d260d084ce4a8e29daf4783c0bc. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:07:31.437586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Getting quotas for user 13c74a78e82f4e72a7d1f7b133074f5a and project 68913d260d084ce4a8e29daf4783c0bc. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:07:31.486589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:07:31.497716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:07:31.641880 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ffee59ee-b4a4-445a-be32-4369539e217b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.667881 Oct 12 22:07:31.644306 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1143/2127] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:07:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:07:31.656655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-5165a924-ba29-4c1f-a7b9-f167d603619d req-8efa04de-65ab-4dc1-97f7-7de35fc7d611 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15055486-69c3-4d87-99da-927949deea8a", "tag": "fec38738-06d0-4ba1-b408-8e99dc334dea"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:31.695742 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4bf62620-37f1-473d-93f0-c13b7d348ed6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:31.701067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:31.718724 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4bf62620-37f1-473d-93f0-c13b7d348ed6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1469 microversion: 2.1 time: 1.263630 Oct 12 22:07:31.740115 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 985/2128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:30 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1469 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:31.746634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5165a924-ba29-4c1f-a7b9-f167d603619d req-8efa04de-65ab-4dc1-97f7-7de35fc7d611 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:31.750481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5165a924-ba29-4c1f-a7b9-f167d603619d req-8efa04de-65ab-4dc1-97f7-7de35fc7d611 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:31.751209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5165a924-ba29-4c1f-a7b9-f167d603619d req-8efa04de-65ab-4dc1-97f7-7de35fc7d611 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:31.758226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f66c7c41-4a0d-43e0-baa2-9b7df92a979a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:31.759125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f66c7c41-4a0d-43e0-baa2-9b7df92a979a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:31.779925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f66c7c41-4a0d-43e0-baa2-9b7df92a979a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:31.785008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f66c7c41-4a0d-43e0-baa2-9b7df92a979a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:31.787844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f66c7c41-4a0d-43e0-baa2-9b7df92a979a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:31.790566 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-5165a924-ba29-4c1f-a7b9-f167d603619d req-8efa04de-65ab-4dc1-97f7-7de35fc7d611 service nova] Creating event network-changed:fec38738-06d0-4ba1-b408-8e99dc334dea for instance 15055486-69c3-4d87-99da-927949deea8a on n-h1-861111-1 Oct 12 22:07:31.790765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f66c7c41-4a0d-43e0-baa2-9b7df92a979a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:31.792323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f66c7c41-4a0d-43e0-baa2-9b7df92a979a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:31.792916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f66c7c41-4a0d-43e0-baa2-9b7df92a979a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:31.808972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-5165a924-ba29-4c1f-a7b9-f167d603619d req-8efa04de-65ab-4dc1-97f7-7de35fc7d611 service nova] Instance 15055486-69c3-4d87-99da-927949deea8a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:07:31.835759 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-5165a924-ba29-4c1f-a7b9-f167d603619d req-8efa04de-65ab-4dc1-97f7-7de35fc7d611 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189270 Oct 12 22:07:31.837321 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1144/2129] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:31.845259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-18a54ce9-7df4-4f27-af50-3f72bde90e05 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:31.847884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-18a54ce9-7df4-4f27-af50-3f72bde90e05 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:31.866497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18a54ce9-7df4-4f27-af50-3f72bde90e05 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:31.867650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18a54ce9-7df4-4f27-af50-3f72bde90e05 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:31.869773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18a54ce9-7df4-4f27-af50-3f72bde90e05 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:31.871170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18a54ce9-7df4-4f27-af50-3f72bde90e05 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:31.873684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18a54ce9-7df4-4f27-af50-3f72bde90e05 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:31.875682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18a54ce9-7df4-4f27-af50-3f72bde90e05 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:32.561265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f66c7c41-4a0d-43e0-baa2-9b7df92a979a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:32.581727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f66c7c41-4a0d-43e0-baa2-9b7df92a979a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:32.595337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f66c7c41-4a0d-43e0-baa2-9b7df92a979a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:32.597417 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f66c7c41-4a0d-43e0-baa2-9b7df92a979a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.852341 Oct 12 22:07:32.598028 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 986/2130] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:31 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:32.625786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-39ee2f64-175b-40b5-8665-cefe428bf1d2 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:32.635854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-39ee2f64-175b-40b5-8665-cefe428bf1d2 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:32.660075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39ee2f64-175b-40b5-8665-cefe428bf1d2 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:32.662477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39ee2f64-175b-40b5-8665-cefe428bf1d2 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:32.664196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39ee2f64-175b-40b5-8665-cefe428bf1d2 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:32.668886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39ee2f64-175b-40b5-8665-cefe428bf1d2 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:32.670049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39ee2f64-175b-40b5-8665-cefe428bf1d2 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:32.672422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39ee2f64-175b-40b5-8665-cefe428bf1d2 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:32.956033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-39ee2f64-175b-40b5-8665-cefe428bf1d2 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:32.967408 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-39ee2f64-175b-40b5-8665-cefe428bf1d2 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1303 microversion: 2.1 time: 0.360879 Oct 12 22:07:32.975565 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 987/2131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:32 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1303 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:32.980747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-77ac313c-18e0-431b-bc15-8c9496deec6a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:32.988346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-77ac313c-18e0-431b-bc15-8c9496deec6a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:33.004022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ac313c-18e0-431b-bc15-8c9496deec6a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:33.004906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ac313c-18e0-431b-bc15-8c9496deec6a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:33.005548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ac313c-18e0-431b-bc15-8c9496deec6a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:33.006484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ac313c-18e0-431b-bc15-8c9496deec6a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:33.007137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ac313c-18e0-431b-bc15-8c9496deec6a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:33.007909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ac313c-18e0-431b-bc15-8c9496deec6a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:33.009508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-18a54ce9-7df4-4f27-af50-3f72bde90e05 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:33.022200 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-18a54ce9-7df4-4f27-af50-3f72bde90e05 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d" status: 200 len: 1317 microversion: 2.1 time: 1.183207 Oct 12 22:07:33.022837 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1145/2132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:31 2022] GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d => generated 1317 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:33.047151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e05ef41-55e5-4f67-b06c-89fdd83080ee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:33.050938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9e05ef41-55e5-4f67-b06c-89fdd83080ee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:33.075988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e05ef41-55e5-4f67-b06c-89fdd83080ee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:33.082435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e05ef41-55e5-4f67-b06c-89fdd83080ee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:33.083053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e05ef41-55e5-4f67-b06c-89fdd83080ee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:33.089802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e05ef41-55e5-4f67-b06c-89fdd83080ee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:33.095768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e05ef41-55e5-4f67-b06c-89fdd83080ee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:33.096297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e05ef41-55e5-4f67-b06c-89fdd83080ee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:33.294382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-77ac313c-18e0-431b-bc15-8c9496deec6a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:33.320255 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-77ac313c-18e0-431b-bc15-8c9496deec6a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1238 microversion: 2.1 time: 0.342878 Oct 12 22:07:33.324014 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 988/2133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:32 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1238 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:33.624142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-31520d6c-ed0a-4560-86fd-f990fda10eb8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:33.625007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-31520d6c-ed0a-4560-86fd-f990fda10eb8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:33.645304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31520d6c-ed0a-4560-86fd-f990fda10eb8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:33.646010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31520d6c-ed0a-4560-86fd-f990fda10eb8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:33.647265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31520d6c-ed0a-4560-86fd-f990fda10eb8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:33.659982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31520d6c-ed0a-4560-86fd-f990fda10eb8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:33.661433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31520d6c-ed0a-4560-86fd-f990fda10eb8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:33.662414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31520d6c-ed0a-4560-86fd-f990fda10eb8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:34.110943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-31520d6c-ed0a-4560-86fd-f990fda10eb8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:34.120209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-31520d6c-ed0a-4560-86fd-f990fda10eb8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:34.135105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-31520d6c-ed0a-4560-86fd-f990fda10eb8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:34.143458 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-31520d6c-ed0a-4560-86fd-f990fda10eb8 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.523638 Oct 12 22:07:34.155414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9e05ef41-55e5-4f67-b06c-89fdd83080ee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:34.157550 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 989/2134] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:33 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:34.162341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-1e9b8839-d0c4-407c-a5a3-238c5a8211c3 req-b989773f-a6ea-4389-9b31-b840c68f66d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29bd3420-7cb1-4a2d-9e61-815d446f1a92", "tag": "c45c5b3a-ebb3-427d-b664-6dc4302d097c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:34.168993 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9e05ef41-55e5-4f67-b06c-89fdd83080ee tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1469 microversion: 2.1 time: 1.144993 Oct 12 22:07:34.169599 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1146/2135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:33 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1469 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:34.200552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-59427a54-214d-4627-a269-052bd18ec9c6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:34.200779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1e9b8839-d0c4-407c-a5a3-238c5a8211c3 req-b989773f-a6ea-4389-9b31-b840c68f66d4 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:34.201342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1e9b8839-d0c4-407c-a5a3-238c5a8211c3 req-b989773f-a6ea-4389-9b31-b840c68f66d4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:34.202127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1e9b8839-d0c4-407c-a5a3-238c5a8211c3 req-b989773f-a6ea-4389-9b31-b840c68f66d4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:34.202847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-59427a54-214d-4627-a269-052bd18ec9c6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:34.217374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59427a54-214d-4627-a269-052bd18ec9c6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:34.218151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59427a54-214d-4627-a269-052bd18ec9c6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:34.221021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59427a54-214d-4627-a269-052bd18ec9c6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:34.224515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59427a54-214d-4627-a269-052bd18ec9c6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:34.225369 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-1e9b8839-d0c4-407c-a5a3-238c5a8211c3 req-b989773f-a6ea-4389-9b31-b840c68f66d4 service nova] Creating event network-changed:c45c5b3a-ebb3-427d-b664-6dc4302d097c for instance 29bd3420-7cb1-4a2d-9e61-815d446f1a92 on n-h2-861111-1 Oct 12 22:07:34.225974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59427a54-214d-4627-a269-052bd18ec9c6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:34.227979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59427a54-214d-4627-a269-052bd18ec9c6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:34.236818 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-1e9b8839-d0c4-407c-a5a3-238c5a8211c3 req-b989773f-a6ea-4389-9b31-b840c68f66d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077804 Oct 12 22:07:34.238820 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 990/2136] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:34.250036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f0ca2fde-7388-414e-87b6-4e88305197bf tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:34.252283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f0ca2fde-7388-414e-87b6-4e88305197bf tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:34.267798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0ca2fde-7388-414e-87b6-4e88305197bf tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:34.269787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0ca2fde-7388-414e-87b6-4e88305197bf tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:34.271350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0ca2fde-7388-414e-87b6-4e88305197bf tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:34.272971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0ca2fde-7388-414e-87b6-4e88305197bf tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:34.273897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0ca2fde-7388-414e-87b6-4e88305197bf tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:34.274733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0ca2fde-7388-414e-87b6-4e88305197bf tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:35.079604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-59427a54-214d-4627-a269-052bd18ec9c6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:35.088104 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-59427a54-214d-4627-a269-052bd18ec9c6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1303 microversion: 2.1 time: 0.906099 Oct 12 22:07:35.097518 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1147/2137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:34 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1303 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:35.119455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cfc9b879-b726-4d4d-9cda-8fa4c120f9b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:35.120480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cfc9b879-b726-4d4d-9cda-8fa4c120f9b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:35.144123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfc9b879-b726-4d4d-9cda-8fa4c120f9b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:35.144933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfc9b879-b726-4d4d-9cda-8fa4c120f9b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:35.145642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfc9b879-b726-4d4d-9cda-8fa4c120f9b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:35.146622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfc9b879-b726-4d4d-9cda-8fa4c120f9b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:35.148342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfc9b879-b726-4d4d-9cda-8fa4c120f9b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:35.149830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfc9b879-b726-4d4d-9cda-8fa4c120f9b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:35.207436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f0ca2fde-7388-414e-87b6-4e88305197bf tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:35.216301 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f0ca2fde-7388-414e-87b6-4e88305197bf tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d" status: 200 len: 1317 microversion: 2.1 time: 0.974073 Oct 12 22:07:35.241185 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 991/2138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:34 2022] GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d => generated 1317 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:35.250476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dccc172b-97bc-458c-8a7f-6bcab9b98547 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:35.256169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dccc172b-97bc-458c-8a7f-6bcab9b98547 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:35.267837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dccc172b-97bc-458c-8a7f-6bcab9b98547 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:35.268611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dccc172b-97bc-458c-8a7f-6bcab9b98547 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:35.269417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dccc172b-97bc-458c-8a7f-6bcab9b98547 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:35.270309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dccc172b-97bc-458c-8a7f-6bcab9b98547 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:35.273670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dccc172b-97bc-458c-8a7f-6bcab9b98547 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:35.274312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dccc172b-97bc-458c-8a7f-6bcab9b98547 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:35.363839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cfc9b879-b726-4d4d-9cda-8fa4c120f9b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:35.378192 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cfc9b879-b726-4d4d-9cda-8fa4c120f9b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1300 microversion: 2.1 time: 0.273665 Oct 12 22:07:35.380378 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1148/2139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:35 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1300 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:35.413719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ad250147-fc70-400c-966b-013b0858ec97 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:35.424255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ad250147-fc70-400c-966b-013b0858ec97 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:35.447343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad250147-fc70-400c-966b-013b0858ec97 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:35.448386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad250147-fc70-400c-966b-013b0858ec97 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:35.449038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad250147-fc70-400c-966b-013b0858ec97 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:35.449956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad250147-fc70-400c-966b-013b0858ec97 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:35.452568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad250147-fc70-400c-966b-013b0858ec97 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:35.453223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad250147-fc70-400c-966b-013b0858ec97 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:36.504974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dccc172b-97bc-458c-8a7f-6bcab9b98547 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:36.529821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dccc172b-97bc-458c-8a7f-6bcab9b98547 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:36.532906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dccc172b-97bc-458c-8a7f-6bcab9b98547 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:36.534741 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dccc172b-97bc-458c-8a7f-6bcab9b98547 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 1.292254 Oct 12 22:07:36.557478 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 992/2140] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:35 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:36.563871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8b863b9f-d8bd-427a-b4e4-44cdff3df532 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:36.565697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8b863b9f-d8bd-427a-b4e4-44cdff3df532 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:36.578622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b863b9f-d8bd-427a-b4e4-44cdff3df532 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:36.580364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b863b9f-d8bd-427a-b4e4-44cdff3df532 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:36.585059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b863b9f-d8bd-427a-b4e4-44cdff3df532 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:36.585986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b863b9f-d8bd-427a-b4e4-44cdff3df532 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:36.586616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b863b9f-d8bd-427a-b4e4-44cdff3df532 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:36.588634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b863b9f-d8bd-427a-b4e4-44cdff3df532 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:37.037586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ad250147-fc70-400c-966b-013b0858ec97 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:37.052740 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ad250147-fc70-400c-966b-013b0858ec97 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1469 microversion: 2.1 time: 1.652896 Oct 12 22:07:37.053336 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1149/2141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:35 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1469 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:37.078767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1a45ed0a-fc3c-4ae1-a8a7-c6ea6f564aa6 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:37.082151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1a45ed0a-fc3c-4ae1-a8a7-c6ea6f564aa6 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:37.112576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a45ed0a-fc3c-4ae1-a8a7-c6ea6f564aa6 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:37.117303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a45ed0a-fc3c-4ae1-a8a7-c6ea6f564aa6 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:37.120189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a45ed0a-fc3c-4ae1-a8a7-c6ea6f564aa6 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:37.130688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a45ed0a-fc3c-4ae1-a8a7-c6ea6f564aa6 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:37.134819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a45ed0a-fc3c-4ae1-a8a7-c6ea6f564aa6 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:37.136632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a45ed0a-fc3c-4ae1-a8a7-c6ea6f564aa6 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:37.514256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8b863b9f-d8bd-427a-b4e4-44cdff3df532 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:37.535712 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8b863b9f-d8bd-427a-b4e4-44cdff3df532 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1303 microversion: 2.1 time: 0.976665 Oct 12 22:07:37.551782 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 993/2142] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:36 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1303 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:37.567767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-058fd1ad-ddbe-4b14-bf1f-0b34c9a36347 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:37.569001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-058fd1ad-ddbe-4b14-bf1f-0b34c9a36347 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:37.579708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-058fd1ad-ddbe-4b14-bf1f-0b34c9a36347 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:37.580789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-058fd1ad-ddbe-4b14-bf1f-0b34c9a36347 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:37.581855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-058fd1ad-ddbe-4b14-bf1f-0b34c9a36347 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:37.584110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-058fd1ad-ddbe-4b14-bf1f-0b34c9a36347 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:37.585503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-058fd1ad-ddbe-4b14-bf1f-0b34c9a36347 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:37.587584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-058fd1ad-ddbe-4b14-bf1f-0b34c9a36347 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:38.000224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-058fd1ad-ddbe-4b14-bf1f-0b34c9a36347 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:38.027121 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-058fd1ad-ddbe-4b14-bf1f-0b34c9a36347 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1300 microversion: 2.1 time: 0.465716 Oct 12 22:07:38.029761 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 994/2143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:37 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1300 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:38.128114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a45ed0a-fc3c-4ae1-a8a7-c6ea6f564aa6 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:38.139455 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1a45ed0a-fc3c-4ae1-a8a7-c6ea6f564aa6 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d" status: 200 len: 1317 microversion: 2.1 time: 1.084985 Oct 12 22:07:38.147223 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1150/2144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:37 2022] GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d => generated 1317 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:38.152530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7fa7069b-d2dd-4abc-ac18-845f6fe2e7cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:38.157046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7fa7069b-d2dd-4abc-ac18-845f6fe2e7cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:38.168985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fa7069b-d2dd-4abc-ac18-845f6fe2e7cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:38.172434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fa7069b-d2dd-4abc-ac18-845f6fe2e7cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:38.173139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fa7069b-d2dd-4abc-ac18-845f6fe2e7cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:38.174103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fa7069b-d2dd-4abc-ac18-845f6fe2e7cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:38.174773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fa7069b-d2dd-4abc-ac18-845f6fe2e7cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:38.176186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fa7069b-d2dd-4abc-ac18-845f6fe2e7cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:38.349460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f35b6904-301b-4759-8bdf-c4c40433d582 tempest-AbsoluteLimitsNegativeTestJSON-1574911099 tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project] Calling method '.version_select at 0x7f5123836f70>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:38.372886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f35b6904-301b-4759-8bdf-c4c40433d582 tempest-AbsoluteLimitsNegativeTestJSON-1574911099 tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:38.378359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f35b6904-301b-4759-8bdf-c4c40433d582 tempest-AbsoluteLimitsNegativeTestJSON-1574911099 tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:38.379073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f35b6904-301b-4759-8bdf-c4c40433d582 tempest-AbsoluteLimitsNegativeTestJSON-1574911099 tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:38.380421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f35b6904-301b-4759-8bdf-c4c40433d582 tempest-AbsoluteLimitsNegativeTestJSON-1574911099 tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:38.381096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f35b6904-301b-4759-8bdf-c4c40433d582 tempest-AbsoluteLimitsNegativeTestJSON-1574911099 tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:38.381777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f35b6904-301b-4759-8bdf-c4c40433d582 tempest-AbsoluteLimitsNegativeTestJSON-1574911099 tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:38.435816 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f35b6904-301b-4759-8bdf-c4c40433d582 tempest-AbsoluteLimitsNegativeTestJSON-1574911099 tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.404111 Oct 12 22:07:38.439090 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 995/2145] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 12 22:07:38 2022] GET /compute/v2.1/limits => generated 511 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:38.445578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a7857f9-2b70-48a0-b644-81f5ecf78e52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:38.475818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7a7857f9-2b70-48a0-b644-81f5ecf78e52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:38.502090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a7857f9-2b70-48a0-b644-81f5ecf78e52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:38.508516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a7857f9-2b70-48a0-b644-81f5ecf78e52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:38.513018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a7857f9-2b70-48a0-b644-81f5ecf78e52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:38.514023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a7857f9-2b70-48a0-b644-81f5ecf78e52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:38.519408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a7857f9-2b70-48a0-b644-81f5ecf78e52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:38.522163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a7857f9-2b70-48a0-b644-81f5ecf78e52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:39.404760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7fa7069b-d2dd-4abc-ac18-845f6fe2e7cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:39.425926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7fa7069b-d2dd-4abc-ac18-845f6fe2e7cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:39.434690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7fa7069b-d2dd-4abc-ac18-845f6fe2e7cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:39.439684 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7fa7069b-d2dd-4abc-ac18-845f6fe2e7cf tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 1.290951 Oct 12 22:07:39.441459 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1151/2146] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:38 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:39.469540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ade172a8-7049-43ac-8f82-aeaa48d758ad tempest-AbsoluteLimitsNegativeTestJSON-1574911099 tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1456874394", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:39.660638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-ade172a8-7049-43ac-8f82-aeaa48d758ad tempest-AbsoluteLimitsNegativeTestJSON-1574911099 tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project] validate_networks() for None {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:07:40.140135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a7857f9-2b70-48a0-b644-81f5ecf78e52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:40.154803 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7a7857f9-2b70-48a0-b644-81f5ecf78e52 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1462 microversion: 2.1 time: 1.714004 Oct 12 22:07:40.176815 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 996/2147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:38 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1462 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:40.189242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-03ad947e-4653-4a80-bda3-747cadfc879a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:40.191624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-03ad947e-4653-4a80-bda3-747cadfc879a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:40.205186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03ad947e-4653-4a80-bda3-747cadfc879a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:40.205506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03ad947e-4653-4a80-bda3-747cadfc879a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:40.206991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03ad947e-4653-4a80-bda3-747cadfc879a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:40.211358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03ad947e-4653-4a80-bda3-747cadfc879a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:40.212078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03ad947e-4653-4a80-bda3-747cadfc879a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:40.212710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03ad947e-4653-4a80-bda3-747cadfc879a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:40.585249 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 22:07:40.585508 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 22:07:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 (ip 10.222.0.16) !!! Oct 12 22:07:40.833885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:40.854398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-ade172a8-7049-43ac-8f82-aeaa48d758ad tempest-AbsoluteLimitsNegativeTestJSON-1574911099 tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project] Getting quotas for project fe508a4edcc143759a5b1f606f0b883c. Resources: dict_keys(['metadata_items']) {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:07:40.864791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-ade172a8-7049-43ac-8f82-aeaa48d758ad tempest-AbsoluteLimitsNegativeTestJSON-1574911099 tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project] Getting quotas for user 1230b82c3f8e44119433bd7c7dbd2504 and project fe508a4edcc143759a5b1f606f0b883c. Resources: dict_keys(['metadata_items']) {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:07:40.894316 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-ade172a8-7049-43ac-8f82-aeaa48d758ad tempest-AbsoluteLimitsNegativeTestJSON-1574911099 tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ade172a8-7049-43ac-8f82-aeaa48d758ad tempest-AbsoluteLimitsNegativeTestJSON-1574911099 tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project] Request method failure captured: Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 1752 Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzqpdUxCBWQMl8tbWBwlpFSGQPfZARJIickqmzs5TeTA-dHc3P_muSYuZIDiOiJ_22KPplKxS37VJJHJivXeqBCs9eEtTtCtW-Y5jbewY_ztmJUpOtK0wCIjGOxM0Ta2iNyQ7Xbb0iiCz3Gdkp4Ia1hQl0YjIjNv3LcL1ujJE79wCRA Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: fe508a4edcc143759a5b1f606f0b883c Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1574911099 Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe508a4edcc143759a5b1f606f0b883c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe508a4edcc143759a5b1f606f0b883c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fe508a4edcc143759a5b1f606f0b883c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fe508a4edcc143759a5b1f606f0b883c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1574911099 Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: fe508a4edcc143759a5b1f606f0b883c Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1574911099 Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 1230b82c3f8e44119433bd7c7dbd2504 Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1456874394", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:07:40.897639 n-d-861111-1 devstack@n-api.service[120453]: exception: Maximum number of metadata items exceeds 128 Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1456874394', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:07:40.900607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:07:40.904585 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:07:40.904585 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:07:40.904585 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 12 22:07:40.904585 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 22:07:40.904585 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 12 22:07:40.904585 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:40.904585 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:40.904585 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:40.904585 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:40.904585 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:40.904585 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:40.904585 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:40.904585 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:40.904585 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 12 22:07:40.904585 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:40.908457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ade172a8-7049-43ac-8f82-aeaa48d758ad tempest-AbsoluteLimitsNegativeTestJSON-1574911099 tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:40.909578 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ade172a8-7049-43ac-8f82-aeaa48d758ad tempest-AbsoluteLimitsNegativeTestJSON-1574911099 tempest-AbsoluteLimitsNegativeTestJSON-1574911099-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.464851 Oct 12 22:07:40.910915 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1152/2148] 10.222.0.16 () {60 vars in 1148 bytes} [Wed Oct 12 22:07:39 2022] POST /compute/v2.1/servers => generated 87 bytes in 1467 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:07:40.926954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ab1a4e7e-0f67-4a31-a6ee-8235b433e5cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:40.928177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ab1a4e7e-0f67-4a31-a6ee-8235b433e5cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:40.942444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab1a4e7e-0f67-4a31-a6ee-8235b433e5cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:40.943291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab1a4e7e-0f67-4a31-a6ee-8235b433e5cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:40.943965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab1a4e7e-0f67-4a31-a6ee-8235b433e5cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:40.946750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab1a4e7e-0f67-4a31-a6ee-8235b433e5cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:40.947552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab1a4e7e-0f67-4a31-a6ee-8235b433e5cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:40.948369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab1a4e7e-0f67-4a31-a6ee-8235b433e5cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:41.073171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ab1a4e7e-0f67-4a31-a6ee-8235b433e5cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:41.103459 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ab1a4e7e-0f67-4a31-a6ee-8235b433e5cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1300 microversion: 2.1 time: 0.190178 Oct 12 22:07:41.105992 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1153/2149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:40 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1300 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:41.133908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-91a4edf2-0edf-497e-9519-effd712957b8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:41.146911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-91a4edf2-0edf-497e-9519-effd712957b8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:41.168841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91a4edf2-0edf-497e-9519-effd712957b8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:41.173103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91a4edf2-0edf-497e-9519-effd712957b8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:41.176883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91a4edf2-0edf-497e-9519-effd712957b8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:41.179096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91a4edf2-0edf-497e-9519-effd712957b8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:41.182394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91a4edf2-0edf-497e-9519-effd712957b8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:41.184732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91a4edf2-0edf-497e-9519-effd712957b8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:41.403713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:41.741337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-91a4edf2-0edf-497e-9519-effd712957b8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:41.750959 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-91a4edf2-0edf-497e-9519-effd712957b8 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d" status: 200 len: 1317 microversion: 2.1 time: 0.639381 Oct 12 22:07:41.768317 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1154/2150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:41 2022] GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d => generated 1317 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:41.773965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-69c2882f-a852-455b-97bf-85d2f6610cb7 req-6c275f3d-f106-4a7f-92cc-72bed990b888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb25c0a-70e6-494e-93fe-7f98f393ed4d", "tag": "42b1300a-460b-4f8f-85bd-a070c6d3cd9f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:41.798732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-69c2882f-a852-455b-97bf-85d2f6610cb7 req-6c275f3d-f106-4a7f-92cc-72bed990b888 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:41.799430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-69c2882f-a852-455b-97bf-85d2f6610cb7 req-6c275f3d-f106-4a7f-92cc-72bed990b888 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:41.801028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-69c2882f-a852-455b-97bf-85d2f6610cb7 req-6c275f3d-f106-4a7f-92cc-72bed990b888 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:41.820336 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-69c2882f-a852-455b-97bf-85d2f6610cb7 req-6c275f3d-f106-4a7f-92cc-72bed990b888 service nova] Creating event network-changed:42b1300a-460b-4f8f-85bd-a070c6d3cd9f for instance 3cb25c0a-70e6-494e-93fe-7f98f393ed4d on n-h1-861111-1 Oct 12 22:07:41.826065 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-69c2882f-a852-455b-97bf-85d2f6610cb7 req-6c275f3d-f106-4a7f-92cc-72bed990b888 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055571 Oct 12 22:07:41.826889 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1155/2151] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:41.832951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6d3a3894-eec4-46a0-85e1-a68ab518734b tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:41.834766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6d3a3894-eec4-46a0-85e1-a68ab518734b tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:41.842090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d3a3894-eec4-46a0-85e1-a68ab518734b tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:41.842774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d3a3894-eec4-46a0-85e1-a68ab518734b tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:41.844241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d3a3894-eec4-46a0-85e1-a68ab518734b tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:41.845505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d3a3894-eec4-46a0-85e1-a68ab518734b tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:41.846117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d3a3894-eec4-46a0-85e1-a68ab518734b tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:41.846728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d3a3894-eec4-46a0-85e1-a68ab518734b tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:41.865785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:42.039550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-03ad947e-4653-4a80-bda3-747cadfc879a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:42.056018 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-03ad947e-4653-4a80-bda3-747cadfc879a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1370 microversion: 2.1 time: 1.876819 Oct 12 22:07:42.059394 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 997/2152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:40 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1370 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:42.068587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-226388ea-baf9-41a9-aff9-7b914a69d07c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:42.071101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-226388ea-baf9-41a9-aff9-7b914a69d07c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:42.092504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-226388ea-baf9-41a9-aff9-7b914a69d07c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:42.093346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-226388ea-baf9-41a9-aff9-7b914a69d07c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:42.093978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-226388ea-baf9-41a9-aff9-7b914a69d07c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:42.095110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-226388ea-baf9-41a9-aff9-7b914a69d07c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:42.095764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-226388ea-baf9-41a9-aff9-7b914a69d07c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:42.096393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-226388ea-baf9-41a9-aff9-7b914a69d07c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:42.102350 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6d3a3894-eec4-46a0-85e1-a68ab518734b tempest-MigrationsAdminTest-203229595 tempest-MigrationsAdminTest-203229595-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1613 microversion: 2.1 time: 0.273947 Oct 12 22:07:42.102980 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1156/2153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:41 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1613 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:42.134951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-caad1e4b-a63a-4274-94c2-aefb4f60d0bb req-aa666cb1-bccc-4c21-b31b-0bbb214facfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15055486-69c3-4d87-99da-927949deea8a", "name": "network-vif-plugged", "status": "completed", "tag": "fec38738-06d0-4ba1-b408-8e99dc334dea"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:42.173961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-caad1e4b-a63a-4274-94c2-aefb4f60d0bb req-aa666cb1-bccc-4c21-b31b-0bbb214facfb service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:42.174424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-caad1e4b-a63a-4274-94c2-aefb4f60d0bb req-aa666cb1-bccc-4c21-b31b-0bbb214facfb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:42.174934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-caad1e4b-a63a-4274-94c2-aefb4f60d0bb req-aa666cb1-bccc-4c21-b31b-0bbb214facfb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:42.190429 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-caad1e4b-a63a-4274-94c2-aefb4f60d0bb req-aa666cb1-bccc-4c21-b31b-0bbb214facfb service nova] Creating event network-vif-plugged:fec38738-06d0-4ba1-b408-8e99dc334dea for instance 15055486-69c3-4d87-99da-927949deea8a on n-h1-861111-1 Oct 12 22:07:42.196582 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-caad1e4b-a63a-4274-94c2-aefb4f60d0bb req-aa666cb1-bccc-4c21-b31b-0bbb214facfb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079077 Oct 12 22:07:42.197219 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1157/2154] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:42.204933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-21126993-b45b-4b11-9a11-ffe4bf356a4f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:42.206000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-21126993-b45b-4b11-9a11-ffe4bf356a4f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:42.214039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21126993-b45b-4b11-9a11-ffe4bf356a4f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:42.214836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21126993-b45b-4b11-9a11-ffe4bf356a4f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:42.215523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21126993-b45b-4b11-9a11-ffe4bf356a4f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:42.216578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21126993-b45b-4b11-9a11-ffe4bf356a4f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:42.217235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21126993-b45b-4b11-9a11-ffe4bf356a4f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:42.217951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21126993-b45b-4b11-9a11-ffe4bf356a4f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:42.285437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-21126993-b45b-4b11-9a11-ffe4bf356a4f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:07:42.500214 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-21126993-b45b-4b11-9a11-ffe4bf356a4f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 204 len: 0 microversion: 2.1 time: 0.300065 Oct 12 22:07:42.504476 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1158/2155] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:07:42 2022] DELETE /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:07:42.514807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e69edb3a-3570-494b-a9fe-fb2593a50788 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:42.516083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e69edb3a-3570-494b-a9fe-fb2593a50788 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:42.536571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e69edb3a-3570-494b-a9fe-fb2593a50788 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:42.536904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e69edb3a-3570-494b-a9fe-fb2593a50788 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:42.537756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e69edb3a-3570-494b-a9fe-fb2593a50788 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:42.538762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e69edb3a-3570-494b-a9fe-fb2593a50788 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:42.541816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e69edb3a-3570-494b-a9fe-fb2593a50788 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:42.543166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e69edb3a-3570-494b-a9fe-fb2593a50788 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:42.706978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e69edb3a-3570-494b-a9fe-fb2593a50788 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:42.719069 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e69edb3a-3570-494b-a9fe-fb2593a50788 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1300 microversion: 2.1 time: 0.212686 Oct 12 22:07:42.720537 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1159/2156] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:42 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1300 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:42.727952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7e01d749-967f-4c9e-ad10-adee2a2c2c3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:42.728789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7e01d749-967f-4c9e-ad10-adee2a2c2c3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:42.736492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e01d749-967f-4c9e-ad10-adee2a2c2c3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:42.737294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e01d749-967f-4c9e-ad10-adee2a2c2c3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:42.737945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e01d749-967f-4c9e-ad10-adee2a2c2c3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:42.739607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e01d749-967f-4c9e-ad10-adee2a2c2c3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:42.740438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e01d749-967f-4c9e-ad10-adee2a2c2c3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:42.741085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e01d749-967f-4c9e-ad10-adee2a2c2c3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:42.797695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7e01d749-967f-4c9e-ad10-adee2a2c2c3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:07:43.058681 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7e01d749-967f-4c9e-ad10-adee2a2c2c3a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 204 len: 0 microversion: 2.1 time: 0.335840 Oct 12 22:07:43.064126 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1160/2157] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:07:42 2022] DELETE /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:07:43.075403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bbd5f38c-8339-4f3c-b262-eecb613bfe0e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:43.078327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bbd5f38c-8339-4f3c-b262-eecb613bfe0e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:43.098883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bbd5f38c-8339-4f3c-b262-eecb613bfe0e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:43.099473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bbd5f38c-8339-4f3c-b262-eecb613bfe0e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:43.100018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bbd5f38c-8339-4f3c-b262-eecb613bfe0e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:43.100779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bbd5f38c-8339-4f3c-b262-eecb613bfe0e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:43.101300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bbd5f38c-8339-4f3c-b262-eecb613bfe0e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:43.101831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bbd5f38c-8339-4f3c-b262-eecb613bfe0e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:43.302381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bbd5f38c-8339-4f3c-b262-eecb613bfe0e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:43.310524 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bbd5f38c-8339-4f3c-b262-eecb613bfe0e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1667 microversion: 2.1 time: 0.244266 Oct 12 22:07:43.334006 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1161/2158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:43 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1667 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:43.355232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-63a6915a-f274-47cf-97ee-0111531af728 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:43.360857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-63a6915a-f274-47cf-97ee-0111531af728 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:43.392046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-226388ea-baf9-41a9-aff9-7b914a69d07c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:43.392726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63a6915a-f274-47cf-97ee-0111531af728 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:43.392726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63a6915a-f274-47cf-97ee-0111531af728 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:43.395195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63a6915a-f274-47cf-97ee-0111531af728 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:43.396274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63a6915a-f274-47cf-97ee-0111531af728 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:43.403171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63a6915a-f274-47cf-97ee-0111531af728 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:43.404868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63a6915a-f274-47cf-97ee-0111531af728 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:43.419066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-226388ea-baf9-41a9-aff9-7b914a69d07c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:43.423141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-226388ea-baf9-41a9-aff9-7b914a69d07c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:43.428098 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-226388ea-baf9-41a9-aff9-7b914a69d07c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 1.367409 Oct 12 22:07:43.432802 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 998/2159] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:42 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:43.447772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a41c7ecf-7d2a-456d-8ebd-b7f3609a2ef1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:43.449178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a41c7ecf-7d2a-456d-8ebd-b7f3609a2ef1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:43.459696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a41c7ecf-7d2a-456d-8ebd-b7f3609a2ef1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:43.460986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a41c7ecf-7d2a-456d-8ebd-b7f3609a2ef1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:43.463157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a41c7ecf-7d2a-456d-8ebd-b7f3609a2ef1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:43.464438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a41c7ecf-7d2a-456d-8ebd-b7f3609a2ef1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:43.465174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a41c7ecf-7d2a-456d-8ebd-b7f3609a2ef1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:43.466042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a41c7ecf-7d2a-456d-8ebd-b7f3609a2ef1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:43.934183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-63a6915a-f274-47cf-97ee-0111531af728 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:43.944180 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-63a6915a-f274-47cf-97ee-0111531af728 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d" status: 200 len: 1317 microversion: 2.1 time: 0.608846 Oct 12 22:07:43.945157 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1162/2160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:43 2022] GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d => generated 1317 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:43.965135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3e4626dd-9e86-455f-8840-b3be8cc1108a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:43.966956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3e4626dd-9e86-455f-8840-b3be8cc1108a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:43.979189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e4626dd-9e86-455f-8840-b3be8cc1108a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:43.980038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e4626dd-9e86-455f-8840-b3be8cc1108a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:43.980583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e4626dd-9e86-455f-8840-b3be8cc1108a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:43.982908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e4626dd-9e86-455f-8840-b3be8cc1108a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:43.983978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e4626dd-9e86-455f-8840-b3be8cc1108a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:43.984637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e4626dd-9e86-455f-8840-b3be8cc1108a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:44.187185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3e4626dd-9e86-455f-8840-b3be8cc1108a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:44.195177 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3e4626dd-9e86-455f-8840-b3be8cc1108a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1370 microversion: 2.1 time: 0.247633 Oct 12 22:07:44.198303 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1163/2161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:43 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:44.204078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6d96ca6f-96b0-4bf6-8b4f-91cc87d60143 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:44.204900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6d96ca6f-96b0-4bf6-8b4f-91cc87d60143 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:44.211203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d96ca6f-96b0-4bf6-8b4f-91cc87d60143 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:44.211903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d96ca6f-96b0-4bf6-8b4f-91cc87d60143 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:44.212533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d96ca6f-96b0-4bf6-8b4f-91cc87d60143 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:44.213688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d96ca6f-96b0-4bf6-8b4f-91cc87d60143 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:44.214307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d96ca6f-96b0-4bf6-8b4f-91cc87d60143 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:44.214973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d96ca6f-96b0-4bf6-8b4f-91cc87d60143 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:44.272787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a41c7ecf-7d2a-456d-8ebd-b7f3609a2ef1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:44.284548 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a41c7ecf-7d2a-456d-8ebd-b7f3609a2ef1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1468 microversion: 2.1 time: 0.850211 Oct 12 22:07:44.291608 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 999/2162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:43 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1468 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:44.297283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-1fb1b41b-31a5-4127-96c2-6a04a94817d4 req-b13ce76e-6600-45ae-a27b-b89c16af21a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54a23a46-7ad2-4563-a557-1806d4d61253", "tag": "c43be245-e399-4a43-a754-f8061895ef0c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:44.307373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1fb1b41b-31a5-4127-96c2-6a04a94817d4 req-b13ce76e-6600-45ae-a27b-b89c16af21a8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:44.308130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1fb1b41b-31a5-4127-96c2-6a04a94817d4 req-b13ce76e-6600-45ae-a27b-b89c16af21a8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:44.308753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1fb1b41b-31a5-4127-96c2-6a04a94817d4 req-b13ce76e-6600-45ae-a27b-b89c16af21a8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:44.323024 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-1fb1b41b-31a5-4127-96c2-6a04a94817d4 req-b13ce76e-6600-45ae-a27b-b89c16af21a8 service nova] Creating event network-changed:c43be245-e399-4a43-a754-f8061895ef0c for instance 54a23a46-7ad2-4563-a557-1806d4d61253 on n-h1-861111-1 Oct 12 22:07:44.355526 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-1fb1b41b-31a5-4127-96c2-6a04a94817d4 req-b13ce76e-6600-45ae-a27b-b89c16af21a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062103 Oct 12 22:07:44.356136 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1000/2163] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:44.372593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-751b4737-8d6d-4ada-8814-e00d42ca8dcd req-55236055-67ec-4160-901f-d8937eb73b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bd3420-7cb1-4a2d-9e61-815d446f1a92", "name": "network-vif-plugged", "status": "completed", "tag": "c45c5b3a-ebb3-427d-b664-6dc4302d097c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:44.394107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-751b4737-8d6d-4ada-8814-e00d42ca8dcd req-55236055-67ec-4160-901f-d8937eb73b9f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:44.394755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-751b4737-8d6d-4ada-8814-e00d42ca8dcd req-55236055-67ec-4160-901f-d8937eb73b9f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:44.395048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-751b4737-8d6d-4ada-8814-e00d42ca8dcd req-55236055-67ec-4160-901f-d8937eb73b9f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:44.408965 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-751b4737-8d6d-4ada-8814-e00d42ca8dcd req-55236055-67ec-4160-901f-d8937eb73b9f service nova] Creating event network-vif-plugged:c45c5b3a-ebb3-427d-b664-6dc4302d097c for instance 29bd3420-7cb1-4a2d-9e61-815d446f1a92 on n-h2-861111-1 Oct 12 22:07:44.415438 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-751b4737-8d6d-4ada-8814-e00d42ca8dcd req-55236055-67ec-4160-901f-d8937eb73b9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057082 Oct 12 22:07:44.416638 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1001/2164] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:44.423194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0d211fef-dffa-4318-9e59-a574b431e1a6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:44.423919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0d211fef-dffa-4318-9e59-a574b431e1a6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:44.430312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d211fef-dffa-4318-9e59-a574b431e1a6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:44.430804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d211fef-dffa-4318-9e59-a574b431e1a6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:44.431260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d211fef-dffa-4318-9e59-a574b431e1a6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:44.432166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d211fef-dffa-4318-9e59-a574b431e1a6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:44.432619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d211fef-dffa-4318-9e59-a574b431e1a6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:44.433226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d211fef-dffa-4318-9e59-a574b431e1a6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:44.500660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6d96ca6f-96b0-4bf6-8b4f-91cc87d60143 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:44.509891 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6d96ca6f-96b0-4bf6-8b4f-91cc87d60143 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1368 microversion: 2.1 time: 0.310086 Oct 12 22:07:44.511711 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1164/2165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:44 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1368 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:44.516841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8a2351da-85f2-4f31-bfa1-251ac26d58d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:44.517561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8a2351da-85f2-4f31-bfa1-251ac26d58d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:44.537685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2351da-85f2-4f31-bfa1-251ac26d58d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:44.538402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2351da-85f2-4f31-bfa1-251ac26d58d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:44.538986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2351da-85f2-4f31-bfa1-251ac26d58d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:44.540207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2351da-85f2-4f31-bfa1-251ac26d58d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:44.541149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2351da-85f2-4f31-bfa1-251ac26d58d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:44.547410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2351da-85f2-4f31-bfa1-251ac26d58d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:44.819221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8a2351da-85f2-4f31-bfa1-251ac26d58d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:44.829059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8a2351da-85f2-4f31-bfa1-251ac26d58d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:44.830547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8a2351da-85f2-4f31-bfa1-251ac26d58d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:44.831760 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8a2351da-85f2-4f31-bfa1-251ac26d58d5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.318740 Oct 12 22:07:44.839004 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1165/2166] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:44 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:44.968416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-82973f6e-3f15-49fb-8ea7-a06fe5c3dfaa tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:44.969076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-82973f6e-3f15-49fb-8ea7-a06fe5c3dfaa tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:44.981697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82973f6e-3f15-49fb-8ea7-a06fe5c3dfaa tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:44.982176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82973f6e-3f15-49fb-8ea7-a06fe5c3dfaa tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:44.982609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82973f6e-3f15-49fb-8ea7-a06fe5c3dfaa tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:44.983859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82973f6e-3f15-49fb-8ea7-a06fe5c3dfaa tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:44.984325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82973f6e-3f15-49fb-8ea7-a06fe5c3dfaa tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:44.984769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82973f6e-3f15-49fb-8ea7-a06fe5c3dfaa tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:45.119572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0d211fef-dffa-4318-9e59-a574b431e1a6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:45.137866 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0d211fef-dffa-4318-9e59-a574b431e1a6 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1667 microversion: 2.1 time: 0.719218 Oct 12 22:07:45.144819 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1002/2167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:44 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1667 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:45.226684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-89d8ce38-f9e5-4140-8a64-441210259035 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:45.227800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-89d8ce38-f9e5-4140-8a64-441210259035 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:45.236541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89d8ce38-f9e5-4140-8a64-441210259035 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:45.237331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89d8ce38-f9e5-4140-8a64-441210259035 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:45.238087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89d8ce38-f9e5-4140-8a64-441210259035 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:45.238983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89d8ce38-f9e5-4140-8a64-441210259035 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:45.239702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89d8ce38-f9e5-4140-8a64-441210259035 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:45.241262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89d8ce38-f9e5-4140-8a64-441210259035 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:45.265904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-82973f6e-3f15-49fb-8ea7-a06fe5c3dfaa tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:45.275746 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-82973f6e-3f15-49fb-8ea7-a06fe5c3dfaa tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d" status: 200 len: 1317 microversion: 2.1 time: 0.311219 Oct 12 22:07:45.279544 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1166/2168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:44 2022] GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:45.307765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9948f43d-1805-4049-b148-48335372bc5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:45.308778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9948f43d-1805-4049-b148-48335372bc5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:45.321349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9948f43d-1805-4049-b148-48335372bc5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:45.322467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9948f43d-1805-4049-b148-48335372bc5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:45.322986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9948f43d-1805-4049-b148-48335372bc5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:45.323988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9948f43d-1805-4049-b148-48335372bc5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:45.324679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9948f43d-1805-4049-b148-48335372bc5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:45.330363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9948f43d-1805-4049-b148-48335372bc5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:45.601185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9948f43d-1805-4049-b148-48335372bc5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:45.612737 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9948f43d-1805-4049-b148-48335372bc5a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1468 microversion: 2.1 time: 0.308724 Oct 12 22:07:45.628307 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1167/2169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:45 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1468 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:45.634992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e1476cf-a85e-4aad-96da-0dcaf7561f06 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:45.635899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9e1476cf-a85e-4aad-96da-0dcaf7561f06 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:45.649618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e1476cf-a85e-4aad-96da-0dcaf7561f06 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:45.650496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e1476cf-a85e-4aad-96da-0dcaf7561f06 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:45.651118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e1476cf-a85e-4aad-96da-0dcaf7561f06 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:45.652044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e1476cf-a85e-4aad-96da-0dcaf7561f06 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:45.652669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e1476cf-a85e-4aad-96da-0dcaf7561f06 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:45.653266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e1476cf-a85e-4aad-96da-0dcaf7561f06 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:46.048789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-89d8ce38-f9e5-4140-8a64-441210259035 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:46.061389 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-89d8ce38-f9e5-4140-8a64-441210259035 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1370 microversion: 2.1 time: 0.838089 Oct 12 22:07:46.064334 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1003/2170] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:45 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1370 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:07:46.072176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-21d000c7-8268-42a1-96bb-3b43b63efc96 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:46.078235 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-21d000c7-8268-42a1-96bb-3b43b63efc96 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:46.100816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21d000c7-8268-42a1-96bb-3b43b63efc96 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:46.106239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21d000c7-8268-42a1-96bb-3b43b63efc96 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:46.106845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21d000c7-8268-42a1-96bb-3b43b63efc96 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:46.109281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21d000c7-8268-42a1-96bb-3b43b63efc96 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:46.113248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21d000c7-8268-42a1-96bb-3b43b63efc96 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:46.115091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21d000c7-8268-42a1-96bb-3b43b63efc96 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:46.184998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9e1476cf-a85e-4aad-96da-0dcaf7561f06 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:46.193457 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9e1476cf-a85e-4aad-96da-0dcaf7561f06 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1368 microversion: 2.1 time: 0.563795 Oct 12 22:07:46.197537 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1168/2171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:45 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1368 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:46.206070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d4a0b687-51e2-4b91-8c63-0c43950d7a8b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:46.209353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d4a0b687-51e2-4b91-8c63-0c43950d7a8b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:46.224397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4a0b687-51e2-4b91-8c63-0c43950d7a8b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:46.236048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4a0b687-51e2-4b91-8c63-0c43950d7a8b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:46.236897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4a0b687-51e2-4b91-8c63-0c43950d7a8b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:46.237967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4a0b687-51e2-4b91-8c63-0c43950d7a8b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:46.238711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4a0b687-51e2-4b91-8c63-0c43950d7a8b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:46.239466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4a0b687-51e2-4b91-8c63-0c43950d7a8b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:46.594735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-21d000c7-8268-42a1-96bb-3b43b63efc96 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:46.617919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-21d000c7-8268-42a1-96bb-3b43b63efc96 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:46.621252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-21d000c7-8268-42a1-96bb-3b43b63efc96 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:46.625180 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-21d000c7-8268-42a1-96bb-3b43b63efc96 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.558820 Oct 12 22:07:46.627041 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1004/2172] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:46 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:46.640844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f4e7606d-8758-4c7a-889a-d7fa98c653db tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:46.644502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f4e7606d-8758-4c7a-889a-d7fa98c653db tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:46.658535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4e7606d-8758-4c7a-889a-d7fa98c653db tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:46.659486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4e7606d-8758-4c7a-889a-d7fa98c653db tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:46.660164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4e7606d-8758-4c7a-889a-d7fa98c653db tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:46.661360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4e7606d-8758-4c7a-889a-d7fa98c653db tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:46.662111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4e7606d-8758-4c7a-889a-d7fa98c653db tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:46.662755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4e7606d-8758-4c7a-889a-d7fa98c653db tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:46.736808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d4a0b687-51e2-4b91-8c63-0c43950d7a8b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:46.748371 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d4a0b687-51e2-4b91-8c63-0c43950d7a8b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1667 microversion: 2.1 time: 0.549427 Oct 12 22:07:46.749849 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1169/2173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:46 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1667 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:46.761668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-12b7886b-9f16-4fb2-a718-6f3c01c31714 req-0df1b673-e84c-42cb-ae81-9856ccc39e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77548da5-9429-4e07-bdad-7902d89d4153", "tag": "cc048857-8664-421b-b22d-6488c4031e97"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:46.796216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:46.798689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-12b7886b-9f16-4fb2-a718-6f3c01c31714 req-0df1b673-e84c-42cb-ae81-9856ccc39e1a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:46.802324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-12b7886b-9f16-4fb2-a718-6f3c01c31714 req-0df1b673-e84c-42cb-ae81-9856ccc39e1a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:46.803548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-12b7886b-9f16-4fb2-a718-6f3c01c31714 req-0df1b673-e84c-42cb-ae81-9856ccc39e1a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:46.827769 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-12b7886b-9f16-4fb2-a718-6f3c01c31714 req-0df1b673-e84c-42cb-ae81-9856ccc39e1a service nova] Creating event network-changed:cc048857-8664-421b-b22d-6488c4031e97 for instance 77548da5-9429-4e07-bdad-7902d89d4153 on n-h2-861111-1 Oct 12 22:07:46.847291 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-12b7886b-9f16-4fb2-a718-6f3c01c31714 req-0df1b673-e84c-42cb-ae81-9856ccc39e1a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093452 Oct 12 22:07:46.869305 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1170/2174] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:46.882367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b28208c6-b2b5-4e95-98f1-8e2f583f9412 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:46.884085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b28208c6-b2b5-4e95-98f1-8e2f583f9412 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:46.905797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b28208c6-b2b5-4e95-98f1-8e2f583f9412 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:46.906587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b28208c6-b2b5-4e95-98f1-8e2f583f9412 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:46.907287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b28208c6-b2b5-4e95-98f1-8e2f583f9412 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:46.908255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b28208c6-b2b5-4e95-98f1-8e2f583f9412 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:46.909885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b28208c6-b2b5-4e95-98f1-8e2f583f9412 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:46.914097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b28208c6-b2b5-4e95-98f1-8e2f583f9412 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:46.923374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:47.377118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b28208c6-b2b5-4e95-98f1-8e2f583f9412 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:47.388445 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b28208c6-b2b5-4e95-98f1-8e2f583f9412 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1468 microversion: 2.1 time: 0.517082 Oct 12 22:07:47.390078 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1171/2175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:46 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1468 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:47.394991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-248df925-82e0-4f03-8d6f-5b4ffaa9848d req-76df223a-2263-4c22-94c5-140440dfea21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb25c0a-70e6-494e-93fe-7f98f393ed4d", "name": "network-vif-plugged", "status": "completed", "tag": "42b1300a-460b-4f8f-85bd-a070c6d3cd9f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:47.404687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-248df925-82e0-4f03-8d6f-5b4ffaa9848d req-76df223a-2263-4c22-94c5-140440dfea21 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:47.405450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-248df925-82e0-4f03-8d6f-5b4ffaa9848d req-76df223a-2263-4c22-94c5-140440dfea21 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:47.406063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-248df925-82e0-4f03-8d6f-5b4ffaa9848d req-76df223a-2263-4c22-94c5-140440dfea21 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:47.423463 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-248df925-82e0-4f03-8d6f-5b4ffaa9848d req-76df223a-2263-4c22-94c5-140440dfea21 service nova] Creating event network-vif-plugged:42b1300a-460b-4f8f-85bd-a070c6d3cd9f for instance 3cb25c0a-70e6-494e-93fe-7f98f393ed4d on n-h1-861111-1 Oct 12 22:07:47.428641 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-248df925-82e0-4f03-8d6f-5b4ffaa9848d req-76df223a-2263-4c22-94c5-140440dfea21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037133 Oct 12 22:07:47.433768 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1172/2176] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:47.440224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6e5966f3-1406-41d8-9d37-1262edf10169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:47.441242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6e5966f3-1406-41d8-9d37-1262edf10169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:47.447843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e5966f3-1406-41d8-9d37-1262edf10169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:47.448662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e5966f3-1406-41d8-9d37-1262edf10169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:47.449329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e5966f3-1406-41d8-9d37-1262edf10169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:47.450293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e5966f3-1406-41d8-9d37-1262edf10169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:47.450968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e5966f3-1406-41d8-9d37-1262edf10169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:47.452356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e5966f3-1406-41d8-9d37-1262edf10169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:47.630212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f4e7606d-8758-4c7a-889a-d7fa98c653db tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:47.646521 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f4e7606d-8758-4c7a-889a-d7fa98c653db tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d" status: 200 len: 1317 microversion: 2.1 time: 1.017796 Oct 12 22:07:47.647667 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1005/2177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:46 2022] GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d => generated 1317 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:47.655820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5f0a33d6-35d6-4097-9d1d-70922177cf4e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:47.656978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5f0a33d6-35d6-4097-9d1d-70922177cf4e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:47.668260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f0a33d6-35d6-4097-9d1d-70922177cf4e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:47.669211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f0a33d6-35d6-4097-9d1d-70922177cf4e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:47.669949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f0a33d6-35d6-4097-9d1d-70922177cf4e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:47.671032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f0a33d6-35d6-4097-9d1d-70922177cf4e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:47.671754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f0a33d6-35d6-4097-9d1d-70922177cf4e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:47.672625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f0a33d6-35d6-4097-9d1d-70922177cf4e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:48.377382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=12 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:48.403515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:48.564231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6e5966f3-1406-41d8-9d37-1262edf10169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:48.575354 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6e5966f3-1406-41d8-9d37-1262edf10169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1370 microversion: 2.1 time: 1.139890 Oct 12 22:07:48.579623 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1173/2178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:47 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1370 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:48.588605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3aaa861a-897c-4590-9992-50e79ff8c638 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:48.592735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3aaa861a-897c-4590-9992-50e79ff8c638 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:48.607372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3aaa861a-897c-4590-9992-50e79ff8c638 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:48.608794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3aaa861a-897c-4590-9992-50e79ff8c638 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:48.611826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3aaa861a-897c-4590-9992-50e79ff8c638 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:48.612580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3aaa861a-897c-4590-9992-50e79ff8c638 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:48.613039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3aaa861a-897c-4590-9992-50e79ff8c638 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:48.615059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3aaa861a-897c-4590-9992-50e79ff8c638 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:48.676725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5f0a33d6-35d6-4097-9d1d-70922177cf4e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:48.697586 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5f0a33d6-35d6-4097-9d1d-70922177cf4e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1368 microversion: 2.1 time: 1.048026 Oct 12 22:07:48.700110 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1006/2179] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:47 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1368 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:48.713701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6f1e8d54-7049-4fa9-b91a-4f0e4518af00 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:48.714744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6f1e8d54-7049-4fa9-b91a-4f0e4518af00 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:48.726483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f1e8d54-7049-4fa9-b91a-4f0e4518af00 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:48.729061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f1e8d54-7049-4fa9-b91a-4f0e4518af00 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:48.730235 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f1e8d54-7049-4fa9-b91a-4f0e4518af00 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:48.731157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f1e8d54-7049-4fa9-b91a-4f0e4518af00 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:48.731814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f1e8d54-7049-4fa9-b91a-4f0e4518af00 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:48.733920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f1e8d54-7049-4fa9-b91a-4f0e4518af00 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:48.993609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3aaa861a-897c-4590-9992-50e79ff8c638 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:49.007283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3aaa861a-897c-4590-9992-50e79ff8c638 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:49.009580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3aaa861a-897c-4590-9992-50e79ff8c638 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:49.011533 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3aaa861a-897c-4590-9992-50e79ff8c638 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.430623 Oct 12 22:07:49.031107 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1174/2180] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:48 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:49.036696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d4774730-1e3f-4370-8d30-079424e7f1c9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:49.043491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d4774730-1e3f-4370-8d30-079424e7f1c9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:49.060129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4774730-1e3f-4370-8d30-079424e7f1c9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:49.060642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4774730-1e3f-4370-8d30-079424e7f1c9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:49.061083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4774730-1e3f-4370-8d30-079424e7f1c9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:49.061856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4774730-1e3f-4370-8d30-079424e7f1c9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:49.062314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4774730-1e3f-4370-8d30-079424e7f1c9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:49.062743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4774730-1e3f-4370-8d30-079424e7f1c9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:49.403532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d4774730-1e3f-4370-8d30-079424e7f1c9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:49.414207 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d4774730-1e3f-4370-8d30-079424e7f1c9 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1468 microversion: 2.1 time: 0.381856 Oct 12 22:07:49.415396 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1175/2181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:49 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1468 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:49.421546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dfc72e4a-213a-4a7f-9288-9e95c41eaf6a tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:49.422386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dfc72e4a-213a-4a7f-9288-9e95c41eaf6a tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:49.428538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfc72e4a-213a-4a7f-9288-9e95c41eaf6a tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:49.429602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfc72e4a-213a-4a7f-9288-9e95c41eaf6a tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:49.435822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfc72e4a-213a-4a7f-9288-9e95c41eaf6a tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:49.437419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfc72e4a-213a-4a7f-9288-9e95c41eaf6a tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:49.440063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfc72e4a-213a-4a7f-9288-9e95c41eaf6a tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:49.440603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfc72e4a-213a-4a7f-9288-9e95c41eaf6a tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:49.604613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6f1e8d54-7049-4fa9-b91a-4f0e4518af00 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:49.614284 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6f1e8d54-7049-4fa9-b91a-4f0e4518af00 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1667 microversion: 2.1 time: 0.911344 Oct 12 22:07:49.615214 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1007/2182] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:48 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1667 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:49.624800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-81a80e6f-b3f3-458b-a367-f3063d536169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:49.625881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-81a80e6f-b3f3-458b-a367-f3063d536169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:49.632882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81a80e6f-b3f3-458b-a367-f3063d536169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:49.633492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81a80e6f-b3f3-458b-a367-f3063d536169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:49.634119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81a80e6f-b3f3-458b-a367-f3063d536169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:49.635058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81a80e6f-b3f3-458b-a367-f3063d536169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:49.635619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81a80e6f-b3f3-458b-a367-f3063d536169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:49.636258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81a80e6f-b3f3-458b-a367-f3063d536169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:49.668035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dfc72e4a-213a-4a7f-9288-9e95c41eaf6a tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:49.677906 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dfc72e4a-213a-4a7f-9288-9e95c41eaf6a tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d" status: 200 len: 1317 microversion: 2.1 time: 0.261194 Oct 12 22:07:49.678581 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1176/2183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:49 2022] GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:49.724436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-799cc8a6-20cd-43ae-8d61-845c9cd9c6d5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:49.725649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-799cc8a6-20cd-43ae-8d61-845c9cd9c6d5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:49.736151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-799cc8a6-20cd-43ae-8d61-845c9cd9c6d5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:49.736928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-799cc8a6-20cd-43ae-8d61-845c9cd9c6d5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:49.738041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-799cc8a6-20cd-43ae-8d61-845c9cd9c6d5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:49.739121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-799cc8a6-20cd-43ae-8d61-845c9cd9c6d5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:49.740160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-799cc8a6-20cd-43ae-8d61-845c9cd9c6d5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:49.740959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-799cc8a6-20cd-43ae-8d61-845c9cd9c6d5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:49.980777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-799cc8a6-20cd-43ae-8d61-845c9cd9c6d5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:50.005453 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-799cc8a6-20cd-43ae-8d61-845c9cd9c6d5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1368 microversion: 2.1 time: 0.286453 Oct 12 22:07:50.021182 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1177/2184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:49 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1368 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:50.026936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-1d5fe60b-c527-488e-91d3-344df4026463 req-4d979517-f236-4055-ba80-514043c49eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325466ea-d13d-4204-89f6-7c5deb99cd61", "name": "network-vif-unplugged", "status": "completed", "tag": "e81cfc4b-c2b5-45e3-9fb2-a58a934b6b9b"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:50.061852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1d5fe60b-c527-488e-91d3-344df4026463 req-4d979517-f236-4055-ba80-514043c49eda service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:50.062843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1d5fe60b-c527-488e-91d3-344df4026463 req-4d979517-f236-4055-ba80-514043c49eda service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:50.063907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1d5fe60b-c527-488e-91d3-344df4026463 req-4d979517-f236-4055-ba80-514043c49eda service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:50.079651 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-1d5fe60b-c527-488e-91d3-344df4026463 req-4d979517-f236-4055-ba80-514043c49eda service nova] Creating event network-vif-unplugged:e81cfc4b-c2b5-45e3-9fb2-a58a934b6b9b for instance 325466ea-d13d-4204-89f6-7c5deb99cd61 on n-h2-861111-1 Oct 12 22:07:50.088433 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-1d5fe60b-c527-488e-91d3-344df4026463 req-4d979517-f236-4055-ba80-514043c49eda service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065037 Oct 12 22:07:50.088711 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1178/2185] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:50.115065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-970b1234-e889-45eb-9d94-73403e8d4a86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:50.116773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-970b1234-e889-45eb-9d94-73403e8d4a86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:50.127613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-970b1234-e889-45eb-9d94-73403e8d4a86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:50.128577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-970b1234-e889-45eb-9d94-73403e8d4a86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:50.131585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-970b1234-e889-45eb-9d94-73403e8d4a86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:50.132863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-970b1234-e889-45eb-9d94-73403e8d4a86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:50.133428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-970b1234-e889-45eb-9d94-73403e8d4a86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:50.134718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-970b1234-e889-45eb-9d94-73403e8d4a86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:50.394330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-970b1234-e889-45eb-9d94-73403e8d4a86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:50.404465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-970b1234-e889-45eb-9d94-73403e8d4a86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:50.406906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-970b1234-e889-45eb-9d94-73403e8d4a86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:50.408627 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-970b1234-e889-45eb-9d94-73403e8d4a86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.312924 Oct 12 22:07:50.414252 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1179/2186] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:50 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:50.438676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d8d630aa-1b69-491f-a268-d23f392bb55b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:50.439223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d8d630aa-1b69-491f-a268-d23f392bb55b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:50.445282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8d630aa-1b69-491f-a268-d23f392bb55b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:50.445777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8d630aa-1b69-491f-a268-d23f392bb55b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:50.446669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8d630aa-1b69-491f-a268-d23f392bb55b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:50.447441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8d630aa-1b69-491f-a268-d23f392bb55b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:50.447906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8d630aa-1b69-491f-a268-d23f392bb55b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:50.450305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8d630aa-1b69-491f-a268-d23f392bb55b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:50.569005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d8d630aa-1b69-491f-a268-d23f392bb55b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:50.587817 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d8d630aa-1b69-491f-a268-d23f392bb55b tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 200 len: 1426 microversion: 2.1 time: 0.153408 Oct 12 22:07:50.590098 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1180/2187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:50 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 1426 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:07:50.639802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-93fd94e0-3519-433c-95cf-130a93ea6e0a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:50.640619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-93fd94e0-3519-433c-95cf-130a93ea6e0a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:50.652257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93fd94e0-3519-433c-95cf-130a93ea6e0a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:50.653338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93fd94e0-3519-433c-95cf-130a93ea6e0a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:50.654456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93fd94e0-3519-433c-95cf-130a93ea6e0a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:50.655758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93fd94e0-3519-433c-95cf-130a93ea6e0a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:50.656418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93fd94e0-3519-433c-95cf-130a93ea6e0a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:50.656861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93fd94e0-3519-433c-95cf-130a93ea6e0a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:50.688018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-81a80e6f-b3f3-458b-a367-f3063d536169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:50.700486 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-81a80e6f-b3f3-458b-a367-f3063d536169 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1370 microversion: 2.1 time: 1.083950 Oct 12 22:07:50.704032 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1008/2188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:49 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1370 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:50.881088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=26 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:50.894080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-93fd94e0-3519-433c-95cf-130a93ea6e0a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:50.907759 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-93fd94e0-3519-433c-95cf-130a93ea6e0a tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1667 microversion: 2.1 time: 0.269520 Oct 12 22:07:50.911312 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1181/2189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:50 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1667 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:50.936395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cbd34bf2-7a20-4501-980d-c27a73620765 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:50.951322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cbd34bf2-7a20-4501-980d-c27a73620765 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:50.970004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbd34bf2-7a20-4501-980d-c27a73620765 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:50.974950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbd34bf2-7a20-4501-980d-c27a73620765 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:50.977361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbd34bf2-7a20-4501-980d-c27a73620765 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:50.979186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbd34bf2-7a20-4501-980d-c27a73620765 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:50.980429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbd34bf2-7a20-4501-980d-c27a73620765 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:50.983724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbd34bf2-7a20-4501-980d-c27a73620765 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:51.108694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1408180554", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "11fa6dbb-49c0-4bd8-acec-556f3ba24029"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:51.227799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] validate_networks() for [('11fa6dbb-49c0-4bd8-acec-556f3ba24029', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:07:51.257944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cbd34bf2-7a20-4501-980d-c27a73620765 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:51.268418 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cbd34bf2-7a20-4501-980d-c27a73620765 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d" status: 200 len: 1317 microversion: 2.1 time: 0.355656 Oct 12 22:07:51.284999 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1182/2190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:50 2022] GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:51.290546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-779ef4c4-3563-4860-a9a6-c6e7017256e1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:51.291640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-779ef4c4-3563-4860-a9a6-c6e7017256e1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:51.299865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-779ef4c4-3563-4860-a9a6-c6e7017256e1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:51.300418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-779ef4c4-3563-4860-a9a6-c6e7017256e1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:51.300970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-779ef4c4-3563-4860-a9a6-c6e7017256e1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:51.301778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-779ef4c4-3563-4860-a9a6-c6e7017256e1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:51.302345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-779ef4c4-3563-4860-a9a6-c6e7017256e1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:51.302869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-779ef4c4-3563-4860-a9a6-c6e7017256e1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:51.474777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-779ef4c4-3563-4860-a9a6-c6e7017256e1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:51.485873 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-779ef4c4-3563-4860-a9a6-c6e7017256e1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1368 microversion: 2.1 time: 0.199217 Oct 12 22:07:51.511439 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1183/2191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:51 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:51.518506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0176bd5f-3040-479a-ad67-d0f67777e952 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:51.519147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0176bd5f-3040-479a-ad67-d0f67777e952 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:51.527009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0176bd5f-3040-479a-ad67-d0f67777e952 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:51.529865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0176bd5f-3040-479a-ad67-d0f67777e952 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:51.530786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0176bd5f-3040-479a-ad67-d0f67777e952 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:51.531732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0176bd5f-3040-479a-ad67-d0f67777e952 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:51.532890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0176bd5f-3040-479a-ad67-d0f67777e952 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:51.533508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0176bd5f-3040-479a-ad67-d0f67777e952 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:51.738661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0176bd5f-3040-479a-ad67-d0f67777e952 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:51.748248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0176bd5f-3040-479a-ad67-d0f67777e952 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:51.750734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0176bd5f-3040-479a-ad67-d0f67777e952 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:51.752094 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0176bd5f-3040-479a-ad67-d0f67777e952 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.239202 Oct 12 22:07:51.752682 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1184/2192] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:51 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:51.758403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e9bec419-e6ee-46fb-8bce-fdbf268f7869 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:51.759273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e9bec419-e6ee-46fb-8bce-fdbf268f7869 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 15055486-69c3-4d87-99da-927949deea8a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:51.766090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9bec419-e6ee-46fb-8bce-fdbf268f7869 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:51.766866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9bec419-e6ee-46fb-8bce-fdbf268f7869 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:51.767509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9bec419-e6ee-46fb-8bce-fdbf268f7869 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:51.768408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9bec419-e6ee-46fb-8bce-fdbf268f7869 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:51.769603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9bec419-e6ee-46fb-8bce-fdbf268f7869 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:51.770587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9bec419-e6ee-46fb-8bce-fdbf268f7869 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:51.815869 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-e9bec419-e6ee-46fb-8bce-fdbf268f7869 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] HTTP exception thrown: Instance 15055486-69c3-4d87-99da-927949deea8a could not be found. Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e9bec419-e6ee-46fb-8bce-fdbf268f7869 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Request method failure captured: Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a HTTP/1.1 Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlvk8Zf5YMjK78ehwua-VIp9tTEWatKA_MwoBx1A7nZ1jO8nGeK8kIboYB3nTbSWwYSvd7WDTRzOrvcfJnVCrHEawKN0Ex4PqqKTBPc7KUF441v6xgLwZCrBOH5r7xr8B7W31weCRXkIKg51P_759AClf1ZN4y-HST82G9fLe0WJA8 Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7d943f8c0c934001b53032564fd00e11 Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-MigrationsAdminTest-40857002 Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d943f8c0c934001b53032564fd00e11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d943f8c0c934001b53032564fd00e11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d943f8c0c934001b53032564fd00e11", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d943f8c0c934001b53032564fd00e11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-MigrationsAdminTest-40857002 Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7d943f8c0c934001b53032564fd00e11 Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-MigrationsAdminTest-40857002 Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-MigrationsAdminTest-40857002-project Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: cfc7df27bf6f456581abff6e80ab4f64 Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-MigrationsAdminTest-40857002-project Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 15055486-69c3-4d87-99da-927949deea8a could not be found. Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '15055486-69c3-4d87-99da-927949deea8a'} Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15055486-69c3-4d87-99da-927949deea8a could not be found. Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15055486-69c3-4d87-99da-927949deea8a could not be found. Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:51.823590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:51.834111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:51.834111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:51.834111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:51.834111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:51.834111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:51.834111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15055486-69c3-4d87-99da-927949deea8a could not be found. Oct 12 22:07:51.834111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:07:51.837417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e9bec419-e6ee-46fb-8bce-fdbf268f7869 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Returning 404 to user: Instance 15055486-69c3-4d87-99da-927949deea8a could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:51.839008 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e9bec419-e6ee-46fb-8bce-fdbf268f7869 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a" status: 404 len: 111 microversion: 2.1 time: 0.085078 Oct 12 22:07:51.840735 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1185/2193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:51 2022] GET /compute/v2.1/servers/15055486-69c3-4d87-99da-927949deea8a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:07:51.851030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-35feb527-aa81-4917-bdc6-717a51a3d2d8 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:51.852930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-35feb527-aa81-4917-bdc6-717a51a3d2d8 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:51.867167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35feb527-aa81-4917-bdc6-717a51a3d2d8 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:51.868518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35feb527-aa81-4917-bdc6-717a51a3d2d8 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:51.869570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35feb527-aa81-4917-bdc6-717a51a3d2d8 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:51.870971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35feb527-aa81-4917-bdc6-717a51a3d2d8 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:51.872063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35feb527-aa81-4917-bdc6-717a51a3d2d8 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:51.873327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35feb527-aa81-4917-bdc6-717a51a3d2d8 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:52.072885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-35feb527-aa81-4917-bdc6-717a51a3d2d8 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:52.084041 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-35feb527-aa81-4917-bdc6-717a51a3d2d8 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1370 microversion: 2.1 time: 0.241425 Oct 12 22:07:52.085797 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1186/2194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:51 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:52.102899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-153e3d2b-f5c2-4035-90a1-fa7cc14ea3da tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:52.103795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-153e3d2b-f5c2-4035-90a1-fa7cc14ea3da tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:52.111913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-153e3d2b-f5c2-4035-90a1-fa7cc14ea3da tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:52.112750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-153e3d2b-f5c2-4035-90a1-fa7cc14ea3da tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:52.113409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-153e3d2b-f5c2-4035-90a1-fa7cc14ea3da tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:52.114337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-153e3d2b-f5c2-4035-90a1-fa7cc14ea3da tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:52.115101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-153e3d2b-f5c2-4035-90a1-fa7cc14ea3da tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:52.115888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-153e3d2b-f5c2-4035-90a1-fa7cc14ea3da tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:52.153863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-153e3d2b-f5c2-4035-90a1-fa7cc14ea3da tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:07:52.276217 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-153e3d2b-f5c2-4035-90a1-fa7cc14ea3da tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 204 len: 0 microversion: 2.1 time: 0.188833 Oct 12 22:07:52.278481 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1187/2195] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:07:52 2022] DELETE /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:07:52.291365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e4c200a9-7451-4cb7-a354-f979324d8335 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:52.293304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e4c200a9-7451-4cb7-a354-f979324d8335 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:52.303526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4c200a9-7451-4cb7-a354-f979324d8335 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:52.304584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4c200a9-7451-4cb7-a354-f979324d8335 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:52.305600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4c200a9-7451-4cb7-a354-f979324d8335 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:52.307434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4c200a9-7451-4cb7-a354-f979324d8335 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:52.308368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4c200a9-7451-4cb7-a354-f979324d8335 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:52.310306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4c200a9-7451-4cb7-a354-f979324d8335 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:52.319702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:52.414290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e4c200a9-7451-4cb7-a354-f979324d8335 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:52.422612 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e4c200a9-7451-4cb7-a354-f979324d8335 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1600 microversion: 2.1 time: 0.141461 Oct 12 22:07:52.423605 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1188/2196] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:52 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1600 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:52.428275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-7370c088-ab3c-46db-9c7d-53fcf81f6e5d req-e0542139-2218-4b93-ba5d-53854ecf836b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15055486-69c3-4d87-99da-927949deea8a", "name": "network-vif-deleted", "tag": "fec38738-06d0-4ba1-b408-8e99dc334dea"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:52.437703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7370c088-ab3c-46db-9c7d-53fcf81f6e5d req-e0542139-2218-4b93-ba5d-53854ecf836b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:52.438178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7370c088-ab3c-46db-9c7d-53fcf81f6e5d req-e0542139-2218-4b93-ba5d-53854ecf836b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:52.439027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7370c088-ab3c-46db-9c7d-53fcf81f6e5d req-e0542139-2218-4b93-ba5d-53854ecf836b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:52.451509 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-7370c088-ab3c-46db-9c7d-53fcf81f6e5d req-e0542139-2218-4b93-ba5d-53854ecf836b service nova] Creating event network-vif-deleted:fec38738-06d0-4ba1-b408-8e99dc334dea for instance 15055486-69c3-4d87-99da-927949deea8a on n-h1-861111-1 Oct 12 22:07:52.456934 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-7370c088-ab3c-46db-9c7d-53fcf81f6e5d req-e0542139-2218-4b93-ba5d-53854ecf836b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032000 Oct 12 22:07:52.458041 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1189/2197] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:52.463992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eec68982-270c-4a21-8ae4-a949415a342e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:52.464696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eec68982-270c-4a21-8ae4-a949415a342e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:52.466627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:52.476876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eec68982-270c-4a21-8ae4-a949415a342e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:52.477628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eec68982-270c-4a21-8ae4-a949415a342e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:52.478490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eec68982-270c-4a21-8ae4-a949415a342e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:52.479310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eec68982-270c-4a21-8ae4-a949415a342e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:52.479782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eec68982-270c-4a21-8ae4-a949415a342e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:52.481433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eec68982-270c-4a21-8ae4-a949415a342e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:52.627225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eec68982-270c-4a21-8ae4-a949415a342e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:52.639001 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eec68982-270c-4a21-8ae4-a949415a342e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1535 microversion: 2.1 time: 0.179567 Oct 12 22:07:52.652955 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1190/2198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:52 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1535 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:52.652955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8abd1850-a12d-48c5-8957-67ce91ca58a5 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:52.652955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8abd1850-a12d-48c5-8957-67ce91ca58a5 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:52.659067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8abd1850-a12d-48c5-8957-67ce91ca58a5 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:52.659067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8abd1850-a12d-48c5-8957-67ce91ca58a5 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:52.659067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8abd1850-a12d-48c5-8957-67ce91ca58a5 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:52.659067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8abd1850-a12d-48c5-8957-67ce91ca58a5 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:52.659067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8abd1850-a12d-48c5-8957-67ce91ca58a5 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:52.659067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8abd1850-a12d-48c5-8957-67ce91ca58a5 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:52.803002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8abd1850-a12d-48c5-8957-67ce91ca58a5 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:52.813886 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8abd1850-a12d-48c5-8957-67ce91ca58a5 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d" status: 200 len: 1504 microversion: 2.1 time: 0.171973 Oct 12 22:07:52.814817 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1191/2199] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:52 2022] GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:52.847301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bf5b0507-1d3a-44b7-b214-e87081b9b18e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:52.848442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bf5b0507-1d3a-44b7-b214-e87081b9b18e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:52.859786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5b0507-1d3a-44b7-b214-e87081b9b18e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:52.860368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5b0507-1d3a-44b7-b214-e87081b9b18e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:52.860943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5b0507-1d3a-44b7-b214-e87081b9b18e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:52.861980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5b0507-1d3a-44b7-b214-e87081b9b18e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:52.862503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5b0507-1d3a-44b7-b214-e87081b9b18e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:52.862994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5b0507-1d3a-44b7-b214-e87081b9b18e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:53.038845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bf5b0507-1d3a-44b7-b214-e87081b9b18e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:53.047695 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bf5b0507-1d3a-44b7-b214-e87081b9b18e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1368 microversion: 2.1 time: 0.231978 Oct 12 22:07:53.065014 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1192/2200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:52 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:53.071081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6ae2df94-ed94-4f2f-8e9d-a57d91fabe05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:53.071639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6ae2df94-ed94-4f2f-8e9d-a57d91fabe05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:53.079057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ae2df94-ed94-4f2f-8e9d-a57d91fabe05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:53.079790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ae2df94-ed94-4f2f-8e9d-a57d91fabe05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:53.080040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ae2df94-ed94-4f2f-8e9d-a57d91fabe05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:53.080919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ae2df94-ed94-4f2f-8e9d-a57d91fabe05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:53.081379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ae2df94-ed94-4f2f-8e9d-a57d91fabe05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:53.081810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ae2df94-ed94-4f2f-8e9d-a57d91fabe05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:53.242360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6ae2df94-ed94-4f2f-8e9d-a57d91fabe05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:53.252492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6ae2df94-ed94-4f2f-8e9d-a57d91fabe05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:53.254085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6ae2df94-ed94-4f2f-8e9d-a57d91fabe05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:53.255126 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6ae2df94-ed94-4f2f-8e9d-a57d91fabe05 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.189248 Oct 12 22:07:53.272749 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1193/2201] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:53 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:53.281262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7f972f54-4aa7-41d3-afd9-60a77ca27922 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:53.282433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7f972f54-4aa7-41d3-afd9-60a77ca27922 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 29bd3420-7cb1-4a2d-9e61-815d446f1a92] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:53.288570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f972f54-4aa7-41d3-afd9-60a77ca27922 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:53.289056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f972f54-4aa7-41d3-afd9-60a77ca27922 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:53.289509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f972f54-4aa7-41d3-afd9-60a77ca27922 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:53.290361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f972f54-4aa7-41d3-afd9-60a77ca27922 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:53.290821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f972f54-4aa7-41d3-afd9-60a77ca27922 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:53.291261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f972f54-4aa7-41d3-afd9-60a77ca27922 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:53.575789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7f972f54-4aa7-41d3-afd9-60a77ca27922 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:53.590446 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7f972f54-4aa7-41d3-afd9-60a77ca27922 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/29bd3420-7cb1-4a2d-9e61-815d446f1a92" status: 200 len: 1505 microversion: 2.1 time: 0.316378 Oct 12 22:07:53.591474 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1194/2202] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:53 2022] GET /compute/v2.1/servers/29bd3420-7cb1-4a2d-9e61-815d446f1a92 => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:53.597742 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:07:53.598386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:07:53.598935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:07:53.599585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:07:53.600111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:07:53.601399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-677a5e79-35ad-46c1-8088-0816b177525e tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:53.602223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-677a5e79-35ad-46c1-8088-0816b177525e tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:53.613948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-677a5e79-35ad-46c1-8088-0816b177525e tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:53.614604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-677a5e79-35ad-46c1-8088-0816b177525e tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:53.615724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-677a5e79-35ad-46c1-8088-0816b177525e tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:53.630927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:53.631480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:53.632479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-677a5e79-35ad-46c1-8088-0816b177525e tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:53.633753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-677a5e79-35ad-46c1-8088-0816b177525e tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:53.633901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:53.635505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-677a5e79-35ad-46c1-8088-0816b177525e tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:53.636753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:53.637245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:53.637938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:53.708066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Getting quotas for project c6c802d3b49b42dfb9c18989fcdea236. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:07:53.721589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Getting quotas for user 6c3e63a35645469587551965e247f103 and project c6c802d3b49b42dfb9c18989fcdea236. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:07:53.766163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:07:53.775026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:07:53.881259 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6fbfcc23-8071-4f3a-9a6a-47dca4115f0a tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.174498 Oct 12 22:07:53.887967 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1009/2203] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:07:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:07:53.899644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3483230b-a2d4-4d2f-9dfe-b56dd341ad02 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:53.900445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3483230b-a2d4-4d2f-9dfe-b56dd341ad02 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:53.917772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3483230b-a2d4-4d2f-9dfe-b56dd341ad02 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:53.920806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3483230b-a2d4-4d2f-9dfe-b56dd341ad02 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:53.921560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3483230b-a2d4-4d2f-9dfe-b56dd341ad02 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:53.922296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3483230b-a2d4-4d2f-9dfe-b56dd341ad02 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:53.922750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3483230b-a2d4-4d2f-9dfe-b56dd341ad02 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:53.923175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3483230b-a2d4-4d2f-9dfe-b56dd341ad02 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:53.988056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3483230b-a2d4-4d2f-9dfe-b56dd341ad02 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:53.989334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3483230b-a2d4-4d2f-9dfe-b56dd341ad02 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:53.989796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3483230b-a2d4-4d2f-9dfe-b56dd341ad02 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:53.990561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-3483230b-a2d4-4d2f-9dfe-b56dd341ad02 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lazy-loading 'fault' on Instance uuid 3d06c998-c0a6-4bb7-8538-9a7b0298b918 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:07:54.008406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-677a5e79-35ad-46c1-8088-0816b177525e tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:54.020334 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-677a5e79-35ad-46c1-8088-0816b177525e tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1370 microversion: 2.1 time: 0.427224 Oct 12 22:07:54.020933 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1195/2204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:53 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1370 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:54.025505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bee5e2a4-2b69-4755-a918-4d506a9a7463 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:54.025993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bee5e2a4-2b69-4755-a918-4d506a9a7463 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 29bd3420-7cb1-4a2d-9e61-815d446f1a92] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:54.043057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bee5e2a4-2b69-4755-a918-4d506a9a7463 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:54.043642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bee5e2a4-2b69-4755-a918-4d506a9a7463 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:54.044075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bee5e2a4-2b69-4755-a918-4d506a9a7463 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:54.044930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bee5e2a4-2b69-4755-a918-4d506a9a7463 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:54.045637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bee5e2a4-2b69-4755-a918-4d506a9a7463 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:54.047047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bee5e2a4-2b69-4755-a918-4d506a9a7463 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:54.088289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bee5e2a4-2b69-4755-a918-4d506a9a7463 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 29bd3420-7cb1-4a2d-9e61-815d446f1a92] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:07:54.168798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3483230b-a2d4-4d2f-9dfe-b56dd341ad02 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:54.186498 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3483230b-a2d4-4d2f-9dfe-b56dd341ad02 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 200 len: 1324 microversion: 2.1 time: 0.300800 Oct 12 22:07:54.195392 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1010/2205] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:53 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:54.202721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-44beaec4-5211-419d-8432-3ddf19adc9f6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:54.203443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-44beaec4-5211-419d-8432-3ddf19adc9f6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:54.221120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44beaec4-5211-419d-8432-3ddf19adc9f6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:54.223026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44beaec4-5211-419d-8432-3ddf19adc9f6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:54.224586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44beaec4-5211-419d-8432-3ddf19adc9f6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:54.225323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44beaec4-5211-419d-8432-3ddf19adc9f6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:54.229109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44beaec4-5211-419d-8432-3ddf19adc9f6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:54.231374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44beaec4-5211-419d-8432-3ddf19adc9f6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:54.296187 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bee5e2a4-2b69-4755-a918-4d506a9a7463 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29bd3420-7cb1-4a2d-9e61-815d446f1a92" status: 204 len: 0 microversion: 2.1 time: 0.272523 Oct 12 22:07:54.297513 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1196/2206] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:07:54 2022] DELETE /compute/v2.1/servers/29bd3420-7cb1-4a2d-9e61-815d446f1a92 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:07:54.309584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-85bec7f8-931d-4424-928c-66220a6059a9 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:54.312465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-85bec7f8-931d-4424-928c-66220a6059a9 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:54.399263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-85bec7f8-931d-4424-928c-66220a6059a9 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:54.406421 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-85bec7f8-931d-4424-928c-66220a6059a9 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1216 microversion: 2.1 time: 0.107307 Oct 12 22:07:54.407501 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1197/2207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:54 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1216 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:54.412173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-144f1ce5-6869-47fa-a37a-d261d5a7afc2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:54.412847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-144f1ce5-6869-47fa-a37a-d261d5a7afc2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:54.420321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-144f1ce5-6869-47fa-a37a-d261d5a7afc2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:54.420932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-144f1ce5-6869-47fa-a37a-d261d5a7afc2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:54.421477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-144f1ce5-6869-47fa-a37a-d261d5a7afc2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:54.422250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-144f1ce5-6869-47fa-a37a-d261d5a7afc2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:54.422774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-144f1ce5-6869-47fa-a37a-d261d5a7afc2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:54.423338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-144f1ce5-6869-47fa-a37a-d261d5a7afc2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:54.620156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-144f1ce5-6869-47fa-a37a-d261d5a7afc2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:54.630729 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-144f1ce5-6869-47fa-a37a-d261d5a7afc2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1368 microversion: 2.1 time: 0.222115 Oct 12 22:07:54.632062 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1198/2208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:54 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:54.649987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0e57dd42-5bf1-4d55-8c1f-83ff425a48ca tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:54.650715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0e57dd42-5bf1-4d55-8c1f-83ff425a48ca tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:54.657797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e57dd42-5bf1-4d55-8c1f-83ff425a48ca tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:54.658368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e57dd42-5bf1-4d55-8c1f-83ff425a48ca tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:54.658895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e57dd42-5bf1-4d55-8c1f-83ff425a48ca tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:54.659803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e57dd42-5bf1-4d55-8c1f-83ff425a48ca tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:54.660250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e57dd42-5bf1-4d55-8c1f-83ff425a48ca tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:54.660744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e57dd42-5bf1-4d55-8c1f-83ff425a48ca tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:54.764748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-44beaec4-5211-419d-8432-3ddf19adc9f6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:54.782012 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-44beaec4-5211-419d-8432-3ddf19adc9f6 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1535 microversion: 2.1 time: 0.588450 Oct 12 22:07:54.800658 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1011/2209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:54 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1535 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:54.807891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-239d5d41-5b82-44d9-b30e-b26e82b49b52 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:54.808416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-239d5d41-5b82-44d9-b30e-b26e82b49b52 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:54.816657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-239d5d41-5b82-44d9-b30e-b26e82b49b52 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:54.818291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-239d5d41-5b82-44d9-b30e-b26e82b49b52 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:54.818870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-239d5d41-5b82-44d9-b30e-b26e82b49b52 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:54.820129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-239d5d41-5b82-44d9-b30e-b26e82b49b52 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:54.820623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-239d5d41-5b82-44d9-b30e-b26e82b49b52 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:54.821161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-239d5d41-5b82-44d9-b30e-b26e82b49b52 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:54.857069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-239d5d41-5b82-44d9-b30e-b26e82b49b52 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:07:54.898709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0e57dd42-5bf1-4d55-8c1f-83ff425a48ca tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:54.948021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0e57dd42-5bf1-4d55-8c1f-83ff425a48ca tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:54.961736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0e57dd42-5bf1-4d55-8c1f-83ff425a48ca tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:54.965966 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0e57dd42-5bf1-4d55-8c1f-83ff425a48ca tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.331764 Oct 12 22:07:54.970550 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1199/2210] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:54 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:54.990818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-6a572680-c3c5-4cf7-970d-61791be3410f req-9a0b362f-0750-4344-84f4-6310f5c6fdab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325466ea-d13d-4204-89f6-7c5deb99cd61", "tag": "e81cfc4b-c2b5-45e3-9fb2-a58a934b6b9b"}, {"server_uuid": "3d06c998-c0a6-4bb7-8538-9a7b0298b918", "name": "network-vif-deleted", "tag": "6a950ceb-e8e8-414f-921b-8239a9d66a46"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:55.017439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6a572680-c3c5-4cf7-970d-61791be3410f req-9a0b362f-0750-4344-84f4-6310f5c6fdab service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:55.018191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6a572680-c3c5-4cf7-970d-61791be3410f req-9a0b362f-0750-4344-84f4-6310f5c6fdab service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:55.020021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6a572680-c3c5-4cf7-970d-61791be3410f req-9a0b362f-0750-4344-84f4-6310f5c6fdab service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:55.030242 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-239d5d41-5b82-44d9-b30e-b26e82b49b52 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d" status: 204 len: 0 microversion: 2.1 time: 0.227566 Oct 12 22:07:55.030923 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1012/2211] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:07:54 2022] DELETE /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:07:55.051432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f777335-004a-4162-ac8c-356229f0eb47 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:55.052635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8f777335-004a-4162-ac8c-356229f0eb47 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 29bd3420-7cb1-4a2d-9e61-815d446f1a92] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:55.059479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f777335-004a-4162-ac8c-356229f0eb47 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:55.059701 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6a572680-c3c5-4cf7-970d-61791be3410f req-9a0b362f-0750-4344-84f4-6310f5c6fdab service nova] Creating event network-changed:e81cfc4b-c2b5-45e3-9fb2-a58a934b6b9b for instance 325466ea-d13d-4204-89f6-7c5deb99cd61 on n-h2-861111-1 Oct 12 22:07:55.059975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f777335-004a-4162-ac8c-356229f0eb47 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:55.060136 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6a572680-c3c5-4cf7-970d-61791be3410f req-9a0b362f-0750-4344-84f4-6310f5c6fdab service nova] Creating event network-vif-deleted:6a950ceb-e8e8-414f-921b-8239a9d66a46 for instance 3d06c998-c0a6-4bb7-8538-9a7b0298b918 on n-h1-861111-1 Oct 12 22:07:55.060736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f777335-004a-4162-ac8c-356229f0eb47 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:55.062150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f777335-004a-4162-ac8c-356229f0eb47 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:55.062789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f777335-004a-4162-ac8c-356229f0eb47 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:55.063425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f777335-004a-4162-ac8c-356229f0eb47 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:55.091106 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-6a572680-c3c5-4cf7-970d-61791be3410f req-9a0b362f-0750-4344-84f4-6310f5c6fdab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.115740 Oct 12 22:07:55.093495 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1200/2212] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:55.100556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-88795aed-ebaf-43bd-8493-e72c12092ee6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:55.101708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-88795aed-ebaf-43bd-8493-e72c12092ee6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:55.114541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88795aed-ebaf-43bd-8493-e72c12092ee6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:55.115319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88795aed-ebaf-43bd-8493-e72c12092ee6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:55.115969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88795aed-ebaf-43bd-8493-e72c12092ee6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:55.116920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88795aed-ebaf-43bd-8493-e72c12092ee6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:55.117859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88795aed-ebaf-43bd-8493-e72c12092ee6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:55.118682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88795aed-ebaf-43bd-8493-e72c12092ee6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:55.300551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-88795aed-ebaf-43bd-8493-e72c12092ee6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:55.319153 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-88795aed-ebaf-43bd-8493-e72c12092ee6 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1370 microversion: 2.1 time: 0.224230 Oct 12 22:07:55.319797 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1201/2213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:55 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:55.326489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f777335-004a-4162-ac8c-356229f0eb47 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:55.335864 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f777335-004a-4162-ac8c-356229f0eb47 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/29bd3420-7cb1-4a2d-9e61-815d446f1a92" status: 200 len: 1511 microversion: 2.1 time: 0.300307 Oct 12 22:07:55.338232 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1013/2214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:55 2022] GET /compute/v2.1/servers/29bd3420-7cb1-4a2d-9e61-815d446f1a92 => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:55.356115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dc588c36-77d1-460b-91ce-fe6c879bca3e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:55.359421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dc588c36-77d1-460b-91ce-fe6c879bca3e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 3d06c998-c0a6-4bb7-8538-9a7b0298b918] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:55.375895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc588c36-77d1-460b-91ce-fe6c879bca3e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:55.376545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc588c36-77d1-460b-91ce-fe6c879bca3e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:55.377053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc588c36-77d1-460b-91ce-fe6c879bca3e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:55.381084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc588c36-77d1-460b-91ce-fe6c879bca3e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:55.382941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc588c36-77d1-460b-91ce-fe6c879bca3e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:55.383551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc588c36-77d1-460b-91ce-fe6c879bca3e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:55.434067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2149f70a-811b-4cd9-ad96-60e4f3e03b78 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:55.434715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2149f70a-811b-4cd9-ad96-60e4f3e03b78 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:55.449189 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-dc588c36-77d1-460b-91ce-fe6c879bca3e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] HTTP exception thrown: Instance 3d06c998-c0a6-4bb7-8538-9a7b0298b918 could not be found. Oct 12 22:07:55.452658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2149f70a-811b-4cd9-ad96-60e4f3e03b78 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:55.453155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2149f70a-811b-4cd9-ad96-60e4f3e03b78 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dc588c36-77d1-460b-91ce-fe6c879bca3e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Request method failure captured: Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 HTTP/1.1 Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzjWa7fW4cCWMnkS2ihtgUCglzU38ChAzYORmM7Dbu9VoPpmuOcvF68E2HOkgVWjtO59JzvrNcPt6cpEPfgvTwc8u3yOUJpSVFhJvxoJSFOpL6COZC7hUepcrA4h6-wO_W4qNSt17id_hM0-SJoaXsiZjl3SD74vmQRJZQN-oA7sWak Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 61e71a9eeaa044e8aa939548f15a585e Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-LiveMigrationTest-68417645 Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61e71a9eeaa044e8aa939548f15a585e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61e71a9eeaa044e8aa939548f15a585e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_61e71a9eeaa044e8aa939548f15a585e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/61e71a9eeaa044e8aa939548f15a585e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-LiveMigrationTest-68417645 Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 61e71a9eeaa044e8aa939548f15a585e Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-LiveMigrationTest-68417645 Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-LiveMigrationTest-68417645-project Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 1fe98ba1ceec4b849eb45eb46ce4d425 Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-LiveMigrationTest-68417645-project Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 3d06c998-c0a6-4bb7-8538-9a7b0298b918 could not be found. Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '3d06c998-c0a6-4bb7-8538-9a7b0298b918'} Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d06c998-c0a6-4bb7-8538-9a7b0298b918 could not be found. Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d06c998-c0a6-4bb7-8538-9a7b0298b918 could not be found. Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:07:55.454313 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:55.459199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:07:55.459199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:07:55.459199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:07:55.459199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:07:55.459199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:07:55.459199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d06c998-c0a6-4bb7-8538-9a7b0298b918 could not be found. Oct 12 22:07:55.459199 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:07:55.462903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dc588c36-77d1-460b-91ce-fe6c879bca3e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Returning 404 to user: Instance 3d06c998-c0a6-4bb7-8538-9a7b0298b918 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:07:55.465163 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dc588c36-77d1-460b-91ce-fe6c879bca3e tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918" status: 404 len: 111 microversion: 2.1 time: 0.125017 Oct 12 22:07:55.466259 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1014/2215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:55 2022] GET /compute/v2.1/servers/3d06c998-c0a6-4bb7-8538-9a7b0298b918 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:07:55.469922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2149f70a-811b-4cd9-ad96-60e4f3e03b78 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:55.471381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2149f70a-811b-4cd9-ad96-60e4f3e03b78 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:55.472774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2149f70a-811b-4cd9-ad96-60e4f3e03b78 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:55.473326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2149f70a-811b-4cd9-ad96-60e4f3e03b78 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:55.484931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6be8f392-7a7a-491b-9afa-5820628fcdf0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '.version_select at 0x7f5128524c10>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:55.534025 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6be8f392-7a7a-491b-9afa-5820628fcdf0 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1903244980" status: 202 len: 0 microversion: 2.1 time: 0.062739 Oct 12 22:07:55.541270 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1015/2216] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 12 22:07:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1903244980 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:07:55.653955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9df41cf1-5a12-4487-9f2a-7d0dc5030fe5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:55.654606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9df41cf1-5a12-4487-9f2a-7d0dc5030fe5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:55.672072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:55.673965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9df41cf1-5a12-4487-9f2a-7d0dc5030fe5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:55.674474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9df41cf1-5a12-4487-9f2a-7d0dc5030fe5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:55.675013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9df41cf1-5a12-4487-9f2a-7d0dc5030fe5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:55.675917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9df41cf1-5a12-4487-9f2a-7d0dc5030fe5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:55.676464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9df41cf1-5a12-4487-9f2a-7d0dc5030fe5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:55.677036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9df41cf1-5a12-4487-9f2a-7d0dc5030fe5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:55.932911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2149f70a-811b-4cd9-ad96-60e4f3e03b78 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:55.944572 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2149f70a-811b-4cd9-ad96-60e4f3e03b78 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1268 microversion: 2.1 time: 0.519138 Oct 12 22:07:55.950069 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1202/2217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:55 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1268 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:07:55.964492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-73179704-9bc5-46e8-9e0e-9b947183ced7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:55.965657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-73179704-9bc5-46e8-9e0e-9b947183ced7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:55.983184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73179704-9bc5-46e8-9e0e-9b947183ced7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:55.985253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73179704-9bc5-46e8-9e0e-9b947183ced7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:55.988558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73179704-9bc5-46e8-9e0e-9b947183ced7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:55.990346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73179704-9bc5-46e8-9e0e-9b947183ced7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:55.991036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73179704-9bc5-46e8-9e0e-9b947183ced7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:55.992181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73179704-9bc5-46e8-9e0e-9b947183ced7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:56.098821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-73179704-9bc5-46e8-9e0e-9b947183ced7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:56.115170 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-73179704-9bc5-46e8-9e0e-9b947183ced7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1493 microversion: 2.1 time: 0.163967 Oct 12 22:07:56.132927 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1203/2218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:55 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1493 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:56.140064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1745d442-f81a-4c50-9071-a4168b5cc593 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:56.147433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1745d442-f81a-4c50-9071-a4168b5cc593 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:56.158325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1745d442-f81a-4c50-9071-a4168b5cc593 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:56.159041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1745d442-f81a-4c50-9071-a4168b5cc593 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:56.161855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1745d442-f81a-4c50-9071-a4168b5cc593 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:56.162807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1745d442-f81a-4c50-9071-a4168b5cc593 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:56.163606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1745d442-f81a-4c50-9071-a4168b5cc593 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:56.166927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1745d442-f81a-4c50-9071-a4168b5cc593 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:56.916184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1745d442-f81a-4c50-9071-a4168b5cc593 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:56.925452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1745d442-f81a-4c50-9071-a4168b5cc593 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:56.936498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1745d442-f81a-4c50-9071-a4168b5cc593 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:56.947143 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1745d442-f81a-4c50-9071-a4168b5cc593 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.811049 Oct 12 22:07:56.959986 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1204/2219] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:56 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:56.959986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-75fe3aac-577f-498e-8185-20d44df54ab4 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:56.960565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-75fe3aac-577f-498e-8185-20d44df54ab4 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:56.984471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75fe3aac-577f-498e-8185-20d44df54ab4 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:56.984746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75fe3aac-577f-498e-8185-20d44df54ab4 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:56.985140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75fe3aac-577f-498e-8185-20d44df54ab4 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:56.985864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75fe3aac-577f-498e-8185-20d44df54ab4 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:56.991625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75fe3aac-577f-498e-8185-20d44df54ab4 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:56.992470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75fe3aac-577f-498e-8185-20d44df54ab4 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:57.033972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:07:57.082887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9df41cf1-5a12-4487-9f2a-7d0dc5030fe5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:57.095102 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9df41cf1-5a12-4487-9f2a-7d0dc5030fe5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1368 microversion: 2.1 time: 1.444958 Oct 12 22:07:57.099147 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1016/2220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:55 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1368 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:07:57.120339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a935dc76-f03a-4796-aff9-e085fbd88e34 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:57.121353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a935dc76-f03a-4796-aff9-e085fbd88e34 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 29bd3420-7cb1-4a2d-9e61-815d446f1a92] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:57.138414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a935dc76-f03a-4796-aff9-e085fbd88e34 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:57.139286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a935dc76-f03a-4796-aff9-e085fbd88e34 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:57.142724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a935dc76-f03a-4796-aff9-e085fbd88e34 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:57.143802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a935dc76-f03a-4796-aff9-e085fbd88e34 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:57.145918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a935dc76-f03a-4796-aff9-e085fbd88e34 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:57.146631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a935dc76-f03a-4796-aff9-e085fbd88e34 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:57.700872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-75fe3aac-577f-498e-8185-20d44df54ab4 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:57.712048 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-75fe3aac-577f-498e-8185-20d44df54ab4 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1370 microversion: 2.1 time: 0.763128 Oct 12 22:07:57.717929 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1205/2221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:56 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1370 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:57.737281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eaa0d5b9-538a-4517-9291-254989364199 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:57.742644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eaa0d5b9-538a-4517-9291-254989364199 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:57.766673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaa0d5b9-538a-4517-9291-254989364199 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:57.767399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaa0d5b9-538a-4517-9291-254989364199 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:57.767846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaa0d5b9-538a-4517-9291-254989364199 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:57.768619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaa0d5b9-538a-4517-9291-254989364199 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:57.769140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaa0d5b9-538a-4517-9291-254989364199 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:57.769572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaa0d5b9-538a-4517-9291-254989364199 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:57.914495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eaa0d5b9-538a-4517-9291-254989364199 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:57.928479 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eaa0d5b9-538a-4517-9291-254989364199 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1274 microversion: 2.1 time: 0.207188 Oct 12 22:07:57.929238 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1206/2222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:57 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:57.945281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6dcddafa-6927-4103-a234-57b610ffc95d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:57.946193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6dcddafa-6927-4103-a234-57b610ffc95d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:57.958925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dcddafa-6927-4103-a234-57b610ffc95d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:57.967867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dcddafa-6927-4103-a234-57b610ffc95d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:57.970250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dcddafa-6927-4103-a234-57b610ffc95d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:57.971273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dcddafa-6927-4103-a234-57b610ffc95d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:57.973507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dcddafa-6927-4103-a234-57b610ffc95d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:57.974147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dcddafa-6927-4103-a234-57b610ffc95d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:58.089210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dcddafa-6927-4103-a234-57b610ffc95d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:58.089718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dcddafa-6927-4103-a234-57b610ffc95d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:58.090170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dcddafa-6927-4103-a234-57b610ffc95d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:58.090634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-6dcddafa-6927-4103-a234-57b610ffc95d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lazy-loading 'fault' on Instance uuid 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:07:58.249473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6dcddafa-6927-4103-a234-57b610ffc95d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:58.264870 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6dcddafa-6927-4103-a234-57b610ffc95d tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 200 len: 1369 microversion: 2.1 time: 0.331599 Oct 12 22:07:58.268988 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1207/2223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:57 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 1369 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:58.308508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-aba177ea-2e9b-4754-8db8-f193b522f2b2 req-869d64ef-f3d5-4f00-a00f-d3d4fdd5bdba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae4e25e-f720-42f5-aaa1-eac6492e37d3", "name": "network-vif-deleted", "tag": "17538477-fced-4d99-b30b-5724d63d3744"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:58.334820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-aba177ea-2e9b-4754-8db8-f193b522f2b2 req-869d64ef-f3d5-4f00-a00f-d3d4fdd5bdba service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:58.335837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-aba177ea-2e9b-4754-8db8-f193b522f2b2 req-869d64ef-f3d5-4f00-a00f-d3d4fdd5bdba service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:58.338066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-aba177ea-2e9b-4754-8db8-f193b522f2b2 req-869d64ef-f3d5-4f00-a00f-d3d4fdd5bdba service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:58.364239 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-aba177ea-2e9b-4754-8db8-f193b522f2b2 req-869d64ef-f3d5-4f00-a00f-d3d4fdd5bdba service nova] Creating event network-vif-deleted:17538477-fced-4d99-b30b-5724d63d3744 for instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 on n-h1-861111-1 Oct 12 22:07:58.377520 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-aba177ea-2e9b-4754-8db8-f193b522f2b2 req-869d64ef-f3d5-4f00-a00f-d3d4fdd5bdba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101548 Oct 12 22:07:58.378608 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1208/2224] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:58.384359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-29cd92b4-742c-4b34-a87b-3b88bcc3fed9 req-00281334-ee31-4084-a57c-fb5d081d301d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77548da5-9429-4e07-bdad-7902d89d4153", "name": "network-vif-plugged", "status": "completed", "tag": "cc048857-8664-421b-b22d-6488c4031e97"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:07:58.395895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-29cd92b4-742c-4b34-a87b-3b88bcc3fed9 req-00281334-ee31-4084-a57c-fb5d081d301d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:58.396664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-29cd92b4-742c-4b34-a87b-3b88bcc3fed9 req-00281334-ee31-4084-a57c-fb5d081d301d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:58.397256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-29cd92b4-742c-4b34-a87b-3b88bcc3fed9 req-00281334-ee31-4084-a57c-fb5d081d301d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:58.418781 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-29cd92b4-742c-4b34-a87b-3b88bcc3fed9 req-00281334-ee31-4084-a57c-fb5d081d301d service nova] Creating event network-vif-plugged:cc048857-8664-421b-b22d-6488c4031e97 for instance 77548da5-9429-4e07-bdad-7902d89d4153 on n-h2-861111-1 Oct 12 22:07:58.425880 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-29cd92b4-742c-4b34-a87b-3b88bcc3fed9 req-00281334-ee31-4084-a57c-fb5d081d301d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045570 Oct 12 22:07:58.426855 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1209/2225] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:07:58.433722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d1f930a5-2485-4d5e-b376-143b39d25067 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:58.434658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d1f930a5-2485-4d5e-b376-143b39d25067 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:58.462991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1f930a5-2485-4d5e-b376-143b39d25067 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:58.463719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1f930a5-2485-4d5e-b376-143b39d25067 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:58.464374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1f930a5-2485-4d5e-b376-143b39d25067 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:58.465289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1f930a5-2485-4d5e-b376-143b39d25067 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:58.465903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1f930a5-2485-4d5e-b376-143b39d25067 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:58.466495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1f930a5-2485-4d5e-b376-143b39d25067 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:59.124019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a935dc76-f03a-4796-aff9-e085fbd88e34 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:59.134423 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a935dc76-f03a-4796-aff9-e085fbd88e34 tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/29bd3420-7cb1-4a2d-9e61-815d446f1a92" status: 200 len: 1511 microversion: 2.1 time: 2.033929 Oct 12 22:07:59.146052 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1017/2226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:57 2022] GET /compute/v2.1/servers/29bd3420-7cb1-4a2d-9e61-815d446f1a92 => generated 1511 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:59.151827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fe18aea9-0e3b-43bd-8903-55f01b1481c8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:59.152669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fe18aea9-0e3b-43bd-8903-55f01b1481c8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:59.164977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe18aea9-0e3b-43bd-8903-55f01b1481c8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:59.172527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe18aea9-0e3b-43bd-8903-55f01b1481c8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:59.173038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe18aea9-0e3b-43bd-8903-55f01b1481c8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:59.173980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe18aea9-0e3b-43bd-8903-55f01b1481c8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:59.174616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe18aea9-0e3b-43bd-8903-55f01b1481c8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:59.175208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe18aea9-0e3b-43bd-8903-55f01b1481c8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:59.308091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d1f930a5-2485-4d5e-b376-143b39d25067 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:59.341055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d1f930a5-2485-4d5e-b376-143b39d25067 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:59.343035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d1f930a5-2485-4d5e-b376-143b39d25067 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:59.389418 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d1f930a5-2485-4d5e-b376-143b39d25067 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.960952 Oct 12 22:07:59.392532 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1210/2227] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:07:58 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:07:59.415053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3b4c5340-fb2f-4e49-95d4-e77c94bbdae1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:59.417270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3b4c5340-fb2f-4e49-95d4-e77c94bbdae1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:59.444190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b4c5340-fb2f-4e49-95d4-e77c94bbdae1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:59.447283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b4c5340-fb2f-4e49-95d4-e77c94bbdae1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:59.449739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b4c5340-fb2f-4e49-95d4-e77c94bbdae1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:59.451098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b4c5340-fb2f-4e49-95d4-e77c94bbdae1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:59.453473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b4c5340-fb2f-4e49-95d4-e77c94bbdae1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:59.458633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b4c5340-fb2f-4e49-95d4-e77c94bbdae1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:59.926303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3b4c5340-fb2f-4e49-95d4-e77c94bbdae1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:07:59.936314 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3b4c5340-fb2f-4e49-95d4-e77c94bbdae1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1370 microversion: 2.1 time: 0.541432 Oct 12 22:07:59.937103 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1211/2228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:59 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1370 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:07:59.943051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0bdeadff-cc2f-4555-ada2-25f0718989aa tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:07:59.943891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0bdeadff-cc2f-4555-ada2-25f0718989aa tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:07:59.957381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bdeadff-cc2f-4555-ada2-25f0718989aa tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:59.959089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bdeadff-cc2f-4555-ada2-25f0718989aa tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:59.959642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bdeadff-cc2f-4555-ada2-25f0718989aa tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:07:59.963633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bdeadff-cc2f-4555-ada2-25f0718989aa tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:07:59.964048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bdeadff-cc2f-4555-ada2-25f0718989aa tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:07:59.964710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bdeadff-cc2f-4555-ada2-25f0718989aa tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:00.071323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0bdeadff-cc2f-4555-ada2-25f0718989aa tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:00.079737 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0bdeadff-cc2f-4555-ada2-25f0718989aa tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1274 microversion: 2.1 time: 0.141793 Oct 12 22:08:00.080639 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1212/2229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:59 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1274 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:00.095470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8ee6ac83-e5f8-4d1a-9cb3-5ae53611e0ea tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:00.096617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8ee6ac83-e5f8-4d1a-9cb3-5ae53611e0ea tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 5ae4e25e-f720-42f5-aaa1-eac6492e37d3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:00.103076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee6ac83-e5f8-4d1a-9cb3-5ae53611e0ea tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:00.105100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee6ac83-e5f8-4d1a-9cb3-5ae53611e0ea tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:00.105944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee6ac83-e5f8-4d1a-9cb3-5ae53611e0ea tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:00.106485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee6ac83-e5f8-4d1a-9cb3-5ae53611e0ea tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:00.107060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee6ac83-e5f8-4d1a-9cb3-5ae53611e0ea tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:00.108261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ee6ac83-e5f8-4d1a-9cb3-5ae53611e0ea tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:00.124708 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-8ee6ac83-e5f8-4d1a-9cb3-5ae53611e0ea tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] HTTP exception thrown: Instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 could not be found. Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8ee6ac83-e5f8-4d1a-9cb3-5ae53611e0ea tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Request method failure captured: Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 HTTP/1.1 Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlvk8Zf5YMjK78ehwua-VIp9tTEWatKA_MwoBx1A7nZ1jO8nGeK8kIboYB3nTbSWwYSvd7WDTRzOrvcfJnVCrHEawKN0Ex4PqqKTBPc7KUF441v6xgLwZCrBOH5r7xr8B7W31weCRXkIKg51P_759AClf1ZN4y-HST82G9fLe0WJA8 Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7d943f8c0c934001b53032564fd00e11 Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-MigrationsAdminTest-40857002 Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d943f8c0c934001b53032564fd00e11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d943f8c0c934001b53032564fd00e11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d943f8c0c934001b53032564fd00e11", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d943f8c0c934001b53032564fd00e11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-MigrationsAdminTest-40857002 Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7d943f8c0c934001b53032564fd00e11 Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-MigrationsAdminTest-40857002 Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-MigrationsAdminTest-40857002-project Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: cfc7df27bf6f456581abff6e80ab4f64 Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-MigrationsAdminTest-40857002-project Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 could not be found. Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '5ae4e25e-f720-42f5-aaa1-eac6492e37d3'} Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 could not be found. Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 could not be found. Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:00.126580 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:00.132863 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:00.132863 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:00.132863 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:00.132863 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:00.132863 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:00.132863 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 could not be found. Oct 12 22:08:00.132863 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:00.132863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8ee6ac83-e5f8-4d1a-9cb3-5ae53611e0ea tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Returning 404 to user: Instance 5ae4e25e-f720-42f5-aaa1-eac6492e37d3 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:00.134027 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8ee6ac83-e5f8-4d1a-9cb3-5ae53611e0ea tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3" status: 404 len: 111 microversion: 2.1 time: 0.042500 Oct 12 22:08:00.137908 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1213/2230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:00 2022] GET /compute/v2.1/servers/5ae4e25e-f720-42f5-aaa1-eac6492e37d3 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:08:00.153497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fe18aea9-0e3b-43bd-8903-55f01b1481c8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:00.167265 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fe18aea9-0e3b-43bd-8903-55f01b1481c8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1368 microversion: 2.1 time: 1.019772 Oct 12 22:08:00.168373 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1018/2231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:07:59 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1368 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:00.181730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-758b071e-aea2-4f75-9a07-f4d2f987a35f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:00.182876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-758b071e-aea2-4f75-9a07-f4d2f987a35f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:00.193131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-758b071e-aea2-4f75-9a07-f4d2f987a35f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:00.193999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-758b071e-aea2-4f75-9a07-f4d2f987a35f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:00.194676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-758b071e-aea2-4f75-9a07-f4d2f987a35f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:00.195678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-758b071e-aea2-4f75-9a07-f4d2f987a35f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:00.196325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-758b071e-aea2-4f75-9a07-f4d2f987a35f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:00.199762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-758b071e-aea2-4f75-9a07-f4d2f987a35f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:00.204917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-357f9c9b-9f0a-4b0d-b04a-5917d1e6dd9c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Action: 'create', calling method: .version_select at 0x7f5123482f70>, body: {"keypair": {"name": "tempest-keypair-1577865335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQpBAjbpzWVQWpYhxNGN6cafoMn55WQ3uadq9tn0SiB4ZMRWxyXoQPIbONwi/pN2K0TOTmh0h0EaFAW7rGfCMI1OJPjlsuU+BrO4sJe9b2xqlue4Umu4qAdP0+LOK4JDg=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:00.222841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-357f9c9b-9f0a-4b0d-b04a-5917d1e6dd9c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Getting quotas for project ede0fba22ac94b9e9a394ed466a92bd4. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:08:00.229840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-357f9c9b-9f0a-4b0d-b04a-5917d1e6dd9c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Getting quotas for user d6c78e7bee0d4dbe88f7c1beb9042038 and project ede0fba22ac94b9e9a394ed466a92bd4. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:08:00.239546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-758b071e-aea2-4f75-9a07-f4d2f987a35f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:08:00.257357 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-357f9c9b-9f0a-4b0d-b04a-5917d1e6dd9c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121074 Oct 12 22:08:00.258343 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1214/2232] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:08:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:00.274155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9d082b99-ce48-40b2-947e-9b9cdf307fa0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '.version_select at 0x7f5123482af0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:00.320665 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9d082b99-ce48-40b2-947e-9b9cdf307fa0 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-3597662" status: 202 len: 0 microversion: 2.1 time: 0.059639 Oct 12 22:08:00.323208 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1215/2233] 10.222.0.16 () {58 vars in 1212 bytes} [Wed Oct 12 22:08:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-3597662 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:08:00.335807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87c7f27e-eb45-416c-9d08-2c79a41b9c0d tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:00.337135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-87c7f27e-eb45-416c-9d08-2c79a41b9c0d tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 29bd3420-7cb1-4a2d-9e61-815d446f1a92] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:00.357012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c7f27e-eb45-416c-9d08-2c79a41b9c0d tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:00.358894 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-758b071e-aea2-4f75-9a07-f4d2f987a35f tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 204 len: 0 microversion: 2.1 time: 0.188501 Oct 12 22:08:00.359678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c7f27e-eb45-416c-9d08-2c79a41b9c0d tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:00.360390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c7f27e-eb45-416c-9d08-2c79a41b9c0d tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:00.362218 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1019/2234] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:08:00 2022] DELETE /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:08:00.362425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c7f27e-eb45-416c-9d08-2c79a41b9c0d tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:00.362946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c7f27e-eb45-416c-9d08-2c79a41b9c0d tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:00.363406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c7f27e-eb45-416c-9d08-2c79a41b9c0d tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:00.374929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9f70a317-b0a7-4b97-979b-3f1d05e67fa9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:00.377747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9f70a317-b0a7-4b97-979b-3f1d05e67fa9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:00.385905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f70a317-b0a7-4b97-979b-3f1d05e67fa9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:00.386438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f70a317-b0a7-4b97-979b-3f1d05e67fa9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:00.387018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f70a317-b0a7-4b97-979b-3f1d05e67fa9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:00.388122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f70a317-b0a7-4b97-979b-3f1d05e67fa9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:00.388873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f70a317-b0a7-4b97-979b-3f1d05e67fa9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:00.389469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f70a317-b0a7-4b97-979b-3f1d05e67fa9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:00.448035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:00.541582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-87c7f27e-eb45-416c-9d08-2c79a41b9c0d tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:00.556659 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-87c7f27e-eb45-416c-9d08-2c79a41b9c0d tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/29bd3420-7cb1-4a2d-9e61-815d446f1a92" status: 200 len: 1469 microversion: 2.1 time: 0.230714 Oct 12 22:08:00.558613 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1216/2235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:00 2022] GET /compute/v2.1/servers/29bd3420-7cb1-4a2d-9e61-815d446f1a92 => generated 1469 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:00.587897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1b87f0d8-dd5d-41b3-a7ce-c75b6adade19 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:00.594602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1b87f0d8-dd5d-41b3-a7ce-c75b6adade19 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:00.618383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b87f0d8-dd5d-41b3-a7ce-c75b6adade19 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:00.619976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b87f0d8-dd5d-41b3-a7ce-c75b6adade19 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:00.621769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b87f0d8-dd5d-41b3-a7ce-c75b6adade19 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:00.624082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b87f0d8-dd5d-41b3-a7ce-c75b6adade19 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:00.624547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b87f0d8-dd5d-41b3-a7ce-c75b6adade19 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:00.624986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b87f0d8-dd5d-41b3-a7ce-c75b6adade19 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:00.917951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9f70a317-b0a7-4b97-979b-3f1d05e67fa9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:00.932357 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9f70a317-b0a7-4b97-979b-3f1d05e67fa9 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1485 microversion: 2.1 time: 0.566542 Oct 12 22:08:00.933547 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1020/2236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:00 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1485 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:00.943004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-c2c4e536-2848-401b-88d9-8f47961966ce req-ec5a31f5-6197-4f5d-a7dc-80e857af9ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54a23a46-7ad2-4563-a557-1806d4d61253", "name": "network-vif-plugged", "status": "completed", "tag": "c43be245-e399-4a43-a754-f8061895ef0c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:00.966909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c2c4e536-2848-401b-88d9-8f47961966ce req-ec5a31f5-6197-4f5d-a7dc-80e857af9ee7 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:00.971984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c2c4e536-2848-401b-88d9-8f47961966ce req-ec5a31f5-6197-4f5d-a7dc-80e857af9ee7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:00.972782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c2c4e536-2848-401b-88d9-8f47961966ce req-ec5a31f5-6197-4f5d-a7dc-80e857af9ee7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:01.001982 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-c2c4e536-2848-401b-88d9-8f47961966ce req-ec5a31f5-6197-4f5d-a7dc-80e857af9ee7 service nova] Creating event network-vif-plugged:c43be245-e399-4a43-a754-f8061895ef0c for instance 54a23a46-7ad2-4563-a557-1806d4d61253 on n-h1-861111-1 Oct 12 22:08:01.027567 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-c2c4e536-2848-401b-88d9-8f47961966ce req-ec5a31f5-6197-4f5d-a7dc-80e857af9ee7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092401 Oct 12 22:08:01.028597 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1021/2237] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:01.036567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d3312dda-b9c3-42c9-b4f8-f0a3c2c33615 req-00d09d59-aa3e-4890-8d06-302eac7385f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bd3420-7cb1-4a2d-9e61-815d446f1a92", "name": "network-vif-deleted", "tag": "c45c5b3a-ebb3-427d-b664-6dc4302d097c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:01.066306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d3312dda-b9c3-42c9-b4f8-f0a3c2c33615 req-00d09d59-aa3e-4890-8d06-302eac7385f1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:01.067396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d3312dda-b9c3-42c9-b4f8-f0a3c2c33615 req-00d09d59-aa3e-4890-8d06-302eac7385f1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:01.070483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d3312dda-b9c3-42c9-b4f8-f0a3c2c33615 req-00d09d59-aa3e-4890-8d06-302eac7385f1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:01.099013 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d3312dda-b9c3-42c9-b4f8-f0a3c2c33615 req-00d09d59-aa3e-4890-8d06-302eac7385f1 service nova] Creating event network-vif-deleted:c45c5b3a-ebb3-427d-b664-6dc4302d097c for instance 29bd3420-7cb1-4a2d-9e61-815d446f1a92 on n-h2-861111-1 Oct 12 22:08:01.114704 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d3312dda-b9c3-42c9-b4f8-f0a3c2c33615 req-00d09d59-aa3e-4890-8d06-302eac7385f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081940 Oct 12 22:08:01.118096 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1022/2238] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:01.123647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-861b4f05-de2b-4e79-b86c-27ac3741aa44 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:01.134803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-861b4f05-de2b-4e79-b86c-27ac3741aa44 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:01.144032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-861b4f05-de2b-4e79-b86c-27ac3741aa44 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:01.150469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-861b4f05-de2b-4e79-b86c-27ac3741aa44 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:01.151154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-861b4f05-de2b-4e79-b86c-27ac3741aa44 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:01.155620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-861b4f05-de2b-4e79-b86c-27ac3741aa44 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:01.157026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-861b4f05-de2b-4e79-b86c-27ac3741aa44 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:01.158662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-861b4f05-de2b-4e79-b86c-27ac3741aa44 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:01.274185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1b87f0d8-dd5d-41b3-a7ce-c75b6adade19 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:01.290378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1b87f0d8-dd5d-41b3-a7ce-c75b6adade19 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:01.293004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1b87f0d8-dd5d-41b3-a7ce-c75b6adade19 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:01.296796 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1b87f0d8-dd5d-41b3-a7ce-c75b6adade19 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.736727 Oct 12 22:08:01.298370 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1217/2239] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:00 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:01.315496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-472da967-1609-48b2-91f9-eededb84ecf9 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:01.315496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-472da967-1609-48b2-91f9-eededb84ecf9 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:01.333053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-472da967-1609-48b2-91f9-eededb84ecf9 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:01.335107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-472da967-1609-48b2-91f9-eededb84ecf9 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:01.335889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-472da967-1609-48b2-91f9-eededb84ecf9 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:01.337832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-472da967-1609-48b2-91f9-eededb84ecf9 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:01.338461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-472da967-1609-48b2-91f9-eededb84ecf9 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:01.339151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-472da967-1609-48b2-91f9-eededb84ecf9 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:01.512614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-472da967-1609-48b2-91f9-eededb84ecf9 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:01.521719 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-472da967-1609-48b2-91f9-eededb84ecf9 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1274 microversion: 2.1 time: 0.221919 Oct 12 22:08:01.522289 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1218/2240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:01 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1274 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:01.543781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8c569bbb-3037-408f-bac6-dc3dae500d4c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:01.544591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8c569bbb-3037-408f-bac6-dc3dae500d4c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:01.551269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c569bbb-3037-408f-bac6-dc3dae500d4c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:01.551902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c569bbb-3037-408f-bac6-dc3dae500d4c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:01.552445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c569bbb-3037-408f-bac6-dc3dae500d4c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:01.553871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c569bbb-3037-408f-bac6-dc3dae500d4c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:01.554456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c569bbb-3037-408f-bac6-dc3dae500d4c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:01.555266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c569bbb-3037-408f-bac6-dc3dae500d4c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:01.697902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-861b4f05-de2b-4e79-b86c-27ac3741aa44 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:01.711805 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-861b4f05-de2b-4e79-b86c-27ac3741aa44 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1370 microversion: 2.1 time: 0.592105 Oct 12 22:08:01.731931 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1023/2241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:01 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1370 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:01.739988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-228fa6fe-2b31-4d55-aa29-13c19be66fff tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:01.740993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-228fa6fe-2b31-4d55-aa29-13c19be66fff tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 29bd3420-7cb1-4a2d-9e61-815d446f1a92] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:01.749294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-228fa6fe-2b31-4d55-aa29-13c19be66fff tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:01.749789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-228fa6fe-2b31-4d55-aa29-13c19be66fff tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:01.750400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-228fa6fe-2b31-4d55-aa29-13c19be66fff tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:01.752133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-228fa6fe-2b31-4d55-aa29-13c19be66fff tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:01.753440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-228fa6fe-2b31-4d55-aa29-13c19be66fff tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:01.754370 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-228fa6fe-2b31-4d55-aa29-13c19be66fff tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:01.822072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-228fa6fe-2b31-4d55-aa29-13c19be66fff tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:01.822572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-228fa6fe-2b31-4d55-aa29-13c19be66fff tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:01.829494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-228fa6fe-2b31-4d55-aa29-13c19be66fff tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:01.830574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-228fa6fe-2b31-4d55-aa29-13c19be66fff tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lazy-loading 'fault' on Instance uuid 29bd3420-7cb1-4a2d-9e61-815d446f1a92 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:08:01.887202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8c569bbb-3037-408f-bac6-dc3dae500d4c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:01.895605 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8c569bbb-3037-408f-bac6-dc3dae500d4c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1559 microversion: 2.1 time: 0.365959 Oct 12 22:08:01.903523 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1219/2242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:01 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1559 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:01.928745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f7a411ad-5657-4a3a-a654-dccbfedc744d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:01.930103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f7a411ad-5657-4a3a-a654-dccbfedc744d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:01.940876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a411ad-5657-4a3a-a654-dccbfedc744d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:01.943448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a411ad-5657-4a3a-a654-dccbfedc744d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:01.946471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a411ad-5657-4a3a-a654-dccbfedc744d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:01.947527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a411ad-5657-4a3a-a654-dccbfedc744d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:01.948308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a411ad-5657-4a3a-a654-dccbfedc744d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:01.948965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7a411ad-5657-4a3a-a654-dccbfedc744d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:02.034358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-228fa6fe-2b31-4d55-aa29-13c19be66fff tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5536917f69c1495b9363dc8704154aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e80cd4201d427189c6f50ca7e9532a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:02.051659 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-228fa6fe-2b31-4d55-aa29-13c19be66fff tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/29bd3420-7cb1-4a2d-9e61-815d446f1a92" status: 200 len: 1307 microversion: 2.1 time: 0.309154 Oct 12 22:08:02.052613 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1024/2243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:01 2022] GET /compute/v2.1/servers/29bd3420-7cb1-4a2d-9e61-815d446f1a92 => generated 1307 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:02.075544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-97befca1-6e3b-4df5-8c3e-aca2b230086c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:02.076470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-97befca1-6e3b-4df5-8c3e-aca2b230086c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:02.093988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97befca1-6e3b-4df5-8c3e-aca2b230086c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:02.094880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97befca1-6e3b-4df5-8c3e-aca2b230086c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:02.095719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97befca1-6e3b-4df5-8c3e-aca2b230086c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:02.096715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97befca1-6e3b-4df5-8c3e-aca2b230086c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:02.097404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97befca1-6e3b-4df5-8c3e-aca2b230086c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:02.098085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97befca1-6e3b-4df5-8c3e-aca2b230086c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:02.186506 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f7a411ad-5657-4a3a-a654-dccbfedc744d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.261384 Oct 12 22:08:02.187112 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1220/2244] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:08:01 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153/os-interface => generated 285 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:02.324517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-001cbaa5-388f-4955-a668-d0d6b1a0a0f5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:02.325346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-001cbaa5-388f-4955-a668-d0d6b1a0a0f5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:02.335639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-001cbaa5-388f-4955-a668-d0d6b1a0a0f5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:02.342459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-001cbaa5-388f-4955-a668-d0d6b1a0a0f5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:02.343178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-001cbaa5-388f-4955-a668-d0d6b1a0a0f5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:02.344269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-001cbaa5-388f-4955-a668-d0d6b1a0a0f5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:02.344902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-001cbaa5-388f-4955-a668-d0d6b1a0a0f5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:02.345505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-001cbaa5-388f-4955-a668-d0d6b1a0a0f5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:02.513906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-97befca1-6e3b-4df5-8c3e-aca2b230086c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:02.571132 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-97befca1-6e3b-4df5-8c3e-aca2b230086c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1485 microversion: 2.1 time: 0.513518 Oct 12 22:08:02.576450 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1025/2245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:02 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1485 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:02.592550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-66aa31be-027a-4a89-ae94-cad2bdd92f25 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:02.609731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-66aa31be-027a-4a89-ae94-cad2bdd92f25 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:02.619856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66aa31be-027a-4a89-ae94-cad2bdd92f25 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:02.620693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66aa31be-027a-4a89-ae94-cad2bdd92f25 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:02.621211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66aa31be-027a-4a89-ae94-cad2bdd92f25 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:02.622337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66aa31be-027a-4a89-ae94-cad2bdd92f25 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:02.623688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66aa31be-027a-4a89-ae94-cad2bdd92f25 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:02.625926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66aa31be-027a-4a89-ae94-cad2bdd92f25 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:02.996717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-001cbaa5-388f-4955-a668-d0d6b1a0a0f5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:03.007568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-001cbaa5-388f-4955-a668-d0d6b1a0a0f5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:03.009787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-001cbaa5-388f-4955-a668-d0d6b1a0a0f5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:03.011841 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-001cbaa5-388f-4955-a668-d0d6b1a0a0f5 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.691268 Oct 12 22:08:03.013121 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1221/2246] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:02 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:08:03.023152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bfd25abd-b4c5-4a8e-84ff-6b451a6ea433 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:03.024242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bfd25abd-b4c5-4a8e-84ff-6b451a6ea433 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:03.038050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfd25abd-b4c5-4a8e-84ff-6b451a6ea433 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:03.039192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfd25abd-b4c5-4a8e-84ff-6b451a6ea433 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:03.040421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfd25abd-b4c5-4a8e-84ff-6b451a6ea433 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:03.044124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfd25abd-b4c5-4a8e-84ff-6b451a6ea433 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:03.046425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfd25abd-b4c5-4a8e-84ff-6b451a6ea433 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:03.047142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfd25abd-b4c5-4a8e-84ff-6b451a6ea433 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:03.309245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-66aa31be-027a-4a89-ae94-cad2bdd92f25 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:03.322922 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-66aa31be-027a-4a89-ae94-cad2bdd92f25 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1316 microversion: 2.1 time: 0.742049 Oct 12 22:08:03.323549 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1026/2247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:02 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1316 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:03.342583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-aa105850-49bd-4599-bb26-8fd651a26a35 req-a94e2a73-1b71-4fe3-9e09-c3fdd1a22c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3ca739-360b-4a87-8580-717e5eb56c4d", "name": "network-vif-deleted", "tag": "2d514d69-05a5-4030-8d63-9876690cb34f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:03.385762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-aa105850-49bd-4599-bb26-8fd651a26a35 req-a94e2a73-1b71-4fe3-9e09-c3fdd1a22c1c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:03.390243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-aa105850-49bd-4599-bb26-8fd651a26a35 req-a94e2a73-1b71-4fe3-9e09-c3fdd1a22c1c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:03.390571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-aa105850-49bd-4599-bb26-8fd651a26a35 req-a94e2a73-1b71-4fe3-9e09-c3fdd1a22c1c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:03.417771 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-aa105850-49bd-4599-bb26-8fd651a26a35 req-a94e2a73-1b71-4fe3-9e09-c3fdd1a22c1c service nova] Creating event network-vif-deleted:2d514d69-05a5-4030-8d63-9876690cb34f for instance bf3ca739-360b-4a87-8580-717e5eb56c4d on n-h2-861111-1 Oct 12 22:08:03.422797 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-aa105850-49bd-4599-bb26-8fd651a26a35 req-a94e2a73-1b71-4fe3-9e09-c3fdd1a22c1c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097459 Oct 12 22:08:03.423758 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1027/2248] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:03.429229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0bba5936-966d-45e1-a501-53586d2d20fe tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:03.430157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0bba5936-966d-45e1-a501-53586d2d20fe tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 29bd3420-7cb1-4a2d-9e61-815d446f1a92] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:03.448788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bba5936-966d-45e1-a501-53586d2d20fe tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:03.449516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bba5936-966d-45e1-a501-53586d2d20fe tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:03.450120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bba5936-966d-45e1-a501-53586d2d20fe tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:03.451014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bba5936-966d-45e1-a501-53586d2d20fe tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:03.452322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bba5936-966d-45e1-a501-53586d2d20fe tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:03.452971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bba5936-966d-45e1-a501-53586d2d20fe tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:03.468872 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-0bba5936-966d-45e1-a501-53586d2d20fe tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] HTTP exception thrown: Instance 29bd3420-7cb1-4a2d-9e61-815d446f1a92 could not be found. Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0bba5936-966d-45e1-a501-53586d2d20fe tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Request method failure captured: Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/29bd3420-7cb1-4a2d-9e61-815d446f1a92 HTTP/1.1 Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzpzr1gKqs5IROFU0pblEN7SIs-BFMW9H-FfTChVCfNeT1o62kdVvuj1z4PfvD4LmMUKdYUJQluO8oP71O-v_XC7o01oE2T-71VIW3w1WBFZ9dHEgCrmebpcBiVM9RzHPeIRFbCt02ksT3sZvGwdyjSG76cJ-6djIKASy4vpBJOMc04 Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 04e80cd4201d427189c6f50ca7e9532a Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-MultipleCreateTestJSON-1891362027 Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04e80cd4201d427189c6f50ca7e9532a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04e80cd4201d427189c6f50ca7e9532a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_04e80cd4201d427189c6f50ca7e9532a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/04e80cd4201d427189c6f50ca7e9532a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-MultipleCreateTestJSON-1891362027 Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 04e80cd4201d427189c6f50ca7e9532a Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1891362027 Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-MultipleCreateTestJSON-1891362027-project Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 5536917f69c1495b9363dc8704154aa8 Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-MultipleCreateTestJSON-1891362027-project Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 29bd3420-7cb1-4a2d-9e61-815d446f1a92 could not be found. Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '29bd3420-7cb1-4a2d-9e61-815d446f1a92'} Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29bd3420-7cb1-4a2d-9e61-815d446f1a92 could not be found. Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29bd3420-7cb1-4a2d-9e61-815d446f1a92 could not be found. Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:03.471120 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:03.476251 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:03.476251 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:03.476251 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:03.476251 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:03.476251 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:03.476251 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29bd3420-7cb1-4a2d-9e61-815d446f1a92 could not be found. Oct 12 22:08:03.476251 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:03.478409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0bba5936-966d-45e1-a501-53586d2d20fe tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Returning 404 to user: Instance 29bd3420-7cb1-4a2d-9e61-815d446f1a92 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:03.479873 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0bba5936-966d-45e1-a501-53586d2d20fe tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/29bd3420-7cb1-4a2d-9e61-815d446f1a92" status: 404 len: 111 microversion: 2.1 time: 0.054633 Oct 12 22:08:03.481262 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1028/2249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:03 2022] GET /compute/v2.1/servers/29bd3420-7cb1-4a2d-9e61-815d446f1a92 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:08:03.502189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bbbdad8c-c3b9-4a85-811a-59dd7b133ee5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:03.504590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bbbdad8c-c3b9-4a85-811a-59dd7b133ee5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:03.516967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbbdad8c-c3b9-4a85-811a-59dd7b133ee5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:03.518191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbbdad8c-c3b9-4a85-811a-59dd7b133ee5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:03.518842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbbdad8c-c3b9-4a85-811a-59dd7b133ee5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:03.519983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbbdad8c-c3b9-4a85-811a-59dd7b133ee5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:03.520666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbbdad8c-c3b9-4a85-811a-59dd7b133ee5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:03.521437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbbdad8c-c3b9-4a85-811a-59dd7b133ee5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:03.580915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bbbdad8c-c3b9-4a85-811a-59dd7b133ee5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:08:03.682183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:03.685212 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bbbdad8c-c3b9-4a85-811a-59dd7b133ee5 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "DELETE /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 204 len: 0 microversion: 2.1 time: 0.201939 Oct 12 22:08:03.688858 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1029/2250] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:08:03 2022] DELETE /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:08:03.692679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-786fa309-3c92-460d-9d41-97d2a41316a2 req-628a7a20-6eea-4502-975f-d4e3a0c3d70a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb25c0a-70e6-494e-93fe-7f98f393ed4d", "name": "network-vif-deleted", "tag": "42b1300a-460b-4f8f-85bd-a070c6d3cd9f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:03.706307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-786fa309-3c92-460d-9d41-97d2a41316a2 req-628a7a20-6eea-4502-975f-d4e3a0c3d70a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:03.706833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-786fa309-3c92-460d-9d41-97d2a41316a2 req-628a7a20-6eea-4502-975f-d4e3a0c3d70a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:03.707296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-786fa309-3c92-460d-9d41-97d2a41316a2 req-628a7a20-6eea-4502-975f-d4e3a0c3d70a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:03.721168 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-786fa309-3c92-460d-9d41-97d2a41316a2 req-628a7a20-6eea-4502-975f-d4e3a0c3d70a service nova] Creating event network-vif-deleted:42b1300a-460b-4f8f-85bd-a070c6d3cd9f for instance 3cb25c0a-70e6-494e-93fe-7f98f393ed4d on n-h1-861111-1 Oct 12 22:08:03.727388 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-786fa309-3c92-460d-9d41-97d2a41316a2 req-628a7a20-6eea-4502-975f-d4e3a0c3d70a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039232 Oct 12 22:08:03.728168 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1030/2251] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:03.734231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bfd25abd-b4c5-4a8e-84ff-6b451a6ea433 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:03.735619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8cc477e6-af71-4d4b-aede-8968ca9c2d0c tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:03.736607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8cc477e6-af71-4d4b-aede-8968ca9c2d0c tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] [instance: 3cb25c0a-70e6-494e-93fe-7f98f393ed4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:03.743596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cc477e6-af71-4d4b-aede-8968ca9c2d0c tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:03.744400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cc477e6-af71-4d4b-aede-8968ca9c2d0c tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:03.746024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cc477e6-af71-4d4b-aede-8968ca9c2d0c tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:03.747758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cc477e6-af71-4d4b-aede-8968ca9c2d0c tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:03.748376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cc477e6-af71-4d4b-aede-8968ca9c2d0c tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:03.748917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cc477e6-af71-4d4b-aede-8968ca9c2d0c tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:03.750126 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bfd25abd-b4c5-4a8e-84ff-6b451a6ea433 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1557 microversion: 2.1 time: 0.734661 Oct 12 22:08:03.750902 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1222/2252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:03 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1557 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:03.762388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:03.773869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0f9c03a6-d25c-45d2-9c81-59afe35c97e5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:03.774758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0f9c03a6-d25c-45d2-9c81-59afe35c97e5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:03.781768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f9c03a6-d25c-45d2-9c81-59afe35c97e5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:03.782630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f9c03a6-d25c-45d2-9c81-59afe35c97e5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:03.783344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f9c03a6-d25c-45d2-9c81-59afe35c97e5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:03.784306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f9c03a6-d25c-45d2-9c81-59afe35c97e5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:03.784982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f9c03a6-d25c-45d2-9c81-59afe35c97e5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:03.785631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f9c03a6-d25c-45d2-9c81-59afe35c97e5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:03.795389 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-8cc477e6-af71-4d4b-aede-8968ca9c2d0c tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] HTTP exception thrown: Instance 3cb25c0a-70e6-494e-93fe-7f98f393ed4d could not be found. Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8cc477e6-af71-4d4b-aede-8968ca9c2d0c tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Request method failure captured: Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d HTTP/1.1 Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzpzr1gKqs5IROFU0pblEN7SIs-BFMW9H-FfTChVCfNeT1o62kdVvuj1z4PfvD4LmMUKdYUJQluO8oP71O-v_XC7o01oE2T-71VIW3w1WBFZ9dHEgCrmebpcBiVM9RzHPeIRFbCt02ksT3sZvGwdyjSG76cJ-6djIKASy4vpBJOMc04 Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 04e80cd4201d427189c6f50ca7e9532a Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-MultipleCreateTestJSON-1891362027 Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04e80cd4201d427189c6f50ca7e9532a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04e80cd4201d427189c6f50ca7e9532a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_04e80cd4201d427189c6f50ca7e9532a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/04e80cd4201d427189c6f50ca7e9532a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-MultipleCreateTestJSON-1891362027 Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 04e80cd4201d427189c6f50ca7e9532a Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1891362027 Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-MultipleCreateTestJSON-1891362027-project Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 5536917f69c1495b9363dc8704154aa8 Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-MultipleCreateTestJSON-1891362027-project Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 3cb25c0a-70e6-494e-93fe-7f98f393ed4d could not be found. Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '3cb25c0a-70e6-494e-93fe-7f98f393ed4d'} Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cb25c0a-70e6-494e-93fe-7f98f393ed4d could not be found. Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cb25c0a-70e6-494e-93fe-7f98f393ed4d could not be found. Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:03.797136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:03.801670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:03.801670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:03.801670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:03.801670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:03.801670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:03.801670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cb25c0a-70e6-494e-93fe-7f98f393ed4d could not be found. Oct 12 22:08:03.801670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:03.801670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8cc477e6-af71-4d4b-aede-8968ca9c2d0c tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] Returning 404 to user: Instance 3cb25c0a-70e6-494e-93fe-7f98f393ed4d could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:03.801670 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8cc477e6-af71-4d4b-aede-8968ca9c2d0c tempest-MultipleCreateTestJSON-1891362027 tempest-MultipleCreateTestJSON-1891362027-project] 10.222.0.16 "GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d" status: 404 len: 111 microversion: 2.1 time: 0.069958 Oct 12 22:08:03.801670 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1031/2253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:03 2022] GET /compute/v2.1/servers/3cb25c0a-70e6-494e-93fe-7f98f393ed4d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:08:03.812408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cabf13a7-3f18-4dad-98ad-37f2f0669d41 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:03.813024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cabf13a7-3f18-4dad-98ad-37f2f0669d41 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:03.822999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cabf13a7-3f18-4dad-98ad-37f2f0669d41 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:03.823433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cabf13a7-3f18-4dad-98ad-37f2f0669d41 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:03.824540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cabf13a7-3f18-4dad-98ad-37f2f0669d41 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:03.825260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cabf13a7-3f18-4dad-98ad-37f2f0669d41 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:03.825714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cabf13a7-3f18-4dad-98ad-37f2f0669d41 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:03.826914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cabf13a7-3f18-4dad-98ad-37f2f0669d41 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:03.853473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f9c03a6-d25c-45d2-9c81-59afe35c97e5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:03.854388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f9c03a6-d25c-45d2-9c81-59afe35c97e5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:03.855330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f9c03a6-d25c-45d2-9c81-59afe35c97e5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:03.856719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-0f9c03a6-d25c-45d2-9c81-59afe35c97e5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lazy-loading 'fault' on Instance uuid bf3ca739-360b-4a87-8580-717e5eb56c4d {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:08:03.963922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0f9c03a6-d25c-45d2-9c81-59afe35c97e5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:03.981969 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0f9c03a6-d25c-45d2-9c81-59afe35c97e5 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 200 len: 1301 microversion: 2.1 time: 0.229792 Oct 12 22:08:03.983772 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1223/2254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:03 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 1301 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:03.989022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-42771a65-d619-48a5-9d18-a47c95352770 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:03.991643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-42771a65-d619-48a5-9d18-a47c95352770 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:04.006867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42771a65-d619-48a5-9d18-a47c95352770 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:04.007650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42771a65-d619-48a5-9d18-a47c95352770 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:04.008317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42771a65-d619-48a5-9d18-a47c95352770 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:04.009286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42771a65-d619-48a5-9d18-a47c95352770 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:04.009982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42771a65-d619-48a5-9d18-a47c95352770 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:04.010650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42771a65-d619-48a5-9d18-a47c95352770 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:04.208837 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-42771a65-d619-48a5-9d18-a47c95352770 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.223373 Oct 12 22:08:04.209442 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1224/2255] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:08:03 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253/os-interface => generated 285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:04.214554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e08454c4-f6ae-415e-8a29-e69b1990554c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:04.215448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e08454c4-f6ae-415e-8a29-e69b1990554c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:04.229575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e08454c4-f6ae-415e-8a29-e69b1990554c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:04.230242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e08454c4-f6ae-415e-8a29-e69b1990554c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:04.230746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e08454c4-f6ae-415e-8a29-e69b1990554c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:04.231573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e08454c4-f6ae-415e-8a29-e69b1990554c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:04.232914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e08454c4-f6ae-415e-8a29-e69b1990554c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:04.233669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e08454c4-f6ae-415e-8a29-e69b1990554c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:04.605826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cabf13a7-3f18-4dad-98ad-37f2f0669d41 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:04.624208 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cabf13a7-3f18-4dad-98ad-37f2f0669d41 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1469 microversion: 2.1 time: 0.818134 Oct 12 22:08:04.635338 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1032/2256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:03 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1469 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:04.635338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-56c29aa2-f9c7-4c34-b52c-489d2d272b07 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:04.635338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-56c29aa2-f9c7-4c34-b52c-489d2d272b07 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:04.645931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56c29aa2-f9c7-4c34-b52c-489d2d272b07 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:04.648901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56c29aa2-f9c7-4c34-b52c-489d2d272b07 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:04.649537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56c29aa2-f9c7-4c34-b52c-489d2d272b07 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:04.657375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56c29aa2-f9c7-4c34-b52c-489d2d272b07 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:04.657877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56c29aa2-f9c7-4c34-b52c-489d2d272b07 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:04.658324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56c29aa2-f9c7-4c34-b52c-489d2d272b07 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:05.089495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-56c29aa2-f9c7-4c34-b52c-489d2d272b07 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:05.098388 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-56c29aa2-f9c7-4c34-b52c-489d2d272b07 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1316 microversion: 2.1 time: 0.472119 Oct 12 22:08:05.103638 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1033/2257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:04 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:05.106850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e08454c4-f6ae-415e-8a29-e69b1990554c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:05.108501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-245f3fef-281c-4305-9583-6d5da990cc3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:05.109119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-245f3fef-281c-4305-9583-6d5da990cc3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: bf3ca739-360b-4a87-8580-717e5eb56c4d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:05.131577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e08454c4-f6ae-415e-8a29-e69b1990554c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:05.133593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-245f3fef-281c-4305-9583-6d5da990cc3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:05.134025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-245f3fef-281c-4305-9583-6d5da990cc3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:05.134468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-245f3fef-281c-4305-9583-6d5da990cc3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:05.135190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-245f3fef-281c-4305-9583-6d5da990cc3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:05.135833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-245f3fef-281c-4305-9583-6d5da990cc3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:05.136327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-245f3fef-281c-4305-9583-6d5da990cc3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:05.137380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e08454c4-f6ae-415e-8a29-e69b1990554c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:05.142694 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e08454c4-f6ae-415e-8a29-e69b1990554c tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.931923 Oct 12 22:08:05.144238 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1225/2258] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:04 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:05.158129 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-245f3fef-281c-4305-9583-6d5da990cc3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] HTTP exception thrown: Instance bf3ca739-360b-4a87-8580-717e5eb56c4d could not be found. Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-245f3fef-281c-4305-9583-6d5da990cc3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Request method failure captured: Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d HTTP/1.1 Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzjWa7fW4cCWMnkS2ihtgUCglzU38ChAzYORmM7Dbu9VoPpmuOcvF68E2HOkgVWjtO59JzvrNcPt6cpEPfgvTwc8u3yOUJpSVFhJvxoJSFOpL6COZC7hUepcrA4h6-wO_W4qNSt17id_hM0-SJoaXsiZjl3SD74vmQRJZQN-oA7sWak Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 61e71a9eeaa044e8aa939548f15a585e Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-LiveMigrationTest-68417645 Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61e71a9eeaa044e8aa939548f15a585e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61e71a9eeaa044e8aa939548f15a585e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_61e71a9eeaa044e8aa939548f15a585e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/61e71a9eeaa044e8aa939548f15a585e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-LiveMigrationTest-68417645 Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 61e71a9eeaa044e8aa939548f15a585e Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-LiveMigrationTest-68417645 Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-LiveMigrationTest-68417645-project Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 1fe98ba1ceec4b849eb45eb46ce4d425 Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-LiveMigrationTest-68417645-project Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance bf3ca739-360b-4a87-8580-717e5eb56c4d could not be found. Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'bf3ca739-360b-4a87-8580-717e5eb56c4d'} Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3ca739-360b-4a87-8580-717e5eb56c4d could not be found. Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3ca739-360b-4a87-8580-717e5eb56c4d could not be found. Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:05.160303 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:05.166023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:05.166023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:05.166023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:05.166023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:05.166023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:05.166023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3ca739-360b-4a87-8580-717e5eb56c4d could not be found. Oct 12 22:08:05.166023 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:05.168020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-245f3fef-281c-4305-9583-6d5da990cc3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Returning 404 to user: Instance bf3ca739-360b-4a87-8580-717e5eb56c4d could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:05.169103 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-245f3fef-281c-4305-9583-6d5da990cc3c tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d" status: 404 len: 111 microversion: 2.1 time: 0.064470 Oct 12 22:08:05.170851 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1034/2259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:05 2022] GET /compute/v2.1/servers/bf3ca739-360b-4a87-8580-717e5eb56c4d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:08:05.180196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5e7c7e14-475a-49a4-99d2-48feb637d5bf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:05.181323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5e7c7e14-475a-49a4-99d2-48feb637d5bf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:05.191791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e7c7e14-475a-49a4-99d2-48feb637d5bf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:05.192713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e7c7e14-475a-49a4-99d2-48feb637d5bf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:05.193636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e7c7e14-475a-49a4-99d2-48feb637d5bf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:05.195769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e7c7e14-475a-49a4-99d2-48feb637d5bf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:05.196849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e7c7e14-475a-49a4-99d2-48feb637d5bf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:05.197312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e7c7e14-475a-49a4-99d2-48feb637d5bf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:05.222330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:05.232954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5e7c7e14-475a-49a4-99d2-48feb637d5bf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:08:05.354773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:05.370183 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5e7c7e14-475a-49a4-99d2-48feb637d5bf tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 204 len: 0 microversion: 2.1 time: 0.195206 Oct 12 22:08:05.371045 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1226/2260] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:08:05 2022] DELETE /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:08:05.379803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5ff65411-b5c3-4906-9c87-26ef8bd6a579 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:05.380739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5ff65411-b5c3-4906-9c87-26ef8bd6a579 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:05.387467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ff65411-b5c3-4906-9c87-26ef8bd6a579 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:05.388178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ff65411-b5c3-4906-9c87-26ef8bd6a579 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:05.388854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ff65411-b5c3-4906-9c87-26ef8bd6a579 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:05.390201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ff65411-b5c3-4906-9c87-26ef8bd6a579 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:05.390623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ff65411-b5c3-4906-9c87-26ef8bd6a579 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:05.391047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ff65411-b5c3-4906-9c87-26ef8bd6a579 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:05.652199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d829e668-3682-4adf-9c8e-0785fc12bebc tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:05.653237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d829e668-3682-4adf-9c8e-0785fc12bebc tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:05.663273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d829e668-3682-4adf-9c8e-0785fc12bebc tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:05.664273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d829e668-3682-4adf-9c8e-0785fc12bebc tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:05.664927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d829e668-3682-4adf-9c8e-0785fc12bebc tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:05.665895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d829e668-3682-4adf-9c8e-0785fc12bebc tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:05.666565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d829e668-3682-4adf-9c8e-0785fc12bebc tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:05.667081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d829e668-3682-4adf-9c8e-0785fc12bebc tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:05.935088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5ff65411-b5c3-4906-9c87-26ef8bd6a579 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:05.953744 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5ff65411-b5c3-4906-9c87-26ef8bd6a579 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1501 microversion: 2.1 time: 0.577493 Oct 12 22:08:05.956501 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1035/2261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:05 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1501 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:05.957654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d829e668-3682-4adf-9c8e-0785fc12bebc tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:05.967704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1526613005", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f242dc36-3fe9-446b-9e25-712c56d106a4"}], "security_groups": [{"name": "tempest-securitygroup--1225316905"}], "key_name": "tempest-keypair-1577865335", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:05.968027 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d829e668-3682-4adf-9c8e-0785fc12bebc tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1469 microversion: 2.1 time: 0.321322 Oct 12 22:08:05.968797 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1227/2262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:05 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1469 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:05.974825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d82aedd3-34b9-49c0-885c-96370e5f498a req-631a8aee-6573-43a6-ae5d-070a3a943dca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c689a6f-3eaf-4ca1-ac49-169512ccf758", "tag": "90217945-8054-4c54-ae66-098ddce4d83f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:06.002054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d82aedd3-34b9-49c0-885c-96370e5f498a req-631a8aee-6573-43a6-ae5d-070a3a943dca service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:06.002845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d82aedd3-34b9-49c0-885c-96370e5f498a req-631a8aee-6573-43a6-ae5d-070a3a943dca service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:06.003915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d82aedd3-34b9-49c0-885c-96370e5f498a req-631a8aee-6573-43a6-ae5d-070a3a943dca service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:06.015540 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d82aedd3-34b9-49c0-885c-96370e5f498a req-631a8aee-6573-43a6-ae5d-070a3a943dca service nova] Creating event network-changed:90217945-8054-4c54-ae66-098ddce4d83f for instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 on n-h1-861111-1 Oct 12 22:08:06.020735 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d82aedd3-34b9-49c0-885c-96370e5f498a req-631a8aee-6573-43a6-ae5d-070a3a943dca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049192 Oct 12 22:08:06.021535 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1228/2263] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:06.026562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-1618da50-3976-4f12-90c7-6f40496a09d5 req-f15817f4-5fce-4629-ac65-648c610a16ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77548da5-9429-4e07-bdad-7902d89d4153", "tag": "cc048857-8664-421b-b22d-6488c4031e97"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:06.038461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1618da50-3976-4f12-90c7-6f40496a09d5 req-f15817f4-5fce-4629-ac65-648c610a16ae service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:06.039127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1618da50-3976-4f12-90c7-6f40496a09d5 req-f15817f4-5fce-4629-ac65-648c610a16ae service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:06.039733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1618da50-3976-4f12-90c7-6f40496a09d5 req-f15817f4-5fce-4629-ac65-648c610a16ae service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:06.053060 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-1618da50-3976-4f12-90c7-6f40496a09d5 req-f15817f4-5fce-4629-ac65-648c610a16ae service nova] Creating event network-changed:cc048857-8664-421b-b22d-6488c4031e97 for instance 77548da5-9429-4e07-bdad-7902d89d4153 on n-h2-861111-1 Oct 12 22:08:06.058190 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-1618da50-3976-4f12-90c7-6f40496a09d5 req-f15817f4-5fce-4629-ac65-648c610a16ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035187 Oct 12 22:08:06.059411 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1229/2264] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:06.126776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e321c366-d616-4316-9367-62888277b701 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:06.128937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e321c366-d616-4316-9367-62888277b701 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:06.139406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e321c366-d616-4316-9367-62888277b701 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:06.141071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e321c366-d616-4316-9367-62888277b701 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:06.141788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e321c366-d616-4316-9367-62888277b701 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:06.143767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e321c366-d616-4316-9367-62888277b701 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:06.144581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e321c366-d616-4316-9367-62888277b701 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:06.145256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e321c366-d616-4316-9367-62888277b701 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:06.465995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] validate_networks() for [('f242dc36-3fe9-446b-9e25-712c56d106a4', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:08:06.525888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e321c366-d616-4316-9367-62888277b701 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:06.561526 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e321c366-d616-4316-9367-62888277b701 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1316 microversion: 2.1 time: 0.440501 Oct 12 22:08:06.570449 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1230/2265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:06 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:08:06.581034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-51bb3acc-5460-4f61-97a5-40eea6664b29 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:06.581690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-51bb3acc-5460-4f61-97a5-40eea6664b29 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:06.599070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51bb3acc-5460-4f61-97a5-40eea6664b29 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:06.604814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51bb3acc-5460-4f61-97a5-40eea6664b29 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:06.605537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51bb3acc-5460-4f61-97a5-40eea6664b29 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:06.606490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51bb3acc-5460-4f61-97a5-40eea6664b29 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:06.607113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51bb3acc-5460-4f61-97a5-40eea6664b29 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:06.609871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51bb3acc-5460-4f61-97a5-40eea6664b29 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:07.035182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-51bb3acc-5460-4f61-97a5-40eea6664b29 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:07.065009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-51bb3acc-5460-4f61-97a5-40eea6664b29 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:07.068829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-51bb3acc-5460-4f61-97a5-40eea6664b29 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:07.073549 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-51bb3acc-5460-4f61-97a5-40eea6664b29 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.500533 Oct 12 22:08:07.074265 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1231/2266] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:06 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:07.085953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1ca512d6-ff9a-4768-9bdb-0598245de90b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:07.112036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1ca512d6-ff9a-4768-9bdb-0598245de90b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:07.141221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ca512d6-ff9a-4768-9bdb-0598245de90b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:07.142417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ca512d6-ff9a-4768-9bdb-0598245de90b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:07.143205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ca512d6-ff9a-4768-9bdb-0598245de90b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:07.144774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ca512d6-ff9a-4768-9bdb-0598245de90b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:07.145396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ca512d6-ff9a-4768-9bdb-0598245de90b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:07.147194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ca512d6-ff9a-4768-9bdb-0598245de90b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:07.271440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1ca512d6-ff9a-4768-9bdb-0598245de90b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe98ba1ceec4b849eb45eb46ce4d425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e71a9eeaa044e8aa939548f15a585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:07.282833 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1ca512d6-ff9a-4768-9bdb-0598245de90b tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 200 len: 1459 microversion: 2.1 time: 0.207095 Oct 12 22:08:07.302573 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1232/2267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:07 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 1459 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:07.313172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0b9d271a-b7a0-4754-a110-7d076d47e2b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:07.314827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0b9d271a-b7a0-4754-a110-7d076d47e2b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:07.323097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b9d271a-b7a0-4754-a110-7d076d47e2b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:07.324195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b9d271a-b7a0-4754-a110-7d076d47e2b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:07.324880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b9d271a-b7a0-4754-a110-7d076d47e2b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:07.326715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b9d271a-b7a0-4754-a110-7d076d47e2b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:07.327906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b9d271a-b7a0-4754-a110-7d076d47e2b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:07.328573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b9d271a-b7a0-4754-a110-7d076d47e2b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:07.539162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0b9d271a-b7a0-4754-a110-7d076d47e2b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:07.552121 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0b9d271a-b7a0-4754-a110-7d076d47e2b1 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1469 microversion: 2.1 time: 0.247737 Oct 12 22:08:07.553303 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1233/2268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:07 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1469 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:07.594299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7b03e860-b0c2-4099-9101-95f8219312a1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:07.598265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7b03e860-b0c2-4099-9101-95f8219312a1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:07.612849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b03e860-b0c2-4099-9101-95f8219312a1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:07.613536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b03e860-b0c2-4099-9101-95f8219312a1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:07.614476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b03e860-b0c2-4099-9101-95f8219312a1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:07.615428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b03e860-b0c2-4099-9101-95f8219312a1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:07.616127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b03e860-b0c2-4099-9101-95f8219312a1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:07.616741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b03e860-b0c2-4099-9101-95f8219312a1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:07.816098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7b03e860-b0c2-4099-9101-95f8219312a1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:07.824510 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7b03e860-b0c2-4099-9101-95f8219312a1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1316 microversion: 2.1 time: 0.240995 Oct 12 22:08:07.825421 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1234/2269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:07 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:08.062835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-fa120c9a-8d73-454d-90b5-820d1b942230 req-d096b0f4-846f-47e2-b05f-d67487ccd8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48128c05-1d65-46fb-accf-2dd2981a742b", "name": "network-vif-deleted", "tag": "51d433b5-9d81-423f-86a9-27412dea934c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:08.076774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fa120c9a-8d73-454d-90b5-820d1b942230 req-d096b0f4-846f-47e2-b05f-d67487ccd8ee service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:08.077597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fa120c9a-8d73-454d-90b5-820d1b942230 req-d096b0f4-846f-47e2-b05f-d67487ccd8ee service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:08.078624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fa120c9a-8d73-454d-90b5-820d1b942230 req-d096b0f4-846f-47e2-b05f-d67487ccd8ee service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:08.095157 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-fa120c9a-8d73-454d-90b5-820d1b942230 req-d096b0f4-846f-47e2-b05f-d67487ccd8ee service nova] Creating event network-vif-deleted:51d433b5-9d81-423f-86a9-27412dea934c for instance 48128c05-1d65-46fb-accf-2dd2981a742b on n-h1-861111-1 Oct 12 22:08:08.106377 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-fa120c9a-8d73-454d-90b5-820d1b942230 req-d096b0f4-846f-47e2-b05f-d67487ccd8ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046195 Oct 12 22:08:08.109380 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1235/2270] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:08:08.117504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-1c5a7a0b-8273-4104-9c81-674384350883 req-52bb2fe8-2866-4575-8ec0-2b49df31146f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54a23a46-7ad2-4563-a557-1806d4d61253", "tag": "c43be245-e399-4a43-a754-f8061895ef0c"}, {"server_uuid": "1701358b-ffd8-442b-add8-6fa9581ceaa4", "name": "network-vif-deleted", "tag": "0bf1a6c0-d01b-4b06-ae76-9244a6b48643"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:08.130605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1c5a7a0b-8273-4104-9c81-674384350883 req-52bb2fe8-2866-4575-8ec0-2b49df31146f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:08.131615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1c5a7a0b-8273-4104-9c81-674384350883 req-52bb2fe8-2866-4575-8ec0-2b49df31146f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:08.132364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1c5a7a0b-8273-4104-9c81-674384350883 req-52bb2fe8-2866-4575-8ec0-2b49df31146f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:08.148190 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-1c5a7a0b-8273-4104-9c81-674384350883 req-52bb2fe8-2866-4575-8ec0-2b49df31146f service nova] Creating event network-changed:c43be245-e399-4a43-a754-f8061895ef0c for instance 54a23a46-7ad2-4563-a557-1806d4d61253 on n-h1-861111-1 Oct 12 22:08:08.149547 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-1c5a7a0b-8273-4104-9c81-674384350883 req-52bb2fe8-2866-4575-8ec0-2b49df31146f service nova] Creating event network-vif-deleted:0bf1a6c0-d01b-4b06-ae76-9244a6b48643 for instance 1701358b-ffd8-442b-add8-6fa9581ceaa4 on n-h2-861111-1 Oct 12 22:08:08.159466 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-1c5a7a0b-8273-4104-9c81-674384350883 req-52bb2fe8-2866-4575-8ec0-2b49df31146f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.048380 Oct 12 22:08:08.160978 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1236/2271] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:08.167443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-adacdefb-eef2-455a-a68f-225f9607447f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:08.168149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-adacdefb-eef2-455a-a68f-225f9607447f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:08.177316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adacdefb-eef2-455a-a68f-225f9607447f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:08.178194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adacdefb-eef2-455a-a68f-225f9607447f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:08.180459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adacdefb-eef2-455a-a68f-225f9607447f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:08.187628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adacdefb-eef2-455a-a68f-225f9607447f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:08.188229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adacdefb-eef2-455a-a68f-225f9607447f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:08.188681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-adacdefb-eef2-455a-a68f-225f9607447f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:08.376537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Getting quotas for project ede0fba22ac94b9e9a394ed466a92bd4. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:08:08.379053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-adacdefb-eef2-455a-a68f-225f9607447f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:08.389284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-adacdefb-eef2-455a-a68f-225f9607447f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:08.390744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-adacdefb-eef2-455a-a68f-225f9607447f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:08.393635 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-adacdefb-eef2-455a-a68f-225f9607447f tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1486 microversion: 2.25 time: 0.231280 Oct 12 22:08:08.397441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Getting quotas for user d6c78e7bee0d4dbe88f7c1beb9042038 and project ede0fba22ac94b9e9a394ed466a92bd4. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:08:08.417386 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1237/2272] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:08 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1486 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:08.423147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:08:08.423608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:08:08.424083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:08:08.424480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5f7b450f-0b02-4fd8-bd96-ba2a4b3ca067 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:08.424605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:08:08.424961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:08:08.425602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5f7b450f-0b02-4fd8-bd96-ba2a4b3ca067 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] [instance: 1701358b-ffd8-442b-add8-6fa9581ceaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:08.432212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f7b450f-0b02-4fd8-bd96-ba2a4b3ca067 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:08.432985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f7b450f-0b02-4fd8-bd96-ba2a4b3ca067 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:08.434225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f7b450f-0b02-4fd8-bd96-ba2a4b3ca067 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:08.435154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f7b450f-0b02-4fd8-bd96-ba2a4b3ca067 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:08.436427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f7b450f-0b02-4fd8-bd96-ba2a4b3ca067 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:08.437080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f7b450f-0b02-4fd8-bd96-ba2a4b3ca067 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:08.437464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:08.437955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:08.438383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:08.439467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:08.440108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:08.440697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:08.480254 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-5f7b450f-0b02-4fd8-bd96-ba2a4b3ca067 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] HTTP exception thrown: Instance 1701358b-ffd8-442b-add8-6fa9581ceaa4 could not be found. Oct 12 22:08:08.482755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Getting quotas for project ede0fba22ac94b9e9a394ed466a92bd4. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5f7b450f-0b02-4fd8-bd96-ba2a4b3ca067 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Request method failure captured: Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 HTTP/1.1 Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzjWa7fW4cCWMnkS2ihtgUCglzU38ChAzYORmM7Dbu9VoPpmuOcvF68E2HOkgVWjtO59JzvrNcPt6cpEPfgvTwc8u3yOUJpSVFhJvxoJSFOpL6COZC7hUepcrA4h6-wO_W4qNSt17id_hM0-SJoaXsiZjl3SD74vmQRJZQN-oA7sWak Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 61e71a9eeaa044e8aa939548f15a585e Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-LiveMigrationTest-68417645 Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61e71a9eeaa044e8aa939548f15a585e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61e71a9eeaa044e8aa939548f15a585e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_61e71a9eeaa044e8aa939548f15a585e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/61e71a9eeaa044e8aa939548f15a585e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-LiveMigrationTest-68417645 Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 61e71a9eeaa044e8aa939548f15a585e Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-LiveMigrationTest-68417645 Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-LiveMigrationTest-68417645-project Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 1fe98ba1ceec4b849eb45eb46ce4d425 Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-LiveMigrationTest-68417645-project Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 1701358b-ffd8-442b-add8-6fa9581ceaa4 could not be found. Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1701358b-ffd8-442b-add8-6fa9581ceaa4'} Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1701358b-ffd8-442b-add8-6fa9581ceaa4 could not be found. Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1701358b-ffd8-442b-add8-6fa9581ceaa4 could not be found. Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:08.482918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:08.488176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:08.488176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:08.488176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:08.488176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:08.488176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:08.488176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1701358b-ffd8-442b-add8-6fa9581ceaa4 could not be found. Oct 12 22:08:08.488176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:08.492440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Getting quotas for user d6c78e7bee0d4dbe88f7c1beb9042038 and project ede0fba22ac94b9e9a394ed466a92bd4. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:08:08.493962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5f7b450f-0b02-4fd8-bd96-ba2a4b3ca067 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] Returning 404 to user: Instance 1701358b-ffd8-442b-add8-6fa9581ceaa4 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:08.494948 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5f7b450f-0b02-4fd8-bd96-ba2a4b3ca067 tempest-LiveMigrationTest-68417645 tempest-LiveMigrationTest-68417645-project] 10.222.0.16 "GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4" status: 404 len: 111 microversion: 2.1 time: 0.076247 Oct 12 22:08:08.496120 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1238/2273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:08 2022] GET /compute/v2.1/servers/1701358b-ffd8-442b-add8-6fa9581ceaa4 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:08:08.517161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:08:08.520349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:08:08.581298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c21f11f8-2608-488a-bfd0-8a1902af250a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:08.581928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c21f11f8-2608-488a-bfd0-8a1902af250a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:08.593635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c21f11f8-2608-488a-bfd0-8a1902af250a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:08.604378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c21f11f8-2608-488a-bfd0-8a1902af250a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:08.608127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c21f11f8-2608-488a-bfd0-8a1902af250a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:08.608930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c21f11f8-2608-488a-bfd0-8a1902af250a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:08.609400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c21f11f8-2608-488a-bfd0-8a1902af250a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:08.610148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c21f11f8-2608-488a-bfd0-8a1902af250a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:08.640991 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f6231065-a247-4a60-baeb-ab8dfbe69c0c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.675082 Oct 12 22:08:08.645527 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1036/2274] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:08:05 2022] POST /compute/v2.1/servers => generated 407 bytes in 2688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:08:08.656301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8b15624e-d51f-4cab-882d-df1d27067b3e tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:08.657635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8b15624e-d51f-4cab-882d-df1d27067b3e tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:08.938754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c21f11f8-2608-488a-bfd0-8a1902af250a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:08.948689 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c21f11f8-2608-488a-bfd0-8a1902af250a tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 200 len: 1298 microversion: 2.1 time: 0.371361 Oct 12 22:08:08.950099 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1239/2275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:08 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 1298 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:08.955653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3480d3e7-ea41-4ead-82da-596731720d6b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:08.956257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3480d3e7-ea41-4ead-82da-596731720d6b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:08.968961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3480d3e7-ea41-4ead-82da-596731720d6b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:08.969460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3480d3e7-ea41-4ead-82da-596731720d6b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:08.969902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3480d3e7-ea41-4ead-82da-596731720d6b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:08.970612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3480d3e7-ea41-4ead-82da-596731720d6b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:08.971262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3480d3e7-ea41-4ead-82da-596731720d6b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:08.971888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3480d3e7-ea41-4ead-82da-596731720d6b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:09.101390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8b15624e-d51f-4cab-882d-df1d27067b3e tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:09.116313 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8b15624e-d51f-4cab-882d-df1d27067b3e tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1270 microversion: 2.1 time: 0.463938 Oct 12 22:08:09.117284 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1037/2276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:08 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1270 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:08:09.260478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3480d3e7-ea41-4ead-82da-596731720d6b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:09.296672 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3480d3e7-ea41-4ead-82da-596731720d6b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1316 microversion: 2.1 time: 0.343205 Oct 12 22:08:09.300354 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1240/2277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:08 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:09.424460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bed74b2a-8372-42bc-a1f3-9cf161d4f960 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:09.425086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bed74b2a-8372-42bc-a1f3-9cf161d4f960 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:09.444719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bed74b2a-8372-42bc-a1f3-9cf161d4f960 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:09.447807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bed74b2a-8372-42bc-a1f3-9cf161d4f960 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:09.448541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bed74b2a-8372-42bc-a1f3-9cf161d4f960 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:09.452636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bed74b2a-8372-42bc-a1f3-9cf161d4f960 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:09.455467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bed74b2a-8372-42bc-a1f3-9cf161d4f960 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:09.456815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bed74b2a-8372-42bc-a1f3-9cf161d4f960 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:09.972198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5ec48d2d-6daa-458a-b7e0-620c67cf93e8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:09.972854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5ec48d2d-6daa-458a-b7e0-620c67cf93e8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: 48128c05-1d65-46fb-accf-2dd2981a742b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:09.979661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ec48d2d-6daa-458a-b7e0-620c67cf93e8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:09.980287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ec48d2d-6daa-458a-b7e0-620c67cf93e8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:09.980913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ec48d2d-6daa-458a-b7e0-620c67cf93e8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:09.981884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ec48d2d-6daa-458a-b7e0-620c67cf93e8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:09.982925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ec48d2d-6daa-458a-b7e0-620c67cf93e8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:09.983528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ec48d2d-6daa-458a-b7e0-620c67cf93e8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:09.997434 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-5ec48d2d-6daa-458a-b7e0-620c67cf93e8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] HTTP exception thrown: Instance 48128c05-1d65-46fb-accf-2dd2981a742b could not be found. Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5ec48d2d-6daa-458a-b7e0-620c67cf93e8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Request method failure captured: Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b HTTP/1.1 Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzlvk8Zf5YMjK78ehwua-VIp9tTEWatKA_MwoBx1A7nZ1jO8nGeK8kIboYB3nTbSWwYSvd7WDTRzOrvcfJnVCrHEawKN0Ex4PqqKTBPc7KUF441v6xgLwZCrBOH5r7xr8B7W31weCRXkIKg51P_759AClf1ZN4y-HST82G9fLe0WJA8 Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7d943f8c0c934001b53032564fd00e11 Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-MigrationsAdminTest-40857002 Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d943f8c0c934001b53032564fd00e11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d943f8c0c934001b53032564fd00e11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d943f8c0c934001b53032564fd00e11", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d943f8c0c934001b53032564fd00e11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-MigrationsAdminTest-40857002 Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7d943f8c0c934001b53032564fd00e11 Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-MigrationsAdminTest-40857002 Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-MigrationsAdminTest-40857002-project Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: cfc7df27bf6f456581abff6e80ab4f64 Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-MigrationsAdminTest-40857002-project Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 48128c05-1d65-46fb-accf-2dd2981a742b could not be found. Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '48128c05-1d65-46fb-accf-2dd2981a742b'} Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48128c05-1d65-46fb-accf-2dd2981a742b could not be found. Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48128c05-1d65-46fb-accf-2dd2981a742b could not be found. Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:10.000462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:10.003529 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:10.003529 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:10.003529 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:10.003529 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:10.003529 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:10.003529 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48128c05-1d65-46fb-accf-2dd2981a742b could not be found. Oct 12 22:08:10.003529 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:10.003529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5ec48d2d-6daa-458a-b7e0-620c67cf93e8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Returning 404 to user: Instance 48128c05-1d65-46fb-accf-2dd2981a742b could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:10.003529 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5ec48d2d-6daa-458a-b7e0-620c67cf93e8 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b" status: 404 len: 111 microversion: 2.1 time: 0.034026 Oct 12 22:08:10.003529 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1241/2278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:09 2022] GET /compute/v2.1/servers/48128c05-1d65-46fb-accf-2dd2981a742b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:08:10.010248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e29d2a57-f451-42f5-ba69-32c2ddf43740 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:10.010842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e29d2a57-f451-42f5-ba69-32c2ddf43740 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:10.017264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e29d2a57-f451-42f5-ba69-32c2ddf43740 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:10.017842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e29d2a57-f451-42f5-ba69-32c2ddf43740 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:10.018349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e29d2a57-f451-42f5-ba69-32c2ddf43740 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:10.019188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e29d2a57-f451-42f5-ba69-32c2ddf43740 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:10.019748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e29d2a57-f451-42f5-ba69-32c2ddf43740 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:10.020290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e29d2a57-f451-42f5-ba69-32c2ddf43740 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:10.050014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e29d2a57-f451-42f5-ba69-32c2ddf43740 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:08:10.137641 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e29d2a57-f451-42f5-ba69-32c2ddf43740 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "DELETE /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 204 len: 0 microversion: 2.1 time: 0.130663 Oct 12 22:08:10.138597 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1242/2279] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:08:10 2022] DELETE /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:08:10.144942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-04c3fcf2-0090-4184-9422-3e80aef57746 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:10.145973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-04c3fcf2-0090-4184-9422-3e80aef57746 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:10.152466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04c3fcf2-0090-4184-9422-3e80aef57746 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:10.153246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04c3fcf2-0090-4184-9422-3e80aef57746 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:10.154461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04c3fcf2-0090-4184-9422-3e80aef57746 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:10.155589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04c3fcf2-0090-4184-9422-3e80aef57746 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:10.156234 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04c3fcf2-0090-4184-9422-3e80aef57746 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:10.156864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04c3fcf2-0090-4184-9422-3e80aef57746 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:10.178729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:10.238264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-04c3fcf2-0090-4184-9422-3e80aef57746 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:10.240795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:10.248740 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-04c3fcf2-0090-4184-9422-3e80aef57746 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1322 microversion: 2.1 time: 0.108628 Oct 12 22:08:10.249840 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1243/2280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:10 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1322 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:10.254437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0851434d-e26d-4d44-a3b7-591a96c0f0d7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:10.255136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0851434d-e26d-4d44-a3b7-591a96c0f0d7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:10.261324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0851434d-e26d-4d44-a3b7-591a96c0f0d7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:10.261898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0851434d-e26d-4d44-a3b7-591a96c0f0d7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:10.262325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0851434d-e26d-4d44-a3b7-591a96c0f0d7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:10.263290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0851434d-e26d-4d44-a3b7-591a96c0f0d7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:10.264074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0851434d-e26d-4d44-a3b7-591a96c0f0d7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:10.264501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0851434d-e26d-4d44-a3b7-591a96c0f0d7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:10.416157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0851434d-e26d-4d44-a3b7-591a96c0f0d7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:10.425743 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0851434d-e26d-4d44-a3b7-591a96c0f0d7 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1469 microversion: 2.1 time: 0.174774 Oct 12 22:08:10.426507 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1244/2281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:10 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:10.432866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ea672d4e-a800-4b2f-8272-133d814b50b1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:10.433568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ea672d4e-a800-4b2f-8272-133d814b50b1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:10.439706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea672d4e-a800-4b2f-8272-133d814b50b1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:10.440408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea672d4e-a800-4b2f-8272-133d814b50b1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:10.441820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea672d4e-a800-4b2f-8272-133d814b50b1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:10.442728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea672d4e-a800-4b2f-8272-133d814b50b1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:10.443427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea672d4e-a800-4b2f-8272-133d814b50b1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:10.444050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea672d4e-a800-4b2f-8272-133d814b50b1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:10.461341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bed74b2a-8372-42bc-a1f3-9cf161d4f960 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:10.471659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bed74b2a-8372-42bc-a1f3-9cf161d4f960 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:10.473636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bed74b2a-8372-42bc-a1f3-9cf161d4f960 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:10.475016 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bed74b2a-8372-42bc-a1f3-9cf161d4f960 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1476 microversion: 2.25 time: 1.055396 Oct 12 22:08:10.495605 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1038/2282] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:09 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1476 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:10.504643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5a2c9c93-c22c-4470-9190-12e91103f9a6 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '.version_select at 0x7f51286635e0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:10.508842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a2c9c93-c22c-4470-9190-12e91103f9a6 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:10.509522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a2c9c93-c22c-4470-9190-12e91103f9a6 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:10.510180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a2c9c93-c22c-4470-9190-12e91103f9a6 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:10.520823 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5a2c9c93-c22c-4470-9190-12e91103f9a6 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2367 microversion: 2.25 time: 0.023681 Oct 12 22:08:10.522247 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1039/2283] 10.222.0.16 () {60 vars in 1184 bytes} [Wed Oct 12 22:08:10 2022] GET /compute/v2.1/os-migrations => generated 2367 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:10.545436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3fa64ee4-419f-4d61-967c-b85142704270 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:10.546885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3fa64ee4-419f-4d61-967c-b85142704270 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:10.554407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fa64ee4-419f-4d61-967c-b85142704270 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:10.559774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fa64ee4-419f-4d61-967c-b85142704270 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:10.561130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fa64ee4-419f-4d61-967c-b85142704270 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:10.562098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fa64ee4-419f-4d61-967c-b85142704270 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:10.564238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fa64ee4-419f-4d61-967c-b85142704270 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:10.564936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fa64ee4-419f-4d61-967c-b85142704270 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:10.656258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ea672d4e-a800-4b2f-8272-133d814b50b1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:10.664967 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ea672d4e-a800-4b2f-8272-133d814b50b1 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1316 microversion: 2.1 time: 0.236598 Oct 12 22:08:10.665605 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1245/2284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:10 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:11.103581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-3fa64ee4-419f-4d61-967c-b85142704270 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] Lazy-loading 'services' on Instance uuid 325466ea-d13d-4204-89f6-7c5deb99cd61 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:08:11.118372 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3fa64ee4-419f-4d61-967c-b85142704270 tempest-LiveAutoBlockMigrationV225Test-1543809058 tempest-LiveAutoBlockMigrationV225Test-1543809058-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1969 microversion: 2.25 time: 0.582295 Oct 12 22:08:11.138027 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1040/2285] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:10 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1969 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:11.151905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-31b5ae42-2fd1-437e-bfef-8e5967ae1504 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:11.152433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-31b5ae42-2fd1-437e-bfef-8e5967ae1504 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:11.158371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31b5ae42-2fd1-437e-bfef-8e5967ae1504 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:11.158881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31b5ae42-2fd1-437e-bfef-8e5967ae1504 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:11.159342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31b5ae42-2fd1-437e-bfef-8e5967ae1504 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:11.160041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31b5ae42-2fd1-437e-bfef-8e5967ae1504 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:11.160496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31b5ae42-2fd1-437e-bfef-8e5967ae1504 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:11.160928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31b5ae42-2fd1-437e-bfef-8e5967ae1504 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:11.190592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-31b5ae42-2fd1-437e-bfef-8e5967ae1504 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:08:11.287861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f138e66-ccfb-4c23-baef-f8113297e4ec tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:11.294194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8f138e66-ccfb-4c23-baef-f8113297e4ec tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:11.330677 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-31b5ae42-2fd1-437e-bfef-8e5967ae1504 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 204 len: 0 microversion: 2.25 time: 0.182284 Oct 12 22:08:11.335958 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1246/2286] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:08:11 2022] DELETE /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:08:11.340472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f138e66-ccfb-4c23-baef-f8113297e4ec tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:11.343759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-883fdeec-f4bf-4b50-8ed3-14c7c0839ad1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:11.344702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-883fdeec-f4bf-4b50-8ed3-14c7c0839ad1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:11.352145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883fdeec-f4bf-4b50-8ed3-14c7c0839ad1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:11.352313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f138e66-ccfb-4c23-baef-f8113297e4ec tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:11.353144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883fdeec-f4bf-4b50-8ed3-14c7c0839ad1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:11.353810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883fdeec-f4bf-4b50-8ed3-14c7c0839ad1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:11.354760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883fdeec-f4bf-4b50-8ed3-14c7c0839ad1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:11.355677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f138e66-ccfb-4c23-baef-f8113297e4ec tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:11.356358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f138e66-ccfb-4c23-baef-f8113297e4ec tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:11.356643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883fdeec-f4bf-4b50-8ed3-14c7c0839ad1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:11.358045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883fdeec-f4bf-4b50-8ed3-14c7c0839ad1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:11.360471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f138e66-ccfb-4c23-baef-f8113297e4ec tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:11.365800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f138e66-ccfb-4c23-baef-f8113297e4ec tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:11.480784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f138e66-ccfb-4c23-baef-f8113297e4ec tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:11.490741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:11.498734 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f138e66-ccfb-4c23-baef-f8113297e4ec tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1330 microversion: 2.1 time: 0.225254 Oct 12 22:08:11.502608 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1041/2287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:11 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1330 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:11.516232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-52df8e0d-b3c3-44ab-b1ec-8ec9c497de76 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:11.517345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-52df8e0d-b3c3-44ab-b1ec-8ec9c497de76 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:11.531303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52df8e0d-b3c3-44ab-b1ec-8ec9c497de76 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:11.537791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52df8e0d-b3c3-44ab-b1ec-8ec9c497de76 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:11.544195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52df8e0d-b3c3-44ab-b1ec-8ec9c497de76 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:11.545874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52df8e0d-b3c3-44ab-b1ec-8ec9c497de76 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:11.546746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52df8e0d-b3c3-44ab-b1ec-8ec9c497de76 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:11.547563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52df8e0d-b3c3-44ab-b1ec-8ec9c497de76 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:12.326196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-883fdeec-f4bf-4b50-8ed3-14c7c0839ad1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:12.337511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-883fdeec-f4bf-4b50-8ed3-14c7c0839ad1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:12.340136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-883fdeec-f4bf-4b50-8ed3-14c7c0839ad1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:12.342688 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-883fdeec-f4bf-4b50-8ed3-14c7c0839ad1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1482 microversion: 2.25 time: 1.003060 Oct 12 22:08:12.343971 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1247/2288] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:11 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1482 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:12.351202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1b24f548-65e4-4e79-82a3-97f01643f90c tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:12.352239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1b24f548-65e4-4e79-82a3-97f01643f90c tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:12.359311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b24f548-65e4-4e79-82a3-97f01643f90c tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:12.359978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b24f548-65e4-4e79-82a3-97f01643f90c tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:12.360610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b24f548-65e4-4e79-82a3-97f01643f90c tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:12.361433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b24f548-65e4-4e79-82a3-97f01643f90c tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:12.368237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b24f548-65e4-4e79-82a3-97f01643f90c tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:12.368912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b24f548-65e4-4e79-82a3-97f01643f90c tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:12.750748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1b24f548-65e4-4e79-82a3-97f01643f90c tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:12.764247 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1b24f548-65e4-4e79-82a3-97f01643f90c tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1316 microversion: 2.1 time: 0.418953 Oct 12 22:08:12.764833 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1248/2289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:12 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:12.769555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f095b59a-0475-409a-8a6c-c859be749d62 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:12.776022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f095b59a-0475-409a-8a6c-c859be749d62 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:12.783603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f095b59a-0475-409a-8a6c-c859be749d62 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:12.784014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f095b59a-0475-409a-8a6c-c859be749d62 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:12.784445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f095b59a-0475-409a-8a6c-c859be749d62 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:12.785148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f095b59a-0475-409a-8a6c-c859be749d62 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:12.785593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f095b59a-0475-409a-8a6c-c859be749d62 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:12.786016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f095b59a-0475-409a-8a6c-c859be749d62 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:12.808207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-52df8e0d-b3c3-44ab-b1ec-8ec9c497de76 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:12.816429 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-52df8e0d-b3c3-44ab-b1ec-8ec9c497de76 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1469 microversion: 2.1 time: 1.312516 Oct 12 22:08:12.817508 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1042/2290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:11 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1469 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:12.906067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f095b59a-0475-409a-8a6c-c859be749d62 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:12.918628 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f095b59a-0475-409a-8a6c-c859be749d62 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1328 microversion: 2.1 time: 0.152581 Oct 12 22:08:12.934899 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1249/2291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:12 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1328 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:13.371390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9b23f991-aa09-4818-bd28-101e3d8df2fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:13.372089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9b23f991-aa09-4818-bd28-101e3d8df2fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:13.389638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b23f991-aa09-4818-bd28-101e3d8df2fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:13.390132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b23f991-aa09-4818-bd28-101e3d8df2fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:13.390813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b23f991-aa09-4818-bd28-101e3d8df2fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:13.391780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b23f991-aa09-4818-bd28-101e3d8df2fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:13.392337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b23f991-aa09-4818-bd28-101e3d8df2fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:13.393176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b23f991-aa09-4818-bd28-101e3d8df2fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:13.545737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-ff7b0004-7799-4723-b971-ae35f3cb9d79 req-dd6fd2c4-43c6-43c1-b7c6-d7de2b4d7f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c689a6f-3eaf-4ca1-ac49-169512ccf758", "name": "network-vif-plugged", "status": "completed", "tag": "90217945-8054-4c54-ae66-098ddce4d83f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:13.564285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ff7b0004-7799-4723-b971-ae35f3cb9d79 req-dd6fd2c4-43c6-43c1-b7c6-d7de2b4d7f68 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:13.564951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ff7b0004-7799-4723-b971-ae35f3cb9d79 req-dd6fd2c4-43c6-43c1-b7c6-d7de2b4d7f68 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:13.565810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ff7b0004-7799-4723-b971-ae35f3cb9d79 req-dd6fd2c4-43c6-43c1-b7c6-d7de2b4d7f68 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:13.585443 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-ff7b0004-7799-4723-b971-ae35f3cb9d79 req-dd6fd2c4-43c6-43c1-b7c6-d7de2b4d7f68 service nova] Creating event network-vif-plugged:90217945-8054-4c54-ae66-098ddce4d83f for instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 on n-h1-861111-1 Oct 12 22:08:13.603623 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-ff7b0004-7799-4723-b971-ae35f3cb9d79 req-dd6fd2c4-43c6-43c1-b7c6-d7de2b4d7f68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060265 Oct 12 22:08:13.610073 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1250/2292] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:13.793557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5465cec4-f465-4d0b-a6e4-a1977b477324 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:13.794439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5465cec4-f465-4d0b-a6e4-a1977b477324 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:13.810748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5465cec4-f465-4d0b-a6e4-a1977b477324 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:13.812769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5465cec4-f465-4d0b-a6e4-a1977b477324 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:13.826752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5465cec4-f465-4d0b-a6e4-a1977b477324 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:13.827932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5465cec4-f465-4d0b-a6e4-a1977b477324 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:13.828802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5465cec4-f465-4d0b-a6e4-a1977b477324 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:13.829393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5465cec4-f465-4d0b-a6e4-a1977b477324 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:14.283900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5465cec4-f465-4d0b-a6e4-a1977b477324 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:14.291827 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5465cec4-f465-4d0b-a6e4-a1977b477324 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1316 microversion: 2.1 time: 0.503323 Oct 12 22:08:14.292415 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1251/2293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:13 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:08:14.325879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9b23f991-aa09-4818-bd28-101e3d8df2fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:14.328764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-01df60bc-26c8-49cb-85a1-a37807a0e506 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:14.329401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-01df60bc-26c8-49cb-85a1-a37807a0e506 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:14.342832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01df60bc-26c8-49cb-85a1-a37807a0e506 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:14.342832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01df60bc-26c8-49cb-85a1-a37807a0e506 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:14.343457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01df60bc-26c8-49cb-85a1-a37807a0e506 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:14.344672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01df60bc-26c8-49cb-85a1-a37807a0e506 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:14.345259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01df60bc-26c8-49cb-85a1-a37807a0e506 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:14.347580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01df60bc-26c8-49cb-85a1-a37807a0e506 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:14.355063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9b23f991-aa09-4818-bd28-101e3d8df2fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:14.360239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9b23f991-aa09-4818-bd28-101e3d8df2fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:14.364468 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9b23f991-aa09-4818-bd28-101e3d8df2fe tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1482 microversion: 2.25 time: 0.994889 Oct 12 22:08:14.365808 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1043/2294] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:13 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1482 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:14.371496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-15ba3181-2ef0-49d8-9412-b8f9fa7c2efb tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:14.372327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-15ba3181-2ef0-49d8-9412-b8f9fa7c2efb tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:14.383394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15ba3181-2ef0-49d8-9412-b8f9fa7c2efb tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:14.384872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15ba3181-2ef0-49d8-9412-b8f9fa7c2efb tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:14.386161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15ba3181-2ef0-49d8-9412-b8f9fa7c2efb tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:14.387132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15ba3181-2ef0-49d8-9412-b8f9fa7c2efb tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:14.389574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15ba3181-2ef0-49d8-9412-b8f9fa7c2efb tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:14.390861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15ba3181-2ef0-49d8-9412-b8f9fa7c2efb tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:14.513248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-01df60bc-26c8-49cb-85a1-a37807a0e506 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc7df27bf6f456581abff6e80ab4f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d943f8c0c934001b53032564fd00e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:14.525846 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-01df60bc-26c8-49cb-85a1-a37807a0e506 tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 200 len: 1427 microversion: 2.1 time: 0.212754 Oct 12 22:08:14.526967 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1252/2295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:14 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 1427 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:14.533024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-7f3005b2-539b-41d6-afb4-90e21d717ead req-819508e2-c409-49fa-ac99-6143a887c59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325466ea-d13d-4204-89f6-7c5deb99cd61", "name": "network-vif-deleted", "tag": "e81cfc4b-c2b5-45e3-9fb2-a58a934b6b9b"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:14.560403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7f3005b2-539b-41d6-afb4-90e21d717ead req-819508e2-c409-49fa-ac99-6143a887c59a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:14.560965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7f3005b2-539b-41d6-afb4-90e21d717ead req-819508e2-c409-49fa-ac99-6143a887c59a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:14.561310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7f3005b2-539b-41d6-afb4-90e21d717ead req-819508e2-c409-49fa-ac99-6143a887c59a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:14.607496 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-7f3005b2-539b-41d6-afb4-90e21d717ead req-819508e2-c409-49fa-ac99-6143a887c59a service nova] Creating event network-vif-deleted:e81cfc4b-c2b5-45e3-9fb2-a58a934b6b9b for instance 325466ea-d13d-4204-89f6-7c5deb99cd61 on n-h1-861111-1 Oct 12 22:08:14.622577 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-7f3005b2-539b-41d6-afb4-90e21d717ead req-819508e2-c409-49fa-ac99-6143a887c59a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090822 Oct 12 22:08:14.623689 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1253/2296] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:15.131567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-15ba3181-2ef0-49d8-9412-b8f9fa7c2efb tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:15.145301 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-15ba3181-2ef0-49d8-9412-b8f9fa7c2efb tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1396 microversion: 2.1 time: 0.777775 Oct 12 22:08:15.164988 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1044/2297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:14 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1396 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:15.315674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4d18e4b3-3dbd-4e8e-b0ba-fee702cc1ccd tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:15.316389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4d18e4b3-3dbd-4e8e-b0ba-fee702cc1ccd tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:15.338924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d18e4b3-3dbd-4e8e-b0ba-fee702cc1ccd tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:15.339558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d18e4b3-3dbd-4e8e-b0ba-fee702cc1ccd tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:15.340853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d18e4b3-3dbd-4e8e-b0ba-fee702cc1ccd tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:15.345756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d18e4b3-3dbd-4e8e-b0ba-fee702cc1ccd tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:15.346787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d18e4b3-3dbd-4e8e-b0ba-fee702cc1ccd tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:15.347576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d18e4b3-3dbd-4e8e-b0ba-fee702cc1ccd tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:15.394549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b6e970ee-31d0-48a5-a537-c021c9aa73d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:15.395543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b6e970ee-31d0-48a5-a537-c021c9aa73d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:15.409665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6e970ee-31d0-48a5-a537-c021c9aa73d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:15.410022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6e970ee-31d0-48a5-a537-c021c9aa73d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:15.410779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6e970ee-31d0-48a5-a537-c021c9aa73d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:15.411841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6e970ee-31d0-48a5-a537-c021c9aa73d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:15.413971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6e970ee-31d0-48a5-a537-c021c9aa73d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:15.416467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6e970ee-31d0-48a5-a537-c021c9aa73d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:15.773432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4d18e4b3-3dbd-4e8e-b0ba-fee702cc1ccd tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:15.785597 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4d18e4b3-3dbd-4e8e-b0ba-fee702cc1ccd tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1316 microversion: 2.1 time: 0.474290 Oct 12 22:08:15.786195 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1254/2298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:15 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:15.800743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b6e970ee-31d0-48a5-a537-c021c9aa73d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:15.816766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-2bf017c3-ca8b-45f9-9fc1-c9cb8aae994b req-2d102a31-7f12-4258-86be-23826ce153e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1c142a-8d11-4578-a840-84ed39f0e1f4", "tag": "e1f32865-68ef-4c76-b641-079a9412068c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:15.817668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b6e970ee-31d0-48a5-a537-c021c9aa73d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:15.819465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b6e970ee-31d0-48a5-a537-c021c9aa73d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:15.823994 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b6e970ee-31d0-48a5-a537-c021c9aa73d7 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1266 microversion: 2.25 time: 0.433861 Oct 12 22:08:15.831099 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1045/2299] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:15 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1266 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:08:15.838475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-22dd07d8-1d27-4f6c-8657-57d90319186e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:15.839100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-22dd07d8-1d27-4f6c-8657-57d90319186e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] [instance: adec1006-780c-4fe7-871a-e4f7addfe159] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:15.853299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2bf017c3-ca8b-45f9-9fc1-c9cb8aae994b req-2d102a31-7f12-4258-86be-23826ce153e2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:15.854038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2bf017c3-ca8b-45f9-9fc1-c9cb8aae994b req-2d102a31-7f12-4258-86be-23826ce153e2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:15.854646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2bf017c3-ca8b-45f9-9fc1-c9cb8aae994b req-2d102a31-7f12-4258-86be-23826ce153e2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:15.868075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22dd07d8-1d27-4f6c-8657-57d90319186e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:15.868824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22dd07d8-1d27-4f6c-8657-57d90319186e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:15.869481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22dd07d8-1d27-4f6c-8657-57d90319186e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:15.876163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22dd07d8-1d27-4f6c-8657-57d90319186e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:15.876991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22dd07d8-1d27-4f6c-8657-57d90319186e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:15.877584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22dd07d8-1d27-4f6c-8657-57d90319186e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:15.878876 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-2bf017c3-ca8b-45f9-9fc1-c9cb8aae994b req-2d102a31-7f12-4258-86be-23826ce153e2 service nova] Creating event network-changed:e1f32865-68ef-4c76-b641-079a9412068c for instance af1c142a-8d11-4578-a840-84ed39f0e1f4 on n-h2-861111-1 Oct 12 22:08:15.893676 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-2bf017c3-ca8b-45f9-9fc1-c9cb8aae994b req-2d102a31-7f12-4258-86be-23826ce153e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106239 Oct 12 22:08:15.894829 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1255/2300] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:15.916684 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-22dd07d8-1d27-4f6c-8657-57d90319186e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] HTTP exception thrown: Instance adec1006-780c-4fe7-871a-e4f7addfe159 could not be found. Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-22dd07d8-1d27-4f6c-8657-57d90319186e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Request method failure captured: Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 HTTP/1.1 Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzlvk8Zf5YMjK78ehwua-VIp9tTEWatKA_MwoBx1A7nZ1jO8nGeK8kIboYB3nTbSWwYSvd7WDTRzOrvcfJnVCrHEawKN0Ex4PqqKTBPc7KUF441v6xgLwZCrBOH5r7xr8B7W31weCRXkIKg51P_759AClf1ZN4y-HST82G9fLe0WJA8 Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 7d943f8c0c934001b53032564fd00e11 Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-MigrationsAdminTest-40857002 Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d943f8c0c934001b53032564fd00e11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d943f8c0c934001b53032564fd00e11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d943f8c0c934001b53032564fd00e11", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d943f8c0c934001b53032564fd00e11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-MigrationsAdminTest-40857002 Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 7d943f8c0c934001b53032564fd00e11 Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-MigrationsAdminTest-40857002 Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-MigrationsAdminTest-40857002-project Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: cfc7df27bf6f456581abff6e80ab4f64 Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-MigrationsAdminTest-40857002-project Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance adec1006-780c-4fe7-871a-e4f7addfe159 could not be found. Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'adec1006-780c-4fe7-871a-e4f7addfe159'} Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adec1006-780c-4fe7-871a-e4f7addfe159 could not be found. Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adec1006-780c-4fe7-871a-e4f7addfe159 could not be found. Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:15.918257 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:15.921633 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:15.921633 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:15.921633 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:15.921633 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:15.921633 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:15.921633 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adec1006-780c-4fe7-871a-e4f7addfe159 could not be found. Oct 12 22:08:15.921633 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:15.923119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-22dd07d8-1d27-4f6c-8657-57d90319186e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] Returning 404 to user: Instance adec1006-780c-4fe7-871a-e4f7addfe159 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:15.924030 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-22dd07d8-1d27-4f6c-8657-57d90319186e tempest-MigrationsAdminTest-40857002 tempest-MigrationsAdminTest-40857002-project] 10.222.0.16 "GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159" status: 404 len: 111 microversion: 2.1 time: 0.089764 Oct 12 22:08:15.927880 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1046/2301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:15 2022] GET /compute/v2.1/servers/adec1006-780c-4fe7-871a-e4f7addfe159 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:08:16.173564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-50a3f8d4-a147-49d3-81b2-f79cf03fe5a3 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:16.174905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-50a3f8d4-a147-49d3-81b2-f79cf03fe5a3 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:16.188908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50a3f8d4-a147-49d3-81b2-f79cf03fe5a3 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:16.189616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50a3f8d4-a147-49d3-81b2-f79cf03fe5a3 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:16.191017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50a3f8d4-a147-49d3-81b2-f79cf03fe5a3 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:16.193929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50a3f8d4-a147-49d3-81b2-f79cf03fe5a3 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:16.194608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50a3f8d4-a147-49d3-81b2-f79cf03fe5a3 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:16.199679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50a3f8d4-a147-49d3-81b2-f79cf03fe5a3 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:16.535228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-50a3f8d4-a147-49d3-81b2-f79cf03fe5a3 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:16.559350 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-50a3f8d4-a147-49d3-81b2-f79cf03fe5a3 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1396 microversion: 2.1 time: 0.389826 Oct 12 22:08:16.560024 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1256/2302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:16 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1396 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:16.659859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-73210d4e-d27b-4b76-9f9b-f359c6228398 req-61dc64bb-68ef-4ee1-a635-48bba20f1972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adec1006-780c-4fe7-871a-e4f7addfe159", "name": "network-vif-deleted", "tag": "1a376da9-7885-4d84-98d7-e6c54abdca11"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:16.669016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:16.671630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-73210d4e-d27b-4b76-9f9b-f359c6228398 req-61dc64bb-68ef-4ee1-a635-48bba20f1972 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:16.672109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-73210d4e-d27b-4b76-9f9b-f359c6228398 req-61dc64bb-68ef-4ee1-a635-48bba20f1972 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:16.672696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-73210d4e-d27b-4b76-9f9b-f359c6228398 req-61dc64bb-68ef-4ee1-a635-48bba20f1972 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:16.686135 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-73210d4e-d27b-4b76-9f9b-f359c6228398 req-61dc64bb-68ef-4ee1-a635-48bba20f1972 service nova] Creating event network-vif-deleted:1a376da9-7885-4d84-98d7-e6c54abdca11 for instance adec1006-780c-4fe7-871a-e4f7addfe159 on n-h2-861111-1 Oct 12 22:08:16.691761 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-73210d4e-d27b-4b76-9f9b-f359c6228398 req-61dc64bb-68ef-4ee1-a635-48bba20f1972 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035684 Oct 12 22:08:16.692557 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1047/2303] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:16.813083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-86ac05aa-6ca7-4f7f-9274-60beedf24456 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:16.814629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-86ac05aa-6ca7-4f7f-9274-60beedf24456 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:16.834661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86ac05aa-6ca7-4f7f-9274-60beedf24456 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:16.836082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86ac05aa-6ca7-4f7f-9274-60beedf24456 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:16.838404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86ac05aa-6ca7-4f7f-9274-60beedf24456 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:16.839280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86ac05aa-6ca7-4f7f-9274-60beedf24456 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:16.839809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86ac05aa-6ca7-4f7f-9274-60beedf24456 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:16.840259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86ac05aa-6ca7-4f7f-9274-60beedf24456 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:16.879346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-91a92776-732a-44a7-ade0-fb988c3f6ab9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:16.882582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-91a92776-732a-44a7-ade0-fb988c3f6ab9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:16.917747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91a92776-732a-44a7-ade0-fb988c3f6ab9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:16.919249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91a92776-732a-44a7-ade0-fb988c3f6ab9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:16.920213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91a92776-732a-44a7-ade0-fb988c3f6ab9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:16.920946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91a92776-732a-44a7-ade0-fb988c3f6ab9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:16.928805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91a92776-732a-44a7-ade0-fb988c3f6ab9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:16.932116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91a92776-732a-44a7-ade0-fb988c3f6ab9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:17.158352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-86ac05aa-6ca7-4f7f-9274-60beedf24456 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:17.159385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-91a92776-732a-44a7-ade0-fb988c3f6ab9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:17.168797 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-86ac05aa-6ca7-4f7f-9274-60beedf24456 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1505 microversion: 2.1 time: 0.361831 Oct 12 22:08:17.170839 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1257/2304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:16 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1505 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:17.179610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-91a92776-732a-44a7-ade0-fb988c3f6ab9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:17.183384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-91a92776-732a-44a7-ade0-fb988c3f6ab9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:17.188087 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-91a92776-732a-44a7-ade0-fb988c3f6ab9 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1266 microversion: 2.25 time: 0.334161 Oct 12 22:08:17.189465 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1048/2305] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:16 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:17.197451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-89c95828-e786-4a36-a868-74f0cd02913b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:17.198275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-89c95828-e786-4a36-a868-74f0cd02913b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:17.212650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89c95828-e786-4a36-a868-74f0cd02913b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:17.213642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89c95828-e786-4a36-a868-74f0cd02913b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:17.218400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89c95828-e786-4a36-a868-74f0cd02913b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:17.220356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89c95828-e786-4a36-a868-74f0cd02913b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:17.221162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89c95828-e786-4a36-a868-74f0cd02913b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:17.223572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89c95828-e786-4a36-a868-74f0cd02913b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:17.262592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-89c95828-e786-4a36-a868-74f0cd02913b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:08:17.353359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:17.411618 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-89c95828-e786-4a36-a868-74f0cd02913b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 204 len: 0 microversion: 2.1 time: 0.219241 Oct 12 22:08:17.412557 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1258/2306] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:08:17 2022] DELETE /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:08:17.424579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d30ca482-e976-4b21-87b4-e54593f3ca23 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:17.425713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d30ca482-e976-4b21-87b4-e54593f3ca23 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:17.437579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d30ca482-e976-4b21-87b4-e54593f3ca23 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:17.438028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d30ca482-e976-4b21-87b4-e54593f3ca23 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:17.439108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d30ca482-e976-4b21-87b4-e54593f3ca23 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:17.440575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d30ca482-e976-4b21-87b4-e54593f3ca23 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:17.441240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d30ca482-e976-4b21-87b4-e54593f3ca23 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:17.441886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d30ca482-e976-4b21-87b4-e54593f3ca23 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:17.588181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b5e85769-c86d-4b39-930d-f313f5bc3ea7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:17.589451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b5e85769-c86d-4b39-930d-f313f5bc3ea7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:17.604299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5e85769-c86d-4b39-930d-f313f5bc3ea7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:17.605532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5e85769-c86d-4b39-930d-f313f5bc3ea7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:17.607802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5e85769-c86d-4b39-930d-f313f5bc3ea7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:17.610173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5e85769-c86d-4b39-930d-f313f5bc3ea7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:17.610787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5e85769-c86d-4b39-930d-f313f5bc3ea7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:17.613339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5e85769-c86d-4b39-930d-f313f5bc3ea7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:17.827760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d30ca482-e976-4b21-87b4-e54593f3ca23 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:17.842175 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d30ca482-e976-4b21-87b4-e54593f3ca23 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1511 microversion: 2.1 time: 0.422901 Oct 12 22:08:17.860938 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1049/2307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:17 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1511 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:08:17.915721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b5e85769-c86d-4b39-930d-f313f5bc3ea7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:17.927928 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b5e85769-c86d-4b39-930d-f313f5bc3ea7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1396 microversion: 2.1 time: 0.344898 Oct 12 22:08:17.931549 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1259/2308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:17 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1396 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:08:18.220865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ac4b83a7-3514-4b48-8fda-c77aebfc8ace tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:18.221558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ac4b83a7-3514-4b48-8fda-c77aebfc8ace tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:18.233597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac4b83a7-3514-4b48-8fda-c77aebfc8ace tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:18.237423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac4b83a7-3514-4b48-8fda-c77aebfc8ace tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:18.238016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac4b83a7-3514-4b48-8fda-c77aebfc8ace tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:18.242042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac4b83a7-3514-4b48-8fda-c77aebfc8ace tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:18.242589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac4b83a7-3514-4b48-8fda-c77aebfc8ace tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:18.243036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac4b83a7-3514-4b48-8fda-c77aebfc8ace tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:18.364878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ac4b83a7-3514-4b48-8fda-c77aebfc8ace tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:18.386281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ac4b83a7-3514-4b48-8fda-c77aebfc8ace tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:18.393262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ac4b83a7-3514-4b48-8fda-c77aebfc8ace tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:18.398426 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ac4b83a7-3514-4b48-8fda-c77aebfc8ace tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1266 microversion: 2.25 time: 0.180389 Oct 12 22:08:18.402253 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1050/2309] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:18 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:18.881190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fc3609d3-52da-4410-8d81-619835f43916 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:18.881805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fc3609d3-52da-4410-8d81-619835f43916 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:18.907104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc3609d3-52da-4410-8d81-619835f43916 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:18.907743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc3609d3-52da-4410-8d81-619835f43916 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:18.908189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc3609d3-52da-4410-8d81-619835f43916 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:18.908932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc3609d3-52da-4410-8d81-619835f43916 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:18.909385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc3609d3-52da-4410-8d81-619835f43916 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:18.909804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc3609d3-52da-4410-8d81-619835f43916 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:18.949920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:18.955274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-50af9238-58a8-4af9-8536-e2c740a5f379 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:18.955957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-50af9238-58a8-4af9-8536-e2c740a5f379 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:18.983402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50af9238-58a8-4af9-8536-e2c740a5f379 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:18.983814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50af9238-58a8-4af9-8536-e2c740a5f379 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:18.984257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50af9238-58a8-4af9-8536-e2c740a5f379 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:18.984976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50af9238-58a8-4af9-8536-e2c740a5f379 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:18.985428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50af9238-58a8-4af9-8536-e2c740a5f379 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:18.985851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50af9238-58a8-4af9-8536-e2c740a5f379 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:19.115340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=12 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:19.671029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-50af9238-58a8-4af9-8536-e2c740a5f379 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:19.681889 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-50af9238-58a8-4af9-8536-e2c740a5f379 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1396 microversion: 2.1 time: 0.732375 Oct 12 22:08:19.682889 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1051/2310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:18 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1396 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:19.691668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3d4386ab-98e1-46db-8640-a9830aaee411 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:19.692492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3d4386ab-98e1-46db-8640-a9830aaee411 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:19.722365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d4386ab-98e1-46db-8640-a9830aaee411 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:19.724341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d4386ab-98e1-46db-8640-a9830aaee411 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:19.725582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d4386ab-98e1-46db-8640-a9830aaee411 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:19.726488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d4386ab-98e1-46db-8640-a9830aaee411 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:19.730067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d4386ab-98e1-46db-8640-a9830aaee411 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:19.732074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d4386ab-98e1-46db-8640-a9830aaee411 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:19.754909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fc3609d3-52da-4410-8d81-619835f43916 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:19.768407 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fc3609d3-52da-4410-8d81-619835f43916 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1511 microversion: 2.1 time: 0.892410 Oct 12 22:08:19.785680 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1260/2311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:18 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1511 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:19.993944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3d4386ab-98e1-46db-8640-a9830aaee411 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:20.017752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-6ae02ccf-74b2-4961-8800-00329499bf92 req-1f4c36ea-37d4-4c90-a175-fe0a54a09430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c689a6f-3eaf-4ca1-ac49-169512ccf758", "name": "network-vif-deleted", "tag": "90217945-8054-4c54-ae66-098ddce4d83f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:20.020454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3d4386ab-98e1-46db-8640-a9830aaee411 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:20.028043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3d4386ab-98e1-46db-8640-a9830aaee411 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:20.029296 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3d4386ab-98e1-46db-8640-a9830aaee411 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1266 microversion: 2.25 time: 0.344431 Oct 12 22:08:20.045859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6ae02ccf-74b2-4961-8800-00329499bf92 req-1f4c36ea-37d4-4c90-a175-fe0a54a09430 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:20.049491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6ae02ccf-74b2-4961-8800-00329499bf92 req-1f4c36ea-37d4-4c90-a175-fe0a54a09430 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:20.049725 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1052/2312] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:19 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1266 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:20.051144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6ae02ccf-74b2-4961-8800-00329499bf92 req-1f4c36ea-37d4-4c90-a175-fe0a54a09430 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:20.096592 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6ae02ccf-74b2-4961-8800-00329499bf92 req-1f4c36ea-37d4-4c90-a175-fe0a54a09430 service nova] Creating event network-vif-deleted:90217945-8054-4c54-ae66-098ddce4d83f for instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 on n-h1-861111-1 Oct 12 22:08:20.111007 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-6ae02ccf-74b2-4961-8800-00329499bf92 req-1f4c36ea-37d4-4c90-a175-fe0a54a09430 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096499 Oct 12 22:08:20.113957 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1261/2313] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:08:20.714317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-58ca0065-5dd3-4533-a30e-401418c1f478 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:20.714937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-58ca0065-5dd3-4533-a30e-401418c1f478 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:20.732923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58ca0065-5dd3-4533-a30e-401418c1f478 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:20.733421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58ca0065-5dd3-4533-a30e-401418c1f478 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:20.736386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58ca0065-5dd3-4533-a30e-401418c1f478 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:20.738231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58ca0065-5dd3-4533-a30e-401418c1f478 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:20.738725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58ca0065-5dd3-4533-a30e-401418c1f478 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:20.739171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58ca0065-5dd3-4533-a30e-401418c1f478 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:20.793662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-325b7eaf-bc0b-4b0a-baa8-cebd6ffec94b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:20.795579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-325b7eaf-bc0b-4b0a-baa8-cebd6ffec94b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:20.805292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-325b7eaf-bc0b-4b0a-baa8-cebd6ffec94b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:20.830033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-325b7eaf-bc0b-4b0a-baa8-cebd6ffec94b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:20.837216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-325b7eaf-bc0b-4b0a-baa8-cebd6ffec94b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:20.842454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-325b7eaf-bc0b-4b0a-baa8-cebd6ffec94b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:20.843141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-325b7eaf-bc0b-4b0a-baa8-cebd6ffec94b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:20.843787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-325b7eaf-bc0b-4b0a-baa8-cebd6ffec94b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:20.931089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-325b7eaf-bc0b-4b0a-baa8-cebd6ffec94b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:20.931598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-325b7eaf-bc0b-4b0a-baa8-cebd6ffec94b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:20.939629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-325b7eaf-bc0b-4b0a-baa8-cebd6ffec94b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:20.940622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-325b7eaf-bc0b-4b0a-baa8-cebd6ffec94b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lazy-loading 'fault' on Instance uuid 8c689a6f-3eaf-4ca1-ac49-169512ccf758 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:08:21.082308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-325b7eaf-bc0b-4b0a-baa8-cebd6ffec94b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e63a35645469587551965e247f103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c802d3b49b42dfb9c18989fcdea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:21.097622 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-325b7eaf-bc0b-4b0a-baa8-cebd6ffec94b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 200 len: 1306 microversion: 2.1 time: 0.303186 Oct 12 22:08:21.115842 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1262/2314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:20 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 1306 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:08:21.127264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-062b02f3-a4de-46db-8b0e-eb3760423523 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:21.129365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-062b02f3-a4de-46db-8b0e-eb3760423523 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:21.140728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-062b02f3-a4de-46db-8b0e-eb3760423523 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:21.141711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-062b02f3-a4de-46db-8b0e-eb3760423523 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:21.145741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-062b02f3-a4de-46db-8b0e-eb3760423523 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:21.146766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-062b02f3-a4de-46db-8b0e-eb3760423523 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:21.147377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-062b02f3-a4de-46db-8b0e-eb3760423523 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:21.151539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-062b02f3-a4de-46db-8b0e-eb3760423523 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:21.221192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-58ca0065-5dd3-4533-a30e-401418c1f478 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:21.238098 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-58ca0065-5dd3-4533-a30e-401418c1f478 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1396 microversion: 2.1 time: 0.527646 Oct 12 22:08:21.251264 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1053/2315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:20 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1396 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:21.434606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4c302410-ada7-4caa-b9b1-92220f70d5ce tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-505623879", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": "none"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:21.498618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-4c302410-ada7-4caa-b9b1-92220f70d5ce tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:08:21.499465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-4c302410-ada7-4caa-b9b1-92220f70d5ce tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:08:21.500119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-4c302410-ada7-4caa-b9b1-92220f70d5ce tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:08:21.500740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-4c302410-ada7-4caa-b9b1-92220f70d5ce tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:08:21.501418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-4c302410-ada7-4caa-b9b1-92220f70d5ce tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:08:21.510905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c302410-ada7-4caa-b9b1-92220f70d5ce tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:21.511677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c302410-ada7-4caa-b9b1-92220f70d5ce tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:21.512321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c302410-ada7-4caa-b9b1-92220f70d5ce tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:21.513274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c302410-ada7-4caa-b9b1-92220f70d5ce tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:21.513902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c302410-ada7-4caa-b9b1-92220f70d5ce tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:21.514505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c302410-ada7-4caa-b9b1-92220f70d5ce tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:21.535978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-4c302410-ada7-4caa-b9b1-92220f70d5ce tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Getting quotas for project 4d8d170d367448498af225c015d06295. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:08:21.543311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-4c302410-ada7-4caa-b9b1-92220f70d5ce tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Getting quotas for user e4212d46a7b94dc08e7ddbb470ab3421 and project 4d8d170d367448498af225c015d06295. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:08:21.558748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4c302410-ada7-4caa-b9b1-92220f70d5ce tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:08:21.561829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4c302410-ada7-4caa-b9b1-92220f70d5ce tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:08:21.618125 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4c302410-ada7-4caa-b9b1-92220f70d5ce tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.377644 Oct 12 22:08:21.619030 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1054/2316] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 22:08:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 379 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:08:21.632788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2a5a1c5e-787f-4b73-8d50-a42cea4d1890 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:21.632788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2a5a1c5e-787f-4b73-8d50-a42cea4d1890 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:21.685571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-062b02f3-a4de-46db-8b0e-eb3760423523 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:21.695670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-062b02f3-a4de-46db-8b0e-eb3760423523 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:21.701704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-062b02f3-a4de-46db-8b0e-eb3760423523 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:21.706786 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-062b02f3-a4de-46db-8b0e-eb3760423523 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1266 microversion: 2.25 time: 0.589578 Oct 12 22:08:21.707559 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1263/2317] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:21 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1266 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:21.743826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2a5a1c5e-787f-4b73-8d50-a42cea4d1890 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:21.753736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2a5a1c5e-787f-4b73-8d50-a42cea4d1890 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:21.761383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2a5a1c5e-787f-4b73-8d50-a42cea4d1890 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:21.772875 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2a5a1c5e-787f-4b73-8d50-a42cea4d1890 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1452 microversion: 2.91 time: 0.145720 Oct 12 22:08:21.775826 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1055/2318] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:21 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:22.126409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-943c3325-c987-4b0a-a334-46894fa58bdf tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:22.127660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-943c3325-c987-4b0a-a334-46894fa58bdf tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:22.139605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-943c3325-c987-4b0a-a334-46894fa58bdf tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:22.140325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-943c3325-c987-4b0a-a334-46894fa58bdf tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:22.140913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-943c3325-c987-4b0a-a334-46894fa58bdf tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:22.141887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-943c3325-c987-4b0a-a334-46894fa58bdf tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:22.142488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-943c3325-c987-4b0a-a334-46894fa58bdf tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:22.143228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-943c3325-c987-4b0a-a334-46894fa58bdf tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:22.160583 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-943c3325-c987-4b0a-a334-46894fa58bdf tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] HTTP exception thrown: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-943c3325-c987-4b0a-a334-46894fa58bdf tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Request method failure captured: Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 HTTP/1.1 Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzq2-lJ_JU8Ua2ATypbQnSJiZrkPPSpvQRh17jWj99IAtcdwDtLcoKX1EK4vRP_PzqeE0cHABZuUTXv4FTkhollxzIC-BVcyl34MSEtepRh2lKOTHZdh26aN37TRWdsVJeUyYRCegeYq5sRyouyBOebZJwO1j7AzERwISan-kAGUjq0 Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: c6c802d3b49b42dfb9c18989fcdea236 Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c6c802d3b49b42dfb9c18989fcdea236", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: c6c802d3b49b42dfb9c18989fcdea236 Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesNegativeTestJSON-1413122619-project Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6c3e63a35645469587551965e247f103 Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesNegativeTestJSON-1413122619-project Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '8c689a6f-3eaf-4ca1-ac49-169512ccf758'} Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:22.162793 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.166688 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.166688 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:22.166688 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:22.166688 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:22.166688 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:22.166688 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.166688 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.168172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-943c3325-c987-4b0a-a334-46894fa58bdf tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Returning 404 to user: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:22.169359 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-943c3325-c987-4b0a-a334-46894fa58bdf tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 404 len: 111 microversion: 2.1 time: 0.050710 Oct 12 22:08:22.170715 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1264/2319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:22 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:08:22.182281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-20838d56-6235-455e-8b06-b6a82f7a1c51 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1458308960", "metadata": {"image_type": "test"}}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:22.187445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-20838d56-6235-455e-8b06-b6a82f7a1c51 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:22.203434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20838d56-6235-455e-8b06-b6a82f7a1c51 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:22.203928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20838d56-6235-455e-8b06-b6a82f7a1c51 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:22.204574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20838d56-6235-455e-8b06-b6a82f7a1c51 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:22.205446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20838d56-6235-455e-8b06-b6a82f7a1c51 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:22.206051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20838d56-6235-455e-8b06-b6a82f7a1c51 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:22.206674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20838d56-6235-455e-8b06-b6a82f7a1c51 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:22.237537 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-20838d56-6235-455e-8b06-b6a82f7a1c51 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] HTTP exception thrown: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-20838d56-6235-455e-8b06-b6a82f7a1c51 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Request method failure captured: Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758/action HTTP/1.1 Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 112 Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzq2-lJ_JU8Ua2ATypbQnSJiZrkPPSpvQRh17jWj99IAtcdwDtLcoKX1EK4vRP_PzqeE0cHABZuUTXv4FTkhollxzIC-BVcyl34MSEtepRh2lKOTHZdh26aN37TRWdsVJeUyYRCegeYq5sRyouyBOebZJwO1j7AzERwISan-kAGUjq0 Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: c6c802d3b49b42dfb9c18989fcdea236 Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c6c802d3b49b42dfb9c18989fcdea236", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: c6c802d3b49b42dfb9c18989fcdea236 Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ImagesNegativeTestJSON-1413122619-project Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 6c3e63a35645469587551965e247f103 Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ImagesNegativeTestJSON-1413122619-project Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1458308960", "metadata": {"image_type": "test"}}} Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '8c689a6f-3eaf-4ca1-ac49-169512ccf758', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1458308960', 'metadata': {'image_type': 'test'}}}} Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 12 22:08:22.240475 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 22:08:22.243846 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:22.243846 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:22.243846 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:22.243846 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:22.243846 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.243846 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.243846 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:22.243846 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.243846 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.243846 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:22.243846 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:22.243846 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:22.243846 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:22.243846 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.243846 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.246457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-20838d56-6235-455e-8b06-b6a82f7a1c51 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Returning 404 to user: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:22.248223 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-20838d56-6235-455e-8b06-b6a82f7a1c51 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "POST /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758/action" status: 404 len: 111 microversion: 2.1 time: 0.072298 Oct 12 22:08:22.249382 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1056/2320] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Oct 12 22:08:22 2022] POST /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:08:22.262366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-56d485e8-53da-48bb-8fcf-dbe2aac94586 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1211523800", "metadata": {"image_type": "test"}}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:22.266214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3c2542ac-42b1-4f1d-9a99-d36f1545a7b9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:22.267137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-56d485e8-53da-48bb-8fcf-dbe2aac94586 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Failed to fetch instance by id tempest-invalid-2039495019 {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 22:08:22.267800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3c2542ac-42b1-4f1d-9a99-d36f1545a7b9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:22.267925 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-56d485e8-53da-48bb-8fcf-dbe2aac94586 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] HTTP exception thrown: Instance tempest-invalid-2039495019 could not be found. Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-56d485e8-53da-48bb-8fcf-dbe2aac94586 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Request method failure captured: Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/tempest-invalid-2039495019/action HTTP/1.1 Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 112 Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzq2-lJ_JU8Ua2ATypbQnSJiZrkPPSpvQRh17jWj99IAtcdwDtLcoKX1EK4vRP_PzqeE0cHABZuUTXv4FTkhollxzIC-BVcyl34MSEtepRh2lKOTHZdh26aN37TRWdsVJeUyYRCegeYq5sRyouyBOebZJwO1j7AzERwISan-kAGUjq0 Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: c6c802d3b49b42dfb9c18989fcdea236 Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c6c802d3b49b42dfb9c18989fcdea236", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: c6c802d3b49b42dfb9c18989fcdea236 Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesNegativeTestJSON-1413122619-project Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6c3e63a35645469587551965e247f103 Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesNegativeTestJSON-1413122619-project Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1211523800", "metadata": {"image_type": "test"}}} Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance tempest-invalid-2039495019 could not be found. Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'tempest-invalid-2039495019', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1211523800', 'metadata': {'image_type': 'test'}}}} Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-2039495019 could not be found. Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:22.271000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-2039495019 could not be found. Oct 12 22:08:22.275579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.275579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:22.275579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.275579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.275579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:22.275579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:22.275579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:22.275579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:22.275579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-2039495019 could not be found. Oct 12 22:08:22.275579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.275579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-56d485e8-53da-48bb-8fcf-dbe2aac94586 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Returning 404 to user: Instance tempest-invalid-2039495019 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:22.277795 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-56d485e8-53da-48bb-8fcf-dbe2aac94586 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "POST /compute/v2.1/servers/tempest-invalid-2039495019/action" status: 404 len: 101 microversion: 2.1 time: 0.020008 Oct 12 22:08:22.280866 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1265/2321] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 12 22:08:22 2022] POST /compute/v2.1/servers/tempest-invalid-2039495019/action => generated 101 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:08:22.287290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c2542ac-42b1-4f1d-9a99-d36f1545a7b9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:22.288175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c2542ac-42b1-4f1d-9a99-d36f1545a7b9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:22.288978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c2542ac-42b1-4f1d-9a99-d36f1545a7b9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:22.290565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c2542ac-42b1-4f1d-9a99-d36f1545a7b9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:22.293385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c2542ac-42b1-4f1d-9a99-d36f1545a7b9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:22.294282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c2542ac-42b1-4f1d-9a99-d36f1545a7b9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:22.304166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b447086f-00b3-44ea-a12e-4e1720f8d741 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1589579918"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:22.314874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b447086f-00b3-44ea-a12e-4e1720f8d741 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 22:08:22.315680 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-b447086f-00b3-44ea-a12e-4e1720f8d741 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b447086f-00b3-44ea-a12e-4e1720f8d741 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Request method failure captured: Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 57 Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzq2-lJ_JU8Ua2ATypbQnSJiZrkPPSpvQRh17jWj99IAtcdwDtLcoKX1EK4vRP_PzqeE0cHABZuUTXv4FTkhollxzIC-BVcyl34MSEtepRh2lKOTHZdh26aN37TRWdsVJeUyYRCegeYq5sRyouyBOebZJwO1j7AzERwISan-kAGUjq0 Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: c6c802d3b49b42dfb9c18989fcdea236 Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c6c802d3b49b42dfb9c18989fcdea236", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: c6c802d3b49b42dfb9c18989fcdea236 Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesNegativeTestJSON-1413122619-project Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6c3e63a35645469587551965e247f103 Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesNegativeTestJSON-1413122619-project Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: {"createImage": {"name": "tempest-test-snap-1589579918"}} Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1589579918'}}} Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:08:22.320783 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.326709 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:22.326709 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.326709 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.326709 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:22.326709 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:22.326709 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:22.326709 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:22.326709 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:08:22.326709 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.340639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b447086f-00b3-44ea-a12e-4e1720f8d741 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:22.343700 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b447086f-00b3-44ea-a12e-4e1720f8d741 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.057744 Oct 12 22:08:22.348508 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1266/2322] 10.222.0.16 () {60 vars in 1275 bytes} [Wed Oct 12 22:08:22 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:08:22.360255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aeda988a-51e0-4e01-a409-f62102f40e25 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1319246236"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:22.371119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aeda988a-51e0-4e01-a409-f62102f40e25 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 22:08:22.371662 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-aeda988a-51e0-4e01-a409-f62102f40e25 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aeda988a-51e0-4e01-a409-f62102f40e25 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Request method failure captured: Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 57 Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzq2-lJ_JU8Ua2ATypbQnSJiZrkPPSpvQRh17jWj99IAtcdwDtLcoKX1EK4vRP_PzqeE0cHABZuUTXv4FTkhollxzIC-BVcyl34MSEtepRh2lKOTHZdh26aN37TRWdsVJeUyYRCegeYq5sRyouyBOebZJwO1j7AzERwISan-kAGUjq0 Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: c6c802d3b49b42dfb9c18989fcdea236 Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c6c802d3b49b42dfb9c18989fcdea236", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: c6c802d3b49b42dfb9c18989fcdea236 Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesNegativeTestJSON-1413122619-project Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6c3e63a35645469587551965e247f103 Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesNegativeTestJSON-1413122619-project Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: {"createImage": {"name": "tempest-test-snap-1319246236"}} Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1319246236'}}} Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:08:22.379078 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.382355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:22.382355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.382355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.382355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:22.382355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:22.382355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:22.382355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:22.382355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:08:22.382355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.382355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aeda988a-51e0-4e01-a409-f62102f40e25 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:22.382355 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aeda988a-51e0-4e01-a409-f62102f40e25 tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.025549 Oct 12 22:08:22.385820 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1267/2323] 10.222.0.16 () {60 vars in 1281 bytes} [Wed Oct 12 22:08:22 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:08:22.396473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8eb85c02-baee-41ea-8207-1e7b048551ce tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:22.396914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8eb85c02-baee-41ea-8207-1e7b048551ce tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:22.415783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:22.417256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8eb85c02-baee-41ea-8207-1e7b048551ce tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:22.417754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8eb85c02-baee-41ea-8207-1e7b048551ce tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:22.420338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8eb85c02-baee-41ea-8207-1e7b048551ce tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:22.421167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8eb85c02-baee-41ea-8207-1e7b048551ce tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:22.424007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8eb85c02-baee-41ea-8207-1e7b048551ce tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:22.424580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8eb85c02-baee-41ea-8207-1e7b048551ce tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:22.452098 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-8eb85c02-baee-41ea-8207-1e7b048551ce tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] HTTP exception thrown: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8eb85c02-baee-41ea-8207-1e7b048551ce tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Request method failure captured: Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 HTTP/1.1 Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzq2-lJ_JU8Ua2ATypbQnSJiZrkPPSpvQRh17jWj99IAtcdwDtLcoKX1EK4vRP_PzqeE0cHABZuUTXv4FTkhollxzIC-BVcyl34MSEtepRh2lKOTHZdh26aN37TRWdsVJeUyYRCegeYq5sRyouyBOebZJwO1j7AzERwISan-kAGUjq0 Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: c6c802d3b49b42dfb9c18989fcdea236 Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c6c802d3b49b42dfb9c18989fcdea236", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: c6c802d3b49b42dfb9c18989fcdea236 Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesNegativeTestJSON-1413122619-project Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6c3e63a35645469587551965e247f103 Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesNegativeTestJSON-1413122619-project Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '8c689a6f-3eaf-4ca1-ac49-169512ccf758'} Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:22.454059 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:22.457387 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.457387 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.457387 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:22.457387 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.457387 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.457387 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:22.457387 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:22.457387 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:22.457387 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:22.457387 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.457387 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.459434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8eb85c02-baee-41ea-8207-1e7b048551ce tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Returning 404 to user: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:22.460556 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8eb85c02-baee-41ea-8207-1e7b048551ce tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 404 len: 111 microversion: 2.1 time: 0.073695 Oct 12 22:08:22.461945 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1268/2324] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:08:22 2022] DELETE /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:08:22.470178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-47c9c48e-e886-47b8-9317-958521e9a84b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:22.472817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-47c9c48e-e886-47b8-9317-958521e9a84b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] [instance: 8c689a6f-3eaf-4ca1-ac49-169512ccf758] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:22.479987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47c9c48e-e886-47b8-9317-958521e9a84b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:22.480922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47c9c48e-e886-47b8-9317-958521e9a84b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:22.482121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47c9c48e-e886-47b8-9317-958521e9a84b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:22.483018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47c9c48e-e886-47b8-9317-958521e9a84b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:22.483732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47c9c48e-e886-47b8-9317-958521e9a84b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:22.484426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47c9c48e-e886-47b8-9317-958521e9a84b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:22.501207 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-47c9c48e-e886-47b8-9317-958521e9a84b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] HTTP exception thrown: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-47c9c48e-e886-47b8-9317-958521e9a84b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Request method failure captured: Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 HTTP/1.1 Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzq2-lJ_JU8Ua2ATypbQnSJiZrkPPSpvQRh17jWj99IAtcdwDtLcoKX1EK4vRP_PzqeE0cHABZuUTXv4FTkhollxzIC-BVcyl34MSEtepRh2lKOTHZdh26aN37TRWdsVJeUyYRCegeYq5sRyouyBOebZJwO1j7AzERwISan-kAGUjq0 Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: c6c802d3b49b42dfb9c18989fcdea236 Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c6c802d3b49b42dfb9c18989fcdea236", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c6c802d3b49b42dfb9c18989fcdea236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: c6c802d3b49b42dfb9c18989fcdea236 Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1413122619 Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesNegativeTestJSON-1413122619-project Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6c3e63a35645469587551965e247f103 Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesNegativeTestJSON-1413122619-project Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '8c689a6f-3eaf-4ca1-ac49-169512ccf758'} Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:22.503188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.506457 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:22.506457 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:22.506457 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:22.506457 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:22.506457 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:22.506457 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. Oct 12 22:08:22.506457 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:22.508348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-47c9c48e-e886-47b8-9317-958521e9a84b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] Returning 404 to user: Instance 8c689a6f-3eaf-4ca1-ac49-169512ccf758 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:22.509827 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-47c9c48e-e886-47b8-9317-958521e9a84b tempest-ImagesNegativeTestJSON-1413122619 tempest-ImagesNegativeTestJSON-1413122619-project] 10.222.0.16 "GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758" status: 404 len: 111 microversion: 2.1 time: 0.043712 Oct 12 22:08:22.511021 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1269/2325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:22 2022] GET /compute/v2.1/servers/8c689a6f-3eaf-4ca1-ac49-169512ccf758 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:08:22.738827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-34977a86-b5e9-41a2-bf80-3865086fc79d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:22.741199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-34977a86-b5e9-41a2-bf80-3865086fc79d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:22.758419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34977a86-b5e9-41a2-bf80-3865086fc79d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:22.776086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34977a86-b5e9-41a2-bf80-3865086fc79d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:22.776675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34977a86-b5e9-41a2-bf80-3865086fc79d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:22.777665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34977a86-b5e9-41a2-bf80-3865086fc79d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:22.781076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34977a86-b5e9-41a2-bf80-3865086fc79d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:22.790205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34977a86-b5e9-41a2-bf80-3865086fc79d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:22.886826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34977a86-b5e9-41a2-bf80-3865086fc79d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:22.887724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34977a86-b5e9-41a2-bf80-3865086fc79d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:22.899718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34977a86-b5e9-41a2-bf80-3865086fc79d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:22.902148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-34977a86-b5e9-41a2-bf80-3865086fc79d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lazy-loading 'fault' on Instance uuid 325466ea-d13d-4204-89f6-7c5deb99cd61 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:08:22.971637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-34977a86-b5e9-41a2-bf80-3865086fc79d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:22.988029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-34977a86-b5e9-41a2-bf80-3865086fc79d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:22.990332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-34977a86-b5e9-41a2-bf80-3865086fc79d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:22.992021 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-34977a86-b5e9-41a2-bf80-3865086fc79d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 200 len: 1271 microversion: 2.25 time: 0.260898 Oct 12 22:08:22.995584 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1270/2326] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:22 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 1271 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:08:23.005189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b44ffe70-920d-4ff3-9984-13f1a048a698 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:23.009041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b44ffe70-920d-4ff3-9984-13f1a048a698 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:23.024640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b44ffe70-920d-4ff3-9984-13f1a048a698 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:23.027541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b44ffe70-920d-4ff3-9984-13f1a048a698 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:23.028743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b44ffe70-920d-4ff3-9984-13f1a048a698 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:23.029717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b44ffe70-920d-4ff3-9984-13f1a048a698 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:23.030637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b44ffe70-920d-4ff3-9984-13f1a048a698 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:23.031305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b44ffe70-920d-4ff3-9984-13f1a048a698 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:23.120948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b44ffe70-920d-4ff3-9984-13f1a048a698 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:23.134976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b44ffe70-920d-4ff3-9984-13f1a048a698 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:23.139906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b44ffe70-920d-4ff3-9984-13f1a048a698 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:23.157146 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b44ffe70-920d-4ff3-9984-13f1a048a698 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1448 microversion: 2.91 time: 0.159696 Oct 12 22:08:23.158413 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1271/2327] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:22 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1448 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:23.210289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3c2542ac-42b1-4f1d-9a99-d36f1545a7b9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:23.222965 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3c2542ac-42b1-4f1d-9a99-d36f1545a7b9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1396 microversion: 2.1 time: 0.961884 Oct 12 22:08:23.240937 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1057/2328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:22 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1396 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:23.569703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-5e257bcb-b9b9-464a-a890-8ee3979e60a0 req-524e8bf0-2a19-496b-acb9-d3a09e2ad5ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1c142a-8d11-4578-a840-84ed39f0e1f4", "name": "network-vif-plugged", "status": "completed", "tag": "e1f32865-68ef-4c76-b641-079a9412068c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:23.608391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5e257bcb-b9b9-464a-a890-8ee3979e60a0 req-524e8bf0-2a19-496b-acb9-d3a09e2ad5ec service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:23.610174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5e257bcb-b9b9-464a-a890-8ee3979e60a0 req-524e8bf0-2a19-496b-acb9-d3a09e2ad5ec service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:23.610606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5e257bcb-b9b9-464a-a890-8ee3979e60a0 req-524e8bf0-2a19-496b-acb9-d3a09e2ad5ec service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:23.642474 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-5e257bcb-b9b9-464a-a890-8ee3979e60a0 req-524e8bf0-2a19-496b-acb9-d3a09e2ad5ec service nova] Creating event network-vif-plugged:e1f32865-68ef-4c76-b641-079a9412068c for instance af1c142a-8d11-4578-a840-84ed39f0e1f4 on n-h2-861111-1 Oct 12 22:08:23.651766 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-5e257bcb-b9b9-464a-a890-8ee3979e60a0 req-524e8bf0-2a19-496b-acb9-d3a09e2ad5ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086194 Oct 12 22:08:23.652571 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1272/2329] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:24.024758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c237850a-007a-4f56-8ba0-f863329e9209 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:24.025720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c237850a-007a-4f56-8ba0-f863329e9209 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 325466ea-d13d-4204-89f6-7c5deb99cd61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:24.036910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c237850a-007a-4f56-8ba0-f863329e9209 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:24.039868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c237850a-007a-4f56-8ba0-f863329e9209 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:24.040541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c237850a-007a-4f56-8ba0-f863329e9209 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:24.043569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c237850a-007a-4f56-8ba0-f863329e9209 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:24.044873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c237850a-007a-4f56-8ba0-f863329e9209 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:24.045531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c237850a-007a-4f56-8ba0-f863329e9209 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:24.077160 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-c237850a-007a-4f56-8ba0-f863329e9209 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] HTTP exception thrown: Instance 325466ea-d13d-4204-89f6-7c5deb99cd61 could not be found. Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c237850a-007a-4f56-8ba0-f863329e9209 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Request method failure captured: Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 HTTP/1.1 Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzkuITKNFODYF1KkcXnHuuWDLLP6rTmUKPX2JoOPqxgnmM59d3hA8u_uGVQOhxtImLS0RiSeXc5du75CWcsN6EL_bGLFOxwpmPYGqSibZsyxXwxep828aKg93B1dKyqDF1nxUm21YQEO_ZB7lue9VEXb7rz01tNRsYAdwMDWWZK_hJ0 Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-Openstack-Nova-Api-Version: 2.25 Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: beef77813aa641769eb3151b41b8e0cf Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-903197672 Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beef77813aa641769eb3151b41b8e0cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beef77813aa641769eb3151b41b8e0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_beef77813aa641769eb3151b41b8e0cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/beef77813aa641769eb3151b41b8e0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-903197672 Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: beef77813aa641769eb3151b41b8e0cf Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-903197672 Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-LiveAutoBlockMigrationV225Test-903197672-project Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 1c8822d55876445d91f5681781313ce9 Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-903197672-project Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 325466ea-d13d-4204-89f6-7c5deb99cd61 could not be found. Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '325466ea-d13d-4204-89f6-7c5deb99cd61'} Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 325466ea-d13d-4204-89f6-7c5deb99cd61 could not be found. Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 325466ea-d13d-4204-89f6-7c5deb99cd61 could not be found. Oct 12 22:08:24.085122 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:24.088821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:24.088821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:24.088821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:24.088821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:24.088821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:24.088821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:24.088821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:24.088821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 325466ea-d13d-4204-89f6-7c5deb99cd61 could not be found. Oct 12 22:08:24.088821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:24.090396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c237850a-007a-4f56-8ba0-f863329e9209 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Returning 404 to user: Instance 325466ea-d13d-4204-89f6-7c5deb99cd61 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:24.102269 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c237850a-007a-4f56-8ba0-f863329e9209 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61" status: 404 len: 111 microversion: 2.25 time: 0.070744 Oct 12 22:08:24.103456 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1058/2330] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:24 2022] GET /compute/v2.1/servers/325466ea-d13d-4204-89f6-7c5deb99cd61 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:08:24.194147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-32b755a6-2cce-46c5-bfb3-3ab35119341b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:24.200605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-32b755a6-2cce-46c5-bfb3-3ab35119341b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:24.229733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32b755a6-2cce-46c5-bfb3-3ab35119341b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:24.232918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32b755a6-2cce-46c5-bfb3-3ab35119341b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:24.235144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32b755a6-2cce-46c5-bfb3-3ab35119341b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:24.236127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32b755a6-2cce-46c5-bfb3-3ab35119341b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:24.237820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32b755a6-2cce-46c5-bfb3-3ab35119341b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:24.238271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32b755a6-2cce-46c5-bfb3-3ab35119341b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:24.250694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aa0dd4fa-6c65-4cb9-abac-3795814cf707 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:24.252024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-aa0dd4fa-6c65-4cb9-abac-3795814cf707 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:24.273725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa0dd4fa-6c65-4cb9-abac-3795814cf707 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:24.274387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa0dd4fa-6c65-4cb9-abac-3795814cf707 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:24.274941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa0dd4fa-6c65-4cb9-abac-3795814cf707 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:24.275937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa0dd4fa-6c65-4cb9-abac-3795814cf707 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:24.280101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa0dd4fa-6c65-4cb9-abac-3795814cf707 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:24.287949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa0dd4fa-6c65-4cb9-abac-3795814cf707 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:24.609912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-32b755a6-2cce-46c5-bfb3-3ab35119341b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:24.636115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-32b755a6-2cce-46c5-bfb3-3ab35119341b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:24.638139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-32b755a6-2cce-46c5-bfb3-3ab35119341b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:24.666987 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-32b755a6-2cce-46c5-bfb3-3ab35119341b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1510 microversion: 2.91 time: 0.484229 Oct 12 22:08:24.673198 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1273/2331] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:24 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1510 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:24.813397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-aa0dd4fa-6c65-4cb9-abac-3795814cf707 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:24.826369 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-aa0dd4fa-6c65-4cb9-abac-3795814cf707 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1396 microversion: 2.1 time: 0.582216 Oct 12 22:08:24.855615 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1059/2332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:24 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1396 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:25.697031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a3dfa19e-ca6f-47ad-bf64-f538b7bbfd56 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:25.698310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a3dfa19e-ca6f-47ad-bf64-f538b7bbfd56 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:25.713704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3dfa19e-ca6f-47ad-bf64-f538b7bbfd56 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:25.714538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3dfa19e-ca6f-47ad-bf64-f538b7bbfd56 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:25.716430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3dfa19e-ca6f-47ad-bf64-f538b7bbfd56 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:25.720121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3dfa19e-ca6f-47ad-bf64-f538b7bbfd56 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:25.720949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3dfa19e-ca6f-47ad-bf64-f538b7bbfd56 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:25.721759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3dfa19e-ca6f-47ad-bf64-f538b7bbfd56 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:25.850743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-17ddcc58-95e4-43ce-8377-00e1e82e7e82 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:25.851419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-17ddcc58-95e4-43ce-8377-00e1e82e7e82 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:25.865762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17ddcc58-95e4-43ce-8377-00e1e82e7e82 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:25.866262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17ddcc58-95e4-43ce-8377-00e1e82e7e82 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:25.869889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17ddcc58-95e4-43ce-8377-00e1e82e7e82 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:25.870820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17ddcc58-95e4-43ce-8377-00e1e82e7e82 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:25.871470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17ddcc58-95e4-43ce-8377-00e1e82e7e82 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:25.880196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17ddcc58-95e4-43ce-8377-00e1e82e7e82 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:26.045110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a3dfa19e-ca6f-47ad-bf64-f538b7bbfd56 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:26.060654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a3dfa19e-ca6f-47ad-bf64-f538b7bbfd56 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:26.067515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a3dfa19e-ca6f-47ad-bf64-f538b7bbfd56 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:26.077743 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a3dfa19e-ca6f-47ad-bf64-f538b7bbfd56 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1510 microversion: 2.91 time: 0.385238 Oct 12 22:08:26.096376 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1274/2333] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:25 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1510 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:26.258872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-17ddcc58-95e4-43ce-8377-00e1e82e7e82 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:26.267191 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-17ddcc58-95e4-43ce-8377-00e1e82e7e82 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1578 microversion: 2.1 time: 0.420518 Oct 12 22:08:26.270871 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1060/2334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:25 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1578 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:26.298696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-064ac618-5348-45ae-a037-7c28bec961e9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:26.299485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-064ac618-5348-45ae-a037-7c28bec961e9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:26.315649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-064ac618-5348-45ae-a037-7c28bec961e9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:26.319746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-064ac618-5348-45ae-a037-7c28bec961e9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:26.323014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-064ac618-5348-45ae-a037-7c28bec961e9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:26.324495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-064ac618-5348-45ae-a037-7c28bec961e9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:26.328455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-064ac618-5348-45ae-a037-7c28bec961e9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:26.333339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-064ac618-5348-45ae-a037-7c28bec961e9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:26.644726 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-064ac618-5348-45ae-a037-7c28bec961e9 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.355469 Oct 12 22:08:26.655924 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1275/2335] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:08:26 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4/os-interface => generated 285 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:27.114491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e23a3dda-bc48-40e4-90e1-46ec5501c8ca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:27.115967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e23a3dda-bc48-40e4-90e1-46ec5501c8ca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:27.135834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e23a3dda-bc48-40e4-90e1-46ec5501c8ca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:27.136586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e23a3dda-bc48-40e4-90e1-46ec5501c8ca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:27.137326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e23a3dda-bc48-40e4-90e1-46ec5501c8ca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:27.138256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e23a3dda-bc48-40e4-90e1-46ec5501c8ca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:27.138861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e23a3dda-bc48-40e4-90e1-46ec5501c8ca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:27.139479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e23a3dda-bc48-40e4-90e1-46ec5501c8ca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:27.443371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e23a3dda-bc48-40e4-90e1-46ec5501c8ca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:27.468940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e23a3dda-bc48-40e4-90e1-46ec5501c8ca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:27.476438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e23a3dda-bc48-40e4-90e1-46ec5501c8ca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:27.491657 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e23a3dda-bc48-40e4-90e1-46ec5501c8ca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1531 microversion: 2.91 time: 0.382780 Oct 12 22:08:27.492881 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1061/2336] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:27 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1531 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:08:27.642080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-29899b95-0e1b-42d0-b3df-4f8c32c04227 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:27.642705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-29899b95-0e1b-42d0-b3df-4f8c32c04227 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:27.653772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29899b95-0e1b-42d0-b3df-4f8c32c04227 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:27.654274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29899b95-0e1b-42d0-b3df-4f8c32c04227 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:27.654714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29899b95-0e1b-42d0-b3df-4f8c32c04227 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:27.655463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29899b95-0e1b-42d0-b3df-4f8c32c04227 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:27.662809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29899b95-0e1b-42d0-b3df-4f8c32c04227 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:27.663522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29899b95-0e1b-42d0-b3df-4f8c32c04227 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:28.128341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-29899b95-0e1b-42d0-b3df-4f8c32c04227 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lazy-loading 'services' on Instance uuid c01cd2e8-7dbc-4751-9124-8e46d3181d89 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:08:28.187090 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-29899b95-0e1b-42d0-b3df-4f8c32c04227 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1936 microversion: 2.91 time: 0.665144 Oct 12 22:08:28.187721 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1276/2337] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:27 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1936 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:28.216730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-507aa985-0a12-4f1a-a50c-1ba5381f8caa tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:28.217472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-507aa985-0a12-4f1a-a50c-1ba5381f8caa tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:28.238266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-507aa985-0a12-4f1a-a50c-1ba5381f8caa tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:28.238773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-507aa985-0a12-4f1a-a50c-1ba5381f8caa tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:28.245315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-507aa985-0a12-4f1a-a50c-1ba5381f8caa tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:28.249226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-507aa985-0a12-4f1a-a50c-1ba5381f8caa tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:28.249824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-507aa985-0a12-4f1a-a50c-1ba5381f8caa tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:28.250283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-507aa985-0a12-4f1a-a50c-1ba5381f8caa tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:28.528072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:28.539256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-507aa985-0a12-4f1a-a50c-1ba5381f8caa tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lazy-loading 'services' on Instance uuid c01cd2e8-7dbc-4751-9124-8e46d3181d89 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:08:28.589612 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-507aa985-0a12-4f1a-a50c-1ba5381f8caa tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1936 microversion: 2.91 time: 0.377516 Oct 12 22:08:28.603261 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1062/2338] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:28 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1936 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:28.624794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-289ee96c-8b26-4340-b511-7a118870c98b tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:28.631280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-289ee96c-8b26-4340-b511-7a118870c98b tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:28.638341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-289ee96c-8b26-4340-b511-7a118870c98b tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:28.639297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-289ee96c-8b26-4340-b511-7a118870c98b tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:28.640550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-289ee96c-8b26-4340-b511-7a118870c98b tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:28.641257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-289ee96c-8b26-4340-b511-7a118870c98b tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:28.642041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-289ee96c-8b26-4340-b511-7a118870c98b tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:28.722860 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-289ee96c-8b26-4340-b511-7a118870c98b tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.094432 Oct 12 22:08:28.733535 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1277/2339] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Oct 12 22:08:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:08:28.740712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e7e8cb8f-e63d-45fc-ae4e-8d1648574fea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:28.742244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e7e8cb8f-e63d-45fc-ae4e-8d1648574fea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:28.757404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7e8cb8f-e63d-45fc-ae4e-8d1648574fea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:28.765368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7e8cb8f-e63d-45fc-ae4e-8d1648574fea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:28.769656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7e8cb8f-e63d-45fc-ae4e-8d1648574fea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:28.770676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7e8cb8f-e63d-45fc-ae4e-8d1648574fea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:28.773406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7e8cb8f-e63d-45fc-ae4e-8d1648574fea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:28.774723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7e8cb8f-e63d-45fc-ae4e-8d1648574fea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:28.842676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-e7e8cb8f-e63d-45fc-ae4e-8d1648574fea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lazy-loading 'flavor' on Instance uuid c01cd2e8-7dbc-4751-9124-8e46d3181d89 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:08:29.405384 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e7e8cb8f-e63d-45fc-ae4e-8d1648574fea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "POST /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89/action" status: 202 len: 0 microversion: 2.91 time: 0.670503 Oct 12 22:08:29.409204 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1063/2340] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 12 22:08:28 2022] POST /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89/action => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:08:29.416824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2ced4e4d-ad4e-416f-822f-b0796c8ddf91 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:29.417719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2ced4e4d-ad4e-416f-822f-b0796c8ddf91 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:29.436398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ced4e4d-ad4e-416f-822f-b0796c8ddf91 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:29.439170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ced4e4d-ad4e-416f-822f-b0796c8ddf91 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:29.440977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ced4e4d-ad4e-416f-822f-b0796c8ddf91 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:29.442728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ced4e4d-ad4e-416f-822f-b0796c8ddf91 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:29.443620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ced4e4d-ad4e-416f-822f-b0796c8ddf91 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:29.449264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ced4e4d-ad4e-416f-822f-b0796c8ddf91 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:29.653395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2ced4e4d-ad4e-416f-822f-b0796c8ddf91 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:29.663425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2ced4e4d-ad4e-416f-822f-b0796c8ddf91 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:29.669830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2ced4e4d-ad4e-416f-822f-b0796c8ddf91 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:29.682842 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2ced4e4d-ad4e-416f-822f-b0796c8ddf91 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.270605 Oct 12 22:08:29.686905 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1278/2341] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:29 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:08:30.718163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d27923e4-1f36-4ae5-968e-902105ef3977 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:30.718884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d27923e4-1f36-4ae5-968e-902105ef3977 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:30.737249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d27923e4-1f36-4ae5-968e-902105ef3977 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:30.737788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d27923e4-1f36-4ae5-968e-902105ef3977 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:30.738321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d27923e4-1f36-4ae5-968e-902105ef3977 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:30.739138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d27923e4-1f36-4ae5-968e-902105ef3977 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:30.739634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d27923e4-1f36-4ae5-968e-902105ef3977 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:30.740111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d27923e4-1f36-4ae5-968e-902105ef3977 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:31.055627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-930e8985-2de6-409a-a2a3-8d80638e6c4e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:31.056993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-930e8985-2de6-409a-a2a3-8d80638e6c4e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:31.087053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-930e8985-2de6-409a-a2a3-8d80638e6c4e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:31.087755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-930e8985-2de6-409a-a2a3-8d80638e6c4e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:31.088211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-930e8985-2de6-409a-a2a3-8d80638e6c4e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:31.088959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-930e8985-2de6-409a-a2a3-8d80638e6c4e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:31.089418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-930e8985-2de6-409a-a2a3-8d80638e6c4e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:31.089848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-930e8985-2de6-409a-a2a3-8d80638e6c4e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:31.177739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-930e8985-2de6-409a-a2a3-8d80638e6c4e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:08:31.381667 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-930e8985-2de6-409a-a2a3-8d80638e6c4e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 204 len: 0 microversion: 2.25 time: 0.335258 Oct 12 22:08:31.382352 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1279/2342] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:08:31 2022] DELETE /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:08:31.396048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bec4571d-12ae-480c-beaf-4afc2ac12ec6 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:31.400195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bec4571d-12ae-480c-beaf-4afc2ac12ec6 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:31.416869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bec4571d-12ae-480c-beaf-4afc2ac12ec6 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:31.417497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bec4571d-12ae-480c-beaf-4afc2ac12ec6 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:31.418674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bec4571d-12ae-480c-beaf-4afc2ac12ec6 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:31.422161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bec4571d-12ae-480c-beaf-4afc2ac12ec6 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:31.422706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bec4571d-12ae-480c-beaf-4afc2ac12ec6 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:31.423161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bec4571d-12ae-480c-beaf-4afc2ac12ec6 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:31.428753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d27923e4-1f36-4ae5-968e-902105ef3977 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:31.442217 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d27923e4-1f36-4ae5-968e-902105ef3977 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:31.448997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d27923e4-1f36-4ae5-968e-902105ef3977 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:31.451220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:31.468855 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d27923e4-1f36-4ae5-968e-902105ef3977 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.756109 Oct 12 22:08:31.479903 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1064/2343] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:30 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:31.496024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-decd727f-4266-498e-bc91-3809a5f27318 req-b027d17e-15ad-475e-8266-e5345fc98c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1c142a-8d11-4578-a840-84ed39f0e1f4", "tag": "e1f32865-68ef-4c76-b641-079a9412068c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:31.533456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:31.535502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-decd727f-4266-498e-bc91-3809a5f27318 req-b027d17e-15ad-475e-8266-e5345fc98c9d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:31.536045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-decd727f-4266-498e-bc91-3809a5f27318 req-b027d17e-15ad-475e-8266-e5345fc98c9d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:31.536491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-decd727f-4266-498e-bc91-3809a5f27318 req-b027d17e-15ad-475e-8266-e5345fc98c9d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:31.557967 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-decd727f-4266-498e-bc91-3809a5f27318 req-b027d17e-15ad-475e-8266-e5345fc98c9d service nova] Creating event network-changed:e1f32865-68ef-4c76-b641-079a9412068c for instance af1c142a-8d11-4578-a840-84ed39f0e1f4 on n-h2-861111-1 Oct 12 22:08:31.579720 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-decd727f-4266-498e-bc91-3809a5f27318 req-b027d17e-15ad-475e-8266-e5345fc98c9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098109 Oct 12 22:08:31.580945 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1065/2344] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:31.586501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-68c51af0-8681-4dcd-9a5f-bdd119cea5c1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:31.587216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-68c51af0-8681-4dcd-9a5f-bdd119cea5c1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:31.616351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68c51af0-8681-4dcd-9a5f-bdd119cea5c1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:31.616860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68c51af0-8681-4dcd-9a5f-bdd119cea5c1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:31.625306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68c51af0-8681-4dcd-9a5f-bdd119cea5c1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:31.626203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68c51af0-8681-4dcd-9a5f-bdd119cea5c1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:31.626712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68c51af0-8681-4dcd-9a5f-bdd119cea5c1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:31.627162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68c51af0-8681-4dcd-9a5f-bdd119cea5c1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:31.750482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:32.045219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bec4571d-12ae-480c-beaf-4afc2ac12ec6 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:32.067274 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bec4571d-12ae-480c-beaf-4afc2ac12ec6 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1578 microversion: 2.1 time: 0.670336 Oct 12 22:08:32.070845 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1280/2345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:31 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1578 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:32.162041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-68c51af0-8681-4dcd-9a5f-bdd119cea5c1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:32.183714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-68c51af0-8681-4dcd-9a5f-bdd119cea5c1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:32.188622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-68c51af0-8681-4dcd-9a5f-bdd119cea5c1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:32.190268 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-68c51af0-8681-4dcd-9a5f-bdd119cea5c1 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1732 microversion: 2.25 time: 0.608209 Oct 12 22:08:32.193411 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1066/2346] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:31 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1732 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:32.517284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ed2a2bea-5794-4a6b-a2aa-9a6b7dc0fd28 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:32.518173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ed2a2bea-5794-4a6b-a2aa-9a6b7dc0fd28 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:32.530935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed2a2bea-5794-4a6b-a2aa-9a6b7dc0fd28 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:32.534215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed2a2bea-5794-4a6b-a2aa-9a6b7dc0fd28 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:32.536415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed2a2bea-5794-4a6b-a2aa-9a6b7dc0fd28 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:32.537363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed2a2bea-5794-4a6b-a2aa-9a6b7dc0fd28 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:32.538668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed2a2bea-5794-4a6b-a2aa-9a6b7dc0fd28 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:32.544857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed2a2bea-5794-4a6b-a2aa-9a6b7dc0fd28 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:32.797997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ed2a2bea-5794-4a6b-a2aa-9a6b7dc0fd28 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:32.813849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ed2a2bea-5794-4a6b-a2aa-9a6b7dc0fd28 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:32.822226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ed2a2bea-5794-4a6b-a2aa-9a6b7dc0fd28 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:32.838318 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ed2a2bea-5794-4a6b-a2aa-9a6b7dc0fd28 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.323396 Oct 12 22:08:32.839359 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1281/2347] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:32 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:08:33.222724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-95520b6c-3bff-47c2-945c-a34c312e7ce2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:33.223714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-95520b6c-3bff-47c2-945c-a34c312e7ce2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:33.238527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95520b6c-3bff-47c2-945c-a34c312e7ce2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:33.239108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95520b6c-3bff-47c2-945c-a34c312e7ce2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:33.240220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95520b6c-3bff-47c2-945c-a34c312e7ce2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:33.241737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95520b6c-3bff-47c2-945c-a34c312e7ce2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:33.242211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95520b6c-3bff-47c2-945c-a34c312e7ce2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:33.242649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95520b6c-3bff-47c2-945c-a34c312e7ce2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:33.744819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-95520b6c-3bff-47c2-945c-a34c312e7ce2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:33.781374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-95520b6c-3bff-47c2-945c-a34c312e7ce2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:33.793439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-95520b6c-3bff-47c2-945c-a34c312e7ce2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:33.803980 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-95520b6c-3bff-47c2-945c-a34c312e7ce2 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1732 microversion: 2.25 time: 0.586121 Oct 12 22:08:33.834071 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1067/2348] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:33 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1732 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:33.873316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0eca0015-c0b9-4c71-b75e-66eb1c9bd818 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:33.873958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0eca0015-c0b9-4c71-b75e-66eb1c9bd818 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:33.899445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0eca0015-c0b9-4c71-b75e-66eb1c9bd818 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:33.901334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0eca0015-c0b9-4c71-b75e-66eb1c9bd818 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:33.901987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0eca0015-c0b9-4c71-b75e-66eb1c9bd818 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:33.904457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0eca0015-c0b9-4c71-b75e-66eb1c9bd818 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:33.905860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0eca0015-c0b9-4c71-b75e-66eb1c9bd818 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:33.908341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0eca0015-c0b9-4c71-b75e-66eb1c9bd818 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:34.208929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-e6b9ca89-2a15-4999-ae8c-52691764f099 req-ce567d1d-0edf-40e1-b569-8f03af27adcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "247e0252-3374-40b8-85f3-995d2031867d", "name": "network-vif-deleted", "tag": "319c47c2-57cf-461d-8a9e-adf8c461cb1d"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:34.219832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e6b9ca89-2a15-4999-ae8c-52691764f099 req-ce567d1d-0edf-40e1-b569-8f03af27adcb service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:34.220318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e6b9ca89-2a15-4999-ae8c-52691764f099 req-ce567d1d-0edf-40e1-b569-8f03af27adcb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:34.220770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e6b9ca89-2a15-4999-ae8c-52691764f099 req-ce567d1d-0edf-40e1-b569-8f03af27adcb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:34.233672 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-e6b9ca89-2a15-4999-ae8c-52691764f099 req-ce567d1d-0edf-40e1-b569-8f03af27adcb service nova] Creating event network-vif-deleted:319c47c2-57cf-461d-8a9e-adf8c461cb1d for instance 247e0252-3374-40b8-85f3-995d2031867d on n-h2-861111-1 Oct 12 22:08:34.240292 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-e6b9ca89-2a15-4999-ae8c-52691764f099 req-ce567d1d-0edf-40e1-b569-8f03af27adcb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035057 Oct 12 22:08:34.241204 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1068/2349] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:08:34.735141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0eca0015-c0b9-4c71-b75e-66eb1c9bd818 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:34.752836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0eca0015-c0b9-4c71-b75e-66eb1c9bd818 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:34.758056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0eca0015-c0b9-4c71-b75e-66eb1c9bd818 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:34.776617 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0eca0015-c0b9-4c71-b75e-66eb1c9bd818 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.907174 Oct 12 22:08:34.777358 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1282/2350] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:33 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:34.832607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6f0fa0da-07fe-411f-a7b6-71af9bddf485 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:34.833579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6f0fa0da-07fe-411f-a7b6-71af9bddf485 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:34.844169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f0fa0da-07fe-411f-a7b6-71af9bddf485 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:34.850087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f0fa0da-07fe-411f-a7b6-71af9bddf485 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:34.850987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f0fa0da-07fe-411f-a7b6-71af9bddf485 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:34.851916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f0fa0da-07fe-411f-a7b6-71af9bddf485 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:34.852586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f0fa0da-07fe-411f-a7b6-71af9bddf485 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:34.853177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f0fa0da-07fe-411f-a7b6-71af9bddf485 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:34.913089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f0fa0da-07fe-411f-a7b6-71af9bddf485 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:34.913648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f0fa0da-07fe-411f-a7b6-71af9bddf485 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:34.914082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f0fa0da-07fe-411f-a7b6-71af9bddf485 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:34.914704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-6f0fa0da-07fe-411f-a7b6-71af9bddf485 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lazy-loading 'fault' on Instance uuid 247e0252-3374-40b8-85f3-995d2031867d {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:08:34.993156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6f0fa0da-07fe-411f-a7b6-71af9bddf485 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:35.009706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6f0fa0da-07fe-411f-a7b6-71af9bddf485 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:35.017901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6f0fa0da-07fe-411f-a7b6-71af9bddf485 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:35.019324 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6f0fa0da-07fe-411f-a7b6-71af9bddf485 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 200 len: 1375 microversion: 2.25 time: 0.191649 Oct 12 22:08:35.020602 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1069/2351] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:34 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 1375 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:35.420016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c94f4002-34d6-485f-be3c-955c1b734f2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'create', calling method: .version_select at 0x7f5123577160>, body: {"keypair": {"name": "tempest-keypair-1625673439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWCR5izD5amlvwVuN1AzpzUI+Zo/Vi/V8I6ganDwK0TjTRQsmxq8VF1qGdoB8t2V0y7xPqI4V2+WLwywINECpnWGJzYjt5iYtzGV/Hfq2f9U+hhgr2cDJYTwqO9G1DXNA=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:35.455693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-c94f4002-34d6-485f-be3c-955c1b734f2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Getting quotas for project 319a8f107945457a8a8f8e9690a697e5. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:08:35.462851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-c94f4002-34d6-485f-be3c-955c1b734f2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Getting quotas for user b29c500796d54d6188ff65056340d35f and project 319a8f107945457a8a8f8e9690a697e5. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:08:35.494810 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c94f4002-34d6-485f-be3c-955c1b734f2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.474190 Oct 12 22:08:35.496166 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1283/2352] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:08:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:35.772520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-912440575", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:35.807737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d7105cbb-2ae1-4f34-96d4-d814d9275ae2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:35.808303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d7105cbb-2ae1-4f34-96d4-d814d9275ae2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:35.825395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7105cbb-2ae1-4f34-96d4-d814d9275ae2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:35.826533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7105cbb-2ae1-4f34-96d4-d814d9275ae2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:35.827169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7105cbb-2ae1-4f34-96d4-d814d9275ae2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:35.828094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7105cbb-2ae1-4f34-96d4-d814d9275ae2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:35.828707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7105cbb-2ae1-4f34-96d4-d814d9275ae2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:35.829367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7105cbb-2ae1-4f34-96d4-d814d9275ae2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:35.850671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:08:35.953203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d7105cbb-2ae1-4f34-96d4-d814d9275ae2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:35.965591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d7105cbb-2ae1-4f34-96d4-d814d9275ae2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:35.967517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d7105cbb-2ae1-4f34-96d4-d814d9275ae2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:35.974061 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d7105cbb-2ae1-4f34-96d4-d814d9275ae2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.170621 Oct 12 22:08:35.974695 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1284/2353] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:35 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:08:36.048040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e3db0971-1330-47ec-8330-ccad49bd6d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:36.048659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e3db0971-1330-47ec-8330-ccad49bd6d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 247e0252-3374-40b8-85f3-995d2031867d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:36.058437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3db0971-1330-47ec-8330-ccad49bd6d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:36.063831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3db0971-1330-47ec-8330-ccad49bd6d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:36.064475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3db0971-1330-47ec-8330-ccad49bd6d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:36.065361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3db0971-1330-47ec-8330-ccad49bd6d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:36.066082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3db0971-1330-47ec-8330-ccad49bd6d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:36.066522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3db0971-1330-47ec-8330-ccad49bd6d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:36.101718 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-e3db0971-1330-47ec-8330-ccad49bd6d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] HTTP exception thrown: Instance 247e0252-3374-40b8-85f3-995d2031867d could not be found. Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e3db0971-1330-47ec-8330-ccad49bd6d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Request method failure captured: Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d HTTP/1.1 Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzkuITKNFODYF1KkcXnHuuWDLLP6rTmUKPX2JoOPqxgnmM59d3hA8u_uGVQOhxtImLS0RiSeXc5du75CWcsN6EL_bGLFOxwpmPYGqSibZsyxXwxep828aKg93B1dKyqDF1nxUm21YQEO_ZB7lue9VEXb7rz01tNRsYAdwMDWWZK_hJ0 Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.25 Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: beef77813aa641769eb3151b41b8e0cf Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-903197672 Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beef77813aa641769eb3151b41b8e0cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beef77813aa641769eb3151b41b8e0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_beef77813aa641769eb3151b41b8e0cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/beef77813aa641769eb3151b41b8e0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-903197672 Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: beef77813aa641769eb3151b41b8e0cf Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-903197672 Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-LiveAutoBlockMigrationV225Test-903197672-project Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 1c8822d55876445d91f5681781313ce9 Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-903197672-project Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 247e0252-3374-40b8-85f3-995d2031867d could not be found. Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '247e0252-3374-40b8-85f3-995d2031867d'} Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 247e0252-3374-40b8-85f3-995d2031867d could not be found. Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 247e0252-3374-40b8-85f3-995d2031867d could not be found. Oct 12 22:08:36.107995 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:36.111186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:36.111186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:36.111186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:36.111186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:36.111186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:36.111186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:36.111186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:36.111186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 247e0252-3374-40b8-85f3-995d2031867d could not be found. Oct 12 22:08:36.111186 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:36.111186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e3db0971-1330-47ec-8330-ccad49bd6d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Returning 404 to user: Instance 247e0252-3374-40b8-85f3-995d2031867d could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:36.111186 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e3db0971-1330-47ec-8330-ccad49bd6d86 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d" status: 404 len: 111 microversion: 2.25 time: 0.066238 Oct 12 22:08:36.111186 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1285/2354] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:36 2022] GET /compute/v2.1/servers/247e0252-3374-40b8-85f3-995d2031867d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 12 22:08:36.123607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-45cfbdd0-26c1-46ae-856d-520f9afab277 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '.version_select at 0x7f51234749d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:36.160610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:08:36.161028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:08:36.161502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:08:36.161604 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-45cfbdd0-26c1-46ae-856d-520f9afab277 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1118449018" status: 204 len: 0 microversion: 2.25 time: 0.046470 Oct 12 22:08:36.161908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:08:36.162115 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1286/2355] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 12 22:08:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1118449018 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 22:08:36.165611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:08:36.180192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:36.180767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:36.187035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:36.188347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:36.189762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:36.190440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:36.224062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Getting quotas for project 331af9ac13ef4fc8a569f24e9aa03414. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:08:36.241770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Getting quotas for user 10c4a14881bf4e7da9f93ffee4f4c78a and project 331af9ac13ef4fc8a569f24e9aa03414. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:08:36.264023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:08:36.267196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:08:36.352712 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c1b5bd9b-1ea0-4c73-8fb6-6536c1b18374 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802989 Oct 12 22:08:36.353834 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1070/2356] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:08:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:08:36.367790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ea3cdec1-7a65-4677-9613-49750c598e52 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:36.369180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ea3cdec1-7a65-4677-9613-49750c598e52 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:36.565412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ea3cdec1-7a65-4677-9613-49750c598e52 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c4a14881bf4e7da9f93ffee4f4c78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331af9ac13ef4fc8a569f24e9aa03414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:36.590774 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ea3cdec1-7a65-4677-9613-49750c598e52 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 200 len: 1222 microversion: 2.1 time: 0.227280 Oct 12 22:08:36.592488 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1287/2357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:36 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 1222 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:37.007274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8237ef88-b50c-4c9e-a882-49098eb24716 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:37.008480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8237ef88-b50c-4c9e-a882-49098eb24716 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:37.028375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8237ef88-b50c-4c9e-a882-49098eb24716 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:37.028872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8237ef88-b50c-4c9e-a882-49098eb24716 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:37.029308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8237ef88-b50c-4c9e-a882-49098eb24716 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:37.030022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8237ef88-b50c-4c9e-a882-49098eb24716 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:37.036408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8237ef88-b50c-4c9e-a882-49098eb24716 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:37.037067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8237ef88-b50c-4c9e-a882-49098eb24716 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:37.209440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8237ef88-b50c-4c9e-a882-49098eb24716 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:37.220335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8237ef88-b50c-4c9e-a882-49098eb24716 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:37.221989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8237ef88-b50c-4c9e-a882-49098eb24716 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:37.236087 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8237ef88-b50c-4c9e-a882-49098eb24716 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.233183 Oct 12 22:08:37.241206 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1071/2358] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:37 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:37.620715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d5af2fb4-3b24-4e3c-955e-45fc91d572ac tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:37.622389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d5af2fb4-3b24-4e3c-955e-45fc91d572ac tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:37.630856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5af2fb4-3b24-4e3c-955e-45fc91d572ac tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:37.631665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5af2fb4-3b24-4e3c-955e-45fc91d572ac tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:37.632748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5af2fb4-3b24-4e3c-955e-45fc91d572ac tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:37.633610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5af2fb4-3b24-4e3c-955e-45fc91d572ac tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:37.634288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5af2fb4-3b24-4e3c-955e-45fc91d572ac tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:37.634907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5af2fb4-3b24-4e3c-955e-45fc91d572ac tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:37.772522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d5af2fb4-3b24-4e3c-955e-45fc91d572ac tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c4a14881bf4e7da9f93ffee4f4c78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331af9ac13ef4fc8a569f24e9aa03414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:37.783510 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d5af2fb4-3b24-4e3c-955e-45fc91d572ac tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 200 len: 1274 microversion: 2.1 time: 0.173197 Oct 12 22:08:37.784465 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1288/2359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:37 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 1274 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:37.894659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1211472598", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68fd94b2-ed36-4c67-ae5b-2f754d0450a2"}], "security_groups": [{"name": "tempest-securitygroup--2013431758"}], "key_name": "tempest-keypair-1625673439", "user_data": "}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:38.181427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8a2f0488-0cd8-4524-a996-313289bc845d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:38.182348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8a2f0488-0cd8-4524-a996-313289bc845d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:38.192277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2f0488-0cd8-4524-a996-313289bc845d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:38.193568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2f0488-0cd8-4524-a996-313289bc845d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:38.194228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2f0488-0cd8-4524-a996-313289bc845d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:38.195159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2f0488-0cd8-4524-a996-313289bc845d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:38.195864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2f0488-0cd8-4524-a996-313289bc845d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:38.196505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a2f0488-0cd8-4524-a996-313289bc845d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:38.220422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] validate_networks() for [('68fd94b2-ed36-4c67-ae5b-2f754d0450a2', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:08:38.265612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8a2f0488-0cd8-4524-a996-313289bc845d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:08:38.382270 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8a2f0488-0cd8-4524-a996-313289bc845d tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 204 len: 0 microversion: 2.25 time: 0.203731 Oct 12 22:08:38.383061 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1289/2360] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:08:38 2022] DELETE /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:08:38.393803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d456e274-126d-4eca-8706-4ba6f2691a9a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:38.402158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d456e274-126d-4eca-8706-4ba6f2691a9a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:38.422943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d456e274-126d-4eca-8706-4ba6f2691a9a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:38.423673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d456e274-126d-4eca-8706-4ba6f2691a9a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:38.424443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d456e274-126d-4eca-8706-4ba6f2691a9a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:38.425329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d456e274-126d-4eca-8706-4ba6f2691a9a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:38.426012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d456e274-126d-4eca-8706-4ba6f2691a9a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:38.426692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d456e274-126d-4eca-8706-4ba6f2691a9a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:38.510346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d456e274-126d-4eca-8706-4ba6f2691a9a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:38.518983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d456e274-126d-4eca-8706-4ba6f2691a9a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:38.520494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d456e274-126d-4eca-8706-4ba6f2691a9a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:38.525986 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d456e274-126d-4eca-8706-4ba6f2691a9a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.140614 Oct 12 22:08:38.526910 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1290/2361] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:38 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:38.532405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4b5602db-cdc6-4cb6-8fb3-b2af170d3a46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:38.533018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4b5602db-cdc6-4cb6-8fb3-b2af170d3a46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:38.539105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b5602db-cdc6-4cb6-8fb3-b2af170d3a46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:38.539591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b5602db-cdc6-4cb6-8fb3-b2af170d3a46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:38.540028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b5602db-cdc6-4cb6-8fb3-b2af170d3a46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:38.540722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b5602db-cdc6-4cb6-8fb3-b2af170d3a46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:38.541169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b5602db-cdc6-4cb6-8fb3-b2af170d3a46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:38.541592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b5602db-cdc6-4cb6-8fb3-b2af170d3a46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:38.660623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:38.732207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b5602db-cdc6-4cb6-8fb3-b2af170d3a46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:38.749603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b5602db-cdc6-4cb6-8fb3-b2af170d3a46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:38.751256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b5602db-cdc6-4cb6-8fb3-b2af170d3a46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:38.758556 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4b5602db-cdc6-4cb6-8fb3-b2af170d3a46 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1548 microversion: 2.25 time: 0.228621 Oct 12 22:08:38.768749 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1291/2362] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:38 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1548 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:38.805968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-484931fe-c7af-4ca0-9b8a-aecedb221c21 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:38.806691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-484931fe-c7af-4ca0-9b8a-aecedb221c21 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:38.814275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-484931fe-c7af-4ca0-9b8a-aecedb221c21 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:38.814782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-484931fe-c7af-4ca0-9b8a-aecedb221c21 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:38.815450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-484931fe-c7af-4ca0-9b8a-aecedb221c21 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:38.816786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-484931fe-c7af-4ca0-9b8a-aecedb221c21 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:38.817453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-484931fe-c7af-4ca0-9b8a-aecedb221c21 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:38.818174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-484931fe-c7af-4ca0-9b8a-aecedb221c21 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:38.915824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-484931fe-c7af-4ca0-9b8a-aecedb221c21 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c4a14881bf4e7da9f93ffee4f4c78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331af9ac13ef4fc8a569f24e9aa03414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:38.929637 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-484931fe-c7af-4ca0-9b8a-aecedb221c21 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 200 len: 1280 microversion: 2.1 time: 0.127480 Oct 12 22:08:38.930782 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1292/2363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:38 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 1280 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:08:39.554965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-149d0835-dca2-4b49-a4c4-a59881324ede tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:39.555869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-149d0835-dca2-4b49-a4c4-a59881324ede tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:39.568653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-149d0835-dca2-4b49-a4c4-a59881324ede tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:39.569177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-149d0835-dca2-4b49-a4c4-a59881324ede tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:39.569611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-149d0835-dca2-4b49-a4c4-a59881324ede tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:39.570319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-149d0835-dca2-4b49-a4c4-a59881324ede tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:39.570751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-149d0835-dca2-4b49-a4c4-a59881324ede tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:39.571172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-149d0835-dca2-4b49-a4c4-a59881324ede tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:39.642085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-149d0835-dca2-4b49-a4c4-a59881324ede tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:39.651171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-149d0835-dca2-4b49-a4c4-a59881324ede tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:39.653294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-149d0835-dca2-4b49-a4c4-a59881324ede tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:39.656191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:39.659689 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-149d0835-dca2-4b49-a4c4-a59881324ede tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.109438 Oct 12 22:08:39.660493 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1293/2364] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:39 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:39.732815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:08:39.733337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:08:39.734675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:08:39.735003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:08:39.735456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:08:39.745051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:39.745623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:39.746155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:39.746954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:39.747458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:39.747872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:39.776765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Getting quotas for project 319a8f107945457a8a8f8e9690a697e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:08:39.780055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:39.784105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Getting quotas for user b29c500796d54d6188ff65056340d35f and project 319a8f107945457a8a8f8e9690a697e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:08:39.788563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2220b63f-45c2-44fc-a392-78523fb4c6dc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:39.790574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2220b63f-45c2-44fc-a392-78523fb4c6dc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:39.798720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:08:39.800772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2220b63f-45c2-44fc-a392-78523fb4c6dc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:39.801134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:08:39.801625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2220b63f-45c2-44fc-a392-78523fb4c6dc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:39.802170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2220b63f-45c2-44fc-a392-78523fb4c6dc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:39.803092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2220b63f-45c2-44fc-a392-78523fb4c6dc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:39.804170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2220b63f-45c2-44fc-a392-78523fb4c6dc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:39.804813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2220b63f-45c2-44fc-a392-78523fb4c6dc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:39.851742 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-59b819b5-6d76-49d8-8e64-e40d0c1d7b50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.961792 Oct 12 22:08:39.852926 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1072/2365] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:08:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 1964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:08:39.864300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-01d9f69b-43b0-4c50-96ce-7f8580486c37 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:39.865138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-01d9f69b-43b0-4c50-96ce-7f8580486c37 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:39.997289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-01d9f69b-43b0-4c50-96ce-7f8580486c37 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:40.008133 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-01d9f69b-43b0-4c50-96ce-7f8580486c37 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1239 microversion: 2.1 time: 0.147635 Oct 12 22:08:40.011445 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1073/2366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:39 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1239 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:40.020186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2220b63f-45c2-44fc-a392-78523fb4c6dc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:40.051228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d0ac9fdd-5783-4066-b5b9-ae24e9fd269c tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:40.051895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d0ac9fdd-5783-4066-b5b9-ae24e9fd269c tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:40.061547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2220b63f-45c2-44fc-a392-78523fb4c6dc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:40.067785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2220b63f-45c2-44fc-a392-78523fb4c6dc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:40.073985 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2220b63f-45c2-44fc-a392-78523fb4c6dc tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1548 microversion: 2.25 time: 0.292135 Oct 12 22:08:40.074355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ac9fdd-5783-4066-b5b9-ae24e9fd269c tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:40.074865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ac9fdd-5783-4066-b5b9-ae24e9fd269c tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:40.075342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ac9fdd-5783-4066-b5b9-ae24e9fd269c tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:40.076071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ac9fdd-5783-4066-b5b9-ae24e9fd269c tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:40.076541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ac9fdd-5783-4066-b5b9-ae24e9fd269c tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:40.077119 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1294/2367] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:39 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1548 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:40.083262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ac9fdd-5783-4066-b5b9-ae24e9fd269c tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:40.243158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d0ac9fdd-5783-4066-b5b9-ae24e9fd269c tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c4a14881bf4e7da9f93ffee4f4c78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331af9ac13ef4fc8a569f24e9aa03414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:40.254990 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d0ac9fdd-5783-4066-b5b9-ae24e9fd269c tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 200 len: 1280 microversion: 2.1 time: 0.241641 Oct 12 22:08:40.255617 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1074/2368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:40 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 1280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:40.627764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-8ddc86ae-d11d-4851-a191-7a8f66505c5e req-d44b09d7-c0ef-4747-8ad7-b939ecffec9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e615f0-f403-426c-a0c9-73cc9b810d10", "name": "network-vif-deleted", "tag": "38be05fb-8b40-41e5-b46a-fd8537f3988f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:40.656977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8ddc86ae-d11d-4851-a191-7a8f66505c5e req-d44b09d7-c0ef-4747-8ad7-b939ecffec9f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:40.657645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8ddc86ae-d11d-4851-a191-7a8f66505c5e req-d44b09d7-c0ef-4747-8ad7-b939ecffec9f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:40.658228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8ddc86ae-d11d-4851-a191-7a8f66505c5e req-d44b09d7-c0ef-4747-8ad7-b939ecffec9f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:40.679456 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-8ddc86ae-d11d-4851-a191-7a8f66505c5e req-d44b09d7-c0ef-4747-8ad7-b939ecffec9f service nova] Creating event network-vif-deleted:38be05fb-8b40-41e5-b46a-fd8537f3988f for instance e0e615f0-f403-426c-a0c9-73cc9b810d10 on n-h2-861111-1 Oct 12 22:08:40.687480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d24e8888-4327-408e-9e8a-081cb584eac3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:40.688932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d24e8888-4327-408e-9e8a-081cb584eac3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:40.693403 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-8ddc86ae-d11d-4851-a191-7a8f66505c5e req-d44b09d7-c0ef-4747-8ad7-b939ecffec9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069448 Oct 12 22:08:40.694513 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1295/2369] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:40.700738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d24e8888-4327-408e-9e8a-081cb584eac3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:40.708070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d24e8888-4327-408e-9e8a-081cb584eac3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:40.710578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d24e8888-4327-408e-9e8a-081cb584eac3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:40.711404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d24e8888-4327-408e-9e8a-081cb584eac3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:40.711873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d24e8888-4327-408e-9e8a-081cb584eac3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:40.714462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d24e8888-4327-408e-9e8a-081cb584eac3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:40.836869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d24e8888-4327-408e-9e8a-081cb584eac3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:40.848454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d24e8888-4327-408e-9e8a-081cb584eac3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:40.849916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d24e8888-4327-408e-9e8a-081cb584eac3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:40.855407 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d24e8888-4327-408e-9e8a-081cb584eac3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.171801 Oct 12 22:08:40.875045 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1075/2370] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:40 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:41.036752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bd058b2e-d039-4b45-b8e1-4a2c6387d5b8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:41.037461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bd058b2e-d039-4b45-b8e1-4a2c6387d5b8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:41.043812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd058b2e-d039-4b45-b8e1-4a2c6387d5b8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:41.044345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd058b2e-d039-4b45-b8e1-4a2c6387d5b8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:41.044726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd058b2e-d039-4b45-b8e1-4a2c6387d5b8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:41.045413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd058b2e-d039-4b45-b8e1-4a2c6387d5b8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:41.045858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd058b2e-d039-4b45-b8e1-4a2c6387d5b8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:41.046448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd058b2e-d039-4b45-b8e1-4a2c6387d5b8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:41.110171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bf99d68a-c682-4e3b-879e-3aaa3d49af95 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:41.110793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bf99d68a-c682-4e3b-879e-3aaa3d49af95 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:41.117869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf99d68a-c682-4e3b-879e-3aaa3d49af95 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:41.124007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf99d68a-c682-4e3b-879e-3aaa3d49af95 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:41.127921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf99d68a-c682-4e3b-879e-3aaa3d49af95 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:41.129360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf99d68a-c682-4e3b-879e-3aaa3d49af95 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:41.129975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf99d68a-c682-4e3b-879e-3aaa3d49af95 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:41.132869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf99d68a-c682-4e3b-879e-3aaa3d49af95 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:41.139963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bd058b2e-d039-4b45-b8e1-4a2c6387d5b8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:41.164565 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bd058b2e-d039-4b45-b8e1-4a2c6387d5b8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1291 microversion: 2.1 time: 0.133529 Oct 12 22:08:41.167570 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1296/2371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:41 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1291 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:41.218856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf99d68a-c682-4e3b-879e-3aaa3d49af95 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:41.220193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf99d68a-c682-4e3b-879e-3aaa3d49af95 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:41.221521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf99d68a-c682-4e3b-879e-3aaa3d49af95 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:41.222155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-bf99d68a-c682-4e3b-879e-3aaa3d49af95 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lazy-loading 'fault' on Instance uuid e0e615f0-f403-426c-a0c9-73cc9b810d10 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:08:41.279648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9a698efe-b833-4e71-87bf-2d81d15e4aa8 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:41.280789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9a698efe-b833-4e71-87bf-2d81d15e4aa8 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:41.292171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a698efe-b833-4e71-87bf-2d81d15e4aa8 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:41.293916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a698efe-b833-4e71-87bf-2d81d15e4aa8 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:41.294881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a698efe-b833-4e71-87bf-2d81d15e4aa8 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:41.295858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a698efe-b833-4e71-87bf-2d81d15e4aa8 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:41.296468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a698efe-b833-4e71-87bf-2d81d15e4aa8 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:41.297051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a698efe-b833-4e71-87bf-2d81d15e4aa8 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:41.465105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bf99d68a-c682-4e3b-879e-3aaa3d49af95 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:41.478956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bf99d68a-c682-4e3b-879e-3aaa3d49af95 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:41.484563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bf99d68a-c682-4e3b-879e-3aaa3d49af95 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:41.488308 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bf99d68a-c682-4e3b-879e-3aaa3d49af95 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 200 len: 1351 microversion: 2.25 time: 0.387765 Oct 12 22:08:41.490795 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1076/2372] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:41 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 1351 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:41.593482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9a698efe-b833-4e71-87bf-2d81d15e4aa8 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c4a14881bf4e7da9f93ffee4f4c78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331af9ac13ef4fc8a569f24e9aa03414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:41.604295 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9a698efe-b833-4e71-87bf-2d81d15e4aa8 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 200 len: 1322 microversion: 2.1 time: 0.329742 Oct 12 22:08:41.605210 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1297/2373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:41 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:41.890838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2470f9c4-e277-40f0-bc62-1991534bb231 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:41.892649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2470f9c4-e277-40f0-bc62-1991534bb231 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:41.900509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2470f9c4-e277-40f0-bc62-1991534bb231 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:41.901331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2470f9c4-e277-40f0-bc62-1991534bb231 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:41.902121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2470f9c4-e277-40f0-bc62-1991534bb231 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:41.903693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2470f9c4-e277-40f0-bc62-1991534bb231 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:41.904491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2470f9c4-e277-40f0-bc62-1991534bb231 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:41.905746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2470f9c4-e277-40f0-bc62-1991534bb231 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:42.024385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2470f9c4-e277-40f0-bc62-1991534bb231 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:42.043553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2470f9c4-e277-40f0-bc62-1991534bb231 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:42.046002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2470f9c4-e277-40f0-bc62-1991534bb231 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:42.054839 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2470f9c4-e277-40f0-bc62-1991534bb231 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.172088 Oct 12 22:08:42.072849 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1077/2374] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:41 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:42.194439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-62f22a9b-0a78-4592-bce0-d7cd53c68a2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:42.195079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-62f22a9b-0a78-4592-bce0-d7cd53c68a2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:42.208054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62f22a9b-0a78-4592-bce0-d7cd53c68a2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:42.209722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62f22a9b-0a78-4592-bce0-d7cd53c68a2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:42.210178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62f22a9b-0a78-4592-bce0-d7cd53c68a2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:42.210931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62f22a9b-0a78-4592-bce0-d7cd53c68a2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:42.213569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62f22a9b-0a78-4592-bce0-d7cd53c68a2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:42.214054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62f22a9b-0a78-4592-bce0-d7cd53c68a2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:42.328428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-62f22a9b-0a78-4592-bce0-d7cd53c68a2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:42.338485 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-62f22a9b-0a78-4592-bce0-d7cd53c68a2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1297 microversion: 2.1 time: 0.148080 Oct 12 22:08:42.343899 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1298/2375] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:42 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1297 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:42.520772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a471e41a-d8d2-4d42-9174-66a90d85bce4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:42.522084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a471e41a-d8d2-4d42-9174-66a90d85bce4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: e0e615f0-f403-426c-a0c9-73cc9b810d10] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:42.531969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a471e41a-d8d2-4d42-9174-66a90d85bce4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:42.532475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a471e41a-d8d2-4d42-9174-66a90d85bce4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:42.541794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a471e41a-d8d2-4d42-9174-66a90d85bce4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:42.542699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a471e41a-d8d2-4d42-9174-66a90d85bce4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:42.543756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a471e41a-d8d2-4d42-9174-66a90d85bce4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:42.544208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a471e41a-d8d2-4d42-9174-66a90d85bce4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:42.601347 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-a471e41a-d8d2-4d42-9174-66a90d85bce4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] HTTP exception thrown: Instance e0e615f0-f403-426c-a0c9-73cc9b810d10 could not be found. Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a471e41a-d8d2-4d42-9174-66a90d85bce4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Request method failure captured: Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 HTTP/1.1 Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzkuITKNFODYF1KkcXnHuuWDLLP6rTmUKPX2JoOPqxgnmM59d3hA8u_uGVQOhxtImLS0RiSeXc5du75CWcsN6EL_bGLFOxwpmPYGqSibZsyxXwxep828aKg93B1dKyqDF1nxUm21YQEO_ZB7lue9VEXb7rz01tNRsYAdwMDWWZK_hJ0 Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-Openstack-Nova-Api-Version: 2.25 Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: beef77813aa641769eb3151b41b8e0cf Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-903197672 Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beef77813aa641769eb3151b41b8e0cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beef77813aa641769eb3151b41b8e0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_beef77813aa641769eb3151b41b8e0cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/beef77813aa641769eb3151b41b8e0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-903197672 Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: beef77813aa641769eb3151b41b8e0cf Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-903197672 Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-LiveAutoBlockMigrationV225Test-903197672-project Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 1c8822d55876445d91f5681781313ce9 Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-903197672-project Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance e0e615f0-f403-426c-a0c9-73cc9b810d10 could not be found. Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'e0e615f0-f403-426c-a0c9-73cc9b810d10'} Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e615f0-f403-426c-a0c9-73cc9b810d10 could not be found. Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e615f0-f403-426c-a0c9-73cc9b810d10 could not be found. Oct 12 22:08:42.603161 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:42.606555 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:42.606555 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:42.606555 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:42.606555 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:42.606555 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:42.606555 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:42.606555 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:42.606555 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e615f0-f403-426c-a0c9-73cc9b810d10 could not be found. Oct 12 22:08:42.606555 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:42.606555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a471e41a-d8d2-4d42-9174-66a90d85bce4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Returning 404 to user: Instance e0e615f0-f403-426c-a0c9-73cc9b810d10 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:42.606555 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a471e41a-d8d2-4d42-9174-66a90d85bce4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10" status: 404 len: 111 microversion: 2.25 time: 0.088162 Oct 12 22:08:42.622706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5547a8cf-7ddb-4f9a-9d62-f865335f0b51 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:42.623270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5547a8cf-7ddb-4f9a-9d62-f865335f0b51 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:42.628833 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1078/2376] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:42 2022] GET /compute/v2.1/servers/e0e615f0-f403-426c-a0c9-73cc9b810d10 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:08:42.643532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c0ab7104-8b1f-4649-9396-2938823d5826 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:42.644164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c0ab7104-8b1f-4649-9396-2938823d5826 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:42.648243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5547a8cf-7ddb-4f9a-9d62-f865335f0b51 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:42.649799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5547a8cf-7ddb-4f9a-9d62-f865335f0b51 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:42.651274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5547a8cf-7ddb-4f9a-9d62-f865335f0b51 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:42.653668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5547a8cf-7ddb-4f9a-9d62-f865335f0b51 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:42.654841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5547a8cf-7ddb-4f9a-9d62-f865335f0b51 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:42.656007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5547a8cf-7ddb-4f9a-9d62-f865335f0b51 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:42.663283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0ab7104-8b1f-4649-9396-2938823d5826 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:42.666177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0ab7104-8b1f-4649-9396-2938823d5826 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:42.666797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0ab7104-8b1f-4649-9396-2938823d5826 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:42.668709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0ab7104-8b1f-4649-9396-2938823d5826 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:42.673030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0ab7104-8b1f-4649-9396-2938823d5826 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:42.673734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0ab7104-8b1f-4649-9396-2938823d5826 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:42.686183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:42.712819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5547a8cf-7ddb-4f9a-9d62-f865335f0b51 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:08:42.861919 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5547a8cf-7ddb-4f9a-9d62-f865335f0b51 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 204 len: 0 microversion: 2.25 time: 0.245709 Oct 12 22:08:42.862577 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1299/2377] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:08:42 2022] DELETE /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:08:42.876022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-93bb2278-9df9-430f-bcb9-ec46a1f57e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:42.879736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-93bb2278-9df9-430f-bcb9-ec46a1f57e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:42.892160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93bb2278-9df9-430f-bcb9-ec46a1f57e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:42.894023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93bb2278-9df9-430f-bcb9-ec46a1f57e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:42.898624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93bb2278-9df9-430f-bcb9-ec46a1f57e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:42.899737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93bb2278-9df9-430f-bcb9-ec46a1f57e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:42.900360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93bb2278-9df9-430f-bcb9-ec46a1f57e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:42.903067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93bb2278-9df9-430f-bcb9-ec46a1f57e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:42.988895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c0ab7104-8b1f-4649-9396-2938823d5826 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c4a14881bf4e7da9f93ffee4f4c78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331af9ac13ef4fc8a569f24e9aa03414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:43.004695 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c0ab7104-8b1f-4649-9396-2938823d5826 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 200 len: 1322 microversion: 2.1 time: 0.374673 Oct 12 22:08:43.007627 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1079/2378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:42 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:43.085322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-64583942-8f44-47c3-8b58-651a413803d1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:43.085934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-64583942-8f44-47c3-8b58-651a413803d1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:43.092996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64583942-8f44-47c3-8b58-651a413803d1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:43.093854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64583942-8f44-47c3-8b58-651a413803d1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:43.094582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64583942-8f44-47c3-8b58-651a413803d1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:43.095536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64583942-8f44-47c3-8b58-651a413803d1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:43.096196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64583942-8f44-47c3-8b58-651a413803d1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:43.096829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64583942-8f44-47c3-8b58-651a413803d1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:43.152404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-93bb2278-9df9-430f-bcb9-ec46a1f57e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:43.161936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-93bb2278-9df9-430f-bcb9-ec46a1f57e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:43.164245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-93bb2278-9df9-430f-bcb9-ec46a1f57e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:43.165991 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-93bb2278-9df9-430f-bcb9-ec46a1f57e18 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1564 microversion: 2.25 time: 0.299273 Oct 12 22:08:43.167296 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1300/2379] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:42 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1564 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:08:43.369703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-70d85657-ba9d-4b91-8036-353f3490b684 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:43.372084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-70d85657-ba9d-4b91-8036-353f3490b684 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:43.383211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70d85657-ba9d-4b91-8036-353f3490b684 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:43.384586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70d85657-ba9d-4b91-8036-353f3490b684 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:43.385257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70d85657-ba9d-4b91-8036-353f3490b684 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:43.387614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70d85657-ba9d-4b91-8036-353f3490b684 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:43.388337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70d85657-ba9d-4b91-8036-353f3490b684 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:43.388997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70d85657-ba9d-4b91-8036-353f3490b684 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:43.484291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-64583942-8f44-47c3-8b58-651a413803d1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:43.487909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:43.502168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-64583942-8f44-47c3-8b58-651a413803d1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:43.503880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-64583942-8f44-47c3-8b58-651a413803d1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:43.518686 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-64583942-8f44-47c3-8b58-651a413803d1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.437908 Oct 12 22:08:43.522041 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1080/2380] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:43 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:08:43.614041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-386fc195-f24c-432f-9515-0b7cfc218f4d req-2ac7c207-47ac-4874-8a77-9e5c9fbac11a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe8b193-bf33-4af2-bd72-005dfff83900", "tag": "92a0f9f4-5667-4383-9be4-f12efc982b5b"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:43.638554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-386fc195-f24c-432f-9515-0b7cfc218f4d req-2ac7c207-47ac-4874-8a77-9e5c9fbac11a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:43.639409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-386fc195-f24c-432f-9515-0b7cfc218f4d req-2ac7c207-47ac-4874-8a77-9e5c9fbac11a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:43.640023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-386fc195-f24c-432f-9515-0b7cfc218f4d req-2ac7c207-47ac-4874-8a77-9e5c9fbac11a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:43.663936 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-386fc195-f24c-432f-9515-0b7cfc218f4d req-2ac7c207-47ac-4874-8a77-9e5c9fbac11a service nova] Creating event network-changed:92a0f9f4-5667-4383-9be4-f12efc982b5b for instance 5fe8b193-bf33-4af2-bd72-005dfff83900 on n-h1-861111-1 Oct 12 22:08:43.670773 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-386fc195-f24c-432f-9515-0b7cfc218f4d req-2ac7c207-47ac-4874-8a77-9e5c9fbac11a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061501 Oct 12 22:08:43.672064 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1081/2381] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:43.919160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3c35db5b-8338-4b6a-8faf-816f39827e16 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0657275e-1af3-44f9-be6d-05fa320e128c"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:43.921732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3c35db5b-8338-4b6a-8faf-816f39827e16 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:43.946916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c35db5b-8338-4b6a-8faf-816f39827e16 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:43.949068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c35db5b-8338-4b6a-8faf-816f39827e16 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:43.951832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c35db5b-8338-4b6a-8faf-816f39827e16 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:43.955528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c35db5b-8338-4b6a-8faf-816f39827e16 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:43.956127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c35db5b-8338-4b6a-8faf-816f39827e16 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:43.957390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c35db5b-8338-4b6a-8faf-816f39827e16 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:43.963979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-70d85657-ba9d-4b91-8036-353f3490b684 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:44.000053 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-70d85657-ba9d-4b91-8036-353f3490b684 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1365 microversion: 2.1 time: 0.633763 Oct 12 22:08:44.003181 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1301/2382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:43 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1365 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:08:44.029920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-960ec926-4720-49da-a875-0b96eaf464da tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:44.030885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-960ec926-4720-49da-a875-0b96eaf464da tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:44.045227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-960ec926-4720-49da-a875-0b96eaf464da tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:44.045995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-960ec926-4720-49da-a875-0b96eaf464da tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:44.046642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-960ec926-4720-49da-a875-0b96eaf464da tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:44.047729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-960ec926-4720-49da-a875-0b96eaf464da tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:44.048627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-960ec926-4720-49da-a875-0b96eaf464da tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:44.049253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-960ec926-4720-49da-a875-0b96eaf464da tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:44.421054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-960ec926-4720-49da-a875-0b96eaf464da tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c4a14881bf4e7da9f93ffee4f4c78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331af9ac13ef4fc8a569f24e9aa03414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:44.424851 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3c35db5b-8338-4b6a-8faf-816f39827e16 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "POST /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.510059 Oct 12 22:08:44.430954 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1082/2383] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 22:08:43 2022] POST /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253/os-volume_attachments => generated 194 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:08:44.432823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a75ad981-3082-4f68-be4b-6260e6f1425a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:44.433659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a75ad981-3082-4f68-be4b-6260e6f1425a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:44.441805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a75ad981-3082-4f68-be4b-6260e6f1425a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:44.442679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a75ad981-3082-4f68-be4b-6260e6f1425a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:44.442977 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-960ec926-4720-49da-a875-0b96eaf464da tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 200 len: 1322 microversion: 2.1 time: 0.415322 Oct 12 22:08:44.443979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a75ad981-3082-4f68-be4b-6260e6f1425a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:44.444929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a75ad981-3082-4f68-be4b-6260e6f1425a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:44.445304 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1302/2384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:44 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:44.446283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a75ad981-3082-4f68-be4b-6260e6f1425a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:44.446845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a75ad981-3082-4f68-be4b-6260e6f1425a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:44.564953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1e170c00-a8b6-4077-9d4c-91359e2cd5f6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:44.566267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1e170c00-a8b6-4077-9d4c-91359e2cd5f6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:44.572960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e170c00-a8b6-4077-9d4c-91359e2cd5f6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:44.578793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e170c00-a8b6-4077-9d4c-91359e2cd5f6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:44.579609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e170c00-a8b6-4077-9d4c-91359e2cd5f6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:44.580510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e170c00-a8b6-4077-9d4c-91359e2cd5f6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:44.583322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e170c00-a8b6-4077-9d4c-91359e2cd5f6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:44.584437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e170c00-a8b6-4077-9d4c-91359e2cd5f6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:44.726037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a75ad981-3082-4f68-be4b-6260e6f1425a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:44.739413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a75ad981-3082-4f68-be4b-6260e6f1425a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:44.743725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a75ad981-3082-4f68-be4b-6260e6f1425a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:44.747538 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a75ad981-3082-4f68-be4b-6260e6f1425a tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1522 microversion: 2.25 time: 0.319731 Oct 12 22:08:44.748998 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1083/2385] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:44 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:44.753061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1e170c00-a8b6-4077-9d4c-91359e2cd5f6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:44.772843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1e170c00-a8b6-4077-9d4c-91359e2cd5f6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:44.775900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1e170c00-a8b6-4077-9d4c-91359e2cd5f6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:44.794450 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1e170c00-a8b6-4077-9d4c-91359e2cd5f6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.233267 Oct 12 22:08:44.795058 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1303/2386] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:44 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:44.899904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-5d3977e8-41c0-49a5-8f07-8145b6d23c57 req-7a3340ac-17f5-4ec1-9e48-c03ccfb0e87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f266cf9-d4aa-4392-ab6c-722b3ef3d26e", "name": "network-vif-deleted", "tag": "43b4aff9-14b1-41df-8485-e703d7cb7bea"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:44.921927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5d3977e8-41c0-49a5-8f07-8145b6d23c57 req-7a3340ac-17f5-4ec1-9e48-c03ccfb0e87c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:44.921927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5d3977e8-41c0-49a5-8f07-8145b6d23c57 req-7a3340ac-17f5-4ec1-9e48-c03ccfb0e87c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:44.922599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5d3977e8-41c0-49a5-8f07-8145b6d23c57 req-7a3340ac-17f5-4ec1-9e48-c03ccfb0e87c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:44.969120 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-5d3977e8-41c0-49a5-8f07-8145b6d23c57 req-7a3340ac-17f5-4ec1-9e48-c03ccfb0e87c service nova] Creating event network-vif-deleted:43b4aff9-14b1-41df-8485-e703d7cb7bea for instance 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e on n-h2-861111-1 Oct 12 22:08:44.975209 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-5d3977e8-41c0-49a5-8f07-8145b6d23c57 req-7a3340ac-17f5-4ec1-9e48-c03ccfb0e87c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079049 Oct 12 22:08:44.976174 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1084/2387] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:45.029575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1dbc730d-faf7-4290-b44f-a6df550953bd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:45.030633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1dbc730d-faf7-4290-b44f-a6df550953bd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:45.042058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dbc730d-faf7-4290-b44f-a6df550953bd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:45.042601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dbc730d-faf7-4290-b44f-a6df550953bd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:45.044086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dbc730d-faf7-4290-b44f-a6df550953bd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:45.045672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dbc730d-faf7-4290-b44f-a6df550953bd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:45.048660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dbc730d-faf7-4290-b44f-a6df550953bd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:45.050326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dbc730d-faf7-4290-b44f-a6df550953bd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:45.323071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1dbc730d-faf7-4290-b44f-a6df550953bd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:45.335848 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1dbc730d-faf7-4290-b44f-a6df550953bd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1365 microversion: 2.1 time: 0.308644 Oct 12 22:08:45.343277 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1304/2388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:45 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1365 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:45.471964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c4113343-0b14-4baf-b71b-2a94d44ec84a tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:45.473244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c4113343-0b14-4baf-b71b-2a94d44ec84a tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:45.489601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4113343-0b14-4baf-b71b-2a94d44ec84a tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:45.490304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4113343-0b14-4baf-b71b-2a94d44ec84a tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:45.490905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4113343-0b14-4baf-b71b-2a94d44ec84a tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:45.492160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4113343-0b14-4baf-b71b-2a94d44ec84a tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:45.492775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4113343-0b14-4baf-b71b-2a94d44ec84a tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:45.493355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4113343-0b14-4baf-b71b-2a94d44ec84a tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:45.767055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-8a1f6190-b4ea-4509-8ae7-3af764cdc8c8 req-95d6c706-b41e-44a1-bf9d-aad02727b311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4023ebba-05d4-4225-938a-c70c2490ae29", "tag": "16f27b0f-2034-49b1-8fc7-d037682a37a4"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:45.782991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8a1f6190-b4ea-4509-8ae7-3af764cdc8c8 req-95d6c706-b41e-44a1-bf9d-aad02727b311 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:45.783824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8a1f6190-b4ea-4509-8ae7-3af764cdc8c8 req-95d6c706-b41e-44a1-bf9d-aad02727b311 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:45.787318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8a1f6190-b4ea-4509-8ae7-3af764cdc8c8 req-95d6c706-b41e-44a1-bf9d-aad02727b311 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:45.804433 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-8a1f6190-b4ea-4509-8ae7-3af764cdc8c8 req-95d6c706-b41e-44a1-bf9d-aad02727b311 service nova] Creating event network-changed:16f27b0f-2034-49b1-8fc7-d037682a37a4 for instance 4023ebba-05d4-4225-938a-c70c2490ae29 on n-h2-861111-1 Oct 12 22:08:45.811094 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-8a1f6190-b4ea-4509-8ae7-3af764cdc8c8 req-95d6c706-b41e-44a1-bf9d-aad02727b311 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048122 Oct 12 22:08:45.814904 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1305/2389] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:08:45.821020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2ab69852-ebba-4580-a50e-82d38e7533c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:45.822000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2ab69852-ebba-4580-a50e-82d38e7533c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:45.831290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ab69852-ebba-4580-a50e-82d38e7533c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:45.831961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ab69852-ebba-4580-a50e-82d38e7533c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:45.832844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ab69852-ebba-4580-a50e-82d38e7533c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:45.833731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ab69852-ebba-4580-a50e-82d38e7533c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:45.834337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ab69852-ebba-4580-a50e-82d38e7533c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:45.835033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ab69852-ebba-4580-a50e-82d38e7533c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:45.882551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ab69852-ebba-4580-a50e-82d38e7533c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:45.883140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ab69852-ebba-4580-a50e-82d38e7533c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:45.883703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ab69852-ebba-4580-a50e-82d38e7533c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:45.884217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-2ab69852-ebba-4580-a50e-82d38e7533c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lazy-loading 'fault' on Instance uuid 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:08:45.930780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c4113343-0b14-4baf-b71b-2a94d44ec84a tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c4a14881bf4e7da9f93ffee4f4c78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331af9ac13ef4fc8a569f24e9aa03414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:45.940821 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c4113343-0b14-4baf-b71b-2a94d44ec84a tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 200 len: 1322 microversion: 2.1 time: 0.473990 Oct 12 22:08:45.947095 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1085/2390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:45 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 1322 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:45.975684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2ab69852-ebba-4580-a50e-82d38e7533c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:45.986464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2ab69852-ebba-4580-a50e-82d38e7533c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:45.988174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2ab69852-ebba-4580-a50e-82d38e7533c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c8822d55876445d91f5681781313ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef77813aa641769eb3151b41b8e0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:45.990197 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2ab69852-ebba-4580-a50e-82d38e7533c4 tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 200 len: 1352 microversion: 2.25 time: 0.173740 Oct 12 22:08:45.991223 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1306/2391] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:45 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 1352 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:46.002906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7c71db30-7df1-46a6-a566-e6c0e702cceb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:46.003538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7c71db30-7df1-46a6-a566-e6c0e702cceb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:46.016208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c71db30-7df1-46a6-a566-e6c0e702cceb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:46.016959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c71db30-7df1-46a6-a566-e6c0e702cceb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:46.017551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c71db30-7df1-46a6-a566-e6c0e702cceb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:46.018416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c71db30-7df1-46a6-a566-e6c0e702cceb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:46.019517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c71db30-7df1-46a6-a566-e6c0e702cceb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:46.020222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c71db30-7df1-46a6-a566-e6c0e702cceb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:46.024221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-41e47bba-6906-486c-903a-efce4ff7aa47 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Action: 'create', calling method: .version_select at 0x7f51288ea550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-85134045", "description": "tempest-description-248530342"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:46.093225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7c71db30-7df1-46a6-a566-e6c0e702cceb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:46.101396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7c71db30-7df1-46a6-a566-e6c0e702cceb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:46.102836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7c71db30-7df1-46a6-a566-e6c0e702cceb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:46.109021 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7c71db30-7df1-46a6-a566-e6c0e702cceb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.116507 Oct 12 22:08:46.109616 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1307/2392] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:45 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:46.366192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c25afc1e-d44b-4f87-ac12-abf37a4df30b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:46.367212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c25afc1e-d44b-4f87-ac12-abf37a4df30b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:46.377264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c25afc1e-d44b-4f87-ac12-abf37a4df30b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:46.378080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c25afc1e-d44b-4f87-ac12-abf37a4df30b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:46.378689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c25afc1e-d44b-4f87-ac12-abf37a4df30b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:46.379735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c25afc1e-d44b-4f87-ac12-abf37a4df30b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:46.380756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c25afc1e-d44b-4f87-ac12-abf37a4df30b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:46.381397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c25afc1e-d44b-4f87-ac12-abf37a4df30b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:46.517671 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-41e47bba-6906-486c-903a-efce4ff7aa47 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.568380 Oct 12 22:08:46.518812 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1086/2393] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:08:45 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:46.532900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-91b624f0-a4cc-4850-9d2e-1bd14a08e9f9 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Action: 'create', calling method: .version_select at 0x7f512840ca60>, body: {"security_group_rule": {"parent_group_id": "3fd33f10-51f2-4d54-961d-351f4a92fb42", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:46.543517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c25afc1e-d44b-4f87-ac12-abf37a4df30b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:46.554879 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c25afc1e-d44b-4f87-ac12-abf37a4df30b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1365 microversion: 2.1 time: 0.196759 Oct 12 22:08:46.555636 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1308/2394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:46 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:46.964338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:46.970573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a5075b7c-4128-473d-9092-7000b94d0d0b tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:46.971612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a5075b7c-4128-473d-9092-7000b94d0d0b tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:46.978877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5075b7c-4128-473d-9092-7000b94d0d0b tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:46.979660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5075b7c-4128-473d-9092-7000b94d0d0b tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:46.980856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5075b7c-4128-473d-9092-7000b94d0d0b tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:46.981755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5075b7c-4128-473d-9092-7000b94d0d0b tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:46.982468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5075b7c-4128-473d-9092-7000b94d0d0b tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:46.983180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5075b7c-4128-473d-9092-7000b94d0d0b tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:47.029592 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-91b624f0-a4cc-4850-9d2e-1bd14a08e9f9 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.501424 Oct 12 22:08:47.031032 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1087/2395] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 12 22:08:46 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:08:47.039847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-50510fab-3a1f-49b8-8aaa-1f916598055e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:47.040014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-50510fab-3a1f-49b8-8aaa-1f916598055e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] [instance: 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:47.056053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50510fab-3a1f-49b8-8aaa-1f916598055e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:47.056735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50510fab-3a1f-49b8-8aaa-1f916598055e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:47.057324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50510fab-3a1f-49b8-8aaa-1f916598055e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:47.058414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50510fab-3a1f-49b8-8aaa-1f916598055e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:47.059103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50510fab-3a1f-49b8-8aaa-1f916598055e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:47.060580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50510fab-3a1f-49b8-8aaa-1f916598055e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:47.081393 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-50510fab-3a1f-49b8-8aaa-1f916598055e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] HTTP exception thrown: Instance 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e could not be found. Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-50510fab-3a1f-49b8-8aaa-1f916598055e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Request method failure captured: Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e HTTP/1.1 Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzkuITKNFODYF1KkcXnHuuWDLLP6rTmUKPX2JoOPqxgnmM59d3hA8u_uGVQOhxtImLS0RiSeXc5du75CWcsN6EL_bGLFOxwpmPYGqSibZsyxXwxep828aKg93B1dKyqDF1nxUm21YQEO_ZB7lue9VEXb7rz01tNRsYAdwMDWWZK_hJ0 Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-Openstack-Nova-Api-Version: 2.25 Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: beef77813aa641769eb3151b41b8e0cf Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-903197672 Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beef77813aa641769eb3151b41b8e0cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beef77813aa641769eb3151b41b8e0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_beef77813aa641769eb3151b41b8e0cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/beef77813aa641769eb3151b41b8e0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-903197672 Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: beef77813aa641769eb3151b41b8e0cf Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-903197672 Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-LiveAutoBlockMigrationV225Test-903197672-project Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 1c8822d55876445d91f5681781313ce9 Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-903197672-project Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e could not be found. Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '6f266cf9-d4aa-4392-ab6c-722b3ef3d26e'} Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e could not be found. Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e could not be found. Oct 12 22:08:47.083801 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:47.087265 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:47.087265 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:47.087265 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:47.087265 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:47.087265 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:47.087265 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:47.087265 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:47.087265 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e could not be found. Oct 12 22:08:47.087265 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:47.089280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-50510fab-3a1f-49b8-8aaa-1f916598055e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] Returning 404 to user: Instance 6f266cf9-d4aa-4392-ab6c-722b3ef3d26e could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:47.090869 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-50510fab-3a1f-49b8-8aaa-1f916598055e tempest-LiveAutoBlockMigrationV225Test-903197672 tempest-LiveAutoBlockMigrationV225Test-903197672-project] 10.222.0.16 "GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e" status: 404 len: 111 microversion: 2.25 time: 0.058976 Oct 12 22:08:47.094830 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1088/2396] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:47 2022] GET /compute/v2.1/servers/6f266cf9-d4aa-4392-ab6c-722b3ef3d26e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:08:47.098062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0a2aeb6f-9f10-488e-a8d0-d331e3814ea0 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Action: 'create', calling method: .version_select at 0x7f51286ec820>, body: {"security_group_rule": {"parent_group_id": "3fd33f10-51f2-4d54-961d-351f4a92fb42", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:47.165185 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-0a2aeb6f-9f10-488e-a8d0-d331e3814ea0 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] HTTP exception thrown: This rule already exists in group 3fd33f10-51f2-4d54-961d-351f4a92fb42 Oct 12 22:08:47.173933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a5075b7c-4128-473d-9092-7000b94d0d0b tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c4a14881bf4e7da9f93ffee4f4c78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331af9ac13ef4fc8a569f24e9aa03414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:47.183717 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a5075b7c-4128-473d-9092-7000b94d0d0b tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 200 len: 1322 microversion: 2.1 time: 0.220323 Oct 12 22:08:47.184543 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1309/2397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:46 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:08:47.189318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0254ba38-8573-4f32-a262-9c90727939b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:47.190193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0254ba38-8573-4f32-a262-9c90727939b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0a2aeb6f-9f10-488e-a8d0-d331e3814ea0 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Request method failure captured: Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 138 Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzrtsj66ZReRc_azbQ89iLJjRLtMdwpsuTGX1J0CF3Hc-Oq7kZN0RfkGSbalciR1Zf99O77Ii7c_ybjaxpTXSBZDbhPYpu6rOj94wQeuDpNzUz-YlhRnYWYqX3o99UiVM3NRXU0-iJuMF1pNpwZLsm184mQF2qcTLw8Q4-U6-GFlVqQ Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1a5e0d7a88294c34ab7db1af7b979c0a Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a5e0d7a88294c34ab7db1af7b979c0a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1a5e0d7a88294c34ab7db1af7b979c0a Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 85652d65dcfd4e0990928f2148729da3 Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: {"security_group_rule": {"parent_group_id": "3fd33f10-51f2-4d54-961d-351f4a92fb42", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: exception: This rule already exists in group 3fd33f10-51f2-4d54-961d-351f4a92fb42 Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3fd33f10-51f2-4d54-961d-351f4a92fb42', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 3fd33f10-51f2-4d54-961d-351f4a92fb42 Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 3fd33f10-51f2-4d54-961d-351f4a92fb42 Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:47.190713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:47.194055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:47.194055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:47.194055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 3fd33f10-51f2-4d54-961d-351f4a92fb42 Oct 12 22:08:47.194055 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:47.194055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0a2aeb6f-9f10-488e-a8d0-d331e3814ea0 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Returning 400 to user: This rule already exists in group 3fd33f10-51f2-4d54-961d-351f4a92fb42 {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:47.194055 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0a2aeb6f-9f10-488e-a8d0-d331e3814ea0 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.099382 Oct 12 22:08:47.194055 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1089/2398] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 12 22:08:47 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:08:47.206155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0254ba38-8573-4f32-a262-9c90727939b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:47.207007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0254ba38-8573-4f32-a262-9c90727939b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:47.207942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0254ba38-8573-4f32-a262-9c90727939b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:47.208507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e3e89ae3-25a7-4a64-bead-67e6e6935052 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Calling method '.version_select at 0x7f512837b310>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:47.209086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0254ba38-8573-4f32-a262-9c90727939b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:47.209742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0254ba38-8573-4f32-a262-9c90727939b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:47.210518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0254ba38-8573-4f32-a262-9c90727939b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:47.287543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0254ba38-8573-4f32-a262-9c90727939b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:47.298970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0254ba38-8573-4f32-a262-9c90727939b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:47.300571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0254ba38-8573-4f32-a262-9c90727939b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:47.306289 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0254ba38-8573-4f32-a262-9c90727939b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.120528 Oct 12 22:08:47.307584 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1310/2399] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:47 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:47.578837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5e1f7460-ffc5-43a1-87d0-15e21e448b73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:47.580308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5e1f7460-ffc5-43a1-87d0-15e21e448b73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:47.590419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e1f7460-ffc5-43a1-87d0-15e21e448b73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:47.605600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e1f7460-ffc5-43a1-87d0-15e21e448b73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:47.606329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e1f7460-ffc5-43a1-87d0-15e21e448b73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:47.607331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e1f7460-ffc5-43a1-87d0-15e21e448b73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:47.607950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e1f7460-ffc5-43a1-87d0-15e21e448b73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:47.608623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e1f7460-ffc5-43a1-87d0-15e21e448b73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:47.694242 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e3e89ae3-25a7-4a64-bead-67e6e6935052 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/ec6dc3a8-9049-4d2e-a4d1-8c91c3ab8b77" status: 202 len: 0 microversion: 2.1 time: 0.489681 Oct 12 22:08:47.695841 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1090/2400] 10.222.0.16 () {58 vars in 1287 bytes} [Wed Oct 12 22:08:47 2022] DELETE /compute/v2.1/os-security-group-rules/ec6dc3a8-9049-4d2e-a4d1-8c91c3ab8b77 => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:08:47.706526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1cea4645-da78-4a06-9101-f3490bd019cf tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Action: 'create', calling method: .version_select at 0x7f51288ea310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-464155747", "description": "tempest-description-74695453"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:47.891751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5e1f7460-ffc5-43a1-87d0-15e21e448b73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:47.902605 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5e1f7460-ffc5-43a1-87d0-15e21e448b73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1365 microversion: 2.1 time: 0.327766 Oct 12 22:08:47.904042 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1311/2401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:47 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1365 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:08:48.215261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0f6bbf41-7b57-4e07-8837-b4e156d8b721 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:48.217189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0f6bbf41-7b57-4e07-8837-b4e156d8b721 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:48.218150 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1cea4645-da78-4a06-9101-f3490bd019cf tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.515914 Oct 12 22:08:48.220125 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1091/2402] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:08:47 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:08:48.235656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b0c8b23f-7244-4948-8492-7fa643d8ed38 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Action: 'create', calling method: .version_select at 0x7f5128411040>, body: {"security_group_rule": {"parent_group_id": "70433e04-211b-4887-bcbb-5aa1671fb74d", "ip_protocol": "tcp", "from_port": 1423559341, "to_port": 22}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:48.244767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f6bbf41-7b57-4e07-8837-b4e156d8b721 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:48.245504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f6bbf41-7b57-4e07-8837-b4e156d8b721 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:48.247348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f6bbf41-7b57-4e07-8837-b4e156d8b721 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:48.248259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f6bbf41-7b57-4e07-8837-b4e156d8b721 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:48.249435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f6bbf41-7b57-4e07-8837-b4e156d8b721 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:48.250275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f6bbf41-7b57-4e07-8837-b4e156d8b721 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:48.338804 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-b0c8b23f-7244-4948-8492-7fa643d8ed38 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] HTTP exception thrown: Invalid port range 1423559341:22. Former value cannot be greater than the later Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b0c8b23f-7244-4948-8492-7fa643d8ed38 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Request method failure captured: Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 146 Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzrtsj66ZReRc_azbQ89iLJjRLtMdwpsuTGX1J0CF3Hc-Oq7kZN0RfkGSbalciR1Zf99O77Ii7c_ybjaxpTXSBZDbhPYpu6rOj94wQeuDpNzUz-YlhRnYWYqX3o99UiVM3NRXU0-iJuMF1pNpwZLsm184mQF2qcTLw8Q4-U6-GFlVqQ Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1a5e0d7a88294c34ab7db1af7b979c0a Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a5e0d7a88294c34ab7db1af7b979c0a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1a5e0d7a88294c34ab7db1af7b979c0a Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 85652d65dcfd4e0990928f2148729da3 Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: {"security_group_rule": {"parent_group_id": "70433e04-211b-4887-bcbb-5aa1671fb74d", "ip_protocol": "tcp", "from_port": 1423559341, "to_port": 22}} Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid port range 1423559341:22. Former value cannot be greater than the later Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'security_group_rule': {'parent_group_id': '70433e04-211b-4887-bcbb-5aa1671fb74d', 'ip_protocol': 'tcp', 'from_port': 1423559341, 'to_port': 22}}} Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1423559341:22. Former value cannot be greater than the later Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1423559341:22. Former value cannot be greater than the later Oct 12 22:08:48.341330 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:48.345488 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:48.345488 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:48.345488 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:48.345488 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:48.345488 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:48.345488 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:48.345488 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:48.345488 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1423559341:22. Former value cannot be greater than the later Oct 12 22:08:48.345488 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:48.346658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b0c8b23f-7244-4948-8492-7fa643d8ed38 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Returning 400 to user: Invalid port range 1423559341:22. Former value cannot be greater than the later {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:48.347888 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b0c8b23f-7244-4948-8492-7fa643d8ed38 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.117852 Oct 12 22:08:48.363222 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1092/2403] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 12 22:08:48 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 12 22:08:48.383385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e1a5b0ea-15ea-407a-a5fd-247fc9c89b79 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:48.383385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e1a5b0ea-15ea-407a-a5fd-247fc9c89b79 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:48.401646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1a5b0ea-15ea-407a-a5fd-247fc9c89b79 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:48.408036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1a5b0ea-15ea-407a-a5fd-247fc9c89b79 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:48.408704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1a5b0ea-15ea-407a-a5fd-247fc9c89b79 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:48.409787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1a5b0ea-15ea-407a-a5fd-247fc9c89b79 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:48.410683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1a5b0ea-15ea-407a-a5fd-247fc9c89b79 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:48.411340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1a5b0ea-15ea-407a-a5fd-247fc9c89b79 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:48.516362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0f6bbf41-7b57-4e07-8837-b4e156d8b721 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c4a14881bf4e7da9f93ffee4f4c78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331af9ac13ef4fc8a569f24e9aa03414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:48.524856 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0f6bbf41-7b57-4e07-8837-b4e156d8b721 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 200 len: 1322 microversion: 2.1 time: 0.319459 Oct 12 22:08:48.525787 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1312/2404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:48 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:08:48.530257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02e7e4b2-9e1c-49c0-a810-cc5a5bca21b7 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Action: 'create', calling method: .version_select at 0x7f512341bdc0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1426445299", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:48.536510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e1a5b0ea-15ea-407a-a5fd-247fc9c89b79 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:48.542117 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-02e7e4b2-9e1c-49c0-a810-cc5a5bca21b7 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] HTTP exception thrown: Security group id should be uuid Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02e7e4b2-9e1c-49c0-a810-cc5a5bca21b7 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Request method failure captured: Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 131 Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzrtsj66ZReRc_azbQ89iLJjRLtMdwpsuTGX1J0CF3Hc-Oq7kZN0RfkGSbalciR1Zf99O77Ii7c_ybjaxpTXSBZDbhPYpu6rOj94wQeuDpNzUz-YlhRnYWYqX3o99UiVM3NRXU0-iJuMF1pNpwZLsm184mQF2qcTLw8Q4-U6-GFlVqQ Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1a5e0d7a88294c34ab7db1af7b979c0a Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a5e0d7a88294c34ab7db1af7b979c0a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1a5e0d7a88294c34ab7db1af7b979c0a Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 85652d65dcfd4e0990928f2148729da3 Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1426445299", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: exception: Security group id should be uuid Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1426445299', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:48.545008 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:48.548287 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 12 22:08:48.548287 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:48.549827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02e7e4b2-9e1c-49c0-a810-cc5a5bca21b7 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Returning 400 to user: Security group id should be uuid {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:48.550257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e1a5b0ea-15ea-407a-a5fd-247fc9c89b79 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:48.551143 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-02e7e4b2-9e1c-49c0-a810-cc5a5bca21b7 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.024533 Oct 12 22:08:48.552111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e1a5b0ea-15ea-407a-a5fd-247fc9c89b79 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:48.552338 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1313/2405] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 12 22:08:48 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:08:48.561529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bda219a1-e62b-400c-bd97-8fc469bd7cc1 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Action: 'create', calling method: .version_select at 0x7f51233e5670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2022745282", "description": "tempest-description-1972595283"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:48.564609 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e1a5b0ea-15ea-407a-a5fd-247fc9c89b79 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.198902 Oct 12 22:08:48.571169 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1093/2406] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:48 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:48.816093 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bda219a1-e62b-400c-bd97-8fc469bd7cc1 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.258943 Oct 12 22:08:48.825943 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1314/2407] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:08:48 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:08:48.831038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-338ae7ba-1b6a-48ad-a82c-5cf29d64bc7f tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Action: 'create', calling method: .version_select at 0x7f512c5768b0>, body: {"security_group_rule": {"parent_group_id": "1c410c94-fc56-47ba-a987-84392d04ebb4", "ip_protocol": "tempest-999-1118326027", "from_port": 22, "to_port": 22}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:48.926792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fa7b53c8-9889-462c-a1cd-9fd4cad62e19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:48.927583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fa7b53c8-9889-462c-a1cd-9fd4cad62e19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:48.945944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa7b53c8-9889-462c-a1cd-9fd4cad62e19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:48.951178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa7b53c8-9889-462c-a1cd-9fd4cad62e19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:48.952683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa7b53c8-9889-462c-a1cd-9fd4cad62e19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:48.953601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa7b53c8-9889-462c-a1cd-9fd4cad62e19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:48.954362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa7b53c8-9889-462c-a1cd-9fd4cad62e19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:48.954871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa7b53c8-9889-462c-a1cd-9fd4cad62e19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:49.072311 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-338ae7ba-1b6a-48ad-a82c-5cf29d64bc7f tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] HTTP exception thrown: Invalid IP protocol tempest-999-1118326027. Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-338ae7ba-1b6a-48ad-a82c-5cf29d64bc7f tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Request method failure captured: Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 157 Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzrtsj66ZReRc_azbQ89iLJjRLtMdwpsuTGX1J0CF3Hc-Oq7kZN0RfkGSbalciR1Zf99O77Ii7c_ybjaxpTXSBZDbhPYpu6rOj94wQeuDpNzUz-YlhRnYWYqX3o99UiVM3NRXU0-iJuMF1pNpwZLsm184mQF2qcTLw8Q4-U6-GFlVqQ Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1a5e0d7a88294c34ab7db1af7b979c0a Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a5e0d7a88294c34ab7db1af7b979c0a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1a5e0d7a88294c34ab7db1af7b979c0a Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 85652d65dcfd4e0990928f2148729da3 Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: {"security_group_rule": {"parent_group_id": "1c410c94-fc56-47ba-a987-84392d04ebb4", "ip_protocol": "tempest-999-1118326027", "from_port": 22, "to_port": 22}} Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid IP protocol tempest-999-1118326027. Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1c410c94-fc56-47ba-a987-84392d04ebb4', 'ip_protocol': 'tempest-999-1118326027', 'from_port': 22, 'to_port': 22}}} Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1118326027. Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1118326027. Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:49.074188 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:49.077699 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:49.077699 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:49.077699 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:49.077699 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:49.077699 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:49.077699 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:49.077699 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1118326027. Oct 12 22:08:49.077699 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:49.077699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-338ae7ba-1b6a-48ad-a82c-5cf29d64bc7f tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Returning 400 to user: Invalid IP protocol tempest-999-1118326027. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:49.077699 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-338ae7ba-1b6a-48ad-a82c-5cf29d64bc7f tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.249164 Oct 12 22:08:49.077699 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1094/2408] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 12 22:08:48 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 251 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:08:49.090774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-71a15d0c-6b1f-4c13-84db-b0a301934fa0 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Action: 'create', calling method: .version_select at 0x7f512c58c3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1439088714", "description": "tempest-description-1270246490"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:49.240592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fa7b53c8-9889-462c-a1cd-9fd4cad62e19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:49.252942 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fa7b53c8-9889-462c-a1cd-9fd4cad62e19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1365 microversion: 2.1 time: 0.329876 Oct 12 22:08:49.254140 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1315/2409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:48 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:08:49.549942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b3d91a0f-14d2-4fb9-b001-1879ff573c89 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:49.550822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b3d91a0f-14d2-4fb9-b001-1879ff573c89 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:49.561057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3d91a0f-14d2-4fb9-b001-1879ff573c89 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:49.564869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3d91a0f-14d2-4fb9-b001-1879ff573c89 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:49.565528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3d91a0f-14d2-4fb9-b001-1879ff573c89 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:49.566427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3d91a0f-14d2-4fb9-b001-1879ff573c89 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:49.568030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3d91a0f-14d2-4fb9-b001-1879ff573c89 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:49.568631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3d91a0f-14d2-4fb9-b001-1879ff573c89 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:49.761349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:49.837436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b3d91a0f-14d2-4fb9-b001-1879ff573c89 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c4a14881bf4e7da9f93ffee4f4c78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331af9ac13ef4fc8a569f24e9aa03414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:49.840505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:49.854528 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b3d91a0f-14d2-4fb9-b001-1879ff573c89 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 200 len: 1322 microversion: 2.1 time: 0.306843 Oct 12 22:08:49.856363 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1316/2410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:49 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:49.883413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ed719c7a-f318-4cb8-9f6a-bf3f9ca4feca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:49.884267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ed719c7a-f318-4cb8-9f6a-bf3f9ca4feca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:49.895467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed719c7a-f318-4cb8-9f6a-bf3f9ca4feca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:49.896160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed719c7a-f318-4cb8-9f6a-bf3f9ca4feca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:49.896819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed719c7a-f318-4cb8-9f6a-bf3f9ca4feca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:49.897926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed719c7a-f318-4cb8-9f6a-bf3f9ca4feca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:49.903319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed719c7a-f318-4cb8-9f6a-bf3f9ca4feca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:49.904411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed719c7a-f318-4cb8-9f6a-bf3f9ca4feca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:50.006061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=14 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:50.042127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ed719c7a-f318-4cb8-9f6a-bf3f9ca4feca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:50.053676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ed719c7a-f318-4cb8-9f6a-bf3f9ca4feca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:50.058756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ed719c7a-f318-4cb8-9f6a-bf3f9ca4feca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:50.083435 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ed719c7a-f318-4cb8-9f6a-bf3f9ca4feca tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.207659 Oct 12 22:08:50.084464 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1317/2411] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:49 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:50.107660 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-71a15d0c-6b1f-4c13-84db-b0a301934fa0 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.024477 Oct 12 22:08:50.116319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-18f2adb6-d15c-4345-8987-8568226facae req-e42dbfd1-690b-4795-9105-220573413ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe8b193-bf33-4af2-bd72-005dfff83900", "name": "network-vif-plugged", "status": "completed", "tag": "92a0f9f4-5667-4383-9be4-f12efc982b5b"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:50.117598 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1095/2412] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:08:49 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:50.120993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-18f2adb6-d15c-4345-8987-8568226facae req-e42dbfd1-690b-4795-9105-220573413ebd service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:50.121616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-18f2adb6-d15c-4345-8987-8568226facae req-e42dbfd1-690b-4795-9105-220573413ebd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:50.122160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-18f2adb6-d15c-4345-8987-8568226facae req-e42dbfd1-690b-4795-9105-220573413ebd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:50.123588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0728f95a-01df-4326-8f6c-fc526f9db8f1 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Action: 'create', calling method: .version_select at 0x7f5128483dc0>, body: {"security_group_rule": {"parent_group_id": "659eee02-4e0e-4f15-a279-5c3be70e2e88", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:50.145343 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-18f2adb6-d15c-4345-8987-8568226facae req-e42dbfd1-690b-4795-9105-220573413ebd service nova] Creating event network-vif-plugged:92a0f9f4-5667-4383-9be4-f12efc982b5b for instance 5fe8b193-bf33-4af2-bd72-005dfff83900 on n-h1-861111-1 Oct 12 22:08:50.150799 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-18f2adb6-d15c-4345-8987-8568226facae req-e42dbfd1-690b-4795-9105-220573413ebd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045300 Oct 12 22:08:50.156414 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1318/2413] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:50.293727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ddf0940e-21f6-4562-98ca-17922b2c3b9e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:50.299722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ddf0940e-21f6-4562-98ca-17922b2c3b9e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:50.308164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddf0940e-21f6-4562-98ca-17922b2c3b9e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:50.309473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddf0940e-21f6-4562-98ca-17922b2c3b9e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:50.310802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddf0940e-21f6-4562-98ca-17922b2c3b9e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:50.314120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddf0940e-21f6-4562-98ca-17922b2c3b9e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:50.315089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddf0940e-21f6-4562-98ca-17922b2c3b9e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:50.317964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddf0940e-21f6-4562-98ca-17922b2c3b9e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:50.363511 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-0728f95a-01df-4326-8f6c-fc526f9db8f1 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0728f95a-01df-4326-8f6c-fc526f9db8f1 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Request method failure captured: Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 138 Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzrtsj66ZReRc_azbQ89iLJjRLtMdwpsuTGX1J0CF3Hc-Oq7kZN0RfkGSbalciR1Zf99O77Ii7c_ybjaxpTXSBZDbhPYpu6rOj94wQeuDpNzUz-YlhRnYWYqX3o99UiVM3NRXU0-iJuMF1pNpwZLsm184mQF2qcTLw8Q4-U6-GFlVqQ Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1a5e0d7a88294c34ab7db1af7b979c0a Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a5e0d7a88294c34ab7db1af7b979c0a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1a5e0d7a88294c34ab7db1af7b979c0a Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 85652d65dcfd4e0990928f2148729da3 Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: {"security_group_rule": {"parent_group_id": "659eee02-4e0e-4f15-a279-5c3be70e2e88", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'security_group_rule': {'parent_group_id': '659eee02-4e0e-4f15-a279-5c3be70e2e88', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 22:08:50.365064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:50.369771 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:50.369771 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:50.369771 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:50.369771 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:50.369771 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:50.369771 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:50.369771 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:50.369771 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 22:08:50.369771 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:50.369771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0728f95a-01df-4326-8f6c-fc526f9db8f1 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:50.369771 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0728f95a-01df-4326-8f6c-fc526f9db8f1 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.247438 Oct 12 22:08:50.378471 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1096/2414] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 12 22:08:50 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 260 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:08:50.383446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-45832c26-1381-413d-9bfb-518c8f049bd9 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Action: 'create', calling method: .version_select at 0x7f512c576280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2091001998", "description": "tempest-description-1510744412"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:50.515056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ddf0940e-21f6-4562-98ca-17922b2c3b9e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:50.524370 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ddf0940e-21f6-4562-98ca-17922b2c3b9e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1365 microversion: 2.1 time: 0.248764 Oct 12 22:08:50.533156 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1319/2415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:50 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:50.854074 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-45832c26-1381-413d-9bfb-518c8f049bd9 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.474339 Oct 12 22:08:50.856030 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1097/2416] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:08:50 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:50.869971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d0f61597-1817-42e9-8f88-bdf983065d69 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Action: 'create', calling method: .version_select at 0x7f51233eec10>, body: {"security_group_rule": {"parent_group_id": "40c12ed6-db20-45fa-8812-fe4276cf3bef", "ip_protocol": "tcp", "from_port": 22, "to_port": 711229581}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:50.889053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6064b9c8-d62b-4ff9-8aa5-1d3cb8e108de tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:50.889645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6064b9c8-d62b-4ff9-8aa5-1d3cb8e108de tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:50.909526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6064b9c8-d62b-4ff9-8aa5-1d3cb8e108de tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:50.911872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6064b9c8-d62b-4ff9-8aa5-1d3cb8e108de tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:50.912322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6064b9c8-d62b-4ff9-8aa5-1d3cb8e108de tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:50.913061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6064b9c8-d62b-4ff9-8aa5-1d3cb8e108de tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:50.915649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6064b9c8-d62b-4ff9-8aa5-1d3cb8e108de tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:50.916489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6064b9c8-d62b-4ff9-8aa5-1d3cb8e108de tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:51.081937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6064b9c8-d62b-4ff9-8aa5-1d3cb8e108de tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c4a14881bf4e7da9f93ffee4f4c78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331af9ac13ef4fc8a569f24e9aa03414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:51.094293 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6064b9c8-d62b-4ff9-8aa5-1d3cb8e108de tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 200 len: 1322 microversion: 2.1 time: 0.216405 Oct 12 22:08:51.096659 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1098/2417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:50 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:08:51.114736 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-d0f61597-1817-42e9-8f88-bdf983065d69 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] HTTP exception thrown: Invalid port range 22:711229581. Valid TCP ports should be between 1-65535 Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d0f61597-1817-42e9-8f88-bdf983065d69 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Request method failure captured: Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 145 Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzrtsj66ZReRc_azbQ89iLJjRLtMdwpsuTGX1J0CF3Hc-Oq7kZN0RfkGSbalciR1Zf99O77Ii7c_ybjaxpTXSBZDbhPYpu6rOj94wQeuDpNzUz-YlhRnYWYqX3o99UiVM3NRXU0-iJuMF1pNpwZLsm184mQF2qcTLw8Q4-U6-GFlVqQ Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1a5e0d7a88294c34ab7db1af7b979c0a Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a5e0d7a88294c34ab7db1af7b979c0a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1a5e0d7a88294c34ab7db1af7b979c0a Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 85652d65dcfd4e0990928f2148729da3 Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: {"security_group_rule": {"parent_group_id": "40c12ed6-db20-45fa-8812-fe4276cf3bef", "ip_protocol": "tcp", "from_port": 22, "to_port": 711229581}} Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid port range 22:711229581. Valid TCP ports should be between 1-65535 Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'security_group_rule': {'parent_group_id': '40c12ed6-db20-45fa-8812-fe4276cf3bef', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 711229581}}} Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:711229581. Valid TCP ports should be between 1-65535 Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:711229581. Valid TCP ports should be between 1-65535 Oct 12 22:08:51.116968 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.120219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:51.120219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.120219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:51.120219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:51.120219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:51.120219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:51.120219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:51.120219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:711229581. Valid TCP ports should be between 1-65535 Oct 12 22:08:51.120219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.122857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d0f61597-1817-42e9-8f88-bdf983065d69 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Returning 400 to user: Invalid port range 22:711229581. Valid TCP ports should be between 1-65535 {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:51.123957 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d0f61597-1817-42e9-8f88-bdf983065d69 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.258251 Oct 12 22:08:51.124174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1c3c7782-6ebf-4250-81b0-7a17487ba1ab tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:51.124799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1c3c7782-6ebf-4250-81b0-7a17487ba1ab tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:51.125790 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1320/2418] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 12 22:08:50 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 261 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:08:51.135117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c3c7782-6ebf-4250-81b0-7a17487ba1ab tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:51.135651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c3c7782-6ebf-4250-81b0-7a17487ba1ab tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:51.136098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c3c7782-6ebf-4250-81b0-7a17487ba1ab tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:51.137311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c3c7782-6ebf-4250-81b0-7a17487ba1ab tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:51.137773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c3c7782-6ebf-4250-81b0-7a17487ba1ab tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:51.138207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c3c7782-6ebf-4250-81b0-7a17487ba1ab tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:51.138892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-507919d6-cf1a-47c1-a654-ed65cde15b07 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Action: 'create', calling method: .version_select at 0x7f5123381430>, body: {"security_group_rule": {"parent_group_id": "0bbb1add-9aed-49e6-8cb7-81b16f90b0ba", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:51.279577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1c3c7782-6ebf-4250-81b0-7a17487ba1ab tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:51.289481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1c3c7782-6ebf-4250-81b0-7a17487ba1ab tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:51.309233 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1c3c7782-6ebf-4250-81b0-7a17487ba1ab tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:51.314811 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1c3c7782-6ebf-4250-81b0-7a17487ba1ab tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.198721 Oct 12 22:08:51.316080 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1099/2419] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:51 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:51.331767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-507919d6-cf1a-47c1-a654-ed65cde15b07 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0bbb1add-9aed-49e6-8cb7-81b16f90b0ba does not exist", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:08:51.333215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.security_group_api [None req-507919d6-cf1a-47c1-a654-ed65cde15b07 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Neutron security group 0bbb1add-9aed-49e6-8cb7-81b16f90b0ba not found {{(pid=120453) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:08:51.333740 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-507919d6-cf1a-47c1-a654-ed65cde15b07 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] HTTP exception thrown: Security group 0bbb1add-9aed-49e6-8cb7-81b16f90b0ba does not exist Oct 12 22:08:51.333740 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-7e714db3-7c07-4188-8c4a-02091dcccd2c'] Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-507919d6-cf1a-47c1-a654-ed65cde15b07 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Request method failure captured: Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 138 Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzrtsj66ZReRc_azbQ89iLJjRLtMdwpsuTGX1J0CF3Hc-Oq7kZN0RfkGSbalciR1Zf99O77Ii7c_ybjaxpTXSBZDbhPYpu6rOj94wQeuDpNzUz-YlhRnYWYqX3o99UiVM3NRXU0-iJuMF1pNpwZLsm184mQF2qcTLw8Q4-U6-GFlVqQ Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1a5e0d7a88294c34ab7db1af7b979c0a Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a5e0d7a88294c34ab7db1af7b979c0a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1a5e0d7a88294c34ab7db1af7b979c0a Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 85652d65dcfd4e0990928f2148729da3 Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: {"security_group_rule": {"parent_group_id": "0bbb1add-9aed-49e6-8cb7-81b16f90b0ba", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: exception: Security group 0bbb1add-9aed-49e6-8cb7-81b16f90b0ba does not exist Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-7e714db3-7c07-4188-8c4a-02091dcccd2c'] Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0bbb1add-9aed-49e6-8cb7-81b16f90b0ba', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:08:51.338318 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0bbb1add-9aed-49e6-8cb7-81b16f90b0ba does not exist Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e714db3-7c07-4188-8c4a-02091dcccd2c'] Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0bbb1add-9aed-49e6-8cb7-81b16f90b0ba does not exist Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e714db3-7c07-4188-8c4a-02091dcccd2c'] Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0bbb1add-9aed-49e6-8cb7-81b16f90b0ba does not exist Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e714db3-7c07-4188-8c4a-02091dcccd2c'] Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0bbb1add-9aed-49e6-8cb7-81b16f90b0ba does not exist Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e714db3-7c07-4188-8c4a-02091dcccd2c'] Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-507919d6-cf1a-47c1-a654-ed65cde15b07 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Returning 404 to user: Security group 0bbb1add-9aed-49e6-8cb7-81b16f90b0ba does not exist Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-7e714db3-7c07-4188-8c4a-02091dcccd2c'] {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-507919d6-cf1a-47c1-a654-ed65cde15b07 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.209673 Oct 12 22:08:51.342263 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1321/2420] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 12 22:08:51 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:08:51.352521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d07e997-69e9-4c60-8807-c3e61811c26a tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Calling method '.version_select at 0x7f51238cf1f0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:51.380222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG neutronclient.v2_0.client [None req-9d07e997-69e9-4c60-8807-c3e61811c26a tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 7aea8707-bb51-4896-abca-25789a0e27c7 does not exist", "detail": ""}} {{(pid=120452) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:08:51.381192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.security_group_api [None req-9d07e997-69e9-4c60-8807-c3e61811c26a tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Neutron security group rule 7aea8707-bb51-4896-abca-25789a0e27c7 not found {{(pid=120452) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 12 22:08:51.381836 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-9d07e997-69e9-4c60-8807-c3e61811c26a tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] HTTP exception thrown: Security group rule 7aea8707-bb51-4896-abca-25789a0e27c7 does not exist Oct 12 22:08:51.381836 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-da86aba8-cb64-4ab4-9701-e779fe1eabe1'] Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d07e997-69e9-4c60-8807-c3e61811c26a tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Request method failure captured: Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/os-security-group-rules/7aea8707-bb51-4896-abca-25789a0e27c7 HTTP/1.1 Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzrtsj66ZReRc_azbQ89iLJjRLtMdwpsuTGX1J0CF3Hc-Oq7kZN0RfkGSbalciR1Zf99O77Ii7c_ybjaxpTXSBZDbhPYpu6rOj94wQeuDpNzUz-YlhRnYWYqX3o99UiVM3NRXU0-iJuMF1pNpwZLsm184mQF2qcTLw8Q4-U6-GFlVqQ Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1a5e0d7a88294c34ab7db1af7b979c0a Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a5e0d7a88294c34ab7db1af7b979c0a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a5e0d7a88294c34ab7db1af7b979c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1a5e0d7a88294c34ab7db1af7b979c0a Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453 Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 85652d65dcfd4e0990928f2148729da3 Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: exception: Security group rule 7aea8707-bb51-4896-abca-25789a0e27c7 does not exist Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-da86aba8-cb64-4ab4-9701-e779fe1eabe1'] Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '7aea8707-bb51-4896-abca-25789a0e27c7'} Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:08:51.386345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 7aea8707-bb51-4896-abca-25789a0e27c7 does not exist Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da86aba8-cb64-4ab4-9701-e779fe1eabe1'] Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 7aea8707-bb51-4896-abca-25789a0e27c7 does not exist Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da86aba8-cb64-4ab4-9701-e779fe1eabe1'] Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 7aea8707-bb51-4896-abca-25789a0e27c7 does not exist Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da86aba8-cb64-4ab4-9701-e779fe1eabe1'] Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 7aea8707-bb51-4896-abca-25789a0e27c7 does not exist Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da86aba8-cb64-4ab4-9701-e779fe1eabe1'] Oct 12 22:08:51.390205 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:51.393274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d07e997-69e9-4c60-8807-c3e61811c26a tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Returning 404 to user: Security group rule 7aea8707-bb51-4896-abca-25789a0e27c7 does not exist Oct 12 22:08:51.393274 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-da86aba8-cb64-4ab4-9701-e779fe1eabe1'] {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:51.394359 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9d07e997-69e9-4c60-8807-c3e61811c26a tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/7aea8707-bb51-4896-abca-25789a0e27c7" status: 404 len: 199 microversion: 2.1 time: 0.045803 Oct 12 22:08:51.396870 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1100/2421] 10.222.0.16 () {58 vars in 1287 bytes} [Wed Oct 12 22:08:51 2022] DELETE /compute/v2.1/os-security-group-rules/7aea8707-bb51-4896-abca-25789a0e27c7 => generated 199 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:08:51.406974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-909e7cea-a6d3-438b-9fa6-0899af8a97d9 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Calling method '.version_select at 0x7f5123381040>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:51.549529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a17fdb72-6f12-466b-b321-5d6d77b5432e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:51.550684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a17fdb72-6f12-466b-b321-5d6d77b5432e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:51.559743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a17fdb72-6f12-466b-b321-5d6d77b5432e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:51.560557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a17fdb72-6f12-466b-b321-5d6d77b5432e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:51.561226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a17fdb72-6f12-466b-b321-5d6d77b5432e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:51.562160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a17fdb72-6f12-466b-b321-5d6d77b5432e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:51.563550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a17fdb72-6f12-466b-b321-5d6d77b5432e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:51.564438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a17fdb72-6f12-466b-b321-5d6d77b5432e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:51.738223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a17fdb72-6f12-466b-b321-5d6d77b5432e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:51.747511 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a17fdb72-6f12-466b-b321-5d6d77b5432e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1365 microversion: 2.1 time: 0.202394 Oct 12 22:08:51.762933 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1101/2422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:51 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:51.856507 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-909e7cea-a6d3-438b-9fa6-0899af8a97d9 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/40c12ed6-db20-45fa-8812-fe4276cf3bef" status: 202 len: 0 microversion: 2.1 time: 0.454334 Oct 12 22:08:51.864857 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1322/2423] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:08:51 2022] DELETE /compute/v2.1/os-security-groups/40c12ed6-db20-45fa-8812-fe4276cf3bef => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:08:51.866541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d38722a-ea33-4942-8214-0f6f4f7ce08b tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Calling method '.version_select at 0x7f51287175e0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:52.068102 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9d38722a-ea33-4942-8214-0f6f4f7ce08b tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/659eee02-4e0e-4f15-a279-5c3be70e2e88" status: 202 len: 0 microversion: 2.1 time: 0.206527 Oct 12 22:08:52.068769 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1102/2424] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:08:51 2022] DELETE /compute/v2.1/os-security-groups/659eee02-4e0e-4f15-a279-5c3be70e2e88 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:08:52.078708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3aa5d4b4-fbf1-4948-a741-ffbfb6869cb3 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Calling method '.version_select at 0x7f5123469b80>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:52.123180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b81fc9f7-b972-4570-af4d-7349fde8abdd tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:52.124182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b81fc9f7-b972-4570-af4d-7349fde8abdd tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:52.130487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81fc9f7-b972-4570-af4d-7349fde8abdd tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:52.130983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81fc9f7-b972-4570-af4d-7349fde8abdd tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:52.131463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81fc9f7-b972-4570-af4d-7349fde8abdd tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:52.132186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81fc9f7-b972-4570-af4d-7349fde8abdd tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:52.132642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81fc9f7-b972-4570-af4d-7349fde8abdd tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:52.133073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81fc9f7-b972-4570-af4d-7349fde8abdd tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:52.279171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b81fc9f7-b972-4570-af4d-7349fde8abdd tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c4a14881bf4e7da9f93ffee4f4c78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331af9ac13ef4fc8a569f24e9aa03414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:52.287736 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b81fc9f7-b972-4570-af4d-7349fde8abdd tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 200 len: 1472 microversion: 2.1 time: 0.169335 Oct 12 22:08:52.288319 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1103/2425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:52 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 1472 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:08:52.311043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-066e59de-28f5-4e89-ab22-6089ddb11e33 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:52.311575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-066e59de-28f5-4e89-ab22-6089ddb11e33 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:52.317949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066e59de-28f5-4e89-ab22-6089ddb11e33 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:52.318459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066e59de-28f5-4e89-ab22-6089ddb11e33 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:52.318888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066e59de-28f5-4e89-ab22-6089ddb11e33 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:52.319633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066e59de-28f5-4e89-ab22-6089ddb11e33 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:52.320089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066e59de-28f5-4e89-ab22-6089ddb11e33 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:52.320518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066e59de-28f5-4e89-ab22-6089ddb11e33 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:52.351117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-066e59de-28f5-4e89-ab22-6089ddb11e33 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '10c4a14881bf4e7da9f93ffee4f4c78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331af9ac13ef4fc8a569f24e9aa03414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-066e59de-28f5-4e89-ab22-6089ddb11e33 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Request method failure captured: Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900/diagnostics HTTP/1.1 Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzrhMtBdzxhtafePf_hv7g45_bHPbMcMbiqBNtGnIp61AatCrvIOtDxjMH-xCc17mWMmBF2Hg9jqbaCFirDiuDwUyU5lWNXHH-AwMrC5QH3bQqwF1tHjWQ8eMAtjisARgRait8xTlvxDzDVVyqJy-VHpydRKxOE70Gf6LhKjo3yp5AA Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 331af9ac13ef4fc8a569f24e9aa03414 Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-275087085 Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/331af9ac13ef4fc8a569f24e9aa03414"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/331af9ac13ef4fc8a569f24e9aa03414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_331af9ac13ef4fc8a569f24e9aa03414", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/331af9ac13ef4fc8a569f24e9aa03414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-275087085 Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 331af9ac13ef4fc8a569f24e9aa03414 Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-275087085 Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerDiagnosticsNegativeTest-275087085-project Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 10c4a14881bf4e7da9f93ffee4f4c78a Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-275087085-project Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'server_id': '5fe8b193-bf33-4af2-bd72-005dfff83900'} Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:52.353511 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:52.357799 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:52.357799 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:52.357799 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:08:52.357799 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:08:52.357799 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 12 22:08:52.357799 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:08:52.357799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-066e59de-28f5-4e89-ab22-6089ddb11e33 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:52.357799 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-066e59de-28f5-4e89-ab22-6089ddb11e33 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.048001 Oct 12 22:08:52.359469 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1104/2426] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:08:52 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900/diagnostics => generated 117 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:08:52.366125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1bbcbf70-5482-4a15-9a5e-913ccc0feb1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:52.366930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1bbcbf70-5482-4a15-9a5e-913ccc0feb1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:52.373691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bbcbf70-5482-4a15-9a5e-913ccc0feb1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:52.374214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bbcbf70-5482-4a15-9a5e-913ccc0feb1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:52.374657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bbcbf70-5482-4a15-9a5e-913ccc0feb1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:52.375411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bbcbf70-5482-4a15-9a5e-913ccc0feb1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:52.376019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bbcbf70-5482-4a15-9a5e-913ccc0feb1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:52.376447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bbcbf70-5482-4a15-9a5e-913ccc0feb1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:52.453763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1bbcbf70-5482-4a15-9a5e-913ccc0feb1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:52.462321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1bbcbf70-5482-4a15-9a5e-913ccc0feb1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:52.463846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1bbcbf70-5482-4a15-9a5e-913ccc0feb1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:52.469445 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1bbcbf70-5482-4a15-9a5e-913ccc0feb1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.108725 Oct 12 22:08:52.470199 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1105/2427] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:52 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:52.480219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0dcbbaf5-e975-4a1d-bdf6-d626aeece486 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:52.480719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0dcbbaf5-e975-4a1d-bdf6-d626aeece486 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:52.486549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dcbbaf5-e975-4a1d-bdf6-d626aeece486 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:52.487043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dcbbaf5-e975-4a1d-bdf6-d626aeece486 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:52.487553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dcbbaf5-e975-4a1d-bdf6-d626aeece486 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:52.488395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dcbbaf5-e975-4a1d-bdf6-d626aeece486 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:52.489115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dcbbaf5-e975-4a1d-bdf6-d626aeece486 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:52.489554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dcbbaf5-e975-4a1d-bdf6-d626aeece486 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:52.518167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0dcbbaf5-e975-4a1d-bdf6-d626aeece486 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:08:52.606622 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0dcbbaf5-e975-4a1d-bdf6-d626aeece486 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 204 len: 0 microversion: 2.1 time: 0.129588 Oct 12 22:08:52.608734 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1106/2428] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:08:52 2022] DELETE /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:08:52.619622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f1c3530d-9b64-437c-b61e-0f2d3f45bb97 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:52.620346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f1c3530d-9b64-437c-b61e-0f2d3f45bb97 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:52.626681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1c3530d-9b64-437c-b61e-0f2d3f45bb97 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:52.627182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1c3530d-9b64-437c-b61e-0f2d3f45bb97 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:52.627775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1c3530d-9b64-437c-b61e-0f2d3f45bb97 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:52.628494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1c3530d-9b64-437c-b61e-0f2d3f45bb97 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:52.628957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1c3530d-9b64-437c-b61e-0f2d3f45bb97 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:52.629386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1c3530d-9b64-437c-b61e-0f2d3f45bb97 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:52.654501 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3aa5d4b4-fbf1-4948-a741-ffbfb6869cb3 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/1c410c94-fc56-47ba-a987-84392d04ebb4" status: 202 len: 0 microversion: 2.1 time: 0.580782 Oct 12 22:08:52.655562 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1323/2429] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:08:52 2022] DELETE /compute/v2.1/os-security-groups/1c410c94-fc56-47ba-a987-84392d04ebb4 => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:08:52.663122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7cb32af4-1c67-4cbf-940b-10ce0865f922 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Calling method '.version_select at 0x7f51233a00d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:52.872998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f1c3530d-9b64-437c-b61e-0f2d3f45bb97 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c4a14881bf4e7da9f93ffee4f4c78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331af9ac13ef4fc8a569f24e9aa03414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:52.894095 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f1c3530d-9b64-437c-b61e-0f2d3f45bb97 tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 200 len: 1478 microversion: 2.1 time: 0.281412 Oct 12 22:08:52.894802 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7cb32af4-1c67-4cbf-940b-10ce0865f922 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/70433e04-211b-4887-bcbb-5aa1671fb74d" status: 202 len: 0 microversion: 2.1 time: 0.235565 Oct 12 22:08:52.895406 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1324/2430] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:08:52 2022] DELETE /compute/v2.1/os-security-groups/70433e04-211b-4887-bcbb-5aa1671fb74d => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:08:52.899753 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1107/2431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:52 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 1478 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:52.905355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2497b078-50e0-47b7-a67a-431a20e12fcb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:52.907617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2497b078-50e0-47b7-a67a-431a20e12fcb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:52.914436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2497b078-50e0-47b7-a67a-431a20e12fcb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:52.915738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2497b078-50e0-47b7-a67a-431a20e12fcb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:52.915738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2497b078-50e0-47b7-a67a-431a20e12fcb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:52.916827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2497b078-50e0-47b7-a67a-431a20e12fcb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:52.917540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2497b078-50e0-47b7-a67a-431a20e12fcb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:52.918702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2497b078-50e0-47b7-a67a-431a20e12fcb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:52.926471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-887b4f84-f31d-49f2-9b09-86adbbb78715 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] Calling method '.version_select at 0x7f512834eaf0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:53.188916 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-887b4f84-f31d-49f2-9b09-86adbbb78715 tempest-SecurityGroupRulesNegativeTestJSON-1910286453 tempest-SecurityGroupRulesNegativeTestJSON-1910286453-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/3fd33f10-51f2-4d54-961d-351f4a92fb42" status: 202 len: 0 microversion: 2.1 time: 0.275830 Oct 12 22:08:53.193143 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1108/2432] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:08:52 2022] DELETE /compute/v2.1/os-security-groups/3fd33f10-51f2-4d54-961d-351f4a92fb42 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:08:53.219746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2497b078-50e0-47b7-a67a-431a20e12fcb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:53.246312 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2497b078-50e0-47b7-a67a-431a20e12fcb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1365 microversion: 2.1 time: 0.348893 Oct 12 22:08:53.247522 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1325/2433] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:52 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1365 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:53.292959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-9decda4e-4142-4eab-844e-c48979eba124 req-f14962b9-de04-42b5-9c50-4f51a3d3edbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4023ebba-05d4-4225-938a-c70c2490ae29", "name": "network-vif-plugged", "status": "completed", "tag": "16f27b0f-2034-49b1-8fc7-d037682a37a4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:53.313854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9decda4e-4142-4eab-844e-c48979eba124 req-f14962b9-de04-42b5-9c50-4f51a3d3edbe service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:53.314346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9decda4e-4142-4eab-844e-c48979eba124 req-f14962b9-de04-42b5-9c50-4f51a3d3edbe service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:53.314783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9decda4e-4142-4eab-844e-c48979eba124 req-f14962b9-de04-42b5-9c50-4f51a3d3edbe service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:53.347330 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-9decda4e-4142-4eab-844e-c48979eba124 req-f14962b9-de04-42b5-9c50-4f51a3d3edbe service nova] Creating event network-vif-plugged:16f27b0f-2034-49b1-8fc7-d037682a37a4 for instance 4023ebba-05d4-4225-938a-c70c2490ae29 on n-h2-861111-1 Oct 12 22:08:53.358754 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-9decda4e-4142-4eab-844e-c48979eba124 req-f14962b9-de04-42b5-9c50-4f51a3d3edbe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069949 Oct 12 22:08:53.362598 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1109/2434] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:53.502602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8a635537-cffd-4487-9a0a-dfad62f6b79f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:53.503534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8a635537-cffd-4487-9a0a-dfad62f6b79f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:53.513571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a635537-cffd-4487-9a0a-dfad62f6b79f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:53.514712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a635537-cffd-4487-9a0a-dfad62f6b79f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:53.516601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a635537-cffd-4487-9a0a-dfad62f6b79f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:53.517582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a635537-cffd-4487-9a0a-dfad62f6b79f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:53.518224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a635537-cffd-4487-9a0a-dfad62f6b79f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:53.518939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a635537-cffd-4487-9a0a-dfad62f6b79f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:53.616722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8a635537-cffd-4487-9a0a-dfad62f6b79f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:53.630884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8a635537-cffd-4487-9a0a-dfad62f6b79f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:53.632922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8a635537-cffd-4487-9a0a-dfad62f6b79f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:53.645909 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8a635537-cffd-4487-9a0a-dfad62f6b79f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.148309 Oct 12 22:08:53.646550 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1326/2435] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:53 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:53.919721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5e9620de-cb20-4bc0-9731-bc1c701c6eef tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:53.920538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5e9620de-cb20-4bc0-9731-bc1c701c6eef tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:53.926899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e9620de-cb20-4bc0-9731-bc1c701c6eef tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:53.927529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e9620de-cb20-4bc0-9731-bc1c701c6eef tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:53.928038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e9620de-cb20-4bc0-9731-bc1c701c6eef tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:53.928828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e9620de-cb20-4bc0-9731-bc1c701c6eef tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:53.929355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e9620de-cb20-4bc0-9731-bc1c701c6eef tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:53.929885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e9620de-cb20-4bc0-9731-bc1c701c6eef tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:53.948954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:08:54.270167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48f5641e-478a-4057-abcc-d1af94e0c4ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:54.271620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-48f5641e-478a-4057-abcc-d1af94e0c4ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:54.278833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48f5641e-478a-4057-abcc-d1af94e0c4ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:54.279263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48f5641e-478a-4057-abcc-d1af94e0c4ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:54.279707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48f5641e-478a-4057-abcc-d1af94e0c4ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:54.280518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48f5641e-478a-4057-abcc-d1af94e0c4ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:54.280976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48f5641e-478a-4057-abcc-d1af94e0c4ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:54.281404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48f5641e-478a-4057-abcc-d1af94e0c4ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:54.346361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5e9620de-cb20-4bc0-9731-bc1c701c6eef tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c4a14881bf4e7da9f93ffee4f4c78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331af9ac13ef4fc8a569f24e9aa03414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:54.355863 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5e9620de-cb20-4bc0-9731-bc1c701c6eef tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 200 len: 1478 microversion: 2.1 time: 0.440958 Oct 12 22:08:54.356748 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1110/2436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:53 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 1478 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:54.433556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-48f5641e-478a-4057-abcc-d1af94e0c4ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:54.443374 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-48f5641e-478a-4057-abcc-d1af94e0c4ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1365 microversion: 2.1 time: 0.177181 Oct 12 22:08:54.445052 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1327/2437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:54 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:54.674871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7f9bb5d3-2653-4a55-9c78-5e50918c4d86 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:54.675529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7f9bb5d3-2653-4a55-9c78-5e50918c4d86 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:54.681773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f9bb5d3-2653-4a55-9c78-5e50918c4d86 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:54.682268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f9bb5d3-2653-4a55-9c78-5e50918c4d86 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:54.682707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f9bb5d3-2653-4a55-9c78-5e50918c4d86 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:54.684099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f9bb5d3-2653-4a55-9c78-5e50918c4d86 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:54.684583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f9bb5d3-2653-4a55-9c78-5e50918c4d86 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:54.685006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f9bb5d3-2653-4a55-9c78-5e50918c4d86 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:55.066683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7f9bb5d3-2653-4a55-9c78-5e50918c4d86 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:55.075200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7f9bb5d3-2653-4a55-9c78-5e50918c4d86 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:55.076782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7f9bb5d3-2653-4a55-9c78-5e50918c4d86 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:55.081994 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7f9bb5d3-2653-4a55-9c78-5e50918c4d86 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.411398 Oct 12 22:08:55.082901 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1111/2438] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:54 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:55.377888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5fd340bc-b2c9-4987-b6fd-5441ab3d509e tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:55.378594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5fd340bc-b2c9-4987-b6fd-5441ab3d509e tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:55.385364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fd340bc-b2c9-4987-b6fd-5441ab3d509e tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:55.385843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fd340bc-b2c9-4987-b6fd-5441ab3d509e tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:55.386786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fd340bc-b2c9-4987-b6fd-5441ab3d509e tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:55.387493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fd340bc-b2c9-4987-b6fd-5441ab3d509e tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:55.387949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fd340bc-b2c9-4987-b6fd-5441ab3d509e tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:55.388368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fd340bc-b2c9-4987-b6fd-5441ab3d509e tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:55.451708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5fd340bc-b2c9-4987-b6fd-5441ab3d509e tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c4a14881bf4e7da9f93ffee4f4c78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331af9ac13ef4fc8a569f24e9aa03414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:55.460648 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5fd340bc-b2c9-4987-b6fd-5441ab3d509e tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 200 len: 1436 microversion: 2.1 time: 0.086072 Oct 12 22:08:55.467743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-32976ea4-6ecf-4627-9212-604c2cf75efd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:55.468510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-32976ea4-6ecf-4627-9212-604c2cf75efd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:55.472423 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1328/2439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:55 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 1436 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:55.477384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32976ea4-6ecf-4627-9212-604c2cf75efd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:55.477761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32976ea4-6ecf-4627-9212-604c2cf75efd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:55.478503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32976ea4-6ecf-4627-9212-604c2cf75efd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:55.479484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32976ea4-6ecf-4627-9212-604c2cf75efd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:55.480740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32976ea4-6ecf-4627-9212-604c2cf75efd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:55.481505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32976ea4-6ecf-4627-9212-604c2cf75efd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:55.706503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-7451b995-9b5a-477c-82fe-6e3ee05759d6 req-9f3a2fd3-79df-4992-b08c-ea7d358112e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe8b193-bf33-4af2-bd72-005dfff83900", "name": "network-vif-deleted", "tag": "92a0f9f4-5667-4383-9be4-f12efc982b5b"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:55.735490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7451b995-9b5a-477c-82fe-6e3ee05759d6 req-9f3a2fd3-79df-4992-b08c-ea7d358112e7 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:55.736394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7451b995-9b5a-477c-82fe-6e3ee05759d6 req-9f3a2fd3-79df-4992-b08c-ea7d358112e7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:55.737047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7451b995-9b5a-477c-82fe-6e3ee05759d6 req-9f3a2fd3-79df-4992-b08c-ea7d358112e7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:55.760210 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-7451b995-9b5a-477c-82fe-6e3ee05759d6 req-9f3a2fd3-79df-4992-b08c-ea7d358112e7 service nova] Creating event network-vif-deleted:92a0f9f4-5667-4383-9be4-f12efc982b5b for instance 5fe8b193-bf33-4af2-bd72-005dfff83900 on n-h1-861111-1 Oct 12 22:08:55.765964 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-7451b995-9b5a-477c-82fe-6e3ee05759d6 req-9f3a2fd3-79df-4992-b08c-ea7d358112e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064341 Oct 12 22:08:55.766907 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1329/2440] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:08:55.911268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-32976ea4-6ecf-4627-9212-604c2cf75efd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:55.919738 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-32976ea4-6ecf-4627-9212-604c2cf75efd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1552 microversion: 2.1 time: 0.457324 Oct 12 22:08:55.920370 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1112/2441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:55 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1552 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:08:55.943105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8d5715ec-9212-4e00-8f4d-6c53836f2f94 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:55.944791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8d5715ec-9212-4e00-8f4d-6c53836f2f94 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:55.952135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d5715ec-9212-4e00-8f4d-6c53836f2f94 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:55.952622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d5715ec-9212-4e00-8f4d-6c53836f2f94 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:55.953053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d5715ec-9212-4e00-8f4d-6c53836f2f94 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:55.953743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d5715ec-9212-4e00-8f4d-6c53836f2f94 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:55.954191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d5715ec-9212-4e00-8f4d-6c53836f2f94 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:55.954617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d5715ec-9212-4e00-8f4d-6c53836f2f94 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:56.038890 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8d5715ec-9212-4e00-8f4d-6c53836f2f94 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099900 Oct 12 22:08:56.039776 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1330/2442] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:08:55 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:56.110800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7edd78d7-7ea6-476a-a6aa-91b5b8d02b89 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:56.111891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7edd78d7-7ea6-476a-a6aa-91b5b8d02b89 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:56.118290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7edd78d7-7ea6-476a-a6aa-91b5b8d02b89 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:56.118968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7edd78d7-7ea6-476a-a6aa-91b5b8d02b89 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:56.119757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7edd78d7-7ea6-476a-a6aa-91b5b8d02b89 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:56.120660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7edd78d7-7ea6-476a-a6aa-91b5b8d02b89 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:56.121418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7edd78d7-7ea6-476a-a6aa-91b5b8d02b89 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:56.121991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7edd78d7-7ea6-476a-a6aa-91b5b8d02b89 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:56.278979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7edd78d7-7ea6-476a-a6aa-91b5b8d02b89 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:56.294692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7edd78d7-7ea6-476a-a6aa-91b5b8d02b89 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:56.297223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7edd78d7-7ea6-476a-a6aa-91b5b8d02b89 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:56.305212 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7edd78d7-7ea6-476a-a6aa-91b5b8d02b89 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1558 microversion: 2.91 time: 0.198304 Oct 12 22:08:56.306301 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1113/2443] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:56 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1558 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:56.501150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1c11b214-a644-4f1e-8e46-d987bf357f3f tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:56.501846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1c11b214-a644-4f1e-8e46-d987bf357f3f tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] [instance: 5fe8b193-bf33-4af2-bd72-005dfff83900] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:56.534591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c11b214-a644-4f1e-8e46-d987bf357f3f tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:56.536404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c11b214-a644-4f1e-8e46-d987bf357f3f tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:56.536896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c11b214-a644-4f1e-8e46-d987bf357f3f tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:56.542062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c11b214-a644-4f1e-8e46-d987bf357f3f tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:56.542706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c11b214-a644-4f1e-8e46-d987bf357f3f tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:56.544901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c11b214-a644-4f1e-8e46-d987bf357f3f tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:56.576838 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-1c11b214-a644-4f1e-8e46-d987bf357f3f tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] HTTP exception thrown: Instance 5fe8b193-bf33-4af2-bd72-005dfff83900 could not be found. Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1c11b214-a644-4f1e-8e46-d987bf357f3f tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Request method failure captured: Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 HTTP/1.1 Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzrhMtBdzxhtafePf_hv7g45_bHPbMcMbiqBNtGnIp61AatCrvIOtDxjMH-xCc17mWMmBF2Hg9jqbaCFirDiuDwUyU5lWNXHH-AwMrC5QH3bQqwF1tHjWQ8eMAtjisARgRait8xTlvxDzDVVyqJy-VHpydRKxOE70Gf6LhKjo3yp5AA Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 331af9ac13ef4fc8a569f24e9aa03414 Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-275087085 Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/331af9ac13ef4fc8a569f24e9aa03414"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/331af9ac13ef4fc8a569f24e9aa03414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_331af9ac13ef4fc8a569f24e9aa03414", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/331af9ac13ef4fc8a569f24e9aa03414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-275087085 Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 331af9ac13ef4fc8a569f24e9aa03414 Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-275087085 Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerDiagnosticsNegativeTest-275087085-project Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 10c4a14881bf4e7da9f93ffee4f4c78a Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-275087085-project Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 5fe8b193-bf33-4af2-bd72-005dfff83900 could not be found. Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '5fe8b193-bf33-4af2-bd72-005dfff83900'} Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fe8b193-bf33-4af2-bd72-005dfff83900 could not be found. Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fe8b193-bf33-4af2-bd72-005dfff83900 could not be found. Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:56.579622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:08:56.585338 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:56.585338 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:08:56.585338 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:08:56.585338 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:08:56.585338 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:08:56.585338 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:08:56.585338 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fe8b193-bf33-4af2-bd72-005dfff83900 could not be found. Oct 12 22:08:56.585338 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:08:56.601413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1c11b214-a644-4f1e-8e46-d987bf357f3f tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] Returning 404 to user: Instance 5fe8b193-bf33-4af2-bd72-005dfff83900 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:08:56.602551 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1c11b214-a644-4f1e-8e46-d987bf357f3f tempest-ServerDiagnosticsNegativeTest-275087085 tempest-ServerDiagnosticsNegativeTest-275087085-project] 10.222.0.16 "GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900" status: 404 len: 111 microversion: 2.1 time: 0.110723 Oct 12 22:08:56.606003 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1331/2444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:08:56 2022] GET /compute/v2.1/servers/5fe8b193-bf33-4af2-bd72-005dfff83900 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:08:57.337621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8cc4ce9e-e94c-43c2-a6fb-4b6625d09363 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:57.338954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8cc4ce9e-e94c-43c2-a6fb-4b6625d09363 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:57.345774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cc4ce9e-e94c-43c2-a6fb-4b6625d09363 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:57.346279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cc4ce9e-e94c-43c2-a6fb-4b6625d09363 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:57.346722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cc4ce9e-e94c-43c2-a6fb-4b6625d09363 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:57.366597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cc4ce9e-e94c-43c2-a6fb-4b6625d09363 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:57.370275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cc4ce9e-e94c-43c2-a6fb-4b6625d09363 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:57.374743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cc4ce9e-e94c-43c2-a6fb-4b6625d09363 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:57.419803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-5c5d13f9-bbd6-45f2-a212-9c70c5a30f3b req-5505b5f2-f27b-4efa-acc5-b0a8d6c4f5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4023ebba-05d4-4225-938a-c70c2490ae29", "tag": "16f27b0f-2034-49b1-8fc7-d037682a37a4"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:08:57.436889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5c5d13f9-bbd6-45f2-a212-9c70c5a30f3b req-5505b5f2-f27b-4efa-acc5-b0a8d6c4f5a6 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:57.444355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5c5d13f9-bbd6-45f2-a212-9c70c5a30f3b req-5505b5f2-f27b-4efa-acc5-b0a8d6c4f5a6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:57.445123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5c5d13f9-bbd6-45f2-a212-9c70c5a30f3b req-5505b5f2-f27b-4efa-acc5-b0a8d6c4f5a6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:57.482069 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-5c5d13f9-bbd6-45f2-a212-9c70c5a30f3b req-5505b5f2-f27b-4efa-acc5-b0a8d6c4f5a6 service nova] Creating event network-changed:16f27b0f-2034-49b1-8fc7-d037682a37a4 for instance 4023ebba-05d4-4225-938a-c70c2490ae29 on n-h2-861111-1 Oct 12 22:08:57.492363 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-5c5d13f9-bbd6-45f2-a212-9c70c5a30f3b req-5505b5f2-f27b-4efa-acc5-b0a8d6c4f5a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079979 Oct 12 22:08:57.497677 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1332/2445] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:57.692824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8cc4ce9e-e94c-43c2-a6fb-4b6625d09363 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:57.706587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8cc4ce9e-e94c-43c2-a6fb-4b6625d09363 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:57.736158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8cc4ce9e-e94c-43c2-a6fb-4b6625d09363 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:57.776112 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8cc4ce9e-e94c-43c2-a6fb-4b6625d09363 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.442279 Oct 12 22:08:57.796124 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1114/2446] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:57 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:08:58.161637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3be8bc75-6245-4716-a654-040e063b1340 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:58.166407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3be8bc75-6245-4716-a654-040e063b1340 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:58.180526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3be8bc75-6245-4716-a654-040e063b1340 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:58.182834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3be8bc75-6245-4716-a654-040e063b1340 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:58.184136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3be8bc75-6245-4716-a654-040e063b1340 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:58.186404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3be8bc75-6245-4716-a654-040e063b1340 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:58.189356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3be8bc75-6245-4716-a654-040e063b1340 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:58.190075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3be8bc75-6245-4716-a654-040e063b1340 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:58.273177 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3be8bc75-6245-4716-a654-040e063b1340 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116874 Oct 12 22:08:58.274392 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1333/2447] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:08:58 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:08:58.285316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-460176a7-9f78-451e-976d-aecfd83f6012 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:58.286173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-460176a7-9f78-451e-976d-aecfd83f6012 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:58.295918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-460176a7-9f78-451e-976d-aecfd83f6012 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:58.297637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-460176a7-9f78-451e-976d-aecfd83f6012 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:58.298234 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-460176a7-9f78-451e-976d-aecfd83f6012 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:58.299994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-460176a7-9f78-451e-976d-aecfd83f6012 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:58.301463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-460176a7-9f78-451e-976d-aecfd83f6012 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:58.302735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-460176a7-9f78-451e-976d-aecfd83f6012 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:58.519468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-460176a7-9f78-451e-976d-aecfd83f6012 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lazy-loading 'services' on Instance uuid 54a23a46-7ad2-4563-a557-1806d4d61253 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:08:58.691016 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-460176a7-9f78-451e-976d-aecfd83f6012 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "DELETE /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253/os-volume_attachments/0657275e-1af3-44f9-be6d-05fa320e128c" status: 202 len: 0 microversion: 2.1 time: 0.409353 Oct 12 22:08:58.691870 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1115/2448] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 22:08:58 2022] DELETE /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253/os-volume_attachments/0657275e-1af3-44f9-be6d-05fa320e128c => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:08:58.810273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-028c07f8-8311-4e4c-bd86-332b62051e27 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:08:58.810877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-028c07f8-8311-4e4c-bd86-332b62051e27 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:08:58.817165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-028c07f8-8311-4e4c-bd86-332b62051e27 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:58.818072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-028c07f8-8311-4e4c-bd86-332b62051e27 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:58.819439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-028c07f8-8311-4e4c-bd86-332b62051e27 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:58.820484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-028c07f8-8311-4e4c-bd86-332b62051e27 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:08:58.821086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-028c07f8-8311-4e4c-bd86-332b62051e27 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:08:58.821718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-028c07f8-8311-4e4c-bd86-332b62051e27 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:08:59.260296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-028c07f8-8311-4e4c-bd86-332b62051e27 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:59.275157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-028c07f8-8311-4e4c-bd86-332b62051e27 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:59.279292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-028c07f8-8311-4e4c-bd86-332b62051e27 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:08:59.295612 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-028c07f8-8311-4e4c-bd86-332b62051e27 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.489670 Oct 12 22:08:59.314295 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1334/2449] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:08:58 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:00.337725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-47b0003e-3d4b-4d83-a86f-1c978e3106a2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:00.338427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-47b0003e-3d4b-4d83-a86f-1c978e3106a2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:00.357455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b0003e-3d4b-4d83-a86f-1c978e3106a2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:00.360343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b0003e-3d4b-4d83-a86f-1c978e3106a2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:00.360985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b0003e-3d4b-4d83-a86f-1c978e3106a2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:00.365031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b0003e-3d4b-4d83-a86f-1c978e3106a2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:00.365667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b0003e-3d4b-4d83-a86f-1c978e3106a2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:00.366261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b0003e-3d4b-4d83-a86f-1c978e3106a2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:00.634449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-47b0003e-3d4b-4d83-a86f-1c978e3106a2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:00.645697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-47b0003e-3d4b-4d83-a86f-1c978e3106a2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:00.647142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-47b0003e-3d4b-4d83-a86f-1c978e3106a2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:00.657493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:00.666481 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-47b0003e-3d4b-4d83-a86f-1c978e3106a2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.340642 Oct 12 22:09:00.672248 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1116/2450] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:00 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:01.703913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-62cfc89f-1a84-42a2-9ac8-88a1bf951ecf tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:01.705114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-62cfc89f-1a84-42a2-9ac8-88a1bf951ecf tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:01.726071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62cfc89f-1a84-42a2-9ac8-88a1bf951ecf tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:01.736364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62cfc89f-1a84-42a2-9ac8-88a1bf951ecf tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:01.738175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62cfc89f-1a84-42a2-9ac8-88a1bf951ecf tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:01.739523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62cfc89f-1a84-42a2-9ac8-88a1bf951ecf tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:01.740181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62cfc89f-1a84-42a2-9ac8-88a1bf951ecf tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:01.740795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62cfc89f-1a84-42a2-9ac8-88a1bf951ecf tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:01.952566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-62cfc89f-1a84-42a2-9ac8-88a1bf951ecf tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:01.966788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-62cfc89f-1a84-42a2-9ac8-88a1bf951ecf tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:01.976195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-62cfc89f-1a84-42a2-9ac8-88a1bf951ecf tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:01.982935 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-62cfc89f-1a84-42a2-9ac8-88a1bf951ecf tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.284617 Oct 12 22:09:01.983859 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1335/2451] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:01 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:03.016227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1d2eb245-8c93-49da-8a96-bffb96b4f5f1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:03.016953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1d2eb245-8c93-49da-8a96-bffb96b4f5f1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:03.074888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d2eb245-8c93-49da-8a96-bffb96b4f5f1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:03.076535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d2eb245-8c93-49da-8a96-bffb96b4f5f1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:03.081802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d2eb245-8c93-49da-8a96-bffb96b4f5f1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:03.083891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d2eb245-8c93-49da-8a96-bffb96b4f5f1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:03.084902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d2eb245-8c93-49da-8a96-bffb96b4f5f1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:03.086406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d2eb245-8c93-49da-8a96-bffb96b4f5f1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:03.329748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1d2eb245-8c93-49da-8a96-bffb96b4f5f1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:03.345525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1d2eb245-8c93-49da-8a96-bffb96b4f5f1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:03.349955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1d2eb245-8c93-49da-8a96-bffb96b4f5f1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:03.363905 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1d2eb245-8c93-49da-8a96-bffb96b4f5f1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.352934 Oct 12 22:09:03.380578 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1117/2452] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:03 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:03.568360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2009805868", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:03.685419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] validate_networks() for None {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:09:03.992864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:09:03.993670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:09:03.994300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:09:03.994856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:09:03.996046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:09:04.006762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:04.007592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:04.008460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:04.009476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:04.010134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:04.010785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:04.039533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:09:04.052305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:04.054135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:09:04.085542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:09:04.088606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:09:04.158541 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b8427db4-fa1d-4daa-98db-f5c379507099 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.889912 Oct 12 22:09:04.161562 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1336/2453] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:09:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:09:04.172829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ea4f85eb-2512-4479-be8b-1580dbac70c2 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:04.174470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ea4f85eb-2512-4479-be8b-1580dbac70c2 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:04.376533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ea4f85eb-2512-4479-be8b-1580dbac70c2 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:04.383735 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ea4f85eb-2512-4479-be8b-1580dbac70c2 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 200 len: 1217 microversion: 2.1 time: 0.214833 Oct 12 22:09:04.396213 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1118/2454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:04 2022] GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 1217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:04.401176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f3e21e72-ec36-4f26-b916-f130ed98dbad tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:04.402372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f3e21e72-ec36-4f26-b916-f130ed98dbad tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:04.418042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3e21e72-ec36-4f26-b916-f130ed98dbad tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:04.418601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3e21e72-ec36-4f26-b916-f130ed98dbad tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:04.420453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3e21e72-ec36-4f26-b916-f130ed98dbad tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:04.421544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3e21e72-ec36-4f26-b916-f130ed98dbad tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:04.421972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3e21e72-ec36-4f26-b916-f130ed98dbad tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:04.422691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3e21e72-ec36-4f26-b916-f130ed98dbad tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:04.557170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f3e21e72-ec36-4f26-b916-f130ed98dbad tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:04.565946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f3e21e72-ec36-4f26-b916-f130ed98dbad tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:04.568100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f3e21e72-ec36-4f26-b916-f130ed98dbad tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:04.574410 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f3e21e72-ec36-4f26-b916-f130ed98dbad tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.177186 Oct 12 22:09:04.591670 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1337/2455] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:04 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:05.427842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a6a39e3d-33e5-480d-acab-cf00df4276fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:05.429287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a6a39e3d-33e5-480d-acab-cf00df4276fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:05.455184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6a39e3d-33e5-480d-acab-cf00df4276fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:05.458577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6a39e3d-33e5-480d-acab-cf00df4276fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:05.464088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6a39e3d-33e5-480d-acab-cf00df4276fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:05.467753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6a39e3d-33e5-480d-acab-cf00df4276fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:05.468538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6a39e3d-33e5-480d-acab-cf00df4276fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:05.485598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6a39e3d-33e5-480d-acab-cf00df4276fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:05.604726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-565b615a-22ea-4a24-afa4-f132db481694 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:05.605344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-565b615a-22ea-4a24-afa4-f132db481694 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:05.609447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a6a39e3d-33e5-480d-acab-cf00df4276fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:05.615375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-565b615a-22ea-4a24-afa4-f132db481694 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:05.615868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-565b615a-22ea-4a24-afa4-f132db481694 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:05.616306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-565b615a-22ea-4a24-afa4-f132db481694 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:05.621584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-565b615a-22ea-4a24-afa4-f132db481694 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:05.622486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-565b615a-22ea-4a24-afa4-f132db481694 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:05.634886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-565b615a-22ea-4a24-afa4-f132db481694 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:05.645030 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a6a39e3d-33e5-480d-acab-cf00df4276fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 200 len: 1213 microversion: 2.1 time: 0.212879 Oct 12 22:09:05.666797 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1119/2456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:05 2022] GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 1213 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:05.770575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-565b615a-22ea-4a24-afa4-f132db481694 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:05.783343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-565b615a-22ea-4a24-afa4-f132db481694 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:05.787428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-565b615a-22ea-4a24-afa4-f132db481694 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:05.799363 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-565b615a-22ea-4a24-afa4-f132db481694 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.199196 Oct 12 22:09:05.812140 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1338/2457] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:05 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:06.678230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3364566b-c13b-49ad-a1c2-cd6aa82afe3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:06.682207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3364566b-c13b-49ad-a1c2-cd6aa82afe3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:06.722948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3364566b-c13b-49ad-a1c2-cd6aa82afe3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:06.731641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3364566b-c13b-49ad-a1c2-cd6aa82afe3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:06.735541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3364566b-c13b-49ad-a1c2-cd6aa82afe3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:06.737958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3364566b-c13b-49ad-a1c2-cd6aa82afe3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:06.740404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3364566b-c13b-49ad-a1c2-cd6aa82afe3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:06.746201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3364566b-c13b-49ad-a1c2-cd6aa82afe3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:06.831114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-664a4124-b0e3-46f6-9ebb-50ef88974f02 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:06.833215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-664a4124-b0e3-46f6-9ebb-50ef88974f02 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:06.842098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-664a4124-b0e3-46f6-9ebb-50ef88974f02 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:06.842589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-664a4124-b0e3-46f6-9ebb-50ef88974f02 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:06.843022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-664a4124-b0e3-46f6-9ebb-50ef88974f02 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:06.849232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-664a4124-b0e3-46f6-9ebb-50ef88974f02 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:06.853686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-664a4124-b0e3-46f6-9ebb-50ef88974f02 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:06.856028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-664a4124-b0e3-46f6-9ebb-50ef88974f02 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:06.976691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3364566b-c13b-49ad-a1c2-cd6aa82afe3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:06.989253 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3364566b-c13b-49ad-a1c2-cd6aa82afe3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 200 len: 1275 microversion: 2.1 time: 0.313982 Oct 12 22:09:07.007698 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1120/2458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:06 2022] GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 1275 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:07.078603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-664a4124-b0e3-46f6-9ebb-50ef88974f02 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:07.087727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-664a4124-b0e3-46f6-9ebb-50ef88974f02 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:07.089767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-664a4124-b0e3-46f6-9ebb-50ef88974f02 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:07.112891 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-664a4124-b0e3-46f6-9ebb-50ef88974f02 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.285653 Oct 12 22:09:07.116363 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1339/2459] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:06 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:08.022535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6d606cf9-3d31-4a85-9f06-fbc4a9c7ead4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:08.024005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6d606cf9-3d31-4a85-9f06-fbc4a9c7ead4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:08.041180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d606cf9-3d31-4a85-9f06-fbc4a9c7ead4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:08.042752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d606cf9-3d31-4a85-9f06-fbc4a9c7ead4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:08.043751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d606cf9-3d31-4a85-9f06-fbc4a9c7ead4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:08.046792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d606cf9-3d31-4a85-9f06-fbc4a9c7ead4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:08.047668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d606cf9-3d31-4a85-9f06-fbc4a9c7ead4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:08.048923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d606cf9-3d31-4a85-9f06-fbc4a9c7ead4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:08.285478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-616233123", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:08.392317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:09:08.611408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6d606cf9-3d31-4a85-9f06-fbc4a9c7ead4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:08.624184 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6d606cf9-3d31-4a85-9f06-fbc4a9c7ead4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 200 len: 1317 microversion: 2.1 time: 0.606870 Oct 12 22:09:08.626914 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1340/2460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:08 2022] GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 1317 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:08.634997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-55bdb99d-8c33-408a-9938-3e39657fec37 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:08.641991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-55bdb99d-8c33-408a-9938-3e39657fec37 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:08.659790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55bdb99d-8c33-408a-9938-3e39657fec37 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:08.662071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55bdb99d-8c33-408a-9938-3e39657fec37 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:08.662698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55bdb99d-8c33-408a-9938-3e39657fec37 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:08.666115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55bdb99d-8c33-408a-9938-3e39657fec37 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:08.666737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55bdb99d-8c33-408a-9938-3e39657fec37 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:08.668179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55bdb99d-8c33-408a-9938-3e39657fec37 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:08.750168 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-55bdb99d-8c33-408a-9938-3e39657fec37 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120730 Oct 12 22:09:08.750769 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1341/2461] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:09:08 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:09:08.755702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d5dafc88-4e51-4213-b00c-b36106c6e451 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:08.759676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d5dafc88-4e51-4213-b00c-b36106c6e451 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:08.775869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5dafc88-4e51-4213-b00c-b36106c6e451 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:08.778134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5dafc88-4e51-4213-b00c-b36106c6e451 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:08.778790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5dafc88-4e51-4213-b00c-b36106c6e451 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:08.781070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5dafc88-4e51-4213-b00c-b36106c6e451 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:08.781819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5dafc88-4e51-4213-b00c-b36106c6e451 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:08.785527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5dafc88-4e51-4213-b00c-b36106c6e451 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:08.798087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:08.913220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d5dafc88-4e51-4213-b00c-b36106c6e451 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:08.921017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:09:08.922873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:09:08.923539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:09:08.924098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:09:08.924657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:09:08.926371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d5dafc88-4e51-4213-b00c-b36106c6e451 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:08.928038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d5dafc88-4e51-4213-b00c-b36106c6e451 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:08.943251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:08.943761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:08.943995 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d5dafc88-4e51-4213-b00c-b36106c6e451 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.189351 Oct 12 22:09:08.944208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:08.944950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:08.945410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:08.945790 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1342/2462] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:08 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:08.955355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:08.974929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-44c29437-532a-4473-8d34-7d8085ea4213 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:08.977649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-44c29437-532a-4473-8d34-7d8085ea4213 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:08.985490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44c29437-532a-4473-8d34-7d8085ea4213 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:08.986240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Getting quotas for project 2963196dad204be0bfb1d9f27f4a1968. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:09:08.986364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44c29437-532a-4473-8d34-7d8085ea4213 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:08.986914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44c29437-532a-4473-8d34-7d8085ea4213 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:08.987777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44c29437-532a-4473-8d34-7d8085ea4213 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:08.988385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44c29437-532a-4473-8d34-7d8085ea4213 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:08.990122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44c29437-532a-4473-8d34-7d8085ea4213 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:08.999954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Getting quotas for user 7d2edcc7683f4df8bca17a3648c4d59b and project 2963196dad204be0bfb1d9f27f4a1968. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:09:09.025447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:09:09.027898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:09:09.052358 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-44c29437-532a-4473-8d34-7d8085ea4213 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088664 Oct 12 22:09:09.053563 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1343/2463] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:09:08 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:09:09.134210 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-940d7e52-291e-4318-9c2c-dde8127f6116 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.213337 Oct 12 22:09:09.160446 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1121/2464] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:09:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:09:09.180858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-90926277-bfa2-4483-a896-6c98efffe555 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:09.181603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-90926277-bfa2-4483-a896-6c98efffe555 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:09.190735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90926277-bfa2-4483-a896-6c98efffe555 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:09.191427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90926277-bfa2-4483-a896-6c98efffe555 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:09.192038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90926277-bfa2-4483-a896-6c98efffe555 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:09.192886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90926277-bfa2-4483-a896-6c98efffe555 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:09.193494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90926277-bfa2-4483-a896-6c98efffe555 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:09.194089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90926277-bfa2-4483-a896-6c98efffe555 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:09.231332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-90926277-bfa2-4483-a896-6c98efffe555 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:09:09.243709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-866404776", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:09.349550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:09:09.407744 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-90926277-bfa2-4483-a896-6c98efffe555 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "DELETE /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 204 len: 0 microversion: 2.1 time: 0.230961 Oct 12 22:09:09.411295 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1344/2465] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:09:09 2022] DELETE /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:09:09.430029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0c693f04-89d9-4bfe-9bbe-940948fcc67c tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:09.438247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0c693f04-89d9-4bfe-9bbe-940948fcc67c tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:09.472139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c693f04-89d9-4bfe-9bbe-940948fcc67c tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:09.475776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c693f04-89d9-4bfe-9bbe-940948fcc67c tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:09.476341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c693f04-89d9-4bfe-9bbe-940948fcc67c tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:09.480599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c693f04-89d9-4bfe-9bbe-940948fcc67c tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:09.481139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c693f04-89d9-4bfe-9bbe-940948fcc67c tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:09.481590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c693f04-89d9-4bfe-9bbe-940948fcc67c tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:09.968214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0c693f04-89d9-4bfe-9bbe-940948fcc67c tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:09.977459 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0c693f04-89d9-4bfe-9bbe-940948fcc67c tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1682 microversion: 2.1 time: 0.561693 Oct 12 22:09:09.985378 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1345/2466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:09 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1682 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:09.992176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-21dc1bd3-03ba-4a7a-b397-26b995f5ae6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:09.997026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-21dc1bd3-03ba-4a7a-b397-26b995f5ae6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:10.014767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21dc1bd3-03ba-4a7a-b397-26b995f5ae6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:10.015417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21dc1bd3-03ba-4a7a-b397-26b995f5ae6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:10.015964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21dc1bd3-03ba-4a7a-b397-26b995f5ae6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:10.016792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21dc1bd3-03ba-4a7a-b397-26b995f5ae6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:10.028004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21dc1bd3-03ba-4a7a-b397-26b995f5ae6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:10.028631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21dc1bd3-03ba-4a7a-b397-26b995f5ae6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:10.402109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-21dc1bd3-03ba-4a7a-b397-26b995f5ae6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:10.419964 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-21dc1bd3-03ba-4a7a-b397-26b995f5ae6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 200 len: 1317 microversion: 2.1 time: 0.431254 Oct 12 22:09:10.420674 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1346/2467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:09 2022] GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:10.425492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c7627783-cbf9-4350-950a-53c4507546ed tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:10.430881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c7627783-cbf9-4350-950a-53c4507546ed tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:10.445610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7627783-cbf9-4350-950a-53c4507546ed tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:10.446344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7627783-cbf9-4350-950a-53c4507546ed tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:10.446910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:09:10.447408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:09:10.447811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:09:10.448755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:09:10.448980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7627783-cbf9-4350-950a-53c4507546ed tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:10.449177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:09:10.449875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7627783-cbf9-4350-950a-53c4507546ed tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:10.450337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7627783-cbf9-4350-950a-53c4507546ed tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:10.450769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7627783-cbf9-4350-950a-53c4507546ed tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:10.478222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:10.478969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:10.480169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:10.481636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:10.482577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:10.483160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:10.506724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Getting quotas for project 2963196dad204be0bfb1d9f27f4a1968. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:09:10.513474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Getting quotas for user 7d2edcc7683f4df8bca17a3648c4d59b and project 2963196dad204be0bfb1d9f27f4a1968. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:09:10.528546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:09:10.531051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:09:10.615739 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-aee9a666-1729-4792-959d-a85b2479adfa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.376683 Oct 12 22:09:10.622380 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1122/2468] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:09:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:09:10.627842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2b2131f8-7311-4238-8af1-5c0f5a5df86b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:10.628728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2b2131f8-7311-4238-8af1-5c0f5a5df86b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:10.747558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c7627783-cbf9-4350-950a-53c4507546ed tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:10.778779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c7627783-cbf9-4350-950a-53c4507546ed tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:10.805573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c7627783-cbf9-4350-950a-53c4507546ed tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:10.836540 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c7627783-cbf9-4350-950a-53c4507546ed tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.408427 Oct 12 22:09:10.851123 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1347/2469] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:10 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:10.865226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2b2131f8-7311-4238-8af1-5c0f5a5df86b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:10.874761 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2b2131f8-7311-4238-8af1-5c0f5a5df86b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1213 microversion: 2.1 time: 0.251039 Oct 12 22:09:10.875570 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1123/2470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:10 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1213 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:10.962566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-99fa9ba6-739c-4b0e-bedf-3d76cf7dd64f req-7e378e25-909e-40db-9313-cb9ccb8b1ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c884fd7-d12b-4faa-95e1-96646f21ef60", "tag": "e1e05e36-e77d-467a-8a79-0fded528c3ed"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:10.987601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-99fa9ba6-739c-4b0e-bedf-3d76cf7dd64f req-7e378e25-909e-40db-9313-cb9ccb8b1ff9 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:10.988081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-99fa9ba6-739c-4b0e-bedf-3d76cf7dd64f req-7e378e25-909e-40db-9313-cb9ccb8b1ff9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:10.988513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-99fa9ba6-739c-4b0e-bedf-3d76cf7dd64f req-7e378e25-909e-40db-9313-cb9ccb8b1ff9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:11.009336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6d8a5a9d-7636-42d8-9f24-33c269289d34 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:11.009968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6d8a5a9d-7636-42d8-9f24-33c269289d34 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:11.036173 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-99fa9ba6-739c-4b0e-bedf-3d76cf7dd64f req-7e378e25-909e-40db-9313-cb9ccb8b1ff9 service nova] Creating event network-changed:e1e05e36-e77d-467a-8a79-0fded528c3ed for instance 3c884fd7-d12b-4faa-95e1-96646f21ef60 on n-h1-861111-1 Oct 12 22:09:11.046024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8a5a9d-7636-42d8-9f24-33c269289d34 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:11.055522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8a5a9d-7636-42d8-9f24-33c269289d34 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:11.056219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8a5a9d-7636-42d8-9f24-33c269289d34 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:11.056337 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-99fa9ba6-739c-4b0e-bedf-3d76cf7dd64f req-7e378e25-909e-40db-9313-cb9ccb8b1ff9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097684 Oct 12 22:09:11.057200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8a5a9d-7636-42d8-9f24-33c269289d34 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:11.059159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8a5a9d-7636-42d8-9f24-33c269289d34 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:11.059298 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1348/2471] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:11.059918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8a5a9d-7636-42d8-9f24-33c269289d34 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:11.070200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6a7134f6-a419-4a20-a738-a5dc8d02e8dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:11.070937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6a7134f6-a419-4a20-a738-a5dc8d02e8dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:11.089420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a7134f6-a419-4a20-a738-a5dc8d02e8dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:11.090225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a7134f6-a419-4a20-a738-a5dc8d02e8dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:11.092450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a7134f6-a419-4a20-a738-a5dc8d02e8dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:11.093351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a7134f6-a419-4a20-a738-a5dc8d02e8dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:11.095553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a7134f6-a419-4a20-a738-a5dc8d02e8dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:11.096223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a7134f6-a419-4a20-a738-a5dc8d02e8dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:11.154709 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6a7134f6-a419-4a20-a738-a5dc8d02e8dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153/ips" status: 200 len: 151 microversion: 2.1 time: 0.094104 Oct 12 22:09:11.164496 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1349/2472] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 22:09:11 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153/ips => generated 151 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:11.175821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5c94ca9e-538c-455c-8bb0-d58477bb0c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f8206e7-dd62-47f9-87fc-d9656a73db92"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:11.181777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5c94ca9e-538c-455c-8bb0-d58477bb0c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:11.199420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c94ca9e-538c-455c-8bb0-d58477bb0c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:11.200163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c94ca9e-538c-455c-8bb0-d58477bb0c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:11.202824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c94ca9e-538c-455c-8bb0-d58477bb0c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:11.204461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c94ca9e-538c-455c-8bb0-d58477bb0c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:11.207125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c94ca9e-538c-455c-8bb0-d58477bb0c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:11.208004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c94ca9e-538c-455c-8bb0-d58477bb0c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:11.412477 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-5c94ca9e-538c-455c-8bb0-d58477bb0c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] HTTP exception thrown: Invalid volume: volume 0f8206e7-dd62-47f9-87fc-d9656a73db92 is already attached to instances: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5c94ca9e-538c-455c-8bb0-d58477bb0c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Request method failure captured: Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153/os-volume_attachments HTTP/1.1 Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 74 Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzoV3foVnGv0suVxK_Nk7Pp5_kjAPhL8yzVHClSGl5RRxDIZH7rcf5PLHi4YXEet-A0AtHcDaHpFcS_aQR9wl8soXuphQXdzTm1zPCiMI4BUWAPu4l1z3R9DkYDtzHZhHRlT-3CEyzuxgoolPW6Gw8glco6cFnu099ScND31HIZBEC4 Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68913d260d084ce4a8e29daf4783c0bc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 13c74a78e82f4e72a7d1f7b133074f5a Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: {"volumeAttachment": {"volumeId": "0f8206e7-dd62-47f9-87fc-d9656a73db92"}} Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid volume: volume 0f8206e7-dd62-47f9-87fc-d9656a73db92 is already attached to instances: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'server_id': '77548da5-9429-4e07-bdad-7902d89d4153', 'body': {'volumeAttachment': {'volumeId': '0f8206e7-dd62-47f9-87fc-d9656a73db92'}}} Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0f8206e7-dd62-47f9-87fc-d9656a73db92 is already attached to instances: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:09:11.414222 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:09:11.418092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:09:11.418092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:09:11.418092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 12 22:09:11.418092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 22:09:11.418092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0f8206e7-dd62-47f9-87fc-d9656a73db92 is already attached to instances: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 Oct 12 22:09:11.418092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:11.418092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:11.418092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:11.418092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:11.418092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:11.418092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:11.418092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:09:11.418092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:09:11.418092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0f8206e7-dd62-47f9-87fc-d9656a73db92 is already attached to instances: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 Oct 12 22:09:11.418092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:11.418092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5c94ca9e-538c-455c-8bb0-d58477bb0c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Returning 400 to user: Invalid volume: volume 0f8206e7-dd62-47f9-87fc-d9656a73db92 is already attached to instances: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:09:11.421168 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5c94ca9e-538c-455c-8bb0-d58477bb0c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "POST /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.249661 Oct 12 22:09:11.432525 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1350/2473] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 22:09:11 2022] POST /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153/os-volume_attachments => generated 174 bytes in 267 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:09:11.467538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-480611b2-99bf-4129-bdae-694006474752 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:11.468057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-480611b2-99bf-4129-bdae-694006474752 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:11.493419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-480611b2-99bf-4129-bdae-694006474752 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:11.498740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-480611b2-99bf-4129-bdae-694006474752 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:11.499209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-480611b2-99bf-4129-bdae-694006474752 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:11.499977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-480611b2-99bf-4129-bdae-694006474752 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:11.500441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-480611b2-99bf-4129-bdae-694006474752 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:11.500879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-480611b2-99bf-4129-bdae-694006474752 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:11.581253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-480611b2-99bf-4129-bdae-694006474752 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:09:11.669421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6d8a5a9d-7636-42d8-9f24-33c269289d34 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:11.677843 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6d8a5a9d-7636-42d8-9f24-33c269289d34 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1682 microversion: 2.1 time: 0.673214 Oct 12 22:09:11.680959 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1124/2474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:11 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1682 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:09:11.695811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0e0067c9-655d-4846-b964-4538e27c6c6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:11.696767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0e0067c9-655d-4846-b964-4538e27c6c6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:11.713983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e0067c9-655d-4846-b964-4538e27c6c6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:11.715087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e0067c9-655d-4846-b964-4538e27c6c6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:11.716330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e0067c9-655d-4846-b964-4538e27c6c6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:11.717855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e0067c9-655d-4846-b964-4538e27c6c6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:11.718684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e0067c9-655d-4846-b964-4538e27c6c6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:11.719391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e0067c9-655d-4846-b964-4538e27c6c6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:11.824056 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-480611b2-99bf-4129-bdae-694006474752 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "DELETE /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 204 len: 0 microversion: 2.1 time: 0.379669 Oct 12 22:09:11.824695 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1351/2475] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:09:11 2022] DELETE /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:09:11.838649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b72fab8c-d075-4e1c-a9bb-6c5373c85fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:11.839419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b72fab8c-d075-4e1c-a9bb-6c5373c85fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:11.881592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b72fab8c-d075-4e1c-a9bb-6c5373c85fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:11.881792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b72fab8c-d075-4e1c-a9bb-6c5373c85fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:11.882130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b72fab8c-d075-4e1c-a9bb-6c5373c85fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:11.882845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b72fab8c-d075-4e1c-a9bb-6c5373c85fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:11.890805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b72fab8c-d075-4e1c-a9bb-6c5373c85fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:11.891328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b72fab8c-d075-4e1c-a9bb-6c5373c85fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:12.144627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b72fab8c-d075-4e1c-a9bb-6c5373c85fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:12.154318 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b72fab8c-d075-4e1c-a9bb-6c5373c85fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1684 microversion: 2.1 time: 0.322720 Oct 12 22:09:12.157560 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1352/2476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:11 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1684 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:12.167499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-40174162-061d-4207-89d6-0d80f0336f7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:12.170090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-40174162-061d-4207-89d6-0d80f0336f7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:12.172154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0e0067c9-655d-4846-b964-4538e27c6c6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:12.178254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40174162-061d-4207-89d6-0d80f0336f7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:12.178736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40174162-061d-4207-89d6-0d80f0336f7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:12.179170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40174162-061d-4207-89d6-0d80f0336f7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:12.179902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40174162-061d-4207-89d6-0d80f0336f7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:12.181288 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0e0067c9-655d-4846-b964-4538e27c6c6d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 200 len: 1317 microversion: 2.1 time: 0.489474 Oct 12 22:09:12.195482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40174162-061d-4207-89d6-0d80f0336f7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:12.195482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40174162-061d-4207-89d6-0d80f0336f7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:12.196236 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1125/2477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:11 2022] GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:12.203059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-58c35175-b559-4951-83a1-5cef8bce0c94 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:12.204134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-58c35175-b559-4951-83a1-5cef8bce0c94 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:12.212243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58c35175-b559-4951-83a1-5cef8bce0c94 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:12.212973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58c35175-b559-4951-83a1-5cef8bce0c94 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:12.213655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58c35175-b559-4951-83a1-5cef8bce0c94 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:12.214775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58c35175-b559-4951-83a1-5cef8bce0c94 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:12.215507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58c35175-b559-4951-83a1-5cef8bce0c94 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:12.216164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58c35175-b559-4951-83a1-5cef8bce0c94 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:12.375746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-58c35175-b559-4951-83a1-5cef8bce0c94 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:12.376993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-40174162-061d-4207-89d6-0d80f0336f7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:12.388170 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-58c35175-b559-4951-83a1-5cef8bce0c94 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1209 microversion: 2.1 time: 0.190542 Oct 12 22:09:12.391899 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1126/2478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:12 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1209 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:12.406424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-40174162-061d-4207-89d6-0d80f0336f7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:12.410153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-40174162-061d-4207-89d6-0d80f0336f7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:12.426700 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-40174162-061d-4207-89d6-0d80f0336f7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.262982 Oct 12 22:09:12.428688 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1353/2479] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:12 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:12.717012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a9d9b78e-71b3-4983-b9f5-d932e81ce678 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:12.719372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a9d9b78e-71b3-4983-b9f5-d932e81ce678 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:12.733989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9d9b78e-71b3-4983-b9f5-d932e81ce678 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:12.735729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9d9b78e-71b3-4983-b9f5-d932e81ce678 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:12.737657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9d9b78e-71b3-4983-b9f5-d932e81ce678 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:12.739462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9d9b78e-71b3-4983-b9f5-d932e81ce678 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:12.741550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9d9b78e-71b3-4983-b9f5-d932e81ce678 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:12.742922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9d9b78e-71b3-4983-b9f5-d932e81ce678 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:13.184655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6964e645-17bc-496a-ba02-f048f39f6509 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:13.185276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6964e645-17bc-496a-ba02-f048f39f6509 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:13.188713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a9d9b78e-71b3-4983-b9f5-d932e81ce678 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:13.196760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6964e645-17bc-496a-ba02-f048f39f6509 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:13.197255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6964e645-17bc-496a-ba02-f048f39f6509 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:13.197699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6964e645-17bc-496a-ba02-f048f39f6509 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:13.203484 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a9d9b78e-71b3-4983-b9f5-d932e81ce678 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1682 microversion: 2.1 time: 0.493367 Oct 12 22:09:13.204263 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1127/2480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:12 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1682 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:13.209609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6964e645-17bc-496a-ba02-f048f39f6509 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:13.210389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6964e645-17bc-496a-ba02-f048f39f6509 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:13.211133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6964e645-17bc-496a-ba02-f048f39f6509 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:13.236655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f544e620-b470-4e7b-84ba-00bc7b149d8c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:13.237285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f544e620-b470-4e7b-84ba-00bc7b149d8c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:13.243510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f544e620-b470-4e7b-84ba-00bc7b149d8c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:13.244001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f544e620-b470-4e7b-84ba-00bc7b149d8c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:13.244440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f544e620-b470-4e7b-84ba-00bc7b149d8c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:13.245731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f544e620-b470-4e7b-84ba-00bc7b149d8c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:13.246181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f544e620-b470-4e7b-84ba-00bc7b149d8c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:13.246784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f544e620-b470-4e7b-84ba-00bc7b149d8c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:13.778826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f544e620-b470-4e7b-84ba-00bc7b149d8c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:13.787753 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f544e620-b470-4e7b-84ba-00bc7b149d8c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 200 len: 1317 microversion: 2.1 time: 0.571129 Oct 12 22:09:13.793592 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1128/2481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:13 2022] GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:13.798836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ac4f380e-859e-4a52-ace6-558b9929f70a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:13.817981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ac4f380e-859e-4a52-ace6-558b9929f70a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:13.838466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac4f380e-859e-4a52-ace6-558b9929f70a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:13.842510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac4f380e-859e-4a52-ace6-558b9929f70a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:13.844633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac4f380e-859e-4a52-ace6-558b9929f70a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:13.845397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac4f380e-859e-4a52-ace6-558b9929f70a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:13.845860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac4f380e-859e-4a52-ace6-558b9929f70a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:13.846292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac4f380e-859e-4a52-ace6-558b9929f70a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:14.009290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6964e645-17bc-496a-ba02-f048f39f6509 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:14.021751 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6964e645-17bc-496a-ba02-f048f39f6509 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1684 microversion: 2.1 time: 0.841501 Oct 12 22:09:14.039384 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1354/2482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:13 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1684 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:14.044359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e02ce3c3-03aa-4f79-9daf-9ac80b026ce6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:14.044963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e02ce3c3-03aa-4f79-9daf-9ac80b026ce6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:14.046896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:14.060702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ac4f380e-859e-4a52-ace6-558b9929f70a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:14.063416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e02ce3c3-03aa-4f79-9daf-9ac80b026ce6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:14.066790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:14.067599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e02ce3c3-03aa-4f79-9daf-9ac80b026ce6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:14.068084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e02ce3c3-03aa-4f79-9daf-9ac80b026ce6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:14.068814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e02ce3c3-03aa-4f79-9daf-9ac80b026ce6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:14.068991 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ac4f380e-859e-4a52-ace6-558b9929f70a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1265 microversion: 2.1 time: 0.274123 Oct 12 22:09:14.069269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e02ce3c3-03aa-4f79-9daf-9ac80b026ce6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:14.071815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e02ce3c3-03aa-4f79-9daf-9ac80b026ce6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:14.072654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:14.077912 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1129/2483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:13 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:14.212618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e02ce3c3-03aa-4f79-9daf-9ac80b026ce6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:14.232637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-abd8e437-4752-4b12-90e3-85f2e2b4c7f1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:14.233256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-abd8e437-4752-4b12-90e3-85f2e2b4c7f1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:14.236257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e02ce3c3-03aa-4f79-9daf-9ac80b026ce6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:14.240340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abd8e437-4752-4b12-90e3-85f2e2b4c7f1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:14.242165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e02ce3c3-03aa-4f79-9daf-9ac80b026ce6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:14.251865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abd8e437-4752-4b12-90e3-85f2e2b4c7f1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:14.255167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abd8e437-4752-4b12-90e3-85f2e2b4c7f1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:14.258738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abd8e437-4752-4b12-90e3-85f2e2b4c7f1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:14.262425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abd8e437-4752-4b12-90e3-85f2e2b4c7f1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:14.263084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abd8e437-4752-4b12-90e3-85f2e2b4c7f1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:14.268093 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e02ce3c3-03aa-4f79-9daf-9ac80b026ce6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.225757 Oct 12 22:09:14.283267 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1355/2484] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:14 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:14.611267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-0a156d8d-5856-4f1c-9599-a4b63213ae13 req-b0be99c9-faf5-4da4-ad36-5f6d156aca82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54a23a46-7ad2-4563-a557-1806d4d61253", "name": "network-vif-deleted", "tag": "c43be245-e399-4a43-a754-f8061895ef0c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:14.636491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0a156d8d-5856-4f1c-9599-a4b63213ae13 req-b0be99c9-faf5-4da4-ad36-5f6d156aca82 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:14.637005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0a156d8d-5856-4f1c-9599-a4b63213ae13 req-b0be99c9-faf5-4da4-ad36-5f6d156aca82 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:14.637451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0a156d8d-5856-4f1c-9599-a4b63213ae13 req-b0be99c9-faf5-4da4-ad36-5f6d156aca82 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:14.686042 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-0a156d8d-5856-4f1c-9599-a4b63213ae13 req-b0be99c9-faf5-4da4-ad36-5f6d156aca82 service nova] Creating event network-vif-deleted:c43be245-e399-4a43-a754-f8061895ef0c for instance 54a23a46-7ad2-4563-a557-1806d4d61253 on n-h1-861111-1 Oct 12 22:09:14.703371 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-0a156d8d-5856-4f1c-9599-a4b63213ae13 req-b0be99c9-faf5-4da4-ad36-5f6d156aca82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096080 Oct 12 22:09:14.707220 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1356/2485] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:09:14.814705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d94f29ec-e98b-4287-8267-f5cdf3fa469a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:14.821096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d94f29ec-e98b-4287-8267-f5cdf3fa469a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:14.826535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-abd8e437-4752-4b12-90e3-85f2e2b4c7f1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9e20674549401c89b9d264d1167f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf3c61412cf43f691e7af5d26e740bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:14.832288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d94f29ec-e98b-4287-8267-f5cdf3fa469a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:14.834255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d94f29ec-e98b-4287-8267-f5cdf3fa469a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:14.834768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d94f29ec-e98b-4287-8267-f5cdf3fa469a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:14.837198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d94f29ec-e98b-4287-8267-f5cdf3fa469a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:14.837870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d94f29ec-e98b-4287-8267-f5cdf3fa469a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:14.838610 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-abd8e437-4752-4b12-90e3-85f2e2b4c7f1 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 200 len: 1615 microversion: 2.1 time: 0.608976 Oct 12 22:09:14.841867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d94f29ec-e98b-4287-8267-f5cdf3fa469a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:14.856334 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1130/2486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:14 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 1615 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:09:14.881987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:15.046740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e4824b44-ef4f-4964-9b9d-31bbf4d42c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:15.047528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e4824b44-ef4f-4964-9b9d-31bbf4d42c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:15.071206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4824b44-ef4f-4964-9b9d-31bbf4d42c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:15.071901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4824b44-ef4f-4964-9b9d-31bbf4d42c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:15.072604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4824b44-ef4f-4964-9b9d-31bbf4d42c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:15.074097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4824b44-ef4f-4964-9b9d-31bbf4d42c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:15.074772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4824b44-ef4f-4964-9b9d-31bbf4d42c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:15.075447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4824b44-ef4f-4964-9b9d-31bbf4d42c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:16.592227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e4824b44-ef4f-4964-9b9d-31bbf4d42c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:16.624363 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e4824b44-ef4f-4964-9b9d-31bbf4d42c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1684 microversion: 2.1 time: 1.582063 Oct 12 22:09:16.624987 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1131/2487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:15 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1684 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:16.642282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2f22bccf-26d1-4241-a36e-71c3b78c1a80 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:16.648270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f22bccf-26d1-4241-a36e-71c3b78c1a80 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:16.670970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f22bccf-26d1-4241-a36e-71c3b78c1a80 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:16.672119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f22bccf-26d1-4241-a36e-71c3b78c1a80 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:16.676335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f22bccf-26d1-4241-a36e-71c3b78c1a80 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:16.677305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f22bccf-26d1-4241-a36e-71c3b78c1a80 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:16.680388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f22bccf-26d1-4241-a36e-71c3b78c1a80 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:16.680999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f22bccf-26d1-4241-a36e-71c3b78c1a80 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:16.935351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d94f29ec-e98b-4287-8267-f5cdf3fa469a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:16.948813 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d94f29ec-e98b-4287-8267-f5cdf3fa469a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 200 len: 1317 microversion: 2.1 time: 2.137090 Oct 12 22:09:16.949428 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1357/2488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:14 2022] GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 1317 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:09:16.977694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9429c454-55b3-45c2-8652-4d26a893dcfd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:16.978606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9429c454-55b3-45c2-8652-4d26a893dcfd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:16.994829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9429c454-55b3-45c2-8652-4d26a893dcfd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:16.999449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9429c454-55b3-45c2-8652-4d26a893dcfd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:17.000187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9429c454-55b3-45c2-8652-4d26a893dcfd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:17.001405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9429c454-55b3-45c2-8652-4d26a893dcfd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:17.002033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9429c454-55b3-45c2-8652-4d26a893dcfd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:17.003629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9429c454-55b3-45c2-8652-4d26a893dcfd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:17.078630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f22bccf-26d1-4241-a36e-71c3b78c1a80 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:17.096888 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2f22bccf-26d1-4241-a36e-71c3b78c1a80 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1271 microversion: 2.1 time: 0.465147 Oct 12 22:09:17.101590 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1132/2489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:16 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1271 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:17.109054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-050ca258-5b1b-49c1-8d1c-300e081bd694 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:17.115866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-050ca258-5b1b-49c1-8d1c-300e081bd694 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:17.129067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-050ca258-5b1b-49c1-8d1c-300e081bd694 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:17.129835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-050ca258-5b1b-49c1-8d1c-300e081bd694 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:17.133758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-050ca258-5b1b-49c1-8d1c-300e081bd694 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:17.134692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-050ca258-5b1b-49c1-8d1c-300e081bd694 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:17.135359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-050ca258-5b1b-49c1-8d1c-300e081bd694 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:17.136728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-050ca258-5b1b-49c1-8d1c-300e081bd694 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:17.169560 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-050ca258-5b1b-49c1-8d1c-300e081bd694 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] HTTP exception thrown: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-050ca258-5b1b-49c1-8d1c-300e081bd694 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Request method failure captured: Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 HTTP/1.1 Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzpoYMtQSnUHG0KyxaWIcAf0TTZS7giBRd1rf3Ojo9zPcJwC9OYUqmS19EMludsJQ1A70mHfuA7Rr3HFdK6gV2eGvM-JM7WARMIACL7gu9-0tgDP_Bdr0UymtP5evaMPgx83kgiMGI7_FxD-tHKyDb1auXeuY9S-71n1eFFbr16VJ8w Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ebf3c61412cf43f691e7af5d26e740bd Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-998835207 Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ebf3c61412cf43f691e7af5d26e740bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ebf3c61412cf43f691e7af5d26e740bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ebf3c61412cf43f691e7af5d26e740bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ebf3c61412cf43f691e7af5d26e740bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-998835207 Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ebf3c61412cf43f691e7af5d26e740bd Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-998835207 Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-AttachSCSIVolumeTestJSON-998835207-project Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 4d9e20674549401c89b9d264d1167f3a Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-998835207-project Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '54a23a46-7ad2-4563-a557-1806d4d61253'} Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:17.178884 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:17.184129 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:17.184129 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:17.184129 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:17.184129 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:09:17.184129 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:09:17.184129 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. Oct 12 22:09:17.184129 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:17.186577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-050ca258-5b1b-49c1-8d1c-300e081bd694 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Returning 404 to user: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:09:17.188591 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-050ca258-5b1b-49c1-8d1c-300e081bd694 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 404 len: 111 microversion: 2.1 time: 0.085119 Oct 12 22:09:17.189718 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1133/2490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:17 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:09:17.202363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3019febe-21ef-4068-9acb-baffc749ac5f tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '.version_select at 0x7f51282e2d30>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:17.246328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9429c454-55b3-45c2-8652-4d26a893dcfd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:17.259089 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3019febe-21ef-4068-9acb-baffc749ac5f tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1786249007" status: 202 len: 0 microversion: 2.1 time: 0.063497 Oct 12 22:09:17.264328 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1134/2491] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 12 22:09:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1786249007 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:09:17.268909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9429c454-55b3-45c2-8652-4d26a893dcfd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:17.270884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9429c454-55b3-45c2-8652-4d26a893dcfd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:17.285585 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9429c454-55b3-45c2-8652-4d26a893dcfd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.315597 Oct 12 22:09:17.289753 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1358/2492] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:16 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:17.651536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6870fa74-3194-4b21-a8f0-048ac14a5d49 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:17.652168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6870fa74-3194-4b21-a8f0-048ac14a5d49 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:17.672149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6870fa74-3194-4b21-a8f0-048ac14a5d49 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:17.675770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6870fa74-3194-4b21-a8f0-048ac14a5d49 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:17.676445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6870fa74-3194-4b21-a8f0-048ac14a5d49 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:17.678653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6870fa74-3194-4b21-a8f0-048ac14a5d49 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:17.683165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6870fa74-3194-4b21-a8f0-048ac14a5d49 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:17.683676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6870fa74-3194-4b21-a8f0-048ac14a5d49 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:17.844569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-242a77a4-3822-43dc-94ff-3d5a37b287ef req-af722905-42f0-4654-b8a3-f781ae57991d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77548da5-9429-4e07-bdad-7902d89d4153", "name": "network-vif-deleted", "tag": "cc048857-8664-421b-b22d-6488c4031e97"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:17.891464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-242a77a4-3822-43dc-94ff-3d5a37b287ef req-af722905-42f0-4654-b8a3-f781ae57991d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:17.892779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-242a77a4-3822-43dc-94ff-3d5a37b287ef req-af722905-42f0-4654-b8a3-f781ae57991d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:17.893795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-242a77a4-3822-43dc-94ff-3d5a37b287ef req-af722905-42f0-4654-b8a3-f781ae57991d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:17.946528 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-242a77a4-3822-43dc-94ff-3d5a37b287ef req-af722905-42f0-4654-b8a3-f781ae57991d service nova] Creating event network-vif-deleted:cc048857-8664-421b-b22d-6488c4031e97 for instance 77548da5-9429-4e07-bdad-7902d89d4153 on n-h2-861111-1 Oct 12 22:09:17.959446 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-242a77a4-3822-43dc-94ff-3d5a37b287ef req-af722905-42f0-4654-b8a3-f781ae57991d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120409 Oct 12 22:09:17.965450 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1359/2493] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:09:18.003950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e3e961be-0a4f-43da-9328-acbd0d062802 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:18.007602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e3e961be-0a4f-43da-9328-acbd0d062802 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:18.042769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3e961be-0a4f-43da-9328-acbd0d062802 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:18.051714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3e961be-0a4f-43da-9328-acbd0d062802 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:18.056772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3e961be-0a4f-43da-9328-acbd0d062802 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:18.064407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3e961be-0a4f-43da-9328-acbd0d062802 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:18.065517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3e961be-0a4f-43da-9328-acbd0d062802 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:18.079976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3e961be-0a4f-43da-9328-acbd0d062802 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:18.208530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6870fa74-3194-4b21-a8f0-048ac14a5d49 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:18.220733 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6870fa74-3194-4b21-a8f0-048ac14a5d49 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 200 len: 1616 microversion: 2.1 time: 0.573372 Oct 12 22:09:18.248083 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1135/2494] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:17 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 1616 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:18.273133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dd29765d-a5db-4cbc-8182-f41648a3d488 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:18.277869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dd29765d-a5db-4cbc-8182-f41648a3d488 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:18.298841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd29765d-a5db-4cbc-8182-f41648a3d488 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:18.303323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd29765d-a5db-4cbc-8182-f41648a3d488 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:18.304843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd29765d-a5db-4cbc-8182-f41648a3d488 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:18.305667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd29765d-a5db-4cbc-8182-f41648a3d488 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:18.311409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd29765d-a5db-4cbc-8182-f41648a3d488 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:18.311968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd29765d-a5db-4cbc-8182-f41648a3d488 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:18.493485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dd29765d-a5db-4cbc-8182-f41648a3d488 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:18.507847 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dd29765d-a5db-4cbc-8182-f41648a3d488 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1271 microversion: 2.1 time: 0.258330 Oct 12 22:09:18.508435 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1136/2495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:18 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1271 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:18.640908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dd2c423f-49b2-4011-bf90-b612c9f28c46 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Action: 'create', calling method: .version_select at 0x7f512c515f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1427057018", "description": "tempest-description-1721189368"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:19.118342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e3e961be-0a4f-43da-9328-acbd0d062802 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:19.131770 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e3e961be-0a4f-43da-9328-acbd0d062802 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 200 len: 1317 microversion: 2.1 time: 1.153445 Oct 12 22:09:19.132548 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1360/2496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:17 2022] GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 1317 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:19.154161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ffd64781-f3b3-4f9a-b92a-18d4aadf0d1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:19.154935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ffd64781-f3b3-4f9a-b92a-18d4aadf0d1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:19.186884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffd64781-f3b3-4f9a-b92a-18d4aadf0d1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:19.187423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffd64781-f3b3-4f9a-b92a-18d4aadf0d1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:19.189708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffd64781-f3b3-4f9a-b92a-18d4aadf0d1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:19.192493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffd64781-f3b3-4f9a-b92a-18d4aadf0d1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:19.195021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffd64781-f3b3-4f9a-b92a-18d4aadf0d1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:19.196471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffd64781-f3b3-4f9a-b92a-18d4aadf0d1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:19.457663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ffd64781-f3b3-4f9a-b92a-18d4aadf0d1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:19.473369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ffd64781-f3b3-4f9a-b92a-18d4aadf0d1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:19.476153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ffd64781-f3b3-4f9a-b92a-18d4aadf0d1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:19.489981 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ffd64781-f3b3-4f9a-b92a-18d4aadf0d1b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.352586 Oct 12 22:09:19.508502 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1361/2497] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:19 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:19.526707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c980c18e-64fd-4236-af4d-dabe10153211 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:19.528276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c980c18e-64fd-4236-af4d-dabe10153211 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:19.552605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c980c18e-64fd-4236-af4d-dabe10153211 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:19.554591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c980c18e-64fd-4236-af4d-dabe10153211 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:19.555779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c980c18e-64fd-4236-af4d-dabe10153211 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:19.558895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c980c18e-64fd-4236-af4d-dabe10153211 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:19.561381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c980c18e-64fd-4236-af4d-dabe10153211 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:19.571626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c980c18e-64fd-4236-af4d-dabe10153211 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:19.606819 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-c980c18e-64fd-4236-af4d-dabe10153211 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] HTTP exception thrown: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c980c18e-64fd-4236-af4d-dabe10153211 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Request method failure captured: Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 HTTP/1.1 Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzoV3foVnGv0suVxK_Nk7Pp5_kjAPhL8yzVHClSGl5RRxDIZH7rcf5PLHi4YXEet-A0AtHcDaHpFcS_aQR9wl8soXuphQXdzTm1zPCiMI4BUWAPu4l1z3R9DkYDtzHZhHRlT-3CEyzuxgoolPW6Gw8glco6cFnu099ScND31HIZBEC4 Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68913d260d084ce4a8e29daf4783c0bc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 13c74a78e82f4e72a7d1f7b133074f5a Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '77548da5-9429-4e07-bdad-7902d89d4153'} Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:19.609468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:19.613751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:19.613751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:19.613751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:19.613751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:09:19.613751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:09:19.613751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. Oct 12 22:09:19.613751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:19.615265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c980c18e-64fd-4236-af4d-dabe10153211 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Returning 404 to user: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:09:19.617631 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c980c18e-64fd-4236-af4d-dabe10153211 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 404 len: 111 microversion: 2.1 time: 0.105141 Oct 12 22:09:19.618731 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1362/2498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:19 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:09:19.625345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e85006e0-0e10-4474-9fc0-421511418f8f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:19.626165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e85006e0-0e10-4474-9fc0-421511418f8f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:19.633913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e85006e0-0e10-4474-9fc0-421511418f8f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:19.634989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e85006e0-0e10-4474-9fc0-421511418f8f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:19.636187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e85006e0-0e10-4474-9fc0-421511418f8f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:19.637054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e85006e0-0e10-4474-9fc0-421511418f8f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:19.638444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e85006e0-0e10-4474-9fc0-421511418f8f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:19.639056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e85006e0-0e10-4474-9fc0-421511418f8f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:19.752960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e85006e0-0e10-4474-9fc0-421511418f8f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:19.771957 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e85006e0-0e10-4474-9fc0-421511418f8f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1271 microversion: 2.1 time: 0.151893 Oct 12 22:09:19.775973 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1363/2499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:19 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:19.781491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0fe06162-715b-433c-92c8-18c3380352f0 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '.version_select at 0x7f5123349a60>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:19.835500 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0fe06162-715b-433c-92c8-18c3380352f0 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142826161" status: 202 len: 0 microversion: 2.1 time: 0.056916 Oct 12 22:09:19.837318 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1364/2500] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 12 22:09:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142826161 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:09:20.122485 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dd2c423f-49b2-4011-bf90-b612c9f28c46 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.612126 Oct 12 22:09:20.123341 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1137/2501] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:09:18 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:20.137102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c59f7626-b156-4681-85b6-5623381b50a6 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Action: 'create', calling method: .version_select at 0x7f5123397550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1984459082", "description": "tempest-description-263564074"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:20.158762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9f377956-73cb-4c4a-9e1c-213a1d377c26 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:20.159766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9f377956-73cb-4c4a-9e1c-213a1d377c26 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:20.179258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f377956-73cb-4c4a-9e1c-213a1d377c26 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:20.180334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f377956-73cb-4c4a-9e1c-213a1d377c26 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:20.183275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f377956-73cb-4c4a-9e1c-213a1d377c26 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:20.186922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f377956-73cb-4c4a-9e1c-213a1d377c26 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:20.187612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f377956-73cb-4c4a-9e1c-213a1d377c26 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:20.188158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f377956-73cb-4c4a-9e1c-213a1d377c26 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:20.497799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:20.835629 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c59f7626-b156-4681-85b6-5623381b50a6 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.702778 Oct 12 22:09:20.848391 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1365/2502] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:09:20 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:20.859829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-948de472-cb1b-4422-b4cc-3deb72dabddb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:20.862012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-948de472-cb1b-4422-b4cc-3deb72dabddb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:20.874593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=16 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:20.883150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-948de472-cb1b-4422-b4cc-3deb72dabddb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:20.884140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-948de472-cb1b-4422-b4cc-3deb72dabddb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:20.884772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-948de472-cb1b-4422-b4cc-3deb72dabddb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:20.886504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-948de472-cb1b-4422-b4cc-3deb72dabddb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:20.887232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-948de472-cb1b-4422-b4cc-3deb72dabddb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:20.887935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-948de472-cb1b-4422-b4cc-3deb72dabddb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:21.006362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-948de472-cb1b-4422-b4cc-3deb72dabddb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:21.016300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-948de472-cb1b-4422-b4cc-3deb72dabddb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:21.017762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-948de472-cb1b-4422-b4cc-3deb72dabddb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:21.024245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:21.034221 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-948de472-cb1b-4422-b4cc-3deb72dabddb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.184544 Oct 12 22:09:21.051325 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1366/2503] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:20 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:21.051325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-24c4be44-905e-4509-9653-3bab8f3a2e64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:21.051325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-24c4be44-905e-4509-9653-3bab8f3a2e64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:21.062639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24c4be44-905e-4509-9653-3bab8f3a2e64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:21.063133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24c4be44-905e-4509-9653-3bab8f3a2e64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:21.063609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24c4be44-905e-4509-9653-3bab8f3a2e64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:21.064312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24c4be44-905e-4509-9653-3bab8f3a2e64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:21.064767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24c4be44-905e-4509-9653-3bab8f3a2e64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:21.065194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24c4be44-905e-4509-9653-3bab8f3a2e64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:21.157691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9f377956-73cb-4c4a-9e1c-213a1d377c26 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:21.176795 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9f377956-73cb-4c4a-9e1c-213a1d377c26 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 200 len: 1317 microversion: 2.1 time: 1.021881 Oct 12 22:09:21.178956 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1138/2504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:20 2022] GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 1317 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:09:21.190780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-989127512", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "bf70099b-bae2-4631-8d40-6f8ec2b3ee84"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:21.302879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] validate_networks() for [('bf70099b-bae2-4631-8d40-6f8ec2b3ee84', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:09:21.344483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-24c4be44-905e-4509-9653-3bab8f3a2e64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:21.362299 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-24c4be44-905e-4509-9653-3bab8f3a2e64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1313 microversion: 2.1 time: 0.323993 Oct 12 22:09:21.384520 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1367/2505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:21 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:21.475696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-751689af-1939-457e-b910-27b679262e81 req-7e47a3e7-6140-4ea6-95a9-2e50cfc2de37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c884fd7-d12b-4faa-95e1-96646f21ef60", "name": "network-vif-plugged", "status": "completed", "tag": "e1e05e36-e77d-467a-8a79-0fded528c3ed"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:21.490433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-751689af-1939-457e-b910-27b679262e81 req-7e47a3e7-6140-4ea6-95a9-2e50cfc2de37 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:21.490912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-751689af-1939-457e-b910-27b679262e81 req-7e47a3e7-6140-4ea6-95a9-2e50cfc2de37 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:21.499517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-751689af-1939-457e-b910-27b679262e81 req-7e47a3e7-6140-4ea6-95a9-2e50cfc2de37 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:21.527856 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-751689af-1939-457e-b910-27b679262e81 req-7e47a3e7-6140-4ea6-95a9-2e50cfc2de37 service nova] Creating event network-vif-plugged:e1e05e36-e77d-467a-8a79-0fded528c3ed for instance 3c884fd7-d12b-4faa-95e1-96646f21ef60 on n-h1-861111-1 Oct 12 22:09:21.537722 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-751689af-1939-457e-b910-27b679262e81 req-7e47a3e7-6140-4ea6-95a9-2e50cfc2de37 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064115 Oct 12 22:09:21.538688 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1368/2506] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:09:21.811099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7a559f1b-77d1-45b3-ba52-6fba8f802662 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:21.811974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7a559f1b-77d1-45b3-ba52-6fba8f802662 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:21.826546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a559f1b-77d1-45b3-ba52-6fba8f802662 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:21.830686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a559f1b-77d1-45b3-ba52-6fba8f802662 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:21.834060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a559f1b-77d1-45b3-ba52-6fba8f802662 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:21.839414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a559f1b-77d1-45b3-ba52-6fba8f802662 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:21.844842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a559f1b-77d1-45b3-ba52-6fba8f802662 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:21.846317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a559f1b-77d1-45b3-ba52-6fba8f802662 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:21.999862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-7a559f1b-77d1-45b3-ba52-6fba8f802662 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lazy-loading 'services' on Instance uuid 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:09:22.159941 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7a559f1b-77d1-45b3-ba52-6fba8f802662 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments/0f8206e7-dd62-47f9-87fc-d9656a73db92" status: 202 len: 0 microversion: 2.1 time: 0.353437 Oct 12 22:09:22.167562 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1369/2507] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 22:09:21 2022] DELETE /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments/0f8206e7-dd62-47f9-87fc-d9656a73db92 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:09:22.176663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e1697d8f-82cd-4b4a-941f-0c62c46c6a9c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:22.178363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e1697d8f-82cd-4b4a-941f-0c62c46c6a9c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:22.189553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1697d8f-82cd-4b4a-941f-0c62c46c6a9c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:22.190292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1697d8f-82cd-4b4a-941f-0c62c46c6a9c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:22.190927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1697d8f-82cd-4b4a-941f-0c62c46c6a9c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:22.192063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1697d8f-82cd-4b4a-941f-0c62c46c6a9c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:22.192848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1697d8f-82cd-4b4a-941f-0c62c46c6a9c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:22.193439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1697d8f-82cd-4b4a-941f-0c62c46c6a9c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:22.301731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e1697d8f-82cd-4b4a-941f-0c62c46c6a9c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:22.315483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e1697d8f-82cd-4b4a-941f-0c62c46c6a9c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:22.317156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e1697d8f-82cd-4b4a-941f-0c62c46c6a9c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:22.323867 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e1697d8f-82cd-4b4a-941f-0c62c46c6a9c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.154320 Oct 12 22:09:22.325445 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1370/2508] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:22 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:22.331839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7a08075f-a89d-4f1f-8a54-de9bc124697a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:22.336908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7a08075f-a89d-4f1f-8a54-de9bc124697a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:22.344056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a08075f-a89d-4f1f-8a54-de9bc124697a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:22.345078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a08075f-a89d-4f1f-8a54-de9bc124697a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:22.346360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a08075f-a89d-4f1f-8a54-de9bc124697a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:22.347271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a08075f-a89d-4f1f-8a54-de9bc124697a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:22.347955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a08075f-a89d-4f1f-8a54-de9bc124697a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:22.348665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a08075f-a89d-4f1f-8a54-de9bc124697a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:22.411341 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7a08075f-a89d-4f1f-8a54-de9bc124697a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084418 Oct 12 22:09:22.419069 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1371/2509] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:09:22 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:22.424718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a0f0f0ee-330a-45a9-9b9c-b99566a9fe96 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:22.425604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a0f0f0ee-330a-45a9-9b9c-b99566a9fe96 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:22.433579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0f0f0ee-330a-45a9-9b9c-b99566a9fe96 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:22.434364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0f0f0ee-330a-45a9-9b9c-b99566a9fe96 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:22.434971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0f0f0ee-330a-45a9-9b9c-b99566a9fe96 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:22.435899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0f0f0ee-330a-45a9-9b9c-b99566a9fe96 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:22.436529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0f0f0ee-330a-45a9-9b9c-b99566a9fe96 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:22.437121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0f0f0ee-330a-45a9-9b9c-b99566a9fe96 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:22.827849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a0f0f0ee-330a-45a9-9b9c-b99566a9fe96 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:22.844696 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a0f0f0ee-330a-45a9-9b9c-b99566a9fe96 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 200 len: 1317 microversion: 2.1 time: 0.424073 Oct 12 22:09:22.845496 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1372/2510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:22 2022] GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:22.875797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-df970af5-632a-4d6f-9d25-4ae231c683a4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:22.876690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-df970af5-632a-4d6f-9d25-4ae231c683a4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:22.885513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df970af5-632a-4d6f-9d25-4ae231c683a4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:22.886416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df970af5-632a-4d6f-9d25-4ae231c683a4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:22.887010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df970af5-632a-4d6f-9d25-4ae231c683a4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:22.887924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df970af5-632a-4d6f-9d25-4ae231c683a4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:22.888534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df970af5-632a-4d6f-9d25-4ae231c683a4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:22.889114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df970af5-632a-4d6f-9d25-4ae231c683a4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:22.893621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:09:22.894101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:09:22.894510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:09:22.894917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:09:22.895354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:09:22.918510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:22.919910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:22.920578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:22.922970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:22.925448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:22.926899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:22.968731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Getting quotas for project 214f86d71a5749b9b98dffe934fe7f1f. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:09:22.978121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Getting quotas for user 81e045d919104fa89572a2d05993abb8 and project 214f86d71a5749b9b98dffe934fe7f1f. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:09:23.014543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:09:23.026413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:09:23.143215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-df970af5-632a-4d6f-9d25-4ae231c683a4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:23.156418 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-df970af5-632a-4d6f-9d25-4ae231c683a4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1313 microversion: 2.1 time: 0.287257 Oct 12 22:09:23.157019 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1373/2511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:22 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:23.181430 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cd05c72d-9ec1-43ce-81e2-b1a4867539d0 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.000393 Oct 12 22:09:23.188124 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1139/2512] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:09:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:09:23.194224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a942369e-86c1-452d-8c7f-df78dd6a0d85 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:23.194890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a942369e-86c1-452d-8c7f-df78dd6a0d85 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:23.334920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a942369e-86c1-452d-8c7f-df78dd6a0d85 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:23.350882 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a942369e-86c1-452d-8c7f-df78dd6a0d85 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8" status: 200 len: 1215 microversion: 2.1 time: 0.159805 Oct 12 22:09:23.363264 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1374/2513] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:23 2022] GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:09:23.371052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-741d0276-cac5-49d8-8d04-3a312a8748ee tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:23.372004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-741d0276-cac5-49d8-8d04-3a312a8748ee tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:23.388179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-741d0276-cac5-49d8-8d04-3a312a8748ee tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:23.391639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-741d0276-cac5-49d8-8d04-3a312a8748ee tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:23.393463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-741d0276-cac5-49d8-8d04-3a312a8748ee tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:23.395393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-741d0276-cac5-49d8-8d04-3a312a8748ee tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:23.396194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-741d0276-cac5-49d8-8d04-3a312a8748ee tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:23.407718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-c1f69c4b-70e5-4083-8e68-13beb22590ba req-37908e51-3abe-4bf9-b732-51b41eb02c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b0eb54-219e-4026-b96c-59b963b0f770", "tag": "72cdcc3a-ba0f-41c3-9bb0-97a69bd68560"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:23.408241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-741d0276-cac5-49d8-8d04-3a312a8748ee tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:23.438358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c1f69c4b-70e5-4083-8e68-13beb22590ba req-37908e51-3abe-4bf9-b732-51b41eb02c39 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:23.438854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c1f69c4b-70e5-4083-8e68-13beb22590ba req-37908e51-3abe-4bf9-b732-51b41eb02c39 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:23.439369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c1f69c4b-70e5-4083-8e68-13beb22590ba req-37908e51-3abe-4bf9-b732-51b41eb02c39 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:23.467106 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-c1f69c4b-70e5-4083-8e68-13beb22590ba req-37908e51-3abe-4bf9-b732-51b41eb02c39 service nova] Creating event network-changed:72cdcc3a-ba0f-41c3-9bb0-97a69bd68560 for instance f3b0eb54-219e-4026-b96c-59b963b0f770 on n-h1-861111-1 Oct 12 22:09:23.475580 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-c1f69c4b-70e5-4083-8e68-13beb22590ba req-37908e51-3abe-4bf9-b732-51b41eb02c39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072417 Oct 12 22:09:23.477962 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1375/2514] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:09:23.493532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1141b651-5cce-4c2c-804d-8f0801482b65 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:23.498356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1141b651-5cce-4c2c-804d-8f0801482b65 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:23.512641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1141b651-5cce-4c2c-804d-8f0801482b65 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:23.517405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1141b651-5cce-4c2c-804d-8f0801482b65 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:23.517912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1141b651-5cce-4c2c-804d-8f0801482b65 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:23.518773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1141b651-5cce-4c2c-804d-8f0801482b65 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:23.519134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1141b651-5cce-4c2c-804d-8f0801482b65 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:23.519712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1141b651-5cce-4c2c-804d-8f0801482b65 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:23.592065 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1141b651-5cce-4c2c-804d-8f0801482b65 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111606 Oct 12 22:09:23.592671 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1376/2515] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:09:23 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:23.660979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-741d0276-cac5-49d8-8d04-3a312a8748ee tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:23.674903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-741d0276-cac5-49d8-8d04-3a312a8748ee tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:23.676739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-741d0276-cac5-49d8-8d04-3a312a8748ee tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:23.692780 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-741d0276-cac5-49d8-8d04-3a312a8748ee tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.342413 Oct 12 22:09:23.695266 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1140/2516] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:23 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:23.870481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c3d7fe02-7b2f-41a2-a6fb-9e6a03b53840 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:23.871509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c3d7fe02-7b2f-41a2-a6fb-9e6a03b53840 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:23.881215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3d7fe02-7b2f-41a2-a6fb-9e6a03b53840 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:23.884026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3d7fe02-7b2f-41a2-a6fb-9e6a03b53840 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:23.884692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3d7fe02-7b2f-41a2-a6fb-9e6a03b53840 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:23.888858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3d7fe02-7b2f-41a2-a6fb-9e6a03b53840 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:23.890405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3d7fe02-7b2f-41a2-a6fb-9e6a03b53840 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:23.893317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3d7fe02-7b2f-41a2-a6fb-9e6a03b53840 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:24.179195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7eb1b230-e133-45bc-9323-39c0652ee5c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:24.180547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7eb1b230-e133-45bc-9323-39c0652ee5c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:24.184778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:24.192010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7eb1b230-e133-45bc-9323-39c0652ee5c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:24.198244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c3d7fe02-7b2f-41a2-a6fb-9e6a03b53840 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:24.203500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7eb1b230-e133-45bc-9323-39c0652ee5c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:24.204755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7eb1b230-e133-45bc-9323-39c0652ee5c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:24.205851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7eb1b230-e133-45bc-9323-39c0652ee5c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:24.206963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7eb1b230-e133-45bc-9323-39c0652ee5c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:24.207639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7eb1b230-e133-45bc-9323-39c0652ee5c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:24.210922 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c3d7fe02-7b2f-41a2-a6fb-9e6a03b53840 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 200 len: 1466 microversion: 2.1 time: 0.345190 Oct 12 22:09:24.224333 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1377/2517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:23 2022] GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 1466 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:24.665831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-14216a16-1534-482f-8ef0-862fcc503058 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:24.666926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-14216a16-1534-482f-8ef0-862fcc503058 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:24.694566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14216a16-1534-482f-8ef0-862fcc503058 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:24.695208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14216a16-1534-482f-8ef0-862fcc503058 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:24.695937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14216a16-1534-482f-8ef0-862fcc503058 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:24.696884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14216a16-1534-482f-8ef0-862fcc503058 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:24.698658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14216a16-1534-482f-8ef0-862fcc503058 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:24.700604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14216a16-1534-482f-8ef0-862fcc503058 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:24.986376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7eb1b230-e133-45bc-9323-39c0652ee5c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:25.004337 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7eb1b230-e133-45bc-9323-39c0652ee5c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1313 microversion: 2.1 time: 0.828905 Oct 12 22:09:25.005007 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1141/2518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:24 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1313 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:25.010035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c0a495c3-1033-4cf7-9c7f-e8cb1009dca6 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:25.011025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c0a495c3-1033-4cf7-9c7f-e8cb1009dca6 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:25.029205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0a495c3-1033-4cf7-9c7f-e8cb1009dca6 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:25.029943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0a495c3-1033-4cf7-9c7f-e8cb1009dca6 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:25.030529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0a495c3-1033-4cf7-9c7f-e8cb1009dca6 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:25.031446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0a495c3-1033-4cf7-9c7f-e8cb1009dca6 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:25.032046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0a495c3-1033-4cf7-9c7f-e8cb1009dca6 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:25.032618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0a495c3-1033-4cf7-9c7f-e8cb1009dca6 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:25.206465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c0a495c3-1033-4cf7-9c7f-e8cb1009dca6 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:25.219796 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c0a495c3-1033-4cf7-9c7f-e8cb1009dca6 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8" status: 200 len: 1267 microversion: 2.1 time: 0.213367 Oct 12 22:09:25.220388 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1142/2519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:25 2022] GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:25.239060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:25.251419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-66213cff-22c4-4902-9db3-f6e42061956b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:25.251863 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-14216a16-1534-482f-8ef0-862fcc503058 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 200 len: 1617 microversion: 2.1 time: 1.000557 Oct 12 22:09:25.254348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-66213cff-22c4-4902-9db3-f6e42061956b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:25.255971 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1378/2520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:24 2022] GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 1617 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:09:25.261469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66213cff-22c4-4902-9db3-f6e42061956b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:25.262260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66213cff-22c4-4902-9db3-f6e42061956b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:25.262904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66213cff-22c4-4902-9db3-f6e42061956b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:25.263917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66213cff-22c4-4902-9db3-f6e42061956b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:25.264579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66213cff-22c4-4902-9db3-f6e42061956b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:25.265210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66213cff-22c4-4902-9db3-f6e42061956b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:25.266673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b36b4ea3-1a57-4341-bf70-bc9b2381a467 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:25.267348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b36b4ea3-1a57-4341-bf70-bc9b2381a467 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:25.289726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b36b4ea3-1a57-4341-bf70-bc9b2381a467 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:25.292498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b36b4ea3-1a57-4341-bf70-bc9b2381a467 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:25.299394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b36b4ea3-1a57-4341-bf70-bc9b2381a467 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:25.300344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b36b4ea3-1a57-4341-bf70-bc9b2381a467 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:25.300844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b36b4ea3-1a57-4341-bf70-bc9b2381a467 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:25.305955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b36b4ea3-1a57-4341-bf70-bc9b2381a467 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:25.341324 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-66213cff-22c4-4902-9db3-f6e42061956b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110103 Oct 12 22:09:25.351331 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1143/2521] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:09:25 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:25.356649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3fb2544a-02ee-4b2c-b8b5-432f37ab9ebe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Action: 'create', calling method: .version_select at 0x7f512c4c8a60>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1994084265", "policies": ["affinity"]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:25.403043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-3fb2544a-02ee-4b2c-b8b5-432f37ab9ebe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_groups'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:09:25.416085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-3fb2544a-02ee-4b2c-b8b5-432f37ab9ebe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_groups'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:09:25.498323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-3fb2544a-02ee-4b2c-b8b5-432f37ab9ebe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_groups'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:09:25.504986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-3fb2544a-02ee-4b2c-b8b5-432f37ab9ebe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_groups'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:09:25.539511 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3fb2544a-02ee-4b2c-b8b5-432f37ab9ebe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.186710 Oct 12 22:09:25.543113 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1144/2522] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Oct 12 22:09:25 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:25.569063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b36b4ea3-1a57-4341-bf70-bc9b2381a467 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:25.573902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-8f4ed7d6-6c09-4b25-a501-4f278bd0e70a req-d2f6ca74-a378-4c3e-baba-ae459816b6ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5", "tag": "070ca292-679a-4589-8eaf-8faad4f81171"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:25.586443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b36b4ea3-1a57-4341-bf70-bc9b2381a467 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:25.589050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8f4ed7d6-6c09-4b25-a501-4f278bd0e70a req-d2f6ca74-a378-4c3e-baba-ae459816b6ed service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:25.590962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8f4ed7d6-6c09-4b25-a501-4f278bd0e70a req-d2f6ca74-a378-4c3e-baba-ae459816b6ed service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:25.596543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b36b4ea3-1a57-4341-bf70-bc9b2381a467 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:25.598139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8f4ed7d6-6c09-4b25-a501-4f278bd0e70a req-d2f6ca74-a378-4c3e-baba-ae459816b6ed service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:25.611545 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b36b4ea3-1a57-4341-bf70-bc9b2381a467 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1535 microversion: 2.91 time: 0.354439 Oct 12 22:09:25.617324 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-8f4ed7d6-6c09-4b25-a501-4f278bd0e70a req-d2f6ca74-a378-4c3e-baba-ae459816b6ed service nova] Creating event network-changed:070ca292-679a-4589-8eaf-8faad4f81171 for instance f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 on n-h1-861111-1 Oct 12 22:09:25.620558 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1379/2523] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:25 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1535 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:25.629923 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-8f4ed7d6-6c09-4b25-a501-4f278bd0e70a req-d2f6ca74-a378-4c3e-baba-ae459816b6ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058001 Oct 12 22:09:25.633698 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1145/2524] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:09:25.727231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-582349859", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "6fd53820-5929-4211-b79d-05c382d7a9d7"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:25.800270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] validate_networks() for None {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:09:26.034278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-966c1004-19fb-42f3-bb65-1e23981d5b00 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:26.040161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-966c1004-19fb-42f3-bb65-1e23981d5b00 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:26.060687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-966c1004-19fb-42f3-bb65-1e23981d5b00 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:26.061166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-966c1004-19fb-42f3-bb65-1e23981d5b00 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:26.061597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-966c1004-19fb-42f3-bb65-1e23981d5b00 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:26.062306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-966c1004-19fb-42f3-bb65-1e23981d5b00 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:26.062920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-966c1004-19fb-42f3-bb65-1e23981d5b00 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:26.067781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-966c1004-19fb-42f3-bb65-1e23981d5b00 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:26.145720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:09:26.146330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:09:26.146950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:09:26.147528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:09:26.148109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:09:26.186401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:26.187820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:26.188436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:26.189327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:26.190227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:26.192102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:26.217745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:09:26.217938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-966c1004-19fb-42f3-bb65-1e23981d5b00 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:26.224598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:09:26.226014 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-966c1004-19fb-42f3-bb65-1e23981d5b00 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1313 microversion: 2.1 time: 0.198777 Oct 12 22:09:26.227917 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1146/2525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:26 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:09:26.259662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c654ef38-eee3-461d-9e35-4eb6de469f1c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:26.261409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c654ef38-eee3-461d-9e35-4eb6de469f1c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:26.278326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Going to run 2 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:09:26.288948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c654ef38-eee3-461d-9e35-4eb6de469f1c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:26.289241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 35efe352-3b67-40fc-99c5-22fbf221bdfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:09:26.289528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c654ef38-eee3-461d-9e35-4eb6de469f1c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:26.289972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c654ef38-eee3-461d-9e35-4eb6de469f1c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:26.290880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c654ef38-eee3-461d-9e35-4eb6de469f1c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:26.291510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c654ef38-eee3-461d-9e35-4eb6de469f1c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:26.292745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c654ef38-eee3-461d-9e35-4eb6de469f1c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:26.370616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120453) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 12 22:09:26.443975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_group_members'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:09:26.450709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_group_members'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:09:26.517844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c654ef38-eee3-461d-9e35-4eb6de469f1c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:26.530802 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c654ef38-eee3-461d-9e35-4eb6de469f1c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8" status: 200 len: 1273 microversion: 2.1 time: 0.289218 Oct 12 22:09:26.531570 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1147/2526] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:26 2022] GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 => generated 1273 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:26.537886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_group_members'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:09:26.539963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bc2a6cf7-4aef-4ac5-8c6e-993d6dcd11da tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:26.542497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bc2a6cf7-4aef-4ac5-8c6e-993d6dcd11da tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:26.558024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_group_members'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:09:26.561081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc2a6cf7-4aef-4ac5-8c6e-993d6dcd11da tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:26.561901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc2a6cf7-4aef-4ac5-8c6e-993d6dcd11da tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:26.562681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc2a6cf7-4aef-4ac5-8c6e-993d6dcd11da tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:26.563671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc2a6cf7-4aef-4ac5-8c6e-993d6dcd11da tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:26.564339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc2a6cf7-4aef-4ac5-8c6e-993d6dcd11da tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:26.565050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc2a6cf7-4aef-4ac5-8c6e-993d6dcd11da tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:26.581722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=35efe352-3b67-40fc-99c5-22fbf221bdfa,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:09:26.608502 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bc2a6cf7-4aef-4ac5-8c6e-993d6dcd11da tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075672 Oct 12 22:09:26.609092 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1148/2527] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:09:26 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:26.643416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ad5bea40-dfd0-45b3-b968-ed1b630bed35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:26.644270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ad5bea40-dfd0-45b3-b968-ed1b630bed35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:26.654331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad5bea40-dfd0-45b3-b968-ed1b630bed35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:26.657121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad5bea40-dfd0-45b3-b968-ed1b630bed35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:26.657843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad5bea40-dfd0-45b3-b968-ed1b630bed35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:26.659810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad5bea40-dfd0-45b3-b968-ed1b630bed35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:26.661108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad5bea40-dfd0-45b3-b968-ed1b630bed35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:26.662543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad5bea40-dfd0-45b3-b968-ed1b630bed35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:26.675037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_group_members'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:09:26.693054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_group_members'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:09:26.773829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_group_members'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:09:26.784263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:26.792456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ad5bea40-dfd0-45b3-b968-ed1b630bed35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:26.805595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_group_members'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:09:26.808393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ad5bea40-dfd0-45b3-b968-ed1b630bed35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:26.814562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ad5bea40-dfd0-45b3-b968-ed1b630bed35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:26.827131 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ad5bea40-dfd0-45b3-b968-ed1b630bed35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1535 microversion: 2.91 time: 0.188523 Oct 12 22:09:26.831538 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1149/2528] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:26 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1535 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:26.875683 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bf5ec925-bfd6-408f-9091-067236ba569c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.151912 Oct 12 22:09:26.880482 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1380/2529] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:09:25 2022] POST /compute/v2.1/servers => generated 32 bytes in 1157 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:09:26.886180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1564a1b-70f7-468d-a91c-feecec7dc610 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:26.890969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a1564a1b-70f7-468d-a91c-feecec7dc610 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:26.903989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a1564a1b-70f7-468d-a91c-feecec7dc610 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Searching by: {'deleted': False, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:09:26.932849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1564a1b-70f7-468d-a91c-feecec7dc610 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:26.933336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1564a1b-70f7-468d-a91c-feecec7dc610 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:26.933780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1564a1b-70f7-468d-a91c-feecec7dc610 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:26.934517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1564a1b-70f7-468d-a91c-feecec7dc610 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:26.934967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1564a1b-70f7-468d-a91c-feecec7dc610 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:26.935416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1564a1b-70f7-468d-a91c-feecec7dc610 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:26.987173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.multi_cell_list [None req-a1564a1b-70f7-468d-a91c-feecec7dc610 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:09:27.013555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2beb8e09-2efb-4d35-9da7-f270f096e452 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:27.013891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2beb8e09-2efb-4d35-9da7-f270f096e452 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:27.028821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2beb8e09-2efb-4d35-9da7-f270f096e452 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:27.029320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2beb8e09-2efb-4d35-9da7-f270f096e452 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:27.032328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2beb8e09-2efb-4d35-9da7-f270f096e452 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:27.032734 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a1564a1b-70f7-468d-a91c-feecec7dc610 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.150850 Oct 12 22:09:27.033116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2beb8e09-2efb-4d35-9da7-f270f096e452 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:27.035566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2beb8e09-2efb-4d35-9da7-f270f096e452 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:27.039457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2beb8e09-2efb-4d35-9da7-f270f096e452 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:27.043609 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1150/2530] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 12 22:09:26 2022] GET /compute/v2.1/servers => generated 1002 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:27.048501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-482da647-0124-4e48-8612-4cbc89172dc8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:27.049333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-482da647-0124-4e48-8612-4cbc89172dc8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:27.063784 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-2beb8e09-2efb-4d35-9da7-f270f096e452 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] HTTP exception thrown: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2beb8e09-2efb-4d35-9da7-f270f096e452 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Request method failure captured: Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 HTTP/1.1 Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzpoYMtQSnUHG0KyxaWIcAf0TTZS7giBRd1rf3Ojo9zPcJwC9OYUqmS19EMludsJQ1A70mHfuA7Rr3HFdK6gV2eGvM-JM7WARMIACL7gu9-0tgDP_Bdr0UymtP5evaMPgx83kgiMGI7_FxD-tHKyDb1auXeuY9S-71n1eFFbr16VJ8w Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: ebf3c61412cf43f691e7af5d26e740bd Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-998835207 Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ebf3c61412cf43f691e7af5d26e740bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ebf3c61412cf43f691e7af5d26e740bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ebf3c61412cf43f691e7af5d26e740bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ebf3c61412cf43f691e7af5d26e740bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-998835207 Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: ebf3c61412cf43f691e7af5d26e740bd Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-998835207 Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachSCSIVolumeTestJSON-998835207-project Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 4d9e20674549401c89b9d264d1167f3a Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-998835207-project Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '54a23a46-7ad2-4563-a557-1806d4d61253'} Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:09:27.066132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:09:27.069944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. Oct 12 22:09:27.069944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:27.069944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:27.069944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:27.069944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:27.069944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:27.069944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:27.069944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:09:27.069944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:09:27.069944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. Oct 12 22:09:27.069944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:27.069944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2beb8e09-2efb-4d35-9da7-f270f096e452 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Returning 404 to user: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:09:27.069944 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2beb8e09-2efb-4d35-9da7-f270f096e452 tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "DELETE /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 404 len: 111 microversion: 2.1 time: 0.060347 Oct 12 22:09:27.072673 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1381/2531] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:09:27 2022] DELETE /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:09:27.079268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2cd34821-2db7-4b63-a2ce-8a5e77ddf56a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:27.079913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2cd34821-2db7-4b63-a2ce-8a5e77ddf56a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] [instance: 54a23a46-7ad2-4563-a557-1806d4d61253] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:27.088536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cd34821-2db7-4b63-a2ce-8a5e77ddf56a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:27.089573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cd34821-2db7-4b63-a2ce-8a5e77ddf56a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:27.089949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cd34821-2db7-4b63-a2ce-8a5e77ddf56a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:27.090639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cd34821-2db7-4b63-a2ce-8a5e77ddf56a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:27.091084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cd34821-2db7-4b63-a2ce-8a5e77ddf56a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:27.091550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cd34821-2db7-4b63-a2ce-8a5e77ddf56a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:27.110057 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-2cd34821-2db7-4b63-a2ce-8a5e77ddf56a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] HTTP exception thrown: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2cd34821-2db7-4b63-a2ce-8a5e77ddf56a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Request method failure captured: Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 HTTP/1.1 Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzpoYMtQSnUHG0KyxaWIcAf0TTZS7giBRd1rf3Ojo9zPcJwC9OYUqmS19EMludsJQ1A70mHfuA7Rr3HFdK6gV2eGvM-JM7WARMIACL7gu9-0tgDP_Bdr0UymtP5evaMPgx83kgiMGI7_FxD-tHKyDb1auXeuY9S-71n1eFFbr16VJ8w Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: ebf3c61412cf43f691e7af5d26e740bd Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-998835207 Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ebf3c61412cf43f691e7af5d26e740bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ebf3c61412cf43f691e7af5d26e740bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ebf3c61412cf43f691e7af5d26e740bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ebf3c61412cf43f691e7af5d26e740bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-998835207 Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: ebf3c61412cf43f691e7af5d26e740bd Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-998835207 Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachSCSIVolumeTestJSON-998835207-project Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 4d9e20674549401c89b9d264d1167f3a Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-998835207-project Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '54a23a46-7ad2-4563-a557-1806d4d61253'} Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:27.112124 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:27.116018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:27.116018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:27.116018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:27.116018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:09:27.116018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:09:27.116018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. Oct 12 22:09:27.116018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:27.116018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2cd34821-2db7-4b63-a2ce-8a5e77ddf56a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] Returning 404 to user: Instance 54a23a46-7ad2-4563-a557-1806d4d61253 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:09:27.116018 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2cd34821-2db7-4b63-a2ce-8a5e77ddf56a tempest-AttachSCSIVolumeTestJSON-998835207 tempest-AttachSCSIVolumeTestJSON-998835207-project] 10.222.0.16 "GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253" status: 404 len: 111 microversion: 2.1 time: 0.039747 Oct 12 22:09:27.120581 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1382/2532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:27 2022] GET /compute/v2.1/servers/54a23a46-7ad2-4563-a557-1806d4d61253 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:09:27.167110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-482da647-0124-4e48-8612-4cbc89172dc8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:27.174126 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-482da647-0124-4e48-8612-4cbc89172dc8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1218 microversion: 2.1 time: 0.129407 Oct 12 22:09:27.183567 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1151/2533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:27 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:27.252761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ee109aff-3f17-4bce-bd25-e0f2d5064200 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:27.253361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ee109aff-3f17-4bce-bd25-e0f2d5064200 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:27.263697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee109aff-3f17-4bce-bd25-e0f2d5064200 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:27.264192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee109aff-3f17-4bce-bd25-e0f2d5064200 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:27.264629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee109aff-3f17-4bce-bd25-e0f2d5064200 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:27.265332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee109aff-3f17-4bce-bd25-e0f2d5064200 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:27.270183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee109aff-3f17-4bce-bd25-e0f2d5064200 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:27.270636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee109aff-3f17-4bce-bd25-e0f2d5064200 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:27.554929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bc71e3b3-dda1-4fd4-abd5-9eeb16a9af48 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:27.555570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bc71e3b3-dda1-4fd4-abd5-9eeb16a9af48 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:27.564619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc71e3b3-dda1-4fd4-abd5-9eeb16a9af48 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:27.565568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc71e3b3-dda1-4fd4-abd5-9eeb16a9af48 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:27.566295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc71e3b3-dda1-4fd4-abd5-9eeb16a9af48 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:27.568073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc71e3b3-dda1-4fd4-abd5-9eeb16a9af48 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:27.568750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc71e3b3-dda1-4fd4-abd5-9eeb16a9af48 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:27.569500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc71e3b3-dda1-4fd4-abd5-9eeb16a9af48 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:27.574037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ee109aff-3f17-4bce-bd25-e0f2d5064200 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:27.588281 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ee109aff-3f17-4bce-bd25-e0f2d5064200 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1313 microversion: 2.1 time: 0.333204 Oct 12 22:09:27.588987 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1383/2534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:27 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:27.613796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:27.631876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb2010df-791f-4b61-8e74-a859ab539259 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:27.641520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cb2010df-791f-4b61-8e74-a859ab539259 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:27.683388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb2010df-791f-4b61-8e74-a859ab539259 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:27.683970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb2010df-791f-4b61-8e74-a859ab539259 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:27.684317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb2010df-791f-4b61-8e74-a859ab539259 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:27.685030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb2010df-791f-4b61-8e74-a859ab539259 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:27.685475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb2010df-791f-4b61-8e74-a859ab539259 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:27.685891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb2010df-791f-4b61-8e74-a859ab539259 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:27.783995 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cb2010df-791f-4b61-8e74-a859ab539259 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165743 Oct 12 22:09:27.799045 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1384/2535] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:09:27 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:27.860580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c3c3f947-efd6-4f0d-b368-4919087c8e75 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:27.861353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c3c3f947-efd6-4f0d-b368-4919087c8e75 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:27.897678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3c3f947-efd6-4f0d-b368-4919087c8e75 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:27.898191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3c3f947-efd6-4f0d-b368-4919087c8e75 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:27.898638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3c3f947-efd6-4f0d-b368-4919087c8e75 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:27.899380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3c3f947-efd6-4f0d-b368-4919087c8e75 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:27.899838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3c3f947-efd6-4f0d-b368-4919087c8e75 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:27.900263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3c3f947-efd6-4f0d-b368-4919087c8e75 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:28.074261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c3c3f947-efd6-4f0d-b368-4919087c8e75 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:28.085589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c3c3f947-efd6-4f0d-b368-4919087c8e75 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:28.091625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c3c3f947-efd6-4f0d-b368-4919087c8e75 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:28.112969 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c3c3f947-efd6-4f0d-b368-4919087c8e75 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1535 microversion: 2.91 time: 0.250263 Oct 12 22:09:28.127660 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1385/2536] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:27 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1535 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:09:28.198684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d03bc25c-bb87-4986-b862-7e86f5582832 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:28.199789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d03bc25c-bb87-4986-b862-7e86f5582832 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:28.596343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d03bc25c-bb87-4986-b862-7e86f5582832 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:28.609110 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d03bc25c-bb87-4986-b862-7e86f5582832 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1218 microversion: 2.1 time: 0.414616 Oct 12 22:09:28.610400 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1386/2537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:28 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1218 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:09:28.619468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f872bc07-fb34-4f4b-b995-03a8b7826925 req-230801ab-093d-4792-b437-f19ef4cd2b85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e83b077-4692-4351-8b85-e82dd3661af8", "tag": "cfc3e15c-0e8c-49d8-885b-7827d5c6c133"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:28.642189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f872bc07-fb34-4f4b-b995-03a8b7826925 req-230801ab-093d-4792-b437-f19ef4cd2b85 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:28.648373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f872bc07-fb34-4f4b-b995-03a8b7826925 req-230801ab-093d-4792-b437-f19ef4cd2b85 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:28.649162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f872bc07-fb34-4f4b-b995-03a8b7826925 req-230801ab-093d-4792-b437-f19ef4cd2b85 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:28.673486 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f872bc07-fb34-4f4b-b995-03a8b7826925 req-230801ab-093d-4792-b437-f19ef4cd2b85 service nova] Creating event network-changed:cfc3e15c-0e8c-49d8-885b-7827d5c6c133 for instance 8e83b077-4692-4351-8b85-e82dd3661af8 on n-h2-861111-1 Oct 12 22:09:28.688632 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f872bc07-fb34-4f4b-b995-03a8b7826925 req-230801ab-093d-4792-b437-f19ef4cd2b85 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076597 Oct 12 22:09:28.689606 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1387/2538] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:28.695228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-385786e7-ea10-4f8b-9321-178bfe526edc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:28.701390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-385786e7-ea10-4f8b-9321-178bfe526edc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:28.730746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-385786e7-ea10-4f8b-9321-178bfe526edc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:28.731563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-385786e7-ea10-4f8b-9321-178bfe526edc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:28.731908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-385786e7-ea10-4f8b-9321-178bfe526edc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:28.732749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-385786e7-ea10-4f8b-9321-178bfe526edc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:28.734012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-385786e7-ea10-4f8b-9321-178bfe526edc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:28.735057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-385786e7-ea10-4f8b-9321-178bfe526edc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:28.992251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-385786e7-ea10-4f8b-9321-178bfe526edc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:29.002030 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-385786e7-ea10-4f8b-9321-178bfe526edc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1313 microversion: 2.1 time: 0.310977 Oct 12 22:09:29.005139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bc71e3b3-dda1-4fd4-abd5-9eeb16a9af48 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:29.013719 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bc71e3b3-dda1-4fd4-abd5-9eeb16a9af48 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8" status: 200 len: 1315 microversion: 2.1 time: 1.463039 Oct 12 22:09:29.035409 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1152/2539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:27 2022] GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 => generated 1315 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:29.054817 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1388/2540] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:28 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:29.068239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-850388cb-4165-4ce6-8c26-3aa9b689dd6f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:29.073958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-850388cb-4165-4ce6-8c26-3aa9b689dd6f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:29.087434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-850388cb-4165-4ce6-8c26-3aa9b689dd6f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:29.087941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-850388cb-4165-4ce6-8c26-3aa9b689dd6f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:29.088948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-850388cb-4165-4ce6-8c26-3aa9b689dd6f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:29.090526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-850388cb-4165-4ce6-8c26-3aa9b689dd6f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:29.091322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-850388cb-4165-4ce6-8c26-3aa9b689dd6f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:29.091718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-850388cb-4165-4ce6-8c26-3aa9b689dd6f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:29.145533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d8020e07-1056-45da-99ca-dca0a5a12d8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:29.146501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d8020e07-1056-45da-99ca-dca0a5a12d8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:29.155021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8020e07-1056-45da-99ca-dca0a5a12d8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:29.155557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8020e07-1056-45da-99ca-dca0a5a12d8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:29.156107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8020e07-1056-45da-99ca-dca0a5a12d8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:29.157250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8020e07-1056-45da-99ca-dca0a5a12d8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:29.158131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8020e07-1056-45da-99ca-dca0a5a12d8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:29.158714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8020e07-1056-45da-99ca-dca0a5a12d8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:29.173960 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-850388cb-4165-4ce6-8c26-3aa9b689dd6f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136544 Oct 12 22:09:29.174599 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1153/2541] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:09:29 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:29.245998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d8020e07-1056-45da-99ca-dca0a5a12d8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:29.255849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d8020e07-1056-45da-99ca-dca0a5a12d8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:29.257376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d8020e07-1056-45da-99ca-dca0a5a12d8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:29.263893 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d8020e07-1056-45da-99ca-dca0a5a12d8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1478 microversion: 2.91 time: 0.123904 Oct 12 22:09:29.264781 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1389/2542] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:29 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1478 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:09:29.291875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-94a6b311-cdc0-40bc-a9cf-9b2f9007ec18 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-861111-1"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:29.294492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-94a6b311-cdc0-40bc-a9cf-9b2f9007ec18 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:29.302168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94a6b311-cdc0-40bc-a9cf-9b2f9007ec18 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:29.302664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94a6b311-cdc0-40bc-a9cf-9b2f9007ec18 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:29.303550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94a6b311-cdc0-40bc-a9cf-9b2f9007ec18 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:29.304224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94a6b311-cdc0-40bc-a9cf-9b2f9007ec18 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:29.304636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94a6b311-cdc0-40bc-a9cf-9b2f9007ec18 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:29.305097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94a6b311-cdc0-40bc-a9cf-9b2f9007ec18 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:29.392819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-94a6b311-cdc0-40bc-a9cf-9b2f9007ec18 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-861111-1". {{(pid=120452) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 22:09:29.514840 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-94a6b311-cdc0-40bc-a9cf-9b2f9007ec18 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89/action" status: 202 len: 0 microversion: 2.91 time: 0.227023 Oct 12 22:09:29.518458 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1154/2543] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 12 22:09:29 2022] POST /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:09:29.524853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b85aed9-d450-47b9-ac15-509fa7cf491b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:29.525683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8b85aed9-d450-47b9-ac15-509fa7cf491b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:29.536006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b85aed9-d450-47b9-ac15-509fa7cf491b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:29.536481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b85aed9-d450-47b9-ac15-509fa7cf491b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:29.537023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b85aed9-d450-47b9-ac15-509fa7cf491b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:29.539231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b85aed9-d450-47b9-ac15-509fa7cf491b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:29.539907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b85aed9-d450-47b9-ac15-509fa7cf491b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:29.540483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b85aed9-d450-47b9-ac15-509fa7cf491b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:29.637938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b85aed9-d450-47b9-ac15-509fa7cf491b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:29.643136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a4f522e0-b4b1-4a4c-b413-a983beddc91f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:29.643894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a4f522e0-b4b1-4a4c-b413-a983beddc91f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:29.659648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b85aed9-d450-47b9-ac15-509fa7cf491b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:29.661843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4f522e0-b4b1-4a4c-b413-a983beddc91f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:29.663831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b85aed9-d450-47b9-ac15-509fa7cf491b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:29.665926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4f522e0-b4b1-4a4c-b413-a983beddc91f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:29.666441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4f522e0-b4b1-4a4c-b413-a983beddc91f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:29.667807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4f522e0-b4b1-4a4c-b413-a983beddc91f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:29.668448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4f522e0-b4b1-4a4c-b413-a983beddc91f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:29.668881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4f522e0-b4b1-4a4c-b413-a983beddc91f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:29.675819 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8b85aed9-d450-47b9-ac15-509fa7cf491b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1486 microversion: 2.91 time: 0.155844 Oct 12 22:09:29.676410 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1390/2544] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:29 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1486 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:09:29.829574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a4f522e0-b4b1-4a4c-b413-a983beddc91f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:29.837999 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a4f522e0-b4b1-4a4c-b413-a983beddc91f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1270 microversion: 2.1 time: 0.205571 Oct 12 22:09:29.839407 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1155/2545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:29 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1270 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:29.956105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-bfea9cf5-1c8e-4f51-8679-bc0d50d233a1 req-bfae9265-5b64-4a5d-b46e-e85c4be62901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b0eb54-219e-4026-b96c-59b963b0f770", "name": "network-vif-plugged", "status": "completed", "tag": "72cdcc3a-ba0f-41c3-9bb0-97a69bd68560"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:29.977291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-bfea9cf5-1c8e-4f51-8679-bc0d50d233a1 req-bfae9265-5b64-4a5d-b46e-e85c4be62901 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:29.977810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-bfea9cf5-1c8e-4f51-8679-bc0d50d233a1 req-bfae9265-5b64-4a5d-b46e-e85c4be62901 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:29.978224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-bfea9cf5-1c8e-4f51-8679-bc0d50d233a1 req-bfae9265-5b64-4a5d-b46e-e85c4be62901 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:30.012566 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-bfea9cf5-1c8e-4f51-8679-bc0d50d233a1 req-bfae9265-5b64-4a5d-b46e-e85c4be62901 service nova] Creating event network-vif-plugged:72cdcc3a-ba0f-41c3-9bb0-97a69bd68560 for instance f3b0eb54-219e-4026-b96c-59b963b0f770 on n-h1-861111-1 Oct 12 22:09:30.017768 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-bfea9cf5-1c8e-4f51-8679-bc0d50d233a1 req-bfae9265-5b64-4a5d-b46e-e85c4be62901 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065428 Oct 12 22:09:30.028328 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1391/2546] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:09:30.039011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-733b7c0d-f649-4b95-805d-da2630b86457 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:30.040020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-733b7c0d-f649-4b95-805d-da2630b86457 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:30.064958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-32c52827-5ef7-45a9-bbe7-caa91b3c6432 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:30.071320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-32c52827-5ef7-45a9-bbe7-caa91b3c6432 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:30.087081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-733b7c0d-f649-4b95-805d-da2630b86457 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:30.087841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-733b7c0d-f649-4b95-805d-da2630b86457 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:30.088286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-733b7c0d-f649-4b95-805d-da2630b86457 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:30.089735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32c52827-5ef7-45a9-bbe7-caa91b3c6432 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:30.090456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32c52827-5ef7-45a9-bbe7-caa91b3c6432 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:30.091119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32c52827-5ef7-45a9-bbe7-caa91b3c6432 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:30.092302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32c52827-5ef7-45a9-bbe7-caa91b3c6432 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:30.092959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32c52827-5ef7-45a9-bbe7-caa91b3c6432 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:30.093585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32c52827-5ef7-45a9-bbe7-caa91b3c6432 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:30.098029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-733b7c0d-f649-4b95-805d-da2630b86457 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:30.098611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-733b7c0d-f649-4b95-805d-da2630b86457 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:30.100082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-733b7c0d-f649-4b95-805d-da2630b86457 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:30.291824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-32c52827-5ef7-45a9-bbe7-caa91b3c6432 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:30.306247 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-32c52827-5ef7-45a9-bbe7-caa91b3c6432 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1313 microversion: 2.1 time: 0.245162 Oct 12 22:09:30.308062 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1392/2547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:30 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:30.313354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3e6b4508-ff76-4430-bb25-2be3007edfe8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:30.315798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3e6b4508-ff76-4430-bb25-2be3007edfe8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:30.323160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e6b4508-ff76-4430-bb25-2be3007edfe8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:30.323924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e6b4508-ff76-4430-bb25-2be3007edfe8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:30.324488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e6b4508-ff76-4430-bb25-2be3007edfe8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:30.325504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e6b4508-ff76-4430-bb25-2be3007edfe8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:30.326081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e6b4508-ff76-4430-bb25-2be3007edfe8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:30.326751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e6b4508-ff76-4430-bb25-2be3007edfe8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:30.365754 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3e6b4508-ff76-4430-bb25-2be3007edfe8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056327 Oct 12 22:09:30.373376 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1393/2548] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:09:30 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:30.711463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8fe49869-de5a-4cbc-95f3-d3f1eb4bc685 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:30.712534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8fe49869-de5a-4cbc-95f3-d3f1eb4bc685 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:30.721959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fe49869-de5a-4cbc-95f3-d3f1eb4bc685 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:30.722450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fe49869-de5a-4cbc-95f3-d3f1eb4bc685 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:30.723071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fe49869-de5a-4cbc-95f3-d3f1eb4bc685 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:30.724148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fe49869-de5a-4cbc-95f3-d3f1eb4bc685 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:30.725395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fe49869-de5a-4cbc-95f3-d3f1eb4bc685 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:30.726473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fe49869-de5a-4cbc-95f3-d3f1eb4bc685 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:30.805141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8fe49869-de5a-4cbc-95f3-d3f1eb4bc685 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:30.814909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8fe49869-de5a-4cbc-95f3-d3f1eb4bc685 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:30.819799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8fe49869-de5a-4cbc-95f3-d3f1eb4bc685 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:30.827983 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8fe49869-de5a-4cbc-95f3-d3f1eb4bc685 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.123722 Oct 12 22:09:30.829046 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1394/2549] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:30 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:09:30.841272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-733b7c0d-f649-4b95-805d-da2630b86457 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:30.856964 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-733b7c0d-f649-4b95-805d-da2630b86457 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8" status: 200 len: 1315 microversion: 2.1 time: 0.823460 Oct 12 22:09:30.868949 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1156/2550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:30 2022] GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 => generated 1315 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:30.869031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-29c5d4cc-faf4-4f8e-9507-6749ad980f64 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:30.873184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-29c5d4cc-faf4-4f8e-9507-6749ad980f64 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:30.879284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29c5d4cc-faf4-4f8e-9507-6749ad980f64 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:30.879780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29c5d4cc-faf4-4f8e-9507-6749ad980f64 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:30.880331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29c5d4cc-faf4-4f8e-9507-6749ad980f64 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:30.881250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29c5d4cc-faf4-4f8e-9507-6749ad980f64 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:30.881707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29c5d4cc-faf4-4f8e-9507-6749ad980f64 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:30.882161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29c5d4cc-faf4-4f8e-9507-6749ad980f64 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:30.949909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-29c5d4cc-faf4-4f8e-9507-6749ad980f64 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:30.958697 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-29c5d4cc-faf4-4f8e-9507-6749ad980f64 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1270 microversion: 2.1 time: 0.093745 Oct 12 22:09:30.960927 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1395/2551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:30 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:31.334933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bb903a8e-ba89-4a1d-b558-8dbd5bd83226 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:31.335868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bb903a8e-ba89-4a1d-b558-8dbd5bd83226 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:31.342549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb903a8e-ba89-4a1d-b558-8dbd5bd83226 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:31.343438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb903a8e-ba89-4a1d-b558-8dbd5bd83226 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:31.343965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb903a8e-ba89-4a1d-b558-8dbd5bd83226 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:31.344814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb903a8e-ba89-4a1d-b558-8dbd5bd83226 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:31.345256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb903a8e-ba89-4a1d-b558-8dbd5bd83226 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:31.345756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb903a8e-ba89-4a1d-b558-8dbd5bd83226 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:31.379022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f736936c-f036-4cbb-a440-e8d3e4e9debd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:31.382118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f736936c-f036-4cbb-a440-e8d3e4e9debd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:31.390431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f736936c-f036-4cbb-a440-e8d3e4e9debd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:31.391019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f736936c-f036-4cbb-a440-e8d3e4e9debd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:31.391537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f736936c-f036-4cbb-a440-e8d3e4e9debd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:31.392306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f736936c-f036-4cbb-a440-e8d3e4e9debd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:31.392822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f736936c-f036-4cbb-a440-e8d3e4e9debd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:31.393336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f736936c-f036-4cbb-a440-e8d3e4e9debd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:31.425618 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f736936c-f036-4cbb-a440-e8d3e4e9debd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050515 Oct 12 22:09:31.430910 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1396/2552] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:09:31 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:31.614505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bb903a8e-ba89-4a1d-b558-8dbd5bd83226 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:31.622492 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bb903a8e-ba89-4a1d-b558-8dbd5bd83226 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1313 microversion: 2.1 time: 0.292415 Oct 12 22:09:31.638081 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1157/2553] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:31 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:31.859455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-074bf2c3-71c9-4d8e-b277-0b2335719469 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:31.860204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-074bf2c3-71c9-4d8e-b277-0b2335719469 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:31.873966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-074bf2c3-71c9-4d8e-b277-0b2335719469 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:31.885898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-88af1c99-944c-4a24-839c-8496095dedca tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:31.888931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-88af1c99-944c-4a24-839c-8496095dedca tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:31.894242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-074bf2c3-71c9-4d8e-b277-0b2335719469 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:31.895134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-074bf2c3-71c9-4d8e-b277-0b2335719469 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:31.896353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-074bf2c3-71c9-4d8e-b277-0b2335719469 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:31.901971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-074bf2c3-71c9-4d8e-b277-0b2335719469 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:31.904604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-074bf2c3-71c9-4d8e-b277-0b2335719469 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:31.910959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88af1c99-944c-4a24-839c-8496095dedca tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:31.911738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88af1c99-944c-4a24-839c-8496095dedca tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:31.914505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88af1c99-944c-4a24-839c-8496095dedca tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:31.915479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88af1c99-944c-4a24-839c-8496095dedca tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:31.916195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88af1c99-944c-4a24-839c-8496095dedca tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:31.922204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88af1c99-944c-4a24-839c-8496095dedca tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:32.119621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-074bf2c3-71c9-4d8e-b277-0b2335719469 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:32.140589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-074bf2c3-71c9-4d8e-b277-0b2335719469 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:32.142232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-074bf2c3-71c9-4d8e-b277-0b2335719469 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:32.151659 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-074bf2c3-71c9-4d8e-b277-0b2335719469 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.296524 Oct 12 22:09:32.153145 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1397/2554] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:31 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:32.158147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7671e533-3ca5-481e-bc99-9d44792c8260 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:32.158967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7671e533-3ca5-481e-bc99-9d44792c8260 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:32.189588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7671e533-3ca5-481e-bc99-9d44792c8260 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:32.207911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7671e533-3ca5-481e-bc99-9d44792c8260 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:32.209103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7671e533-3ca5-481e-bc99-9d44792c8260 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:32.212780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7671e533-3ca5-481e-bc99-9d44792c8260 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:32.213707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7671e533-3ca5-481e-bc99-9d44792c8260 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:32.217185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7671e533-3ca5-481e-bc99-9d44792c8260 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:32.558452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-88af1c99-944c-4a24-839c-8496095dedca tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:32.576969 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-88af1c99-944c-4a24-839c-8496095dedca tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8" status: 200 len: 1315 microversion: 2.1 time: 0.696204 Oct 12 22:09:32.582632 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1158/2555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:31 2022] GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:09:32.589682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6e19eabe-0221-4337-a983-9fd471fb6245 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:32.598575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6e19eabe-0221-4337-a983-9fd471fb6245 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:32.609060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e19eabe-0221-4337-a983-9fd471fb6245 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:32.609832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e19eabe-0221-4337-a983-9fd471fb6245 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:32.610413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e19eabe-0221-4337-a983-9fd471fb6245 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:32.611333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e19eabe-0221-4337-a983-9fd471fb6245 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:32.611936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e19eabe-0221-4337-a983-9fd471fb6245 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:32.612508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e19eabe-0221-4337-a983-9fd471fb6245 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:32.650586 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6e19eabe-0221-4337-a983-9fd471fb6245 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065274 Oct 12 22:09:32.652449 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1159/2556] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:09:32 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:09:32.658308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7671e533-3ca5-481e-bc99-9d44792c8260 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:32.670007 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7671e533-3ca5-481e-bc99-9d44792c8260 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1270 microversion: 2.1 time: 0.512505 Oct 12 22:09:32.670983 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1398/2557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:32 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1270 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:32.678677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9f0c2cd3-6ba6-4634-9cd6-23f3510a932c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:32.680070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9f0c2cd3-6ba6-4634-9cd6-23f3510a932c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:32.691160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f0c2cd3-6ba6-4634-9cd6-23f3510a932c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:32.691969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f0c2cd3-6ba6-4634-9cd6-23f3510a932c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:32.692651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f0c2cd3-6ba6-4634-9cd6-23f3510a932c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:32.693450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f0c2cd3-6ba6-4634-9cd6-23f3510a932c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:32.694113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f0c2cd3-6ba6-4634-9cd6-23f3510a932c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:32.694954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f0c2cd3-6ba6-4634-9cd6-23f3510a932c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:32.758638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-868ef90d-2025-4779-a337-f50d29f1c3c7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:32.760138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-868ef90d-2025-4779-a337-f50d29f1c3c7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:32.780402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-868ef90d-2025-4779-a337-f50d29f1c3c7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:32.783757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-868ef90d-2025-4779-a337-f50d29f1c3c7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:32.784386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-868ef90d-2025-4779-a337-f50d29f1c3c7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:32.785296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-868ef90d-2025-4779-a337-f50d29f1c3c7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:32.785912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-868ef90d-2025-4779-a337-f50d29f1c3c7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:32.786522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-868ef90d-2025-4779-a337-f50d29f1c3c7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:32.883761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-868ef90d-2025-4779-a337-f50d29f1c3c7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:09:32.887379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:33.059177 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-868ef90d-2025-4779-a337-f50d29f1c3c7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72" status: 204 len: 0 microversion: 2.1 time: 0.304643 Oct 12 22:09:33.059874 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1399/2558] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:09:32 2022] DELETE /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:09:33.068402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e3944a9b-06a7-4858-8cd1-40d7b1df80b5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:33.069113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e3944a9b-06a7-4858-8cd1-40d7b1df80b5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:33.086336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3944a9b-06a7-4858-8cd1-40d7b1df80b5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:33.086839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3944a9b-06a7-4858-8cd1-40d7b1df80b5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:33.087295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3944a9b-06a7-4858-8cd1-40d7b1df80b5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:33.088312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3944a9b-06a7-4858-8cd1-40d7b1df80b5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:33.089112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3944a9b-06a7-4858-8cd1-40d7b1df80b5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:33.089545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3944a9b-06a7-4858-8cd1-40d7b1df80b5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:33.612850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e3944a9b-06a7-4858-8cd1-40d7b1df80b5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:33.628847 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e3944a9b-06a7-4858-8cd1-40d7b1df80b5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72" status: 200 len: 1683 microversion: 2.1 time: 0.563370 Oct 12 22:09:33.631727 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1400/2559] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:33 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 => generated 1683 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:33.653557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-61ea7782-25f2-4d86-aa65-6c0ca0989cc3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:33.655716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-61ea7782-25f2-4d86-aa65-6c0ca0989cc3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:33.669889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61ea7782-25f2-4d86-aa65-6c0ca0989cc3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:33.670575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61ea7782-25f2-4d86-aa65-6c0ca0989cc3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:33.670798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61ea7782-25f2-4d86-aa65-6c0ca0989cc3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:33.687533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61ea7782-25f2-4d86-aa65-6c0ca0989cc3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:33.692212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61ea7782-25f2-4d86-aa65-6c0ca0989cc3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:33.699510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61ea7782-25f2-4d86-aa65-6c0ca0989cc3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:33.766280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9f0c2cd3-6ba6-4634-9cd6-23f3510a932c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:33.778870 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9f0c2cd3-6ba6-4634-9cd6-23f3510a932c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1313 microversion: 2.1 time: 1.117227 Oct 12 22:09:33.783956 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1160/2560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:32 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1313 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:33.806537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4792b7da-e992-4288-b947-45e7a5e2077b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:33.809676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4792b7da-e992-4288-b947-45e7a5e2077b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:33.821067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4792b7da-e992-4288-b947-45e7a5e2077b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:33.828047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4792b7da-e992-4288-b947-45e7a5e2077b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:33.828679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4792b7da-e992-4288-b947-45e7a5e2077b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:33.829622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4792b7da-e992-4288-b947-45e7a5e2077b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:33.832477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4792b7da-e992-4288-b947-45e7a5e2077b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:33.836627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4792b7da-e992-4288-b947-45e7a5e2077b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:33.980356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-61ea7782-25f2-4d86-aa65-6c0ca0989cc3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:33.987482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-61ea7782-25f2-4d86-aa65-6c0ca0989cc3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:33.988888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-61ea7782-25f2-4d86-aa65-6c0ca0989cc3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:34.013238 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-61ea7782-25f2-4d86-aa65-6c0ca0989cc3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.379382 Oct 12 22:09:34.025877 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1401/2561] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:33 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:34.046576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f4dbd1c1-6e9c-4296-be19-045cbfeec5d5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:34.047953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f4dbd1c1-6e9c-4296-be19-045cbfeec5d5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:34.058580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4dbd1c1-6e9c-4296-be19-045cbfeec5d5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:34.062225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4dbd1c1-6e9c-4296-be19-045cbfeec5d5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:34.065390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4dbd1c1-6e9c-4296-be19-045cbfeec5d5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:34.067336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4dbd1c1-6e9c-4296-be19-045cbfeec5d5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:34.069257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4dbd1c1-6e9c-4296-be19-045cbfeec5d5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:34.070314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4dbd1c1-6e9c-4296-be19-045cbfeec5d5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:34.148484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f4dbd1c1-6e9c-4296-be19-045cbfeec5d5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:34.157613 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f4dbd1c1-6e9c-4296-be19-045cbfeec5d5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1276 microversion: 2.1 time: 0.130348 Oct 12 22:09:34.158509 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1402/2562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:34 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1276 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:34.256961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4792b7da-e992-4288-b947-45e7a5e2077b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:34.270899 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4792b7da-e992-4288-b947-45e7a5e2077b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8" status: 200 len: 1315 microversion: 2.1 time: 0.485230 Oct 12 22:09:34.276012 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1161/2563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:33 2022] GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:34.549565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a648604c-aef2-4241-b2ad-d64aed4e985f req-62b3be1d-664f-42fb-9f8e-c5f4e2378a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5", "name": "network-vif-plugged", "status": "completed", "tag": "070ca292-679a-4589-8eaf-8faad4f81171"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:34.573544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a648604c-aef2-4241-b2ad-d64aed4e985f req-62b3be1d-664f-42fb-9f8e-c5f4e2378a7e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:34.586794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a648604c-aef2-4241-b2ad-d64aed4e985f req-62b3be1d-664f-42fb-9f8e-c5f4e2378a7e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:34.587814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a648604c-aef2-4241-b2ad-d64aed4e985f req-62b3be1d-664f-42fb-9f8e-c5f4e2378a7e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:34.625490 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a648604c-aef2-4241-b2ad-d64aed4e985f req-62b3be1d-664f-42fb-9f8e-c5f4e2378a7e service nova] Creating event network-vif-plugged:070ca292-679a-4589-8eaf-8faad4f81171 for instance f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 on n-h1-861111-1 Oct 12 22:09:34.636332 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a648604c-aef2-4241-b2ad-d64aed4e985f req-62b3be1d-664f-42fb-9f8e-c5f4e2378a7e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094867 Oct 12 22:09:34.647568 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1403/2564] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:34.658012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-479a7335-aa7f-4b37-8d2a-99daec02b77d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:34.658626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-479a7335-aa7f-4b37-8d2a-99daec02b77d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:34.673768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-479a7335-aa7f-4b37-8d2a-99daec02b77d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:34.676032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-479a7335-aa7f-4b37-8d2a-99daec02b77d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:34.676609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-479a7335-aa7f-4b37-8d2a-99daec02b77d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:34.678972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-479a7335-aa7f-4b37-8d2a-99daec02b77d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:34.680755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-479a7335-aa7f-4b37-8d2a-99daec02b77d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:34.682830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-479a7335-aa7f-4b37-8d2a-99daec02b77d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:34.814134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ed9d97e1-75b4-4ecd-bf48-251c7accdaff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:34.823194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ed9d97e1-75b4-4ecd-bf48-251c7accdaff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:34.835568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed9d97e1-75b4-4ecd-bf48-251c7accdaff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:34.839462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed9d97e1-75b4-4ecd-bf48-251c7accdaff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:34.841239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed9d97e1-75b4-4ecd-bf48-251c7accdaff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:34.842413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed9d97e1-75b4-4ecd-bf48-251c7accdaff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:34.844971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed9d97e1-75b4-4ecd-bf48-251c7accdaff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:34.847799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed9d97e1-75b4-4ecd-bf48-251c7accdaff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:35.140572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ed9d97e1-75b4-4ecd-bf48-251c7accdaff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:35.149741 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ed9d97e1-75b4-4ecd-bf48-251c7accdaff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1313 microversion: 2.1 time: 0.340724 Oct 12 22:09:35.151954 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1404/2565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:34 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:35.172582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5cc4a2af-19fc-41e2-9266-424ec99fee06 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:35.173652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5cc4a2af-19fc-41e2-9266-424ec99fee06 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:35.180584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cc4a2af-19fc-41e2-9266-424ec99fee06 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:35.181413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cc4a2af-19fc-41e2-9266-424ec99fee06 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:35.182730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cc4a2af-19fc-41e2-9266-424ec99fee06 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:35.183528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cc4a2af-19fc-41e2-9266-424ec99fee06 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:35.184425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cc4a2af-19fc-41e2-9266-424ec99fee06 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:35.185087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cc4a2af-19fc-41e2-9266-424ec99fee06 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:35.330020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5cc4a2af-19fc-41e2-9266-424ec99fee06 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:35.340528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5cc4a2af-19fc-41e2-9266-424ec99fee06 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:35.343817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5cc4a2af-19fc-41e2-9266-424ec99fee06 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:35.349502 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5cc4a2af-19fc-41e2-9266-424ec99fee06 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.184601 Oct 12 22:09:35.385857 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1405/2566] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:35 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:35.391000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e31b03b8-0f83-4f30-9706-59408f7012f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:35.391879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e31b03b8-0f83-4f30-9706-59408f7012f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:35.407554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e31b03b8-0f83-4f30-9706-59408f7012f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:35.408369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e31b03b8-0f83-4f30-9706-59408f7012f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:35.408990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e31b03b8-0f83-4f30-9706-59408f7012f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:35.409869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e31b03b8-0f83-4f30-9706-59408f7012f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:35.410493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e31b03b8-0f83-4f30-9706-59408f7012f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:35.411091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e31b03b8-0f83-4f30-9706-59408f7012f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:35.620401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e31b03b8-0f83-4f30-9706-59408f7012f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:35.651544 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e31b03b8-0f83-4f30-9706-59408f7012f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1276 microversion: 2.1 time: 0.258882 Oct 12 22:09:35.654732 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1406/2567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:35 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1276 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:35.669543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-479a7335-aa7f-4b37-8d2a-99daec02b77d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:35.677262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b882db01-a6d7-424f-a15e-a9cb865fb75d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:35.678852 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-479a7335-aa7f-4b37-8d2a-99daec02b77d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72" status: 200 len: 1683 microversion: 2.1 time: 1.024640 Oct 12 22:09:35.679637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b882db01-a6d7-424f-a15e-a9cb865fb75d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:35.704908 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1162/2568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:34 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 => generated 1683 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:35.705223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b882db01-a6d7-424f-a15e-a9cb865fb75d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:35.705223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b882db01-a6d7-424f-a15e-a9cb865fb75d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:35.705223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b882db01-a6d7-424f-a15e-a9cb865fb75d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:35.705223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b882db01-a6d7-424f-a15e-a9cb865fb75d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:35.709407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b882db01-a6d7-424f-a15e-a9cb865fb75d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:35.709407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b882db01-a6d7-424f-a15e-a9cb865fb75d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:36.008030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b882db01-a6d7-424f-a15e-a9cb865fb75d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:36.029860 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b882db01-a6d7-424f-a15e-a9cb865fb75d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8" status: 200 len: 1315 microversion: 2.1 time: 0.373696 Oct 12 22:09:36.045352 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1407/2569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:35 2022] GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:36.149371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-2cefbe9c-c47b-4cd9-ac50-72122c4ae2c8 req-a26c57de-c3ab-4b9c-a386-0d5f73702752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35efe352-3b67-40fc-99c5-22fbf221bdfa", "tag": "47ace383-978a-4d7b-be27-0a3f503cb49b"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:36.173695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2cefbe9c-c47b-4cd9-ac50-72122c4ae2c8 req-a26c57de-c3ab-4b9c-a386-0d5f73702752 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:36.174265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2cefbe9c-c47b-4cd9-ac50-72122c4ae2c8 req-a26c57de-c3ab-4b9c-a386-0d5f73702752 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:36.179155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e8534797-9602-4bed-a397-62c524ef7439 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:36.180392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e8534797-9602-4bed-a397-62c524ef7439 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:36.180927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2cefbe9c-c47b-4cd9-ac50-72122c4ae2c8 req-a26c57de-c3ab-4b9c-a386-0d5f73702752 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:36.202477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8534797-9602-4bed-a397-62c524ef7439 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:36.203373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8534797-9602-4bed-a397-62c524ef7439 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:36.209240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8534797-9602-4bed-a397-62c524ef7439 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:36.210549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8534797-9602-4bed-a397-62c524ef7439 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:36.211259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8534797-9602-4bed-a397-62c524ef7439 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:36.211441 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-2cefbe9c-c47b-4cd9-ac50-72122c4ae2c8 req-a26c57de-c3ab-4b9c-a386-0d5f73702752 service nova] Creating event network-changed:47ace383-978a-4d7b-be27-0a3f503cb49b for instance 35efe352-3b67-40fc-99c5-22fbf221bdfa on n-h2-861111-1 Oct 12 22:09:36.212099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8534797-9602-4bed-a397-62c524ef7439 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:36.212844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:36.221279 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-2cefbe9c-c47b-4cd9-ac50-72122c4ae2c8 req-a26c57de-c3ab-4b9c-a386-0d5f73702752 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077796 Oct 12 22:09:36.222470 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1163/2570] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 12 22:09:36.383143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d6187612-7d95-4b35-b3b2-73e9e7743d34 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:36.384150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d6187612-7d95-4b35-b3b2-73e9e7743d34 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:36.394708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6187612-7d95-4b35-b3b2-73e9e7743d34 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:36.398934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6187612-7d95-4b35-b3b2-73e9e7743d34 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:36.399522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6187612-7d95-4b35-b3b2-73e9e7743d34 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:36.400339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6187612-7d95-4b35-b3b2-73e9e7743d34 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:36.400909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6187612-7d95-4b35-b3b2-73e9e7743d34 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:36.402577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6187612-7d95-4b35-b3b2-73e9e7743d34 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:36.521428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d6187612-7d95-4b35-b3b2-73e9e7743d34 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:36.534717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d6187612-7d95-4b35-b3b2-73e9e7743d34 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:36.536547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d6187612-7d95-4b35-b3b2-73e9e7743d34 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:36.544131 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d6187612-7d95-4b35-b3b2-73e9e7743d34 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.165612 Oct 12 22:09:36.545031 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1164/2571] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:36 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:09:36.618674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e8534797-9602-4bed-a397-62c524ef7439 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:36.628953 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e8534797-9602-4bed-a397-62c524ef7439 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1313 microversion: 2.1 time: 0.453655 Oct 12 22:09:36.629965 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1408/2572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:36 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:36.680890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-65a5c330-73a3-48fe-ac66-970fe6f99959 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:36.681628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-65a5c330-73a3-48fe-ac66-970fe6f99959 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:36.687059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-b2a28242-229e-458c-b005-36506406ee6d req-d4a28273-bc29-434d-8823-2d94b2e799f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e83b077-4692-4351-8b85-e82dd3661af8", "name": "network-vif-plugged", "status": "completed", "tag": "cfc3e15c-0e8c-49d8-885b-7827d5c6c133"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:36.696584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65a5c330-73a3-48fe-ac66-970fe6f99959 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:36.697335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65a5c330-73a3-48fe-ac66-970fe6f99959 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:36.698401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65a5c330-73a3-48fe-ac66-970fe6f99959 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:36.699207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65a5c330-73a3-48fe-ac66-970fe6f99959 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:36.702898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65a5c330-73a3-48fe-ac66-970fe6f99959 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:36.703659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65a5c330-73a3-48fe-ac66-970fe6f99959 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:36.713576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b2a28242-229e-458c-b005-36506406ee6d req-d4a28273-bc29-434d-8823-2d94b2e799f0 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:36.714058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b2a28242-229e-458c-b005-36506406ee6d req-d4a28273-bc29-434d-8823-2d94b2e799f0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:36.714489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b2a28242-229e-458c-b005-36506406ee6d req-d4a28273-bc29-434d-8823-2d94b2e799f0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:36.786342 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-b2a28242-229e-458c-b005-36506406ee6d req-d4a28273-bc29-434d-8823-2d94b2e799f0 service nova] Creating event network-vif-plugged:cfc3e15c-0e8c-49d8-885b-7827d5c6c133 for instance 8e83b077-4692-4351-8b85-e82dd3661af8 on n-h2-861111-1 Oct 12 22:09:36.799374 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-b2a28242-229e-458c-b005-36506406ee6d req-d4a28273-bc29-434d-8823-2d94b2e799f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111196 Oct 12 22:09:36.800742 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1409/2573] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:09:36.827311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e98796d5-3d65-4d50-82c9-d171bcdc9225 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:36.830281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e98796d5-3d65-4d50-82c9-d171bcdc9225 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:36.830410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-65a5c330-73a3-48fe-ac66-970fe6f99959 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:36.839105 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-65a5c330-73a3-48fe-ac66-970fe6f99959 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1276 microversion: 2.1 time: 0.164361 Oct 12 22:09:36.847581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e98796d5-3d65-4d50-82c9-d171bcdc9225 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:36.847581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e98796d5-3d65-4d50-82c9-d171bcdc9225 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:36.847755 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1165/2574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:36 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:36.871056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e98796d5-3d65-4d50-82c9-d171bcdc9225 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:36.872140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e98796d5-3d65-4d50-82c9-d171bcdc9225 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:36.873182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e98796d5-3d65-4d50-82c9-d171bcdc9225 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:36.873783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e98796d5-3d65-4d50-82c9-d171bcdc9225 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:37.053914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d4feb651-89d5-44ce-926a-e630a0322474 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:37.054622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d4feb651-89d5-44ce-926a-e630a0322474 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:37.058474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:37.067391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4feb651-89d5-44ce-926a-e630a0322474 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:37.073302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4feb651-89d5-44ce-926a-e630a0322474 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:37.073864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4feb651-89d5-44ce-926a-e630a0322474 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:37.074687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4feb651-89d5-44ce-926a-e630a0322474 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:37.075222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4feb651-89d5-44ce-926a-e630a0322474 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:37.075739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4feb651-89d5-44ce-926a-e630a0322474 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:37.103898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e98796d5-3d65-4d50-82c9-d171bcdc9225 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:37.115679 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e98796d5-3d65-4d50-82c9-d171bcdc9225 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72" status: 200 len: 1683 microversion: 2.1 time: 0.312248 Oct 12 22:09:37.119012 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1410/2575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:36 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 => generated 1683 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:37.173971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=16 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:37.334794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-51a2573d-ea06-455a-a355-746a6c522195 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:37.343976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-51a2573d-ea06-455a-a355-746a6c522195 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:37.345744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-51a2573d-ea06-455a-a355-746a6c522195 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Searching by: {'deleted': False, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:09:37.371521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51a2573d-ea06-455a-a355-746a6c522195 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:37.372048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51a2573d-ea06-455a-a355-746a6c522195 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:37.372503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51a2573d-ea06-455a-a355-746a6c522195 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:37.373315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51a2573d-ea06-455a-a355-746a6c522195 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:37.373774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51a2573d-ea06-455a-a355-746a6c522195 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:37.374208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51a2573d-ea06-455a-a355-746a6c522195 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:37.423386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-51a2573d-ea06-455a-a355-746a6c522195 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:09:37.472324 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-51a2573d-ea06-455a-a355-746a6c522195 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.141995 Oct 12 22:09:37.478289 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1411/2576] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 12 22:09:37 2022] GET /compute/v2.1/servers => generated 334 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:37.488594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-253bba59-20b0-40e7-9868-47e8c7caa36c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:37.495471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-253bba59-20b0-40e7-9868-47e8c7caa36c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:37.496807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-253bba59-20b0-40e7-9868-47e8c7caa36c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Searching by: {'deleted': False, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:09:37.507419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-253bba59-20b0-40e7-9868-47e8c7caa36c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:37.508102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-253bba59-20b0-40e7-9868-47e8c7caa36c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:37.508679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-253bba59-20b0-40e7-9868-47e8c7caa36c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:37.509654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-253bba59-20b0-40e7-9868-47e8c7caa36c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:37.510798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-253bba59-20b0-40e7-9868-47e8c7caa36c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:37.511449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-253bba59-20b0-40e7-9868-47e8c7caa36c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:37.550263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-253bba59-20b0-40e7-9868-47e8c7caa36c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:09:37.668194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d4feb651-89d5-44ce-926a-e630a0322474 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:37.682800 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d4feb651-89d5-44ce-926a-e630a0322474 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8" status: 200 len: 1315 microversion: 2.1 time: 0.628417 Oct 12 22:09:37.705613 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1166/2577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:37 2022] GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 => generated 1315 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:37.718320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9de351f0-581a-4e2d-86cf-2d3719bd75a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:37.719560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-253bba59-20b0-40e7-9868-47e8c7caa36c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:37.720485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9de351f0-581a-4e2d-86cf-2d3719bd75a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:37.726567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-253bba59-20b0-40e7-9868-47e8c7caa36c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:37.727047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-253bba59-20b0-40e7-9868-47e8c7caa36c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:37.727526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-253bba59-20b0-40e7-9868-47e8c7caa36c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:37.741406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9de351f0-581a-4e2d-86cf-2d3719bd75a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:37.742584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9de351f0-581a-4e2d-86cf-2d3719bd75a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:37.743589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9de351f0-581a-4e2d-86cf-2d3719bd75a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:37.746047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9de351f0-581a-4e2d-86cf-2d3719bd75a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:37.747110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9de351f0-581a-4e2d-86cf-2d3719bd75a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:37.747912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9de351f0-581a-4e2d-86cf-2d3719bd75a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:37.957574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9de351f0-581a-4e2d-86cf-2d3719bd75a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:38.006960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9de351f0-581a-4e2d-86cf-2d3719bd75a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:38.008789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9de351f0-581a-4e2d-86cf-2d3719bd75a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:38.018823 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9de351f0-581a-4e2d-86cf-2d3719bd75a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.311297 Oct 12 22:09:38.020100 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1167/2578] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:37 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:38.025476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af298ada-098d-4370-89f2-dfde00d2a3a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:38.026933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-af298ada-098d-4370-89f2-dfde00d2a3a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:38.036407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af298ada-098d-4370-89f2-dfde00d2a3a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:38.037161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af298ada-098d-4370-89f2-dfde00d2a3a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:38.037760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af298ada-098d-4370-89f2-dfde00d2a3a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:38.038633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af298ada-098d-4370-89f2-dfde00d2a3a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:38.039269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af298ada-098d-4370-89f2-dfde00d2a3a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:38.040189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af298ada-098d-4370-89f2-dfde00d2a3a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:38.048416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:38.065061 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-253bba59-20b0-40e7-9868-47e8c7caa36c tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1700 microversion: 2.1 time: 0.580511 Oct 12 22:09:38.067005 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1412/2579] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:09:37 2022] GET /compute/v2.1/servers/detail => generated 1700 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:38.070289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-95b2595c-0e58-4790-969e-15c0648083d7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:38.070908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-95b2595c-0e58-4790-969e-15c0648083d7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:38.107728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95b2595c-0e58-4790-969e-15c0648083d7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:38.108428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95b2595c-0e58-4790-969e-15c0648083d7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:38.108752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95b2595c-0e58-4790-969e-15c0648083d7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:38.109670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95b2595c-0e58-4790-969e-15c0648083d7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:38.110475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95b2595c-0e58-4790-969e-15c0648083d7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:38.111217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95b2595c-0e58-4790-969e-15c0648083d7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:38.367289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-af298ada-098d-4370-89f2-dfde00d2a3a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:38.367830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-95b2595c-0e58-4790-969e-15c0648083d7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:38.375703 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-af298ada-098d-4370-89f2-dfde00d2a3a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1313 microversion: 2.1 time: 0.354280 Oct 12 22:09:38.380972 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1168/2580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:38 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:38.383845 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-95b2595c-0e58-4790-969e-15c0648083d7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1318 microversion: 2.1 time: 0.317079 Oct 12 22:09:38.384916 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1413/2581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:38 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:38.401223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e7d8a5f5-4537-46a7-9d28-4c2e069da355 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:38.410213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9add6cdc-76f9-493b-bca3-25bce2cbb3c6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:38.411426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9add6cdc-76f9-493b-bca3-25bce2cbb3c6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:38.420903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9add6cdc-76f9-493b-bca3-25bce2cbb3c6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:38.421725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9add6cdc-76f9-493b-bca3-25bce2cbb3c6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:38.422579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9add6cdc-76f9-493b-bca3-25bce2cbb3c6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:38.423912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9add6cdc-76f9-493b-bca3-25bce2cbb3c6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:38.425292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9add6cdc-76f9-493b-bca3-25bce2cbb3c6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:38.426174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9add6cdc-76f9-493b-bca3-25bce2cbb3c6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:38.430828 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e7d8a5f5-4537-46a7-9d28-4c2e069da355 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.048527 Oct 12 22:09:38.431442 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1169/2582] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:09:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:38.611561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9add6cdc-76f9-493b-bca3-25bce2cbb3c6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:38.627888 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9add6cdc-76f9-493b-bca3-25bce2cbb3c6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72" status: 200 len: 1615 microversion: 2.1 time: 0.240713 Oct 12 22:09:38.651584 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1414/2583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:38 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 => generated 1615 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:38.694070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-2faa173a-0584-4c32-b181-c46e1d899320 req-5b33f60e-7b84-4bc2-a15d-3611d3f4146c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe4575c-4bfa-4907-80a1-6cbfeb246f72", "name": "network-vif-deleted", "tag": "91f7b233-578e-4e47-81c2-cc982b4b0605"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:38.712262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3d914f89-68c5-4bae-b651-60d0d3481adc tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:38.713757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3d914f89-68c5-4bae-b651-60d0d3481adc tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:38.721005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d914f89-68c5-4bae-b651-60d0d3481adc tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:38.721517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2faa173a-0584-4c32-b181-c46e1d899320 req-5b33f60e-7b84-4bc2-a15d-3611d3f4146c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:38.721932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d914f89-68c5-4bae-b651-60d0d3481adc tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:38.722050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2faa173a-0584-4c32-b181-c46e1d899320 req-5b33f60e-7b84-4bc2-a15d-3611d3f4146c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:38.722416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2faa173a-0584-4c32-b181-c46e1d899320 req-5b33f60e-7b84-4bc2-a15d-3611d3f4146c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:38.722773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d914f89-68c5-4bae-b651-60d0d3481adc tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:38.723678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d914f89-68c5-4bae-b651-60d0d3481adc tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:38.724298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d914f89-68c5-4bae-b651-60d0d3481adc tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:38.724874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d914f89-68c5-4bae-b651-60d0d3481adc tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:38.729888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:38.733900 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-2faa173a-0584-4c32-b181-c46e1d899320 req-5b33f60e-7b84-4bc2-a15d-3611d3f4146c service nova] Creating event network-vif-deleted:91f7b233-578e-4e47-81c2-cc982b4b0605 for instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 on n-h2-861111-1 Oct 12 22:09:38.749207 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-2faa173a-0584-4c32-b181-c46e1d899320 req-5b33f60e-7b84-4bc2-a15d-3611d3f4146c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058680 Oct 12 22:09:38.754826 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1170/2584] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:09:38.960358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a428f441-ab4e-4bc6-b562-8784b7dbdeda tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:38.960951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a428f441-ab4e-4bc6-b562-8784b7dbdeda tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:38.977110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a428f441-ab4e-4bc6-b562-8784b7dbdeda tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:38.977740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a428f441-ab4e-4bc6-b562-8784b7dbdeda tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:38.978185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a428f441-ab4e-4bc6-b562-8784b7dbdeda tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:38.979031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a428f441-ab4e-4bc6-b562-8784b7dbdeda tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:38.986116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a428f441-ab4e-4bc6-b562-8784b7dbdeda tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:38.986644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a428f441-ab4e-4bc6-b562-8784b7dbdeda tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:39.016137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3d914f89-68c5-4bae-b651-60d0d3481adc tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:39.025258 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3d914f89-68c5-4bae-b651-60d0d3481adc tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8" status: 200 len: 1315 microversion: 2.1 time: 0.322328 Oct 12 22:09:39.031970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a428f441-ab4e-4bc6-b562-8784b7dbdeda tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:09:39.043439 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1415/2585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:38 2022] GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:39.054669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3597d07b-476f-437d-87e5-40a04e7ae480 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:39.055306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3597d07b-476f-437d-87e5-40a04e7ae480 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:39.066037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:39.067517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3597d07b-476f-437d-87e5-40a04e7ae480 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:39.070230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3597d07b-476f-437d-87e5-40a04e7ae480 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:39.070674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3597d07b-476f-437d-87e5-40a04e7ae480 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:39.071411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3597d07b-476f-437d-87e5-40a04e7ae480 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:39.074344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3597d07b-476f-437d-87e5-40a04e7ae480 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:39.074938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3597d07b-476f-437d-87e5-40a04e7ae480 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:39.165284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:39.190809 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a428f441-ab4e-4bc6-b562-8784b7dbdeda tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "DELETE /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 204 len: 0 microversion: 2.1 time: 0.231629 Oct 12 22:09:39.198911 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1171/2586] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:09:38 2022] DELETE /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:09:39.204771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ce61f7e1-ac9f-48a9-8173-9b0a831548d1 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:39.205564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ce61f7e1-ac9f-48a9-8173-9b0a831548d1 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:39.231194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce61f7e1-ac9f-48a9-8173-9b0a831548d1 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:39.231884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3597d07b-476f-437d-87e5-40a04e7ae480 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:39.232613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce61f7e1-ac9f-48a9-8173-9b0a831548d1 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:39.233162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce61f7e1-ac9f-48a9-8173-9b0a831548d1 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:39.233967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce61f7e1-ac9f-48a9-8173-9b0a831548d1 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:39.234504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce61f7e1-ac9f-48a9-8173-9b0a831548d1 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:39.235017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce61f7e1-ac9f-48a9-8173-9b0a831548d1 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:39.247825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3597d07b-476f-437d-87e5-40a04e7ae480 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:39.250917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3597d07b-476f-437d-87e5-40a04e7ae480 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:39.265397 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3597d07b-476f-437d-87e5-40a04e7ae480 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.216212 Oct 12 22:09:39.286013 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1416/2587] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:39 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:39.398475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b0092ece-b0df-4fa6-990f-46b9a660b2db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:39.399135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b0092ece-b0df-4fa6-990f-46b9a660b2db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:39.409735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0092ece-b0df-4fa6-990f-46b9a660b2db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:39.410566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0092ece-b0df-4fa6-990f-46b9a660b2db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:39.411268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0092ece-b0df-4fa6-990f-46b9a660b2db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:39.412362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0092ece-b0df-4fa6-990f-46b9a660b2db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:39.413755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0092ece-b0df-4fa6-990f-46b9a660b2db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:39.414593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0092ece-b0df-4fa6-990f-46b9a660b2db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:39.531487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ce61f7e1-ac9f-48a9-8173-9b0a831548d1 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:39.557693 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ce61f7e1-ac9f-48a9-8173-9b0a831548d1 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1703 microversion: 2.1 time: 0.345742 Oct 12 22:09:39.557693 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1172/2588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:39 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1703 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:09:39.589292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ace5bac7-140f-40fb-996f-31d8211c3614 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:39.590205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ace5bac7-140f-40fb-996f-31d8211c3614 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:39.597320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ace5bac7-140f-40fb-996f-31d8211c3614 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:39.598057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ace5bac7-140f-40fb-996f-31d8211c3614 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:39.598671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ace5bac7-140f-40fb-996f-31d8211c3614 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:39.599572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ace5bac7-140f-40fb-996f-31d8211c3614 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:39.600241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ace5bac7-140f-40fb-996f-31d8211c3614 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:39.600814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ace5bac7-140f-40fb-996f-31d8211c3614 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:39.796726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ace5bac7-140f-40fb-996f-31d8211c3614 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:39.811204 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ace5bac7-140f-40fb-996f-31d8211c3614 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1318 microversion: 2.1 time: 0.259434 Oct 12 22:09:39.820332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b0092ece-b0df-4fa6-990f-46b9a660b2db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:39.830189 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1173/2589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:39 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:39.832897 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b0092ece-b0df-4fa6-990f-46b9a660b2db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1313 microversion: 2.1 time: 0.438189 Oct 12 22:09:39.833840 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1417/2590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:39 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:09:39.837028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6866de09-59ce-4786-8480-3408a933105d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:39.838193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6866de09-59ce-4786-8480-3408a933105d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:39.847621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6866de09-59ce-4786-8480-3408a933105d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:39.848451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6866de09-59ce-4786-8480-3408a933105d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:39.849268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6866de09-59ce-4786-8480-3408a933105d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:39.852051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6866de09-59ce-4786-8480-3408a933105d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:39.852774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6866de09-59ce-4786-8480-3408a933105d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:39.853460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6866de09-59ce-4786-8480-3408a933105d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:39.951280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6866de09-59ce-4786-8480-3408a933105d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:39.965800 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6866de09-59ce-4786-8480-3408a933105d tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72" status: 200 len: 1327 microversion: 2.1 time: 0.134080 Oct 12 22:09:39.973651 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1174/2591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:39 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 => generated 1327 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:40.051675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ae468bc0-9e4e-4308-b09d-a848763181cb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:40.052450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ae468bc0-9e4e-4308-b09d-a848763181cb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:40.059714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae468bc0-9e4e-4308-b09d-a848763181cb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:40.060439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae468bc0-9e4e-4308-b09d-a848763181cb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:40.060944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae468bc0-9e4e-4308-b09d-a848763181cb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:40.063554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae468bc0-9e4e-4308-b09d-a848763181cb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:40.063554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae468bc0-9e4e-4308-b09d-a848763181cb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:40.063554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae468bc0-9e4e-4308-b09d-a848763181cb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:40.297031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cbb9fa50-7300-4b05-914b-d19fd0407264 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:40.297657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cbb9fa50-7300-4b05-914b-d19fd0407264 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:40.307573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbb9fa50-7300-4b05-914b-d19fd0407264 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:40.308078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbb9fa50-7300-4b05-914b-d19fd0407264 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:40.318744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbb9fa50-7300-4b05-914b-d19fd0407264 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:40.319636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbb9fa50-7300-4b05-914b-d19fd0407264 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:40.320121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbb9fa50-7300-4b05-914b-d19fd0407264 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:40.320567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbb9fa50-7300-4b05-914b-d19fd0407264 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:40.470814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cbb9fa50-7300-4b05-914b-d19fd0407264 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:40.492953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cbb9fa50-7300-4b05-914b-d19fd0407264 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:40.495026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cbb9fa50-7300-4b05-914b-d19fd0407264 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:40.498963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ae468bc0-9e4e-4308-b09d-a848763181cb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:40.517133 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ae468bc0-9e4e-4308-b09d-a848763181cb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8" status: 200 len: 1315 microversion: 2.1 time: 0.469349 Oct 12 22:09:40.537369 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1418/2592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:40 2022] GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:40.537830 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cbb9fa50-7300-4b05-914b-d19fd0407264 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.244171 Oct 12 22:09:40.538888 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1175/2593] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:40 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:09:40.589063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-67ee1a51-6681-40ff-9e3a-e03cf4f369ca tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:40.589686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-67ee1a51-6681-40ff-9e3a-e03cf4f369ca tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:40.604007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67ee1a51-6681-40ff-9e3a-e03cf4f369ca tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:40.605746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67ee1a51-6681-40ff-9e3a-e03cf4f369ca tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:40.606335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67ee1a51-6681-40ff-9e3a-e03cf4f369ca tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:40.609356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67ee1a51-6681-40ff-9e3a-e03cf4f369ca tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:40.609832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67ee1a51-6681-40ff-9e3a-e03cf4f369ca tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:40.613438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67ee1a51-6681-40ff-9e3a-e03cf4f369ca tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:40.840053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-40139785-d3d9-4b71-bc78-c1d3d22821cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:40.840707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-40139785-d3d9-4b71-bc78-c1d3d22821cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:40.864254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40139785-d3d9-4b71-bc78-c1d3d22821cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:40.866832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40139785-d3d9-4b71-bc78-c1d3d22821cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:40.868058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40139785-d3d9-4b71-bc78-c1d3d22821cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:40.871357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40139785-d3d9-4b71-bc78-c1d3d22821cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:40.875864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40139785-d3d9-4b71-bc78-c1d3d22821cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:40.876827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40139785-d3d9-4b71-bc78-c1d3d22821cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:41.967676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-40139785-d3d9-4b71-bc78-c1d3d22821cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:41.991938 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-40139785-d3d9-4b71-bc78-c1d3d22821cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1318 microversion: 2.1 time: 1.154127 Oct 12 22:09:41.993762 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1176/2594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:40 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1318 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:09:42.011466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f2e95594-e8c5-420e-aee4-aa82874f9a26 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:42.012597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f2e95594-e8c5-420e-aee4-aa82874f9a26 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:42.041792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e95594-e8c5-420e-aee4-aa82874f9a26 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:42.042305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e95594-e8c5-420e-aee4-aa82874f9a26 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:42.042755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e95594-e8c5-420e-aee4-aa82874f9a26 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:42.043509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e95594-e8c5-420e-aee4-aa82874f9a26 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:42.043974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e95594-e8c5-420e-aee4-aa82874f9a26 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:42.044390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e95594-e8c5-420e-aee4-aa82874f9a26 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:42.215840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-67ee1a51-6681-40ff-9e3a-e03cf4f369ca tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:42.229912 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-67ee1a51-6681-40ff-9e3a-e03cf4f369ca tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1703 microversion: 2.1 time: 1.645442 Oct 12 22:09:42.239707 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1419/2595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:40 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1703 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:42.250000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b1dd633b-6a18-4f93-9c0c-64a5266a453e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:42.250634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b1dd633b-6a18-4f93-9c0c-64a5266a453e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:42.281733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1dd633b-6a18-4f93-9c0c-64a5266a453e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:42.282259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1dd633b-6a18-4f93-9c0c-64a5266a453e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:42.282655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1dd633b-6a18-4f93-9c0c-64a5266a453e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:42.283397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1dd633b-6a18-4f93-9c0c-64a5266a453e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:42.283995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1dd633b-6a18-4f93-9c0c-64a5266a453e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:42.284277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1dd633b-6a18-4f93-9c0c-64a5266a453e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:42.467981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1dd633b-6a18-4f93-9c0c-64a5266a453e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:42.467981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1dd633b-6a18-4f93-9c0c-64a5266a453e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:42.467981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1dd633b-6a18-4f93-9c0c-64a5266a453e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:42.470177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-b1dd633b-6a18-4f93-9c0c-64a5266a453e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lazy-loading 'fault' on Instance uuid 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:09:42.640551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b1dd633b-6a18-4f93-9c0c-64a5266a453e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:42.657277 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b1dd633b-6a18-4f93-9c0c-64a5266a453e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72" status: 200 len: 1332 microversion: 2.1 time: 0.416093 Oct 12 22:09:42.661301 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1420/2596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:42 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 => generated 1332 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:42.667566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-97c5b417-8a33-44ee-b9d9-113aa36d360e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:42.668362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-97c5b417-8a33-44ee-b9d9-113aa36d360e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:42.675894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c5b417-8a33-44ee-b9d9-113aa36d360e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:42.676728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c5b417-8a33-44ee-b9d9-113aa36d360e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:42.677381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c5b417-8a33-44ee-b9d9-113aa36d360e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:42.678484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c5b417-8a33-44ee-b9d9-113aa36d360e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:42.679462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c5b417-8a33-44ee-b9d9-113aa36d360e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:42.680807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c5b417-8a33-44ee-b9d9-113aa36d360e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:43.030850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-97c5b417-8a33-44ee-b9d9-113aa36d360e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:43.043726 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-97c5b417-8a33-44ee-b9d9-113aa36d360e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8" status: 200 len: 1503 microversion: 2.1 time: 0.380867 Oct 12 22:09:43.046313 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1421/2597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:42 2022] GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 => generated 1503 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:43.054969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0cb46e0b-0b83-432f-bc78-6c80e5776c1f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:43.055622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0cb46e0b-0b83-432f-bc78-6c80e5776c1f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:43.066998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cb46e0b-0b83-432f-bc78-6c80e5776c1f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:43.067972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cb46e0b-0b83-432f-bc78-6c80e5776c1f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:43.067972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cb46e0b-0b83-432f-bc78-6c80e5776c1f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:43.068698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cb46e0b-0b83-432f-bc78-6c80e5776c1f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:43.069160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cb46e0b-0b83-432f-bc78-6c80e5776c1f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:43.069599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cb46e0b-0b83-432f-bc78-6c80e5776c1f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:43.159943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0cb46e0b-0b83-432f-bc78-6c80e5776c1f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:43.170987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0cb46e0b-0b83-432f-bc78-6c80e5776c1f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:43.173040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0cb46e0b-0b83-432f-bc78-6c80e5776c1f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:43.179368 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0cb46e0b-0b83-432f-bc78-6c80e5776c1f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.130812 Oct 12 22:09:43.180215 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1422/2598] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:43 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:43.253122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-dbb40ab3-6fa2-45b7-94ee-409666b56488 req-0564b0ba-733e-4dbb-8a68-21e5bd4a53c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1baccb0f-089a-44e5-8011-c45767da7abc", "tag": "51f781cf-b3dc-4040-977e-77aa6a84e95f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:43.263422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-dbb40ab3-6fa2-45b7-94ee-409666b56488 req-0564b0ba-733e-4dbb-8a68-21e5bd4a53c6 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:43.263899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-dbb40ab3-6fa2-45b7-94ee-409666b56488 req-0564b0ba-733e-4dbb-8a68-21e5bd4a53c6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:43.264328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-dbb40ab3-6fa2-45b7-94ee-409666b56488 req-0564b0ba-733e-4dbb-8a68-21e5bd4a53c6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:43.276194 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-dbb40ab3-6fa2-45b7-94ee-409666b56488 req-0564b0ba-733e-4dbb-8a68-21e5bd4a53c6 service nova] Creating event network-changed:51f781cf-b3dc-4040-977e-77aa6a84e95f for instance 1baccb0f-089a-44e5-8011-c45767da7abc on n-h2-861111-1 Oct 12 22:09:43.282098 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-dbb40ab3-6fa2-45b7-94ee-409666b56488 req-0564b0ba-733e-4dbb-8a68-21e5bd4a53c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100327 Oct 12 22:09:43.283010 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1423/2599] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:43.289144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7af34300-ead2-42b7-a2f5-23f7b6dca4f1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:43.289863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7af34300-ead2-42b7-a2f5-23f7b6dca4f1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:43.296960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af34300-ead2-42b7-a2f5-23f7b6dca4f1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:43.297454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af34300-ead2-42b7-a2f5-23f7b6dca4f1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:43.297890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af34300-ead2-42b7-a2f5-23f7b6dca4f1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:43.298588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af34300-ead2-42b7-a2f5-23f7b6dca4f1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:43.299209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af34300-ead2-42b7-a2f5-23f7b6dca4f1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:43.299664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af34300-ead2-42b7-a2f5-23f7b6dca4f1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:43.446941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f2e95594-e8c5-420e-aee4-aa82874f9a26 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:43.457358 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f2e95594-e8c5-420e-aee4-aa82874f9a26 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1313 microversion: 2.1 time: 1.459582 Oct 12 22:09:43.471299 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1177/2600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:41 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1313 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:43.471299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2f6f54f2-e80f-402b-85bf-439e9dfde997 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1427057018"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:43.472244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f6f54f2-e80f-402b-85bf-439e9dfde997 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:43.480075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f6f54f2-e80f-402b-85bf-439e9dfde997 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:43.480898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f6f54f2-e80f-402b-85bf-439e9dfde997 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:43.481517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f6f54f2-e80f-402b-85bf-439e9dfde997 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:43.482341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f6f54f2-e80f-402b-85bf-439e9dfde997 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:43.482918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f6f54f2-e80f-402b-85bf-439e9dfde997 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:43.483519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f6f54f2-e80f-402b-85bf-439e9dfde997 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:43.576066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7af34300-ead2-42b7-a2f5-23f7b6dca4f1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:43.586612 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7af34300-ead2-42b7-a2f5-23f7b6dca4f1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1318 microversion: 2.1 time: 0.301947 Oct 12 22:09:43.600772 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1424/2601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:43 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:43.610498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c6ad2c3e-733a-4008-8098-eba80e834677 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:43.612258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c6ad2c3e-733a-4008-8098-eba80e834677 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:43.622638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6ad2c3e-733a-4008-8098-eba80e834677 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:43.623482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6ad2c3e-733a-4008-8098-eba80e834677 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:43.624169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6ad2c3e-733a-4008-8098-eba80e834677 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:43.625133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6ad2c3e-733a-4008-8098-eba80e834677 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:43.625828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6ad2c3e-733a-4008-8098-eba80e834677 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:43.626626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6ad2c3e-733a-4008-8098-eba80e834677 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:43.768568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c6ad2c3e-733a-4008-8098-eba80e834677 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:43.816607 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c6ad2c3e-733a-4008-8098-eba80e834677 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1635 microversion: 2.1 time: 0.209593 Oct 12 22:09:43.828241 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1425/2602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:43 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1635 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:43.844923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e12249f6-f036-42d2-aeb3-668293da5f81 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:43.846103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e12249f6-f036-42d2-aeb3-668293da5f81 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:43.855660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e12249f6-f036-42d2-aeb3-668293da5f81 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:43.857028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e12249f6-f036-42d2-aeb3-668293da5f81 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:43.871961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e12249f6-f036-42d2-aeb3-668293da5f81 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:43.873030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e12249f6-f036-42d2-aeb3-668293da5f81 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:43.873727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e12249f6-f036-42d2-aeb3-668293da5f81 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:43.874499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e12249f6-f036-42d2-aeb3-668293da5f81 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:43.893713 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-e12249f6-f036-42d2-aeb3-668293da5f81 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] HTTP exception thrown: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e12249f6-f036-42d2-aeb3-668293da5f81 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Request method failure captured: Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 HTTP/1.1 Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzoV3foVnGv0suVxK_Nk7Pp5_kjAPhL8yzVHClSGl5RRxDIZH7rcf5PLHi4YXEet-A0AtHcDaHpFcS_aQR9wl8soXuphQXdzTm1zPCiMI4BUWAPu4l1z3R9DkYDtzHZhHRlT-3CEyzuxgoolPW6Gw8glco6cFnu099ScND31HIZBEC4 Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68913d260d084ce4a8e29daf4783c0bc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 13c74a78e82f4e72a7d1f7b133074f5a Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1fe4575c-4bfa-4907-80a1-6cbfeb246f72'} Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:43.895864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:43.900036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:43.900036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:43.900036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:43.900036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:09:43.900036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:09:43.900036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. Oct 12 22:09:43.900036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:43.902122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e12249f6-f036-42d2-aeb3-668293da5f81 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Returning 404 to user: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:09:43.903135 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e12249f6-f036-42d2-aeb3-668293da5f81 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72" status: 404 len: 111 microversion: 2.1 time: 0.069945 Oct 12 22:09:43.914095 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1426/2603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:43 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:09:43.929855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-9ff5c7f8-910e-4f57-9a9b-2e27fc38adff req-42b75dc5-a1c9-49b2-9669-ac7a22fdf8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35efe352-3b67-40fc-99c5-22fbf221bdfa", "name": "network-vif-plugged", "status": "completed", "tag": "47ace383-978a-4d7b-be27-0a3f503cb49b"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:43.943372 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.network.security_group_api [None req-2f6f54f2-e80f-402b-85bf-439e9dfde997 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Adding security group 35e47f71-29c6-45ad-808b-4f2b4ead8ea4 to port cfc3e15c-0e8c-49d8-885b-7827d5c6c133 Oct 12 22:09:43.973530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9ff5c7f8-910e-4f57-9a9b-2e27fc38adff req-42b75dc5-a1c9-49b2-9669-ac7a22fdf8b7 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:43.974190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9ff5c7f8-910e-4f57-9a9b-2e27fc38adff req-42b75dc5-a1c9-49b2-9669-ac7a22fdf8b7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:43.974880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9ff5c7f8-910e-4f57-9a9b-2e27fc38adff req-42b75dc5-a1c9-49b2-9669-ac7a22fdf8b7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:44.000352 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-9ff5c7f8-910e-4f57-9a9b-2e27fc38adff req-42b75dc5-a1c9-49b2-9669-ac7a22fdf8b7 service nova] Creating event network-vif-plugged:47ace383-978a-4d7b-be27-0a3f503cb49b for instance 35efe352-3b67-40fc-99c5-22fbf221bdfa on n-h2-861111-1 Oct 12 22:09:44.008325 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-9ff5c7f8-910e-4f57-9a9b-2e27fc38adff req-42b75dc5-a1c9-49b2-9669-ac7a22fdf8b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091973 Oct 12 22:09:44.010316 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1427/2604] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:44.144998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-7460c59c-afe9-40d3-a91e-a986ea3b7c79 req-9d180e94-115d-4c4e-82d3-7239be888dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1c142a-8d11-4578-a840-84ed39f0e1f4", "name": "network-vif-deleted", "tag": "e1f32865-68ef-4c76-b641-079a9412068c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:44.158866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7460c59c-afe9-40d3-a91e-a986ea3b7c79 req-9d180e94-115d-4c4e-82d3-7239be888dd6 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:44.159574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7460c59c-afe9-40d3-a91e-a986ea3b7c79 req-9d180e94-115d-4c4e-82d3-7239be888dd6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:44.160298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7460c59c-afe9-40d3-a91e-a986ea3b7c79 req-9d180e94-115d-4c4e-82d3-7239be888dd6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:44.173920 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-7460c59c-afe9-40d3-a91e-a986ea3b7c79 req-9d180e94-115d-4c4e-82d3-7239be888dd6 service nova] Creating event network-vif-deleted:e1f32865-68ef-4c76-b641-079a9412068c for instance af1c142a-8d11-4578-a840-84ed39f0e1f4 on n-h2-861111-1 Oct 12 22:09:44.180912 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-7460c59c-afe9-40d3-a91e-a986ea3b7c79 req-9d180e94-115d-4c4e-82d3-7239be888dd6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168607 Oct 12 22:09:44.182236 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1428/2605] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:44.191733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9f94efd7-8f12-40e5-8cb9-b67a70dd4016 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '.version_select at 0x7f512336dee0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:44.221636 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9f94efd7-8f12-40e5-8cb9-b67a70dd4016 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774593784" status: 202 len: 0 microversion: 2.1 time: 0.037501 Oct 12 22:09:44.223086 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1429/2606] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 12 22:09:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774593784 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:09:44.231653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5806bd0b-d5ea-4717-b41b-aee2bcf4a6d4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:44.232776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5806bd0b-d5ea-4717-b41b-aee2bcf4a6d4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:44.241586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5806bd0b-d5ea-4717-b41b-aee2bcf4a6d4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:44.242515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5806bd0b-d5ea-4717-b41b-aee2bcf4a6d4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:44.245361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5806bd0b-d5ea-4717-b41b-aee2bcf4a6d4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:44.245701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5806bd0b-d5ea-4717-b41b-aee2bcf4a6d4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:44.246175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5806bd0b-d5ea-4717-b41b-aee2bcf4a6d4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:44.247486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5806bd0b-d5ea-4717-b41b-aee2bcf4a6d4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:44.337712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5806bd0b-d5ea-4717-b41b-aee2bcf4a6d4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:44.347826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5806bd0b-d5ea-4717-b41b-aee2bcf4a6d4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:44.349679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5806bd0b-d5ea-4717-b41b-aee2bcf4a6d4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:44.355460 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5806bd0b-d5ea-4717-b41b-aee2bcf4a6d4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.131061 Oct 12 22:09:44.356222 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1430/2607] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:44 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:44.482031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2024336e-dde8-47ee-a7de-e59168972680 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:44.482946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2024336e-dde8-47ee-a7de-e59168972680 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:44.489906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2024336e-dde8-47ee-a7de-e59168972680 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:44.490616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2024336e-dde8-47ee-a7de-e59168972680 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:44.491056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2024336e-dde8-47ee-a7de-e59168972680 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:44.491793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2024336e-dde8-47ee-a7de-e59168972680 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:44.492245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2024336e-dde8-47ee-a7de-e59168972680 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:44.492669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2024336e-dde8-47ee-a7de-e59168972680 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:44.641852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2024336e-dde8-47ee-a7de-e59168972680 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:44.651460 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2024336e-dde8-47ee-a7de-e59168972680 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1313 microversion: 2.1 time: 0.173228 Oct 12 22:09:44.678087 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1431/2608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:44 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:44.686331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0c549608-608b-455b-a5c6-242878a9549b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:44.686966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0c549608-608b-455b-a5c6-242878a9549b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:44.694749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c549608-608b-455b-a5c6-242878a9549b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:44.695399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c549608-608b-455b-a5c6-242878a9549b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:44.695837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c549608-608b-455b-a5c6-242878a9549b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:44.696534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c549608-608b-455b-a5c6-242878a9549b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:44.697163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c549608-608b-455b-a5c6-242878a9549b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:44.697764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c549608-608b-455b-a5c6-242878a9549b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:45.055136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0c549608-608b-455b-a5c6-242878a9549b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:45.063886 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0c549608-608b-455b-a5c6-242878a9549b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1318 microversion: 2.1 time: 0.384419 Oct 12 22:09:45.071286 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1432/2609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:44 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:45.082923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ed7fbde0-d7e2-4b5e-b5cd-7a2c3cd1a6d7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:45.084734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ed7fbde0-d7e2-4b5e-b5cd-7a2c3cd1a6d7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:45.097171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed7fbde0-d7e2-4b5e-b5cd-7a2c3cd1a6d7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:45.097623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed7fbde0-d7e2-4b5e-b5cd-7a2c3cd1a6d7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:45.098234 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed7fbde0-d7e2-4b5e-b5cd-7a2c3cd1a6d7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:45.099016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed7fbde0-d7e2-4b5e-b5cd-7a2c3cd1a6d7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:45.099510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed7fbde0-d7e2-4b5e-b5cd-7a2c3cd1a6d7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:45.099943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed7fbde0-d7e2-4b5e-b5cd-7a2c3cd1a6d7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:45.139791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed7fbde0-d7e2-4b5e-b5cd-7a2c3cd1a6d7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:45.140533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed7fbde0-d7e2-4b5e-b5cd-7a2c3cd1a6d7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:45.140982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed7fbde0-d7e2-4b5e-b5cd-7a2c3cd1a6d7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:45.141440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-ed7fbde0-d7e2-4b5e-b5cd-7a2c3cd1a6d7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lazy-loading 'fault' on Instance uuid af1c142a-8d11-4578-a840-84ed39f0e1f4 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:09:45.278983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ed7fbde0-d7e2-4b5e-b5cd-7a2c3cd1a6d7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:45.293206 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ed7fbde0-d7e2-4b5e-b5cd-7a2c3cd1a6d7 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1360 microversion: 2.1 time: 0.227059 Oct 12 22:09:45.293418 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2f6f54f2-e80f-402b-85bf-439e9dfde997 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "POST /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8/action" status: 202 len: 0 microversion: 2.1 time: 1.827422 Oct 12 22:09:45.294961 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1178/2610] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:09:43 2022] POST /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8/action => generated 0 bytes in 1830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:09:45.295278 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1433/2611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:45 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1360 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:45.319697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b372aaf2-7457-4686-b584-72814ad33145 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1984459082"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:45.320484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b372aaf2-7457-4686-b584-72814ad33145 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:45.328567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b372aaf2-7457-4686-b584-72814ad33145 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:45.329287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b372aaf2-7457-4686-b584-72814ad33145 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:45.329911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b372aaf2-7457-4686-b584-72814ad33145 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:45.330882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b372aaf2-7457-4686-b584-72814ad33145 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:45.331587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b372aaf2-7457-4686-b584-72814ad33145 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:45.332234 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b372aaf2-7457-4686-b584-72814ad33145 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:45.384014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-13d4f1af-e6e2-4ab3-b165-c65e8b932f9b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:45.384677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-13d4f1af-e6e2-4ab3-b165-c65e8b932f9b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:45.392792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13d4f1af-e6e2-4ab3-b165-c65e8b932f9b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:45.393397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13d4f1af-e6e2-4ab3-b165-c65e8b932f9b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:45.393852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13d4f1af-e6e2-4ab3-b165-c65e8b932f9b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:45.394652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13d4f1af-e6e2-4ab3-b165-c65e8b932f9b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:45.395108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13d4f1af-e6e2-4ab3-b165-c65e8b932f9b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:45.395653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13d4f1af-e6e2-4ab3-b165-c65e8b932f9b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:45.511592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-13d4f1af-e6e2-4ab3-b165-c65e8b932f9b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:45.520821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:45.527847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-13d4f1af-e6e2-4ab3-b165-c65e8b932f9b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:45.529328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-13d4f1af-e6e2-4ab3-b165-c65e8b932f9b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:45.550665 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-13d4f1af-e6e2-4ab3-b165-c65e8b932f9b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.167099 Oct 12 22:09:45.551396 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1434/2612] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:45 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:09:45.561798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-ee9ad121-22e4-4b89-8663-9ec5c27428ca req-24914b3b-ff2f-4d77-80ee-354dd8e471c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e83b077-4692-4351-8b85-e82dd3661af8", "tag": "cfc3e15c-0e8c-49d8-885b-7827d5c6c133"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:45.581337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ee9ad121-22e4-4b89-8663-9ec5c27428ca req-24914b3b-ff2f-4d77-80ee-354dd8e471c0 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:45.581839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ee9ad121-22e4-4b89-8663-9ec5c27428ca req-24914b3b-ff2f-4d77-80ee-354dd8e471c0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:45.582280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ee9ad121-22e4-4b89-8663-9ec5c27428ca req-24914b3b-ff2f-4d77-80ee-354dd8e471c0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:45.616318 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-ee9ad121-22e4-4b89-8663-9ec5c27428ca req-24914b3b-ff2f-4d77-80ee-354dd8e471c0 service nova] Creating event network-changed:cfc3e15c-0e8c-49d8-885b-7827d5c6c133 for instance 8e83b077-4692-4351-8b85-e82dd3661af8 on n-h2-861111-1 Oct 12 22:09:45.622290 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-ee9ad121-22e4-4b89-8663-9ec5c27428ca req-24914b3b-ff2f-4d77-80ee-354dd8e471c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069499 Oct 12 22:09:45.624007 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1435/2613] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:45.630344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-64569218-3ea1-421c-92d9-d9a17b040779 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Action: 'create', calling method: .version_select at 0x7f51233631f0>, body: {"keypair": {"name": "tempest-keypair-989260750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMK+hRoatPzBEBASxK5sL97QMOxYX7/amz7rlc8ARw+3D1gi4ecoR0B2R2ynhOLOz6GD8Y8DU0CRJjsEWAWOPbf2iiqzCaJ/H7liQ1vfvjx9EnSK4kYPSYCH2cE4bGEjw=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:45.657118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=29 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:45.659106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-64569218-3ea1-421c-92d9-d9a17b040779 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Getting quotas for project 68913d260d084ce4a8e29daf4783c0bc. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:09:45.676457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-64569218-3ea1-421c-92d9-d9a17b040779 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Getting quotas for user 13c74a78e82f4e72a7d1f7b133074f5a and project 68913d260d084ce4a8e29daf4783c0bc. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:09:45.682579 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.network.security_group_api [None req-b372aaf2-7457-4686-b584-72814ad33145 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Adding security group c516e4d1-3dac-4b07-a7c0-91cda7793f8c to port cfc3e15c-0e8c-49d8-885b-7827d5c6c133 Oct 12 22:09:45.709100 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-64569218-3ea1-421c-92d9-d9a17b040779 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.083484 Oct 12 22:09:45.709890 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1436/2614] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:09:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:45.714769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4b929fe5-931a-46a6-a654-fb7be22accc5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:45.719905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4b929fe5-931a-46a6-a654-fb7be22accc5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:45.727272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b929fe5-931a-46a6-a654-fb7be22accc5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:45.728069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b929fe5-931a-46a6-a654-fb7be22accc5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:45.729266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b929fe5-931a-46a6-a654-fb7be22accc5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:45.730202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b929fe5-931a-46a6-a654-fb7be22accc5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:45.730854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b929fe5-931a-46a6-a654-fb7be22accc5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:45.731519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b929fe5-931a-46a6-a654-fb7be22accc5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:45.971797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b929fe5-931a-46a6-a654-fb7be22accc5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:45.996932 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4b929fe5-931a-46a6-a654-fb7be22accc5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1462 microversion: 2.1 time: 0.270821 Oct 12 22:09:45.998601 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1437/2615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:45 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1462 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:46.024304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-46c36f1d-40db-4815-82be-296cea27f8fa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:46.025128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-46c36f1d-40db-4815-82be-296cea27f8fa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:46.034511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46c36f1d-40db-4815-82be-296cea27f8fa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:46.035016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46c36f1d-40db-4815-82be-296cea27f8fa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:46.035591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46c36f1d-40db-4815-82be-296cea27f8fa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:46.036679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46c36f1d-40db-4815-82be-296cea27f8fa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:46.038531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46c36f1d-40db-4815-82be-296cea27f8fa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:46.039124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46c36f1d-40db-4815-82be-296cea27f8fa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:46.390023 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b372aaf2-7457-4686-b584-72814ad33145 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "POST /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8/action" status: 202 len: 0 microversion: 2.1 time: 1.075528 Oct 12 22:09:46.391757 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1179/2616] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:09:45 2022] POST /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8/action => generated 0 bytes in 1092 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:09:46.396634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-46c36f1d-40db-4815-82be-296cea27f8fa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:46.398296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb8d1fdf-7808-4ec0-85aa-82ce96ff8b41 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:46.399026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eb8d1fdf-7808-4ec0-85aa-82ce96ff8b41 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:46.408668 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-46c36f1d-40db-4815-82be-296cea27f8fa tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1463 microversion: 2.1 time: 0.391504 Oct 12 22:09:46.409289 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1438/2617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:46 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1463 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:09:46.420497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe555a0f-374e-4af8-bbfb-4d211599ab3d tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:46.421134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fe555a0f-374e-4af8-bbfb-4d211599ab3d tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:46.434409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe555a0f-374e-4af8-bbfb-4d211599ab3d tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:46.435193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe555a0f-374e-4af8-bbfb-4d211599ab3d tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:46.437543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe555a0f-374e-4af8-bbfb-4d211599ab3d tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:46.438884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb8d1fdf-7808-4ec0-85aa-82ce96ff8b41 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:46.439565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb8d1fdf-7808-4ec0-85aa-82ce96ff8b41 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:46.439950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb8d1fdf-7808-4ec0-85aa-82ce96ff8b41 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:46.440878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb8d1fdf-7808-4ec0-85aa-82ce96ff8b41 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:46.442287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe555a0f-374e-4af8-bbfb-4d211599ab3d tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:46.442434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb8d1fdf-7808-4ec0-85aa-82ce96ff8b41 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:46.442780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb8d1fdf-7808-4ec0-85aa-82ce96ff8b41 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:46.444468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe555a0f-374e-4af8-bbfb-4d211599ab3d tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:46.445905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe555a0f-374e-4af8-bbfb-4d211599ab3d tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:46.539169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe555a0f-374e-4af8-bbfb-4d211599ab3d tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:46.542398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe555a0f-374e-4af8-bbfb-4d211599ab3d tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:46.542877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe555a0f-374e-4af8-bbfb-4d211599ab3d tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:46.543502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-fe555a0f-374e-4af8-bbfb-4d211599ab3d tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lazy-loading 'fault' on Instance uuid af1c142a-8d11-4578-a840-84ed39f0e1f4 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:09:46.628070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fe555a0f-374e-4af8-bbfb-4d211599ab3d tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c78e7bee0d4dbe88f7c1beb9042038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede0fba22ac94b9e9a394ed466a92bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:46.639097 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fe555a0f-374e-4af8-bbfb-4d211599ab3d tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 200 len: 1360 microversion: 2.1 time: 0.228764 Oct 12 22:09:46.639724 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1439/2618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:46 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 1360 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:46.666648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1e99861f-c247-40f6-9f6c-7f2beab477eb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:46.671272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1e99861f-c247-40f6-9f6c-7f2beab477eb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:46.686745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e99861f-c247-40f6-9f6c-7f2beab477eb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:46.687448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e99861f-c247-40f6-9f6c-7f2beab477eb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:46.688658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e99861f-c247-40f6-9f6c-7f2beab477eb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:46.690441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e99861f-c247-40f6-9f6c-7f2beab477eb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:46.691772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e99861f-c247-40f6-9f6c-7f2beab477eb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:46.692464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e99861f-c247-40f6-9f6c-7f2beab477eb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:46.910109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eb8d1fdf-7808-4ec0-85aa-82ce96ff8b41 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:46.925721 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb8d1fdf-7808-4ec0-85aa-82ce96ff8b41 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1318 microversion: 2.1 time: 0.532601 Oct 12 22:09:46.928574 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1180/2619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:46 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:46.970835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-900116293", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f3b0eb54-219e-4026-b96c-59b963b0f770"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:46.986357 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1e99861f-c247-40f6-9f6c-7f2beab477eb tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.341038 Oct 12 22:09:46.987354 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1440/2620] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 12 22:09:46 2022] GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8/os-security-groups => generated 1158 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:46.992466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3c95b9d4-2f1c-4fb5-8d74-c26c9e2f71c5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:46.993087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3c95b9d4-2f1c-4fb5-8d74-c26c9e2f71c5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:47.007261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c95b9d4-2f1c-4fb5-8d74-c26c9e2f71c5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:47.010839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c95b9d4-2f1c-4fb5-8d74-c26c9e2f71c5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:47.011353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c95b9d4-2f1c-4fb5-8d74-c26c9e2f71c5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:47.012090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c95b9d4-2f1c-4fb5-8d74-c26c9e2f71c5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:47.012565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c95b9d4-2f1c-4fb5-8d74-c26c9e2f71c5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:47.013025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c95b9d4-2f1c-4fb5-8d74-c26c9e2f71c5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:47.120502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:09:47.202757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3c95b9d4-2f1c-4fb5-8d74-c26c9e2f71c5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:47.214258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3c95b9d4-2f1c-4fb5-8d74-c26c9e2f71c5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:47.220898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3c95b9d4-2f1c-4fb5-8d74-c26c9e2f71c5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:47.230674 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3c95b9d4-2f1c-4fb5-8d74-c26c9e2f71c5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.242042 Oct 12 22:09:47.238249 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1441/2621] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:46 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:47.243864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b18e2f2-290b-421f-9dac-5ebed2b61b83 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Action: 'create', calling method: .version_select at 0x7f51233abb80>, body: {"security_group": {"name": " tempest-securitygroup -378600707 ", "description": "tempest-description-1476910485"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:47.467251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:09:47.468238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:09:47.469236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:09:47.469988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:09:47.471232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:09:47.485994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:47.488177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:47.489448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:47.490683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:47.492174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:47.493057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:47.526803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:47.547594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Getting quotas for project 2963196dad204be0bfb1d9f27f4a1968. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:09:47.552678 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8b18e2f2-290b-421f-9dac-5ebed2b61b83 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.315466 Oct 12 22:09:47.553412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Getting quotas for user 7d2edcc7683f4df8bca17a3648c4d59b and project 2963196dad204be0bfb1d9f27f4a1968. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:09:47.554602 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1442/2622] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:09:47 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:47.568148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-da191103-e062-45e6-b957-453e2330cfe9 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f51233b2040>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:47.571276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:09:47.575423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:09:47.678915 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-da191103-e062-45e6-b957-453e2330cfe9 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/58c3399a-c4a4-4029-ba72-89251177875b" status: 200 len: 223 microversion: 2.1 time: 0.113986 Oct 12 22:09:47.680371 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1443/2623] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 12 22:09:47 2022] GET /compute/v2.1/os-security-groups/58c3399a-c4a4-4029-ba72-89251177875b => generated 223 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:09:47.695505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-67f57f5b-99c0-4712-a693-f257e2b54d60 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:47.696740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-67f57f5b-99c0-4712-a693-f257e2b54d60 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] [instance: af1c142a-8d11-4578-a840-84ed39f0e1f4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:47.706575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f57f5b-99c0-4712-a693-f257e2b54d60 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:47.707631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f57f5b-99c0-4712-a693-f257e2b54d60 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:47.708745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f57f5b-99c0-4712-a693-f257e2b54d60 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:47.709604 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-698092cf-fd73-4c1d-8afa-7b3c92a4c9a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779159 Oct 12 22:09:47.709913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f57f5b-99c0-4712-a693-f257e2b54d60 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:47.710265 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1181/2624] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:09:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:09:47.718504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-95a07af9-3cc8-4fbb-acde-696758ce2244 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f512368ad30>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:47.718931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f57f5b-99c0-4712-a693-f257e2b54d60 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:47.719775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f57f5b-99c0-4712-a693-f257e2b54d60 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:47.736292 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-67f57f5b-99c0-4712-a693-f257e2b54d60 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] HTTP exception thrown: Instance af1c142a-8d11-4578-a840-84ed39f0e1f4 could not be found. Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-67f57f5b-99c0-4712-a693-f257e2b54d60 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Request method failure captured: Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 HTTP/1.1 Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzq_-fgz8KjY6rs9YWjgqYRM81cdOfPsESgeIKvQ_oZLFcvqTjI-V5vgIDV-TCmedCcdhyCBP9BV7CE7f4JlRpDket0w48IYy2gJ4YRzU50EzYKW35IAWJbowo7YnWi7mY-1kAZlkVtmSgtfIueDnvhKZdoD6BfFDy3Zk-U1rG1S8jI Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: ede0fba22ac94b9e9a394ed466a92bd4 Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestJSON-2125405203 Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ede0fba22ac94b9e9a394ed466a92bd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ede0fba22ac94b9e9a394ed466a92bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ede0fba22ac94b9e9a394ed466a92bd4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ede0fba22ac94b9e9a394ed466a92bd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestJSON-2125405203 Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: ede0fba22ac94b9e9a394ed466a92bd4 Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestJSON-2125405203 Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestJSON-2125405203-project Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: d6c78e7bee0d4dbe88f7c1beb9042038 Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestJSON-2125405203-project Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance af1c142a-8d11-4578-a840-84ed39f0e1f4 could not be found. Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'af1c142a-8d11-4578-a840-84ed39f0e1f4'} Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af1c142a-8d11-4578-a840-84ed39f0e1f4 could not be found. Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af1c142a-8d11-4578-a840-84ed39f0e1f4 could not be found. Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:47.738506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:47.742430 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:47.742430 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:47.742430 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:47.742430 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:09:47.742430 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:09:47.742430 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af1c142a-8d11-4578-a840-84ed39f0e1f4 could not be found. Oct 12 22:09:47.742430 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:47.742430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-67f57f5b-99c0-4712-a693-f257e2b54d60 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Returning 404 to user: Instance af1c142a-8d11-4578-a840-84ed39f0e1f4 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:09:47.742430 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-67f57f5b-99c0-4712-a693-f257e2b54d60 tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4" status: 404 len: 111 microversion: 2.1 time: 0.057057 Oct 12 22:09:47.742430 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1444/2625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:47 2022] GET /compute/v2.1/servers/af1c142a-8d11-4578-a840-84ed39f0e1f4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:09:47.748365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6ddee99f-2119-4fac-9368-d111b2580b53 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:47.749001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6ddee99f-2119-4fac-9368-d111b2580b53 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:47.836049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6ddee99f-2119-4fac-9368-d111b2580b53 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:47.846980 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6ddee99f-2119-4fac-9368-d111b2580b53 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68" status: 200 len: 1213 microversion: 2.1 time: 0.105040 Oct 12 22:09:47.848067 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1445/2626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:47 2022] GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:47.853525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-59bcb9f4-de51-4e68-a92b-70a8a80edb5e req-365a8ad6-3e49-42ff-a052-205ed4e3beca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e83b077-4692-4351-8b85-e82dd3661af8", "tag": "cfc3e15c-0e8c-49d8-885b-7827d5c6c133"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:47.865098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-59bcb9f4-de51-4e68-a92b-70a8a80edb5e req-365a8ad6-3e49-42ff-a052-205ed4e3beca service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:47.866302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-59bcb9f4-de51-4e68-a92b-70a8a80edb5e req-365a8ad6-3e49-42ff-a052-205ed4e3beca service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:47.867273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-59bcb9f4-de51-4e68-a92b-70a8a80edb5e req-365a8ad6-3e49-42ff-a052-205ed4e3beca service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:47.880988 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-59bcb9f4-de51-4e68-a92b-70a8a80edb5e req-365a8ad6-3e49-42ff-a052-205ed4e3beca service nova] Creating event network-changed:cfc3e15c-0e8c-49d8-885b-7827d5c6c133 for instance 8e83b077-4692-4351-8b85-e82dd3661af8 on n-h2-861111-1 Oct 12 22:09:47.886439 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-59bcb9f4-de51-4e68-a92b-70a8a80edb5e req-365a8ad6-3e49-42ff-a052-205ed4e3beca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036806 Oct 12 22:09:47.887215 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1446/2627] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:47.892893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e349f8e9-8a43-46cf-9d2e-5f2eef74c9af tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] Calling method '.version_select at 0x7f5123363160>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:47.919698 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e349f8e9-8a43-46cf-9d2e-5f2eef74c9af tempest-ServersTestJSON-2125405203 tempest-ServersTestJSON-2125405203-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1577865335" status: 202 len: 0 microversion: 2.1 time: 0.030856 Oct 12 22:09:47.920952 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1447/2628] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 12 22:09:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1577865335 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:09:47.956433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-17ee1fed-8b33-475b-a294-ce7ad2914ca7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:47.957610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-17ee1fed-8b33-475b-a294-ce7ad2914ca7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:47.981476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17ee1fed-8b33-475b-a294-ce7ad2914ca7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:47.982273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17ee1fed-8b33-475b-a294-ce7ad2914ca7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:47.982896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17ee1fed-8b33-475b-a294-ce7ad2914ca7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:47.984009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17ee1fed-8b33-475b-a294-ce7ad2914ca7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:47.984667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17ee1fed-8b33-475b-a294-ce7ad2914ca7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:47.985432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17ee1fed-8b33-475b-a294-ce7ad2914ca7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:48.489763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-17ee1fed-8b33-475b-a294-ce7ad2914ca7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:48.509777 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-17ee1fed-8b33-475b-a294-ce7ad2914ca7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1318 microversion: 2.1 time: 0.557219 Oct 12 22:09:48.513008 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1448/2629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:47 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:09:48.521262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bf1351f0-d983-459f-9fe0-5226bc5ceafd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:48.527570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bf1351f0-d983-459f-9fe0-5226bc5ceafd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:48.547595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf1351f0-d983-459f-9fe0-5226bc5ceafd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:48.548075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf1351f0-d983-459f-9fe0-5226bc5ceafd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:48.548555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf1351f0-d983-459f-9fe0-5226bc5ceafd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:48.549286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf1351f0-d983-459f-9fe0-5226bc5ceafd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:48.549740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf1351f0-d983-459f-9fe0-5226bc5ceafd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:48.550337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf1351f0-d983-459f-9fe0-5226bc5ceafd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:48.753613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bf1351f0-d983-459f-9fe0-5226bc5ceafd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:48.773162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bf1351f0-d983-459f-9fe0-5226bc5ceafd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:48.776383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bf1351f0-d983-459f-9fe0-5226bc5ceafd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:48.784747 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bf1351f0-d983-459f-9fe0-5226bc5ceafd tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1531 microversion: 2.91 time: 0.270327 Oct 12 22:09:48.797198 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1449/2630] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:48 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1531 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:48.813638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-191951027", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce6dd748-e52a-46d1-938f-29e5070fa849"}], "security_groups": [{"name": "tempest-securitygroup--1915503616"}], "key_name": "tempest-keypair-989260750", "user_data": "}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:48.940593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] validate_networks() for [('ce6dd748-e52a-46d1-938f-29e5070fa849', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:09:49.132793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:49.216396 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-95a07af9-3cc8-4fbb-acde-696758ce2244 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/58c3399a-c4a4-4029-ba72-89251177875b" status: 202 len: 0 microversion: 2.1 time: 1.505016 Oct 12 22:09:49.217190 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1182/2631] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:09:47 2022] DELETE /compute/v2.1/os-security-groups/58c3399a-c4a4-4029-ba72-89251177875b => generated 0 bytes in 1506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:09:49.223932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8b13d188-6458-4523-9c48-810049c36f1f tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:49.224702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8b13d188-6458-4523-9c48-810049c36f1f tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:49.233415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b13d188-6458-4523-9c48-810049c36f1f tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:49.234151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b13d188-6458-4523-9c48-810049c36f1f tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:49.234842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b13d188-6458-4523-9c48-810049c36f1f tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:49.235874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b13d188-6458-4523-9c48-810049c36f1f tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:49.236433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b13d188-6458-4523-9c48-810049c36f1f tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:49.237079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b13d188-6458-4523-9c48-810049c36f1f tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:49.432826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:09:49.433629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:09:49.434444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:09:49.435463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:09:49.436159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:09:49.446557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:49.448120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:49.448821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:49.449803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:49.450541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:49.451306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:49.451487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-8b13d188-6458-4523-9c48-810049c36f1f tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lazy-loading 'services' on Instance uuid c01cd2e8-7dbc-4751-9124-8e46d3181d89 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:09:49.475661 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8b13d188-6458-4523-9c48-810049c36f1f tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1936 microversion: 2.91 time: 0.257042 Oct 12 22:09:49.476772 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1183/2632] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:49 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1936 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:49.482680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-07a76bd8-fdac-47ff-9b9a-32aacb9dcc50 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:49.483978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-07a76bd8-fdac-47ff-9b9a-32aacb9dcc50 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:49.506052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07a76bd8-fdac-47ff-9b9a-32aacb9dcc50 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:49.506982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07a76bd8-fdac-47ff-9b9a-32aacb9dcc50 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:49.507674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07a76bd8-fdac-47ff-9b9a-32aacb9dcc50 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:49.508612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07a76bd8-fdac-47ff-9b9a-32aacb9dcc50 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:49.510362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07a76bd8-fdac-47ff-9b9a-32aacb9dcc50 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:49.511139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07a76bd8-fdac-47ff-9b9a-32aacb9dcc50 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:49.511764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Getting quotas for project 68913d260d084ce4a8e29daf4783c0bc. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:09:49.519287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Getting quotas for user 13c74a78e82f4e72a7d1f7b133074f5a and project 68913d260d084ce4a8e29daf4783c0bc. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:09:49.536721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:09:49.540019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:09:49.611013 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-465edf8a-ad45-46d5-8492-64b1b720dcfd tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.811571 Oct 12 22:09:49.612564 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1450/2633] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:09:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:09:49.617769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-670ffc7f-8eae-48c9-bc47-42d84c9ff008 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f5123290430>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:49.657590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-07a76bd8-fdac-47ff-9b9a-32aacb9dcc50 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:49.676702 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-07a76bd8-fdac-47ff-9b9a-32aacb9dcc50 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68" status: 200 len: 1271 microversion: 2.1 time: 0.198647 Oct 12 22:09:49.682257 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1184/2634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:49 2022] GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 => generated 1271 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:49.691289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-670ffc7f-8eae-48c9-bc47-42d84c9ff008 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 58c3399a-c4a4-4029-ba72-89251177875b does not exist", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:09:49.692177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.security_group_api [None req-670ffc7f-8eae-48c9-bc47-42d84c9ff008 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Neutron security group 58c3399a-c4a4-4029-ba72-89251177875b not found {{(pid=120453) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:09:49.692723 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-670ffc7f-8eae-48c9-bc47-42d84c9ff008 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] HTTP exception thrown: Security group 58c3399a-c4a4-4029-ba72-89251177875b does not exist Oct 12 22:09:49.692723 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-56270bd8-559a-44fb-a564-8d332a43c7ff'] Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-670ffc7f-8eae-48c9-bc47-42d84c9ff008 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Request method failure captured: Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-security-groups/58c3399a-c4a4-4029-ba72-89251177875b HTTP/1.1 Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzsOoCBjc82qYrgXGJcyS2C14AOyPaAY8jKON607aXBRETBa1-csxQQTd0dgLMFOSgjqcymNifeM8Cm_FMIYg-_UXGIEhCMX-O3n3HlLkfS0dfrzyRNsTuLIp0L-pAR76rzZrOO2f-Vw4UsY6dbCy5X6TdVdQGY9sHIG-ct3MYAKFNg Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_214f86d71a5749b9b98dffe934fe7f1f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 81e045d919104fa89572a2d05993abb8 Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: exception: Security group 58c3399a-c4a4-4029-ba72-89251177875b does not exist Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-56270bd8-559a-44fb-a564-8d332a43c7ff'] Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '58c3399a-c4a4-4029-ba72-89251177875b'} Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:09:49.695876 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 58c3399a-c4a4-4029-ba72-89251177875b does not exist Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56270bd8-559a-44fb-a564-8d332a43c7ff'] Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 58c3399a-c4a4-4029-ba72-89251177875b does not exist Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56270bd8-559a-44fb-a564-8d332a43c7ff'] Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 58c3399a-c4a4-4029-ba72-89251177875b does not exist Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56270bd8-559a-44fb-a564-8d332a43c7ff'] Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 58c3399a-c4a4-4029-ba72-89251177875b does not exist Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56270bd8-559a-44fb-a564-8d332a43c7ff'] Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-670ffc7f-8eae-48c9-bc47-42d84c9ff008 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Returning 404 to user: Security group 58c3399a-c4a4-4029-ba72-89251177875b does not exist Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-56270bd8-559a-44fb-a564-8d332a43c7ff'] {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-670ffc7f-8eae-48c9-bc47-42d84c9ff008 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/58c3399a-c4a4-4029-ba72-89251177875b" status: 404 len: 194 microversion: 2.1 time: 0.083757 Oct 12 22:09:49.700229 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1451/2635] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 12 22:09:49 2022] GET /compute/v2.1/os-security-groups/58c3399a-c4a4-4029-ba72-89251177875b => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:09:49.710190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-25873a59-6c18-41ab-88bb-54491754fecb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:49.710756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-25873a59-6c18-41ab-88bb-54491754fecb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:49.713204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-356c501c-ebb2-4394-8c7e-0142a999ca60 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:49.713754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-356c501c-ebb2-4394-8c7e-0142a999ca60 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:49.737634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-356c501c-ebb2-4394-8c7e-0142a999ca60 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:49.739922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25873a59-6c18-41ab-88bb-54491754fecb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:49.740428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25873a59-6c18-41ab-88bb-54491754fecb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:49.742140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-356c501c-ebb2-4394-8c7e-0142a999ca60 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:49.742875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-356c501c-ebb2-4394-8c7e-0142a999ca60 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:49.744859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25873a59-6c18-41ab-88bb-54491754fecb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:49.745031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-356c501c-ebb2-4394-8c7e-0142a999ca60 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:49.745400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-356c501c-ebb2-4394-8c7e-0142a999ca60 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:49.746106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-356c501c-ebb2-4394-8c7e-0142a999ca60 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:49.747636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25873a59-6c18-41ab-88bb-54491754fecb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:49.748392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25873a59-6c18-41ab-88bb-54491754fecb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:49.749788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25873a59-6c18-41ab-88bb-54491754fecb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:49.801524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-356c501c-ebb2-4394-8c7e-0142a999ca60 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lazy-loading 'flavor' on Instance uuid c01cd2e8-7dbc-4751-9124-8e46d3181d89 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:09:49.895654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:50.070416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-25873a59-6c18-41ab-88bb-54491754fecb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:50.080078 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-25873a59-6c18-41ab-88bb-54491754fecb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1318 microversion: 2.1 time: 0.380317 Oct 12 22:09:50.084332 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1452/2636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:49 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:50.095111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f25252bf-d64d-484c-b328-8ceac3c5714c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:50.096950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f25252bf-d64d-484c-b328-8ceac3c5714c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:50.180648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f25252bf-d64d-484c-b328-8ceac3c5714c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:50.190735 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-356c501c-ebb2-4394-8c7e-0142a999ca60 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "POST /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89/action" status: 202 len: 0 microversion: 2.91 time: 0.505227 Oct 12 22:09:50.192125 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1185/2637] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 12 22:09:49 2022] POST /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:09:50.199094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a72e959a-fce5-4dc2-a515-cef6f31494be tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Action: 'create', calling method: .version_select at 0x7f5123693670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-885839441", "description": "tempest-description-1903291554"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:50.200554 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f25252bf-d64d-484c-b328-8ceac3c5714c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 200 len: 1240 microversion: 2.1 time: 0.114730 Oct 12 22:09:50.215843 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1453/2638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:50 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 1240 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:50.224580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-75f62fdd-3b8a-46e5-99a1-968f435b93e9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:50.225424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-75f62fdd-3b8a-46e5-99a1-968f435b93e9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:50.235944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75f62fdd-3b8a-46e5-99a1-968f435b93e9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:50.236675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75f62fdd-3b8a-46e5-99a1-968f435b93e9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:50.237260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75f62fdd-3b8a-46e5-99a1-968f435b93e9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:50.238117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75f62fdd-3b8a-46e5-99a1-968f435b93e9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:50.238689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75f62fdd-3b8a-46e5-99a1-968f435b93e9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:50.239329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75f62fdd-3b8a-46e5-99a1-968f435b93e9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:50.315888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-75f62fdd-3b8a-46e5-99a1-968f435b93e9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:50.326149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-75f62fdd-3b8a-46e5-99a1-968f435b93e9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:50.327906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-75f62fdd-3b8a-46e5-99a1-968f435b93e9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:50.334204 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-75f62fdd-3b8a-46e5-99a1-968f435b93e9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.116738 Oct 12 22:09:50.343508 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1454/2639] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:50 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:50.713034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8295c10c-da9c-4db6-b802-06f111692869 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:50.714628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8295c10c-da9c-4db6-b802-06f111692869 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:50.738362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8295c10c-da9c-4db6-b802-06f111692869 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:50.740639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8295c10c-da9c-4db6-b802-06f111692869 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:50.741095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8295c10c-da9c-4db6-b802-06f111692869 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:50.752273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8295c10c-da9c-4db6-b802-06f111692869 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:50.754466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8295c10c-da9c-4db6-b802-06f111692869 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:50.755801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8295c10c-da9c-4db6-b802-06f111692869 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:50.859270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8295c10c-da9c-4db6-b802-06f111692869 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:50.867697 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8295c10c-da9c-4db6-b802-06f111692869 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68" status: 200 len: 1271 microversion: 2.1 time: 0.162418 Oct 12 22:09:50.869668 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1455/2640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:50 2022] GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:09:50.981725 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a72e959a-fce5-4dc2-a515-cef6f31494be tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.788112 Oct 12 22:09:50.990906 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1186/2641] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:09:50 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:50.996230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-85d0ef72-e196-4674-91fd-62e7b2bf3218 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Action: 'create', calling method: .version_select at 0x7f5123290820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-572294715", "description": "tempest-description-409533805"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:51.106836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0229e222-5943-46b4-b92d-ea63dd7124ad tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:51.107771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0229e222-5943-46b4-b92d-ea63dd7124ad tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:51.118081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0229e222-5943-46b4-b92d-ea63dd7124ad tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:51.120454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0229e222-5943-46b4-b92d-ea63dd7124ad tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:51.120999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0229e222-5943-46b4-b92d-ea63dd7124ad tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:51.121844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0229e222-5943-46b4-b92d-ea63dd7124ad tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:51.122512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0229e222-5943-46b4-b92d-ea63dd7124ad tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:51.123035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0229e222-5943-46b4-b92d-ea63dd7124ad tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:51.543991 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-85d0ef72-e196-4674-91fd-62e7b2bf3218 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.552101 Oct 12 22:09:51.544757 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1456/2642] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:09:50 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:51.550259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f149b9c0-e048-4b62-a9c8-e916891888a7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:51.551149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f149b9c0-e048-4b62-a9c8-e916891888a7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:51.559360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f149b9c0-e048-4b62-a9c8-e916891888a7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:51.560107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f149b9c0-e048-4b62-a9c8-e916891888a7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:51.560708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f149b9c0-e048-4b62-a9c8-e916891888a7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:51.561578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f149b9c0-e048-4b62-a9c8-e916891888a7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:51.562148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f149b9c0-e048-4b62-a9c8-e916891888a7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:51.562676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f149b9c0-e048-4b62-a9c8-e916891888a7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:51.781532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0229e222-5943-46b4-b92d-ea63dd7124ad tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:51.820990 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0229e222-5943-46b4-b92d-ea63dd7124ad tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1318 microversion: 2.1 time: 0.715115 Oct 12 22:09:51.823330 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1187/2643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:51 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1318 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:51.831848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd1aa037-58d6-4ab6-8d8a-c5e834e4191d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:51.835978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cd1aa037-58d6-4ab6-8d8a-c5e834e4191d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:51.854328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd1aa037-58d6-4ab6-8d8a-c5e834e4191d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:51.855971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd1aa037-58d6-4ab6-8d8a-c5e834e4191d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:51.856608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd1aa037-58d6-4ab6-8d8a-c5e834e4191d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:51.857553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd1aa037-58d6-4ab6-8d8a-c5e834e4191d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:51.858936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd1aa037-58d6-4ab6-8d8a-c5e834e4191d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:51.859561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd1aa037-58d6-4ab6-8d8a-c5e834e4191d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:52.039809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cd1aa037-58d6-4ab6-8d8a-c5e834e4191d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:52.054772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cd1aa037-58d6-4ab6-8d8a-c5e834e4191d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:52.056372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cd1aa037-58d6-4ab6-8d8a-c5e834e4191d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:52.066285 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cd1aa037-58d6-4ab6-8d8a-c5e834e4191d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.241229 Oct 12 22:09:52.067931 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1188/2644] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:51 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:52.076502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3c871d44-20fd-4e35-8842-9ba9eac77b74 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Action: 'create', calling method: .version_select at 0x7f5123693820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-372311628", "description": "tempest-description-1940708173"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:52.282155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f149b9c0-e048-4b62-a9c8-e916891888a7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:52.292598 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f149b9c0-e048-4b62-a9c8-e916891888a7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 200 len: 1298 microversion: 2.1 time: 0.746084 Oct 12 22:09:52.293680 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1457/2645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:51 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 1298 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:52.299487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cc13683d-ae03-41f1-bc76-3f46ef77dd70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:52.300314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cc13683d-ae03-41f1-bc76-3f46ef77dd70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:52.314985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc13683d-ae03-41f1-bc76-3f46ef77dd70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:52.315974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc13683d-ae03-41f1-bc76-3f46ef77dd70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:52.316607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc13683d-ae03-41f1-bc76-3f46ef77dd70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:52.317619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc13683d-ae03-41f1-bc76-3f46ef77dd70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:52.318275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc13683d-ae03-41f1-bc76-3f46ef77dd70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:52.318919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc13683d-ae03-41f1-bc76-3f46ef77dd70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:52.622663 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3c871d44-20fd-4e35-8842-9ba9eac77b74 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.552353 Oct 12 22:09:52.633914 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1189/2646] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:09:52 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:52.659675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cc13683d-ae03-41f1-bc76-3f46ef77dd70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:52.672754 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cc13683d-ae03-41f1-bc76-3f46ef77dd70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68" status: 200 len: 1313 microversion: 2.1 time: 0.377430 Oct 12 22:09:52.689564 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1458/2647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:52 2022] GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:52.703660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8d997069-304d-4dc3-b25c-c72b7628a00c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f51232900d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:52.833903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-95d718cf-6373-461c-942a-f04a1a0e5103 req-f219ee93-d493-4c5c-b0ea-e017ac1ed2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1baccb0f-089a-44e5-8011-c45767da7abc", "name": "network-vif-plugged", "status": "completed", "tag": "51f781cf-b3dc-4040-977e-77aa6a84e95f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:52.852897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-95d718cf-6373-461c-942a-f04a1a0e5103 req-f219ee93-d493-4c5c-b0ea-e017ac1ed2cc service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:52.854695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-95d718cf-6373-461c-942a-f04a1a0e5103 req-f219ee93-d493-4c5c-b0ea-e017ac1ed2cc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:52.855342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-95d718cf-6373-461c-942a-f04a1a0e5103 req-f219ee93-d493-4c5c-b0ea-e017ac1ed2cc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:52.884115 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-95d718cf-6373-461c-942a-f04a1a0e5103 req-f219ee93-d493-4c5c-b0ea-e017ac1ed2cc service nova] Creating event network-vif-plugged:51f781cf-b3dc-4040-977e-77aa6a84e95f for instance 1baccb0f-089a-44e5-8011-c45767da7abc on n-h2-861111-1 Oct 12 22:09:52.891475 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-95d718cf-6373-461c-942a-f04a1a0e5103 req-f219ee93-d493-4c5c-b0ea-e017ac1ed2cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261490 Oct 12 22:09:52.892433 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1190/2648] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:52.898842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5e17382b-b0ec-4346-b867-9d54cc42fcce tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:52.899744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5e17382b-b0ec-4346-b867-9d54cc42fcce tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:52.907887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e17382b-b0ec-4346-b867-9d54cc42fcce tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:52.908597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e17382b-b0ec-4346-b867-9d54cc42fcce tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:52.909388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e17382b-b0ec-4346-b867-9d54cc42fcce tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:52.910285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e17382b-b0ec-4346-b867-9d54cc42fcce tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:52.910889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e17382b-b0ec-4346-b867-9d54cc42fcce tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:52.911506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e17382b-b0ec-4346-b867-9d54cc42fcce tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:53.272343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5e17382b-b0ec-4346-b867-9d54cc42fcce tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:53.288893 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5e17382b-b0ec-4346-b867-9d54cc42fcce tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1318 microversion: 2.1 time: 0.395022 Oct 12 22:09:53.290384 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1191/2649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:52 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:53.322795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b79362ff-1fc4-4339-8388-a9dcffb90875 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:53.324350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b79362ff-1fc4-4339-8388-a9dcffb90875 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:53.330632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b79362ff-1fc4-4339-8388-a9dcffb90875 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:53.331376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b79362ff-1fc4-4339-8388-a9dcffb90875 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:53.331965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b79362ff-1fc4-4339-8388-a9dcffb90875 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:53.334528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b79362ff-1fc4-4339-8388-a9dcffb90875 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:53.335323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b79362ff-1fc4-4339-8388-a9dcffb90875 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:53.335941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b79362ff-1fc4-4339-8388-a9dcffb90875 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:53.386833 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8d997069-304d-4dc3-b25c-c72b7628a00c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.690551 Oct 12 22:09:53.397129 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1459/2650] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 12 22:09:52 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:53.397129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fd96a053-0851-4f77-adc2-3bd4de6d01eb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:53.398815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fd96a053-0851-4f77-adc2-3bd4de6d01eb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:53.435292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd96a053-0851-4f77-adc2-3bd4de6d01eb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:53.444132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd96a053-0851-4f77-adc2-3bd4de6d01eb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:53.446880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd96a053-0851-4f77-adc2-3bd4de6d01eb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:53.449749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd96a053-0851-4f77-adc2-3bd4de6d01eb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:53.453015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd96a053-0851-4f77-adc2-3bd4de6d01eb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:53.457139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd96a053-0851-4f77-adc2-3bd4de6d01eb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:53.502021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b79362ff-1fc4-4339-8388-a9dcffb90875 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:53.523095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b79362ff-1fc4-4339-8388-a9dcffb90875 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:53.524619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b79362ff-1fc4-4339-8388-a9dcffb90875 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:53.537165 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b79362ff-1fc4-4339-8388-a9dcffb90875 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.229860 Oct 12 22:09:53.561423 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1192/2651] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:53 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:53.587303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-851fe724-171d-4c4c-a87e-9510700593c3 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f51236935e0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:54.011778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fd96a053-0851-4f77-adc2-3bd4de6d01eb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:54.025118 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fd96a053-0851-4f77-adc2-3bd4de6d01eb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 200 len: 1366 microversion: 2.1 time: 0.635625 Oct 12 22:09:54.026793 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1460/2652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:53 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 1366 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:54.033274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-44366b23-94ef-42ec-a3e9-b581fcd1a459 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:54.034090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-44366b23-94ef-42ec-a3e9-b581fcd1a459 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:54.050430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44366b23-94ef-42ec-a3e9-b581fcd1a459 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:54.050944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44366b23-94ef-42ec-a3e9-b581fcd1a459 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:54.051429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44366b23-94ef-42ec-a3e9-b581fcd1a459 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:54.052371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44366b23-94ef-42ec-a3e9-b581fcd1a459 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:54.053279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44366b23-94ef-42ec-a3e9-b581fcd1a459 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:54.054763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44366b23-94ef-42ec-a3e9-b581fcd1a459 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:54.298480 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-851fe724-171d-4c4c-a87e-9510700593c3 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c148c27a-7c5a-4635-9a8e-2103070f3642" status: 202 len: 0 microversion: 2.1 time: 0.735601 Oct 12 22:09:54.300899 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1193/2653] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:09:53 2022] DELETE /compute/v2.1/os-security-groups/c148c27a-7c5a-4635-9a8e-2103070f3642 => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:09:54.307698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-ffb07920-086f-4f22-8085-b87a0705c2ff req-b8086851-a7e2-4ed8-9310-ccf4bddeaeea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11f2bfa7-4830-4faa-844f-69e08c861f68", "tag": "428a0b3d-bd48-4717-b715-5639453998f6"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:54.326043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ffb07920-086f-4f22-8085-b87a0705c2ff req-b8086851-a7e2-4ed8-9310-ccf4bddeaeea service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:54.326569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ffb07920-086f-4f22-8085-b87a0705c2ff req-b8086851-a7e2-4ed8-9310-ccf4bddeaeea service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:54.327214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ffb07920-086f-4f22-8085-b87a0705c2ff req-b8086851-a7e2-4ed8-9310-ccf4bddeaeea service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:54.341352 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-ffb07920-086f-4f22-8085-b87a0705c2ff req-b8086851-a7e2-4ed8-9310-ccf4bddeaeea service nova] Creating event network-changed:428a0b3d-bd48-4717-b715-5639453998f6 for instance 11f2bfa7-4830-4faa-844f-69e08c861f68 on n-h1-861111-1 Oct 12 22:09:54.347861 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-ffb07920-086f-4f22-8085-b87a0705c2ff req-b8086851-a7e2-4ed8-9310-ccf4bddeaeea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045327 Oct 12 22:09:54.349080 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1194/2654] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:54.354786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a370f7ec-c152-4f8b-aba4-0116d1c2993c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f5123692040>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:54.405668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-44366b23-94ef-42ec-a3e9-b581fcd1a459 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:54.413617 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-44366b23-94ef-42ec-a3e9-b581fcd1a459 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68" status: 200 len: 1313 microversion: 2.1 time: 0.385558 Oct 12 22:09:54.414202 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1461/2655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:54 2022] GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:54.434661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f166e293-f386-456c-9de5-dc297f01c323 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:54.435312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f166e293-f386-456c-9de5-dc297f01c323 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:54.441678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f166e293-f386-456c-9de5-dc297f01c323 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:54.442450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f166e293-f386-456c-9de5-dc297f01c323 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:54.443132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f166e293-f386-456c-9de5-dc297f01c323 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:54.444085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f166e293-f386-456c-9de5-dc297f01c323 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:54.444750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f166e293-f386-456c-9de5-dc297f01c323 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:54.450018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f166e293-f386-456c-9de5-dc297f01c323 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:54.453080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG neutronclient.v2_0.client [None req-a370f7ec-c152-4f8b-aba4-0116d1c2993c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c148c27a-7c5a-4635-9a8e-2103070f3642 does not exist", "detail": ""}} {{(pid=120452) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:09:54.455634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.security_group_api [None req-a370f7ec-c152-4f8b-aba4-0116d1c2993c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Neutron security group c148c27a-7c5a-4635-9a8e-2103070f3642 not found {{(pid=120452) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:09:54.456612 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-a370f7ec-c152-4f8b-aba4-0116d1c2993c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] HTTP exception thrown: Security group c148c27a-7c5a-4635-9a8e-2103070f3642 does not exist Oct 12 22:09:54.456612 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-7e750a1f-2a72-446b-ae12-4778df9ab47b'] Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a370f7ec-c152-4f8b-aba4-0116d1c2993c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Request method failure captured: Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-security-groups/c148c27a-7c5a-4635-9a8e-2103070f3642 HTTP/1.1 Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzsOoCBjc82qYrgXGJcyS2C14AOyPaAY8jKON607aXBRETBa1-csxQQTd0dgLMFOSgjqcymNifeM8Cm_FMIYg-_UXGIEhCMX-O3n3HlLkfS0dfrzyRNsTuLIp0L-pAR76rzZrOO2f-Vw4UsY6dbCy5X6TdVdQGY9sHIG-ct3MYAKFNg Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_214f86d71a5749b9b98dffe934fe7f1f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 81e045d919104fa89572a2d05993abb8 Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: exception: Security group c148c27a-7c5a-4635-9a8e-2103070f3642 does not exist Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-7e750a1f-2a72-446b-ae12-4778df9ab47b'] Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'c148c27a-7c5a-4635-9a8e-2103070f3642'} Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:09:54.462322 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c148c27a-7c5a-4635-9a8e-2103070f3642 does not exist Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e750a1f-2a72-446b-ae12-4778df9ab47b'] Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c148c27a-7c5a-4635-9a8e-2103070f3642 does not exist Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e750a1f-2a72-446b-ae12-4778df9ab47b'] Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c148c27a-7c5a-4635-9a8e-2103070f3642 does not exist Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e750a1f-2a72-446b-ae12-4778df9ab47b'] Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c148c27a-7c5a-4635-9a8e-2103070f3642 does not exist Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e750a1f-2a72-446b-ae12-4778df9ab47b'] Oct 12 22:09:54.468770 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:54.474621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a370f7ec-c152-4f8b-aba4-0116d1c2993c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Returning 404 to user: Security group c148c27a-7c5a-4635-9a8e-2103070f3642 does not exist Oct 12 22:09:54.474621 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-7e750a1f-2a72-446b-ae12-4778df9ab47b'] {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:09:54.474621 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a370f7ec-c152-4f8b-aba4-0116d1c2993c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/c148c27a-7c5a-4635-9a8e-2103070f3642" status: 404 len: 194 microversion: 2.1 time: 0.120801 Oct 12 22:09:54.474621 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1195/2656] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 12 22:09:54 2022] GET /compute/v2.1/os-security-groups/c148c27a-7c5a-4635-9a8e-2103070f3642 => generated 194 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:09:54.486602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-336efbd1-eb94-43db-a776-9f9fe8247b78 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f512c4c83a0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:54.800957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f166e293-f386-456c-9de5-dc297f01c323 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:54.810007 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f166e293-f386-456c-9de5-dc297f01c323 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1318 microversion: 2.1 time: 0.381178 Oct 12 22:09:54.814050 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1462/2657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:54 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:54.818970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-df72e9e2-f1df-41db-9db7-0b610acdfb6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:54.824682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-df72e9e2-f1df-41db-9db7-0b610acdfb6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:54.841306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df72e9e2-f1df-41db-9db7-0b610acdfb6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:54.842000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df72e9e2-f1df-41db-9db7-0b610acdfb6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:54.842544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df72e9e2-f1df-41db-9db7-0b610acdfb6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:54.843387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df72e9e2-f1df-41db-9db7-0b610acdfb6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:54.843945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df72e9e2-f1df-41db-9db7-0b610acdfb6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:54.844465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df72e9e2-f1df-41db-9db7-0b610acdfb6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:54.847583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:54.997665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-df72e9e2-f1df-41db-9db7-0b610acdfb6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:55.015534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-df72e9e2-f1df-41db-9db7-0b610acdfb6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:55.026697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-df72e9e2-f1df-41db-9db7-0b610acdfb6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:55.034124 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-df72e9e2-f1df-41db-9db7-0b610acdfb6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.218097 Oct 12 22:09:55.039444 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1463/2658] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:54 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:55.057206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-67f99e54-0224-4985-90d0-b9ac2e91dcd1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:55.058134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-67f99e54-0224-4985-90d0-b9ac2e91dcd1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:55.066554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f99e54-0224-4985-90d0-b9ac2e91dcd1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:55.067313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f99e54-0224-4985-90d0-b9ac2e91dcd1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:55.068030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f99e54-0224-4985-90d0-b9ac2e91dcd1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:55.068890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f99e54-0224-4985-90d0-b9ac2e91dcd1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:55.069554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f99e54-0224-4985-90d0-b9ac2e91dcd1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:55.070143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f99e54-0224-4985-90d0-b9ac2e91dcd1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:55.139688 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-336efbd1-eb94-43db-a776-9f9fe8247b78 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c691583e-fa79-4edc-ac6a-73c9aaced7d3" status: 202 len: 0 microversion: 2.1 time: 0.656801 Oct 12 22:09:55.149250 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1196/2659] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:09:54 2022] DELETE /compute/v2.1/os-security-groups/c691583e-fa79-4edc-ac6a-73c9aaced7d3 => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:09:55.164025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-db27db4c-f8c7-4637-b4ef-981651507959 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f512c4c8160>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:55.224002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG neutronclient.v2_0.client [None req-db27db4c-f8c7-4637-b4ef-981651507959 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 does not exist", "detail": ""}} {{(pid=120452) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:09:55.224606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.security_group_api [None req-db27db4c-f8c7-4637-b4ef-981651507959 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Neutron security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 not found {{(pid=120452) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:09:55.225149 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-db27db4c-f8c7-4637-b4ef-981651507959 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] HTTP exception thrown: Security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 does not exist Oct 12 22:09:55.225149 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-b912c4c4-f828-440f-a515-f9d28d2b2f3f'] Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-db27db4c-f8c7-4637-b4ef-981651507959 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Request method failure captured: Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-security-groups/c691583e-fa79-4edc-ac6a-73c9aaced7d3 HTTP/1.1 Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzsOoCBjc82qYrgXGJcyS2C14AOyPaAY8jKON607aXBRETBa1-csxQQTd0dgLMFOSgjqcymNifeM8Cm_FMIYg-_UXGIEhCMX-O3n3HlLkfS0dfrzyRNsTuLIp0L-pAR76rzZrOO2f-Vw4UsY6dbCy5X6TdVdQGY9sHIG-ct3MYAKFNg Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_214f86d71a5749b9b98dffe934fe7f1f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 81e045d919104fa89572a2d05993abb8 Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: exception: Security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 does not exist Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-b912c4c4-f828-440f-a515-f9d28d2b2f3f'] Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'c691583e-fa79-4edc-ac6a-73c9aaced7d3'} Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:09:55.227442 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 does not exist Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b912c4c4-f828-440f-a515-f9d28d2b2f3f'] Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 does not exist Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b912c4c4-f828-440f-a515-f9d28d2b2f3f'] Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 does not exist Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b912c4c4-f828-440f-a515-f9d28d2b2f3f'] Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 does not exist Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b912c4c4-f828-440f-a515-f9d28d2b2f3f'] Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-db27db4c-f8c7-4637-b4ef-981651507959 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Returning 404 to user: Security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 does not exist Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-b912c4c4-f828-440f-a515-f9d28d2b2f3f'] {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-db27db4c-f8c7-4637-b4ef-981651507959 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/c691583e-fa79-4edc-ac6a-73c9aaced7d3" status: 404 len: 194 microversion: 2.1 time: 0.073817 Oct 12 22:09:55.234606 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1197/2660] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 12 22:09:55 2022] GET /compute/v2.1/os-security-groups/c691583e-fa79-4edc-ac6a-73c9aaced7d3 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:09:55.237940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-67e0cd9f-6a72-496c-a479-45821f810f95 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f5123693f70>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:55.649761 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-67e0cd9f-6a72-496c-a479-45821f810f95 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/d689cf9c-d27c-43fa-943d-6a247018f548" status: 202 len: 0 microversion: 2.1 time: 0.415732 Oct 12 22:09:55.654994 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1198/2661] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:09:55 2022] DELETE /compute/v2.1/os-security-groups/d689cf9c-d27c-43fa-943d-6a247018f548 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:09:55.667788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f997c072-b512-4309-9694-617bbf89a00a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:55.668853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f997c072-b512-4309-9694-617bbf89a00a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:55.688848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f997c072-b512-4309-9694-617bbf89a00a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:55.689577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f997c072-b512-4309-9694-617bbf89a00a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:55.691424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f997c072-b512-4309-9694-617bbf89a00a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:55.692320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f997c072-b512-4309-9694-617bbf89a00a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:55.693390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f997c072-b512-4309-9694-617bbf89a00a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:55.694036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f997c072-b512-4309-9694-617bbf89a00a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:55.843684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-67f99e54-0224-4985-90d0-b9ac2e91dcd1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:55.852158 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-67f99e54-0224-4985-90d0-b9ac2e91dcd1 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 200 len: 1366 microversion: 2.1 time: 0.804419 Oct 12 22:09:55.853374 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1464/2662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:55 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 1366 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:55.858148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b7887945-e682-4a5b-9765-8cc36a6977a2 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f5123469dc0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:55.949772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-b7887945-e682-4a5b-9765-8cc36a6977a2 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d689cf9c-d27c-43fa-943d-6a247018f548 does not exist", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:09:55.950526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.security_group_api [None req-b7887945-e682-4a5b-9765-8cc36a6977a2 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Neutron security group d689cf9c-d27c-43fa-943d-6a247018f548 not found {{(pid=120453) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:09:55.951131 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-b7887945-e682-4a5b-9765-8cc36a6977a2 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] HTTP exception thrown: Security group d689cf9c-d27c-43fa-943d-6a247018f548 does not exist Oct 12 22:09:55.951131 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-cfce753d-e2de-40e6-b0c7-d9fc54ed66b0'] Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b7887945-e682-4a5b-9765-8cc36a6977a2 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Request method failure captured: Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-security-groups/d689cf9c-d27c-43fa-943d-6a247018f548 HTTP/1.1 Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzsOoCBjc82qYrgXGJcyS2C14AOyPaAY8jKON607aXBRETBa1-csxQQTd0dgLMFOSgjqcymNifeM8Cm_FMIYg-_UXGIEhCMX-O3n3HlLkfS0dfrzyRNsTuLIp0L-pAR76rzZrOO2f-Vw4UsY6dbCy5X6TdVdQGY9sHIG-ct3MYAKFNg Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_214f86d71a5749b9b98dffe934fe7f1f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 81e045d919104fa89572a2d05993abb8 Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: exception: Security group d689cf9c-d27c-43fa-943d-6a247018f548 does not exist Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-cfce753d-e2de-40e6-b0c7-d9fc54ed66b0'] Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'd689cf9c-d27c-43fa-943d-6a247018f548'} Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:09:55.953339 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d689cf9c-d27c-43fa-943d-6a247018f548 does not exist Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfce753d-e2de-40e6-b0c7-d9fc54ed66b0'] Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d689cf9c-d27c-43fa-943d-6a247018f548 does not exist Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfce753d-e2de-40e6-b0c7-d9fc54ed66b0'] Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d689cf9c-d27c-43fa-943d-6a247018f548 does not exist Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfce753d-e2de-40e6-b0c7-d9fc54ed66b0'] Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d689cf9c-d27c-43fa-943d-6a247018f548 does not exist Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfce753d-e2de-40e6-b0c7-d9fc54ed66b0'] Oct 12 22:09:55.956571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:09:55.964028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b7887945-e682-4a5b-9765-8cc36a6977a2 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Returning 404 to user: Security group d689cf9c-d27c-43fa-943d-6a247018f548 does not exist Oct 12 22:09:55.964028 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-cfce753d-e2de-40e6-b0c7-d9fc54ed66b0'] {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:09:55.965190 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b7887945-e682-4a5b-9765-8cc36a6977a2 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/d689cf9c-d27c-43fa-943d-6a247018f548" status: 404 len: 194 microversion: 2.1 time: 0.110752 Oct 12 22:09:55.966293 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1465/2663] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 12 22:09:55 2022] GET /compute/v2.1/os-security-groups/d689cf9c-d27c-43fa-943d-6a247018f548 => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:09:55.971407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4a84f58d-116d-458e-bb60-72a5fcfa6837 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:55.972284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4a84f58d-116d-458e-bb60-72a5fcfa6837 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:55.982986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a84f58d-116d-458e-bb60-72a5fcfa6837 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:55.983983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a84f58d-116d-458e-bb60-72a5fcfa6837 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:55.984753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a84f58d-116d-458e-bb60-72a5fcfa6837 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:55.985684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a84f58d-116d-458e-bb60-72a5fcfa6837 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:55.986345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a84f58d-116d-458e-bb60-72a5fcfa6837 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:55.986978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a84f58d-116d-458e-bb60-72a5fcfa6837 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:56.077353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f997c072-b512-4309-9694-617bbf89a00a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:56.085695 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f997c072-b512-4309-9694-617bbf89a00a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68" status: 200 len: 1313 microversion: 2.1 time: 0.429154 Oct 12 22:09:56.102179 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1199/2664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:55 2022] GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:56.107916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-81cf66db-0233-4375-bc6a-3e459c7fe898 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f5128340af0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:56.310982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4a84f58d-116d-458e-bb60-72a5fcfa6837 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:56.346378 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4a84f58d-116d-458e-bb60-72a5fcfa6837 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1468 microversion: 2.1 time: 0.361079 Oct 12 22:09:56.347888 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1466/2665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:55 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1468 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:56.354948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fce96869-8aee-41d6-947b-cf14b2e17490 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:56.356239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fce96869-8aee-41d6-947b-cf14b2e17490 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:56.369485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fce96869-8aee-41d6-947b-cf14b2e17490 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:56.370611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fce96869-8aee-41d6-947b-cf14b2e17490 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:56.371608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fce96869-8aee-41d6-947b-cf14b2e17490 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:56.372560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fce96869-8aee-41d6-947b-cf14b2e17490 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:56.373273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fce96869-8aee-41d6-947b-cf14b2e17490 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:56.374083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fce96869-8aee-41d6-947b-cf14b2e17490 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:56.498079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fce96869-8aee-41d6-947b-cf14b2e17490 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:56.511279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fce96869-8aee-41d6-947b-cf14b2e17490 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:56.520218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fce96869-8aee-41d6-947b-cf14b2e17490 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:56.526264 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fce96869-8aee-41d6-947b-cf14b2e17490 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.176906 Oct 12 22:09:56.527889 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1467/2666] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:56 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:56.535479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e67e77fa-61fa-4f04-859c-9fa1ca1be2f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:56.536514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e67e77fa-61fa-4f04-859c-9fa1ca1be2f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 35efe352-3b67-40fc-99c5-22fbf221bdfa] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:56.543717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e67e77fa-61fa-4f04-859c-9fa1ca1be2f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:56.544552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e67e77fa-61fa-4f04-859c-9fa1ca1be2f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:56.545314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e67e77fa-61fa-4f04-859c-9fa1ca1be2f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:56.546726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e67e77fa-61fa-4f04-859c-9fa1ca1be2f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:56.547489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e67e77fa-61fa-4f04-859c-9fa1ca1be2f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:56.548006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e67e77fa-61fa-4f04-859c-9fa1ca1be2f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:56.910379 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-81cf66db-0233-4375-bc6a-3e459c7fe898 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.806784 Oct 12 22:09:56.911906 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1200/2667] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 12 22:09:56 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:56.916948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d6e247c6-2c61-4a6f-9cad-3725fe28eceb req-d435672f-d56f-4412-85bc-4d249892d640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2", "tag": "4786efcb-bf77-4622-9cea-64620dc6221b"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:56.936844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e67e77fa-61fa-4f04-859c-9fa1ca1be2f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:56.940032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d6e247c6-2c61-4a6f-9cad-3725fe28eceb req-d435672f-d56f-4412-85bc-4d249892d640 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:56.941357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d6e247c6-2c61-4a6f-9cad-3725fe28eceb req-d435672f-d56f-4412-85bc-4d249892d640 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:56.946410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d6e247c6-2c61-4a6f-9cad-3725fe28eceb req-d435672f-d56f-4412-85bc-4d249892d640 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:56.949433 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e67e77fa-61fa-4f04-859c-9fa1ca1be2f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/35efe352-3b67-40fc-99c5-22fbf221bdfa" status: 200 len: 1467 microversion: 2.1 time: 0.420192 Oct 12 22:09:56.950554 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1468/2668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:56 2022] GET /compute/v2.1/servers/35efe352-3b67-40fc-99c5-22fbf221bdfa => generated 1467 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:56.956575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1be6191c-2773-402e-a086-41026bab1496 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:56.957480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1be6191c-2773-402e-a086-41026bab1496 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:56.967555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1be6191c-2773-402e-a086-41026bab1496 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:56.968377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1be6191c-2773-402e-a086-41026bab1496 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:56.969029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1be6191c-2773-402e-a086-41026bab1496 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:56.970447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1be6191c-2773-402e-a086-41026bab1496 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:56.971091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1be6191c-2773-402e-a086-41026bab1496 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:56.971723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1be6191c-2773-402e-a086-41026bab1496 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:56.989770 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d6e247c6-2c61-4a6f-9cad-3725fe28eceb req-d435672f-d56f-4412-85bc-4d249892d640 service nova] Creating event network-changed:4786efcb-bf77-4622-9cea-64620dc6221b for instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 on n-h2-861111-1 Oct 12 22:09:56.996830 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d6e247c6-2c61-4a6f-9cad-3725fe28eceb req-d435672f-d56f-4412-85bc-4d249892d640 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083515 Oct 12 22:09:56.997992 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1201/2669] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:57.004195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-647a2554-e5f8-45af-836b-d07abf52bb74 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Action: 'create', calling method: .version_select at 0x7f5123693d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-220381227", "description": "tempest-description-1320964218"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:57.275524 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-647a2554-e5f8-45af-836b-d07abf52bb74 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.276066 Oct 12 22:09:57.276135 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1202/2670] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:09:56 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:57.290266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b141c90d-8fd8-450d-84bd-e93c75cd88fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:57.295999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b141c90d-8fd8-450d-84bd-e93c75cd88fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:57.296882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b141c90d-8fd8-450d-84bd-e93c75cd88fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Searching by: {'reservation_id': 'r-g72c8luq', 'deleted': False, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:09:57.302310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b141c90d-8fd8-450d-84bd-e93c75cd88fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:57.302798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b141c90d-8fd8-450d-84bd-e93c75cd88fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:57.303264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b141c90d-8fd8-450d-84bd-e93c75cd88fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:57.303988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b141c90d-8fd8-450d-84bd-e93c75cd88fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:57.304458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b141c90d-8fd8-450d-84bd-e93c75cd88fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:57.305459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b141c90d-8fd8-450d-84bd-e93c75cd88fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:57.415169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1be6191c-2773-402e-a086-41026bab1496 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:57.435272 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1be6191c-2773-402e-a086-41026bab1496 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 200 len: 1366 microversion: 2.1 time: 0.483315 Oct 12 22:09:57.436029 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1469/2671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:56 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 1366 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:57.440950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-25755643-5464-4af8-8dfb-839ecc807eb3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:57.445063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-25755643-5464-4af8-8dfb-839ecc807eb3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:57.462350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25755643-5464-4af8-8dfb-839ecc807eb3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:57.463071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25755643-5464-4af8-8dfb-839ecc807eb3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:57.465229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25755643-5464-4af8-8dfb-839ecc807eb3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:57.468084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25755643-5464-4af8-8dfb-839ecc807eb3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:57.469031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25755643-5464-4af8-8dfb-839ecc807eb3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:57.470576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25755643-5464-4af8-8dfb-839ecc807eb3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:57.516274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.multi_cell_list [None req-b141c90d-8fd8-450d-84bd-e93c75cd88fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:09:57.588821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:09:57.638256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b141c90d-8fd8-450d-84bd-e93c75cd88fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:57.646589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b141c90d-8fd8-450d-84bd-e93c75cd88fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:57.647397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b141c90d-8fd8-450d-84bd-e93c75cd88fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:57.648046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b141c90d-8fd8-450d-84bd-e93c75cd88fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:57.700012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-25755643-5464-4af8-8dfb-839ecc807eb3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:57.714197 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-25755643-5464-4af8-8dfb-839ecc807eb3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68" status: 200 len: 1313 microversion: 2.1 time: 0.277012 Oct 12 22:09:57.714788 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1470/2672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:57 2022] GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:57.720521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fd487a43-af2b-4ae4-8b23-d93a92caa330 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Action: 'create', calling method: .version_select at 0x7f51233ee670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-333677791", "description": "tempest-description-267728949"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:58.004817 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fd487a43-af2b-4ae4-8b23-d93a92caa330 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.288588 Oct 12 22:09:58.006280 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1471/2673] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:09:57 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:58.012781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0cdc0581-0f3a-4e6f-a126-69f5b3eae4ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:58.013570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0cdc0581-0f3a-4e6f-a126-69f5b3eae4ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:58.023494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cdc0581-0f3a-4e6f-a126-69f5b3eae4ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:58.024055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cdc0581-0f3a-4e6f-a126-69f5b3eae4ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:58.024505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cdc0581-0f3a-4e6f-a126-69f5b3eae4ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:58.026050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cdc0581-0f3a-4e6f-a126-69f5b3eae4ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:58.026530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cdc0581-0f3a-4e6f-a126-69f5b3eae4ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:58.027282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cdc0581-0f3a-4e6f-a126-69f5b3eae4ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:58.133708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0cdc0581-0f3a-4e6f-a126-69f5b3eae4ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:58.144726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0cdc0581-0f3a-4e6f-a126-69f5b3eae4ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:58.146279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0cdc0581-0f3a-4e6f-a126-69f5b3eae4ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:58.152811 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0cdc0581-0f3a-4e6f-a126-69f5b3eae4ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.144583 Oct 12 22:09:58.171959 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1472/2674] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:58 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:58.198137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1230347517", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "bf70099b-bae2-4631-8d40-6f8ec2b3ee84"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:09:58.300095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] validate_networks() for [('bf70099b-bae2-4631-8d40-6f8ec2b3ee84', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:09:58.351128 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b141c90d-8fd8-450d-84bd-e93c75cd88fe tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-g72c8luq" status: 200 len: 2928 microversion: 2.1 time: 1.065299 Oct 12 22:09:58.351759 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1203/2675] 10.222.0.16 () {58 vars in 1197 bytes} [Wed Oct 12 22:09:57 2022] GET /compute/v2.1/servers/detail?reservation_id=r-g72c8luq => generated 2928 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:58.380441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c99e55c1-3f19-442c-9833-a7650e0aab49 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:58.409220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.compute.server_groups [None req-c99e55c1-3f19-442c-9833-a7650e0aab49 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Querying cell 2bc00301-6462-4874-9c83-c889d0ff6a49(cell1) for 2 instances {{(pid=120452) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 12 22:09:58.410186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c99e55c1-3f19-442c-9833-a7650e0aab49 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:58.410804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c99e55c1-3f19-442c-9833-a7650e0aab49 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:58.411447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c99e55c1-3f19-442c-9833-a7650e0aab49 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:58.445764 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c99e55c1-3f19-442c-9833-a7650e0aab49 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/6fd53820-5929-4211-b79d-05c382d7a9d7" status: 200 len: 266 microversion: 2.1 time: 0.070569 Oct 12 22:09:58.447006 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1204/2676] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:09:58 2022] GET /compute/v2.1/os-server-groups/6fd53820-5929-4211-b79d-05c382d7a9d7 => generated 266 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:09:58.458942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-16f7cb17-5199-4f46-9558-c134925d2c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:58.459915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-16f7cb17-5199-4f46-9558-c134925d2c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:58.473099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16f7cb17-5199-4f46-9558-c134925d2c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:58.477115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16f7cb17-5199-4f46-9558-c134925d2c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:58.477731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16f7cb17-5199-4f46-9558-c134925d2c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:58.479163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16f7cb17-5199-4f46-9558-c134925d2c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:58.480789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16f7cb17-5199-4f46-9558-c134925d2c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:58.481388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16f7cb17-5199-4f46-9558-c134925d2c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:58.820290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:09:58.820962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:09:58.821585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:09:58.822172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:09:58.822753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:09:58.834063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:58.834721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:58.835351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:58.836414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:58.837013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:58.838128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:58.858981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Getting quotas for project 214f86d71a5749b9b98dffe934fe7f1f. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:09:58.864919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Getting quotas for user 81e045d919104fa89572a2d05993abb8 and project 214f86d71a5749b9b98dffe934fe7f1f. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:09:58.868213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-16f7cb17-5199-4f46-9558-c134925d2c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:58.882329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:09:58.883912 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-16f7cb17-5199-4f46-9558-c134925d2c36 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 200 len: 1366 microversion: 2.1 time: 0.429068 Oct 12 22:09:58.884866 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1205/2677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:58 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 1366 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:58.885068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:09:58.889203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-716fcaed-0ae4-4e70-8a51-b32925eb7926 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:58.889811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-716fcaed-0ae4-4e70-8a51-b32925eb7926 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:58.904792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716fcaed-0ae4-4e70-8a51-b32925eb7926 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:58.908230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716fcaed-0ae4-4e70-8a51-b32925eb7926 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:58.908772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716fcaed-0ae4-4e70-8a51-b32925eb7926 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:58.909593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716fcaed-0ae4-4e70-8a51-b32925eb7926 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:58.912539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716fcaed-0ae4-4e70-8a51-b32925eb7926 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:58.913143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716fcaed-0ae4-4e70-8a51-b32925eb7926 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:58.960267 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3ca997ba-ae09-4f7b-9997-fea04bcc6960 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767601 Oct 12 22:09:58.964211 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1473/2678] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:09:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:09:58.972476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a942f42b-97f3-4062-b560-a3d8dccbace9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:58.974295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a942f42b-97f3-4062-b560-a3d8dccbace9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:58.984057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a942f42b-97f3-4062-b560-a3d8dccbace9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:58.984552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a942f42b-97f3-4062-b560-a3d8dccbace9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:58.984987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a942f42b-97f3-4062-b560-a3d8dccbace9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:58.986186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a942f42b-97f3-4062-b560-a3d8dccbace9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:58.986661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a942f42b-97f3-4062-b560-a3d8dccbace9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:58.987089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a942f42b-97f3-4062-b560-a3d8dccbace9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:59.150931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a942f42b-97f3-4062-b560-a3d8dccbace9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:59.161149 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a942f42b-97f3-4062-b560-a3d8dccbace9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68" status: 200 len: 1313 microversion: 2.1 time: 0.195635 Oct 12 22:09:59.161876 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1474/2679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:58 2022] GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:59.166984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-81e5eb9e-bdbc-4e18-8604-9bab6557849b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:59.167813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-81e5eb9e-bdbc-4e18-8604-9bab6557849b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:59.233241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-81e5eb9e-bdbc-4e18-8604-9bab6557849b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:59.242104 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-81e5eb9e-bdbc-4e18-8604-9bab6557849b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1216 microversion: 2.1 time: 0.079107 Oct 12 22:09:59.244562 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1475/2680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:59 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1216 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:59.249898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-01b80f6a-3f0c-4e6d-a326-5f3e5fb8c962 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:59.250723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-01b80f6a-3f0c-4e6d-a326-5f3e5fb8c962 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:59.256845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01b80f6a-3f0c-4e6d-a326-5f3e5fb8c962 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:59.257542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01b80f6a-3f0c-4e6d-a326-5f3e5fb8c962 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:59.258193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01b80f6a-3f0c-4e6d-a326-5f3e5fb8c962 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:59.259074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01b80f6a-3f0c-4e6d-a326-5f3e5fb8c962 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:59.260148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01b80f6a-3f0c-4e6d-a326-5f3e5fb8c962 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:59.260760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01b80f6a-3f0c-4e6d-a326-5f3e5fb8c962 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:59.346133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-01b80f6a-3f0c-4e6d-a326-5f3e5fb8c962 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:59.357629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-01b80f6a-3f0c-4e6d-a326-5f3e5fb8c962 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:59.361322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-01b80f6a-3f0c-4e6d-a326-5f3e5fb8c962 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:09:59.371303 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-01b80f6a-3f0c-4e6d-a326-5f3e5fb8c962 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.124920 Oct 12 22:09:59.375385 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1476/2681] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:09:59 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:09:59.588929 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-716fcaed-0ae4-4e70-8a51-b32925eb7926 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 200 len: 1619 microversion: 2.1 time: 0.701102 Oct 12 22:09:59.591267 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1206/2682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:58 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 1619 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:09:59.618319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0f037be1-0055-4691-887a-b29df0e3e093 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:59.618981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0f037be1-0055-4691-887a-b29df0e3e093 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] [instance: 35efe352-3b67-40fc-99c5-22fbf221bdfa] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:59.636187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f037be1-0055-4691-887a-b29df0e3e093 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:59.637930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f037be1-0055-4691-887a-b29df0e3e093 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:59.638592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f037be1-0055-4691-887a-b29df0e3e093 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:59.641184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f037be1-0055-4691-887a-b29df0e3e093 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:59.642098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f037be1-0055-4691-887a-b29df0e3e093 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:59.644377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f037be1-0055-4691-887a-b29df0e3e093 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:59.912249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4c0eedda-b331-46e0-8b48-3246e18ee749 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:09:59.912875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4c0eedda-b331-46e0-8b48-3246e18ee749 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:09:59.925910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c0eedda-b331-46e0-8b48-3246e18ee749 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:59.926690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c0eedda-b331-46e0-8b48-3246e18ee749 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:59.927309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c0eedda-b331-46e0-8b48-3246e18ee749 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:09:59.930063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c0eedda-b331-46e0-8b48-3246e18ee749 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:09:59.930704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c0eedda-b331-46e0-8b48-3246e18ee749 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:09:59.932343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c0eedda-b331-46e0-8b48-3246e18ee749 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:00.026879 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0f037be1-0055-4691-887a-b29df0e3e093 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/35efe352-3b67-40fc-99c5-22fbf221bdfa" status: 200 len: 1618 microversion: 2.1 time: 0.412650 Oct 12 22:10:00.027888 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1477/2683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:59 2022] GET /compute/v2.1/servers/35efe352-3b67-40fc-99c5-22fbf221bdfa => generated 1618 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:00.060052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e5ec2b6-1bb3-4101-83b6-953cea7d8b5c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Action: 'create', calling method: .version_select at 0x7f5123469280>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1592806507", "policies": ["anti-affinity"]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:00.088746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-9e5ec2b6-1bb3-4101-83b6-953cea7d8b5c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:10:00.096669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-9e5ec2b6-1bb3-4101-83b6-953cea7d8b5c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:10:00.155860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:00.193497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-9e5ec2b6-1bb3-4101-83b6-953cea7d8b5c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:10:00.203746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-9e5ec2b6-1bb3-4101-83b6-953cea7d8b5c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:10:00.238613 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9e5ec2b6-1bb3-4101-83b6-953cea7d8b5c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.183289 Oct 12 22:10:00.240314 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1478/2684] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Oct 12 22:10:00 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:00.246381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8eb5b897-84d1-4f65-8b11-dd3e95c6c8f2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:00.247187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8eb5b897-84d1-4f65-8b11-dd3e95c6c8f2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:00.278369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8eb5b897-84d1-4f65-8b11-dd3e95c6c8f2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:00.279087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8eb5b897-84d1-4f65-8b11-dd3e95c6c8f2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:00.279578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8eb5b897-84d1-4f65-8b11-dd3e95c6c8f2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:00.280327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8eb5b897-84d1-4f65-8b11-dd3e95c6c8f2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:00.282310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8eb5b897-84d1-4f65-8b11-dd3e95c6c8f2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:00.284469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8eb5b897-84d1-4f65-8b11-dd3e95c6c8f2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:00.577197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8eb5b897-84d1-4f65-8b11-dd3e95c6c8f2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:00.588606 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8eb5b897-84d1-4f65-8b11-dd3e95c6c8f2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68" status: 200 len: 1313 microversion: 2.1 time: 0.346945 Oct 12 22:10:00.589702 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1479/2685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:00 2022] GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:00.595192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2a9dfa17-e855-4dbf-ba6b-883af346766e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:00.596136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2a9dfa17-e855-4dbf-ba6b-883af346766e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:00.602738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a9dfa17-e855-4dbf-ba6b-883af346766e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:00.604375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a9dfa17-e855-4dbf-ba6b-883af346766e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:00.609327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a9dfa17-e855-4dbf-ba6b-883af346766e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:00.610257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a9dfa17-e855-4dbf-ba6b-883af346766e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:00.611136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a9dfa17-e855-4dbf-ba6b-883af346766e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:00.612651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a9dfa17-e855-4dbf-ba6b-883af346766e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:00.702832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2a9dfa17-e855-4dbf-ba6b-883af346766e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:00.712129 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2a9dfa17-e855-4dbf-ba6b-883af346766e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1268 microversion: 2.1 time: 0.120123 Oct 12 22:10:00.712856 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1480/2686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:00 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1268 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:00.732442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b25d590-cce2-41b4-94c3-6531d4eb9896 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:00.733021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8b25d590-cce2-41b4-94c3-6531d4eb9896 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:00.742912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b25d590-cce2-41b4-94c3-6531d4eb9896 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:00.745535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b25d590-cce2-41b4-94c3-6531d4eb9896 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:00.757657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b25d590-cce2-41b4-94c3-6531d4eb9896 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:00.762915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b25d590-cce2-41b4-94c3-6531d4eb9896 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:00.763434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b25d590-cce2-41b4-94c3-6531d4eb9896 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:00.764069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b25d590-cce2-41b4-94c3-6531d4eb9896 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:00.775828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4c0eedda-b331-46e0-8b48-3246e18ee749 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:00.789990 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4c0eedda-b331-46e0-8b48-3246e18ee749 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 200 len: 1366 microversion: 2.1 time: 0.882632 Oct 12 22:10:00.796692 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1207/2687] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:09:59 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 1366 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:00.820212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-9d90c575-637c-4fae-9d74-85fed7cb2672 req-6b69fa9a-1e7c-4778-a81b-56ffbaa043f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f2bfa7-4830-4faa-844f-69e08c861f68", "name": "network-vif-plugged", "status": "completed", "tag": "428a0b3d-bd48-4717-b715-5639453998f6"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:00.854991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9d90c575-637c-4fae-9d74-85fed7cb2672 req-6b69fa9a-1e7c-4778-a81b-56ffbaa043f2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:00.859385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9d90c575-637c-4fae-9d74-85fed7cb2672 req-6b69fa9a-1e7c-4778-a81b-56ffbaa043f2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:00.862615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9d90c575-637c-4fae-9d74-85fed7cb2672 req-6b69fa9a-1e7c-4778-a81b-56ffbaa043f2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:00.893285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b25d590-cce2-41b4-94c3-6531d4eb9896 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:00.901978 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-9d90c575-637c-4fae-9d74-85fed7cb2672 req-6b69fa9a-1e7c-4778-a81b-56ffbaa043f2 service nova] Creating event network-vif-plugged:428a0b3d-bd48-4717-b715-5639453998f6 for instance 11f2bfa7-4830-4faa-844f-69e08c861f68 on n-h1-861111-1 Oct 12 22:10:00.908064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b25d590-cce2-41b4-94c3-6531d4eb9896 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:00.920539 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-9d90c575-637c-4fae-9d74-85fed7cb2672 req-6b69fa9a-1e7c-4778-a81b-56ffbaa043f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118067 Oct 12 22:10:00.922726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b25d590-cce2-41b4-94c3-6531d4eb9896 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:00.923782 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1208/2688] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:00.934440 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8b25d590-cce2-41b4-94c3-6531d4eb9896 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.219663 Oct 12 22:10:00.937076 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1481/2689] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:00 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:00.937285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-316242998", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0062e0e1-f049-4b7b-8395-e166a0421e0b"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:01.029546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:10:01.617486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6a60b342-8dfe-4b50-83f8-d2abd0d73d61 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:01.618123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6a60b342-8dfe-4b50-83f8-d2abd0d73d61 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:01.627093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a60b342-8dfe-4b50-83f8-d2abd0d73d61 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:01.628632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a60b342-8dfe-4b50-83f8-d2abd0d73d61 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:01.629080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a60b342-8dfe-4b50-83f8-d2abd0d73d61 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:01.629802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a60b342-8dfe-4b50-83f8-d2abd0d73d61 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:01.630414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a60b342-8dfe-4b50-83f8-d2abd0d73d61 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:01.632246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a60b342-8dfe-4b50-83f8-d2abd0d73d61 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:01.844763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6a60b342-8dfe-4b50-83f8-d2abd0d73d61 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:01.860529 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6a60b342-8dfe-4b50-83f8-d2abd0d73d61 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68" status: 200 len: 1313 microversion: 2.1 time: 0.248745 Oct 12 22:10:01.862228 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1482/2690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:01 2022] GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:01.874937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-49b83617-e3be-468d-8b28-5c65f2481fe1 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:01.877080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-49b83617-e3be-468d-8b28-5c65f2481fe1 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:01.891376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49b83617-e3be-468d-8b28-5c65f2481fe1 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:01.892186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49b83617-e3be-468d-8b28-5c65f2481fe1 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:01.892789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49b83617-e3be-468d-8b28-5c65f2481fe1 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:01.895082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49b83617-e3be-468d-8b28-5c65f2481fe1 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:01.896787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49b83617-e3be-468d-8b28-5c65f2481fe1 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:01.898285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49b83617-e3be-468d-8b28-5c65f2481fe1 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:01.995900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:10:01.996421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:10:01.996844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:10:01.997755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:10:01.998340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:10:02.018453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:02.019143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:02.019663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:02.020661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:02.021325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:02.021961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:02.049638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-49b83617-e3be-468d-8b28-5c65f2481fe1 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:02.062915 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-49b83617-e3be-468d-8b28-5c65f2481fe1 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1274 microversion: 2.1 time: 0.198934 Oct 12 22:10:02.064646 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1483/2691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:01 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1274 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:02.077639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-39dc09c1-dec3-4de1-a488-61267d008071 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:02.078685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-39dc09c1-dec3-4de1-a488-61267d008071 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:02.079058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:10:02.090045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39dc09c1-dec3-4de1-a488-61267d008071 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:02.090807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39dc09c1-dec3-4de1-a488-61267d008071 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:02.091509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39dc09c1-dec3-4de1-a488-61267d008071 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:02.092776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39dc09c1-dec3-4de1-a488-61267d008071 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:02.093559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39dc09c1-dec3-4de1-a488-61267d008071 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:02.094203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39dc09c1-dec3-4de1-a488-61267d008071 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:02.094773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:10:02.116821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Going to run 2 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:10:02.119454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: b862f7de-fe9b-49bc-9e77-0d3e453558e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:10:02.128629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:02.171211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:02.174974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120452) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 12 22:10:02.209685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_group_members'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:10:02.220746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_group_members'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:10:02.280207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_group_members'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:10:02.287141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_group_members'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:10:02.306599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=b862f7de-fe9b-49bc-9e77-0d3e453558e8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:10:02.346380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-39dc09c1-dec3-4de1-a488-61267d008071 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:02.359888 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-39dc09c1-dec3-4de1-a488-61267d008071 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 200 len: 1366 microversion: 2.1 time: 0.293905 Oct 12 22:10:02.372596 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1484/2692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:02 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:02.385375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-753a4c12-9567-465f-9e26-6d2bfa616401 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:02.387930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-753a4c12-9567-465f-9e26-6d2bfa616401 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:02.393361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-753a4c12-9567-465f-9e26-6d2bfa616401 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:02.394014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-753a4c12-9567-465f-9e26-6d2bfa616401 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:02.394444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-753a4c12-9567-465f-9e26-6d2bfa616401 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:02.394797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_group_members'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:10:02.395328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-753a4c12-9567-465f-9e26-6d2bfa616401 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:02.395900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-753a4c12-9567-465f-9e26-6d2bfa616401 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:02.397118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-753a4c12-9567-465f-9e26-6d2bfa616401 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:02.408164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_group_members'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:10:02.470635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_group_members'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:10:02.484558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'server_group_members'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:10:02.532664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-753a4c12-9567-465f-9e26-6d2bfa616401 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:02.546679 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-332b4003-8747-4c6d-a3b9-58f0e6e0c406 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.618290 Oct 12 22:10:02.548188 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1209/2693] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:10:00 2022] POST /compute/v2.1/servers => generated 32 bytes in 1624 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:10:02.555746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-753a4c12-9567-465f-9e26-6d2bfa616401 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:02.562658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-753a4c12-9567-465f-9e26-6d2bfa616401 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:02.570783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b824e814-231d-4e66-bb9e-ffb91dd9884e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:02.576732 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-753a4c12-9567-465f-9e26-6d2bfa616401 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.197467 Oct 12 22:10:02.584883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b824e814-231d-4e66-bb9e-ffb91dd9884e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:02.586012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b824e814-231d-4e66-bb9e-ffb91dd9884e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Searching by: {'deleted': False, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:10:02.592920 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1485/2694] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:02 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:02.606202 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b824e814-231d-4e66-bb9e-ffb91dd9884e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:02.606897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b824e814-231d-4e66-bb9e-ffb91dd9884e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:02.607570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b824e814-231d-4e66-bb9e-ffb91dd9884e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:02.608482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b824e814-231d-4e66-bb9e-ffb91dd9884e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:02.609170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b824e814-231d-4e66-bb9e-ffb91dd9884e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:02.609758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b824e814-231d-4e66-bb9e-ffb91dd9884e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:02.650799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.multi_cell_list [None req-b824e814-231d-4e66-bb9e-ffb91dd9884e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:10:02.698183 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b824e814-231d-4e66-bb9e-ffb91dd9884e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.143647 Oct 12 22:10:02.714678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1352c1cc-c7f7-4881-a817-8419aae2d790 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:02.716414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1352c1cc-c7f7-4881-a817-8419aae2d790 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:02.721943 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1210/2695] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 12 22:10:02 2022] GET /compute/v2.1/servers => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:02.886416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ee6911e0-616e-4968-950b-104ae6c84b1d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:02.887249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ee6911e0-616e-4968-950b-104ae6c84b1d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:02.896828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee6911e0-616e-4968-950b-104ae6c84b1d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:02.897422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee6911e0-616e-4968-950b-104ae6c84b1d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:02.903476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee6911e0-616e-4968-950b-104ae6c84b1d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:02.904291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee6911e0-616e-4968-950b-104ae6c84b1d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:02.904774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee6911e0-616e-4968-950b-104ae6c84b1d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:02.905219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee6911e0-616e-4968-950b-104ae6c84b1d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:03.022417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1352c1cc-c7f7-4881-a817-8419aae2d790 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:03.039350 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1352c1cc-c7f7-4881-a817-8419aae2d790 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1218 microversion: 2.1 time: 0.330578 Oct 12 22:10:03.051900 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1486/2696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:02 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1218 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:03.261776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-353f2df7-ec78-434f-b4a9-0a5156611ef4 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Action: 'create', calling method: .version_select at 0x7f5123469ca0>, body: {"keypair": {"name": "tempest-keypair-1163312936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmho5uuma/bTJLCWWm48JOvPs4PBsFEv97Jrhy89em9DaNDU2dQYxiAI7r1yuIURrS9dbXUvJntDGw7kXVd7KM5Q9f4ywmpOel2LfrVrmW6RTXMnFNvmT8BapL8GLB+5g=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:03.281878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-353f2df7-ec78-434f-b4a9-0a5156611ef4 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Getting quotas for project 7e47ba5c93ba476c8114f5ed002eb2cb. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:10:03.289342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-353f2df7-ec78-434f-b4a9-0a5156611ef4 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Getting quotas for user fac8025b0fc84f118ecf10cf6bc25cd0 and project 7e47ba5c93ba476c8114f5ed002eb2cb. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:10:03.331040 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-353f2df7-ec78-434f-b4a9-0a5156611ef4 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.258980 Oct 12 22:10:03.338981 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1487/2697] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:10:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:10:03.345141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-88ed5e73-287e-4276-a8d8-51b31a78c47d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:03.345946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-88ed5e73-287e-4276-a8d8-51b31a78c47d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:03.353456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88ed5e73-287e-4276-a8d8-51b31a78c47d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:03.354304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88ed5e73-287e-4276-a8d8-51b31a78c47d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:03.354909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88ed5e73-287e-4276-a8d8-51b31a78c47d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:03.356121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88ed5e73-287e-4276-a8d8-51b31a78c47d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:03.356733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88ed5e73-287e-4276-a8d8-51b31a78c47d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:03.357508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88ed5e73-287e-4276-a8d8-51b31a78c47d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:03.446511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ee6911e0-616e-4968-950b-104ae6c84b1d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:03.458828 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ee6911e0-616e-4968-950b-104ae6c84b1d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68" status: 200 len: 1313 microversion: 2.1 time: 0.576498 Oct 12 22:10:03.460365 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1211/2698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:02 2022] GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 => generated 1313 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:03.468747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-17c3a601-620b-4fc5-9826-1c487ee5bb14 req-ba5deb3c-bb53-46ba-8d76-b6154d1bca6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2", "name": "network-vif-plugged", "status": "completed", "tag": "4786efcb-bf77-4622-9cea-64620dc6221b"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:03.493354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-17c3a601-620b-4fc5-9826-1c487ee5bb14 req-ba5deb3c-bb53-46ba-8d76-b6154d1bca6a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:03.494626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-17c3a601-620b-4fc5-9826-1c487ee5bb14 req-ba5deb3c-bb53-46ba-8d76-b6154d1bca6a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:03.495174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-17c3a601-620b-4fc5-9826-1c487ee5bb14 req-ba5deb3c-bb53-46ba-8d76-b6154d1bca6a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:03.527956 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-17c3a601-620b-4fc5-9826-1c487ee5bb14 req-ba5deb3c-bb53-46ba-8d76-b6154d1bca6a service nova] Creating event network-vif-plugged:4786efcb-bf77-4622-9cea-64620dc6221b for instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 on n-h2-861111-1 Oct 12 22:10:03.545356 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-17c3a601-620b-4fc5-9826-1c487ee5bb14 req-ba5deb3c-bb53-46ba-8d76-b6154d1bca6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083181 Oct 12 22:10:03.546122 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1212/2699] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:03.553469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-07213f26-579c-462d-bdae-aa3c9997a275 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:03.554197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-07213f26-579c-462d-bdae-aa3c9997a275 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:03.566745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07213f26-579c-462d-bdae-aa3c9997a275 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:03.571825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07213f26-579c-462d-bdae-aa3c9997a275 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:03.575114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07213f26-579c-462d-bdae-aa3c9997a275 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:03.576129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07213f26-579c-462d-bdae-aa3c9997a275 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:03.578074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07213f26-579c-462d-bdae-aa3c9997a275 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:03.579879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07213f26-579c-462d-bdae-aa3c9997a275 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:03.659716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-88ed5e73-287e-4276-a8d8-51b31a78c47d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:03.674230 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-88ed5e73-287e-4276-a8d8-51b31a78c47d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1316 microversion: 2.1 time: 0.331314 Oct 12 22:10:03.676444 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1488/2700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:03 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:03.686628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fdd633c4-bf55-41b8-9bb7-06394e4401d3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:03.689463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fdd633c4-bf55-41b8-9bb7-06394e4401d3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:03.706866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdd633c4-bf55-41b8-9bb7-06394e4401d3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:03.710739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdd633c4-bf55-41b8-9bb7-06394e4401d3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:03.712716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdd633c4-bf55-41b8-9bb7-06394e4401d3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:03.714561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdd633c4-bf55-41b8-9bb7-06394e4401d3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:03.715053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdd633c4-bf55-41b8-9bb7-06394e4401d3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:03.715680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdd633c4-bf55-41b8-9bb7-06394e4401d3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:03.876475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fdd633c4-bf55-41b8-9bb7-06394e4401d3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:03.893362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fdd633c4-bf55-41b8-9bb7-06394e4401d3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:03.896357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fdd633c4-bf55-41b8-9bb7-06394e4401d3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:03.904042 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fdd633c4-bf55-41b8-9bb7-06394e4401d3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.224221 Oct 12 22:10:03.947993 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1489/2701] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:03 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:04.037248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-07213f26-579c-462d-bdae-aa3c9997a275 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:04.041935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:04.054453 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-07213f26-579c-462d-bdae-aa3c9997a275 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 200 len: 1366 microversion: 2.1 time: 0.507145 Oct 12 22:10:04.063771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2780f629-0e38-4646-87dc-c8c5e6597847 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:04.064664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2780f629-0e38-4646-87dc-c8c5e6597847 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:04.067706 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1213/2702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:03 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 1366 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:04.085632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2780f629-0e38-4646-87dc-c8c5e6597847 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:04.086815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2780f629-0e38-4646-87dc-c8c5e6597847 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:04.087976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2780f629-0e38-4646-87dc-c8c5e6597847 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:04.089349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2780f629-0e38-4646-87dc-c8c5e6597847 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:04.089981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2780f629-0e38-4646-87dc-c8c5e6597847 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:04.090749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2780f629-0e38-4646-87dc-c8c5e6597847 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:04.220472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2780f629-0e38-4646-87dc-c8c5e6597847 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:04.230411 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2780f629-0e38-4646-87dc-c8c5e6597847 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1222 microversion: 2.1 time: 0.171543 Oct 12 22:10:04.235612 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1490/2703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:04 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1222 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:04.487803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d833eae-4bd3-4252-8da1-ccefb41a4526 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:04.489555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9d833eae-4bd3-4252-8da1-ccefb41a4526 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:04.500860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d833eae-4bd3-4252-8da1-ccefb41a4526 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:04.501827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d833eae-4bd3-4252-8da1-ccefb41a4526 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:04.502653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d833eae-4bd3-4252-8da1-ccefb41a4526 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:04.503606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d833eae-4bd3-4252-8da1-ccefb41a4526 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:04.504749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d833eae-4bd3-4252-8da1-ccefb41a4526 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:04.505587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d833eae-4bd3-4252-8da1-ccefb41a4526 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:04.703504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0b68aca8-c9a3-4457-beba-dafb95e51473 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:04.704320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0b68aca8-c9a3-4457-beba-dafb95e51473 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:04.710726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b68aca8-c9a3-4457-beba-dafb95e51473 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:04.711381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b68aca8-c9a3-4457-beba-dafb95e51473 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:04.712006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b68aca8-c9a3-4457-beba-dafb95e51473 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:04.714182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b68aca8-c9a3-4457-beba-dafb95e51473 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:04.714182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b68aca8-c9a3-4457-beba-dafb95e51473 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:04.714182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b68aca8-c9a3-4457-beba-dafb95e51473 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:04.986138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9d833eae-4bd3-4252-8da1-ccefb41a4526 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:05.001307 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9d833eae-4bd3-4252-8da1-ccefb41a4526 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68" status: 200 len: 1463 microversion: 2.1 time: 0.519415 Oct 12 22:10:05.003211 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1214/2704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:04 2022] GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 => generated 1463 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:05.008823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-da898b1c-6a91-4ce3-b092-d1895ee53711 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:05.009707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-da898b1c-6a91-4ce3-b092-d1895ee53711 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:05.016663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0b68aca8-c9a3-4457-beba-dafb95e51473 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:05.017512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da898b1c-6a91-4ce3-b092-d1895ee53711 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:05.018154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da898b1c-6a91-4ce3-b092-d1895ee53711 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:05.018740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da898b1c-6a91-4ce3-b092-d1895ee53711 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:05.019624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da898b1c-6a91-4ce3-b092-d1895ee53711 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:05.020322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da898b1c-6a91-4ce3-b092-d1895ee53711 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:05.020882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da898b1c-6a91-4ce3-b092-d1895ee53711 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:05.030958 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0b68aca8-c9a3-4457-beba-dafb95e51473 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1316 microversion: 2.1 time: 0.332031 Oct 12 22:10:05.052025 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1491/2705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:04 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:05.166115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-da898b1c-6a91-4ce3-b092-d1895ee53711 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:05.179460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-da898b1c-6a91-4ce3-b092-d1895ee53711 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:05.180982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-da898b1c-6a91-4ce3-b092-d1895ee53711 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:05.195037 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-da898b1c-6a91-4ce3-b092-d1895ee53711 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.189686 Oct 12 22:10:05.200011 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1215/2706] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:05 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:05.206193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9ed06442-81e0-4208-9a31-99126031060f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:05.206800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9ed06442-81e0-4208-9a31-99126031060f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:05.235334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ed06442-81e0-4208-9a31-99126031060f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:05.241271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ed06442-81e0-4208-9a31-99126031060f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:05.241876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ed06442-81e0-4208-9a31-99126031060f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:05.242643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ed06442-81e0-4208-9a31-99126031060f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:05.243114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ed06442-81e0-4208-9a31-99126031060f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:05.243662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ed06442-81e0-4208-9a31-99126031060f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:05.341937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-17dea64b-534e-4363-8ce0-2783076e66fb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:05.350977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-17dea64b-534e-4363-8ce0-2783076e66fb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Searching by: {'deleted': False, 'project_id': 'acb0a5bd02e5427ba2038e4c7da67f07'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:10:05.365873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17dea64b-534e-4363-8ce0-2783076e66fb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:05.370887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17dea64b-534e-4363-8ce0-2783076e66fb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:05.371648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17dea64b-534e-4363-8ce0-2783076e66fb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:05.375938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17dea64b-534e-4363-8ce0-2783076e66fb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:05.376538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17dea64b-534e-4363-8ce0-2783076e66fb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:05.377004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17dea64b-534e-4363-8ce0-2783076e66fb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:05.430330 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-17dea64b-534e-4363-8ce0-2783076e66fb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.376781 Oct 12 22:10:05.431728 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1492/2707] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:10:05 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:10:05.437333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7a45e27a-4e17-4148-b506-a8a991f150ac tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:05.438227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7a45e27a-4e17-4148-b506-a8a991f150ac tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:05.445104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a45e27a-4e17-4148-b506-a8a991f150ac tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:05.445831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a45e27a-4e17-4148-b506-a8a991f150ac tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:05.446455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a45e27a-4e17-4148-b506-a8a991f150ac tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:05.448463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a45e27a-4e17-4148-b506-a8a991f150ac tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:05.449096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a45e27a-4e17-4148-b506-a8a991f150ac tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:05.449694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a45e27a-4e17-4148-b506-a8a991f150ac tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:05.569530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7a45e27a-4e17-4148-b506-a8a991f150ac tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:05.577793 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7a45e27a-4e17-4148-b506-a8a991f150ac tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1288 microversion: 2.1 time: 0.144746 Oct 12 22:10:05.579089 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1493/2708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:05 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1288 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:05.593643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-69a07f6a-ea6b-4e89-8cf3-355104294387 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:05.611921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-69a07f6a-ea6b-4e89-8cf3-355104294387 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Searching by: {'deleted': False} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:10:05.617027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69a07f6a-ea6b-4e89-8cf3-355104294387 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:05.617868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69a07f6a-ea6b-4e89-8cf3-355104294387 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:05.619052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69a07f6a-ea6b-4e89-8cf3-355104294387 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:05.620269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69a07f6a-ea6b-4e89-8cf3-355104294387 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:05.621066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69a07f6a-ea6b-4e89-8cf3-355104294387 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:05.621853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69a07f6a-ea6b-4e89-8cf3-355104294387 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:05.782595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-69a07f6a-ea6b-4e89-8cf3-355104294387 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:10:05.811698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9ed06442-81e0-4208-9a31-99126031060f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:05.819558 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9ed06442-81e0-4208-9a31-99126031060f tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 200 len: 1366 microversion: 2.1 time: 0.620258 Oct 12 22:10:05.823630 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1216/2709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:05 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 1366 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:05.893153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69a07f6a-ea6b-4e89-8cf3-355104294387 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:05.893870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69a07f6a-ea6b-4e89-8cf3-355104294387 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:05.894463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69a07f6a-ea6b-4e89-8cf3-355104294387 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:06.066972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f83fabd7-b9bf-43c7-af28-d55530eda313 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:06.069554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f83fabd7-b9bf-43c7-af28-d55530eda313 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:06.084788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f83fabd7-b9bf-43c7-af28-d55530eda313 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:06.088811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f83fabd7-b9bf-43c7-af28-d55530eda313 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:06.092495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f83fabd7-b9bf-43c7-af28-d55530eda313 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:06.095168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f83fabd7-b9bf-43c7-af28-d55530eda313 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:06.095927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f83fabd7-b9bf-43c7-af28-d55530eda313 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:06.097305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f83fabd7-b9bf-43c7-af28-d55530eda313 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:06.483914 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-69a07f6a-ea6b-4e89-8cf3-355104294387 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 20480 microversion: 2.1 time: 0.903331 Oct 12 22:10:06.496921 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1494/2710] 10.222.0.16 () {58 vars in 1171 bytes} [Wed Oct 12 22:10:05 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 20480 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:10:06.527534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-1437467b-2e0b-4a76-a2bf-394ad7911076 req-387150c6-3588-4243-9038-c4fb907b0a0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51cce335-3600-4511-8ccd-8b837074bf95", "tag": "738fc407-d734-4f84-b018-92200d206616"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:06.547867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1437467b-2e0b-4a76-a2bf-394ad7911076 req-387150c6-3588-4243-9038-c4fb907b0a0c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:06.549893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1437467b-2e0b-4a76-a2bf-394ad7911076 req-387150c6-3588-4243-9038-c4fb907b0a0c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:06.553124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1437467b-2e0b-4a76-a2bf-394ad7911076 req-387150c6-3588-4243-9038-c4fb907b0a0c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:06.617617 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-1437467b-2e0b-4a76-a2bf-394ad7911076 req-387150c6-3588-4243-9038-c4fb907b0a0c service nova] Creating event network-changed:738fc407-d734-4f84-b018-92200d206616 for instance 51cce335-3600-4511-8ccd-8b837074bf95 on n-h1-861111-1 Oct 12 22:10:06.639163 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-1437467b-2e0b-4a76-a2bf-394ad7911076 req-387150c6-3588-4243-9038-c4fb907b0a0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140377 Oct 12 22:10:06.641391 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1495/2711] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:06.649478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f676cfaf-9adf-483e-97d0-2debe19cb96d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:06.650209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f676cfaf-9adf-483e-97d0-2debe19cb96d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:06.666736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f676cfaf-9adf-483e-97d0-2debe19cb96d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:06.668030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f676cfaf-9adf-483e-97d0-2debe19cb96d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:06.669040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f676cfaf-9adf-483e-97d0-2debe19cb96d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:06.670104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f676cfaf-9adf-483e-97d0-2debe19cb96d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:06.671896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f676cfaf-9adf-483e-97d0-2debe19cb96d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:06.672768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f676cfaf-9adf-483e-97d0-2debe19cb96d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:06.825895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f676cfaf-9adf-483e-97d0-2debe19cb96d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:06.845455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f676cfaf-9adf-483e-97d0-2debe19cb96d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:06.848659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f676cfaf-9adf-483e-97d0-2debe19cb96d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:06.856311 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f676cfaf-9adf-483e-97d0-2debe19cb96d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.213489 Oct 12 22:10:06.858063 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1496/2712] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:06 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:06.862714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5162411a-f88c-4fba-aedd-4b2e52885bcb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:06.869859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5162411a-f88c-4fba-aedd-4b2e52885bcb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Searching by: {'deleted': False, 'project_id': 'acb0a5bd02e5427ba2038e4c7da67f07'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:10:06.875220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5162411a-f88c-4fba-aedd-4b2e52885bcb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:06.875611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5162411a-f88c-4fba-aedd-4b2e52885bcb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:06.876044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5162411a-f88c-4fba-aedd-4b2e52885bcb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:06.876763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5162411a-f88c-4fba-aedd-4b2e52885bcb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:06.877205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5162411a-f88c-4fba-aedd-4b2e52885bcb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:06.877628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5162411a-f88c-4fba-aedd-4b2e52885bcb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:06.937010 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5162411a-f88c-4fba-aedd-4b2e52885bcb tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?tenant_id=2963196dad204be0bfb1d9f27f4a1968" status: 200 len: 15 microversion: 2.1 time: 0.077677 Oct 12 22:10:06.940244 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1497/2713] 10.222.0.16 () {58 vars in 1231 bytes} [Wed Oct 12 22:10:06 2022] GET /compute/v2.1/servers/detail?tenant_id=2963196dad204be0bfb1d9f27f4a1968 => generated 15 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:10:06.953354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7f14b37e-e705-47b7-a6ca-dc3c318f55fc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:06.954058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7f14b37e-e705-47b7-a6ca-dc3c318f55fc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:06.963651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f14b37e-e705-47b7-a6ca-dc3c318f55fc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:06.964437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f14b37e-e705-47b7-a6ca-dc3c318f55fc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:06.965231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f14b37e-e705-47b7-a6ca-dc3c318f55fc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:06.966121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f14b37e-e705-47b7-a6ca-dc3c318f55fc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:06.966991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f14b37e-e705-47b7-a6ca-dc3c318f55fc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:06.967637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f14b37e-e705-47b7-a6ca-dc3c318f55fc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:07.063891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7f14b37e-e705-47b7-a6ca-dc3c318f55fc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:07.076104 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7f14b37e-e705-47b7-a6ca-dc3c318f55fc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1276 microversion: 2.1 time: 0.129866 Oct 12 22:10:07.076993 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1498/2714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:06 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:07.084969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e8b1d169-c0dd-4dc4-84b9-1cbb17a65084 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:07.085893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e8b1d169-c0dd-4dc4-84b9-1cbb17a65084 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:07.097325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8b1d169-c0dd-4dc4-84b9-1cbb17a65084 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:07.098243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8b1d169-c0dd-4dc4-84b9-1cbb17a65084 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:07.099300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8b1d169-c0dd-4dc4-84b9-1cbb17a65084 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:07.100235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8b1d169-c0dd-4dc4-84b9-1cbb17a65084 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:07.100858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8b1d169-c0dd-4dc4-84b9-1cbb17a65084 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:07.101754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8b1d169-c0dd-4dc4-84b9-1cbb17a65084 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:07.314850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e8b1d169-c0dd-4dc4-84b9-1cbb17a65084 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:07.330044 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e8b1d169-c0dd-4dc4-84b9-1cbb17a65084 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 200 len: 1556 microversion: 2.1 time: 0.251306 Oct 12 22:10:07.334397 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1499/2715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:07 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 1556 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:07.342182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4853731e-2862-4a32-867a-be7dca95ba0d tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:07.363532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4853731e-2862-4a32-867a-be7dca95ba0d tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Searching by: {'tenant_id': '2963196dad204be0bfb1d9f27f4a1968', 'deleted': False} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:10:07.371987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4853731e-2862-4a32-867a-be7dca95ba0d tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:07.373141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4853731e-2862-4a32-867a-be7dca95ba0d tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:07.373697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4853731e-2862-4a32-867a-be7dca95ba0d tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:07.374525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4853731e-2862-4a32-867a-be7dca95ba0d tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:07.375138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4853731e-2862-4a32-867a-be7dca95ba0d tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:07.376771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4853731e-2862-4a32-867a-be7dca95ba0d tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:07.440504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-4853731e-2862-4a32-867a-be7dca95ba0d tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:10:07.530602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4853731e-2862-4a32-867a-be7dca95ba0d tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:07.531282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4853731e-2862-4a32-867a-be7dca95ba0d tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:07.531710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4853731e-2862-4a32-867a-be7dca95ba0d tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:07.663170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f83fabd7-b9bf-43c7-af28-d55530eda313 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:07.676903 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f83fabd7-b9bf-43c7-af28-d55530eda313 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1316 microversion: 2.1 time: 1.615531 Oct 12 22:10:07.691881 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1217/2716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:06 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1316 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:07.699426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-24f405b3-6f61-4fc1-a250-556fd2c236f9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:07.700242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-24f405b3-6f61-4fc1-a250-556fd2c236f9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:07.708086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24f405b3-6f61-4fc1-a250-556fd2c236f9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:07.711547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24f405b3-6f61-4fc1-a250-556fd2c236f9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:07.712294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24f405b3-6f61-4fc1-a250-556fd2c236f9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:07.713263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24f405b3-6f61-4fc1-a250-556fd2c236f9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:07.713913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24f405b3-6f61-4fc1-a250-556fd2c236f9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:07.715599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24f405b3-6f61-4fc1-a250-556fd2c236f9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:08.141146 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-24f405b3-6f61-4fc1-a250-556fd2c236f9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.447692 Oct 12 22:10:08.141755 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1218/2717] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:10:07 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-interface => generated 284 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:08.147416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cf454205-b78a-4601-a5a7-8c2e4fcab9c2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:08.148036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cf454205-b78a-4601-a5a7-8c2e4fcab9c2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:08.173832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf454205-b78a-4601-a5a7-8c2e4fcab9c2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:08.174353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf454205-b78a-4601-a5a7-8c2e4fcab9c2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:08.174798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf454205-b78a-4601-a5a7-8c2e4fcab9c2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:08.181878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf454205-b78a-4601-a5a7-8c2e4fcab9c2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:08.182463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf454205-b78a-4601-a5a7-8c2e4fcab9c2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:08.182917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf454205-b78a-4601-a5a7-8c2e4fcab9c2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:08.350113 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4853731e-2862-4a32-867a-be7dca95ba0d tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2963196dad204be0bfb1d9f27f4a1968" status: 200 len: 4824 microversion: 2.1 time: 1.014196 Oct 12 22:10:08.350936 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1500/2718] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 12 22:10:07 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2963196dad204be0bfb1d9f27f4a1968 => generated 4824 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:08.357211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cefb278a-7cb9-4500-9b58-da98337e10aa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:08.358020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cefb278a-7cb9-4500-9b58-da98337e10aa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:08.367983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cefb278a-7cb9-4500-9b58-da98337e10aa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:08.374543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cefb278a-7cb9-4500-9b58-da98337e10aa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:08.375225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cefb278a-7cb9-4500-9b58-da98337e10aa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:08.376246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cefb278a-7cb9-4500-9b58-da98337e10aa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:08.377136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cefb278a-7cb9-4500-9b58-da98337e10aa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:08.377761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cefb278a-7cb9-4500-9b58-da98337e10aa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:08.471491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cefb278a-7cb9-4500-9b58-da98337e10aa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:08.483952 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cefb278a-7cb9-4500-9b58-da98337e10aa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1276 microversion: 2.1 time: 0.131903 Oct 12 22:10:08.485208 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1501/2719] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:08 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1276 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:08.491174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c4d6ae18-c5ec-4d61-b2f9-f8359be0ad07 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:08.511005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c4d6ae18-c5ec-4d61-b2f9-f8359be0ad07 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Searching by: {'tenant_id': 'acb0a5bd02e5427ba2038e4c7da67f07', 'deleted': False} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:10:08.517791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4d6ae18-c5ec-4d61-b2f9-f8359be0ad07 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:08.518511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4d6ae18-c5ec-4d61-b2f9-f8359be0ad07 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:08.519042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4d6ae18-c5ec-4d61-b2f9-f8359be0ad07 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:08.519951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4d6ae18-c5ec-4d61-b2f9-f8359be0ad07 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:08.520532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4d6ae18-c5ec-4d61-b2f9-f8359be0ad07 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:08.521110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4d6ae18-c5ec-4d61-b2f9-f8359be0ad07 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:08.573317 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c4d6ae18-c5ec-4d61-b2f9-f8359be0ad07 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=acb0a5bd02e5427ba2038e4c7da67f07" status: 200 len: 15 microversion: 2.1 time: 0.086643 Oct 12 22:10:08.574771 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1502/2720] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 12 22:10:08 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=acb0a5bd02e5427ba2038e4c7da67f07 => generated 15 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:10:08.580979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cf454205-b78a-4601-a5a7-8c2e4fcab9c2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:08.590763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cf454205-b78a-4601-a5a7-8c2e4fcab9c2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:08.593435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cf454205-b78a-4601-a5a7-8c2e4fcab9c2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:08.605791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-086620f7-20c6-4933-b689-8b8ae4560b5a tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:08.620149 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-086620f7-20c6-4933-b689-8b8ae4560b5a tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.020523 Oct 12 22:10:08.621433 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cf454205-b78a-4601-a5a7-8c2e4fcab9c2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.471425 Oct 12 22:10:08.624698 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1219/2721] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:08 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:08.627294 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1503/2722] 10.222.0.16 () {58 vars in 1189 bytes} [Wed Oct 12 22:10:08 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:10:08.658376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d8dc467-5044-446a-899f-5360967b5c44 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:08.660787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5d8dc467-5044-446a-899f-5360967b5c44 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:08.667792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d8dc467-5044-446a-899f-5360967b5c44 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:08.668423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d8dc467-5044-446a-899f-5360967b5c44 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:08.668705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d8dc467-5044-446a-899f-5360967b5c44 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:08.669606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d8dc467-5044-446a-899f-5360967b5c44 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:08.670059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d8dc467-5044-446a-899f-5360967b5c44 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:08.670507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d8dc467-5044-446a-899f-5360967b5c44 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:08.704517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-56bf24dd-e3dc-460a-9f2f-337d37ea4444 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:08.705161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-56bf24dd-e3dc-460a-9f2f-337d37ea4444 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:08.714036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56bf24dd-e3dc-460a-9f2f-337d37ea4444 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:08.714528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56bf24dd-e3dc-460a-9f2f-337d37ea4444 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:08.714972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56bf24dd-e3dc-460a-9f2f-337d37ea4444 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:08.715707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56bf24dd-e3dc-460a-9f2f-337d37ea4444 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:08.716159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56bf24dd-e3dc-460a-9f2f-337d37ea4444 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:08.716588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56bf24dd-e3dc-460a-9f2f-337d37ea4444 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:08.809346 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5d8dc467-5044-446a-899f-5360967b5c44 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770/action" status: 202 len: 0 microversion: 2.1 time: 0.160763 Oct 12 22:10:08.813111 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1220/2723] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:10:08 2022] POST /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:10:08.827414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-426c645a-1398-49c6-a534-88fb21f9e884 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:08.832523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-426c645a-1398-49c6-a534-88fb21f9e884 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:08.833847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-426c645a-1398-49c6-a534-88fb21f9e884 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '2963196dad204be0bfb1d9f27f4a1968'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:10:08.840499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-426c645a-1398-49c6-a534-88fb21f9e884 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:08.841172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-426c645a-1398-49c6-a534-88fb21f9e884 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:08.841800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-426c645a-1398-49c6-a534-88fb21f9e884 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:08.842716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-426c645a-1398-49c6-a534-88fb21f9e884 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:08.843168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-426c645a-1398-49c6-a534-88fb21f9e884 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:08.843769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-426c645a-1398-49c6-a534-88fb21f9e884 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:08.891505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.multi_cell_list [None req-426c645a-1398-49c6-a534-88fb21f9e884 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:10:08.932854 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-426c645a-1398-49c6-a534-88fb21f9e884 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.118387 Oct 12 22:10:08.934629 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1221/2724] 10.222.0.16 () {58 vars in 1150 bytes} [Wed Oct 12 22:10:08 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:08.947393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8669572f-4e07-4b4c-8778-a4f9b7361dd0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:08.949438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8669572f-4e07-4b4c-8778-a4f9b7361dd0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:08.957470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8669572f-4e07-4b4c-8778-a4f9b7361dd0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:08.957964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8669572f-4e07-4b4c-8778-a4f9b7361dd0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:08.958771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8669572f-4e07-4b4c-8778-a4f9b7361dd0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:08.959672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8669572f-4e07-4b4c-8778-a4f9b7361dd0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:08.960270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8669572f-4e07-4b4c-8778-a4f9b7361dd0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:08.961224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8669572f-4e07-4b4c-8778-a4f9b7361dd0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:09.098676 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8669572f-4e07-4b4c-8778-a4f9b7361dd0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770/action" status: 202 len: 0 microversion: 2.1 time: 0.156831 Oct 12 22:10:09.103723 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1222/2725] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:10:08 2022] POST /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:10:09.114280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-074a677a-c00a-4077-b5e8-90230784a525 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:09.115183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-074a677a-c00a-4077-b5e8-90230784a525 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:09.125218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-074a677a-c00a-4077-b5e8-90230784a525 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:09.125710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-074a677a-c00a-4077-b5e8-90230784a525 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:09.126157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-074a677a-c00a-4077-b5e8-90230784a525 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:09.126859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-074a677a-c00a-4077-b5e8-90230784a525 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:09.127353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-074a677a-c00a-4077-b5e8-90230784a525 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:09.129406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-074a677a-c00a-4077-b5e8-90230784a525 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:09.251314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-56bf24dd-e3dc-460a-9f2f-337d37ea4444 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:09.270485 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-56bf24dd-e3dc-460a-9f2f-337d37ea4444 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1316 microversion: 2.1 time: 0.568433 Oct 12 22:10:09.271917 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1504/2726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:08 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:09.516104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fce7e599-7696-4601-a6e7-d090444cd93c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:09.517238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fce7e599-7696-4601-a6e7-d090444cd93c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:09.532002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fce7e599-7696-4601-a6e7-d090444cd93c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:09.533945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fce7e599-7696-4601-a6e7-d090444cd93c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:09.535184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fce7e599-7696-4601-a6e7-d090444cd93c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:09.538672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fce7e599-7696-4601-a6e7-d090444cd93c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:09.541161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fce7e599-7696-4601-a6e7-d090444cd93c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:09.541778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fce7e599-7696-4601-a6e7-d090444cd93c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:09.600883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:09.636558 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-074a677a-c00a-4077-b5e8-90230784a525 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1614 microversion: 2.1 time: 0.532286 Oct 12 22:10:09.641282 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1223/2727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:09 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1614 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:09.650402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3577d8e3-1057-470b-b802-a3d3d3b3fe6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:09.655399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3577d8e3-1057-470b-b802-a3d3d3b3fe6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:09.667064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3577d8e3-1057-470b-b802-a3d3d3b3fe6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:09.667697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3577d8e3-1057-470b-b802-a3d3d3b3fe6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:09.669730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3577d8e3-1057-470b-b802-a3d3d3b3fe6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:09.674895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3577d8e3-1057-470b-b802-a3d3d3b3fe6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:09.675592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3577d8e3-1057-470b-b802-a3d3d3b3fe6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:09.676119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3577d8e3-1057-470b-b802-a3d3d3b3fe6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:09.930933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fce7e599-7696-4601-a6e7-d090444cd93c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:09.940174 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fce7e599-7696-4601-a6e7-d090444cd93c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1318 microversion: 2.1 time: 0.430739 Oct 12 22:10:09.942331 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1505/2728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:09 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:09.948832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-700f14f2-317f-4b80-b6c3-b760fa97a475 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:09.949613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-700f14f2-317f-4b80-b6c3-b760fa97a475 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:09.956806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-700f14f2-317f-4b80-b6c3-b760fa97a475 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:09.957571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-700f14f2-317f-4b80-b6c3-b760fa97a475 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:09.958160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-700f14f2-317f-4b80-b6c3-b760fa97a475 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:09.960472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-700f14f2-317f-4b80-b6c3-b760fa97a475 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:09.961239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-700f14f2-317f-4b80-b6c3-b760fa97a475 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:09.962206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-700f14f2-317f-4b80-b6c3-b760fa97a475 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:10.172621 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-700f14f2-317f-4b80-b6c3-b760fa97a475 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1614 microversion: 2.1 time: 0.228730 Oct 12 22:10:10.173922 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1506/2729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:09 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1614 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:10.187007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3577d8e3-1057-470b-b802-a3d3d3b3fe6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:10.200486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-92147e1a-d795-459d-824b-b65ba37588ae tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:10.213544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3577d8e3-1057-470b-b802-a3d3d3b3fe6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:10.214831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-92147e1a-d795-459d-824b-b65ba37588ae tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Searching by: {'host': 'n-h1-861111-1', 'deleted': False} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:10:10.217869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3577d8e3-1057-470b-b802-a3d3d3b3fe6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:10.227943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:10.230671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92147e1a-d795-459d-824b-b65ba37588ae tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:10.233205 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3577d8e3-1057-470b-b802-a3d3d3b3fe6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.587052 Oct 12 22:10:10.234163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92147e1a-d795-459d-824b-b65ba37588ae tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:10.234803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92147e1a-d795-459d-824b-b65ba37588ae tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:10.236600 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1224/2730] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:09 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:10:10.240371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92147e1a-d795-459d-824b-b65ba37588ae tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:10.241109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92147e1a-d795-459d-824b-b65ba37588ae tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:10.242733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92147e1a-d795-459d-824b-b65ba37588ae tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:10.293851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ab680923-2818-4ce3-a320-3535ed2d68ef tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:10.295118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ab680923-2818-4ce3-a320-3535ed2d68ef tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:10.303365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab680923-2818-4ce3-a320-3535ed2d68ef tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:10.304108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab680923-2818-4ce3-a320-3535ed2d68ef tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:10.304898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab680923-2818-4ce3-a320-3535ed2d68ef tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:10.306518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab680923-2818-4ce3-a320-3535ed2d68ef tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:10.307198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab680923-2818-4ce3-a320-3535ed2d68ef tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:10.307860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab680923-2818-4ce3-a320-3535ed2d68ef tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:10.381088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-92147e1a-d795-459d-824b-b65ba37588ae tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:10:10.471485 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-92147e1a-d795-459d-824b-b65ba37588ae tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=n-h1-861111-1&all_tenants=1" status: 200 len: 2308 microversion: 2.1 time: 0.277695 Oct 12 22:10:10.472418 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1507/2731] 10.222.0.16 () {58 vars in 1190 bytes} [Wed Oct 12 22:10:10 2022] GET /compute/v2.1/servers?host=n-h1-861111-1&all_tenants=1 => generated 2308 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:10.478040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-99969049-568b-4e8f-b693-61f2f799dfca req-fd7acc66-1ae8-4611-a94f-eb19256e83eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2", "tag": "4786efcb-bf77-4622-9cea-64620dc6221b"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:10.499282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-99969049-568b-4e8f-b693-61f2f799dfca req-fd7acc66-1ae8-4611-a94f-eb19256e83eb service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:10.499282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-99969049-568b-4e8f-b693-61f2f799dfca req-fd7acc66-1ae8-4611-a94f-eb19256e83eb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:10.499513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-99969049-568b-4e8f-b693-61f2f799dfca req-fd7acc66-1ae8-4611-a94f-eb19256e83eb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:10.512629 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-99969049-568b-4e8f-b693-61f2f799dfca req-fd7acc66-1ae8-4611-a94f-eb19256e83eb service nova] Creating event network-changed:4786efcb-bf77-4622-9cea-64620dc6221b for instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 on n-h2-861111-1 Oct 12 22:10:10.519279 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-99969049-568b-4e8f-b693-61f2f799dfca req-fd7acc66-1ae8-4611-a94f-eb19256e83eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045109 Oct 12 22:10:10.519909 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1508/2732] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:10.526885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b421ad6c-e9e2-463a-b815-4371616f2fc0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:10.535154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b421ad6c-e9e2-463a-b815-4371616f2fc0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:10:10.542587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b421ad6c-e9e2-463a-b815-4371616f2fc0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:10.544581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b421ad6c-e9e2-463a-b815-4371616f2fc0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:10.548191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b421ad6c-e9e2-463a-b815-4371616f2fc0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:10.548652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b421ad6c-e9e2-463a-b815-4371616f2fc0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:10.549120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b421ad6c-e9e2-463a-b815-4371616f2fc0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:10.549563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b421ad6c-e9e2-463a-b815-4371616f2fc0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:10.579997 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b421ad6c-e9e2-463a-b815-4371616f2fc0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.057840 Oct 12 22:10:10.591856 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1509/2733] 10.222.0.16 () {58 vars in 1196 bytes} [Wed Oct 12 22:10:10 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:10:10.596868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-38b9dd8b-e613-4339-8bf9-69329900877a tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:10.599365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-38b9dd8b-e613-4339-8bf9-69329900877a tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:10.607788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38b9dd8b-e613-4339-8bf9-69329900877a tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:10.608446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38b9dd8b-e613-4339-8bf9-69329900877a tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:10.608717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38b9dd8b-e613-4339-8bf9-69329900877a tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:10.609443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38b9dd8b-e613-4339-8bf9-69329900877a tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:10.609894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38b9dd8b-e613-4339-8bf9-69329900877a tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:10.610323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38b9dd8b-e613-4339-8bf9-69329900877a tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:10.906467 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-38b9dd8b-e613-4339-8bf9-69329900877a tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770/action" status: 202 len: 0 microversion: 2.1 time: 0.313297 Oct 12 22:10:10.907217 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1510/2734] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:10:10 2022] POST /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:10:10.923231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:10.935879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:10.943173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:10.943911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:10.944507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:10.945526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:10.946190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:10.946825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:11.049507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ab680923-2818-4ce3-a320-3535ed2d68ef tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:11.061041 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ab680923-2818-4ce3-a320-3535ed2d68ef tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1316 microversion: 2.1 time: 0.770971 Oct 12 22:10:11.063635 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1225/2735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:10 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1316 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:11.092313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-036108eb-4297-4073-8c74-04f321c5d06a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:11.092949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-036108eb-4297-4073-8c74-04f321c5d06a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:11.108058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-036108eb-4297-4073-8c74-04f321c5d06a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:11.110168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-036108eb-4297-4073-8c74-04f321c5d06a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:11.112396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-036108eb-4297-4073-8c74-04f321c5d06a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:11.112526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:10:11.113596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:10:11.114438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-036108eb-4297-4073-8c74-04f321c5d06a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:11.115418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:10:11.116417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-036108eb-4297-4073-8c74-04f321c5d06a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:11.116899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:10:11.117466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:10:11.117866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-036108eb-4297-4073-8c74-04f321c5d06a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:11.303952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:11.322787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:11.323993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:11.324464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:11.325194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:11.325654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:11.326075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:11.420776 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-529dab8b-8fc0-4fab-82b6-c93e70dc758f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "POST /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770/action" status: 202 len: 1067 microversion: 2.1 time: 0.508841 Oct 12 22:10:11.440456 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1511/2736] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:10:10 2022] POST /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770/action => generated 1067 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 12 22:10:11.451017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a3bef866-8e9a-4951-80b0-70a1fd488315 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:11.451674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a3bef866-8e9a-4951-80b0-70a1fd488315 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:11.457949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3bef866-8e9a-4951-80b0-70a1fd488315 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:11.459298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3bef866-8e9a-4951-80b0-70a1fd488315 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:11.459905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3bef866-8e9a-4951-80b0-70a1fd488315 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:11.460636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3bef866-8e9a-4951-80b0-70a1fd488315 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:11.461099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3bef866-8e9a-4951-80b0-70a1fd488315 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:11.461532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3bef866-8e9a-4951-80b0-70a1fd488315 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:11.650787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a3bef866-8e9a-4951-80b0-70a1fd488315 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:11.668709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a3bef866-8e9a-4951-80b0-70a1fd488315 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:11.670195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a3bef866-8e9a-4951-80b0-70a1fd488315 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:11.677182 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a3bef866-8e9a-4951-80b0-70a1fd488315 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.235449 Oct 12 22:10:11.687597 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1512/2737] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:11 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:11.697352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f5e5b919-4817-4481-84c9-ef777a61c541 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:11.697976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f5e5b919-4817-4481-84c9-ef777a61c541 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:11.715601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5e5b919-4817-4481-84c9-ef777a61c541 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:11.715601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5e5b919-4817-4481-84c9-ef777a61c541 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:11.716076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5e5b919-4817-4481-84c9-ef777a61c541 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:11.716791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5e5b919-4817-4481-84c9-ef777a61c541 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:11.717252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5e5b919-4817-4481-84c9-ef777a61c541 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:11.717684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5e5b919-4817-4481-84c9-ef777a61c541 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:11.984213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-036108eb-4297-4073-8c74-04f321c5d06a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:11.993470 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-036108eb-4297-4073-8c74-04f321c5d06a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1318 microversion: 2.1 time: 0.910150 Oct 12 22:10:11.997397 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1226/2738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:11 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1318 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:12.008931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8a9297ee-5195-4dcb-a20e-f50318577892 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:12.013515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8a9297ee-5195-4dcb-a20e-f50318577892 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:12.032660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a9297ee-5195-4dcb-a20e-f50318577892 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:12.033665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a9297ee-5195-4dcb-a20e-f50318577892 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:12.036248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a9297ee-5195-4dcb-a20e-f50318577892 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:12.037477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a9297ee-5195-4dcb-a20e-f50318577892 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:12.040869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a9297ee-5195-4dcb-a20e-f50318577892 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:12.042407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a9297ee-5195-4dcb-a20e-f50318577892 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:12.059170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f5e5b919-4817-4481-84c9-ef777a61c541 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:12.069878 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f5e5b919-4817-4481-84c9-ef777a61c541 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1471 microversion: 2.1 time: 0.381061 Oct 12 22:10:12.071002 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1513/2739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:11 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1471 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:12.097714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-77629d7b-50ac-4258-8d59-e793229148f5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:12.100424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:12.101302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-77629d7b-50ac-4258-8d59-e793229148f5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:12.115701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77629d7b-50ac-4258-8d59-e793229148f5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:12.116380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77629d7b-50ac-4258-8d59-e793229148f5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:12.117713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77629d7b-50ac-4258-8d59-e793229148f5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:12.118650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77629d7b-50ac-4258-8d59-e793229148f5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:12.121671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77629d7b-50ac-4258-8d59-e793229148f5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:12.122313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77629d7b-50ac-4258-8d59-e793229148f5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:12.505767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=24 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:12.525695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-77629d7b-50ac-4258-8d59-e793229148f5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:12.537569 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-77629d7b-50ac-4258-8d59-e793229148f5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1316 microversion: 2.1 time: 0.451108 Oct 12 22:10:12.538671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8a9297ee-5195-4dcb-a20e-f50318577892 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:12.543463 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1514/2740] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:12 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:12.554114 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8a9297ee-5195-4dcb-a20e-f50318577892 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.553214 Oct 12 22:10:12.555411 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1227/2741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:11 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:12.588581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-99e4175f-d5f9-4441-abe9-e22163ff6314 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:12.589352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-99e4175f-d5f9-4441-abe9-e22163ff6314 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:12.605188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99e4175f-d5f9-4441-abe9-e22163ff6314 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:12.606123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99e4175f-d5f9-4441-abe9-e22163ff6314 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:12.606979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99e4175f-d5f9-4441-abe9-e22163ff6314 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:12.607567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99e4175f-d5f9-4441-abe9-e22163ff6314 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:12.608128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99e4175f-d5f9-4441-abe9-e22163ff6314 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:12.609563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99e4175f-d5f9-4441-abe9-e22163ff6314 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:12.712956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c749f9c8-40a4-4085-a304-9ad6f89bab61 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:12.713578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c749f9c8-40a4-4085-a304-9ad6f89bab61 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:12.720871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:12.724260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c749f9c8-40a4-4085-a304-9ad6f89bab61 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:12.727066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c749f9c8-40a4-4085-a304-9ad6f89bab61 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:12.728704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c749f9c8-40a4-4085-a304-9ad6f89bab61 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:12.730105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c749f9c8-40a4-4085-a304-9ad6f89bab61 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:12.730745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c749f9c8-40a4-4085-a304-9ad6f89bab61 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:12.732294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c749f9c8-40a4-4085-a304-9ad6f89bab61 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:12.910586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-99e4175f-d5f9-4441-abe9-e22163ff6314 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:12.924796 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-99e4175f-d5f9-4441-abe9-e22163ff6314 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.342392 Oct 12 22:10:12.941151 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1515/2742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:12 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:12.958931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8193614b-488c-44de-a758-2cdeadce0a4c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:12.959866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8193614b-488c-44de-a758-2cdeadce0a4c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:12.966973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8193614b-488c-44de-a758-2cdeadce0a4c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:12.968014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8193614b-488c-44de-a758-2cdeadce0a4c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:12.968891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8193614b-488c-44de-a758-2cdeadce0a4c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:12.969337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8193614b-488c-44de-a758-2cdeadce0a4c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:12.969805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8193614b-488c-44de-a758-2cdeadce0a4c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:12.970505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8193614b-488c-44de-a758-2cdeadce0a4c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:13.098609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c749f9c8-40a4-4085-a304-9ad6f89bab61 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:13.121684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c749f9c8-40a4-4085-a304-9ad6f89bab61 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:13.123158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c749f9c8-40a4-4085-a304-9ad6f89bab61 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:13.128824 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c749f9c8-40a4-4085-a304-9ad6f89bab61 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.424716 Oct 12 22:10:13.129415 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1228/2743] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:12 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:10:13.144143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bbd88ddc-e8c7-444a-97ad-c4101560ce28 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:13.145004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bbd88ddc-e8c7-444a-97ad-c4101560ce28 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:13.153778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbd88ddc-e8c7-444a-97ad-c4101560ce28 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:13.155893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbd88ddc-e8c7-444a-97ad-c4101560ce28 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:13.156568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbd88ddc-e8c7-444a-97ad-c4101560ce28 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:13.157486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbd88ddc-e8c7-444a-97ad-c4101560ce28 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:13.157950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbd88ddc-e8c7-444a-97ad-c4101560ce28 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:13.158380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbd88ddc-e8c7-444a-97ad-c4101560ce28 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:13.355071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8193614b-488c-44de-a758-2cdeadce0a4c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:13.377918 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8193614b-488c-44de-a758-2cdeadce0a4c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.431099 Oct 12 22:10:13.381098 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1516/2744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:12 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:13.387772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fcd596d5-a10b-4678-8029-78f39bb26902 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:13.388660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fcd596d5-a10b-4678-8029-78f39bb26902 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:13.395851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd596d5-a10b-4678-8029-78f39bb26902 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:13.396544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd596d5-a10b-4678-8029-78f39bb26902 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:13.397269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd596d5-a10b-4678-8029-78f39bb26902 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:13.400907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd596d5-a10b-4678-8029-78f39bb26902 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:13.401620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd596d5-a10b-4678-8029-78f39bb26902 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:13.402347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd596d5-a10b-4678-8029-78f39bb26902 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:13.799565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fcd596d5-a10b-4678-8029-78f39bb26902 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:13.810230 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fcd596d5-a10b-4678-8029-78f39bb26902 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1471 microversion: 2.1 time: 0.427190 Oct 12 22:10:13.810830 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1517/2745] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:13 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1471 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:13.828423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1327d101-8545-416d-ada8-77da612213cf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1556820809"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:13.833686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1327d101-8545-416d-ada8-77da612213cf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:13.848159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1327d101-8545-416d-ada8-77da612213cf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:13.848660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1327d101-8545-416d-ada8-77da612213cf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:13.849580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1327d101-8545-416d-ada8-77da612213cf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:13.849831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1327d101-8545-416d-ada8-77da612213cf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:13.850290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1327d101-8545-416d-ada8-77da612213cf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:13.850709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1327d101-8545-416d-ada8-77da612213cf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:14.111775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bbd88ddc-e8c7-444a-97ad-c4101560ce28 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:14.120960 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bbd88ddc-e8c7-444a-97ad-c4101560ce28 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1318 microversion: 2.1 time: 0.980491 Oct 12 22:10:14.121551 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1229/2746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:13 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1318 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:14.130622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-28b2d56b-7dea-4edb-876b-3b0ee4130fce tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:14.136116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-28b2d56b-7dea-4edb-876b-3b0ee4130fce tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:14.150622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28b2d56b-7dea-4edb-876b-3b0ee4130fce tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:14.151387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28b2d56b-7dea-4edb-876b-3b0ee4130fce tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:14.151831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28b2d56b-7dea-4edb-876b-3b0ee4130fce tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:14.152554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28b2d56b-7dea-4edb-876b-3b0ee4130fce tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:14.153006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28b2d56b-7dea-4edb-876b-3b0ee4130fce tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:14.153432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28b2d56b-7dea-4edb-876b-3b0ee4130fce tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:14.229331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:14.277760 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1327d101-8545-416d-ada8-77da612213cf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 202 len: 0 microversion: 2.1 time: 0.456267 Oct 12 22:10:14.280181 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1518/2747] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:10:13 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 12 22:10:14.299571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-acc04915-b012-44ef-b1fc-57e571779e7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:14.302919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-acc04915-b012-44ef-b1fc-57e571779e7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:14.316371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acc04915-b012-44ef-b1fc-57e571779e7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:14.317310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acc04915-b012-44ef-b1fc-57e571779e7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:14.319420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acc04915-b012-44ef-b1fc-57e571779e7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:14.322493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acc04915-b012-44ef-b1fc-57e571779e7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:14.326407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acc04915-b012-44ef-b1fc-57e571779e7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:14.330205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acc04915-b012-44ef-b1fc-57e571779e7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:14.477283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-acc04915-b012-44ef-b1fc-57e571779e7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:14.495610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-acc04915-b012-44ef-b1fc-57e571779e7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:14.499510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-acc04915-b012-44ef-b1fc-57e571779e7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:14.513991 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-acc04915-b012-44ef-b1fc-57e571779e7f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.226874 Oct 12 22:10:14.515189 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1519/2748] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:14 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:14.773407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-4b0b018b-e6b8-47b1-8029-85628a7de3d3 req-88e50aab-8b92-43e4-9ffd-2f91d1b7456c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51cce335-3600-4511-8ccd-8b837074bf95", "name": "network-vif-plugged", "status": "completed", "tag": "738fc407-d734-4f84-b018-92200d206616"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:14.802839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4b0b018b-e6b8-47b1-8029-85628a7de3d3 req-88e50aab-8b92-43e4-9ffd-2f91d1b7456c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:14.807626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4b0b018b-e6b8-47b1-8029-85628a7de3d3 req-88e50aab-8b92-43e4-9ffd-2f91d1b7456c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:14.808170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4b0b018b-e6b8-47b1-8029-85628a7de3d3 req-88e50aab-8b92-43e4-9ffd-2f91d1b7456c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:14.829146 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-4b0b018b-e6b8-47b1-8029-85628a7de3d3 req-88e50aab-8b92-43e4-9ffd-2f91d1b7456c service nova] Creating event network-vif-plugged:738fc407-d734-4f84-b018-92200d206616 for instance 51cce335-3600-4511-8ccd-8b837074bf95 on n-h1-861111-1 Oct 12 22:10:14.877255 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-4b0b018b-e6b8-47b1-8029-85628a7de3d3 req-88e50aab-8b92-43e4-9ffd-2f91d1b7456c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106624 Oct 12 22:10:14.883677 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1520/2749] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:10:14.902213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb13de03-45b7-4498-90e0-9a21614747b8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:14.910251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cb13de03-45b7-4498-90e0-9a21614747b8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:14.937003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb13de03-45b7-4498-90e0-9a21614747b8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:14.937781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb13de03-45b7-4498-90e0-9a21614747b8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:14.942514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb13de03-45b7-4498-90e0-9a21614747b8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:14.947959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb13de03-45b7-4498-90e0-9a21614747b8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:14.957609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb13de03-45b7-4498-90e0-9a21614747b8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:14.958287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb13de03-45b7-4498-90e0-9a21614747b8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:15.266115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cb13de03-45b7-4498-90e0-9a21614747b8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:15.277848 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cb13de03-45b7-4498-90e0-9a21614747b8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1471 microversion: 2.1 time: 0.388971 Oct 12 22:10:15.279394 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1521/2750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:14 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1471 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:15.284744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5c337098-c8f9-4c77-994b-7eca06b19435 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:15.285648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5c337098-c8f9-4c77-994b-7eca06b19435 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:15.294127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c337098-c8f9-4c77-994b-7eca06b19435 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:15.294703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c337098-c8f9-4c77-994b-7eca06b19435 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:15.295137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c337098-c8f9-4c77-994b-7eca06b19435 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:15.295933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c337098-c8f9-4c77-994b-7eca06b19435 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:15.296392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c337098-c8f9-4c77-994b-7eca06b19435 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:15.297133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c337098-c8f9-4c77-994b-7eca06b19435 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:15.613565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-28b2d56b-7dea-4edb-876b-3b0ee4130fce tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:15.634399 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-28b2d56b-7dea-4edb-876b-3b0ee4130fce tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1316 microversion: 2.1 time: 1.499732 Oct 12 22:10:15.653360 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1230/2751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:14 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1316 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:15.662064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8a573dba-0765-42ee-bed1-c2385e712f9e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:15.662600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8a573dba-0765-42ee-bed1-c2385e712f9e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:15.679260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a573dba-0765-42ee-bed1-c2385e712f9e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:15.679786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a573dba-0765-42ee-bed1-c2385e712f9e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:15.680400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a573dba-0765-42ee-bed1-c2385e712f9e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:15.686524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a573dba-0765-42ee-bed1-c2385e712f9e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:15.687072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a573dba-0765-42ee-bed1-c2385e712f9e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:15.691793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a573dba-0765-42ee-bed1-c2385e712f9e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:15.816740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8a573dba-0765-42ee-bed1-c2385e712f9e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:15.829476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8a573dba-0765-42ee-bed1-c2385e712f9e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:15.831017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8a573dba-0765-42ee-bed1-c2385e712f9e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:15.843391 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8a573dba-0765-42ee-bed1-c2385e712f9e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.188716 Oct 12 22:10:15.844090 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1231/2752] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:15 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:15.942919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-4d8ad32b-06ed-46bf-8342-f860c4ded9a4 req-af17ff86-dc51-49e6-9fcd-03854822b587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29922f3d-5384-486f-8968-4fd73fd9016d", "tag": "352fa9f3-0c18-4a3c-8393-47d9c4910a0d"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:15.952551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4d8ad32b-06ed-46bf-8342-f860c4ded9a4 req-af17ff86-dc51-49e6-9fcd-03854822b587 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:15.953376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4d8ad32b-06ed-46bf-8342-f860c4ded9a4 req-af17ff86-dc51-49e6-9fcd-03854822b587 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:15.954122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4d8ad32b-06ed-46bf-8342-f860c4ded9a4 req-af17ff86-dc51-49e6-9fcd-03854822b587 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:15.974019 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-4d8ad32b-06ed-46bf-8342-f860c4ded9a4 req-af17ff86-dc51-49e6-9fcd-03854822b587 service nova] Creating event network-changed:352fa9f3-0c18-4a3c-8393-47d9c4910a0d for instance 29922f3d-5384-486f-8968-4fd73fd9016d on n-h1-861111-1 Oct 12 22:10:15.985052 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-4d8ad32b-06ed-46bf-8342-f860c4ded9a4 req-af17ff86-dc51-49e6-9fcd-03854822b587 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045942 Oct 12 22:10:15.986153 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1232/2753] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:16.129195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5c337098-c8f9-4c77-994b-7eca06b19435 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:16.141157 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5c337098-c8f9-4c77-994b-7eca06b19435 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1318 microversion: 2.1 time: 0.857979 Oct 12 22:10:16.142038 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1522/2754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:15 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1318 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:16.308146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-153a42e1-fd97-47b3-b0e5-6d151384aa64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:16.309083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-153a42e1-fd97-47b3-b0e5-6d151384aa64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:16.317186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-153a42e1-fd97-47b3-b0e5-6d151384aa64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:16.318226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-153a42e1-fd97-47b3-b0e5-6d151384aa64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:16.319153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-153a42e1-fd97-47b3-b0e5-6d151384aa64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:16.320708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-153a42e1-fd97-47b3-b0e5-6d151384aa64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:16.326261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-153a42e1-fd97-47b3-b0e5-6d151384aa64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:16.327014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-153a42e1-fd97-47b3-b0e5-6d151384aa64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:16.660154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fd335af0-7750-41a3-8b95-e649ed3a7922 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:16.660776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fd335af0-7750-41a3-8b95-e649ed3a7922 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:16.676957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd335af0-7750-41a3-8b95-e649ed3a7922 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:16.677764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd335af0-7750-41a3-8b95-e649ed3a7922 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:16.678738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd335af0-7750-41a3-8b95-e649ed3a7922 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:16.681552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd335af0-7750-41a3-8b95-e649ed3a7922 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:16.682098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd335af0-7750-41a3-8b95-e649ed3a7922 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:16.684522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd335af0-7750-41a3-8b95-e649ed3a7922 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:16.700197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-153a42e1-fd97-47b3-b0e5-6d151384aa64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:16.708892 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-153a42e1-fd97-47b3-b0e5-6d151384aa64 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1471 microversion: 2.1 time: 0.410343 Oct 12 22:10:16.710279 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1233/2755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:16 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1471 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:16.881739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-328ddd27-4038-41b1-9c2e-6958e92f4f9d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:16.885388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-328ddd27-4038-41b1-9c2e-6958e92f4f9d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:16.899607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-328ddd27-4038-41b1-9c2e-6958e92f4f9d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:16.901806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-328ddd27-4038-41b1-9c2e-6958e92f4f9d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:16.902658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-328ddd27-4038-41b1-9c2e-6958e92f4f9d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:16.906636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-328ddd27-4038-41b1-9c2e-6958e92f4f9d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:16.907795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-328ddd27-4038-41b1-9c2e-6958e92f4f9d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:16.910048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-328ddd27-4038-41b1-9c2e-6958e92f4f9d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:16.959763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fd335af0-7750-41a3-8b95-e649ed3a7922 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:16.970491 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fd335af0-7750-41a3-8b95-e649ed3a7922 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1316 microversion: 2.1 time: 0.314164 Oct 12 22:10:16.980452 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1523/2756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:16 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:17.031139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-328ddd27-4038-41b1-9c2e-6958e92f4f9d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:17.044721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-328ddd27-4038-41b1-9c2e-6958e92f4f9d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:17.046766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-328ddd27-4038-41b1-9c2e-6958e92f4f9d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:17.055564 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-328ddd27-4038-41b1-9c2e-6958e92f4f9d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.180675 Oct 12 22:10:17.057438 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1234/2757] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:16 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:10:17.165749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eaf2a2a2-e0d6-4468-9b24-6b610d2f7a43 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:17.166623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eaf2a2a2-e0d6-4468-9b24-6b610d2f7a43 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:17.180606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaf2a2a2-e0d6-4468-9b24-6b610d2f7a43 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:17.184655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaf2a2a2-e0d6-4468-9b24-6b610d2f7a43 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:17.185289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaf2a2a2-e0d6-4468-9b24-6b610d2f7a43 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:17.186472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaf2a2a2-e0d6-4468-9b24-6b610d2f7a43 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:17.187479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaf2a2a2-e0d6-4468-9b24-6b610d2f7a43 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:17.189426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eaf2a2a2-e0d6-4468-9b24-6b610d2f7a43 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:17.530391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=39 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:17.703594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eaf2a2a2-e0d6-4468-9b24-6b610d2f7a43 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:17.714961 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eaf2a2a2-e0d6-4468-9b24-6b610d2f7a43 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1318 microversion: 2.1 time: 0.554040 Oct 12 22:10:17.740631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-773bb517-ccef-4712-a8ec-8af76a114bdf tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:17.742974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-773bb517-ccef-4712-a8ec-8af76a114bdf tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:17.747883 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1524/2758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:17 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1318 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:17.757193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-773bb517-ccef-4712-a8ec-8af76a114bdf tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:17.758057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-773bb517-ccef-4712-a8ec-8af76a114bdf tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:17.758870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-773bb517-ccef-4712-a8ec-8af76a114bdf tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:17.761068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-773bb517-ccef-4712-a8ec-8af76a114bdf tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:17.761767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-773bb517-ccef-4712-a8ec-8af76a114bdf tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:17.762414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-773bb517-ccef-4712-a8ec-8af76a114bdf tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:18.000694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e67c6023-9fb5-4662-bdba-24e7be6d148c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:18.002796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e67c6023-9fb5-4662-bdba-24e7be6d148c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:18.020578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e67c6023-9fb5-4662-bdba-24e7be6d148c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:18.022321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e67c6023-9fb5-4662-bdba-24e7be6d148c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:18.025134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e67c6023-9fb5-4662-bdba-24e7be6d148c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:18.025973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e67c6023-9fb5-4662-bdba-24e7be6d148c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:18.028011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e67c6023-9fb5-4662-bdba-24e7be6d148c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:18.028745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e67c6023-9fb5-4662-bdba-24e7be6d148c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:18.124011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-773bb517-ccef-4712-a8ec-8af76a114bdf tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:18.137054 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-773bb517-ccef-4712-a8ec-8af76a114bdf tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1471 microversion: 2.1 time: 0.406403 Oct 12 22:10:18.155629 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1235/2759] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:17 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1471 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:18.169686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-b27429cf-7e82-47ca-8f43-0671092a99bc req-2495c37d-b2f0-4dcc-8d7d-4845da0fdc73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b862f7de-fe9b-49bc-9e77-0d3e453558e8", "tag": "4e7ca35a-5772-4985-baa1-a73c3a5acaa8"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:18.206568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b27429cf-7e82-47ca-8f43-0671092a99bc req-2495c37d-b2f0-4dcc-8d7d-4845da0fdc73 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:18.208843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b27429cf-7e82-47ca-8f43-0671092a99bc req-2495c37d-b2f0-4dcc-8d7d-4845da0fdc73 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:18.209306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b27429cf-7e82-47ca-8f43-0671092a99bc req-2495c37d-b2f0-4dcc-8d7d-4845da0fdc73 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:18.232052 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-b27429cf-7e82-47ca-8f43-0671092a99bc req-2495c37d-b2f0-4dcc-8d7d-4845da0fdc73 service nova] Creating event network-changed:4e7ca35a-5772-4985-baa1-a73c3a5acaa8 for instance b862f7de-fe9b-49bc-9e77-0d3e453558e8 on n-h2-861111-1 Oct 12 22:10:18.242512 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-b27429cf-7e82-47ca-8f43-0671092a99bc req-2495c37d-b2f0-4dcc-8d7d-4845da0fdc73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083342 Oct 12 22:10:18.246850 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1236/2760] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:18.260864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2c931fdd-de76-4794-9547-b7453b05e43b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:18.267666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2c931fdd-de76-4794-9547-b7453b05e43b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:18.286443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c931fdd-de76-4794-9547-b7453b05e43b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:18.287938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c931fdd-de76-4794-9547-b7453b05e43b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:18.289219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c931fdd-de76-4794-9547-b7453b05e43b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:18.293473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c931fdd-de76-4794-9547-b7453b05e43b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:18.295062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c931fdd-de76-4794-9547-b7453b05e43b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:18.296039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c931fdd-de76-4794-9547-b7453b05e43b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:18.360655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e67c6023-9fb5-4662-bdba-24e7be6d148c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:18.368676 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e67c6023-9fb5-4662-bdba-24e7be6d148c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1505 microversion: 2.1 time: 0.374478 Oct 12 22:10:18.389958 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1525/2761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:17 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:18.403594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7713f730-c05f-4326-b31a-8d5733f50fe8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-220381227"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:18.404595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7713f730-c05f-4326-b31a-8d5733f50fe8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:18.405345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2c931fdd-de76-4794-9547-b7453b05e43b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:18.415100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7713f730-c05f-4326-b31a-8d5733f50fe8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:18.416189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2c931fdd-de76-4794-9547-b7453b05e43b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:18.417665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2c931fdd-de76-4794-9547-b7453b05e43b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:18.418284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7713f730-c05f-4326-b31a-8d5733f50fe8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:18.420002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7713f730-c05f-4326-b31a-8d5733f50fe8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:18.420845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7713f730-c05f-4326-b31a-8d5733f50fe8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:18.422152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7713f730-c05f-4326-b31a-8d5733f50fe8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:18.423258 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2c931fdd-de76-4794-9547-b7453b05e43b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.174060 Oct 12 22:10:18.423572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7713f730-c05f-4326-b31a-8d5733f50fe8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:18.440109 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1237/2762] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:18 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:18.519722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-348034120", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "fa934f2d-e3b6-4d5e-9bb7-bf4de3e361c6"}, {"uuid": "64d55f9f-0cc9-486c-8f84-e3c19e2ceabb"}, {"uuid": "fa934f2d-e3b6-4d5e-9bb7-bf4de3e361c6"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:18.602460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] validate_networks() for [('fa934f2d-e3b6-4d5e-9bb7-bf4de3e361c6', None, None, None, None, None), ('64d55f9f-0cc9-486c-8f84-e3c19e2ceabb', None, None, None, None, None), ('fa934f2d-e3b6-4d5e-9bb7-bf4de3e361c6', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:10:18.620330 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.network.security_group_api [None req-7713f730-c05f-4326-b31a-8d5733f50fe8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Adding security group d8e81666-b0e1-4909-aded-45f48f5a9a9b to port 738fc407-d734-4f84-b018-92200d206616 Oct 12 22:10:18.858334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=10 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:19.128927 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7713f730-c05f-4326-b31a-8d5733f50fe8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "POST /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95/action" status: 202 len: 0 microversion: 2.1 time: 0.737620 Oct 12 22:10:19.129776 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1526/2763] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:10:18 2022] POST /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:10:19.134733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-73b50f17-dd59-46ea-9313-88c4ee17300f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:19.135487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-73b50f17-dd59-46ea-9313-88c4ee17300f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:19.155273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73b50f17-dd59-46ea-9313-88c4ee17300f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:19.156033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73b50f17-dd59-46ea-9313-88c4ee17300f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:19.156692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73b50f17-dd59-46ea-9313-88c4ee17300f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:19.157596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73b50f17-dd59-46ea-9313-88c4ee17300f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:19.158255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73b50f17-dd59-46ea-9313-88c4ee17300f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:19.158897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73b50f17-dd59-46ea-9313-88c4ee17300f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:19.411683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-73b50f17-dd59-46ea-9313-88c4ee17300f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:19.421643 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-73b50f17-dd59-46ea-9313-88c4ee17300f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1318 microversion: 2.1 time: 0.290676 Oct 12 22:10:19.422264 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1527/2764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:19 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:19.439174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6bb4b025-029f-4d6b-ac11-c153232599ad tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f5128209d30>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:19.558134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-6bb4b025-029f-4d6b-ac11-c153232599ad tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d8e81666-b0e1-4909-aded-45f48f5a9a9b in use.", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:10:19.558844 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-6bb4b025-029f-4d6b-ac11-c153232599ad tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] HTTP exception thrown: Security Group d8e81666-b0e1-4909-aded-45f48f5a9a9b in use. Oct 12 22:10:19.558844 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-f19acca8-da03-4e83-af82-2f76934f49c1'] Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6bb4b025-029f-4d6b-ac11-c153232599ad tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Request method failure captured: Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/os-security-groups/d8e81666-b0e1-4909-aded-45f48f5a9a9b HTTP/1.1 Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzsOoCBjc82qYrgXGJcyS2C14AOyPaAY8jKON607aXBRETBa1-csxQQTd0dgLMFOSgjqcymNifeM8Cm_FMIYg-_UXGIEhCMX-O3n3HlLkfS0dfrzyRNsTuLIp0L-pAR76rzZrOO2f-Vw4UsY6dbCy5X6TdVdQGY9sHIG-ct3MYAKFNg Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_214f86d71a5749b9b98dffe934fe7f1f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 81e045d919104fa89572a2d05993abb8 Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: exception: Security Group d8e81666-b0e1-4909-aded-45f48f5a9a9b in use. Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-f19acca8-da03-4e83-af82-2f76934f49c1'] Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'd8e81666-b0e1-4909-aded-45f48f5a9a9b'} Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:10:19.561137 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group d8e81666-b0e1-4909-aded-45f48f5a9a9b in use. Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f19acca8-da03-4e83-af82-2f76934f49c1'] Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group d8e81666-b0e1-4909-aded-45f48f5a9a9b in use. Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f19acca8-da03-4e83-af82-2f76934f49c1'] Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group d8e81666-b0e1-4909-aded-45f48f5a9a9b in use. Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f19acca8-da03-4e83-af82-2f76934f49c1'] Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group d8e81666-b0e1-4909-aded-45f48f5a9a9b in use. Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f19acca8-da03-4e83-af82-2f76934f49c1'] Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6bb4b025-029f-4d6b-ac11-c153232599ad tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Returning 400 to user: Security Group d8e81666-b0e1-4909-aded-45f48f5a9a9b in use. Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-f19acca8-da03-4e83-af82-2f76934f49c1'] {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6bb4b025-029f-4d6b-ac11-c153232599ad tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/d8e81666-b0e1-4909-aded-45f48f5a9a9b" status: 400 len: 185 microversion: 2.1 time: 0.139364 Oct 12 22:10:19.565029 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1528/2765] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:10:19 2022] DELETE /compute/v2.1/os-security-groups/d8e81666-b0e1-4909-aded-45f48f5a9a9b => generated 185 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:10:19.573062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3970a603-6212-464f-8e11-3d587db79172 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:19.573694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3970a603-6212-464f-8e11-3d587db79172 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:19.586752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3970a603-6212-464f-8e11-3d587db79172 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:19.587959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3970a603-6212-464f-8e11-3d587db79172 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:19.588419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3970a603-6212-464f-8e11-3d587db79172 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:19.589134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3970a603-6212-464f-8e11-3d587db79172 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:19.589592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3970a603-6212-464f-8e11-3d587db79172 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:19.590018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3970a603-6212-464f-8e11-3d587db79172 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:19.845383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3970a603-6212-464f-8e11-3d587db79172 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:19.859954 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3970a603-6212-464f-8e11-3d587db79172 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1471 microversion: 2.1 time: 0.294115 Oct 12 22:10:19.861475 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1529/2766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:19 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1471 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:19.868982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-ac6e89bd-68f1-4d59-863f-a2913541bdb7 req-4e1f4f2c-5e45-4a97-a693-a4e9d3e2bbec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51cce335-3600-4511-8ccd-8b837074bf95", "tag": "738fc407-d734-4f84-b018-92200d206616"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:19.887947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ac6e89bd-68f1-4d59-863f-a2913541bdb7 req-4e1f4f2c-5e45-4a97-a693-a4e9d3e2bbec service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:19.889360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ac6e89bd-68f1-4d59-863f-a2913541bdb7 req-4e1f4f2c-5e45-4a97-a693-a4e9d3e2bbec service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:19.890486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ac6e89bd-68f1-4d59-863f-a2913541bdb7 req-4e1f4f2c-5e45-4a97-a693-a4e9d3e2bbec service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:19.906815 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-ac6e89bd-68f1-4d59-863f-a2913541bdb7 req-4e1f4f2c-5e45-4a97-a693-a4e9d3e2bbec service nova] Creating event network-changed:738fc407-d734-4f84-b018-92200d206616 for instance 51cce335-3600-4511-8ccd-8b837074bf95 on n-h1-861111-1 Oct 12 22:10:19.914383 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-ac6e89bd-68f1-4d59-863f-a2913541bdb7 req-4e1f4f2c-5e45-4a97-a693-a4e9d3e2bbec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050436 Oct 12 22:10:19.919993 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1530/2767] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:19.927718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-09c09347-a875-428b-8597-7ec1ff77ef68 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:19.928539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-09c09347-a875-428b-8597-7ec1ff77ef68 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:19.938726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09c09347-a875-428b-8597-7ec1ff77ef68 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:19.941802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09c09347-a875-428b-8597-7ec1ff77ef68 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:19.942400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09c09347-a875-428b-8597-7ec1ff77ef68 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:19.943295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09c09347-a875-428b-8597-7ec1ff77ef68 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:19.943836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09c09347-a875-428b-8597-7ec1ff77ef68 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:19.944337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09c09347-a875-428b-8597-7ec1ff77ef68 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:20.049480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-09c09347-a875-428b-8597-7ec1ff77ef68 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:20.061059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-09c09347-a875-428b-8597-7ec1ff77ef68 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:20.062629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-09c09347-a875-428b-8597-7ec1ff77ef68 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:20.072179 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-09c09347-a875-428b-8597-7ec1ff77ef68 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.149328 Oct 12 22:10:20.083671 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1531/2768] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:19 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:20.083671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2002038a-9f8d-4896-88ae-772fa3d95356 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:20.083671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2002038a-9f8d-4896-88ae-772fa3d95356 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:20.090008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2002038a-9f8d-4896-88ae-772fa3d95356 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:20.090641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2002038a-9f8d-4896-88ae-772fa3d95356 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:20.091089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2002038a-9f8d-4896-88ae-772fa3d95356 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:20.092975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2002038a-9f8d-4896-88ae-772fa3d95356 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:20.093443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2002038a-9f8d-4896-88ae-772fa3d95356 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:20.094025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2002038a-9f8d-4896-88ae-772fa3d95356 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:20.135091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:10:20.135673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:10:20.136358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:10:20.136894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:10:20.137382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:10:20.152965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:20.154219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:20.154880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:20.155854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:20.156646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:20.157293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:20.178346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Getting quotas for project 0287e296f1c9414e81fbd0212bde30ad. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:10:20.194653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Getting quotas for user 4c5adfbe06184b1e8531545707047456 and project 0287e296f1c9414e81fbd0212bde30ad. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:10:20.233389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:10:20.236271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:10:20.251678 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2002038a-9f8d-4896-88ae-772fa3d95356 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "POST /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95/action" status: 202 len: 0 microversion: 2.1 time: 0.176338 Oct 12 22:10:20.254104 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1532/2769] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:10:20 2022] POST /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:10:20.267632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ddf2e07f-2318-4b5d-9091-647bf433f5bf tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:20.273386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ddf2e07f-2318-4b5d-9091-647bf433f5bf tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:20.287979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddf2e07f-2318-4b5d-9091-647bf433f5bf tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:20.288480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddf2e07f-2318-4b5d-9091-647bf433f5bf tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:20.289367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddf2e07f-2318-4b5d-9091-647bf433f5bf tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:20.290797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddf2e07f-2318-4b5d-9091-647bf433f5bf tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:20.291342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddf2e07f-2318-4b5d-9091-647bf433f5bf tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:20.291954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddf2e07f-2318-4b5d-9091-647bf433f5bf tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:20.318091 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d1448b20-77e1-4e4b-ac6a-cbf3c575327e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.802649 Oct 12 22:10:20.319582 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1238/2770] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:10:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:10:20.331787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5344daa0-9257-42eb-ab53-a9810b9dc244 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:20.332601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5344daa0-9257-42eb-ab53-a9810b9dc244 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:20.547214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5344daa0-9257-42eb-ab53-a9810b9dc244 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:20.556528 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5344daa0-9257-42eb-ab53-a9810b9dc244 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1212 microversion: 2.1 time: 0.229104 Oct 12 22:10:20.557110 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1239/2771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:20 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1212 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:20.566958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=18 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:20.575348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bcf81653-f1a2-41b4-84c7-ae198c14ea32 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:20.589500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bcf81653-f1a2-41b4-84c7-ae198c14ea32 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:20.603826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcf81653-f1a2-41b4-84c7-ae198c14ea32 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:20.609164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcf81653-f1a2-41b4-84c7-ae198c14ea32 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:20.609649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcf81653-f1a2-41b4-84c7-ae198c14ea32 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:20.610393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcf81653-f1a2-41b4-84c7-ae198c14ea32 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:20.611123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcf81653-f1a2-41b4-84c7-ae198c14ea32 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:20.611592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcf81653-f1a2-41b4-84c7-ae198c14ea32 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:20.612414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ddf2e07f-2318-4b5d-9091-647bf433f5bf tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:20.638061 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ddf2e07f-2318-4b5d-9091-647bf433f5bf tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1575 microversion: 2.1 time: 0.381025 Oct 12 22:10:20.639110 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1533/2772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:20 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1575 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:20.884627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c5ed4b7e-0166-4363-8a83-49740a04283b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:20.885535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c5ed4b7e-0166-4363-8a83-49740a04283b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:20.899786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5ed4b7e-0166-4363-8a83-49740a04283b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:20.900455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5ed4b7e-0166-4363-8a83-49740a04283b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:20.900823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5ed4b7e-0166-4363-8a83-49740a04283b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:20.901614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5ed4b7e-0166-4363-8a83-49740a04283b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:20.902096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5ed4b7e-0166-4363-8a83-49740a04283b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:20.902502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5ed4b7e-0166-4363-8a83-49740a04283b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:21.148639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c5ed4b7e-0166-4363-8a83-49740a04283b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:21.160515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bcf81653-f1a2-41b4-84c7-ae198c14ea32 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:21.171534 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c5ed4b7e-0166-4363-8a83-49740a04283b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1471 microversion: 2.1 time: 0.291106 Oct 12 22:10:21.175735 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1534/2773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:20 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1471 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:21.178776 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bcf81653-f1a2-41b4-84c7-ae198c14ea32 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1318 microversion: 2.1 time: 0.613757 Oct 12 22:10:21.180441 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1240/2774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:20 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:21.182837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a93f2f7e-c99b-43e1-8200-bf051406d337 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:21.184262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a93f2f7e-c99b-43e1-8200-bf051406d337 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:21.190791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a93f2f7e-c99b-43e1-8200-bf051406d337 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:21.191866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a93f2f7e-c99b-43e1-8200-bf051406d337 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:21.192476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a93f2f7e-c99b-43e1-8200-bf051406d337 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:21.193338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a93f2f7e-c99b-43e1-8200-bf051406d337 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:21.194024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a93f2f7e-c99b-43e1-8200-bf051406d337 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:21.194609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a93f2f7e-c99b-43e1-8200-bf051406d337 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:21.301300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a93f2f7e-c99b-43e1-8200-bf051406d337 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:21.317165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a93f2f7e-c99b-43e1-8200-bf051406d337 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:21.318626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a93f2f7e-c99b-43e1-8200-bf051406d337 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:21.326640 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a93f2f7e-c99b-43e1-8200-bf051406d337 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1558 microversion: 2.91 time: 0.149408 Oct 12 22:10:21.327262 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1535/2775] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:21 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:21.582446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fa6f7932-2ec3-4195-8f23-d8a97755a5d1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:21.583080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fa6f7932-2ec3-4195-8f23-d8a97755a5d1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:21.593346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa6f7932-2ec3-4195-8f23-d8a97755a5d1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:21.595408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa6f7932-2ec3-4195-8f23-d8a97755a5d1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:21.597647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa6f7932-2ec3-4195-8f23-d8a97755a5d1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:21.598571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa6f7932-2ec3-4195-8f23-d8a97755a5d1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:21.601806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa6f7932-2ec3-4195-8f23-d8a97755a5d1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:21.602962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa6f7932-2ec3-4195-8f23-d8a97755a5d1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:21.663139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-60647298-46f1-4f88-a0d0-6b7fedea8c40 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:21.666695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-60647298-46f1-4f88-a0d0-6b7fedea8c40 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:21.684596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60647298-46f1-4f88-a0d0-6b7fedea8c40 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:21.685877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60647298-46f1-4f88-a0d0-6b7fedea8c40 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:21.686579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60647298-46f1-4f88-a0d0-6b7fedea8c40 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:21.687605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60647298-46f1-4f88-a0d0-6b7fedea8c40 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:21.688219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60647298-46f1-4f88-a0d0-6b7fedea8c40 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:21.688965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60647298-46f1-4f88-a0d0-6b7fedea8c40 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:21.716133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:21.803317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fa6f7932-2ec3-4195-8f23-d8a97755a5d1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:21.815576 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fa6f7932-2ec3-4195-8f23-d8a97755a5d1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1264 microversion: 2.1 time: 0.237129 Oct 12 22:10:21.828494 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1241/2776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:21 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1264 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:21.932741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-60647298-46f1-4f88-a0d0-6b7fedea8c40 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:21.941641 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-60647298-46f1-4f88-a0d0-6b7fedea8c40 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1575 microversion: 2.1 time: 0.283811 Oct 12 22:10:21.956258 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1536/2777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:21 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1575 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:22.200733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ffd4b72e-43e5-4ddf-823b-fdc226caaf5f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:22.201345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ffd4b72e-43e5-4ddf-823b-fdc226caaf5f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:22.206028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1194b41b-d1dc-4d08-bfb3-fabdd22672cc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:22.206974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1194b41b-d1dc-4d08-bfb3-fabdd22672cc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:22.216054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffd4b72e-43e5-4ddf-823b-fdc226caaf5f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:22.217835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffd4b72e-43e5-4ddf-823b-fdc226caaf5f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:22.219816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffd4b72e-43e5-4ddf-823b-fdc226caaf5f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:22.221044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffd4b72e-43e5-4ddf-823b-fdc226caaf5f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:22.221916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffd4b72e-43e5-4ddf-823b-fdc226caaf5f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:22.222524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffd4b72e-43e5-4ddf-823b-fdc226caaf5f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:22.224824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1194b41b-d1dc-4d08-bfb3-fabdd22672cc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:22.228290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1194b41b-d1dc-4d08-bfb3-fabdd22672cc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:22.230886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1194b41b-d1dc-4d08-bfb3-fabdd22672cc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:22.233037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1194b41b-d1dc-4d08-bfb3-fabdd22672cc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:22.235773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1194b41b-d1dc-4d08-bfb3-fabdd22672cc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:22.236497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1194b41b-d1dc-4d08-bfb3-fabdd22672cc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:22.582841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1194b41b-d1dc-4d08-bfb3-fabdd22672cc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:22.605032 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1194b41b-d1dc-4d08-bfb3-fabdd22672cc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1318 microversion: 2.1 time: 0.404353 Oct 12 22:10:22.619819 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1537/2778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:22 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:22.636776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-01e38297-ef5e-46e4-8a86-087ce3c9515a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:22.637682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-01e38297-ef5e-46e4-8a86-087ce3c9515a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:22.653216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01e38297-ef5e-46e4-8a86-087ce3c9515a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:22.655842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01e38297-ef5e-46e4-8a86-087ce3c9515a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:22.659855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01e38297-ef5e-46e4-8a86-087ce3c9515a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:22.661108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01e38297-ef5e-46e4-8a86-087ce3c9515a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:22.662065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01e38297-ef5e-46e4-8a86-087ce3c9515a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:22.662752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01e38297-ef5e-46e4-8a86-087ce3c9515a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:22.754320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-01e38297-ef5e-46e4-8a86-087ce3c9515a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:22.766231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-01e38297-ef5e-46e4-8a86-087ce3c9515a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:22.768395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-01e38297-ef5e-46e4-8a86-087ce3c9515a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:22.775709 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-01e38297-ef5e-46e4-8a86-087ce3c9515a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.153857 Oct 12 22:10:22.776734 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1538/2779] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:22 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:22.841011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-581426e1-5203-435b-952d-df8916357a42 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:22.841673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-581426e1-5203-435b-952d-df8916357a42 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:22.849605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-581426e1-5203-435b-952d-df8916357a42 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:22.850107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-581426e1-5203-435b-952d-df8916357a42 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:22.850567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-581426e1-5203-435b-952d-df8916357a42 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:22.851277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-581426e1-5203-435b-952d-df8916357a42 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:22.851740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-581426e1-5203-435b-952d-df8916357a42 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:22.852173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-581426e1-5203-435b-952d-df8916357a42 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:22.961094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-581426e1-5203-435b-952d-df8916357a42 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:22.972032 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-581426e1-5203-435b-952d-df8916357a42 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1270 microversion: 2.1 time: 0.135282 Oct 12 22:10:22.972806 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1539/2780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:22 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1270 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:22.977197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-03ffff78-7e35-4587-b2df-660741c9e179 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:22.978434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-03ffff78-7e35-4587-b2df-660741c9e179 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:22.984596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03ffff78-7e35-4587-b2df-660741c9e179 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:22.985074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03ffff78-7e35-4587-b2df-660741c9e179 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:22.985507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03ffff78-7e35-4587-b2df-660741c9e179 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:22.986194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03ffff78-7e35-4587-b2df-660741c9e179 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:22.986642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03ffff78-7e35-4587-b2df-660741c9e179 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:22.987471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03ffff78-7e35-4587-b2df-660741c9e179 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:23.224624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ffd4b72e-43e5-4ddf-823b-fdc226caaf5f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:23.238521 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ffd4b72e-43e5-4ddf-823b-fdc226caaf5f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1471 microversion: 2.1 time: 1.044194 Oct 12 22:10:23.241922 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1242/2781] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:22 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1471 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:23.280802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-03ffff78-7e35-4587-b2df-660741c9e179 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:23.291703 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-03ffff78-7e35-4587-b2df-660741c9e179 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1575 microversion: 2.1 time: 0.317992 Oct 12 22:10:23.308328 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1540/2782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:22 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1575 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:23.637422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-50239b59-329d-4abe-a8ba-d02debada23b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:23.638398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-50239b59-329d-4abe-a8ba-d02debada23b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:23.646525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50239b59-329d-4abe-a8ba-d02debada23b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:23.647428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50239b59-329d-4abe-a8ba-d02debada23b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:23.648099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50239b59-329d-4abe-a8ba-d02debada23b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:23.649364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50239b59-329d-4abe-a8ba-d02debada23b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:23.650231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50239b59-329d-4abe-a8ba-d02debada23b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:23.650877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50239b59-329d-4abe-a8ba-d02debada23b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:23.819416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-80ce3947-c6b9-42f0-9921-ea597e930c5e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:23.821623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-80ce3947-c6b9-42f0-9921-ea597e930c5e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:23.842766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80ce3947-c6b9-42f0-9921-ea597e930c5e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:23.843857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80ce3947-c6b9-42f0-9921-ea597e930c5e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:23.845175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80ce3947-c6b9-42f0-9921-ea597e930c5e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:23.850970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80ce3947-c6b9-42f0-9921-ea597e930c5e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:23.853352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80ce3947-c6b9-42f0-9921-ea597e930c5e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:23.856060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80ce3947-c6b9-42f0-9921-ea597e930c5e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:24.050254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-80ce3947-c6b9-42f0-9921-ea597e930c5e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:24.069574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-80ce3947-c6b9-42f0-9921-ea597e930c5e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:24.071991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-80ce3947-c6b9-42f0-9921-ea597e930c5e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:24.080590 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-80ce3947-c6b9-42f0-9921-ea597e930c5e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.276058 Oct 12 22:10:24.081513 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1541/2783] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:23 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:24.089333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-15902878-160c-4d94-bae4-07e2eb14ba9f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:24.090756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-15902878-160c-4d94-bae4-07e2eb14ba9f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:24.106216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15902878-160c-4d94-bae4-07e2eb14ba9f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:24.106216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15902878-160c-4d94-bae4-07e2eb14ba9f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:24.106216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15902878-160c-4d94-bae4-07e2eb14ba9f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:24.106955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15902878-160c-4d94-bae4-07e2eb14ba9f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:24.107871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15902878-160c-4d94-bae4-07e2eb14ba9f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:24.108435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15902878-160c-4d94-bae4-07e2eb14ba9f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:24.179227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-50239b59-329d-4abe-a8ba-d02debada23b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:24.216306 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-50239b59-329d-4abe-a8ba-d02debada23b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1318 microversion: 2.1 time: 0.586876 Oct 12 22:10:24.217160 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1243/2784] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:23 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1318 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:24.266095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a7dacbec-64b3-41eb-a33f-5f8590017fdc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:24.266095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a7dacbec-64b3-41eb-a33f-5f8590017fdc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:24.279262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7dacbec-64b3-41eb-a33f-5f8590017fdc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:24.279695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7dacbec-64b3-41eb-a33f-5f8590017fdc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:24.280129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7dacbec-64b3-41eb-a33f-5f8590017fdc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:24.288634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7dacbec-64b3-41eb-a33f-5f8590017fdc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:24.289146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7dacbec-64b3-41eb-a33f-5f8590017fdc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:24.289589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7dacbec-64b3-41eb-a33f-5f8590017fdc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:24.300989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-15902878-160c-4d94-bae4-07e2eb14ba9f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:24.324762 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-15902878-160c-4d94-bae4-07e2eb14ba9f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1270 microversion: 2.1 time: 0.241800 Oct 12 22:10:24.326121 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1542/2785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:24 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1270 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:24.347443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9be10953-22b2-42d1-b177-8903688359f2 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:24.350969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9be10953-22b2-42d1-b177-8903688359f2 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:24.375072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9be10953-22b2-42d1-b177-8903688359f2 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:24.375948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9be10953-22b2-42d1-b177-8903688359f2 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:24.376630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9be10953-22b2-42d1-b177-8903688359f2 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:24.377968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9be10953-22b2-42d1-b177-8903688359f2 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:24.379443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9be10953-22b2-42d1-b177-8903688359f2 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:24.380398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9be10953-22b2-42d1-b177-8903688359f2 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:24.699108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a7dacbec-64b3-41eb-a33f-5f8590017fdc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:24.720342 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a7dacbec-64b3-41eb-a33f-5f8590017fdc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1471 microversion: 2.1 time: 0.458192 Oct 12 22:10:24.729061 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1244/2786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:24 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1471 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:24.851028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9be10953-22b2-42d1-b177-8903688359f2 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:24.862203 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9be10953-22b2-42d1-b177-8903688359f2 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1573 microversion: 2.1 time: 0.533295 Oct 12 22:10:24.863595 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1543/2787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:24 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1573 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:24.891837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-60f2603d-ad5f-4b5c-a949-6385ed4d898c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-333677791"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:24.892983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-60f2603d-ad5f-4b5c-a949-6385ed4d898c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:24.902359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60f2603d-ad5f-4b5c-a949-6385ed4d898c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:24.903104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60f2603d-ad5f-4b5c-a949-6385ed4d898c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:24.903626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60f2603d-ad5f-4b5c-a949-6385ed4d898c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:24.904353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60f2603d-ad5f-4b5c-a949-6385ed4d898c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:24.904813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60f2603d-ad5f-4b5c-a949-6385ed4d898c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:24.905245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60f2603d-ad5f-4b5c-a949-6385ed4d898c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:25.114361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5dfaa89f-dfb4-4fa6-9624-2e4ddad4d445 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:25.114991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5dfaa89f-dfb4-4fa6-9624-2e4ddad4d445 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:25.146236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5dfaa89f-dfb4-4fa6-9624-2e4ddad4d445 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:25.146236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5dfaa89f-dfb4-4fa6-9624-2e4ddad4d445 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:25.146236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5dfaa89f-dfb4-4fa6-9624-2e4ddad4d445 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:25.147382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5dfaa89f-dfb4-4fa6-9624-2e4ddad4d445 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:25.147867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5dfaa89f-dfb4-4fa6-9624-2e4ddad4d445 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:25.150023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5dfaa89f-dfb4-4fa6-9624-2e4ddad4d445 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:25.303288 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.network.security_group_api [None req-60f2603d-ad5f-4b5c-a949-6385ed4d898c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Adding security group 2f623678-3fa3-4637-a7f4-997875304fc7 to port 738fc407-d734-4f84-b018-92200d206616 Oct 12 22:10:25.389200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5dfaa89f-dfb4-4fa6-9624-2e4ddad4d445 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:25.406390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5dfaa89f-dfb4-4fa6-9624-2e4ddad4d445 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:25.408171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5dfaa89f-dfb4-4fa6-9624-2e4ddad4d445 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:25.421119 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5dfaa89f-dfb4-4fa6-9624-2e4ddad4d445 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.311331 Oct 12 22:10:25.436071 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1544/2788] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:25 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:10:25.460183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1987a4b4-b50f-47db-a4d6-4aaf88632605 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:25.461045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1987a4b4-b50f-47db-a4d6-4aaf88632605 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:25.470871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1987a4b4-b50f-47db-a4d6-4aaf88632605 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:25.471399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1987a4b4-b50f-47db-a4d6-4aaf88632605 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:25.471837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1987a4b4-b50f-47db-a4d6-4aaf88632605 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:25.472543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1987a4b4-b50f-47db-a4d6-4aaf88632605 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:25.472988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1987a4b4-b50f-47db-a4d6-4aaf88632605 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:25.473580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1987a4b4-b50f-47db-a4d6-4aaf88632605 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:25.651692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1987a4b4-b50f-47db-a4d6-4aaf88632605 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:25.675323 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1987a4b4-b50f-47db-a4d6-4aaf88632605 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1318 microversion: 2.1 time: 0.234119 Oct 12 22:10:25.676231 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1545/2789] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:25 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:25.684207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bf535415-fdf4-4b3a-b61d-cf9700f360a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:25.684828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bf535415-fdf4-4b3a-b61d-cf9700f360a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:25.697579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf535415-fdf4-4b3a-b61d-cf9700f360a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:25.699533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf535415-fdf4-4b3a-b61d-cf9700f360a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:25.699995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf535415-fdf4-4b3a-b61d-cf9700f360a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:25.700788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf535415-fdf4-4b3a-b61d-cf9700f360a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:25.702639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf535415-fdf4-4b3a-b61d-cf9700f360a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:25.705108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf535415-fdf4-4b3a-b61d-cf9700f360a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:25.914353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bf535415-fdf4-4b3a-b61d-cf9700f360a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:25.922909 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bf535415-fdf4-4b3a-b61d-cf9700f360a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1312 microversion: 2.1 time: 0.245821 Oct 12 22:10:25.923526 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1546/2790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:25 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1312 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:25.936219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eb074b19-04bc-4110-890e-97754fc54018 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:25.936845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eb074b19-04bc-4110-890e-97754fc54018 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:25.953580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb074b19-04bc-4110-890e-97754fc54018 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:25.954073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb074b19-04bc-4110-890e-97754fc54018 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:25.954514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb074b19-04bc-4110-890e-97754fc54018 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:25.955224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb074b19-04bc-4110-890e-97754fc54018 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:25.955700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb074b19-04bc-4110-890e-97754fc54018 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:25.959301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb074b19-04bc-4110-890e-97754fc54018 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:26.209479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eb074b19-04bc-4110-890e-97754fc54018 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:26.220092 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eb074b19-04bc-4110-890e-97754fc54018 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1471 microversion: 2.1 time: 0.293698 Oct 12 22:10:26.221024 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1547/2791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:25 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1471 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:26.456343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-795525b4-139e-4795-94c6-515595c24377 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:26.457492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-795525b4-139e-4795-94c6-515595c24377 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:26.469150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-795525b4-139e-4795-94c6-515595c24377 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:26.474100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-795525b4-139e-4795-94c6-515595c24377 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:26.474927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-795525b4-139e-4795-94c6-515595c24377 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:26.478286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-795525b4-139e-4795-94c6-515595c24377 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:26.480731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-795525b4-139e-4795-94c6-515595c24377 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:26.481728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-795525b4-139e-4795-94c6-515595c24377 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:26.629661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-795525b4-139e-4795-94c6-515595c24377 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:26.641298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-795525b4-139e-4795-94c6-515595c24377 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:26.642874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-795525b4-139e-4795-94c6-515595c24377 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:26.645871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:26.675620 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-795525b4-139e-4795-94c6-515595c24377 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.223353 Oct 12 22:10:26.678705 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1548/2792] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:26 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:26.705309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-edf5585c-e3d6-4272-9c3f-82d17377be2a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:26.708845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-edf5585c-e3d6-4272-9c3f-82d17377be2a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:26.730081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-edf5585c-e3d6-4272-9c3f-82d17377be2a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:26.738460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-edf5585c-e3d6-4272-9c3f-82d17377be2a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:26.739022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-edf5585c-e3d6-4272-9c3f-82d17377be2a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:26.740027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-edf5585c-e3d6-4272-9c3f-82d17377be2a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:26.740568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-edf5585c-e3d6-4272-9c3f-82d17377be2a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:26.741071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-edf5585c-e3d6-4272-9c3f-82d17377be2a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:26.799880 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-60f2603d-ad5f-4b5c-a949-6385ed4d898c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "POST /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95/action" status: 202 len: 0 microversion: 2.1 time: 1.914500 Oct 12 22:10:26.800834 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1245/2793] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:10:24 2022] POST /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95/action => generated 0 bytes in 1917 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:10:26.809338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-894f503f-7a7e-4b55-8723-243dc1e4bad8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f51235af8b0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:27.093513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-edf5585c-e3d6-4272-9c3f-82d17377be2a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:27.109439 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-edf5585c-e3d6-4272-9c3f-82d17377be2a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1318 microversion: 2.1 time: 0.408036 Oct 12 22:10:27.132637 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1549/2794] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:26 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:27.144146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-7a1ae8c5-6fb2-4ca3-8f88-271361a72e22 req-9145b5ec-396d-4a0d-9ed3-2f77291e240f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51cce335-3600-4511-8ccd-8b837074bf95", "tag": "738fc407-d734-4f84-b018-92200d206616"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:27.204411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7a1ae8c5-6fb2-4ca3-8f88-271361a72e22 req-9145b5ec-396d-4a0d-9ed3-2f77291e240f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:27.207372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7a1ae8c5-6fb2-4ca3-8f88-271361a72e22 req-9145b5ec-396d-4a0d-9ed3-2f77291e240f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:27.210896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7a1ae8c5-6fb2-4ca3-8f88-271361a72e22 req-9145b5ec-396d-4a0d-9ed3-2f77291e240f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:27.265710 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-7a1ae8c5-6fb2-4ca3-8f88-271361a72e22 req-9145b5ec-396d-4a0d-9ed3-2f77291e240f service nova] Creating event network-changed:738fc407-d734-4f84-b018-92200d206616 for instance 51cce335-3600-4511-8ccd-8b837074bf95 on n-h1-861111-1 Oct 12 22:10:27.306714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG neutronclient.v2_0.client [None req-894f503f-7a7e-4b55-8723-243dc1e4bad8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 2f623678-3fa3-4637-a7f4-997875304fc7 in use.", "detail": ""}} {{(pid=120452) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:10:27.307457 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-894f503f-7a7e-4b55-8723-243dc1e4bad8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] HTTP exception thrown: Security Group 2f623678-3fa3-4637-a7f4-997875304fc7 in use. Oct 12 22:10:27.307457 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-794eb8ee-2d92-4ed6-8d17-b17e8e8216bd'] Oct 12 22:10:27.311157 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-7a1ae8c5-6fb2-4ca3-8f88-271361a72e22 req-9145b5ec-396d-4a0d-9ed3-2f77291e240f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173895 Oct 12 22:10:27.315007 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1550/2795] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-894f503f-7a7e-4b55-8723-243dc1e4bad8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Request method failure captured: Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/os-security-groups/2f623678-3fa3-4637-a7f4-997875304fc7 HTTP/1.1 Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzsOoCBjc82qYrgXGJcyS2C14AOyPaAY8jKON607aXBRETBa1-csxQQTd0dgLMFOSgjqcymNifeM8Cm_FMIYg-_UXGIEhCMX-O3n3HlLkfS0dfrzyRNsTuLIp0L-pAR76rzZrOO2f-Vw4UsY6dbCy5X6TdVdQGY9sHIG-ct3MYAKFNg Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_214f86d71a5749b9b98dffe934fe7f1f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 81e045d919104fa89572a2d05993abb8 Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: exception: Security Group 2f623678-3fa3-4637-a7f4-997875304fc7 in use. Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-794eb8ee-2d92-4ed6-8d17-b17e8e8216bd'] Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '2f623678-3fa3-4637-a7f4-997875304fc7'} Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:10:27.318713 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 2f623678-3fa3-4637-a7f4-997875304fc7 in use. Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-794eb8ee-2d92-4ed6-8d17-b17e8e8216bd'] Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 2f623678-3fa3-4637-a7f4-997875304fc7 in use. Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-794eb8ee-2d92-4ed6-8d17-b17e8e8216bd'] Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 2f623678-3fa3-4637-a7f4-997875304fc7 in use. Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-794eb8ee-2d92-4ed6-8d17-b17e8e8216bd'] Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 2f623678-3fa3-4637-a7f4-997875304fc7 in use. Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-794eb8ee-2d92-4ed6-8d17-b17e8e8216bd'] Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-894f503f-7a7e-4b55-8723-243dc1e4bad8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Returning 400 to user: Security Group 2f623678-3fa3-4637-a7f4-997875304fc7 in use. Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-794eb8ee-2d92-4ed6-8d17-b17e8e8216bd'] {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-894f503f-7a7e-4b55-8723-243dc1e4bad8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/2f623678-3fa3-4637-a7f4-997875304fc7" status: 400 len: 185 microversion: 2.1 time: 0.515771 Oct 12 22:10:27.323279 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1246/2796] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:10:26 2022] DELETE /compute/v2.1/os-security-groups/2f623678-3fa3-4637-a7f4-997875304fc7 => generated 185 bytes in 517 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 12 22:10:27.342277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9459c2bf-474e-4fd6-a7f8-c08024a5c1ff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:27.342965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9459c2bf-474e-4fd6-a7f8-c08024a5c1ff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:27.344903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-98be64e3-f967-481e-8c7a-16f9206b806c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:27.352947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-98be64e3-f967-481e-8c7a-16f9206b806c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:27.364060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9459c2bf-474e-4fd6-a7f8-c08024a5c1ff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:27.364707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9459c2bf-474e-4fd6-a7f8-c08024a5c1ff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:27.365636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9459c2bf-474e-4fd6-a7f8-c08024a5c1ff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:27.367220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9459c2bf-474e-4fd6-a7f8-c08024a5c1ff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:27.368028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9459c2bf-474e-4fd6-a7f8-c08024a5c1ff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:27.368475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9459c2bf-474e-4fd6-a7f8-c08024a5c1ff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:27.385735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98be64e3-f967-481e-8c7a-16f9206b806c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:27.386315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98be64e3-f967-481e-8c7a-16f9206b806c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:27.386849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98be64e3-f967-481e-8c7a-16f9206b806c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:27.387716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98be64e3-f967-481e-8c7a-16f9206b806c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:27.391727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98be64e3-f967-481e-8c7a-16f9206b806c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:27.392553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98be64e3-f967-481e-8c7a-16f9206b806c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:27.941214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-98be64e3-f967-481e-8c7a-16f9206b806c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:27.951515 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-98be64e3-f967-481e-8c7a-16f9206b806c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1333 microversion: 2.1 time: 0.632356 Oct 12 22:10:27.961658 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1551/2797] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:27 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1333 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:27.998571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9f3a5fd6-d613-43bf-8d56-f32c3391547f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:27.999500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9f3a5fd6-d613-43bf-8d56-f32c3391547f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:28.017384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f3a5fd6-d613-43bf-8d56-f32c3391547f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:28.017830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f3a5fd6-d613-43bf-8d56-f32c3391547f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:28.018356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f3a5fd6-d613-43bf-8d56-f32c3391547f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:28.019087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f3a5fd6-d613-43bf-8d56-f32c3391547f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:28.019747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f3a5fd6-d613-43bf-8d56-f32c3391547f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:28.020232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f3a5fd6-d613-43bf-8d56-f32c3391547f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:28.122976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9f3a5fd6-d613-43bf-8d56-f32c3391547f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:10:28.246223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:28.327361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9459c2bf-474e-4fd6-a7f8-c08024a5c1ff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:28.363706 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9459c2bf-474e-4fd6-a7f8-c08024a5c1ff tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1471 microversion: 2.1 time: 1.037113 Oct 12 22:10:28.364360 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1247/2798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:27 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1471 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:28.385910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3382a158-91f1-486d-b998-061997a2fa4e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:28.386576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3382a158-91f1-486d-b998-061997a2fa4e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:28.405439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3382a158-91f1-486d-b998-061997a2fa4e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:28.417861 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9f3a5fd6-d613-43bf-8d56-f32c3391547f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 204 len: 0 microversion: 2.1 time: 0.454435 Oct 12 22:10:28.418461 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1552/2799] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:10:27 2022] DELETE /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:10:28.422529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3382a158-91f1-486d-b998-061997a2fa4e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:28.422978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3382a158-91f1-486d-b998-061997a2fa4e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:28.423750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3382a158-91f1-486d-b998-061997a2fa4e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:28.424204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3382a158-91f1-486d-b998-061997a2fa4e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:28.424350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-156c1574-ad4f-43a6-8eda-a4d6546c225f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:28.424626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3382a158-91f1-486d-b998-061997a2fa4e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:28.425067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-156c1574-ad4f-43a6-8eda-a4d6546c225f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:28.442562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-156c1574-ad4f-43a6-8eda-a4d6546c225f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:28.443091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-156c1574-ad4f-43a6-8eda-a4d6546c225f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:28.443536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-156c1574-ad4f-43a6-8eda-a4d6546c225f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:28.444247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-156c1574-ad4f-43a6-8eda-a4d6546c225f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:28.444934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-156c1574-ad4f-43a6-8eda-a4d6546c225f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:28.445541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-156c1574-ad4f-43a6-8eda-a4d6546c225f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:28.508432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:28.715379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3382a158-91f1-486d-b998-061997a2fa4e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:28.737341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3382a158-91f1-486d-b998-061997a2fa4e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:28.742573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3382a158-91f1-486d-b998-061997a2fa4e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:28.783592 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3382a158-91f1-486d-b998-061997a2fa4e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.410456 Oct 12 22:10:28.784199 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1248/2800] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:28 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:28.802415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3de41cef-630d-451c-b19e-2d9a16964d18 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:28.802415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3de41cef-630d-451c-b19e-2d9a16964d18 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:28.820002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3de41cef-630d-451c-b19e-2d9a16964d18 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:28.820505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3de41cef-630d-451c-b19e-2d9a16964d18 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:28.820981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3de41cef-630d-451c-b19e-2d9a16964d18 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:28.821701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3de41cef-630d-451c-b19e-2d9a16964d18 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:28.822152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3de41cef-630d-451c-b19e-2d9a16964d18 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:28.822576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3de41cef-630d-451c-b19e-2d9a16964d18 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:28.908032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-156c1574-ad4f-43a6-8eda-a4d6546c225f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:28.922197 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-156c1574-ad4f-43a6-8eda-a4d6546c225f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1318 microversion: 2.1 time: 0.499846 Oct 12 22:10:28.936504 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1553/2801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:28 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:28.984642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a1d86291-25db-47ae-b32f-4efb565ceed7 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:28.985574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a1d86291-25db-47ae-b32f-4efb565ceed7 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:29.003704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1d86291-25db-47ae-b32f-4efb565ceed7 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:29.004739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1d86291-25db-47ae-b32f-4efb565ceed7 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:29.006108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1d86291-25db-47ae-b32f-4efb565ceed7 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:29.010309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1d86291-25db-47ae-b32f-4efb565ceed7 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:29.011047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1d86291-25db-47ae-b32f-4efb565ceed7 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:29.012346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1d86291-25db-47ae-b32f-4efb565ceed7 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:29.460464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3de41cef-630d-451c-b19e-2d9a16964d18 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:29.483584 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3de41cef-630d-451c-b19e-2d9a16964d18 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1647 microversion: 2.1 time: 0.698279 Oct 12 22:10:29.488568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a1d86291-25db-47ae-b32f-4efb565ceed7 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:29.503402 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1249/2802] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:28 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1647 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:29.507186 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a1d86291-25db-47ae-b32f-4efb565ceed7 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.526605 Oct 12 22:10:29.510215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-02f96623-1d32-4195-b99d-c0ab2b85eeb9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:29.511148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-02f96623-1d32-4195-b99d-c0ab2b85eeb9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:29.511340 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1554/2803] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:28 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:29.517896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02f96623-1d32-4195-b99d-c0ab2b85eeb9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:29.518612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02f96623-1d32-4195-b99d-c0ab2b85eeb9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:29.519264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02f96623-1d32-4195-b99d-c0ab2b85eeb9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:29.520158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02f96623-1d32-4195-b99d-c0ab2b85eeb9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:29.520787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02f96623-1d32-4195-b99d-c0ab2b85eeb9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:29.521540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02f96623-1d32-4195-b99d-c0ab2b85eeb9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:29.831305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9947f86d-0417-4e44-9e94-132571eceff6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:29.836445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9947f86d-0417-4e44-9e94-132571eceff6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:29.886499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9947f86d-0417-4e44-9e94-132571eceff6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:29.887404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9947f86d-0417-4e44-9e94-132571eceff6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:29.888011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9947f86d-0417-4e44-9e94-132571eceff6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:29.888900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9947f86d-0417-4e44-9e94-132571eceff6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:29.889513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9947f86d-0417-4e44-9e94-132571eceff6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:29.890099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9947f86d-0417-4e44-9e94-132571eceff6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:30.018742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9947f86d-0417-4e44-9e94-132571eceff6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:30.029739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9947f86d-0417-4e44-9e94-132571eceff6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:30.031221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9947f86d-0417-4e44-9e94-132571eceff6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:30.056432 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9947f86d-0417-4e44-9e94-132571eceff6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.237324 Oct 12 22:10:30.060477 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1555/2804] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:29 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:30.065266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3fba75d0-b24f-4392-8399-017a888bb7d3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:30.065880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3fba75d0-b24f-4392-8399-017a888bb7d3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:30.088110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fba75d0-b24f-4392-8399-017a888bb7d3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:30.088603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fba75d0-b24f-4392-8399-017a888bb7d3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:30.089252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fba75d0-b24f-4392-8399-017a888bb7d3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:30.090333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fba75d0-b24f-4392-8399-017a888bb7d3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:30.090796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fba75d0-b24f-4392-8399-017a888bb7d3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:30.091229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fba75d0-b24f-4392-8399-017a888bb7d3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:30.168274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:30.283618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-02f96623-1d32-4195-b99d-c0ab2b85eeb9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:30.299638 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-02f96623-1d32-4195-b99d-c0ab2b85eeb9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1471 microversion: 2.1 time: 0.794759 Oct 12 22:10:30.302209 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1250/2805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:29 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1471 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:30.355609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-3eef7a3f-97aa-46bb-904e-3ffc310b7c99 req-dfff7d28-6ea1-4c2a-a85b-ee3d68a86593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29922f3d-5384-486f-8968-4fd73fd9016d", "name": "network-vif-plugged", "status": "completed", "tag": "352fa9f3-0c18-4a3c-8393-47d9c4910a0d"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:30.379864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3eef7a3f-97aa-46bb-904e-3ffc310b7c99 req-dfff7d28-6ea1-4c2a-a85b-ee3d68a86593 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:30.382426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3eef7a3f-97aa-46bb-904e-3ffc310b7c99 req-dfff7d28-6ea1-4c2a-a85b-ee3d68a86593 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:30.383106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3eef7a3f-97aa-46bb-904e-3ffc310b7c99 req-dfff7d28-6ea1-4c2a-a85b-ee3d68a86593 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:30.414048 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-3eef7a3f-97aa-46bb-904e-3ffc310b7c99 req-dfff7d28-6ea1-4c2a-a85b-ee3d68a86593 service nova] Creating event network-vif-plugged:352fa9f3-0c18-4a3c-8393-47d9c4910a0d for instance 29922f3d-5384-486f-8968-4fd73fd9016d on n-h1-861111-1 Oct 12 22:10:30.427223 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-3eef7a3f-97aa-46bb-904e-3ffc310b7c99 req-dfff7d28-6ea1-4c2a-a85b-ee3d68a86593 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075557 Oct 12 22:10:30.431809 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1251/2806] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:10:30.518869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ce7568e4-5e33-4511-b3a5-29040d987456 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:30.520558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ce7568e4-5e33-4511-b3a5-29040d987456 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:30.534465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce7568e4-5e33-4511-b3a5-29040d987456 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:30.536061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce7568e4-5e33-4511-b3a5-29040d987456 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:30.538717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce7568e4-5e33-4511-b3a5-29040d987456 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:30.540471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce7568e4-5e33-4511-b3a5-29040d987456 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:30.543639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce7568e4-5e33-4511-b3a5-29040d987456 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:30.544733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce7568e4-5e33-4511-b3a5-29040d987456 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:30.545426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3fba75d0-b24f-4392-8399-017a888bb7d3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:30.572465 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3fba75d0-b24f-4392-8399-017a888bb7d3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1318 microversion: 2.1 time: 0.510821 Oct 12 22:10:30.592926 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1556/2807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:30 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:30.606725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ce456746-71f1-45e5-b6bf-82d5837c53bc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:30.607669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ce456746-71f1-45e5-b6bf-82d5837c53bc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:30.620084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce456746-71f1-45e5-b6bf-82d5837c53bc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:30.625091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce456746-71f1-45e5-b6bf-82d5837c53bc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:30.625814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce456746-71f1-45e5-b6bf-82d5837c53bc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:30.627312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce456746-71f1-45e5-b6bf-82d5837c53bc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:30.627970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce456746-71f1-45e5-b6bf-82d5837c53bc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:30.628626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce456746-71f1-45e5-b6bf-82d5837c53bc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:30.671604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:31.044915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ce456746-71f1-45e5-b6bf-82d5837c53bc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:31.054360 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ce456746-71f1-45e5-b6bf-82d5837c53bc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.459962 Oct 12 22:10:31.054952 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1557/2808] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:30 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:31.090457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c1b0d71b-c005-449a-bf3b-9b0b05ea6e4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:31.091475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c1b0d71b-c005-449a-bf3b-9b0b05ea6e4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:31.106639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1b0d71b-c005-449a-bf3b-9b0b05ea6e4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:31.108316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1b0d71b-c005-449a-bf3b-9b0b05ea6e4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:31.109167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1b0d71b-c005-449a-bf3b-9b0b05ea6e4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:31.110979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1b0d71b-c005-449a-bf3b-9b0b05ea6e4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:31.114374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1b0d71b-c005-449a-bf3b-9b0b05ea6e4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:31.116159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1b0d71b-c005-449a-bf3b-9b0b05ea6e4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:31.331785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c1b0d71b-c005-449a-bf3b-9b0b05ea6e4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:31.347412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c1b0d71b-c005-449a-bf3b-9b0b05ea6e4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:31.349301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c1b0d71b-c005-449a-bf3b-9b0b05ea6e4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:31.358226 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c1b0d71b-c005-449a-bf3b-9b0b05ea6e4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.273558 Oct 12 22:10:31.360366 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1558/2809] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:31 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:31.367151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-042eadce-dad0-49fc-9139-98b59102ee2e tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:31.368385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-042eadce-dad0-49fc-9139-98b59102ee2e tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:31.388621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-042eadce-dad0-49fc-9139-98b59102ee2e tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:31.389122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-042eadce-dad0-49fc-9139-98b59102ee2e tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:31.389625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-042eadce-dad0-49fc-9139-98b59102ee2e tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:31.391014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-042eadce-dad0-49fc-9139-98b59102ee2e tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:31.391709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-042eadce-dad0-49fc-9139-98b59102ee2e tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:31.392146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-042eadce-dad0-49fc-9139-98b59102ee2e tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:31.634843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-042eadce-dad0-49fc-9139-98b59102ee2e tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:31.659736 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-042eadce-dad0-49fc-9139-98b59102ee2e tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1477 microversion: 2.1 time: 0.297794 Oct 12 22:10:31.660671 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1559/2810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:31 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1477 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:31.673203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-28ef57a6-5ab6-46b2-bce4-4da1cc3931d6 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:31.676559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-28ef57a6-5ab6-46b2-bce4-4da1cc3931d6 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:31.695640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28ef57a6-5ab6-46b2-bce4-4da1cc3931d6 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:31.697738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28ef57a6-5ab6-46b2-bce4-4da1cc3931d6 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:31.698405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28ef57a6-5ab6-46b2-bce4-4da1cc3931d6 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:31.699426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28ef57a6-5ab6-46b2-bce4-4da1cc3931d6 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:31.700104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28ef57a6-5ab6-46b2-bce4-4da1cc3931d6 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:31.705803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28ef57a6-5ab6-46b2-bce4-4da1cc3931d6 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:31.969966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ce7568e4-5e33-4511-b3a5-29040d987456 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:31.969966 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ce7568e4-5e33-4511-b3a5-29040d987456 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1647 microversion: 2.1 time: 1.431910 Oct 12 22:10:31.969966 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1252/2811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:30 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1647 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:32.084954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dccb3676-a1a0-4c2d-a34d-d165e264b833 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:32.086130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dccb3676-a1a0-4c2d-a34d-d165e264b833 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:32.119664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dccb3676-a1a0-4c2d-a34d-d165e264b833 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:32.120600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dccb3676-a1a0-4c2d-a34d-d165e264b833 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:32.121228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dccb3676-a1a0-4c2d-a34d-d165e264b833 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:32.122382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dccb3676-a1a0-4c2d-a34d-d165e264b833 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:32.122993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dccb3676-a1a0-4c2d-a34d-d165e264b833 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:32.123661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dccb3676-a1a0-4c2d-a34d-d165e264b833 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:32.145376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-28ef57a6-5ab6-46b2-bce4-4da1cc3931d6 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:32.158000 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-28ef57a6-5ab6-46b2-bce4-4da1cc3931d6 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1318 microversion: 2.1 time: 0.495965 Oct 12 22:10:32.177622 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1560/2812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:31 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1318 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:32.388406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fca48605-6df7-4319-ab6a-53aab9efabe4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:32.389265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fca48605-6df7-4319-ab6a-53aab9efabe4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:32.410733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fca48605-6df7-4319-ab6a-53aab9efabe4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:32.411259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fca48605-6df7-4319-ab6a-53aab9efabe4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:32.411731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fca48605-6df7-4319-ab6a-53aab9efabe4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:32.412458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fca48605-6df7-4319-ab6a-53aab9efabe4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:32.412930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fca48605-6df7-4319-ab6a-53aab9efabe4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:32.413364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fca48605-6df7-4319-ab6a-53aab9efabe4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:32.553422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fca48605-6df7-4319-ab6a-53aab9efabe4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:32.563456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fca48605-6df7-4319-ab6a-53aab9efabe4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:32.575599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fca48605-6df7-4319-ab6a-53aab9efabe4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:32.592196 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fca48605-6df7-4319-ab6a-53aab9efabe4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.209963 Oct 12 22:10:32.619945 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1561/2813] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:32 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:10:32.642132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a33a15d8-196e-432f-9c9d-19235667c99f req-87746afa-12d5-46ec-bb44-d927e06c7f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b862f7de-fe9b-49bc-9e77-0d3e453558e8", "name": "network-vif-plugged", "status": "completed", "tag": "4e7ca35a-5772-4985-baa1-a73c3a5acaa8"}, {"server_uuid": "4023ebba-05d4-4225-938a-c70c2490ae29", "name": "network-vif-plugged", "status": "completed", "tag": "16f27b0f-2034-49b1-8fc7-d037682a37a4"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:32.658796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a33a15d8-196e-432f-9c9d-19235667c99f req-87746afa-12d5-46ec-bb44-d927e06c7f75 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:32.663792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a33a15d8-196e-432f-9c9d-19235667c99f req-87746afa-12d5-46ec-bb44-d927e06c7f75 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:32.664392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a33a15d8-196e-432f-9c9d-19235667c99f req-87746afa-12d5-46ec-bb44-d927e06c7f75 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:32.699808 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a33a15d8-196e-432f-9c9d-19235667c99f req-87746afa-12d5-46ec-bb44-d927e06c7f75 service nova] Creating event network-vif-plugged:4e7ca35a-5772-4985-baa1-a73c3a5acaa8 for instance b862f7de-fe9b-49bc-9e77-0d3e453558e8 on n-h2-861111-1 Oct 12 22:10:32.704881 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a33a15d8-196e-432f-9c9d-19235667c99f req-87746afa-12d5-46ec-bb44-d927e06c7f75 service nova] Creating event network-vif-plugged:16f27b0f-2034-49b1-8fc7-d037682a37a4 for instance 4023ebba-05d4-4225-938a-c70c2490ae29 on n-h2-861111-1 Oct 12 22:10:32.727016 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a33a15d8-196e-432f-9c9d-19235667c99f req-87746afa-12d5-46ec-bb44-d927e06c7f75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089113 Oct 12 22:10:32.730014 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1562/2814] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:32.742478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b912f8bb-b67a-4dc6-98c0-3921f3b49fa3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:32.745675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b912f8bb-b67a-4dc6-98c0-3921f3b49fa3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:32.778372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b912f8bb-b67a-4dc6-98c0-3921f3b49fa3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:32.779088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b912f8bb-b67a-4dc6-98c0-3921f3b49fa3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:32.783701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b912f8bb-b67a-4dc6-98c0-3921f3b49fa3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:32.787018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b912f8bb-b67a-4dc6-98c0-3921f3b49fa3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:32.789158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b912f8bb-b67a-4dc6-98c0-3921f3b49fa3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:32.789983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b912f8bb-b67a-4dc6-98c0-3921f3b49fa3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:33.028532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dccb3676-a1a0-4c2d-a34d-d165e264b833 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:33.038581 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dccb3676-a1a0-4c2d-a34d-d165e264b833 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.960861 Oct 12 22:10:33.052331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b912f8bb-b67a-4dc6-98c0-3921f3b49fa3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:33.053473 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1253/2815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:32 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:33.061780 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b912f8bb-b67a-4dc6-98c0-3921f3b49fa3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1477 microversion: 2.1 time: 0.327980 Oct 12 22:10:33.062555 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1563/2816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:32 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1477 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:33.066997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a0feffb1-d72c-4c57-8077-01641430d22d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:33.075716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a0feffb1-d72c-4c57-8077-01641430d22d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:33.096074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0feffb1-d72c-4c57-8077-01641430d22d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:33.096574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0feffb1-d72c-4c57-8077-01641430d22d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:33.097009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0feffb1-d72c-4c57-8077-01641430d22d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:33.097724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0feffb1-d72c-4c57-8077-01641430d22d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:33.098175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0feffb1-d72c-4c57-8077-01641430d22d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:33.098606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0feffb1-d72c-4c57-8077-01641430d22d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:33.186730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0517034c-5f09-4104-a877-e2119508e25d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:33.199265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0517034c-5f09-4104-a877-e2119508e25d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:33.200846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0517034c-5f09-4104-a877-e2119508e25d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:33.207189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0517034c-5f09-4104-a877-e2119508e25d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:33.207699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0517034c-5f09-4104-a877-e2119508e25d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:33.216106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0517034c-5f09-4104-a877-e2119508e25d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:33.216819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0517034c-5f09-4104-a877-e2119508e25d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:33.217283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0517034c-5f09-4104-a877-e2119508e25d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:33.325783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a0feffb1-d72c-4c57-8077-01641430d22d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:33.335289 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a0feffb1-d72c-4c57-8077-01641430d22d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1469 microversion: 2.1 time: 0.280650 Oct 12 22:10:33.344337 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1254/2817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:33 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1469 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:33.439314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-ceac0c2c-7c2d-4f84-9aae-2ff80fa2c292 req-2833ae6b-9f17-4fa7-ba73-056f2bda1e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fae77315-a6c0-474c-aef9-5c8edda79113", "tag": "78b7a819-d94a-4d81-ad53-c90d49702e64"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:33.492213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ceac0c2c-7c2d-4f84-9aae-2ff80fa2c292 req-2833ae6b-9f17-4fa7-ba73-056f2bda1e22 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:33.493602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ceac0c2c-7c2d-4f84-9aae-2ff80fa2c292 req-2833ae6b-9f17-4fa7-ba73-056f2bda1e22 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:33.499933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ceac0c2c-7c2d-4f84-9aae-2ff80fa2c292 req-2833ae6b-9f17-4fa7-ba73-056f2bda1e22 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:33.501788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0517034c-5f09-4104-a877-e2119508e25d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:33.513112 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0517034c-5f09-4104-a877-e2119508e25d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1318 microversion: 2.1 time: 0.330549 Oct 12 22:10:33.529008 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1564/2818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:33 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:33.537523 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-ceac0c2c-7c2d-4f84-9aae-2ff80fa2c292 req-2833ae6b-9f17-4fa7-ba73-056f2bda1e22 service nova] Creating event network-changed:78b7a819-d94a-4d81-ad53-c90d49702e64 for instance fae77315-a6c0-474c-aef9-5c8edda79113 on n-h2-861111-1 Oct 12 22:10:33.550763 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-ceac0c2c-7c2d-4f84-9aae-2ff80fa2c292 req-2833ae6b-9f17-4fa7-ba73-056f2bda1e22 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117278 Oct 12 22:10:33.556690 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1255/2819] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:33.628636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-883cad6b-f52e-49b9-b888-db5572d40c0b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:33.629373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-883cad6b-f52e-49b9-b888-db5572d40c0b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:33.642102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883cad6b-f52e-49b9-b888-db5572d40c0b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:33.643850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883cad6b-f52e-49b9-b888-db5572d40c0b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:33.646022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883cad6b-f52e-49b9-b888-db5572d40c0b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:33.647060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883cad6b-f52e-49b9-b888-db5572d40c0b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:33.657198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883cad6b-f52e-49b9-b888-db5572d40c0b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:33.657981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883cad6b-f52e-49b9-b888-db5572d40c0b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:33.908589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-883cad6b-f52e-49b9-b888-db5572d40c0b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:33.934476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-883cad6b-f52e-49b9-b888-db5572d40c0b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:33.943511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-883cad6b-f52e-49b9-b888-db5572d40c0b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:33.967812 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-883cad6b-f52e-49b9-b888-db5572d40c0b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.345129 Oct 12 22:10:33.982667 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1565/2820] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:33 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:34.066102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fe398b4d-7c88-497f-8bc9-988fa264272a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:34.068229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fe398b4d-7c88-497f-8bc9-988fa264272a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:34.091189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-de9faf97-b850-42e5-aae7-03b5e34c2174 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:34.092073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-de9faf97-b850-42e5-aae7-03b5e34c2174 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:34.108233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de9faf97-b850-42e5-aae7-03b5e34c2174 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:34.108890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe398b4d-7c88-497f-8bc9-988fa264272a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:34.113331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe398b4d-7c88-497f-8bc9-988fa264272a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:34.113992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe398b4d-7c88-497f-8bc9-988fa264272a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:34.115872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de9faf97-b850-42e5-aae7-03b5e34c2174 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:34.120650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de9faf97-b850-42e5-aae7-03b5e34c2174 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:34.123204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe398b4d-7c88-497f-8bc9-988fa264272a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:34.124212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de9faf97-b850-42e5-aae7-03b5e34c2174 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:34.124859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe398b4d-7c88-497f-8bc9-988fa264272a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:34.125447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de9faf97-b850-42e5-aae7-03b5e34c2174 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:34.126048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe398b4d-7c88-497f-8bc9-988fa264272a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:34.128208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de9faf97-b850-42e5-aae7-03b5e34c2174 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:34.496845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-de9faf97-b850-42e5-aae7-03b5e34c2174 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:34.506547 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-de9faf97-b850-42e5-aae7-03b5e34c2174 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1477 microversion: 2.1 time: 0.420103 Oct 12 22:10:34.514024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fe398b4d-7c88-497f-8bc9-988fa264272a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:34.522267 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fe398b4d-7c88-497f-8bc9-988fa264272a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.462369 Oct 12 22:10:34.524279 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1566/2821] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:34 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1477 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:34.525059 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1256/2822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:34 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:34.529628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe92762f-9f29-4926-814e-44651f8e37fe tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:34.530437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fe92762f-9f29-4926-814e-44651f8e37fe tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:34.537966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe92762f-9f29-4926-814e-44651f8e37fe tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:34.538712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe92762f-9f29-4926-814e-44651f8e37fe tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:34.539379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe92762f-9f29-4926-814e-44651f8e37fe tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:34.547564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe92762f-9f29-4926-814e-44651f8e37fe tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:34.548259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6a03622f-825c-4058-8eba-c910dee74a51 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:34.549059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6a03622f-825c-4058-8eba-c910dee74a51 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:34.549803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe92762f-9f29-4926-814e-44651f8e37fe tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:34.552331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe92762f-9f29-4926-814e-44651f8e37fe tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:34.567567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a03622f-825c-4058-8eba-c910dee74a51 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:34.568366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a03622f-825c-4058-8eba-c910dee74a51 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:34.571625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a03622f-825c-4058-8eba-c910dee74a51 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:34.572694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a03622f-825c-4058-8eba-c910dee74a51 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:34.573424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a03622f-825c-4058-8eba-c910dee74a51 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:34.587648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a03622f-825c-4058-8eba-c910dee74a51 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:34.760970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe92762f-9f29-4926-814e-44651f8e37fe tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:34.760970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe92762f-9f29-4926-814e-44651f8e37fe tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:34.760970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe92762f-9f29-4926-814e-44651f8e37fe tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:34.760970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-fe92762f-9f29-4926-814e-44651f8e37fe tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lazy-loading 'fault' on Instance uuid 51cce335-3600-4511-8ccd-8b837074bf95 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:10:34.926755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fe92762f-9f29-4926-814e-44651f8e37fe tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:34.939226 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fe92762f-9f29-4926-814e-44651f8e37fe tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 200 len: 1474 microversion: 2.1 time: 0.413323 Oct 12 22:10:34.945564 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1567/2823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:34 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 1474 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:34.960782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-9cc61aca-1910-49b8-819e-95b16012e6d7 req-3cb226c2-7e18-4c18-a26e-4e07ec20c1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b0eb54-219e-4026-b96c-59b963b0f770", "name": "network-vif-unplugged", "status": "completed", "tag": "72cdcc3a-ba0f-41c3-9bb0-97a69bd68560"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:34.998644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9cc61aca-1910-49b8-819e-95b16012e6d7 req-3cb226c2-7e18-4c18-a26e-4e07ec20c1d4 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:34.999439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9cc61aca-1910-49b8-819e-95b16012e6d7 req-3cb226c2-7e18-4c18-a26e-4e07ec20c1d4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:35.000061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9cc61aca-1910-49b8-819e-95b16012e6d7 req-3cb226c2-7e18-4c18-a26e-4e07ec20c1d4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:35.039863 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-9cc61aca-1910-49b8-819e-95b16012e6d7 req-3cb226c2-7e18-4c18-a26e-4e07ec20c1d4 service nova] Creating event network-vif-unplugged:72cdcc3a-ba0f-41c3-9bb0-97a69bd68560 for instance f3b0eb54-219e-4026-b96c-59b963b0f770 on n-h1-861111-1 Oct 12 22:10:35.045681 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-9cc61aca-1910-49b8-819e-95b16012e6d7 req-3cb226c2-7e18-4c18-a26e-4e07ec20c1d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095352 Oct 12 22:10:35.048365 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1568/2824] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:35.082252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-172f0dd5-d0d9-48e8-9d24-7dfa1378dbf5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:35.084787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-172f0dd5-d0d9-48e8-9d24-7dfa1378dbf5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:35.100462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-172f0dd5-d0d9-48e8-9d24-7dfa1378dbf5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:35.103587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-172f0dd5-d0d9-48e8-9d24-7dfa1378dbf5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:35.106325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-172f0dd5-d0d9-48e8-9d24-7dfa1378dbf5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:35.108329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-172f0dd5-d0d9-48e8-9d24-7dfa1378dbf5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:35.110520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-172f0dd5-d0d9-48e8-9d24-7dfa1378dbf5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:35.110979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-172f0dd5-d0d9-48e8-9d24-7dfa1378dbf5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:35.220420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6a03622f-825c-4058-8eba-c910dee74a51 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:35.238830 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6a03622f-825c-4058-8eba-c910dee74a51 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1468 microversion: 2.1 time: 0.697055 Oct 12 22:10:35.252364 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1257/2825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:34 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1468 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:35.265795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2b0792da-6af6-4436-bc52-5f73b2515681 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:35.279500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2b0792da-6af6-4436-bc52-5f73b2515681 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: b862f7de-fe9b-49bc-9e77-0d3e453558e8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:35.296048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-172f0dd5-d0d9-48e8-9d24-7dfa1378dbf5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:35.299845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:35.305695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-172f0dd5-d0d9-48e8-9d24-7dfa1378dbf5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:35.307272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-172f0dd5-d0d9-48e8-9d24-7dfa1378dbf5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:35.314252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b0792da-6af6-4436-bc52-5f73b2515681 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:35.316556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b0792da-6af6-4436-bc52-5f73b2515681 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:35.320148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b0792da-6af6-4436-bc52-5f73b2515681 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:35.320678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b0792da-6af6-4436-bc52-5f73b2515681 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:35.322416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b0792da-6af6-4436-bc52-5f73b2515681 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:35.328050 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-172f0dd5-d0d9-48e8-9d24-7dfa1378dbf5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.263510 Oct 12 22:10:35.328847 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1569/2826] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:35 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:35.334664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b0792da-6af6-4436-bc52-5f73b2515681 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:35.530468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ce3affbf-ce69-4571-b13e-a04b8ba58cac tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:35.531498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ce3affbf-ce69-4571-b13e-a04b8ba58cac tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:35.545838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce3affbf-ce69-4571-b13e-a04b8ba58cac tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:35.546728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce3affbf-ce69-4571-b13e-a04b8ba58cac tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:35.547367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce3affbf-ce69-4571-b13e-a04b8ba58cac tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:35.550271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce3affbf-ce69-4571-b13e-a04b8ba58cac tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:35.550957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce3affbf-ce69-4571-b13e-a04b8ba58cac tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:35.551705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ce3affbf-ce69-4571-b13e-a04b8ba58cac tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:35.674767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2b0792da-6af6-4436-bc52-5f73b2515681 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:35.694172 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2b0792da-6af6-4436-bc52-5f73b2515681 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/b862f7de-fe9b-49bc-9e77-0d3e453558e8" status: 200 len: 1467 microversion: 2.1 time: 0.432511 Oct 12 22:10:35.700783 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1258/2827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:35 2022] GET /compute/v2.1/servers/b862f7de-fe9b-49bc-9e77-0d3e453558e8 => generated 1467 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:35.714267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb04eef4-426a-42cc-86fa-e9466b1a273e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:35.717416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eb04eef4-426a-42cc-86fa-e9466b1a273e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:35.737190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb04eef4-426a-42cc-86fa-e9466b1a273e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:35.737950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb04eef4-426a-42cc-86fa-e9466b1a273e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:35.738910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb04eef4-426a-42cc-86fa-e9466b1a273e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:35.739805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb04eef4-426a-42cc-86fa-e9466b1a273e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:35.743394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb04eef4-426a-42cc-86fa-e9466b1a273e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:35.744563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb04eef4-426a-42cc-86fa-e9466b1a273e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:35.841535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ce3affbf-ce69-4571-b13e-a04b8ba58cac tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:35.855183 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ce3affbf-ce69-4571-b13e-a04b8ba58cac tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1477 microversion: 2.1 time: 0.328501 Oct 12 22:10:35.856423 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1570/2828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:35 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1477 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:35.863599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ee6bd391-6b11-4ad4-b69f-1e589c74c457 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:35.873030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ee6bd391-6b11-4ad4-b69f-1e589c74c457 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:35.874153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ee6bd391-6b11-4ad4-b69f-1e589c74c457 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Searching by: {'reservation_id': 'r-16uvhljl', 'deleted': False, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:10:35.886017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee6bd391-6b11-4ad4-b69f-1e589c74c457 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:35.886737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee6bd391-6b11-4ad4-b69f-1e589c74c457 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:35.887474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee6bd391-6b11-4ad4-b69f-1e589c74c457 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:35.889924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee6bd391-6b11-4ad4-b69f-1e589c74c457 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:35.891387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee6bd391-6b11-4ad4-b69f-1e589c74c457 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:35.892048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee6bd391-6b11-4ad4-b69f-1e589c74c457 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:36.088570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-ee6bd391-6b11-4ad4-b69f-1e589c74c457 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:10:36.117043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eb04eef4-426a-42cc-86fa-e9466b1a273e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:36.134197 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb04eef4-426a-42cc-86fa-e9466b1a273e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.431882 Oct 12 22:10:36.136397 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1259/2829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:35 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:36.151321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-cdd6e456-c9fa-425d-a22b-b34d26e755ff req-20b77abb-1c39-4159-8007-e2cbfe8590e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51cce335-3600-4511-8ccd-8b837074bf95", "name": "network-vif-deleted", "tag": "738fc407-d734-4f84-b018-92200d206616"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:36.177177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-cdd6e456-c9fa-425d-a22b-b34d26e755ff req-20b77abb-1c39-4159-8007-e2cbfe8590e2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:36.177837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-cdd6e456-c9fa-425d-a22b-b34d26e755ff req-20b77abb-1c39-4159-8007-e2cbfe8590e2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:36.179435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-cdd6e456-c9fa-425d-a22b-b34d26e755ff req-20b77abb-1c39-4159-8007-e2cbfe8590e2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:36.201295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ee6bd391-6b11-4ad4-b69f-1e589c74c457 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:36.202379 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-cdd6e456-c9fa-425d-a22b-b34d26e755ff req-20b77abb-1c39-4159-8007-e2cbfe8590e2 service nova] Creating event network-vif-deleted:738fc407-d734-4f84-b018-92200d206616 for instance 51cce335-3600-4511-8ccd-8b837074bf95 on n-h1-861111-1 Oct 12 22:10:36.210636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee6bd391-6b11-4ad4-b69f-1e589c74c457 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:36.211946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee6bd391-6b11-4ad4-b69f-1e589c74c457 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:36.211946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee6bd391-6b11-4ad4-b69f-1e589c74c457 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:36.218899 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-cdd6e456-c9fa-425d-a22b-b34d26e755ff req-20b77abb-1c39-4159-8007-e2cbfe8590e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079164 Oct 12 22:10:36.220224 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1260/2830] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:36.230434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-73981893-7898-4b09-aad3-95c5a8a1f59d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:36.231887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-73981893-7898-4b09-aad3-95c5a8a1f59d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:36.238963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73981893-7898-4b09-aad3-95c5a8a1f59d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:36.239820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73981893-7898-4b09-aad3-95c5a8a1f59d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:36.240415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73981893-7898-4b09-aad3-95c5a8a1f59d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:36.245192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73981893-7898-4b09-aad3-95c5a8a1f59d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:36.245933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73981893-7898-4b09-aad3-95c5a8a1f59d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:36.246549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73981893-7898-4b09-aad3-95c5a8a1f59d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:36.277959 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-73981893-7898-4b09-aad3-95c5a8a1f59d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] HTTP exception thrown: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-73981893-7898-4b09-aad3-95c5a8a1f59d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Request method failure captured: Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 HTTP/1.1 Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzsOoCBjc82qYrgXGJcyS2C14AOyPaAY8jKON607aXBRETBa1-csxQQTd0dgLMFOSgjqcymNifeM8Cm_FMIYg-_UXGIEhCMX-O3n3HlLkfS0dfrzyRNsTuLIp0L-pAR76rzZrOO2f-Vw4UsY6dbCy5X6TdVdQGY9sHIG-ct3MYAKFNg Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_214f86d71a5749b9b98dffe934fe7f1f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 81e045d919104fa89572a2d05993abb8 Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '51cce335-3600-4511-8ccd-8b837074bf95'} Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:36.280125 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:10:36.285296 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:36.285296 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:36.285296 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:36.285296 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:10:36.285296 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:10:36.285296 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. Oct 12 22:10:36.285296 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:10:36.287998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-73981893-7898-4b09-aad3-95c5a8a1f59d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Returning 404 to user: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:10:36.289325 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-73981893-7898-4b09-aad3-95c5a8a1f59d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 404 len: 111 microversion: 2.1 time: 0.063001 Oct 12 22:10:36.290438 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1261/2831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:36 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:10:36.300951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7e8e8ab2-c168-4b2b-aef7-bfd579fd0ee5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f51235641f0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:36.407064 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ee6bd391-6b11-4ad4-b69f-1e589c74c457 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-16uvhljl" status: 200 len: 2928 microversion: 2.1 time: 0.546577 Oct 12 22:10:36.409410 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1571/2832] 10.222.0.16 () {58 vars in 1197 bytes} [Wed Oct 12 22:10:35 2022] GET /compute/v2.1/servers/detail?reservation_id=r-16uvhljl => generated 2928 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:36.414812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-989121bf-9a04-497d-b47a-8caf62df3faa tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:36.415472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-989121bf-9a04-497d-b47a-8caf62df3faa tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:36.427575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-989121bf-9a04-497d-b47a-8caf62df3faa tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:36.428285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-989121bf-9a04-497d-b47a-8caf62df3faa tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:36.429984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-989121bf-9a04-497d-b47a-8caf62df3faa tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:36.431514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-989121bf-9a04-497d-b47a-8caf62df3faa tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:36.432133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-989121bf-9a04-497d-b47a-8caf62df3faa tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:36.434919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-989121bf-9a04-497d-b47a-8caf62df3faa tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:36.519954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-989121bf-9a04-497d-b47a-8caf62df3faa tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:36.531895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-989121bf-9a04-497d-b47a-8caf62df3faa tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:36.544140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-989121bf-9a04-497d-b47a-8caf62df3faa tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:36.550365 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-989121bf-9a04-497d-b47a-8caf62df3faa tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.139903 Oct 12 22:10:36.551414 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1572/2833] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:36 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:36.556023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b7d70be2-7cd5-42c4-bf6d-0d387d1cb9b7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:36.589422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.compute.server_groups [None req-b7d70be2-7cd5-42c4-bf6d-0d387d1cb9b7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Querying cell 2bc00301-6462-4874-9c83-c889d0ff6a49(cell1) for 2 instances {{(pid=120453) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 12 22:10:36.590324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7d70be2-7cd5-42c4-bf6d-0d387d1cb9b7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:36.590932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7d70be2-7cd5-42c4-bf6d-0d387d1cb9b7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:36.595856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7d70be2-7cd5-42c4-bf6d-0d387d1cb9b7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:36.656801 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b7d70be2-7cd5-42c4-bf6d-0d387d1cb9b7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/0062e0e1-f049-4b7b-8395-e166a0421e0b" status: 200 len: 271 microversion: 2.1 time: 0.104197 Oct 12 22:10:36.665998 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1573/2834] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:10:36 2022] GET /compute/v2.1/os-server-groups/0062e0e1-f049-4b7b-8395-e166a0421e0b => generated 271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:36.676690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-752a9300-032c-4a47-b535-e5928e8c326f tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:36.677660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-752a9300-032c-4a47-b535-e5928e8c326f tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:36.693119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-752a9300-032c-4a47-b535-e5928e8c326f tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:36.693780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-752a9300-032c-4a47-b535-e5928e8c326f tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:36.694342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-752a9300-032c-4a47-b535-e5928e8c326f tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:36.695158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-752a9300-032c-4a47-b535-e5928e8c326f tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:36.695780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-752a9300-032c-4a47-b535-e5928e8c326f tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:36.696301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-752a9300-032c-4a47-b535-e5928e8c326f tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:36.935038 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-752a9300-032c-4a47-b535-e5928e8c326f tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 200 len: 1619 microversion: 2.1 time: 0.262024 Oct 12 22:10:36.940605 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1574/2835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:36 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 1619 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:36.947936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-44231a59-cb46-4516-a695-6ddb5ff410c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:36.958287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-44231a59-cb46-4516-a695-6ddb5ff410c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:36.964928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44231a59-cb46-4516-a695-6ddb5ff410c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:36.965671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44231a59-cb46-4516-a695-6ddb5ff410c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:36.966254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44231a59-cb46-4516-a695-6ddb5ff410c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:36.967053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44231a59-cb46-4516-a695-6ddb5ff410c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:36.967633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44231a59-cb46-4516-a695-6ddb5ff410c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:36.971056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44231a59-cb46-4516-a695-6ddb5ff410c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:37.272685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-44231a59-cb46-4516-a695-6ddb5ff410c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:37.282446 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-44231a59-cb46-4516-a695-6ddb5ff410c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1477 microversion: 2.1 time: 0.340229 Oct 12 22:10:37.297975 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1575/2836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:36 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1477 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:37.297975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2c927d29-0ef1-4766-a421-fb13a9f00608 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:37.297975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2c927d29-0ef1-4766-a421-fb13a9f00608 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] [instance: b862f7de-fe9b-49bc-9e77-0d3e453558e8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:37.299852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c927d29-0ef1-4766-a421-fb13a9f00608 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:37.300337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c927d29-0ef1-4766-a421-fb13a9f00608 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:37.300771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c927d29-0ef1-4766-a421-fb13a9f00608 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:37.302135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c927d29-0ef1-4766-a421-fb13a9f00608 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:37.302783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c927d29-0ef1-4766-a421-fb13a9f00608 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:37.303248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c927d29-0ef1-4766-a421-fb13a9f00608 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:37.475490 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7e8e8ab2-c168-4b2b-aef7-bfd579fd0ee5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/d8e81666-b0e1-4909-aded-45f48f5a9a9b" status: 202 len: 0 microversion: 2.1 time: 1.179316 Oct 12 22:10:37.478035 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1262/2837] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:10:36 2022] DELETE /compute/v2.1/os-security-groups/d8e81666-b0e1-4909-aded-45f48f5a9a9b => generated 0 bytes in 1182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:10:37.483382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d8870852-6bcd-4ce9-b8d3-4fefa943aa4b req-242eb11f-9dff-44d3-91ab-59ff6c802c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b0eb54-219e-4026-b96c-59b963b0f770", "name": "network-vif-plugged", "status": "completed", "tag": "72cdcc3a-ba0f-41c3-9bb0-97a69bd68560"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:37.503011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d8870852-6bcd-4ce9-b8d3-4fefa943aa4b req-242eb11f-9dff-44d3-91ab-59ff6c802c04 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:37.507913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d8870852-6bcd-4ce9-b8d3-4fefa943aa4b req-242eb11f-9dff-44d3-91ab-59ff6c802c04 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:37.508620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d8870852-6bcd-4ce9-b8d3-4fefa943aa4b req-242eb11f-9dff-44d3-91ab-59ff6c802c04 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:37.523256 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2c927d29-0ef1-4766-a421-fb13a9f00608 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b862f7de-fe9b-49bc-9e77-0d3e453558e8" status: 200 len: 1618 microversion: 2.1 time: 0.238107 Oct 12 22:10:37.525819 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1576/2838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:37 2022] GET /compute/v2.1/servers/b862f7de-fe9b-49bc-9e77-0d3e453558e8 => generated 1618 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:37.533913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-57370c7d-c668-417a-a1a1-316245c058fa tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:37.534347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-57370c7d-c668-417a-a1a1-316245c058fa tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:37.585778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57370c7d-c668-417a-a1a1-316245c058fa tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:37.588073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57370c7d-c668-417a-a1a1-316245c058fa tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:37.589408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57370c7d-c668-417a-a1a1-316245c058fa tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:37.603821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57370c7d-c668-417a-a1a1-316245c058fa tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:37.604823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57370c7d-c668-417a-a1a1-316245c058fa tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:37.605676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57370c7d-c668-417a-a1a1-316245c058fa tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:37.605925 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d8870852-6bcd-4ce9-b8d3-4fefa943aa4b req-242eb11f-9dff-44d3-91ab-59ff6c802c04 service nova] Creating event network-vif-plugged:72cdcc3a-ba0f-41c3-9bb0-97a69bd68560 for instance f3b0eb54-219e-4026-b96c-59b963b0f770 on n-h1-861111-1 Oct 12 22:10:37.630559 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d8870852-6bcd-4ce9-b8d3-4fefa943aa4b req-242eb11f-9dff-44d3-91ab-59ff6c802c04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151068 Oct 12 22:10:37.640203 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1263/2839] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:37.650099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3bac8858-ee2c-432a-a1de-4c8cde5ea935 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f51235648b0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:37.984445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-57370c7d-c668-417a-a1a1-316245c058fa tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:37.996367 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-57370c7d-c668-417a-a1a1-316245c058fa tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.468614 Oct 12 22:10:37.996961 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1577/2840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:37 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:38.023379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8919ad14-94d6-4de3-a1d3-5fdead58f7b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:38.027855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8919ad14-94d6-4de3-a1d3-5fdead58f7b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:38.038937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8919ad14-94d6-4de3-a1d3-5fdead58f7b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:38.040378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8919ad14-94d6-4de3-a1d3-5fdead58f7b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:38.045734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8919ad14-94d6-4de3-a1d3-5fdead58f7b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:38.047678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8919ad14-94d6-4de3-a1d3-5fdead58f7b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:38.052064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8919ad14-94d6-4de3-a1d3-5fdead58f7b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:38.053194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8919ad14-94d6-4de3-a1d3-5fdead58f7b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:38.207618 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3bac8858-ee2c-432a-a1de-4c8cde5ea935 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/2f623678-3fa3-4637-a7f4-997875304fc7" status: 202 len: 0 microversion: 2.1 time: 0.564919 Oct 12 22:10:38.209057 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1264/2841] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:10:37 2022] DELETE /compute/v2.1/os-security-groups/2f623678-3fa3-4637-a7f4-997875304fc7 => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:10:38.214760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1325900139", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "3c884fd7-d12b-4faa-95e1-96646f21ef60"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:38.251016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8919ad14-94d6-4de3-a1d3-5fdead58f7b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:38.266914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8919ad14-94d6-4de3-a1d3-5fdead58f7b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:38.272445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8919ad14-94d6-4de3-a1d3-5fdead58f7b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:38.324738 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8919ad14-94d6-4de3-a1d3-5fdead58f7b9 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.309966 Oct 12 22:10:38.325378 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1578/2842] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:37 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:38.354148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-76489ad7-e62d-4911-8660-97af29ab24ee tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Action: 'create', calling method: .version_select at 0x7f512c40f790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1075359889", "description": "tempest-description-798881787"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:38.619292 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-76489ad7-e62d-4911-8660-97af29ab24ee tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.274364 Oct 12 22:10:38.627780 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1579/2843] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:10:38 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:38.627780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f8b86930-fcdc-43b7-9150-6f228d904513 req-a5ec36ed-046f-4de1-9472-1c436e81183a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fae77315-a6c0-474c-aef9-5c8edda79113", "tag": "d80d4594-afa7-4bd2-9bef-eebbc4773763"}, {"name": "network-changed", "server_uuid": "fae77315-a6c0-474c-aef9-5c8edda79113", "tag": "ac01c165-88a6-42a2-b3a9-4b440eea669c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:38.656326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f8b86930-fcdc-43b7-9150-6f228d904513 req-a5ec36ed-046f-4de1-9472-1c436e81183a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:38.656805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f8b86930-fcdc-43b7-9150-6f228d904513 req-a5ec36ed-046f-4de1-9472-1c436e81183a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:38.657235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f8b86930-fcdc-43b7-9150-6f228d904513 req-a5ec36ed-046f-4de1-9472-1c436e81183a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:38.696232 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f8b86930-fcdc-43b7-9150-6f228d904513 req-a5ec36ed-046f-4de1-9472-1c436e81183a service nova] Creating event network-changed:d80d4594-afa7-4bd2-9bef-eebbc4773763 for instance fae77315-a6c0-474c-aef9-5c8edda79113 on n-h2-861111-1 Oct 12 22:10:38.696709 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f8b86930-fcdc-43b7-9150-6f228d904513 req-a5ec36ed-046f-4de1-9472-1c436e81183a service nova] Creating event network-changed:ac01c165-88a6-42a2-b3a9-4b440eea669c for instance fae77315-a6c0-474c-aef9-5c8edda79113 on n-h2-861111-1 Oct 12 22:10:38.703002 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f8b86930-fcdc-43b7-9150-6f228d904513 req-a5ec36ed-046f-4de1-9472-1c436e81183a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.081922 Oct 12 22:10:38.710000 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1580/2844] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:38.724295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1a7c0e02-b646-4e40-99d7-be17eeb51bf6 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:38.725232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1a7c0e02-b646-4e40-99d7-be17eeb51bf6 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:38.740249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a7c0e02-b646-4e40-99d7-be17eeb51bf6 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:38.740746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a7c0e02-b646-4e40-99d7-be17eeb51bf6 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:38.741178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a7c0e02-b646-4e40-99d7-be17eeb51bf6 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:38.741887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a7c0e02-b646-4e40-99d7-be17eeb51bf6 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:38.742315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a7c0e02-b646-4e40-99d7-be17eeb51bf6 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:38.742779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a7c0e02-b646-4e40-99d7-be17eeb51bf6 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:38.971498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a7c0e02-b646-4e40-99d7-be17eeb51bf6 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:38.989776 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1a7c0e02-b646-4e40-99d7-be17eeb51bf6 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1477 microversion: 2.1 time: 0.278487 Oct 12 22:10:38.990596 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1581/2845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:38 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1477 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:39.011649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2d15b1db-5a14-4a65-9afa-f1950332092e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Action: 'update', calling method: .version_select at 0x7f51235391f0>, body: {"security_group": {"name": "tempest-sg-hth-1526197588", "description": "tempest-description-hth-1402876200"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:39.331323 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2d15b1db-5a14-4a65-9afa-f1950332092e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/0d12e005-1d1d-4158-b604-172710125884" status: 200 len: 218 microversion: 2.1 time: 0.339864 Oct 12 22:10:39.331930 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1582/2846] 10.222.0.16 () {60 vars in 1290 bytes} [Wed Oct 12 22:10:38 2022] PUT /compute/v2.1/os-security-groups/0d12e005-1d1d-4158-b604-172710125884 => generated 218 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:39.344696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ee6af936-a45c-4e20-914e-f84dd8582e21 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:39.345332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ee6af936-a45c-4e20-914e-f84dd8582e21 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:39.362003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee6af936-a45c-4e20-914e-f84dd8582e21 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:39.362533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee6af936-a45c-4e20-914e-f84dd8582e21 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:39.362933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee6af936-a45c-4e20-914e-f84dd8582e21 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:39.363798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee6af936-a45c-4e20-914e-f84dd8582e21 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:39.364117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee6af936-a45c-4e20-914e-f84dd8582e21 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:39.364545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee6af936-a45c-4e20-914e-f84dd8582e21 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:39.631360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ee6af936-a45c-4e20-914e-f84dd8582e21 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:39.643523 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ee6af936-a45c-4e20-914e-f84dd8582e21 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.310453 Oct 12 22:10:39.645387 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1583/2847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:39 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:39.661897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-74f8504b-f17d-469d-af95-96dcfc3bec87 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f5123539310>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:39.767018 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-74f8504b-f17d-469d-af95-96dcfc3bec87 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/0d12e005-1d1d-4158-b604-172710125884" status: 200 len: 218 microversion: 2.1 time: 0.120249 Oct 12 22:10:39.769369 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1584/2848] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 12 22:10:39 2022] GET /compute/v2.1/os-security-groups/0d12e005-1d1d-4158-b604-172710125884 => generated 218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:39.776293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-10e10929-14b6-464e-91e0-2e560a438ba3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:39.777154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-10e10929-14b6-464e-91e0-2e560a438ba3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:39.790367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10e10929-14b6-464e-91e0-2e560a438ba3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:39.791139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10e10929-14b6-464e-91e0-2e560a438ba3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:39.792068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10e10929-14b6-464e-91e0-2e560a438ba3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:39.793116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10e10929-14b6-464e-91e0-2e560a438ba3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:39.794135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10e10929-14b6-464e-91e0-2e560a438ba3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:39.794791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10e10929-14b6-464e-91e0-2e560a438ba3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:39.898280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-10e10929-14b6-464e-91e0-2e560a438ba3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:39.908291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-10e10929-14b6-464e-91e0-2e560a438ba3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:39.910071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-10e10929-14b6-464e-91e0-2e560a438ba3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:39.916086 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-10e10929-14b6-464e-91e0-2e560a438ba3 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.145349 Oct 12 22:10:39.916866 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1585/2849] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:39 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:39.929403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c883ec8a-b512-4ef8-843f-69ace51dd13f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f5128606040>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:40.186144 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c883ec8a-b512-4ef8-843f-69ace51dd13f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/0d12e005-1d1d-4158-b604-172710125884" status: 202 len: 0 microversion: 2.1 time: 0.261394 Oct 12 22:10:40.190534 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1586/2850] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:10:39 2022] DELETE /compute/v2.1/os-security-groups/0d12e005-1d1d-4158-b604-172710125884 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:10:40.197923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a6312cc6-57f2-499f-9663-5ae149a2b661 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:40.198800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a6312cc6-57f2-499f-9663-5ae149a2b661 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:40.222974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6312cc6-57f2-499f-9663-5ae149a2b661 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:40.223585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6312cc6-57f2-499f-9663-5ae149a2b661 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:40.224028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6312cc6-57f2-499f-9663-5ae149a2b661 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:40.224861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6312cc6-57f2-499f-9663-5ae149a2b661 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:40.226440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6312cc6-57f2-499f-9663-5ae149a2b661 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:40.227221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6312cc6-57f2-499f-9663-5ae149a2b661 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:40.405894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a6312cc6-57f2-499f-9663-5ae149a2b661 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:40.416768 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a6312cc6-57f2-499f-9663-5ae149a2b661 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1463 microversion: 2.1 time: 0.224883 Oct 12 22:10:40.417518 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1587/2851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:40 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1463 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:40.424158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-95acdf74-8c70-42ac-8a5a-9d6efa78450d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:40.425963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-95acdf74-8c70-42ac-8a5a-9d6efa78450d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:40.436956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:40.439378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95acdf74-8c70-42ac-8a5a-9d6efa78450d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:40.440270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95acdf74-8c70-42ac-8a5a-9d6efa78450d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:40.441183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95acdf74-8c70-42ac-8a5a-9d6efa78450d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:40.442502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95acdf74-8c70-42ac-8a5a-9d6efa78450d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:40.443193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95acdf74-8c70-42ac-8a5a-9d6efa78450d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:40.443963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95acdf74-8c70-42ac-8a5a-9d6efa78450d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:40.466679 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-95acdf74-8c70-42ac-8a5a-9d6efa78450d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] HTTP exception thrown: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-95acdf74-8c70-42ac-8a5a-9d6efa78450d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Request method failure captured: Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 HTTP/1.1 Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzsOoCBjc82qYrgXGJcyS2C14AOyPaAY8jKON607aXBRETBa1-csxQQTd0dgLMFOSgjqcymNifeM8Cm_FMIYg-_UXGIEhCMX-O3n3HlLkfS0dfrzyRNsTuLIp0L-pAR76rzZrOO2f-Vw4UsY6dbCy5X6TdVdQGY9sHIG-ct3MYAKFNg Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_214f86d71a5749b9b98dffe934fe7f1f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 81e045d919104fa89572a2d05993abb8 Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '51cce335-3600-4511-8ccd-8b837074bf95'} Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:10:40.469593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:10:40.478397 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. Oct 12 22:10:40.478397 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:40.478397 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:40.478397 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:40.478397 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:40.478397 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:40.478397 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:40.478397 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:10:40.478397 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:10:40.478397 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. Oct 12 22:10:40.478397 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:40.478397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-95acdf74-8c70-42ac-8a5a-9d6efa78450d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Returning 404 to user: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:10:40.478397 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-95acdf74-8c70-42ac-8a5a-9d6efa78450d tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 404 len: 111 microversion: 2.1 time: 0.053088 Oct 12 22:10:40.478397 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1588/2852] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:10:40 2022] DELETE /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:10:40.480405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-72f2f9d6-4c8b-4632-8c35-3bdef10db8f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:40.480405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-72f2f9d6-4c8b-4632-8c35-3bdef10db8f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:40.486621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72f2f9d6-4c8b-4632-8c35-3bdef10db8f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:40.487278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72f2f9d6-4c8b-4632-8c35-3bdef10db8f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:40.487724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72f2f9d6-4c8b-4632-8c35-3bdef10db8f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:40.488430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72f2f9d6-4c8b-4632-8c35-3bdef10db8f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:40.491856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72f2f9d6-4c8b-4632-8c35-3bdef10db8f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:40.491856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72f2f9d6-4c8b-4632-8c35-3bdef10db8f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:40.694275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-72f2f9d6-4c8b-4632-8c35-3bdef10db8f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:40.703642 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-72f2f9d6-4c8b-4632-8c35-3bdef10db8f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1463 microversion: 2.1 time: 0.228838 Oct 12 22:10:40.704231 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1589/2853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:40 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1463 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:40.711736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a082d050-bd8e-482c-ad38-7e139bc8cf26 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:40.712357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a082d050-bd8e-482c-ad38-7e139bc8cf26 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 51cce335-3600-4511-8ccd-8b837074bf95] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:40.724299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a082d050-bd8e-482c-ad38-7e139bc8cf26 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:40.724797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a082d050-bd8e-482c-ad38-7e139bc8cf26 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:40.725239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a082d050-bd8e-482c-ad38-7e139bc8cf26 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:40.725946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a082d050-bd8e-482c-ad38-7e139bc8cf26 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:40.726398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a082d050-bd8e-482c-ad38-7e139bc8cf26 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:40.727382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a082d050-bd8e-482c-ad38-7e139bc8cf26 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:40.753900 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-a082d050-bd8e-482c-ad38-7e139bc8cf26 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] HTTP exception thrown: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a082d050-bd8e-482c-ad38-7e139bc8cf26 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Request method failure captured: Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 HTTP/1.1 Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzsOoCBjc82qYrgXGJcyS2C14AOyPaAY8jKON607aXBRETBa1-csxQQTd0dgLMFOSgjqcymNifeM8Cm_FMIYg-_UXGIEhCMX-O3n3HlLkfS0dfrzyRNsTuLIp0L-pAR76rzZrOO2f-Vw4UsY6dbCy5X6TdVdQGY9sHIG-ct3MYAKFNg Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_214f86d71a5749b9b98dffe934fe7f1f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 81e045d919104fa89572a2d05993abb8 Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '51cce335-3600-4511-8ccd-8b837074bf95'} Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:40.755506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:40.759175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:40.759175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:40.759175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:40.759175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:10:40.759175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:10:40.759175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. Oct 12 22:10:40.759175 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:40.759175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a082d050-bd8e-482c-ad38-7e139bc8cf26 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Returning 404 to user: Instance 51cce335-3600-4511-8ccd-8b837074bf95 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:10:40.759175 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a082d050-bd8e-482c-ad38-7e139bc8cf26 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95" status: 404 len: 111 microversion: 2.1 time: 0.051754 Oct 12 22:10:40.770474 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1590/2854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:40 2022] GET /compute/v2.1/servers/51cce335-3600-4511-8ccd-8b837074bf95 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:10:40.777115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9ba904b2-71f4-4272-adf8-a29ce3f4ce4e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:40.778054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9ba904b2-71f4-4272-adf8-a29ce3f4ce4e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:40.787756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ba904b2-71f4-4272-adf8-a29ce3f4ce4e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:40.788355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ba904b2-71f4-4272-adf8-a29ce3f4ce4e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:40.788698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ba904b2-71f4-4272-adf8-a29ce3f4ce4e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:40.791455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ba904b2-71f4-4272-adf8-a29ce3f4ce4e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:40.791455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ba904b2-71f4-4272-adf8-a29ce3f4ce4e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:40.791662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ba904b2-71f4-4272-adf8-a29ce3f4ce4e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:40.972844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9ba904b2-71f4-4272-adf8-a29ce3f4ce4e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:40.982475 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9ba904b2-71f4-4272-adf8-a29ce3f4ce4e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.210245 Oct 12 22:10:40.995261 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1591/2855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:40 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:40.995261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:40.995261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:41.002051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:41.002051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:41.002051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:41.002051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:41.002051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:41.002051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:41.006562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:42.570146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:10:42.592110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:10:42.592675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:10:42.592989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:10:42.593390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:10:42.593966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:10:42.697288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:42.704118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:42.705156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:42.705953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:42.707069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:42.707721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:42.708303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:42.772807 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-846fb21b-94ac-40d8-bab1-5341cf067e89 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "POST /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770/action" status: 202 len: 1067 microversion: 2.1 time: 1.787493 Oct 12 22:10:42.774360 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1592/2856] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:10:40 2022] POST /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770/action => generated 1067 bytes in 1790 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 12 22:10:42.780712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a3e12070-fef1-4478-9b10-86a97fcbf76e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f51283555e0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:42.816205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-a3e12070-fef1-4478-9b10-86a97fcbf76e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2f623678-3fa3-4637-a7f4-997875304fc7 does not exist", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:10:42.817023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.security_group_api [None req-a3e12070-fef1-4478-9b10-86a97fcbf76e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Neutron security group 2f623678-3fa3-4637-a7f4-997875304fc7 not found {{(pid=120453) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:10:42.817691 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-a3e12070-fef1-4478-9b10-86a97fcbf76e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] HTTP exception thrown: Security group 2f623678-3fa3-4637-a7f4-997875304fc7 does not exist Oct 12 22:10:42.817691 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-5df04b61-f456-480e-a9dc-d5ca2874716b'] Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a3e12070-fef1-4478-9b10-86a97fcbf76e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Request method failure captured: Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/os-security-groups/2f623678-3fa3-4637-a7f4-997875304fc7 HTTP/1.1 Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzsOoCBjc82qYrgXGJcyS2C14AOyPaAY8jKON607aXBRETBa1-csxQQTd0dgLMFOSgjqcymNifeM8Cm_FMIYg-_UXGIEhCMX-O3n3HlLkfS0dfrzyRNsTuLIp0L-pAR76rzZrOO2f-Vw4UsY6dbCy5X6TdVdQGY9sHIG-ct3MYAKFNg Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_214f86d71a5749b9b98dffe934fe7f1f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 81e045d919104fa89572a2d05993abb8 Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: exception: Security group 2f623678-3fa3-4637-a7f4-997875304fc7 does not exist Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-5df04b61-f456-480e-a9dc-d5ca2874716b'] Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '2f623678-3fa3-4637-a7f4-997875304fc7'} Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:10:42.823231 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2f623678-3fa3-4637-a7f4-997875304fc7 does not exist Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5df04b61-f456-480e-a9dc-d5ca2874716b'] Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2f623678-3fa3-4637-a7f4-997875304fc7 does not exist Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5df04b61-f456-480e-a9dc-d5ca2874716b'] Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2f623678-3fa3-4637-a7f4-997875304fc7 does not exist Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5df04b61-f456-480e-a9dc-d5ca2874716b'] Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2f623678-3fa3-4637-a7f4-997875304fc7 does not exist Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5df04b61-f456-480e-a9dc-d5ca2874716b'] Oct 12 22:10:42.827636 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:42.831037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a3e12070-fef1-4478-9b10-86a97fcbf76e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Returning 404 to user: Security group 2f623678-3fa3-4637-a7f4-997875304fc7 does not exist Oct 12 22:10:42.831037 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-5df04b61-f456-480e-a9dc-d5ca2874716b'] {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:10:42.832884 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a3e12070-fef1-4478-9b10-86a97fcbf76e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/2f623678-3fa3-4637-a7f4-997875304fc7" status: 404 len: 194 microversion: 2.1 time: 0.056865 Oct 12 22:10:42.838690 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1593/2857] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:10:42 2022] DELETE /compute/v2.1/os-security-groups/2f623678-3fa3-4637-a7f4-997875304fc7 => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:10:42.845579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dc635fb3-4e02-4fd3-8fcb-0eb97f25e3d5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:42.847849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dc635fb3-4e02-4fd3-8fcb-0eb97f25e3d5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:42.860755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc635fb3-4e02-4fd3-8fcb-0eb97f25e3d5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:42.861610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc635fb3-4e02-4fd3-8fcb-0eb97f25e3d5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:42.863126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc635fb3-4e02-4fd3-8fcb-0eb97f25e3d5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:42.864328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc635fb3-4e02-4fd3-8fcb-0eb97f25e3d5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:42.865209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc635fb3-4e02-4fd3-8fcb-0eb97f25e3d5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:42.865641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc635fb3-4e02-4fd3-8fcb-0eb97f25e3d5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:42.942347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dc635fb3-4e02-4fd3-8fcb-0eb97f25e3d5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:42.953261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dc635fb3-4e02-4fd3-8fcb-0eb97f25e3d5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:42.955717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dc635fb3-4e02-4fd3-8fcb-0eb97f25e3d5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:42.963568 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dc635fb3-4e02-4fd3-8fcb-0eb97f25e3d5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1553 microversion: 2.91 time: 0.122361 Oct 12 22:10:42.965128 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1594/2858] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:42 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1553 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:42.974178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-71933bf5-b4ef-485b-beb8-005e2081f3ec tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:42.975442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-71933bf5-b4ef-485b-beb8-005e2081f3ec tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:42.982912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71933bf5-b4ef-485b-beb8-005e2081f3ec tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:42.983647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71933bf5-b4ef-485b-beb8-005e2081f3ec tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:42.984228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71933bf5-b4ef-485b-beb8-005e2081f3ec tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:42.985208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71933bf5-b4ef-485b-beb8-005e2081f3ec tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:42.985839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71933bf5-b4ef-485b-beb8-005e2081f3ec tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:42.986408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71933bf5-b4ef-485b-beb8-005e2081f3ec tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:43.234655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-71933bf5-b4ef-485b-beb8-005e2081f3ec tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:43.247811 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-71933bf5-b4ef-485b-beb8-005e2081f3ec tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.277979 Oct 12 22:10:43.261686 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1595/2859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:42 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:43.273365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-42c9bd41-c8c2-4c8e-9b96-91fdcfc04ffc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:43.279943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-42c9bd41-c8c2-4c8e-9b96-91fdcfc04ffc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:43.290718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42c9bd41-c8c2-4c8e-9b96-91fdcfc04ffc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:43.291215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42c9bd41-c8c2-4c8e-9b96-91fdcfc04ffc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:43.291678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42c9bd41-c8c2-4c8e-9b96-91fdcfc04ffc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:43.292389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42c9bd41-c8c2-4c8e-9b96-91fdcfc04ffc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:43.292846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42c9bd41-c8c2-4c8e-9b96-91fdcfc04ffc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:43.293272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42c9bd41-c8c2-4c8e-9b96-91fdcfc04ffc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:43.400587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:10:43.401061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:10:43.401596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:10:43.402068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:10:43.402897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:10:43.406539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:43.436129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:43.436613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:43.441861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:43.443904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:43.446564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:43.447224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:43.503565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:10:43.515683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:10:43.547620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:10:43.556269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:10:43.585668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-42c9bd41-c8c2-4c8e-9b96-91fdcfc04ffc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:43.596211 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-42c9bd41-c8c2-4c8e-9b96-91fdcfc04ffc tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.333102 Oct 12 22:10:43.601285 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1596/2860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:43 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:43.625507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b4eb7198-3c37-4f0c-96f6-ccfe76ae6bf5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f512c40ff70>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:43.649240 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-772610d0-224d-4657-a190-c4ed3102c930 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.438750 Oct 12 22:10:43.653029 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1265/2861] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:10:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 5443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:10:43.654037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-b4eb7198-3c37-4f0c-96f6-ccfe76ae6bf5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d8e81666-b0e1-4909-aded-45f48f5a9a9b does not exist", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:10:43.654652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.security_group_api [None req-b4eb7198-3c37-4f0c-96f6-ccfe76ae6bf5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Neutron security group d8e81666-b0e1-4909-aded-45f48f5a9a9b not found {{(pid=120453) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:10:43.655257 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-b4eb7198-3c37-4f0c-96f6-ccfe76ae6bf5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] HTTP exception thrown: Security group d8e81666-b0e1-4909-aded-45f48f5a9a9b does not exist Oct 12 22:10:43.655257 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-65002e16-75fd-4c5f-815c-84cd413c20a1'] Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b4eb7198-3c37-4f0c-96f6-ccfe76ae6bf5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Request method failure captured: Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/os-security-groups/d8e81666-b0e1-4909-aded-45f48f5a9a9b HTTP/1.1 Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzsOoCBjc82qYrgXGJcyS2C14AOyPaAY8jKON607aXBRETBa1-csxQQTd0dgLMFOSgjqcymNifeM8Cm_FMIYg-_UXGIEhCMX-O3n3HlLkfS0dfrzyRNsTuLIp0L-pAR76rzZrOO2f-Vw4UsY6dbCy5X6TdVdQGY9sHIG-ct3MYAKFNg Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_214f86d71a5749b9b98dffe934fe7f1f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 81e045d919104fa89572a2d05993abb8 Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: exception: Security group d8e81666-b0e1-4909-aded-45f48f5a9a9b does not exist Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-65002e16-75fd-4c5f-815c-84cd413c20a1'] Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'd8e81666-b0e1-4909-aded-45f48f5a9a9b'} Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:10:43.657205 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d8e81666-b0e1-4909-aded-45f48f5a9a9b does not exist Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65002e16-75fd-4c5f-815c-84cd413c20a1'] Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d8e81666-b0e1-4909-aded-45f48f5a9a9b does not exist Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65002e16-75fd-4c5f-815c-84cd413c20a1'] Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d8e81666-b0e1-4909-aded-45f48f5a9a9b does not exist Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65002e16-75fd-4c5f-815c-84cd413c20a1'] Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d8e81666-b0e1-4909-aded-45f48f5a9a9b does not exist Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65002e16-75fd-4c5f-815c-84cd413c20a1'] Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b4eb7198-3c37-4f0c-96f6-ccfe76ae6bf5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Returning 404 to user: Security group d8e81666-b0e1-4909-aded-45f48f5a9a9b does not exist Oct 12 22:10:43.660882 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-65002e16-75fd-4c5f-815c-84cd413c20a1'] {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:10:43.663014 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b4eb7198-3c37-4f0c-96f6-ccfe76ae6bf5 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/d8e81666-b0e1-4909-aded-45f48f5a9a9b" status: 404 len: 194 microversion: 2.1 time: 0.056082 Oct 12 22:10:43.663096 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1597/2862] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:10:43 2022] DELETE /compute/v2.1/os-security-groups/d8e81666-b0e1-4909-aded-45f48f5a9a9b => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:10:43.667893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-21a6ba0b-0a07-4543-b44c-71b21a167c9a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:43.667893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-21a6ba0b-0a07-4543-b44c-71b21a167c9a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:43.676194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c4e3ea98-ac47-41f0-93f7-c8e77ed9b0e9 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f5128e44310>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:43.710570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-c4e3ea98-ac47-41f0-93f7-c8e77ed9b0e9 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d689cf9c-d27c-43fa-943d-6a247018f548 does not exist", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:10:43.711307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.security_group_api [None req-c4e3ea98-ac47-41f0-93f7-c8e77ed9b0e9 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Neutron security group d689cf9c-d27c-43fa-943d-6a247018f548 not found {{(pid=120453) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:10:43.713067 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-c4e3ea98-ac47-41f0-93f7-c8e77ed9b0e9 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] HTTP exception thrown: Security group d689cf9c-d27c-43fa-943d-6a247018f548 does not exist Oct 12 22:10:43.713067 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-47451fda-77ae-4c42-b4b6-c328a31c2837'] Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c4e3ea98-ac47-41f0-93f7-c8e77ed9b0e9 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Request method failure captured: Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/os-security-groups/d689cf9c-d27c-43fa-943d-6a247018f548 HTTP/1.1 Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzsOoCBjc82qYrgXGJcyS2C14AOyPaAY8jKON607aXBRETBa1-csxQQTd0dgLMFOSgjqcymNifeM8Cm_FMIYg-_UXGIEhCMX-O3n3HlLkfS0dfrzyRNsTuLIp0L-pAR76rzZrOO2f-Vw4UsY6dbCy5X6TdVdQGY9sHIG-ct3MYAKFNg Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_214f86d71a5749b9b98dffe934fe7f1f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 81e045d919104fa89572a2d05993abb8 Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: exception: Security group d689cf9c-d27c-43fa-943d-6a247018f548 does not exist Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-47451fda-77ae-4c42-b4b6-c328a31c2837'] Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'd689cf9c-d27c-43fa-943d-6a247018f548'} Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:10:43.717017 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d689cf9c-d27c-43fa-943d-6a247018f548 does not exist Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47451fda-77ae-4c42-b4b6-c328a31c2837'] Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d689cf9c-d27c-43fa-943d-6a247018f548 does not exist Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47451fda-77ae-4c42-b4b6-c328a31c2837'] Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d689cf9c-d27c-43fa-943d-6a247018f548 does not exist Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47451fda-77ae-4c42-b4b6-c328a31c2837'] Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d689cf9c-d27c-43fa-943d-6a247018f548 does not exist Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47451fda-77ae-4c42-b4b6-c328a31c2837'] Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c4e3ea98-ac47-41f0-93f7-c8e77ed9b0e9 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Returning 404 to user: Security group d689cf9c-d27c-43fa-943d-6a247018f548 does not exist Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-47451fda-77ae-4c42-b4b6-c328a31c2837'] {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c4e3ea98-ac47-41f0-93f7-c8e77ed9b0e9 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/d689cf9c-d27c-43fa-943d-6a247018f548" status: 404 len: 194 microversion: 2.1 time: 0.047282 Oct 12 22:10:43.721086 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1598/2863] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:10:43 2022] DELETE /compute/v2.1/os-security-groups/d689cf9c-d27c-43fa-943d-6a247018f548 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:10:43.732983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e459eb5-6a1b-46db-a3bb-2b58f9d7139c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f51286069d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:43.763113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-9e459eb5-6a1b-46db-a3bb-2b58f9d7139c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 does not exist", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:10:43.763773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.security_group_api [None req-9e459eb5-6a1b-46db-a3bb-2b58f9d7139c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Neutron security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 not found {{(pid=120453) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:10:43.764300 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-9e459eb5-6a1b-46db-a3bb-2b58f9d7139c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] HTTP exception thrown: Security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 does not exist Oct 12 22:10:43.764300 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-054b6098-0dd2-4119-82fc-0b976865c394'] Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e459eb5-6a1b-46db-a3bb-2b58f9d7139c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Request method failure captured: Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/os-security-groups/c691583e-fa79-4edc-ac6a-73c9aaced7d3 HTTP/1.1 Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzsOoCBjc82qYrgXGJcyS2C14AOyPaAY8jKON607aXBRETBa1-csxQQTd0dgLMFOSgjqcymNifeM8Cm_FMIYg-_UXGIEhCMX-O3n3HlLkfS0dfrzyRNsTuLIp0L-pAR76rzZrOO2f-Vw4UsY6dbCy5X6TdVdQGY9sHIG-ct3MYAKFNg Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_214f86d71a5749b9b98dffe934fe7f1f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 81e045d919104fa89572a2d05993abb8 Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: exception: Security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 does not exist Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-054b6098-0dd2-4119-82fc-0b976865c394'] Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'c691583e-fa79-4edc-ac6a-73c9aaced7d3'} Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:10:43.766767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 does not exist Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-054b6098-0dd2-4119-82fc-0b976865c394'] Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 does not exist Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-054b6098-0dd2-4119-82fc-0b976865c394'] Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 does not exist Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-054b6098-0dd2-4119-82fc-0b976865c394'] Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 does not exist Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-054b6098-0dd2-4119-82fc-0b976865c394'] Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e459eb5-6a1b-46db-a3bb-2b58f9d7139c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Returning 404 to user: Security group c691583e-fa79-4edc-ac6a-73c9aaced7d3 does not exist Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-054b6098-0dd2-4119-82fc-0b976865c394'] {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:10:43.770944 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9e459eb5-6a1b-46db-a3bb-2b58f9d7139c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c691583e-fa79-4edc-ac6a-73c9aaced7d3" status: 404 len: 194 microversion: 2.1 time: 0.039329 Oct 12 22:10:43.775605 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1599/2864] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:10:43 2022] DELETE /compute/v2.1/os-security-groups/c691583e-fa79-4edc-ac6a-73c9aaced7d3 => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:10:43.780743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-85a753f4-d417-452b-b014-df99214b08bf tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f5128fa9d30>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:43.810272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-85a753f4-d417-452b-b014-df99214b08bf tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c148c27a-7c5a-4635-9a8e-2103070f3642 does not exist", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:10:43.810887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.security_group_api [None req-85a753f4-d417-452b-b014-df99214b08bf tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Neutron security group c148c27a-7c5a-4635-9a8e-2103070f3642 not found {{(pid=120453) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:10:43.812510 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-85a753f4-d417-452b-b014-df99214b08bf tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] HTTP exception thrown: Security group c148c27a-7c5a-4635-9a8e-2103070f3642 does not exist Oct 12 22:10:43.812510 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-86b41198-33de-414b-b489-af10da12c04e'] Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-85a753f4-d417-452b-b014-df99214b08bf tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Request method failure captured: Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/os-security-groups/c148c27a-7c5a-4635-9a8e-2103070f3642 HTTP/1.1 Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzsOoCBjc82qYrgXGJcyS2C14AOyPaAY8jKON607aXBRETBa1-csxQQTd0dgLMFOSgjqcymNifeM8Cm_FMIYg-_UXGIEhCMX-O3n3HlLkfS0dfrzyRNsTuLIp0L-pAR76rzZrOO2f-Vw4UsY6dbCy5X6TdVdQGY9sHIG-ct3MYAKFNg Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_214f86d71a5749b9b98dffe934fe7f1f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 81e045d919104fa89572a2d05993abb8 Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: exception: Security group c148c27a-7c5a-4635-9a8e-2103070f3642 does not exist Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-86b41198-33de-414b-b489-af10da12c04e'] Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'c148c27a-7c5a-4635-9a8e-2103070f3642'} Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:10:43.813393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c148c27a-7c5a-4635-9a8e-2103070f3642 does not exist Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86b41198-33de-414b-b489-af10da12c04e'] Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c148c27a-7c5a-4635-9a8e-2103070f3642 does not exist Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86b41198-33de-414b-b489-af10da12c04e'] Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c148c27a-7c5a-4635-9a8e-2103070f3642 does not exist Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86b41198-33de-414b-b489-af10da12c04e'] Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c148c27a-7c5a-4635-9a8e-2103070f3642 does not exist Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86b41198-33de-414b-b489-af10da12c04e'] Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-85a753f4-d417-452b-b014-df99214b08bf tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Returning 404 to user: Security group c148c27a-7c5a-4635-9a8e-2103070f3642 does not exist Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-86b41198-33de-414b-b489-af10da12c04e'] {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:10:43.817010 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-85a753f4-d417-452b-b014-df99214b08bf tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c148c27a-7c5a-4635-9a8e-2103070f3642" status: 404 len: 194 microversion: 2.1 time: 0.039737 Oct 12 22:10:43.821060 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1600/2865] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:10:43 2022] DELETE /compute/v2.1/os-security-groups/c148c27a-7c5a-4635-9a8e-2103070f3642 => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:10:43.824683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b41745eb-9d82-49ee-90e3-57920d89c74b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f5128606310>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:43.851923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-21a6ba0b-0a07-4543-b44c-71b21a167c9a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:43.853397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-b41745eb-9d82-49ee-90e3-57920d89c74b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 58c3399a-c4a4-4029-ba72-89251177875b does not exist", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:10:43.854009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.security_group_api [None req-b41745eb-9d82-49ee-90e3-57920d89c74b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Neutron security group 58c3399a-c4a4-4029-ba72-89251177875b not found {{(pid=120453) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:10:43.854540 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-b41745eb-9d82-49ee-90e3-57920d89c74b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] HTTP exception thrown: Security group 58c3399a-c4a4-4029-ba72-89251177875b does not exist Oct 12 22:10:43.854540 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-5e069b6d-f592-4492-ae41-d0fe487c5630'] Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b41745eb-9d82-49ee-90e3-57920d89c74b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Request method failure captured: Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/os-security-groups/58c3399a-c4a4-4029-ba72-89251177875b HTTP/1.1 Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzsOoCBjc82qYrgXGJcyS2C14AOyPaAY8jKON607aXBRETBa1-csxQQTd0dgLMFOSgjqcymNifeM8Cm_FMIYg-_UXGIEhCMX-O3n3HlLkfS0dfrzyRNsTuLIp0L-pAR76rzZrOO2f-Vw4UsY6dbCy5X6TdVdQGY9sHIG-ct3MYAKFNg Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_214f86d71a5749b9b98dffe934fe7f1f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 81e045d919104fa89572a2d05993abb8 Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: exception: Security group 58c3399a-c4a4-4029-ba72-89251177875b does not exist Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-5e069b6d-f592-4492-ae41-d0fe487c5630'] Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '58c3399a-c4a4-4029-ba72-89251177875b'} Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:10:43.856448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 58c3399a-c4a4-4029-ba72-89251177875b does not exist Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e069b6d-f592-4492-ae41-d0fe487c5630'] Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 58c3399a-c4a4-4029-ba72-89251177875b does not exist Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e069b6d-f592-4492-ae41-d0fe487c5630'] Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 58c3399a-c4a4-4029-ba72-89251177875b does not exist Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e069b6d-f592-4492-ae41-d0fe487c5630'] Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 58c3399a-c4a4-4029-ba72-89251177875b does not exist Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e069b6d-f592-4492-ae41-d0fe487c5630'] Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b41745eb-9d82-49ee-90e3-57920d89c74b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Returning 404 to user: Security group 58c3399a-c4a4-4029-ba72-89251177875b does not exist Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-5e069b6d-f592-4492-ae41-d0fe487c5630'] {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:10:43.860822 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b41745eb-9d82-49ee-90e3-57920d89c74b tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/58c3399a-c4a4-4029-ba72-89251177875b" status: 404 len: 194 microversion: 2.1 time: 0.037590 Oct 12 22:10:43.865693 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1601/2866] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:10:43 2022] DELETE /compute/v2.1/os-security-groups/58c3399a-c4a4-4029-ba72-89251177875b => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:10:43.869121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-59874abd-85fb-47a0-9ea1-a1832cd2145e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:43.869636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-59874abd-85fb-47a0-9ea1-a1832cd2145e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:43.872757 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-21a6ba0b-0a07-4543-b44c-71b21a167c9a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1217 microversion: 2.1 time: 0.212838 Oct 12 22:10:43.877634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59874abd-85fb-47a0-9ea1-a1832cd2145e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:43.878382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59874abd-85fb-47a0-9ea1-a1832cd2145e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:43.878964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59874abd-85fb-47a0-9ea1-a1832cd2145e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:43.880715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59874abd-85fb-47a0-9ea1-a1832cd2145e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:43.881341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59874abd-85fb-47a0-9ea1-a1832cd2145e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:43.882067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59874abd-85fb-47a0-9ea1-a1832cd2145e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:43.888902 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1266/2867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:43 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1217 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:43.921514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-59874abd-85fb-47a0-9ea1-a1832cd2145e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:10:44.001973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b03a91cd-b12e-4d09-9bcb-c0076cad2dd2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:44.003088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b03a91cd-b12e-4d09-9bcb-c0076cad2dd2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:44.019082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b03a91cd-b12e-4d09-9bcb-c0076cad2dd2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:44.020072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b03a91cd-b12e-4d09-9bcb-c0076cad2dd2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:44.020815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b03a91cd-b12e-4d09-9bcb-c0076cad2dd2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:44.021828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b03a91cd-b12e-4d09-9bcb-c0076cad2dd2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:44.022617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b03a91cd-b12e-4d09-9bcb-c0076cad2dd2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:44.023297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b03a91cd-b12e-4d09-9bcb-c0076cad2dd2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:44.091668 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-59874abd-85fb-47a0-9ea1-a1832cd2145e tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8" status: 204 len: 0 microversion: 2.1 time: 0.228261 Oct 12 22:10:44.095174 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1602/2868] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:10:43 2022] DELETE /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:10:44.101500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ea1f4869-5306-4474-aecb-87d6a2ddfda8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:44.102804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ea1f4869-5306-4474-aecb-87d6a2ddfda8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:44.114614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea1f4869-5306-4474-aecb-87d6a2ddfda8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:44.115113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea1f4869-5306-4474-aecb-87d6a2ddfda8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:44.115572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea1f4869-5306-4474-aecb-87d6a2ddfda8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:44.116305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea1f4869-5306-4474-aecb-87d6a2ddfda8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:44.116837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea1f4869-5306-4474-aecb-87d6a2ddfda8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:44.117267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea1f4869-5306-4474-aecb-87d6a2ddfda8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:44.187860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b03a91cd-b12e-4d09-9bcb-c0076cad2dd2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:44.200884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b03a91cd-b12e-4d09-9bcb-c0076cad2dd2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:44.221491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b03a91cd-b12e-4d09-9bcb-c0076cad2dd2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:44.235740 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b03a91cd-b12e-4d09-9bcb-c0076cad2dd2 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1535 microversion: 2.91 time: 0.246683 Oct 12 22:10:44.236399 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1267/2869] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:43 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1535 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:10:44.273923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-21d2f31b-4655-4bc1-b985-992c2ca12619 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:44.274757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-21d2f31b-4655-4bc1-b985-992c2ca12619 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:44.283753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21d2f31b-4655-4bc1-b985-992c2ca12619 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:44.287443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21d2f31b-4655-4bc1-b985-992c2ca12619 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:44.289066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21d2f31b-4655-4bc1-b985-992c2ca12619 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:44.290425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21d2f31b-4655-4bc1-b985-992c2ca12619 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:44.290886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21d2f31b-4655-4bc1-b985-992c2ca12619 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:44.291342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21d2f31b-4655-4bc1-b985-992c2ca12619 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:44.393411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ea1f4869-5306-4474-aecb-87d6a2ddfda8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:44.403835 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ea1f4869-5306-4474-aecb-87d6a2ddfda8 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8" status: 200 len: 1647 microversion: 2.1 time: 0.306984 Oct 12 22:10:44.421082 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1603/2870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:44 2022] GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 => generated 1647 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:44.533332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-21d2f31b-4655-4bc1-b985-992c2ca12619 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:44.543793 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-21d2f31b-4655-4bc1-b985-992c2ca12619 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.273721 Oct 12 22:10:44.557721 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1268/2871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:44 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:44.632828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c47083c7-ff6a-4913-a1b8-c774c3c7de79 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:44.634183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c47083c7-ff6a-4913-a1b8-c774c3c7de79 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:44.645729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c47083c7-ff6a-4913-a1b8-c774c3c7de79 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:44.647733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c47083c7-ff6a-4913-a1b8-c774c3c7de79 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:44.648352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c47083c7-ff6a-4913-a1b8-c774c3c7de79 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:44.650152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c47083c7-ff6a-4913-a1b8-c774c3c7de79 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:44.650759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c47083c7-ff6a-4913-a1b8-c774c3c7de79 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:44.651359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c47083c7-ff6a-4913-a1b8-c774c3c7de79 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:44.898329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-69078967-35dc-42e6-95b1-b25807559ed7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:44.899738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-69078967-35dc-42e6-95b1-b25807559ed7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:44.911516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69078967-35dc-42e6-95b1-b25807559ed7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:44.912049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69078967-35dc-42e6-95b1-b25807559ed7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:44.912496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69078967-35dc-42e6-95b1-b25807559ed7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:44.915470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69078967-35dc-42e6-95b1-b25807559ed7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:44.916172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69078967-35dc-42e6-95b1-b25807559ed7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:44.916787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69078967-35dc-42e6-95b1-b25807559ed7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:44.919527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c47083c7-ff6a-4913-a1b8-c774c3c7de79 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:44.931949 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c47083c7-ff6a-4913-a1b8-c774c3c7de79 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.302927 Oct 12 22:10:44.934694 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1604/2872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:44 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:45.004030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-69078967-35dc-42e6-95b1-b25807559ed7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:45.013597 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-69078967-35dc-42e6-95b1-b25807559ed7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1221 microversion: 2.1 time: 0.119395 Oct 12 22:10:45.015378 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1269/2873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:44 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1221 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:45.272474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-245fbcf0-c432-4968-9aaa-aa1b1ea0af54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:45.273166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-245fbcf0-c432-4968-9aaa-aa1b1ea0af54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:45.286764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-245fbcf0-c432-4968-9aaa-aa1b1ea0af54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:45.288718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-245fbcf0-c432-4968-9aaa-aa1b1ea0af54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:45.291891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-245fbcf0-c432-4968-9aaa-aa1b1ea0af54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:45.292673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-245fbcf0-c432-4968-9aaa-aa1b1ea0af54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:45.293146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-245fbcf0-c432-4968-9aaa-aa1b1ea0af54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:45.293670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-245fbcf0-c432-4968-9aaa-aa1b1ea0af54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:45.424446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-245fbcf0-c432-4968-9aaa-aa1b1ea0af54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:45.432014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8011bb71-3c8b-4ced-ba1c-c97c1dc55155 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:45.433076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8011bb71-3c8b-4ced-ba1c-c97c1dc55155 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:45.445001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-245fbcf0-c432-4968-9aaa-aa1b1ea0af54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:45.447717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8011bb71-3c8b-4ced-ba1c-c97c1dc55155 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:45.448670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8011bb71-3c8b-4ced-ba1c-c97c1dc55155 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:45.448670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8011bb71-3c8b-4ced-ba1c-c97c1dc55155 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:45.449339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8011bb71-3c8b-4ced-ba1c-c97c1dc55155 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:45.449767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8011bb71-3c8b-4ced-ba1c-c97c1dc55155 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:45.450187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8011bb71-3c8b-4ced-ba1c-c97c1dc55155 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:45.466268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-245fbcf0-c432-4968-9aaa-aa1b1ea0af54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:45.477791 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-245fbcf0-c432-4968-9aaa-aa1b1ea0af54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1535 microversion: 2.91 time: 0.209044 Oct 12 22:10:45.497505 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1605/2874] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:45 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1535 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:45.578953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ee45df99-c430-4c56-89e0-ef04cda93efb tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:45.579967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ee45df99-c430-4c56-89e0-ef04cda93efb tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:45.597024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee45df99-c430-4c56-89e0-ef04cda93efb tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:45.598408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee45df99-c430-4c56-89e0-ef04cda93efb tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:45.600063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee45df99-c430-4c56-89e0-ef04cda93efb tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:45.601181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee45df99-c430-4c56-89e0-ef04cda93efb tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:45.602616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee45df99-c430-4c56-89e0-ef04cda93efb tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:45.603634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee45df99-c430-4c56-89e0-ef04cda93efb tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:45.812196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8011bb71-3c8b-4ced-ba1c-c97c1dc55155 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:45.829598 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8011bb71-3c8b-4ced-ba1c-c97c1dc55155 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8" status: 200 len: 1647 microversion: 2.1 time: 0.402670 Oct 12 22:10:45.843937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ee45df99-c430-4c56-89e0-ef04cda93efb tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:45.847658 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1270/2875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:45 2022] GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 => generated 1647 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:45.853587 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ee45df99-c430-4c56-89e0-ef04cda93efb tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.279149 Oct 12 22:10:45.860348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5b354178-c3c2-42e1-a70f-42719042876c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:45.861241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5b354178-c3c2-42e1-a70f-42719042876c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:45.868410 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1606/2876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:45 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:45.872925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b354178-c3c2-42e1-a70f-42719042876c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:45.874871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b354178-c3c2-42e1-a70f-42719042876c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:45.875619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b354178-c3c2-42e1-a70f-42719042876c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:45.876592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b354178-c3c2-42e1-a70f-42719042876c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:45.877638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b354178-c3c2-42e1-a70f-42719042876c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:45.878283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b354178-c3c2-42e1-a70f-42719042876c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:45.959647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4e55b1d3-f126-4fd8-b461-d42549217805 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:45.960553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4e55b1d3-f126-4fd8-b461-d42549217805 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:45.972718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e55b1d3-f126-4fd8-b461-d42549217805 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:45.973220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e55b1d3-f126-4fd8-b461-d42549217805 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:45.973668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e55b1d3-f126-4fd8-b461-d42549217805 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:45.974410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e55b1d3-f126-4fd8-b461-d42549217805 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:45.975307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e55b1d3-f126-4fd8-b461-d42549217805 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:45.989218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e55b1d3-f126-4fd8-b461-d42549217805 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:45.991339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:46.153799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5b354178-c3c2-42e1-a70f-42719042876c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:46.182396 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5b354178-c3c2-42e1-a70f-42719042876c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 0.329691 Oct 12 22:10:46.184914 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1271/2877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:45 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:46.191402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3b4bc3d2-1f7e-41d6-9fd7-95bdbcaa8441 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:46.193013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3b4bc3d2-1f7e-41d6-9fd7-95bdbcaa8441 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:46.198952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:46.206365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b4bc3d2-1f7e-41d6-9fd7-95bdbcaa8441 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:46.206979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b4bc3d2-1f7e-41d6-9fd7-95bdbcaa8441 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:46.207400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b4bc3d2-1f7e-41d6-9fd7-95bdbcaa8441 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:46.208439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b4bc3d2-1f7e-41d6-9fd7-95bdbcaa8441 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:46.209677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b4bc3d2-1f7e-41d6-9fd7-95bdbcaa8441 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:46.210352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b4bc3d2-1f7e-41d6-9fd7-95bdbcaa8441 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:46.216585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:46.290216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4e55b1d3-f126-4fd8-b461-d42549217805 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:46.295444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3b4bc3d2-1f7e-41d6-9fd7-95bdbcaa8441 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:46.298051 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4e55b1d3-f126-4fd8-b461-d42549217805 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.343189 Oct 12 22:10:46.311492 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3b4bc3d2-1f7e-41d6-9fd7-95bdbcaa8441 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1269 microversion: 2.1 time: 0.118661 Oct 12 22:10:46.312374 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1607/2878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:45 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:46.329165 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1272/2879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:46 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1269 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:46.511732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-34820759-d1c1-445a-ae2c-f70ad6038f01 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:46.512775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-34820759-d1c1-445a-ae2c-f70ad6038f01 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:46.520169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34820759-d1c1-445a-ae2c-f70ad6038f01 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:46.521107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34820759-d1c1-445a-ae2c-f70ad6038f01 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:46.521719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34820759-d1c1-445a-ae2c-f70ad6038f01 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:46.522806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34820759-d1c1-445a-ae2c-f70ad6038f01 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:46.524282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34820759-d1c1-445a-ae2c-f70ad6038f01 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:46.524725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34820759-d1c1-445a-ae2c-f70ad6038f01 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:46.621522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-34820759-d1c1-445a-ae2c-f70ad6038f01 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:46.637720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-34820759-d1c1-445a-ae2c-f70ad6038f01 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:46.640421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-34820759-d1c1-445a-ae2c-f70ad6038f01 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:46.647574 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-34820759-d1c1-445a-ae2c-f70ad6038f01 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1478 microversion: 2.91 time: 0.139977 Oct 12 22:10:46.655971 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1608/2880] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:46 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1478 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:46.675005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3231f0a0-61cf-4009-9792-8163d17d7976 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-861111-1"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:46.680547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3231f0a0-61cf-4009-9792-8163d17d7976 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:46.687871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3231f0a0-61cf-4009-9792-8163d17d7976 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:46.688642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3231f0a0-61cf-4009-9792-8163d17d7976 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:46.689243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3231f0a0-61cf-4009-9792-8163d17d7976 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:46.690121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3231f0a0-61cf-4009-9792-8163d17d7976 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:46.690810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3231f0a0-61cf-4009-9792-8163d17d7976 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:46.691429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3231f0a0-61cf-4009-9792-8163d17d7976 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:46.735309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f2f9c825-b8a8-4bbc-8b6d-1107e4915fbf req-17cc3b09-3d88-4748-ac9a-346d17a4aeba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e83b077-4692-4351-8b85-e82dd3661af8", "name": "network-vif-deleted", "tag": "cfc3e15c-0e8c-49d8-885b-7827d5c6c133"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:46.751295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3231f0a0-61cf-4009-9792-8163d17d7976 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-861111-1". {{(pid=120452) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 22:10:46.751617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f2f9c825-b8a8-4bbc-8b6d-1107e4915fbf req-17cc3b09-3d88-4748-ac9a-346d17a4aeba service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:46.752269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f2f9c825-b8a8-4bbc-8b6d-1107e4915fbf req-17cc3b09-3d88-4748-ac9a-346d17a4aeba service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:46.755300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f2f9c825-b8a8-4bbc-8b6d-1107e4915fbf req-17cc3b09-3d88-4748-ac9a-346d17a4aeba service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:46.784393 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f2f9c825-b8a8-4bbc-8b6d-1107e4915fbf req-17cc3b09-3d88-4748-ac9a-346d17a4aeba service nova] Creating event network-vif-deleted:cfc3e15c-0e8c-49d8-885b-7827d5c6c133 for instance 8e83b077-4692-4351-8b85-e82dd3661af8 on n-h2-861111-1 Oct 12 22:10:46.796876 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f2f9c825-b8a8-4bbc-8b6d-1107e4915fbf req-17cc3b09-3d88-4748-ac9a-346d17a4aeba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065958 Oct 12 22:10:46.802355 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1609/2881] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:46.851703 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3231f0a0-61cf-4009-9792-8163d17d7976 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89/action" status: 202 len: 0 microversion: 2.91 time: 0.179983 Oct 12 22:10:46.855660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f59d072c-e090-4e84-8460-aa589274a50f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:46.856553 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1273/2882] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 12 22:10:46 2022] POST /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:10:46.857313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f59d072c-e090-4e84-8460-aa589274a50f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:46.864659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ab3cc97c-9f15-454c-8829-fc1e29a17c6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:46.865469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ab3cc97c-9f15-454c-8829-fc1e29a17c6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:46.874426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab3cc97c-9f15-454c-8829-fc1e29a17c6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:46.875191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab3cc97c-9f15-454c-8829-fc1e29a17c6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:46.875350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f59d072c-e090-4e84-8460-aa589274a50f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:46.875844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f59d072c-e090-4e84-8460-aa589274a50f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:46.876099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab3cc97c-9f15-454c-8829-fc1e29a17c6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:46.876280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f59d072c-e090-4e84-8460-aa589274a50f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:46.876999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f59d072c-e090-4e84-8460-aa589274a50f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:46.877354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab3cc97c-9f15-454c-8829-fc1e29a17c6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:46.877472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f59d072c-e090-4e84-8460-aa589274a50f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:46.877859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f59d072c-e090-4e84-8460-aa589274a50f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:46.878219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab3cc97c-9f15-454c-8829-fc1e29a17c6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:46.878836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab3cc97c-9f15-454c-8829-fc1e29a17c6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:47.101228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ab3cc97c-9f15-454c-8829-fc1e29a17c6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:47.112076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ab3cc97c-9f15-454c-8829-fc1e29a17c6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:47.113547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ab3cc97c-9f15-454c-8829-fc1e29a17c6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:47.138637 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ab3cc97c-9f15-454c-8829-fc1e29a17c6d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1486 microversion: 2.91 time: 0.280778 Oct 12 22:10:47.139573 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1274/2883] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:46 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1486 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:47.145881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6c1fb197-a156-4b04-9b2d-e8359592466d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:47.161479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6c1fb197-a156-4b04-9b2d-e8359592466d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:47.193432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c1fb197-a156-4b04-9b2d-e8359592466d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:47.196525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c1fb197-a156-4b04-9b2d-e8359592466d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:47.200355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c1fb197-a156-4b04-9b2d-e8359592466d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:47.201418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c1fb197-a156-4b04-9b2d-e8359592466d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:47.202082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c1fb197-a156-4b04-9b2d-e8359592466d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:47.203053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c1fb197-a156-4b04-9b2d-e8359592466d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:47.282000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f59d072c-e090-4e84-8460-aa589274a50f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e045d919104fa89572a2d05993abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214f86d71a5749b9b98dffe934fe7f1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:47.299602 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f59d072c-e090-4e84-8460-aa589274a50f tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8" status: 200 len: 1300 microversion: 2.1 time: 0.448895 Oct 12 22:10:47.300754 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1610/2884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:46 2022] GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 => generated 1300 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:47.306058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-91d232cc-8d0c-4a2e-ab73-29025ed7f294 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:47.320150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-91d232cc-8d0c-4a2e-ab73-29025ed7f294 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:47.331871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91d232cc-8d0c-4a2e-ab73-29025ed7f294 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:47.332670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91d232cc-8d0c-4a2e-ab73-29025ed7f294 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:47.333283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91d232cc-8d0c-4a2e-ab73-29025ed7f294 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:47.334701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91d232cc-8d0c-4a2e-ab73-29025ed7f294 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:47.335465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91d232cc-8d0c-4a2e-ab73-29025ed7f294 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:47.336076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91d232cc-8d0c-4a2e-ab73-29025ed7f294 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:47.548873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6c1fb197-a156-4b04-9b2d-e8359592466d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:47.559152 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6c1fb197-a156-4b04-9b2d-e8359592466d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.416913 Oct 12 22:10:47.564520 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1275/2885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:47 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:47.573147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-72a72121-f3e9-476f-8267-ad02f1aaa966 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:47.574040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-72a72121-f3e9-476f-8267-ad02f1aaa966 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:47.584756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72a72121-f3e9-476f-8267-ad02f1aaa966 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:47.585252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72a72121-f3e9-476f-8267-ad02f1aaa966 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:47.585954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72a72121-f3e9-476f-8267-ad02f1aaa966 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:47.586751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72a72121-f3e9-476f-8267-ad02f1aaa966 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:47.587208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72a72121-f3e9-476f-8267-ad02f1aaa966 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:47.587736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72a72121-f3e9-476f-8267-ad02f1aaa966 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:47.645568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-91d232cc-8d0c-4a2e-ab73-29025ed7f294 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:47.649885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:47.655148 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-91d232cc-8d0c-4a2e-ab73-29025ed7f294 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.353215 Oct 12 22:10:47.663948 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1611/2886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:47 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:47.677970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7e62998d-09b7-4ace-8910-ce5e6a30147d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:47.678602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7e62998d-09b7-4ace-8910-ce5e6a30147d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:47.697889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e62998d-09b7-4ace-8910-ce5e6a30147d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:47.701623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e62998d-09b7-4ace-8910-ce5e6a30147d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:47.705498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e62998d-09b7-4ace-8910-ce5e6a30147d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:47.706427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e62998d-09b7-4ace-8910-ce5e6a30147d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:47.707046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e62998d-09b7-4ace-8910-ce5e6a30147d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:47.707770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e62998d-09b7-4ace-8910-ce5e6a30147d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:47.814575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7e62998d-09b7-4ace-8910-ce5e6a30147d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:47.825349 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7e62998d-09b7-4ace-8910-ce5e6a30147d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1275 microversion: 2.1 time: 0.160170 Oct 12 22:10:47.825865 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1612/2887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:47 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:47.830471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-98e89231-789f-4a34-94ec-04c3f971a555 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-996501818"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:47.832927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-98e89231-789f-4a34-94ec-04c3f971a555 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:47.840275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98e89231-789f-4a34-94ec-04c3f971a555 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:47.840994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98e89231-789f-4a34-94ec-04c3f971a555 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:47.841613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98e89231-789f-4a34-94ec-04c3f971a555 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:47.842516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98e89231-789f-4a34-94ec-04c3f971a555 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:47.843154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98e89231-789f-4a34-94ec-04c3f971a555 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:47.843785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98e89231-789f-4a34-94ec-04c3f971a555 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:47.847150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-72a72121-f3e9-476f-8267-ad02f1aaa966 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:47.856656 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-72a72121-f3e9-476f-8267-ad02f1aaa966 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.290401 Oct 12 22:10:47.857739 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1276/2888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:47 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:48.140855 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-98e89231-789f-4a34-94ec-04c3f971a555 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 202 len: 0 microversion: 2.1 time: 0.312866 Oct 12 22:10:48.151731 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1613/2889] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:10:47 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 12 22:10:48.172897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2f6ec3f1-eaca-4c8f-8650-2d0c0d9f895a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:48.174158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f6ec3f1-eaca-4c8f-8650-2d0c0d9f895a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:48.191402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f6ec3f1-eaca-4c8f-8650-2d0c0d9f895a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:48.193140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f6ec3f1-eaca-4c8f-8650-2d0c0d9f895a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:48.194474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f6ec3f1-eaca-4c8f-8650-2d0c0d9f895a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:48.195410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f6ec3f1-eaca-4c8f-8650-2d0c0d9f895a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:48.196082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f6ec3f1-eaca-4c8f-8650-2d0c0d9f895a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:48.196696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f6ec3f1-eaca-4c8f-8650-2d0c0d9f895a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:48.281744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f6ec3f1-eaca-4c8f-8650-2d0c0d9f895a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:48.299792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f6ec3f1-eaca-4c8f-8650-2d0c0d9f895a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:48.302441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f6ec3f1-eaca-4c8f-8650-2d0c0d9f895a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:48.309340 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2f6ec3f1-eaca-4c8f-8650-2d0c0d9f895a tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1486 microversion: 2.91 time: 0.140454 Oct 12 22:10:48.310529 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1277/2890] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:48 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1486 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:48.337297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-56dc4b42-3c5a-47fb-9a6f-4505f5dacb38 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:48.338064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-56dc4b42-3c5a-47fb-9a6f-4505f5dacb38 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] [instance: 8e83b077-4692-4351-8b85-e82dd3661af8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:48.350700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56dc4b42-3c5a-47fb-9a6f-4505f5dacb38 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:48.351200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56dc4b42-3c5a-47fb-9a6f-4505f5dacb38 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:48.353178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56dc4b42-3c5a-47fb-9a6f-4505f5dacb38 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:48.353906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56dc4b42-3c5a-47fb-9a6f-4505f5dacb38 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:48.354364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56dc4b42-3c5a-47fb-9a6f-4505f5dacb38 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:48.354787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56dc4b42-3c5a-47fb-9a6f-4505f5dacb38 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:48.391893 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-56dc4b42-3c5a-47fb-9a6f-4505f5dacb38 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] HTTP exception thrown: Instance 8e83b077-4692-4351-8b85-e82dd3661af8 could not be found. Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-56dc4b42-3c5a-47fb-9a6f-4505f5dacb38 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Request method failure captured: Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 HTTP/1.1 Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzsOoCBjc82qYrgXGJcyS2C14AOyPaAY8jKON607aXBRETBa1-csxQQTd0dgLMFOSgjqcymNifeM8Cm_FMIYg-_UXGIEhCMX-O3n3HlLkfS0dfrzyRNsTuLIp0L-pAR76rzZrOO2f-Vw4UsY6dbCy5X6TdVdQGY9sHIG-ct3MYAKFNg Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_214f86d71a5749b9b98dffe934fe7f1f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/214f86d71a5749b9b98dffe934fe7f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 214f86d71a5749b9b98dffe934fe7f1f Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-180015320 Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 81e045d919104fa89572a2d05993abb8 Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupsTestJSON-180015320-project Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 8e83b077-4692-4351-8b85-e82dd3661af8 could not be found. Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '8e83b077-4692-4351-8b85-e82dd3661af8'} Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e83b077-4692-4351-8b85-e82dd3661af8 could not be found. Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e83b077-4692-4351-8b85-e82dd3661af8 could not be found. Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:10:48.395190 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:48.398994 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:10:48.398994 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:10:48.398994 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:10:48.398994 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:10:48.398994 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:10:48.398994 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e83b077-4692-4351-8b85-e82dd3661af8 could not be found. Oct 12 22:10:48.398994 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:10:48.403354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-56dc4b42-3c5a-47fb-9a6f-4505f5dacb38 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Returning 404 to user: Instance 8e83b077-4692-4351-8b85-e82dd3661af8 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:10:48.404552 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-56dc4b42-3c5a-47fb-9a6f-4505f5dacb38 tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8" status: 404 len: 111 microversion: 2.1 time: 0.072954 Oct 12 22:10:48.408972 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1614/2891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:48 2022] GET /compute/v2.1/servers/8e83b077-4692-4351-8b85-e82dd3661af8 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:10:48.415451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dc5b08b7-447c-424a-973f-2b0637db610c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f51236ecee0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:48.589189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-36be4eb9-0c1c-4322-9be5-76f466dce993 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:48.589945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-36be4eb9-0c1c-4322-9be5-76f466dce993 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:48.606505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36be4eb9-0c1c-4322-9be5-76f466dce993 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:48.607020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36be4eb9-0c1c-4322-9be5-76f466dce993 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:48.616230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36be4eb9-0c1c-4322-9be5-76f466dce993 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:48.617359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36be4eb9-0c1c-4322-9be5-76f466dce993 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:48.618031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36be4eb9-0c1c-4322-9be5-76f466dce993 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:48.619560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36be4eb9-0c1c-4322-9be5-76f466dce993 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:48.822743 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dc5b08b7-447c-424a-973f-2b0637db610c tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c516e4d1-3dac-4b07-a7c0-91cda7793f8c" status: 202 len: 0 microversion: 2.1 time: 0.411520 Oct 12 22:10:48.823983 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1278/2892] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:10:48 2022] DELETE /compute/v2.1/os-security-groups/c516e4d1-3dac-4b07-a7c0-91cda7793f8c => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:10:48.841790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b9ccd030-7aad-4e8b-a478-0e945074baec tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] Calling method '.version_select at 0x7f51235dc550>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:49.024382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-36be4eb9-0c1c-4322-9be5-76f466dce993 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:49.033383 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-36be4eb9-0c1c-4322-9be5-76f466dce993 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.450268 Oct 12 22:10:49.034617 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1615/2893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:48 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:49.040396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d5ea702a-1561-4b10-afd8-7a54b88d7c07 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:49.041394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d5ea702a-1561-4b10-afd8-7a54b88d7c07 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:49.047692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5ea702a-1561-4b10-afd8-7a54b88d7c07 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:49.048183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5ea702a-1561-4b10-afd8-7a54b88d7c07 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:49.048967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5ea702a-1561-4b10-afd8-7a54b88d7c07 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:49.049886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5ea702a-1561-4b10-afd8-7a54b88d7c07 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:49.050785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5ea702a-1561-4b10-afd8-7a54b88d7c07 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:49.051604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5ea702a-1561-4b10-afd8-7a54b88d7c07 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:49.082038 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b9ccd030-7aad-4e8b-a478-0e945074baec tempest-SecurityGroupsTestJSON-180015320 tempest-SecurityGroupsTestJSON-180015320-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/35e47f71-29c6-45ad-808b-4f2b4ead8ea4" status: 202 len: 0 microversion: 2.1 time: 0.249875 Oct 12 22:10:49.083215 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1279/2894] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:10:48 2022] DELETE /compute/v2.1/os-security-groups/35e47f71-29c6-45ad-808b-4f2b4ead8ea4 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:10:49.090885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f96e94b-bc35-4b9c-806d-1a00a05c88a5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:49.092113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8f96e94b-bc35-4b9c-806d-1a00a05c88a5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:49.107860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f96e94b-bc35-4b9c-806d-1a00a05c88a5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:49.108618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f96e94b-bc35-4b9c-806d-1a00a05c88a5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:49.109274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f96e94b-bc35-4b9c-806d-1a00a05c88a5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:49.110059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f96e94b-bc35-4b9c-806d-1a00a05c88a5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:49.110588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f96e94b-bc35-4b9c-806d-1a00a05c88a5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:49.119613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f96e94b-bc35-4b9c-806d-1a00a05c88a5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:49.267532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f96e94b-bc35-4b9c-806d-1a00a05c88a5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:49.276028 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f96e94b-bc35-4b9c-806d-1a00a05c88a5 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.190721 Oct 12 22:10:49.276625 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1280/2895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:49 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:49.337767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dcda80b6-58c1-491d-b711-27d36d392f78 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:49.338573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dcda80b6-58c1-491d-b711-27d36d392f78 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:49.344882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcda80b6-58c1-491d-b711-27d36d392f78 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:49.345291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcda80b6-58c1-491d-b711-27d36d392f78 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:49.345728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcda80b6-58c1-491d-b711-27d36d392f78 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:49.346439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcda80b6-58c1-491d-b711-27d36d392f78 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:49.346888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcda80b6-58c1-491d-b711-27d36d392f78 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:49.347340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcda80b6-58c1-491d-b711-27d36d392f78 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:49.414560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dcda80b6-58c1-491d-b711-27d36d392f78 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:49.422994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dcda80b6-58c1-491d-b711-27d36d392f78 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:49.424577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dcda80b6-58c1-491d-b711-27d36d392f78 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:49.429791 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dcda80b6-58c1-491d-b711-27d36d392f78 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.096243 Oct 12 22:10:49.431007 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1281/2896] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:49 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:10:49.682188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-363622115", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "58eb8c17-6d61-4cf3-a552-ce1d3ca2556e"}], "security_groups": [{"name": "tempest-securitygroup--224019792"}], "key_name": "tempest-keypair-1163312936", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "5d2f6e36-d8c2-495d-aae1-85c4a1e2493a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:49.686754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d5ea702a-1561-4b10-afd8-7a54b88d7c07 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:49.707662 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d5ea702a-1561-4b10-afd8-7a54b88d7c07 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1317 microversion: 2.1 time: 0.671570 Oct 12 22:10:49.709145 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1616/2897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:49 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1317 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:49.817632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] validate_networks() for [('58eb8c17-6d61-4cf3-a552-ce1d3ca2556e', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:10:50.060985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e5844e7e-527b-42f9-b5b5-080d2b38022b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:50.061663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e5844e7e-527b-42f9-b5b5-080d2b38022b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:50.069436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5844e7e-527b-42f9-b5b5-080d2b38022b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:50.069924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5844e7e-527b-42f9-b5b5-080d2b38022b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:50.070402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5844e7e-527b-42f9-b5b5-080d2b38022b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:50.071817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5844e7e-527b-42f9-b5b5-080d2b38022b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:50.072270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5844e7e-527b-42f9-b5b5-080d2b38022b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:50.072691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5844e7e-527b-42f9-b5b5-080d2b38022b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:50.347830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Getting quotas for project 7e47ba5c93ba476c8114f5ed002eb2cb. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:10:50.355952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Getting quotas for user fac8025b0fc84f118ecf10cf6bc25cd0 and project 7e47ba5c93ba476c8114f5ed002eb2cb. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:10:50.372213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:10:50.373500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:10:50.374595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:10:50.375411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:10:50.376300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:10:50.388667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:50.389733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:50.390487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:50.391895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:50.393001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:50.394050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:50.423058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Getting quotas for project 7e47ba5c93ba476c8114f5ed002eb2cb. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:10:50.431595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Getting quotas for user fac8025b0fc84f118ecf10cf6bc25cd0 and project 7e47ba5c93ba476c8114f5ed002eb2cb. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:10:50.480765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e5844e7e-527b-42f9-b5b5-080d2b38022b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:50.491831 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e5844e7e-527b-42f9-b5b5-080d2b38022b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.435193 Oct 12 22:10:50.513546 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1617/2898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:50 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:50.519010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:10:50.520300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7b5ea01b-4c1d-4fd0-ab4c-1d24933ea1f3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:50.521378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5d2f6e36-d8c2-495d-aae1-85c4a1e2493a',volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:10:50.521548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7b5ea01b-4c1d-4fd0-ab4c-1d24933ea1f3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:50.531745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b5ea01b-4c1d-4fd0-ab4c-1d24933ea1f3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:50.532416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b5ea01b-4c1d-4fd0-ab4c-1d24933ea1f3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:50.533205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b5ea01b-4c1d-4fd0-ab4c-1d24933ea1f3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:50.534135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b5ea01b-4c1d-4fd0-ab4c-1d24933ea1f3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:50.534960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b5ea01b-4c1d-4fd0-ab4c-1d24933ea1f3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:50.535612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b5ea01b-4c1d-4fd0-ab4c-1d24933ea1f3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:50.773168 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8cbebce6-aa7c-4c91-9d00-a98fd6cf980d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.095672 Oct 12 22:10:50.781000 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1282/2899] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:10:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:10:50.787974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8c45e42f-877e-4a29-97c9-f8f2df41abdc tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:50.788658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8c45e42f-877e-4a29-97c9-f8f2df41abdc tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:50.799455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c45e42f-877e-4a29-97c9-f8f2df41abdc tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:50.799951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c45e42f-877e-4a29-97c9-f8f2df41abdc tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:50.800424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c45e42f-877e-4a29-97c9-f8f2df41abdc tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:50.801650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c45e42f-877e-4a29-97c9-f8f2df41abdc tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:50.802343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c45e42f-877e-4a29-97c9-f8f2df41abdc tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:50.803058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c45e42f-877e-4a29-97c9-f8f2df41abdc tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:50.886564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8c45e42f-877e-4a29-97c9-f8f2df41abdc tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:50.895810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8c45e42f-877e-4a29-97c9-f8f2df41abdc tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:50.900205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8c45e42f-877e-4a29-97c9-f8f2df41abdc tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:50.906614 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8c45e42f-877e-4a29-97c9-f8f2df41abdc tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.128862 Oct 12 22:10:50.923262 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1283/2900] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:50 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:50.928036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-4fa298f5-33c0-48a1-a52e-4228c9891a11 req-d1799fd2-18c0-4473-a79b-5abfae13cd8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba7407a-199c-49e6-947d-eee5e1e616c7", "tag": "4bee2c3f-5642-485e-a878-61e340a21f21"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:50.939705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4fa298f5-33c0-48a1-a52e-4228c9891a11 req-d1799fd2-18c0-4473-a79b-5abfae13cd8d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:50.940546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4fa298f5-33c0-48a1-a52e-4228c9891a11 req-d1799fd2-18c0-4473-a79b-5abfae13cd8d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:50.941153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4fa298f5-33c0-48a1-a52e-4228c9891a11 req-d1799fd2-18c0-4473-a79b-5abfae13cd8d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:50.953826 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-4fa298f5-33c0-48a1-a52e-4228c9891a11 req-d1799fd2-18c0-4473-a79b-5abfae13cd8d service nova] Creating event network-changed:4bee2c3f-5642-485e-a878-61e340a21f21 for instance cba7407a-199c-49e6-947d-eee5e1e616c7 on n-h2-861111-1 Oct 12 22:10:50.976533 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-4fa298f5-33c0-48a1-a52e-4228c9891a11 req-d1799fd2-18c0-4473-a79b-5abfae13cd8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056884 Oct 12 22:10:50.978404 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1284/2901] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:50.991327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-861bcce6-f3af-4f54-8f08-f0985cee63af tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:50.992045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-861bcce6-f3af-4f54-8f08-f0985cee63af tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:50.999529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7b5ea01b-4c1d-4fd0-ab4c-1d24933ea1f3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:51.012862 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7b5ea01b-4c1d-4fd0-ab4c-1d24933ea1f3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.497416 Oct 12 22:10:51.014495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-861bcce6-f3af-4f54-8f08-f0985cee63af tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:51.015337 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1618/2902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:50 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:51.020321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-861bcce6-f3af-4f54-8f08-f0985cee63af tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:51.020814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-861bcce6-f3af-4f54-8f08-f0985cee63af tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:51.021554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-861bcce6-f3af-4f54-8f08-f0985cee63af tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:51.022015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-861bcce6-f3af-4f54-8f08-f0985cee63af tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:51.022442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-861bcce6-f3af-4f54-8f08-f0985cee63af tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:51.027913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb912ad5-5782-4a3d-9d9b-425ce699cca2 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:51.034368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cb912ad5-5782-4a3d-9d9b-425ce699cca2 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:51.188490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cb912ad5-5782-4a3d-9d9b-425ce699cca2 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:51.199752 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cb912ad5-5782-4a3d-9d9b-425ce699cca2 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1121 microversion: 2.1 time: 0.180368 Oct 12 22:10:51.215282 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1619/2903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:51 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1121 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:51.261039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-861bcce6-f3af-4f54-8f08-f0985cee63af tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:51.272443 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-861bcce6-f3af-4f54-8f08-f0985cee63af tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1317 microversion: 2.1 time: 0.292664 Oct 12 22:10:51.273577 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1285/2904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:50 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:51.521459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cabb7f02-e1a6-42e5-a991-8d10996dd2e0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:51.522267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cabb7f02-e1a6-42e5-a991-8d10996dd2e0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:51.535746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cabb7f02-e1a6-42e5-a991-8d10996dd2e0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:51.536247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cabb7f02-e1a6-42e5-a991-8d10996dd2e0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:51.536688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cabb7f02-e1a6-42e5-a991-8d10996dd2e0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:51.537401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cabb7f02-e1a6-42e5-a991-8d10996dd2e0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:51.537859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cabb7f02-e1a6-42e5-a991-8d10996dd2e0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:51.538287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cabb7f02-e1a6-42e5-a991-8d10996dd2e0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:51.933967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-27ea7e61-bd08-4430-9e68-955b9cd21c8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:51.935391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-27ea7e61-bd08-4430-9e68-955b9cd21c8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:51.944640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27ea7e61-bd08-4430-9e68-955b9cd21c8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:51.950434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27ea7e61-bd08-4430-9e68-955b9cd21c8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:51.951116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27ea7e61-bd08-4430-9e68-955b9cd21c8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:51.952049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27ea7e61-bd08-4430-9e68-955b9cd21c8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:51.952667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27ea7e61-bd08-4430-9e68-955b9cd21c8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:51.953260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27ea7e61-bd08-4430-9e68-955b9cd21c8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:52.094029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-27ea7e61-bd08-4430-9e68-955b9cd21c8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:52.110814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-27ea7e61-bd08-4430-9e68-955b9cd21c8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:52.112623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-27ea7e61-bd08-4430-9e68-955b9cd21c8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:52.120618 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-27ea7e61-bd08-4430-9e68-955b9cd21c8c tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.190461 Oct 12 22:10:52.125818 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1286/2905] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:51 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:52.130753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5f211081-de45-4b59-8e7b-bd5bc8522e1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:52.136428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5f211081-de45-4b59-8e7b-bd5bc8522e1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:52.151351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f211081-de45-4b59-8e7b-bd5bc8522e1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:52.152157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f211081-de45-4b59-8e7b-bd5bc8522e1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:52.152810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f211081-de45-4b59-8e7b-bd5bc8522e1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:52.156102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f211081-de45-4b59-8e7b-bd5bc8522e1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:52.156805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f211081-de45-4b59-8e7b-bd5bc8522e1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:52.157438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f211081-de45-4b59-8e7b-bd5bc8522e1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:52.193641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cabb7f02-e1a6-42e5-a991-8d10996dd2e0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:52.219991 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cabb7f02-e1a6-42e5-a991-8d10996dd2e0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.696244 Oct 12 22:10:52.240356 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1620/2906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:51 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:52.253512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-0a45b132-dae7-4748-91ac-41e7cef6e937 req-77b37735-fd08-4a6f-be2f-10c321ef06dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fae77315-a6c0-474c-aef9-5c8edda79113", "name": "network-vif-plugged", "status": "completed", "tag": "78b7a819-d94a-4d81-ad53-c90d49702e64"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:52.309035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0a45b132-dae7-4748-91ac-41e7cef6e937 req-77b37735-fd08-4a6f-be2f-10c321ef06dd service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:52.310704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0a45b132-dae7-4748-91ac-41e7cef6e937 req-77b37735-fd08-4a6f-be2f-10c321ef06dd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:52.311609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0a45b132-dae7-4748-91ac-41e7cef6e937 req-77b37735-fd08-4a6f-be2f-10c321ef06dd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:52.375700 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-0a45b132-dae7-4748-91ac-41e7cef6e937 req-77b37735-fd08-4a6f-be2f-10c321ef06dd service nova] Creating event network-vif-plugged:78b7a819-d94a-4d81-ad53-c90d49702e64 for instance fae77315-a6c0-474c-aef9-5c8edda79113 on n-h2-861111-1 Oct 12 22:10:52.401822 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-0a45b132-dae7-4748-91ac-41e7cef6e937 req-77b37735-fd08-4a6f-be2f-10c321ef06dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155149 Oct 12 22:10:52.405107 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1621/2907] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:52.426442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1dbc9c2b-e4a9-4858-a87f-942615112e1a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:52.428659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1dbc9c2b-e4a9-4858-a87f-942615112e1a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:52.454257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dbc9c2b-e4a9-4858-a87f-942615112e1a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:52.455055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dbc9c2b-e4a9-4858-a87f-942615112e1a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:52.456574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dbc9c2b-e4a9-4858-a87f-942615112e1a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:52.457864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dbc9c2b-e4a9-4858-a87f-942615112e1a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:52.469164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dbc9c2b-e4a9-4858-a87f-942615112e1a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:52.469164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dbc9c2b-e4a9-4858-a87f-942615112e1a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:52.504579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5f211081-de45-4b59-8e7b-bd5bc8522e1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:52.520775 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5f211081-de45-4b59-8e7b-bd5bc8522e1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.393589 Oct 12 22:10:52.538357 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1287/2908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:52 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:52.546993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cfa91015-ae5b-4673-b211-be121ee32577 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:52.551927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cfa91015-ae5b-4673-b211-be121ee32577 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:52.564187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfa91015-ae5b-4673-b211-be121ee32577 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:52.565154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfa91015-ae5b-4673-b211-be121ee32577 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:52.572170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfa91015-ae5b-4673-b211-be121ee32577 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:52.573245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfa91015-ae5b-4673-b211-be121ee32577 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:52.573935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfa91015-ae5b-4673-b211-be121ee32577 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:52.574680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfa91015-ae5b-4673-b211-be121ee32577 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:52.681295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1dbc9c2b-e4a9-4858-a87f-942615112e1a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:52.689893 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1dbc9c2b-e4a9-4858-a87f-942615112e1a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1219 microversion: 2.1 time: 0.283319 Oct 12 22:10:52.703646 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1622/2909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:52 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1219 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:52.890504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cfa91015-ae5b-4673-b211-be121ee32577 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:52.912901 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cfa91015-ae5b-4673-b211-be121ee32577 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1317 microversion: 2.1 time: 0.363208 Oct 12 22:10:52.915264 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1288/2910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:52 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:53.173519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-811fe1da-1fc6-4d62-9d38-aad0fe7bddd1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:53.176797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-811fe1da-1fc6-4d62-9d38-aad0fe7bddd1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:53.223913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-811fe1da-1fc6-4d62-9d38-aad0fe7bddd1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:53.228912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-811fe1da-1fc6-4d62-9d38-aad0fe7bddd1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:53.230462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-811fe1da-1fc6-4d62-9d38-aad0fe7bddd1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:53.234678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-811fe1da-1fc6-4d62-9d38-aad0fe7bddd1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:53.236616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-811fe1da-1fc6-4d62-9d38-aad0fe7bddd1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:53.238332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-811fe1da-1fc6-4d62-9d38-aad0fe7bddd1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:53.255602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6c279e67-f918-4658-b6e2-6202c2395710 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:53.256940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6c279e67-f918-4658-b6e2-6202c2395710 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:53.268311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c279e67-f918-4658-b6e2-6202c2395710 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:53.274138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c279e67-f918-4658-b6e2-6202c2395710 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:53.274822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c279e67-f918-4658-b6e2-6202c2395710 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:53.276489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c279e67-f918-4658-b6e2-6202c2395710 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:53.277656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c279e67-f918-4658-b6e2-6202c2395710 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:53.278310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c279e67-f918-4658-b6e2-6202c2395710 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:53.616423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-811fe1da-1fc6-4d62-9d38-aad0fe7bddd1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:53.640381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-811fe1da-1fc6-4d62-9d38-aad0fe7bddd1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:53.657205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-811fe1da-1fc6-4d62-9d38-aad0fe7bddd1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:53.676339 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-811fe1da-1fc6-4d62-9d38-aad0fe7bddd1 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.517261 Oct 12 22:10:53.677501 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1623/2911] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:53 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:53.683508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6840bc12-b69b-483e-905f-d6916ebc7787 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:53.693642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6840bc12-b69b-483e-905f-d6916ebc7787 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:53.720409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6840bc12-b69b-483e-905f-d6916ebc7787 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:53.721161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6840bc12-b69b-483e-905f-d6916ebc7787 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:53.721746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6840bc12-b69b-483e-905f-d6916ebc7787 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:53.722644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6840bc12-b69b-483e-905f-d6916ebc7787 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:53.723281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6840bc12-b69b-483e-905f-d6916ebc7787 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:53.723860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6840bc12-b69b-483e-905f-d6916ebc7787 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:54.121841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6840bc12-b69b-483e-905f-d6916ebc7787 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:54.130535 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6840bc12-b69b-483e-905f-d6916ebc7787 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.451641 Oct 12 22:10:54.138816 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1624/2912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:53 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:54.143764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ac1eb418-e5e4-4815-8f31-bd5d322d5cf1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:54.160396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ac1eb418-e5e4-4815-8f31-bd5d322d5cf1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:54.189951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac1eb418-e5e4-4815-8f31-bd5d322d5cf1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:54.192137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac1eb418-e5e4-4815-8f31-bd5d322d5cf1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:54.196892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac1eb418-e5e4-4815-8f31-bd5d322d5cf1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:54.201929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac1eb418-e5e4-4815-8f31-bd5d322d5cf1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:54.202930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac1eb418-e5e4-4815-8f31-bd5d322d5cf1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:54.203736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac1eb418-e5e4-4815-8f31-bd5d322d5cf1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:54.244191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6c279e67-f918-4658-b6e2-6202c2395710 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:54.264065 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6c279e67-f918-4658-b6e2-6202c2395710 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 1.013709 Oct 12 22:10:54.271978 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1289/2913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:53 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:54.287152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8660d7cf-a0eb-4fba-932b-acc58af21e71 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:54.290651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8660d7cf-a0eb-4fba-932b-acc58af21e71 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:54.321936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:54.323562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8660d7cf-a0eb-4fba-932b-acc58af21e71 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:54.324255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8660d7cf-a0eb-4fba-932b-acc58af21e71 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:54.324766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8660d7cf-a0eb-4fba-932b-acc58af21e71 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:54.325488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8660d7cf-a0eb-4fba-932b-acc58af21e71 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:54.325957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8660d7cf-a0eb-4fba-932b-acc58af21e71 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:54.326359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8660d7cf-a0eb-4fba-932b-acc58af21e71 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:54.475878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ac1eb418-e5e4-4815-8f31-bd5d322d5cf1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:54.483998 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ac1eb418-e5e4-4815-8f31-bd5d322d5cf1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1237 microversion: 2.1 time: 0.343816 Oct 12 22:10:54.491133 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1625/2914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:54 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1237 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:54.520116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d7ccbe4b-1f65-4f85-849e-577e5ca6fd84 req-66a8cf26-ae9a-40cd-bb0c-46c353c017a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fae77315-a6c0-474c-aef9-5c8edda79113", "name": "network-vif-plugged", "status": "completed", "tag": "ac01c165-88a6-42a2-b3a9-4b440eea669c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:54.548460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d7ccbe4b-1f65-4f85-849e-577e5ca6fd84 req-66a8cf26-ae9a-40cd-bb0c-46c353c017a0 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:54.557917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d7ccbe4b-1f65-4f85-849e-577e5ca6fd84 req-66a8cf26-ae9a-40cd-bb0c-46c353c017a0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:54.558562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d7ccbe4b-1f65-4f85-849e-577e5ca6fd84 req-66a8cf26-ae9a-40cd-bb0c-46c353c017a0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:54.613502 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d7ccbe4b-1f65-4f85-849e-577e5ca6fd84 req-66a8cf26-ae9a-40cd-bb0c-46c353c017a0 service nova] Creating event network-vif-plugged:ac01c165-88a6-42a2-b3a9-4b440eea669c for instance fae77315-a6c0-474c-aef9-5c8edda79113 on n-h2-861111-1 Oct 12 22:10:54.637135 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d7ccbe4b-1f65-4f85-849e-577e5ca6fd84 req-66a8cf26-ae9a-40cd-bb0c-46c353c017a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137978 Oct 12 22:10:54.641702 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1626/2915] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:10:54.708117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-36112322-d675-4e8d-9002-86873475de81 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:54.709393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-36112322-d675-4e8d-9002-86873475de81 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:54.728741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36112322-d675-4e8d-9002-86873475de81 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:54.731759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36112322-d675-4e8d-9002-86873475de81 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:54.732496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36112322-d675-4e8d-9002-86873475de81 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:54.740123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36112322-d675-4e8d-9002-86873475de81 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:54.740969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36112322-d675-4e8d-9002-86873475de81 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:54.741642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36112322-d675-4e8d-9002-86873475de81 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:54.846166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8660d7cf-a0eb-4fba-932b-acc58af21e71 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:54.849971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:54.858074 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8660d7cf-a0eb-4fba-932b-acc58af21e71 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1317 microversion: 2.1 time: 0.578038 Oct 12 22:10:54.858758 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1290/2916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:54 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:54.994651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-36112322-d675-4e8d-9002-86873475de81 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:55.017989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-36112322-d675-4e8d-9002-86873475de81 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:55.019494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-36112322-d675-4e8d-9002-86873475de81 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:55.037539 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-36112322-d675-4e8d-9002-86873475de81 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.333970 Oct 12 22:10:55.038143 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1627/2917] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:54 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:10:55.161505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd6a46cd-6a2f-4fb9-83d9-f6a6942d6628 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:55.166370 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cd6a46cd-6a2f-4fb9-83d9-f6a6942d6628 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:55.189249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd6a46cd-6a2f-4fb9-83d9-f6a6942d6628 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:55.189820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd6a46cd-6a2f-4fb9-83d9-f6a6942d6628 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:55.194831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd6a46cd-6a2f-4fb9-83d9-f6a6942d6628 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:55.195663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd6a46cd-6a2f-4fb9-83d9-f6a6942d6628 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:55.200919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd6a46cd-6a2f-4fb9-83d9-f6a6942d6628 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:55.201198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd6a46cd-6a2f-4fb9-83d9-f6a6942d6628 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:55.299394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-67d477cb-f35c-48c0-936f-eed9423e689e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:55.300312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-67d477cb-f35c-48c0-936f-eed9423e689e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:55.330653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67d477cb-f35c-48c0-936f-eed9423e689e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:55.331178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67d477cb-f35c-48c0-936f-eed9423e689e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:55.331986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67d477cb-f35c-48c0-936f-eed9423e689e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:55.332406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67d477cb-f35c-48c0-936f-eed9423e689e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:55.332937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67d477cb-f35c-48c0-936f-eed9423e689e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:55.333366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67d477cb-f35c-48c0-936f-eed9423e689e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:55.809167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cd6a46cd-6a2f-4fb9-83d9-f6a6942d6628 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:55.819294 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cd6a46cd-6a2f-4fb9-83d9-f6a6942d6628 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.661619 Oct 12 22:10:55.822344 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1291/2918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:55 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:55.857285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6aff1bd4-9c7e-4b2a-9ec4-c9d1da341498 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:55.862331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6aff1bd4-9c7e-4b2a-9ec4-c9d1da341498 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:55.886331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aff1bd4-9c7e-4b2a-9ec4-c9d1da341498 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:55.894582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aff1bd4-9c7e-4b2a-9ec4-c9d1da341498 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:55.895984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aff1bd4-9c7e-4b2a-9ec4-c9d1da341498 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:55.897662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aff1bd4-9c7e-4b2a-9ec4-c9d1da341498 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:55.899625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aff1bd4-9c7e-4b2a-9ec4-c9d1da341498 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:55.900873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aff1bd4-9c7e-4b2a-9ec4-c9d1da341498 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:56.224950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-67d477cb-f35c-48c0-936f-eed9423e689e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:56.244227 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-67d477cb-f35c-48c0-936f-eed9423e689e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.949869 Oct 12 22:10:56.247501 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1628/2919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:55 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:56.264289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2925161a-cb3c-412d-a361-440d27fde6e0 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:56.265185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2925161a-cb3c-412d-a361-440d27fde6e0 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:56.295548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2925161a-cb3c-412d-a361-440d27fde6e0 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:56.296042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2925161a-cb3c-412d-a361-440d27fde6e0 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:56.296507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2925161a-cb3c-412d-a361-440d27fde6e0 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:56.297453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2925161a-cb3c-412d-a361-440d27fde6e0 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:56.305291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2925161a-cb3c-412d-a361-440d27fde6e0 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:56.306034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2925161a-cb3c-412d-a361-440d27fde6e0 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:56.453908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6aff1bd4-9c7e-4b2a-9ec4-c9d1da341498 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:56.462615 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6aff1bd4-9c7e-4b2a-9ec4-c9d1da341498 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1304 microversion: 2.1 time: 0.628988 Oct 12 22:10:56.471319 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1292/2920] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:55 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1304 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:56.483721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-409297f2-88a9-4443-970a-1a57d44827e6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:56.484486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-409297f2-88a9-4443-970a-1a57d44827e6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:56.506688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-409297f2-88a9-4443-970a-1a57d44827e6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:56.509022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-409297f2-88a9-4443-970a-1a57d44827e6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:56.509607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-409297f2-88a9-4443-970a-1a57d44827e6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:56.519752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-409297f2-88a9-4443-970a-1a57d44827e6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:56.520644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-409297f2-88a9-4443-970a-1a57d44827e6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:56.521214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-409297f2-88a9-4443-970a-1a57d44827e6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:56.611430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2925161a-cb3c-412d-a361-440d27fde6e0 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:56.620090 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2925161a-cb3c-412d-a361-440d27fde6e0 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1317 microversion: 2.1 time: 0.371203 Oct 12 22:10:56.620689 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1629/2921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:56 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:56.673962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-409297f2-88a9-4443-970a-1a57d44827e6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:56.685649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-67aa4d0a-f6a1-4956-9cb6-0f52965f100a req-18be4f23-c362-4677-87ef-77691d16e84c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fae77315-a6c0-474c-aef9-5c8edda79113", "name": "network-vif-plugged", "status": "completed", "tag": "d80d4594-afa7-4bd2-9bef-eebbc4773763"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:56.687984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-409297f2-88a9-4443-970a-1a57d44827e6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:56.689917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-409297f2-88a9-4443-970a-1a57d44827e6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:56.700553 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-409297f2-88a9-4443-970a-1a57d44827e6 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.229574 Oct 12 22:10:56.700781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-67aa4d0a-f6a1-4956-9cb6-0f52965f100a req-18be4f23-c362-4677-87ef-77691d16e84c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:56.701158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-67aa4d0a-f6a1-4956-9cb6-0f52965f100a req-18be4f23-c362-4677-87ef-77691d16e84c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:56.701632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-67aa4d0a-f6a1-4956-9cb6-0f52965f100a req-18be4f23-c362-4677-87ef-77691d16e84c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:56.702506 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1293/2922] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:56 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:56.716944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:56.744125 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-67aa4d0a-f6a1-4956-9cb6-0f52965f100a req-18be4f23-c362-4677-87ef-77691d16e84c service nova] Creating event network-vif-plugged:d80d4594-afa7-4bd2-9bef-eebbc4773763 for instance fae77315-a6c0-474c-aef9-5c8edda79113 on n-h2-861111-1 Oct 12 22:10:56.753392 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-67aa4d0a-f6a1-4956-9cb6-0f52965f100a req-18be4f23-c362-4677-87ef-77691d16e84c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071211 Oct 12 22:10:56.755093 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1630/2923] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:56.850289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ef1e6742-694e-4374-a47c-2c013e7a6395 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:56.851217 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ef1e6742-694e-4374-a47c-2c013e7a6395 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:56.859606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef1e6742-694e-4374-a47c-2c013e7a6395 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:56.860761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef1e6742-694e-4374-a47c-2c013e7a6395 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:56.861341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef1e6742-694e-4374-a47c-2c013e7a6395 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:56.862214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef1e6742-694e-4374-a47c-2c013e7a6395 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:56.862799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef1e6742-694e-4374-a47c-2c013e7a6395 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:56.863407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef1e6742-694e-4374-a47c-2c013e7a6395 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:57.094502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ef1e6742-694e-4374-a47c-2c013e7a6395 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:57.105839 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ef1e6742-694e-4374-a47c-2c013e7a6395 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.262943 Oct 12 22:10:57.108273 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1294/2924] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:56 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:57.239002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-e0c9926f-f183-4d60-af3c-485deb8dd395 req-112e4b2b-224f-4402-bc28-e76c12e3b87f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55c3cea-33ea-435c-84b3-f668bd000c8c", "tag": "f17c481a-e1dd-4e92-afef-f445e4724b1c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:57.257841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e0c9926f-f183-4d60-af3c-485deb8dd395 req-112e4b2b-224f-4402-bc28-e76c12e3b87f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:57.259032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e0c9926f-f183-4d60-af3c-485deb8dd395 req-112e4b2b-224f-4402-bc28-e76c12e3b87f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:57.259678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e0c9926f-f183-4d60-af3c-485deb8dd395 req-112e4b2b-224f-4402-bc28-e76c12e3b87f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:57.270967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-775a2f76-6dac-4193-a281-3d3eefc675c8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:57.271615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-775a2f76-6dac-4193-a281-3d3eefc675c8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:57.282346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-775a2f76-6dac-4193-a281-3d3eefc675c8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:57.283094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-775a2f76-6dac-4193-a281-3d3eefc675c8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:57.283708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-775a2f76-6dac-4193-a281-3d3eefc675c8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:57.284572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-775a2f76-6dac-4193-a281-3d3eefc675c8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:57.285689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-775a2f76-6dac-4193-a281-3d3eefc675c8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:57.289597 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-e0c9926f-f183-4d60-af3c-485deb8dd395 req-112e4b2b-224f-4402-bc28-e76c12e3b87f service nova] Creating event network-changed:f17c481a-e1dd-4e92-afef-f445e4724b1c for instance f55c3cea-33ea-435c-84b3-f668bd000c8c on n-h1-861111-1 Oct 12 22:10:57.290268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-775a2f76-6dac-4193-a281-3d3eefc675c8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:57.305974 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-e0c9926f-f183-4d60-af3c-485deb8dd395 req-112e4b2b-224f-4402-bc28-e76c12e3b87f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073019 Oct 12 22:10:57.309732 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1631/2925] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:10:57.498268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6d72d874-9cc9-44ae-a379-22b9d9cce803 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:57.498981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6d72d874-9cc9-44ae-a379-22b9d9cce803 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:57.515106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d72d874-9cc9-44ae-a379-22b9d9cce803 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:57.517225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d72d874-9cc9-44ae-a379-22b9d9cce803 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:57.519111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d72d874-9cc9-44ae-a379-22b9d9cce803 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:57.525415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d72d874-9cc9-44ae-a379-22b9d9cce803 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:57.526660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d72d874-9cc9-44ae-a379-22b9d9cce803 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:57.527824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d72d874-9cc9-44ae-a379-22b9d9cce803 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:57.648478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-775a2f76-6dac-4193-a281-3d3eefc675c8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:57.656897 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-775a2f76-6dac-4193-a281-3d3eefc675c8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.390911 Oct 12 22:10:57.658256 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1295/2926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:57 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:57.666240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-61868477-54ab-4bcd-84b1-cce7d030008e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:57.667018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-61868477-54ab-4bcd-84b1-cce7d030008e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:57.676879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61868477-54ab-4bcd-84b1-cce7d030008e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:57.677583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61868477-54ab-4bcd-84b1-cce7d030008e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:57.678192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61868477-54ab-4bcd-84b1-cce7d030008e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:57.679066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61868477-54ab-4bcd-84b1-cce7d030008e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:57.680275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61868477-54ab-4bcd-84b1-cce7d030008e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:57.680864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61868477-54ab-4bcd-84b1-cce7d030008e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:57.853621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6d72d874-9cc9-44ae-a379-22b9d9cce803 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:57.861959 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6d72d874-9cc9-44ae-a379-22b9d9cce803 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1304 microversion: 2.1 time: 0.369992 Oct 12 22:10:57.876141 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1632/2927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:57 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1304 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:57.885498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-37bba1d1-b4ea-4bed-b60b-93067db12fb5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:57.886668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-37bba1d1-b4ea-4bed-b60b-93067db12fb5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:57.894418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:10:57.897365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37bba1d1-b4ea-4bed-b60b-93067db12fb5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:57.898186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37bba1d1-b4ea-4bed-b60b-93067db12fb5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:57.899040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37bba1d1-b4ea-4bed-b60b-93067db12fb5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:57.899997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37bba1d1-b4ea-4bed-b60b-93067db12fb5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:57.900638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37bba1d1-b4ea-4bed-b60b-93067db12fb5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:57.901228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37bba1d1-b4ea-4bed-b60b-93067db12fb5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:58.041222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-61868477-54ab-4bcd-84b1-cce7d030008e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:58.050037 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-61868477-54ab-4bcd-84b1-cce7d030008e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1317 microversion: 2.1 time: 0.388709 Oct 12 22:10:58.054247 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1296/2928] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:57 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:58.059164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-37bba1d1-b4ea-4bed-b60b-93067db12fb5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:58.078849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-37bba1d1-b4ea-4bed-b60b-93067db12fb5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:58.081395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-37bba1d1-b4ea-4bed-b60b-93067db12fb5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:58.094888 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-37bba1d1-b4ea-4bed-b60b-93067db12fb5 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.216768 Oct 12 22:10:58.100004 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1633/2929] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:57 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:58.136080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-02e37e15-85fb-434e-9541-29fb89bef2f4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:58.137229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-02e37e15-85fb-434e-9541-29fb89bef2f4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:58.153560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02e37e15-85fb-434e-9541-29fb89bef2f4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:58.154773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02e37e15-85fb-434e-9541-29fb89bef2f4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:58.155431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02e37e15-85fb-434e-9541-29fb89bef2f4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:58.156337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02e37e15-85fb-434e-9541-29fb89bef2f4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:58.156959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02e37e15-85fb-434e-9541-29fb89bef2f4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:58.157563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02e37e15-85fb-434e-9541-29fb89bef2f4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:58.440577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-02e37e15-85fb-434e-9541-29fb89bef2f4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:58.454141 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-02e37e15-85fb-434e-9541-29fb89bef2f4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.322868 Oct 12 22:10:58.454687 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1297/2930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:58 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:58.685025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-67fa57c3-a625-45ef-8f63-7c1c2ab94ef4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:58.686281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-67fa57c3-a625-45ef-8f63-7c1c2ab94ef4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:58.694373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67fa57c3-a625-45ef-8f63-7c1c2ab94ef4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:58.695791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67fa57c3-a625-45ef-8f63-7c1c2ab94ef4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:58.696423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67fa57c3-a625-45ef-8f63-7c1c2ab94ef4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:58.697362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67fa57c3-a625-45ef-8f63-7c1c2ab94ef4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:58.697976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67fa57c3-a625-45ef-8f63-7c1c2ab94ef4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:58.698566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67fa57c3-a625-45ef-8f63-7c1c2ab94ef4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:58.785191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-10302387-a5c8-4363-970a-5a28cdcc1522 req-6dcb03c2-41c8-4e43-be6e-92a436016a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4023ebba-05d4-4225-938a-c70c2490ae29", "name": "network-vif-unplugged", "status": "completed", "tag": "16f27b0f-2034-49b1-8fc7-d037682a37a4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:10:58.797013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-10302387-a5c8-4363-970a-5a28cdcc1522 req-6dcb03c2-41c8-4e43-be6e-92a436016a40 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:58.797745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-10302387-a5c8-4363-970a-5a28cdcc1522 req-6dcb03c2-41c8-4e43-be6e-92a436016a40 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:58.798361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-10302387-a5c8-4363-970a-5a28cdcc1522 req-6dcb03c2-41c8-4e43-be6e-92a436016a40 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:58.814315 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-10302387-a5c8-4363-970a-5a28cdcc1522 req-6dcb03c2-41c8-4e43-be6e-92a436016a40 service nova] Creating event network-vif-unplugged:16f27b0f-2034-49b1-8fc7-d037682a37a4 for instance 4023ebba-05d4-4225-938a-c70c2490ae29 on n-h2-861111-1 Oct 12 22:10:58.822457 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-10302387-a5c8-4363-970a-5a28cdcc1522 req-6dcb03c2-41c8-4e43-be6e-92a436016a40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041029 Oct 12 22:10:58.826899 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1298/2931] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:10:58.889812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6642c24f-58a6-4cba-bd8c-2d00bbd1b721 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:58.891060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6642c24f-58a6-4cba-bd8c-2d00bbd1b721 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:58.898220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6642c24f-58a6-4cba-bd8c-2d00bbd1b721 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:58.899084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6642c24f-58a6-4cba-bd8c-2d00bbd1b721 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:58.899743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6642c24f-58a6-4cba-bd8c-2d00bbd1b721 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:58.900679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6642c24f-58a6-4cba-bd8c-2d00bbd1b721 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:58.903070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6642c24f-58a6-4cba-bd8c-2d00bbd1b721 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:58.903787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6642c24f-58a6-4cba-bd8c-2d00bbd1b721 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:58.967057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-67fa57c3-a625-45ef-8f63-7c1c2ab94ef4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:58.976667 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-67fa57c3-a625-45ef-8f63-7c1c2ab94ef4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.295469 Oct 12 22:10:58.977606 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1634/2932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:58 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:59.080960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a11b1494-718d-4e01-af20-f4de93a81ace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:59.081983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a11b1494-718d-4e01-af20-f4de93a81ace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:59.089037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a11b1494-718d-4e01-af20-f4de93a81ace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:59.090061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a11b1494-718d-4e01-af20-f4de93a81ace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:59.090514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a11b1494-718d-4e01-af20-f4de93a81ace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:59.091997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a11b1494-718d-4e01-af20-f4de93a81ace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:59.092742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a11b1494-718d-4e01-af20-f4de93a81ace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:59.093321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a11b1494-718d-4e01-af20-f4de93a81ace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:59.210080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6642c24f-58a6-4cba-bd8c-2d00bbd1b721 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:59.221268 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6642c24f-58a6-4cba-bd8c-2d00bbd1b721 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1304 microversion: 2.1 time: 0.335709 Oct 12 22:10:59.222722 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1299/2933] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:58 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1304 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:10:59.229534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7196f7cc-100a-436c-a47a-f94953fb1a5b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:59.230678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7196f7cc-100a-436c-a47a-f94953fb1a5b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:59.239126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7196f7cc-100a-436c-a47a-f94953fb1a5b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:59.239841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7196f7cc-100a-436c-a47a-f94953fb1a5b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:59.240461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7196f7cc-100a-436c-a47a-f94953fb1a5b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:59.241163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7196f7cc-100a-436c-a47a-f94953fb1a5b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:59.241661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7196f7cc-100a-436c-a47a-f94953fb1a5b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:59.242224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7196f7cc-100a-436c-a47a-f94953fb1a5b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:59.247087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a11b1494-718d-4e01-af20-f4de93a81ace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:59.255781 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a11b1494-718d-4e01-af20-f4de93a81ace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1317 microversion: 2.1 time: 0.179602 Oct 12 22:10:59.258743 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1635/2934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:59 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:10:59.356209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7196f7cc-100a-436c-a47a-f94953fb1a5b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:59.365349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7196f7cc-100a-436c-a47a-f94953fb1a5b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:59.366862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7196f7cc-100a-436c-a47a-f94953fb1a5b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:59.372892 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7196f7cc-100a-436c-a47a-f94953fb1a5b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.148313 Oct 12 22:10:59.373819 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1300/2935] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:10:59 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:10:59.478661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b11e05c7-6257-49c1-913b-80041f6db6e2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:10:59.479716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b11e05c7-6257-49c1-913b-80041f6db6e2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:10:59.486066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b11e05c7-6257-49c1-913b-80041f6db6e2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:59.486553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b11e05c7-6257-49c1-913b-80041f6db6e2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:59.486997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b11e05c7-6257-49c1-913b-80041f6db6e2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:59.487723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b11e05c7-6257-49c1-913b-80041f6db6e2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:10:59.488180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b11e05c7-6257-49c1-913b-80041f6db6e2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:10:59.488712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b11e05c7-6257-49c1-913b-80041f6db6e2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:10:59.639966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b11e05c7-6257-49c1-913b-80041f6db6e2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:10:59.650006 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b11e05c7-6257-49c1-913b-80041f6db6e2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.175862 Oct 12 22:10:59.650594 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1636/2936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:10:59 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:00.006189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b35cfc20-cd67-4ca9-b622-14db4054aaf5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:00.006981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b35cfc20-cd67-4ca9-b622-14db4054aaf5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:00.020238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b35cfc20-cd67-4ca9-b622-14db4054aaf5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:00.020738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b35cfc20-cd67-4ca9-b622-14db4054aaf5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:00.026544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b35cfc20-cd67-4ca9-b622-14db4054aaf5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:00.027430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b35cfc20-cd67-4ca9-b622-14db4054aaf5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:00.027913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b35cfc20-cd67-4ca9-b622-14db4054aaf5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:00.028348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b35cfc20-cd67-4ca9-b622-14db4054aaf5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:00.246684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a0b648cc-4e42-4aa7-967d-2d6ac6f5fdc6 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:00.248170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a0b648cc-4e42-4aa7-967d-2d6ac6f5fdc6 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:00.258376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0b648cc-4e42-4aa7-967d-2d6ac6f5fdc6 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:00.259167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0b648cc-4e42-4aa7-967d-2d6ac6f5fdc6 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:00.259822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0b648cc-4e42-4aa7-967d-2d6ac6f5fdc6 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:00.260682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0b648cc-4e42-4aa7-967d-2d6ac6f5fdc6 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:00.261559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0b648cc-4e42-4aa7-967d-2d6ac6f5fdc6 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:00.262222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0b648cc-4e42-4aa7-967d-2d6ac6f5fdc6 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:00.371683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b35cfc20-cd67-4ca9-b622-14db4054aaf5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:00.386639 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b35cfc20-cd67-4ca9-b622-14db4054aaf5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.384311 Oct 12 22:11:00.388806 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1301/2937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:00 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:00.403690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-888eff83-9e4f-407a-a390-86d9a85de454 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:00.404547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-888eff83-9e4f-407a-a390-86d9a85de454 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:00.419474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:00.427308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-888eff83-9e4f-407a-a390-86d9a85de454 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:00.428022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-888eff83-9e4f-407a-a390-86d9a85de454 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:00.428617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-888eff83-9e4f-407a-a390-86d9a85de454 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:00.430332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-888eff83-9e4f-407a-a390-86d9a85de454 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:00.430940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-888eff83-9e4f-407a-a390-86d9a85de454 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:00.431558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-888eff83-9e4f-407a-a390-86d9a85de454 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:00.482902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=18 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:00.567544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a0b648cc-4e42-4aa7-967d-2d6ac6f5fdc6 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:00.584127 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a0b648cc-4e42-4aa7-967d-2d6ac6f5fdc6 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1304 microversion: 2.1 time: 0.342892 Oct 12 22:11:00.587403 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1637/2938] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:00 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1304 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:00.596917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-06366ae3-b6c1-4bfb-b981-90f66daf7196 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:00.602362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-06366ae3-b6c1-4bfb-b981-90f66daf7196 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:00.611629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06366ae3-b6c1-4bfb-b981-90f66daf7196 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:00.613908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06366ae3-b6c1-4bfb-b981-90f66daf7196 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:00.614642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06366ae3-b6c1-4bfb-b981-90f66daf7196 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:00.615670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06366ae3-b6c1-4bfb-b981-90f66daf7196 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:00.617110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06366ae3-b6c1-4bfb-b981-90f66daf7196 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:00.619788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06366ae3-b6c1-4bfb-b981-90f66daf7196 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:00.716624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-06366ae3-b6c1-4bfb-b981-90f66daf7196 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:00.743600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-06366ae3-b6c1-4bfb-b981-90f66daf7196 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:00.748337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-06366ae3-b6c1-4bfb-b981-90f66daf7196 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:00.784546 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-06366ae3-b6c1-4bfb-b981-90f66daf7196 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.194741 Oct 12 22:11:00.790176 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1638/2939] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:00 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:11:00.797229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-268cce2c-261d-4c79-b794-650a59b02dde tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:00.798383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-268cce2c-261d-4c79-b794-650a59b02dde tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:00.848274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-268cce2c-261d-4c79-b794-650a59b02dde tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:00.848996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-268cce2c-261d-4c79-b794-650a59b02dde tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:00.864482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-268cce2c-261d-4c79-b794-650a59b02dde tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:00.865396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-268cce2c-261d-4c79-b794-650a59b02dde tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:00.865882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-268cce2c-261d-4c79-b794-650a59b02dde tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:00.866322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-268cce2c-261d-4c79-b794-650a59b02dde tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:01.035891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-888eff83-9e4f-407a-a390-86d9a85de454 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:01.058989 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-888eff83-9e4f-407a-a390-86d9a85de454 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1317 microversion: 2.1 time: 0.666322 Oct 12 22:11:01.059812 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1302/2940] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:00 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1317 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:01.066819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d3c894d6-5cc4-409c-9cc0-e59d543d9218 req-f3f9a917-cb61-4a2c-925a-e00eb3c6b3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4023ebba-05d4-4225-938a-c70c2490ae29", "name": "network-vif-plugged", "status": "completed", "tag": "16f27b0f-2034-49b1-8fc7-d037682a37a4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:01.080155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d3c894d6-5cc4-409c-9cc0-e59d543d9218 req-f3f9a917-cb61-4a2c-925a-e00eb3c6b3c2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:01.080908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d3c894d6-5cc4-409c-9cc0-e59d543d9218 req-f3f9a917-cb61-4a2c-925a-e00eb3c6b3c2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:01.081558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d3c894d6-5cc4-409c-9cc0-e59d543d9218 req-f3f9a917-cb61-4a2c-925a-e00eb3c6b3c2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:01.097244 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d3c894d6-5cc4-409c-9cc0-e59d543d9218 req-f3f9a917-cb61-4a2c-925a-e00eb3c6b3c2 service nova] Creating event network-vif-plugged:16f27b0f-2034-49b1-8fc7-d037682a37a4 for instance 4023ebba-05d4-4225-938a-c70c2490ae29 on n-h2-861111-1 Oct 12 22:11:01.104746 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d3c894d6-5cc4-409c-9cc0-e59d543d9218 req-f3f9a917-cb61-4a2c-925a-e00eb3c6b3c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043064 Oct 12 22:11:01.106212 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1303/2941] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:01.197147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:01.290055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-268cce2c-261d-4c79-b794-650a59b02dde tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:01.301360 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-268cce2c-261d-4c79-b794-650a59b02dde tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.509578 Oct 12 22:11:01.302623 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1639/2942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:00 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:01.413433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e934f1b9-ce54-4f38-a2c9-aba8e9763c8d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:01.414244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e934f1b9-ce54-4f38-a2c9-aba8e9763c8d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:01.429421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e934f1b9-ce54-4f38-a2c9-aba8e9763c8d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:01.431702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e934f1b9-ce54-4f38-a2c9-aba8e9763c8d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:01.432236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e934f1b9-ce54-4f38-a2c9-aba8e9763c8d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:01.434708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e934f1b9-ce54-4f38-a2c9-aba8e9763c8d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:01.437021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e934f1b9-ce54-4f38-a2c9-aba8e9763c8d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:01.437650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e934f1b9-ce54-4f38-a2c9-aba8e9763c8d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:01.613716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-175aec67-77ca-40ca-be76-1cd3af0f02e5 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:01.613716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-175aec67-77ca-40ca-be76-1cd3af0f02e5 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:01.619509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-175aec67-77ca-40ca-be76-1cd3af0f02e5 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:01.620275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-175aec67-77ca-40ca-be76-1cd3af0f02e5 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:01.620724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-175aec67-77ca-40ca-be76-1cd3af0f02e5 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:01.621628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-175aec67-77ca-40ca-be76-1cd3af0f02e5 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:01.622261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-175aec67-77ca-40ca-be76-1cd3af0f02e5 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:01.622888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-175aec67-77ca-40ca-be76-1cd3af0f02e5 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:01.660937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e934f1b9-ce54-4f38-a2c9-aba8e9763c8d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:01.688040 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e934f1b9-ce54-4f38-a2c9-aba8e9763c8d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.278718 Oct 12 22:11:01.688742 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1304/2943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:01 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:01.818316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dee5ff67-169a-4b2a-aa4d-085dc34dbe4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:01.818838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dee5ff67-169a-4b2a-aa4d-085dc34dbe4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:01.829314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dee5ff67-169a-4b2a-aa4d-085dc34dbe4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:01.830005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dee5ff67-169a-4b2a-aa4d-085dc34dbe4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:01.831719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dee5ff67-169a-4b2a-aa4d-085dc34dbe4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:01.848895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dee5ff67-169a-4b2a-aa4d-085dc34dbe4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:01.848895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dee5ff67-169a-4b2a-aa4d-085dc34dbe4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:01.848895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dee5ff67-169a-4b2a-aa4d-085dc34dbe4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:01.968033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dee5ff67-169a-4b2a-aa4d-085dc34dbe4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:01.977603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dee5ff67-169a-4b2a-aa4d-085dc34dbe4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:01.979299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dee5ff67-169a-4b2a-aa4d-085dc34dbe4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:01.984456 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dee5ff67-169a-4b2a-aa4d-085dc34dbe4b tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.170231 Oct 12 22:11:01.985055 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1305/2944] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:01 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:11:01.989211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-175aec67-77ca-40ca-be76-1cd3af0f02e5 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:01.997473 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-175aec67-77ca-40ca-be76-1cd3af0f02e5 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1304 microversion: 2.1 time: 0.388902 Oct 12 22:11:01.998038 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1640/2945] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:01 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1304 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:02.086129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2ffabad8-ccfe-407f-8f37-61fbc10415b3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:02.086810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2ffabad8-ccfe-407f-8f37-61fbc10415b3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:02.092950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ffabad8-ccfe-407f-8f37-61fbc10415b3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:02.093428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ffabad8-ccfe-407f-8f37-61fbc10415b3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:02.093857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ffabad8-ccfe-407f-8f37-61fbc10415b3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:02.094655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ffabad8-ccfe-407f-8f37-61fbc10415b3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:02.095201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ffabad8-ccfe-407f-8f37-61fbc10415b3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:02.095683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ffabad8-ccfe-407f-8f37-61fbc10415b3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:02.326131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-024fdc1e-11ce-4309-b9e0-c1e683f99ead tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:02.326745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-024fdc1e-11ce-4309-b9e0-c1e683f99ead tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:02.339182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024fdc1e-11ce-4309-b9e0-c1e683f99ead tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:02.339711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024fdc1e-11ce-4309-b9e0-c1e683f99ead tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:02.340148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024fdc1e-11ce-4309-b9e0-c1e683f99ead tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:02.340859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024fdc1e-11ce-4309-b9e0-c1e683f99ead tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:02.341314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024fdc1e-11ce-4309-b9e0-c1e683f99ead tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:02.341743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-024fdc1e-11ce-4309-b9e0-c1e683f99ead tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:02.381798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2ffabad8-ccfe-407f-8f37-61fbc10415b3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:02.397485 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2ffabad8-ccfe-407f-8f37-61fbc10415b3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1317 microversion: 2.1 time: 0.315536 Oct 12 22:11:02.410490 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1306/2946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:02 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:02.666630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-024fdc1e-11ce-4309-b9e0-c1e683f99ead tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:02.677853 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-024fdc1e-11ce-4309-b9e0-c1e683f99ead tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.355371 Oct 12 22:11:02.679192 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1641/2947] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:02 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:02.714282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-12ddff4e-3b23-4293-b6f4-46fdb33f7fb1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:02.714897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-12ddff4e-3b23-4293-b6f4-46fdb33f7fb1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:02.732984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12ddff4e-3b23-4293-b6f4-46fdb33f7fb1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:02.733771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12ddff4e-3b23-4293-b6f4-46fdb33f7fb1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:02.734454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12ddff4e-3b23-4293-b6f4-46fdb33f7fb1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:02.735476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12ddff4e-3b23-4293-b6f4-46fdb33f7fb1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:02.736089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12ddff4e-3b23-4293-b6f4-46fdb33f7fb1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:02.736689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12ddff4e-3b23-4293-b6f4-46fdb33f7fb1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:03.015035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1a7e3ba2-496e-4180-b166-dc0852c6cc35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:03.016126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1a7e3ba2-496e-4180-b166-dc0852c6cc35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:03.027979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a7e3ba2-496e-4180-b166-dc0852c6cc35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:03.028491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a7e3ba2-496e-4180-b166-dc0852c6cc35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:03.028929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a7e3ba2-496e-4180-b166-dc0852c6cc35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:03.031785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a7e3ba2-496e-4180-b166-dc0852c6cc35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:03.033377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a7e3ba2-496e-4180-b166-dc0852c6cc35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:03.034018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a7e3ba2-496e-4180-b166-dc0852c6cc35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:03.035037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-12ddff4e-3b23-4293-b6f4-46fdb33f7fb1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:03.052066 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-12ddff4e-3b23-4293-b6f4-46fdb33f7fb1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.334168 Oct 12 22:11:03.067337 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1307/2948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:02 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:03.067337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-94344c40-809a-49ef-b8e9-dc84f576ed6f tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:03.067337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-94344c40-809a-49ef-b8e9-dc84f576ed6f tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:03.073291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94344c40-809a-49ef-b8e9-dc84f576ed6f tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:03.078105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94344c40-809a-49ef-b8e9-dc84f576ed6f tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:03.078790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94344c40-809a-49ef-b8e9-dc84f576ed6f tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:03.079738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94344c40-809a-49ef-b8e9-dc84f576ed6f tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:03.080372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94344c40-809a-49ef-b8e9-dc84f576ed6f tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:03.082488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94344c40-809a-49ef-b8e9-dc84f576ed6f tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:03.224541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a7e3ba2-496e-4180-b166-dc0852c6cc35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:03.233317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a7e3ba2-496e-4180-b166-dc0852c6cc35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:03.237667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a7e3ba2-496e-4180-b166-dc0852c6cc35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:03.250239 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1a7e3ba2-496e-4180-b166-dc0852c6cc35 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.239913 Oct 12 22:11:03.281241 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1642/2949] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:03 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:11:03.314042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-94344c40-809a-49ef-b8e9-dc84f576ed6f tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:03.319870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:03.327663 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-94344c40-809a-49ef-b8e9-dc84f576ed6f tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1292 microversion: 2.1 time: 0.273337 Oct 12 22:11:03.328671 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1308/2950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:03 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1292 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:03.332859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-394f8830-a2d7-417d-8ccd-ec99925732bf req-b5b051b4-6ad3-4799-ba0d-fc053436a12a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba7407a-199c-49e6-947d-eee5e1e616c7", "name": "network-vif-plugged", "status": "completed", "tag": "4bee2c3f-5642-485e-a878-61e340a21f21"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:03.345791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-394f8830-a2d7-417d-8ccd-ec99925732bf req-b5b051b4-6ad3-4799-ba0d-fc053436a12a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:03.346324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-394f8830-a2d7-417d-8ccd-ec99925732bf req-b5b051b4-6ad3-4799-ba0d-fc053436a12a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:03.346762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-394f8830-a2d7-417d-8ccd-ec99925732bf req-b5b051b4-6ad3-4799-ba0d-fc053436a12a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:03.358973 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-394f8830-a2d7-417d-8ccd-ec99925732bf req-b5b051b4-6ad3-4799-ba0d-fc053436a12a service nova] Creating event network-vif-plugged:4bee2c3f-5642-485e-a878-61e340a21f21 for instance cba7407a-199c-49e6-947d-eee5e1e616c7 on n-h2-861111-1 Oct 12 22:11:03.366350 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-394f8830-a2d7-417d-8ccd-ec99925732bf req-b5b051b4-6ad3-4799-ba0d-fc053436a12a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036966 Oct 12 22:11:03.368237 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1643/2951] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:11:03.425559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4ad02140-16e1-4174-b0e0-18a074787828 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:03.426174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4ad02140-16e1-4174-b0e0-18a074787828 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:03.432642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ad02140-16e1-4174-b0e0-18a074787828 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:03.433363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ad02140-16e1-4174-b0e0-18a074787828 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:03.434088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ad02140-16e1-4174-b0e0-18a074787828 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:03.435856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ad02140-16e1-4174-b0e0-18a074787828 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:03.436518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ad02140-16e1-4174-b0e0-18a074787828 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:03.436969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ad02140-16e1-4174-b0e0-18a074787828 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:03.593224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4ad02140-16e1-4174-b0e0-18a074787828 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:03.601892 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4ad02140-16e1-4174-b0e0-18a074787828 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1317 microversion: 2.1 time: 0.179758 Oct 12 22:11:03.602470 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1309/2952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:03 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:03.704409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-69288793-6db6-4275-9cc6-ebef92a9fbe4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:03.706888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-69288793-6db6-4275-9cc6-ebef92a9fbe4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:03.717333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69288793-6db6-4275-9cc6-ebef92a9fbe4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:03.718072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69288793-6db6-4275-9cc6-ebef92a9fbe4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:03.718504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69288793-6db6-4275-9cc6-ebef92a9fbe4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:03.719303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69288793-6db6-4275-9cc6-ebef92a9fbe4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:03.719966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69288793-6db6-4275-9cc6-ebef92a9fbe4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:03.720587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69288793-6db6-4275-9cc6-ebef92a9fbe4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:03.980343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-69288793-6db6-4275-9cc6-ebef92a9fbe4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:03.988247 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-69288793-6db6-4275-9cc6-ebef92a9fbe4 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.288716 Oct 12 22:11:03.988822 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1644/2953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:03 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:04.079978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-10936ab9-9270-4236-91b3-5b1aa2f76284 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:04.080923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-10936ab9-9270-4236-91b3-5b1aa2f76284 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:04.088618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10936ab9-9270-4236-91b3-5b1aa2f76284 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:04.089173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10936ab9-9270-4236-91b3-5b1aa2f76284 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:04.089608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10936ab9-9270-4236-91b3-5b1aa2f76284 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:04.090300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10936ab9-9270-4236-91b3-5b1aa2f76284 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:04.090871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10936ab9-9270-4236-91b3-5b1aa2f76284 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:04.091329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10936ab9-9270-4236-91b3-5b1aa2f76284 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:04.252704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-10936ab9-9270-4236-91b3-5b1aa2f76284 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:04.266221 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-10936ab9-9270-4236-91b3-5b1aa2f76284 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.187799 Oct 12 22:11:04.266857 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1310/2954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:04 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:04.290624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4b71ddd0-93c4-4532-936f-242d4e78db9f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:04.291581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4b71ddd0-93c4-4532-936f-242d4e78db9f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:04.299682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b71ddd0-93c4-4532-936f-242d4e78db9f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:04.300527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b71ddd0-93c4-4532-936f-242d4e78db9f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:04.301582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b71ddd0-93c4-4532-936f-242d4e78db9f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:04.302500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b71ddd0-93c4-4532-936f-242d4e78db9f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:04.303298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b71ddd0-93c4-4532-936f-242d4e78db9f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:04.303991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b71ddd0-93c4-4532-936f-242d4e78db9f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:04.353385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fe68ce73-2de3-41dc-b85f-442f0a686d30 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:04.354107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fe68ce73-2de3-41dc-b85f-442f0a686d30 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:04.362419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe68ce73-2de3-41dc-b85f-442f0a686d30 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:04.363040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe68ce73-2de3-41dc-b85f-442f0a686d30 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:04.363689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe68ce73-2de3-41dc-b85f-442f0a686d30 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:04.364494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe68ce73-2de3-41dc-b85f-442f0a686d30 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:04.366107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe68ce73-2de3-41dc-b85f-442f0a686d30 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:04.366822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe68ce73-2de3-41dc-b85f-442f0a686d30 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:04.457643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b71ddd0-93c4-4532-936f-242d4e78db9f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:04.468886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b71ddd0-93c4-4532-936f-242d4e78db9f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:04.470598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b71ddd0-93c4-4532-936f-242d4e78db9f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:04.476914 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4b71ddd0-93c4-4532-936f-242d4e78db9f tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.192332 Oct 12 22:11:04.479798 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1645/2955] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:04 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:11:04.554904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fe68ce73-2de3-41dc-b85f-442f0a686d30 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:04.566758 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fe68ce73-2de3-41dc-b85f-442f0a686d30 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1292 microversion: 2.1 time: 0.217999 Oct 12 22:11:04.572335 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1311/2956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:04 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1292 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:04.626424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-979758f5-f6a8-4eee-b7eb-136e952202cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:04.627770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-979758f5-f6a8-4eee-b7eb-136e952202cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:04.634844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-979758f5-f6a8-4eee-b7eb-136e952202cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:04.635503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-979758f5-f6a8-4eee-b7eb-136e952202cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:04.636037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-979758f5-f6a8-4eee-b7eb-136e952202cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:04.637014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-979758f5-f6a8-4eee-b7eb-136e952202cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:04.637563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-979758f5-f6a8-4eee-b7eb-136e952202cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:04.638077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-979758f5-f6a8-4eee-b7eb-136e952202cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:04.835886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-979758f5-f6a8-4eee-b7eb-136e952202cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:04.844479 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-979758f5-f6a8-4eee-b7eb-136e952202cf tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1317 microversion: 2.1 time: 0.223058 Oct 12 22:11:04.845217 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1646/2957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:04 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:05.012663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a96c060e-afa1-4a3c-b30d-09e92cfc584d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:05.013838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a96c060e-afa1-4a3c-b30d-09e92cfc584d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:05.020632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a96c060e-afa1-4a3c-b30d-09e92cfc584d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:05.021342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a96c060e-afa1-4a3c-b30d-09e92cfc584d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:05.022089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a96c060e-afa1-4a3c-b30d-09e92cfc584d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:05.023724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a96c060e-afa1-4a3c-b30d-09e92cfc584d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:05.024328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a96c060e-afa1-4a3c-b30d-09e92cfc584d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:05.024920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a96c060e-afa1-4a3c-b30d-09e92cfc584d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:05.202230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a96c060e-afa1-4a3c-b30d-09e92cfc584d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:05.211901 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a96c060e-afa1-4a3c-b30d-09e92cfc584d tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.203315 Oct 12 22:11:05.213042 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1312/2958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:05 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:05.294281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3c653819-3336-428d-9e17-39158cef32af tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:05.295000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3c653819-3336-428d-9e17-39158cef32af tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:05.316410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c653819-3336-428d-9e17-39158cef32af tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:05.317311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c653819-3336-428d-9e17-39158cef32af tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:05.317940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c653819-3336-428d-9e17-39158cef32af tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:05.319006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c653819-3336-428d-9e17-39158cef32af tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:05.330832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c653819-3336-428d-9e17-39158cef32af tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:05.331527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c653819-3336-428d-9e17-39158cef32af tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:05.507980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b89c90d4-f06c-45bf-9870-8e2faad8fa44 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:05.508526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b89c90d4-f06c-45bf-9870-8e2faad8fa44 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:05.514754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b89c90d4-f06c-45bf-9870-8e2faad8fa44 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:05.515481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b89c90d4-f06c-45bf-9870-8e2faad8fa44 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:05.515934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b89c90d4-f06c-45bf-9870-8e2faad8fa44 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:05.516615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b89c90d4-f06c-45bf-9870-8e2faad8fa44 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:05.517784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b89c90d4-f06c-45bf-9870-8e2faad8fa44 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:05.518220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b89c90d4-f06c-45bf-9870-8e2faad8fa44 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:05.569637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3c653819-3336-428d-9e17-39158cef32af tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:05.583217 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3c653819-3336-428d-9e17-39158cef32af tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.293727 Oct 12 22:11:05.584770 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1647/2959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:05 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:05.593460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c1da573d-5bd1-4578-9173-79a622355d1d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:05.604239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c1da573d-5bd1-4578-9173-79a622355d1d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:05.610562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1da573d-5bd1-4578-9173-79a622355d1d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:05.611059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1da573d-5bd1-4578-9173-79a622355d1d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:05.611534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1da573d-5bd1-4578-9173-79a622355d1d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:05.612245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1da573d-5bd1-4578-9173-79a622355d1d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:05.612707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1da573d-5bd1-4578-9173-79a622355d1d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:05.613132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1da573d-5bd1-4578-9173-79a622355d1d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:05.621394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b89c90d4-f06c-45bf-9870-8e2faad8fa44 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:05.632233 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b89c90d4-f06c-45bf-9870-8e2faad8fa44 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:05.634180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b89c90d4-f06c-45bf-9870-8e2faad8fa44 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:05.640632 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b89c90d4-f06c-45bf-9870-8e2faad8fa44 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.136628 Oct 12 22:11:05.641798 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1313/2960] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:05 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:11:05.827596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c1da573d-5bd1-4578-9173-79a622355d1d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:05.832219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:05.838757 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c1da573d-5bd1-4578-9173-79a622355d1d tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1292 microversion: 2.1 time: 0.249135 Oct 12 22:11:05.839365 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1648/2961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:05 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1292 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:05.872060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-64fe5163-fc54-4928-91d1-41136fb98d3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:05.873815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-64fe5163-fc54-4928-91d1-41136fb98d3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:05.882851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64fe5163-fc54-4928-91d1-41136fb98d3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:05.883660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64fe5163-fc54-4928-91d1-41136fb98d3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:05.884288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64fe5163-fc54-4928-91d1-41136fb98d3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:05.885080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64fe5163-fc54-4928-91d1-41136fb98d3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:05.885752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64fe5163-fc54-4928-91d1-41136fb98d3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:05.886288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64fe5163-fc54-4928-91d1-41136fb98d3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:06.046016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-64fe5163-fc54-4928-91d1-41136fb98d3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:06.054927 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-64fe5163-fc54-4928-91d1-41136fb98d3e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1317 microversion: 2.1 time: 0.189296 Oct 12 22:11:06.055847 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1314/2962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:05 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:06.236103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cd75ab45-bf76-4f0d-8efd-730f0e8f8fa7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:06.237090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cd75ab45-bf76-4f0d-8efd-730f0e8f8fa7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:06.246442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd75ab45-bf76-4f0d-8efd-730f0e8f8fa7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:06.247079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd75ab45-bf76-4f0d-8efd-730f0e8f8fa7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:06.247680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd75ab45-bf76-4f0d-8efd-730f0e8f8fa7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:06.248476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd75ab45-bf76-4f0d-8efd-730f0e8f8fa7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:06.249032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd75ab45-bf76-4f0d-8efd-730f0e8f8fa7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:06.249546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd75ab45-bf76-4f0d-8efd-730f0e8f8fa7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:06.490639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cd75ab45-bf76-4f0d-8efd-730f0e8f8fa7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:06.502414 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cd75ab45-bf76-4f0d-8efd-730f0e8f8fa7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.270715 Oct 12 22:11:06.504001 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1649/2963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:06 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:06.606598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d147c55-3105-45ab-a5fc-9b9740c3a607 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:06.607535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5d147c55-3105-45ab-a5fc-9b9740c3a607 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:06.639571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d147c55-3105-45ab-a5fc-9b9740c3a607 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:06.640367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d147c55-3105-45ab-a5fc-9b9740c3a607 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:06.641064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d147c55-3105-45ab-a5fc-9b9740c3a607 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:06.641919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d147c55-3105-45ab-a5fc-9b9740c3a607 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:06.642532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d147c55-3105-45ab-a5fc-9b9740c3a607 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:06.642976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d147c55-3105-45ab-a5fc-9b9740c3a607 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:06.670071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b16c7281-ff9e-4a79-8ea3-5aab87911791 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:06.670684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b16c7281-ff9e-4a79-8ea3-5aab87911791 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:06.681776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b16c7281-ff9e-4a79-8ea3-5aab87911791 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:06.684038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b16c7281-ff9e-4a79-8ea3-5aab87911791 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:06.684972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b16c7281-ff9e-4a79-8ea3-5aab87911791 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:06.685576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b16c7281-ff9e-4a79-8ea3-5aab87911791 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:06.686026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b16c7281-ff9e-4a79-8ea3-5aab87911791 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:06.688027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b16c7281-ff9e-4a79-8ea3-5aab87911791 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:06.793103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b16c7281-ff9e-4a79-8ea3-5aab87911791 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:06.811467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b16c7281-ff9e-4a79-8ea3-5aab87911791 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:06.813130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b16c7281-ff9e-4a79-8ea3-5aab87911791 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:06.818873 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b16c7281-ff9e-4a79-8ea3-5aab87911791 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.153193 Oct 12 22:11:06.820555 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1650/2964] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:06 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:11:06.863674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-33afed79-5ff9-497b-9d07-a98e849a8480 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:06.865519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-33afed79-5ff9-497b-9d07-a98e849a8480 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:06.872306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33afed79-5ff9-497b-9d07-a98e849a8480 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:06.873524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33afed79-5ff9-497b-9d07-a98e849a8480 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:06.874198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33afed79-5ff9-497b-9d07-a98e849a8480 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:06.874989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33afed79-5ff9-497b-9d07-a98e849a8480 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:06.875973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33afed79-5ff9-497b-9d07-a98e849a8480 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:06.876620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33afed79-5ff9-497b-9d07-a98e849a8480 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:06.880128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5d147c55-3105-45ab-a5fc-9b9740c3a607 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:06.893406 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5d147c55-3105-45ab-a5fc-9b9740c3a607 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1354 microversion: 2.1 time: 0.290654 Oct 12 22:11:06.895764 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1315/2965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:06 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1354 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:07.032108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-33afed79-5ff9-497b-9d07-a98e849a8480 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:07.043810 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-33afed79-5ff9-497b-9d07-a98e849a8480 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1292 microversion: 2.1 time: 0.184891 Oct 12 22:11:07.044787 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1651/2966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:06 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1292 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:07.077882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a785ce53-aa64-4c9c-960d-100a7f600fd5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:07.078683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a785ce53-aa64-4c9c-960d-100a7f600fd5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:07.090567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1878235471", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "8a2bd9d3-e80d-4911-bb4a-296de8e90165"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:07.101991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a785ce53-aa64-4c9c-960d-100a7f600fd5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:07.110048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a785ce53-aa64-4c9c-960d-100a7f600fd5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:07.110543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a785ce53-aa64-4c9c-960d-100a7f600fd5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:07.111341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a785ce53-aa64-4c9c-960d-100a7f600fd5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:07.111809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a785ce53-aa64-4c9c-960d-100a7f600fd5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:07.112410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a785ce53-aa64-4c9c-960d-100a7f600fd5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:07.176362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] validate_networks() for [('8a2bd9d3-e80d-4911-bb4a-296de8e90165', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:11:07.285103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a785ce53-aa64-4c9c-960d-100a7f600fd5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:07.296064 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a785ce53-aa64-4c9c-960d-100a7f600fd5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1317 microversion: 2.1 time: 0.221932 Oct 12 22:11:07.299915 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1652/2967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:07 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:07.527878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1f9c00d1-de77-4174-95b1-ee89762a3e4f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:07.528798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1f9c00d1-de77-4174-95b1-ee89762a3e4f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:07.536215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f9c00d1-de77-4174-95b1-ee89762a3e4f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:07.536695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f9c00d1-de77-4174-95b1-ee89762a3e4f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:07.537380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f9c00d1-de77-4174-95b1-ee89762a3e4f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:07.538438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f9c00d1-de77-4174-95b1-ee89762a3e4f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:07.539152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f9c00d1-de77-4174-95b1-ee89762a3e4f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:07.539881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f9c00d1-de77-4174-95b1-ee89762a3e4f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:07.605374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:11:07.605799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:11:07.606269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:11:07.606701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:11:07.607378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:11:07.621950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:07.622442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:07.622879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:07.623647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:07.624103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:07.624528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:07.643957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Getting quotas for project 4b898b5d0208478e996b7fee2060ed64. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:11:07.650301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Getting quotas for user 11096cece79f4b8fad4b92270f51b299 and project 4b898b5d0208478e996b7fee2060ed64. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:11:07.663098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:11:07.666020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:11:07.674364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1f9c00d1-de77-4174-95b1-ee89762a3e4f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:07.683862 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1f9c00d1-de77-4174-95b1-ee89762a3e4f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.160753 Oct 12 22:11:07.684467 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1653/2968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:07 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:07.720442 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-71ca1b72-2644-4c15-a829-5ab51a99eff3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772812 Oct 12 22:11:07.721554 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1316/2969] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:11:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:11:07.733151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8f7bb89f-0cda-44a0-94e6-48a2d907150a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:07.733947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8f7bb89f-0cda-44a0-94e6-48a2d907150a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:07.796856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8f7bb89f-0cda-44a0-94e6-48a2d907150a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:07.804003 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8f7bb89f-0cda-44a0-94e6-48a2d907150a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1215 microversion: 2.1 time: 0.075024 Oct 12 22:11:07.804701 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1654/2970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:07 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:07.848793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-acacce5c-894e-4598-bce6-74a8f131a6ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:07.849555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-acacce5c-894e-4598-bce6-74a8f131a6ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:07.856747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acacce5c-894e-4598-bce6-74a8f131a6ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:07.857236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acacce5c-894e-4598-bce6-74a8f131a6ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:07.857752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acacce5c-894e-4598-bce6-74a8f131a6ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:07.858333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acacce5c-894e-4598-bce6-74a8f131a6ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:07.858779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acacce5c-894e-4598-bce6-74a8f131a6ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:07.859273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acacce5c-894e-4598-bce6-74a8f131a6ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:07.918081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-57dedbd9-cffc-4289-96dd-9dc2f4c0ccb9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:07.918706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-57dedbd9-cffc-4289-96dd-9dc2f4c0ccb9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:07.924711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-acacce5c-894e-4598-bce6-74a8f131a6ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:07.925174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57dedbd9-cffc-4289-96dd-9dc2f4c0ccb9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:07.925659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57dedbd9-cffc-4289-96dd-9dc2f4c0ccb9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:07.926095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57dedbd9-cffc-4289-96dd-9dc2f4c0ccb9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:07.926780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57dedbd9-cffc-4289-96dd-9dc2f4c0ccb9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:07.927515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57dedbd9-cffc-4289-96dd-9dc2f4c0ccb9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:07.928090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57dedbd9-cffc-4289-96dd-9dc2f4c0ccb9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:07.933315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-acacce5c-894e-4598-bce6-74a8f131a6ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:07.934819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-acacce5c-894e-4598-bce6-74a8f131a6ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:07.940462 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-acacce5c-894e-4598-bce6-74a8f131a6ea tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.095607 Oct 12 22:11:07.941029 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1317/2971] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:07 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:11:08.066165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c0d26a36-d625-442c-9503-d80404741f07 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:08.067123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c0d26a36-d625-442c-9503-d80404741f07 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:08.074354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0d26a36-d625-442c-9503-d80404741f07 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:08.075121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0d26a36-d625-442c-9503-d80404741f07 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:08.075822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0d26a36-d625-442c-9503-d80404741f07 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:08.076831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0d26a36-d625-442c-9503-d80404741f07 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:08.077547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0d26a36-d625-442c-9503-d80404741f07 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:08.078216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0d26a36-d625-442c-9503-d80404741f07 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:08.092510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-57dedbd9-cffc-4289-96dd-9dc2f4c0ccb9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:08.105403 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-57dedbd9-cffc-4289-96dd-9dc2f4c0ccb9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1803 microversion: 2.1 time: 0.191519 Oct 12 22:11:08.106620 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1655/2972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:07 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1803 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:08.132070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f560ebc5-a21c-4037-a275-7709582a2463 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:08.133427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f560ebc5-a21c-4037-a275-7709582a2463 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:08.139925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f560ebc5-a21c-4037-a275-7709582a2463 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:08.140626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f560ebc5-a21c-4037-a275-7709582a2463 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:08.141059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f560ebc5-a21c-4037-a275-7709582a2463 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:08.141923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f560ebc5-a21c-4037-a275-7709582a2463 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:08.142371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f560ebc5-a21c-4037-a275-7709582a2463 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:08.143132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f560ebc5-a21c-4037-a275-7709582a2463 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:08.170189 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f560ebc5-a21c-4037-a275-7709582a2463 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113/ips" status: 200 len: 217 microversion: 2.1 time: 0.042625 Oct 12 22:11:08.170782 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1656/2973] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 22:11:08 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113/ips => generated 217 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:08.182651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-68a9cbb8-eb06-475c-9eb3-7069a6ec01a0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:08.183206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-68a9cbb8-eb06-475c-9eb3-7069a6ec01a0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:08.189802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68a9cbb8-eb06-475c-9eb3-7069a6ec01a0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:08.190270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68a9cbb8-eb06-475c-9eb3-7069a6ec01a0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:08.190705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68a9cbb8-eb06-475c-9eb3-7069a6ec01a0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:08.191473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68a9cbb8-eb06-475c-9eb3-7069a6ec01a0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:08.191878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68a9cbb8-eb06-475c-9eb3-7069a6ec01a0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:08.192502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68a9cbb8-eb06-475c-9eb3-7069a6ec01a0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:08.225674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-68a9cbb8-eb06-475c-9eb3-7069a6ec01a0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:11:08.262958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c0d26a36-d625-442c-9503-d80404741f07 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:08.271910 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c0d26a36-d625-442c-9503-d80404741f07 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1292 microversion: 2.1 time: 0.209422 Oct 12 22:11:08.272739 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1318/2974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:08 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1292 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:08.319012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0821a918-e8aa-4f5c-a892-bd822c164035 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:08.320451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0821a918-e8aa-4f5c-a892-bd822c164035 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:08.325322 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-68a9cbb8-eb06-475c-9eb3-7069a6ec01a0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 204 len: 0 microversion: 2.1 time: 0.146359 Oct 12 22:11:08.326141 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1657/2975] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:11:08 2022] DELETE /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:11:08.326541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0821a918-e8aa-4f5c-a892-bd822c164035 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:08.327160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0821a918-e8aa-4f5c-a892-bd822c164035 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:08.327788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0821a918-e8aa-4f5c-a892-bd822c164035 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:08.328519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0821a918-e8aa-4f5c-a892-bd822c164035 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:08.329067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0821a918-e8aa-4f5c-a892-bd822c164035 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:08.329508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0821a918-e8aa-4f5c-a892-bd822c164035 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:08.334407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-94577fcb-575b-4f07-90ce-e52de6732f8f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:08.335103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-94577fcb-575b-4f07-90ce-e52de6732f8f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:08.341565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94577fcb-575b-4f07-90ce-e52de6732f8f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:08.342055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94577fcb-575b-4f07-90ce-e52de6732f8f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:08.342486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94577fcb-575b-4f07-90ce-e52de6732f8f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:08.343173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94577fcb-575b-4f07-90ce-e52de6732f8f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:08.343638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94577fcb-575b-4f07-90ce-e52de6732f8f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:08.344056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94577fcb-575b-4f07-90ce-e52de6732f8f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:08.490408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0821a918-e8aa-4f5c-a892-bd822c164035 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:08.499991 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0821a918-e8aa-4f5c-a892-bd822c164035 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1317 microversion: 2.1 time: 0.185102 Oct 12 22:11:08.508153 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1319/2976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:08 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:08.556805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-94577fcb-575b-4f07-90ce-e52de6732f8f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:08.564752 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-94577fcb-575b-4f07-90ce-e52de6732f8f tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1809 microversion: 2.1 time: 0.234529 Oct 12 22:11:08.565318 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1658/2977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:08 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:08.707157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fd498de9-fc4e-418a-8766-b26be0035ebe tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:08.707812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fd498de9-fc4e-418a-8766-b26be0035ebe tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:08.715613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd498de9-fc4e-418a-8766-b26be0035ebe tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:08.716227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd498de9-fc4e-418a-8766-b26be0035ebe tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:08.716669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd498de9-fc4e-418a-8766-b26be0035ebe tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:08.717378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd498de9-fc4e-418a-8766-b26be0035ebe tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:08.717830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd498de9-fc4e-418a-8766-b26be0035ebe tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:08.718256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd498de9-fc4e-418a-8766-b26be0035ebe tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:08.832127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-755e5b1c-85a4-4577-a063-392b6564a5fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:08.833318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-755e5b1c-85a4-4577-a063-392b6564a5fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:08.842143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-755e5b1c-85a4-4577-a063-392b6564a5fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:08.842637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-755e5b1c-85a4-4577-a063-392b6564a5fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:08.843069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-755e5b1c-85a4-4577-a063-392b6564a5fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:08.843971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-755e5b1c-85a4-4577-a063-392b6564a5fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:08.844423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-755e5b1c-85a4-4577-a063-392b6564a5fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:08.844846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-755e5b1c-85a4-4577-a063-392b6564a5fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:08.854306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fd498de9-fc4e-418a-8766-b26be0035ebe tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:08.863127 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fd498de9-fc4e-418a-8766-b26be0035ebe tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.159683 Oct 12 22:11:08.878740 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1320/2978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:08 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:08.908260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-755e5b1c-85a4-4577-a063-392b6564a5fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:08.915981 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-755e5b1c-85a4-4577-a063-392b6564a5fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1267 microversion: 2.1 time: 0.088507 Oct 12 22:11:08.916578 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1659/2979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:08 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:08.969723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1d5ab72e-787f-44e0-8707-05814d7e3c54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:08.970264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1d5ab72e-787f-44e0-8707-05814d7e3c54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:08.976239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d5ab72e-787f-44e0-8707-05814d7e3c54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:08.976729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d5ab72e-787f-44e0-8707-05814d7e3c54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:08.977169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d5ab72e-787f-44e0-8707-05814d7e3c54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:08.977865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d5ab72e-787f-44e0-8707-05814d7e3c54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:08.978323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d5ab72e-787f-44e0-8707-05814d7e3c54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:08.978757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d5ab72e-787f-44e0-8707-05814d7e3c54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:09.043267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1d5ab72e-787f-44e0-8707-05814d7e3c54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:09.052062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1d5ab72e-787f-44e0-8707-05814d7e3c54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:09.053505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1d5ab72e-787f-44e0-8707-05814d7e3c54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:09.058422 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1d5ab72e-787f-44e0-8707-05814d7e3c54 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.092966 Oct 12 22:11:09.058987 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1321/2980] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:08 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:11:09.297758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1b077358-8a93-4720-bc2e-a4797de357d3 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:09.298371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1b077358-8a93-4720-bc2e-a4797de357d3 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:09.304395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b077358-8a93-4720-bc2e-a4797de357d3 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:09.304881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b077358-8a93-4720-bc2e-a4797de357d3 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:09.305314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b077358-8a93-4720-bc2e-a4797de357d3 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:09.306008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b077358-8a93-4720-bc2e-a4797de357d3 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:09.306453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b077358-8a93-4720-bc2e-a4797de357d3 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:09.306877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b077358-8a93-4720-bc2e-a4797de357d3 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:09.438600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1b077358-8a93-4720-bc2e-a4797de357d3 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:09.446487 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1b077358-8a93-4720-bc2e-a4797de357d3 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1292 microversion: 2.1 time: 0.152627 Oct 12 22:11:09.447059 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1660/2981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:09 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1292 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:09.525025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4e279a9f-5e96-49b1-8880-beaa28d7b524 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:09.525670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4e279a9f-5e96-49b1-8880-beaa28d7b524 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:09.531774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e279a9f-5e96-49b1-8880-beaa28d7b524 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:09.532265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e279a9f-5e96-49b1-8880-beaa28d7b524 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:09.532701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e279a9f-5e96-49b1-8880-beaa28d7b524 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:09.533407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e279a9f-5e96-49b1-8880-beaa28d7b524 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:09.533861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e279a9f-5e96-49b1-8880-beaa28d7b524 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:09.534288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e279a9f-5e96-49b1-8880-beaa28d7b524 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:09.589559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02335043-e6a8-454f-9610-da61ce0fc998 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:09.590177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-02335043-e6a8-454f-9610-da61ce0fc998 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:09.597042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02335043-e6a8-454f-9610-da61ce0fc998 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:09.597764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02335043-e6a8-454f-9610-da61ce0fc998 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:09.598357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02335043-e6a8-454f-9610-da61ce0fc998 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:09.599230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02335043-e6a8-454f-9610-da61ce0fc998 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:09.599862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02335043-e6a8-454f-9610-da61ce0fc998 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:09.600291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02335043-e6a8-454f-9610-da61ce0fc998 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:09.673179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4e279a9f-5e96-49b1-8880-beaa28d7b524 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:09.681305 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4e279a9f-5e96-49b1-8880-beaa28d7b524 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1317 microversion: 2.1 time: 0.160729 Oct 12 22:11:09.687088 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1322/2982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:09 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:09.749508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-02335043-e6a8-454f-9610-da61ce0fc998 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:09.763430 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-02335043-e6a8-454f-9610-da61ce0fc998 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1809 microversion: 2.1 time: 0.178163 Oct 12 22:11:09.764022 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1661/2983] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:09 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:09.888192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-749b5e80-f071-48bd-aa36-933e4a0e5c0a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:09.889412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-749b5e80-f071-48bd-aa36-933e4a0e5c0a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:09.895683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-749b5e80-f071-48bd-aa36-933e4a0e5c0a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:09.896373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-749b5e80-f071-48bd-aa36-933e4a0e5c0a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:09.897280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-749b5e80-f071-48bd-aa36-933e4a0e5c0a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:09.898852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-749b5e80-f071-48bd-aa36-933e4a0e5c0a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:09.899563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-749b5e80-f071-48bd-aa36-933e4a0e5c0a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:09.900453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-749b5e80-f071-48bd-aa36-933e4a0e5c0a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:09.939184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6b0ee0e2-96ba-400f-84d6-315aacbd53e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:09.940354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6b0ee0e2-96ba-400f-84d6-315aacbd53e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:09.949288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b0ee0e2-96ba-400f-84d6-315aacbd53e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:09.950446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b0ee0e2-96ba-400f-84d6-315aacbd53e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:09.951186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b0ee0e2-96ba-400f-84d6-315aacbd53e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:09.952530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b0ee0e2-96ba-400f-84d6-315aacbd53e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:09.953148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b0ee0e2-96ba-400f-84d6-315aacbd53e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:09.953733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b0ee0e2-96ba-400f-84d6-315aacbd53e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:10.041001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6b0ee0e2-96ba-400f-84d6-315aacbd53e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:10.050634 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6b0ee0e2-96ba-400f-84d6-315aacbd53e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1267 microversion: 2.1 time: 0.115230 Oct 12 22:11:10.051801 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1662/2984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:09 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:10.088481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c57c8f1e-7c89-401f-b263-46b243447964 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:10.089116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c57c8f1e-7c89-401f-b263-46b243447964 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:10.100668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-749b5e80-f071-48bd-aa36-933e4a0e5c0a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:10.112652 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-749b5e80-f071-48bd-aa36-933e4a0e5c0a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1472 microversion: 2.1 time: 0.229229 Oct 12 22:11:10.113205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c57c8f1e-7c89-401f-b263-46b243447964 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:10.113711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c57c8f1e-7c89-401f-b263-46b243447964 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:10.113948 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1323/2985] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:09 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1472 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:10.128046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c57c8f1e-7c89-401f-b263-46b243447964 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:10.128876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c57c8f1e-7c89-401f-b263-46b243447964 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:10.129370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c57c8f1e-7c89-401f-b263-46b243447964 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:10.129819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c57c8f1e-7c89-401f-b263-46b243447964 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:10.202129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c57c8f1e-7c89-401f-b263-46b243447964 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:10.211437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c57c8f1e-7c89-401f-b263-46b243447964 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:10.212890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c57c8f1e-7c89-401f-b263-46b243447964 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:10.218194 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c57c8f1e-7c89-401f-b263-46b243447964 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.135778 Oct 12 22:11:10.218773 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1663/2986] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:10 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:11:10.470779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6f0703d7-a987-4197-8018-dad84d0f54e1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:10.472232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6f0703d7-a987-4197-8018-dad84d0f54e1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:10.493228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f0703d7-a987-4197-8018-dad84d0f54e1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:10.493930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f0703d7-a987-4197-8018-dad84d0f54e1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:10.504018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f0703d7-a987-4197-8018-dad84d0f54e1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:10.504782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f0703d7-a987-4197-8018-dad84d0f54e1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:10.505453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f0703d7-a987-4197-8018-dad84d0f54e1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:10.506039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f0703d7-a987-4197-8018-dad84d0f54e1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:10.705914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-996d4a73-c598-4210-8b16-3ac1f4b06ed3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:10.706583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-996d4a73-c598-4210-8b16-3ac1f4b06ed3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:10.730390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-996d4a73-c598-4210-8b16-3ac1f4b06ed3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:10.730901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-996d4a73-c598-4210-8b16-3ac1f4b06ed3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:10.735158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-996d4a73-c598-4210-8b16-3ac1f4b06ed3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:10.736266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-996d4a73-c598-4210-8b16-3ac1f4b06ed3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:10.736757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-996d4a73-c598-4210-8b16-3ac1f4b06ed3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:10.737199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-996d4a73-c598-4210-8b16-3ac1f4b06ed3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:10.799596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6f0703d7-a987-4197-8018-dad84d0f54e1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:10.809798 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6f0703d7-a987-4197-8018-dad84d0f54e1 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1292 microversion: 2.1 time: 0.343393 Oct 12 22:11:10.810980 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1324/2987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:10 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1292 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:10.827453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1be4b6c2-dad5-414a-b81d-cb13b85a61bf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:10.828711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1be4b6c2-dad5-414a-b81d-cb13b85a61bf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:10.835935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1be4b6c2-dad5-414a-b81d-cb13b85a61bf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:10.836816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1be4b6c2-dad5-414a-b81d-cb13b85a61bf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:10.837757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1be4b6c2-dad5-414a-b81d-cb13b85a61bf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:10.839151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1be4b6c2-dad5-414a-b81d-cb13b85a61bf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:10.839806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1be4b6c2-dad5-414a-b81d-cb13b85a61bf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:10.840457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1be4b6c2-dad5-414a-b81d-cb13b85a61bf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:10.928407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-996d4a73-c598-4210-8b16-3ac1f4b06ed3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:10.936300 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-996d4a73-c598-4210-8b16-3ac1f4b06ed3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1466 microversion: 2.1 time: 0.235002 Oct 12 22:11:10.936886 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1664/2988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:10 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1466 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:10.957929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5e9c0607-b509-47a0-b4bc-0628a629618a tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:10.958544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5e9c0607-b509-47a0-b4bc-0628a629618a tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:10.965573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e9c0607-b509-47a0-b4bc-0628a629618a tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:10.966331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e9c0607-b509-47a0-b4bc-0628a629618a tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:10.967009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e9c0607-b509-47a0-b4bc-0628a629618a tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:10.968032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e9c0607-b509-47a0-b4bc-0628a629618a tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:10.968691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e9c0607-b509-47a0-b4bc-0628a629618a tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:10.969323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e9c0607-b509-47a0-b4bc-0628a629618a tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:10.973588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:11.013399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1be4b6c2-dad5-414a-b81d-cb13b85a61bf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:11.021563 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1be4b6c2-dad5-414a-b81d-cb13b85a61bf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1809 microversion: 2.1 time: 0.209338 Oct 12 22:11:11.031484 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1325/2989] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:10 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:11.074114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0f430031-1a78-4aea-ada4-a5292e9b53fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:11.074982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0f430031-1a78-4aea-ada4-a5292e9b53fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:11.081249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f430031-1a78-4aea-ada4-a5292e9b53fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:11.081741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f430031-1a78-4aea-ada4-a5292e9b53fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:11.082185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f430031-1a78-4aea-ada4-a5292e9b53fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:11.082894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f430031-1a78-4aea-ada4-a5292e9b53fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:11.083362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f430031-1a78-4aea-ada4-a5292e9b53fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:11.084045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f430031-1a78-4aea-ada4-a5292e9b53fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:11.088882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:11.101968 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5e9c0607-b509-47a0-b4bc-0628a629618a tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1617 microversion: 2.1 time: 0.146933 Oct 12 22:11:11.102548 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1665/2990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:10 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1617 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:11.144950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-696cede9-743d-4f70-9817-55b321148f1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:11.145582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-696cede9-743d-4f70-9817-55b321148f1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:11.157765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696cede9-743d-4f70-9817-55b321148f1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:11.157960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696cede9-743d-4f70-9817-55b321148f1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:11.158405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696cede9-743d-4f70-9817-55b321148f1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:11.159111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696cede9-743d-4f70-9817-55b321148f1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:11.159884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696cede9-743d-4f70-9817-55b321148f1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:11.160188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696cede9-743d-4f70-9817-55b321148f1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:11.160519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0f430031-1a78-4aea-ada4-a5292e9b53fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:11.168760 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0f430031-1a78-4aea-ada4-a5292e9b53fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1285 microversion: 2.1 time: 0.098536 Oct 12 22:11:11.169252 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1326/2991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:11 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:11.234801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-311109550", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["3c884fd7-d12b-4faa-95e1-96646f21ef60"]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:11.241881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:11.292471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:11:11.303894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-696cede9-743d-4f70-9817-55b321148f1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:11.312575 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-696cede9-743d-4f70-9817-55b321148f1c tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1478 microversion: 2.1 time: 0.174128 Oct 12 22:11:11.313251 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1666/2992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:11 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1478 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:11.317961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5e13c0f2-f796-471d-915e-d8c95e2f87a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:11.318861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5e13c0f2-f796-471d-915e-d8c95e2f87a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:11.327002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e13c0f2-f796-471d-915e-d8c95e2f87a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:11.327521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e13c0f2-f796-471d-915e-d8c95e2f87a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:11.327941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e13c0f2-f796-471d-915e-d8c95e2f87a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:11.328631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e13c0f2-f796-471d-915e-d8c95e2f87a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:11.329077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e13c0f2-f796-471d-915e-d8c95e2f87a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:11.329499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e13c0f2-f796-471d-915e-d8c95e2f87a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:11.395887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5e13c0f2-f796-471d-915e-d8c95e2f87a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:11.404896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5e13c0f2-f796-471d-915e-d8c95e2f87a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:11.406340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5e13c0f2-f796-471d-915e-d8c95e2f87a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:11.411327 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5e13c0f2-f796-471d-915e-d8c95e2f87a7 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.096918 Oct 12 22:11:11.418924 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1667/2993] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:11 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:11:11.520025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:11:11.520455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:11:11.520928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:11:11.521343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:11:11.522063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:11:11.531123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:11.531642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:11.532167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:11.532917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:11.533549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:11.533996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:11.553739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:11:11.559459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:11:11.573980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:11:11.576221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:11:11.624659 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9cf0d4a1-0285-4ea2-9b40-1f749cd544d9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.393690 Oct 12 22:11:11.631394 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1327/2994] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:11:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:11:11.637628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-616e1702-f7d9-45a5-99ee-9bdf79cd0124 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:11.638390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-616e1702-f7d9-45a5-99ee-9bdf79cd0124 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:11.709255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-616e1702-f7d9-45a5-99ee-9bdf79cd0124 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:11.718076 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-616e1702-f7d9-45a5-99ee-9bdf79cd0124 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1216 microversion: 2.1 time: 0.084984 Oct 12 22:11:11.720201 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1668/2995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:11 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:11.833723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d6c9ed57-84f0-4b98-8942-38f97155f997 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:11.834778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d6c9ed57-84f0-4b98-8942-38f97155f997 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:11.841337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6c9ed57-84f0-4b98-8942-38f97155f997 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:11.841937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6c9ed57-84f0-4b98-8942-38f97155f997 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:11.842599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6c9ed57-84f0-4b98-8942-38f97155f997 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:11.843432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6c9ed57-84f0-4b98-8942-38f97155f997 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:11.843991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6c9ed57-84f0-4b98-8942-38f97155f997 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:11.844520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6c9ed57-84f0-4b98-8942-38f97155f997 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:12.047942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6069adab-5175-4964-858a-87c350e22717 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:12.049400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6069adab-5175-4964-858a-87c350e22717 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:12.058569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6069adab-5175-4964-858a-87c350e22717 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:12.059117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6069adab-5175-4964-858a-87c350e22717 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:12.059585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6069adab-5175-4964-858a-87c350e22717 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:12.060448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6069adab-5175-4964-858a-87c350e22717 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:12.061192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6069adab-5175-4964-858a-87c350e22717 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:12.061674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6069adab-5175-4964-858a-87c350e22717 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:12.166294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d6c9ed57-84f0-4b98-8942-38f97155f997 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:12.204591 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d6c9ed57-84f0-4b98-8942-38f97155f997 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1292 microversion: 2.1 time: 0.374275 Oct 12 22:11:12.205763 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1328/2996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:11 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1292 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:12.224182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a6cce5d5-73f5-466a-a0a6-ca2403e96d6f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:12.225054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a6cce5d5-73f5-466a-a0a6-ca2403e96d6f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:12.231053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6069adab-5175-4964-858a-87c350e22717 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:12.242174 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6069adab-5175-4964-858a-87c350e22717 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1809 microversion: 2.1 time: 0.195283 Oct 12 22:11:12.244180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6cce5d5-73f5-466a-a0a6-ca2403e96d6f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:12.244664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6cce5d5-73f5-466a-a0a6-ca2403e96d6f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:12.245096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6cce5d5-73f5-466a-a0a6-ca2403e96d6f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:12.245789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6cce5d5-73f5-466a-a0a6-ca2403e96d6f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:12.246233 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6cce5d5-73f5-466a-a0a6-ca2403e96d6f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:12.246666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6cce5d5-73f5-466a-a0a6-ca2403e96d6f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:12.252331 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1669/2997] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:12 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:12.347355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e7a72fef-fca7-4219-99e6-39fbbd5d4d7a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:12.350138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e7a72fef-fca7-4219-99e6-39fbbd5d4d7a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:12.368505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7a72fef-fca7-4219-99e6-39fbbd5d4d7a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:12.371667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7a72fef-fca7-4219-99e6-39fbbd5d4d7a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:12.372269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7a72fef-fca7-4219-99e6-39fbbd5d4d7a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:12.373390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7a72fef-fca7-4219-99e6-39fbbd5d4d7a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:12.376414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7a72fef-fca7-4219-99e6-39fbbd5d4d7a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:12.378341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7a72fef-fca7-4219-99e6-39fbbd5d4d7a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:12.410879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a6cce5d5-73f5-466a-a0a6-ca2403e96d6f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:12.423993 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a6cce5d5-73f5-466a-a0a6-ca2403e96d6f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1273 microversion: 2.1 time: 0.210879 Oct 12 22:11:12.445158 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1329/2998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:12 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1273 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:12.450248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c38c6c3a-4d2e-45ba-9c33-91677bd5e64d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:12.458714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c38c6c3a-4d2e-45ba-9c33-91677bd5e64d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:12.467455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c38c6c3a-4d2e-45ba-9c33-91677bd5e64d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:12.469805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c38c6c3a-4d2e-45ba-9c33-91677bd5e64d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:12.470272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c38c6c3a-4d2e-45ba-9c33-91677bd5e64d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:12.471004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c38c6c3a-4d2e-45ba-9c33-91677bd5e64d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:12.472442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c38c6c3a-4d2e-45ba-9c33-91677bd5e64d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:12.473071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c38c6c3a-4d2e-45ba-9c33-91677bd5e64d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:12.590005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e7a72fef-fca7-4219-99e6-39fbbd5d4d7a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:12.599757 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e7a72fef-fca7-4219-99e6-39fbbd5d4d7a tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1478 microversion: 2.1 time: 0.266504 Oct 12 22:11:12.603864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c38c6c3a-4d2e-45ba-9c33-91677bd5e64d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:12.612604 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1670/2999] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:12 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1478 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:12.623014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c38c6c3a-4d2e-45ba-9c33-91677bd5e64d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:12.624601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c38c6c3a-4d2e-45ba-9c33-91677bd5e64d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:12.629923 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c38c6c3a-4d2e-45ba-9c33-91677bd5e64d tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.183554 Oct 12 22:11:12.630600 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1330/3000] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:12 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:11:12.742044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87c1034e-bd25-4d4c-9433-e8113b6c0f0b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:12.742657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-87c1034e-bd25-4d4c-9433-e8113b6c0f0b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:12.746545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:12.750718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c1034e-bd25-4d4c-9433-e8113b6c0f0b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:12.751211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c1034e-bd25-4d4c-9433-e8113b6c0f0b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:12.751698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c1034e-bd25-4d4c-9433-e8113b6c0f0b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:12.752384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c1034e-bd25-4d4c-9433-e8113b6c0f0b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:12.753514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c1034e-bd25-4d4c-9433-e8113b6c0f0b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:12.753951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c1034e-bd25-4d4c-9433-e8113b6c0f0b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:12.839210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-87c1034e-bd25-4d4c-9433-e8113b6c0f0b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:12.859424 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-87c1034e-bd25-4d4c-9433-e8113b6c0f0b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1212 microversion: 2.1 time: 0.121083 Oct 12 22:11:12.860574 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1671/3001] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:12 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1212 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:13.075462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-c9305dc7-c729-43a8-a554-fdcfc24008be req-7a23547a-cffa-4868-9e10-166dcc83d84f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55c3cea-33ea-435c-84b3-f668bd000c8c", "name": "network-vif-plugged", "status": "completed", "tag": "f17c481a-e1dd-4e92-afef-f445e4724b1c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:13.094260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c9305dc7-c729-43a8-a554-fdcfc24008be req-7a23547a-cffa-4868-9e10-166dcc83d84f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:13.094741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c9305dc7-c729-43a8-a554-fdcfc24008be req-7a23547a-cffa-4868-9e10-166dcc83d84f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:13.099292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c9305dc7-c729-43a8-a554-fdcfc24008be req-7a23547a-cffa-4868-9e10-166dcc83d84f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:13.145618 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-c9305dc7-c729-43a8-a554-fdcfc24008be req-7a23547a-cffa-4868-9e10-166dcc83d84f service nova] Creating event network-vif-plugged:f17c481a-e1dd-4e92-afef-f445e4724b1c for instance f55c3cea-33ea-435c-84b3-f668bd000c8c on n-h1-861111-1 Oct 12 22:11:13.162079 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-c9305dc7-c729-43a8-a554-fdcfc24008be req-7a23547a-cffa-4868-9e10-166dcc83d84f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091814 Oct 12 22:11:13.165112 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1331/3002] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:13.229623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-89bd657a-0c34-4c1d-965d-712cdf76dfa8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:13.230353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-89bd657a-0c34-4c1d-965d-712cdf76dfa8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:13.245635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89bd657a-0c34-4c1d-965d-712cdf76dfa8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:13.246474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89bd657a-0c34-4c1d-965d-712cdf76dfa8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:13.248838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89bd657a-0c34-4c1d-965d-712cdf76dfa8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:13.250852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89bd657a-0c34-4c1d-965d-712cdf76dfa8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:13.251482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89bd657a-0c34-4c1d-965d-712cdf76dfa8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:13.252802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89bd657a-0c34-4c1d-965d-712cdf76dfa8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:13.278382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e46fbf40-2d73-46b2-bb9c-7eec0c965a16 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:13.279758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e46fbf40-2d73-46b2-bb9c-7eec0c965a16 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:13.288191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e46fbf40-2d73-46b2-bb9c-7eec0c965a16 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:13.290364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e46fbf40-2d73-46b2-bb9c-7eec0c965a16 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:13.292230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e46fbf40-2d73-46b2-bb9c-7eec0c965a16 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:13.293877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e46fbf40-2d73-46b2-bb9c-7eec0c965a16 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:13.297884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e46fbf40-2d73-46b2-bb9c-7eec0c965a16 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:13.299378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e46fbf40-2d73-46b2-bb9c-7eec0c965a16 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:13.482694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-89bd657a-0c34-4c1d-965d-712cdf76dfa8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:13.490877 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-89bd657a-0c34-4c1d-965d-712cdf76dfa8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1292 microversion: 2.1 time: 0.266132 Oct 12 22:11:13.491970 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1672/3003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:13 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1292 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:13.496309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d3165228-7404-4f42-968e-5c7eb38d55ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:13.496918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d3165228-7404-4f42-968e-5c7eb38d55ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:13.503282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3165228-7404-4f42-968e-5c7eb38d55ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:13.503906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3165228-7404-4f42-968e-5c7eb38d55ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:13.504217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3165228-7404-4f42-968e-5c7eb38d55ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:13.504914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3165228-7404-4f42-968e-5c7eb38d55ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:13.505856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3165228-7404-4f42-968e-5c7eb38d55ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:13.505856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3165228-7404-4f42-968e-5c7eb38d55ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:13.713667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d3165228-7404-4f42-968e-5c7eb38d55ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:13.726470 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d3165228-7404-4f42-968e-5c7eb38d55ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1315 microversion: 2.1 time: 0.232578 Oct 12 22:11:13.727339 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1673/3004] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:13 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:13.732672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-81c8f6a1-3310-48ec-9857-9b22fd0e4473 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:13.733518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-81c8f6a1-3310-48ec-9857-9b22fd0e4473 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:13.741269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81c8f6a1-3310-48ec-9857-9b22fd0e4473 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:13.742684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81c8f6a1-3310-48ec-9857-9b22fd0e4473 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:13.743300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81c8f6a1-3310-48ec-9857-9b22fd0e4473 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:13.744158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81c8f6a1-3310-48ec-9857-9b22fd0e4473 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:13.744771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81c8f6a1-3310-48ec-9857-9b22fd0e4473 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:13.745373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81c8f6a1-3310-48ec-9857-9b22fd0e4473 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:13.943522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-81c8f6a1-3310-48ec-9857-9b22fd0e4473 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:13.954759 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-81c8f6a1-3310-48ec-9857-9b22fd0e4473 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1478 microversion: 2.1 time: 0.225904 Oct 12 22:11:13.955577 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1674/3005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:13 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1478 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:13.978520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6cfe9c79-166c-4d5d-8376-d23b40274862 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:13.979207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6cfe9c79-166c-4d5d-8376-d23b40274862 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:13.985962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cfe9c79-166c-4d5d-8376-d23b40274862 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:13.987127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cfe9c79-166c-4d5d-8376-d23b40274862 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:13.987763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cfe9c79-166c-4d5d-8376-d23b40274862 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:13.988486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cfe9c79-166c-4d5d-8376-d23b40274862 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:13.988979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cfe9c79-166c-4d5d-8376-d23b40274862 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:13.989420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cfe9c79-166c-4d5d-8376-d23b40274862 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:14.074166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6cfe9c79-166c-4d5d-8376-d23b40274862 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:14.089316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6cfe9c79-166c-4d5d-8376-d23b40274862 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:14.091177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6cfe9c79-166c-4d5d-8376-d23b40274862 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:14.097363 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6cfe9c79-166c-4d5d-8376-d23b40274862 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.124081 Oct 12 22:11:14.098161 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1675/3006] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:13 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:11:14.125556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d26aa365-b696-4ca4-bf48-6e98634e8833 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:14.126208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d26aa365-b696-4ca4-bf48-6e98634e8833 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:14.137364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d26aa365-b696-4ca4-bf48-6e98634e8833 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:14.137856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d26aa365-b696-4ca4-bf48-6e98634e8833 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:14.138361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d26aa365-b696-4ca4-bf48-6e98634e8833 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:14.139092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d26aa365-b696-4ca4-bf48-6e98634e8833 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:14.140276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d26aa365-b696-4ca4-bf48-6e98634e8833 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:14.144861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d26aa365-b696-4ca4-bf48-6e98634e8833 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:14.242664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d26aa365-b696-4ca4-bf48-6e98634e8833 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:14.252196 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d26aa365-b696-4ca4-bf48-6e98634e8833 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1268 microversion: 2.1 time: 0.152667 Oct 12 22:11:14.253330 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1676/3007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:14 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:14.326758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e46fbf40-2d73-46b2-bb9c-7eec0c965a16 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:14.340196 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e46fbf40-2d73-46b2-bb9c-7eec0c965a16 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1809 microversion: 2.1 time: 1.064595 Oct 12 22:11:14.357496 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1332/3008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:13 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1809 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:14.516280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-64bd6d65-afc0-4ad6-befe-715228bf7440 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:14.517240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-64bd6d65-afc0-4ad6-befe-715228bf7440 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:14.526311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64bd6d65-afc0-4ad6-befe-715228bf7440 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:14.527562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64bd6d65-afc0-4ad6-befe-715228bf7440 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:14.528390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64bd6d65-afc0-4ad6-befe-715228bf7440 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:14.529461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64bd6d65-afc0-4ad6-befe-715228bf7440 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:14.530318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64bd6d65-afc0-4ad6-befe-715228bf7440 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:14.531293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64bd6d65-afc0-4ad6-befe-715228bf7440 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:14.771650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-508bea64-5e01-451b-a8ba-9b613f794e3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:14.772545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-508bea64-5e01-451b-a8ba-9b613f794e3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:14.795849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-64bd6d65-afc0-4ad6-befe-715228bf7440 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:14.803535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-508bea64-5e01-451b-a8ba-9b613f794e3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:14.806456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-508bea64-5e01-451b-a8ba-9b613f794e3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:14.807022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-508bea64-5e01-451b-a8ba-9b613f794e3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:14.809746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-508bea64-5e01-451b-a8ba-9b613f794e3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:14.810490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-508bea64-5e01-451b-a8ba-9b613f794e3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:14.812514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-508bea64-5e01-451b-a8ba-9b613f794e3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:14.814927 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-64bd6d65-afc0-4ad6-befe-715228bf7440 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1292 microversion: 2.1 time: 0.302607 Oct 12 22:11:14.818303 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1677/3009] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:14 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1292 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:14.981426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b61cc53a-88f3-40ea-b713-76d3e52ab8a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:14.982381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b61cc53a-88f3-40ea-b713-76d3e52ab8a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:15.000020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b61cc53a-88f3-40ea-b713-76d3e52ab8a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:15.001540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b61cc53a-88f3-40ea-b713-76d3e52ab8a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:15.003981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b61cc53a-88f3-40ea-b713-76d3e52ab8a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:15.005157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b61cc53a-88f3-40ea-b713-76d3e52ab8a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:15.008388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b61cc53a-88f3-40ea-b713-76d3e52ab8a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:15.009086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b61cc53a-88f3-40ea-b713-76d3e52ab8a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:15.467929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-508bea64-5e01-451b-a8ba-9b613f794e3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:15.481930 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-508bea64-5e01-451b-a8ba-9b613f794e3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1315 microversion: 2.1 time: 0.733402 Oct 12 22:11:15.488317 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1333/3010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:14 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1315 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:15.498161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0db171df-b1fb-4188-a013-d3fa81932fbb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:15.501903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0db171df-b1fb-4188-a013-d3fa81932fbb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:15.542503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0db171df-b1fb-4188-a013-d3fa81932fbb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:15.544041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0db171df-b1fb-4188-a013-d3fa81932fbb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:15.547006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0db171df-b1fb-4188-a013-d3fa81932fbb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:15.548068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0db171df-b1fb-4188-a013-d3fa81932fbb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:15.551491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0db171df-b1fb-4188-a013-d3fa81932fbb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:15.552320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0db171df-b1fb-4188-a013-d3fa81932fbb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:15.571433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b61cc53a-88f3-40ea-b713-76d3e52ab8a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:15.591921 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b61cc53a-88f3-40ea-b713-76d3e52ab8a8 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1478 microversion: 2.1 time: 0.615924 Oct 12 22:11:15.601631 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1678/3011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:14 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1478 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:15.622443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-bd9e47fb-1d54-40e7-aede-633e7be0e3b1 req-ddab0c2e-45d0-4e92-a531-9de2b8509cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b0eb54-219e-4026-b96c-59b963b0f770", "name": "network-vif-unplugged", "status": "completed", "tag": "72cdcc3a-ba0f-41c3-9bb0-97a69bd68560"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:15.670953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-bd9e47fb-1d54-40e7-aede-633e7be0e3b1 req-ddab0c2e-45d0-4e92-a531-9de2b8509cd2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:15.672063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-bd9e47fb-1d54-40e7-aede-633e7be0e3b1 req-ddab0c2e-45d0-4e92-a531-9de2b8509cd2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:15.674502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-bd9e47fb-1d54-40e7-aede-633e7be0e3b1 req-ddab0c2e-45d0-4e92-a531-9de2b8509cd2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:15.711850 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-bd9e47fb-1d54-40e7-aede-633e7be0e3b1 req-ddab0c2e-45d0-4e92-a531-9de2b8509cd2 service nova] Creating event network-vif-unplugged:72cdcc3a-ba0f-41c3-9bb0-97a69bd68560 for instance f3b0eb54-219e-4026-b96c-59b963b0f770 on n-h1-861111-1 Oct 12 22:11:15.724323 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-bd9e47fb-1d54-40e7-aede-633e7be0e3b1 req-ddab0c2e-45d0-4e92-a531-9de2b8509cd2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120960 Oct 12 22:11:15.729436 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1679/3012] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:15.744272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ed4aa8d7-74b1-485f-a4d1-2186ebb979f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:15.749006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ed4aa8d7-74b1-485f-a4d1-2186ebb979f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:15.769130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed4aa8d7-74b1-485f-a4d1-2186ebb979f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:15.774975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed4aa8d7-74b1-485f-a4d1-2186ebb979f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:15.777985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed4aa8d7-74b1-485f-a4d1-2186ebb979f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:15.781161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed4aa8d7-74b1-485f-a4d1-2186ebb979f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:15.784839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed4aa8d7-74b1-485f-a4d1-2186ebb979f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:15.788871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed4aa8d7-74b1-485f-a4d1-2186ebb979f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:15.892899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0db171df-b1fb-4188-a013-d3fa81932fbb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:15.912742 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0db171df-b1fb-4188-a013-d3fa81932fbb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:15.917860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0db171df-b1fb-4188-a013-d3fa81932fbb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:15.930701 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0db171df-b1fb-4188-a013-d3fa81932fbb tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1544 microversion: 2.91 time: 0.440905 Oct 12 22:11:15.931325 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1334/3013] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:15 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1544 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:11:15.952138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b518f0a2-1ec0-44b8-8eee-d81327b130c0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:15.952743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b518f0a2-1ec0-44b8-8eee-d81327b130c0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:15.966461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b518f0a2-1ec0-44b8-8eee-d81327b130c0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:15.966969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b518f0a2-1ec0-44b8-8eee-d81327b130c0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:15.967458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b518f0a2-1ec0-44b8-8eee-d81327b130c0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:15.968307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b518f0a2-1ec0-44b8-8eee-d81327b130c0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:15.968757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b518f0a2-1ec0-44b8-8eee-d81327b130c0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:15.969179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b518f0a2-1ec0-44b8-8eee-d81327b130c0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:16.020187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ed4aa8d7-74b1-485f-a4d1-2186ebb979f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:16.029563 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ed4aa8d7-74b1-485f-a4d1-2186ebb979f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1274 microversion: 2.1 time: 0.298532 Oct 12 22:11:16.040467 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1680/3014] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:15 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1274 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:16.055158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f1da30cc-43f6-4beb-b04c-d2330898a93b req-d9a250e7-7da0-4e0f-80be-b32e9e67622b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fae77315-a6c0-474c-aef9-5c8edda79113", "name": "network-vif-deleted", "tag": "ac01c165-88a6-42a2-b3a9-4b440eea669c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:16.075866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f1da30cc-43f6-4beb-b04c-d2330898a93b req-d9a250e7-7da0-4e0f-80be-b32e9e67622b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:16.076398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f1da30cc-43f6-4beb-b04c-d2330898a93b req-d9a250e7-7da0-4e0f-80be-b32e9e67622b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:16.077092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f1da30cc-43f6-4beb-b04c-d2330898a93b req-d9a250e7-7da0-4e0f-80be-b32e9e67622b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:16.101943 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f1da30cc-43f6-4beb-b04c-d2330898a93b req-d9a250e7-7da0-4e0f-80be-b32e9e67622b service nova] Creating event network-vif-deleted:ac01c165-88a6-42a2-b3a9-4b440eea669c for instance fae77315-a6c0-474c-aef9-5c8edda79113 on n-h2-861111-1 Oct 12 22:11:16.112069 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f1da30cc-43f6-4beb-b04c-d2330898a93b req-d9a250e7-7da0-4e0f-80be-b32e9e67622b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069795 Oct 12 22:11:16.113140 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1681/3015] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:16.119464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b2df0dbc-1017-4fbb-8766-73523cd9fb6e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:16.120482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b2df0dbc-1017-4fbb-8766-73523cd9fb6e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:16.127061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2df0dbc-1017-4fbb-8766-73523cd9fb6e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:16.127783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2df0dbc-1017-4fbb-8766-73523cd9fb6e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:16.128369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2df0dbc-1017-4fbb-8766-73523cd9fb6e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:16.129219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2df0dbc-1017-4fbb-8766-73523cd9fb6e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:16.129845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2df0dbc-1017-4fbb-8766-73523cd9fb6e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:16.130432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2df0dbc-1017-4fbb-8766-73523cd9fb6e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:16.434119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b518f0a2-1ec0-44b8-8eee-d81327b130c0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:16.450594 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b518f0a2-1ec0-44b8-8eee-d81327b130c0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1788 microversion: 2.1 time: 0.515852 Oct 12 22:11:16.452963 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1335/3016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:15 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1788 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:16.516389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c1ade813-7147-40d5-9661-a935da7a1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:16.517044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c1ade813-7147-40d5-9661-a935da7a1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:16.536728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1ade813-7147-40d5-9661-a935da7a1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:16.550706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1ade813-7147-40d5-9661-a935da7a1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:16.551051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1ade813-7147-40d5-9661-a935da7a1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:16.556398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1ade813-7147-40d5-9661-a935da7a1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:16.560244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1ade813-7147-40d5-9661-a935da7a1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:16.560471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1ade813-7147-40d5-9661-a935da7a1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:16.721712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b2df0dbc-1017-4fbb-8766-73523cd9fb6e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:16.734782 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b2df0dbc-1017-4fbb-8766-73523cd9fb6e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1483 microversion: 2.1 time: 0.620285 Oct 12 22:11:16.735797 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1682/3017] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:16 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1483 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:16.740536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a1a4334e-f1b8-4f45-a7f3-f3751b1259a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:16.756412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a1a4334e-f1b8-4f45-a7f3-f3751b1259a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:16.771278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1a4334e-f1b8-4f45-a7f3-f3751b1259a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:16.774697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1a4334e-f1b8-4f45-a7f3-f3751b1259a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:16.783960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1a4334e-f1b8-4f45-a7f3-f3751b1259a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:16.787066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1a4334e-f1b8-4f45-a7f3-f3751b1259a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:16.787748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1a4334e-f1b8-4f45-a7f3-f3751b1259a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:16.788391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1a4334e-f1b8-4f45-a7f3-f3751b1259a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:17.262600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a1a4334e-f1b8-4f45-a7f3-f3751b1259a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:17.278307 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a1a4334e-f1b8-4f45-a7f3-f3751b1259a9 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1478 microversion: 2.1 time: 0.540016 Oct 12 22:11:17.280625 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1683/3018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:16 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1478 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:17.291526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8ce87b96-f7ba-4a23-a69a-11a1f4e62b5c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:17.293738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8ce87b96-f7ba-4a23-a69a-11a1f4e62b5c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:17.314142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ce87b96-f7ba-4a23-a69a-11a1f4e62b5c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:17.315160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ce87b96-f7ba-4a23-a69a-11a1f4e62b5c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:17.316684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ce87b96-f7ba-4a23-a69a-11a1f4e62b5c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:17.317642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ce87b96-f7ba-4a23-a69a-11a1f4e62b5c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:17.318547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ce87b96-f7ba-4a23-a69a-11a1f4e62b5c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:17.320008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ce87b96-f7ba-4a23-a69a-11a1f4e62b5c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:17.332777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:17.482869 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8ce87b96-f7ba-4a23-a69a-11a1f4e62b5c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.200206 Oct 12 22:11:17.491328 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1684/3019] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:11:17 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c/os-interface => generated 285 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:17.498611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b7aa34c3-e288-438d-9e49-5a9bd54a8566 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:17.500186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b7aa34c3-e288-438d-9e49-5a9bd54a8566 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:17.517040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7aa34c3-e288-438d-9e49-5a9bd54a8566 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:17.520910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7aa34c3-e288-438d-9e49-5a9bd54a8566 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:17.521822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7aa34c3-e288-438d-9e49-5a9bd54a8566 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:17.523007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7aa34c3-e288-438d-9e49-5a9bd54a8566 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:17.524769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7aa34c3-e288-438d-9e49-5a9bd54a8566 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:17.527392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7aa34c3-e288-438d-9e49-5a9bd54a8566 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:17.547727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c1ade813-7147-40d5-9661-a935da7a1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:17.565510 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c1ade813-7147-40d5-9661-a935da7a1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1315 microversion: 2.1 time: 1.049332 Oct 12 22:11:17.566153 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1336/3020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:16 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1315 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:17.582482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-186e671a-2913-4909-89ba-44b24296cb01 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:17.583105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-186e671a-2913-4909-89ba-44b24296cb01 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:17.603014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-186e671a-2913-4909-89ba-44b24296cb01 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:17.603543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-186e671a-2913-4909-89ba-44b24296cb01 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:17.603976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-186e671a-2913-4909-89ba-44b24296cb01 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:17.604679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-186e671a-2913-4909-89ba-44b24296cb01 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:17.605127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-186e671a-2913-4909-89ba-44b24296cb01 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:17.605551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-186e671a-2913-4909-89ba-44b24296cb01 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:17.705745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b7aa34c3-e288-438d-9e49-5a9bd54a8566 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:17.726427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b7aa34c3-e288-438d-9e49-5a9bd54a8566 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:17.729007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b7aa34c3-e288-438d-9e49-5a9bd54a8566 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:17.745761 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b7aa34c3-e288-438d-9e49-5a9bd54a8566 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1531 microversion: 2.91 time: 0.253100 Oct 12 22:11:17.746635 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1685/3021] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:17 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1531 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:11:17.756733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b3101b02-09b5-44b7-857e-95e179d7d249 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:17.758310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b3101b02-09b5-44b7-857e-95e179d7d249 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:17.771748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3101b02-09b5-44b7-857e-95e179d7d249 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:17.773630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3101b02-09b5-44b7-857e-95e179d7d249 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:17.774342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3101b02-09b5-44b7-857e-95e179d7d249 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:17.784796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3101b02-09b5-44b7-857e-95e179d7d249 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:17.785634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3101b02-09b5-44b7-857e-95e179d7d249 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:17.787011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3101b02-09b5-44b7-857e-95e179d7d249 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:18.009308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-186e671a-2913-4909-89ba-44b24296cb01 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:18.044464 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-186e671a-2913-4909-89ba-44b24296cb01 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1316 microversion: 2.1 time: 0.474347 Oct 12 22:11:18.045580 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1337/3022] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:17 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:18.068951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f43221d6-ed67-40e3-8e92-9301e3e1eeb2 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:18.070096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f43221d6-ed67-40e3-8e92-9301e3e1eeb2 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:18.093114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f43221d6-ed67-40e3-8e92-9301e3e1eeb2 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:18.093762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f43221d6-ed67-40e3-8e92-9301e3e1eeb2 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:18.097313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f43221d6-ed67-40e3-8e92-9301e3e1eeb2 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:18.107898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f43221d6-ed67-40e3-8e92-9301e3e1eeb2 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:18.108382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f43221d6-ed67-40e3-8e92-9301e3e1eeb2 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:18.108822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f43221d6-ed67-40e3-8e92-9301e3e1eeb2 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:18.207175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b3101b02-09b5-44b7-857e-95e179d7d249 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:18.221001 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b3101b02-09b5-44b7-857e-95e179d7d249 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 200 len: 1611 microversion: 2.1 time: 0.471802 Oct 12 22:11:18.221783 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1686/3023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:17 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 1611 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:18.231062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-c4aaae3d-574a-485a-a979-e1f4db1590d9 req-b06bde5e-073c-445c-b86d-17f72361648e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e3560f-1bb0-482f-84cc-fc83097d0327", "tag": "e07c76e8-5fc2-4075-ab9c-8bb75eedab89"}, {"server_uuid": "fae77315-a6c0-474c-aef9-5c8edda79113", "name": "network-vif-deleted", "tag": "d80d4594-afa7-4bd2-9bef-eebbc4773763"}, {"server_uuid": "fae77315-a6c0-474c-aef9-5c8edda79113", "name": "network-vif-deleted", "tag": "78b7a819-d94a-4d81-ad53-c90d49702e64"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:18.258351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c4aaae3d-574a-485a-a979-e1f4db1590d9 req-b06bde5e-073c-445c-b86d-17f72361648e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:18.283193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c4aaae3d-574a-485a-a979-e1f4db1590d9 req-b06bde5e-073c-445c-b86d-17f72361648e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:18.284496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c4aaae3d-574a-485a-a979-e1f4db1590d9 req-b06bde5e-073c-445c-b86d-17f72361648e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:18.321873 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-c4aaae3d-574a-485a-a979-e1f4db1590d9 req-b06bde5e-073c-445c-b86d-17f72361648e service nova] Creating event network-changed:e07c76e8-5fc2-4075-ab9c-8bb75eedab89 for instance 73e3560f-1bb0-482f-84cc-fc83097d0327 on n-h1-861111-1 Oct 12 22:11:18.336728 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-c4aaae3d-574a-485a-a979-e1f4db1590d9 req-b06bde5e-073c-445c-b86d-17f72361648e service nova] Creating event network-vif-deleted:d80d4594-afa7-4bd2-9bef-eebbc4773763 for instance fae77315-a6c0-474c-aef9-5c8edda79113 on n-h2-861111-1 Oct 12 22:11:18.337652 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-c4aaae3d-574a-485a-a979-e1f4db1590d9 req-b06bde5e-073c-445c-b86d-17f72361648e service nova] Creating event network-vif-deleted:78b7a819-d94a-4d81-ad53-c90d49702e64 for instance fae77315-a6c0-474c-aef9-5c8edda79113 on n-h2-861111-1 Oct 12 22:11:18.340715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-f43221d6-ed67-40e3-8e92-9301e3e1eeb2 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] Lazy-loading 'services' on Instance uuid c01cd2e8-7dbc-4751-9124-8e46d3181d89 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:11:18.360059 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-c4aaae3d-574a-485a-a979-e1f4db1590d9 req-b06bde5e-073c-445c-b86d-17f72361648e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.130217 Oct 12 22:11:18.360951 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1687/3024] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:18.383184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1c63ae67-16f8-4ec7-8e21-36b32f91c4c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:18.384061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1c63ae67-16f8-4ec7-8e21-36b32f91c4c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:18.407213 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f43221d6-ed67-40e3-8e92-9301e3e1eeb2 tempest-UnshelveToHostMultiNodesTest-1389288807 tempest-UnshelveToHostMultiNodesTest-1389288807-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1936 microversion: 2.91 time: 0.359150 Oct 12 22:11:18.409576 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1338/3025] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:18 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1936 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:11:18.450322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c63ae67-16f8-4ec7-8e21-36b32f91c4c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:18.452978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c63ae67-16f8-4ec7-8e21-36b32f91c4c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:18.454820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c63ae67-16f8-4ec7-8e21-36b32f91c4c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:18.463946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c63ae67-16f8-4ec7-8e21-36b32f91c4c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:18.467256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c63ae67-16f8-4ec7-8e21-36b32f91c4c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:18.467851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c63ae67-16f8-4ec7-8e21-36b32f91c4c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:18.472567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f205217a-3f5b-4e18-9e33-491329f3eb2e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:18.473303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f205217a-3f5b-4e18-9e33-491329f3eb2e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:18.490711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f205217a-3f5b-4e18-9e33-491329f3eb2e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:18.491951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f205217a-3f5b-4e18-9e33-491329f3eb2e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:18.499386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f205217a-3f5b-4e18-9e33-491329f3eb2e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:18.500354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f205217a-3f5b-4e18-9e33-491329f3eb2e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:18.500978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f205217a-3f5b-4e18-9e33-491329f3eb2e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:18.501574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f205217a-3f5b-4e18-9e33-491329f3eb2e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:18.552465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f205217a-3f5b-4e18-9e33-491329f3eb2e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:11:18.729701 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f205217a-3f5b-4e18-9e33-491329f3eb2e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 204 len: 0 microversion: 2.91 time: 0.260775 Oct 12 22:11:18.730923 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1339/3026] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:11:18 2022] DELETE /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:11:18.736655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-8d1f4251-d94b-45ab-a847-c596674e5c6d req-55e3bab4-c1e0-4ad6-96d7-bc2b3447f125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b0eb54-219e-4026-b96c-59b963b0f770", "name": "network-vif-plugged", "status": "completed", "tag": "72cdcc3a-ba0f-41c3-9bb0-97a69bd68560"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:18.765035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8d1f4251-d94b-45ab-a847-c596674e5c6d req-55e3bab4-c1e0-4ad6-96d7-bc2b3447f125 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:18.765806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8d1f4251-d94b-45ab-a847-c596674e5c6d req-55e3bab4-c1e0-4ad6-96d7-bc2b3447f125 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:18.766432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8d1f4251-d94b-45ab-a847-c596674e5c6d req-55e3bab4-c1e0-4ad6-96d7-bc2b3447f125 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:18.785857 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-8d1f4251-d94b-45ab-a847-c596674e5c6d req-55e3bab4-c1e0-4ad6-96d7-bc2b3447f125 service nova] Creating event network-vif-plugged:72cdcc3a-ba0f-41c3-9bb0-97a69bd68560 for instance f3b0eb54-219e-4026-b96c-59b963b0f770 on n-h1-861111-1 Oct 12 22:11:18.800935 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-8d1f4251-d94b-45ab-a847-c596674e5c6d req-55e3bab4-c1e0-4ad6-96d7-bc2b3447f125 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068393 Oct 12 22:11:18.806662 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1340/3027] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:18.817452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-99584753-1cf3-4912-8882-fb96bc07233c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:18.825337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-99584753-1cf3-4912-8882-fb96bc07233c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:18.838636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99584753-1cf3-4912-8882-fb96bc07233c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:18.839566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99584753-1cf3-4912-8882-fb96bc07233c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:18.840367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99584753-1cf3-4912-8882-fb96bc07233c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:18.856127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99584753-1cf3-4912-8882-fb96bc07233c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:18.858771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99584753-1cf3-4912-8882-fb96bc07233c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:18.864247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99584753-1cf3-4912-8882-fb96bc07233c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:19.115950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1c63ae67-16f8-4ec7-8e21-36b32f91c4c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:19.130962 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1c63ae67-16f8-4ec7-8e21-36b32f91c4c7 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1478 microversion: 2.1 time: 0.761920 Oct 12 22:11:19.137901 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1688/3028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:18 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1478 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:19.155388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c5fc6a87-7a97-448d-8502-0464378be13e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:19.156306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c5fc6a87-7a97-448d-8502-0464378be13e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:19.162897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5fc6a87-7a97-448d-8502-0464378be13e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:19.168284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5fc6a87-7a97-448d-8502-0464378be13e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:19.169012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5fc6a87-7a97-448d-8502-0464378be13e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:19.169942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5fc6a87-7a97-448d-8502-0464378be13e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:19.170577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5fc6a87-7a97-448d-8502-0464378be13e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:19.171199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5fc6a87-7a97-448d-8502-0464378be13e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:19.383159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c5fc6a87-7a97-448d-8502-0464378be13e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:19.397253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c5fc6a87-7a97-448d-8502-0464378be13e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:19.416915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c5fc6a87-7a97-448d-8502-0464378be13e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:19.445210 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c5fc6a87-7a97-448d-8502-0464378be13e tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.303257 Oct 12 22:11:19.448474 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1689/3029] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:19 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:11:19.460349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c5807266-a68b-46b4-a04b-d1acb149c25f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:19.465546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c5807266-a68b-46b4-a04b-d1acb149c25f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:19.484686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5807266-a68b-46b4-a04b-d1acb149c25f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:19.485246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5807266-a68b-46b4-a04b-d1acb149c25f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:19.487005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5807266-a68b-46b4-a04b-d1acb149c25f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:19.489584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5807266-a68b-46b4-a04b-d1acb149c25f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:19.490137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5807266-a68b-46b4-a04b-d1acb149c25f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:19.490677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5807266-a68b-46b4-a04b-d1acb149c25f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:19.609936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-99584753-1cf3-4912-8882-fb96bc07233c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:19.618824 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-99584753-1cf3-4912-8882-fb96bc07233c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1315 microversion: 2.1 time: 0.809855 Oct 12 22:11:19.619358 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1341/3030] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:18 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:19.629097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5302460b-7449-4ee0-a5a7-7cca7324de39 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:19.629894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5302460b-7449-4ee0-a5a7-7cca7324de39 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:19.662639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5302460b-7449-4ee0-a5a7-7cca7324de39 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:19.666559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5302460b-7449-4ee0-a5a7-7cca7324de39 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:19.669987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5302460b-7449-4ee0-a5a7-7cca7324de39 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:19.670949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5302460b-7449-4ee0-a5a7-7cca7324de39 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:19.671877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5302460b-7449-4ee0-a5a7-7cca7324de39 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:19.672495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5302460b-7449-4ee0-a5a7-7cca7324de39 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:19.695996 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-5302460b-7449-4ee0-a5a7-7cca7324de39 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] HTTP exception thrown: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5302460b-7449-4ee0-a5a7-7cca7324de39 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Request method failure captured: Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 HTTP/1.1 Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRztH-2cK6EcNrtu-ZFwiruT6Q8zJdENYas1C6WcCB9aoZvIW_Yd_lMijAJEpfeIDVAE3iHxx_b3e15m_Drd-MP8HS_4RlHH7J-ugq0PIYEKg7Kaaz8t2BWs25twn5bRCwgR449YSnstuvCm6JOwramKI9NMnWnRgFVTMwM5Y9dJ-lec Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 0287e296f1c9414e81fbd0212bde30ad Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersTestMultiNic-1304317170 Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0287e296f1c9414e81fbd0212bde30ad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersTestMultiNic-1304317170 Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 0287e296f1c9414e81fbd0212bde30ad Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersTestMultiNic-1304317170 Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersTestMultiNic-1304317170-project Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 4c5adfbe06184b1e8531545707047456 Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersTestMultiNic-1304317170-project Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'fae77315-a6c0-474c-aef9-5c8edda79113'} Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:11:19.698227 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:19.703335 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:19.703335 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:19.703335 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:19.703335 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:11:19.703335 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:11:19.703335 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. Oct 12 22:11:19.703335 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:19.703335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5302460b-7449-4ee0-a5a7-7cca7324de39 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Returning 404 to user: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:11:19.703335 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5302460b-7449-4ee0-a5a7-7cca7324de39 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 404 len: 111 microversion: 2.1 time: 0.077473 Oct 12 22:11:19.703335 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1342/3031] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:19 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:11:20.170685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-53347398-010b-4e5a-80e8-d92687aaf652 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:20.171339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-53347398-010b-4e5a-80e8-d92687aaf652 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:20.181828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53347398-010b-4e5a-80e8-d92687aaf652 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:20.182434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53347398-010b-4e5a-80e8-d92687aaf652 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:20.188143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53347398-010b-4e5a-80e8-d92687aaf652 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:20.188143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53347398-010b-4e5a-80e8-d92687aaf652 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:20.188143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53347398-010b-4e5a-80e8-d92687aaf652 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:20.188143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53347398-010b-4e5a-80e8-d92687aaf652 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:20.209053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:20.237250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c5807266-a68b-46b4-a04b-d1acb149c25f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:20.246503 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c5807266-a68b-46b4-a04b-d1acb149c25f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1316 microversion: 2.1 time: 0.796936 Oct 12 22:11:20.261890 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1690/3032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:19 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1316 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:20.267306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-c8800c10-0de4-49a0-bf93-dcc52bf5d70e req-a47bf7d8-7f53-43e3-8608-0309fe3f331d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9f516c-739e-45d8-afbb-8cb1402afb48", "tag": "84b34108-a2ff-4c45-8b45-d41cd871c673"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:20.282826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c8800c10-0de4-49a0-bf93-dcc52bf5d70e req-a47bf7d8-7f53-43e3-8608-0309fe3f331d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:20.287143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c8800c10-0de4-49a0-bf93-dcc52bf5d70e req-a47bf7d8-7f53-43e3-8608-0309fe3f331d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:20.288773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c8800c10-0de4-49a0-bf93-dcc52bf5d70e req-a47bf7d8-7f53-43e3-8608-0309fe3f331d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:20.317567 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-c8800c10-0de4-49a0-bf93-dcc52bf5d70e req-a47bf7d8-7f53-43e3-8608-0309fe3f331d service nova] Creating event network-changed:84b34108-a2ff-4c45-8b45-d41cd871c673 for instance dd9f516c-739e-45d8-afbb-8cb1402afb48 on n-h2-861111-1 Oct 12 22:11:20.325951 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-c8800c10-0de4-49a0-bf93-dcc52bf5d70e req-a47bf7d8-7f53-43e3-8608-0309fe3f331d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062469 Oct 12 22:11:20.329900 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1691/3033] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:20.460831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-53347398-010b-4e5a-80e8-d92687aaf652 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:20.483138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ebe1c994-773c-4697-81bd-01bde6cda6b4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:20.484016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ebe1c994-773c-4697-81bd-01bde6cda6b4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:20.487665 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-53347398-010b-4e5a-80e8-d92687aaf652 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1478 microversion: 2.1 time: 0.320723 Oct 12 22:11:20.507211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebe1c994-773c-4697-81bd-01bde6cda6b4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:20.508137 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1343/3034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:20 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1478 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:20.508844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebe1c994-773c-4697-81bd-01bde6cda6b4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:20.509467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebe1c994-773c-4697-81bd-01bde6cda6b4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:20.510480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebe1c994-773c-4697-81bd-01bde6cda6b4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:20.511116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebe1c994-773c-4697-81bd-01bde6cda6b4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:20.511741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebe1c994-773c-4697-81bd-01bde6cda6b4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:20.643925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5e1b688c-cae8-4a6c-ad36-56d3f602a441 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:20.644549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5e1b688c-cae8-4a6c-ad36-56d3f602a441 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:20.658508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e1b688c-cae8-4a6c-ad36-56d3f602a441 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:20.659154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e1b688c-cae8-4a6c-ad36-56d3f602a441 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:20.659636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e1b688c-cae8-4a6c-ad36-56d3f602a441 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:20.660360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e1b688c-cae8-4a6c-ad36-56d3f602a441 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:20.660822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e1b688c-cae8-4a6c-ad36-56d3f602a441 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:20.661253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e1b688c-cae8-4a6c-ad36-56d3f602a441 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:20.743134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ebe1c994-773c-4697-81bd-01bde6cda6b4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:20.758757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ebe1c994-773c-4697-81bd-01bde6cda6b4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:20.760246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ebe1c994-773c-4697-81bd-01bde6cda6b4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:20.781948 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ebe1c994-773c-4697-81bd-01bde6cda6b4 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1537 microversion: 2.91 time: 0.302968 Oct 12 22:11:20.782804 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1692/3035] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:20 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1537 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:11:20.952660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5e1b688c-cae8-4a6c-ad36-56d3f602a441 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:20.981297 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5e1b688c-cae8-4a6c-ad36-56d3f602a441 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1315 microversion: 2.1 time: 0.341116 Oct 12 22:11:20.985266 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1344/3036] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:20 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:21.271652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c111205b-e925-40e4-87e1-368b21ba62b9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:21.272889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c111205b-e925-40e4-87e1-368b21ba62b9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:21.281126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c111205b-e925-40e4-87e1-368b21ba62b9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:21.281996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c111205b-e925-40e4-87e1-368b21ba62b9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:21.282674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c111205b-e925-40e4-87e1-368b21ba62b9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:21.283670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c111205b-e925-40e4-87e1-368b21ba62b9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:21.284484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c111205b-e925-40e4-87e1-368b21ba62b9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:21.285143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c111205b-e925-40e4-87e1-368b21ba62b9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:21.516875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-012883de-ca7b-4f80-a994-25819adff890 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:21.518220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-012883de-ca7b-4f80-a994-25819adff890 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:21.537828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-012883de-ca7b-4f80-a994-25819adff890 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:21.539384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-012883de-ca7b-4f80-a994-25819adff890 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:21.540055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-012883de-ca7b-4f80-a994-25819adff890 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:21.541140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-012883de-ca7b-4f80-a994-25819adff890 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:21.541813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-012883de-ca7b-4f80-a994-25819adff890 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:21.542537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-012883de-ca7b-4f80-a994-25819adff890 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:21.543715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:21.566307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=12 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:21.715296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:21.773425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-012883de-ca7b-4f80-a994-25819adff890 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:21.785102 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-012883de-ca7b-4f80-a994-25819adff890 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1463 microversion: 2.1 time: 0.272941 Oct 12 22:11:21.785703 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1345/3037] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:21 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1463 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:21.819104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-08b2c3a2-9aa8-4add-a38d-279b3ae27121 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:21.820530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-08b2c3a2-9aa8-4add-a38d-279b3ae27121 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:21.827710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08b2c3a2-9aa8-4add-a38d-279b3ae27121 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:21.828480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08b2c3a2-9aa8-4add-a38d-279b3ae27121 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:21.829337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08b2c3a2-9aa8-4add-a38d-279b3ae27121 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:21.830248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08b2c3a2-9aa8-4add-a38d-279b3ae27121 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:21.836169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08b2c3a2-9aa8-4add-a38d-279b3ae27121 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:21.836630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08b2c3a2-9aa8-4add-a38d-279b3ae27121 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:21.896993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08b2c3a2-9aa8-4add-a38d-279b3ae27121 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:21.897728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08b2c3a2-9aa8-4add-a38d-279b3ae27121 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:21.898201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08b2c3a2-9aa8-4add-a38d-279b3ae27121 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:21.898655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-08b2c3a2-9aa8-4add-a38d-279b3ae27121 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lazy-loading 'fault' on Instance uuid c01cd2e8-7dbc-4751-9124-8e46d3181d89 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:11:21.998689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-08b2c3a2-9aa8-4add-a38d-279b3ae27121 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:22.012854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-08b2c3a2-9aa8-4add-a38d-279b3ae27121 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:22.015591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-08b2c3a2-9aa8-4add-a38d-279b3ae27121 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4212d46a7b94dc08e7ddbb470ab3421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d170d367448498af225c015d06295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:22.021564 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-08b2c3a2-9aa8-4add-a38d-279b3ae27121 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 200 len: 1542 microversion: 2.91 time: 0.207389 Oct 12 22:11:22.023615 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1346/3038] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:21 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 1542 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:11:22.030107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f2f052a1-e286-4334-8d60-e6a09dea1337 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:22.036340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c111205b-e925-40e4-87e1-368b21ba62b9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:22.048837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f2f052a1-e286-4334-8d60-e6a09dea1337 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:22.058845 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c111205b-e925-40e4-87e1-368b21ba62b9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1316 microversion: 2.1 time: 0.791759 Oct 12 22:11:22.068353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2f052a1-e286-4334-8d60-e6a09dea1337 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:22.081695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2f052a1-e286-4334-8d60-e6a09dea1337 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:22.084787 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1693/3039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:21 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1316 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:22.086276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2f052a1-e286-4334-8d60-e6a09dea1337 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:22.087211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2f052a1-e286-4334-8d60-e6a09dea1337 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:22.088034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2f052a1-e286-4334-8d60-e6a09dea1337 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:22.090508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2f052a1-e286-4334-8d60-e6a09dea1337 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:22.096451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-836794ff-275e-4682-a479-fcb2fae8877e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:22.097549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-836794ff-275e-4682-a479-fcb2fae8877e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:22.111392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-836794ff-275e-4682-a479-fcb2fae8877e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:22.112122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-836794ff-275e-4682-a479-fcb2fae8877e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:22.112735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-836794ff-275e-4682-a479-fcb2fae8877e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:22.113701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-836794ff-275e-4682-a479-fcb2fae8877e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:22.114565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-836794ff-275e-4682-a479-fcb2fae8877e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:22.115156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-836794ff-275e-4682-a479-fcb2fae8877e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:22.297525 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f2f052a1-e286-4334-8d60-e6a09dea1337 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770/action" status: 202 len: 0 microversion: 2.1 time: 0.272254 Oct 12 22:11:22.298461 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1347/3040] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:11:22 2022] POST /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:11:22.307165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af10f62a-71d3-4325-beae-f1a7ca41006c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:22.308697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-af10f62a-71d3-4325-beae-f1a7ca41006c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:22.323570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af10f62a-71d3-4325-beae-f1a7ca41006c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:22.324737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af10f62a-71d3-4325-beae-f1a7ca41006c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:22.325710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af10f62a-71d3-4325-beae-f1a7ca41006c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:22.326517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af10f62a-71d3-4325-beae-f1a7ca41006c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:22.328888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af10f62a-71d3-4325-beae-f1a7ca41006c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:22.329790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af10f62a-71d3-4325-beae-f1a7ca41006c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:22.504549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-836794ff-275e-4682-a479-fcb2fae8877e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:22.513499 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-836794ff-275e-4682-a479-fcb2fae8877e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1315 microversion: 2.1 time: 0.427512 Oct 12 22:11:22.514237 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1694/3041] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:22 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:22.532148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-986cd3e2-b63b-4b4f-ad70-ce19047ee309 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:22.533095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-986cd3e2-b63b-4b4f-ad70-ce19047ee309 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:22.540125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-986cd3e2-b63b-4b4f-ad70-ce19047ee309 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:22.540928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-986cd3e2-b63b-4b4f-ad70-ce19047ee309 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:22.541546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-986cd3e2-b63b-4b4f-ad70-ce19047ee309 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:22.542593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-986cd3e2-b63b-4b4f-ad70-ce19047ee309 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:22.543295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-986cd3e2-b63b-4b4f-ad70-ce19047ee309 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:22.543960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-986cd3e2-b63b-4b4f-ad70-ce19047ee309 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:22.595474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-986cd3e2-b63b-4b4f-ad70-ce19047ee309 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:22.595961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-986cd3e2-b63b-4b4f-ad70-ce19047ee309 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:22.596424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-986cd3e2-b63b-4b4f-ad70-ce19047ee309 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:22.597082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-986cd3e2-b63b-4b4f-ad70-ce19047ee309 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lazy-loading 'fault' on Instance uuid f3b0eb54-219e-4026-b96c-59b963b0f770 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:11:22.817314 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-986cd3e2-b63b-4b4f-ad70-ce19047ee309 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1597 microversion: 2.1 time: 0.301936 Oct 12 22:11:22.831455 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1695/3042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:22 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1597 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:22.838964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a504fb0d-5803-47b8-a831-bd6577eac18c req-2de97517-43b3-4cc2-9d03-a54c9647eed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55c3cea-33ea-435c-84b3-f668bd000c8c", "tag": "f17c481a-e1dd-4e92-afef-f445e4724b1c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:22.865885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-af10f62a-71d3-4325-beae-f1a7ca41006c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:22.871409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a504fb0d-5803-47b8-a831-bd6577eac18c req-2de97517-43b3-4cc2-9d03-a54c9647eed3 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:22.873113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a504fb0d-5803-47b8-a831-bd6577eac18c req-2de97517-43b3-4cc2-9d03-a54c9647eed3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:22.874264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a504fb0d-5803-47b8-a831-bd6577eac18c req-2de97517-43b3-4cc2-9d03-a54c9647eed3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:22.874898 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-af10f62a-71d3-4325-beae-f1a7ca41006c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1483 microversion: 2.1 time: 0.575213 Oct 12 22:11:22.878331 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1348/3043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:22 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1483 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:22.889302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9e92d5db-8530-4a6a-8941-c590630f26d0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:22.894583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9e92d5db-8530-4a6a-8941-c590630f26d0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:22.899372 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a504fb0d-5803-47b8-a831-bd6577eac18c req-2de97517-43b3-4cc2-9d03-a54c9647eed3 service nova] Creating event network-changed:f17c481a-e1dd-4e92-afef-f445e4724b1c for instance f55c3cea-33ea-435c-84b3-f668bd000c8c on n-h1-861111-1 Oct 12 22:11:22.907036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e92d5db-8530-4a6a-8941-c590630f26d0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:22.908756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e92d5db-8530-4a6a-8941-c590630f26d0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:22.911502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e92d5db-8530-4a6a-8941-c590630f26d0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:22.915421 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a504fb0d-5803-47b8-a831-bd6577eac18c req-2de97517-43b3-4cc2-9d03-a54c9647eed3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092952 Oct 12 22:11:22.915923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e92d5db-8530-4a6a-8941-c590630f26d0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:22.916576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e92d5db-8530-4a6a-8941-c590630f26d0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:22.917178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e92d5db-8530-4a6a-8941-c590630f26d0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:22.920254 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1696/3044] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:23.062715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b010bcd3-c411-43c2-bb8e-88bca4a735f8 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:23.063737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b010bcd3-c411-43c2-bb8e-88bca4a735f8 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] [instance: c01cd2e8-7dbc-4751-9124-8e46d3181d89] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:23.078148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b010bcd3-c411-43c2-bb8e-88bca4a735f8 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:23.078879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b010bcd3-c411-43c2-bb8e-88bca4a735f8 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:23.079450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b010bcd3-c411-43c2-bb8e-88bca4a735f8 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:23.080571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b010bcd3-c411-43c2-bb8e-88bca4a735f8 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:23.081348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b010bcd3-c411-43c2-bb8e-88bca4a735f8 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:23.081938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b010bcd3-c411-43c2-bb8e-88bca4a735f8 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:23.086511 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9e92d5db-8530-4a6a-8941-c590630f26d0 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770/action" status: 202 len: 0 microversion: 2.1 time: 0.205524 Oct 12 22:11:23.090147 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1349/3045] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:11:22 2022] POST /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:11:23.098930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-403f1941-3410-48e2-a007-727b5cee1e89 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:23.099398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-403f1941-3410-48e2-a007-727b5cee1e89 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:23.119119 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-b010bcd3-c411-43c2-bb8e-88bca4a735f8 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] HTTP exception thrown: Instance c01cd2e8-7dbc-4751-9124-8e46d3181d89 could not be found. Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b010bcd3-c411-43c2-bb8e-88bca4a735f8 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Request method failure captured: Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 HTTP/1.1 Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzrTLPAQySGB-8F8WYSoVSQ2vcMoebJPZiFVk0GpAnJkqe0bgxZO1P01m-rqJNjtps0LD2IzXlfeB3aiMpZgm8tKIK9rXNX899Fp2wiw_p6gmWt8MPiINa31ZLVKlRv1PfF5YpCgwT6WMjbdk1p8O8tHzaZ7vyVZzCVAZ1D1txiqd7c Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.91 Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 4d8d170d367448498af225c015d06295 Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1180903294 Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d8d170d367448498af225c015d06295"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d8d170d367448498af225c015d06295"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d8d170d367448498af225c015d06295", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d8d170d367448498af225c015d06295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1180903294 Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 4d8d170d367448498af225c015d06295 Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1180903294 Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-UnshelveToHostMultiNodesTest-1180903294-project Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: e4212d46a7b94dc08e7ddbb470ab3421 Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1180903294-project Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance c01cd2e8-7dbc-4751-9124-8e46d3181d89 could not be found. Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'c01cd2e8-7dbc-4751-9124-8e46d3181d89'} Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c01cd2e8-7dbc-4751-9124-8e46d3181d89 could not be found. Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c01cd2e8-7dbc-4751-9124-8e46d3181d89 could not be found. Oct 12 22:11:23.121111 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:11:23.125272 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:11:23.125272 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:11:23.125272 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:23.125272 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:23.125272 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:23.125272 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:11:23.125272 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:11:23.125272 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c01cd2e8-7dbc-4751-9124-8e46d3181d89 could not be found. Oct 12 22:11:23.125272 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:11:23.125780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-403f1941-3410-48e2-a007-727b5cee1e89 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:23.125780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-403f1941-3410-48e2-a007-727b5cee1e89 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:23.127185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b010bcd3-c411-43c2-bb8e-88bca4a735f8 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] Returning 404 to user: Instance c01cd2e8-7dbc-4751-9124-8e46d3181d89 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:11:23.128169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-403f1941-3410-48e2-a007-727b5cee1e89 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:23.128522 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b010bcd3-c411-43c2-bb8e-88bca4a735f8 tempest-UnshelveToHostMultiNodesTest-1180903294 tempest-UnshelveToHostMultiNodesTest-1180903294-project] 10.222.0.16 "GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89" status: 404 len: 111 microversion: 2.91 time: 0.075804 Oct 12 22:11:23.128955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-403f1941-3410-48e2-a007-727b5cee1e89 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:23.129860 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1697/3046] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:11:23 2022] GET /compute/v2.1/servers/c01cd2e8-7dbc-4751-9124-8e46d3181d89 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 12 22:11:23.133848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-403f1941-3410-48e2-a007-727b5cee1e89 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:23.136598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-403f1941-3410-48e2-a007-727b5cee1e89 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:23.137385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-16c2045e-05c8-4f76-988f-5ff2faa079e1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:23.138214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-16c2045e-05c8-4f76-988f-5ff2faa079e1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:23.144955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16c2045e-05c8-4f76-988f-5ff2faa079e1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:23.145911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16c2045e-05c8-4f76-988f-5ff2faa079e1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:23.146574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16c2045e-05c8-4f76-988f-5ff2faa079e1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:23.148195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16c2045e-05c8-4f76-988f-5ff2faa079e1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:23.148861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16c2045e-05c8-4f76-988f-5ff2faa079e1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:23.149487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16c2045e-05c8-4f76-988f-5ff2faa079e1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:23.346653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-16c2045e-05c8-4f76-988f-5ff2faa079e1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:23.357150 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-16c2045e-05c8-4f76-988f-5ff2faa079e1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1316 microversion: 2.1 time: 0.225848 Oct 12 22:11:23.371299 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1698/3047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:23 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:23.539072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ae710a6e-8619-486f-a5b6-deea0b28e201 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:23.539810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ae710a6e-8619-486f-a5b6-deea0b28e201 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:23.548280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae710a6e-8619-486f-a5b6-deea0b28e201 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:23.551271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae710a6e-8619-486f-a5b6-deea0b28e201 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:23.551813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae710a6e-8619-486f-a5b6-deea0b28e201 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:23.556914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae710a6e-8619-486f-a5b6-deea0b28e201 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:23.557581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae710a6e-8619-486f-a5b6-deea0b28e201 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:23.558109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae710a6e-8619-486f-a5b6-deea0b28e201 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:23.686856 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-403f1941-3410-48e2-a007-727b5cee1e89 tempest-ServersAdminTestJSON-2028110173 tempest-ServersAdminTestJSON-2028110173-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1614 microversion: 2.1 time: 0.595135 Oct 12 22:11:23.689936 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1350/3048] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:23 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1614 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:23.723444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4670681a-c31f-4f55-aada-abe30c266bb1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:23.726639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4670681a-c31f-4f55-aada-abe30c266bb1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:23.743402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4670681a-c31f-4f55-aada-abe30c266bb1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:23.743992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4670681a-c31f-4f55-aada-abe30c266bb1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:23.744515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4670681a-c31f-4f55-aada-abe30c266bb1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:23.746767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4670681a-c31f-4f55-aada-abe30c266bb1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:23.747491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4670681a-c31f-4f55-aada-abe30c266bb1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:23.749104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4670681a-c31f-4f55-aada-abe30c266bb1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:23.823113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4670681a-c31f-4f55-aada-abe30c266bb1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:11:24.039962 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4670681a-c31f-4f55-aada-abe30c266bb1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "DELETE /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68" status: 204 len: 0 microversion: 2.1 time: 0.328135 Oct 12 22:11:24.041190 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1351/3049] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:11:23 2022] DELETE /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:11:24.047472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-01a74883-3f72-46d2-b6fc-9fcedb9e08fd req-e9b299ff-955a-463c-b4f3-2bc373852edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e3560f-1bb0-482f-84cc-fc83097d0327", "name": "network-vif-plugged", "status": "completed", "tag": "e07c76e8-5fc2-4075-ab9c-8bb75eedab89"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:24.059944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-01a74883-3f72-46d2-b6fc-9fcedb9e08fd req-e9b299ff-955a-463c-b4f3-2bc373852edc service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:24.060572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-01a74883-3f72-46d2-b6fc-9fcedb9e08fd req-e9b299ff-955a-463c-b4f3-2bc373852edc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:24.061296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-01a74883-3f72-46d2-b6fc-9fcedb9e08fd req-e9b299ff-955a-463c-b4f3-2bc373852edc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:24.076468 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-01a74883-3f72-46d2-b6fc-9fcedb9e08fd req-e9b299ff-955a-463c-b4f3-2bc373852edc service nova] Creating event network-vif-plugged:e07c76e8-5fc2-4075-ab9c-8bb75eedab89 for instance 73e3560f-1bb0-482f-84cc-fc83097d0327 on n-h1-861111-1 Oct 12 22:11:24.084069 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-01a74883-3f72-46d2-b6fc-9fcedb9e08fd req-e9b299ff-955a-463c-b4f3-2bc373852edc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041011 Oct 12 22:11:24.086311 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1352/3050] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:24.092448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a9649388-7218-4968-9edd-bd929e1fcf67 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:24.093615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a9649388-7218-4968-9edd-bd929e1fcf67 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:24.102122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9649388-7218-4968-9edd-bd929e1fcf67 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:24.102747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9649388-7218-4968-9edd-bd929e1fcf67 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:24.103520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9649388-7218-4968-9edd-bd929e1fcf67 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:24.104319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9649388-7218-4968-9edd-bd929e1fcf67 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:24.105146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9649388-7218-4968-9edd-bd929e1fcf67 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:24.106242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9649388-7218-4968-9edd-bd929e1fcf67 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:24.309161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ae710a6e-8619-486f-a5b6-deea0b28e201 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:24.320625 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ae710a6e-8619-486f-a5b6-deea0b28e201 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1315 microversion: 2.1 time: 0.787114 Oct 12 22:11:24.322271 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1699/3051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:23 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1315 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:24.380907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fa5a3c2c-0b11-4fbf-ab64-db96c72badb9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:24.382297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fa5a3c2c-0b11-4fbf-ab64-db96c72badb9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:24.392962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa5a3c2c-0b11-4fbf-ab64-db96c72badb9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:24.393457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa5a3c2c-0b11-4fbf-ab64-db96c72badb9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:24.393894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa5a3c2c-0b11-4fbf-ab64-db96c72badb9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:24.394604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa5a3c2c-0b11-4fbf-ab64-db96c72badb9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:24.395065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa5a3c2c-0b11-4fbf-ab64-db96c72badb9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:24.395519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa5a3c2c-0b11-4fbf-ab64-db96c72badb9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:24.430985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a9649388-7218-4968-9edd-bd929e1fcf67 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:24.449887 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a9649388-7218-4968-9edd-bd929e1fcf67 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68" status: 200 len: 1469 microversion: 2.1 time: 0.362107 Oct 12 22:11:24.451425 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1353/3052] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:24 2022] GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 => generated 1469 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:24.737091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fa5a3c2c-0b11-4fbf-ab64-db96c72badb9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:24.800712 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fa5a3c2c-0b11-4fbf-ab64-db96c72badb9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1316 microversion: 2.1 time: 0.421671 Oct 12 22:11:24.803858 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1700/3053] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:24 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1316 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:25.346165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5b402896-58f9-47a5-84cb-80fcb81e6810 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:25.347085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5b402896-58f9-47a5-84cb-80fcb81e6810 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:25.356113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b402896-58f9-47a5-84cb-80fcb81e6810 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:25.356627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b402896-58f9-47a5-84cb-80fcb81e6810 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:25.357568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b402896-58f9-47a5-84cb-80fcb81e6810 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:25.358793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b402896-58f9-47a5-84cb-80fcb81e6810 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:25.359490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b402896-58f9-47a5-84cb-80fcb81e6810 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:25.360072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b402896-58f9-47a5-84cb-80fcb81e6810 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:25.474787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-82b01585-7a14-422e-9d52-cc84777ad1f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:25.475978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-82b01585-7a14-422e-9d52-cc84777ad1f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:25.490232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82b01585-7a14-422e-9d52-cc84777ad1f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:25.492126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82b01585-7a14-422e-9d52-cc84777ad1f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:25.492770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82b01585-7a14-422e-9d52-cc84777ad1f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:25.494866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82b01585-7a14-422e-9d52-cc84777ad1f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:25.495532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82b01585-7a14-422e-9d52-cc84777ad1f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:25.496615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82b01585-7a14-422e-9d52-cc84777ad1f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:25.866245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-82b01585-7a14-422e-9d52-cc84777ad1f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:25.889574 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-82b01585-7a14-422e-9d52-cc84777ad1f0 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68" status: 200 len: 1469 microversion: 2.1 time: 0.418564 Oct 12 22:11:25.890999 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1701/3054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:25 2022] GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 => generated 1469 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:25.896428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-40097923-0f71-4dd5-89dd-537659d4c345 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:25.898114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-40097923-0f71-4dd5-89dd-537659d4c345 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:25.905280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40097923-0f71-4dd5-89dd-537659d4c345 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:25.906051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40097923-0f71-4dd5-89dd-537659d4c345 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:25.906676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40097923-0f71-4dd5-89dd-537659d4c345 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:25.907701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40097923-0f71-4dd5-89dd-537659d4c345 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:25.908733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40097923-0f71-4dd5-89dd-537659d4c345 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:25.909353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40097923-0f71-4dd5-89dd-537659d4c345 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:26.262501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5b402896-58f9-47a5-84cb-80fcb81e6810 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:26.273774 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5b402896-58f9-47a5-84cb-80fcb81e6810 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1315 microversion: 2.1 time: 0.928647 Oct 12 22:11:26.274403 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1354/3055] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:25 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1315 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:26.275489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-40097923-0f71-4dd5-89dd-537659d4c345 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:26.295044 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-40097923-0f71-4dd5-89dd-537659d4c345 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1316 microversion: 2.1 time: 0.402072 Oct 12 22:11:26.296391 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1702/3056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:25 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1316 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:26.916081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-626f87c8-b8d6-4bc9-a5ec-90b7f5ed7c70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:26.916703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-626f87c8-b8d6-4bc9-a5ec-90b7f5ed7c70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:26.922875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-626f87c8-b8d6-4bc9-a5ec-90b7f5ed7c70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:26.925938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-626f87c8-b8d6-4bc9-a5ec-90b7f5ed7c70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:26.929426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-626f87c8-b8d6-4bc9-a5ec-90b7f5ed7c70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:26.931667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-626f87c8-b8d6-4bc9-a5ec-90b7f5ed7c70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:26.932818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-626f87c8-b8d6-4bc9-a5ec-90b7f5ed7c70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:26.934681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-626f87c8-b8d6-4bc9-a5ec-90b7f5ed7c70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:27.007420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-83b355ce-3e8f-4767-9e2b-d2a926c68882 req-dc4182b4-2ff1-4941-bf81-d7787f9b063c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f2bfa7-4830-4faa-844f-69e08c861f68", "name": "network-vif-deleted", "tag": "428a0b3d-bd48-4717-b715-5639453998f6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:27.033822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-83b355ce-3e8f-4767-9e2b-d2a926c68882 req-dc4182b4-2ff1-4941-bf81-d7787f9b063c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:27.035694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-83b355ce-3e8f-4767-9e2b-d2a926c68882 req-dc4182b4-2ff1-4941-bf81-d7787f9b063c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:27.036394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-83b355ce-3e8f-4767-9e2b-d2a926c68882 req-dc4182b4-2ff1-4941-bf81-d7787f9b063c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:27.073323 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-83b355ce-3e8f-4767-9e2b-d2a926c68882 req-dc4182b4-2ff1-4941-bf81-d7787f9b063c service nova] Creating event network-vif-deleted:428a0b3d-bd48-4717-b715-5639453998f6 for instance 11f2bfa7-4830-4faa-844f-69e08c861f68 on n-h1-861111-1 Oct 12 22:11:27.092635 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-83b355ce-3e8f-4767-9e2b-d2a926c68882 req-dc4182b4-2ff1-4941-bf81-d7787f9b063c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089470 Oct 12 22:11:27.095253 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1703/3057] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:11:27.134916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-626f87c8-b8d6-4bc9-a5ec-90b7f5ed7c70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:27.150955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:27.162136 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-626f87c8-b8d6-4bc9-a5ec-90b7f5ed7c70 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68" status: 200 len: 1427 microversion: 2.1 time: 0.248105 Oct 12 22:11:27.166651 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1355/3058] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:26 2022] GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 => generated 1427 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:27.302031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f7bb3265-0e85-418f-b5df-eb47408bf7c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:27.302890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f7bb3265-0e85-418f-b5df-eb47408bf7c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:27.321899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a0c039e8-22b8-4abb-a88d-0dd1b8a2d19e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:27.322381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7bb3265-0e85-418f-b5df-eb47408bf7c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:27.322936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7bb3265-0e85-418f-b5df-eb47408bf7c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:27.323415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7bb3265-0e85-418f-b5df-eb47408bf7c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:27.323571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a0c039e8-22b8-4abb-a88d-0dd1b8a2d19e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:27.324163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7bb3265-0e85-418f-b5df-eb47408bf7c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:27.324904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7bb3265-0e85-418f-b5df-eb47408bf7c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:27.329288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7bb3265-0e85-418f-b5df-eb47408bf7c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:27.336939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0c039e8-22b8-4abb-a88d-0dd1b8a2d19e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:27.338215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0c039e8-22b8-4abb-a88d-0dd1b8a2d19e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:27.339060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0c039e8-22b8-4abb-a88d-0dd1b8a2d19e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:27.340204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0c039e8-22b8-4abb-a88d-0dd1b8a2d19e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:27.340322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:27.341033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0c039e8-22b8-4abb-a88d-0dd1b8a2d19e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:27.341863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0c039e8-22b8-4abb-a88d-0dd1b8a2d19e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:27.658493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a0c039e8-22b8-4abb-a88d-0dd1b8a2d19e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:27.669846 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a0c039e8-22b8-4abb-a88d-0dd1b8a2d19e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1316 microversion: 2.1 time: 0.355628 Oct 12 22:11:27.671394 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1356/3059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:27 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:27.752744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f7bb3265-0e85-418f-b5df-eb47408bf7c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:27.765488 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f7bb3265-0e85-418f-b5df-eb47408bf7c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1503 microversion: 2.1 time: 0.467839 Oct 12 22:11:27.766891 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1704/3060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:27 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1503 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:27.795303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cab1a23a-a181-478b-afc6-8eff6b7d1aae tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:27.795927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cab1a23a-a181-478b-afc6-8eff6b7d1aae tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:27.812088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cab1a23a-a181-478b-afc6-8eff6b7d1aae tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:27.814030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cab1a23a-a181-478b-afc6-8eff6b7d1aae tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:27.816877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cab1a23a-a181-478b-afc6-8eff6b7d1aae tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:27.823885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cab1a23a-a181-478b-afc6-8eff6b7d1aae tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:27.824570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cab1a23a-a181-478b-afc6-8eff6b7d1aae tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:27.825082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cab1a23a-a181-478b-afc6-8eff6b7d1aae tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:27.915345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cab1a23a-a181-478b-afc6-8eff6b7d1aae tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:11:28.089960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:28.104001 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cab1a23a-a181-478b-afc6-8eff6b7d1aae tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "DELETE /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 204 len: 0 microversion: 2.1 time: 0.311526 Oct 12 22:11:28.106264 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1357/3061] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:11:27 2022] DELETE /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:11:28.117883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2a1abbe6-e95e-4f62-baab-ae4cbc645d14 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:28.119041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2a1abbe6-e95e-4f62-baab-ae4cbc645d14 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:28.132157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1abbe6-e95e-4f62-baab-ae4cbc645d14 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:28.133945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1abbe6-e95e-4f62-baab-ae4cbc645d14 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:28.137657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1abbe6-e95e-4f62-baab-ae4cbc645d14 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:28.141355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1abbe6-e95e-4f62-baab-ae4cbc645d14 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:28.142240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1abbe6-e95e-4f62-baab-ae4cbc645d14 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:28.142930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1abbe6-e95e-4f62-baab-ae4cbc645d14 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:28.191719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1f2e7846-33f8-448b-8e2e-c4445e1f8776 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:28.192592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1f2e7846-33f8-448b-8e2e-c4445e1f8776 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: 11f2bfa7-4830-4faa-844f-69e08c861f68] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:28.212306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f2e7846-33f8-448b-8e2e-c4445e1f8776 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:28.215381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f2e7846-33f8-448b-8e2e-c4445e1f8776 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:28.219290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f2e7846-33f8-448b-8e2e-c4445e1f8776 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:28.221659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f2e7846-33f8-448b-8e2e-c4445e1f8776 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:28.223883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f2e7846-33f8-448b-8e2e-c4445e1f8776 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:28.224804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f2e7846-33f8-448b-8e2e-c4445e1f8776 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:28.279820 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-1f2e7846-33f8-448b-8e2e-c4445e1f8776 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] HTTP exception thrown: Instance 11f2bfa7-4830-4faa-844f-69e08c861f68 could not be found. Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1f2e7846-33f8-448b-8e2e-c4445e1f8776 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Request method failure captured: Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 HTTP/1.1 Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzsC9uIY3h8wOFE1Id4uT_uH5coBHGtt96bz9q0_Nw4Cg2MIWUW1LgqT-nHv1d2HKAhWxylwq-RJ09aRQjC-yJpzX5O9E5JJ29ZjFan6w8c7npd93_WIGxuCqbz1q4BhF-IqgU8EnyNbbxrX3d7EPGJc0qT5Vc7En5FrAhS1ThYL12Y Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 2963196dad204be0bfb1d9f27f4a1968 Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersAdminTestJSON-524853645 Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2963196dad204be0bfb1d9f27f4a1968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2963196dad204be0bfb1d9f27f4a1968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2963196dad204be0bfb1d9f27f4a1968", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2963196dad204be0bfb1d9f27f4a1968"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersAdminTestJSON-524853645 Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 2963196dad204be0bfb1d9f27f4a1968 Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersAdminTestJSON-524853645 Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersAdminTestJSON-524853645-project Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7d2edcc7683f4df8bca17a3648c4d59b Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersAdminTestJSON-524853645-project Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 11f2bfa7-4830-4faa-844f-69e08c861f68 could not be found. Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '11f2bfa7-4830-4faa-844f-69e08c861f68'} Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11f2bfa7-4830-4faa-844f-69e08c861f68 could not be found. Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11f2bfa7-4830-4faa-844f-69e08c861f68 could not be found. Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:11:28.282919 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:28.289599 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:28.289599 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:28.289599 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:28.289599 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:11:28.289599 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:11:28.289599 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11f2bfa7-4830-4faa-844f-69e08c861f68 could not be found. Oct 12 22:11:28.289599 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:28.292433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1f2e7846-33f8-448b-8e2e-c4445e1f8776 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Returning 404 to user: Instance 11f2bfa7-4830-4faa-844f-69e08c861f68 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:11:28.293971 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1f2e7846-33f8-448b-8e2e-c4445e1f8776 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68" status: 404 len: 111 microversion: 2.1 time: 0.106622 Oct 12 22:11:28.296226 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1358/3062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:28 2022] GET /compute/v2.1/servers/11f2bfa7-4830-4faa-844f-69e08c861f68 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:11:28.310715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-64ac399b-df4b-4172-85a5-5c7a580e2a72 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:28.311317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-64ac399b-df4b-4172-85a5-5c7a580e2a72 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:28.329610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64ac399b-df4b-4172-85a5-5c7a580e2a72 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:28.330308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64ac399b-df4b-4172-85a5-5c7a580e2a72 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:28.331576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64ac399b-df4b-4172-85a5-5c7a580e2a72 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:28.332536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64ac399b-df4b-4172-85a5-5c7a580e2a72 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:28.333804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64ac399b-df4b-4172-85a5-5c7a580e2a72 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:28.334556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64ac399b-df4b-4172-85a5-5c7a580e2a72 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:28.412597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-64ac399b-df4b-4172-85a5-5c7a580e2a72 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:11:28.545586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2a1abbe6-e95e-4f62-baab-ae4cbc645d14 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:28.561691 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2a1abbe6-e95e-4f62-baab-ae4cbc645d14 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1509 microversion: 2.1 time: 0.444384 Oct 12 22:11:28.562335 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1705/3063] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:28 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1509 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:28.659830 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-64ac399b-df4b-4172-85a5-5c7a580e2a72 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 204 len: 0 microversion: 2.1 time: 0.360378 Oct 12 22:11:28.660709 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1359/3064] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:11:28 2022] DELETE /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:11:28.669422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-455a1f52-2a69-4ac1-b745-971a3a8bf087 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:28.670591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-455a1f52-2a69-4ac1-b745-971a3a8bf087 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:28.690840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-455a1f52-2a69-4ac1-b745-971a3a8bf087 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:28.691835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-455a1f52-2a69-4ac1-b745-971a3a8bf087 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:28.692451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-455a1f52-2a69-4ac1-b745-971a3a8bf087 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:28.693359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-455a1f52-2a69-4ac1-b745-971a3a8bf087 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:28.699097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-435c60f4-8fbf-47ec-a0a3-67baeb48140a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:28.699870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-435c60f4-8fbf-47ec-a0a3-67baeb48140a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:28.701290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-455a1f52-2a69-4ac1-b745-971a3a8bf087 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:28.702508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-455a1f52-2a69-4ac1-b745-971a3a8bf087 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:28.716760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-435c60f4-8fbf-47ec-a0a3-67baeb48140a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:28.717312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-435c60f4-8fbf-47ec-a0a3-67baeb48140a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:28.717754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-435c60f4-8fbf-47ec-a0a3-67baeb48140a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:28.718517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-435c60f4-8fbf-47ec-a0a3-67baeb48140a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:28.718974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-435c60f4-8fbf-47ec-a0a3-67baeb48140a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:28.719440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-435c60f4-8fbf-47ec-a0a3-67baeb48140a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:28.974857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-435c60f4-8fbf-47ec-a0a3-67baeb48140a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:28.987444 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-435c60f4-8fbf-47ec-a0a3-67baeb48140a tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1316 microversion: 2.1 time: 0.292848 Oct 12 22:11:29.001506 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1360/3065] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:28 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1316 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:29.028009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-455a1f52-2a69-4ac1-b745-971a3a8bf087 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:29.040154 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-455a1f52-2a69-4ac1-b745-971a3a8bf087 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1468 microversion: 2.1 time: 0.372957 Oct 12 22:11:29.041303 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1706/3066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:28 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1468 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:29.140859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1533277630", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "65c504c5-9368-4c7d-bfc2-4dda1d855be9"}, {"uuid": "cf8cb307-bf75-4008-bd55-9e22c8ff54a7"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:29.223764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] validate_networks() for [('65c504c5-9368-4c7d-bfc2-4dda1d855be9', None, None, None, None, None), ('cf8cb307-bf75-4008-bd55-9e22c8ff54a7', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:11:29.294571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-16998172-28e8-49d4-9280-0877e644ac66 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:29.298312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16998172-28e8-49d4-9280-0877e644ac66 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:29.301497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16998172-28e8-49d4-9280-0877e644ac66 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:29.302171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16998172-28e8-49d4-9280-0877e644ac66 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:29.302936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16998172-28e8-49d4-9280-0877e644ac66 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:29.303466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16998172-28e8-49d4-9280-0877e644ac66 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:29.303902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16998172-28e8-49d4-9280-0877e644ac66 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:29.349769 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-16998172-28e8-49d4-9280-0877e644ac66 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.347890 Oct 12 22:11:29.351022 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1361/3067] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:11:29 2022] GET /compute/v2.1/os-services => generated 944 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:29.364245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4c5f589a-1750-4dc3-91d6-1d665ae252b7 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:29.368707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c5f589a-1750-4dc3-91d6-1d665ae252b7 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:29.369529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c5f589a-1750-4dc3-91d6-1d665ae252b7 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:29.370152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c5f589a-1750-4dc3-91d6-1d665ae252b7 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:29.371172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c5f589a-1750-4dc3-91d6-1d665ae252b7 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:29.372011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c5f589a-1750-4dc3-91d6-1d665ae252b7 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:29.372780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c5f589a-1750-4dc3-91d6-1d665ae252b7 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:29.408065 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4c5f589a-1750-4dc3-91d6-1d665ae252b7 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.047657 Oct 12 22:11:29.409399 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1362/3068] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 12 22:11:29 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:29.424724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7b25a71b-92be-40d3-86d8-157195f13b8f tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:29.429796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b25a71b-92be-40d3-86d8-157195f13b8f tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:29.430563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b25a71b-92be-40d3-86d8-157195f13b8f tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:29.431177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b25a71b-92be-40d3-86d8-157195f13b8f tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:29.433385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b25a71b-92be-40d3-86d8-157195f13b8f tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:29.433731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b25a71b-92be-40d3-86d8-157195f13b8f tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:29.434198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b25a71b-92be-40d3-86d8-157195f13b8f tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:29.467267 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7b25a71b-92be-40d3-86d8-157195f13b8f tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.047363 Oct 12 22:11:29.468203 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1363/3069] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:11:29 2022] GET /compute/v2.1/os-services => generated 944 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:29.481709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fd3b9648-9093-4a98-8324-f242a4334a29 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:29.493037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd3b9648-9093-4a98-8324-f242a4334a29 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:29.494379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd3b9648-9093-4a98-8324-f242a4334a29 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:29.496005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd3b9648-9093-4a98-8324-f242a4334a29 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:29.497630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd3b9648-9093-4a98-8324-f242a4334a29 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:29.498105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd3b9648-9093-4a98-8324-f242a4334a29 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:29.499045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd3b9648-9093-4a98-8324-f242a4334a29 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:29.533564 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fd3b9648-9093-4a98-8324-f242a4334a29 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-861111-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.055843 Oct 12 22:11:29.543084 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1364/3070] 10.222.0.16 () {58 vars in 1194 bytes} [Wed Oct 12 22:11:29 2022] GET /compute/v2.1/os-services?host=n-d-861111-1&binary=xxx => generated 16 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:11:29.556957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1954992e-ebdf-46b1-ac97-4b9e7c77b51e tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:29.561158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1954992e-ebdf-46b1-ac97-4b9e7c77b51e tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:29.561647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1954992e-ebdf-46b1-ac97-4b9e7c77b51e tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:29.562085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1954992e-ebdf-46b1-ac97-4b9e7c77b51e tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:29.562819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1954992e-ebdf-46b1-ac97-4b9e7c77b51e tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:29.563290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1954992e-ebdf-46b1-ac97-4b9e7c77b51e tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:29.563717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1954992e-ebdf-46b1-ac97-4b9e7c77b51e tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:29.602925 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1954992e-ebdf-46b1-ac97-4b9e7c77b51e tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.050576 Oct 12 22:11:29.611628 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1365/3071] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:11:29 2022] GET /compute/v2.1/os-services => generated 944 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:29.638454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7c4eeecd-0d78-4ef0-b407-9434e9aa088b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:29.639402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7c4eeecd-0d78-4ef0-b407-9434e9aa088b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:29.665024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c4eeecd-0d78-4ef0-b407-9434e9aa088b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:29.665525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c4eeecd-0d78-4ef0-b407-9434e9aa088b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:29.665970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c4eeecd-0d78-4ef0-b407-9434e9aa088b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:29.667365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c4eeecd-0d78-4ef0-b407-9434e9aa088b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:29.667785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c4eeecd-0d78-4ef0-b407-9434e9aa088b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:29.668290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c4eeecd-0d78-4ef0-b407-9434e9aa088b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:29.887543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7c4eeecd-0d78-4ef0-b407-9434e9aa088b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:29.903804 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7c4eeecd-0d78-4ef0-b407-9434e9aa088b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1509 microversion: 2.1 time: 0.298603 Oct 12 22:11:29.905869 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1366/3072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:29 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1509 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:29.932721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6aea3954-6dbe-49e9-848f-d9994246eb68 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:29.938831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aea3954-6dbe-49e9-848f-d9994246eb68 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:29.939599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aea3954-6dbe-49e9-848f-d9994246eb68 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:29.940236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aea3954-6dbe-49e9-848f-d9994246eb68 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:29.942069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aea3954-6dbe-49e9-848f-d9994246eb68 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:29.943720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aea3954-6dbe-49e9-848f-d9994246eb68 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:29.945059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aea3954-6dbe-49e9-848f-d9994246eb68 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:30.002478 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6aea3954-6dbe-49e9-848f-d9994246eb68 tempest-ServicesAdminNegativeTestJSON-1592531030 tempest-ServicesAdminNegativeTestJSON-1592531030-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.088622 Oct 12 22:11:30.003281 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1367/3073] 10.222.0.16 () {58 vars in 1198 bytes} [Wed Oct 12 22:11:29 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:11:30.015195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4d4fe3d6-2985-44fa-a4f1-07b026494855 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:30.016576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4d4fe3d6-2985-44fa-a4f1-07b026494855 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:30.028805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d4fe3d6-2985-44fa-a4f1-07b026494855 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:30.029309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d4fe3d6-2985-44fa-a4f1-07b026494855 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:30.029748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d4fe3d6-2985-44fa-a4f1-07b026494855 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:30.030466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d4fe3d6-2985-44fa-a4f1-07b026494855 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:30.030937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d4fe3d6-2985-44fa-a4f1-07b026494855 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:30.031371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d4fe3d6-2985-44fa-a4f1-07b026494855 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:30.321571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4d4fe3d6-2985-44fa-a4f1-07b026494855 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:30.339188 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4d4fe3d6-2985-44fa-a4f1-07b026494855 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1316 microversion: 2.1 time: 0.327818 Oct 12 22:11:30.340391 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1368/3074] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:30 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:30.637971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-828fa0e2-33de-41a6-8a62-6b99ca3d1569 tempest-ServicesAdminNegativeTestJSON-812652141 tempest-ServicesAdminNegativeTestJSON-812652141-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:30.645248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-828fa0e2-33de-41a6-8a62-6b99ca3d1569 tempest-ServicesAdminNegativeTestJSON-812652141 tempest-ServicesAdminNegativeTestJSON-812652141-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e0e4d0cfe69a4d55abd9207b272f8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd3fd947ffa4554ba2137cbbd5993fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-828fa0e2-33de-41a6-8a62-6b99ca3d1569 tempest-ServicesAdminNegativeTestJSON-812652141 tempest-ServicesAdminNegativeTestJSON-812652141-project] Request method failure captured: Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzuPFSNWm_5kI1dGS0TzFgXX2EFevLqSpGGEdeChgqwmFTnT4FpAE04LKIiWl8zanqwj3lphxmb9MDowmF6Y2-1ZMuOfWhz8enQxxyPIUvMjasMVdwgMY2zETpDBR4npsmrRBrUWhu7EPVwUxPEIoyCGVIRhZ-6Z8_0_kz158M191A8 Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 6bd3fd947ffa4554ba2137cbbd5993fa Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-812652141 Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6bd3fd947ffa4554ba2137cbbd5993fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6bd3fd947ffa4554ba2137cbbd5993fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6bd3fd947ffa4554ba2137cbbd5993fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6bd3fd947ffa4554ba2137cbbd5993fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-812652141 Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 6bd3fd947ffa4554ba2137cbbd5993fa Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-812652141 Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServicesAdminNegativeTestJSON-812652141-project Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: e0e4d0cfe69a4d55abd9207b272f8670 Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-812652141-project Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: action_args: {} Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 22:11:30.654831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:30.659777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:11:30.659777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:30.659777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:30.659777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:30.659777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:30.659777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:11:30.659777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:11:30.659777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 22:11:30.659777 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:30.659777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-828fa0e2-33de-41a6-8a62-6b99ca3d1569 tempest-ServicesAdminNegativeTestJSON-812652141 tempest-ServicesAdminNegativeTestJSON-812652141-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:11:30.659777 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-828fa0e2-33de-41a6-8a62-6b99ca3d1569 tempest-ServicesAdminNegativeTestJSON-812652141 tempest-ServicesAdminNegativeTestJSON-812652141-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.317350 Oct 12 22:11:30.659777 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1369/3075] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:11:30 2022] GET /compute/v2.1/os-services => generated 112 bytes in 318 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:11:30.691838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5b512e3f-21a5-4cf8-95fc-7106032c5fc3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:30.692528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5b512e3f-21a5-4cf8-95fc-7106032c5fc3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:30.719860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b512e3f-21a5-4cf8-95fc-7106032c5fc3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:30.722273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b512e3f-21a5-4cf8-95fc-7106032c5fc3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:30.722735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b512e3f-21a5-4cf8-95fc-7106032c5fc3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:30.723568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b512e3f-21a5-4cf8-95fc-7106032c5fc3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:30.728939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b512e3f-21a5-4cf8-95fc-7106032c5fc3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:30.730616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b512e3f-21a5-4cf8-95fc-7106032c5fc3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:31.290219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:11:31.291984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:11:31.292718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:11:31.293355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:11:31.293993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:11:31.312363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:31.312470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:31.312885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:31.313600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:31.314041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:31.324954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:31.368281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Getting quotas for project 0287e296f1c9414e81fbd0212bde30ad. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:11:31.376161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Getting quotas for user 4c5adfbe06184b1e8531545707047456 and project 0287e296f1c9414e81fbd0212bde30ad. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:11:31.405462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:11:31.411178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:11:31.517740 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ab3b44e1-e16b-49a1-9f5d-b1d4ac4a324a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.382397 Oct 12 22:11:31.529318 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1707/3076] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:11:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:11:31.535784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cc533bbe-c828-4d8b-99cf-4153f846466f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:31.536944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cc533bbe-c828-4d8b-99cf-4153f846466f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:31.546774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc533bbe-c828-4d8b-99cf-4153f846466f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:31.550006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc533bbe-c828-4d8b-99cf-4153f846466f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:31.550774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc533bbe-c828-4d8b-99cf-4153f846466f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:31.555581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc533bbe-c828-4d8b-99cf-4153f846466f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:31.557426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc533bbe-c828-4d8b-99cf-4153f846466f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:31.557997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc533bbe-c828-4d8b-99cf-4153f846466f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:31.711721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5b512e3f-21a5-4cf8-95fc-7106032c5fc3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:31.720237 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5b512e3f-21a5-4cf8-95fc-7106032c5fc3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1468 microversion: 2.1 time: 1.051828 Oct 12 22:11:31.726661 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1370/3077] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:30 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1468 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:31.747763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-de3f2e49-3da9-49ba-864d-149311613094 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:31.748378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-de3f2e49-3da9-49ba-864d-149311613094 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:31.775143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de3f2e49-3da9-49ba-864d-149311613094 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:31.775857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de3f2e49-3da9-49ba-864d-149311613094 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:31.777222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de3f2e49-3da9-49ba-864d-149311613094 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:31.782978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de3f2e49-3da9-49ba-864d-149311613094 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:31.783697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de3f2e49-3da9-49ba-864d-149311613094 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:31.784205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de3f2e49-3da9-49ba-864d-149311613094 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:31.977038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cc533bbe-c828-4d8b-99cf-4153f846466f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:31.999837 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cc533bbe-c828-4d8b-99cf-4153f846466f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1509 microversion: 2.1 time: 0.469031 Oct 12 22:11:32.015689 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1708/3078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:31 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1509 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:32.020873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e63318f2-754c-48e8-8cdb-a792cd480c29 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:32.035772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e63318f2-754c-48e8-8cdb-a792cd480c29 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:32.042291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:32.219909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e63318f2-754c-48e8-8cdb-a792cd480c29 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:32.228929 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e63318f2-754c-48e8-8cdb-a792cd480c29 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1213 microversion: 2.1 time: 0.211790 Oct 12 22:11:32.233181 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1709/3079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:32 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1213 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:32.238146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-6a31fa19-ba8f-40a7-bcbd-09b028dad43e req-c36adefb-951b-4a0b-8e89-31347569d3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9f516c-739e-45d8-afbb-8cb1402afb48", "name": "network-vif-plugged", "status": "completed", "tag": "84b34108-a2ff-4c45-8b45-d41cd871c673"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:32.270876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6a31fa19-ba8f-40a7-bcbd-09b028dad43e req-c36adefb-951b-4a0b-8e89-31347569d3c1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:32.272653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6a31fa19-ba8f-40a7-bcbd-09b028dad43e req-c36adefb-951b-4a0b-8e89-31347569d3c1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:32.278019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6a31fa19-ba8f-40a7-bcbd-09b028dad43e req-c36adefb-951b-4a0b-8e89-31347569d3c1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:32.301784 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6a31fa19-ba8f-40a7-bcbd-09b028dad43e req-c36adefb-951b-4a0b-8e89-31347569d3c1 service nova] Creating event network-vif-plugged:84b34108-a2ff-4c45-8b45-d41cd871c673 for instance dd9f516c-739e-45d8-afbb-8cb1402afb48 on n-h2-861111-1 Oct 12 22:11:32.313578 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-6a31fa19-ba8f-40a7-bcbd-09b028dad43e req-c36adefb-951b-4a0b-8e89-31347569d3c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078695 Oct 12 22:11:32.318076 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1710/3080] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:32.750528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3e685173-fe14-497a-9cec-9b427f551130 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:32.751519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3e685173-fe14-497a-9cec-9b427f551130 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:32.770115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e685173-fe14-497a-9cec-9b427f551130 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:32.770884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e685173-fe14-497a-9cec-9b427f551130 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:32.775175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e685173-fe14-497a-9cec-9b427f551130 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:32.784383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e685173-fe14-497a-9cec-9b427f551130 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:32.786244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-de3f2e49-3da9-49ba-864d-149311613094 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:32.787195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e685173-fe14-497a-9cec-9b427f551130 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:32.798253 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-de3f2e49-3da9-49ba-864d-149311613094 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1316 microversion: 2.1 time: 1.069596 Oct 12 22:11:32.799559 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1371/3081] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:31 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1316 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:32.804929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e685173-fe14-497a-9cec-9b427f551130 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:32.876721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-7fb45c56-b86f-479f-b1dc-6ce03619e43b req-be903c9d-bed6-4544-84cf-4deca6d81f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e3560f-1bb0-482f-84cc-fc83097d0327", "name": "network-vif-deleted", "tag": "e07c76e8-5fc2-4075-ab9c-8bb75eedab89"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:32.923540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7fb45c56-b86f-479f-b1dc-6ce03619e43b req-be903c9d-bed6-4544-84cf-4deca6d81f05 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:32.924325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7fb45c56-b86f-479f-b1dc-6ce03619e43b req-be903c9d-bed6-4544-84cf-4deca6d81f05 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:32.924935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7fb45c56-b86f-479f-b1dc-6ce03619e43b req-be903c9d-bed6-4544-84cf-4deca6d81f05 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:32.953437 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-7fb45c56-b86f-479f-b1dc-6ce03619e43b req-be903c9d-bed6-4544-84cf-4deca6d81f05 service nova] Creating event network-vif-deleted:e07c76e8-5fc2-4075-ab9c-8bb75eedab89 for instance 73e3560f-1bb0-482f-84cc-fc83097d0327 on n-h1-861111-1 Oct 12 22:11:32.977036 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-7fb45c56-b86f-479f-b1dc-6ce03619e43b req-be903c9d-bed6-4544-84cf-4deca6d81f05 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104489 Oct 12 22:11:32.980422 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1372/3082] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:33.042400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5f98ef14-9307-4bde-8faf-a603541741f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:33.043336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5f98ef14-9307-4bde-8faf-a603541741f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:33.057326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f98ef14-9307-4bde-8faf-a603541741f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:33.058064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f98ef14-9307-4bde-8faf-a603541741f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:33.058698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f98ef14-9307-4bde-8faf-a603541741f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:33.059768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f98ef14-9307-4bde-8faf-a603541741f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:33.060348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f98ef14-9307-4bde-8faf-a603541741f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:33.060850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f98ef14-9307-4bde-8faf-a603541741f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:33.168562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3e685173-fe14-497a-9cec-9b427f551130 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:33.185506 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3e685173-fe14-497a-9cec-9b427f551130 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1468 microversion: 2.1 time: 0.439126 Oct 12 22:11:33.186478 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1711/3083] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:32 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1468 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:33.207426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f98ef14-9307-4bde-8faf-a603541741f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:33.207933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f98ef14-9307-4bde-8faf-a603541741f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:33.208362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f98ef14-9307-4bde-8faf-a603541741f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:33.208801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-5f98ef14-9307-4bde-8faf-a603541741f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lazy-loading 'fault' on Instance uuid 73e3560f-1bb0-482f-84cc-fc83097d0327 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:11:33.260180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-27c625ee-99b5-42b8-90a5-2bdbc2a71b10 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:33.260801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-27c625ee-99b5-42b8-90a5-2bdbc2a71b10 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:33.272830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27c625ee-99b5-42b8-90a5-2bdbc2a71b10 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:33.280622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27c625ee-99b5-42b8-90a5-2bdbc2a71b10 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:33.281286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27c625ee-99b5-42b8-90a5-2bdbc2a71b10 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:33.281933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27c625ee-99b5-42b8-90a5-2bdbc2a71b10 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:33.282409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27c625ee-99b5-42b8-90a5-2bdbc2a71b10 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:33.282840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27c625ee-99b5-42b8-90a5-2bdbc2a71b10 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:33.357492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5f98ef14-9307-4bde-8faf-a603541741f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:33.373684 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5f98ef14-9307-4bde-8faf-a603541741f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 200 len: 1305 microversion: 2.1 time: 0.335326 Oct 12 22:11:33.376941 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1373/3084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:33 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 1305 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:33.520289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-27c625ee-99b5-42b8-90a5-2bdbc2a71b10 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:33.534647 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-27c625ee-99b5-42b8-90a5-2bdbc2a71b10 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1265 microversion: 2.1 time: 0.279270 Oct 12 22:11:33.547507 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1712/3085] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:33 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:33.823312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b34f9032-d851-4695-9919-ec56d315b2da tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:33.826830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b34f9032-d851-4695-9919-ec56d315b2da tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:33.838750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b34f9032-d851-4695-9919-ec56d315b2da tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:33.839570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b34f9032-d851-4695-9919-ec56d315b2da tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:33.840170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b34f9032-d851-4695-9919-ec56d315b2da tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:33.841083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b34f9032-d851-4695-9919-ec56d315b2da tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:33.841772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b34f9032-d851-4695-9919-ec56d315b2da tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:33.842413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b34f9032-d851-4695-9919-ec56d315b2da tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:34.080535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b34f9032-d851-4695-9919-ec56d315b2da tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:34.092859 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b34f9032-d851-4695-9919-ec56d315b2da tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1316 microversion: 2.1 time: 0.274316 Oct 12 22:11:34.099318 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1374/3086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:33 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:34.213818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-03601490-06fd-48ac-9342-dffb0d6d05c2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:34.213818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-03601490-06fd-48ac-9342-dffb0d6d05c2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:34.241414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03601490-06fd-48ac-9342-dffb0d6d05c2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:34.242035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03601490-06fd-48ac-9342-dffb0d6d05c2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:34.242501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03601490-06fd-48ac-9342-dffb0d6d05c2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:34.243280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03601490-06fd-48ac-9342-dffb0d6d05c2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:34.253320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03601490-06fd-48ac-9342-dffb0d6d05c2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:34.254000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03601490-06fd-48ac-9342-dffb0d6d05c2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:34.337338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03601490-06fd-48ac-9342-dffb0d6d05c2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:34.338193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03601490-06fd-48ac-9342-dffb0d6d05c2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:34.338734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03601490-06fd-48ac-9342-dffb0d6d05c2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:34.339310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-03601490-06fd-48ac-9342-dffb0d6d05c2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lazy-loading 'fault' on Instance uuid f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:11:34.401218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c92d30c2-9d93-41bc-856a-025cc9a7b756 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:34.403339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c92d30c2-9d93-41bc-856a-025cc9a7b756 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:34.411038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c92d30c2-9d93-41bc-856a-025cc9a7b756 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:34.412495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c92d30c2-9d93-41bc-856a-025cc9a7b756 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:34.413185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c92d30c2-9d93-41bc-856a-025cc9a7b756 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:34.414280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c92d30c2-9d93-41bc-856a-025cc9a7b756 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:34.414967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c92d30c2-9d93-41bc-856a-025cc9a7b756 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:34.415526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c92d30c2-9d93-41bc-856a-025cc9a7b756 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:34.421073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:34.438640 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-c92d30c2-9d93-41bc-856a-025cc9a7b756 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c92d30c2-9d93-41bc-856a-025cc9a7b756 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 HTTP/1.1 Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '73e3560f-1bb0-482f-84cc-fc83097d0327'} Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:11:34.441993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:34.446418 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:34.446418 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:34.446418 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:34.446418 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:11:34.446418 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:11:34.446418 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. Oct 12 22:11:34.446418 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:34.446418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c92d30c2-9d93-41bc-856a-025cc9a7b756 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:11:34.446418 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c92d30c2-9d93-41bc-856a-025cc9a7b756 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 404 len: 111 microversion: 2.1 time: 0.049400 Oct 12 22:11:34.448290 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1375/3087] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:34 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:11:34.467943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-03601490-06fd-48ac-9342-dffb0d6d05c2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:34.478854 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-03601490-06fd-48ac-9342-dffb0d6d05c2 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 200 len: 1303 microversion: 2.1 time: 0.272441 Oct 12 22:11:34.479965 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1713/3088] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:34 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 1303 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:34.565503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-02925c34-fea2-45c4-9a9b-1c9509e4bb12 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:34.567639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-02925c34-fea2-45c4-9a9b-1c9509e4bb12 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:34.601186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02925c34-fea2-45c4-9a9b-1c9509e4bb12 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:34.602097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02925c34-fea2-45c4-9a9b-1c9509e4bb12 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:34.603090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02925c34-fea2-45c4-9a9b-1c9509e4bb12 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:34.604316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02925c34-fea2-45c4-9a9b-1c9509e4bb12 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:34.605863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02925c34-fea2-45c4-9a9b-1c9509e4bb12 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:34.610448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02925c34-fea2-45c4-9a9b-1c9509e4bb12 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:34.745932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-24889387", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "8a2bd9d3-e80d-4911-bb4a-296de8e90165"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:34.803987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-02925c34-fea2-45c4-9a9b-1c9509e4bb12 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:34.826443 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-02925c34-fea2-45c4-9a9b-1c9509e4bb12 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1265 microversion: 2.1 time: 0.255333 Oct 12 22:11:34.846584 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1376/3089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:34 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:34.921399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] validate_networks() for [('8a2bd9d3-e80d-4911-bb4a-296de8e90165', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:11:35.000399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-daca58ab-5d76-4197-9bf4-233bfacd0ceb req-44d55394-3a27-4cb8-b21a-5a09136e860e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5", "name": "network-vif-deleted", "tag": "070ca292-679a-4589-8eaf-8faad4f81171"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:35.023395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-daca58ab-5d76-4197-9bf4-233bfacd0ceb req-44d55394-3a27-4cb8-b21a-5a09136e860e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:35.024822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-daca58ab-5d76-4197-9bf4-233bfacd0ceb req-44d55394-3a27-4cb8-b21a-5a09136e860e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:35.026263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-daca58ab-5d76-4197-9bf4-233bfacd0ceb req-44d55394-3a27-4cb8-b21a-5a09136e860e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:35.052620 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-daca58ab-5d76-4197-9bf4-233bfacd0ceb req-44d55394-3a27-4cb8-b21a-5a09136e860e service nova] Creating event network-vif-deleted:070ca292-679a-4589-8eaf-8faad4f81171 for instance f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 on n-h1-861111-1 Oct 12 22:11:35.064595 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-daca58ab-5d76-4197-9bf4-233bfacd0ceb req-44d55394-3a27-4cb8-b21a-5a09136e860e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069253 Oct 12 22:11:35.068243 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1377/3090] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:35.124535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-df9f511d-c9be-4870-88fc-143119a8a8a7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:35.126963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-df9f511d-c9be-4870-88fc-143119a8a8a7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:35.138426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df9f511d-c9be-4870-88fc-143119a8a8a7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:35.141599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df9f511d-c9be-4870-88fc-143119a8a8a7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:35.143731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df9f511d-c9be-4870-88fc-143119a8a8a7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:35.144840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df9f511d-c9be-4870-88fc-143119a8a8a7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:35.146270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df9f511d-c9be-4870-88fc-143119a8a8a7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:35.148641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df9f511d-c9be-4870-88fc-143119a8a8a7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:35.437375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-df9f511d-c9be-4870-88fc-143119a8a8a7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:35.449091 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-df9f511d-c9be-4870-88fc-143119a8a8a7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1466 microversion: 2.1 time: 0.329403 Oct 12 22:11:35.451280 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1378/3091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:35 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1466 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:35.479790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c58d8d23-cb64-4c89-82d9-a1fd00052b35 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:35.480620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c58d8d23-cb64-4c89-82d9-a1fd00052b35 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:35.486976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c58d8d23-cb64-4c89-82d9-a1fd00052b35 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:35.487554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c58d8d23-cb64-4c89-82d9-a1fd00052b35 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:35.488059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c58d8d23-cb64-4c89-82d9-a1fd00052b35 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:35.488996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c58d8d23-cb64-4c89-82d9-a1fd00052b35 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:35.489602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c58d8d23-cb64-4c89-82d9-a1fd00052b35 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:35.490156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c58d8d23-cb64-4c89-82d9-a1fd00052b35 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:35.644445 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c58d8d23-cb64-4c89-82d9-a1fd00052b35 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1617 microversion: 2.1 time: 0.172224 Oct 12 22:11:35.645579 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1379/3092] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:35 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1617 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:35.650796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ba7dd8b2-a501-45c5-913c-a6aa6163f76f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:35.651433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ba7dd8b2-a501-45c5-913c-a6aa6163f76f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:35.657756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba7dd8b2-a501-45c5-913c-a6aa6163f76f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:35.658604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba7dd8b2-a501-45c5-913c-a6aa6163f76f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:35.659303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba7dd8b2-a501-45c5-913c-a6aa6163f76f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:35.660825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba7dd8b2-a501-45c5-913c-a6aa6163f76f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:35.661589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba7dd8b2-a501-45c5-913c-a6aa6163f76f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:35.662284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba7dd8b2-a501-45c5-913c-a6aa6163f76f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:35.688347 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-ba7dd8b2-a501-45c5-913c-a6aa6163f76f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] HTTP exception thrown: Instance f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 could not be found. Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ba7dd8b2-a501-45c5-913c-a6aa6163f76f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Request method failure captured: Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 HTTP/1.1 Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzsC9uIY3h8wOFE1Id4uT_uH5coBHGtt96bz9q0_Nw4Cg2MIWUW1LgqT-nHv1d2HKAhWxylwq-RJ09aRQjC-yJpzX5O9E5JJ29ZjFan6w8c7npd93_WIGxuCqbz1q4BhF-IqgU8EnyNbbxrX3d7EPGJc0qT5Vc7En5FrAhS1ThYL12Y Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 2963196dad204be0bfb1d9f27f4a1968 Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersAdminTestJSON-524853645 Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2963196dad204be0bfb1d9f27f4a1968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2963196dad204be0bfb1d9f27f4a1968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2963196dad204be0bfb1d9f27f4a1968", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2963196dad204be0bfb1d9f27f4a1968"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersAdminTestJSON-524853645 Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 2963196dad204be0bfb1d9f27f4a1968 Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersAdminTestJSON-524853645 Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersAdminTestJSON-524853645-project Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7d2edcc7683f4df8bca17a3648c4d59b Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersAdminTestJSON-524853645-project Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 could not be found. Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5'} Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 could not be found. Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 could not be found. Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:11:35.690222 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:35.693984 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:35.693984 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:35.693984 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:35.693984 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:11:35.693984 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:11:35.693984 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 could not be found. Oct 12 22:11:35.693984 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:35.693984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ba7dd8b2-a501-45c5-913c-a6aa6163f76f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Returning 404 to user: Instance f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:11:35.693984 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ba7dd8b2-a501-45c5-913c-a6aa6163f76f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5" status: 404 len: 111 microversion: 2.1 time: 0.045097 Oct 12 22:11:35.696050 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1380/3093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:35 2022] GET /compute/v2.1/servers/f034e6bb-a356-4d6d-b0dc-b4a07d82fcd5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:11:35.703010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a7c6a7a4-b881-4f22-920e-e74692ce1f58 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:35.703746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a7c6a7a4-b881-4f22-920e-e74692ce1f58 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:35.712151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7c6a7a4-b881-4f22-920e-e74692ce1f58 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:35.712575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7c6a7a4-b881-4f22-920e-e74692ce1f58 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:35.713308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7c6a7a4-b881-4f22-920e-e74692ce1f58 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:35.714017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7c6a7a4-b881-4f22-920e-e74692ce1f58 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:35.714469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7c6a7a4-b881-4f22-920e-e74692ce1f58 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:35.714995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7c6a7a4-b881-4f22-920e-e74692ce1f58 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:35.781460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:11:35.782583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:11:35.783412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:11:35.784058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:11:35.784740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:11:35.804672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:35.805930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:35.806478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:35.807581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:35.808225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:35.809049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:35.831763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Getting quotas for project 4b898b5d0208478e996b7fee2060ed64. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:11:35.838531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Getting quotas for user 11096cece79f4b8fad4b92270f51b299 and project 4b898b5d0208478e996b7fee2060ed64. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:11:35.853268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:11:35.855760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:11:35.905718 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-743b2378-6c07-466f-bdba-596aa090ceda tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.167658 Oct 12 22:11:35.906750 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1714/3094] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:11:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:11:35.914660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-093b654b-11f9-4075-9419-a7b7b93fd62b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:35.915441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-093b654b-11f9-4075-9419-a7b7b93fd62b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:35.923370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-093b654b-11f9-4075-9419-a7b7b93fd62b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:35.924088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-093b654b-11f9-4075-9419-a7b7b93fd62b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:35.924712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-093b654b-11f9-4075-9419-a7b7b93fd62b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:35.925748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-093b654b-11f9-4075-9419-a7b7b93fd62b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:35.926419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-093b654b-11f9-4075-9419-a7b7b93fd62b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:35.927047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-093b654b-11f9-4075-9419-a7b7b93fd62b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:35.962280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-093b654b-11f9-4075-9419-a7b7b93fd62b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:11:35.967508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a7c6a7a4-b881-4f22-920e-e74692ce1f58 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:35.978077 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a7c6a7a4-b881-4f22-920e-e74692ce1f58 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 0.280930 Oct 12 22:11:35.981219 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1381/3095] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:35 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:35.994314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1924259898", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "3c884fd7-d12b-4faa-95e1-96646f21ef60"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:36.086967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:11:36.139906 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-093b654b-11f9-4075-9419-a7b7b93fd62b tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 204 len: 0 microversion: 2.1 time: 0.230930 Oct 12 22:11:36.143758 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1715/3096] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:11:35 2022] DELETE /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:11:36.172603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0fb552d9-6718-4d9a-859a-e17346e79350 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:36.173570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0fb552d9-6718-4d9a-859a-e17346e79350 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:36.181249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0fb552d9-6718-4d9a-859a-e17346e79350 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:36.181954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0fb552d9-6718-4d9a-859a-e17346e79350 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:36.182607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0fb552d9-6718-4d9a-859a-e17346e79350 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:36.183646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0fb552d9-6718-4d9a-859a-e17346e79350 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:36.184581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0fb552d9-6718-4d9a-859a-e17346e79350 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:36.185203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0fb552d9-6718-4d9a-859a-e17346e79350 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:36.272109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0fb552d9-6718-4d9a-859a-e17346e79350 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:36.284592 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0fb552d9-6718-4d9a-859a-e17346e79350 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1271 microversion: 2.1 time: 0.139269 Oct 12 22:11:36.285845 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1716/3097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:36 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1271 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:36.292164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fae40e7c-ec2a-4706-9774-fc887d189ad5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:36.293387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fae40e7c-ec2a-4706-9774-fc887d189ad5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:36.422461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fae40e7c-ec2a-4706-9774-fc887d189ad5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:36.442789 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fae40e7c-ec2a-4706-9774-fc887d189ad5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1213 microversion: 2.1 time: 0.152127 Oct 12 22:11:36.451457 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1717/3098] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:36 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1213 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:36.457777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-271a7614-184f-4cfb-9533-4a3476a983be tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:36.462895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-271a7614-184f-4cfb-9533-4a3476a983be tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:36.474041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-271a7614-184f-4cfb-9533-4a3476a983be tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:36.474506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-271a7614-184f-4cfb-9533-4a3476a983be tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:36.475154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-271a7614-184f-4cfb-9533-4a3476a983be tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:36.476175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-271a7614-184f-4cfb-9533-4a3476a983be tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:36.477219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-271a7614-184f-4cfb-9533-4a3476a983be tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:36.478109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-271a7614-184f-4cfb-9533-4a3476a983be tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:36.548039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:11:36.548712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:11:36.549462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:11:36.550073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:11:36.550699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:11:36.569765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:36.572261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:36.573058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:36.574204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:36.574716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:36.575377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:36.608374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:11:36.620073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Getting quotas for user 7a8e7139c1694698a5fde98743165501 and project 1da6fbca378a43c6b71b9b1b2fa1bc7c. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:11:36.647574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:11:36.650379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:11:36.713770 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a4873c88-78df-4d56-9ece-03d61de227ea tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730868 Oct 12 22:11:36.714872 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1382/3099] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:11:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:11:36.728308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d23d4b6e-743b-466a-a02b-3bcbb5293b6e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:36.729248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d23d4b6e-743b-466a-a02b-3bcbb5293b6e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:36.767399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-271a7614-184f-4cfb-9533-4a3476a983be tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:36.777936 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-271a7614-184f-4cfb-9533-4a3476a983be tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1469 microversion: 2.1 time: 0.324557 Oct 12 22:11:36.779066 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1718/3100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:36 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1469 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:36.893560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d23d4b6e-743b-466a-a02b-3bcbb5293b6e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:36.906543 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d23d4b6e-743b-466a-a02b-3bcbb5293b6e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1217 microversion: 2.1 time: 0.183889 Oct 12 22:11:36.917696 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1383/3101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:36 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1217 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:37.004472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5267581f-36fa-4835-b7df-102a98cb69c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:37.005095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5267581f-36fa-4835-b7df-102a98cb69c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:37.018269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5267581f-36fa-4835-b7df-102a98cb69c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:37.019454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5267581f-36fa-4835-b7df-102a98cb69c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:37.020285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5267581f-36fa-4835-b7df-102a98cb69c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:37.021505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5267581f-36fa-4835-b7df-102a98cb69c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:37.022134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5267581f-36fa-4835-b7df-102a98cb69c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:37.023057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5267581f-36fa-4835-b7df-102a98cb69c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:37.234384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5267581f-36fa-4835-b7df-102a98cb69c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:37.249497 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5267581f-36fa-4835-b7df-102a98cb69c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.248406 Oct 12 22:11:37.267836 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1719/3102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:36 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:37.285963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cc69aaa5-73e3-48a7-a200-f689c9bf3e12 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-191150906"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:37.297527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cc69aaa5-73e3-48a7-a200-f689c9bf3e12 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:37.313911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3d065f0e-9909-4e14-bffe-74a363d72709 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:37.314540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3d065f0e-9909-4e14-bffe-74a363d72709 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:37.322620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc69aaa5-73e3-48a7-a200-f689c9bf3e12 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:37.323497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc69aaa5-73e3-48a7-a200-f689c9bf3e12 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:37.324222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc69aaa5-73e3-48a7-a200-f689c9bf3e12 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:37.325201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc69aaa5-73e3-48a7-a200-f689c9bf3e12 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:37.326091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc69aaa5-73e3-48a7-a200-f689c9bf3e12 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:37.326818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc69aaa5-73e3-48a7-a200-f689c9bf3e12 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:37.338650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d065f0e-9909-4e14-bffe-74a363d72709 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:37.341321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d065f0e-9909-4e14-bffe-74a363d72709 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:37.341876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d065f0e-9909-4e14-bffe-74a363d72709 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:37.343753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d065f0e-9909-4e14-bffe-74a363d72709 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:37.344229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d065f0e-9909-4e14-bffe-74a363d72709 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:37.345928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d065f0e-9909-4e14-bffe-74a363d72709 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:37.723767 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cc69aaa5-73e3-48a7-a200-f689c9bf3e12 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 202 len: 0 microversion: 2.1 time: 0.449073 Oct 12 22:11:37.726922 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1384/3103] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:11:37 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 12 22:11:37.746413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6cbe69d2-e56e-4903-92d5-6e6c9016a204 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:37.749934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6cbe69d2-e56e-4903-92d5-6e6c9016a204 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:37.760896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cbe69d2-e56e-4903-92d5-6e6c9016a204 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:37.763785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cbe69d2-e56e-4903-92d5-6e6c9016a204 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:37.764488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cbe69d2-e56e-4903-92d5-6e6c9016a204 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:37.767172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cbe69d2-e56e-4903-92d5-6e6c9016a204 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:37.768027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cbe69d2-e56e-4903-92d5-6e6c9016a204 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:37.768650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cbe69d2-e56e-4903-92d5-6e6c9016a204 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:37.851311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3d065f0e-9909-4e14-bffe-74a363d72709 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:37.862315 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3d065f0e-9909-4e14-bffe-74a363d72709 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.554384 Oct 12 22:11:37.863273 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1720/3104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:37 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:38.231914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8768f2f4-eac5-42d3-8618-c990da3d59dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:38.233163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8768f2f4-eac5-42d3-8618-c990da3d59dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:38.248136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8768f2f4-eac5-42d3-8618-c990da3d59dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:38.248951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8768f2f4-eac5-42d3-8618-c990da3d59dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:38.249682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8768f2f4-eac5-42d3-8618-c990da3d59dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:38.250597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8768f2f4-eac5-42d3-8618-c990da3d59dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:38.251286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8768f2f4-eac5-42d3-8618-c990da3d59dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:38.252139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8768f2f4-eac5-42d3-8618-c990da3d59dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:38.284544 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8768f2f4-eac5-42d3-8618-c990da3d59dc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/ips" status: 200 len: 150 microversion: 2.1 time: 0.420124 Oct 12 22:11:38.292434 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1721/3105] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 22:11:37 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/ips => generated 150 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:38.299804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6cbe69d2-e56e-4903-92d5-6e6c9016a204 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:38.302519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3e9abf48-c6e4-44f8-ade7-7442d4ca2579 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:38.309500 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6cbe69d2-e56e-4903-92d5-6e6c9016a204 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1265 microversion: 2.1 time: 0.578476 Oct 12 22:11:38.309838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3e9abf48-c6e4-44f8-ade7-7442d4ca2579 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:38.313396 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1385/3106] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:37 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1265 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:38.321216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e9abf48-c6e4-44f8-ade7-7442d4ca2579 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:38.321960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e9abf48-c6e4-44f8-ade7-7442d4ca2579 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:38.322673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e9abf48-c6e4-44f8-ade7-7442d4ca2579 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:38.323710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e9abf48-c6e4-44f8-ade7-7442d4ca2579 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:38.324334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1576c71c-058d-44b1-9823-ec167dfb39e3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:38.327564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1576c71c-058d-44b1-9823-ec167dfb39e3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:38.338679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1576c71c-058d-44b1-9823-ec167dfb39e3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:38.340291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e9abf48-c6e4-44f8-ade7-7442d4ca2579 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:38.340960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e9abf48-c6e4-44f8-ade7-7442d4ca2579 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:38.341692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1576c71c-058d-44b1-9823-ec167dfb39e3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:38.343707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1576c71c-058d-44b1-9823-ec167dfb39e3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:38.344905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1576c71c-058d-44b1-9823-ec167dfb39e3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:38.346539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1576c71c-058d-44b1-9823-ec167dfb39e3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:38.347053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1576c71c-058d-44b1-9823-ec167dfb39e3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:38.884359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3e9abf48-c6e4-44f8-ade7-7442d4ca2579 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:38.905990 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3e9abf48-c6e4-44f8-ade7-7442d4ca2579 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1680 microversion: 2.1 time: 0.610572 Oct 12 22:11:38.909330 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1722/3107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:38 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1680 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:38.941262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fc15fc86-01e7-41e1-8843-c8350145d2e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:38.942014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fc15fc86-01e7-41e1-8843-c8350145d2e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:38.973820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc15fc86-01e7-41e1-8843-c8350145d2e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:38.974317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc15fc86-01e7-41e1-8843-c8350145d2e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:38.974751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc15fc86-01e7-41e1-8843-c8350145d2e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:38.976004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc15fc86-01e7-41e1-8843-c8350145d2e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:38.985591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc15fc86-01e7-41e1-8843-c8350145d2e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:38.986093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc15fc86-01e7-41e1-8843-c8350145d2e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:38.994614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:39.134851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fc15fc86-01e7-41e1-8843-c8350145d2e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:39.146821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1576c71c-058d-44b1-9823-ec167dfb39e3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:39.147741 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fc15fc86-01e7-41e1-8843-c8350145d2e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1269 microversion: 2.1 time: 0.236363 Oct 12 22:11:39.148491 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1723/3108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:38 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1269 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:39.157661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fc875d2c-5773-4882-aa84-79cd91b8241e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:39.160611 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1576c71c-058d-44b1-9823-ec167dfb39e3 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1469 microversion: 2.1 time: 0.845988 Oct 12 22:11:39.161405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fc875d2c-5773-4882-aa84-79cd91b8241e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:39.174019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc875d2c-5773-4882-aa84-79cd91b8241e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:39.174799 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1386/3109] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:38 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1469 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:39.180453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc875d2c-5773-4882-aa84-79cd91b8241e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:39.180914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc875d2c-5773-4882-aa84-79cd91b8241e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:39.181650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc875d2c-5773-4882-aa84-79cd91b8241e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:39.182104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc875d2c-5773-4882-aa84-79cd91b8241e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:39.182519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc875d2c-5773-4882-aa84-79cd91b8241e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:39.309318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-5ecb341e-41f1-47b9-a319-2944dfc5043e req-d62ae630-5b82-4ac2-afc3-159d3cc79fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4023ebba-05d4-4225-938a-c70c2490ae29", "name": "network-vif-unplugged", "status": "completed", "tag": "16f27b0f-2034-49b1-8fc7-d037682a37a4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:39.338870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5ecb341e-41f1-47b9-a319-2944dfc5043e req-d62ae630-5b82-4ac2-afc3-159d3cc79fc1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:39.339427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5ecb341e-41f1-47b9-a319-2944dfc5043e req-d62ae630-5b82-4ac2-afc3-159d3cc79fc1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:39.339877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5ecb341e-41f1-47b9-a319-2944dfc5043e req-d62ae630-5b82-4ac2-afc3-159d3cc79fc1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:39.366738 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-5ecb341e-41f1-47b9-a319-2944dfc5043e req-d62ae630-5b82-4ac2-afc3-159d3cc79fc1 service nova] Creating event network-vif-unplugged:16f27b0f-2034-49b1-8fc7-d037682a37a4 for instance 4023ebba-05d4-4225-938a-c70c2490ae29 on n-h2-861111-1 Oct 12 22:11:39.405185 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-5ecb341e-41f1-47b9-a319-2944dfc5043e req-d62ae630-5b82-4ac2-afc3-159d3cc79fc1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099499 Oct 12 22:11:39.406410 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1387/3110] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:11:39.413082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1e72c119-bc2e-497e-8651-d277b2952f41 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:39.422839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1e72c119-bc2e-497e-8651-d277b2952f41 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:39.445711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e72c119-bc2e-497e-8651-d277b2952f41 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:39.448209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e72c119-bc2e-497e-8651-d277b2952f41 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:39.449020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e72c119-bc2e-497e-8651-d277b2952f41 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:39.461719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e72c119-bc2e-497e-8651-d277b2952f41 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:39.462462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e72c119-bc2e-497e-8651-d277b2952f41 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:39.463075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e72c119-bc2e-497e-8651-d277b2952f41 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:39.661209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fc875d2c-5773-4882-aa84-79cd91b8241e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:39.674768 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fc875d2c-5773-4882-aa84-79cd91b8241e tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.522472 Oct 12 22:11:39.682895 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1724/3111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:39 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:39.695608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-b25ace5d-7d6c-413e-8337-2a4128f3e6b2 req-7cb8bbc1-ea60-4872-bc4a-85de01c36cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "111af739-6af4-48aa-b0c4-2e891131a11c", "tag": "ac1836d2-2559-4a35-9a8d-f73a71674266"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:39.721101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b25ace5d-7d6c-413e-8337-2a4128f3e6b2 req-7cb8bbc1-ea60-4872-bc4a-85de01c36cfd service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:39.726322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b25ace5d-7d6c-413e-8337-2a4128f3e6b2 req-7cb8bbc1-ea60-4872-bc4a-85de01c36cfd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:39.728712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b25ace5d-7d6c-413e-8337-2a4128f3e6b2 req-7cb8bbc1-ea60-4872-bc4a-85de01c36cfd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:39.743905 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-b25ace5d-7d6c-413e-8337-2a4128f3e6b2 req-7cb8bbc1-ea60-4872-bc4a-85de01c36cfd service nova] Creating event network-changed:ac1836d2-2559-4a35-9a8d-f73a71674266 for instance 111af739-6af4-48aa-b0c4-2e891131a11c on n-h2-861111-1 Oct 12 22:11:39.750330 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-b25ace5d-7d6c-413e-8337-2a4128f3e6b2 req-7cb8bbc1-ea60-4872-bc4a-85de01c36cfd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065761 Oct 12 22:11:39.772354 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1725/3112] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:39.889745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1e72c119-bc2e-497e-8651-d277b2952f41 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:39.899452 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1e72c119-bc2e-497e-8651-d277b2952f41 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1271 microversion: 2.1 time: 0.490951 Oct 12 22:11:39.905159 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1388/3113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:39 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1271 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:39.936942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1c34a9ab-b18a-4794-8cb8-8fdadb397487 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:39.938158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1c34a9ab-b18a-4794-8cb8-8fdadb397487 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:39.971892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c34a9ab-b18a-4794-8cb8-8fdadb397487 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:39.972552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c34a9ab-b18a-4794-8cb8-8fdadb397487 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:39.973089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c34a9ab-b18a-4794-8cb8-8fdadb397487 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:39.973894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c34a9ab-b18a-4794-8cb8-8fdadb397487 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:39.978194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c34a9ab-b18a-4794-8cb8-8fdadb397487 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:39.978730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c34a9ab-b18a-4794-8cb8-8fdadb397487 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:40.174702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-02b37f86-d074-42d1-8419-5d090695dac5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:40.186715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-02b37f86-d074-42d1-8419-5d090695dac5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:40.192684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:40.196205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02b37f86-d074-42d1-8419-5d090695dac5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:40.197192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02b37f86-d074-42d1-8419-5d090695dac5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:40.197823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02b37f86-d074-42d1-8419-5d090695dac5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:40.198756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02b37f86-d074-42d1-8419-5d090695dac5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:40.199471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02b37f86-d074-42d1-8419-5d090695dac5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:40.200104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02b37f86-d074-42d1-8419-5d090695dac5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:40.327099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1c34a9ab-b18a-4794-8cb8-8fdadb397487 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:40.343437 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1c34a9ab-b18a-4794-8cb8-8fdadb397487 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1680 microversion: 2.1 time: 0.411577 Oct 12 22:11:40.348572 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1726/3114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:39 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1680 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:40.356693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-07b6f8a9-0243-4451-8a39-a776273dc4db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:40.357473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-07b6f8a9-0243-4451-8a39-a776273dc4db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:40.376173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07b6f8a9-0243-4451-8a39-a776273dc4db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:40.379131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07b6f8a9-0243-4451-8a39-a776273dc4db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:40.379770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07b6f8a9-0243-4451-8a39-a776273dc4db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:40.383558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07b6f8a9-0243-4451-8a39-a776273dc4db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:40.385104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07b6f8a9-0243-4451-8a39-a776273dc4db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:40.386364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07b6f8a9-0243-4451-8a39-a776273dc4db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:40.527054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-07b6f8a9-0243-4451-8a39-a776273dc4db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:40.550539 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-07b6f8a9-0243-4451-8a39-a776273dc4db tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1427 microversion: 2.1 time: 0.200394 Oct 12 22:11:40.551218 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1727/3115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:40 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1427 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:40.640847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-02b37f86-d074-42d1-8419-5d090695dac5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:40.656395 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-02b37f86-d074-42d1-8419-5d090695dac5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1275 microversion: 2.1 time: 0.483521 Oct 12 22:11:40.658144 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1389/3116] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:40 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1275 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:40.707196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a69e9d04-9a50-4802-b690-f6e97138a636 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:40.707637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a69e9d04-9a50-4802-b690-f6e97138a636 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:40.720141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a69e9d04-9a50-4802-b690-f6e97138a636 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:40.720738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a69e9d04-9a50-4802-b690-f6e97138a636 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:40.721194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a69e9d04-9a50-4802-b690-f6e97138a636 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:40.721943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a69e9d04-9a50-4802-b690-f6e97138a636 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:40.722536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a69e9d04-9a50-4802-b690-f6e97138a636 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:40.722980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a69e9d04-9a50-4802-b690-f6e97138a636 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:40.728338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-ec4d0f7d-d044-40ac-964f-d03ae520c6a5 req-36ef4260-9aa2-4a6a-909c-80237d0fc747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b0eb54-219e-4026-b96c-59b963b0f770", "name": "network-vif-deleted", "tag": "72cdcc3a-ba0f-41c3-9bb0-97a69bd68560"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:40.767022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ec4d0f7d-d044-40ac-964f-d03ae520c6a5 req-36ef4260-9aa2-4a6a-909c-80237d0fc747 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:40.770688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ec4d0f7d-d044-40ac-964f-d03ae520c6a5 req-36ef4260-9aa2-4a6a-909c-80237d0fc747 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:40.772667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ec4d0f7d-d044-40ac-964f-d03ae520c6a5 req-36ef4260-9aa2-4a6a-909c-80237d0fc747 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:40.811748 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-ec4d0f7d-d044-40ac-964f-d03ae520c6a5 req-36ef4260-9aa2-4a6a-909c-80237d0fc747 service nova] Creating event network-vif-deleted:72cdcc3a-ba0f-41c3-9bb0-97a69bd68560 for instance f3b0eb54-219e-4026-b96c-59b963b0f770 on n-h1-861111-1 Oct 12 22:11:40.827666 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-ec4d0f7d-d044-40ac-964f-d03ae520c6a5 req-36ef4260-9aa2-4a6a-909c-80237d0fc747 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105516 Oct 12 22:11:40.828981 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1390/3117] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:40.931984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3973dd63-1127-4225-83ed-a1b3c9946603 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:40.932754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3973dd63-1127-4225-83ed-a1b3c9946603 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:40.939216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3973dd63-1127-4225-83ed-a1b3c9946603 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:40.940034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3973dd63-1127-4225-83ed-a1b3c9946603 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:40.940657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3973dd63-1127-4225-83ed-a1b3c9946603 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:40.941518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3973dd63-1127-4225-83ed-a1b3c9946603 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:40.942300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3973dd63-1127-4225-83ed-a1b3c9946603 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:40.943018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3973dd63-1127-4225-83ed-a1b3c9946603 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:40.963291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a69e9d04-9a50-4802-b690-f6e97138a636 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:40.971413 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a69e9d04-9a50-4802-b690-f6e97138a636 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.269189 Oct 12 22:11:40.974176 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1728/3118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:40 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:41.126219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3973dd63-1127-4225-83ed-a1b3c9946603 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:41.129176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fc88848b-2f79-45b3-b4c2-6a244ac2bba3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09c991be-e7ef-40be-90fd-a5bc110fb69f"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:41.133226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fc88848b-2f79-45b3-b4c2-6a244ac2bba3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:41.141024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc88848b-2f79-45b3-b4c2-6a244ac2bba3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:41.141805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc88848b-2f79-45b3-b4c2-6a244ac2bba3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:41.142726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc88848b-2f79-45b3-b4c2-6a244ac2bba3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:41.143735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc88848b-2f79-45b3-b4c2-6a244ac2bba3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:41.144617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc88848b-2f79-45b3-b4c2-6a244ac2bba3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:41.145509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc88848b-2f79-45b3-b4c2-6a244ac2bba3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:41.145861 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3973dd63-1127-4225-83ed-a1b3c9946603 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1271 microversion: 2.1 time: 0.218674 Oct 12 22:11:41.146872 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1391/3119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:40 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1271 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:41.376012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-85ecaf6c-839a-4f7d-aae7-277c08de73d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:41.376801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-85ecaf6c-839a-4f7d-aae7-277c08de73d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:41.383944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85ecaf6c-839a-4f7d-aae7-277c08de73d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:41.384566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85ecaf6c-839a-4f7d-aae7-277c08de73d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:41.385229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85ecaf6c-839a-4f7d-aae7-277c08de73d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:41.386036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85ecaf6c-839a-4f7d-aae7-277c08de73d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:41.386728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85ecaf6c-839a-4f7d-aae7-277c08de73d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:41.387286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85ecaf6c-839a-4f7d-aae7-277c08de73d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:41.438504 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fc88848b-2f79-45b3-b4c2-6a244ac2bba3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "POST /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312531 Oct 12 22:11:41.440246 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1729/3120] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 22:11:41 2022] POST /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:11:41.579924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2b0e08c1-4916-4ed3-adca-0bc477e523c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:41.581095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2b0e08c1-4916-4ed3-adca-0bc477e523c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:41.590307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b0e08c1-4916-4ed3-adca-0bc477e523c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:41.591109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b0e08c1-4916-4ed3-adca-0bc477e523c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:41.591563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b0e08c1-4916-4ed3-adca-0bc477e523c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:41.592292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b0e08c1-4916-4ed3-adca-0bc477e523c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:41.592727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b0e08c1-4916-4ed3-adca-0bc477e523c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:41.593315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b0e08c1-4916-4ed3-adca-0bc477e523c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:41.660779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b0e08c1-4916-4ed3-adca-0bc477e523c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:41.661639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b0e08c1-4916-4ed3-adca-0bc477e523c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:41.662102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b0e08c1-4916-4ed3-adca-0bc477e523c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:41.663143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-2b0e08c1-4916-4ed3-adca-0bc477e523c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lazy-loading 'fault' on Instance uuid f3b0eb54-219e-4026-b96c-59b963b0f770 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:11:41.716396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2b0e08c1-4916-4ed3-adca-0bc477e523c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2edcc7683f4df8bca17a3648c4d59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2963196dad204be0bfb1d9f27f4a1968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:41.724710 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2b0e08c1-4916-4ed3-adca-0bc477e523c1 tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 200 len: 1303 microversion: 2.1 time: 0.151311 Oct 12 22:11:41.725952 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1730/3121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:41 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 1303 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:41.732587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e6eefa54-6d86-498b-8e02-671324389f5c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:41.733441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e6eefa54-6d86-498b-8e02-671324389f5c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:41.740181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6eefa54-6d86-498b-8e02-671324389f5c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:41.740980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6eefa54-6d86-498b-8e02-671324389f5c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:41.741599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6eefa54-6d86-498b-8e02-671324389f5c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:41.742598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6eefa54-6d86-498b-8e02-671324389f5c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:41.743231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6eefa54-6d86-498b-8e02-671324389f5c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:41.743711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6eefa54-6d86-498b-8e02-671324389f5c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:41.815735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e6eefa54-6d86-498b-8e02-671324389f5c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:41.824454 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e6eefa54-6d86-498b-8e02-671324389f5c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1275 microversion: 2.1 time: 0.097039 Oct 12 22:11:41.825107 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1731/3122] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:41 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:41.956906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-18299d3b-c38a-4343-aba5-a6e0b9d67593 req-d38fcd3e-3992-4375-a37b-6ab0c0bf134e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "111af739-6af4-48aa-b0c4-2e891131a11c", "tag": "be7b8151-86c4-44ed-bfe4-84477b980d0a"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:41.968020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-18299d3b-c38a-4343-aba5-a6e0b9d67593 req-d38fcd3e-3992-4375-a37b-6ab0c0bf134e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:41.968531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-18299d3b-c38a-4343-aba5-a6e0b9d67593 req-d38fcd3e-3992-4375-a37b-6ab0c0bf134e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:41.968972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-18299d3b-c38a-4343-aba5-a6e0b9d67593 req-d38fcd3e-3992-4375-a37b-6ab0c0bf134e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:41.981059 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-18299d3b-c38a-4343-aba5-a6e0b9d67593 req-d38fcd3e-3992-4375-a37b-6ab0c0bf134e service nova] Creating event network-changed:be7b8151-86c4-44ed-bfe4-84477b980d0a for instance 111af739-6af4-48aa-b0c4-2e891131a11c on n-h2-861111-1 Oct 12 22:11:41.986317 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-18299d3b-c38a-4343-aba5-a6e0b9d67593 req-d38fcd3e-3992-4375-a37b-6ab0c0bf134e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033261 Oct 12 22:11:41.987102 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1732/3123] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:11:41.996783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c15fc93f-7bf8-4583-be14-2f3125507573 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:41.997648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c15fc93f-7bf8-4583-be14-2f3125507573 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:42.005034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15fc93f-7bf8-4583-be14-2f3125507573 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:42.005696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15fc93f-7bf8-4583-be14-2f3125507573 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:42.006775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15fc93f-7bf8-4583-be14-2f3125507573 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:42.007679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15fc93f-7bf8-4583-be14-2f3125507573 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:42.008287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15fc93f-7bf8-4583-be14-2f3125507573 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:42.008825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15fc93f-7bf8-4583-be14-2f3125507573 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:42.160955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c15fc93f-7bf8-4583-be14-2f3125507573 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:42.172091 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c15fc93f-7bf8-4583-be14-2f3125507573 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.179417 Oct 12 22:11:42.183543 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1733/3124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:41 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:42.188082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-89e245f9-1580-43fa-b725-43894ec98b10 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:42.188816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-89e245f9-1580-43fa-b725-43894ec98b10 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:42.196730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89e245f9-1580-43fa-b725-43894ec98b10 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:42.197738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89e245f9-1580-43fa-b725-43894ec98b10 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:42.198452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89e245f9-1580-43fa-b725-43894ec98b10 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:42.199277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89e245f9-1580-43fa-b725-43894ec98b10 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:42.199863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89e245f9-1580-43fa-b725-43894ec98b10 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:42.200719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89e245f9-1580-43fa-b725-43894ec98b10 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:42.216459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-85ecaf6c-839a-4f7d-aae7-277c08de73d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:42.224304 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-85ecaf6c-839a-4f7d-aae7-277c08de73d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1680 microversion: 2.1 time: 0.852017 Oct 12 22:11:42.239660 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1392/3125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:41 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1680 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:42.274770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-89e245f9-1580-43fa-b725-43894ec98b10 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:42.283585 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-89e245f9-1580-43fa-b725-43894ec98b10 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1271 microversion: 2.1 time: 0.107940 Oct 12 22:11:42.284501 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1734/3126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:42 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:42.751981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-52139ecf-4cf8-47ce-b190-bc06432bbb7f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:42.752790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-52139ecf-4cf8-47ce-b190-bc06432bbb7f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] [instance: f3b0eb54-219e-4026-b96c-59b963b0f770] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:42.763997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52139ecf-4cf8-47ce-b190-bc06432bbb7f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:42.764930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52139ecf-4cf8-47ce-b190-bc06432bbb7f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:42.765593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52139ecf-4cf8-47ce-b190-bc06432bbb7f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:42.766520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52139ecf-4cf8-47ce-b190-bc06432bbb7f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:42.767125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52139ecf-4cf8-47ce-b190-bc06432bbb7f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:42.768096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52139ecf-4cf8-47ce-b190-bc06432bbb7f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:42.784316 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-52139ecf-4cf8-47ce-b190-bc06432bbb7f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] HTTP exception thrown: Instance f3b0eb54-219e-4026-b96c-59b963b0f770 could not be found. Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-52139ecf-4cf8-47ce-b190-bc06432bbb7f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Request method failure captured: Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 HTTP/1.1 Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzsC9uIY3h8wOFE1Id4uT_uH5coBHGtt96bz9q0_Nw4Cg2MIWUW1LgqT-nHv1d2HKAhWxylwq-RJ09aRQjC-yJpzX5O9E5JJ29ZjFan6w8c7npd93_WIGxuCqbz1q4BhF-IqgU8EnyNbbxrX3d7EPGJc0qT5Vc7En5FrAhS1ThYL12Y Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 2963196dad204be0bfb1d9f27f4a1968 Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersAdminTestJSON-524853645 Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2963196dad204be0bfb1d9f27f4a1968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2963196dad204be0bfb1d9f27f4a1968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2963196dad204be0bfb1d9f27f4a1968", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2963196dad204be0bfb1d9f27f4a1968"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersAdminTestJSON-524853645 Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 2963196dad204be0bfb1d9f27f4a1968 Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersAdminTestJSON-524853645 Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersAdminTestJSON-524853645-project Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7d2edcc7683f4df8bca17a3648c4d59b Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersAdminTestJSON-524853645-project Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance f3b0eb54-219e-4026-b96c-59b963b0f770 could not be found. Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'f3b0eb54-219e-4026-b96c-59b963b0f770'} Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3b0eb54-219e-4026-b96c-59b963b0f770 could not be found. Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3b0eb54-219e-4026-b96c-59b963b0f770 could not be found. Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:11:42.786354 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:42.790952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:42.790952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:42.790952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:42.790952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:11:42.790952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:11:42.790952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3b0eb54-219e-4026-b96c-59b963b0f770 could not be found. Oct 12 22:11:42.790952 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:11:42.790952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-52139ecf-4cf8-47ce-b190-bc06432bbb7f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] Returning 404 to user: Instance f3b0eb54-219e-4026-b96c-59b963b0f770 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:11:42.790952 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-52139ecf-4cf8-47ce-b190-bc06432bbb7f tempest-ServersAdminTestJSON-524853645 tempest-ServersAdminTestJSON-524853645-project] 10.222.0.16 "GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770" status: 404 len: 111 microversion: 2.1 time: 0.042236 Oct 12 22:11:42.792307 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1393/3127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:42 2022] GET /compute/v2.1/servers/f3b0eb54-219e-4026-b96c-59b963b0f770 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:11:42.847722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-42429af9-a05b-49bf-82a8-199291ffe84f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:42.848342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-42429af9-a05b-49bf-82a8-199291ffe84f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:42.855544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42429af9-a05b-49bf-82a8-199291ffe84f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:42.856035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42429af9-a05b-49bf-82a8-199291ffe84f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:42.856533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42429af9-a05b-49bf-82a8-199291ffe84f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:42.857443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42429af9-a05b-49bf-82a8-199291ffe84f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:42.862668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42429af9-a05b-49bf-82a8-199291ffe84f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:42.864479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-42429af9-a05b-49bf-82a8-199291ffe84f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:42.989566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-42429af9-a05b-49bf-82a8-199291ffe84f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:43.000506 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-42429af9-a05b-49bf-82a8-199291ffe84f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1275 microversion: 2.1 time: 0.156696 Oct 12 22:11:43.001386 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1735/3128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:42 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1275 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:43.196919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ab5635e1-846f-4115-accb-ab60796be44b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:43.197714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ab5635e1-846f-4115-accb-ab60796be44b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:43.209194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab5635e1-846f-4115-accb-ab60796be44b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:43.212057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab5635e1-846f-4115-accb-ab60796be44b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:43.215991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab5635e1-846f-4115-accb-ab60796be44b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:43.218954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab5635e1-846f-4115-accb-ab60796be44b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:43.220520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab5635e1-846f-4115-accb-ab60796be44b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:43.223560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab5635e1-846f-4115-accb-ab60796be44b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:43.249396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d533a42f-cdcc-4cf7-8530-c608048ad4d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:43.250119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d533a42f-cdcc-4cf7-8530-c608048ad4d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:43.261693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d533a42f-cdcc-4cf7-8530-c608048ad4d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:43.264309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d533a42f-cdcc-4cf7-8530-c608048ad4d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:43.266396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d533a42f-cdcc-4cf7-8530-c608048ad4d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:43.267293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d533a42f-cdcc-4cf7-8530-c608048ad4d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:43.270138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d533a42f-cdcc-4cf7-8530-c608048ad4d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:43.270679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d533a42f-cdcc-4cf7-8530-c608048ad4d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:43.578654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d533a42f-cdcc-4cf7-8530-c608048ad4d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:43.591658 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d533a42f-cdcc-4cf7-8530-c608048ad4d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1688 microversion: 2.1 time: 0.346397 Oct 12 22:11:43.595409 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1736/3129] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:43 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1688 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:43.607947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4bf4c2c0-8cb7-4e7a-9277-769f72b22b3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:43.608595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4bf4c2c0-8cb7-4e7a-9277-769f72b22b3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:43.628153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bf4c2c0-8cb7-4e7a-9277-769f72b22b3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:43.628655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bf4c2c0-8cb7-4e7a-9277-769f72b22b3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:43.629490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bf4c2c0-8cb7-4e7a-9277-769f72b22b3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:43.629836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bf4c2c0-8cb7-4e7a-9277-769f72b22b3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:43.632933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bf4c2c0-8cb7-4e7a-9277-769f72b22b3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:43.633731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bf4c2c0-8cb7-4e7a-9277-769f72b22b3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:43.884972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4bf4c2c0-8cb7-4e7a-9277-769f72b22b3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:43.894431 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4bf4c2c0-8cb7-4e7a-9277-769f72b22b3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1313 microversion: 2.1 time: 0.297810 Oct 12 22:11:43.896389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ab5635e1-846f-4115-accb-ab60796be44b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:43.898623 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1737/3130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:43 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:43.906430 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ab5635e1-846f-4115-accb-ab60796be44b tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.714664 Oct 12 22:11:43.907424 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1394/3131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:43 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:44.035327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-acd2e23f-3d43-4b97-bde3-bc198561c678 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:44.037578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-acd2e23f-3d43-4b97-bde3-bc198561c678 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:44.055429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acd2e23f-3d43-4b97-bde3-bc198561c678 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:44.056033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acd2e23f-3d43-4b97-bde3-bc198561c678 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:44.058121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acd2e23f-3d43-4b97-bde3-bc198561c678 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:44.059904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acd2e23f-3d43-4b97-bde3-bc198561c678 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:44.063589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acd2e23f-3d43-4b97-bde3-bc198561c678 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:44.064135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acd2e23f-3d43-4b97-bde3-bc198561c678 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:44.350554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-acd2e23f-3d43-4b97-bde3-bc198561c678 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:44.359953 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-acd2e23f-3d43-4b97-bde3-bc198561c678 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1317 microversion: 2.1 time: 0.338719 Oct 12 22:11:44.361219 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1738/3132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:44 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:44.623958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c63d7b12-8e75-410f-97c8-11d428925638 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:44.625493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c63d7b12-8e75-410f-97c8-11d428925638 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:44.637372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c63d7b12-8e75-410f-97c8-11d428925638 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:44.638157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c63d7b12-8e75-410f-97c8-11d428925638 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:44.639944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c63d7b12-8e75-410f-97c8-11d428925638 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:44.642854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c63d7b12-8e75-410f-97c8-11d428925638 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:44.644432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c63d7b12-8e75-410f-97c8-11d428925638 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:44.646424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c63d7b12-8e75-410f-97c8-11d428925638 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:44.917971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4a37eb37-6765-4817-b060-bb791c7478c4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:44.919312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4a37eb37-6765-4817-b060-bb791c7478c4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:44.936042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a37eb37-6765-4817-b060-bb791c7478c4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:44.936536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a37eb37-6765-4817-b060-bb791c7478c4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:44.936979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a37eb37-6765-4817-b060-bb791c7478c4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:44.937897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a37eb37-6765-4817-b060-bb791c7478c4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:44.938527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a37eb37-6765-4817-b060-bb791c7478c4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:44.938961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a37eb37-6765-4817-b060-bb791c7478c4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:44.976776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:45.237900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4a37eb37-6765-4817-b060-bb791c7478c4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:45.267216 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4a37eb37-6765-4817-b060-bb791c7478c4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1313 microversion: 2.1 time: 0.352934 Oct 12 22:11:45.271691 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1739/3133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:44 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:45.287819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-30d94d7b-e67e-4335-b806-696e94067748 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:45.289648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-30d94d7b-e67e-4335-b806-696e94067748 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:45.311774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30d94d7b-e67e-4335-b806-696e94067748 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:45.314477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30d94d7b-e67e-4335-b806-696e94067748 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:45.315168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30d94d7b-e67e-4335-b806-696e94067748 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:45.317396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30d94d7b-e67e-4335-b806-696e94067748 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:45.320996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30d94d7b-e67e-4335-b806-696e94067748 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:45.323594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30d94d7b-e67e-4335-b806-696e94067748 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:45.548203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c63d7b12-8e75-410f-97c8-11d428925638 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:45.565496 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c63d7b12-8e75-410f-97c8-11d428925638 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1688 microversion: 2.1 time: 0.945711 Oct 12 22:11:45.579675 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1395/3134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:44 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1688 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:45.588874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fe76f543-b28c-40c0-aa9b-95e500c6c4c5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:45.589741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fe76f543-b28c-40c0-aa9b-95e500c6c4c5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:45.603406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe76f543-b28c-40c0-aa9b-95e500c6c4c5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:45.607905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe76f543-b28c-40c0-aa9b-95e500c6c4c5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:45.608660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe76f543-b28c-40c0-aa9b-95e500c6c4c5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:45.609622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe76f543-b28c-40c0-aa9b-95e500c6c4c5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:45.610249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe76f543-b28c-40c0-aa9b-95e500c6c4c5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:45.610850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe76f543-b28c-40c0-aa9b-95e500c6c4c5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:45.627934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:45.817924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:46.009244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fe76f543-b28c-40c0-aa9b-95e500c6c4c5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:46.020313 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fe76f543-b28c-40c0-aa9b-95e500c6c4c5 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1317 microversion: 2.1 time: 0.438699 Oct 12 22:11:46.039592 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1396/3135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:45 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:46.060519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-2df74ba2-199f-4725-9a4d-75a559008463 req-d2eafe9e-637a-4be4-9b6e-923b2f6d8976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4023ebba-05d4-4225-938a-c70c2490ae29", "name": "network-vif-plugged", "status": "completed", "tag": "16f27b0f-2034-49b1-8fc7-d037682a37a4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:46.075485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2df74ba2-199f-4725-9a4d-75a559008463 req-d2eafe9e-637a-4be4-9b6e-923b2f6d8976 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:46.076228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2df74ba2-199f-4725-9a4d-75a559008463 req-d2eafe9e-637a-4be4-9b6e-923b2f6d8976 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:46.076874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2df74ba2-199f-4725-9a4d-75a559008463 req-d2eafe9e-637a-4be4-9b6e-923b2f6d8976 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:46.427720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=16 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:46.544883 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-2df74ba2-199f-4725-9a4d-75a559008463 req-d2eafe9e-637a-4be4-9b6e-923b2f6d8976 service nova] Creating event network-vif-plugged:16f27b0f-2034-49b1-8fc7-d037682a37a4 for instance 4023ebba-05d4-4225-938a-c70c2490ae29 on n-h2-861111-1 Oct 12 22:11:46.555408 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-2df74ba2-199f-4725-9a4d-75a559008463 req-d2eafe9e-637a-4be4-9b6e-923b2f6d8976 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.511728 Oct 12 22:11:46.556076 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1397/3136] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:46.561562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e18b652f-dacd-4f10-96d7-031310249e70 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:46.562488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e18b652f-dacd-4f10-96d7-031310249e70 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:46.571192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e18b652f-dacd-4f10-96d7-031310249e70 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:46.571953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e18b652f-dacd-4f10-96d7-031310249e70 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:46.572545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e18b652f-dacd-4f10-96d7-031310249e70 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:46.573746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e18b652f-dacd-4f10-96d7-031310249e70 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:46.574507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e18b652f-dacd-4f10-96d7-031310249e70 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:46.575219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e18b652f-dacd-4f10-96d7-031310249e70 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:46.596776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=14 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:46.659426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-30d94d7b-e67e-4335-b806-696e94067748 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:46.672607 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-30d94d7b-e67e-4335-b806-696e94067748 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 1.398324 Oct 12 22:11:46.673379 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1740/3137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:45 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:46.691314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-35b1d253-06c6-4e7c-9593-0a07fbf71b42 req-22a89ccc-dad8-434c-b4d4-219aaccf3752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed4377e1-7ac3-4b36-ad3d-ac212282c090", "tag": "2454e52e-61bf-48dd-91c1-b2016da8e8ef"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:46.709278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-35b1d253-06c6-4e7c-9593-0a07fbf71b42 req-22a89ccc-dad8-434c-b4d4-219aaccf3752 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:46.710458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-35b1d253-06c6-4e7c-9593-0a07fbf71b42 req-22a89ccc-dad8-434c-b4d4-219aaccf3752 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:46.713253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-35b1d253-06c6-4e7c-9593-0a07fbf71b42 req-22a89ccc-dad8-434c-b4d4-219aaccf3752 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:46.738136 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-35b1d253-06c6-4e7c-9593-0a07fbf71b42 req-22a89ccc-dad8-434c-b4d4-219aaccf3752 service nova] Creating event network-changed:2454e52e-61bf-48dd-91c1-b2016da8e8ef for instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 on n-h1-861111-1 Oct 12 22:11:46.749900 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-35b1d253-06c6-4e7c-9593-0a07fbf71b42 req-22a89ccc-dad8-434c-b4d4-219aaccf3752 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074907 Oct 12 22:11:46.752027 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1741/3138] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:46.899193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:46.951576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e18b652f-dacd-4f10-96d7-031310249e70 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:46.961704 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e18b652f-dacd-4f10-96d7-031310249e70 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1313 microversion: 2.1 time: 0.404230 Oct 12 22:11:46.962273 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1398/3139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:46 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:46.979489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dea6a3c8-50ec-4d4d-bb44-710c6410bc55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:46.980111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dea6a3c8-50ec-4d4d-bb44-710c6410bc55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:46.991377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dea6a3c8-50ec-4d4d-bb44-710c6410bc55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:46.992073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dea6a3c8-50ec-4d4d-bb44-710c6410bc55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:47.005194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dea6a3c8-50ec-4d4d-bb44-710c6410bc55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:47.006611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dea6a3c8-50ec-4d4d-bb44-710c6410bc55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:47.007101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dea6a3c8-50ec-4d4d-bb44-710c6410bc55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:47.018160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dea6a3c8-50ec-4d4d-bb44-710c6410bc55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:47.029404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5dedd59e-01ff-483b-b8fc-4b4cba4bc004 tempest-FlavorsV2NegativeTest-1355577216 tempest-FlavorsV2NegativeTest-1355577216-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:47.049285 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5dedd59e-01ff-483b-b8fc-4b4cba4bc004 tempest-FlavorsV2NegativeTest-1355577216 tempest-FlavorsV2NegativeTest-1355577216-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.295718 Oct 12 22:11:47.050376 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1742/3140] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:11:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:47.061336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-06cc0fdd-e31e-4da6-8adb-2d7806e24f49 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:47.064812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-06cc0fdd-e31e-4da6-8adb-2d7806e24f49 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:47.081053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06cc0fdd-e31e-4da6-8adb-2d7806e24f49 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:47.083260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06cc0fdd-e31e-4da6-8adb-2d7806e24f49 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:47.084889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06cc0fdd-e31e-4da6-8adb-2d7806e24f49 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:47.085862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06cc0fdd-e31e-4da6-8adb-2d7806e24f49 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:47.086539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06cc0fdd-e31e-4da6-8adb-2d7806e24f49 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:47.087198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06cc0fdd-e31e-4da6-8adb-2d7806e24f49 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:47.341976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-06cc0fdd-e31e-4da6-8adb-2d7806e24f49 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:47.353194 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-06cc0fdd-e31e-4da6-8adb-2d7806e24f49 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1317 microversion: 2.1 time: 0.301443 Oct 12 22:11:47.353956 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1743/3141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:47 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:47.436714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dea6a3c8-50ec-4d4d-bb44-710c6410bc55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:47.446264 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dea6a3c8-50ec-4d4d-bb44-710c6410bc55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1688 microversion: 2.1 time: 0.482846 Oct 12 22:11:47.450722 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1399/3142] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:46 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1688 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:47.704395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c9e5f7f9-5bd0-4400-bbbe-0c9c03ad8142 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:47.705138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c9e5f7f9-5bd0-4400-bbbe-0c9c03ad8142 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:47.713190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9e5f7f9-5bd0-4400-bbbe-0c9c03ad8142 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:47.727020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9e5f7f9-5bd0-4400-bbbe-0c9c03ad8142 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:47.727509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9e5f7f9-5bd0-4400-bbbe-0c9c03ad8142 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:47.728271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9e5f7f9-5bd0-4400-bbbe-0c9c03ad8142 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:47.728735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9e5f7f9-5bd0-4400-bbbe-0c9c03ad8142 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:47.735894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9e5f7f9-5bd0-4400-bbbe-0c9c03ad8142 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:47.998064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-16c57c64-03d7-42fa-9242-9685ae139362 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:47.998996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-16c57c64-03d7-42fa-9242-9685ae139362 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:48.016504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16c57c64-03d7-42fa-9242-9685ae139362 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:48.017706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16c57c64-03d7-42fa-9242-9685ae139362 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:48.023773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16c57c64-03d7-42fa-9242-9685ae139362 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:48.030737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16c57c64-03d7-42fa-9242-9685ae139362 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:48.035746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16c57c64-03d7-42fa-9242-9685ae139362 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:48.036676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16c57c64-03d7-42fa-9242-9685ae139362 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:48.080779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c9e5f7f9-5bd0-4400-bbbe-0c9c03ad8142 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:48.095602 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c9e5f7f9-5bd0-4400-bbbe-0c9c03ad8142 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.398779 Oct 12 22:11:48.097972 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1744/3143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:47 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:48.154802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ff19d9eb-218f-4864-a728-0e113128484c tempest-FlavorsV2NegativeTest-1355577216 tempest-FlavorsV2NegativeTest-1355577216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1874588574", "imageRef": "94bd44b5-1bfd-4465-8f9b-a9f468123919", "flavorRef": "452"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:48.207285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:48.273374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-ff19d9eb-218f-4864-a728-0e113128484c tempest-FlavorsV2NegativeTest-1355577216 tempest-FlavorsV2NegativeTest-1355577216-project] validate_networks() for None {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:11:48.295974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-16c57c64-03d7-42fa-9242-9685ae139362 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:48.305489 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-16c57c64-03d7-42fa-9242-9685ae139362 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1313 microversion: 2.1 time: 0.319541 Oct 12 22:11:48.308413 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1400/3144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:47 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:48.377193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f6374f29-b84a-442b-88d2-7c986c4177eb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:48.378065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f6374f29-b84a-442b-88d2-7c986c4177eb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:48.384847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6374f29-b84a-442b-88d2-7c986c4177eb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:48.385607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6374f29-b84a-442b-88d2-7c986c4177eb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:48.386242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6374f29-b84a-442b-88d2-7c986c4177eb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:48.387123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6374f29-b84a-442b-88d2-7c986c4177eb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:48.387774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6374f29-b84a-442b-88d2-7c986c4177eb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:48.388257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6374f29-b84a-442b-88d2-7c986c4177eb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:48.539720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f6374f29-b84a-442b-88d2-7c986c4177eb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:48.550909 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f6374f29-b84a-442b-88d2-7c986c4177eb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1317 microversion: 2.1 time: 0.177651 Oct 12 22:11:48.553830 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1401/3145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:48 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:48.560944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8e8f8ae8-f141-42f7-9fbf-0f9f6597923e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:48.562517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8e8f8ae8-f141-42f7-9fbf-0f9f6597923e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:48.570227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e8f8ae8-f141-42f7-9fbf-0f9f6597923e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:48.570945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e8f8ae8-f141-42f7-9fbf-0f9f6597923e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:48.571584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e8f8ae8-f141-42f7-9fbf-0f9f6597923e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:48.572459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e8f8ae8-f141-42f7-9fbf-0f9f6597923e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:48.574169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e8f8ae8-f141-42f7-9fbf-0f9f6597923e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:48.574558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e8f8ae8-f141-42f7-9fbf-0f9f6597923e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:48.642512 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-ff19d9eb-218f-4864-a728-0e113128484c tempest-FlavorsV2NegativeTest-1355577216 tempest-FlavorsV2NegativeTest-1355577216-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ff19d9eb-218f-4864-a728-0e113128484c tempest-FlavorsV2NegativeTest-1355577216 tempest-FlavorsV2NegativeTest-1355577216-project] Request method failure captured: Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 143 Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzuiFByURVdM-yWa_YP4h6t5c8rL2mfCELDIM7X-jZkmsTBiW2d799LEIuambbZFVGlefMwNNHEe7UA8Kpz3vZuZ187nFkJlqqWP6RFj1TpG6VpO7IjxeOhqHs7tct1yU21jxl9Ko1eAQFLdS5uK6vbRDe9hfU7Zv4cJ5SfpvlkN7Kk Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 6533b54ccfc74b6b8e4fae5331acca32 Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FlavorsV2NegativeTest-1355577216 Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6533b54ccfc74b6b8e4fae5331acca32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6533b54ccfc74b6b8e4fae5331acca32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6533b54ccfc74b6b8e4fae5331acca32", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6533b54ccfc74b6b8e4fae5331acca32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FlavorsV2NegativeTest-1355577216 Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 6533b54ccfc74b6b8e4fae5331acca32 Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1355577216 Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FlavorsV2NegativeTest-1355577216-project Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 1dc48a0009b744df8354fc9d9c13947d Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FlavorsV2NegativeTest-1355577216-project Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1874588574", "imageRef": "94bd44b5-1bfd-4465-8f9b-a9f468123919", "flavorRef": "452"}} Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: exception: Flavor's memory is too small for requested image. Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1874588574', 'imageRef': '94bd44b5-1bfd-4465-8f9b-a9f468123919', 'flavorRef': '452'}}} Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:11:48.644881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ff19d9eb-218f-4864-a728-0e113128484c tempest-FlavorsV2NegativeTest-1355577216 tempest-FlavorsV2NegativeTest-1355577216-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ff19d9eb-218f-4864-a728-0e113128484c tempest-FlavorsV2NegativeTest-1355577216 tempest-FlavorsV2NegativeTest-1355577216-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.496325 Oct 12 22:11:48.650117 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1745/3146] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:11:48 2022] POST /compute/v2.1/servers => generated 93 bytes in 499 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:11:48.845694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-077cfdae-717b-4fc0-a7f6-b6598fbbaaff req-c3187901-019c-42be-b893-0b6bee21207a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c60ad5e1-e69b-4dd0-8745-b47ba9b70a02", "tag": "2884f056-6c9a-4429-bf12-6dbf469b39dd"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:48.871813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-077cfdae-717b-4fc0-a7f6-b6598fbbaaff req-c3187901-019c-42be-b893-0b6bee21207a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:48.876593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8e8f8ae8-f141-42f7-9fbf-0f9f6597923e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:48.880505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-077cfdae-717b-4fc0-a7f6-b6598fbbaaff req-c3187901-019c-42be-b893-0b6bee21207a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:48.883156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-077cfdae-717b-4fc0-a7f6-b6598fbbaaff req-c3187901-019c-42be-b893-0b6bee21207a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:48.890834 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8e8f8ae8-f141-42f7-9fbf-0f9f6597923e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1688 microversion: 2.1 time: 0.335598 Oct 12 22:11:48.907652 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1402/3147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:48 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1688 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:48.910569 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-077cfdae-717b-4fc0-a7f6-b6598fbbaaff req-c3187901-019c-42be-b893-0b6bee21207a service nova] Creating event network-changed:2884f056-6c9a-4429-bf12-6dbf469b39dd for instance c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 on n-h1-861111-1 Oct 12 22:11:48.919224 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-077cfdae-717b-4fc0-a7f6-b6598fbbaaff req-c3187901-019c-42be-b893-0b6bee21207a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087170 Oct 12 22:11:48.920486 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1746/3148] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:11:49.121717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-066724e3-2fbc-4e09-be2b-bc6475ff9ddc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:49.123316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-066724e3-2fbc-4e09-be2b-bc6475ff9ddc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:49.151580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066724e3-2fbc-4e09-be2b-bc6475ff9ddc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:49.154147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066724e3-2fbc-4e09-be2b-bc6475ff9ddc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:49.155649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066724e3-2fbc-4e09-be2b-bc6475ff9ddc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:49.156694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066724e3-2fbc-4e09-be2b-bc6475ff9ddc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:49.158843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066724e3-2fbc-4e09-be2b-bc6475ff9ddc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:49.164165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066724e3-2fbc-4e09-be2b-bc6475ff9ddc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:49.335844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-31587ed9-b1ab-4403-8eb1-72d4dea6f844 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:49.336774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-31587ed9-b1ab-4403-8eb1-72d4dea6f844 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:49.351074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31587ed9-b1ab-4403-8eb1-72d4dea6f844 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:49.352034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31587ed9-b1ab-4403-8eb1-72d4dea6f844 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:49.353046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31587ed9-b1ab-4403-8eb1-72d4dea6f844 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:49.354252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31587ed9-b1ab-4403-8eb1-72d4dea6f844 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:49.354926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31587ed9-b1ab-4403-8eb1-72d4dea6f844 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:49.355927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31587ed9-b1ab-4403-8eb1-72d4dea6f844 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:49.691856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-31587ed9-b1ab-4403-8eb1-72d4dea6f844 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:49.709467 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-31587ed9-b1ab-4403-8eb1-72d4dea6f844 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1313 microversion: 2.1 time: 0.379622 Oct 12 22:11:49.710324 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1747/3149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:49 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:49.716810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-54663bab-4e68-46bf-b3c8-e2b1e16fb4c9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:49.720299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-54663bab-4e68-46bf-b3c8-e2b1e16fb4c9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:49.744574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-54663bab-4e68-46bf-b3c8-e2b1e16fb4c9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:49.747502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-54663bab-4e68-46bf-b3c8-e2b1e16fb4c9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:49.749522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-54663bab-4e68-46bf-b3c8-e2b1e16fb4c9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:49.752380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-54663bab-4e68-46bf-b3c8-e2b1e16fb4c9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:49.753545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-54663bab-4e68-46bf-b3c8-e2b1e16fb4c9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:49.754679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-54663bab-4e68-46bf-b3c8-e2b1e16fb4c9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:49.825494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-066724e3-2fbc-4e09-be2b-bc6475ff9ddc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:49.851947 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-066724e3-2fbc-4e09-be2b-bc6475ff9ddc tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.722386 Oct 12 22:11:49.864577 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1403/3150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:49 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:50.067002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-14247191", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "709423db-695b-4953-a10f-b3358d5669f7"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:50.086484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-54663bab-4e68-46bf-b3c8-e2b1e16fb4c9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:50.096615 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-54663bab-4e68-46bf-b3c8-e2b1e16fb4c9 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1317 microversion: 2.1 time: 0.384196 Oct 12 22:11:50.097841 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1748/3151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:49 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:50.103584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d4ef55b8-8b17-457c-b1bd-ef01970c43d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:50.104505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d4ef55b8-8b17-457c-b1bd-ef01970c43d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:50.111775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4ef55b8-8b17-457c-b1bd-ef01970c43d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:50.112555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4ef55b8-8b17-457c-b1bd-ef01970c43d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:50.113208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4ef55b8-8b17-457c-b1bd-ef01970c43d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:50.114236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4ef55b8-8b17-457c-b1bd-ef01970c43d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:50.114901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4ef55b8-8b17-457c-b1bd-ef01970c43d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:50.117158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4ef55b8-8b17-457c-b1bd-ef01970c43d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:50.145339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] validate_networks() for [('709423db-695b-4953-a10f-b3358d5669f7', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:11:50.420480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d4ef55b8-8b17-457c-b1bd-ef01970c43d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:50.433510 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d4ef55b8-8b17-457c-b1bd-ef01970c43d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1688 microversion: 2.1 time: 0.334359 Oct 12 22:11:50.438487 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1749/3152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:50 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1688 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:50.738412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb9b9478-dc05-45dc-8b99-7c71cc9e35f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:50.739114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cb9b9478-dc05-45dc-8b99-7c71cc9e35f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:50.749784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb9b9478-dc05-45dc-8b99-7c71cc9e35f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:50.750509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb9b9478-dc05-45dc-8b99-7c71cc9e35f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:50.751673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb9b9478-dc05-45dc-8b99-7c71cc9e35f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:50.752990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb9b9478-dc05-45dc-8b99-7c71cc9e35f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:50.753685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb9b9478-dc05-45dc-8b99-7c71cc9e35f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:50.754415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb9b9478-dc05-45dc-8b99-7c71cc9e35f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:51.030028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cb9b9478-dc05-45dc-8b99-7c71cc9e35f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:51.041477 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cb9b9478-dc05-45dc-8b99-7c71cc9e35f4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1313 microversion: 2.1 time: 0.306639 Oct 12 22:11:51.054936 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1750/3153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:50 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:51.066508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d348fe51-329a-4d9e-bb06-c01ed89809f0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:51.067523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d348fe51-329a-4d9e-bb06-c01ed89809f0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:51.076059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d348fe51-329a-4d9e-bb06-c01ed89809f0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:51.078149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d348fe51-329a-4d9e-bb06-c01ed89809f0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:51.078834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d348fe51-329a-4d9e-bb06-c01ed89809f0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:51.082080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d348fe51-329a-4d9e-bb06-c01ed89809f0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:51.082848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d348fe51-329a-4d9e-bb06-c01ed89809f0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:51.086155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d348fe51-329a-4d9e-bb06-c01ed89809f0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:51.237993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:11:51.240266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:11:51.241639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:11:51.242630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:11:51.243920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:11:51.269788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:51.271220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:51.274385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:51.276059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:51.277021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:51.278273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:51.298468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d348fe51-329a-4d9e-bb06-c01ed89809f0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:51.306751 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d348fe51-329a-4d9e-bb06-c01ed89809f0 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.246467 Oct 12 22:11:51.308723 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1751/3154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:51 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:51.313476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a0319fe5-f7aa-4070-ba12-11a11ffa15f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:51.315801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a0319fe5-f7aa-4070-ba12-11a11ffa15f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:51.323192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0319fe5-f7aa-4070-ba12-11a11ffa15f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:51.323966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0319fe5-f7aa-4070-ba12-11a11ffa15f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:51.324916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0319fe5-f7aa-4070-ba12-11a11ffa15f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:51.326046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0319fe5-f7aa-4070-ba12-11a11ffa15f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:51.326658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0319fe5-f7aa-4070-ba12-11a11ffa15f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:51.327262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0319fe5-f7aa-4070-ba12-11a11ffa15f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:51.337273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Getting quotas for project b201054c71d241ee8b130a9b0a014cf6. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:11:51.357031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Getting quotas for user 94f72337548c4724bf3f4c1009221120 and project b201054c71d241ee8b130a9b0a014cf6. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:11:51.395766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:11:51.404517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:11:51.562161 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0104ff92-3f41-409d-8080-5d9d439fdb19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.704207 Oct 12 22:11:51.562810 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1404/3155] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:11:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:11:51.565977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a0319fe5-f7aa-4070-ba12-11a11ffa15f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:51.588503 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a0319fe5-f7aa-4070-ba12-11a11ffa15f4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1317 microversion: 2.1 time: 0.278642 Oct 12 22:11:51.590139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f6d35d4a-b72d-4606-b518-f58dddd886d9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:51.590314 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1752/3156] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:51 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:51.603725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a4ae5983-5122-4311-91ec-bd2035656bdb tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:51.609369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f6d35d4a-b72d-4606-b518-f58dddd886d9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:51.611584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a4ae5983-5122-4311-91ec-bd2035656bdb tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:51.659270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6d35d4a-b72d-4606-b518-f58dddd886d9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:51.659270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6d35d4a-b72d-4606-b518-f58dddd886d9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:51.659270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6d35d4a-b72d-4606-b518-f58dddd886d9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:51.659270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6d35d4a-b72d-4606-b518-f58dddd886d9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:51.668458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6d35d4a-b72d-4606-b518-f58dddd886d9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:51.668940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6d35d4a-b72d-4606-b518-f58dddd886d9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:51.787109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a4ae5983-5122-4311-91ec-bd2035656bdb tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:51.795455 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a4ae5983-5122-4311-91ec-bd2035656bdb tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 200 len: 1222 microversion: 2.1 time: 0.203099 Oct 12 22:11:51.796035 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1753/3157] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:51 2022] GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 1222 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:52.069799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c2d48525-1f56-4e12-9fe6-deb4f536ec7a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:52.070722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c2d48525-1f56-4e12-9fe6-deb4f536ec7a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:52.077297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d48525-1f56-4e12-9fe6-deb4f536ec7a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:52.086061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d48525-1f56-4e12-9fe6-deb4f536ec7a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:52.086782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d48525-1f56-4e12-9fe6-deb4f536ec7a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:52.087801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d48525-1f56-4e12-9fe6-deb4f536ec7a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:52.088680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d48525-1f56-4e12-9fe6-deb4f536ec7a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:52.089278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d48525-1f56-4e12-9fe6-deb4f536ec7a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:52.621323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c2d48525-1f56-4e12-9fe6-deb4f536ec7a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:52.635680 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c2d48525-1f56-4e12-9fe6-deb4f536ec7a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1313 microversion: 2.1 time: 0.570403 Oct 12 22:11:52.641322 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1754/3158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:52 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1313 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:52.655760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af8615bf-3794-4a5d-bea6-2fada4025580 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:52.663548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-af8615bf-3794-4a5d-bea6-2fada4025580 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:52.676528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af8615bf-3794-4a5d-bea6-2fada4025580 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:52.677397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af8615bf-3794-4a5d-bea6-2fada4025580 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:52.681391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af8615bf-3794-4a5d-bea6-2fada4025580 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:52.686145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af8615bf-3794-4a5d-bea6-2fada4025580 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:52.690694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af8615bf-3794-4a5d-bea6-2fada4025580 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:52.693594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af8615bf-3794-4a5d-bea6-2fada4025580 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:52.991918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-af8615bf-3794-4a5d-bea6-2fada4025580 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:53.000921 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-af8615bf-3794-4a5d-bea6-2fada4025580 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.358042 Oct 12 22:11:53.003890 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1755/3159] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:52 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:53.011784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ece6f7dc-e553-4480-a711-4289c5c36eab tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:53.016041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ece6f7dc-e553-4480-a711-4289c5c36eab tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:53.028878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ece6f7dc-e553-4480-a711-4289c5c36eab tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:53.031742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ece6f7dc-e553-4480-a711-4289c5c36eab tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:53.033522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ece6f7dc-e553-4480-a711-4289c5c36eab tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:53.034622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ece6f7dc-e553-4480-a711-4289c5c36eab tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:53.039574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ece6f7dc-e553-4480-a711-4289c5c36eab tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:53.040245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ece6f7dc-e553-4480-a711-4289c5c36eab tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:53.184055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f6d35d4a-b72d-4606-b518-f58dddd886d9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:53.198774 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f6d35d4a-b72d-4606-b518-f58dddd886d9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 1.628451 Oct 12 22:11:53.199994 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1405/3160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:51 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:53.214050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3dd6728e-911d-41c6-af57-dd98c7fd736d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:53.220966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3dd6728e-911d-41c6-af57-dd98c7fd736d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:53.234028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3dd6728e-911d-41c6-af57-dd98c7fd736d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:53.234518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3dd6728e-911d-41c6-af57-dd98c7fd736d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:53.234969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3dd6728e-911d-41c6-af57-dd98c7fd736d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:53.243337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3dd6728e-911d-41c6-af57-dd98c7fd736d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:53.244071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3dd6728e-911d-41c6-af57-dd98c7fd736d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:53.244528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3dd6728e-911d-41c6-af57-dd98c7fd736d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:53.431664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3dd6728e-911d-41c6-af57-dd98c7fd736d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:53.447962 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3dd6728e-911d-41c6-af57-dd98c7fd736d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 200 len: 1274 microversion: 2.1 time: 0.246333 Oct 12 22:11:53.450104 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1406/3161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:53 2022] GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 1274 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:53.670336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c9be739a-89bc-4ef9-bcc1-b2502e8eb42f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:53.671795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c9be739a-89bc-4ef9-bcc1-b2502e8eb42f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:53.684539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9be739a-89bc-4ef9-bcc1-b2502e8eb42f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:53.685121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9be739a-89bc-4ef9-bcc1-b2502e8eb42f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:53.685648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9be739a-89bc-4ef9-bcc1-b2502e8eb42f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:53.687933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9be739a-89bc-4ef9-bcc1-b2502e8eb42f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:53.688413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9be739a-89bc-4ef9-bcc1-b2502e8eb42f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:53.688859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9be739a-89bc-4ef9-bcc1-b2502e8eb42f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:53.689464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ece6f7dc-e553-4480-a711-4289c5c36eab tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:53.718817 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ece6f7dc-e553-4480-a711-4289c5c36eab tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1317 microversion: 2.1 time: 0.709566 Oct 12 22:11:53.719457 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1756/3162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:53 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1317 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:54.026472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e812ace2-cb3f-4dea-a203-ca56d1bde3f5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:54.027088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e812ace2-cb3f-4dea-a203-ca56d1bde3f5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:54.055796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e812ace2-cb3f-4dea-a203-ca56d1bde3f5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:54.056797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e812ace2-cb3f-4dea-a203-ca56d1bde3f5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:54.059571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e812ace2-cb3f-4dea-a203-ca56d1bde3f5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:54.063474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e812ace2-cb3f-4dea-a203-ca56d1bde3f5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:54.064006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e812ace2-cb3f-4dea-a203-ca56d1bde3f5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:54.066191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e812ace2-cb3f-4dea-a203-ca56d1bde3f5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:54.368610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c9be739a-89bc-4ef9-bcc1-b2502e8eb42f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:54.376881 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c9be739a-89bc-4ef9-bcc1-b2502e8eb42f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1313 microversion: 2.1 time: 0.711384 Oct 12 22:11:54.377552 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1407/3163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:53 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1313 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:54.402022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b9618d0a-72a1-4bc0-8669-8cf4b403c6cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:54.402411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b9618d0a-72a1-4bc0-8669-8cf4b403c6cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:54.414004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9618d0a-72a1-4bc0-8669-8cf4b403c6cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:54.414650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9618d0a-72a1-4bc0-8669-8cf4b403c6cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:54.415449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9618d0a-72a1-4bc0-8669-8cf4b403c6cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:54.416608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9618d0a-72a1-4bc0-8669-8cf4b403c6cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:54.417329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9618d0a-72a1-4bc0-8669-8cf4b403c6cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:54.418213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9618d0a-72a1-4bc0-8669-8cf4b403c6cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:54.587668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e812ace2-cb3f-4dea-a203-ca56d1bde3f5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:54.599023 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e812ace2-cb3f-4dea-a203-ca56d1bde3f5 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.576275 Oct 12 22:11:54.602410 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1757/3164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:54 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:54.616190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b52925a5-8186-4e6d-b4f0-ada74f2f2388 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:54.618104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b52925a5-8186-4e6d-b4f0-ada74f2f2388 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:54.639991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b52925a5-8186-4e6d-b4f0-ada74f2f2388 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:54.642255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b52925a5-8186-4e6d-b4f0-ada74f2f2388 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:54.643049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b52925a5-8186-4e6d-b4f0-ada74f2f2388 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:54.645928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b52925a5-8186-4e6d-b4f0-ada74f2f2388 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:54.647545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b52925a5-8186-4e6d-b4f0-ada74f2f2388 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:54.648833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b52925a5-8186-4e6d-b4f0-ada74f2f2388 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:54.829057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b52925a5-8186-4e6d-b4f0-ada74f2f2388 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:54.843570 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b52925a5-8186-4e6d-b4f0-ada74f2f2388 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 200 len: 1280 microversion: 2.1 time: 0.238293 Oct 12 22:11:54.844535 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1758/3165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:54 2022] GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 1280 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:54.856437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ecd71aa6-3b3e-41f0-9552-c0435fcf8a4d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:54.858486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ecd71aa6-3b3e-41f0-9552-c0435fcf8a4d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:54.871945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecd71aa6-3b3e-41f0-9552-c0435fcf8a4d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:54.874688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecd71aa6-3b3e-41f0-9552-c0435fcf8a4d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:54.876579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecd71aa6-3b3e-41f0-9552-c0435fcf8a4d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:54.877629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecd71aa6-3b3e-41f0-9552-c0435fcf8a4d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:54.879641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecd71aa6-3b3e-41f0-9552-c0435fcf8a4d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:54.882030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecd71aa6-3b3e-41f0-9552-c0435fcf8a4d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:54.909846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b9618d0a-72a1-4bc0-8669-8cf4b403c6cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:54.926738 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b9618d0a-72a1-4bc0-8669-8cf4b403c6cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 0.542055 Oct 12 22:11:54.929909 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1408/3166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:54 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:55.220779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ecd71aa6-3b3e-41f0-9552-c0435fcf8a4d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:55.233767 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ecd71aa6-3b3e-41f0-9552-c0435fcf8a4d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1317 microversion: 2.1 time: 0.385272 Oct 12 22:11:55.246183 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1759/3167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:54 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:55.406646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5a712705-73a4-4b67-bfb3-6c0d36b0ba90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:55.407357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5a712705-73a4-4b67-bfb3-6c0d36b0ba90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:55.421702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a712705-73a4-4b67-bfb3-6c0d36b0ba90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:55.422211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a712705-73a4-4b67-bfb3-6c0d36b0ba90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:55.422661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a712705-73a4-4b67-bfb3-6c0d36b0ba90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:55.423570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a712705-73a4-4b67-bfb3-6c0d36b0ba90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:55.425762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a712705-73a4-4b67-bfb3-6c0d36b0ba90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:55.428126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a712705-73a4-4b67-bfb3-6c0d36b0ba90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:55.629311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4d8cf222-5744-4b71-9a17-30bea63ef853 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:55.630353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4d8cf222-5744-4b71-9a17-30bea63ef853 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:55.642927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d8cf222-5744-4b71-9a17-30bea63ef853 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:55.645645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d8cf222-5744-4b71-9a17-30bea63ef853 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:55.647622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d8cf222-5744-4b71-9a17-30bea63ef853 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:55.650504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d8cf222-5744-4b71-9a17-30bea63ef853 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:55.651185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d8cf222-5744-4b71-9a17-30bea63ef853 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:55.651805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d8cf222-5744-4b71-9a17-30bea63ef853 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:55.692704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:55.809943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5a712705-73a4-4b67-bfb3-6c0d36b0ba90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:55.824789 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5a712705-73a4-4b67-bfb3-6c0d36b0ba90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1313 microversion: 2.1 time: 0.422114 Oct 12 22:11:55.826243 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1409/3168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:55 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:55.872505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-448893cd-09f8-4755-9dfd-7dd993985ca8 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:55.873483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-448893cd-09f8-4755-9dfd-7dd993985ca8 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:55.881483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-448893cd-09f8-4755-9dfd-7dd993985ca8 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:55.885213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-448893cd-09f8-4755-9dfd-7dd993985ca8 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:55.885778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-448893cd-09f8-4755-9dfd-7dd993985ca8 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:55.886735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-448893cd-09f8-4755-9dfd-7dd993985ca8 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:55.887430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-448893cd-09f8-4755-9dfd-7dd993985ca8 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:55.890868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-448893cd-09f8-4755-9dfd-7dd993985ca8 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:56.042594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4d8cf222-5744-4b71-9a17-30bea63ef853 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:56.061450 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4d8cf222-5744-4b71-9a17-30bea63ef853 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.433621 Oct 12 22:11:56.064800 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1760/3169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:55 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:56.083389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-103b57e6-ee32-40fa-b917-23edceff8bae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:56.084674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-103b57e6-ee32-40fa-b917-23edceff8bae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:56.107905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-103b57e6-ee32-40fa-b917-23edceff8bae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:56.108416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-103b57e6-ee32-40fa-b917-23edceff8bae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:56.108865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-103b57e6-ee32-40fa-b917-23edceff8bae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:56.109706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-103b57e6-ee32-40fa-b917-23edceff8bae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:56.110019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-103b57e6-ee32-40fa-b917-23edceff8bae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:56.110449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-103b57e6-ee32-40fa-b917-23edceff8bae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:56.342662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-103b57e6-ee32-40fa-b917-23edceff8bae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:56.360604 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-103b57e6-ee32-40fa-b917-23edceff8bae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 0.291580 Oct 12 22:11:56.361238 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1761/3170] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:56 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:56.371422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-26455724-dd2c-43c5-a491-9885b80a08e5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09c991be-e7ef-40be-90fd-a5bc110fb69f"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:56.376980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-26455724-dd2c-43c5-a491-9885b80a08e5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:56.393839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26455724-dd2c-43c5-a491-9885b80a08e5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:56.394329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26455724-dd2c-43c5-a491-9885b80a08e5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:56.397395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26455724-dd2c-43c5-a491-9885b80a08e5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:56.398122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26455724-dd2c-43c5-a491-9885b80a08e5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:56.398585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26455724-dd2c-43c5-a491-9885b80a08e5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:56.399013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26455724-dd2c-43c5-a491-9885b80a08e5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:56.407983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-448893cd-09f8-4755-9dfd-7dd993985ca8 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:56.417050 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-448893cd-09f8-4755-9dfd-7dd993985ca8 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 200 len: 1322 microversion: 2.1 time: 0.548224 Oct 12 22:11:56.421096 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1410/3171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:55 2022] GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 1322 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:56.430308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e9fdc113-4f76-43a5-863a-ecbb2404688b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:56.441526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e9fdc113-4f76-43a5-863a-ecbb2404688b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:56.464876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9fdc113-4f76-43a5-863a-ecbb2404688b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:56.465381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9fdc113-4f76-43a5-863a-ecbb2404688b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:56.465832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9fdc113-4f76-43a5-863a-ecbb2404688b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:56.466552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9fdc113-4f76-43a5-863a-ecbb2404688b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:56.467007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9fdc113-4f76-43a5-863a-ecbb2404688b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:56.477252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9fdc113-4f76-43a5-863a-ecbb2404688b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:56.502226 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-26455724-dd2c-43c5-a491-9885b80a08e5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] HTTP exception thrown: Invalid volume: volume 09c991be-e7ef-40be-90fd-a5bc110fb69f is already attached to instances: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-26455724-dd2c-43c5-a491-9885b80a08e5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Request method failure captured: Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments HTTP/1.1 Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 74 Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzoV3foVnGv0suVxK_Nk7Pp5_kjAPhL8yzVHClSGl5RRxDIZH7rcf5PLHi4YXEet-A0AtHcDaHpFcS_aQR9wl8soXuphQXdzTm1zPCiMI4BUWAPu4l1z3R9DkYDtzHZhHRlT-3CEyzuxgoolPW6Gw8glco6cFnu099ScND31HIZBEC4 Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68913d260d084ce4a8e29daf4783c0bc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 13c74a78e82f4e72a7d1f7b133074f5a Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: {"volumeAttachment": {"volumeId": "09c991be-e7ef-40be-90fd-a5bc110fb69f"}} Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid volume: volume 09c991be-e7ef-40be-90fd-a5bc110fb69f is already attached to instances: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'server_id': 'e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2', 'body': {'volumeAttachment': {'volumeId': '09c991be-e7ef-40be-90fd-a5bc110fb69f'}}} Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 09c991be-e7ef-40be-90fd-a5bc110fb69f is already attached to instances: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:11:56.504347 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:11:56.510924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:11:56.510924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:11:56.510924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 12 22:11:56.510924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 22:11:56.510924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 09c991be-e7ef-40be-90fd-a5bc110fb69f is already attached to instances: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 Oct 12 22:11:56.510924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:11:56.510924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:11:56.510924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:11:56.510924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:11:56.510924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:11:56.510924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:11:56.510924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:11:56.510924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:11:56.510924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 09c991be-e7ef-40be-90fd-a5bc110fb69f is already attached to instances: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 Oct 12 22:11:56.510924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:11:56.514503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-26455724-dd2c-43c5-a491-9885b80a08e5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Returning 400 to user: Invalid volume: volume 09c991be-e7ef-40be-90fd-a5bc110fb69f is already attached to instances: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:11:56.515305 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-26455724-dd2c-43c5-a491-9885b80a08e5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "POST /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.152933 Oct 12 22:11:56.516071 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1762/3172] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 22:11:56 2022] POST /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments => generated 174 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:11:56.616664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-143a6de9-05ae-4fce-8fe6-3f79d380afe2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:56.618121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-143a6de9-05ae-4fce-8fe6-3f79d380afe2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:56.630340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-143a6de9-05ae-4fce-8fe6-3f79d380afe2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:56.634283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-143a6de9-05ae-4fce-8fe6-3f79d380afe2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:56.634862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-143a6de9-05ae-4fce-8fe6-3f79d380afe2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:56.635733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-143a6de9-05ae-4fce-8fe6-3f79d380afe2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:56.639017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-143a6de9-05ae-4fce-8fe6-3f79d380afe2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:56.639655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-143a6de9-05ae-4fce-8fe6-3f79d380afe2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:56.755520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e9fdc113-4f76-43a5-863a-ecbb2404688b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:56.766537 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e9fdc113-4f76-43a5-863a-ecbb2404688b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1317 microversion: 2.1 time: 0.341042 Oct 12 22:11:56.785273 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1411/3173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:56 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:56.852342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b06dd7ab-f703-48d9-8de4-1c6d1187b2f9 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:56.852958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b06dd7ab-f703-48d9-8de4-1c6d1187b2f9 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:56.862207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b06dd7ab-f703-48d9-8de4-1c6d1187b2f9 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:56.862708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b06dd7ab-f703-48d9-8de4-1c6d1187b2f9 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:56.863148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b06dd7ab-f703-48d9-8de4-1c6d1187b2f9 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:56.863890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b06dd7ab-f703-48d9-8de4-1c6d1187b2f9 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:56.864342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b06dd7ab-f703-48d9-8de4-1c6d1187b2f9 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:56.864771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b06dd7ab-f703-48d9-8de4-1c6d1187b2f9 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:56.874209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-143a6de9-05ae-4fce-8fe6-3f79d380afe2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lazy-loading 'services' on Instance uuid e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:11:57.025276 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-143a6de9-05ae-4fce-8fe6-3f79d380afe2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments/09c991be-e7ef-40be-90fd-a5bc110fb69f" status: 202 len: 0 microversion: 2.1 time: 0.414089 Oct 12 22:11:57.025898 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1763/3174] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 22:11:56 2022] DELETE /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments/09c991be-e7ef-40be-90fd-a5bc110fb69f => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:11:57.043913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e9c4c8a0-03f2-493e-949d-e1e513a7a6b2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:57.052141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e9c4c8a0-03f2-493e-949d-e1e513a7a6b2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:57.064104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9c4c8a0-03f2-493e-949d-e1e513a7a6b2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:57.064600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9c4c8a0-03f2-493e-949d-e1e513a7a6b2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:57.065039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9c4c8a0-03f2-493e-949d-e1e513a7a6b2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:57.065750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9c4c8a0-03f2-493e-949d-e1e513a7a6b2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:57.066206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9c4c8a0-03f2-493e-949d-e1e513a7a6b2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:57.066654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9c4c8a0-03f2-493e-949d-e1e513a7a6b2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:57.140953 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e9c4c8a0-03f2-493e-949d-e1e513a7a6b2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107935 Oct 12 22:11:57.141855 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1764/3175] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:11:57 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:11:57.159021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0de58f64-6e71-4132-9604-d6961a2b99a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:57.159917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0de58f64-6e71-4132-9604-d6961a2b99a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:57.166580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0de58f64-6e71-4132-9604-d6961a2b99a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:57.167259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0de58f64-6e71-4132-9604-d6961a2b99a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:57.170444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0de58f64-6e71-4132-9604-d6961a2b99a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:57.171458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0de58f64-6e71-4132-9604-d6961a2b99a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:57.172097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0de58f64-6e71-4132-9604-d6961a2b99a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:57.178838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0de58f64-6e71-4132-9604-d6961a2b99a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:57.262395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b06dd7ab-f703-48d9-8de4-1c6d1187b2f9 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:57.270843 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b06dd7ab-f703-48d9-8de4-1c6d1187b2f9 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1313 microversion: 2.1 time: 0.422759 Oct 12 22:11:57.279101 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1412/3176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:56 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:57.388834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-05a54fde-4e15-43a6-887d-ead6dc3392b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:57.389848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-05a54fde-4e15-43a6-887d-ead6dc3392b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:57.403260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05a54fde-4e15-43a6-887d-ead6dc3392b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:57.403998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05a54fde-4e15-43a6-887d-ead6dc3392b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:57.404705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05a54fde-4e15-43a6-887d-ead6dc3392b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:57.405684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05a54fde-4e15-43a6-887d-ead6dc3392b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:57.406367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05a54fde-4e15-43a6-887d-ead6dc3392b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:57.408650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05a54fde-4e15-43a6-887d-ead6dc3392b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:57.683942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-05a54fde-4e15-43a6-887d-ead6dc3392b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:57.696408 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-05a54fde-4e15-43a6-887d-ead6dc3392b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 0.311049 Oct 12 22:11:57.697703 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1413/3177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:57 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:57.704196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-062e0903-197c-45b0-81af-57a7c47303d6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:57.705692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-062e0903-197c-45b0-81af-57a7c47303d6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:57.715498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-062e0903-197c-45b0-81af-57a7c47303d6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:57.717200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-062e0903-197c-45b0-81af-57a7c47303d6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:57.722475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-062e0903-197c-45b0-81af-57a7c47303d6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:57.724044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-062e0903-197c-45b0-81af-57a7c47303d6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:57.725343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-062e0903-197c-45b0-81af-57a7c47303d6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:57.726533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-062e0903-197c-45b0-81af-57a7c47303d6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:57.733463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:11:58.045890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0de58f64-6e71-4132-9604-d6961a2b99a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:58.074157 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0de58f64-6e71-4132-9604-d6961a2b99a2 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.930654 Oct 12 22:11:58.077016 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1765/3178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:57 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:58.110927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-c1116e0d-5c9b-45e4-a4b4-fc561e5fa809 req-8b1aef52-f1b5-43bb-a5d7-17fccef09a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4377e1-7ac3-4b36-ad3d-ac212282c090", "name": "network-vif-plugged", "status": "completed", "tag": "2454e52e-61bf-48dd-91c1-b2016da8e8ef"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:58.141355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c1116e0d-5c9b-45e4-a4b4-fc561e5fa809 req-8b1aef52-f1b5-43bb-a5d7-17fccef09a5c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:58.142032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c1116e0d-5c9b-45e4-a4b4-fc561e5fa809 req-8b1aef52-f1b5-43bb-a5d7-17fccef09a5c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:58.145506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c1116e0d-5c9b-45e4-a4b4-fc561e5fa809 req-8b1aef52-f1b5-43bb-a5d7-17fccef09a5c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:58.176980 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-c1116e0d-5c9b-45e4-a4b4-fc561e5fa809 req-8b1aef52-f1b5-43bb-a5d7-17fccef09a5c service nova] Creating event network-vif-plugged:2454e52e-61bf-48dd-91c1-b2016da8e8ef for instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 on n-h1-861111-1 Oct 12 22:11:58.188474 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-c1116e0d-5c9b-45e4-a4b4-fc561e5fa809 req-8b1aef52-f1b5-43bb-a5d7-17fccef09a5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108395 Oct 12 22:11:58.189249 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1766/3179] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:58.218459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-afcb74a7-0650-4adf-813d-5661e1d7ad0d req-80a84040-a096-4541-ba71-cc92e11a3da6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f924aa3b-0c00-4577-bb06-3a169f972d3d", "tag": "388738e3-987d-4373-89b2-ec1c33e4c96c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:11:58.256237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-062e0903-197c-45b0-81af-57a7c47303d6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:58.259575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-afcb74a7-0650-4adf-813d-5661e1d7ad0d req-80a84040-a096-4541-ba71-cc92e11a3da6 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:58.262816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-afcb74a7-0650-4adf-813d-5661e1d7ad0d req-80a84040-a096-4541-ba71-cc92e11a3da6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:58.264008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-afcb74a7-0650-4adf-813d-5661e1d7ad0d req-80a84040-a096-4541-ba71-cc92e11a3da6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:58.269556 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-062e0903-197c-45b0-81af-57a7c47303d6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 200 len: 1322 microversion: 2.1 time: 0.570486 Oct 12 22:11:58.270534 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1414/3180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:57 2022] GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 1322 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:58.278908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b724ebd-a634-4f10-a540-52e22d18ede7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:58.289281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6b724ebd-a634-4f10-a540-52e22d18ede7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:58.296613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b724ebd-a634-4f10-a540-52e22d18ede7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:58.297294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b724ebd-a634-4f10-a540-52e22d18ede7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:58.300010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b724ebd-a634-4f10-a540-52e22d18ede7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:58.301395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b724ebd-a634-4f10-a540-52e22d18ede7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:58.302189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b724ebd-a634-4f10-a540-52e22d18ede7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:58.304025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b724ebd-a634-4f10-a540-52e22d18ede7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:58.305097 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-afcb74a7-0650-4adf-813d-5661e1d7ad0d req-80a84040-a096-4541-ba71-cc92e11a3da6 service nova] Creating event network-changed:388738e3-987d-4373-89b2-ec1c33e4c96c for instance f924aa3b-0c00-4577-bb06-3a169f972d3d on n-h1-861111-1 Oct 12 22:11:58.344252 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-afcb74a7-0650-4adf-813d-5661e1d7ad0d req-80a84040-a096-4541-ba71-cc92e11a3da6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151959 Oct 12 22:11:58.346186 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1767/3181] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:58.377183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-14cc316d-6405-4a39-9ba5-c10ffaf6a746 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:58.383200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-14cc316d-6405-4a39-9ba5-c10ffaf6a746 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:58.399665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14cc316d-6405-4a39-9ba5-c10ffaf6a746 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:58.400166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14cc316d-6405-4a39-9ba5-c10ffaf6a746 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:58.400603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14cc316d-6405-4a39-9ba5-c10ffaf6a746 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:58.401308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14cc316d-6405-4a39-9ba5-c10ffaf6a746 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:58.401759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14cc316d-6405-4a39-9ba5-c10ffaf6a746 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:58.402185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14cc316d-6405-4a39-9ba5-c10ffaf6a746 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:58.508420 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-14cc316d-6405-4a39-9ba5-c10ffaf6a746 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158494 Oct 12 22:11:58.509382 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1768/3182] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:11:58 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:58.523811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3261b8b4-8890-4cba-8749-41d55481319c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:58.524616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3261b8b4-8890-4cba-8749-41d55481319c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:58.534621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3261b8b4-8890-4cba-8749-41d55481319c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:58.535261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3261b8b4-8890-4cba-8749-41d55481319c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:58.541365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3261b8b4-8890-4cba-8749-41d55481319c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:58.543416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3261b8b4-8890-4cba-8749-41d55481319c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:58.545149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3261b8b4-8890-4cba-8749-41d55481319c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:58.546896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3261b8b4-8890-4cba-8749-41d55481319c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:58.733482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6b724ebd-a634-4f10-a540-52e22d18ede7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:58.746243 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6b724ebd-a634-4f10-a540-52e22d18ede7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1317 microversion: 2.1 time: 0.474240 Oct 12 22:11:58.746836 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1415/3183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:58 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:58.785228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-12800498-edaf-4ad8-87d7-c3a615948633 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:58.791160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-12800498-edaf-4ad8-87d7-c3a615948633 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:58.802226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12800498-edaf-4ad8-87d7-c3a615948633 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:58.802987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12800498-edaf-4ad8-87d7-c3a615948633 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:58.815002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12800498-edaf-4ad8-87d7-c3a615948633 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:58.815931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12800498-edaf-4ad8-87d7-c3a615948633 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:58.816427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12800498-edaf-4ad8-87d7-c3a615948633 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:58.816874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12800498-edaf-4ad8-87d7-c3a615948633 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:58.863096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3261b8b4-8890-4cba-8749-41d55481319c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:58.872580 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3261b8b4-8890-4cba-8749-41d55481319c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1313 microversion: 2.1 time: 0.361699 Oct 12 22:11:58.874196 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1769/3184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:58 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:59.105177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-73ac7e78-9a6a-42bc-b89d-a461be79d883 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:59.106569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-73ac7e78-9a6a-42bc-b89d-a461be79d883 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:59.122605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73ac7e78-9a6a-42bc-b89d-a461be79d883 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:59.123132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73ac7e78-9a6a-42bc-b89d-a461be79d883 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:59.123592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73ac7e78-9a6a-42bc-b89d-a461be79d883 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:59.124389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73ac7e78-9a6a-42bc-b89d-a461be79d883 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:59.125274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73ac7e78-9a6a-42bc-b89d-a461be79d883 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:59.125400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73ac7e78-9a6a-42bc-b89d-a461be79d883 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:59.422977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-73ac7e78-9a6a-42bc-b89d-a461be79d883 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:59.436113 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-73ac7e78-9a6a-42bc-b89d-a461be79d883 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.336894 Oct 12 22:11:59.439186 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1770/3185] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:59 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:11:59.450848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cd3213ed-e626-48de-b33a-5bbf9e1c3a32 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:59.454951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cd3213ed-e626-48de-b33a-5bbf9e1c3a32 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:59.467816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd3213ed-e626-48de-b33a-5bbf9e1c3a32 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:59.477494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd3213ed-e626-48de-b33a-5bbf9e1c3a32 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:59.478569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd3213ed-e626-48de-b33a-5bbf9e1c3a32 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:59.479706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd3213ed-e626-48de-b33a-5bbf9e1c3a32 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:59.480442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd3213ed-e626-48de-b33a-5bbf9e1c3a32 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:59.482775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd3213ed-e626-48de-b33a-5bbf9e1c3a32 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:59.773962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-12800498-edaf-4ad8-87d7-c3a615948633 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:59.796025 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-12800498-edaf-4ad8-87d7-c3a615948633 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 1.014422 Oct 12 22:11:59.801606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cd3213ed-e626-48de-b33a-5bbf9e1c3a32 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:11:59.803324 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1416/3186] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:58 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:59.808709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-309d1191-244b-45cb-a84e-ddd39f513a8e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:59.826995 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cd3213ed-e626-48de-b33a-5bbf9e1c3a32 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 200 len: 1322 microversion: 2.1 time: 0.386095 Oct 12 22:11:59.830891 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1771/3187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:59 2022] GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:11:59.843917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-309d1191-244b-45cb-a84e-ddd39f513a8e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:59.850211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-140256a9-5880-48be-88b1-8a7dbe950c6c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:59.850790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-140256a9-5880-48be-88b1-8a7dbe950c6c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:59.858402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-309d1191-244b-45cb-a84e-ddd39f513a8e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:59.858907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-309d1191-244b-45cb-a84e-ddd39f513a8e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:59.859382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-309d1191-244b-45cb-a84e-ddd39f513a8e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:59.860106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-309d1191-244b-45cb-a84e-ddd39f513a8e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:59.860564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-309d1191-244b-45cb-a84e-ddd39f513a8e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:59.860994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-309d1191-244b-45cb-a84e-ddd39f513a8e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:59.865137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-140256a9-5880-48be-88b1-8a7dbe950c6c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:59.865647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-140256a9-5880-48be-88b1-8a7dbe950c6c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:59.866116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-140256a9-5880-48be-88b1-8a7dbe950c6c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:59.866818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-140256a9-5880-48be-88b1-8a7dbe950c6c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:59.867302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-140256a9-5880-48be-88b1-8a7dbe950c6c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:59.867742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-140256a9-5880-48be-88b1-8a7dbe950c6c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:59.942429 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-309d1191-244b-45cb-a84e-ddd39f513a8e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137573 Oct 12 22:11:59.943747 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1417/3188] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:11:59 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:11:59.958101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7911aa5b-96ed-4804-8aa8-05d23e682529 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:11:59.958803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7911aa5b-96ed-4804-8aa8-05d23e682529 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:11:59.971691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7911aa5b-96ed-4804-8aa8-05d23e682529 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:59.972480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7911aa5b-96ed-4804-8aa8-05d23e682529 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:59.976623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7911aa5b-96ed-4804-8aa8-05d23e682529 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:11:59.977599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7911aa5b-96ed-4804-8aa8-05d23e682529 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:11:59.978224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7911aa5b-96ed-4804-8aa8-05d23e682529 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:11:59.978813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7911aa5b-96ed-4804-8aa8-05d23e682529 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:00.129362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-140256a9-5880-48be-88b1-8a7dbe950c6c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:00.141277 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-140256a9-5880-48be-88b1-8a7dbe950c6c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1317 microversion: 2.1 time: 0.312204 Oct 12 22:12:00.142117 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1772/3189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:59 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:00.291912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7911aa5b-96ed-4804-8aa8-05d23e682529 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:00.300029 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7911aa5b-96ed-4804-8aa8-05d23e682529 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1500 microversion: 2.1 time: 0.351789 Oct 12 22:12:00.311463 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1418/3190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:11:59 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1500 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:00.341033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-3fe0c5e8-e065-4dff-a386-766dc5abb357 req-00b585e6-d260-4b0b-9285-aa2cb2d999c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60ad5e1-e69b-4dd0-8745-b47ba9b70a02", "name": "network-vif-plugged", "status": "completed", "tag": "2884f056-6c9a-4429-bf12-6dbf469b39dd"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:00.355175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3fe0c5e8-e065-4dff-a386-766dc5abb357 req-00b585e6-d260-4b0b-9285-aa2cb2d999c5 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:00.358822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3fe0c5e8-e065-4dff-a386-766dc5abb357 req-00b585e6-d260-4b0b-9285-aa2cb2d999c5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:00.359495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3fe0c5e8-e065-4dff-a386-766dc5abb357 req-00b585e6-d260-4b0b-9285-aa2cb2d999c5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:00.387763 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-3fe0c5e8-e065-4dff-a386-766dc5abb357 req-00b585e6-d260-4b0b-9285-aa2cb2d999c5 service nova] Creating event network-vif-plugged:2884f056-6c9a-4429-bf12-6dbf469b39dd for instance c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 on n-h1-861111-1 Oct 12 22:12:00.399632 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-3fe0c5e8-e065-4dff-a386-766dc5abb357 req-00b585e6-d260-4b0b-9285-aa2cb2d999c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062063 Oct 12 22:12:00.400770 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1773/3191] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:00.467044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0dab9067-9ed8-4112-be35-74c85d9eeb9d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:00.468717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0dab9067-9ed8-4112-be35-74c85d9eeb9d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:00.487602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dab9067-9ed8-4112-be35-74c85d9eeb9d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:00.488497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dab9067-9ed8-4112-be35-74c85d9eeb9d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:00.491426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dab9067-9ed8-4112-be35-74c85d9eeb9d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:00.494689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dab9067-9ed8-4112-be35-74c85d9eeb9d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:00.500436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dab9067-9ed8-4112-be35-74c85d9eeb9d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:00.502493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dab9067-9ed8-4112-be35-74c85d9eeb9d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:00.832417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-be1a1ffd-df1f-475d-bc4f-9c32b18c4d67 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:00.834293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-be1a1ffd-df1f-475d-bc4f-9c32b18c4d67 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:00.861537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be1a1ffd-df1f-475d-bc4f-9c32b18c4d67 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:00.866567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be1a1ffd-df1f-475d-bc4f-9c32b18c4d67 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:00.867893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be1a1ffd-df1f-475d-bc4f-9c32b18c4d67 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:00.871067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be1a1ffd-df1f-475d-bc4f-9c32b18c4d67 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:00.872888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be1a1ffd-df1f-475d-bc4f-9c32b18c4d67 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:00.875384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be1a1ffd-df1f-475d-bc4f-9c32b18c4d67 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:01.098158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0dab9067-9ed8-4112-be35-74c85d9eeb9d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:01.106432 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0dab9067-9ed8-4112-be35-74c85d9eeb9d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.643266 Oct 12 22:12:01.107010 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1419/3192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:00 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:01.118387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-996ab4fc-8d5d-4454-bbcb-db862fd97998 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:01.124558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-996ab4fc-8d5d-4454-bbcb-db862fd97998 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:01.139332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-996ab4fc-8d5d-4454-bbcb-db862fd97998 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:01.140003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-996ab4fc-8d5d-4454-bbcb-db862fd97998 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:01.152050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-996ab4fc-8d5d-4454-bbcb-db862fd97998 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:01.153497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-996ab4fc-8d5d-4454-bbcb-db862fd97998 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:01.154137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-996ab4fc-8d5d-4454-bbcb-db862fd97998 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:01.154718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-996ab4fc-8d5d-4454-bbcb-db862fd97998 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:01.165445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-be1a1ffd-df1f-475d-bc4f-9c32b18c4d67 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:01.178569 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-be1a1ffd-df1f-475d-bc4f-9c32b18c4d67 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 0.352912 Oct 12 22:12:01.201442 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1774/3193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:00 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:01.208483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9484fdae-4f33-4491-b54c-b6ac1c0fd739 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:01.212543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9484fdae-4f33-4491-b54c-b6ac1c0fd739 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:01.222709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9484fdae-4f33-4491-b54c-b6ac1c0fd739 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:01.224130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9484fdae-4f33-4491-b54c-b6ac1c0fd739 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:01.224861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9484fdae-4f33-4491-b54c-b6ac1c0fd739 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:01.226344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9484fdae-4f33-4491-b54c-b6ac1c0fd739 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:01.227022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9484fdae-4f33-4491-b54c-b6ac1c0fd739 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:01.229155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9484fdae-4f33-4491-b54c-b6ac1c0fd739 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:01.279812 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9484fdae-4f33-4491-b54c-b6ac1c0fd739 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076854 Oct 12 22:12:01.286243 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1775/3194] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:12:01 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:01.299190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-796ac6ab-0c05-4d7d-9356-e025faa5a308 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:01.301487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-796ac6ab-0c05-4d7d-9356-e025faa5a308 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:01.303437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:01.322507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-796ac6ab-0c05-4d7d-9356-e025faa5a308 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:01.325023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-796ac6ab-0c05-4d7d-9356-e025faa5a308 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:01.327494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-796ac6ab-0c05-4d7d-9356-e025faa5a308 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:01.330196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-796ac6ab-0c05-4d7d-9356-e025faa5a308 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:01.331770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-796ac6ab-0c05-4d7d-9356-e025faa5a308 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:01.335352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-796ac6ab-0c05-4d7d-9356-e025faa5a308 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:01.376747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:01.693680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-796ac6ab-0c05-4d7d-9356-e025faa5a308 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:01.713531 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-796ac6ab-0c05-4d7d-9356-e025faa5a308 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1317 microversion: 2.1 time: 0.421702 Oct 12 22:12:01.714282 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1776/3195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:01 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:02.136981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-774e04b1-a00a-4d3a-8e2f-face86691b58 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:02.138463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-774e04b1-a00a-4d3a-8e2f-face86691b58 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:02.141222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:02.156561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-774e04b1-a00a-4d3a-8e2f-face86691b58 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:02.157052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-774e04b1-a00a-4d3a-8e2f-face86691b58 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:02.164068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-774e04b1-a00a-4d3a-8e2f-face86691b58 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:02.164447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-774e04b1-a00a-4d3a-8e2f-face86691b58 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:02.165022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-774e04b1-a00a-4d3a-8e2f-face86691b58 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:02.165724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-774e04b1-a00a-4d3a-8e2f-face86691b58 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:02.507818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-774e04b1-a00a-4d3a-8e2f-face86691b58 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:02.526707 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-774e04b1-a00a-4d3a-8e2f-face86691b58 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.393932 Oct 12 22:12:02.527650 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1777/3196] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:02 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:12:02.534452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f999d4fe-5216-42a9-b2fd-8c328070c3fb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:02.554446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f999d4fe-5216-42a9-b2fd-8c328070c3fb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:02.589471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f999d4fe-5216-42a9-b2fd-8c328070c3fb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:02.590254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f999d4fe-5216-42a9-b2fd-8c328070c3fb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:02.591910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f999d4fe-5216-42a9-b2fd-8c328070c3fb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:02.597233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f999d4fe-5216-42a9-b2fd-8c328070c3fb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:02.597949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f999d4fe-5216-42a9-b2fd-8c328070c3fb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:02.600732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f999d4fe-5216-42a9-b2fd-8c328070c3fb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:02.625544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-996ab4fc-8d5d-4454-bbcb-db862fd97998 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:02.638978 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-996ab4fc-8d5d-4454-bbcb-db862fd97998 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 200 len: 1322 microversion: 2.1 time: 1.528130 Oct 12 22:12:02.639919 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1420/3197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:01 2022] GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 1322 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:02.645192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ffdf80ca-502a-49db-b500-b374ba3de1b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:02.654936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ffdf80ca-502a-49db-b500-b374ba3de1b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:02.662752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:02.666287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffdf80ca-502a-49db-b500-b374ba3de1b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:02.670196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffdf80ca-502a-49db-b500-b374ba3de1b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:02.670730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffdf80ca-502a-49db-b500-b374ba3de1b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:02.671508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffdf80ca-502a-49db-b500-b374ba3de1b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:02.671977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffdf80ca-502a-49db-b500-b374ba3de1b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:02.672427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffdf80ca-502a-49db-b500-b374ba3de1b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:02.743097 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ffdf80ca-502a-49db-b500-b374ba3de1b7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102054 Oct 12 22:12:02.750705 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1421/3198] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:12:02 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:02.771790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-464edb3e-9ae4-4d0d-9692-1a433e9922fe req-c9f0926d-d3e6-4d59-aadc-982434fbf98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "111af739-6af4-48aa-b0c4-2e891131a11c", "name": "network-vif-plugged", "status": "completed", "tag": "ac1836d2-2559-4a35-9a8d-f73a71674266"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:02.794174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-464edb3e-9ae4-4d0d-9692-1a433e9922fe req-c9f0926d-d3e6-4d59-aadc-982434fbf98d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:02.803330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-464edb3e-9ae4-4d0d-9692-1a433e9922fe req-c9f0926d-d3e6-4d59-aadc-982434fbf98d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:02.804381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-464edb3e-9ae4-4d0d-9692-1a433e9922fe req-c9f0926d-d3e6-4d59-aadc-982434fbf98d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:02.840548 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-464edb3e-9ae4-4d0d-9692-1a433e9922fe req-c9f0926d-d3e6-4d59-aadc-982434fbf98d service nova] Creating event network-vif-plugged:ac1836d2-2559-4a35-9a8d-f73a71674266 for instance 111af739-6af4-48aa-b0c4-2e891131a11c on n-h2-861111-1 Oct 12 22:12:02.853122 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-464edb3e-9ae4-4d0d-9692-1a433e9922fe req-c9f0926d-d3e6-4d59-aadc-982434fbf98d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100304 Oct 12 22:12:02.854019 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1422/3199] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:02.860769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9e2273fe-cdd4-43ae-a313-7342dabe9acd tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:02.861721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9e2273fe-cdd4-43ae-a313-7342dabe9acd tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:02.869883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e2273fe-cdd4-43ae-a313-7342dabe9acd tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:02.870925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e2273fe-cdd4-43ae-a313-7342dabe9acd tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:02.871617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e2273fe-cdd4-43ae-a313-7342dabe9acd tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:02.872522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e2273fe-cdd4-43ae-a313-7342dabe9acd tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:02.873306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e2273fe-cdd4-43ae-a313-7342dabe9acd tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:02.873881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e2273fe-cdd4-43ae-a313-7342dabe9acd tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:02.881750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f999d4fe-5216-42a9-b2fd-8c328070c3fb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:02.895935 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f999d4fe-5216-42a9-b2fd-8c328070c3fb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 0.366823 Oct 12 22:12:02.897639 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1778/3200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:02 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:03.495350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9e2273fe-cdd4-43ae-a313-7342dabe9acd tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:03.508165 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9e2273fe-cdd4-43ae-a313-7342dabe9acd tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1317 microversion: 2.1 time: 0.649519 Oct 12 22:12:03.539070 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1423/3201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:02 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1317 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:03.555833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-036e010c-8a63-4483-bf5e-244b5557d185 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:03.557256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-036e010c-8a63-4483-bf5e-244b5557d185 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:03.570268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-036e010c-8a63-4483-bf5e-244b5557d185 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:03.575675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-036e010c-8a63-4483-bf5e-244b5557d185 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:03.576475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-036e010c-8a63-4483-bf5e-244b5557d185 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:03.579691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-036e010c-8a63-4483-bf5e-244b5557d185 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:03.581211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-036e010c-8a63-4483-bf5e-244b5557d185 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:03.582511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-036e010c-8a63-4483-bf5e-244b5557d185 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:03.667073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5008ab09-967f-4f7c-84e2-30bf3286a5c2 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:03.668459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5008ab09-967f-4f7c-84e2-30bf3286a5c2 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:03.679971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5008ab09-967f-4f7c-84e2-30bf3286a5c2 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:03.690256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5008ab09-967f-4f7c-84e2-30bf3286a5c2 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:03.691359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5008ab09-967f-4f7c-84e2-30bf3286a5c2 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:03.692377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5008ab09-967f-4f7c-84e2-30bf3286a5c2 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:03.693173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5008ab09-967f-4f7c-84e2-30bf3286a5c2 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:03.694100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5008ab09-967f-4f7c-84e2-30bf3286a5c2 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:04.035091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-036e010c-8a63-4483-bf5e-244b5557d185 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:04.044495 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-036e010c-8a63-4483-bf5e-244b5557d185 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.495446 Oct 12 22:12:04.045282 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1779/3202] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:03 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:04.063831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-22a8f863-5ad7-46b5-a4d4-e5e3d32d8613 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:04.071258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-22a8f863-5ad7-46b5-a4d4-e5e3d32d8613 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:04.087604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22a8f863-5ad7-46b5-a4d4-e5e3d32d8613 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:04.087974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22a8f863-5ad7-46b5-a4d4-e5e3d32d8613 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:04.088417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22a8f863-5ad7-46b5-a4d4-e5e3d32d8613 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:04.090829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22a8f863-5ad7-46b5-a4d4-e5e3d32d8613 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:04.091397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22a8f863-5ad7-46b5-a4d4-e5e3d32d8613 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:04.093153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22a8f863-5ad7-46b5-a4d4-e5e3d32d8613 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:04.176287 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-22a8f863-5ad7-46b5-a4d4-e5e3d32d8613 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122356 Oct 12 22:12:04.178721 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1780/3203] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:12:04 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:04.190630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3f332ec8-e86d-48ce-8c98-a6e0e7db24e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:04.194176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3f332ec8-e86d-48ce-8c98-a6e0e7db24e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:04.211807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f332ec8-e86d-48ce-8c98-a6e0e7db24e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:04.212326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f332ec8-e86d-48ce-8c98-a6e0e7db24e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:04.212765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f332ec8-e86d-48ce-8c98-a6e0e7db24e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:04.216074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f332ec8-e86d-48ce-8c98-a6e0e7db24e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:04.216682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f332ec8-e86d-48ce-8c98-a6e0e7db24e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:04.216990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f332ec8-e86d-48ce-8c98-a6e0e7db24e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:04.390755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5008ab09-967f-4f7c-84e2-30bf3286a5c2 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:04.403517 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5008ab09-967f-4f7c-84e2-30bf3286a5c2 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 200 len: 1322 microversion: 2.1 time: 0.740166 Oct 12 22:12:04.407380 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1424/3204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:03 2022] GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 1322 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:04.417295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eeab1215-9d3a-4e45-8527-37985a51e0be tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90a91c0f-875b-400c-ac03-0d48e2dc75e3"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:04.423643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eeab1215-9d3a-4e45-8527-37985a51e0be tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:04.436705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eeab1215-9d3a-4e45-8527-37985a51e0be tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:04.437598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eeab1215-9d3a-4e45-8527-37985a51e0be tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:04.440385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eeab1215-9d3a-4e45-8527-37985a51e0be tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:04.442568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eeab1215-9d3a-4e45-8527-37985a51e0be tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:04.443847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eeab1215-9d3a-4e45-8527-37985a51e0be tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:04.449992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eeab1215-9d3a-4e45-8527-37985a51e0be tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:04.554801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3f332ec8-e86d-48ce-8c98-a6e0e7db24e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:04.571571 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3f332ec8-e86d-48ce-8c98-a6e0e7db24e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 0.387087 Oct 12 22:12:04.585053 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1781/3205] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:04 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:04.608372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6572bfc5-0812-45b5-9cdb-022687e0c4dc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:04.609628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6572bfc5-0812-45b5-9cdb-022687e0c4dc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:04.621574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6572bfc5-0812-45b5-9cdb-022687e0c4dc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:04.623839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6572bfc5-0812-45b5-9cdb-022687e0c4dc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:04.624320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6572bfc5-0812-45b5-9cdb-022687e0c4dc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:04.625058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6572bfc5-0812-45b5-9cdb-022687e0c4dc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:04.628462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6572bfc5-0812-45b5-9cdb-022687e0c4dc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:04.629604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6572bfc5-0812-45b5-9cdb-022687e0c4dc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:05.000799 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eeab1215-9d3a-4e45-8527-37985a51e0be tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "POST /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.591163 Oct 12 22:12:05.005218 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1425/3206] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 22:12:04 2022] POST /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090/os-volume_attachments => generated 194 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:05.017840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-b1478cf5-e0c3-4943-a865-a4ffd67660d5 req-e693b587-e5f7-4099-a87a-e29e153c891a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "111af739-6af4-48aa-b0c4-2e891131a11c", "name": "network-vif-plugged", "status": "completed", "tag": "be7b8151-86c4-44ed-bfe4-84477b980d0a"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:05.030611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b1478cf5-e0c3-4943-a865-a4ffd67660d5 req-e693b587-e5f7-4099-a87a-e29e153c891a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:05.031455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b1478cf5-e0c3-4943-a865-a4ffd67660d5 req-e693b587-e5f7-4099-a87a-e29e153c891a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:05.032051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b1478cf5-e0c3-4943-a865-a4ffd67660d5 req-e693b587-e5f7-4099-a87a-e29e153c891a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:05.058836 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-b1478cf5-e0c3-4943-a865-a4ffd67660d5 req-e693b587-e5f7-4099-a87a-e29e153c891a service nova] Creating event network-vif-plugged:be7b8151-86c4-44ed-bfe4-84477b980d0a for instance 111af739-6af4-48aa-b0c4-2e891131a11c on n-h2-861111-1 Oct 12 22:12:05.068707 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-b1478cf5-e0c3-4943-a865-a4ffd67660d5 req-e693b587-e5f7-4099-a87a-e29e153c891a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060192 Oct 12 22:12:05.073379 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1426/3207] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:05.098735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-54d43a11-f75a-45d6-ae0c-b27ce2d2815a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:05.100177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-54d43a11-f75a-45d6-ae0c-b27ce2d2815a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:05.109206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54d43a11-f75a-45d6-ae0c-b27ce2d2815a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:05.109701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54d43a11-f75a-45d6-ae0c-b27ce2d2815a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:05.110146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54d43a11-f75a-45d6-ae0c-b27ce2d2815a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:05.111035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54d43a11-f75a-45d6-ae0c-b27ce2d2815a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:05.111533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54d43a11-f75a-45d6-ae0c-b27ce2d2815a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:05.111995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54d43a11-f75a-45d6-ae0c-b27ce2d2815a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:05.211381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6572bfc5-0812-45b5-9cdb-022687e0c4dc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:05.229932 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6572bfc5-0812-45b5-9cdb-022687e0c4dc tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1467 microversion: 2.1 time: 0.643381 Oct 12 22:12:05.231748 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1782/3208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:04 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1467 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:05.255338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-84744882-f0c3-49d4-8f8b-10bbe14d0add tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:05.260599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-84744882-f0c3-49d4-8f8b-10bbe14d0add tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:05.273121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84744882-f0c3-49d4-8f8b-10bbe14d0add tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:05.273863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84744882-f0c3-49d4-8f8b-10bbe14d0add tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:05.274434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84744882-f0c3-49d4-8f8b-10bbe14d0add tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:05.275463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84744882-f0c3-49d4-8f8b-10bbe14d0add tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:05.276162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84744882-f0c3-49d4-8f8b-10bbe14d0add tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:05.276738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84744882-f0c3-49d4-8f8b-10bbe14d0add tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:05.328650 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-84744882-f0c3-49d4-8f8b-10bbe14d0add tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094903 Oct 12 22:12:05.330512 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1783/3209] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:12:05 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:05.344920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6b4f5d9a-82a0-4ea2-b5bb-b77e8a4bc078 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:05.350641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6b4f5d9a-82a0-4ea2-b5bb-b77e8a4bc078 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:05.386022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b4f5d9a-82a0-4ea2-b5bb-b77e8a4bc078 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:05.387155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b4f5d9a-82a0-4ea2-b5bb-b77e8a4bc078 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:05.388633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b4f5d9a-82a0-4ea2-b5bb-b77e8a4bc078 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:05.390836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b4f5d9a-82a0-4ea2-b5bb-b77e8a4bc078 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:05.391432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b4f5d9a-82a0-4ea2-b5bb-b77e8a4bc078 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:05.392841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b4f5d9a-82a0-4ea2-b5bb-b77e8a4bc078 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:05.632713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-54d43a11-f75a-45d6-ae0c-b27ce2d2815a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:05.641617 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-54d43a11-f75a-45d6-ae0c-b27ce2d2815a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.567462 Oct 12 22:12:05.654053 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1427/3210] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:05 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:05.707445 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6b4f5d9a-82a0-4ea2-b5bb-b77e8a4bc078 tempest-ServersOnMultiNodesTest-1063909280 tempest-ServersOnMultiNodesTest-1063909280-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1618 microversion: 2.1 time: 0.368346 Oct 12 22:12:05.719404 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1784/3211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:05 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1618 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:05.734165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-10f3c8a1-1ccb-4168-bc87-88dfd3a6c2fd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:05.734165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-10f3c8a1-1ccb-4168-bc87-88dfd3a6c2fd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:05.747738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10f3c8a1-1ccb-4168-bc87-88dfd3a6c2fd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:05.748224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10f3c8a1-1ccb-4168-bc87-88dfd3a6c2fd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:05.748668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10f3c8a1-1ccb-4168-bc87-88dfd3a6c2fd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:05.749377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10f3c8a1-1ccb-4168-bc87-88dfd3a6c2fd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:05.749842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10f3c8a1-1ccb-4168-bc87-88dfd3a6c2fd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:05.750272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10f3c8a1-1ccb-4168-bc87-88dfd3a6c2fd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:06.011633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-764186690", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "fb7d3258-6587-403e-9076-bc67d7e46a31"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:06.083053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] validate_networks() for [('fb7d3258-6587-403e-9076-bc67d7e46a31', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:12:06.092011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-10f3c8a1-1ccb-4168-bc87-88dfd3a6c2fd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:06.105514 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-10f3c8a1-1ccb-4168-bc87-88dfd3a6c2fd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 200 len: 1322 microversion: 2.1 time: 0.384899 Oct 12 22:12:06.108019 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1785/3212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:05 2022] GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:06.125548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6ffad9e5-6a5e-4b91-bf99-68852bd889d8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:06.126846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6ffad9e5-6a5e-4b91-bf99-68852bd889d8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:06.142088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ffad9e5-6a5e-4b91-bf99-68852bd889d8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:06.148211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ffad9e5-6a5e-4b91-bf99-68852bd889d8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:06.149653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ffad9e5-6a5e-4b91-bf99-68852bd889d8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:06.152566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ffad9e5-6a5e-4b91-bf99-68852bd889d8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:06.153057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ffad9e5-6a5e-4b91-bf99-68852bd889d8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:06.155857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ffad9e5-6a5e-4b91-bf99-68852bd889d8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:06.416665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6ffad9e5-6a5e-4b91-bf99-68852bd889d8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:06.429644 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6ffad9e5-6a5e-4b91-bf99-68852bd889d8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 0.320216 Oct 12 22:12:06.434556 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1786/3213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:06 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:06.448070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4e77bb7b-9dec-441b-bf07-67419fd0f05c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:06.448754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4e77bb7b-9dec-441b-bf07-67419fd0f05c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:06.464134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e77bb7b-9dec-441b-bf07-67419fd0f05c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:06.465978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e77bb7b-9dec-441b-bf07-67419fd0f05c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:06.467352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e77bb7b-9dec-441b-bf07-67419fd0f05c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:06.469337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e77bb7b-9dec-441b-bf07-67419fd0f05c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:06.471006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e77bb7b-9dec-441b-bf07-67419fd0f05c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:06.472386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e77bb7b-9dec-441b-bf07-67419fd0f05c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:06.527422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4e77bb7b-9dec-441b-bf07-67419fd0f05c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:12:06.654426 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4e77bb7b-9dec-441b-bf07-67419fd0f05c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 204 len: 0 microversion: 2.1 time: 0.218428 Oct 12 22:12:06.658448 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1787/3214] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:12:06 2022] DELETE /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:12:06.684271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f91be291-bae1-4b66-8d53-7d1d732e88df tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:06.687369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f91be291-bae1-4b66-8d53-7d1d732e88df tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:06.704434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f91be291-bae1-4b66-8d53-7d1d732e88df tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:06.709371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f91be291-bae1-4b66-8d53-7d1d732e88df tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:06.711691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f91be291-bae1-4b66-8d53-7d1d732e88df tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:06.714504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f91be291-bae1-4b66-8d53-7d1d732e88df tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:06.718028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f91be291-bae1-4b66-8d53-7d1d732e88df tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:06.718850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f91be291-bae1-4b66-8d53-7d1d732e88df tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:06.777971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:12:06.778398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:12:06.779006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:12:06.779447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:12:06.780021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:12:06.781526 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f91be291-bae1-4b66-8d53-7d1d732e88df tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118396 Oct 12 22:12:06.782656 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1788/3215] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:12:06 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:06.787640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2381d1f8-bfd8-402c-97fe-c6c06bb118e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:06.788513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2381d1f8-bfd8-402c-97fe-c6c06bb118e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:06.795458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2381d1f8-bfd8-402c-97fe-c6c06bb118e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:06.795671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:06.796102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:06.796546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:06.796887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2381d1f8-bfd8-402c-97fe-c6c06bb118e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:06.797566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2381d1f8-bfd8-402c-97fe-c6c06bb118e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:06.798083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:06.798550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:06.798934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2381d1f8-bfd8-402c-97fe-c6c06bb118e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:06.799075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:06.799780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2381d1f8-bfd8-402c-97fe-c6c06bb118e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:06.800405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2381d1f8-bfd8-402c-97fe-c6c06bb118e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:06.826273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Getting quotas for project 85487b1a0fc14efd8b218080c3d23ce3. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:12:06.847021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Getting quotas for user bb00c4c021344aa296bead35a76dd606 and project 85487b1a0fc14efd8b218080c3d23ce3. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:12:06.862124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:06.877678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:12:06.881603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:12:06.980307 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6353b2ca-eb71-4db7-854a-e28f3126548f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.321555 Oct 12 22:12:06.981328 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1428/3216] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:12:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:12:06.986885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d03d19a5-bcf8-4695-a86f-4ae749206f5c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:06.988102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d03d19a5-bcf8-4695-a86f-4ae749206f5c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:06.997007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d03d19a5-bcf8-4695-a86f-4ae749206f5c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:06.998541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d03d19a5-bcf8-4695-a86f-4ae749206f5c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:06.999475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d03d19a5-bcf8-4695-a86f-4ae749206f5c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:07.000390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d03d19a5-bcf8-4695-a86f-4ae749206f5c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:07.001029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d03d19a5-bcf8-4695-a86f-4ae749206f5c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:07.001703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d03d19a5-bcf8-4695-a86f-4ae749206f5c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:07.077734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2381d1f8-bfd8-402c-97fe-c6c06bb118e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:07.086588 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2381d1f8-bfd8-402c-97fe-c6c06bb118e7 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1473 microversion: 2.1 time: 0.302640 Oct 12 22:12:07.109252 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1789/3217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:06 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1473 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:07.118934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fa47869f-6c0a-490e-89b5-3389f935d4cf tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:07.134403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fa47869f-6c0a-490e-89b5-3389f935d4cf tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:07.175010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:07.297555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fa47869f-6c0a-490e-89b5-3389f935d4cf tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:07.310952 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fa47869f-6c0a-490e-89b5-3389f935d4cf tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1231 microversion: 2.1 time: 0.198302 Oct 12 22:12:07.312304 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1790/3218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:07 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1231 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:07.325888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9c00da6c-32bf-40ee-8656-8b29432f6b5d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:07.329404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9c00da6c-32bf-40ee-8656-8b29432f6b5d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:07.334587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d03d19a5-bcf8-4695-a86f-4ae749206f5c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:07.347973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c00da6c-32bf-40ee-8656-8b29432f6b5d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:07.348470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c00da6c-32bf-40ee-8656-8b29432f6b5d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:07.352959 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d03d19a5-bcf8-4695-a86f-4ae749206f5c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1334 microversion: 2.1 time: 0.370352 Oct 12 22:12:07.353550 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1429/3219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:06 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1334 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:07.354090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c00da6c-32bf-40ee-8656-8b29432f6b5d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:07.355208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c00da6c-32bf-40ee-8656-8b29432f6b5d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:07.355721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c00da6c-32bf-40ee-8656-8b29432f6b5d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:07.356156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c00da6c-32bf-40ee-8656-8b29432f6b5d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:07.462769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3fb1d5da-6ae6-4584-be60-ed32484c65a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:07.463559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3fb1d5da-6ae6-4584-be60-ed32484c65a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:07.483117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fb1d5da-6ae6-4584-be60-ed32484c65a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:07.484014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fb1d5da-6ae6-4584-be60-ed32484c65a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:07.484728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fb1d5da-6ae6-4584-be60-ed32484c65a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:07.485594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fb1d5da-6ae6-4584-be60-ed32484c65a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:07.488495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fb1d5da-6ae6-4584-be60-ed32484c65a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:07.489417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fb1d5da-6ae6-4584-be60-ed32484c65a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:07.797208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9c00da6c-32bf-40ee-8656-8b29432f6b5d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:07.828013 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9c00da6c-32bf-40ee-8656-8b29432f6b5d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 200 len: 1322 microversion: 2.1 time: 0.510043 Oct 12 22:12:07.832375 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1791/3220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:07 2022] GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 1322 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:07.852424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48282352-96dd-4be5-b0e8-c40240f047be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:07.879398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-48282352-96dd-4be5-b0e8-c40240f047be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:07.882760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-48282352-96dd-4be5-b0e8-c40240f047be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Searching by: {'deleted': False, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:12:07.904287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48282352-96dd-4be5-b0e8-c40240f047be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:07.905011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48282352-96dd-4be5-b0e8-c40240f047be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:07.910989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48282352-96dd-4be5-b0e8-c40240f047be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:07.917107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48282352-96dd-4be5-b0e8-c40240f047be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:07.918435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48282352-96dd-4be5-b0e8-c40240f047be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:07.921305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48282352-96dd-4be5-b0e8-c40240f047be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:08.043455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3fb1d5da-6ae6-4584-be60-ed32484c65a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:08.046957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-48282352-96dd-4be5-b0e8-c40240f047be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:12:08.060311 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3fb1d5da-6ae6-4584-be60-ed32484c65a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 0.602640 Oct 12 22:12:08.060916 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1430/3221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:07 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:08.107644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b0439fd1-a728-4851-870f-3bf8ee4ad16a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:08.118310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b0439fd1-a728-4851-870f-3bf8ee4ad16a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:08.140616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0439fd1-a728-4851-870f-3bf8ee4ad16a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:08.142538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0439fd1-a728-4851-870f-3bf8ee4ad16a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:08.143140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0439fd1-a728-4851-870f-3bf8ee4ad16a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:08.146553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0439fd1-a728-4851-870f-3bf8ee4ad16a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:08.147111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0439fd1-a728-4851-870f-3bf8ee4ad16a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:08.154676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0439fd1-a728-4851-870f-3bf8ee4ad16a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:08.173974 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-48282352-96dd-4be5-b0e8-c40240f047be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.340122 Oct 12 22:12:08.185334 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1792/3222] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 12 22:12:07 2022] GET /compute/v2.1/servers => generated 343 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:08.199616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f88c5dda-9730-4c73-83dd-3715ab606c80 req-1c2d7861-85b2-44f8-ae5a-6552979d076b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f924aa3b-0c00-4577-bb06-3a169f972d3d", "name": "network-vif-plugged", "status": "completed", "tag": "388738e3-987d-4373-89b2-ec1c33e4c96c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:08.230738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:08.249813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f88c5dda-9730-4c73-83dd-3715ab606c80 req-1c2d7861-85b2-44f8-ae5a-6552979d076b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:08.250464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f88c5dda-9730-4c73-83dd-3715ab606c80 req-1c2d7861-85b2-44f8-ae5a-6552979d076b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:08.250907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f88c5dda-9730-4c73-83dd-3715ab606c80 req-1c2d7861-85b2-44f8-ae5a-6552979d076b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:08.291583 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f88c5dda-9730-4c73-83dd-3715ab606c80 req-1c2d7861-85b2-44f8-ae5a-6552979d076b service nova] Creating event network-vif-plugged:388738e3-987d-4373-89b2-ec1c33e4c96c for instance f924aa3b-0c00-4577-bb06-3a169f972d3d on n-h1-861111-1 Oct 12 22:12:08.295415 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b0439fd1-a728-4851-870f-3bf8ee4ad16a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.209030 Oct 12 22:12:08.303086 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1431/3223] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:12:08 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2/os-volume_attachments => generated 25 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:12:08.309100 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f88c5dda-9730-4c73-83dd-3715ab606c80 req-1c2d7861-85b2-44f8-ae5a-6552979d076b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127343 Oct 12 22:12:08.309820 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1793/3224] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:08.320076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5b302a31-2615-493d-8597-6929e021b79e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:08.322321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5b302a31-2615-493d-8597-6929e021b79e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:08.335970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-01c25f6d-7eed-4b2a-87b0-635668f51072 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:08.337590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b302a31-2615-493d-8597-6929e021b79e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:08.341113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b302a31-2615-493d-8597-6929e021b79e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:08.341830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b302a31-2615-493d-8597-6929e021b79e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:08.342705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b302a31-2615-493d-8597-6929e021b79e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:08.344818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b302a31-2615-493d-8597-6929e021b79e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:08.347377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b302a31-2615-493d-8597-6929e021b79e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:08.362291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-01c25f6d-7eed-4b2a-87b0-635668f51072 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:08.363222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-01c25f6d-7eed-4b2a-87b0-635668f51072 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Searching by: {'deleted': False, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:12:08.385647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01c25f6d-7eed-4b2a-87b0-635668f51072 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:08.386143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01c25f6d-7eed-4b2a-87b0-635668f51072 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:08.386583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01c25f6d-7eed-4b2a-87b0-635668f51072 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:08.397373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01c25f6d-7eed-4b2a-87b0-635668f51072 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:08.400798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01c25f6d-7eed-4b2a-87b0-635668f51072 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:08.401298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01c25f6d-7eed-4b2a-87b0-635668f51072 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:08.480172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-01c25f6d-7eed-4b2a-87b0-635668f51072 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:12:08.522647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:08.572489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-01c25f6d-7eed-4b2a-87b0-635668f51072 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:08.592820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01c25f6d-7eed-4b2a-87b0-635668f51072 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:08.593316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01c25f6d-7eed-4b2a-87b0-635668f51072 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:08.593767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01c25f6d-7eed-4b2a-87b0-635668f51072 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:08.887206 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-01c25f6d-7eed-4b2a-87b0-635668f51072 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.576376 Oct 12 22:12:08.903751 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1794/3225] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:12:08 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:08.914832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-99975478-4392-4eda-9c97-027a52a2b159 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:08.915651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-99975478-4392-4eda-9c97-027a52a2b159 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:08.939535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99975478-4392-4eda-9c97-027a52a2b159 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:08.940308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99975478-4392-4eda-9c97-027a52a2b159 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:08.940961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99975478-4392-4eda-9c97-027a52a2b159 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:08.941867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99975478-4392-4eda-9c97-027a52a2b159 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:08.943917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99975478-4392-4eda-9c97-027a52a2b159 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:08.944533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99975478-4392-4eda-9c97-027a52a2b159 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:09.091176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5b302a31-2615-493d-8597-6929e021b79e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:09.108238 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5b302a31-2615-493d-8597-6929e021b79e tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1473 microversion: 2.1 time: 0.809824 Oct 12 22:12:09.109402 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1432/3226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:08 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1473 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:09.114285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1653a9ec-b6e2-4162-96e7-30d682d0fd20 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:09.118386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1653a9ec-b6e2-4162-96e7-30d682d0fd20 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:09.128988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1653a9ec-b6e2-4162-96e7-30d682d0fd20 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:09.131140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1653a9ec-b6e2-4162-96e7-30d682d0fd20 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:09.133870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1653a9ec-b6e2-4162-96e7-30d682d0fd20 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:09.134701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1653a9ec-b6e2-4162-96e7-30d682d0fd20 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:09.135277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1653a9ec-b6e2-4162-96e7-30d682d0fd20 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:09.141478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1653a9ec-b6e2-4162-96e7-30d682d0fd20 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:09.152851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-99975478-4392-4eda-9c97-027a52a2b159 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:09.180756 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-99975478-4392-4eda-9c97-027a52a2b159 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1283 microversion: 2.1 time: 0.275361 Oct 12 22:12:09.195647 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1795/3227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:08 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1283 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:09.201345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5bbce5f0-f00b-409f-aa16-c7cc433d91de tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:09.201856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5bbce5f0-f00b-409f-aa16-c7cc433d91de tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:09.227776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bbce5f0-f00b-409f-aa16-c7cc433d91de tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:09.231887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bbce5f0-f00b-409f-aa16-c7cc433d91de tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:09.232634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bbce5f0-f00b-409f-aa16-c7cc433d91de tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:09.233604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bbce5f0-f00b-409f-aa16-c7cc433d91de tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:09.234314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bbce5f0-f00b-409f-aa16-c7cc433d91de tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:09.235518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bbce5f0-f00b-409f-aa16-c7cc433d91de tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:09.289959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5bbce5f0-f00b-409f-aa16-c7cc433d91de tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:12:09.466496 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5bbce5f0-f00b-409f-aa16-c7cc433d91de tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 204 len: 0 microversion: 2.1 time: 0.269346 Oct 12 22:12:09.467744 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1796/3228] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:12:09 2022] DELETE /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:12:09.473323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a8e86e74-bcce-4ac2-8a09-b885e8fd0ab1 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:09.474725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a8e86e74-bcce-4ac2-8a09-b885e8fd0ab1 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:09.488218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8e86e74-bcce-4ac2-8a09-b885e8fd0ab1 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:09.491167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8e86e74-bcce-4ac2-8a09-b885e8fd0ab1 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:09.491774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8e86e74-bcce-4ac2-8a09-b885e8fd0ab1 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:09.493422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8e86e74-bcce-4ac2-8a09-b885e8fd0ab1 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:09.494688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8e86e74-bcce-4ac2-8a09-b885e8fd0ab1 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:09.496379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8e86e74-bcce-4ac2-8a09-b885e8fd0ab1 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:09.686229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1653a9ec-b6e2-4162-96e7-30d682d0fd20 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:09.714644 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1653a9ec-b6e2-4162-96e7-30d682d0fd20 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1668 microversion: 2.1 time: 0.603749 Oct 12 22:12:09.717709 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1433/3229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:09 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1668 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:09.742260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-73e36c62-9db6-49cb-838e-06a60a2fcc3b tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:09.775654 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-73e36c62-9db6-49cb-838e-06a60a2fcc3b tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.052097 Oct 12 22:12:09.790984 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1434/3230] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:12:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:09.808522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-634ab3da-2350-4737-bc04-6e42a7f86b04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:09.809149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-634ab3da-2350-4737-bc04-6e42a7f86b04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:09.831616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-634ab3da-2350-4737-bc04-6e42a7f86b04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:09.832124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-634ab3da-2350-4737-bc04-6e42a7f86b04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:09.832579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-634ab3da-2350-4737-bc04-6e42a7f86b04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:09.837272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-634ab3da-2350-4737-bc04-6e42a7f86b04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:09.837937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-634ab3da-2350-4737-bc04-6e42a7f86b04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:09.838570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-634ab3da-2350-4737-bc04-6e42a7f86b04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:09.892776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a8e86e74-bcce-4ac2-8a09-b885e8fd0ab1 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:09.909021 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a8e86e74-bcce-4ac2-8a09-b885e8fd0ab1 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 200 len: 1322 microversion: 2.1 time: 0.439881 Oct 12 22:12:09.929610 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1797/3231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:09 2022] GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:09.942073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ffdaee78-34ec-4e13-83eb-e2b9fe3169ee tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:09.945311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ffdaee78-34ec-4e13-83eb-e2b9fe3169ee tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:09.960096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffdaee78-34ec-4e13-83eb-e2b9fe3169ee tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:09.960584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffdaee78-34ec-4e13-83eb-e2b9fe3169ee tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:09.961017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffdaee78-34ec-4e13-83eb-e2b9fe3169ee tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:09.966400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffdaee78-34ec-4e13-83eb-e2b9fe3169ee tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:09.966935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffdaee78-34ec-4e13-83eb-e2b9fe3169ee tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:09.967408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffdaee78-34ec-4e13-83eb-e2b9fe3169ee tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:10.313224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ffdaee78-34ec-4e13-83eb-e2b9fe3169ee tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:10.335593 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ffdaee78-34ec-4e13-83eb-e2b9fe3169ee tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 200 len: 1681 microversion: 2.1 time: 0.402994 Oct 12 22:12:10.338992 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1798/3232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:09 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 1681 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:10.350912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4636a751-eb83-47a0-a453-61b1f1141878 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:10.365870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4636a751-eb83-47a0-a453-61b1f1141878 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:10.390854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4636a751-eb83-47a0-a453-61b1f1141878 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:10.396199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4636a751-eb83-47a0-a453-61b1f1141878 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:10.396749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4636a751-eb83-47a0-a453-61b1f1141878 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:10.397503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4636a751-eb83-47a0-a453-61b1f1141878 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:10.397970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4636a751-eb83-47a0-a453-61b1f1141878 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:10.398391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4636a751-eb83-47a0-a453-61b1f1141878 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:10.422968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-634ab3da-2350-4737-bc04-6e42a7f86b04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:10.438419 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-634ab3da-2350-4737-bc04-6e42a7f86b04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 0.645864 Oct 12 22:12:10.439015 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1435/3233] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:09 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:10.444934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-84b3cbe0-ad81-4b29-b029-915acd45a5fa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:10.464336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-84b3cbe0-ad81-4b29-b029-915acd45a5fa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:10.478604 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4636a751-eb83-47a0-a453-61b1f1141878 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c/ips" status: 200 len: 178 microversion: 2.1 time: 0.136348 Oct 12 22:12:10.482603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84b3cbe0-ad81-4b29-b029-915acd45a5fa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:10.483415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84b3cbe0-ad81-4b29-b029-915acd45a5fa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:10.485331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84b3cbe0-ad81-4b29-b029-915acd45a5fa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:10.485973 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1799/3234] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 22:12:10 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c/ips => generated 178 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:10.486899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84b3cbe0-ad81-4b29-b029-915acd45a5fa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:10.491661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84b3cbe0-ad81-4b29-b029-915acd45a5fa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:10.492332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84b3cbe0-ad81-4b29-b029-915acd45a5fa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:10.509057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-90093abe-f787-42ec-bd6c-d309341af535 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:10.509479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-90093abe-f787-42ec-bd6c-d309341af535 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:10.534157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90093abe-f787-42ec-bd6c-d309341af535 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:10.537646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90093abe-f787-42ec-bd6c-d309341af535 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:10.539082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90093abe-f787-42ec-bd6c-d309341af535 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:10.542448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90093abe-f787-42ec-bd6c-d309341af535 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:10.544280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90093abe-f787-42ec-bd6c-d309341af535 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:10.544750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90093abe-f787-42ec-bd6c-d309341af535 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:10.636159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-84b3cbe0-ad81-4b29-b029-915acd45a5fa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:10.644883 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-84b3cbe0-ad81-4b29-b029-915acd45a5fa tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1302 microversion: 2.1 time: 0.204602 Oct 12 22:12:10.647618 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1436/3235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:10 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1302 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:10.663499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-63111f37-292e-4d8c-9137-0ea2788f646f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:10.663705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-90093abe-f787-42ec-bd6c-d309341af535 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:12:10.664640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-63111f37-292e-4d8c-9137-0ea2788f646f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:10.678417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63111f37-292e-4d8c-9137-0ea2788f646f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:10.679038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63111f37-292e-4d8c-9137-0ea2788f646f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:10.680810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63111f37-292e-4d8c-9137-0ea2788f646f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:10.686338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63111f37-292e-4d8c-9137-0ea2788f646f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:10.687713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63111f37-292e-4d8c-9137-0ea2788f646f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:10.688557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63111f37-292e-4d8c-9137-0ea2788f646f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:10.888666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-63111f37-292e-4d8c-9137-0ea2788f646f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:10.900980 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-63111f37-292e-4d8c-9137-0ea2788f646f tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1283 microversion: 2.1 time: 0.249438 Oct 12 22:12:10.904256 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1437/3236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:10 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1283 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:10.913429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-6206a9b9-4579-456d-ba54-e7f6b8ab449a req-505565b2-5e67-434b-9bf6-de7a8033c714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60ad5e1-e69b-4dd0-8745-b47ba9b70a02", "name": "network-vif-deleted", "tag": "2884f056-6c9a-4429-bf12-6dbf469b39dd"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:10.942457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6206a9b9-4579-456d-ba54-e7f6b8ab449a req-505565b2-5e67-434b-9bf6-de7a8033c714 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:10.943474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6206a9b9-4579-456d-ba54-e7f6b8ab449a req-505565b2-5e67-434b-9bf6-de7a8033c714 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:10.944171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6206a9b9-4579-456d-ba54-e7f6b8ab449a req-505565b2-5e67-434b-9bf6-de7a8033c714 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:10.971955 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-6206a9b9-4579-456d-ba54-e7f6b8ab449a req-505565b2-5e67-434b-9bf6-de7a8033c714 service nova] Creating event network-vif-deleted:2884f056-6c9a-4429-bf12-6dbf469b39dd for instance c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 on n-h1-861111-1 Oct 12 22:12:10.975762 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-90093abe-f787-42ec-bd6c-d309341af535 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 204 len: 0 microversion: 2.1 time: 0.475572 Oct 12 22:12:10.978795 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1800/3237] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:12:10 2022] DELETE /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:12:10.987646 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-6206a9b9-4579-456d-ba54-e7f6b8ab449a req-505565b2-5e67-434b-9bf6-de7a8033c714 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081687 Oct 12 22:12:10.997559 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1438/3238] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:11.006919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d954c7ba-a007-44af-b59f-9adde4fcecb4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:11.012838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d954c7ba-a007-44af-b59f-9adde4fcecb4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:11.019557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e6bc9207-8019-4601-aba9-e008a4409d76 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:11.022448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e6bc9207-8019-4601-aba9-e008a4409d76 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:11.039286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d954c7ba-a007-44af-b59f-9adde4fcecb4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:11.039451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d954c7ba-a007-44af-b59f-9adde4fcecb4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:11.045329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d954c7ba-a007-44af-b59f-9adde4fcecb4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:11.046181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d954c7ba-a007-44af-b59f-9adde4fcecb4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:11.046664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d954c7ba-a007-44af-b59f-9adde4fcecb4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:11.050608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6bc9207-8019-4601-aba9-e008a4409d76 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:11.054915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d954c7ba-a007-44af-b59f-9adde4fcecb4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:11.055942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6bc9207-8019-4601-aba9-e008a4409d76 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:11.062176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6bc9207-8019-4601-aba9-e008a4409d76 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:11.070983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6bc9207-8019-4601-aba9-e008a4409d76 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:11.071606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6bc9207-8019-4601-aba9-e008a4409d76 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:11.072065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6bc9207-8019-4601-aba9-e008a4409d76 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:11.213877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d954c7ba-a007-44af-b59f-9adde4fcecb4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:12:11.444361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e6bc9207-8019-4601-aba9-e008a4409d76 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:11.458015 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e6bc9207-8019-4601-aba9-e008a4409d76 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 200 len: 1518 microversion: 2.1 time: 0.452506 Oct 12 22:12:11.460808 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1439/3239] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:10 2022] GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 1518 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:11.467699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7232358c-a7b0-4122-86f8-64c337e402f8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:11.468305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7232358c-a7b0-4122-86f8-64c337e402f8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:11.484146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7232358c-a7b0-4122-86f8-64c337e402f8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:11.484572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7232358c-a7b0-4122-86f8-64c337e402f8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:11.485011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7232358c-a7b0-4122-86f8-64c337e402f8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:11.485783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7232358c-a7b0-4122-86f8-64c337e402f8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:11.486174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7232358c-a7b0-4122-86f8-64c337e402f8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:11.486612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7232358c-a7b0-4122-86f8-64c337e402f8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:11.507355 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d954c7ba-a007-44af-b59f-9adde4fcecb4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "DELETE /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 204 len: 0 microversion: 2.1 time: 0.523067 Oct 12 22:12:11.508618 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1801/3240] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:12:10 2022] DELETE /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:12:11.518399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d1f9e7cd-9de1-4790-81ba-34528b05ed93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:11.523066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d1f9e7cd-9de1-4790-81ba-34528b05ed93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:11.539064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1f9e7cd-9de1-4790-81ba-34528b05ed93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:11.540006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1f9e7cd-9de1-4790-81ba-34528b05ed93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:11.540687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1f9e7cd-9de1-4790-81ba-34528b05ed93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:11.542663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1f9e7cd-9de1-4790-81ba-34528b05ed93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:11.544228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1f9e7cd-9de1-4790-81ba-34528b05ed93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:11.545578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1f9e7cd-9de1-4790-81ba-34528b05ed93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:11.797851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7232358c-a7b0-4122-86f8-64c337e402f8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:11.807227 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7232358c-a7b0-4122-86f8-64c337e402f8 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1608 microversion: 2.1 time: 0.343101 Oct 12 22:12:11.807761 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1440/3241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:11 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1608 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:11.840615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-18f2f5cb-c741-4ef0-a11a-f1f39481c50d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:11.841263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-18f2f5cb-c741-4ef0-a11a-f1f39481c50d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:11.852780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f2f5cb-c741-4ef0-a11a-f1f39481c50d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:11.853282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f2f5cb-c741-4ef0-a11a-f1f39481c50d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:11.854155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f2f5cb-c741-4ef0-a11a-f1f39481c50d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:11.856241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f2f5cb-c741-4ef0-a11a-f1f39481c50d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:11.862632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d1f9e7cd-9de1-4790-81ba-34528b05ed93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:11.866111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f2f5cb-c741-4ef0-a11a-f1f39481c50d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:11.868098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f2f5cb-c741-4ef0-a11a-f1f39481c50d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:11.873371 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d1f9e7cd-9de1-4790-81ba-34528b05ed93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 200 len: 1681 microversion: 2.1 time: 0.363246 Oct 12 22:12:11.877838 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1802/3242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:11 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 1681 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:11.882552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c459c378-cf4c-4224-849b-1c622caa2fcc tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Action: 'create', calling method: .version_select at 0x7f5123121430>, body: {"pool": null} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:12.191675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-18f2f5cb-c741-4ef0-a11a-f1f39481c50d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:12.208394 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-18f2f5cb-c741-4ef0-a11a-f1f39481c50d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 0.380290 Oct 12 22:12:12.211930 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1441/3243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:11 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:12.237433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-194a034b-f1da-4b1c-acbb-0657e22df49d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:12.241373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-194a034b-f1da-4b1c-acbb-0657e22df49d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:12.265453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-194a034b-f1da-4b1c-acbb-0657e22df49d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:12.268025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-194a034b-f1da-4b1c-acbb-0657e22df49d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:12.268610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-194a034b-f1da-4b1c-acbb-0657e22df49d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:12.269348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-194a034b-f1da-4b1c-acbb-0657e22df49d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:12.271865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-194a034b-f1da-4b1c-acbb-0657e22df49d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:12.272307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-194a034b-f1da-4b1c-acbb-0657e22df49d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:12.858554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-194a034b-f1da-4b1c-acbb-0657e22df49d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:12.868290 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-194a034b-f1da-4b1c-acbb-0657e22df49d tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1674 microversion: 2.1 time: 0.651411 Oct 12 22:12:12.887138 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1442/3244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:12 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1674 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:12.894957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-870a8520-14ae-4988-a3be-343dac1bfe9f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:12.905145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-870a8520-14ae-4988-a3be-343dac1bfe9f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:12.913833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-870a8520-14ae-4988-a3be-343dac1bfe9f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:12.914977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-870a8520-14ae-4988-a3be-343dac1bfe9f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:12.915688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-870a8520-14ae-4988-a3be-343dac1bfe9f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:12.916574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-870a8520-14ae-4988-a3be-343dac1bfe9f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:12.917178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-870a8520-14ae-4988-a3be-343dac1bfe9f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:12.917754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-870a8520-14ae-4988-a3be-343dac1bfe9f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:12.991966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-870a8520-14ae-4988-a3be-343dac1bfe9f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:12.992755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-870a8520-14ae-4988-a3be-343dac1bfe9f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:12.993345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-870a8520-14ae-4988-a3be-343dac1bfe9f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:12.994239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-870a8520-14ae-4988-a3be-343dac1bfe9f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lazy-loading 'fault' on Instance uuid c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:12:13.180964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-870a8520-14ae-4988-a3be-343dac1bfe9f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:13.192236 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-870a8520-14ae-4988-a3be-343dac1bfe9f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 200 len: 1307 microversion: 2.1 time: 0.303565 Oct 12 22:12:13.210639 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1443/3245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:12 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 1307 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:13.221985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6d9cebf2-8e47-4f27-aa83-2f79d72cd135 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:13.226126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6d9cebf2-8e47-4f27-aa83-2f79d72cd135 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:13.241113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d9cebf2-8e47-4f27-aa83-2f79d72cd135 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:13.241639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d9cebf2-8e47-4f27-aa83-2f79d72cd135 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:13.242294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d9cebf2-8e47-4f27-aa83-2f79d72cd135 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:13.245121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d9cebf2-8e47-4f27-aa83-2f79d72cd135 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:13.247648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d9cebf2-8e47-4f27-aa83-2f79d72cd135 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:13.248638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d9cebf2-8e47-4f27-aa83-2f79d72cd135 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:13.586282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6d9cebf2-8e47-4f27-aa83-2f79d72cd135 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:13.597324 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6d9cebf2-8e47-4f27-aa83-2f79d72cd135 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1289 microversion: 2.1 time: 0.382872 Oct 12 22:12:13.619762 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1444/3246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:13 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1289 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:13.633954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bfa8c922-4324-4cc5-81fe-313fa68c70be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:13.638189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bfa8c922-4324-4cc5-81fe-313fa68c70be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:13.652270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfa8c922-4324-4cc5-81fe-313fa68c70be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:13.653068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfa8c922-4324-4cc5-81fe-313fa68c70be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:13.656602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfa8c922-4324-4cc5-81fe-313fa68c70be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:13.657556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfa8c922-4324-4cc5-81fe-313fa68c70be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:13.658317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfa8c922-4324-4cc5-81fe-313fa68c70be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:13.658907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfa8c922-4324-4cc5-81fe-313fa68c70be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:15.307697 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c459c378-cf4c-4224-849b-1c622caa2fcc tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.428719 Oct 12 22:12:15.308900 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1803/3247] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 12 22:12:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:15.316374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-83f69169-35fd-4277-bcfe-c8a3213c8ccc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:15.318619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-83f69169-35fd-4277-bcfe-c8a3213c8ccc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:15.355716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83f69169-35fd-4277-bcfe-c8a3213c8ccc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:15.358741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83f69169-35fd-4277-bcfe-c8a3213c8ccc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:15.359481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83f69169-35fd-4277-bcfe-c8a3213c8ccc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:15.363177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83f69169-35fd-4277-bcfe-c8a3213c8ccc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:15.363877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83f69169-35fd-4277-bcfe-c8a3213c8ccc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:15.364560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83f69169-35fd-4277-bcfe-c8a3213c8ccc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:15.470775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83f69169-35fd-4277-bcfe-c8a3213c8ccc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:15.472636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83f69169-35fd-4277-bcfe-c8a3213c8ccc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:15.472922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83f69169-35fd-4277-bcfe-c8a3213c8ccc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:15.473384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-83f69169-35fd-4277-bcfe-c8a3213c8ccc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lazy-loading 'fault' on Instance uuid e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:12:15.544922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bfa8c922-4324-4cc5-81fe-313fa68c70be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:15.559393 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bfa8c922-4324-4cc5-81fe-313fa68c70be tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1608 microversion: 2.1 time: 1.937279 Oct 12 22:12:15.575562 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1445/3248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:13 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1608 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:15.579081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a443cf8c-d26f-438d-8b10-d3d7e78f60af tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:15.584468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a443cf8c-d26f-438d-8b10-d3d7e78f60af tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:15.598735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a443cf8c-d26f-438d-8b10-d3d7e78f60af tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:15.599757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a443cf8c-d26f-438d-8b10-d3d7e78f60af tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:15.600201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a443cf8c-d26f-438d-8b10-d3d7e78f60af tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:15.600917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a443cf8c-d26f-438d-8b10-d3d7e78f60af tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:15.612593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a443cf8c-d26f-438d-8b10-d3d7e78f60af tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:15.613279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a443cf8c-d26f-438d-8b10-d3d7e78f60af tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:15.620050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-83f69169-35fd-4277-bcfe-c8a3213c8ccc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:15.638432 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-83f69169-35fd-4277-bcfe-c8a3213c8ccc tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 200 len: 1330 microversion: 2.1 time: 0.327861 Oct 12 22:12:15.642905 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1804/3249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:15 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 1330 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:15.668481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1839f601-6906-4e1a-b4e0-98ed4795f5a1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:15.669019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1839f601-6906-4e1a-b4e0-98ed4795f5a1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:15.712752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1839f601-6906-4e1a-b4e0-98ed4795f5a1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:15.715321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1839f601-6906-4e1a-b4e0-98ed4795f5a1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:15.715815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1839f601-6906-4e1a-b4e0-98ed4795f5a1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:15.726130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1839f601-6906-4e1a-b4e0-98ed4795f5a1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:15.726799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1839f601-6906-4e1a-b4e0-98ed4795f5a1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:15.727278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1839f601-6906-4e1a-b4e0-98ed4795f5a1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:16.125962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1839f601-6906-4e1a-b4e0-98ed4795f5a1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:16.139447 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1839f601-6906-4e1a-b4e0-98ed4795f5a1 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1674 microversion: 2.1 time: 0.493111 Oct 12 22:12:16.155344 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1805/3250] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:15 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1674 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:16.155344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8ed5e507-db64-4d02-a0f7-f6e5dd3a47e4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:16.155344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8ed5e507-db64-4d02-a0f7-f6e5dd3a47e4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: c60ad5e1-e69b-4dd0-8745-b47ba9b70a02] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:16.155860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ed5e507-db64-4d02-a0f7-f6e5dd3a47e4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:16.156356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ed5e507-db64-4d02-a0f7-f6e5dd3a47e4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:16.156789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ed5e507-db64-4d02-a0f7-f6e5dd3a47e4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:16.157488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ed5e507-db64-4d02-a0f7-f6e5dd3a47e4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:16.157936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ed5e507-db64-4d02-a0f7-f6e5dd3a47e4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:16.158356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ed5e507-db64-4d02-a0f7-f6e5dd3a47e4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:16.177683 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-8ed5e507-db64-4d02-a0f7-f6e5dd3a47e4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] HTTP exception thrown: Instance c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 could not be found. Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8ed5e507-db64-4d02-a0f7-f6e5dd3a47e4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Request method failure captured: Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 HTTP/1.1 Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzr98Hx3HSZUwq13XuvkKDPq0Iz5m-bV7cM398dlrUOClDHZvKrry9jEBmFlbHSmTggU-8Kzhn-tq2F0pNUWaJ0dz4mTrYT4WEggz5nFy73h3CWXJWY0xrriAWPLgFsaD4ELYtj-jFuaZbDIGMPZ-s-9QASFcLZt-WruPxAE5oPSHB0 Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1da6fbca378a43c6b71b9b1b2fa1bc7c Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1da6fbca378a43c6b71b9b1b2fa1bc7c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1da6fbca378a43c6b71b9b1b2fa1bc7c Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersOnMultiNodesTest-2073144359-project Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7a8e7139c1694698a5fde98743165501 Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersOnMultiNodesTest-2073144359-project Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 could not be found. Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'c60ad5e1-e69b-4dd0-8745-b47ba9b70a02'} Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 could not be found. Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 could not be found. Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:16.179949 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:16.185188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:16.185188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:16.185188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:16.185188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:12:16.185188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:12:16.185188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 could not be found. Oct 12 22:12:16.185188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:16.185188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8ed5e507-db64-4d02-a0f7-f6e5dd3a47e4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Returning 404 to user: Instance c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:12:16.185188 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8ed5e507-db64-4d02-a0f7-f6e5dd3a47e4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02" status: 404 len: 111 microversion: 2.1 time: 0.040083 Oct 12 22:12:16.185188 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1806/3251] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:16 2022] GET /compute/v2.1/servers/c60ad5e1-e69b-4dd0-8745-b47ba9b70a02 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:12:16.213225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0f111955-fe7e-4870-a71d-55223119dcaf tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:16.213881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0f111955-fe7e-4870-a71d-55223119dcaf tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:16.238178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f111955-fe7e-4870-a71d-55223119dcaf tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:16.242536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f111955-fe7e-4870-a71d-55223119dcaf tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:16.243154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f111955-fe7e-4870-a71d-55223119dcaf tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:16.244284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f111955-fe7e-4870-a71d-55223119dcaf tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:16.244830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f111955-fe7e-4870-a71d-55223119dcaf tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:16.256008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f111955-fe7e-4870-a71d-55223119dcaf tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:16.304333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:16.539946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a443cf8c-d26f-438d-8b10-d3d7e78f60af tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:16.552122 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a443cf8c-d26f-438d-8b10-d3d7e78f60af tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 0.984322 Oct 12 22:12:16.557906 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1446/3252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:15 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:16.575703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-ac3ea04a-6e9d-4e19-9558-b75417583354 req-e6c56a76-8fbe-4546-8b73-21b8aea1bcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2", "name": "network-vif-deleted", "tag": "4786efcb-bf77-4622-9cea-64620dc6221b"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:16.599481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ac3ea04a-6e9d-4e19-9558-b75417583354 req-e6c56a76-8fbe-4546-8b73-21b8aea1bcd0 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:16.600308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ac3ea04a-6e9d-4e19-9558-b75417583354 req-e6c56a76-8fbe-4546-8b73-21b8aea1bcd0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:16.600674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0f111955-fe7e-4870-a71d-55223119dcaf tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:16.601996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ac3ea04a-6e9d-4e19-9558-b75417583354 req-e6c56a76-8fbe-4546-8b73-21b8aea1bcd0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:16.622771 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-ac3ea04a-6e9d-4e19-9558-b75417583354 req-e6c56a76-8fbe-4546-8b73-21b8aea1bcd0 service nova] Creating event network-vif-deleted:4786efcb-bf77-4622-9cea-64620dc6221b for instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 on n-h2-861111-1 Oct 12 22:12:16.629372 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-ac3ea04a-6e9d-4e19-9558-b75417583354 req-e6c56a76-8fbe-4546-8b73-21b8aea1bcd0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068523 Oct 12 22:12:16.631815 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1447/3253] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:16.635352 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0f111955-fe7e-4870-a71d-55223119dcaf tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1331 microversion: 2.1 time: 0.428473 Oct 12 22:12:16.638876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-289187682", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "709423db-695b-4953-a10f-b3358d5669f7"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:16.648083 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1807/3254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:16 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1331 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:16.654171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b637ba8f-3c7b-4286-ba8f-99c557eea2a4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:16.654880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b637ba8f-3c7b-4286-ba8f-99c557eea2a4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:16.670214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b637ba8f-3c7b-4286-ba8f-99c557eea2a4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:16.671569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b637ba8f-3c7b-4286-ba8f-99c557eea2a4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:16.671828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b637ba8f-3c7b-4286-ba8f-99c557eea2a4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:16.672673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b637ba8f-3c7b-4286-ba8f-99c557eea2a4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:16.673138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b637ba8f-3c7b-4286-ba8f-99c557eea2a4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:16.673572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b637ba8f-3c7b-4286-ba8f-99c557eea2a4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:16.726522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] validate_networks() for [('709423db-695b-4953-a10f-b3358d5669f7', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:12:16.748091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b637ba8f-3c7b-4286-ba8f-99c557eea2a4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:12:16.814715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:16.870707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:16.908102 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b637ba8f-3c7b-4286-ba8f-99c557eea2a4 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 204 len: 0 microversion: 2.1 time: 0.258132 Oct 12 22:12:16.909338 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1808/3255] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:12:16 2022] DELETE /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:12:16.917372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-21a078f8-33c6-45d6-b4b3-6e67cd876f0e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:16.918288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-21a078f8-33c6-45d6-b4b3-6e67cd876f0e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:16.926185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a078f8-33c6-45d6-b4b3-6e67cd876f0e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:16.927264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a078f8-33c6-45d6-b4b3-6e67cd876f0e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:16.927797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a078f8-33c6-45d6-b4b3-6e67cd876f0e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:16.928528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a078f8-33c6-45d6-b4b3-6e67cd876f0e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:16.929018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a078f8-33c6-45d6-b4b3-6e67cd876f0e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:16.929454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21a078f8-33c6-45d6-b4b3-6e67cd876f0e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:17.089916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-21a078f8-33c6-45d6-b4b3-6e67cd876f0e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:17.110057 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-21a078f8-33c6-45d6-b4b3-6e67cd876f0e tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1541 microversion: 2.1 time: 0.199123 Oct 12 22:12:17.112197 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1809/3256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:16 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1541 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:17.118371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-90d7b6d7-02d1-470e-933b-ff5017065515 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:17.119986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-90d7b6d7-02d1-470e-933b-ff5017065515 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:17.140591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90d7b6d7-02d1-470e-933b-ff5017065515 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:17.141495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90d7b6d7-02d1-470e-933b-ff5017065515 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:17.142086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90d7b6d7-02d1-470e-933b-ff5017065515 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:17.143117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90d7b6d7-02d1-470e-933b-ff5017065515 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:17.144018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90d7b6d7-02d1-470e-933b-ff5017065515 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:17.144592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90d7b6d7-02d1-470e-933b-ff5017065515 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:17.170163 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-90d7b6d7-02d1-470e-933b-ff5017065515 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] HTTP exception thrown: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-90d7b6d7-02d1-470e-933b-ff5017065515 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Request method failure captured: Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 HTTP/1.1 Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzoV3foVnGv0suVxK_Nk7Pp5_kjAPhL8yzVHClSGl5RRxDIZH7rcf5PLHi4YXEet-A0AtHcDaHpFcS_aQR9wl8soXuphQXdzTm1zPCiMI4BUWAPu4l1z3R9DkYDtzHZhHRlT-3CEyzuxgoolPW6Gw8glco6cFnu099ScND31HIZBEC4 Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68913d260d084ce4a8e29daf4783c0bc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 13c74a78e82f4e72a7d1f7b133074f5a Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2'} Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:17.171900 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:17.176312 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:17.176312 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:17.176312 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:17.176312 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:12:17.176312 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:12:17.176312 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. Oct 12 22:12:17.176312 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:17.176312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-90d7b6d7-02d1-470e-933b-ff5017065515 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Returning 404 to user: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:12:17.176312 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-90d7b6d7-02d1-470e-933b-ff5017065515 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 404 len: 111 microversion: 2.1 time: 0.059845 Oct 12 22:12:17.178803 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1810/3257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:17 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:12:17.184745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-24641542-ea02-49d1-a4fe-67a8dd48fcf3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:17.185360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-24641542-ea02-49d1-a4fe-67a8dd48fcf3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:17.198592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24641542-ea02-49d1-a4fe-67a8dd48fcf3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:17.199500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24641542-ea02-49d1-a4fe-67a8dd48fcf3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:17.200688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24641542-ea02-49d1-a4fe-67a8dd48fcf3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:17.202439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24641542-ea02-49d1-a4fe-67a8dd48fcf3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:17.202917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24641542-ea02-49d1-a4fe-67a8dd48fcf3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:17.203386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24641542-ea02-49d1-a4fe-67a8dd48fcf3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:17.426620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-24641542-ea02-49d1-a4fe-67a8dd48fcf3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:17.441630 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-24641542-ea02-49d1-a4fe-67a8dd48fcf3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1472 microversion: 2.1 time: 0.257652 Oct 12 22:12:17.456261 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1811/3258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:17 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1472 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:17.466521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-62968e86-13a5-430e-9461-ed8a6b5540ef tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:17.466883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-62968e86-13a5-430e-9461-ed8a6b5540ef tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:17.477364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62968e86-13a5-430e-9461-ed8a6b5540ef tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:17.477480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62968e86-13a5-430e-9461-ed8a6b5540ef tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:17.477844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62968e86-13a5-430e-9461-ed8a6b5540ef tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:17.478557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62968e86-13a5-430e-9461-ed8a6b5540ef tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:17.479030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62968e86-13a5-430e-9461-ed8a6b5540ef tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:17.479497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62968e86-13a5-430e-9461-ed8a6b5540ef tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:17.700460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-62968e86-13a5-430e-9461-ed8a6b5540ef tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:17.744431 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-62968e86-13a5-430e-9461-ed8a6b5540ef tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1653 microversion: 2.1 time: 0.286719 Oct 12 22:12:17.765677 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1812/3259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:17 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1653 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:17.774733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cdd0642d-9446-43c6-ad87-68e0fc8df4a7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '.version_select at 0x7f5123090ee0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:17.834521 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cdd0642d-9446-43c6-ad87-68e0fc8df4a7 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-989260750" status: 202 len: 0 microversion: 2.1 time: 0.066626 Oct 12 22:12:17.835117 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1813/3260] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 12 22:12:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-989260750 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:12:17.843063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-232cea03-9792-4459-9eee-669396c47395 req-e0ffa916-6e59-4ee7-9933-7448e4a68f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "111af739-6af4-48aa-b0c4-2e891131a11c", "name": "network-vif-deleted", "tag": "ac1836d2-2559-4a35-9a8d-f73a71674266"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:17.869199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-232cea03-9792-4459-9eee-669396c47395 req-e0ffa916-6e59-4ee7-9933-7448e4a68f8a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:17.869682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-232cea03-9792-4459-9eee-669396c47395 req-e0ffa916-6e59-4ee7-9933-7448e4a68f8a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:17.870223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-232cea03-9792-4459-9eee-669396c47395 req-e0ffa916-6e59-4ee7-9933-7448e4a68f8a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:17.899954 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-232cea03-9792-4459-9eee-669396c47395 req-e0ffa916-6e59-4ee7-9933-7448e4a68f8a service nova] Creating event network-vif-deleted:ac1836d2-2559-4a35-9a8d-f73a71674266 for instance 111af739-6af4-48aa-b0c4-2e891131a11c on n-h2-861111-1 Oct 12 22:12:17.907113 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-232cea03-9792-4459-9eee-669396c47395 req-e0ffa916-6e59-4ee7-9933-7448e4a68f8a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070695 Oct 12 22:12:17.908585 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1814/3261] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:17.914678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-47430ed0-d77a-4dad-8758-921ce7d639ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:17.915844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-47430ed0-d77a-4dad-8758-921ce7d639ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:17.923354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47430ed0-d77a-4dad-8758-921ce7d639ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:17.923851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47430ed0-d77a-4dad-8758-921ce7d639ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:17.924285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47430ed0-d77a-4dad-8758-921ce7d639ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:17.924986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47430ed0-d77a-4dad-8758-921ce7d639ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:17.925437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47430ed0-d77a-4dad-8758-921ce7d639ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:17.926897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47430ed0-d77a-4dad-8758-921ce7d639ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:18.072873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:12:18.074491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:12:18.075361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:12:18.075776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:12:18.076236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:12:18.106116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:18.106617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:18.107057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:18.107815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:18.108274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:18.108705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:18.130737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-47430ed0-d77a-4dad-8758-921ce7d639ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:18.147674 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-47430ed0-d77a-4dad-8758-921ce7d639ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 0.237880 Oct 12 22:12:18.150607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Getting quotas for project b201054c71d241ee8b130a9b0a014cf6. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:12:18.161266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Getting quotas for user 94f72337548c4724bf3f4c1009221120 and project b201054c71d241ee8b130a9b0a014cf6. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:12:18.164660 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1815/3262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:17 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:18.182374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6d5558b0-932d-4ded-ad30-4520c1090075 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:18.183003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6d5558b0-932d-4ded-ad30-4520c1090075 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:18.184482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:12:18.188358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:12:18.207154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d5558b0-932d-4ded-ad30-4520c1090075 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:18.219985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d5558b0-932d-4ded-ad30-4520c1090075 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:18.220612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d5558b0-932d-4ded-ad30-4520c1090075 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:18.221495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d5558b0-932d-4ded-ad30-4520c1090075 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:18.222071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d5558b0-932d-4ded-ad30-4520c1090075 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:18.222634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d5558b0-932d-4ded-ad30-4520c1090075 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:18.281938 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b68c353c-0cb3-499a-813b-d0b8d96fe1c3 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.648038 Oct 12 22:12:18.288795 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1448/3263] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:12:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:12:18.293748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4da3c76c-6386-4d4d-9291-c2100237cf3a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:18.294377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4da3c76c-6386-4d4d-9291-c2100237cf3a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:18.313007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4da3c76c-6386-4d4d-9291-c2100237cf3a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:18.313503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4da3c76c-6386-4d4d-9291-c2100237cf3a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:18.314163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4da3c76c-6386-4d4d-9291-c2100237cf3a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:18.321098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4da3c76c-6386-4d4d-9291-c2100237cf3a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:18.321830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4da3c76c-6386-4d4d-9291-c2100237cf3a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:18.322467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4da3c76c-6386-4d4d-9291-c2100237cf3a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:18.456152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:18.554853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4da3c76c-6386-4d4d-9291-c2100237cf3a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:18.558475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:18.578871 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4da3c76c-6386-4d4d-9291-c2100237cf3a tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1541 microversion: 2.1 time: 0.288872 Oct 12 22:12:18.582734 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1449/3264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:18 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1541 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:18.593797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4c731b23-4a5b-4dfa-95c3-2ed5298588cd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:18.595783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4c731b23-4a5b-4dfa-95c3-2ed5298588cd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:18.678115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6d5558b0-932d-4ded-ad30-4520c1090075 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:18.689877 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6d5558b0-932d-4ded-ad30-4520c1090075 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1331 microversion: 2.1 time: 0.524045 Oct 12 22:12:18.691522 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1816/3265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:18 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1331 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:18.734317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-15b8fe51-f08c-4c2d-a834-d43ec9c1ef79 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:18.734957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-15b8fe51-f08c-4c2d-a834-d43ec9c1ef79 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:18.766105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15b8fe51-f08c-4c2d-a834-d43ec9c1ef79 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:18.766627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15b8fe51-f08c-4c2d-a834-d43ec9c1ef79 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:18.767070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15b8fe51-f08c-4c2d-a834-d43ec9c1ef79 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:18.767819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15b8fe51-f08c-4c2d-a834-d43ec9c1ef79 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:18.768268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15b8fe51-f08c-4c2d-a834-d43ec9c1ef79 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:18.776943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15b8fe51-f08c-4c2d-a834-d43ec9c1ef79 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:19.169310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4c731b23-4a5b-4dfa-95c3-2ed5298588cd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:19.182347 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4c731b23-4a5b-4dfa-95c3-2ed5298588cd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" status: 200 len: 1223 microversion: 2.1 time: 0.595536 Oct 12 22:12:19.182919 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1450/3266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:18 2022] GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 => generated 1223 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:19.187652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8fda33ea-a453-4faf-a6eb-579dc1fc636a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:19.188271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8fda33ea-a453-4faf-a6eb-579dc1fc636a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:19.220838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fda33ea-a453-4faf-a6eb-579dc1fc636a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:19.221251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fda33ea-a453-4faf-a6eb-579dc1fc636a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:19.221696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fda33ea-a453-4faf-a6eb-579dc1fc636a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:19.222417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fda33ea-a453-4faf-a6eb-579dc1fc636a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:19.222877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fda33ea-a453-4faf-a6eb-579dc1fc636a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:19.223337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fda33ea-a453-4faf-a6eb-579dc1fc636a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:19.476134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-15b8fe51-f08c-4c2d-a834-d43ec9c1ef79 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:19.490200 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-15b8fe51-f08c-4c2d-a834-d43ec9c1ef79 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1472 microversion: 2.1 time: 0.796995 Oct 12 22:12:19.491032 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1817/3267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:18 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1472 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:19.519444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8fda33ea-a453-4faf-a6eb-579dc1fc636a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:19.522916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:19.524743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1931e3b4-2560-4cd7-b883-e5d007dd663b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:19.525486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1931e3b4-2560-4cd7-b883-e5d007dd663b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:19.531290 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8fda33ea-a453-4faf-a6eb-579dc1fc636a tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1496 microversion: 2.1 time: 0.343587 Oct 12 22:12:19.532644 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1451/3268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:19 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1496 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:19.549372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1931e3b4-2560-4cd7-b883-e5d007dd663b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:19.549874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1931e3b4-2560-4cd7-b883-e5d007dd663b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:19.550319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1931e3b4-2560-4cd7-b883-e5d007dd663b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:19.551029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1931e3b4-2560-4cd7-b883-e5d007dd663b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:19.551509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1931e3b4-2560-4cd7-b883-e5d007dd663b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:19.552495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1931e3b4-2560-4cd7-b883-e5d007dd663b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:19.610565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-34948142-403d-4daa-85c3-be300226f56c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:19.611475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-34948142-403d-4daa-85c3-be300226f56c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:19.623297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34948142-403d-4daa-85c3-be300226f56c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:19.626019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34948142-403d-4daa-85c3-be300226f56c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:19.626650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34948142-403d-4daa-85c3-be300226f56c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:19.638749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34948142-403d-4daa-85c3-be300226f56c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:19.639573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34948142-403d-4daa-85c3-be300226f56c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:19.640297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34948142-403d-4daa-85c3-be300226f56c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:19.782526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-34948142-403d-4daa-85c3-be300226f56c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:19.798448 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-34948142-403d-4daa-85c3-be300226f56c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1252 microversion: 2.1 time: 0.192296 Oct 12 22:12:19.812924 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1452/3269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:19 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1252 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:12:19.831286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8a7dbe4d-3508-4df1-b4cb-263d0dd7ac28 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:19.832013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8a7dbe4d-3508-4df1-b4cb-263d0dd7ac28 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:19.846442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a7dbe4d-3508-4df1-b4cb-263d0dd7ac28 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:19.846970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a7dbe4d-3508-4df1-b4cb-263d0dd7ac28 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:19.847455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a7dbe4d-3508-4df1-b4cb-263d0dd7ac28 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:19.848223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a7dbe4d-3508-4df1-b4cb-263d0dd7ac28 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:19.848778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a7dbe4d-3508-4df1-b4cb-263d0dd7ac28 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:19.849246 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a7dbe4d-3508-4df1-b4cb-263d0dd7ac28 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:20.355940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1931e3b4-2560-4cd7-b883-e5d007dd663b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:20.368505 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1931e3b4-2560-4cd7-b883-e5d007dd663b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 0.876495 Oct 12 22:12:20.376285 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1818/3270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:19 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:20.408299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-ac1f58f0-9dbc-4eca-9ef6-31373fb0d738 req-4de187cd-1de9-4163-885a-4d13f5a506bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55c3cea-33ea-435c-84b3-f668bd000c8c", "name": "network-vif-deleted", "tag": "f17c481a-e1dd-4e92-afef-f445e4724b1c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:20.427766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ac1f58f0-9dbc-4eca-9ef6-31373fb0d738 req-4de187cd-1de9-4163-885a-4d13f5a506bb service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:20.428480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ac1f58f0-9dbc-4eca-9ef6-31373fb0d738 req-4de187cd-1de9-4163-885a-4d13f5a506bb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:20.429098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ac1f58f0-9dbc-4eca-9ef6-31373fb0d738 req-4de187cd-1de9-4163-885a-4d13f5a506bb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:20.441554 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-ac1f58f0-9dbc-4eca-9ef6-31373fb0d738 req-4de187cd-1de9-4163-885a-4d13f5a506bb service nova] Creating event network-vif-deleted:f17c481a-e1dd-4e92-afef-f445e4724b1c for instance f55c3cea-33ea-435c-84b3-f668bd000c8c on n-h1-861111-1 Oct 12 22:12:20.457106 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-ac1f58f0-9dbc-4eca-9ef6-31373fb0d738 req-4de187cd-1de9-4163-885a-4d13f5a506bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079486 Oct 12 22:12:20.458630 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1819/3271] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:20.464335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-39905b35-98a7-4201-99d1-ae17faf6eefd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:20.465353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-39905b35-98a7-4201-99d1-ae17faf6eefd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:20.483224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39905b35-98a7-4201-99d1-ae17faf6eefd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:20.489034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39905b35-98a7-4201-99d1-ae17faf6eefd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:20.490027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39905b35-98a7-4201-99d1-ae17faf6eefd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:20.490961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39905b35-98a7-4201-99d1-ae17faf6eefd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:20.491225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39905b35-98a7-4201-99d1-ae17faf6eefd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:20.491682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39905b35-98a7-4201-99d1-ae17faf6eefd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:20.697778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-39905b35-98a7-4201-99d1-ae17faf6eefd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:20.705945 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-39905b35-98a7-4201-99d1-ae17faf6eefd tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" status: 200 len: 1275 microversion: 2.1 time: 0.245595 Oct 12 22:12:20.706544 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1820/3272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:20 2022] GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 => generated 1275 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:20.720182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c0213885-7559-4b76-a431-8a79bbc8086c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:20.740606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c0213885-7559-4b76-a431-8a79bbc8086c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:20.747218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0213885-7559-4b76-a431-8a79bbc8086c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:20.752766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0213885-7559-4b76-a431-8a79bbc8086c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:20.753474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0213885-7559-4b76-a431-8a79bbc8086c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:20.754431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0213885-7559-4b76-a431-8a79bbc8086c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:20.755750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0213885-7559-4b76-a431-8a79bbc8086c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:20.762182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0213885-7559-4b76-a431-8a79bbc8086c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:20.896585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c0213885-7559-4b76-a431-8a79bbc8086c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:20.904854 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c0213885-7559-4b76-a431-8a79bbc8086c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1430 microversion: 2.1 time: 0.188372 Oct 12 22:12:20.912162 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1821/3273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:20 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1430 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:20.924408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b7c1e9f6-8d1d-481b-8492-62fa517374cf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:20.925389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b7c1e9f6-8d1d-481b-8492-62fa517374cf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:20.942406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7c1e9f6-8d1d-481b-8492-62fa517374cf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:20.948247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7c1e9f6-8d1d-481b-8492-62fa517374cf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:20.955891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7c1e9f6-8d1d-481b-8492-62fa517374cf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:20.956968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7c1e9f6-8d1d-481b-8492-62fa517374cf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:20.960192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7c1e9f6-8d1d-481b-8492-62fa517374cf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:20.960872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7c1e9f6-8d1d-481b-8492-62fa517374cf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:21.165490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b7c1e9f6-8d1d-481b-8492-62fa517374cf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:21.179182 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b7c1e9f6-8d1d-481b-8492-62fa517374cf tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1454 microversion: 2.1 time: 0.264380 Oct 12 22:12:21.195356 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1822/3274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:20 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1454 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:21.196202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8a843e91-7083-45e9-90d0-7e6151856d3c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:21.199020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8a843e91-7083-45e9-90d0-7e6151856d3c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:21.222691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a843e91-7083-45e9-90d0-7e6151856d3c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:21.223865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a843e91-7083-45e9-90d0-7e6151856d3c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:21.224535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a843e91-7083-45e9-90d0-7e6151856d3c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:21.225655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a843e91-7083-45e9-90d0-7e6151856d3c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:21.226374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a843e91-7083-45e9-90d0-7e6151856d3c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:21.227011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a843e91-7083-45e9-90d0-7e6151856d3c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:21.528449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8a7dbe4d-3508-4df1-b4cb-263d0dd7ac28 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:21.554050 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8a7dbe4d-3508-4df1-b4cb-263d0dd7ac28 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1331 microversion: 2.1 time: 1.739717 Oct 12 22:12:21.574296 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1453/3275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:19 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1331 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:21.598304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ede3fdd4-7967-4633-92cc-255fa51e418e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:21.608006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ede3fdd4-7967-4633-92cc-255fa51e418e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:21.630154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ede3fdd4-7967-4633-92cc-255fa51e418e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:21.637473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ede3fdd4-7967-4633-92cc-255fa51e418e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:21.640542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ede3fdd4-7967-4633-92cc-255fa51e418e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:21.641535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ede3fdd4-7967-4633-92cc-255fa51e418e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:21.643096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ede3fdd4-7967-4633-92cc-255fa51e418e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:21.646493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ede3fdd4-7967-4633-92cc-255fa51e418e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:21.999019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8a843e91-7083-45e9-90d0-7e6151856d3c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:22.022752 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8a843e91-7083-45e9-90d0-7e6151856d3c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1252 microversion: 2.1 time: 0.825965 Oct 12 22:12:22.024444 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1823/3276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:21 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1252 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:22.063304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-89837e58-bb3a-4995-baf4-f0c14b4a4bef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:22.064334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-89837e58-bb3a-4995-baf4-f0c14b4a4bef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:22.077743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89837e58-bb3a-4995-baf4-f0c14b4a4bef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:22.078602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89837e58-bb3a-4995-baf4-f0c14b4a4bef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:22.079395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89837e58-bb3a-4995-baf4-f0c14b4a4bef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:22.080408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89837e58-bb3a-4995-baf4-f0c14b4a4bef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:22.081115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89837e58-bb3a-4995-baf4-f0c14b4a4bef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:22.081800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89837e58-bb3a-4995-baf4-f0c14b4a4bef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:22.251989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-89837e58-bb3a-4995-baf4-f0c14b4a4bef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:22.268260 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-89837e58-bb3a-4995-baf4-f0c14b4a4bef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" status: 200 len: 1281 microversion: 2.1 time: 0.234534 Oct 12 22:12:22.270128 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1824/3277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:22 2022] GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 => generated 1281 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:22.284696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4c92d6b6-c147-4c0f-bbe7-299887f19770 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:22.289706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4c92d6b6-c147-4c0f-bbe7-299887f19770 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:22.309015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c92d6b6-c147-4c0f-bbe7-299887f19770 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:22.313026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c92d6b6-c147-4c0f-bbe7-299887f19770 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:22.317302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c92d6b6-c147-4c0f-bbe7-299887f19770 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:22.318205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c92d6b6-c147-4c0f-bbe7-299887f19770 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:22.322612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c92d6b6-c147-4c0f-bbe7-299887f19770 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:22.323424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c92d6b6-c147-4c0f-bbe7-299887f19770 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:22.391226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:22.424574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ede3fdd4-7967-4633-92cc-255fa51e418e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:22.432593 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ede3fdd4-7967-4633-92cc-255fa51e418e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1683 microversion: 2.1 time: 0.850105 Oct 12 22:12:22.436164 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1454/3278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:21 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1683 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:22.444904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-46179af2-7d80-48f6-b22a-089a411d5bd5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Action: 'create', calling method: .version_select at 0x7f51236ecb80>, body: {"keypair": {"name": "tempest-keypair-1428081210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1QQGIf+CZjnmhNanJHNIN3ZB9MBSwN0QhFO/CfzUG4rqiDmIIpL/DDgzDwn4neV7wc4/La9+c71ZMnsQX+XH9ttr0MF42bBCHiIJYACWnve4sutcP4oZlkaZ4JiN9n0A=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:22.463209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-46179af2-7d80-48f6-b22a-089a411d5bd5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Getting quotas for project 68913d260d084ce4a8e29daf4783c0bc. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:12:22.468401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-46179af2-7d80-48f6-b22a-089a411d5bd5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Getting quotas for user 13c74a78e82f4e72a7d1f7b133074f5a and project 68913d260d084ce4a8e29daf4783c0bc. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:12:22.495902 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-46179af2-7d80-48f6-b22a-089a411d5bd5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056900 Oct 12 22:12:22.503657 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1455/3279] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:12:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:22.525046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-ab7a4207-124d-492b-8012-17061df3849f req-63c47879-1d6d-4b4c-8dd3-b012c777c3bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9f516c-739e-45d8-afbb-8cb1402afb48", "name": "network-vif-deleted", "tag": "84b34108-a2ff-4c45-8b45-d41cd871c673"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:22.541974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4c92d6b6-c147-4c0f-bbe7-299887f19770 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:22.550478 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4c92d6b6-c147-4c0f-bbe7-299887f19770 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1301 microversion: 2.1 time: 0.275976 Oct 12 22:12:22.556562 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1825/3280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:22 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1301 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:22.571329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ab7a4207-124d-492b-8012-17061df3849f req-63c47879-1d6d-4b4c-8dd3-b012c777c3bd service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:22.574057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ab7a4207-124d-492b-8012-17061df3849f req-63c47879-1d6d-4b4c-8dd3-b012c777c3bd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:22.575218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ab7a4207-124d-492b-8012-17061df3849f req-63c47879-1d6d-4b4c-8dd3-b012c777c3bd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:22.580463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2881626b-c059-46a4-b651-6b59880c63e9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:22.584645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2881626b-c059-46a4-b651-6b59880c63e9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:22.590744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:22.608416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2881626b-c059-46a4-b651-6b59880c63e9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:22.610543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2881626b-c059-46a4-b651-6b59880c63e9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:22.611801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2881626b-c059-46a4-b651-6b59880c63e9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:22.615925 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-ab7a4207-124d-492b-8012-17061df3849f req-63c47879-1d6d-4b4c-8dd3-b012c777c3bd service nova] Creating event network-vif-deleted:84b34108-a2ff-4c45-8b45-d41cd871c673 for instance dd9f516c-739e-45d8-afbb-8cb1402afb48 on n-h2-861111-1 Oct 12 22:12:22.617724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2881626b-c059-46a4-b651-6b59880c63e9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:22.618438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2881626b-c059-46a4-b651-6b59880c63e9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:22.619102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2881626b-c059-46a4-b651-6b59880c63e9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:22.632950 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-ab7a4207-124d-492b-8012-17061df3849f req-63c47879-1d6d-4b4c-8dd3-b012c777c3bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122088 Oct 12 22:12:22.634711 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1456/3281] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:22.642400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9a19c5a3-c301-4413-adea-b6a6a3a2b181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:22.644224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9a19c5a3-c301-4413-adea-b6a6a3a2b181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:22.657167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a19c5a3-c301-4413-adea-b6a6a3a2b181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:22.672364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a19c5a3-c301-4413-adea-b6a6a3a2b181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:22.673569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a19c5a3-c301-4413-adea-b6a6a3a2b181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:22.674625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a19c5a3-c301-4413-adea-b6a6a3a2b181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:22.679962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a19c5a3-c301-4413-adea-b6a6a3a2b181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:22.680735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a19c5a3-c301-4413-adea-b6a6a3a2b181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:22.741759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2881626b-c059-46a4-b651-6b59880c63e9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:22.742353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2881626b-c059-46a4-b651-6b59880c63e9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:22.744643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2881626b-c059-46a4-b651-6b59880c63e9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:22.745398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-2881626b-c059-46a4-b651-6b59880c63e9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lazy-loading 'fault' on Instance uuid 111af739-6af4-48aa-b0c4-2e891131a11c {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:12:22.757524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9a19c5a3-c301-4413-adea-b6a6a3a2b181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:12:22.847799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2881626b-c059-46a4-b651-6b59880c63e9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c5adfbe06184b1e8531545707047456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0287e296f1c9414e81fbd0212bde30ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:22.866368 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2881626b-c059-46a4-b651-6b59880c63e9 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 200 len: 1303 microversion: 2.1 time: 0.306927 Oct 12 22:12:22.869320 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1826/3282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:22 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 1303 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:22.887727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-66ea5b51-e6f8-4dc9-bcb7-9eb52eccc8b7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:22.891494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-66ea5b51-e6f8-4dc9-bcb7-9eb52eccc8b7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:22.904828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66ea5b51-e6f8-4dc9-bcb7-9eb52eccc8b7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:22.905687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66ea5b51-e6f8-4dc9-bcb7-9eb52eccc8b7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:22.906428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66ea5b51-e6f8-4dc9-bcb7-9eb52eccc8b7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:22.907948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66ea5b51-e6f8-4dc9-bcb7-9eb52eccc8b7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:22.909387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66ea5b51-e6f8-4dc9-bcb7-9eb52eccc8b7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:22.910254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66ea5b51-e6f8-4dc9-bcb7-9eb52eccc8b7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:22.929495 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9a19c5a3-c301-4413-adea-b6a6a3a2b181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 204 len: 0 microversion: 2.1 time: 0.292452 Oct 12 22:12:22.930515 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1457/3283] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:12:22 2022] DELETE /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:12:22.945260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-c5104620-5855-49df-a9b4-020168c126a8 req-1d4c7456-61ff-464e-8def-24a1e33cb669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834fccfb-555f-4b47-9c94-eff3997d3dd2", "tag": "52d827f6-3263-45e3-be6b-9e5d6a230519"}, {"server_uuid": "111af739-6af4-48aa-b0c4-2e891131a11c", "name": "network-vif-deleted", "tag": "be7b8151-86c4-44ed-bfe4-84477b980d0a"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:22.950525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:22.974087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c5104620-5855-49df-a9b4-020168c126a8 req-1d4c7456-61ff-464e-8def-24a1e33cb669 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:22.974338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c5104620-5855-49df-a9b4-020168c126a8 req-1d4c7456-61ff-464e-8def-24a1e33cb669 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:22.974978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c5104620-5855-49df-a9b4-020168c126a8 req-1d4c7456-61ff-464e-8def-24a1e33cb669 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:22.993777 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-c5104620-5855-49df-a9b4-020168c126a8 req-1d4c7456-61ff-464e-8def-24a1e33cb669 service nova] Creating event network-changed:52d827f6-3263-45e3-be6b-9e5d6a230519 for instance 834fccfb-555f-4b47-9c94-eff3997d3dd2 on n-h2-861111-1 Oct 12 22:12:22.994720 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-c5104620-5855-49df-a9b4-020168c126a8 req-1d4c7456-61ff-464e-8def-24a1e33cb669 service nova] Creating event network-vif-deleted:be7b8151-86c4-44ed-bfe4-84477b980d0a for instance 111af739-6af4-48aa-b0c4-2e891131a11c on n-h2-861111-1 Oct 12 22:12:23.003219 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-c5104620-5855-49df-a9b4-020168c126a8 req-1d4c7456-61ff-464e-8def-24a1e33cb669 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.070630 Oct 12 22:12:23.004046 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1458/3284] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:23.010224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-75709a02-34ae-49f8-825b-19a4f5495147 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:23.010921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-75709a02-34ae-49f8-825b-19a4f5495147 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:23.021348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75709a02-34ae-49f8-825b-19a4f5495147 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:23.021928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75709a02-34ae-49f8-825b-19a4f5495147 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:23.022419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75709a02-34ae-49f8-825b-19a4f5495147 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:23.023194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75709a02-34ae-49f8-825b-19a4f5495147 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:23.023916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75709a02-34ae-49f8-825b-19a4f5495147 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:23.024344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75709a02-34ae-49f8-825b-19a4f5495147 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:23.146069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-66ea5b51-e6f8-4dc9-bcb7-9eb52eccc8b7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:23.159467 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-66ea5b51-e6f8-4dc9-bcb7-9eb52eccc8b7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1331 microversion: 2.1 time: 0.286852 Oct 12 22:12:23.160200 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1827/3285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:22 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1331 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:23.167140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7f8e11c4-04bf-45c4-beb3-17011e95c128 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:23.167998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7f8e11c4-04bf-45c4-beb3-17011e95c128 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:23.175071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f8e11c4-04bf-45c4-beb3-17011e95c128 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:23.175746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f8e11c4-04bf-45c4-beb3-17011e95c128 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:23.176341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f8e11c4-04bf-45c4-beb3-17011e95c128 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:23.178026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f8e11c4-04bf-45c4-beb3-17011e95c128 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:23.178633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f8e11c4-04bf-45c4-beb3-17011e95c128 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:23.179205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f8e11c4-04bf-45c4-beb3-17011e95c128 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:23.299162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7f8e11c4-04bf-45c4-beb3-17011e95c128 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:23.320411 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7f8e11c4-04bf-45c4-beb3-17011e95c128 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1252 microversion: 2.1 time: 0.158227 Oct 12 22:12:23.323798 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1828/3286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:23 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1252 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:23.337891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0e427162-9832-430d-99aa-a88568cabafb tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:23.343663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0e427162-9832-430d-99aa-a88568cabafb tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:23.415148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e427162-9832-430d-99aa-a88568cabafb tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:23.416185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e427162-9832-430d-99aa-a88568cabafb tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:23.419452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e427162-9832-430d-99aa-a88568cabafb tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:23.422695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e427162-9832-430d-99aa-a88568cabafb tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:23.426814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e427162-9832-430d-99aa-a88568cabafb tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:23.428341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e427162-9832-430d-99aa-a88568cabafb tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:23.467732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-75709a02-34ae-49f8-825b-19a4f5495147 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:23.482371 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-75709a02-34ae-49f8-825b-19a4f5495147 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1552 microversion: 2.1 time: 0.476479 Oct 12 22:12:23.502611 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1459/3287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:23 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1552 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:23.509898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-481f53ed-5430-42c2-a2d1-0f6269c7e2f1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:23.510749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-481f53ed-5430-42c2-a2d1-0f6269c7e2f1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:23.519702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-481f53ed-5430-42c2-a2d1-0f6269c7e2f1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:23.520371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-481f53ed-5430-42c2-a2d1-0f6269c7e2f1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:23.520799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-481f53ed-5430-42c2-a2d1-0f6269c7e2f1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:23.525343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-481f53ed-5430-42c2-a2d1-0f6269c7e2f1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:23.525978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-481f53ed-5430-42c2-a2d1-0f6269c7e2f1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:23.527395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-481f53ed-5430-42c2-a2d1-0f6269c7e2f1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:23.610485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0e427162-9832-430d-99aa-a88568cabafb tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:23.620535 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0e427162-9832-430d-99aa-a88568cabafb tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" status: 200 len: 1281 microversion: 2.1 time: 0.294271 Oct 12 22:12:23.624958 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1829/3288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:23 2022] GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 => generated 1281 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:23.631906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3e2361ef-f5e4-46da-b958-70e5f1799e54 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:23.632721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3e2361ef-f5e4-46da-b958-70e5f1799e54 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:23.646879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e2361ef-f5e4-46da-b958-70e5f1799e54 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:23.648990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e2361ef-f5e4-46da-b958-70e5f1799e54 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:23.649646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e2361ef-f5e4-46da-b958-70e5f1799e54 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:23.652448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e2361ef-f5e4-46da-b958-70e5f1799e54 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:23.653781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e2361ef-f5e4-46da-b958-70e5f1799e54 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:23.655575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e2361ef-f5e4-46da-b958-70e5f1799e54 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:23.789164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e2361ef-f5e4-46da-b958-70e5f1799e54 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:23.789977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e2361ef-f5e4-46da-b958-70e5f1799e54 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:23.790432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e2361ef-f5e4-46da-b958-70e5f1799e54 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:23.790901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-3e2361ef-f5e4-46da-b958-70e5f1799e54 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lazy-loading 'fault' on Instance uuid dd9f516c-739e-45d8-afbb-8cb1402afb48 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:12:23.860948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3e2361ef-f5e4-46da-b958-70e5f1799e54 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:23.876961 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3e2361ef-f5e4-46da-b958-70e5f1799e54 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1306 microversion: 2.1 time: 0.249323 Oct 12 22:12:23.877973 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1830/3289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:23 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1306 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:23.897521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9a38bd43-a929-4736-91be-ce6df705930c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:23.898613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9a38bd43-a929-4736-91be-ce6df705930c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:23.903010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-481f53ed-5430-42c2-a2d1-0f6269c7e2f1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:23.916496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a38bd43-a929-4736-91be-ce6df705930c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:23.917749 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-481f53ed-5430-42c2-a2d1-0f6269c7e2f1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.413777 Oct 12 22:12:23.919124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a38bd43-a929-4736-91be-ce6df705930c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:23.919650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a38bd43-a929-4736-91be-ce6df705930c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:23.920349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a38bd43-a929-4736-91be-ce6df705930c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:23.920809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a38bd43-a929-4736-91be-ce6df705930c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:23.921237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a38bd43-a929-4736-91be-ce6df705930c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:23.927709 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1460/3290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:23 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:23.961011 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-9a38bd43-a929-4736-91be-ce6df705930c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] HTTP exception thrown: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9a38bd43-a929-4736-91be-ce6df705930c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Request method failure captured: Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c HTTP/1.1 Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRztH-2cK6EcNrtu-ZFwiruT6Q8zJdENYas1C6WcCB9aoZvIW_Yd_lMijAJEpfeIDVAE3iHxx_b3e15m_Drd-MP8HS_4RlHH7J-ugq0PIYEKg7Kaaz8t2BWs25twn5bRCwgR449YSnstuvCm6JOwramKI9NMnWnRgFVTMwM5Y9dJ-lec Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0287e296f1c9414e81fbd0212bde30ad Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestMultiNic-1304317170 Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0287e296f1c9414e81fbd0212bde30ad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestMultiNic-1304317170 Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0287e296f1c9414e81fbd0212bde30ad Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestMultiNic-1304317170 Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestMultiNic-1304317170-project Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 4c5adfbe06184b1e8531545707047456 Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestMultiNic-1304317170-project Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '111af739-6af4-48aa-b0c4-2e891131a11c'} Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:23.962943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:23.967473 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:23.967473 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:23.967473 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:23.967473 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:12:23.967473 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:12:23.967473 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. Oct 12 22:12:23.967473 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:23.968740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9a38bd43-a929-4736-91be-ce6df705930c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Returning 404 to user: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:12:23.969771 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9a38bd43-a929-4736-91be-ce6df705930c tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 404 len: 111 microversion: 2.1 time: 0.076615 Oct 12 22:12:23.970858 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1831/3291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:23 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:12:24.029665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c6984fe0-d0ed-4ad8-8213-7592b4465833 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:24.030565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c6984fe0-d0ed-4ad8-8213-7592b4465833 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:24.049183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6984fe0-d0ed-4ad8-8213-7592b4465833 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:24.051180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6984fe0-d0ed-4ad8-8213-7592b4465833 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:24.051769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6984fe0-d0ed-4ad8-8213-7592b4465833 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:24.052562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6984fe0-d0ed-4ad8-8213-7592b4465833 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:24.056062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6984fe0-d0ed-4ad8-8213-7592b4465833 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:24.056800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6984fe0-d0ed-4ad8-8213-7592b4465833 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:24.185135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-51bd1345-7449-4bb7-8d67-64e1f0de676e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:24.185870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-51bd1345-7449-4bb7-8d67-64e1f0de676e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:24.195299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51bd1345-7449-4bb7-8d67-64e1f0de676e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:24.196076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51bd1345-7449-4bb7-8d67-64e1f0de676e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:24.196755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51bd1345-7449-4bb7-8d67-64e1f0de676e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:24.197709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51bd1345-7449-4bb7-8d67-64e1f0de676e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:24.198380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51bd1345-7449-4bb7-8d67-64e1f0de676e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:24.199100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51bd1345-7449-4bb7-8d67-64e1f0de676e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:24.316868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c6984fe0-d0ed-4ad8-8213-7592b4465833 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:24.335178 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c6984fe0-d0ed-4ad8-8213-7592b4465833 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.308124 Oct 12 22:12:24.336596 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1461/3292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:24 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:24.352022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-752b06e9-f312-46f0-af64-9e2786d6f099 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:24.354320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-752b06e9-f312-46f0-af64-9e2786d6f099 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:24.367431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-752b06e9-f312-46f0-af64-9e2786d6f099 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:24.374676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-752b06e9-f312-46f0-af64-9e2786d6f099 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:24.375752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-752b06e9-f312-46f0-af64-9e2786d6f099 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:24.382608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-752b06e9-f312-46f0-af64-9e2786d6f099 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:24.383620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-752b06e9-f312-46f0-af64-9e2786d6f099 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:24.384657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-752b06e9-f312-46f0-af64-9e2786d6f099 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:24.457395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-51bd1345-7449-4bb7-8d67-64e1f0de676e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:24.477818 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-51bd1345-7449-4bb7-8d67-64e1f0de676e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1331 microversion: 2.1 time: 0.292407 Oct 12 22:12:24.480332 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1832/3293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:24 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1331 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:12:24.510639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1814e01b-4982-4a2f-abf9-85b0430970fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:24.511494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1814e01b-4982-4a2f-abf9-85b0430970fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:24.518276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1814e01b-4982-4a2f-abf9-85b0430970fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:24.519086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1814e01b-4982-4a2f-abf9-85b0430970fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:24.519808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1814e01b-4982-4a2f-abf9-85b0430970fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:24.520975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1814e01b-4982-4a2f-abf9-85b0430970fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:24.521666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1814e01b-4982-4a2f-abf9-85b0430970fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:24.522271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1814e01b-4982-4a2f-abf9-85b0430970fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:24.533788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-752b06e9-f312-46f0-af64-9e2786d6f099 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:24.544678 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-752b06e9-f312-46f0-af64-9e2786d6f099 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1252 microversion: 2.1 time: 0.197643 Oct 12 22:12:24.549291 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1462/3294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:24 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1252 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:24.649541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-18a9b08f-f7ce-404d-84fc-8fd720164a39 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:24.650297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-18a9b08f-f7ce-404d-84fc-8fd720164a39 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:24.664117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18a9b08f-f7ce-404d-84fc-8fd720164a39 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:24.665533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18a9b08f-f7ce-404d-84fc-8fd720164a39 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:24.666181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18a9b08f-f7ce-404d-84fc-8fd720164a39 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:24.667469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18a9b08f-f7ce-404d-84fc-8fd720164a39 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:24.669039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18a9b08f-f7ce-404d-84fc-8fd720164a39 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:24.671637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18a9b08f-f7ce-404d-84fc-8fd720164a39 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:24.749187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1814e01b-4982-4a2f-abf9-85b0430970fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:24.759876 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1814e01b-4982-4a2f-abf9-85b0430970fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1552 microversion: 2.1 time: 0.253209 Oct 12 22:12:24.769016 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1833/3295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:24 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1552 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:12:24.904512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c33f03f0-4b6f-48a5-88c3-8e77e0a02fef tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:24.905046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c33f03f0-4b6f-48a5-88c3-8e77e0a02fef tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:24.918814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c33f03f0-4b6f-48a5-88c3-8e77e0a02fef tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:24.919792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c33f03f0-4b6f-48a5-88c3-8e77e0a02fef tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:24.920240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c33f03f0-4b6f-48a5-88c3-8e77e0a02fef tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:24.921203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c33f03f0-4b6f-48a5-88c3-8e77e0a02fef tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:24.921740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c33f03f0-4b6f-48a5-88c3-8e77e0a02fef tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:24.922153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c33f03f0-4b6f-48a5-88c3-8e77e0a02fef tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:24.992146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c33f03f0-4b6f-48a5-88c3-8e77e0a02fef tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:24.992554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c33f03f0-4b6f-48a5-88c3-8e77e0a02fef tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:24.992998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c33f03f0-4b6f-48a5-88c3-8e77e0a02fef tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:24.993469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-c33f03f0-4b6f-48a5-88c3-8e77e0a02fef tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lazy-loading 'fault' on Instance uuid dd9f516c-739e-45d8-afbb-8cb1402afb48 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:12:25.067569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c33f03f0-4b6f-48a5-88c3-8e77e0a02fef tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:25.076974 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c33f03f0-4b6f-48a5-88c3-8e77e0a02fef tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1306 microversion: 2.1 time: 0.176261 Oct 12 22:12:25.078084 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1834/3296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:24 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1306 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:12:25.510587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1c6cb75c-e707-4a33-8a70-0612de0448e9 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:25.512462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1c6cb75c-e707-4a33-8a70-0612de0448e9 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:25.522729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c6cb75c-e707-4a33-8a70-0612de0448e9 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:25.523701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c6cb75c-e707-4a33-8a70-0612de0448e9 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:25.524748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c6cb75c-e707-4a33-8a70-0612de0448e9 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:25.526544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c6cb75c-e707-4a33-8a70-0612de0448e9 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:25.527209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c6cb75c-e707-4a33-8a70-0612de0448e9 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:25.528073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c6cb75c-e707-4a33-8a70-0612de0448e9 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:25.568039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-18a9b08f-f7ce-404d-84fc-8fd720164a39 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:25.575779 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-18a9b08f-f7ce-404d-84fc-8fd720164a39 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" status: 200 len: 1323 microversion: 2.1 time: 0.930623 Oct 12 22:12:25.582366 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1463/3297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:24 2022] GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 => generated 1323 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:12:25.587766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b79b9b7c-7c81-42d0-943c-36fa65b5c592 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:25.592015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b79b9b7c-7c81-42d0-943c-36fa65b5c592 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:25.604654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b79b9b7c-7c81-42d0-943c-36fa65b5c592 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:25.605354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b79b9b7c-7c81-42d0-943c-36fa65b5c592 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:25.606784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b79b9b7c-7c81-42d0-943c-36fa65b5c592 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:25.608699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b79b9b7c-7c81-42d0-943c-36fa65b5c592 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:25.619990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b79b9b7c-7c81-42d0-943c-36fa65b5c592 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:25.620701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b79b9b7c-7c81-42d0-943c-36fa65b5c592 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:25.706139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1c6cb75c-e707-4a33-8a70-0612de0448e9 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:25.715872 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1c6cb75c-e707-4a33-8a70-0612de0448e9 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1331 microversion: 2.1 time: 0.213519 Oct 12 22:12:25.723287 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1835/3298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:25 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1331 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:12:25.723287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8991fde2-c691-4887-b511-f7e7917aba76 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:25.724132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8991fde2-c691-4887-b511-f7e7917aba76 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:25.733126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8991fde2-c691-4887-b511-f7e7917aba76 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:25.734059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8991fde2-c691-4887-b511-f7e7917aba76 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:25.734653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8991fde2-c691-4887-b511-f7e7917aba76 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:25.735562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8991fde2-c691-4887-b511-f7e7917aba76 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:25.736120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8991fde2-c691-4887-b511-f7e7917aba76 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:25.736650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8991fde2-c691-4887-b511-f7e7917aba76 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:25.894697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8991fde2-c691-4887-b511-f7e7917aba76 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:25.904942 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8991fde2-c691-4887-b511-f7e7917aba76 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.186460 Oct 12 22:12:25.916100 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1836/3299] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:25 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:25.916100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9a375f77-6004-409d-b83c-45063f5eec2a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:25.916100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9a375f77-6004-409d-b83c-45063f5eec2a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:25.919848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a375f77-6004-409d-b83c-45063f5eec2a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:25.920496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a375f77-6004-409d-b83c-45063f5eec2a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:25.921144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a375f77-6004-409d-b83c-45063f5eec2a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:25.921663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a375f77-6004-409d-b83c-45063f5eec2a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:25.922125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a375f77-6004-409d-b83c-45063f5eec2a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:25.922553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a375f77-6004-409d-b83c-45063f5eec2a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:26.083988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9a375f77-6004-409d-b83c-45063f5eec2a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:26.093754 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9a375f77-6004-409d-b83c-45063f5eec2a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1552 microversion: 2.1 time: 0.185857 Oct 12 22:12:26.094472 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1837/3300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:25 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1552 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:26.101663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-398d4441-cb0a-4da7-8f6a-686f029c3b82 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:26.102597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-398d4441-cb0a-4da7-8f6a-686f029c3b82 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:26.111531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-398d4441-cb0a-4da7-8f6a-686f029c3b82 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:26.112280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-398d4441-cb0a-4da7-8f6a-686f029c3b82 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:26.113068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-398d4441-cb0a-4da7-8f6a-686f029c3b82 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:26.113927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-398d4441-cb0a-4da7-8f6a-686f029c3b82 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:26.114546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-398d4441-cb0a-4da7-8f6a-686f029c3b82 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:26.115337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-398d4441-cb0a-4da7-8f6a-686f029c3b82 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:26.119898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b79b9b7c-7c81-42d0-943c-36fa65b5c592 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:26.138760 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b79b9b7c-7c81-42d0-943c-36fa65b5c592 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1252 microversion: 2.1 time: 0.554890 Oct 12 22:12:26.141525 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1464/3301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:25 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1252 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:26.153863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e359f25a-4bac-476e-b5e5-b11e2b489e95 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:26.154584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e359f25a-4bac-476e-b5e5-b11e2b489e95 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:26.173797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e359f25a-4bac-476e-b5e5-b11e2b489e95 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:26.174380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e359f25a-4bac-476e-b5e5-b11e2b489e95 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:26.175186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e359f25a-4bac-476e-b5e5-b11e2b489e95 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:26.176170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e359f25a-4bac-476e-b5e5-b11e2b489e95 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:26.176871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e359f25a-4bac-476e-b5e5-b11e2b489e95 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:26.189246 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e359f25a-4bac-476e-b5e5-b11e2b489e95 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:26.296497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e359f25a-4bac-476e-b5e5-b11e2b489e95 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:26.297862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e359f25a-4bac-476e-b5e5-b11e2b489e95 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:26.298568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e359f25a-4bac-476e-b5e5-b11e2b489e95 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:26.299345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-e359f25a-4bac-476e-b5e5-b11e2b489e95 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lazy-loading 'fault' on Instance uuid dd9f516c-739e-45d8-afbb-8cb1402afb48 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:12:26.388760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-398d4441-cb0a-4da7-8f6a-686f029c3b82 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:26.400091 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-398d4441-cb0a-4da7-8f6a-686f029c3b82 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.304225 Oct 12 22:12:26.401155 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1838/3302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:26 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:26.428773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6a1feed4-559c-4d9b-80dc-0cfc25233541 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:26.429603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6a1feed4-559c-4d9b-80dc-0cfc25233541 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:26.436436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a1feed4-559c-4d9b-80dc-0cfc25233541 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:26.436987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a1feed4-559c-4d9b-80dc-0cfc25233541 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:26.438661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a1feed4-559c-4d9b-80dc-0cfc25233541 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:26.439485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a1feed4-559c-4d9b-80dc-0cfc25233541 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:26.439955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a1feed4-559c-4d9b-80dc-0cfc25233541 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:26.440391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a1feed4-559c-4d9b-80dc-0cfc25233541 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:26.484893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e359f25a-4bac-476e-b5e5-b11e2b489e95 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:26.494559 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e359f25a-4bac-476e-b5e5-b11e2b489e95 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 200 len: 1306 microversion: 2.1 time: 0.350306 Oct 12 22:12:26.500612 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1465/3303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:26 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 1306 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:26.608108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8cf33cf5-6bd7-4b08-8a2c-2e6a28963344 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:26.609962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8cf33cf5-6bd7-4b08-8a2c-2e6a28963344 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:26.626239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cf33cf5-6bd7-4b08-8a2c-2e6a28963344 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:26.626928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cf33cf5-6bd7-4b08-8a2c-2e6a28963344 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:26.627660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cf33cf5-6bd7-4b08-8a2c-2e6a28963344 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:26.628574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cf33cf5-6bd7-4b08-8a2c-2e6a28963344 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:26.629496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cf33cf5-6bd7-4b08-8a2c-2e6a28963344 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:26.630543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cf33cf5-6bd7-4b08-8a2c-2e6a28963344 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:26.885409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6a1feed4-559c-4d9b-80dc-0cfc25233541 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:26.906043 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6a1feed4-559c-4d9b-80dc-0cfc25233541 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.485350 Oct 12 22:12:26.907719 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1839/3304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:26 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:26.919588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-935e0c33-fb9e-43ae-b4b3-436900bd8d90 req-00bcd2d6-7cc8-40b3-80c4-eead2a3a7f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4023ebba-05d4-4225-938a-c70c2490ae29", "name": "network-vif-unplugged", "status": "completed", "tag": "16f27b0f-2034-49b1-8fc7-d037682a37a4"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:26.952813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-935e0c33-fb9e-43ae-b4b3-436900bd8d90 req-00bcd2d6-7cc8-40b3-80c4-eead2a3a7f38 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:26.956611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-935e0c33-fb9e-43ae-b4b3-436900bd8d90 req-00bcd2d6-7cc8-40b3-80c4-eead2a3a7f38 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:26.957262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-935e0c33-fb9e-43ae-b4b3-436900bd8d90 req-00bcd2d6-7cc8-40b3-80c4-eead2a3a7f38 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:26.993321 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-935e0c33-fb9e-43ae-b4b3-436900bd8d90 req-00bcd2d6-7cc8-40b3-80c4-eead2a3a7f38 service nova] Creating event network-vif-unplugged:16f27b0f-2034-49b1-8fc7-d037682a37a4 for instance 4023ebba-05d4-4225-938a-c70c2490ae29 on n-h2-861111-1 Oct 12 22:12:27.009419 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-935e0c33-fb9e-43ae-b4b3-436900bd8d90 req-00bcd2d6-7cc8-40b3-80c4-eead2a3a7f38 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100179 Oct 12 22:12:27.010054 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1840/3305] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:27.018662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b3de590d-4cef-40a5-b23b-d4627f96728e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:27.022916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b3de590d-4cef-40a5-b23b-d4627f96728e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:27.031768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3de590d-4cef-40a5-b23b-d4627f96728e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:27.032761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3de590d-4cef-40a5-b23b-d4627f96728e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:27.033442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3de590d-4cef-40a5-b23b-d4627f96728e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:27.034384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3de590d-4cef-40a5-b23b-d4627f96728e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:27.035054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3de590d-4cef-40a5-b23b-d4627f96728e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:27.035707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3de590d-4cef-40a5-b23b-d4627f96728e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:27.180540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8cf33cf5-6bd7-4b08-8a2c-2e6a28963344 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:27.189950 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8cf33cf5-6bd7-4b08-8a2c-2e6a28963344 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" status: 200 len: 1323 microversion: 2.1 time: 0.585540 Oct 12 22:12:27.190543 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1466/3306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:26 2022] GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 => generated 1323 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:27.210049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1cca1e54-0054-45ad-92db-7dd087df4658 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:27.212435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1cca1e54-0054-45ad-92db-7dd087df4658 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:27.226886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cca1e54-0054-45ad-92db-7dd087df4658 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:27.227408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cca1e54-0054-45ad-92db-7dd087df4658 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:27.227856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cca1e54-0054-45ad-92db-7dd087df4658 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:27.228571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cca1e54-0054-45ad-92db-7dd087df4658 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:27.229038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cca1e54-0054-45ad-92db-7dd087df4658 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:27.229469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cca1e54-0054-45ad-92db-7dd087df4658 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:27.318122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b3de590d-4cef-40a5-b23b-d4627f96728e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:27.328078 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b3de590d-4cef-40a5-b23b-d4627f96728e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1331 microversion: 2.1 time: 0.312068 Oct 12 22:12:27.329021 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1841/3307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:27 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1331 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:27.334433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bed799ed-9d52-48c7-b1c3-624ae292aa98 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:27.335055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bed799ed-9d52-48c7-b1c3-624ae292aa98 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:27.353218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bed799ed-9d52-48c7-b1c3-624ae292aa98 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:27.353730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bed799ed-9d52-48c7-b1c3-624ae292aa98 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:27.354161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bed799ed-9d52-48c7-b1c3-624ae292aa98 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:27.354881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bed799ed-9d52-48c7-b1c3-624ae292aa98 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:27.359819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bed799ed-9d52-48c7-b1c3-624ae292aa98 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:27.360645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bed799ed-9d52-48c7-b1c3-624ae292aa98 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:27.362552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:27.388644 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1cca1e54-0054-45ad-92db-7dd087df4658 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 202 len: 0 microversion: 2.1 time: 0.196805 Oct 12 22:12:27.392210 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1467/3308] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:12:27 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:12:27.399613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4eb284a1-dc7a-4f9b-8018-589130ea8d1c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:27.400360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4eb284a1-dc7a-4f9b-8018-589130ea8d1c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:27.409952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:27.419273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4eb284a1-dc7a-4f9b-8018-589130ea8d1c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:27.422555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4eb284a1-dc7a-4f9b-8018-589130ea8d1c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:27.423022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4eb284a1-dc7a-4f9b-8018-589130ea8d1c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:27.425392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4eb284a1-dc7a-4f9b-8018-589130ea8d1c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:27.426571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4eb284a1-dc7a-4f9b-8018-589130ea8d1c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:27.428834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4eb284a1-dc7a-4f9b-8018-589130ea8d1c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:27.492749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4eb284a1-dc7a-4f9b-8018-589130ea8d1c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:27.493738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4eb284a1-dc7a-4f9b-8018-589130ea8d1c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:27.494897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4eb284a1-dc7a-4f9b-8018-589130ea8d1c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:27.496039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-4eb284a1-dc7a-4f9b-8018-589130ea8d1c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lazy-loading 'fault' on Instance uuid f55c3cea-33ea-435c-84b3-f668bd000c8c {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:12:27.651205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bed799ed-9d52-48c7-b1c3-624ae292aa98 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:27.663302 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bed799ed-9d52-48c7-b1c3-624ae292aa98 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1552 microversion: 2.1 time: 0.333082 Oct 12 22:12:27.668432 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1842/3309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:27 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1552 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:27.675487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9804a2d2-3d93-48df-a7f6-1638c11e3222 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:27.676118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9804a2d2-3d93-48df-a7f6-1638c11e3222 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:27.683601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9804a2d2-3d93-48df-a7f6-1638c11e3222 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:27.684096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9804a2d2-3d93-48df-a7f6-1638c11e3222 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:27.688274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9804a2d2-3d93-48df-a7f6-1638c11e3222 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:27.689230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9804a2d2-3d93-48df-a7f6-1638c11e3222 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:27.689946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9804a2d2-3d93-48df-a7f6-1638c11e3222 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:27.690339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9804a2d2-3d93-48df-a7f6-1638c11e3222 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:27.748448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4eb284a1-dc7a-4f9b-8018-589130ea8d1c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac8025b0fc84f118ecf10cf6bc25cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ba5c93ba476c8114f5ed002eb2cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:27.759042 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4eb284a1-dc7a-4f9b-8018-589130ea8d1c tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 200 len: 1211 microversion: 2.1 time: 0.368496 Oct 12 22:12:27.763760 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1468/3310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:27 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 1211 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:27.784546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83d812a2-ed79-46a8-a4dd-2a446662459f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:27.785525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-83d812a2-ed79-46a8-a4dd-2a446662459f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: dd9f516c-739e-45d8-afbb-8cb1402afb48] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:27.797948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83d812a2-ed79-46a8-a4dd-2a446662459f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:27.798813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83d812a2-ed79-46a8-a4dd-2a446662459f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:27.799589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83d812a2-ed79-46a8-a4dd-2a446662459f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:27.801091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83d812a2-ed79-46a8-a4dd-2a446662459f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:27.802359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83d812a2-ed79-46a8-a4dd-2a446662459f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:27.805433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83d812a2-ed79-46a8-a4dd-2a446662459f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:27.839043 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-83d812a2-ed79-46a8-a4dd-2a446662459f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] HTTP exception thrown: Instance dd9f516c-739e-45d8-afbb-8cb1402afb48 could not be found. Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83d812a2-ed79-46a8-a4dd-2a446662459f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Request method failure captured: Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 HTTP/1.1 Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzr98Hx3HSZUwq13XuvkKDPq0Iz5m-bV7cM398dlrUOClDHZvKrry9jEBmFlbHSmTggU-8Kzhn-tq2F0pNUWaJ0dz4mTrYT4WEggz5nFy73h3CWXJWY0xrriAWPLgFsaD4ELYtj-jFuaZbDIGMPZ-s-9QASFcLZt-WruPxAE5oPSHB0 Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1da6fbca378a43c6b71b9b1b2fa1bc7c Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1da6fbca378a43c6b71b9b1b2fa1bc7c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1da6fbca378a43c6b71b9b1b2fa1bc7c Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersOnMultiNodesTest-2073144359-project Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7a8e7139c1694698a5fde98743165501 Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersOnMultiNodesTest-2073144359-project Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance dd9f516c-739e-45d8-afbb-8cb1402afb48 could not be found. Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'dd9f516c-739e-45d8-afbb-8cb1402afb48'} Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9f516c-739e-45d8-afbb-8cb1402afb48 could not be found. Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9f516c-739e-45d8-afbb-8cb1402afb48 could not be found. Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:27.840876 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:27.846098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:27.846098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:27.846098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:27.846098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:12:27.846098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:12:27.846098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9f516c-739e-45d8-afbb-8cb1402afb48 could not be found. Oct 12 22:12:27.846098 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:27.846098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83d812a2-ed79-46a8-a4dd-2a446662459f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Returning 404 to user: Instance dd9f516c-739e-45d8-afbb-8cb1402afb48 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:12:27.846098 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-83d812a2-ed79-46a8-a4dd-2a446662459f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48" status: 404 len: 111 microversion: 2.1 time: 0.077198 Oct 12 22:12:27.846098 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1469/3311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:27 2022] GET /compute/v2.1/servers/dd9f516c-739e-45d8-afbb-8cb1402afb48 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:12:27.853815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cecc0781-cc9c-415c-aef6-560f6802840d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:27.854628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cecc0781-cc9c-415c-aef6-560f6802840d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:27.862635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cecc0781-cc9c-415c-aef6-560f6802840d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:27.863122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cecc0781-cc9c-415c-aef6-560f6802840d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:27.863953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cecc0781-cc9c-415c-aef6-560f6802840d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:27.864717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cecc0781-cc9c-415c-aef6-560f6802840d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:27.865172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cecc0781-cc9c-415c-aef6-560f6802840d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:27.865588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cecc0781-cc9c-415c-aef6-560f6802840d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:27.904727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cecc0781-cc9c-415c-aef6-560f6802840d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:12:28.062734 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cecc0781-cc9c-415c-aef6-560f6802840d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 204 len: 0 microversion: 2.1 time: 0.212643 Oct 12 22:12:28.064032 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1470/3312] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:12:27 2022] DELETE /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:12:28.069063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9804a2d2-3d93-48df-a7f6-1638c11e3222 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:28.074226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ce493863-39a4-4951-abb1-933b47784150 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:28.075209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ce493863-39a4-4951-abb1-933b47784150 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:28.077405 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9804a2d2-3d93-48df-a7f6-1638c11e3222 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1672 microversion: 2.1 time: 0.407872 Oct 12 22:12:28.081410 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1843/3313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:27 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1672 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:28.092171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce493863-39a4-4951-abb1-933b47784150 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:28.092687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce493863-39a4-4951-abb1-933b47784150 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:28.093124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce493863-39a4-4951-abb1-933b47784150 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:28.094997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce493863-39a4-4951-abb1-933b47784150 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:28.095573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce493863-39a4-4951-abb1-933b47784150 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:28.096119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce493863-39a4-4951-abb1-933b47784150 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:28.131617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:28.219133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4cc9c83a-0e95-42ba-adca-2430aae3b91f tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:28.225023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4cc9c83a-0e95-42ba-adca-2430aae3b91f tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:28.244043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cc9c83a-0e95-42ba-adca-2430aae3b91f tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:28.251351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cc9c83a-0e95-42ba-adca-2430aae3b91f tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:28.252116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cc9c83a-0e95-42ba-adca-2430aae3b91f tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:28.254578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cc9c83a-0e95-42ba-adca-2430aae3b91f tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:28.255333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cc9c83a-0e95-42ba-adca-2430aae3b91f tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:28.256122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cc9c83a-0e95-42ba-adca-2430aae3b91f tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:28.437561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4cc9c83a-0e95-42ba-adca-2430aae3b91f tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:28.446004 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4cc9c83a-0e95-42ba-adca-2430aae3b91f tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" status: 200 len: 1323 microversion: 2.1 time: 0.234949 Oct 12 22:12:28.454817 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1844/3314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:28 2022] GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 => generated 1323 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:28.470733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-869e3c51-a018-4b5d-b5a3-1163c510bbd4 req-985bef39-81ad-43a3-ad7d-d1cfa2fab1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835", "tag": "76764896-d8b2-4553-97a9-4df1772081c6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:28.481758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-869e3c51-a018-4b5d-b5a3-1163c510bbd4 req-985bef39-81ad-43a3-ad7d-d1cfa2fab1a3 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:28.482389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-869e3c51-a018-4b5d-b5a3-1163c510bbd4 req-985bef39-81ad-43a3-ad7d-d1cfa2fab1a3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:28.482946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-869e3c51-a018-4b5d-b5a3-1163c510bbd4 req-985bef39-81ad-43a3-ad7d-d1cfa2fab1a3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:28.500040 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-869e3c51-a018-4b5d-b5a3-1163c510bbd4 req-985bef39-81ad-43a3-ad7d-d1cfa2fab1a3 service nova] Creating event network-changed:76764896-d8b2-4553-97a9-4df1772081c6 for instance c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 on n-h1-861111-1 Oct 12 22:12:28.507491 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-869e3c51-a018-4b5d-b5a3-1163c510bbd4 req-985bef39-81ad-43a3-ad7d-d1cfa2fab1a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050760 Oct 12 22:12:28.509063 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1845/3315] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:28.516550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e90a99b9-3777-44f7-aeb8-40fed82b8bb7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:28.517393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e90a99b9-3777-44f7-aeb8-40fed82b8bb7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:28.549955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e90a99b9-3777-44f7-aeb8-40fed82b8bb7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:28.550474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e90a99b9-3777-44f7-aeb8-40fed82b8bb7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:28.550925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e90a99b9-3777-44f7-aeb8-40fed82b8bb7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:28.551721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e90a99b9-3777-44f7-aeb8-40fed82b8bb7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:28.554855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e90a99b9-3777-44f7-aeb8-40fed82b8bb7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:28.555343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e90a99b9-3777-44f7-aeb8-40fed82b8bb7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:28.627222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ce493863-39a4-4951-abb1-933b47784150 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:28.644089 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ce493863-39a4-4951-abb1-933b47784150 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1472 microversion: 2.1 time: 0.575155 Oct 12 22:12:28.659340 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1471/3316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:28 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1472 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:28.691469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f8e993e7-1f6d-4259-ae16-7a44b5b7cad0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:28.692128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f8e993e7-1f6d-4259-ae16-7a44b5b7cad0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:28.702221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8e993e7-1f6d-4259-ae16-7a44b5b7cad0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:28.702717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8e993e7-1f6d-4259-ae16-7a44b5b7cad0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:28.703153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8e993e7-1f6d-4259-ae16-7a44b5b7cad0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:28.703892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8e993e7-1f6d-4259-ae16-7a44b5b7cad0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:28.704333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8e993e7-1f6d-4259-ae16-7a44b5b7cad0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:28.704757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8e993e7-1f6d-4259-ae16-7a44b5b7cad0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:28.805361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e90a99b9-3777-44f7-aeb8-40fed82b8bb7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:28.819993 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e90a99b9-3777-44f7-aeb8-40fed82b8bb7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1331 microversion: 2.1 time: 0.306386 Oct 12 22:12:28.821325 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1846/3317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:28 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1331 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:28.829247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-20899a69-6278-41b5-a62e-40c62d9c51ea tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:28.829483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f8e993e7-1f6d-4259-ae16-7a44b5b7cad0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:28.831334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-20899a69-6278-41b5-a62e-40c62d9c51ea tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] [instance: f55c3cea-33ea-435c-84b3-f668bd000c8c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:28.842296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20899a69-6278-41b5-a62e-40c62d9c51ea tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:28.843059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20899a69-6278-41b5-a62e-40c62d9c51ea tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:28.843793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20899a69-6278-41b5-a62e-40c62d9c51ea tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:28.844813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20899a69-6278-41b5-a62e-40c62d9c51ea tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:28.845430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20899a69-6278-41b5-a62e-40c62d9c51ea tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:28.845972 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f8e993e7-1f6d-4259-ae16-7a44b5b7cad0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1344 microversion: 2.1 time: 0.158356 Oct 12 22:12:28.846178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20899a69-6278-41b5-a62e-40c62d9c51ea tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:28.846569 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1472/3318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:28 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1344 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:12:29.115099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-754a0a08-76b1-45a9-a8d6-3811b94f4faa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:29.118351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-754a0a08-76b1-45a9-a8d6-3811b94f4faa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:29.133548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-754a0a08-76b1-45a9-a8d6-3811b94f4faa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:29.134627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-754a0a08-76b1-45a9-a8d6-3811b94f4faa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:29.135273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-754a0a08-76b1-45a9-a8d6-3811b94f4faa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:29.136158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-754a0a08-76b1-45a9-a8d6-3811b94f4faa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:29.136757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-754a0a08-76b1-45a9-a8d6-3811b94f4faa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:29.137793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-754a0a08-76b1-45a9-a8d6-3811b94f4faa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:29.395228 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-20899a69-6278-41b5-a62e-40c62d9c51ea tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] HTTP exception thrown: Instance f55c3cea-33ea-435c-84b3-f668bd000c8c could not be found. Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-20899a69-6278-41b5-a62e-40c62d9c51ea tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Request method failure captured: Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c HTTP/1.1 Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzs6i5RDYTC2RZBiT3QSHZRf-zoEZRw_ZqaAQ7gbnhx-yCHsYu_7k-zzpPXeppbIiX1UwxBtZ6h2IIDa6g7Vp0VTfBwb_mJ7sRwSgSMdH5FXvnL0XziXN6kNPlEcBGPDgabaHly95BF2GpCWBPUAu0_SA7X4bJndS_iZ3toppDpytZk Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7e47ba5c93ba476c8114f5ed002eb2cb Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestBootFromVolume-1753875229 Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e47ba5c93ba476c8114f5ed002eb2cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e47ba5c93ba476c8114f5ed002eb2cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7e47ba5c93ba476c8114f5ed002eb2cb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7e47ba5c93ba476c8114f5ed002eb2cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestBootFromVolume-1753875229 Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7e47ba5c93ba476c8114f5ed002eb2cb Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1753875229 Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestBootFromVolume-1753875229-project Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: fac8025b0fc84f118ecf10cf6bc25cd0 Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestBootFromVolume-1753875229-project Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance f55c3cea-33ea-435c-84b3-f668bd000c8c could not be found. Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'f55c3cea-33ea-435c-84b3-f668bd000c8c'} Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55c3cea-33ea-435c-84b3-f668bd000c8c could not be found. Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55c3cea-33ea-435c-84b3-f668bd000c8c could not be found. Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:29.396966 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:29.401022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:29.401022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:29.401022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:29.401022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:12:29.401022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:12:29.401022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55c3cea-33ea-435c-84b3-f668bd000c8c could not be found. Oct 12 22:12:29.401022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:29.402621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-20899a69-6278-41b5-a62e-40c62d9c51ea tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Returning 404 to user: Instance f55c3cea-33ea-435c-84b3-f668bd000c8c could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:12:29.419443 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-20899a69-6278-41b5-a62e-40c62d9c51ea tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c" status: 404 len: 111 microversion: 2.1 time: 0.596628 Oct 12 22:12:29.420031 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1847/3319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:28 2022] GET /compute/v2.1/servers/f55c3cea-33ea-435c-84b3-f668bd000c8c => generated 111 bytes in 598 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:12:29.440582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6c3190c3-dbcb-4f02-a296-85fffc5adc54 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] Calling method '.version_select at 0x7f5123066940>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:29.478628 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6c3190c3-dbcb-4f02-a296-85fffc5adc54 tempest-ServersTestBootFromVolume-1753875229 tempest-ServersTestBootFromVolume-1753875229-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163312936" status: 202 len: 0 microversion: 2.1 time: 0.054108 Oct 12 22:12:29.479839 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1848/3320] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 12 22:12:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163312936 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:12:29.484640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2cf424c8-23fd-4d03-bc9d-11e6fca51869 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:29.486410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2cf424c8-23fd-4d03-bc9d-11e6fca51869 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:29.502811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cf424c8-23fd-4d03-bc9d-11e6fca51869 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:29.503923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cf424c8-23fd-4d03-bc9d-11e6fca51869 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:29.504066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cf424c8-23fd-4d03-bc9d-11e6fca51869 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:29.504767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cf424c8-23fd-4d03-bc9d-11e6fca51869 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:29.509520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cf424c8-23fd-4d03-bc9d-11e6fca51869 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:29.510351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cf424c8-23fd-4d03-bc9d-11e6fca51869 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:29.826214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2cf424c8-23fd-4d03-bc9d-11e6fca51869 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:29.842462 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2cf424c8-23fd-4d03-bc9d-11e6fca51869 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" status: 200 len: 1323 microversion: 2.1 time: 0.361536 Oct 12 22:12:29.843344 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1849/3321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:29 2022] GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 => generated 1323 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:29.851543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5d8f1315-63d1-4848-8ca2-aed5228e7b72 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:29.852520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5d8f1315-63d1-4848-8ca2-aed5228e7b72 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:29.869288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d8f1315-63d1-4848-8ca2-aed5228e7b72 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:29.869990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d8f1315-63d1-4848-8ca2-aed5228e7b72 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:29.870594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d8f1315-63d1-4848-8ca2-aed5228e7b72 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:29.871518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d8f1315-63d1-4848-8ca2-aed5228e7b72 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:29.872141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d8f1315-63d1-4848-8ca2-aed5228e7b72 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:29.872725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d8f1315-63d1-4848-8ca2-aed5228e7b72 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:30.104008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-754a0a08-76b1-45a9-a8d6-3811b94f4faa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:30.115453 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-754a0a08-76b1-45a9-a8d6-3811b94f4faa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1672 microversion: 2.1 time: 1.014261 Oct 12 22:12:30.117068 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1473/3322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:29 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1672 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:30.124406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1151183876", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce6dd748-e52a-46d1-938f-29e5070fa849"}], "security_groups": [{"name": "tempest-securitygroup--338350397"}], "key_name": "tempest-keypair-1428081210", "user_data": "}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:30.197577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5d8f1315-63d1-4848-8ca2-aed5228e7b72 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:30.211044 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5d8f1315-63d1-4848-8ca2-aed5228e7b72 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1472 microversion: 2.1 time: 0.364129 Oct 12 22:12:30.213038 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1850/3323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:29 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1472 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:30.227626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-39680e8d-063e-4e00-abac-6c5069206aa7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:30.228593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-39680e8d-063e-4e00-abac-6c5069206aa7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:30.244583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39680e8d-063e-4e00-abac-6c5069206aa7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:30.245423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39680e8d-063e-4e00-abac-6c5069206aa7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:30.246344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39680e8d-063e-4e00-abac-6c5069206aa7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:30.247301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39680e8d-063e-4e00-abac-6c5069206aa7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:30.249905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39680e8d-063e-4e00-abac-6c5069206aa7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:30.251322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39680e8d-063e-4e00-abac-6c5069206aa7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:30.448349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] validate_networks() for [('ce6dd748-e52a-46d1-938f-29e5070fa849', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:12:30.933491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-39680e8d-063e-4e00-abac-6c5069206aa7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:30.948178 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-39680e8d-063e-4e00-abac-6c5069206aa7 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1331 microversion: 2.1 time: 0.725331 Oct 12 22:12:30.950396 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1851/3324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:30 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1331 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:30.961919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-26809997-4e1d-48da-854a-8466918703a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:30.962554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-26809997-4e1d-48da-854a-8466918703a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:30.976219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26809997-4e1d-48da-854a-8466918703a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:30.976723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26809997-4e1d-48da-854a-8466918703a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:30.977165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26809997-4e1d-48da-854a-8466918703a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:30.977878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26809997-4e1d-48da-854a-8466918703a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:30.978330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26809997-4e1d-48da-854a-8466918703a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:30.978757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26809997-4e1d-48da-854a-8466918703a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:31.108863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-26809997-4e1d-48da-854a-8466918703a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:31.119466 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-26809997-4e1d-48da-854a-8466918703a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1344 microversion: 2.1 time: 0.167091 Oct 12 22:12:31.120065 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1852/3325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:30 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1344 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:31.127404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dff12586-3517-4b5e-81b3-ff9c7a03abc8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:31.127903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dff12586-3517-4b5e-81b3-ff9c7a03abc8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:31.163150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dff12586-3517-4b5e-81b3-ff9c7a03abc8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:31.169268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dff12586-3517-4b5e-81b3-ff9c7a03abc8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:31.170006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dff12586-3517-4b5e-81b3-ff9c7a03abc8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:31.172111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dff12586-3517-4b5e-81b3-ff9c7a03abc8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:31.172811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dff12586-3517-4b5e-81b3-ff9c7a03abc8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:31.173478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dff12586-3517-4b5e-81b3-ff9c7a03abc8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:31.204123 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-dff12586-3517-4b5e-81b3-ff9c7a03abc8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] HTTP exception thrown: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dff12586-3517-4b5e-81b3-ff9c7a03abc8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Request method failure captured: Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c HTTP/1.1 Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRztH-2cK6EcNrtu-ZFwiruT6Q8zJdENYas1C6WcCB9aoZvIW_Yd_lMijAJEpfeIDVAE3iHxx_b3e15m_Drd-MP8HS_4RlHH7J-ugq0PIYEKg7Kaaz8t2BWs25twn5bRCwgR449YSnstuvCm6JOwramKI9NMnWnRgFVTMwM5Y9dJ-lec Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0287e296f1c9414e81fbd0212bde30ad Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestMultiNic-1304317170 Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0287e296f1c9414e81fbd0212bde30ad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestMultiNic-1304317170 Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0287e296f1c9414e81fbd0212bde30ad Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestMultiNic-1304317170 Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestMultiNic-1304317170-project Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 4c5adfbe06184b1e8531545707047456 Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestMultiNic-1304317170-project Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '111af739-6af4-48aa-b0c4-2e891131a11c'} Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:12:31.207270 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:12:31.212462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. Oct 12 22:12:31.212462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:31.212462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:31.212462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:31.212462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:31.212462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:31.212462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:31.212462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:12:31.212462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:12:31.212462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. Oct 12 22:12:31.212462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:31.216110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dff12586-3517-4b5e-81b3-ff9c7a03abc8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Returning 404 to user: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:12:31.217135 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dff12586-3517-4b5e-81b3-ff9c7a03abc8 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "DELETE /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 404 len: 111 microversion: 2.1 time: 0.093480 Oct 12 22:12:31.220472 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1853/3326] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:12:31 2022] DELETE /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:12:31.230960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-27792280-d778-4404-9bb7-61b5b067f230 req-1f940e20-2e32-443c-8bc0-611b0dd6937a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4377e1-7ac3-4b36-ad3d-ac212282c090", "name": "network-vif-deleted", "tag": "2454e52e-61bf-48dd-91c1-b2016da8e8ef"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:31.262974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-27792280-d778-4404-9bb7-61b5b067f230 req-1f940e20-2e32-443c-8bc0-611b0dd6937a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:31.265400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-27792280-d778-4404-9bb7-61b5b067f230 req-1f940e20-2e32-443c-8bc0-611b0dd6937a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:31.266140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-27792280-d778-4404-9bb7-61b5b067f230 req-1f940e20-2e32-443c-8bc0-611b0dd6937a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:31.305019 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-27792280-d778-4404-9bb7-61b5b067f230 req-1f940e20-2e32-443c-8bc0-611b0dd6937a service nova] Creating event network-vif-deleted:2454e52e-61bf-48dd-91c1-b2016da8e8ef for instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 on n-h1-861111-1 Oct 12 22:12:31.318228 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-27792280-d778-4404-9bb7-61b5b067f230 req-1f940e20-2e32-443c-8bc0-611b0dd6937a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096144 Oct 12 22:12:31.319451 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1854/3327] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:31.324889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-7dadf98c-aa3b-4c4c-b339-26386b46a76a req-71e14363-a274-4e54-933a-89f2f9382ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834fccfb-555f-4b47-9c94-eff3997d3dd2", "name": "network-vif-plugged", "status": "completed", "tag": "52d827f6-3263-45e3-be6b-9e5d6a230519"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:31.336472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7dadf98c-aa3b-4c4c-b339-26386b46a76a req-71e14363-a274-4e54-933a-89f2f9382ceb service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:31.337660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7dadf98c-aa3b-4c4c-b339-26386b46a76a req-71e14363-a274-4e54-933a-89f2f9382ceb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:31.338181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7dadf98c-aa3b-4c4c-b339-26386b46a76a req-71e14363-a274-4e54-933a-89f2f9382ceb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:31.356697 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-7dadf98c-aa3b-4c4c-b339-26386b46a76a req-71e14363-a274-4e54-933a-89f2f9382ceb service nova] Creating event network-vif-plugged:52d827f6-3263-45e3-be6b-9e5d6a230519 for instance 834fccfb-555f-4b47-9c94-eff3997d3dd2 on n-h2-861111-1 Oct 12 22:12:31.362033 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-7dadf98c-aa3b-4c4c-b339-26386b46a76a req-71e14363-a274-4e54-933a-89f2f9382ceb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041018 Oct 12 22:12:31.362908 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1855/3328] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:31.368978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e20dd818-f302-4ba8-a6ad-9832ca560611 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:31.369946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e20dd818-f302-4ba8-a6ad-9832ca560611 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:31.378023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e20dd818-f302-4ba8-a6ad-9832ca560611 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:31.378768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e20dd818-f302-4ba8-a6ad-9832ca560611 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:31.379986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e20dd818-f302-4ba8-a6ad-9832ca560611 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:31.380988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e20dd818-f302-4ba8-a6ad-9832ca560611 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:31.381652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e20dd818-f302-4ba8-a6ad-9832ca560611 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:31.382291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e20dd818-f302-4ba8-a6ad-9832ca560611 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:31.624431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:12:31.625538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:12:31.626240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:12:31.626867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:12:31.627596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:12:31.650958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:31.651884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:31.652571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:31.655877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:31.656620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:31.657270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:31.713952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Getting quotas for project 68913d260d084ce4a8e29daf4783c0bc. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:12:31.720416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Getting quotas for user 13c74a78e82f4e72a7d1f7b133074f5a and project 68913d260d084ce4a8e29daf4783c0bc. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:12:31.750228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:12:31.752802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:12:31.889705 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5e46a457-9f28-4d6b-9d19-d9f52c45ab05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.769248 Oct 12 22:12:31.891901 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1474/3329] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:12:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:12:31.904769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-43117f35-9640-4201-9b6f-a051eadef2ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:31.909536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-43117f35-9640-4201-9b6f-a051eadef2ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:31.939684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43117f35-9640-4201-9b6f-a051eadef2ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:31.940298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43117f35-9640-4201-9b6f-a051eadef2ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:31.940754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43117f35-9640-4201-9b6f-a051eadef2ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:31.941504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43117f35-9640-4201-9b6f-a051eadef2ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:31.942671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43117f35-9640-4201-9b6f-a051eadef2ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:31.943007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43117f35-9640-4201-9b6f-a051eadef2ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:32.267502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e20dd818-f302-4ba8-a6ad-9832ca560611 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:32.275565 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e20dd818-f302-4ba8-a6ad-9832ca560611 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" status: 200 len: 1323 microversion: 2.1 time: 0.911025 Oct 12 22:12:32.295832 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1856/3330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:31 2022] GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 => generated 1323 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:32.302095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-88a73cbb-2090-4e54-bc06-41b94f0f7f85 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:32.315628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-88a73cbb-2090-4e54-bc06-41b94f0f7f85 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: 111af739-6af4-48aa-b0c4-2e891131a11c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:32.337520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88a73cbb-2090-4e54-bc06-41b94f0f7f85 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:32.339109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88a73cbb-2090-4e54-bc06-41b94f0f7f85 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:32.339768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88a73cbb-2090-4e54-bc06-41b94f0f7f85 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:32.340939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88a73cbb-2090-4e54-bc06-41b94f0f7f85 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:32.341655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88a73cbb-2090-4e54-bc06-41b94f0f7f85 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:32.343306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88a73cbb-2090-4e54-bc06-41b94f0f7f85 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:32.381107 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-88a73cbb-2090-4e54-bc06-41b94f0f7f85 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] HTTP exception thrown: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-88a73cbb-2090-4e54-bc06-41b94f0f7f85 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Request method failure captured: Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c HTTP/1.1 Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRztH-2cK6EcNrtu-ZFwiruT6Q8zJdENYas1C6WcCB9aoZvIW_Yd_lMijAJEpfeIDVAE3iHxx_b3e15m_Drd-MP8HS_4RlHH7J-ugq0PIYEKg7Kaaz8t2BWs25twn5bRCwgR449YSnstuvCm6JOwramKI9NMnWnRgFVTMwM5Y9dJ-lec Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0287e296f1c9414e81fbd0212bde30ad Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestMultiNic-1304317170 Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0287e296f1c9414e81fbd0212bde30ad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestMultiNic-1304317170 Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0287e296f1c9414e81fbd0212bde30ad Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestMultiNic-1304317170 Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestMultiNic-1304317170-project Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 4c5adfbe06184b1e8531545707047456 Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestMultiNic-1304317170-project Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '111af739-6af4-48aa-b0c4-2e891131a11c'} Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:32.385394 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:32.392672 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:32.392672 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:32.392672 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:32.392672 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:12:32.392672 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:12:32.392672 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. Oct 12 22:12:32.392672 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:32.395191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-88a73cbb-2090-4e54-bc06-41b94f0f7f85 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Returning 404 to user: Instance 111af739-6af4-48aa-b0c4-2e891131a11c could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:12:32.396724 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-88a73cbb-2090-4e54-bc06-41b94f0f7f85 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c" status: 404 len: 111 microversion: 2.1 time: 0.099196 Oct 12 22:12:32.401101 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1857/3331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:32 2022] GET /compute/v2.1/servers/111af739-6af4-48aa-b0c4-2e891131a11c => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:12:32.408270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-43117f35-9640-4201-9b6f-a051eadef2ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:32.415000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9709a249-c897-4839-8cca-2ed427dcf6f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:32.417277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9709a249-c897-4839-8cca-2ed427dcf6f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:32.426439 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-43117f35-9640-4201-9b6f-a051eadef2ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1677 microversion: 2.1 time: 0.530199 Oct 12 22:12:32.427228 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1475/3332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:31 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1677 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:32.442923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d21ddccb-e030-45f8-a914-59e31b1bd834 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:32.442923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d21ddccb-e030-45f8-a914-59e31b1bd834 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:32.444131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9709a249-c897-4839-8cca-2ed427dcf6f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:32.448827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9709a249-c897-4839-8cca-2ed427dcf6f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:32.451802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9709a249-c897-4839-8cca-2ed427dcf6f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:32.455575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9709a249-c897-4839-8cca-2ed427dcf6f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:32.456130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9709a249-c897-4839-8cca-2ed427dcf6f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:32.461539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9709a249-c897-4839-8cca-2ed427dcf6f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:32.600553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d21ddccb-e030-45f8-a914-59e31b1bd834 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:32.609227 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d21ddccb-e030-45f8-a914-59e31b1bd834 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 200 len: 1242 microversion: 2.1 time: 0.180357 Oct 12 22:12:32.611989 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1476/3333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:32 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 1242 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:32.634804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7b736d6d-60d0-4283-994b-38cbaa9e72b2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:32.638368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7b736d6d-60d0-4283-994b-38cbaa9e72b2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:32.659944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b736d6d-60d0-4283-994b-38cbaa9e72b2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:32.660440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b736d6d-60d0-4283-994b-38cbaa9e72b2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:32.661435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b736d6d-60d0-4283-994b-38cbaa9e72b2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:32.662078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9709a249-c897-4839-8cca-2ed427dcf6f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:32.662235 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b736d6d-60d0-4283-994b-38cbaa9e72b2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:32.662620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b736d6d-60d0-4283-994b-38cbaa9e72b2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:32.662990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b736d6d-60d0-4283-994b-38cbaa9e72b2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:32.670326 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9709a249-c897-4839-8cca-2ed427dcf6f8 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1430 microversion: 2.1 time: 0.267851 Oct 12 22:12:32.674107 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1858/3334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:32 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1430 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:32.680002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02bb1c38-c4e3-49ea-97de-1fad33a8019b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:32.680624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-02bb1c38-c4e3-49ea-97de-1fad33a8019b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:32.702155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02bb1c38-c4e3-49ea-97de-1fad33a8019b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:32.702927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02bb1c38-c4e3-49ea-97de-1fad33a8019b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:32.703573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02bb1c38-c4e3-49ea-97de-1fad33a8019b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:32.706529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02bb1c38-c4e3-49ea-97de-1fad33a8019b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:32.709784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02bb1c38-c4e3-49ea-97de-1fad33a8019b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:32.710246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02bb1c38-c4e3-49ea-97de-1fad33a8019b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:32.842769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-02bb1c38-c4e3-49ea-97de-1fad33a8019b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:32.855304 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-02bb1c38-c4e3-49ea-97de-1fad33a8019b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1344 microversion: 2.1 time: 0.180062 Oct 12 22:12:32.856142 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1859/3335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:32 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1344 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:32.875756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02b18a2a-b59b-45eb-88a9-a0f0a49b62a4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:32.876422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-02b18a2a-b59b-45eb-88a9-a0f0a49b62a4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:32.890075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b18a2a-b59b-45eb-88a9-a0f0a49b62a4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:32.890974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b18a2a-b59b-45eb-88a9-a0f0a49b62a4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:32.893938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b18a2a-b59b-45eb-88a9-a0f0a49b62a4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:32.895993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b18a2a-b59b-45eb-88a9-a0f0a49b62a4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:32.896607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b18a2a-b59b-45eb-88a9-a0f0a49b62a4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:32.898238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b18a2a-b59b-45eb-88a9-a0f0a49b62a4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:32.921857 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-02b18a2a-b59b-45eb-88a9-a0f0a49b62a4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] HTTP exception thrown: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02b18a2a-b59b-45eb-88a9-a0f0a49b62a4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Request method failure captured: Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 HTTP/1.1 Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRztH-2cK6EcNrtu-ZFwiruT6Q8zJdENYas1C6WcCB9aoZvIW_Yd_lMijAJEpfeIDVAE3iHxx_b3e15m_Drd-MP8HS_4RlHH7J-ugq0PIYEKg7Kaaz8t2BWs25twn5bRCwgR449YSnstuvCm6JOwramKI9NMnWnRgFVTMwM5Y9dJ-lec Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0287e296f1c9414e81fbd0212bde30ad Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestMultiNic-1304317170 Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0287e296f1c9414e81fbd0212bde30ad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestMultiNic-1304317170 Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0287e296f1c9414e81fbd0212bde30ad Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestMultiNic-1304317170 Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestMultiNic-1304317170-project Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 4c5adfbe06184b1e8531545707047456 Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestMultiNic-1304317170-project Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'fae77315-a6c0-474c-aef9-5c8edda79113'} Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:12:32.924491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:12:32.930307 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. Oct 12 22:12:32.930307 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:32.930307 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:32.930307 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:32.930307 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:32.930307 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:32.930307 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:32.930307 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:12:32.930307 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:12:32.930307 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. Oct 12 22:12:32.930307 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:32.931137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02b18a2a-b59b-45eb-88a9-a0f0a49b62a4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Returning 404 to user: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:12:32.932045 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-02b18a2a-b59b-45eb-88a9-a0f0a49b62a4 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 404 len: 111 microversion: 2.1 time: 0.072709 Oct 12 22:12:32.935624 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1860/3336] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:12:32 2022] DELETE /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:12:32.944233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c4b08094-9e54-475b-bb28-71b4f91b5a86 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:32.945146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c4b08094-9e54-475b-bb28-71b4f91b5a86 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] [instance: fae77315-a6c0-474c-aef9-5c8edda79113] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:32.952704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4b08094-9e54-475b-bb28-71b4f91b5a86 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:32.953195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4b08094-9e54-475b-bb28-71b4f91b5a86 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:32.958302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7b736d6d-60d0-4283-994b-38cbaa9e72b2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:32.965072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4b08094-9e54-475b-bb28-71b4f91b5a86 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:32.968406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4b08094-9e54-475b-bb28-71b4f91b5a86 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:32.969164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4b08094-9e54-475b-bb28-71b4f91b5a86 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:32.969289 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7b736d6d-60d0-4283-994b-38cbaa9e72b2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1331 microversion: 2.1 time: 0.355543 Oct 12 22:12:32.970742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4b08094-9e54-475b-bb28-71b4f91b5a86 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:32.971014 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1477/3337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:32 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1331 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:33.014210 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-c4b08094-9e54-475b-bb28-71b4f91b5a86 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] HTTP exception thrown: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c4b08094-9e54-475b-bb28-71b4f91b5a86 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Request method failure captured: Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 HTTP/1.1 Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRztH-2cK6EcNrtu-ZFwiruT6Q8zJdENYas1C6WcCB9aoZvIW_Yd_lMijAJEpfeIDVAE3iHxx_b3e15m_Drd-MP8HS_4RlHH7J-ugq0PIYEKg7Kaaz8t2BWs25twn5bRCwgR449YSnstuvCm6JOwramKI9NMnWnRgFVTMwM5Y9dJ-lec Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0287e296f1c9414e81fbd0212bde30ad Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestMultiNic-1304317170 Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0287e296f1c9414e81fbd0212bde30ad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0287e296f1c9414e81fbd0212bde30ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestMultiNic-1304317170 Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0287e296f1c9414e81fbd0212bde30ad Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestMultiNic-1304317170 Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestMultiNic-1304317170-project Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 4c5adfbe06184b1e8531545707047456 Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestMultiNic-1304317170-project Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'fae77315-a6c0-474c-aef9-5c8edda79113'} Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:33.031461 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:33.035915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:33.035915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:33.035915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:33.035915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:12:33.035915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:12:33.035915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. Oct 12 22:12:33.035915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:33.037467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c4b08094-9e54-475b-bb28-71b4f91b5a86 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] Returning 404 to user: Instance fae77315-a6c0-474c-aef9-5c8edda79113 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:12:33.038514 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c4b08094-9e54-475b-bb28-71b4f91b5a86 tempest-ServersTestMultiNic-1304317170 tempest-ServersTestMultiNic-1304317170-project] 10.222.0.16 "GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113" status: 404 len: 111 microversion: 2.1 time: 0.098869 Oct 12 22:12:33.042066 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1861/3338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:32 2022] GET /compute/v2.1/servers/fae77315-a6c0-474c-aef9-5c8edda79113 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:12:33.304290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eae58d6a-6fb6-41a9-b86d-637c77e8df1e tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:33.305298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eae58d6a-6fb6-41a9-b86d-637c77e8df1e tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:33.318843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eae58d6a-6fb6-41a9-b86d-637c77e8df1e tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:33.319788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eae58d6a-6fb6-41a9-b86d-637c77e8df1e tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:33.320467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eae58d6a-6fb6-41a9-b86d-637c77e8df1e tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:33.328040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eae58d6a-6fb6-41a9-b86d-637c77e8df1e tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:33.328630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eae58d6a-6fb6-41a9-b86d-637c77e8df1e tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:33.330500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eae58d6a-6fb6-41a9-b86d-637c77e8df1e tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:33.382254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-25ffcfca-879a-4e8a-b437-f5ad69694175 req-d5f8b710-db41-44fd-9b29-4aa006e9a810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba7407a-199c-49e6-947d-eee5e1e616c7", "name": "network-vif-deleted", "tag": "4bee2c3f-5642-485e-a878-61e340a21f21"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:33.395232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-25ffcfca-879a-4e8a-b437-f5ad69694175 req-d5f8b710-db41-44fd-9b29-4aa006e9a810 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:33.395726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-25ffcfca-879a-4e8a-b437-f5ad69694175 req-d5f8b710-db41-44fd-9b29-4aa006e9a810 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:33.396154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-25ffcfca-879a-4e8a-b437-f5ad69694175 req-d5f8b710-db41-44fd-9b29-4aa006e9a810 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:33.418309 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-25ffcfca-879a-4e8a-b437-f5ad69694175 req-d5f8b710-db41-44fd-9b29-4aa006e9a810 service nova] Creating event network-vif-deleted:4bee2c3f-5642-485e-a878-61e340a21f21 for instance cba7407a-199c-49e6-947d-eee5e1e616c7 on n-h2-861111-1 Oct 12 22:12:33.424581 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-25ffcfca-879a-4e8a-b437-f5ad69694175 req-d5f8b710-db41-44fd-9b29-4aa006e9a810 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051514 Oct 12 22:12:33.425620 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1862/3339] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:33.461368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e4b00a5b-1f38-4add-8c40-bc629226c991 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:33.462506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e4b00a5b-1f38-4add-8c40-bc629226c991 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:33.477781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4b00a5b-1f38-4add-8c40-bc629226c991 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:33.479530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4b00a5b-1f38-4add-8c40-bc629226c991 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:33.480366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4b00a5b-1f38-4add-8c40-bc629226c991 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:33.481343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4b00a5b-1f38-4add-8c40-bc629226c991 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:33.482021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4b00a5b-1f38-4add-8c40-bc629226c991 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:33.482815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4b00a5b-1f38-4add-8c40-bc629226c991 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:33.648624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eae58d6a-6fb6-41a9-b86d-637c77e8df1e tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:33.657795 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eae58d6a-6fb6-41a9-b86d-637c77e8df1e tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" status: 200 len: 1323 microversion: 2.1 time: 0.359334 Oct 12 22:12:33.658345 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1478/3340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:33 2022] GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 => generated 1323 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:33.669213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dd8181e0-7f28-46fa-8a6c-2f47af5e0abb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:33.669841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dd8181e0-7f28-46fa-8a6c-2f47af5e0abb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:33.682880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd8181e0-7f28-46fa-8a6c-2f47af5e0abb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:33.694158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd8181e0-7f28-46fa-8a6c-2f47af5e0abb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:33.694895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd8181e0-7f28-46fa-8a6c-2f47af5e0abb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:33.697289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd8181e0-7f28-46fa-8a6c-2f47af5e0abb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:33.697921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd8181e0-7f28-46fa-8a6c-2f47af5e0abb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:33.698527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd8181e0-7f28-46fa-8a6c-2f47af5e0abb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:33.829116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dd8181e0-7f28-46fa-8a6c-2f47af5e0abb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:33.857236 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dd8181e0-7f28-46fa-8a6c-2f47af5e0abb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 200 len: 1294 microversion: 2.1 time: 0.197575 Oct 12 22:12:33.858506 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1479/3341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:33 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 1294 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:33.869565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c30bd83c-a353-478f-b2da-6f0384bdae3c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:33.870638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c30bd83c-a353-478f-b2da-6f0384bdae3c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:33.883193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c30bd83c-a353-478f-b2da-6f0384bdae3c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:33.884061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c30bd83c-a353-478f-b2da-6f0384bdae3c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:33.884682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c30bd83c-a353-478f-b2da-6f0384bdae3c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:33.885654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c30bd83c-a353-478f-b2da-6f0384bdae3c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:33.886590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c30bd83c-a353-478f-b2da-6f0384bdae3c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:33.887458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c30bd83c-a353-478f-b2da-6f0384bdae3c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:34.051465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c30bd83c-a353-478f-b2da-6f0384bdae3c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:34.066740 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c30bd83c-a353-478f-b2da-6f0384bdae3c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1430 microversion: 2.1 time: 0.206963 Oct 12 22:12:34.067613 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1480/3342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:33 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1430 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:34.072276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d581a357-9af8-4891-b0b5-a6336bd1dec4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:34.075782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d581a357-9af8-4891-b0b5-a6336bd1dec4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:34.086893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d581a357-9af8-4891-b0b5-a6336bd1dec4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:34.087680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d581a357-9af8-4891-b0b5-a6336bd1dec4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:34.096067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d581a357-9af8-4891-b0b5-a6336bd1dec4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:34.097139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d581a357-9af8-4891-b0b5-a6336bd1dec4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:34.098935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d581a357-9af8-4891-b0b5-a6336bd1dec4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:34.099586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d581a357-9af8-4891-b0b5-a6336bd1dec4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:34.108653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e4b00a5b-1f38-4add-8c40-bc629226c991 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:34.127542 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e4b00a5b-1f38-4add-8c40-bc629226c991 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1677 microversion: 2.1 time: 0.663888 Oct 12 22:12:34.140892 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1863/3343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:33 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1677 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:34.152040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-68d4191f-0129-42db-88b9-2fac06b4fcd2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:34.152959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-68d4191f-0129-42db-88b9-2fac06b4fcd2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:34.163136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68d4191f-0129-42db-88b9-2fac06b4fcd2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:34.169911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68d4191f-0129-42db-88b9-2fac06b4fcd2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:34.171038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68d4191f-0129-42db-88b9-2fac06b4fcd2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:34.171978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68d4191f-0129-42db-88b9-2fac06b4fcd2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:34.172597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68d4191f-0129-42db-88b9-2fac06b4fcd2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:34.173180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68d4191f-0129-42db-88b9-2fac06b4fcd2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:34.224395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d581a357-9af8-4891-b0b5-a6336bd1dec4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:34.238217 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d581a357-9af8-4891-b0b5-a6336bd1dec4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1344 microversion: 2.1 time: 0.168062 Oct 12 22:12:34.242049 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1481/3344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:34 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1344 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:34.682404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2b26238d-d644-4d87-9efd-a1f6726c850d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:34.684048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2b26238d-d644-4d87-9efd-a1f6726c850d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:34.703546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b26238d-d644-4d87-9efd-a1f6726c850d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:34.704807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b26238d-d644-4d87-9efd-a1f6726c850d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:34.705483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b26238d-d644-4d87-9efd-a1f6726c850d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:34.706469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b26238d-d644-4d87-9efd-a1f6726c850d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:34.713375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b26238d-d644-4d87-9efd-a1f6726c850d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:34.714193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b26238d-d644-4d87-9efd-a1f6726c850d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:34.741069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-68d4191f-0129-42db-88b9-2fac06b4fcd2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:34.750592 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-68d4191f-0129-42db-88b9-2fac06b4fcd2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1331 microversion: 2.1 time: 0.608485 Oct 12 22:12:34.753882 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1864/3345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:34 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1331 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:34.887213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aed8cb01-9408-40c1-99de-b5bdc5c6bf05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:34.888104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aed8cb01-9408-40c1-99de-b5bdc5c6bf05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:34.903457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aed8cb01-9408-40c1-99de-b5bdc5c6bf05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:34.904645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aed8cb01-9408-40c1-99de-b5bdc5c6bf05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:34.905233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aed8cb01-9408-40c1-99de-b5bdc5c6bf05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:34.906121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aed8cb01-9408-40c1-99de-b5bdc5c6bf05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:34.906726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aed8cb01-9408-40c1-99de-b5bdc5c6bf05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:34.907359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aed8cb01-9408-40c1-99de-b5bdc5c6bf05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:35.093021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2b26238d-d644-4d87-9efd-a1f6726c850d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:35.102686 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2b26238d-d644-4d87-9efd-a1f6726c850d tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" status: 200 len: 1323 microversion: 2.1 time: 0.425179 Oct 12 22:12:35.118682 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1482/3346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:34 2022] GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 => generated 1323 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:12:35.124525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-edbb5905-f4ab-4dd9-9716-116725a17842 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:35.125148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-edbb5905-f4ab-4dd9-9716-116725a17842 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:35.132185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-edbb5905-f4ab-4dd9-9716-116725a17842 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:35.132390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-edbb5905-f4ab-4dd9-9716-116725a17842 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:35.132994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-edbb5905-f4ab-4dd9-9716-116725a17842 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:35.134064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-edbb5905-f4ab-4dd9-9716-116725a17842 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:35.134756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-edbb5905-f4ab-4dd9-9716-116725a17842 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:35.135369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-edbb5905-f4ab-4dd9-9716-116725a17842 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:35.227182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-edbb5905-f4ab-4dd9-9716-116725a17842 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:35.237696 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-edbb5905-f4ab-4dd9-9716-116725a17842 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1430 microversion: 2.1 time: 0.116889 Oct 12 22:12:35.253047 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1483/3347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:35 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1430 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:35.266261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4e00d4f5-181c-46c1-baff-b487c4ded409 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:35.267050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4e00d4f5-181c-46c1-baff-b487c4ded409 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:35.277103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e00d4f5-181c-46c1-baff-b487c4ded409 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:35.278774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e00d4f5-181c-46c1-baff-b487c4ded409 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:35.279580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e00d4f5-181c-46c1-baff-b487c4ded409 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:35.280553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e00d4f5-181c-46c1-baff-b487c4ded409 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:35.281185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e00d4f5-181c-46c1-baff-b487c4ded409 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:35.281861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e00d4f5-181c-46c1-baff-b487c4ded409 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:35.429379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aed8cb01-9408-40c1-99de-b5bdc5c6bf05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:35.441063 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aed8cb01-9408-40c1-99de-b5bdc5c6bf05 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 200 len: 1300 microversion: 2.1 time: 0.558106 Oct 12 22:12:35.463815 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1865/3348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:34 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 1300 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:35.470695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e438effa-cfca-494f-a488-85d15a3babdc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:35.473749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e438effa-cfca-494f-a488-85d15a3babdc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:35.484304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e438effa-cfca-494f-a488-85d15a3babdc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:35.496091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e438effa-cfca-494f-a488-85d15a3babdc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:35.496913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e438effa-cfca-494f-a488-85d15a3babdc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:35.497939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e438effa-cfca-494f-a488-85d15a3babdc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:35.498517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e438effa-cfca-494f-a488-85d15a3babdc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:35.499009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e438effa-cfca-494f-a488-85d15a3babdc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:35.541507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:35.558711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e438effa-cfca-494f-a488-85d15a3babdc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:35.559215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e438effa-cfca-494f-a488-85d15a3babdc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:35.567490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e438effa-cfca-494f-a488-85d15a3babdc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:35.571324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-e438effa-cfca-494f-a488-85d15a3babdc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lazy-loading 'fault' on Instance uuid ed4377e1-7ac3-4b36-ad3d-ac212282c090 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:12:35.674658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e438effa-cfca-494f-a488-85d15a3babdc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:35.688068 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e438effa-cfca-494f-a488-85d15a3babdc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 200 len: 1349 microversion: 2.1 time: 0.222512 Oct 12 22:12:35.693395 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1866/3349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:35 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 1349 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:35.779094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d233a1c9-cad3-453b-97a0-b8315fc7f849 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:35.783774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d233a1c9-cad3-453b-97a0-b8315fc7f849 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:35.790717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d233a1c9-cad3-453b-97a0-b8315fc7f849 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:35.791621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d233a1c9-cad3-453b-97a0-b8315fc7f849 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:35.792270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d233a1c9-cad3-453b-97a0-b8315fc7f849 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:35.793267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d233a1c9-cad3-453b-97a0-b8315fc7f849 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:35.794933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d233a1c9-cad3-453b-97a0-b8315fc7f849 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:35.799933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d233a1c9-cad3-453b-97a0-b8315fc7f849 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:36.039768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4e00d4f5-181c-46c1-baff-b487c4ded409 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:36.047496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:36.052832 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4e00d4f5-181c-46c1-baff-b487c4ded409 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1677 microversion: 2.1 time: 0.794907 Oct 12 22:12:36.054702 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1484/3350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:35 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1677 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:36.073198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d233a1c9-cad3-453b-97a0-b8315fc7f849 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:36.081191 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d233a1c9-cad3-453b-97a0-b8315fc7f849 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1331 microversion: 2.1 time: 0.306166 Oct 12 22:12:36.081762 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1867/3351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:35 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1331 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:36.126220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-afa89e6b-5a8b-456d-8f98-a9d035d33b64 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:36.127101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-afa89e6b-5a8b-456d-8f98-a9d035d33b64 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:36.133733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afa89e6b-5a8b-456d-8f98-a9d035d33b64 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:36.134221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afa89e6b-5a8b-456d-8f98-a9d035d33b64 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:36.134654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afa89e6b-5a8b-456d-8f98-a9d035d33b64 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:36.136153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afa89e6b-5a8b-456d-8f98-a9d035d33b64 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:36.136759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afa89e6b-5a8b-456d-8f98-a9d035d33b64 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:36.137346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afa89e6b-5a8b-456d-8f98-a9d035d33b64 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:36.265012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f04fc6bd-9f0e-49de-9324-d8be2383f08f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:36.265618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f04fc6bd-9f0e-49de-9324-d8be2383f08f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:36.282400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f04fc6bd-9f0e-49de-9324-d8be2383f08f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:36.282893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f04fc6bd-9f0e-49de-9324-d8be2383f08f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:36.283361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f04fc6bd-9f0e-49de-9324-d8be2383f08f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:36.284078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f04fc6bd-9f0e-49de-9324-d8be2383f08f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:36.284526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f04fc6bd-9f0e-49de-9324-d8be2383f08f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:36.284950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f04fc6bd-9f0e-49de-9324-d8be2383f08f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:36.353906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f04fc6bd-9f0e-49de-9324-d8be2383f08f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:36.354455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f04fc6bd-9f0e-49de-9324-d8be2383f08f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:36.354887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f04fc6bd-9f0e-49de-9324-d8be2383f08f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:36.355450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-f04fc6bd-9f0e-49de-9324-d8be2383f08f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lazy-loading 'fault' on Instance uuid cba7407a-199c-49e6-947d-eee5e1e616c7 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:12:36.424331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f04fc6bd-9f0e-49de-9324-d8be2383f08f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:36.440658 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f04fc6bd-9f0e-49de-9324-d8be2383f08f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 200 len: 1307 microversion: 2.1 time: 0.178739 Oct 12 22:12:36.441977 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1868/3352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:36 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 1307 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:36.471261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f8f94a49-9034-4704-a153-dc940aeee421 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:36.472241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f8f94a49-9034-4704-a153-dc940aeee421 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:36.487528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8f94a49-9034-4704-a153-dc940aeee421 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:36.488423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8f94a49-9034-4704-a153-dc940aeee421 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:36.489325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8f94a49-9034-4704-a153-dc940aeee421 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:36.492827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8f94a49-9034-4704-a153-dc940aeee421 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:36.495021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8f94a49-9034-4704-a153-dc940aeee421 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:36.495826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8f94a49-9034-4704-a153-dc940aeee421 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:36.868158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f8f94a49-9034-4704-a153-dc940aeee421 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:36.877096 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f8f94a49-9034-4704-a153-dc940aeee421 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 200 len: 1367 microversion: 2.1 time: 0.410659 Oct 12 22:12:36.881096 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1869/3353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:36 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 1367 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:36.887402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-5784d30b-c6a6-4c7a-91f2-daf3f1d81db5 req-37d6f0f2-efc6-437e-8a8c-ea89bfc96953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835", "name": "network-vif-plugged", "status": "completed", "tag": "76764896-d8b2-4553-97a9-4df1772081c6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:36.897973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:36.907933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5784d30b-c6a6-4c7a-91f2-daf3f1d81db5 req-37d6f0f2-efc6-437e-8a8c-ea89bfc96953 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:36.908484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5784d30b-c6a6-4c7a-91f2-daf3f1d81db5 req-37d6f0f2-efc6-437e-8a8c-ea89bfc96953 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:36.909175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5784d30b-c6a6-4c7a-91f2-daf3f1d81db5 req-37d6f0f2-efc6-437e-8a8c-ea89bfc96953 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:36.924360 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-5784d30b-c6a6-4c7a-91f2-daf3f1d81db5 req-37d6f0f2-efc6-437e-8a8c-ea89bfc96953 service nova] Creating event network-vif-plugged:76764896-d8b2-4553-97a9-4df1772081c6 for instance c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 on n-h1-861111-1 Oct 12 22:12:36.929093 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-5784d30b-c6a6-4c7a-91f2-daf3f1d81db5 req-37d6f0f2-efc6-437e-8a8c-ea89bfc96953 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045230 Oct 12 22:12:36.930321 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1870/3354] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:36.936909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4d681162-605e-4277-83f3-b00261042540 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:36.937887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4d681162-605e-4277-83f3-b00261042540 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:36.963607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d681162-605e-4277-83f3-b00261042540 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:36.965309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d681162-605e-4277-83f3-b00261042540 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:36.965791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d681162-605e-4277-83f3-b00261042540 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:36.966851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d681162-605e-4277-83f3-b00261042540 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:36.967006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d681162-605e-4277-83f3-b00261042540 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:36.967520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d681162-605e-4277-83f3-b00261042540 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:36.987736 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-4d681162-605e-4277-83f3-b00261042540 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4d681162-605e-4277-83f3-b00261042540 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 HTTP/1.1 Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'ed4377e1-7ac3-4b36-ad3d-ac212282c090'} Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:36.990499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:36.994499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:36.994499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:36.994499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:36.994499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:12:36.994499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:12:36.994499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:12:36.994499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:36.997032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4d681162-605e-4277-83f3-b00261042540 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:12:36.998124 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4d681162-605e-4277-83f3-b00261042540 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 404 len: 111 microversion: 2.1 time: 0.066304 Oct 12 22:12:36.999277 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1871/3355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:36 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:12:37.078163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ef47002e-8bee-42bf-ba6c-5e26c298c080 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:37.079087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ef47002e-8bee-42bf-ba6c-5e26c298c080 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:37.101093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef47002e-8bee-42bf-ba6c-5e26c298c080 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:37.101596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef47002e-8bee-42bf-ba6c-5e26c298c080 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:37.102044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef47002e-8bee-42bf-ba6c-5e26c298c080 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:37.102766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef47002e-8bee-42bf-ba6c-5e26c298c080 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:37.103229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef47002e-8bee-42bf-ba6c-5e26c298c080 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:37.103686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef47002e-8bee-42bf-ba6c-5e26c298c080 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:37.198965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-afa89e6b-5a8b-456d-8f98-a9d035d33b64 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:37.209940 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-afa89e6b-5a8b-456d-8f98-a9d035d33b64 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" status: 200 len: 1323 microversion: 2.1 time: 1.087847 Oct 12 22:12:37.228048 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1485/3356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:36 2022] GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 => generated 1323 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:37.242168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ec8dfaba-eb3f-47a2-8160-5eff7b59664c tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:37.242812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ec8dfaba-eb3f-47a2-8160-5eff7b59664c tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:37.251585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec8dfaba-eb3f-47a2-8160-5eff7b59664c tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:37.252579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec8dfaba-eb3f-47a2-8160-5eff7b59664c tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:37.253214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec8dfaba-eb3f-47a2-8160-5eff7b59664c tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:37.255259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec8dfaba-eb3f-47a2-8160-5eff7b59664c tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:37.255948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec8dfaba-eb3f-47a2-8160-5eff7b59664c tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:37.256565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec8dfaba-eb3f-47a2-8160-5eff7b59664c tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:37.435669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ef47002e-8bee-42bf-ba6c-5e26c298c080 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:37.452249 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ef47002e-8bee-42bf-ba6c-5e26c298c080 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.377056 Oct 12 22:12:37.459729 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1872/3357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:37 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:37.475896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-19573f8e-04ed-4416-8c91-91aa675b8e4c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:37.481603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-19573f8e-04ed-4416-8c91-91aa675b8e4c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:37.492183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19573f8e-04ed-4416-8c91-91aa675b8e4c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:37.494408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19573f8e-04ed-4416-8c91-91aa675b8e4c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:37.494882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19573f8e-04ed-4416-8c91-91aa675b8e4c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:37.495667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19573f8e-04ed-4416-8c91-91aa675b8e4c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:37.497240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19573f8e-04ed-4416-8c91-91aa675b8e4c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:37.497846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19573f8e-04ed-4416-8c91-91aa675b8e4c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:37.537312 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-19573f8e-04ed-4416-8c91-91aa675b8e4c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-19573f8e-04ed-4416-8c91-91aa675b8e4c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090/os-volume_attachments HTTP/1.1 Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'server_id': 'ed4377e1-7ac3-4b36-ad3d-ac212282c090'} Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:12:37.544144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:12:37.548728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:12:37.548728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:37.548728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:37.548728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:37.548728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:37.548728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:37.548728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:37.548728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:12:37.548728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:12:37.548728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:12:37.548728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:37.550712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-19573f8e-04ed-4416-8c91-91aa675b8e4c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:12:37.553589 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-19573f8e-04ed-4416-8c91-91aa675b8e4c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.090582 Oct 12 22:12:37.556022 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1873/3358] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:12:37 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090/os-volume_attachments => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:12:37.565565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-652d5a54-2a20-40cf-86d4-ceb8c1c96d69 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:37.572963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-652d5a54-2a20-40cf-86d4-ceb8c1c96d69 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: cba7407a-199c-49e6-947d-eee5e1e616c7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:37.588280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-652d5a54-2a20-40cf-86d4-ceb8c1c96d69 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:37.589505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-652d5a54-2a20-40cf-86d4-ceb8c1c96d69 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:37.590098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-652d5a54-2a20-40cf-86d4-ceb8c1c96d69 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:37.591072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-652d5a54-2a20-40cf-86d4-ceb8c1c96d69 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:37.592212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-652d5a54-2a20-40cf-86d4-ceb8c1c96d69 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:37.592858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-652d5a54-2a20-40cf-86d4-ceb8c1c96d69 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:37.617755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ec8dfaba-eb3f-47a2-8160-5eff7b59664c tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:37.625795 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-652d5a54-2a20-40cf-86d4-ceb8c1c96d69 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] HTTP exception thrown: Instance cba7407a-199c-49e6-947d-eee5e1e616c7 could not be found. Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-652d5a54-2a20-40cf-86d4-ceb8c1c96d69 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Request method failure captured: Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 HTTP/1.1 Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzr98Hx3HSZUwq13XuvkKDPq0Iz5m-bV7cM398dlrUOClDHZvKrry9jEBmFlbHSmTggU-8Kzhn-tq2F0pNUWaJ0dz4mTrYT4WEggz5nFy73h3CWXJWY0xrriAWPLgFsaD4ELYtj-jFuaZbDIGMPZ-s-9QASFcLZt-WruPxAE5oPSHB0 Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1da6fbca378a43c6b71b9b1b2fa1bc7c Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1da6fbca378a43c6b71b9b1b2fa1bc7c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1da6fbca378a43c6b71b9b1b2fa1bc7c Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersOnMultiNodesTest-2073144359-project Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7a8e7139c1694698a5fde98743165501 Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersOnMultiNodesTest-2073144359-project Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance cba7407a-199c-49e6-947d-eee5e1e616c7 could not be found. Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'cba7407a-199c-49e6-947d-eee5e1e616c7'} Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba7407a-199c-49e6-947d-eee5e1e616c7 could not be found. Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba7407a-199c-49e6-947d-eee5e1e616c7 could not be found. Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:37.628617 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:37.633665 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:37.633665 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:37.633665 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:37.633665 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:12:37.633665 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:12:37.633665 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba7407a-199c-49e6-947d-eee5e1e616c7 could not be found. Oct 12 22:12:37.633665 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:37.633665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-652d5a54-2a20-40cf-86d4-ceb8c1c96d69 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Returning 404 to user: Instance cba7407a-199c-49e6-947d-eee5e1e616c7 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:12:37.633665 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-652d5a54-2a20-40cf-86d4-ceb8c1c96d69 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7" status: 404 len: 111 microversion: 2.1 time: 0.073339 Oct 12 22:12:37.633665 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1874/3359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:37 2022] GET /compute/v2.1/servers/cba7407a-199c-49e6-947d-eee5e1e616c7 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:12:37.634522 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ec8dfaba-eb3f-47a2-8160-5eff7b59664c tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1331 microversion: 2.1 time: 0.396640 Oct 12 22:12:37.639898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8a0fef05-f571-41ca-8a39-d20f35a479a3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:37.642228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8a0fef05-f571-41ca-8a39-d20f35a479a3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:37.651472 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1486/3360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:37 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1331 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:37.652033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a0fef05-f571-41ca-8a39-d20f35a479a3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:37.652033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a0fef05-f571-41ca-8a39-d20f35a479a3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:37.652033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a0fef05-f571-41ca-8a39-d20f35a479a3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:37.652033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a0fef05-f571-41ca-8a39-d20f35a479a3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:37.652033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a0fef05-f571-41ca-8a39-d20f35a479a3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:37.652759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a0fef05-f571-41ca-8a39-d20f35a479a3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:37.655168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-679d4c5a-5a66-4380-9092-424292bc0901 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:37.656025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-679d4c5a-5a66-4380-9092-424292bc0901 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: b862f7de-fe9b-49bc-9e77-0d3e453558e8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:37.675525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-679d4c5a-5a66-4380-9092-424292bc0901 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:37.676291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-679d4c5a-5a66-4380-9092-424292bc0901 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:37.676740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-679d4c5a-5a66-4380-9092-424292bc0901 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:37.677462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-679d4c5a-5a66-4380-9092-424292bc0901 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:37.678244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-679d4c5a-5a66-4380-9092-424292bc0901 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:37.678392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-679d4c5a-5a66-4380-9092-424292bc0901 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:37.717512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-679d4c5a-5a66-4380-9092-424292bc0901 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: b862f7de-fe9b-49bc-9e77-0d3e453558e8] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:12:37.753054 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8a0fef05-f571-41ca-8a39-d20f35a479a3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 200 len: 324 microversion: 2.1 time: 0.118707 Oct 12 22:12:37.759551 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1875/3361] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:12:37 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 324 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:37.773511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7b582e7d-85ce-48d8-a22e-1684f02a0f2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:37.775906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7b582e7d-85ce-48d8-a22e-1684f02a0f2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:37.798307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b582e7d-85ce-48d8-a22e-1684f02a0f2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:37.800688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b582e7d-85ce-48d8-a22e-1684f02a0f2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:37.804380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b582e7d-85ce-48d8-a22e-1684f02a0f2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:37.806706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b582e7d-85ce-48d8-a22e-1684f02a0f2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:37.807589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b582e7d-85ce-48d8-a22e-1684f02a0f2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:37.811990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b582e7d-85ce-48d8-a22e-1684f02a0f2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:37.842446 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-679d4c5a-5a66-4380-9092-424292bc0901 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b862f7de-fe9b-49bc-9e77-0d3e453558e8" status: 204 len: 0 microversion: 2.1 time: 0.192844 Oct 12 22:12:37.843483 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1487/3362] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:12:37 2022] DELETE /compute/v2.1/servers/b862f7de-fe9b-49bc-9e77-0d3e453558e8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:12:37.853770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6ff57cbf-827f-416d-acfc-a8e4d439a213 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:37.854601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6ff57cbf-827f-416d-acfc-a8e4d439a213 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:37.873195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ff57cbf-827f-416d-acfc-a8e4d439a213 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:37.874206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ff57cbf-827f-416d-acfc-a8e4d439a213 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:37.874849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ff57cbf-827f-416d-acfc-a8e4d439a213 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:37.885637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ff57cbf-827f-416d-acfc-a8e4d439a213 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:37.886707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ff57cbf-827f-416d-acfc-a8e4d439a213 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:37.887475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ff57cbf-827f-416d-acfc-a8e4d439a213 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:37.952754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6ff57cbf-827f-416d-acfc-a8e4d439a213 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:12:38.070216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:38.079101 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6ff57cbf-827f-416d-acfc-a8e4d439a213 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 204 len: 0 microversion: 2.1 time: 0.230209 Oct 12 22:12:38.080482 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1488/3363] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:12:37 2022] DELETE /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:12:38.089608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ec98099e-2256-4e12-b9e8-e29f9e733f18 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:38.091477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ec98099e-2256-4e12-b9e8-e29f9e733f18 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:38.101368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec98099e-2256-4e12-b9e8-e29f9e733f18 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:38.101937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec98099e-2256-4e12-b9e8-e29f9e733f18 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:38.102454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec98099e-2256-4e12-b9e8-e29f9e733f18 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:38.103662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec98099e-2256-4e12-b9e8-e29f9e733f18 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:38.104323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec98099e-2256-4e12-b9e8-e29f9e733f18 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:38.104900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec98099e-2256-4e12-b9e8-e29f9e733f18 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:38.156562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7b582e7d-85ce-48d8-a22e-1684f02a0f2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:38.171552 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7b582e7d-85ce-48d8-a22e-1684f02a0f2b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.410644 Oct 12 22:12:38.172277 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1876/3364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:37 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:38.179652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1099484451", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "8a2bd9d3-e80d-4911-bb4a-296de8e90165"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:38.264760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] validate_networks() for [('8a2bd9d3-e80d-4911-bb4a-296de8e90165', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:12:38.474323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ec98099e-2256-4e12-b9e8-e29f9e733f18 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:38.483726 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ec98099e-2256-4e12-b9e8-e29f9e733f18 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 200 len: 1367 microversion: 2.1 time: 0.401870 Oct 12 22:12:38.499513 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1489/3365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:38 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 1367 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:38.516679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d8266dbd-e225-4fc4-a2d3-bfc2d6cc958d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:38.517957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d8266dbd-e225-4fc4-a2d3-bfc2d6cc958d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: b862f7de-fe9b-49bc-9e77-0d3e453558e8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:38.526054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8266dbd-e225-4fc4-a2d3-bfc2d6cc958d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:38.526951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8266dbd-e225-4fc4-a2d3-bfc2d6cc958d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:38.527432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8266dbd-e225-4fc4-a2d3-bfc2d6cc958d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:38.528532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8266dbd-e225-4fc4-a2d3-bfc2d6cc958d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:38.529347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8266dbd-e225-4fc4-a2d3-bfc2d6cc958d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:38.529603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8266dbd-e225-4fc4-a2d3-bfc2d6cc958d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:38.782369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d8266dbd-e225-4fc4-a2d3-bfc2d6cc958d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:38.798631 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d8266dbd-e225-4fc4-a2d3-bfc2d6cc958d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/b862f7de-fe9b-49bc-9e77-0d3e453558e8" status: 200 len: 1473 microversion: 2.1 time: 0.297690 Oct 12 22:12:38.818505 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1490/3366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:38 2022] GET /compute/v2.1/servers/b862f7de-fe9b-49bc-9e77-0d3e453558e8 => generated 1473 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:38.825078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-233575e8-8156-4965-b4a7-64f640cbda61 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:38.825917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-233575e8-8156-4965-b4a7-64f640cbda61 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:38.836433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-233575e8-8156-4965-b4a7-64f640cbda61 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:38.837140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-233575e8-8156-4965-b4a7-64f640cbda61 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:38.837637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-233575e8-8156-4965-b4a7-64f640cbda61 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:38.838637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-233575e8-8156-4965-b4a7-64f640cbda61 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:38.839284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-233575e8-8156-4965-b4a7-64f640cbda61 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:38.839932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-233575e8-8156-4965-b4a7-64f640cbda61 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:39.031824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-233575e8-8156-4965-b4a7-64f640cbda61 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:39.043860 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-233575e8-8156-4965-b4a7-64f640cbda61 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.224078 Oct 12 22:12:39.044457 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1491/3367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:38 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:39.059516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b90c8583-c02a-4349-8622-6d66fda003ff tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:39.060888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b90c8583-c02a-4349-8622-6d66fda003ff tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:39.070278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b90c8583-c02a-4349-8622-6d66fda003ff tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:39.070685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b90c8583-c02a-4349-8622-6d66fda003ff tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:39.074771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b90c8583-c02a-4349-8622-6d66fda003ff tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:39.075736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b90c8583-c02a-4349-8622-6d66fda003ff tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:39.076055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b90c8583-c02a-4349-8622-6d66fda003ff tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:39.076602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b90c8583-c02a-4349-8622-6d66fda003ff tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:39.174133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:12:39.174628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:12:39.180117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:12:39.180787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:12:39.181496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:12:39.201254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:39.201797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:39.203569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:39.215415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:39.216068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:39.216529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:39.245462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Getting quotas for project 4b898b5d0208478e996b7fee2060ed64. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:12:39.253711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Getting quotas for user 11096cece79f4b8fad4b92270f51b299 and project 4b898b5d0208478e996b7fee2060ed64. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:12:39.269466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:12:39.273630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 934f8d4a-d673-424d-a2b8-498156de4c86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:12:39.300213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b90c8583-c02a-4349-8622-6d66fda003ff tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:39.312484 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b90c8583-c02a-4349-8622-6d66fda003ff tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" status: 200 len: 1323 microversion: 2.1 time: 0.264704 Oct 12 22:12:39.317671 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1492/3368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:39 2022] GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 => generated 1323 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:39.333146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6086d401-a3e9-4cd6-9875-3967612f906a tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:39.333639 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-371c0525-98a5-4549-aff8-66370eaecc3c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.159763 Oct 12 22:12:39.335561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6086d401-a3e9-4cd6-9875-3967612f906a tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:39.336034 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1877/3369] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:12:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:12:39.340768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-445a3428-702a-4571-bcb1-b7d3e74db46d req-72611fd9-4960-45ff-8e5c-d48d40cf8d1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feeebc28-6cfd-4f7d-8e32-d725731d0ba3", "tag": "10b52e2e-0015-4406-ae37-d8e3d7eab6de"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:39.349064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6086d401-a3e9-4cd6-9875-3967612f906a tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:39.351797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6086d401-a3e9-4cd6-9875-3967612f906a tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:39.352272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6086d401-a3e9-4cd6-9875-3967612f906a tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:39.352873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-445a3428-702a-4571-bcb1-b7d3e74db46d req-72611fd9-4960-45ff-8e5c-d48d40cf8d1c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:39.353544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-445a3428-702a-4571-bcb1-b7d3e74db46d req-72611fd9-4960-45ff-8e5c-d48d40cf8d1c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:39.354161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-445a3428-702a-4571-bcb1-b7d3e74db46d req-72611fd9-4960-45ff-8e5c-d48d40cf8d1c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:39.359689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6086d401-a3e9-4cd6-9875-3967612f906a tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:39.360606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6086d401-a3e9-4cd6-9875-3967612f906a tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:39.361069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6086d401-a3e9-4cd6-9875-3967612f906a tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:39.368985 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-445a3428-702a-4571-bcb1-b7d3e74db46d req-72611fd9-4960-45ff-8e5c-d48d40cf8d1c service nova] Creating event network-changed:10b52e2e-0015-4406-ae37-d8e3d7eab6de for instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 on n-h1-861111-1 Oct 12 22:12:39.374253 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-445a3428-702a-4571-bcb1-b7d3e74db46d req-72611fd9-4960-45ff-8e5c-d48d40cf8d1c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036892 Oct 12 22:12:39.380105 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1878/3370] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:39.386086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bdf80fbe-6503-44aa-a9b8-420c07079bb0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:39.387013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bdf80fbe-6503-44aa-a9b8-420c07079bb0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:39.394630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bdf80fbe-6503-44aa-a9b8-420c07079bb0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:39.396511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bdf80fbe-6503-44aa-a9b8-420c07079bb0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:39.397299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bdf80fbe-6503-44aa-a9b8-420c07079bb0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:39.398569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bdf80fbe-6503-44aa-a9b8-420c07079bb0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:39.399372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bdf80fbe-6503-44aa-a9b8-420c07079bb0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:39.400092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bdf80fbe-6503-44aa-a9b8-420c07079bb0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:39.906151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bdf80fbe-6503-44aa-a9b8-420c07079bb0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:39.916783 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bdf80fbe-6503-44aa-a9b8-420c07079bb0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.534973 Oct 12 22:12:39.920191 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1879/3371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:39 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:39.925176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a692fc0e-1732-4a68-bd3f-392d4b827f3a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:39.934759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6086d401-a3e9-4cd6-9875-3967612f906a tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:39.938389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a692fc0e-1732-4a68-bd3f-392d4b827f3a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 934f8d4a-d673-424d-a2b8-498156de4c86] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:39.949072 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6086d401-a3e9-4cd6-9875-3967612f906a tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1534 microversion: 2.1 time: 0.627258 Oct 12 22:12:39.949987 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1493/3372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:39 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1534 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:39.956369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e6babce2-2b6c-4ff4-afa7-b0ca16e9a2cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:39.956986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e6babce2-2b6c-4ff4-afa7-b0ca16e9a2cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:39.981995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6babce2-2b6c-4ff4-afa7-b0ca16e9a2cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:39.982507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6babce2-2b6c-4ff4-afa7-b0ca16e9a2cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:39.982952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6babce2-2b6c-4ff4-afa7-b0ca16e9a2cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:39.983976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6babce2-2b6c-4ff4-afa7-b0ca16e9a2cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:39.984460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6babce2-2b6c-4ff4-afa7-b0ca16e9a2cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:39.984861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6babce2-2b6c-4ff4-afa7-b0ca16e9a2cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:40.034759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a692fc0e-1732-4a68-bd3f-392d4b827f3a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:40.045505 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a692fc0e-1732-4a68-bd3f-392d4b827f3a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/934f8d4a-d673-424d-a2b8-498156de4c86" status: 200 len: 1215 microversion: 2.1 time: 0.123946 Oct 12 22:12:40.049832 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1880/3373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:39 2022] GET /compute/v2.1/servers/934f8d4a-d673-424d-a2b8-498156de4c86 => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:40.072071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f1910204-f971-48da-8c39-cd6ec53b55e3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:40.072710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f1910204-f971-48da-8c39-cd6ec53b55e3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: b862f7de-fe9b-49bc-9e77-0d3e453558e8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:40.089929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1910204-f971-48da-8c39-cd6ec53b55e3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:40.101336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1910204-f971-48da-8c39-cd6ec53b55e3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:40.102219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1910204-f971-48da-8c39-cd6ec53b55e3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:40.103182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1910204-f971-48da-8c39-cd6ec53b55e3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:40.103984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1910204-f971-48da-8c39-cd6ec53b55e3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:40.104616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1910204-f971-48da-8c39-cd6ec53b55e3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:40.413058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f1910204-f971-48da-8c39-cd6ec53b55e3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:40.424476 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f1910204-f971-48da-8c39-cd6ec53b55e3 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/b862f7de-fe9b-49bc-9e77-0d3e453558e8" status: 200 len: 1473 microversion: 2.1 time: 0.373388 Oct 12 22:12:40.453141 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1881/3374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:40 2022] GET /compute/v2.1/servers/b862f7de-fe9b-49bc-9e77-0d3e453558e8 => generated 1473 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:40.460384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-591bd7fb-7ccf-4132-a008-897073060896 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:40.461765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-591bd7fb-7ccf-4132-a008-897073060896 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:40.472056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-591bd7fb-7ccf-4132-a008-897073060896 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:40.474659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-591bd7fb-7ccf-4132-a008-897073060896 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:40.475362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-591bd7fb-7ccf-4132-a008-897073060896 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:40.476318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-591bd7fb-7ccf-4132-a008-897073060896 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:40.478026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-591bd7fb-7ccf-4132-a008-897073060896 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:40.478714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-591bd7fb-7ccf-4132-a008-897073060896 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:40.562337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e6babce2-2b6c-4ff4-afa7-b0ca16e9a2cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:40.571270 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e6babce2-2b6c-4ff4-afa7-b0ca16e9a2cb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 200 len: 1367 microversion: 2.1 time: 0.620176 Oct 12 22:12:40.576801 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1494/3375] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:39 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 1367 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:40.595397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f90f470-230b-4f08-8c70-a7a48be9ec19 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Action: 'create', calling method: .version_select at 0x7f512841c280>, body: {"pool": "21b6d064-e8e1-4525-a9dd-3c2b7193f582"} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:40.749465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-591bd7fb-7ccf-4132-a008-897073060896 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:40.776877 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-591bd7fb-7ccf-4132-a008-897073060896 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.322250 Oct 12 22:12:40.810560 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1882/3376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:40 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:40.818184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a1db73a8-3077-49d9-a7d4-1c270e3ac8b7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:40.819059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a1db73a8-3077-49d9-a7d4-1c270e3ac8b7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 934f8d4a-d673-424d-a2b8-498156de4c86] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:40.828344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1db73a8-3077-49d9-a7d4-1c270e3ac8b7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:40.828953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1db73a8-3077-49d9-a7d4-1c270e3ac8b7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:40.829500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1db73a8-3077-49d9-a7d4-1c270e3ac8b7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:40.830328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1db73a8-3077-49d9-a7d4-1c270e3ac8b7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:40.830947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1db73a8-3077-49d9-a7d4-1c270e3ac8b7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:40.831561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1db73a8-3077-49d9-a7d4-1c270e3ac8b7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:40.862774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a1db73a8-3077-49d9-a7d4-1c270e3ac8b7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 934f8d4a-d673-424d-a2b8-498156de4c86] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:12:41.021714 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a1db73a8-3077-49d9-a7d4-1c270e3ac8b7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "DELETE /compute/v2.1/servers/934f8d4a-d673-424d-a2b8-498156de4c86" status: 204 len: 0 microversion: 2.1 time: 0.208932 Oct 12 22:12:41.026223 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1883/3377] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:12:40 2022] DELETE /compute/v2.1/servers/934f8d4a-d673-424d-a2b8-498156de4c86 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:12:41.044341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-108d5c29-911f-4485-96eb-3d9da595800b tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:41.045327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-108d5c29-911f-4485-96eb-3d9da595800b tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:41.073387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-108d5c29-911f-4485-96eb-3d9da595800b tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:41.075616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-108d5c29-911f-4485-96eb-3d9da595800b tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:41.077555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-108d5c29-911f-4485-96eb-3d9da595800b tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:41.078744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-108d5c29-911f-4485-96eb-3d9da595800b tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:41.079705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-108d5c29-911f-4485-96eb-3d9da595800b tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:41.082777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-108d5c29-911f-4485-96eb-3d9da595800b tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:41.339748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-108d5c29-911f-4485-96eb-3d9da595800b tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:41.354134 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-108d5c29-911f-4485-96eb-3d9da595800b tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" status: 200 len: 1519 microversion: 2.1 time: 0.315361 Oct 12 22:12:41.356698 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1884/3378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:41 2022] GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 => generated 1519 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:41.366038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1211488591", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "68fd94b2-ed36-4c67-ae5b-2f754d0450a2"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:41.482917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] validate_networks() for [('68fd94b2-ed36-4c67-ae5b-2f754d0450a2', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:12:41.682795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:42.606075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=20 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:42.921205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:12:42.922401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:12:42.923185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:12:42.924888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:12:42.925544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:12:42.955424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:42.958745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:42.960201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:42.961265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:42.966708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:42.967962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:43.033881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Getting quotas for project 319a8f107945457a8a8f8e9690a697e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:12:43.044258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Getting quotas for user b29c500796d54d6188ff65056340d35f and project 319a8f107945457a8a8f8e9690a697e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:12:43.077351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:12:43.083483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:12:43.245394 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e4566fe1-43e8-46eb-9cfd-dd61b483d3a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.887486 Oct 12 22:12:43.246069 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1885/3379] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:12:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:12:43.262482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-869633aa-9f7f-4180-bc13-da21387ba278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:43.266785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-869633aa-9f7f-4180-bc13-da21387ba278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 934f8d4a-d673-424d-a2b8-498156de4c86] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:43.287747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-869633aa-9f7f-4180-bc13-da21387ba278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:43.288256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-869633aa-9f7f-4180-bc13-da21387ba278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:43.288712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-869633aa-9f7f-4180-bc13-da21387ba278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:43.289432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-869633aa-9f7f-4180-bc13-da21387ba278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:43.289894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-869633aa-9f7f-4180-bc13-da21387ba278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:43.290330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-869633aa-9f7f-4180-bc13-da21387ba278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:43.325634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:43.424412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-869633aa-9f7f-4180-bc13-da21387ba278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:43.433239 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-869633aa-9f7f-4180-bc13-da21387ba278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/934f8d4a-d673-424d-a2b8-498156de4c86" status: 200 len: 1219 microversion: 2.1 time: 0.177501 Oct 12 22:12:43.442068 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1886/3380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:43 2022] GET /compute/v2.1/servers/934f8d4a-d673-424d-a2b8-498156de4c86 => generated 1219 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:43.451092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a4a94594-abef-4031-aae2-0cd49553b184 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Action: 'action', calling method: .version_select at 0x7f5129e27b80>, body: {"addFloatingIp": {"address": "172.25.2.111"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:43.464514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a4a94594-abef-4031-aae2-0cd49553b184 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:43.489591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4a94594-abef-4031-aae2-0cd49553b184 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:43.493830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4a94594-abef-4031-aae2-0cd49553b184 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:43.498633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4a94594-abef-4031-aae2-0cd49553b184 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:43.499957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4a94594-abef-4031-aae2-0cd49553b184 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:43.500666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4a94594-abef-4031-aae2-0cd49553b184 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:43.507896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4a94594-abef-4031-aae2-0cd49553b184 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:43.627198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4a94594-abef-4031-aae2-0cd49553b184 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "refresh_cache-f924aa3b-0c00-4577-bb06-3a169f972d3d" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:12:43.627648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4a94594-abef-4031-aae2-0cd49553b184 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquired lock "refresh_cache-f924aa3b-0c00-4577-bb06-3a169f972d3d" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:12:44.819771 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f90f470-230b-4f08-8c70-a7a48be9ec19 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.241448 Oct 12 22:12:44.828139 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1495/3381] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 12 22:12:40 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:44.831803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f36a7a07-a31a-4f3e-beaf-7a8a1147cace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:44.832973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f36a7a07-a31a-4f3e-beaf-7a8a1147cace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: b862f7de-fe9b-49bc-9e77-0d3e453558e8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:44.846484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f36a7a07-a31a-4f3e-beaf-7a8a1147cace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:44.846978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f36a7a07-a31a-4f3e-beaf-7a8a1147cace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:44.847437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f36a7a07-a31a-4f3e-beaf-7a8a1147cace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:44.848797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f36a7a07-a31a-4f3e-beaf-7a8a1147cace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:44.849250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f36a7a07-a31a-4f3e-beaf-7a8a1147cace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:44.849671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f36a7a07-a31a-4f3e-beaf-7a8a1147cace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:44.876931 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-f36a7a07-a31a-4f3e-beaf-7a8a1147cace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] HTTP exception thrown: Instance b862f7de-fe9b-49bc-9e77-0d3e453558e8 could not be found. Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f36a7a07-a31a-4f3e-beaf-7a8a1147cace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Request method failure captured: Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/b862f7de-fe9b-49bc-9e77-0d3e453558e8 HTTP/1.1 Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzr98Hx3HSZUwq13XuvkKDPq0Iz5m-bV7cM398dlrUOClDHZvKrry9jEBmFlbHSmTggU-8Kzhn-tq2F0pNUWaJ0dz4mTrYT4WEggz5nFy73h3CWXJWY0xrriAWPLgFsaD4ELYtj-jFuaZbDIGMPZ-s-9QASFcLZt-WruPxAE5oPSHB0 Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1da6fbca378a43c6b71b9b1b2fa1bc7c Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1da6fbca378a43c6b71b9b1b2fa1bc7c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1da6fbca378a43c6b71b9b1b2fa1bc7c Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersOnMultiNodesTest-2073144359-project Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7a8e7139c1694698a5fde98743165501 Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersOnMultiNodesTest-2073144359-project Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance b862f7de-fe9b-49bc-9e77-0d3e453558e8 could not be found. Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'b862f7de-fe9b-49bc-9e77-0d3e453558e8'} Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b862f7de-fe9b-49bc-9e77-0d3e453558e8 could not be found. Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b862f7de-fe9b-49bc-9e77-0d3e453558e8 could not be found. Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:44.878612 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:44.883465 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:44.883465 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:44.883465 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:44.883465 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:12:44.883465 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:12:44.883465 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b862f7de-fe9b-49bc-9e77-0d3e453558e8 could not be found. Oct 12 22:12:44.883465 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:44.883465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f36a7a07-a31a-4f3e-beaf-7a8a1147cace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Returning 404 to user: Instance b862f7de-fe9b-49bc-9e77-0d3e453558e8 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:12:44.883465 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f36a7a07-a31a-4f3e-beaf-7a8a1147cace tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/b862f7de-fe9b-49bc-9e77-0d3e453558e8" status: 404 len: 111 microversion: 2.1 time: 0.058862 Oct 12 22:12:44.883465 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1496/3382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:44 2022] GET /compute/v2.1/servers/b862f7de-fe9b-49bc-9e77-0d3e453558e8 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:12:44.893296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8bf1ec2b-7154-4598-8b17-ec712215fbc6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:44.893953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8bf1ec2b-7154-4598-8b17-ec712215fbc6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:44.914510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bf1ec2b-7154-4598-8b17-ec712215fbc6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:44.915165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bf1ec2b-7154-4598-8b17-ec712215fbc6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:44.915793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bf1ec2b-7154-4598-8b17-ec712215fbc6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:44.922369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bf1ec2b-7154-4598-8b17-ec712215fbc6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:44.922847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bf1ec2b-7154-4598-8b17-ec712215fbc6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:44.923771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bf1ec2b-7154-4598-8b17-ec712215fbc6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:45.297426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8bf1ec2b-7154-4598-8b17-ec712215fbc6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:45.305849 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8bf1ec2b-7154-4598-8b17-ec712215fbc6 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 200 len: 1367 microversion: 2.1 time: 0.423757 Oct 12 22:12:45.324772 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1497/3383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:44 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 1367 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:45.335194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-e1b1e9ed-4452-4701-9dc3-d3c407ca2feb req-adb04480-4dc3-4888-955b-41a05c27c531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29922f3d-5384-486f-8968-4fd73fd9016d", "name": "network-vif-deleted", "tag": "352fa9f3-0c18-4a3c-8393-47d9c4910a0d"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:45.358113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e1b1e9ed-4452-4701-9dc3-d3c407ca2feb req-adb04480-4dc3-4888-955b-41a05c27c531 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:45.364102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e1b1e9ed-4452-4701-9dc3-d3c407ca2feb req-adb04480-4dc3-4888-955b-41a05c27c531 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:45.364810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e1b1e9ed-4452-4701-9dc3-d3c407ca2feb req-adb04480-4dc3-4888-955b-41a05c27c531 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:45.384933 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-e1b1e9ed-4452-4701-9dc3-d3c407ca2feb req-adb04480-4dc3-4888-955b-41a05c27c531 service nova] Creating event network-vif-deleted:352fa9f3-0c18-4a3c-8393-47d9c4910a0d for instance 29922f3d-5384-486f-8968-4fd73fd9016d on n-h1-861111-1 Oct 12 22:12:45.397009 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-e1b1e9ed-4452-4701-9dc3-d3c407ca2feb req-adb04480-4dc3-4888-955b-41a05c27c531 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070731 Oct 12 22:12:45.399384 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1498/3384] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:45.414664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-80bfb0b0-d95f-4f2e-8b1b-996c166a43ff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:45.415762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-80bfb0b0-d95f-4f2e-8b1b-996c166a43ff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:45.431558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80bfb0b0-d95f-4f2e-8b1b-996c166a43ff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:45.432291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80bfb0b0-d95f-4f2e-8b1b-996c166a43ff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:45.432982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80bfb0b0-d95f-4f2e-8b1b-996c166a43ff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:45.433899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80bfb0b0-d95f-4f2e-8b1b-996c166a43ff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:45.434565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80bfb0b0-d95f-4f2e-8b1b-996c166a43ff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:45.435204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80bfb0b0-d95f-4f2e-8b1b-996c166a43ff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:45.565921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-80bfb0b0-d95f-4f2e-8b1b-996c166a43ff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:45.574189 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-80bfb0b0-d95f-4f2e-8b1b-996c166a43ff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1275 microversion: 2.1 time: 0.173378 Oct 12 22:12:45.588273 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1499/3385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:45 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:45.593673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0f49e5af-b6e3-495f-8629-92bf8bcb0206 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:45.594448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0f49e5af-b6e3-495f-8629-92bf8bcb0206 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 934f8d4a-d673-424d-a2b8-498156de4c86] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:45.604932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f49e5af-b6e3-495f-8629-92bf8bcb0206 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:45.605677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f49e5af-b6e3-495f-8629-92bf8bcb0206 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:45.606689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f49e5af-b6e3-495f-8629-92bf8bcb0206 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:45.610140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f49e5af-b6e3-495f-8629-92bf8bcb0206 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:45.610810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f49e5af-b6e3-495f-8629-92bf8bcb0206 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:45.611428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f49e5af-b6e3-495f-8629-92bf8bcb0206 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:45.640841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:45.660636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f49e5af-b6e3-495f-8629-92bf8bcb0206 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:45.661401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f49e5af-b6e3-495f-8629-92bf8bcb0206 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:45.662005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f49e5af-b6e3-495f-8629-92bf8bcb0206 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:45.662907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-0f49e5af-b6e3-495f-8629-92bf8bcb0206 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lazy-loading 'fault' on Instance uuid 934f8d4a-d673-424d-a2b8-498156de4c86 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:12:45.717728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0f49e5af-b6e3-495f-8629-92bf8bcb0206 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:45.727363 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0f49e5af-b6e3-495f-8629-92bf8bcb0206 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/934f8d4a-d673-424d-a2b8-498156de4c86" status: 200 len: 1221 microversion: 2.1 time: 0.137634 Oct 12 22:12:45.728412 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1500/3386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:45 2022] GET /compute/v2.1/servers/934f8d4a-d673-424d-a2b8-498156de4c86 => generated 1221 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:45.734001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b067f448-e8dc-4abd-9f6b-27eb41e5bcc2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Action: 'action', calling method: .version_select at 0x7f512a8ac8b0>, body: {"addFloatingIp": {"address": "172.25.2.234"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:45.736962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b067f448-e8dc-4abd-9f6b-27eb41e5bcc2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:45.744822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b067f448-e8dc-4abd-9f6b-27eb41e5bcc2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:45.745578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b067f448-e8dc-4abd-9f6b-27eb41e5bcc2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:45.746215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b067f448-e8dc-4abd-9f6b-27eb41e5bcc2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:45.747157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b067f448-e8dc-4abd-9f6b-27eb41e5bcc2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:45.747801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b067f448-e8dc-4abd-9f6b-27eb41e5bcc2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:45.748389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b067f448-e8dc-4abd-9f6b-27eb41e5bcc2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:45.831324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b067f448-e8dc-4abd-9f6b-27eb41e5bcc2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "refresh_cache-834fccfb-555f-4b47-9c94-eff3997d3dd2" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:12:45.831999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b067f448-e8dc-4abd-9f6b-27eb41e5bcc2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquired lock "refresh_cache-834fccfb-555f-4b47-9c94-eff3997d3dd2" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:12:46.972098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-b067f448-e8dc-4abd-9f6b-27eb41e5bcc2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Building network info cache for instance {{(pid=120452) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:12:47.579497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-b067f448-e8dc-4abd-9f6b-27eb41e5bcc2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Updating instance_info_cache with network_info: [{"id": "52d827f6-3263-45e3-be6b-9e5d6a230519", "address": "fa:16:3e:5d:a0:89", "network": {"id": "fb7d3258-6587-403e-9076-bc67d7e46a31", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-718625200-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "85487b1a0fc14efd8b218080c3d23ce3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap52d827f6-32", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120452) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:12:47.610921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b067f448-e8dc-4abd-9f6b-27eb41e5bcc2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Releasing lock "refresh_cache-834fccfb-555f-4b47-9c94-eff3997d3dd2" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:12:47.613191 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b067f448-e8dc-4abd-9f6b-27eb41e5bcc2 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "POST /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2/action" status: 202 len: 0 microversion: 2.1 time: 1.883431 Oct 12 22:12:47.619141 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1501/3387] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:12:45 2022] POST /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2/action => generated 0 bytes in 1890 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:12:47.628566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-a4a94594-abef-4031-aae2-0cd49553b184 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Building network info cache for instance {{(pid=120453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:12:47.650616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-195371c0-814e-429d-b10c-019134d9f720 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:47.651834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-195371c0-814e-429d-b10c-019134d9f720 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 29922f3d-5384-486f-8968-4fd73fd9016d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:47.664507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-195371c0-814e-429d-b10c-019134d9f720 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:47.666341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-195371c0-814e-429d-b10c-019134d9f720 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:47.667846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-195371c0-814e-429d-b10c-019134d9f720 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:47.668826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-195371c0-814e-429d-b10c-019134d9f720 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:47.672859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-195371c0-814e-429d-b10c-019134d9f720 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:47.673737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-195371c0-814e-429d-b10c-019134d9f720 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:47.694024 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-195371c0-814e-429d-b10c-019134d9f720 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] HTTP exception thrown: Instance 29922f3d-5384-486f-8968-4fd73fd9016d could not be found. Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-195371c0-814e-429d-b10c-019134d9f720 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Request method failure captured: Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d HTTP/1.1 Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzr98Hx3HSZUwq13XuvkKDPq0Iz5m-bV7cM398dlrUOClDHZvKrry9jEBmFlbHSmTggU-8Kzhn-tq2F0pNUWaJ0dz4mTrYT4WEggz5nFy73h3CWXJWY0xrriAWPLgFsaD4ELYtj-jFuaZbDIGMPZ-s-9QASFcLZt-WruPxAE5oPSHB0 Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1da6fbca378a43c6b71b9b1b2fa1bc7c Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1da6fbca378a43c6b71b9b1b2fa1bc7c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1da6fbca378a43c6b71b9b1b2fa1bc7c Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersOnMultiNodesTest-2073144359-project Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7a8e7139c1694698a5fde98743165501 Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersOnMultiNodesTest-2073144359-project Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 29922f3d-5384-486f-8968-4fd73fd9016d could not be found. Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '29922f3d-5384-486f-8968-4fd73fd9016d'} Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29922f3d-5384-486f-8968-4fd73fd9016d could not be found. Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29922f3d-5384-486f-8968-4fd73fd9016d could not be found. Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:47.696670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:47.700578 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:47.700578 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:47.700578 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:47.700578 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:12:47.700578 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:12:47.700578 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29922f3d-5384-486f-8968-4fd73fd9016d could not be found. Oct 12 22:12:47.700578 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:47.702436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-195371c0-814e-429d-b10c-019134d9f720 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Returning 404 to user: Instance 29922f3d-5384-486f-8968-4fd73fd9016d could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:12:47.704274 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-195371c0-814e-429d-b10c-019134d9f720 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d" status: 404 len: 111 microversion: 2.1 time: 0.082990 Oct 12 22:12:47.705842 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1502/3388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:47 2022] GET /compute/v2.1/servers/29922f3d-5384-486f-8968-4fd73fd9016d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:12:47.712358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b59a474-8f89-4043-b7b2-ac6d3931beb8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:47.714084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6b59a474-8f89-4043-b7b2-ac6d3931beb8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:47.721023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b59a474-8f89-4043-b7b2-ac6d3931beb8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:47.721940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b59a474-8f89-4043-b7b2-ac6d3931beb8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:47.723567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b59a474-8f89-4043-b7b2-ac6d3931beb8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:47.724811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b59a474-8f89-4043-b7b2-ac6d3931beb8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:47.725626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b59a474-8f89-4043-b7b2-ac6d3931beb8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:47.726484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b59a474-8f89-4043-b7b2-ac6d3931beb8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:47.930067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6b59a474-8f89-4043-b7b2-ac6d3931beb8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:47.944545 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6b59a474-8f89-4043-b7b2-ac6d3931beb8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 200 len: 1367 microversion: 2.1 time: 0.237333 Oct 12 22:12:47.946391 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1503/3389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:47 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:47.969531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-af3b84e4-a4af-4631-9275-3f1aedf5c0eb req-f6b63c03-29a6-44b5-aeed-94fd9f1d5a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feeebc28-6cfd-4f7d-8e32-d725731d0ba3", "name": "network-vif-plugged", "status": "completed", "tag": "10b52e2e-0015-4406-ae37-d8e3d7eab6de"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:48.018300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-af3b84e4-a4af-4631-9275-3f1aedf5c0eb req-f6b63c03-29a6-44b5-aeed-94fd9f1d5a54 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:48.020909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-af3b84e4-a4af-4631-9275-3f1aedf5c0eb req-f6b63c03-29a6-44b5-aeed-94fd9f1d5a54 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:48.021361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-af3b84e4-a4af-4631-9275-3f1aedf5c0eb req-f6b63c03-29a6-44b5-aeed-94fd9f1d5a54 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:48.050834 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-af3b84e4-a4af-4631-9275-3f1aedf5c0eb req-f6b63c03-29a6-44b5-aeed-94fd9f1d5a54 service nova] Creating event network-vif-plugged:10b52e2e-0015-4406-ae37-d8e3d7eab6de for instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 on n-h1-861111-1 Oct 12 22:12:48.060909 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-af3b84e4-a4af-4631-9275-3f1aedf5c0eb req-f6b63c03-29a6-44b5-aeed-94fd9f1d5a54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097454 Oct 12 22:12:48.063365 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1504/3390] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:48.078812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0e9f6f5d-e2cd-48df-b099-acdc863b8d19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:48.080468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0e9f6f5d-e2cd-48df-b099-acdc863b8d19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:48.131954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e9f6f5d-e2cd-48df-b099-acdc863b8d19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:48.143948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e9f6f5d-e2cd-48df-b099-acdc863b8d19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:48.147012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e9f6f5d-e2cd-48df-b099-acdc863b8d19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:48.150607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e9f6f5d-e2cd-48df-b099-acdc863b8d19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:48.154059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e9f6f5d-e2cd-48df-b099-acdc863b8d19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:48.156470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e9f6f5d-e2cd-48df-b099-acdc863b8d19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:48.844327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0e9f6f5d-e2cd-48df-b099-acdc863b8d19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:48.859661 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0e9f6f5d-e2cd-48df-b099-acdc863b8d19 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1315 microversion: 2.1 time: 0.794787 Oct 12 22:12:48.876524 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1505/3391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:48 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:48.882717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7172c22c-2048-42c3-ba94-6df5c37f5242 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:48.883634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7172c22c-2048-42c3-ba94-6df5c37f5242 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 934f8d4a-d673-424d-a2b8-498156de4c86] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:48.890026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7172c22c-2048-42c3-ba94-6df5c37f5242 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:48.890769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7172c22c-2048-42c3-ba94-6df5c37f5242 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:48.891528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7172c22c-2048-42c3-ba94-6df5c37f5242 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:48.892421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7172c22c-2048-42c3-ba94-6df5c37f5242 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:48.893046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7172c22c-2048-42c3-ba94-6df5c37f5242 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:48.893618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7172c22c-2048-42c3-ba94-6df5c37f5242 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:48.912318 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-7172c22c-2048-42c3-ba94-6df5c37f5242 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7172c22c-2048-42c3-ba94-6df5c37f5242 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/934f8d4a-d673-424d-a2b8-498156de4c86 HTTP/1.1 Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '934f8d4a-d673-424d-a2b8-498156de4c86'} Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:48.918812 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:48.923144 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:48.923144 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:48.923144 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:48.923144 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:12:48.923144 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:12:48.923144 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. Oct 12 22:12:48.923144 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:48.924654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7172c22c-2048-42c3-ba94-6df5c37f5242 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:12:48.927123 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7172c22c-2048-42c3-ba94-6df5c37f5242 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/934f8d4a-d673-424d-a2b8-498156de4c86" status: 404 len: 111 microversion: 2.1 time: 0.049239 Oct 12 22:12:48.931377 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1506/3392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:48 2022] GET /compute/v2.1/servers/934f8d4a-d673-424d-a2b8-498156de4c86 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:12:48.938947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-913eea05-c8fd-422d-b397-7dacbceedf76 req-27a69898-0214-4d12-bad1-7c952e6a310d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b862f7de-fe9b-49bc-9e77-0d3e453558e8", "name": "network-vif-deleted", "tag": "4e7ca35a-5772-4985-baa1-a73c3a5acaa8"}, {"name": "network-changed", "server_uuid": "834fccfb-555f-4b47-9c94-eff3997d3dd2", "tag": "52d827f6-3263-45e3-be6b-9e5d6a230519"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:48.976013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-913eea05-c8fd-422d-b397-7dacbceedf76 req-27a69898-0214-4d12-bad1-7c952e6a310d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:48.977087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-913eea05-c8fd-422d-b397-7dacbceedf76 req-27a69898-0214-4d12-bad1-7c952e6a310d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:48.977701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-913eea05-c8fd-422d-b397-7dacbceedf76 req-27a69898-0214-4d12-bad1-7c952e6a310d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:49.009548 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-913eea05-c8fd-422d-b397-7dacbceedf76 req-27a69898-0214-4d12-bad1-7c952e6a310d service nova] Creating event network-vif-deleted:4e7ca35a-5772-4985-baa1-a73c3a5acaa8 for instance b862f7de-fe9b-49bc-9e77-0d3e453558e8 on n-h2-861111-1 Oct 12 22:12:49.013350 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-913eea05-c8fd-422d-b397-7dacbceedf76 req-27a69898-0214-4d12-bad1-7c952e6a310d service nova] Creating event network-changed:52d827f6-3263-45e3-be6b-9e5d6a230519 for instance 834fccfb-555f-4b47-9c94-eff3997d3dd2 on n-h2-861111-1 Oct 12 22:12:49.029622 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-913eea05-c8fd-422d-b397-7dacbceedf76 req-27a69898-0214-4d12-bad1-7c952e6a310d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.096570 Oct 12 22:12:49.037727 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1507/3393] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:49.043772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a28bfded-739f-4ed8-b34b-33b08edcf994 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Action: 'create', calling method: .version_select at 0x7f51234661f0>, body: {"pool": "21b6d064-e8e1-4525-a9dd-3c2b7193f582"} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:49.719728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-a4a94594-abef-4031-aae2-0cd49553b184 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Updating instance_info_cache with network_info: [{"id": "388738e3-987d-4373-89b2-ec1c33e4c96c", "address": "fa:16:3e:dd:21:48", "network": {"id": "709423db-695b-4953-a10f-b3358d5669f7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-519345160-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b201054c71d241ee8b130a9b0a014cf6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap388738e3-98", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:12:49.744441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4a94594-abef-4031-aae2-0cd49553b184 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Releasing lock "refresh_cache-f924aa3b-0c00-4577-bb06-3a169f972d3d" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:12:49.745582 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a4a94594-abef-4031-aae2-0cd49553b184 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "POST /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d/action" status: 202 len: 0 microversion: 2.1 time: 6.302201 Oct 12 22:12:49.746707 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1887/3394] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:12:43 2022] POST /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d/action => generated 0 bytes in 6304 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:12:49.753695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-b3e5c32b-53ed-409a-8446-2e8bb399a62c req-a9636bd6-815a-488d-b1eb-37049f01c8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f924aa3b-0c00-4577-bb06-3a169f972d3d", "tag": "388738e3-987d-4373-89b2-ec1c33e4c96c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:49.777358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b3e5c32b-53ed-409a-8446-2e8bb399a62c req-a9636bd6-815a-488d-b1eb-37049f01c8f6 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:49.778022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b3e5c32b-53ed-409a-8446-2e8bb399a62c req-a9636bd6-815a-488d-b1eb-37049f01c8f6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:49.778652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b3e5c32b-53ed-409a-8446-2e8bb399a62c req-a9636bd6-815a-488d-b1eb-37049f01c8f6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:49.798232 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-b3e5c32b-53ed-409a-8446-2e8bb399a62c req-a9636bd6-815a-488d-b1eb-37049f01c8f6 service nova] Creating event network-changed:388738e3-987d-4373-89b2-ec1c33e4c96c for instance f924aa3b-0c00-4577-bb06-3a169f972d3d on n-h1-861111-1 Oct 12 22:12:49.809483 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-b3e5c32b-53ed-409a-8446-2e8bb399a62c req-a9636bd6-815a-488d-b1eb-37049f01c8f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061228 Oct 12 22:12:49.810340 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1888/3395] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:49.819471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ee44f7ac-4ceb-476b-9191-1840e552190b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:49.916211 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ee44f7ac-4ceb-476b-9191-1840e552190b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/0062e0e1-f049-4b7b-8395-e166a0421e0b" status: 204 len: 0 microversion: 2.1 time: 0.104490 Oct 12 22:12:49.917364 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1889/3396] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 12 22:12:49 2022] DELETE /compute/v2.1/os-server-groups/0062e0e1-f049-4b7b-8395-e166a0421e0b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:12:49.923219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b495c64f-6445-417b-b3aa-a7df55fc8fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:49.924238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b495c64f-6445-417b-b3aa-a7df55fc8fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:49.945647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b495c64f-6445-417b-b3aa-a7df55fc8fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:49.946559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b495c64f-6445-417b-b3aa-a7df55fc8fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:49.947175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b495c64f-6445-417b-b3aa-a7df55fc8fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:49.948168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b495c64f-6445-417b-b3aa-a7df55fc8fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:49.948778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b495c64f-6445-417b-b3aa-a7df55fc8fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:49.949348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b495c64f-6445-417b-b3aa-a7df55fc8fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:50.210591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b495c64f-6445-417b-b3aa-a7df55fc8fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:50.231520 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b495c64f-6445-417b-b3aa-a7df55fc8fce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 200 len: 1367 microversion: 2.1 time: 0.312677 Oct 12 22:12:50.244166 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1890/3397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:49 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:50.261791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-935917545", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "8a2bd9d3-e80d-4911-bb4a-296de8e90165"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:50.350227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] validate_networks() for [('8a2bd9d3-e80d-4911-bb4a-296de8e90165', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:12:51.235388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:12:51.236894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:12:51.237900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:12:51.239369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:12:51.240056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:12:51.265298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:51.266275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:51.266884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:51.267910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:51.268365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:51.268795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:51.290041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Getting quotas for project 4b898b5d0208478e996b7fee2060ed64. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:12:51.299602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Getting quotas for user 11096cece79f4b8fad4b92270f51b299 and project 4b898b5d0208478e996b7fee2060ed64. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:12:51.316826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:12:51.319389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:12:51.374507 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-105c7fe7-a3a9-4d1a-97da-e27a4431c997 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.127545 Oct 12 22:12:51.376048 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1891/3398] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:12:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:12:51.381316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ba4faebd-c654-4cc6-9301-b9a6ebaf6e05 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.111"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:51.384846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ba4faebd-c654-4cc6-9301-b9a6ebaf6e05 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:51.389516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:51.394241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba4faebd-c654-4cc6-9301-b9a6ebaf6e05 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:51.395452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba4faebd-c654-4cc6-9301-b9a6ebaf6e05 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:51.395897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba4faebd-c654-4cc6-9301-b9a6ebaf6e05 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:51.396604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba4faebd-c654-4cc6-9301-b9a6ebaf6e05 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:51.397154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba4faebd-c654-4cc6-9301-b9a6ebaf6e05 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:51.397594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba4faebd-c654-4cc6-9301-b9a6ebaf6e05 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:51.427158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba4faebd-c654-4cc6-9301-b9a6ebaf6e05 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "refresh_cache-c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:12:51.427588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba4faebd-c654-4cc6-9301-b9a6ebaf6e05 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquired lock "refresh_cache-c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:12:53.790259 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.network.neutron [None req-ba4faebd-c654-4cc6-9301-b9a6ebaf6e05 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] re-assign floating IP 172.25.2.111 from instance f924aa3b-0c00-4577-bb06-3a169f972d3d Oct 12 22:12:53.854200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-ba4faebd-c654-4cc6-9301-b9a6ebaf6e05 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Building network info cache for instance {{(pid=120453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:12:54.073699 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a28bfded-739f-4ed8-b34b-33b08edcf994 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.034105 Oct 12 22:12:54.076621 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1508/3399] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 12 22:12:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:54.086044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-045ba938-570b-44d7-9d48-cd388fee9cd0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:54.087207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-045ba938-570b-44d7-9d48-cd388fee9cd0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:54.095486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-045ba938-570b-44d7-9d48-cd388fee9cd0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:54.096275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-045ba938-570b-44d7-9d48-cd388fee9cd0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:54.096931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-045ba938-570b-44d7-9d48-cd388fee9cd0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:54.097896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-045ba938-570b-44d7-9d48-cd388fee9cd0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:54.098568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-045ba938-570b-44d7-9d48-cd388fee9cd0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:54.099339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-045ba938-570b-44d7-9d48-cd388fee9cd0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:54.448256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-ba4faebd-c654-4cc6-9301-b9a6ebaf6e05 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Updating instance_info_cache with network_info: [{"id": "388738e3-987d-4373-89b2-ec1c33e4c96c", "address": "fa:16:3e:dd:21:48", "network": {"id": "709423db-695b-4953-a10f-b3358d5669f7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-519345160-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b201054c71d241ee8b130a9b0a014cf6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap388738e3-98", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:12:54.465389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-ba4faebd-c654-4cc6-9301-b9a6ebaf6e05 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Building network info cache for instance {{(pid=120453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:12:54.537137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-045ba938-570b-44d7-9d48-cd388fee9cd0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:54.554989 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-045ba938-570b-44d7-9d48-cd388fee9cd0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1315 microversion: 2.1 time: 0.476931 Oct 12 22:12:54.556140 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1509/3400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:54 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:54.560941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6579fddc-c706-4856-acb6-75a04b7fd99c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:54.561693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6579fddc-c706-4856-acb6-75a04b7fd99c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 35efe352-3b67-40fc-99c5-22fbf221bdfa] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:54.568713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6579fddc-c706-4856-acb6-75a04b7fd99c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:54.569520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6579fddc-c706-4856-acb6-75a04b7fd99c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:54.570174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6579fddc-c706-4856-acb6-75a04b7fd99c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:54.571130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6579fddc-c706-4856-acb6-75a04b7fd99c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:54.571845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6579fddc-c706-4856-acb6-75a04b7fd99c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:54.572483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6579fddc-c706-4856-acb6-75a04b7fd99c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:54.601290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6579fddc-c706-4856-acb6-75a04b7fd99c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 35efe352-3b67-40fc-99c5-22fbf221bdfa] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:12:54.704514 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6579fddc-c706-4856-acb6-75a04b7fd99c tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "DELETE /compute/v2.1/servers/35efe352-3b67-40fc-99c5-22fbf221bdfa" status: 204 len: 0 microversion: 2.1 time: 0.146677 Oct 12 22:12:54.712258 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1510/3401] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:12:54 2022] DELETE /compute/v2.1/servers/35efe352-3b67-40fc-99c5-22fbf221bdfa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:12:54.718747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5689288b-cf3b-447c-b231-88a76b09578b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:54.719810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5689288b-cf3b-447c-b231-88a76b09578b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:54.728084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5689288b-cf3b-447c-b231-88a76b09578b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:54.728870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5689288b-cf3b-447c-b231-88a76b09578b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:54.729483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5689288b-cf3b-447c-b231-88a76b09578b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:54.730364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5689288b-cf3b-447c-b231-88a76b09578b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:54.730972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5689288b-cf3b-447c-b231-88a76b09578b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:54.731635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5689288b-cf3b-447c-b231-88a76b09578b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:55.259090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5689288b-cf3b-447c-b231-88a76b09578b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:55.270825 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5689288b-cf3b-447c-b231-88a76b09578b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 200 len: 1558 microversion: 2.1 time: 0.554764 Oct 12 22:12:55.283537 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1511/3402] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:54 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 1558 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:55.283537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cc322652-8712-401b-bd3c-e45d0553af91 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:55.283537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cc322652-8712-401b-bd3c-e45d0553af91 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:55.296386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc322652-8712-401b-bd3c-e45d0553af91 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:55.297273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc322652-8712-401b-bd3c-e45d0553af91 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:55.297927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc322652-8712-401b-bd3c-e45d0553af91 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:55.298857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc322652-8712-401b-bd3c-e45d0553af91 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:55.300086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc322652-8712-401b-bd3c-e45d0553af91 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:55.300878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc322652-8712-401b-bd3c-e45d0553af91 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:55.428518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cc322652-8712-401b-bd3c-e45d0553af91 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:55.440992 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cc322652-8712-401b-bd3c-e45d0553af91 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 200 len: 1272 microversion: 2.1 time: 0.164968 Oct 12 22:12:55.442606 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1512/3403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:55 2022] GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:55.461680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-7c8c5d24-8784-4604-95e9-859e30e97b2f req-0652ded1-80a6-48e6-94b3-46c28e16efa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c1dff38-e8eb-433d-8e67-2f53de91034b", "tag": "b053f354-90ab-466d-a60d-b883c1ca228d"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:55.486427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-ba4faebd-c654-4cc6-9301-b9a6ebaf6e05 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Updating instance_info_cache with network_info: [{"id": "76764896-d8b2-4553-97a9-4df1772081c6", "address": "fa:16:3e:b8:84:98", "network": {"id": "709423db-695b-4953-a10f-b3358d5669f7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-519345160-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b201054c71d241ee8b130a9b0a014cf6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap76764896-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:12:55.487504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7c8c5d24-8784-4604-95e9-859e30e97b2f req-0652ded1-80a6-48e6-94b3-46c28e16efa2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:55.490237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7c8c5d24-8784-4604-95e9-859e30e97b2f req-0652ded1-80a6-48e6-94b3-46c28e16efa2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:55.490696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7c8c5d24-8784-4604-95e9-859e30e97b2f req-0652ded1-80a6-48e6-94b3-46c28e16efa2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:55.508073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba4faebd-c654-4cc6-9301-b9a6ebaf6e05 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Releasing lock "refresh_cache-c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:12:55.509164 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ba4faebd-c654-4cc6-9301-b9a6ebaf6e05 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "POST /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835/action" status: 202 len: 0 microversion: 2.1 time: 4.132054 Oct 12 22:12:55.510264 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1892/3404] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:12:51 2022] POST /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835/action => generated 0 bytes in 4134 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:12:55.526760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-15b29cd9-bffc-4e8d-818b-959489aa3b15 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.204"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:55.527341 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-7c8c5d24-8784-4604-95e9-859e30e97b2f req-0652ded1-80a6-48e6-94b3-46c28e16efa2 service nova] Creating event network-changed:b053f354-90ab-466d-a60d-b883c1ca228d for instance 3c1dff38-e8eb-433d-8e67-2f53de91034b on n-h2-861111-1 Oct 12 22:12:55.533220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-15b29cd9-bffc-4e8d-818b-959489aa3b15 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:55.540525 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-7c8c5d24-8784-4604-95e9-859e30e97b2f req-0652ded1-80a6-48e6-94b3-46c28e16efa2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095428 Oct 12 22:12:55.543923 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1513/3405] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:55.558947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15b29cd9-bffc-4e8d-818b-959489aa3b15 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:55.559362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6de6b968-ff99-4e0e-a59a-fbaa479dd1a1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:55.562041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15b29cd9-bffc-4e8d-818b-959489aa3b15 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:55.562501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15b29cd9-bffc-4e8d-818b-959489aa3b15 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:55.562825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6de6b968-ff99-4e0e-a59a-fbaa479dd1a1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:55.563274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15b29cd9-bffc-4e8d-818b-959489aa3b15 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:55.563726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15b29cd9-bffc-4e8d-818b-959489aa3b15 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:55.564157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15b29cd9-bffc-4e8d-818b-959489aa3b15 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:55.576713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de6b968-ff99-4e0e-a59a-fbaa479dd1a1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:55.582796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de6b968-ff99-4e0e-a59a-fbaa479dd1a1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:55.589258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de6b968-ff99-4e0e-a59a-fbaa479dd1a1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:55.594393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de6b968-ff99-4e0e-a59a-fbaa479dd1a1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:55.595056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de6b968-ff99-4e0e-a59a-fbaa479dd1a1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:55.595831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de6b968-ff99-4e0e-a59a-fbaa479dd1a1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:55.646824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15b29cd9-bffc-4e8d-818b-959489aa3b15 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "refresh_cache-834fccfb-555f-4b47-9c94-eff3997d3dd2" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:12:55.649148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15b29cd9-bffc-4e8d-818b-959489aa3b15 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquired lock "refresh_cache-834fccfb-555f-4b47-9c94-eff3997d3dd2" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:12:55.658793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6de6b968-ff99-4e0e-a59a-fbaa479dd1a1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:12:55.868186 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6de6b968-ff99-4e0e-a59a-fbaa479dd1a1 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 204 len: 0 microversion: 2.1 time: 0.321647 Oct 12 22:12:55.871261 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1514/3406] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:12:55 2022] DELETE /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:12:55.884069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3caced5f-e0f1-4d44-a156-67b482891de8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:55.886428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3caced5f-e0f1-4d44-a156-67b482891de8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:55.908313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3caced5f-e0f1-4d44-a156-67b482891de8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:55.912787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3caced5f-e0f1-4d44-a156-67b482891de8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:55.915385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3caced5f-e0f1-4d44-a156-67b482891de8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:55.917013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3caced5f-e0f1-4d44-a156-67b482891de8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:55.920521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3caced5f-e0f1-4d44-a156-67b482891de8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:55.920990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3caced5f-e0f1-4d44-a156-67b482891de8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:56.100419 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3caced5f-e0f1-4d44-a156-67b482891de8 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.226308 Oct 12 22:12:56.101043 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1515/3407] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:12:55 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-interface => generated 285 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:56.110119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5a1bd4df-5a30-41c0-8742-aedd888dbad9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Action: 'action', calling method: .version_select at 0x7f512a8ac9d0>, body: {"removeFloatingIp": {"address": "172.25.2.111"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:56.487800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5a1bd4df-5a30-41c0-8742-aedd888dbad9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:56.495932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a1bd4df-5a30-41c0-8742-aedd888dbad9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:56.495932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a1bd4df-5a30-41c0-8742-aedd888dbad9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:56.496646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a1bd4df-5a30-41c0-8742-aedd888dbad9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:56.500157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a1bd4df-5a30-41c0-8742-aedd888dbad9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:56.500157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a1bd4df-5a30-41c0-8742-aedd888dbad9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:56.502608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a1bd4df-5a30-41c0-8742-aedd888dbad9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:57.055929 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-5a1bd4df-5a30-41c0-8742-aedd888dbad9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] HTTP exception thrown: Floating IP 172.25.2.111 is not associated with instance f924aa3b-0c00-4577-bb06-3a169f972d3d. Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5a1bd4df-5a30-41c0-8742-aedd888dbad9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Request method failure captured: Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d/action HTTP/1.1 Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 49 Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzul-k5ArXCQUv4eknvtIsPJ9IZVfOm8YPa3SwCUsqFWCRAV14uEUMtsOkYjvC0q-7NXLDiqEC3pOHv9uVvDx5vcXDVthjw5VCF_6P_hAWpa4FEHeIeCEzgEA-O4pl_OKILQCsTf8R5NQXZN-jc9ZBqBSC6DyQjKRIbsfaCaANtTg2g Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: b201054c71d241ee8b130a9b0a014cf6 Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-845994595 Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b201054c71d241ee8b130a9b0a014cf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b201054c71d241ee8b130a9b0a014cf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b201054c71d241ee8b130a9b0a014cf6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b201054c71d241ee8b130a9b0a014cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-845994595 Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: b201054c71d241ee8b130a9b0a014cf6 Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-845994595 Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-FloatingIPsAssociationTestJSON-845994595-project Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 94f72337548c4724bf3f4c1009221120 Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-845994595-project Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: {"removeFloatingIp": {"address": "172.25.2.111"}} Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: exception: Floating IP 172.25.2.111 is not associated with instance f924aa3b-0c00-4577-bb06-3a169f972d3d. Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'f924aa3b-0c00-4577-bb06-3a169f972d3d', 'body': {'removeFloatingIp': {'address': '172.25.2.111'}}} Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.111 is not associated with instance f924aa3b-0c00-4577-bb06-3a169f972d3d. Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.111 is not associated with instance f924aa3b-0c00-4577-bb06-3a169f972d3d. Oct 12 22:12:57.058104 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:12:57.063262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5a1bd4df-5a30-41c0-8742-aedd888dbad9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Returning 409 to user: Floating IP 172.25.2.111 is not associated with instance f924aa3b-0c00-4577-bb06-3a169f972d3d. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:12:57.064154 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5a1bd4df-5a30-41c0-8742-aedd888dbad9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "POST /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d/action" status: 409 len: 146 microversion: 2.1 time: 0.962173 Oct 12 22:12:57.064954 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1516/3408] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:12:56 2022] POST /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d/action => generated 146 bytes in 963 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:12:57.071643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cda0691d-917b-4f15-87cd-1552d97471a6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:57.072271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cda0691d-917b-4f15-87cd-1552d97471a6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:57.086063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cda0691d-917b-4f15-87cd-1552d97471a6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:57.086566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cda0691d-917b-4f15-87cd-1552d97471a6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:57.087013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cda0691d-917b-4f15-87cd-1552d97471a6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:57.087768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cda0691d-917b-4f15-87cd-1552d97471a6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:57.088206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cda0691d-917b-4f15-87cd-1552d97471a6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:57.088635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cda0691d-917b-4f15-87cd-1552d97471a6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:57.143706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-15b29cd9-bffc-4e8d-818b-959489aa3b15 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.204 (b06bab3b-8794-4bee-9332-05bde286628d) with port 52d827f6-3263-45e3-be6b-9e5d6a230519 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 21b6d064-e8e1-4525-a9dd-3c2b7193f582.", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:12:57.145029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15b29cd9-bffc-4e8d-818b-959489aa3b15 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Releasing lock "refresh_cache-834fccfb-555f-4b47-9c94-eff3997d3dd2" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:12:57.145697 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-15b29cd9-bffc-4e8d-818b-959489aa3b15 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.204 (b06bab3b-8794-4bee-9332-05bde286628d) with port 52d827f6-3263-45e3-be6b-9e5d6a230519 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 21b6d064-e8e1-4525-a9dd-3c2b7193f582. Oct 12 22:12:57.145697 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-111e8dc9-4e2d-4b80-9b47-5f448564adee'] Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-15b29cd9-bffc-4e8d-818b-959489aa3b15 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Request method failure captured: Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2/action HTTP/1.1 Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 46 Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzu09m4YMwyAW5XmhOEfb-EgkfB9KSU4r5FkixV7M0UuuPgFW2vI4R72JNrd-Kem9C8wReSqFIUGo5s7iUjQ4HMfT66uooX5zG09UfafAz6N8lvC0atzIXSX_eSCNJOFTK8rOQ6KIRatSIQpy_9JO--t4Nf9UB_m_unRQ7w9_PrKrsQ Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 85487b1a0fc14efd8b218080c3d23ce3 Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-902763970 Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85487b1a0fc14efd8b218080c3d23ce3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85487b1a0fc14efd8b218080c3d23ce3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_85487b1a0fc14efd8b218080c3d23ce3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/85487b1a0fc14efd8b218080c3d23ce3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-902763970 Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 85487b1a0fc14efd8b218080c3d23ce3 Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-902763970 Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: bb00c4c021344aa296bead35a76dd606 Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: {"addFloatingIp": {"address": "172.25.2.204"}} Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: exception: Cannot associate floating IP 172.25.2.204 (b06bab3b-8794-4bee-9332-05bde286628d) with port 52d827f6-3263-45e3-be6b-9e5d6a230519 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 21b6d064-e8e1-4525-a9dd-3c2b7193f582. Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-111e8dc9-4e2d-4b80-9b47-5f448564adee'] Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '834fccfb-555f-4b47-9c94-eff3997d3dd2', 'body': {'addFloatingIp': {'address': '172.25.2.204'}}} Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:12:57.148538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.204 (b06bab3b-8794-4bee-9332-05bde286628d) with port 52d827f6-3263-45e3-be6b-9e5d6a230519 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 21b6d064-e8e1-4525-a9dd-3c2b7193f582. Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-111e8dc9-4e2d-4b80-9b47-5f448564adee'] Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.204 (b06bab3b-8794-4bee-9332-05bde286628d) with port 52d827f6-3263-45e3-be6b-9e5d6a230519 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 21b6d064-e8e1-4525-a9dd-3c2b7193f582. Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-111e8dc9-4e2d-4b80-9b47-5f448564adee'] Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.204 (b06bab3b-8794-4bee-9332-05bde286628d) with port 52d827f6-3263-45e3-be6b-9e5d6a230519 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 21b6d064-e8e1-4525-a9dd-3c2b7193f582. Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-111e8dc9-4e2d-4b80-9b47-5f448564adee'] Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.204 (b06bab3b-8794-4bee-9332-05bde286628d) with port 52d827f6-3263-45e3-be6b-9e5d6a230519 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 21b6d064-e8e1-4525-a9dd-3c2b7193f582. Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-111e8dc9-4e2d-4b80-9b47-5f448564adee'] Oct 12 22:12:57.153132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:12:57.157007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-15b29cd9-bffc-4e8d-818b-959489aa3b15 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Returning 400 to user: Cannot associate floating IP 172.25.2.204 (b06bab3b-8794-4bee-9332-05bde286628d) with port 52d827f6-3263-45e3-be6b-9e5d6a230519 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 21b6d064-e8e1-4525-a9dd-3c2b7193f582. Oct 12 22:12:57.157007 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-111e8dc9-4e2d-4b80-9b47-5f448564adee'] {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:12:57.157844 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-15b29cd9-bffc-4e8d-818b-959489aa3b15 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "POST /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2/action" status: 400 len: 381 microversion: 2.1 time: 1.644205 Oct 12 22:12:57.158407 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1893/3409] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:12:55 2022] POST /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2/action => generated 381 bytes in 1646 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:12:57.380165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-96f0a19f-755d-4849-81f2-db359f5d5a82 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Action: 'create', calling method: .version_select at 0x7f51285c2700>, body: {"keypair": {"name": "tempest-keypair-443066155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGR9wSD3e4qEKuuRYSGk2gxMacWy7FnhpJVLSiHOZK05ztntlHTyUmNKhd+ioxLIUogIixjlPa6vFJxHThDBV0+xcvUVBldVPW497nB9FUzrFyJ3fl/4pBx4LBS/MfsUNg=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:57.409427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-96f0a19f-755d-4849-81f2-db359f5d5a82 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Getting quotas for project 950d9a3e971644709e04007bf0d3a6e5. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:12:57.418792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-96f0a19f-755d-4849-81f2-db359f5d5a82 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Getting quotas for user 0e9463eb3ccf4028af1bfc61749c8e99 and project 950d9a3e971644709e04007bf0d3a6e5. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:12:57.465225 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-96f0a19f-755d-4849-81f2-db359f5d5a82 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.302003 Oct 12 22:12:57.474012 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1894/3410] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:12:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:12:57.480846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4f01a277-38bb-431b-90a4-278eeea28302 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:57.481636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4f01a277-38bb-431b-90a4-278eeea28302 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 35efe352-3b67-40fc-99c5-22fbf221bdfa] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:57.491046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f01a277-38bb-431b-90a4-278eeea28302 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:57.491758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f01a277-38bb-431b-90a4-278eeea28302 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:57.492439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f01a277-38bb-431b-90a4-278eeea28302 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:57.493848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f01a277-38bb-431b-90a4-278eeea28302 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:57.494545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f01a277-38bb-431b-90a4-278eeea28302 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:57.495502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f01a277-38bb-431b-90a4-278eeea28302 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:57.538404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cda0691d-917b-4f15-87cd-1552d97471a6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:57.546378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:12:57.549281 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cda0691d-917b-4f15-87cd-1552d97471a6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1315 microversion: 2.1 time: 0.483542 Oct 12 22:12:57.571795 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1517/3411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:57 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:57.579795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c22f7746-20d8-4476-9283-70d262b6237a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:57.580816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c22f7746-20d8-4476-9283-70d262b6237a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:57.591666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c22f7746-20d8-4476-9283-70d262b6237a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:57.592624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c22f7746-20d8-4476-9283-70d262b6237a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:57.593557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c22f7746-20d8-4476-9283-70d262b6237a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:57.594662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c22f7746-20d8-4476-9283-70d262b6237a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:57.595507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c22f7746-20d8-4476-9283-70d262b6237a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:57.596168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c22f7746-20d8-4476-9283-70d262b6237a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:58.430270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c22f7746-20d8-4476-9283-70d262b6237a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:58.448508 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c22f7746-20d8-4476-9283-70d262b6237a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 200 len: 1314 microversion: 2.1 time: 0.874606 Oct 12 22:12:58.462430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4f01a277-38bb-431b-90a4-278eeea28302 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:12:58.466998 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1518/3412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:57 2022] GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 1314 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:58.475602 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4f01a277-38bb-431b-90a4-278eeea28302 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/35efe352-3b67-40fc-99c5-22fbf221bdfa" status: 200 len: 1473 microversion: 2.1 time: 0.999460 Oct 12 22:12:58.478717 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1895/3413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:12:57 2022] GET /compute/v2.1/servers/35efe352-3b67-40fc-99c5-22fbf221bdfa => generated 1473 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:12:58.483666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0294159d-96e7-45b4-a5c7-257ec0aa8981 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '.version_select at 0x7f5128ac5d30>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:12:58.490308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8ea33189-9555-48c1-ba11-405d11164c19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.111"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:12:59.406696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8ea33189-9555-48c1-ba11-405d11164c19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:12:59.414047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ea33189-9555-48c1-ba11-405d11164c19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:59.414191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ea33189-9555-48c1-ba11-405d11164c19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:59.414630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ea33189-9555-48c1-ba11-405d11164c19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:12:59.416532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ea33189-9555-48c1-ba11-405d11164c19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:12:59.417737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ea33189-9555-48c1-ba11-405d11164c19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:12:59.419840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ea33189-9555-48c1-ba11-405d11164c19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:00.234854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ea33189-9555-48c1-ba11-405d11164c19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "refresh_cache-c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:13:00.235045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ea33189-9555-48c1-ba11-405d11164c19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquired lock "refresh_cache-c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:13:00.393670 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0294159d-96e7-45b4-a5c7-257ec0aa8981 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/b06bab3b-8794-4bee-9332-05bde286628d" status: 202 len: 0 microversion: 2.1 time: 1.913612 Oct 12 22:13:00.395085 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1896/3414] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:12:58 2022] DELETE /compute/v2.1/os-floating-ips/b06bab3b-8794-4bee-9332-05bde286628d => generated 0 bytes in 1916 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:13:00.402564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-3105f11e-84eb-43f2-bfa6-7b537fb2ba38 req-23ca2b87-e929-4d54-bea1-18a2d47c2686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f924aa3b-0c00-4577-bb06-3a169f972d3d", "tag": "388738e3-987d-4373-89b2-ec1c33e4c96c"}, {"name": "network-changed", "server_uuid": "c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835", "tag": "76764896-d8b2-4553-97a9-4df1772081c6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:00.429558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3105f11e-84eb-43f2-bfa6-7b537fb2ba38 req-23ca2b87-e929-4d54-bea1-18a2d47c2686 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:00.430049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3105f11e-84eb-43f2-bfa6-7b537fb2ba38 req-23ca2b87-e929-4d54-bea1-18a2d47c2686 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:00.430502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3105f11e-84eb-43f2-bfa6-7b537fb2ba38 req-23ca2b87-e929-4d54-bea1-18a2d47c2686 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:00.465639 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-3105f11e-84eb-43f2-bfa6-7b537fb2ba38 req-23ca2b87-e929-4d54-bea1-18a2d47c2686 service nova] Creating event network-changed:388738e3-987d-4373-89b2-ec1c33e4c96c for instance f924aa3b-0c00-4577-bb06-3a169f972d3d on n-h1-861111-1 Oct 12 22:13:00.466167 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-3105f11e-84eb-43f2-bfa6-7b537fb2ba38 req-23ca2b87-e929-4d54-bea1-18a2d47c2686 service nova] Creating event network-changed:76764896-d8b2-4553-97a9-4df1772081c6 for instance c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 on n-h1-861111-1 Oct 12 22:13:00.473483 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-3105f11e-84eb-43f2-bfa6-7b537fb2ba38 req-23ca2b87-e929-4d54-bea1-18a2d47c2686 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.076240 Oct 12 22:13:00.474711 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1897/3415] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:00.483019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d4f4c1ed-4952-44d1-badc-dcb35b299285 req-709c930b-cd7f-4441-a4fa-962ac4326e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1dff38-e8eb-433d-8e67-2f53de91034b", "name": "network-vif-plugged", "status": "completed", "tag": "b053f354-90ab-466d-a60d-b883c1ca228d"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:00.494843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d4f4c1ed-4952-44d1-badc-dcb35b299285 req-709c930b-cd7f-4441-a4fa-962ac4326e44 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:00.496752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d4f4c1ed-4952-44d1-badc-dcb35b299285 req-709c930b-cd7f-4441-a4fa-962ac4326e44 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:00.497373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d4f4c1ed-4952-44d1-badc-dcb35b299285 req-709c930b-cd7f-4441-a4fa-962ac4326e44 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:00.534114 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d4f4c1ed-4952-44d1-badc-dcb35b299285 req-709c930b-cd7f-4441-a4fa-962ac4326e44 service nova] Creating event network-vif-plugged:b053f354-90ab-466d-a60d-b883c1ca228d for instance 3c1dff38-e8eb-433d-8e67-2f53de91034b on n-h2-861111-1 Oct 12 22:13:00.543996 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d4f4c1ed-4952-44d1-badc-dcb35b299285 req-709c930b-cd7f-4441-a4fa-962ac4326e44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062253 Oct 12 22:13:00.545324 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1898/3416] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:00.555952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-92b87ed7-587d-4cfd-95f5-1026ab84ae86 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:00.558981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-92b87ed7-587d-4cfd-95f5-1026ab84ae86 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:00.567028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92b87ed7-587d-4cfd-95f5-1026ab84ae86 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:00.567942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92b87ed7-587d-4cfd-95f5-1026ab84ae86 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:00.568612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92b87ed7-587d-4cfd-95f5-1026ab84ae86 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:00.569967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92b87ed7-587d-4cfd-95f5-1026ab84ae86 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:00.570641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92b87ed7-587d-4cfd-95f5-1026ab84ae86 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:00.571627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92b87ed7-587d-4cfd-95f5-1026ab84ae86 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:00.771613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-92b87ed7-587d-4cfd-95f5-1026ab84ae86 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:00.781934 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-92b87ed7-587d-4cfd-95f5-1026ab84ae86 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1315 microversion: 2.1 time: 0.234895 Oct 12 22:13:00.782592 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1899/3417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:00 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:00.797822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a2d395b6-490c-4f05-b291-0e1b10e2aa55 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:00.797822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a2d395b6-490c-4f05-b291-0e1b10e2aa55 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:00.797822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2d395b6-490c-4f05-b291-0e1b10e2aa55 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:00.797822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2d395b6-490c-4f05-b291-0e1b10e2aa55 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:00.797822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2d395b6-490c-4f05-b291-0e1b10e2aa55 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:00.797822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2d395b6-490c-4f05-b291-0e1b10e2aa55 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:00.797822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2d395b6-490c-4f05-b291-0e1b10e2aa55 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:00.797822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2d395b6-490c-4f05-b291-0e1b10e2aa55 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:00.961465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a2d395b6-490c-4f05-b291-0e1b10e2aa55 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:00.970662 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a2d395b6-490c-4f05-b291-0e1b10e2aa55 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 200 len: 1314 microversion: 2.1 time: 0.186723 Oct 12 22:13:00.971489 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1900/3418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:00 2022] GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:00.994306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-21b219f4-592b-4b53-b029-d0772d4d939b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:00.995282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-21b219f4-592b-4b53-b029-d0772d4d939b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 35efe352-3b67-40fc-99c5-22fbf221bdfa] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:01.004317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21b219f4-592b-4b53-b029-d0772d4d939b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:01.005171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21b219f4-592b-4b53-b029-d0772d4d939b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:01.006229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21b219f4-592b-4b53-b029-d0772d4d939b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:01.007097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21b219f4-592b-4b53-b029-d0772d4d939b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:01.007875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21b219f4-592b-4b53-b029-d0772d4d939b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:01.008566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21b219f4-592b-4b53-b029-d0772d4d939b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:01.029200 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-21b219f4-592b-4b53-b029-d0772d4d939b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] HTTP exception thrown: Instance 35efe352-3b67-40fc-99c5-22fbf221bdfa could not be found. Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-21b219f4-592b-4b53-b029-d0772d4d939b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Request method failure captured: Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/35efe352-3b67-40fc-99c5-22fbf221bdfa HTTP/1.1 Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzr98Hx3HSZUwq13XuvkKDPq0Iz5m-bV7cM398dlrUOClDHZvKrry9jEBmFlbHSmTggU-8Kzhn-tq2F0pNUWaJ0dz4mTrYT4WEggz5nFy73h3CWXJWY0xrriAWPLgFsaD4ELYtj-jFuaZbDIGMPZ-s-9QASFcLZt-WruPxAE5oPSHB0 Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1da6fbca378a43c6b71b9b1b2fa1bc7c Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1da6fbca378a43c6b71b9b1b2fa1bc7c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1da6fbca378a43c6b71b9b1b2fa1bc7c Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersOnMultiNodesTest-2073144359-project Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7a8e7139c1694698a5fde98743165501 Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersOnMultiNodesTest-2073144359-project Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 35efe352-3b67-40fc-99c5-22fbf221bdfa could not be found. Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '35efe352-3b67-40fc-99c5-22fbf221bdfa'} Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35efe352-3b67-40fc-99c5-22fbf221bdfa could not be found. Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35efe352-3b67-40fc-99c5-22fbf221bdfa could not be found. Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:01.031905 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:01.036961 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:01.036961 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:01.036961 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:01.036961 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:13:01.036961 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:13:01.036961 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35efe352-3b67-40fc-99c5-22fbf221bdfa could not be found. Oct 12 22:13:01.036961 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:01.038894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-21b219f4-592b-4b53-b029-d0772d4d939b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Returning 404 to user: Instance 35efe352-3b67-40fc-99c5-22fbf221bdfa could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:13:01.039954 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-21b219f4-592b-4b53-b029-d0772d4d939b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/35efe352-3b67-40fc-99c5-22fbf221bdfa" status: 404 len: 111 microversion: 2.1 time: 0.050507 Oct 12 22:13:01.043990 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1901/3419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:00 2022] GET /compute/v2.1/servers/35efe352-3b67-40fc-99c5-22fbf221bdfa => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:13:01.049894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-35ded780-5e6b-4ffc-bf15-1da3509ea3d1 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Action: 'action', calling method: .version_select at 0x7f512a8aea60>, body: {"removeFloatingIp": {"address": "172.25.2.234"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:01.210130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-35ded780-5e6b-4ffc-bf15-1da3509ea3d1 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:01.217861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35ded780-5e6b-4ffc-bf15-1da3509ea3d1 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:01.218794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35ded780-5e6b-4ffc-bf15-1da3509ea3d1 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:01.219277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35ded780-5e6b-4ffc-bf15-1da3509ea3d1 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:01.219996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35ded780-5e6b-4ffc-bf15-1da3509ea3d1 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:01.220456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35ded780-5e6b-4ffc-bf15-1da3509ea3d1 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:01.220888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35ded780-5e6b-4ffc-bf15-1da3509ea3d1 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:01.279982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:01.538621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35ded780-5e6b-4ffc-bf15-1da3509ea3d1 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "refresh_cache-834fccfb-555f-4b47-9c94-eff3997d3dd2" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:13:01.539224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35ded780-5e6b-4ffc-bf15-1da3509ea3d1 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquired lock "refresh_cache-834fccfb-555f-4b47-9c94-eff3997d3dd2" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:13:02.326789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-35ded780-5e6b-4ffc-bf15-1da3509ea3d1 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Building network info cache for instance {{(pid=120453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:13:02.940296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-35ded780-5e6b-4ffc-bf15-1da3509ea3d1 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Updating instance_info_cache with network_info: [{"id": "52d827f6-3263-45e3-be6b-9e5d6a230519", "address": "fa:16:3e:5d:a0:89", "network": {"id": "fb7d3258-6587-403e-9076-bc67d7e46a31", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-718625200-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "85487b1a0fc14efd8b218080c3d23ce3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap52d827f6-32", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:13:02.954937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35ded780-5e6b-4ffc-bf15-1da3509ea3d1 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Releasing lock "refresh_cache-834fccfb-555f-4b47-9c94-eff3997d3dd2" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:13:02.969893 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-35ded780-5e6b-4ffc-bf15-1da3509ea3d1 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "POST /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2/action" status: 202 len: 0 microversion: 2.1 time: 1.910246 Oct 12 22:13:02.974497 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1902/3420] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:13:01 2022] POST /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2/action => generated 0 bytes in 1926 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:13:02.978326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-890ca2cb-e447-48a2-824e-590ad6916782 req-fab2e1cf-c272-473b-8def-4bfa1c758f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "295cbe61-8ee8-4a38-b2e8-4045383c2f61", "tag": "b9260bbe-318b-4479-b25c-f5be8d845d8c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:02.990674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-890ca2cb-e447-48a2-824e-590ad6916782 req-fab2e1cf-c272-473b-8def-4bfa1c758f99 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:02.991804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-890ca2cb-e447-48a2-824e-590ad6916782 req-fab2e1cf-c272-473b-8def-4bfa1c758f99 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:02.992495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-890ca2cb-e447-48a2-824e-590ad6916782 req-fab2e1cf-c272-473b-8def-4bfa1c758f99 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:03.008917 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-890ca2cb-e447-48a2-824e-590ad6916782 req-fab2e1cf-c272-473b-8def-4bfa1c758f99 service nova] Creating event network-changed:b9260bbe-318b-4479-b25c-f5be8d845d8c for instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 on n-h1-861111-1 Oct 12 22:13:03.014745 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-890ca2cb-e447-48a2-824e-590ad6916782 req-fab2e1cf-c272-473b-8def-4bfa1c758f99 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042101 Oct 12 22:13:03.016159 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1903/3421] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:03.022546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87bdaf43-9928-4c7a-af50-90478e380b1f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:03.023554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-87bdaf43-9928-4c7a-af50-90478e380b1f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 1baccb0f-089a-44e5-8011-c45767da7abc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:03.030480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87bdaf43-9928-4c7a-af50-90478e380b1f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:03.031187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87bdaf43-9928-4c7a-af50-90478e380b1f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:03.031832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87bdaf43-9928-4c7a-af50-90478e380b1f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:03.032595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87bdaf43-9928-4c7a-af50-90478e380b1f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:03.033053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87bdaf43-9928-4c7a-af50-90478e380b1f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:03.033662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87bdaf43-9928-4c7a-af50-90478e380b1f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:03.048029 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-87bdaf43-9928-4c7a-af50-90478e380b1f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] HTTP exception thrown: Instance 1baccb0f-089a-44e5-8011-c45767da7abc could not be found. Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87bdaf43-9928-4c7a-af50-90478e380b1f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Request method failure captured: Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc HTTP/1.1 Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzr98Hx3HSZUwq13XuvkKDPq0Iz5m-bV7cM398dlrUOClDHZvKrry9jEBmFlbHSmTggU-8Kzhn-tq2F0pNUWaJ0dz4mTrYT4WEggz5nFy73h3CWXJWY0xrriAWPLgFsaD4ELYtj-jFuaZbDIGMPZ-s-9QASFcLZt-WruPxAE5oPSHB0 Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1da6fbca378a43c6b71b9b1b2fa1bc7c Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1da6fbca378a43c6b71b9b1b2fa1bc7c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1da6fbca378a43c6b71b9b1b2fa1bc7c Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersOnMultiNodesTest-2073144359-project Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7a8e7139c1694698a5fde98743165501 Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersOnMultiNodesTest-2073144359-project Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 1baccb0f-089a-44e5-8011-c45767da7abc could not be found. Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1baccb0f-089a-44e5-8011-c45767da7abc'} Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1baccb0f-089a-44e5-8011-c45767da7abc could not be found. Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1baccb0f-089a-44e5-8011-c45767da7abc could not be found. Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:03.049767 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:03.054064 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:03.054064 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:03.054064 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:03.054064 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:13:03.054064 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:13:03.054064 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1baccb0f-089a-44e5-8011-c45767da7abc could not be found. Oct 12 22:13:03.054064 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:03.055375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87bdaf43-9928-4c7a-af50-90478e380b1f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Returning 404 to user: Instance 1baccb0f-089a-44e5-8011-c45767da7abc could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:13:03.056286 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-87bdaf43-9928-4c7a-af50-90478e380b1f tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc" status: 404 len: 111 microversion: 2.1 time: 0.038668 Oct 12 22:13:03.056857 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1904/3422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:03 2022] GET /compute/v2.1/servers/1baccb0f-089a-44e5-8011-c45767da7abc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:13:03.065271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-72ff7e26-0f4b-4e66-a886-2b427c94c4d0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:03.066542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-72ff7e26-0f4b-4e66-a886-2b427c94c4d0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:03.073063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72ff7e26-0f4b-4e66-a886-2b427c94c4d0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:03.074125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72ff7e26-0f4b-4e66-a886-2b427c94c4d0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:03.074589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72ff7e26-0f4b-4e66-a886-2b427c94c4d0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:03.075314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72ff7e26-0f4b-4e66-a886-2b427c94c4d0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:03.075935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72ff7e26-0f4b-4e66-a886-2b427c94c4d0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:03.076513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72ff7e26-0f4b-4e66-a886-2b427c94c4d0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:03.226240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-72ff7e26-0f4b-4e66-a886-2b427c94c4d0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:03.236587 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-72ff7e26-0f4b-4e66-a886-2b427c94c4d0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1315 microversion: 2.1 time: 0.175362 Oct 12 22:13:03.247296 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1905/3423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:03 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:03.247296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4feb269e-7cd3-4a83-a516-3fbaf972c5ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:03.247296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4feb269e-7cd3-4a83-a516-3fbaf972c5ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:03.257143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4feb269e-7cd3-4a83-a516-3fbaf972c5ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:03.257686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4feb269e-7cd3-4a83-a516-3fbaf972c5ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:03.258157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4feb269e-7cd3-4a83-a516-3fbaf972c5ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:03.259143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4feb269e-7cd3-4a83-a516-3fbaf972c5ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:03.259632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4feb269e-7cd3-4a83-a516-3fbaf972c5ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:03.260064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4feb269e-7cd3-4a83-a516-3fbaf972c5ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:03.429665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4feb269e-7cd3-4a83-a516-3fbaf972c5ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:03.438748 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4feb269e-7cd3-4a83-a516-3fbaf972c5ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 200 len: 1314 microversion: 2.1 time: 0.199407 Oct 12 22:13:03.439729 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1906/3424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:03 2022] GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:03.445223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-027fb0bc-7e5a-4e3b-ac58-3ae215b82e81 req-16fe6eb5-4d02-4e74-8719-3d849c27a562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feeebc28-6cfd-4f7d-8e32-d725731d0ba3", "tag": "10b52e2e-0015-4406-ae37-d8e3d7eab6de"}, {"server_uuid": "35efe352-3b67-40fc-99c5-22fbf221bdfa", "name": "network-vif-deleted", "tag": "47ace383-978a-4d7b-be27-0a3f503cb49b"}, {"name": "network-changed", "server_uuid": "834fccfb-555f-4b47-9c94-eff3997d3dd2", "tag": "52d827f6-3263-45e3-be6b-9e5d6a230519"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:03.457258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-027fb0bc-7e5a-4e3b-ac58-3ae215b82e81 req-16fe6eb5-4d02-4e74-8719-3d849c27a562 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:03.458053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-027fb0bc-7e5a-4e3b-ac58-3ae215b82e81 req-16fe6eb5-4d02-4e74-8719-3d849c27a562 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:03.458656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-027fb0bc-7e5a-4e3b-ac58-3ae215b82e81 req-16fe6eb5-4d02-4e74-8719-3d849c27a562 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:03.463647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=4,nova_cell1:RELEASE=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:03.475467 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-027fb0bc-7e5a-4e3b-ac58-3ae215b82e81 req-16fe6eb5-4d02-4e74-8719-3d849c27a562 service nova] Creating event network-changed:10b52e2e-0015-4406-ae37-d8e3d7eab6de for instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 on n-h1-861111-1 Oct 12 22:13:03.476263 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-027fb0bc-7e5a-4e3b-ac58-3ae215b82e81 req-16fe6eb5-4d02-4e74-8719-3d849c27a562 service nova] Creating event network-vif-deleted:47ace383-978a-4d7b-be27-0a3f503cb49b for instance 35efe352-3b67-40fc-99c5-22fbf221bdfa on n-h2-861111-1 Oct 12 22:13:03.476954 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-027fb0bc-7e5a-4e3b-ac58-3ae215b82e81 req-16fe6eb5-4d02-4e74-8719-3d849c27a562 service nova] Creating event network-changed:52d827f6-3263-45e3-be6b-9e5d6a230519 for instance 834fccfb-555f-4b47-9c94-eff3997d3dd2 on n-h2-861111-1 Oct 12 22:13:03.487600 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-027fb0bc-7e5a-4e3b-ac58-3ae215b82e81 req-16fe6eb5-4d02-4e74-8719-3d849c27a562 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.046467 Oct 12 22:13:03.489299 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1907/3425] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:03.495854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2123e907-d3f8-4355-bb58-cfe0ced98c5b tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '.version_select at 0x7f512848ea60>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:03.671813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-8ea33189-9555-48c1-ba11-405d11164c19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Building network info cache for instance {{(pid=120452) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:13:04.609933 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2123e907-d3f8-4355-bb58-cfe0ced98c5b tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/4668390d-8fe2-4c05-9ae0-eaf00b2f643f" status: 202 len: 0 microversion: 2.1 time: 1.119229 Oct 12 22:13:04.615336 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1908/3426] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:13:03 2022] DELETE /compute/v2.1/os-floating-ips/4668390d-8fe2-4c05-9ae0-eaf00b2f643f => generated 0 bytes in 1125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:13:04.623788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-76c51858-0614-4b9e-86a8-673284a8dbc0 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:04.675718 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-76c51858-0614-4b9e-86a8-673284a8dbc0 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/6fd53820-5929-4211-b79d-05c382d7a9d7" status: 204 len: 0 microversion: 2.1 time: 0.058636 Oct 12 22:13:04.677092 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1909/3427] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 12 22:13:04 2022] DELETE /compute/v2.1/os-server-groups/6fd53820-5929-4211-b79d-05c382d7a9d7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:13:04.683012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-836f3865-c365-4cd3-b214-c6191d8b419f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:04.683795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-836f3865-c365-4cd3-b214-c6191d8b419f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:04.695365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-836f3865-c365-4cd3-b214-c6191d8b419f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:04.696148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-836f3865-c365-4cd3-b214-c6191d8b419f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:04.696595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-836f3865-c365-4cd3-b214-c6191d8b419f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:04.697339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-836f3865-c365-4cd3-b214-c6191d8b419f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:04.697801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-836f3865-c365-4cd3-b214-c6191d8b419f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:04.698232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-836f3865-c365-4cd3-b214-c6191d8b419f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:04.859615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-836f3865-c365-4cd3-b214-c6191d8b419f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:04.874452 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-836f3865-c365-4cd3-b214-c6191d8b419f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1502 microversion: 2.1 time: 0.195485 Oct 12 22:13:04.875226 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1910/3428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:04 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:04.880464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-953a992d-3e57-492a-9285-917f81e00ae7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:04.881392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-953a992d-3e57-492a-9285-917f81e00ae7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:04.887757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-953a992d-3e57-492a-9285-917f81e00ae7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:04.888389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-953a992d-3e57-492a-9285-917f81e00ae7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:04.889090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-953a992d-3e57-492a-9285-917f81e00ae7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:04.889872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-953a992d-3e57-492a-9285-917f81e00ae7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:04.890527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-953a992d-3e57-492a-9285-917f81e00ae7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:04.891151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-953a992d-3e57-492a-9285-917f81e00ae7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:05.045914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-953a992d-3e57-492a-9285-917f81e00ae7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:05.055213 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-953a992d-3e57-492a-9285-917f81e00ae7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 200 len: 1314 microversion: 2.1 time: 0.178622 Oct 12 22:13:05.056273 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1911/3429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:04 2022] GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:05.061263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6d08022c-7f9a-4e02-be26-a54d04a83a7e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6d08022c-7f9a-4e02-be26-a54d04a83a7e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Request method failure captured: Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2/action HTTP/1.1 Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 34 Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzu09m4YMwyAW5XmhOEfb-EgkfB9KSU4r5FkixV7M0UuuPgFW2vI4R72JNrd-Kem9C8wReSqFIUGo5s7iUjQ4HMfT66uooX5zG09UfafAz6N8lvC0atzIXSX_eSCNJOFTK8rOQ6KIRatSIQpy_9JO--t4Nf9UB_m_unRQ7w9_PrKrsQ Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 85487b1a0fc14efd8b218080c3d23ce3 Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-902763970 Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85487b1a0fc14efd8b218080c3d23ce3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85487b1a0fc14efd8b218080c3d23ce3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_85487b1a0fc14efd8b218080c3d23ce3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/85487b1a0fc14efd8b218080c3d23ce3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-902763970 Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 85487b1a0fc14efd8b218080c3d23ce3 Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-902763970 Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: bb00c4c021344aa296bead35a76dd606 Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: {"addFloatingIp": {"address": ""}} Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '834fccfb-555f-4b47-9c94-eff3997d3dd2', 'body': {'addFloatingIp': {'address': ''}}} Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi '' Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:13:05.065630 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:13:05.070943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:13:05.070943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 12 22:13:05.070943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:05.070943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:05.070943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:05.070943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:05.070943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:05.070943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:05.070943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:13:05.070943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:13:05.070943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 12 22:13:05.070943 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:05.072806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6d08022c-7f9a-4e02-be26-a54d04a83a7e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:13:05.073835 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6d08022c-7f9a-4e02-be26-a54d04a83a7e tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "POST /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2/action" status: 400 len: 142 microversion: 2.1 time: 0.016427 Oct 12 22:13:05.074411 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1912/3430] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:13:05 2022] POST /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2/action => generated 142 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:13:05.079120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-62673113-108e-49d1-bf86-f769d7a465bb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:05.079863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-62673113-108e-49d1-bf86-f769d7a465bb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:05.088096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62673113-108e-49d1-bf86-f769d7a465bb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:05.088872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62673113-108e-49d1-bf86-f769d7a465bb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:05.089470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62673113-108e-49d1-bf86-f769d7a465bb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:05.090361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62673113-108e-49d1-bf86-f769d7a465bb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:05.091099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62673113-108e-49d1-bf86-f769d7a465bb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:05.091713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62673113-108e-49d1-bf86-f769d7a465bb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:05.123670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-62673113-108e-49d1-bf86-f769d7a465bb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:13:05.226093 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-62673113-108e-49d1-bf86-f769d7a465bb tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 204 len: 0 microversion: 2.1 time: 0.149938 Oct 12 22:13:05.226739 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1913/3431] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:13:05 2022] DELETE /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:13:05.235402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4f48ceeb-2008-465b-af8d-5dd45a077ce6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:05.242195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f48ceeb-2008-465b-af8d-5dd45a077ce6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:05.242692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f48ceeb-2008-465b-af8d-5dd45a077ce6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:05.243136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f48ceeb-2008-465b-af8d-5dd45a077ce6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:05.271600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4f48ceeb-2008-465b-af8d-5dd45a077ce6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Going to try to stop instance {{(pid=120453) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 22:13:05.331340 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4f48ceeb-2008-465b-af8d-5dd45a077ce6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b/action" status: 202 len: 0 microversion: 2.1 time: 0.102990 Oct 12 22:13:05.331666 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1914/3432] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:13:05 2022] POST /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:13:05.356281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8ab5f3bc-995b-4921-8b0f-84d5f99cec84 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:05.359699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8ab5f3bc-995b-4921-8b0f-84d5f99cec84 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:05.367028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ab5f3bc-995b-4921-8b0f-84d5f99cec84 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:05.367561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ab5f3bc-995b-4921-8b0f-84d5f99cec84 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:05.368006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ab5f3bc-995b-4921-8b0f-84d5f99cec84 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:05.368717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ab5f3bc-995b-4921-8b0f-84d5f99cec84 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:05.369180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ab5f3bc-995b-4921-8b0f-84d5f99cec84 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:05.369618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ab5f3bc-995b-4921-8b0f-84d5f99cec84 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:05.395158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ab5f3bc-995b-4921-8b0f-84d5f99cec84 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "refresh_cache-834fccfb-555f-4b47-9c94-eff3997d3dd2" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:13:05.395503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ab5f3bc-995b-4921-8b0f-84d5f99cec84 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquired lock "refresh_cache-834fccfb-555f-4b47-9c94-eff3997d3dd2" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:13:05.506017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ab5f3bc-995b-4921-8b0f-84d5f99cec84 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Releasing lock "refresh_cache-834fccfb-555f-4b47-9c94-eff3997d3dd2" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:13:05.506765 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-8ab5f3bc-995b-4921-8b0f-84d5f99cec84 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] HTTP exception thrown: floating IP not found Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8ab5f3bc-995b-4921-8b0f-84d5f99cec84 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Request method failure captured: Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2/action HTTP/1.1 Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 41 Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzu09m4YMwyAW5XmhOEfb-EgkfB9KSU4r5FkixV7M0UuuPgFW2vI4R72JNrd-Kem9C8wReSqFIUGo5s7iUjQ4HMfT66uooX5zG09UfafAz6N8lvC0atzIXSX_eSCNJOFTK8rOQ6KIRatSIQpy_9JO--t4Nf9UB_m_unRQ7w9_PrKrsQ Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 85487b1a0fc14efd8b218080c3d23ce3 Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-902763970 Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85487b1a0fc14efd8b218080c3d23ce3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85487b1a0fc14efd8b218080c3d23ce3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_85487b1a0fc14efd8b218080c3d23ce3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/85487b1a0fc14efd8b218080c3d23ce3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-902763970 Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 85487b1a0fc14efd8b218080c3d23ce3 Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-902763970 Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: bb00c4c021344aa296bead35a76dd606 Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: exception: floating IP not found Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '834fccfb-555f-4b47-9c94-eff3997d3dd2', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 12 22:13:05.508755 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:05.513238 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:05.513238 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:05.513238 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:05.513238 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:05.513238 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:05.513238 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:13:05.513238 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:13:05.513238 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 12 22:13:05.513238 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:05.513238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8ab5f3bc-995b-4921-8b0f-84d5f99cec84 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Returning 404 to user: floating IP not found {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:13:05.513238 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8ab5f3bc-995b-4921-8b0f-84d5f99cec84 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "POST /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2/action" status: 404 len: 67 microversion: 2.1 time: 0.160746 Oct 12 22:13:05.517368 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1915/3433] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:13:05 2022] POST /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2/action => generated 67 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:13:05.523731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87e606e0-39ee-4352-a14b-ddd3e2a2922b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:05.524522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-87e606e0-39ee-4352-a14b-ddd3e2a2922b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:05.534507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e606e0-39ee-4352-a14b-ddd3e2a2922b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:05.534507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e606e0-39ee-4352-a14b-ddd3e2a2922b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:05.534507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e606e0-39ee-4352-a14b-ddd3e2a2922b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:05.534507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e606e0-39ee-4352-a14b-ddd3e2a2922b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:05.534507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e606e0-39ee-4352-a14b-ddd3e2a2922b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:05.534507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e606e0-39ee-4352-a14b-ddd3e2a2922b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:05.720093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-87e606e0-39ee-4352-a14b-ddd3e2a2922b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:05.728208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-8ea33189-9555-48c1-ba11-405d11164c19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Updating instance_info_cache with network_info: [{"id": "76764896-d8b2-4553-97a9-4df1772081c6", "address": "fa:16:3e:b8:84:98", "network": {"id": "709423db-695b-4953-a10f-b3358d5669f7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-519345160-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b201054c71d241ee8b130a9b0a014cf6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap76764896-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120452) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:13:05.733469 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-87e606e0-39ee-4352-a14b-ddd3e2a2922b tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 200 len: 1472 microversion: 2.1 time: 0.214941 Oct 12 22:13:05.734406 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1916/3434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:05 2022] GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 1472 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:05.739598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-83278cef-4c74-44f8-950b-b26fbfc3caa7 req-4e543cb0-6a40-4ebf-9fe6-040b8dd17c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1baccb0f-089a-44e5-8011-c45767da7abc", "name": "network-vif-deleted", "tag": "51f781cf-b3dc-4040-977e-77aa6a84e95f"}, {"name": "network-changed", "server_uuid": "c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835", "tag": "76764896-d8b2-4553-97a9-4df1772081c6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:05.747837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ea33189-9555-48c1-ba11-405d11164c19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Releasing lock "refresh_cache-c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:13:05.749101 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8ea33189-9555-48c1-ba11-405d11164c19 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "POST /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835/action" status: 202 len: 0 microversion: 2.1 time: 7.280492 Oct 12 22:13:05.749964 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1519/3435] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:12:58 2022] POST /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835/action => generated 0 bytes in 7282 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:13:05.755660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-13c76a3b-602c-444f-890d-14d8c8ee8467 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:05.756689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-13c76a3b-602c-444f-890d-14d8c8ee8467 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:05.760334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-83278cef-4c74-44f8-950b-b26fbfc3caa7 req-4e543cb0-6a40-4ebf-9fe6-040b8dd17c4a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:05.760836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-83278cef-4c74-44f8-950b-b26fbfc3caa7 req-4e543cb0-6a40-4ebf-9fe6-040b8dd17c4a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:05.761272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-83278cef-4c74-44f8-950b-b26fbfc3caa7 req-4e543cb0-6a40-4ebf-9fe6-040b8dd17c4a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:05.764440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13c76a3b-602c-444f-890d-14d8c8ee8467 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:05.765281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13c76a3b-602c-444f-890d-14d8c8ee8467 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:05.765880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13c76a3b-602c-444f-890d-14d8c8ee8467 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:05.766737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13c76a3b-602c-444f-890d-14d8c8ee8467 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:05.767411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13c76a3b-602c-444f-890d-14d8c8ee8467 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:05.767986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13c76a3b-602c-444f-890d-14d8c8ee8467 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:05.786292 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-83278cef-4c74-44f8-950b-b26fbfc3caa7 req-4e543cb0-6a40-4ebf-9fe6-040b8dd17c4a service nova] Creating event network-vif-deleted:51f781cf-b3dc-4040-977e-77aa6a84e95f for instance 1baccb0f-089a-44e5-8011-c45767da7abc on n-h2-861111-1 Oct 12 22:13:05.787222 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-83278cef-4c74-44f8-950b-b26fbfc3caa7 req-4e543cb0-6a40-4ebf-9fe6-040b8dd17c4a service nova] Creating event network-changed:76764896-d8b2-4553-97a9-4df1772081c6 for instance c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 on n-h1-861111-1 Oct 12 22:13:05.799666 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-83278cef-4c74-44f8-950b-b26fbfc3caa7 req-4e543cb0-6a40-4ebf-9fe6-040b8dd17c4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.063700 Oct 12 22:13:05.801937 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1917/3436] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:05.809432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "6fa7622a-1fe1-4e7c-9b15-ad5e127cfbde"}], "security_groups": [{"name": "tempest-securitygroup--662348154"}], "key_name": "tempest-keypair-443066155", "user_data": "}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:05.954991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] validate_networks() for [('6fa7622a-1fe1-4e7c-9b15-ad5e127cfbde', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:13:05.967264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-13c76a3b-602c-444f-890d-14d8c8ee8467 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:05.975689 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-13c76a3b-602c-444f-890d-14d8c8ee8467 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1512 microversion: 2.1 time: 0.224236 Oct 12 22:13:05.976833 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1520/3437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:05 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1512 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:05.981535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6182d03e-e6ab-4a19-a341-359cd0b1cabc tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:06.033866 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-6182d03e-e6ab-4a19-a341-359cd0b1cabc tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6182d03e-e6ab-4a19-a341-359cd0b1cabc tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Request method failure captured: Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2/action HTTP/1.1 Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 44 Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzu09m4YMwyAW5XmhOEfb-EgkfB9KSU4r5FkixV7M0UuuPgFW2vI4R72JNrd-Kem9C8wReSqFIUGo5s7iUjQ4HMfT66uooX5zG09UfafAz6N8lvC0atzIXSX_eSCNJOFTK8rOQ6KIRatSIQpy_9JO--t4Nf9UB_m_unRQ7w9_PrKrsQ Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 85487b1a0fc14efd8b218080c3d23ce3 Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-902763970 Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85487b1a0fc14efd8b218080c3d23ce3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85487b1a0fc14efd8b218080c3d23ce3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_85487b1a0fc14efd8b218080c3d23ce3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/85487b1a0fc14efd8b218080c3d23ce3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-902763970 Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 85487b1a0fc14efd8b218080c3d23ce3 Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-902763970 Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: bb00c4c021344aa296bead35a76dd606 Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: exception: Floating IP not found for address 0.0.0.0. Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '834fccfb-555f-4b47-9c94-eff3997d3dd2', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 12 22:13:06.035838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 12 22:13:06.039580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 12 22:13:06.039580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:13:06.039580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:06.039580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:13:06.039580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:06.039580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:06.039580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:06.039580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:13:06.039580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:13:06.039580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 12 22:13:06.039580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:13:06.042431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6182d03e-e6ab-4a19-a341-359cd0b1cabc tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:13:06.043508 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6182d03e-e6ab-4a19-a341-359cd0b1cabc tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "POST /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2/action" status: 404 len: 88 microversion: 2.1 time: 0.065556 Oct 12 22:13:06.044512 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1521/3438] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:13:05 2022] POST /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2/action => generated 88 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:13:06.050473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-655791ac-557c-497b-9e1c-c7431f8c96e9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:06.052250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-655791ac-557c-497b-9e1c-c7431f8c96e9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:06.061576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-655791ac-557c-497b-9e1c-c7431f8c96e9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:06.062514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-655791ac-557c-497b-9e1c-c7431f8c96e9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:06.063573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-655791ac-557c-497b-9e1c-c7431f8c96e9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:06.064469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-655791ac-557c-497b-9e1c-c7431f8c96e9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:06.065077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-655791ac-557c-497b-9e1c-c7431f8c96e9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:06.066180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-655791ac-557c-497b-9e1c-c7431f8c96e9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:06.099781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-655791ac-557c-497b-9e1c-c7431f8c96e9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:13:06.204348 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-655791ac-557c-497b-9e1c-c7431f8c96e9 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" status: 204 len: 0 microversion: 2.1 time: 0.157943 Oct 12 22:13:06.205297 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1522/3439] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:13:06 2022] DELETE /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:13:06.211672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d091a24-6f98-4dba-8633-fcd2aadfe0d0 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:06.212590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5d091a24-6f98-4dba-8633-fcd2aadfe0d0 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:06.219137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d091a24-6f98-4dba-8633-fcd2aadfe0d0 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:06.220017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d091a24-6f98-4dba-8633-fcd2aadfe0d0 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:06.220683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d091a24-6f98-4dba-8633-fcd2aadfe0d0 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:06.221641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d091a24-6f98-4dba-8633-fcd2aadfe0d0 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:06.222729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d091a24-6f98-4dba-8633-fcd2aadfe0d0 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:06.223421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d091a24-6f98-4dba-8633-fcd2aadfe0d0 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:06.258324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5d091a24-6f98-4dba-8633-fcd2aadfe0d0 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:13:06.385254 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5d091a24-6f98-4dba-8633-fcd2aadfe0d0 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "DELETE /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 204 len: 0 microversion: 2.1 time: 0.178232 Oct 12 22:13:06.386197 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1523/3440] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:13:06 2022] DELETE /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:13:06.392481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2c28dedd-b611-4430-8a5d-0843fd6d249a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:06.393413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2c28dedd-b611-4430-8a5d-0843fd6d249a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:06.414350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c28dedd-b611-4430-8a5d-0843fd6d249a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:06.415930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c28dedd-b611-4430-8a5d-0843fd6d249a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:06.416534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c28dedd-b611-4430-8a5d-0843fd6d249a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:06.417410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c28dedd-b611-4430-8a5d-0843fd6d249a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:06.418021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c28dedd-b611-4430-8a5d-0843fd6d249a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:06.418641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c28dedd-b611-4430-8a5d-0843fd6d249a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:06.427015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:13:06.427487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:13:06.427978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:13:06.428485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:13:06.428911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:13:06.443831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:06.444331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:06.444860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:06.446213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:06.446488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:06.447077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:06.479424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Getting quotas for project 950d9a3e971644709e04007bf0d3a6e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:13:06.485362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Getting quotas for user 0e9463eb3ccf4028af1bfc61749c8e99 and project 950d9a3e971644709e04007bf0d3a6e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:13:06.499852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:13:06.502338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:13:06.567297 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dd3e2e12-6f33-4be8-8541-6b5ae8368843 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.759571 Oct 12 22:13:06.568906 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1918/3441] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:13:05 2022] POST /compute/v2.1/servers => generated 408 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:13:06.576542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e9f07ed7-b540-4d2b-a863-734c43103bb7 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.111"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:06.580098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e9f07ed7-b540-4d2b-a863-734c43103bb7 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:06.591839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9f07ed7-b540-4d2b-a863-734c43103bb7 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:06.592893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9f07ed7-b540-4d2b-a863-734c43103bb7 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:06.593307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9f07ed7-b540-4d2b-a863-734c43103bb7 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:06.594148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9f07ed7-b540-4d2b-a863-734c43103bb7 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:06.594782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9f07ed7-b540-4d2b-a863-734c43103bb7 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:06.595423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9f07ed7-b540-4d2b-a863-734c43103bb7 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:06.646407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9f07ed7-b540-4d2b-a863-734c43103bb7 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "refresh_cache-f924aa3b-0c00-4577-bb06-3a169f972d3d" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:13:06.647128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9f07ed7-b540-4d2b-a863-734c43103bb7 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquired lock "refresh_cache-f924aa3b-0c00-4577-bb06-3a169f972d3d" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:13:06.947635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2c28dedd-b611-4430-8a5d-0843fd6d249a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:06.959086 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2c28dedd-b611-4430-8a5d-0843fd6d249a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 200 len: 1314 microversion: 2.1 time: 0.571383 Oct 12 22:13:06.960048 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1524/3442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:06 2022] GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:06.994038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3d9e0d79-d5a4-44e0-82a6-176c50ee5d42 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:06.994681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3d9e0d79-d5a4-44e0-82a6-176c50ee5d42 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:07.006404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d9e0d79-d5a4-44e0-82a6-176c50ee5d42 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:07.006902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d9e0d79-d5a4-44e0-82a6-176c50ee5d42 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:07.007374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d9e0d79-d5a4-44e0-82a6-176c50ee5d42 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:07.008084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d9e0d79-d5a4-44e0-82a6-176c50ee5d42 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:07.014841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d9e0d79-d5a4-44e0-82a6-176c50ee5d42 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:07.016699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d9e0d79-d5a4-44e0-82a6-176c50ee5d42 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:07.299694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3d9e0d79-d5a4-44e0-82a6-176c50ee5d42 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:07.310625 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3d9e0d79-d5a4-44e0-82a6-176c50ee5d42 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1540 microversion: 2.1 time: 0.333087 Oct 12 22:13:07.329814 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1525/3443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:06 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1540 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:07.336631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e578030e-6de0-44be-8b77-ffcb30603334 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:07.337993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e578030e-6de0-44be-8b77-ffcb30603334 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:07.345607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e578030e-6de0-44be-8b77-ffcb30603334 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:07.346323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e578030e-6de0-44be-8b77-ffcb30603334 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:07.347528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e578030e-6de0-44be-8b77-ffcb30603334 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:07.349133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e578030e-6de0-44be-8b77-ffcb30603334 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:07.349770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e578030e-6de0-44be-8b77-ffcb30603334 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:07.350368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e578030e-6de0-44be-8b77-ffcb30603334 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:07.438348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e578030e-6de0-44be-8b77-ffcb30603334 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9463eb3ccf4028af1bfc61749c8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950d9a3e971644709e04007bf0d3a6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:07.459548 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e578030e-6de0-44be-8b77-ffcb30603334 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 200 len: 1229 microversion: 2.1 time: 0.127915 Oct 12 22:13:07.461287 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1526/3444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:07 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 1229 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:07.467713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-dc8cae20-375a-4fc4-be07-2ac139fcee6c req-0f37f79e-53a0-4d92-a332-ebaf3f6d985e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "295cbe61-8ee8-4a38-b2e8-4045383c2f61", "name": "network-vif-plugged", "status": "completed", "tag": "b9260bbe-318b-4479-b25c-f5be8d845d8c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:07.480765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dc8cae20-375a-4fc4-be07-2ac139fcee6c req-0f37f79e-53a0-4d92-a332-ebaf3f6d985e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:07.481848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dc8cae20-375a-4fc4-be07-2ac139fcee6c req-0f37f79e-53a0-4d92-a332-ebaf3f6d985e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:07.482617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dc8cae20-375a-4fc4-be07-2ac139fcee6c req-0f37f79e-53a0-4d92-a332-ebaf3f6d985e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:07.495476 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-dc8cae20-375a-4fc4-be07-2ac139fcee6c req-0f37f79e-53a0-4d92-a332-ebaf3f6d985e service nova] Creating event network-vif-plugged:b9260bbe-318b-4479-b25c-f5be8d845d8c for instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 on n-h1-861111-1 Oct 12 22:13:07.500840 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-dc8cae20-375a-4fc4-be07-2ac139fcee6c req-0f37f79e-53a0-4d92-a332-ebaf3f6d985e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038216 Oct 12 22:13:07.501813 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1527/3445] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:07.507331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-286878a5-ae5f-4150-88c5-2670225ac65d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:07.508984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-286878a5-ae5f-4150-88c5-2670225ac65d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:07.511546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:07.524380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-286878a5-ae5f-4150-88c5-2670225ac65d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:07.525035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-286878a5-ae5f-4150-88c5-2670225ac65d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:07.526175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-286878a5-ae5f-4150-88c5-2670225ac65d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:07.527752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-286878a5-ae5f-4150-88c5-2670225ac65d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:07.528442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-286878a5-ae5f-4150-88c5-2670225ac65d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:07.528670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-286878a5-ae5f-4150-88c5-2670225ac65d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:08.129407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-286878a5-ae5f-4150-88c5-2670225ac65d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:08.147674 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-286878a5-ae5f-4150-88c5-2670225ac65d tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 200 len: 1472 microversion: 2.1 time: 0.640219 Oct 12 22:13:08.155032 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1528/3446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:07 2022] GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 1472 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:08.162463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d0ecd54b-8923-4462-a24e-9004d9025473 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:08.163096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d0ecd54b-8923-4462-a24e-9004d9025473 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:08.184229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ecd54b-8923-4462-a24e-9004d9025473 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:08.184749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ecd54b-8923-4462-a24e-9004d9025473 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:08.185199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ecd54b-8923-4462-a24e-9004d9025473 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:08.185926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ecd54b-8923-4462-a24e-9004d9025473 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:08.186387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ecd54b-8923-4462-a24e-9004d9025473 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:08.186816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ecd54b-8923-4462-a24e-9004d9025473 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:08.796834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d0ecd54b-8923-4462-a24e-9004d9025473 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:08.812583 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d0ecd54b-8923-4462-a24e-9004d9025473 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1512 microversion: 2.1 time: 0.656271 Oct 12 22:13:08.829914 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1529/3447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:08 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1512 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:08.839871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-108d72b8-89fa-4c01-b331-a646c61c4a16 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:08.841024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-108d72b8-89fa-4c01-b331-a646c61c4a16 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:08.852327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-108d72b8-89fa-4c01-b331-a646c61c4a16 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:08.852996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-108d72b8-89fa-4c01-b331-a646c61c4a16 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:08.853547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-108d72b8-89fa-4c01-b331-a646c61c4a16 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:08.854381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-108d72b8-89fa-4c01-b331-a646c61c4a16 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:08.855441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-108d72b8-89fa-4c01-b331-a646c61c4a16 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:08.855997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-108d72b8-89fa-4c01-b331-a646c61c4a16 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:10.073731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-e9f07ed7-b540-4d2b-a863-734c43103bb7 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Building network info cache for instance {{(pid=120453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:13:10.712827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-108d72b8-89fa-4c01-b331-a646c61c4a16 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:10.721629 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-108d72b8-89fa-4c01-b331-a646c61c4a16 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 200 len: 1314 microversion: 2.1 time: 1.890107 Oct 12 22:13:10.734112 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1530/3448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:08 2022] GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 1314 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:10.753313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c4b4d404-eda4-4b6c-b2d6-cedea6d8be06 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:10.754246 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c4b4d404-eda4-4b6c-b2d6-cedea6d8be06 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:10.761589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4b4d404-eda4-4b6c-b2d6-cedea6d8be06 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:10.772009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4b4d404-eda4-4b6c-b2d6-cedea6d8be06 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:10.773003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4b4d404-eda4-4b6c-b2d6-cedea6d8be06 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:10.774301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4b4d404-eda4-4b6c-b2d6-cedea6d8be06 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:10.782815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4b4d404-eda4-4b6c-b2d6-cedea6d8be06 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:10.785940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4b4d404-eda4-4b6c-b2d6-cedea6d8be06 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:11.264727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c4b4d404-eda4-4b6c-b2d6-cedea6d8be06 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb00c4c021344aa296bead35a76dd606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85487b1a0fc14efd8b218080c3d23ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:11.293734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:11.296655 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c4b4d404-eda4-4b6c-b2d6-cedea6d8be06 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 200 len: 1498 microversion: 2.1 time: 0.561058 Oct 12 22:13:11.297259 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1531/3449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:10 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 1498 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:11.312687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-35b7ab43-c29f-4811-9df1-0debbecb852b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:11.314419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-35b7ab43-c29f-4811-9df1-0debbecb852b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:11.356114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35b7ab43-c29f-4811-9df1-0debbecb852b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:11.360374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35b7ab43-c29f-4811-9df1-0debbecb852b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:11.362334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35b7ab43-c29f-4811-9df1-0debbecb852b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:11.364321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35b7ab43-c29f-4811-9df1-0debbecb852b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:11.364935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35b7ab43-c29f-4811-9df1-0debbecb852b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:11.365540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35b7ab43-c29f-4811-9df1-0debbecb852b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:11.494017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-35b7ab43-c29f-4811-9df1-0debbecb852b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9463eb3ccf4028af1bfc61749c8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950d9a3e971644709e04007bf0d3a6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:11.520200 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-35b7ab43-c29f-4811-9df1-0debbecb852b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 200 len: 1283 microversion: 2.1 time: 0.219939 Oct 12 22:13:11.521456 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1532/3450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:11 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 1283 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:11.537411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-12ed7d89-f08c-49d6-9844-f6bf806a1f88 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:11.538781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-12ed7d89-f08c-49d6-9844-f6bf806a1f88 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:11.558724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12ed7d89-f08c-49d6-9844-f6bf806a1f88 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:11.559227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12ed7d89-f08c-49d6-9844-f6bf806a1f88 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:11.559742 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12ed7d89-f08c-49d6-9844-f6bf806a1f88 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:11.564551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12ed7d89-f08c-49d6-9844-f6bf806a1f88 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:11.565201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12ed7d89-f08c-49d6-9844-f6bf806a1f88 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:11.569949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12ed7d89-f08c-49d6-9844-f6bf806a1f88 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:11.709755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-12ed7d89-f08c-49d6-9844-f6bf806a1f88 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8e7139c1694698a5fde98743165501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6fbca378a43c6b71b9b1b2fa1bc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:11.729404 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-12ed7d89-f08c-49d6-9844-f6bf806a1f88 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 200 len: 1302 microversion: 2.1 time: 0.205576 Oct 12 22:13:11.733342 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1533/3451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:11 2022] GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 1302 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:11.740623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d24938a1-4343-4fef-9fb2-8d28924b30f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:11.741493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d24938a1-4343-4fef-9fb2-8d28924b30f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:11.767038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d24938a1-4343-4fef-9fb2-8d28924b30f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:11.768811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d24938a1-4343-4fef-9fb2-8d28924b30f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:11.775834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d24938a1-4343-4fef-9fb2-8d28924b30f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:11.780053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d24938a1-4343-4fef-9fb2-8d28924b30f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:11.780918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d24938a1-4343-4fef-9fb2-8d28924b30f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:11.782140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d24938a1-4343-4fef-9fb2-8d28924b30f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:12.006006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d24938a1-4343-4fef-9fb2-8d28924b30f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:12.016799 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d24938a1-4343-4fef-9fb2-8d28924b30f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1512 microversion: 2.1 time: 0.281772 Oct 12 22:13:12.027340 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1534/3452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:11 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1512 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:12.027340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-e493d565-0e99-4542-b591-f202a920934a req-9f2655cb-23c7-4049-afc7-24aa8ce2997e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f924aa3b-0c00-4577-bb06-3a169f972d3d", "tag": "388738e3-987d-4373-89b2-ec1c33e4c96c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:12.034031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e493d565-0e99-4542-b591-f202a920934a req-9f2655cb-23c7-4049-afc7-24aa8ce2997e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:12.034031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e493d565-0e99-4542-b591-f202a920934a req-9f2655cb-23c7-4049-afc7-24aa8ce2997e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:12.034755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e493d565-0e99-4542-b591-f202a920934a req-9f2655cb-23c7-4049-afc7-24aa8ce2997e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:12.048508 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-e493d565-0e99-4542-b591-f202a920934a req-9f2655cb-23c7-4049-afc7-24aa8ce2997e service nova] Creating event network-changed:388738e3-987d-4373-89b2-ec1c33e4c96c for instance f924aa3b-0c00-4577-bb06-3a169f972d3d on n-h1-861111-1 Oct 12 22:13:12.055146 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-e493d565-0e99-4542-b591-f202a920934a req-9f2655cb-23c7-4049-afc7-24aa8ce2997e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035953 Oct 12 22:13:12.056034 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1535/3453] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:12.061167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-a08fb5f1-6c2c-496f-adad-a6507c15fd65 req-443faa30-fa66-4e26-8574-1a7a02f1aa70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c884fd7-d12b-4faa-95e1-96646f21ef60", "name": "network-vif-deleted", "tag": "e1e05e36-e77d-467a-8a79-0fded528c3ed"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:12.071275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a08fb5f1-6c2c-496f-adad-a6507c15fd65 req-443faa30-fa66-4e26-8574-1a7a02f1aa70 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:12.071723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a08fb5f1-6c2c-496f-adad-a6507c15fd65 req-443faa30-fa66-4e26-8574-1a7a02f1aa70 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:12.072041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a08fb5f1-6c2c-496f-adad-a6507c15fd65 req-443faa30-fa66-4e26-8574-1a7a02f1aa70 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:12.085235 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-a08fb5f1-6c2c-496f-adad-a6507c15fd65 req-443faa30-fa66-4e26-8574-1a7a02f1aa70 service nova] Creating event network-vif-deleted:e1e05e36-e77d-467a-8a79-0fded528c3ed for instance 3c884fd7-d12b-4faa-95e1-96646f21ef60 on n-h1-861111-1 Oct 12 22:13:12.094728 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-a08fb5f1-6c2c-496f-adad-a6507c15fd65 req-443faa30-fa66-4e26-8574-1a7a02f1aa70 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037590 Oct 12 22:13:12.095427 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1536/3454] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:12.105616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0d6b37b6-aa45-4162-a226-0e5a97b60e6c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:12.106337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0d6b37b6-aa45-4162-a226-0e5a97b60e6c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:12.113878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d6b37b6-aa45-4162-a226-0e5a97b60e6c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:12.114287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d6b37b6-aa45-4162-a226-0e5a97b60e6c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:12.114722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d6b37b6-aa45-4162-a226-0e5a97b60e6c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:12.115479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d6b37b6-aa45-4162-a226-0e5a97b60e6c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:12.116037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d6b37b6-aa45-4162-a226-0e5a97b60e6c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:12.116422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d6b37b6-aa45-4162-a226-0e5a97b60e6c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:12.300872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0d6b37b6-aa45-4162-a226-0e5a97b60e6c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:12.309528 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0d6b37b6-aa45-4162-a226-0e5a97b60e6c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 200 len: 1501 microversion: 2.1 time: 0.209089 Oct 12 22:13:12.323960 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1537/3455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:12 2022] GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 1501 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:12.336620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bcd78838-41f3-4677-b214-e696019e8eb5 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:12.337688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bcd78838-41f3-4677-b214-e696019e8eb5 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] [instance: 834fccfb-555f-4b47-9c94-eff3997d3dd2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:12.345304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcd78838-41f3-4677-b214-e696019e8eb5 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:12.346270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcd78838-41f3-4677-b214-e696019e8eb5 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:12.347785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcd78838-41f3-4677-b214-e696019e8eb5 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:12.348881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcd78838-41f3-4677-b214-e696019e8eb5 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:12.349665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcd78838-41f3-4677-b214-e696019e8eb5 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:12.350307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcd78838-41f3-4677-b214-e696019e8eb5 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:12.373173 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-bcd78838-41f3-4677-b214-e696019e8eb5 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] HTTP exception thrown: Instance 834fccfb-555f-4b47-9c94-eff3997d3dd2 could not be found. Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bcd78838-41f3-4677-b214-e696019e8eb5 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Request method failure captured: Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 HTTP/1.1 Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzu09m4YMwyAW5XmhOEfb-EgkfB9KSU4r5FkixV7M0UuuPgFW2vI4R72JNrd-Kem9C8wReSqFIUGo5s7iUjQ4HMfT66uooX5zG09UfafAz6N8lvC0atzIXSX_eSCNJOFTK8rOQ6KIRatSIQpy_9JO--t4Nf9UB_m_unRQ7w9_PrKrsQ Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 85487b1a0fc14efd8b218080c3d23ce3 Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-902763970 Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85487b1a0fc14efd8b218080c3d23ce3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85487b1a0fc14efd8b218080c3d23ce3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_85487b1a0fc14efd8b218080c3d23ce3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/85487b1a0fc14efd8b218080c3d23ce3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-902763970 Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 85487b1a0fc14efd8b218080c3d23ce3 Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-902763970 Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: bb00c4c021344aa296bead35a76dd606 Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 834fccfb-555f-4b47-9c94-eff3997d3dd2 could not be found. Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '834fccfb-555f-4b47-9c94-eff3997d3dd2'} Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 834fccfb-555f-4b47-9c94-eff3997d3dd2 could not be found. Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 834fccfb-555f-4b47-9c94-eff3997d3dd2 could not be found. Oct 12 22:13:12.376751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:13:12.380579 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:12.380579 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:13:12.380579 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:12.380579 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:12.380579 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:12.380579 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:13:12.380579 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:13:12.380579 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 834fccfb-555f-4b47-9c94-eff3997d3dd2 could not be found. Oct 12 22:13:12.380579 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:13:12.383714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bcd78838-41f3-4677-b214-e696019e8eb5 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] Returning 404 to user: Instance 834fccfb-555f-4b47-9c94-eff3997d3dd2 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:13:12.385882 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bcd78838-41f3-4677-b214-e696019e8eb5 tempest-FloatingIPsAssociationNegativeTestJSON-902763970 tempest-FloatingIPsAssociationNegativeTestJSON-902763970-project] 10.222.0.16 "GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2" status: 404 len: 111 microversion: 2.1 time: 0.060474 Oct 12 22:13:12.388970 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1538/3456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:12 2022] GET /compute/v2.1/servers/834fccfb-555f-4b47-9c94-eff3997d3dd2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:13:12.400879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-29c1d6ca-d515-4e4e-85ef-08b3c51d04ee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:12.402154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-29c1d6ca-d515-4e4e-85ef-08b3c51d04ee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:12.410267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29c1d6ca-d515-4e4e-85ef-08b3c51d04ee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:12.411071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29c1d6ca-d515-4e4e-85ef-08b3c51d04ee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:12.417006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29c1d6ca-d515-4e4e-85ef-08b3c51d04ee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:12.418635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29c1d6ca-d515-4e4e-85ef-08b3c51d04ee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:12.419284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29c1d6ca-d515-4e4e-85ef-08b3c51d04ee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:12.419836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29c1d6ca-d515-4e4e-85ef-08b3c51d04ee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:12.516864 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-29c1d6ca-d515-4e4e-85ef-08b3c51d04ee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "POST /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61/action" status: 202 len: 0 microversion: 2.1 time: 0.126165 Oct 12 22:13:12.521311 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1539/3457] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:13:12 2022] POST /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:13:12.535958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9dae47df-4652-45d6-a6d3-786fb85ad6f8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:12.537764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9dae47df-4652-45d6-a6d3-786fb85ad6f8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:12.548985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9dae47df-4652-45d6-a6d3-786fb85ad6f8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:12.550719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9dae47df-4652-45d6-a6d3-786fb85ad6f8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:12.551178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9dae47df-4652-45d6-a6d3-786fb85ad6f8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:12.552274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9dae47df-4652-45d6-a6d3-786fb85ad6f8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:12.552751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9dae47df-4652-45d6-a6d3-786fb85ad6f8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:12.553174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9dae47df-4652-45d6-a6d3-786fb85ad6f8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:12.732371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9dae47df-4652-45d6-a6d3-786fb85ad6f8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:12.744119 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9dae47df-4652-45d6-a6d3-786fb85ad6f8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 200 len: 1506 microversion: 2.1 time: 0.215502 Oct 12 22:13:12.747762 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1540/3458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:12 2022] GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:12.780114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-77d261c7-15f2-4d2c-9a37-4de2445f9e24 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:12.781534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-77d261c7-15f2-4d2c-9a37-4de2445f9e24 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:12.788906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77d261c7-15f2-4d2c-9a37-4de2445f9e24 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:12.789681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77d261c7-15f2-4d2c-9a37-4de2445f9e24 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:12.790270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77d261c7-15f2-4d2c-9a37-4de2445f9e24 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:12.791189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77d261c7-15f2-4d2c-9a37-4de2445f9e24 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:12.791836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77d261c7-15f2-4d2c-9a37-4de2445f9e24 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:12.792423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77d261c7-15f2-4d2c-9a37-4de2445f9e24 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:12.988576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-e9f07ed7-b540-4d2b-a863-734c43103bb7 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Updating instance_info_cache with network_info: [{"id": "388738e3-987d-4373-89b2-ec1c33e4c96c", "address": "fa:16:3e:dd:21:48", "network": {"id": "709423db-695b-4953-a10f-b3358d5669f7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-519345160-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b201054c71d241ee8b130a9b0a014cf6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap388738e3-98", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:13:13.000404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-77d261c7-15f2-4d2c-9a37-4de2445f9e24 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9463eb3ccf4028af1bfc61749c8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950d9a3e971644709e04007bf0d3a6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:13.009316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9f07ed7-b540-4d2b-a863-734c43103bb7 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Releasing lock "refresh_cache-f924aa3b-0c00-4577-bb06-3a169f972d3d" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:13:13.011328 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e9f07ed7-b540-4d2b-a863-734c43103bb7 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "POST /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d/action" status: 202 len: 0 microversion: 2.1 time: 6.441159 Oct 12 22:13:13.013544 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1919/3459] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:13:06 2022] POST /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d/action => generated 0 bytes in 6444 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:13:13.019499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-964ad4b8-87b4-492e-b0c3-b5811df7e778 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:13.020620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-964ad4b8-87b4-492e-b0c3-b5811df7e778 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] [instance: 3c884fd7-d12b-4faa-95e1-96646f21ef60] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:13.021039 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-77d261c7-15f2-4d2c-9a37-4de2445f9e24 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 200 len: 1350 microversion: 2.1 time: 0.264129 Oct 12 22:13:13.023621 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1541/3460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:12 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 1350 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:13.029251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964ad4b8-87b4-492e-b0c3-b5811df7e778 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:13.031704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964ad4b8-87b4-492e-b0c3-b5811df7e778 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:13.032452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964ad4b8-87b4-492e-b0c3-b5811df7e778 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:13.035979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964ad4b8-87b4-492e-b0c3-b5811df7e778 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:13.036803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964ad4b8-87b4-492e-b0c3-b5811df7e778 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:13.037463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964ad4b8-87b4-492e-b0c3-b5811df7e778 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:13.040239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-afdc1572-8b0d-4088-aa69-5d4901528c04 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '.version_select at 0x7f51287fcc10>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:13.065125 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-964ad4b8-87b4-492e-b0c3-b5811df7e778 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] HTTP exception thrown: Instance 3c884fd7-d12b-4faa-95e1-96646f21ef60 could not be found. Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-964ad4b8-87b4-492e-b0c3-b5811df7e778 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Request method failure captured: Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 HTTP/1.1 Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzr98Hx3HSZUwq13XuvkKDPq0Iz5m-bV7cM398dlrUOClDHZvKrry9jEBmFlbHSmTggU-8Kzhn-tq2F0pNUWaJ0dz4mTrYT4WEggz5nFy73h3CWXJWY0xrriAWPLgFsaD4ELYtj-jFuaZbDIGMPZ-s-9QASFcLZt-WruPxAE5oPSHB0 Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1da6fbca378a43c6b71b9b1b2fa1bc7c Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1da6fbca378a43c6b71b9b1b2fa1bc7c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1da6fbca378a43c6b71b9b1b2fa1bc7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1da6fbca378a43c6b71b9b1b2fa1bc7c Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2073144359 Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersOnMultiNodesTest-2073144359-project Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7a8e7139c1694698a5fde98743165501 Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersOnMultiNodesTest-2073144359-project Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 3c884fd7-d12b-4faa-95e1-96646f21ef60 could not be found. Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '3c884fd7-d12b-4faa-95e1-96646f21ef60'} Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c884fd7-d12b-4faa-95e1-96646f21ef60 could not be found. Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c884fd7-d12b-4faa-95e1-96646f21ef60 could not be found. Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:13.068328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:13.072946 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:13.072946 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:13.072946 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:13.072946 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:13:13.072946 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:13:13.072946 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c884fd7-d12b-4faa-95e1-96646f21ef60 could not be found. Oct 12 22:13:13.072946 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:13.074776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-964ad4b8-87b4-492e-b0c3-b5811df7e778 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] Returning 404 to user: Instance 3c884fd7-d12b-4faa-95e1-96646f21ef60 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:13:13.075841 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-964ad4b8-87b4-492e-b0c3-b5811df7e778 tempest-ServersOnMultiNodesTest-2073144359 tempest-ServersOnMultiNodesTest-2073144359-project] 10.222.0.16 "GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60" status: 404 len: 111 microversion: 2.1 time: 0.061038 Oct 12 22:13:13.076963 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1920/3461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:13 2022] GET /compute/v2.1/servers/3c884fd7-d12b-4faa-95e1-96646f21ef60 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:13:13.101590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8c3c50b5-8afc-4fc1-9477-ad179b320bf0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:13.102228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8c3c50b5-8afc-4fc1-9477-ad179b320bf0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:13.118177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c3c50b5-8afc-4fc1-9477-ad179b320bf0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:13.120544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c3c50b5-8afc-4fc1-9477-ad179b320bf0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:13.121193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c3c50b5-8afc-4fc1-9477-ad179b320bf0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:13.122100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c3c50b5-8afc-4fc1-9477-ad179b320bf0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:13.122714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c3c50b5-8afc-4fc1-9477-ad179b320bf0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:13.123361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c3c50b5-8afc-4fc1-9477-ad179b320bf0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:13.323683 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-afdc1572-8b0d-4088-aa69-5d4901528c04 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/319082b5-5f65-4c90-a4d9-fcd9335fae5b" status: 200 len: 185 microversion: 2.1 time: 0.298944 Oct 12 22:13:13.324345 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1542/3462] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 12 22:13:13 2022] GET /compute/v2.1/os-floating-ips/319082b5-5f65-4c90-a4d9-fcd9335fae5b => generated 185 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:13.338147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-79734172-eeaa-44e9-ac03-655855715c17 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.111"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:13.562346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-79734172-eeaa-44e9-ac03-655855715c17 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:13.577840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79734172-eeaa-44e9-ac03-655855715c17 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:13.580735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79734172-eeaa-44e9-ac03-655855715c17 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:13.583898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79734172-eeaa-44e9-ac03-655855715c17 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:13.585864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79734172-eeaa-44e9-ac03-655855715c17 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:13.587726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79734172-eeaa-44e9-ac03-655855715c17 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:13.588625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79734172-eeaa-44e9-ac03-655855715c17 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:13.640042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8c3c50b5-8afc-4fc1-9477-ad179b320bf0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:13.648402 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8c3c50b5-8afc-4fc1-9477-ad179b320bf0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1512 microversion: 2.1 time: 0.570221 Oct 12 22:13:13.664328 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1921/3463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:13 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1512 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:13.773276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-01662cd7-f370-4190-aa07-e92b6d613393 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:13.774613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-01662cd7-f370-4190-aa07-e92b6d613393 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:13.782613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01662cd7-f370-4190-aa07-e92b6d613393 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:13.783738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01662cd7-f370-4190-aa07-e92b6d613393 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:13.784514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01662cd7-f370-4190-aa07-e92b6d613393 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:13.785339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01662cd7-f370-4190-aa07-e92b6d613393 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:13.785914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01662cd7-f370-4190-aa07-e92b6d613393 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:13.786417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-01662cd7-f370-4190-aa07-e92b6d613393 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:13.948077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79734172-eeaa-44e9-ac03-655855715c17 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "refresh_cache-f924aa3b-0c00-4577-bb06-3a169f972d3d" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:13:13.948613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79734172-eeaa-44e9-ac03-655855715c17 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquired lock "refresh_cache-f924aa3b-0c00-4577-bb06-3a169f972d3d" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:13:14.498955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-01662cd7-f370-4190-aa07-e92b6d613393 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:14.512006 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-01662cd7-f370-4190-aa07-e92b6d613393 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 200 len: 1486 microversion: 2.1 time: 0.745845 Oct 12 22:13:14.513221 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1922/3464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:13 2022] GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 1486 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:13:14.528858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4988f4c4-7a5f-4220-bdd6-dde559219d1b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:14.530001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4988f4c4-7a5f-4220-bdd6-dde559219d1b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:14.538949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4988f4c4-7a5f-4220-bdd6-dde559219d1b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:14.539860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4988f4c4-7a5f-4220-bdd6-dde559219d1b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:14.540516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4988f4c4-7a5f-4220-bdd6-dde559219d1b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:14.545583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4988f4c4-7a5f-4220-bdd6-dde559219d1b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:14.546551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4988f4c4-7a5f-4220-bdd6-dde559219d1b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:14.547219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4988f4c4-7a5f-4220-bdd6-dde559219d1b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:14.879038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-79734172-eeaa-44e9-ac03-655855715c17 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Building network info cache for instance {{(pid=120452) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:13:15.226010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4988f4c4-7a5f-4220-bdd6-dde559219d1b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9463eb3ccf4028af1bfc61749c8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950d9a3e971644709e04007bf0d3a6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:15.239184 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4988f4c4-7a5f-4220-bdd6-dde559219d1b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 200 len: 1350 microversion: 2.1 time: 0.724651 Oct 12 22:13:15.241529 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1923/3465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:14 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 1350 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:15.246923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-ab95e6ac-0be8-4c11-b70a-7107d0fb8508 req-9aa7a307-6831-4e16-bbba-e169ed2501ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835", "name": "network-vif-deleted", "tag": "76764896-d8b2-4553-97a9-4df1772081c6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:15.277957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ab95e6ac-0be8-4c11-b70a-7107d0fb8508 req-9aa7a307-6831-4e16-bbba-e169ed2501ea service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:15.285594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ab95e6ac-0be8-4c11-b70a-7107d0fb8508 req-9aa7a307-6831-4e16-bbba-e169ed2501ea service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:15.286272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ab95e6ac-0be8-4c11-b70a-7107d0fb8508 req-9aa7a307-6831-4e16-bbba-e169ed2501ea service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:15.308159 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-ab95e6ac-0be8-4c11-b70a-7107d0fb8508 req-9aa7a307-6831-4e16-bbba-e169ed2501ea service nova] Creating event network-vif-deleted:76764896-d8b2-4553-97a9-4df1772081c6 for instance c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 on n-h1-861111-1 Oct 12 22:13:15.322168 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-ab95e6ac-0be8-4c11-b70a-7107d0fb8508 req-9aa7a307-6831-4e16-bbba-e169ed2501ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078605 Oct 12 22:13:15.327269 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1924/3466] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:15.333243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-5bc7ff9a-5443-4b63-bc54-1122eb0ec653 req-e849163a-3539-4cd6-801f-d0ab52fbfec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834fccfb-555f-4b47-9c94-eff3997d3dd2", "name": "network-vif-deleted", "tag": "52d827f6-3263-45e3-be6b-9e5d6a230519"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:15.359476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5bc7ff9a-5443-4b63-bc54-1122eb0ec653 req-e849163a-3539-4cd6-801f-d0ab52fbfec6 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:15.362490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5bc7ff9a-5443-4b63-bc54-1122eb0ec653 req-e849163a-3539-4cd6-801f-d0ab52fbfec6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:15.363118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5bc7ff9a-5443-4b63-bc54-1122eb0ec653 req-e849163a-3539-4cd6-801f-d0ab52fbfec6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:15.386936 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-5bc7ff9a-5443-4b63-bc54-1122eb0ec653 req-e849163a-3539-4cd6-801f-d0ab52fbfec6 service nova] Creating event network-vif-deleted:52d827f6-3263-45e3-be6b-9e5d6a230519 for instance 834fccfb-555f-4b47-9c94-eff3997d3dd2 on n-h2-861111-1 Oct 12 22:13:15.397296 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-5bc7ff9a-5443-4b63-bc54-1122eb0ec653 req-e849163a-3539-4cd6-801f-d0ab52fbfec6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068412 Oct 12 22:13:15.398492 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1925/3467] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:15.416225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-58054f59-a542-4cd2-b208-efe3f6c64d27 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:15.417028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-58054f59-a542-4cd2-b208-efe3f6c64d27 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:15.420287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:15.425587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58054f59-a542-4cd2-b208-efe3f6c64d27 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:15.434754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58054f59-a542-4cd2-b208-efe3f6c64d27 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:15.435442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58054f59-a542-4cd2-b208-efe3f6c64d27 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:15.436390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58054f59-a542-4cd2-b208-efe3f6c64d27 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:15.437035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58054f59-a542-4cd2-b208-efe3f6c64d27 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:15.437656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58054f59-a542-4cd2-b208-efe3f6c64d27 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:15.513982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-58054f59-a542-4cd2-b208-efe3f6c64d27 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:13:15.588251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-79734172-eeaa-44e9-ac03-655855715c17 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Updating instance_info_cache with network_info: [{"id": "388738e3-987d-4373-89b2-ec1c33e4c96c", "address": "fa:16:3e:dd:21:48", "network": {"id": "709423db-695b-4953-a10f-b3358d5669f7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-519345160-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b201054c71d241ee8b130a9b0a014cf6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap388738e3-98", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120452) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:13:15.607969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79734172-eeaa-44e9-ac03-655855715c17 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Releasing lock "refresh_cache-f924aa3b-0c00-4577-bb06-3a169f972d3d" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:13:15.609622 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-79734172-eeaa-44e9-ac03-655855715c17 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "POST /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d/action" status: 202 len: 0 microversion: 2.1 time: 2.275985 Oct 12 22:13:15.610273 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1543/3468] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:13:13 2022] POST /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d/action => generated 0 bytes in 2277 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:13:15.617611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:15.636205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a8f37231-56fb-4909-96ff-87309d6f4848 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:15.638543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a8f37231-56fb-4909-96ff-87309d6f4848 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:15.654655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f37231-56fb-4909-96ff-87309d6f4848 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:15.656336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f37231-56fb-4909-96ff-87309d6f4848 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:15.657325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f37231-56fb-4909-96ff-87309d6f4848 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:15.658451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f37231-56fb-4909-96ff-87309d6f4848 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:15.661216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f37231-56fb-4909-96ff-87309d6f4848 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:15.663300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f37231-56fb-4909-96ff-87309d6f4848 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:15.732761 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-58054f59-a542-4cd2-b208-efe3f6c64d27 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "DELETE /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 204 len: 0 microversion: 2.1 time: 0.332446 Oct 12 22:13:15.734078 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1926/3469] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:13:15 2022] DELETE /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:13:15.741583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87a6f9e7-5414-4109-b4f7-20695786e544 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:15.742456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-87a6f9e7-5414-4109-b4f7-20695786e544 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:15.749056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87a6f9e7-5414-4109-b4f7-20695786e544 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:15.749936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87a6f9e7-5414-4109-b4f7-20695786e544 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:15.750595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87a6f9e7-5414-4109-b4f7-20695786e544 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:15.751563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87a6f9e7-5414-4109-b4f7-20695786e544 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:15.752235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87a6f9e7-5414-4109-b4f7-20695786e544 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:15.752928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87a6f9e7-5414-4109-b4f7-20695786e544 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:15.782857 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-87a6f9e7-5414-4109-b4f7-20695786e544 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] HTTP exception thrown: Instance c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 could not be found. Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87a6f9e7-5414-4109-b4f7-20695786e544 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Request method failure captured: Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 HTTP/1.1 Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzul-k5ArXCQUv4eknvtIsPJ9IZVfOm8YPa3SwCUsqFWCRAV14uEUMtsOkYjvC0q-7NXLDiqEC3pOHv9uVvDx5vcXDVthjw5VCF_6P_hAWpa4FEHeIeCEzgEA-O4pl_OKILQCsTf8R5NQXZN-jc9ZBqBSC6DyQjKRIbsfaCaANtTg2g Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: b201054c71d241ee8b130a9b0a014cf6 Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-845994595 Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b201054c71d241ee8b130a9b0a014cf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b201054c71d241ee8b130a9b0a014cf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b201054c71d241ee8b130a9b0a014cf6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b201054c71d241ee8b130a9b0a014cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-845994595 Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: b201054c71d241ee8b130a9b0a014cf6 Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-845994595 Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FloatingIPsAssociationTestJSON-845994595-project Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 94f72337548c4724bf3f4c1009221120 Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-845994595-project Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 could not be found. Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835'} Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 could not be found. Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:13:15.785481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:13:15.790948 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 could not be found. Oct 12 22:13:15.790948 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:15.790948 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:15.790948 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:15.790948 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:15.790948 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:15.790948 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:15.790948 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:13:15.790948 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:13:15.790948 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 could not be found. Oct 12 22:13:15.790948 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:15.790948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87a6f9e7-5414-4109-b4f7-20695786e544 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Returning 404 to user: Instance c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:13:15.792423 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-87a6f9e7-5414-4109-b4f7-20695786e544 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" status: 404 len: 111 microversion: 2.1 time: 0.054958 Oct 12 22:13:15.793291 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1927/3470] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:13:15 2022] DELETE /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:13:15.802527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-97c05486-b528-4a6a-b9bd-a71e31ba3afa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:15.803319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-97c05486-b528-4a6a-b9bd-a71e31ba3afa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:15.813976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c05486-b528-4a6a-b9bd-a71e31ba3afa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:15.814701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c05486-b528-4a6a-b9bd-a71e31ba3afa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:15.816517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c05486-b528-4a6a-b9bd-a71e31ba3afa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:15.817840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c05486-b528-4a6a-b9bd-a71e31ba3afa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:15.818642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c05486-b528-4a6a-b9bd-a71e31ba3afa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:15.819180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c05486-b528-4a6a-b9bd-a71e31ba3afa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:15.997426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a8f37231-56fb-4909-96ff-87309d6f4848 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:16.008676 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a8f37231-56fb-4909-96ff-87309d6f4848 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1512 microversion: 2.1 time: 0.394807 Oct 12 22:13:16.027459 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1544/3471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:15 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1512 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:16.033049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af5fb724-d527-45ba-a470-0a066f0e0a93 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:16.033938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-af5fb724-d527-45ba-a470-0a066f0e0a93 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:16.041089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af5fb724-d527-45ba-a470-0a066f0e0a93 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:16.041800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af5fb724-d527-45ba-a470-0a066f0e0a93 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:16.042434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af5fb724-d527-45ba-a470-0a066f0e0a93 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:16.043346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af5fb724-d527-45ba-a470-0a066f0e0a93 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:16.043965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af5fb724-d527-45ba-a470-0a066f0e0a93 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:16.044956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af5fb724-d527-45ba-a470-0a066f0e0a93 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:16.061236 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-af5fb724-d527-45ba-a470-0a066f0e0a93 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] HTTP exception thrown: Instance c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 could not be found. Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af5fb724-d527-45ba-a470-0a066f0e0a93 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Request method failure captured: Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 HTTP/1.1 Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzul-k5ArXCQUv4eknvtIsPJ9IZVfOm8YPa3SwCUsqFWCRAV14uEUMtsOkYjvC0q-7NXLDiqEC3pOHv9uVvDx5vcXDVthjw5VCF_6P_hAWpa4FEHeIeCEzgEA-O4pl_OKILQCsTf8R5NQXZN-jc9ZBqBSC6DyQjKRIbsfaCaANtTg2g Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: b201054c71d241ee8b130a9b0a014cf6 Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-845994595 Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b201054c71d241ee8b130a9b0a014cf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b201054c71d241ee8b130a9b0a014cf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b201054c71d241ee8b130a9b0a014cf6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b201054c71d241ee8b130a9b0a014cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-845994595 Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: b201054c71d241ee8b130a9b0a014cf6 Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-845994595 Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-FloatingIPsAssociationTestJSON-845994595-project Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 94f72337548c4724bf3f4c1009221120 Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-845994595-project Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 could not be found. Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835'} Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 could not be found. Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 could not be found. Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:13:16.063464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:16.067311 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:13:16.067311 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:16.067311 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:16.067311 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:16.067311 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:13:16.067311 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:13:16.067311 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 could not be found. Oct 12 22:13:16.067311 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:13:16.069842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af5fb724-d527-45ba-a470-0a066f0e0a93 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Returning 404 to user: Instance c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:13:16.071085 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-af5fb724-d527-45ba-a470-0a066f0e0a93 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835" status: 404 len: 111 microversion: 2.1 time: 0.042052 Oct 12 22:13:16.072084 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1545/3472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:16 2022] GET /compute/v2.1/servers/c2f0e2f9-8f1e-4cd9-9aff-38bea1ae9835 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:13:16.080030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-978dc6dc-9d40-48b9-82f0-32d7d953ae7b tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '.version_select at 0x7f51236f20d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:16.458886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:16.496542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=30 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:16.558554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-97c05486-b528-4a6a-b9bd-a71e31ba3afa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:16.568216 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-97c05486-b528-4a6a-b9bd-a71e31ba3afa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 200 len: 1492 microversion: 2.1 time: 0.773682 Oct 12 22:13:16.572742 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1928/3473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:15 2022] GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 1492 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:16.588638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e8bc7844-40d5-4e47-85bb-d2e5788c1be4 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:16.589916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e8bc7844-40d5-4e47-85bb-d2e5788c1be4 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:16.604220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8bc7844-40d5-4e47-85bb-d2e5788c1be4 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:16.604932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8bc7844-40d5-4e47-85bb-d2e5788c1be4 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:16.605719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8bc7844-40d5-4e47-85bb-d2e5788c1be4 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:16.606584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8bc7844-40d5-4e47-85bb-d2e5788c1be4 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:16.607195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8bc7844-40d5-4e47-85bb-d2e5788c1be4 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:16.608017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8bc7844-40d5-4e47-85bb-d2e5788c1be4 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:18.280719 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-978dc6dc-9d40-48b9-82f0-32d7d953ae7b tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/319082b5-5f65-4c90-a4d9-fcd9335fae5b" status: 202 len: 0 microversion: 2.1 time: 2.204392 Oct 12 22:13:18.285046 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1546/3474] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:13:16 2022] DELETE /compute/v2.1/os-floating-ips/319082b5-5f65-4c90-a4d9-fcd9335fae5b => generated 0 bytes in 2209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:13:18.290491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0c01c212-bde5-4589-ac17-1112d0d1df52 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:18.291119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0c01c212-bde5-4589-ac17-1112d0d1df52 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:18.302407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c01c212-bde5-4589-ac17-1112d0d1df52 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:18.302911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c01c212-bde5-4589-ac17-1112d0d1df52 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:18.303385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c01c212-bde5-4589-ac17-1112d0d1df52 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:18.304285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c01c212-bde5-4589-ac17-1112d0d1df52 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:18.304899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c01c212-bde5-4589-ac17-1112d0d1df52 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:18.305482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c01c212-bde5-4589-ac17-1112d0d1df52 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:18.604274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0c01c212-bde5-4589-ac17-1112d0d1df52 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:18.629032 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0c01c212-bde5-4589-ac17-1112d0d1df52 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1512 microversion: 2.1 time: 0.342803 Oct 12 22:13:18.633402 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1547/3475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:18 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1512 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:18.644064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-5c961da6-6b03-454e-ad65-3b31f79e3c5f req-eea6dc10-682a-428e-b428-7576e7c49950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060fc715-5b23-43ea-a528-6013a979ac3e", "tag": "d96fed9a-b440-4554-9add-7c497a701d8f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:18.682532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5c961da6-6b03-454e-ad65-3b31f79e3c5f req-eea6dc10-682a-428e-b428-7576e7c49950 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:18.683926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5c961da6-6b03-454e-ad65-3b31f79e3c5f req-eea6dc10-682a-428e-b428-7576e7c49950 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:18.685142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5c961da6-6b03-454e-ad65-3b31f79e3c5f req-eea6dc10-682a-428e-b428-7576e7c49950 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:18.713272 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-5c961da6-6b03-454e-ad65-3b31f79e3c5f req-eea6dc10-682a-428e-b428-7576e7c49950 service nova] Creating event network-changed:d96fed9a-b440-4554-9add-7c497a701d8f for instance 060fc715-5b23-43ea-a528-6013a979ac3e on n-h1-861111-1 Oct 12 22:13:18.727790 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-5c961da6-6b03-454e-ad65-3b31f79e3c5f req-eea6dc10-682a-428e-b428-7576e7c49950 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091090 Oct 12 22:13:18.733024 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1548/3476] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:18.743644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-f784ce37-fb5b-4a79-9fb0-854d2365c53b req-bb68dece-2ac4-42a5-aa75-85ec4fbf66ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f924aa3b-0c00-4577-bb06-3a169f972d3d", "tag": "388738e3-987d-4373-89b2-ec1c33e4c96c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:18.774518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e8bc7844-40d5-4e47-85bb-d2e5788c1be4 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9463eb3ccf4028af1bfc61749c8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950d9a3e971644709e04007bf0d3a6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:18.784632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f784ce37-fb5b-4a79-9fb0-854d2365c53b req-bb68dece-2ac4-42a5-aa75-85ec4fbf66ea service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:18.784775 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e8bc7844-40d5-4e47-85bb-d2e5788c1be4 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 200 len: 1350 microversion: 2.1 time: 2.210657 Oct 12 22:13:18.785113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f784ce37-fb5b-4a79-9fb0-854d2365c53b req-bb68dece-2ac4-42a5-aa75-85ec4fbf66ea service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:18.785546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f784ce37-fb5b-4a79-9fb0-854d2365c53b req-bb68dece-2ac4-42a5-aa75-85ec4fbf66ea service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:18.798043 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1929/3477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:16 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 1350 bytes in 2224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:18.808511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3738bf5b-9f14-46b7-816c-743e29167b26 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:18.809411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3738bf5b-9f14-46b7-816c-743e29167b26 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:18.818077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3738bf5b-9f14-46b7-816c-743e29167b26 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:18.819460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3738bf5b-9f14-46b7-816c-743e29167b26 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:18.821874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3738bf5b-9f14-46b7-816c-743e29167b26 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:18.822848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3738bf5b-9f14-46b7-816c-743e29167b26 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:18.824606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3738bf5b-9f14-46b7-816c-743e29167b26 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:18.825998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3738bf5b-9f14-46b7-816c-743e29167b26 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:18.832498 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-f784ce37-fb5b-4a79-9fb0-854d2365c53b req-bb68dece-2ac4-42a5-aa75-85ec4fbf66ea service nova] Creating event network-changed:388738e3-987d-4373-89b2-ec1c33e4c96c for instance f924aa3b-0c00-4577-bb06-3a169f972d3d on n-h1-861111-1 Oct 12 22:13:18.850893 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-f784ce37-fb5b-4a79-9fb0-854d2365c53b req-bb68dece-2ac4-42a5-aa75-85ec4fbf66ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106193 Oct 12 22:13:18.857051 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1549/3478] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:18.862522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dfe010fc-12ea-4f2a-9224-1a1fb0080ee4 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:18.863109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dfe010fc-12ea-4f2a-9224-1a1fb0080ee4 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:18.887536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe010fc-12ea-4f2a-9224-1a1fb0080ee4 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:18.888033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe010fc-12ea-4f2a-9224-1a1fb0080ee4 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:18.894469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe010fc-12ea-4f2a-9224-1a1fb0080ee4 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:18.895321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe010fc-12ea-4f2a-9224-1a1fb0080ee4 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:18.895817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe010fc-12ea-4f2a-9224-1a1fb0080ee4 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:18.896242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe010fc-12ea-4f2a-9224-1a1fb0080ee4 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:18.935163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dfe010fc-12ea-4f2a-9224-1a1fb0080ee4 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:13:19.096091 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dfe010fc-12ea-4f2a-9224-1a1fb0080ee4 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 204 len: 0 microversion: 2.1 time: 0.237556 Oct 12 22:13:19.097955 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1550/3479] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:13:18 2022] DELETE /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:13:19.289145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3738bf5b-9f14-46b7-816c-743e29167b26 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:19.293685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2578697a-a973-4f7a-bdf0-b6b1ad329b67 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:19.303640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2578697a-a973-4f7a-bdf0-b6b1ad329b67 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:19.308201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2578697a-a973-4f7a-bdf0-b6b1ad329b67 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:19.308826 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3738bf5b-9f14-46b7-816c-743e29167b26 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 200 len: 1492 microversion: 2.1 time: 0.508238 Oct 12 22:13:19.310388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2578697a-a973-4f7a-bdf0-b6b1ad329b67 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:19.326123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2578697a-a973-4f7a-bdf0-b6b1ad329b67 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:19.326355 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1930/3480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:18 2022] GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 1492 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:19.333108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2578697a-a973-4f7a-bdf0-b6b1ad329b67 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:19.335928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2578697a-a973-4f7a-bdf0-b6b1ad329b67 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:19.346030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a6e6a3d5-c383-480d-8c63-0d59cb9397ef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:19.349951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a6e6a3d5-c383-480d-8c63-0d59cb9397ef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:19.361330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:19.367296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6e6a3d5-c383-480d-8c63-0d59cb9397ef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:19.368394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6e6a3d5-c383-480d-8c63-0d59cb9397ef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:19.369265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6e6a3d5-c383-480d-8c63-0d59cb9397ef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:19.373486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6e6a3d5-c383-480d-8c63-0d59cb9397ef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:19.376055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6e6a3d5-c383-480d-8c63-0d59cb9397ef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:19.376753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6e6a3d5-c383-480d-8c63-0d59cb9397ef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:19.429924 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2578697a-a973-4f7a-bdf0-b6b1ad329b67 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.330092 Oct 12 22:13:19.431435 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1551/3481] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:13:19 2022] GET /compute/v2.1/os-services => generated 944 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:19.457409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-72090d30-8029-4920-9d2e-3730a6accfc1 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:19.463495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72090d30-8029-4920-9d2e-3730a6accfc1 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:19.467486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72090d30-8029-4920-9d2e-3730a6accfc1 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:19.470448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72090d30-8029-4920-9d2e-3730a6accfc1 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:19.471635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72090d30-8029-4920-9d2e-3730a6accfc1 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:19.472378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72090d30-8029-4920-9d2e-3730a6accfc1 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:19.479989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72090d30-8029-4920-9d2e-3730a6accfc1 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:19.534349 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-72090d30-8029-4920-9d2e-3730a6accfc1 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-861111-1" status: 200 len: 578 microversion: 2.1 time: 0.092877 Oct 12 22:13:19.535378 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1552/3482] 10.222.0.16 () {58 vars in 1172 bytes} [Wed Oct 12 22:13:19 2022] GET /compute/v2.1/os-services?host=n-d-861111-1 => generated 578 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:19.551750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0e62407c-7fe3-496f-ab60-a67f0e5eff05 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:19.556727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e62407c-7fe3-496f-ab60-a67f0e5eff05 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:19.557344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e62407c-7fe3-496f-ab60-a67f0e5eff05 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:19.558230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e62407c-7fe3-496f-ab60-a67f0e5eff05 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:19.558972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e62407c-7fe3-496f-ab60-a67f0e5eff05 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:19.559575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e62407c-7fe3-496f-ab60-a67f0e5eff05 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:19.559894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e62407c-7fe3-496f-ab60-a67f0e5eff05 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:19.588441 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0e62407c-7fe3-496f-ab60-a67f0e5eff05 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043817 Oct 12 22:13:19.590339 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1553/3483] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 12 22:13:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:19.604034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fee2ed6c-5bd0-4b54-98ac-b7e7ee016eb0 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:19.607996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fee2ed6c-5bd0-4b54-98ac-b7e7ee016eb0 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:19.608764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fee2ed6c-5bd0-4b54-98ac-b7e7ee016eb0 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:19.609705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fee2ed6c-5bd0-4b54-98ac-b7e7ee016eb0 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:19.610789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fee2ed6c-5bd0-4b54-98ac-b7e7ee016eb0 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:19.611640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fee2ed6c-5bd0-4b54-98ac-b7e7ee016eb0 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:19.612814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fee2ed6c-5bd0-4b54-98ac-b7e7ee016eb0 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:19.642255 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fee2ed6c-5bd0-4b54-98ac-b7e7ee016eb0 tempest-ServicesAdminTestJSON-1099988023 tempest-ServicesAdminTestJSON-1099988023-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.043080 Oct 12 22:13:19.644121 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1554/3484] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:13:19 2022] GET /compute/v2.1/os-services => generated 944 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:13:19.668095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-11dd087c-77b5-4bbf-b533-7f1577d3112b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:19.669069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-11dd087c-77b5-4bbf-b533-7f1577d3112b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:19.686982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11dd087c-77b5-4bbf-b533-7f1577d3112b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:19.687499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11dd087c-77b5-4bbf-b533-7f1577d3112b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:19.687949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11dd087c-77b5-4bbf-b533-7f1577d3112b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:19.688656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11dd087c-77b5-4bbf-b533-7f1577d3112b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:19.689105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11dd087c-77b5-4bbf-b533-7f1577d3112b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:19.689533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11dd087c-77b5-4bbf-b533-7f1577d3112b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:19.811819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a6e6a3d5-c383-480d-8c63-0d59cb9397ef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:19.823043 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a6e6a3d5-c383-480d-8c63-0d59cb9397ef tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 200 len: 1524 microversion: 2.1 time: 0.489569 Oct 12 22:13:19.831805 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1931/3485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:19 2022] GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 1524 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:19.855372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b5a137f2-8dd2-408f-a353-454e53470e7a tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:19.856256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b5a137f2-8dd2-408f-a353-454e53470e7a tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:19.873437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5a137f2-8dd2-408f-a353-454e53470e7a tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:19.874088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5a137f2-8dd2-408f-a353-454e53470e7a tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:19.874633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5a137f2-8dd2-408f-a353-454e53470e7a tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:19.875468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5a137f2-8dd2-408f-a353-454e53470e7a tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:19.876172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5a137f2-8dd2-408f-a353-454e53470e7a tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:19.876668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5a137f2-8dd2-408f-a353-454e53470e7a tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:20.175302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-11dd087c-77b5-4bbf-b533-7f1577d3112b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:20.189688 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-11dd087c-77b5-4bbf-b533-7f1577d3112b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1512 microversion: 2.1 time: 0.538229 Oct 12 22:13:20.204558 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1555/3486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:19 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1512 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:20.207216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b5a137f2-8dd2-408f-a353-454e53470e7a tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9463eb3ccf4028af1bfc61749c8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950d9a3e971644709e04007bf0d3a6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:20.215597 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b5a137f2-8dd2-408f-a353-454e53470e7a tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 200 len: 1350 microversion: 2.1 time: 0.366984 Oct 12 22:13:20.216520 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1932/3487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:19 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 1350 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:20.338585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-47cbca8c-5933-48a9-9109-3cf3a6999eed tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:20.339212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-47cbca8c-5933-48a9-9109-3cf3a6999eed tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:20.348727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47cbca8c-5933-48a9-9109-3cf3a6999eed tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:20.351965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47cbca8c-5933-48a9-9109-3cf3a6999eed tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:20.352547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47cbca8c-5933-48a9-9109-3cf3a6999eed tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:20.353373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47cbca8c-5933-48a9-9109-3cf3a6999eed tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:20.354028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47cbca8c-5933-48a9-9109-3cf3a6999eed tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:20.355633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47cbca8c-5933-48a9-9109-3cf3a6999eed tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:20.461641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47cbca8c-5933-48a9-9109-3cf3a6999eed tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:20.462154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47cbca8c-5933-48a9-9109-3cf3a6999eed tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:20.462786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47cbca8c-5933-48a9-9109-3cf3a6999eed tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:20.463527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-47cbca8c-5933-48a9-9109-3cf3a6999eed tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lazy-loading 'fault' on Instance uuid 295cbe61-8ee8-4a38-b2e8-4045383c2f61 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:13:20.578578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-47cbca8c-5933-48a9-9109-3cf3a6999eed tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:20.612789 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-47cbca8c-5933-48a9-9109-3cf3a6999eed tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 200 len: 1304 microversion: 2.1 time: 0.278448 Oct 12 22:13:20.614579 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1556/3488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:20 2022] GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 1304 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:20.861545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-58779802-6811-4af6-8432-7aa9ccbe0651 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:20.863074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-58779802-6811-4af6-8432-7aa9ccbe0651 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:20.878149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58779802-6811-4af6-8432-7aa9ccbe0651 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:20.879680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58779802-6811-4af6-8432-7aa9ccbe0651 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:20.880150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58779802-6811-4af6-8432-7aa9ccbe0651 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:20.881029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58779802-6811-4af6-8432-7aa9ccbe0651 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:20.881723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58779802-6811-4af6-8432-7aa9ccbe0651 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:20.882318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58779802-6811-4af6-8432-7aa9ccbe0651 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:20.909833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-60f4f48c-6b6a-4551-a401-7f641ecb6bd9 req-ee58bd7f-3d04-47de-be01-38e57e537ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "295cbe61-8ee8-4a38-b2e8-4045383c2f61", "name": "network-vif-deleted", "tag": "b9260bbe-318b-4479-b25c-f5be8d845d8c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:20.952466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-60f4f48c-6b6a-4551-a401-7f641ecb6bd9 req-ee58bd7f-3d04-47de-be01-38e57e537ccf service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:20.953236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-60f4f48c-6b6a-4551-a401-7f641ecb6bd9 req-ee58bd7f-3d04-47de-be01-38e57e537ccf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:20.953687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-60f4f48c-6b6a-4551-a401-7f641ecb6bd9 req-ee58bd7f-3d04-47de-be01-38e57e537ccf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:20.996662 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-60f4f48c-6b6a-4551-a401-7f641ecb6bd9 req-ee58bd7f-3d04-47de-be01-38e57e537ccf service nova] Creating event network-vif-deleted:b9260bbe-318b-4479-b25c-f5be8d845d8c for instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 on n-h1-861111-1 Oct 12 22:13:21.030046 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-60f4f48c-6b6a-4551-a401-7f641ecb6bd9 req-ee58bd7f-3d04-47de-be01-38e57e537ccf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128142 Oct 12 22:13:21.034779 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1557/3489] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:21.148504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-58779802-6811-4af6-8432-7aa9ccbe0651 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:21.161724 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-58779802-6811-4af6-8432-7aa9ccbe0651 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 200 len: 1524 microversion: 2.1 time: 0.307627 Oct 12 22:13:21.164892 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1933/3490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:20 2022] GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 1524 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:21.215774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0ac74df5-9e10-4682-92a1-0206fd9addba tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:21.216501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0ac74df5-9e10-4682-92a1-0206fd9addba tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:21.230146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ac74df5-9e10-4682-92a1-0206fd9addba tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:21.232141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ac74df5-9e10-4682-92a1-0206fd9addba tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:21.232824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ac74df5-9e10-4682-92a1-0206fd9addba tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:21.233624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ac74df5-9e10-4682-92a1-0206fd9addba tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:21.243076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-924a90d9-a322-4dfd-b7d7-6e6d6c14b544 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:21.244215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-924a90d9-a322-4dfd-b7d7-6e6d6c14b544 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:21.250304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ac74df5-9e10-4682-92a1-0206fd9addba tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:21.253523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ac74df5-9e10-4682-92a1-0206fd9addba tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:21.267358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-924a90d9-a322-4dfd-b7d7-6e6d6c14b544 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:21.271164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-924a90d9-a322-4dfd-b7d7-6e6d6c14b544 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:21.273241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-924a90d9-a322-4dfd-b7d7-6e6d6c14b544 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:21.277475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-924a90d9-a322-4dfd-b7d7-6e6d6c14b544 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:21.277710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-924a90d9-a322-4dfd-b7d7-6e6d6c14b544 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:21.283314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-924a90d9-a322-4dfd-b7d7-6e6d6c14b544 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:21.594054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-924a90d9-a322-4dfd-b7d7-6e6d6c14b544 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9463eb3ccf4028af1bfc61749c8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950d9a3e971644709e04007bf0d3a6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:21.608139 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-924a90d9-a322-4dfd-b7d7-6e6d6c14b544 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 200 len: 1350 microversion: 2.1 time: 0.370560 Oct 12 22:13:21.609396 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1934/3491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:21 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 1350 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:13:21.637931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d505a077-bcbf-42e9-9209-283053ec52cb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:21.639807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d505a077-bcbf-42e9-9209-283053ec52cb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:21.664761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d505a077-bcbf-42e9-9209-283053ec52cb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:21.665254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d505a077-bcbf-42e9-9209-283053ec52cb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:21.665688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d505a077-bcbf-42e9-9209-283053ec52cb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:21.666392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d505a077-bcbf-42e9-9209-283053ec52cb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:21.667004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d505a077-bcbf-42e9-9209-283053ec52cb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:21.667454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d505a077-bcbf-42e9-9209-283053ec52cb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:21.782641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d505a077-bcbf-42e9-9209-283053ec52cb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:21.783134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d505a077-bcbf-42e9-9209-283053ec52cb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:21.783595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d505a077-bcbf-42e9-9209-283053ec52cb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:21.784602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-d505a077-bcbf-42e9-9209-283053ec52cb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lazy-loading 'fault' on Instance uuid 295cbe61-8ee8-4a38-b2e8-4045383c2f61 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:13:21.916632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d505a077-bcbf-42e9-9209-283053ec52cb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:21.935123 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d505a077-bcbf-42e9-9209-283053ec52cb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 200 len: 1304 microversion: 2.1 time: 0.300286 Oct 12 22:13:21.939492 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1935/3492] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:21 2022] GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 1304 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:22.020127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0ac74df5-9e10-4682-92a1-0206fd9addba tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:22.034809 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0ac74df5-9e10-4682-92a1-0206fd9addba tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1512 microversion: 2.1 time: 0.824629 Oct 12 22:13:22.051702 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1558/3493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:21 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1512 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:22.183954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87631ed0-ba7e-43fd-a503-292add4affc5 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:22.184866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-87631ed0-ba7e-43fd-a503-292add4affc5 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:22.200462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87631ed0-ba7e-43fd-a503-292add4affc5 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:22.202335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87631ed0-ba7e-43fd-a503-292add4affc5 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:22.202335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87631ed0-ba7e-43fd-a503-292add4affc5 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:22.203036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87631ed0-ba7e-43fd-a503-292add4affc5 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:22.203526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87631ed0-ba7e-43fd-a503-292add4affc5 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:22.203954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87631ed0-ba7e-43fd-a503-292add4affc5 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:22.610520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-87631ed0-ba7e-43fd-a503-292add4affc5 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:22.624272 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-87631ed0-ba7e-43fd-a503-292add4affc5 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 200 len: 1524 microversion: 2.1 time: 0.444089 Oct 12 22:13:22.629789 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1936/3494] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:22 2022] GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 1524 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:22.654328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-26ee1f4d-859d-4818-9fe1-3a4daa7c208d tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:22.656082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-26ee1f4d-859d-4818-9fe1-3a4daa7c208d tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:22.670571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26ee1f4d-859d-4818-9fe1-3a4daa7c208d tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:22.671065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26ee1f4d-859d-4818-9fe1-3a4daa7c208d tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:22.675127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26ee1f4d-859d-4818-9fe1-3a4daa7c208d tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:22.679158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26ee1f4d-859d-4818-9fe1-3a4daa7c208d tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:22.680867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26ee1f4d-859d-4818-9fe1-3a4daa7c208d tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:22.681731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26ee1f4d-859d-4818-9fe1-3a4daa7c208d tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:22.978278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dc84a267-b4d8-4fe8-a2a9-a69202cb02d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:22.979084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dc84a267-b4d8-4fe8-a2a9-a69202cb02d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:23.009085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc84a267-b4d8-4fe8-a2a9-a69202cb02d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:23.011032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc84a267-b4d8-4fe8-a2a9-a69202cb02d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:23.012088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc84a267-b4d8-4fe8-a2a9-a69202cb02d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:23.014563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc84a267-b4d8-4fe8-a2a9-a69202cb02d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:23.015177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc84a267-b4d8-4fe8-a2a9-a69202cb02d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:23.015784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc84a267-b4d8-4fe8-a2a9-a69202cb02d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:23.045454 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-dc84a267-b4d8-4fe8-a2a9-a69202cb02d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dc84a267-b4d8-4fe8-a2a9-a69202cb02d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 HTTP/1.1 Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '295cbe61-8ee8-4a38-b2e8-4045383c2f61'} Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:23.047400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:23.051938 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:23.051938 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:23.051938 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:23.051938 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:13:23.051938 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:13:23.051938 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. Oct 12 22:13:23.051938 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:23.055188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dc84a267-b4d8-4fe8-a2a9-a69202cb02d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:13:23.057946 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dc84a267-b4d8-4fe8-a2a9-a69202cb02d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 404 len: 111 microversion: 2.1 time: 0.097162 Oct 12 22:13:23.073137 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1937/3495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:22 2022] GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:13:23.100150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cded2aae-be71-4f9e-af13-f1323a212d4a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:23.101882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cded2aae-be71-4f9e-af13-f1323a212d4a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:23.118710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cded2aae-be71-4f9e-af13-f1323a212d4a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:23.123007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cded2aae-be71-4f9e-af13-f1323a212d4a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:23.124486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cded2aae-be71-4f9e-af13-f1323a212d4a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:23.129062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cded2aae-be71-4f9e-af13-f1323a212d4a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:23.130643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cded2aae-be71-4f9e-af13-f1323a212d4a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:23.131197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cded2aae-be71-4f9e-af13-f1323a212d4a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:23.187106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-26ee1f4d-859d-4818-9fe1-3a4daa7c208d tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9463eb3ccf4028af1bfc61749c8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950d9a3e971644709e04007bf0d3a6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:23.201062 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-26ee1f4d-859d-4818-9fe1-3a4daa7c208d tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 200 len: 1350 microversion: 2.1 time: 0.568855 Oct 12 22:13:23.204467 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1559/3496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:22 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 1350 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:13:23.316835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-417927884", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "8a2bd9d3-e80d-4911-bb4a-296de8e90165"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:23.437149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] validate_networks() for [('8a2bd9d3-e80d-4911-bb4a-296de8e90165', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:13:23.639413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cded2aae-be71-4f9e-af13-f1323a212d4a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:23.660308 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cded2aae-be71-4f9e-af13-f1323a212d4a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1512 microversion: 2.1 time: 0.578692 Oct 12 22:13:23.677112 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1938/3497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:23 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1512 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:23.699479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d7de736d-2cd5-4260-b2a2-f570f94781f6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:23.705604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d7de736d-2cd5-4260-b2a2-f570f94781f6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:23.733946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7de736d-2cd5-4260-b2a2-f570f94781f6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:23.735526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7de736d-2cd5-4260-b2a2-f570f94781f6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:23.742150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7de736d-2cd5-4260-b2a2-f570f94781f6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:23.745919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7de736d-2cd5-4260-b2a2-f570f94781f6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:23.746725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7de736d-2cd5-4260-b2a2-f570f94781f6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:23.748467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7de736d-2cd5-4260-b2a2-f570f94781f6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:23.938125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d7de736d-2cd5-4260-b2a2-f570f94781f6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f72337548c4724bf3f4c1009221120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201054c71d241ee8b130a9b0a014cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:23.956426 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d7de736d-2cd5-4260-b2a2-f570f94781f6 tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 200 len: 1482 microversion: 2.1 time: 0.276900 Oct 12 22:13:23.965545 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1939/3498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:23 2022] GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 1482 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:23.973606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-5b695d62-27ec-4d78-8820-07cadcebb7d7 req-e5f76c05-ffa4-4615-a179-0b80db03a247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f924aa3b-0c00-4577-bb06-3a169f972d3d", "name": "network-vif-deleted", "tag": "388738e3-987d-4373-89b2-ec1c33e4c96c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:24.007529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5b695d62-27ec-4d78-8820-07cadcebb7d7 req-e5f76c05-ffa4-4615-a179-0b80db03a247 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:24.009529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5b695d62-27ec-4d78-8820-07cadcebb7d7 req-e5f76c05-ffa4-4615-a179-0b80db03a247 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:24.010004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5b695d62-27ec-4d78-8820-07cadcebb7d7 req-e5f76c05-ffa4-4615-a179-0b80db03a247 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:24.052185 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-5b695d62-27ec-4d78-8820-07cadcebb7d7 req-e5f76c05-ffa4-4615-a179-0b80db03a247 service nova] Creating event network-vif-deleted:388738e3-987d-4373-89b2-ec1c33e4c96c for instance f924aa3b-0c00-4577-bb06-3a169f972d3d on n-h1-861111-1 Oct 12 22:13:24.063493 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-5b695d62-27ec-4d78-8820-07cadcebb7d7 req-e5f76c05-ffa4-4615-a179-0b80db03a247 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092783 Oct 12 22:13:24.065785 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1940/3499] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:24.228923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4c411239-d370-4dde-9baa-10707380c0de tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:24.229637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4c411239-d370-4dde-9baa-10707380c0de tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:24.243978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c411239-d370-4dde-9baa-10707380c0de tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:24.244477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c411239-d370-4dde-9baa-10707380c0de tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:24.253699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c411239-d370-4dde-9baa-10707380c0de tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:24.257988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c411239-d370-4dde-9baa-10707380c0de tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:24.261988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c411239-d370-4dde-9baa-10707380c0de tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:24.262496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c411239-d370-4dde-9baa-10707380c0de tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:24.481489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:13:24.484543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:13:24.485201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:13:24.486349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:13:24.491286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:13:24.536881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:24.539583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:24.542001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:24.543661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:24.545895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:24.546710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:24.650843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Getting quotas for project 4b898b5d0208478e996b7fee2060ed64. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:13:24.665144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Getting quotas for user 11096cece79f4b8fad4b92270f51b299 and project 4b898b5d0208478e996b7fee2060ed64. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:13:24.706813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:13:24.711131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:13:24.837816 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-58a29429-579d-41a7-8fa5-53ce9bdd7e8e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.521477 Oct 12 22:13:24.839696 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1560/3500] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:13:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:13:24.851278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-535a4354-02d6-4cf6-a5f8-17bbfa074bc0 req-c9cb4719-019f-444c-9b0a-fab1414f8af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "060fc715-5b23-43ea-a528-6013a979ac3e", "name": "network-vif-plugged", "status": "completed", "tag": "d96fed9a-b440-4554-9add-7c497a701d8f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:24.882421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-535a4354-02d6-4cf6-a5f8-17bbfa074bc0 req-c9cb4719-019f-444c-9b0a-fab1414f8af0 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:24.885687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-535a4354-02d6-4cf6-a5f8-17bbfa074bc0 req-c9cb4719-019f-444c-9b0a-fab1414f8af0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:24.889065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-535a4354-02d6-4cf6-a5f8-17bbfa074bc0 req-c9cb4719-019f-444c-9b0a-fab1414f8af0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:24.918499 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-535a4354-02d6-4cf6-a5f8-17bbfa074bc0 req-c9cb4719-019f-444c-9b0a-fab1414f8af0 service nova] Creating event network-vif-plugged:d96fed9a-b440-4554-9add-7c497a701d8f for instance 060fc715-5b23-43ea-a528-6013a979ac3e on n-h1-861111-1 Oct 12 22:13:24.931707 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-535a4354-02d6-4cf6-a5f8-17bbfa074bc0 req-c9cb4719-019f-444c-9b0a-fab1414f8af0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089267 Oct 12 22:13:24.932407 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1561/3501] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:24.958126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ac3af994-e367-4b54-b6be-aa6a0ecdba13 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:24.962827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ac3af994-e367-4b54-b6be-aa6a0ecdba13 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:24.988736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3af994-e367-4b54-b6be-aa6a0ecdba13 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:24.990101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3af994-e367-4b54-b6be-aa6a0ecdba13 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:24.991447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3af994-e367-4b54-b6be-aa6a0ecdba13 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:24.993308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3af994-e367-4b54-b6be-aa6a0ecdba13 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:24.994648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3af994-e367-4b54-b6be-aa6a0ecdba13 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:24.995738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3af994-e367-4b54-b6be-aa6a0ecdba13 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:25.220686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4c411239-d370-4dde-9baa-10707380c0de tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9463eb3ccf4028af1bfc61749c8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950d9a3e971644709e04007bf0d3a6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:25.230032 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4c411239-d370-4dde-9baa-10707380c0de tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 200 len: 1350 microversion: 2.1 time: 1.007615 Oct 12 22:13:25.230620 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1941/3502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:24 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 1350 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:25.253201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-453fb5db-f90c-455c-b38e-a56f7eb85f79 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:25.253858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-453fb5db-f90c-455c-b38e-a56f7eb85f79 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:25.357089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-453fb5db-f90c-455c-b38e-a56f7eb85f79 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:25.364557 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-453fb5db-f90c-455c-b38e-a56f7eb85f79 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1214 microversion: 2.1 time: 0.132894 Oct 12 22:13:25.379034 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1942/3503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:25 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:25.387336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1b42225a-7bd2-498d-9ab9-d9fc31922c3a tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:25.388158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1b42225a-7bd2-498d-9ab9-d9fc31922c3a tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] [instance: f924aa3b-0c00-4577-bb06-3a169f972d3d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:25.397257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b42225a-7bd2-498d-9ab9-d9fc31922c3a tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:25.399913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b42225a-7bd2-498d-9ab9-d9fc31922c3a tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:25.402673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b42225a-7bd2-498d-9ab9-d9fc31922c3a tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:25.411468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b42225a-7bd2-498d-9ab9-d9fc31922c3a tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:25.412391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b42225a-7bd2-498d-9ab9-d9fc31922c3a tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:25.417801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b42225a-7bd2-498d-9ab9-d9fc31922c3a tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:25.450920 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-1b42225a-7bd2-498d-9ab9-d9fc31922c3a tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] HTTP exception thrown: Instance f924aa3b-0c00-4577-bb06-3a169f972d3d could not be found. Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1b42225a-7bd2-498d-9ab9-d9fc31922c3a tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Request method failure captured: Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d HTTP/1.1 Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzul-k5ArXCQUv4eknvtIsPJ9IZVfOm8YPa3SwCUsqFWCRAV14uEUMtsOkYjvC0q-7NXLDiqEC3pOHv9uVvDx5vcXDVthjw5VCF_6P_hAWpa4FEHeIeCEzgEA-O4pl_OKILQCsTf8R5NQXZN-jc9ZBqBSC6DyQjKRIbsfaCaANtTg2g Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: b201054c71d241ee8b130a9b0a014cf6 Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-845994595 Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b201054c71d241ee8b130a9b0a014cf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b201054c71d241ee8b130a9b0a014cf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b201054c71d241ee8b130a9b0a014cf6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b201054c71d241ee8b130a9b0a014cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-845994595 Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: b201054c71d241ee8b130a9b0a014cf6 Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-845994595 Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FloatingIPsAssociationTestJSON-845994595-project Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 94f72337548c4724bf3f4c1009221120 Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-845994595-project Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance f924aa3b-0c00-4577-bb06-3a169f972d3d could not be found. Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'f924aa3b-0c00-4577-bb06-3a169f972d3d'} Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f924aa3b-0c00-4577-bb06-3a169f972d3d could not be found. Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f924aa3b-0c00-4577-bb06-3a169f972d3d could not be found. Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:25.454332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:25.459000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:25.459000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:25.459000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:25.459000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:25.459000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:13:25.459000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:13:25.459000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f924aa3b-0c00-4577-bb06-3a169f972d3d could not be found. Oct 12 22:13:25.459000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:25.461263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1b42225a-7bd2-498d-9ab9-d9fc31922c3a tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] Returning 404 to user: Instance f924aa3b-0c00-4577-bb06-3a169f972d3d could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:13:25.464109 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1b42225a-7bd2-498d-9ab9-d9fc31922c3a tempest-FloatingIPsAssociationTestJSON-845994595 tempest-FloatingIPsAssociationTestJSON-845994595-project] 10.222.0.16 "GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d" status: 404 len: 111 microversion: 2.1 time: 0.083888 Oct 12 22:13:25.480511 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1943/3504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:25 2022] GET /compute/v2.1/servers/f924aa3b-0c00-4577-bb06-3a169f972d3d => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:13:26.186363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ac3af994-e367-4b54-b6be-aa6a0ecdba13 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:26.196083 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ac3af994-e367-4b54-b6be-aa6a0ecdba13 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1512 microversion: 2.1 time: 1.261116 Oct 12 22:13:26.197240 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1562/3505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:24 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1512 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:26.257693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7f59f7a3-a705-401c-9476-4ff9eb598928 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:26.269295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7f59f7a3-a705-401c-9476-4ff9eb598928 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:26.287799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f59f7a3-a705-401c-9476-4ff9eb598928 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:26.288291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f59f7a3-a705-401c-9476-4ff9eb598928 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:26.288728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f59f7a3-a705-401c-9476-4ff9eb598928 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:26.289484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f59f7a3-a705-401c-9476-4ff9eb598928 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:26.289941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f59f7a3-a705-401c-9476-4ff9eb598928 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:26.290498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f59f7a3-a705-401c-9476-4ff9eb598928 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:26.394402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-669757f4-8649-4795-82f3-e3eba4f0b036 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:26.395741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-669757f4-8649-4795-82f3-e3eba4f0b036 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:26.406599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-669757f4-8649-4795-82f3-e3eba4f0b036 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:26.408377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-669757f4-8649-4795-82f3-e3eba4f0b036 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:26.409363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-669757f4-8649-4795-82f3-e3eba4f0b036 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:26.413977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-669757f4-8649-4795-82f3-e3eba4f0b036 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:26.414496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-669757f4-8649-4795-82f3-e3eba4f0b036 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:26.414938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-669757f4-8649-4795-82f3-e3eba4f0b036 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:26.529769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-669757f4-8649-4795-82f3-e3eba4f0b036 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:26.540256 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-669757f4-8649-4795-82f3-e3eba4f0b036 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1266 microversion: 2.1 time: 0.150955 Oct 12 22:13:26.541816 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1563/3506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:26 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:26.642486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7f59f7a3-a705-401c-9476-4ff9eb598928 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9463eb3ccf4028af1bfc61749c8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950d9a3e971644709e04007bf0d3a6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:26.653589 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7f59f7a3-a705-401c-9476-4ff9eb598928 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 200 len: 1350 microversion: 2.1 time: 0.401001 Oct 12 22:13:26.655977 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1944/3507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:26 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 1350 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:27.179922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-304eb438-5b34-4dfe-a1ec-aa9f4911da6e tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Calling method '.version_select at 0x7f51286eddc0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:27.220335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-59e90ef6-2dd8-4f74-a963-1fc69b6f14a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:27.221713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-59e90ef6-2dd8-4f74-a963-1fc69b6f14a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:27.231079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e90ef6-2dd8-4f74-a963-1fc69b6f14a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:27.233589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e90ef6-2dd8-4f74-a963-1fc69b6f14a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:27.235466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e90ef6-2dd8-4f74-a963-1fc69b6f14a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:27.242890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e90ef6-2dd8-4f74-a963-1fc69b6f14a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:27.243989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e90ef6-2dd8-4f74-a963-1fc69b6f14a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:27.244621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e90ef6-2dd8-4f74-a963-1fc69b6f14a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:27.253101 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-304eb438-5b34-4dfe-a1ec-aa9f4911da6e tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] 10.222.0.16 "GET /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27" status: 200 len: 636 microversion: 2.1 time: 0.079804 Oct 12 22:13:27.254689 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1564/3508] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:13:27 2022] GET /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27 => generated 636 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:27.282210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-37d443e6-b079-4160-a601-994f075cd33d tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Action: 'update_all', calling method: .version_select at 0x7f51286edd30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:27.355307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-37d443e6-b079-4160-a601-994f075cd33d tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:13:27.370825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:27.372323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-37d443e6-b079-4160-a601-994f075cd33d tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for user b1248902d7dd4457bf090ece8a1d66bf and project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:13:27.606253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-59e90ef6-2dd8-4f74-a963-1fc69b6f14a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:27.626553 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-59e90ef6-2dd8-4f74-a963-1fc69b6f14a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1512 microversion: 2.1 time: 0.410534 Oct 12 22:13:27.627521 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1945/3509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:27 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1512 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:13:27.644787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-faea8518-8d1f-43fe-b705-3f3241c76a4a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:27.645532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-faea8518-8d1f-43fe-b705-3f3241c76a4a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:27.660358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faea8518-8d1f-43fe-b705-3f3241c76a4a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:27.661146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faea8518-8d1f-43fe-b705-3f3241c76a4a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:27.661597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faea8518-8d1f-43fe-b705-3f3241c76a4a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:27.662317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faea8518-8d1f-43fe-b705-3f3241c76a4a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:27.662779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faea8518-8d1f-43fe-b705-3f3241c76a4a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:27.663211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faea8518-8d1f-43fe-b705-3f3241c76a4a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:27.699080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:27.811229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-faea8518-8d1f-43fe-b705-3f3241c76a4a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:27.828006 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-faea8518-8d1f-43fe-b705-3f3241c76a4a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1272 microversion: 2.1 time: 0.199357 Oct 12 22:13:27.842621 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1946/3510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:27 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:27.842621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f054b7d7-4f22-401e-8f08-15eadbacf7fa tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:27.842621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f054b7d7-4f22-401e-8f08-15eadbacf7fa tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:27.855902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f054b7d7-4f22-401e-8f08-15eadbacf7fa tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:27.856407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f054b7d7-4f22-401e-8f08-15eadbacf7fa tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:27.860937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f054b7d7-4f22-401e-8f08-15eadbacf7fa tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:27.862622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f054b7d7-4f22-401e-8f08-15eadbacf7fa tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:27.863472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f054b7d7-4f22-401e-8f08-15eadbacf7fa tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:27.864113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f054b7d7-4f22-401e-8f08-15eadbacf7fa tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:27.921664 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-37d443e6-b079-4160-a601-994f075cd33d tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] 10.222.0.16 "PUT /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata" status: 200 len: 61 microversion: 2.1 time: 0.656250 Oct 12 22:13:27.922953 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1565/3511] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:13:27 2022] PUT /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata => generated 61 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:13:27.933161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bb9a871c-66a5-4a42-908c-054494917b2f tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Calling method '.version_select at 0x7f51286ed280>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:28.250824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f054b7d7-4f22-401e-8f08-15eadbacf7fa tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9463eb3ccf4028af1bfc61749c8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950d9a3e971644709e04007bf0d3a6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:28.266992 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f054b7d7-4f22-401e-8f08-15eadbacf7fa tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 200 len: 1541 microversion: 2.1 time: 0.436321 Oct 12 22:13:28.269997 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1947/3512] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:27 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 1541 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:28.294403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b11db089-ba15-407b-8bc3-9f2a34b949ae tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:28.294980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b11db089-ba15-407b-8bc3-9f2a34b949ae tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:28.311787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b11db089-ba15-407b-8bc3-9f2a34b949ae tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:28.312284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b11db089-ba15-407b-8bc3-9f2a34b949ae tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:28.312723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b11db089-ba15-407b-8bc3-9f2a34b949ae tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:28.313439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b11db089-ba15-407b-8bc3-9f2a34b949ae tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:28.317707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b11db089-ba15-407b-8bc3-9f2a34b949ae tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:28.318159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b11db089-ba15-407b-8bc3-9f2a34b949ae tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:28.371330 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bb9a871c-66a5-4a42-908c-054494917b2f tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] 10.222.0.16 "DELETE /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.442455 Oct 12 22:13:28.372179 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1566/3513] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Oct 12 22:13:27 2022] DELETE /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata/os_version => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:13:28.380503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-92bff5bf-0026-48b5-88cb-e6660b97d494 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Calling method '.version_select at 0x7f512862dca0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:28.445530 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-92bff5bf-0026-48b5-88cb-e6660b97d494 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] 10.222.0.16 "GET /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata" status: 200 len: 37 microversion: 2.1 time: 0.068649 Oct 12 22:13:28.446375 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1567/3514] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 12 22:13:28 2022] GET /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata => generated 37 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:13:28.457326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9c272d3c-6733-4870-b97c-f2799b854186 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Action: 'update_all', calling method: .version_select at 0x7f51287359d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:28.501800 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b11db089-ba15-407b-8bc3-9f2a34b949ae tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.212347 Oct 12 22:13:28.502454 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1948/3515] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:13:28 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e/os-interface => generated 285 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:13:28.536428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-9c272d3c-6733-4870-b97c-f2799b854186 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:13:28.552952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-9c272d3c-6733-4870-b97c-f2799b854186 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for user b1248902d7dd4457bf090ece8a1d66bf and project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:13:28.655610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a466770b-12b6-4a7e-b180-4e901abfbab3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:28.656818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a466770b-12b6-4a7e-b180-4e901abfbab3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:28.668889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a466770b-12b6-4a7e-b180-4e901abfbab3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:28.671648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a466770b-12b6-4a7e-b180-4e901abfbab3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:28.673387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a466770b-12b6-4a7e-b180-4e901abfbab3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:28.677764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a466770b-12b6-4a7e-b180-4e901abfbab3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:28.679722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a466770b-12b6-4a7e-b180-4e901abfbab3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:28.681957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a466770b-12b6-4a7e-b180-4e901abfbab3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:29.206181 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9c272d3c-6733-4870-b97c-f2799b854186 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] 10.222.0.16 "PUT /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata" status: 200 len: 61 microversion: 2.1 time: 0.753273 Oct 12 22:13:29.207113 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1568/3516] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:13:28 2022] PUT /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata => generated 61 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:13:29.213055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-30724a64-f5b0-47ab-9869-4f4c9f11c631 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:29.217311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-30724a64-f5b0-47ab-9869-4f4c9f11c631 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:29.233323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30724a64-f5b0-47ab-9869-4f4c9f11c631 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:29.235636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30724a64-f5b0-47ab-9869-4f4c9f11c631 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:29.236291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30724a64-f5b0-47ab-9869-4f4c9f11c631 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:29.239483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30724a64-f5b0-47ab-9869-4f4c9f11c631 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:29.240176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30724a64-f5b0-47ab-9869-4f4c9f11c631 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:29.240775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30724a64-f5b0-47ab-9869-4f4c9f11c631 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:29.564511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a466770b-12b6-4a7e-b180-4e901abfbab3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:29.585015 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a466770b-12b6-4a7e-b180-4e901abfbab3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1512 microversion: 2.1 time: 0.934552 Oct 12 22:13:29.586055 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1949/3517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:28 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1512 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:29.599451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-10882550-6fe1-4a38-a4e1-e702a2576918 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Calling method '.version_select at 0x7f512c4313a0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:29.654293 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-10882550-6fe1-4a38-a4e1-e702a2576918 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] 10.222.0.16 "GET /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.067011 Oct 12 22:13:29.655862 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1950/3518] 10.222.0.16 () {58 vars in 1290 bytes} [Wed Oct 12 22:13:29 2022] GET /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata/os_distro => generated 33 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:13:29.666895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-487f8647-b867-450d-9a6c-214cd7784cc1 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Action: 'update_all', calling method: .version_select at 0x7f51285a2790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:29.748272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-487f8647-b867-450d-9a6c-214cd7784cc1 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:13:29.773698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-487f8647-b867-450d-9a6c-214cd7784cc1 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for user b1248902d7dd4457bf090ece8a1d66bf and project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:13:29.859722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-30724a64-f5b0-47ab-9869-4f4c9f11c631 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:29.891003 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-30724a64-f5b0-47ab-9869-4f4c9f11c631 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1314 microversion: 2.1 time: 0.682375 Oct 12 22:13:29.905022 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1569/3519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:29 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1314 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:30.139365 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-487f8647-b867-450d-9a6c-214cd7784cc1 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] 10.222.0.16 "PUT /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata" status: 200 len: 61 microversion: 2.1 time: 0.476951 Oct 12 22:13:30.140384 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1951/3520] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:13:29 2022] PUT /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata => generated 61 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:13:30.150476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-23389cb9-e7b7-44ca-a8d6-a9852e2334ba tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Calling method '.version_select at 0x7f51238cf4c0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:30.204559 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-23389cb9-e7b7-44ca-a8d6-a9852e2334ba tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] 10.222.0.16 "GET /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata" status: 200 len: 61 microversion: 2.1 time: 0.058611 Oct 12 22:13:30.205323 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1570/3521] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 12 22:13:30 2022] GET /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata => generated 61 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:13:30.217034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5e80d220-c237-4a18-8ab0-05430aaf2c93 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Action: 'update_all', calling method: .version_select at 0x7f512860b550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:30.305504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-5e80d220-c237-4a18-8ab0-05430aaf2c93 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:13:30.322241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-5e80d220-c237-4a18-8ab0-05430aaf2c93 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for user b1248902d7dd4457bf090ece8a1d66bf and project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:13:30.568204 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5e80d220-c237-4a18-8ab0-05430aaf2c93 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] 10.222.0.16 "PUT /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata" status: 200 len: 61 microversion: 2.1 time: 0.355733 Oct 12 22:13:30.569109 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1952/3522] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:13:30 2022] PUT /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata => generated 61 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:13:30.579469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fce24ef3-9adf-425e-aab2-9646cddf93cb tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Action: 'update_all', calling method: .version_select at 0x7f512c364ee0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:30.610418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b6b7105c-e052-46ae-9e5a-d7651fc85a87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:30.611602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b6b7105c-e052-46ae-9e5a-d7651fc85a87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:30.621080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6b7105c-e052-46ae-9e5a-d7651fc85a87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:30.622972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6b7105c-e052-46ae-9e5a-d7651fc85a87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:30.625647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6b7105c-e052-46ae-9e5a-d7651fc85a87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:30.633290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6b7105c-e052-46ae-9e5a-d7651fc85a87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:30.635580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6b7105c-e052-46ae-9e5a-d7651fc85a87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:30.637782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6b7105c-e052-46ae-9e5a-d7651fc85a87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:30.678033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-fce24ef3-9adf-425e-aab2-9646cddf93cb tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:13:30.692017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-fce24ef3-9adf-425e-aab2-9646cddf93cb tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for user b1248902d7dd4457bf090ece8a1d66bf and project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:13:31.294728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b6b7105c-e052-46ae-9e5a-d7651fc85a87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:31.313770 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b6b7105c-e052-46ae-9e5a-d7651fc85a87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1512 microversion: 2.1 time: 0.705729 Oct 12 22:13:31.323875 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1953/3523] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:30 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1512 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:13:31.331695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-04a722d0-2023-4e23-9a28-0ec82d6090e4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:31.332509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-04a722d0-2023-4e23-9a28-0ec82d6090e4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:31.382981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04a722d0-2023-4e23-9a28-0ec82d6090e4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:31.383667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04a722d0-2023-4e23-9a28-0ec82d6090e4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:31.384108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04a722d0-2023-4e23-9a28-0ec82d6090e4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:31.384816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04a722d0-2023-4e23-9a28-0ec82d6090e4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:31.385268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04a722d0-2023-4e23-9a28-0ec82d6090e4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:31.385693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04a722d0-2023-4e23-9a28-0ec82d6090e4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:31.479050 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fce24ef3-9adf-425e-aab2-9646cddf93cb tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] 10.222.0.16 "PUT /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata" status: 200 len: 64 microversion: 2.1 time: 0.903543 Oct 12 22:13:31.480661 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1571/3524] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:13:30 2022] PUT /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata => generated 64 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:13:31.493153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c989e66a-78fd-4cfa-8809-a74b9320677e tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Calling method '.version_select at 0x7f512396b3a0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:31.550131 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c989e66a-78fd-4cfa-8809-a74b9320677e tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] 10.222.0.16 "GET /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata" status: 200 len: 64 microversion: 2.1 time: 0.060271 Oct 12 22:13:31.551641 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1572/3525] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 12 22:13:31 2022] GET /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata => generated 64 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:13:31.556506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7fd67fe5-284a-4897-8473-79a14d45f322 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:31.557146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7fd67fe5-284a-4897-8473-79a14d45f322 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:31.563705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fd67fe5-284a-4897-8473-79a14d45f322 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:31.564435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fd67fe5-284a-4897-8473-79a14d45f322 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:31.565109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fd67fe5-284a-4897-8473-79a14d45f322 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:31.566003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fd67fe5-284a-4897-8473-79a14d45f322 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:31.566617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fd67fe5-284a-4897-8473-79a14d45f322 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:31.567207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fd67fe5-284a-4897-8473-79a14d45f322 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:31.606159 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7fd67fe5-284a-4897-8473-79a14d45f322 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/ips" status: 200 len: 151 microversion: 2.1 time: 0.052459 Oct 12 22:13:31.606497 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1573/3526] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 22:13:31 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/ips => generated 151 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:31.616283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-66cad73a-770a-4e8e-97c7-e0a9a504389d tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Action: 'update_all', calling method: .version_select at 0x7f5128483790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:31.678471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-66cad73a-770a-4e8e-97c7-e0a9a504389d tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:13:31.687748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-66cad73a-770a-4e8e-97c7-e0a9a504389d tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for user b1248902d7dd4457bf090ece8a1d66bf and project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:13:32.070913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-04a722d0-2023-4e23-9a28-0ec82d6090e4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:32.086476 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-04a722d0-2023-4e23-9a28-0ec82d6090e4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1314 microversion: 2.1 time: 0.766411 Oct 12 22:13:32.090745 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1954/3527] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:31 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1314 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:32.106718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-1ef692b4-8421-4348-9f8f-b2b015decedb req-6fe0e1a7-555b-4919-a9ee-98f3888d7dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50994542-c3c0-46a4-b994-50c452999ba2", "tag": "1ab1002b-2837-44c5-913e-110671db6764"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:32.148695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1ef692b4-8421-4348-9f8f-b2b015decedb req-6fe0e1a7-555b-4919-a9ee-98f3888d7dd9 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:32.149881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1ef692b4-8421-4348-9f8f-b2b015decedb req-6fe0e1a7-555b-4919-a9ee-98f3888d7dd9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:32.151446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1ef692b4-8421-4348-9f8f-b2b015decedb req-6fe0e1a7-555b-4919-a9ee-98f3888d7dd9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:32.204604 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-1ef692b4-8421-4348-9f8f-b2b015decedb req-6fe0e1a7-555b-4919-a9ee-98f3888d7dd9 service nova] Creating event network-changed:1ab1002b-2837-44c5-913e-110671db6764 for instance 50994542-c3c0-46a4-b994-50c452999ba2 on n-h2-861111-1 Oct 12 22:13:32.234228 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-1ef692b4-8421-4348-9f8f-b2b015decedb req-6fe0e1a7-555b-4919-a9ee-98f3888d7dd9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127670 Oct 12 22:13:32.234228 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1955/3528] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:32.244910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-99902c1b-e0d1-46cf-9bd5-76e4e92585a3 req-56331ac1-4e6d-4b8f-b4b2-05af54e4b50c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060fc715-5b23-43ea-a528-6013a979ac3e", "tag": "d96fed9a-b440-4554-9add-7c497a701d8f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:32.287525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-99902c1b-e0d1-46cf-9bd5-76e4e92585a3 req-56331ac1-4e6d-4b8f-b4b2-05af54e4b50c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:32.292634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-99902c1b-e0d1-46cf-9bd5-76e4e92585a3 req-56331ac1-4e6d-4b8f-b4b2-05af54e4b50c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:32.293166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-99902c1b-e0d1-46cf-9bd5-76e4e92585a3 req-56331ac1-4e6d-4b8f-b4b2-05af54e4b50c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:32.338699 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-99902c1b-e0d1-46cf-9bd5-76e4e92585a3 req-56331ac1-4e6d-4b8f-b4b2-05af54e4b50c service nova] Creating event network-changed:d96fed9a-b440-4554-9add-7c497a701d8f for instance 060fc715-5b23-43ea-a528-6013a979ac3e on n-h1-861111-1 Oct 12 22:13:32.352547 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-99902c1b-e0d1-46cf-9bd5-76e4e92585a3 req-56331ac1-4e6d-4b8f-b4b2-05af54e4b50c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122993 Oct 12 22:13:32.356587 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1956/3529] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:32.371813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-99acb666-e05c-41de-ae2b-94f4989cfa55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:32.374549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-99acb666-e05c-41de-ae2b-94f4989cfa55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:32.392119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99acb666-e05c-41de-ae2b-94f4989cfa55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:32.392361 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-66cad73a-770a-4e8e-97c7-e0a9a504389d tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] 10.222.0.16 "PUT /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata" status: 200 len: 61 microversion: 2.1 time: 0.784639 Oct 12 22:13:32.393354 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1574/3530] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:13:31 2022] PUT /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata => generated 61 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:13:32.400433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99acb666-e05c-41de-ae2b-94f4989cfa55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:32.403421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99acb666-e05c-41de-ae2b-94f4989cfa55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:32.404486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99acb666-e05c-41de-ae2b-94f4989cfa55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:32.405172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99acb666-e05c-41de-ae2b-94f4989cfa55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:32.405829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99acb666-e05c-41de-ae2b-94f4989cfa55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:32.405955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ca6ec079-6262-4137-89ce-e89d0afbac38 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Action: 'update', calling method: .version_select at 0x7f512377f670>, body: {"meta": {"os_version": "alt"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:32.544342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-ca6ec079-6262-4137-89ce-e89d0afbac38 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:13:32.555957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-ca6ec079-6262-4137-89ce-e89d0afbac38 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for user b1248902d7dd4457bf090ece8a1d66bf and project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:13:32.876087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-99acb666-e05c-41de-ae2b-94f4989cfa55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:32.893529 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-99acb666-e05c-41de-ae2b-94f4989cfa55 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1489 microversion: 2.1 time: 0.534379 Oct 12 22:13:32.897872 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1957/3531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:32 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1489 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:32.920800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4522d898-b649-4f1b-8216-464b66f26f36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:32.927489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4522d898-b649-4f1b-8216-464b66f26f36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:32.946889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4522d898-b649-4f1b-8216-464b66f26f36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:32.947425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4522d898-b649-4f1b-8216-464b66f26f36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:32.947868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4522d898-b649-4f1b-8216-464b66f26f36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:32.948583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4522d898-b649-4f1b-8216-464b66f26f36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:32.956882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4522d898-b649-4f1b-8216-464b66f26f36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:32.957339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4522d898-b649-4f1b-8216-464b66f26f36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:33.094661 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4522d898-b649-4f1b-8216-464b66f26f36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 200 len: 151 microversion: 2.1 time: 0.177934 Oct 12 22:13:33.103642 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1958/3532] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:13:32 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 151 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:33.124504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0bafd507-b491-484e-a5e1-13a3ea8df3ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:33.137321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0bafd507-b491-484e-a5e1-13a3ea8df3ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:33.165066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bafd507-b491-484e-a5e1-13a3ea8df3ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:33.166213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bafd507-b491-484e-a5e1-13a3ea8df3ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:33.166883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bafd507-b491-484e-a5e1-13a3ea8df3ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:33.168267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bafd507-b491-484e-a5e1-13a3ea8df3ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:33.168915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bafd507-b491-484e-a5e1-13a3ea8df3ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:33.169534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bafd507-b491-484e-a5e1-13a3ea8df3ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:33.217135 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ca6ec079-6262-4137-89ce-e89d0afbac38 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] 10.222.0.16 "PUT /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.817878 Oct 12 22:13:33.224391 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1575/3533] 10.222.0.16 () {60 vars in 1313 bytes} [Wed Oct 12 22:13:32 2022] PUT /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata/os_version => generated 31 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:13:33.229892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f7a25975-fc1b-4042-8f64-f1028733baa4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:33.232410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f7a25975-fc1b-4042-8f64-f1028733baa4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:33.262568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7a25975-fc1b-4042-8f64-f1028733baa4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:33.263860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7a25975-fc1b-4042-8f64-f1028733baa4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:33.265284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7a25975-fc1b-4042-8f64-f1028733baa4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:33.266797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7a25975-fc1b-4042-8f64-f1028733baa4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:33.268325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7a25975-fc1b-4042-8f64-f1028733baa4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:33.272386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7a25975-fc1b-4042-8f64-f1028733baa4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:33.921269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0bafd507-b491-484e-a5e1-13a3ea8df3ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:33.938225 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0bafd507-b491-484e-a5e1-13a3ea8df3ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.825538 Oct 12 22:13:33.944742 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1959/3534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:33 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:33.958555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6c84cd1d-e6a2-4f5b-8069-34d3fd05ab64 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Calling method '.version_select at 0x7f512860bdc0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:34.047599 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6c84cd1d-e6a2-4f5b-8069-34d3fd05ab64 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] 10.222.0.16 "GET /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata" status: 200 len: 58 microversion: 2.1 time: 0.101046 Oct 12 22:13:34.048118 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1960/3535] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 12 22:13:33 2022] GET /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata => generated 58 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:13:34.059118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-89a4097b-ffc1-47c9-addf-9d42f05960c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:34.060327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-89a4097b-ffc1-47c9-addf-9d42f05960c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:34.078278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89a4097b-ffc1-47c9-addf-9d42f05960c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:34.079063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89a4097b-ffc1-47c9-addf-9d42f05960c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:34.080782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89a4097b-ffc1-47c9-addf-9d42f05960c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:34.081691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89a4097b-ffc1-47c9-addf-9d42f05960c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:34.083445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89a4097b-ffc1-47c9-addf-9d42f05960c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:34.085174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89a4097b-ffc1-47c9-addf-9d42f05960c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:34.605564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=10 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:34.754031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-89a4097b-ffc1-47c9-addf-9d42f05960c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:34.773133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f7a25975-fc1b-4042-8f64-f1028733baa4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:34.790288 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-89a4097b-ffc1-47c9-addf-9d42f05960c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.739716 Oct 12 22:13:34.791720 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1961/3536] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:34 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:34.797261 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f7a25975-fc1b-4042-8f64-f1028733baa4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1314 microversion: 2.1 time: 1.571577 Oct 12 22:13:34.797859 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1576/3537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:33 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1314 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:34.798420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8da3de1e-d49f-4aeb-b90d-3e613a30e9ab tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Action: 'update_all', calling method: .version_select at 0x7f5128abce50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:34.819740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-016da26f-484d-4a3c-b1ec-071108814417 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:34.820355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-016da26f-484d-4a3c-b1ec-071108814417 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:34.833511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-016da26f-484d-4a3c-b1ec-071108814417 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:34.834563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-016da26f-484d-4a3c-b1ec-071108814417 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:34.835267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-016da26f-484d-4a3c-b1ec-071108814417 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:34.836212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-016da26f-484d-4a3c-b1ec-071108814417 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:34.836881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-016da26f-484d-4a3c-b1ec-071108814417 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:34.837523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-016da26f-484d-4a3c-b1ec-071108814417 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:34.919881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-8da3de1e-d49f-4aeb-b90d-3e613a30e9ab tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:13:34.936220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-8da3de1e-d49f-4aeb-b90d-3e613a30e9ab tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for user b1248902d7dd4457bf090ece8a1d66bf and project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:13:35.545262 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8da3de1e-d49f-4aeb-b90d-3e613a30e9ab tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] 10.222.0.16 "PUT /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata" status: 200 len: 61 microversion: 2.1 time: 0.751979 Oct 12 22:13:35.546274 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1962/3538] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:13:34 2022] PUT /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata => generated 61 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:13:35.556519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2cf20c8d-ed37-4d86-a292-5f828fe3c1d4 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Action: 'create', calling method: .version_select at 0x7f51286060d0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:35.659578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-2cf20c8d-ed37-4d86-a292-5f828fe3c1d4 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:13:35.665494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:35.667136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-2cf20c8d-ed37-4d86-a292-5f828fe3c1d4 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Getting quotas for user b1248902d7dd4457bf090ece8a1d66bf and project 34de8342c6b342a697ae5f27d4f75dbe. Resources: dict_keys(['metadata_items']) {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:13:35.836060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-016da26f-484d-4a3c-b1ec-071108814417 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:35.848466 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-016da26f-484d-4a3c-b1ec-071108814417 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 1.031561 Oct 12 22:13:35.850113 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1577/3539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:34 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:35.858606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9e2bd3dd-7b51-442e-aa61-059b2157b96e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27090350-78f8-4a6a-81de-d95fc59a58ca"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:35.862452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9e2bd3dd-7b51-442e-aa61-059b2157b96e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:35.883419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e2bd3dd-7b51-442e-aa61-059b2157b96e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:35.888118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e2bd3dd-7b51-442e-aa61-059b2157b96e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:35.889611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e2bd3dd-7b51-442e-aa61-059b2157b96e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:35.891501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e2bd3dd-7b51-442e-aa61-059b2157b96e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:35.892977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e2bd3dd-7b51-442e-aa61-059b2157b96e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:35.895120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e2bd3dd-7b51-442e-aa61-059b2157b96e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:36.198962 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2cf20c8d-ed37-4d86-a292-5f828fe3c1d4 tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] 10.222.0.16 "POST /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata" status: 200 len: 85 microversion: 2.1 time: 0.646860 Oct 12 22:13:36.204618 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1963/3540] 10.222.0.16 () {60 vars in 1281 bytes} [Wed Oct 12 22:13:35 2022] POST /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata => generated 85 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:13:36.212341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e0c600bf-03e4-4e9a-9c7b-6ec61e40850d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:36.213230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e0c600bf-03e4-4e9a-9c7b-6ec61e40850d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:36.221573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0c600bf-03e4-4e9a-9c7b-6ec61e40850d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:36.222335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0c600bf-03e4-4e9a-9c7b-6ec61e40850d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:36.222929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0c600bf-03e4-4e9a-9c7b-6ec61e40850d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:36.238100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0c600bf-03e4-4e9a-9c7b-6ec61e40850d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:36.239172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0c600bf-03e4-4e9a-9c7b-6ec61e40850d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:36.239871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0c600bf-03e4-4e9a-9c7b-6ec61e40850d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:36.387095 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9e2bd3dd-7b51-442e-aa61-059b2157b96e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "POST /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.533381 Oct 12 22:13:36.398633 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1578/3541] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 22:13:35 2022] POST /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments => generated 194 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:36.406762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-66219f61-684b-48e2-b2fc-4873d266fac0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:36.409035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-66219f61-684b-48e2-b2fc-4873d266fac0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:36.419494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66219f61-684b-48e2-b2fc-4873d266fac0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:36.420412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66219f61-684b-48e2-b2fc-4873d266fac0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:36.421492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66219f61-684b-48e2-b2fc-4873d266fac0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:36.422475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66219f61-684b-48e2-b2fc-4873d266fac0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:36.423185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66219f61-684b-48e2-b2fc-4873d266fac0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:36.423820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66219f61-684b-48e2-b2fc-4873d266fac0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:36.790586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e0c600bf-03e4-4e9a-9c7b-6ec61e40850d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:36.807428 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e0c600bf-03e4-4e9a-9c7b-6ec61e40850d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1314 microversion: 2.1 time: 0.600361 Oct 12 22:13:36.808022 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1964/3542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:36 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:36.838542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-639cbc04-208a-41b8-b29b-57afabae121c tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] Calling method '.version_select at 0x7f512c431e50>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:36.898359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-66219f61-684b-48e2-b2fc-4873d266fac0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:36.909981 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-66219f61-684b-48e2-b2fc-4873d266fac0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.509463 Oct 12 22:13:36.919982 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1579/3543] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:36 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:36.946322 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-639cbc04-208a-41b8-b29b-57afabae121c tempest-ImagesMetadataTestJSON-2053904807 tempest-ImagesMetadataTestJSON-2053904807-project] 10.222.0.16 "GET /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata" status: 200 len: 85 microversion: 2.1 time: 0.134495 Oct 12 22:13:36.947112 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1965/3544] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 12 22:13:36 2022] GET /compute/v2.1/images/85fdbf55-bfd5-4023-94eb-df1979c33d27/metadata => generated 85 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:13:37.198529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1188314980", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "68fd94b2-ed36-4c67-ae5b-2f754d0450a2"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:37.788349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] validate_networks() for [('68fd94b2-ed36-4c67-ae5b-2f754d0450a2', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:13:37.837327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d884b5ac-deb4-486d-abe7-f90a271a52c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:37.837957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d884b5ac-deb4-486d-abe7-f90a271a52c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:37.863542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d884b5ac-deb4-486d-abe7-f90a271a52c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:37.864051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d884b5ac-deb4-486d-abe7-f90a271a52c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:37.868966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d884b5ac-deb4-486d-abe7-f90a271a52c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:37.869759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d884b5ac-deb4-486d-abe7-f90a271a52c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:37.870244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d884b5ac-deb4-486d-abe7-f90a271a52c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:37.870783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d884b5ac-deb4-486d-abe7-f90a271a52c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:38.620501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d884b5ac-deb4-486d-abe7-f90a271a52c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:38.628758 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d884b5ac-deb4-486d-abe7-f90a271a52c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1314 microversion: 2.1 time: 0.797273 Oct 12 22:13:38.629334 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1966/3545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:37 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1314 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:39.589687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:13:39.590228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:13:39.590808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:13:39.591480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:13:39.592004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:13:39.618448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:39.621991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:39.623986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:39.628695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:39.629720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:39.631284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:39.653800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f0557809-e1fc-4531-bbfb-9e2dc8f4e8bf tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:39.655357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f0557809-e1fc-4531-bbfb-9e2dc8f4e8bf tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:39.670399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0557809-e1fc-4531-bbfb-9e2dc8f4e8bf tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:39.673660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0557809-e1fc-4531-bbfb-9e2dc8f4e8bf tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:39.676264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0557809-e1fc-4531-bbfb-9e2dc8f4e8bf tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:39.679360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0557809-e1fc-4531-bbfb-9e2dc8f4e8bf tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:39.679854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0557809-e1fc-4531-bbfb-9e2dc8f4e8bf tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:39.680891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0557809-e1fc-4531-bbfb-9e2dc8f4e8bf tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:39.698602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Getting quotas for project 319a8f107945457a8a8f8e9690a697e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:13:39.723200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Getting quotas for user b29c500796d54d6188ff65056340d35f and project 319a8f107945457a8a8f8e9690a697e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:13:39.786431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:13:39.798872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:13:40.056561 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c8b47ec1-fa01-43e6-9ab0-747f3965e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.861711 Oct 12 22:13:40.057204 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1580/3546] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:13:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:13:40.094900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f984031c-2e09-4f36-81a8-9620d7e15db2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:40.098512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f984031c-2e09-4f36-81a8-9620d7e15db2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:40.229195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f0557809-e1fc-4531-bbfb-9e2dc8f4e8bf tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:40.238251 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f0557809-e1fc-4531-bbfb-9e2dc8f4e8bf tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1314 microversion: 2.1 time: 0.589616 Oct 12 22:13:40.244911 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1967/3547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:39 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:40.403970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f984031c-2e09-4f36-81a8-9620d7e15db2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:40.424099 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f984031c-2e09-4f36-81a8-9620d7e15db2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1215 microversion: 2.1 time: 0.349553 Oct 12 22:13:40.429232 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1581/3548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:40 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1215 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:40.735063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-357ac8f7-deb2-41ea-abce-96a7c5cfc847 req-efc5f492-3fe5-4949-83f9-39b735be6bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50994542-c3c0-46a4-b994-50c452999ba2", "name": "network-vif-plugged", "status": "completed", "tag": "1ab1002b-2837-44c5-913e-110671db6764"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:40.749607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-357ac8f7-deb2-41ea-abce-96a7c5cfc847 req-efc5f492-3fe5-4949-83f9-39b735be6bfc service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:40.750244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-357ac8f7-deb2-41ea-abce-96a7c5cfc847 req-efc5f492-3fe5-4949-83f9-39b735be6bfc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:40.750857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-357ac8f7-deb2-41ea-abce-96a7c5cfc847 req-efc5f492-3fe5-4949-83f9-39b735be6bfc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:40.789337 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-357ac8f7-deb2-41ea-abce-96a7c5cfc847 req-efc5f492-3fe5-4949-83f9-39b735be6bfc service nova] Creating event network-vif-plugged:1ab1002b-2837-44c5-913e-110671db6764 for instance 50994542-c3c0-46a4-b994-50c452999ba2 on n-h2-861111-1 Oct 12 22:13:40.796464 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-357ac8f7-deb2-41ea-abce-96a7c5cfc847 req-efc5f492-3fe5-4949-83f9-39b735be6bfc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067895 Oct 12 22:13:40.798642 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1582/3549] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:13:41.013069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6c69682a-80eb-4e96-8680-1186b732395c tempest-FloatingIPsNegativeTestJSON-1847495057 tempest-FloatingIPsNegativeTestJSON-1847495057-project] Calling method '.version_select at 0x7f51282f5790>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:41.271597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-48f4c2af-c41c-4ad5-bb95-24a0798e5e7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:41.272303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-48f4c2af-c41c-4ad5-bb95-24a0798e5e7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:41.274724 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6c69682a-80eb-4e96-8680-1186b732395c tempest-FloatingIPsNegativeTestJSON-1847495057 tempest-FloatingIPsNegativeTestJSON-1847495057-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 1.028440 Oct 12 22:13:41.283996 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1968/3550] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 12 22:13:40 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:13:41.289898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c32e7b39-7408-4320-8b0a-789793435705 tempest-FloatingIPsNegativeTestJSON-1847495057 tempest-FloatingIPsNegativeTestJSON-1847495057-project] Action: 'create', calling method: .version_select at 0x7f512c431d30>, body: {"pool": "non_exist_pool"} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:41.295725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48f4c2af-c41c-4ad5-bb95-24a0798e5e7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:41.297316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48f4c2af-c41c-4ad5-bb95-24a0798e5e7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:41.297774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48f4c2af-c41c-4ad5-bb95-24a0798e5e7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:41.300712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48f4c2af-c41c-4ad5-bb95-24a0798e5e7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:41.302684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48f4c2af-c41c-4ad5-bb95-24a0798e5e7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:41.303514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48f4c2af-c41c-4ad5-bb95-24a0798e5e7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:41.338911 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-c32e7b39-7408-4320-8b0a-789793435705 tempest-FloatingIPsNegativeTestJSON-1847495057 tempest-FloatingIPsNegativeTestJSON-1847495057-project] HTTP exception thrown: Floating IP pool not found. Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c32e7b39-7408-4320-8b0a-789793435705 tempest-FloatingIPsNegativeTestJSON-1847495057 tempest-FloatingIPsNegativeTestJSON-1847495057-project] Request method failure captured: Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 26 Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwTBOTLc0qVAR4z-j5wfud9EvA24PeZa4qTC7KjKlhqPOhQhOu124XZQEfUPaKiYPobKkNaUKGRbvXGPBbaGO3GiSuyAze2jGPDJsJ9L2PafkLGyAeXsP9hGJBwhPKRgfBLMfKvdPjVcNlQl3kBcCrTlIYq5Ak2V7Bx4apb9YiDrBI Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 895b6c66aa6443919d8c7d3f8f61be2f Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1847495057 Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/895b6c66aa6443919d8c7d3f8f61be2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/895b6c66aa6443919d8c7d3f8f61be2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_895b6c66aa6443919d8c7d3f8f61be2f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/895b6c66aa6443919d8c7d3f8f61be2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1847495057 Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 895b6c66aa6443919d8c7d3f8f61be2f Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1847495057 Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FloatingIPsNegativeTestJSON-1847495057-project Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 31086d36f05543779c053430a3dafb62 Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1847495057-project Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: {"pool": "non_exist_pool"} Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: exception: Floating IP pool not found. Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:13:41.342160 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:13:41.348211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 12 22:13:41.348211 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:41.353100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c32e7b39-7408-4320-8b0a-789793435705 tempest-FloatingIPsNegativeTestJSON-1847495057 tempest-FloatingIPsNegativeTestJSON-1847495057-project] Returning 404 to user: Floating IP pool not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:13:41.358355 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c32e7b39-7408-4320-8b0a-789793435705 tempest-FloatingIPsNegativeTestJSON-1847495057 tempest-FloatingIPsNegativeTestJSON-1847495057-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.072751 Oct 12 22:13:41.360460 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1969/3551] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 12 22:13:41 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:13:41.373746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5ea7e9d3-d624-49ab-a6d6-0ea487fe94f1 tempest-FloatingIPsNegativeTestJSON-1847495057 tempest-FloatingIPsNegativeTestJSON-1847495057-project] Calling method '.version_select at 0x7f51287c81f0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:41.421793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:41.649174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-48f4c2af-c41c-4ad5-bb95-24a0798e5e7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:41.666665 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-48f4c2af-c41c-4ad5-bb95-24a0798e5e7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1314 microversion: 2.1 time: 0.393243 Oct 12 22:13:41.675881 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1583/3552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:41 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:13:41.711426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fd052d83-da07-41c6-8cfd-e7359c819feb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:41.716005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fd052d83-da07-41c6-8cfd-e7359c819feb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:41.762473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd052d83-da07-41c6-8cfd-e7359c819feb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:41.765853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd052d83-da07-41c6-8cfd-e7359c819feb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:41.766411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd052d83-da07-41c6-8cfd-e7359c819feb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:41.767986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd052d83-da07-41c6-8cfd-e7359c819feb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:41.769673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd052d83-da07-41c6-8cfd-e7359c819feb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:41.770834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd052d83-da07-41c6-8cfd-e7359c819feb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:41.787764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-5ea7e9d3-d624-49ab-a6d6-0ea487fe94f1 tempest-FloatingIPsNegativeTestJSON-1847495057 tempest-FloatingIPsNegativeTestJSON-1847495057-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3a971fd2-edd3-43ee-a56c-30681cf6af95 could not be found", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:13:41.788551 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-5ea7e9d3-d624-49ab-a6d6-0ea487fe94f1 tempest-FloatingIPsNegativeTestJSON-1847495057 tempest-FloatingIPsNegativeTestJSON-1847495057-project] HTTP exception thrown: Floating IP not found for ID 3a971fd2-edd3-43ee-a56c-30681cf6af95 Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5ea7e9d3-d624-49ab-a6d6-0ea487fe94f1 tempest-FloatingIPsNegativeTestJSON-1847495057 tempest-FloatingIPsNegativeTestJSON-1847495057-project] Request method failure captured: Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/os-floating-ips/3a971fd2-edd3-43ee-a56c-30681cf6af95 HTTP/1.1 Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwTBOTLc0qVAR4z-j5wfud9EvA24PeZa4qTC7KjKlhqPOhQhOu124XZQEfUPaKiYPobKkNaUKGRbvXGPBbaGO3GiSuyAze2jGPDJsJ9L2PafkLGyAeXsP9hGJBwhPKRgfBLMfKvdPjVcNlQl3kBcCrTlIYq5Ak2V7Bx4apb9YiDrBI Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 895b6c66aa6443919d8c7d3f8f61be2f Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1847495057 Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/895b6c66aa6443919d8c7d3f8f61be2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/895b6c66aa6443919d8c7d3f8f61be2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_895b6c66aa6443919d8c7d3f8f61be2f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/895b6c66aa6443919d8c7d3f8f61be2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1847495057 Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 895b6c66aa6443919d8c7d3f8f61be2f Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1847495057 Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FloatingIPsNegativeTestJSON-1847495057-project Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 31086d36f05543779c053430a3dafb62 Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1847495057-project Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: exception: Floating IP not found for ID 3a971fd2-edd3-43ee-a56c-30681cf6af95 Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '3a971fd2-edd3-43ee-a56c-30681cf6af95'} Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3a971fd2-edd3-43ee-a56c-30681cf6af95 could not be found Oct 12 22:13:41.790645 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3674da90-d11d-4fb0-b36e-c7c2f8f52576'] Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3a971fd2-edd3-43ee-a56c-30681cf6af95. Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3a971fd2-edd3-43ee-a56c-30681cf6af95 Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3a971fd2-edd3-43ee-a56c-30681cf6af95 Oct 12 22:13:41.795344 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:13:41.800712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5ea7e9d3-d624-49ab-a6d6-0ea487fe94f1 tempest-FloatingIPsNegativeTestJSON-1847495057 tempest-FloatingIPsNegativeTestJSON-1847495057-project] Returning 404 to user: Floating IP not found for ID 3a971fd2-edd3-43ee-a56c-30681cf6af95 {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:13:41.801759 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5ea7e9d3-d624-49ab-a6d6-0ea487fe94f1 tempest-FloatingIPsNegativeTestJSON-1847495057 tempest-FloatingIPsNegativeTestJSON-1847495057-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/3a971fd2-edd3-43ee-a56c-30681cf6af95" status: 404 len: 111 microversion: 2.1 time: 0.434487 Oct 12 22:13:41.803061 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1970/3553] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:13:41 2022] DELETE /compute/v2.1/os-floating-ips/3a971fd2-edd3-43ee-a56c-30681cf6af95 => generated 111 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:13:41.988244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fd052d83-da07-41c6-8cfd-e7359c819feb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:41.999397 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fd052d83-da07-41c6-8cfd-e7359c819feb tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1211 microversion: 2.1 time: 0.318774 Oct 12 22:13:42.002224 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1584/3554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:41 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1211 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:42.696980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a5634a45-e520-4085-bd7d-3bea64c8c93a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:42.698728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a5634a45-e520-4085-bd7d-3bea64c8c93a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:42.719136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5634a45-e520-4085-bd7d-3bea64c8c93a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:42.720815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5634a45-e520-4085-bd7d-3bea64c8c93a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:42.721274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5634a45-e520-4085-bd7d-3bea64c8c93a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:42.723135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5634a45-e520-4085-bd7d-3bea64c8c93a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:42.724684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5634a45-e520-4085-bd7d-3bea64c8c93a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:42.726940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a5634a45-e520-4085-bd7d-3bea64c8c93a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:43.026935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9072fee9-bccc-431e-8cb0-0ddbd606457d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:43.027611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9072fee9-bccc-431e-8cb0-0ddbd606457d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:43.044853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9072fee9-bccc-431e-8cb0-0ddbd606457d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:43.046789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9072fee9-bccc-431e-8cb0-0ddbd606457d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:43.047502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9072fee9-bccc-431e-8cb0-0ddbd606457d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:43.055644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9072fee9-bccc-431e-8cb0-0ddbd606457d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:43.058125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9072fee9-bccc-431e-8cb0-0ddbd606457d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:43.059886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9072fee9-bccc-431e-8cb0-0ddbd606457d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:43.284987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9072fee9-bccc-431e-8cb0-0ddbd606457d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:43.298925 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9072fee9-bccc-431e-8cb0-0ddbd606457d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1273 microversion: 2.1 time: 0.277253 Oct 12 22:13:43.300474 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1585/3555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:43 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1273 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:13:43.944536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a5634a45-e520-4085-bd7d-3bea64c8c93a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:43.965884 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a5634a45-e520-4085-bd7d-3bea64c8c93a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1502 microversion: 2.1 time: 1.277610 Oct 12 22:13:43.967815 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1971/3556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:42 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1502 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:44.003588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f888aef8-b114-4a49-8369-4a4f4be510a3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:44.004241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f888aef8-b114-4a49-8369-4a4f4be510a3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:44.015546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f888aef8-b114-4a49-8369-4a4f4be510a3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:44.018187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f888aef8-b114-4a49-8369-4a4f4be510a3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:44.018829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f888aef8-b114-4a49-8369-4a4f4be510a3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:44.019747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f888aef8-b114-4a49-8369-4a4f4be510a3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:44.021571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f888aef8-b114-4a49-8369-4a4f4be510a3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:44.025288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f888aef8-b114-4a49-8369-4a4f4be510a3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:44.086162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-f888aef8-b114-4a49-8369-4a4f4be510a3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lazy-loading 'flavor' on Instance uuid 50994542-c3c0-46a4-b994-50c452999ba2 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:13:44.328540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-73fcee36-d68b-4018-a190-d55e0822b079 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:44.329425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-73fcee36-d68b-4018-a190-d55e0822b079 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:44.342553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73fcee36-d68b-4018-a190-d55e0822b079 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:44.344155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73fcee36-d68b-4018-a190-d55e0822b079 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:44.344820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73fcee36-d68b-4018-a190-d55e0822b079 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:44.346710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73fcee36-d68b-4018-a190-d55e0822b079 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:44.347563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73fcee36-d68b-4018-a190-d55e0822b079 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:44.348158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73fcee36-d68b-4018-a190-d55e0822b079 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:44.410692 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f888aef8-b114-4a49-8369-4a4f4be510a3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "POST /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2/action" status: 202 len: 0 microversion: 2.1 time: 0.412986 Oct 12 22:13:44.412125 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1586/3557] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:13:43 2022] POST /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:13:44.422184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9e9d4d24-8766-4cbd-a51b-b2433215d3fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:44.422694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9e9d4d24-8766-4cbd-a51b-b2433215d3fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:44.445438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e9d4d24-8766-4cbd-a51b-b2433215d3fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:44.448123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e9d4d24-8766-4cbd-a51b-b2433215d3fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:44.448571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e9d4d24-8766-4cbd-a51b-b2433215d3fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:44.449305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e9d4d24-8766-4cbd-a51b-b2433215d3fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:44.451454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e9d4d24-8766-4cbd-a51b-b2433215d3fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:44.452060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e9d4d24-8766-4cbd-a51b-b2433215d3fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:44.756676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-73fcee36-d68b-4018-a190-d55e0822b079 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:44.770842 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-73fcee36-d68b-4018-a190-d55e0822b079 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1273 microversion: 2.1 time: 0.450171 Oct 12 22:13:44.771476 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1972/3558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:44 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1273 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:45.021188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9e9d4d24-8766-4cbd-a51b-b2433215d3fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:45.030536 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9e9d4d24-8766-4cbd-a51b-b2433215d3fc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1508 microversion: 2.1 time: 0.614412 Oct 12 22:13:45.051329 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1587/3559] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:44 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1508 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:45.793525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-46402bb3-221a-4252-aadc-b666876a5eff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:45.794140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-46402bb3-221a-4252-aadc-b666876a5eff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:45.813329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=18 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:45.819450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46402bb3-221a-4252-aadc-b666876a5eff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:45.820200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46402bb3-221a-4252-aadc-b666876a5eff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:45.820806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46402bb3-221a-4252-aadc-b666876a5eff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:45.824237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46402bb3-221a-4252-aadc-b666876a5eff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:45.824896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46402bb3-221a-4252-aadc-b666876a5eff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:45.825749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46402bb3-221a-4252-aadc-b666876a5eff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:46.059936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0b7ea838-d870-4671-bbf7-8443b791e0b8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:46.060553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0b7ea838-d870-4671-bbf7-8443b791e0b8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:46.074103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b7ea838-d870-4671-bbf7-8443b791e0b8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:46.074498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b7ea838-d870-4671-bbf7-8443b791e0b8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:46.074936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b7ea838-d870-4671-bbf7-8443b791e0b8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:46.075675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b7ea838-d870-4671-bbf7-8443b791e0b8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:46.076126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b7ea838-d870-4671-bbf7-8443b791e0b8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:46.076556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b7ea838-d870-4671-bbf7-8443b791e0b8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:46.518492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0b7ea838-d870-4671-bbf7-8443b791e0b8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:46.536064 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0b7ea838-d870-4671-bbf7-8443b791e0b8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1508 microversion: 2.1 time: 0.479849 Oct 12 22:13:46.538524 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1588/3560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:46 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1508 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:46.554514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-46402bb3-221a-4252-aadc-b666876a5eff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:46.568083 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-46402bb3-221a-4252-aadc-b666876a5eff tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1315 microversion: 2.1 time: 0.778386 Oct 12 22:13:46.568689 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1973/3561] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:45 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1315 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:47.569077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3d7c3c79-a494-4852-80a9-c0870e7e7f88 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:47.569694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3d7c3c79-a494-4852-80a9-c0870e7e7f88 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:47.592334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-73814495-d073-4c38-ac55-465127647578 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:47.593072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-73814495-d073-4c38-ac55-465127647578 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:47.602814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d7c3c79-a494-4852-80a9-c0870e7e7f88 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:47.603340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d7c3c79-a494-4852-80a9-c0870e7e7f88 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:47.603779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d7c3c79-a494-4852-80a9-c0870e7e7f88 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:47.604495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d7c3c79-a494-4852-80a9-c0870e7e7f88 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:47.604950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d7c3c79-a494-4852-80a9-c0870e7e7f88 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:47.605376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d7c3c79-a494-4852-80a9-c0870e7e7f88 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:47.608926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73814495-d073-4c38-ac55-465127647578 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:47.616688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73814495-d073-4c38-ac55-465127647578 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:47.617318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73814495-d073-4c38-ac55-465127647578 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:47.620396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73814495-d073-4c38-ac55-465127647578 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:47.626401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73814495-d073-4c38-ac55-465127647578 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:47.627543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73814495-d073-4c38-ac55-465127647578 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:48.237776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-73814495-d073-4c38-ac55-465127647578 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:48.248449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:48.286369 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-73814495-d073-4c38-ac55-465127647578 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1315 microversion: 2.1 time: 0.697875 Oct 12 22:13:48.287596 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1974/3562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:47 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:13:48.461799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3d7c3c79-a494-4852-80a9-c0870e7e7f88 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:48.475492 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3d7c3c79-a494-4852-80a9-c0870e7e7f88 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1508 microversion: 2.1 time: 0.906664 Oct 12 22:13:48.476663 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1589/3563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:47 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1508 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:49.313097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-21781ead-7668-43ff-b624-73d2d27c0dc2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:49.313882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-21781ead-7668-43ff-b624-73d2d27c0dc2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:49.328541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21781ead-7668-43ff-b624-73d2d27c0dc2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:49.329767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21781ead-7668-43ff-b624-73d2d27c0dc2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:49.331807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21781ead-7668-43ff-b624-73d2d27c0dc2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:49.339586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21781ead-7668-43ff-b624-73d2d27c0dc2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:49.340329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21781ead-7668-43ff-b624-73d2d27c0dc2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:49.340987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21781ead-7668-43ff-b624-73d2d27c0dc2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:49.505060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-52d6cf0a-c301-4791-acef-3e7bbba6741e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:49.505688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-52d6cf0a-c301-4791-acef-3e7bbba6741e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:49.518688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52d6cf0a-c301-4791-acef-3e7bbba6741e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:49.519211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52d6cf0a-c301-4791-acef-3e7bbba6741e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:49.519698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52d6cf0a-c301-4791-acef-3e7bbba6741e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:49.522632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52d6cf0a-c301-4791-acef-3e7bbba6741e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:49.523146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52d6cf0a-c301-4791-acef-3e7bbba6741e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:49.523604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52d6cf0a-c301-4791-acef-3e7bbba6741e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:49.656210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:49.783064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-21781ead-7668-43ff-b624-73d2d27c0dc2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:49.792490 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-21781ead-7668-43ff-b624-73d2d27c0dc2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1315 microversion: 2.1 time: 0.483150 Oct 12 22:13:49.801009 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1975/3564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:49 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:50.416913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=34 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:50.830287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d09f2955-90de-4312-be4a-63041b83e2a2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:50.836143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d09f2955-90de-4312-be4a-63041b83e2a2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:50.860585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d09f2955-90de-4312-be4a-63041b83e2a2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:50.861782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d09f2955-90de-4312-be4a-63041b83e2a2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:50.864591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d09f2955-90de-4312-be4a-63041b83e2a2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:50.866823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d09f2955-90de-4312-be4a-63041b83e2a2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:50.867607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d09f2955-90de-4312-be4a-63041b83e2a2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:50.868275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d09f2955-90de-4312-be4a-63041b83e2a2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:51.458597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d09f2955-90de-4312-be4a-63041b83e2a2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:51.476698 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d09f2955-90de-4312-be4a-63041b83e2a2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1315 microversion: 2.1 time: 0.649218 Oct 12 22:13:51.499866 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1976/3565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:50 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1315 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:13:52.021812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-52d6cf0a-c301-4791-acef-3e7bbba6741e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:52.045858 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-52d6cf0a-c301-4791-acef-3e7bbba6741e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1508 microversion: 2.1 time: 2.545277 Oct 12 22:13:52.056008 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1590/3566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:49 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1508 bytes in 2556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:52.502493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bb92f694-30a5-48e2-a2dd-a691eca24dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:52.503116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bb92f694-30a5-48e2-a2dd-a691eca24dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:52.517904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb92f694-30a5-48e2-a2dd-a691eca24dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:52.518416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb92f694-30a5-48e2-a2dd-a691eca24dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:52.518822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb92f694-30a5-48e2-a2dd-a691eca24dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:52.519570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb92f694-30a5-48e2-a2dd-a691eca24dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:52.520025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb92f694-30a5-48e2-a2dd-a691eca24dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:52.528598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb92f694-30a5-48e2-a2dd-a691eca24dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:52.917085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bb92f694-30a5-48e2-a2dd-a691eca24dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:52.927437 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bb92f694-30a5-48e2-a2dd-a691eca24dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1315 microversion: 2.1 time: 0.429311 Oct 12 22:13:52.928184 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1977/3567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:52 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:53.075031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e786df12-1210-49a6-ac47-46cafddde63f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:53.076595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e786df12-1210-49a6-ac47-46cafddde63f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:53.094041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e786df12-1210-49a6-ac47-46cafddde63f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:53.105466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e786df12-1210-49a6-ac47-46cafddde63f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:53.110429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e786df12-1210-49a6-ac47-46cafddde63f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:53.114969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e786df12-1210-49a6-ac47-46cafddde63f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:53.117596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e786df12-1210-49a6-ac47-46cafddde63f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:53.119059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e786df12-1210-49a6-ac47-46cafddde63f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:53.455446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-958356599", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "4c7ece18-e66a-43bb-9b96-c723ee75dc53"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:53.572400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] validate_networks() for [('4c7ece18-e66a-43bb-9b96-c723ee75dc53', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:13:53.782338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e786df12-1210-49a6-ac47-46cafddde63f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:53.794718 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e786df12-1210-49a6-ac47-46cafddde63f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1508 microversion: 2.1 time: 0.724325 Oct 12 22:13:53.796515 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1591/3568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:53 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1508 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:53.803740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-c5c36be2-3221-46a5-9446-ade453028d18 req-a170c390-1fc3-4cf9-800c-068959cfc65f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa125a5f-e370-48e8-ab9b-64f8f10bc1ac", "tag": "d471c95a-42c6-4ec1-adc0-1382973e1381"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:53.815565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c5c36be2-3221-46a5-9446-ade453028d18 req-a170c390-1fc3-4cf9-800c-068959cfc65f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:53.817677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c5c36be2-3221-46a5-9446-ade453028d18 req-a170c390-1fc3-4cf9-800c-068959cfc65f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:53.818513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c5c36be2-3221-46a5-9446-ade453028d18 req-a170c390-1fc3-4cf9-800c-068959cfc65f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:53.834252 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-c5c36be2-3221-46a5-9446-ade453028d18 req-a170c390-1fc3-4cf9-800c-068959cfc65f service nova] Creating event network-changed:d471c95a-42c6-4ec1-adc0-1382973e1381 for instance aa125a5f-e370-48e8-ab9b-64f8f10bc1ac on n-h1-861111-1 Oct 12 22:13:53.842702 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-c5c36be2-3221-46a5-9446-ade453028d18 req-a170c390-1fc3-4cf9-800c-068959cfc65f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044060 Oct 12 22:13:53.844802 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1592/3569] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:53.954767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1fb0bf91-ba56-4dfb-a302-55ff580501f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:53.955369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1fb0bf91-ba56-4dfb-a302-55ff580501f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:53.965320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fb0bf91-ba56-4dfb-a302-55ff580501f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:53.965822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fb0bf91-ba56-4dfb-a302-55ff580501f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:53.966283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fb0bf91-ba56-4dfb-a302-55ff580501f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:53.967006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fb0bf91-ba56-4dfb-a302-55ff580501f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:53.967495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fb0bf91-ba56-4dfb-a302-55ff580501f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:53.967966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fb0bf91-ba56-4dfb-a302-55ff580501f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:54.573468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:13:54.575520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:13:54.576384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:13:54.577012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:13:54.577654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:13:54.591887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:54.593514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:54.594848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:54.598240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:54.598972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:54.599663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:54.654400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Getting quotas for project 5a107edadb364defb4f2c408969c097c. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:13:54.667609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1fb0bf91-ba56-4dfb-a302-55ff580501f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:54.701648 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1fb0bf91-ba56-4dfb-a302-55ff580501f3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1315 microversion: 2.1 time: 0.751577 Oct 12 22:13:54.705564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Getting quotas for user a2c263e74d274bef8094b9d7ecfc820b and project 5a107edadb364defb4f2c408969c097c. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:13:54.728152 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1593/3570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:53 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1315 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:54.752787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:13:54.765578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:13:54.859592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-15ba9ce7-3ced-4708-bdd7-f2ebc9792b28 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:54.862022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-15ba9ce7-3ced-4708-bdd7-f2ebc9792b28 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:54.871142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15ba9ce7-3ced-4708-bdd7-f2ebc9792b28 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:54.872589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15ba9ce7-3ced-4708-bdd7-f2ebc9792b28 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:54.873384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15ba9ce7-3ced-4708-bdd7-f2ebc9792b28 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:54.874462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15ba9ce7-3ced-4708-bdd7-f2ebc9792b28 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:54.875537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15ba9ce7-3ced-4708-bdd7-f2ebc9792b28 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:54.876320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15ba9ce7-3ced-4708-bdd7-f2ebc9792b28 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:54.962310 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-367eaf1a-3a04-433c-9294-70672e056e99 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.809562 Oct 12 22:13:54.964068 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1978/3571] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:13:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:13:54.974805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-df2e39e7-eb65-4d0a-9136-24370d316c00 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:54.977785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-df2e39e7-eb65-4d0a-9136-24370d316c00 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:55.089538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-df2e39e7-eb65-4d0a-9136-24370d316c00 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:55.100672 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-df2e39e7-eb65-4d0a-9136-24370d316c00 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1224 microversion: 2.1 time: 0.126813 Oct 12 22:13:55.103053 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1979/3572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:54 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1224 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:55.308816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-46ed085d-ac25-4d44-b503-a0ad3bda2dcb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:55.309982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-46ed085d-ac25-4d44-b503-a0ad3bda2dcb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:55.328950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46ed085d-ac25-4d44-b503-a0ad3bda2dcb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:55.330072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46ed085d-ac25-4d44-b503-a0ad3bda2dcb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:55.336986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46ed085d-ac25-4d44-b503-a0ad3bda2dcb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:55.338183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46ed085d-ac25-4d44-b503-a0ad3bda2dcb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:55.341739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46ed085d-ac25-4d44-b503-a0ad3bda2dcb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:55.343598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-46ed085d-ac25-4d44-b503-a0ad3bda2dcb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:55.591046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-46ed085d-ac25-4d44-b503-a0ad3bda2dcb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lazy-loading 'services' on Instance uuid feeebc28-6cfd-4f7d-8e32-d725731d0ba3 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:13:55.706758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-15ba9ce7-3ced-4708-bdd7-f2ebc9792b28 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:55.720692 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-15ba9ce7-3ced-4708-bdd7-f2ebc9792b28 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1508 microversion: 2.1 time: 0.890867 Oct 12 22:13:55.724491 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1594/3573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:54 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1508 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:55.748325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cc9150b2-ab0a-423b-bcbf-576a1cda2a98 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:55.750791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cc9150b2-ab0a-423b-bcbf-576a1cda2a98 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:55.770517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc9150b2-ab0a-423b-bcbf-576a1cda2a98 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:55.771335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc9150b2-ab0a-423b-bcbf-576a1cda2a98 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:55.772011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc9150b2-ab0a-423b-bcbf-576a1cda2a98 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:55.772928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc9150b2-ab0a-423b-bcbf-576a1cda2a98 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:55.779367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc9150b2-ab0a-423b-bcbf-576a1cda2a98 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:55.780476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc9150b2-ab0a-423b-bcbf-576a1cda2a98 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:55.811748 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-46ed085d-ac25-4d44-b503-a0ad3bda2dcb tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "DELETE /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments/27090350-78f8-4a6a-81de-d95fc59a58ca" status: 202 len: 0 microversion: 2.1 time: 0.515181 Oct 12 22:13:55.821469 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1980/3574] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 22:13:55 2022] DELETE /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments/27090350-78f8-4a6a-81de-d95fc59a58ca => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:13:55.848678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-047776f1-d8ea-4592-9f32-ea6615f1001b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:55.859463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-047776f1-d8ea-4592-9f32-ea6615f1001b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:55.893271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-047776f1-d8ea-4592-9f32-ea6615f1001b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:55.896972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-047776f1-d8ea-4592-9f32-ea6615f1001b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:55.897747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-047776f1-d8ea-4592-9f32-ea6615f1001b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:55.900553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-047776f1-d8ea-4592-9f32-ea6615f1001b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:55.901048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-047776f1-d8ea-4592-9f32-ea6615f1001b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:55.905067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-047776f1-d8ea-4592-9f32-ea6615f1001b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:56.024226 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-047776f1-d8ea-4592-9f32-ea6615f1001b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200358 Oct 12 22:13:56.030575 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1981/3575] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:13:55 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:56.130555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2a1869d4-e78f-4dac-8d0b-3dd35afe303c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:56.131866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2a1869d4-e78f-4dac-8d0b-3dd35afe303c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:56.148312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1869d4-e78f-4dac-8d0b-3dd35afe303c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:56.148990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1869d4-e78f-4dac-8d0b-3dd35afe303c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:56.151788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1869d4-e78f-4dac-8d0b-3dd35afe303c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:56.153183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1869d4-e78f-4dac-8d0b-3dd35afe303c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:56.155501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1869d4-e78f-4dac-8d0b-3dd35afe303c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:56.158485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1869d4-e78f-4dac-8d0b-3dd35afe303c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:56.162557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cc9150b2-ab0a-423b-bcbf-576a1cda2a98 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:56.210422 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cc9150b2-ab0a-423b-bcbf-576a1cda2a98 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1315 microversion: 2.1 time: 0.479387 Oct 12 22:13:56.213235 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1595/3576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:55 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:56.328670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2a1869d4-e78f-4dac-8d0b-3dd35afe303c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:56.353067 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2a1869d4-e78f-4dac-8d0b-3dd35afe303c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1228 microversion: 2.1 time: 0.227537 Oct 12 22:13:56.354126 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1982/3577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:56 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1228 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:56.752830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b9e4a5d6-fd56-4623-a839-23bff96b1f64 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:56.753413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b9e4a5d6-fd56-4623-a839-23bff96b1f64 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:56.769958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9e4a5d6-fd56-4623-a839-23bff96b1f64 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:56.771566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9e4a5d6-fd56-4623-a839-23bff96b1f64 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:56.773970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9e4a5d6-fd56-4623-a839-23bff96b1f64 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:56.774973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9e4a5d6-fd56-4623-a839-23bff96b1f64 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:56.776620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9e4a5d6-fd56-4623-a839-23bff96b1f64 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:56.778853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9e4a5d6-fd56-4623-a839-23bff96b1f64 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:56.826455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2073844102", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "c7dc26d4-2a62-4792-b299-a59c618c0313"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:13:56.914932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] validate_networks() for [('c7dc26d4-2a62-4792-b299-a59c618c0313', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:13:57.110584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b9e4a5d6-fd56-4623-a839-23bff96b1f64 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:57.120751 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b9e4a5d6-fd56-4623-a839-23bff96b1f64 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1508 microversion: 2.1 time: 0.372494 Oct 12 22:13:57.121847 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1983/3578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:56 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1508 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:57.128383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7500a578-38ce-498b-a66a-4bdc138c1cb9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:57.130778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7500a578-38ce-498b-a66a-4bdc138c1cb9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:57.172247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7500a578-38ce-498b-a66a-4bdc138c1cb9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:57.173095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7500a578-38ce-498b-a66a-4bdc138c1cb9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:57.174263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7500a578-38ce-498b-a66a-4bdc138c1cb9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:57.175164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7500a578-38ce-498b-a66a-4bdc138c1cb9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:57.175795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7500a578-38ce-498b-a66a-4bdc138c1cb9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:57.176381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7500a578-38ce-498b-a66a-4bdc138c1cb9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:57.220644 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7500a578-38ce-498b-a66a-4bdc138c1cb9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096899 Oct 12 22:13:57.222170 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1984/3579] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:13:57 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:57.237782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-39b3ed31-0cd4-4821-a145-a836c4abec24 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:57.238470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-39b3ed31-0cd4-4821-a145-a836c4abec24 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:57.265517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39b3ed31-0cd4-4821-a145-a836c4abec24 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:57.266020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39b3ed31-0cd4-4821-a145-a836c4abec24 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:57.271845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39b3ed31-0cd4-4821-a145-a836c4abec24 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:57.272796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39b3ed31-0cd4-4821-a145-a836c4abec24 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:57.273911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39b3ed31-0cd4-4821-a145-a836c4abec24 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:57.274358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39b3ed31-0cd4-4821-a145-a836c4abec24 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:57.585356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-39b3ed31-0cd4-4821-a145-a836c4abec24 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:57.593814 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-39b3ed31-0cd4-4821-a145-a836c4abec24 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1315 microversion: 2.1 time: 0.360637 Oct 12 22:13:57.603622 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1985/3580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:57 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:57.608384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-79b1dc08-a1e0-4955-a38f-5d71c23d4683 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:57.609002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-79b1dc08-a1e0-4955-a38f-5d71c23d4683 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:57.633781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b1dc08-a1e0-4955-a38f-5d71c23d4683 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:57.634692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b1dc08-a1e0-4955-a38f-5d71c23d4683 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:57.635461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b1dc08-a1e0-4955-a38f-5d71c23d4683 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:57.636347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b1dc08-a1e0-4955-a38f-5d71c23d4683 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:57.637014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b1dc08-a1e0-4955-a38f-5d71c23d4683 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:57.637595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b1dc08-a1e0-4955-a38f-5d71c23d4683 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:57.764034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-79b1dc08-a1e0-4955-a38f-5d71c23d4683 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:57.780630 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-79b1dc08-a1e0-4955-a38f-5d71c23d4683 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1282 microversion: 2.1 time: 0.172906 Oct 12 22:13:57.783838 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1986/3581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:57 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1282 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:13:58.149970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-553c0a0b-7111-46b7-86d4-3f8351ddcd07 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:58.150883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-553c0a0b-7111-46b7-86d4-3f8351ddcd07 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:58.168890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-553c0a0b-7111-46b7-86d4-3f8351ddcd07 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:58.169397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-553c0a0b-7111-46b7-86d4-3f8351ddcd07 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:58.172036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-553c0a0b-7111-46b7-86d4-3f8351ddcd07 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:58.172798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-553c0a0b-7111-46b7-86d4-3f8351ddcd07 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:58.173308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-553c0a0b-7111-46b7-86d4-3f8351ddcd07 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:58.173747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-553c0a0b-7111-46b7-86d4-3f8351ddcd07 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:58.822055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:13:58.822660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:13:58.823232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:13:58.823856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:13:58.824423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:13:58.830334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:13:58.842184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:58.846522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:58.848402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:58.851828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:58.852522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:58.852663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-553c0a0b-7111-46b7-86d4-3f8351ddcd07 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:13:58.853608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:58.863120 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-553c0a0b-7111-46b7-86d4-3f8351ddcd07 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1508 microversion: 2.1 time: 0.717710 Oct 12 22:13:58.871850 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1987/3582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:58 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1508 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:13:58.892954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f5e960de-93b0-4495-ae1e-cbc2cad03bf5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:58.897629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f5e960de-93b0-4495-ae1e-cbc2cad03bf5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:58.898000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Getting quotas for project 8adffdfcc17442a88c91f6804787279a. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:13:58.910996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Getting quotas for user 06066387f835419c914fa6bebf0f3411 and project 8adffdfcc17442a88c91f6804787279a. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:13:58.919682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5e960de-93b0-4495-ae1e-cbc2cad03bf5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:58.934171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5e960de-93b0-4495-ae1e-cbc2cad03bf5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:58.938003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:13:58.938717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5e960de-93b0-4495-ae1e-cbc2cad03bf5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:58.939688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5e960de-93b0-4495-ae1e-cbc2cad03bf5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:58.940284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5e960de-93b0-4495-ae1e-cbc2cad03bf5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:58.940847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5e960de-93b0-4495-ae1e-cbc2cad03bf5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:58.944403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:13:59.051052 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fe1f2394-aacd-4893-93e3-fad0b9eeb98c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.714819 Oct 12 22:13:59.055559 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1596/3583] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:13:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:13:59.062817 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f5e960de-93b0-4495-ae1e-cbc2cad03bf5 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178397 Oct 12 22:13:59.071232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-53e92d6d-97ad-4ae0-a15b-48d1760d2985 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:59.076156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-53e92d6d-97ad-4ae0-a15b-48d1760d2985 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:59.084972 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1988/3584] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:13:58 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:13:59.099904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-59103789-9676-46ec-a615-d4a482e3a481 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:13:59.100541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-59103789-9676-46ec-a615-d4a482e3a481 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:13:59.104262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53e92d6d-97ad-4ae0-a15b-48d1760d2985 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:59.106328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53e92d6d-97ad-4ae0-a15b-48d1760d2985 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:59.106937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53e92d6d-97ad-4ae0-a15b-48d1760d2985 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:59.109931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53e92d6d-97ad-4ae0-a15b-48d1760d2985 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:59.110559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53e92d6d-97ad-4ae0-a15b-48d1760d2985 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:59.111975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53e92d6d-97ad-4ae0-a15b-48d1760d2985 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:59.117858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59103789-9676-46ec-a615-d4a482e3a481 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:59.118368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59103789-9676-46ec-a615-d4a482e3a481 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:59.118817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59103789-9676-46ec-a615-d4a482e3a481 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:13:59.124870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59103789-9676-46ec-a615-d4a482e3a481 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:13:59.125918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59103789-9676-46ec-a615-d4a482e3a481 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:13:59.127129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59103789-9676-46ec-a615-d4a482e3a481 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:00.001701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-59103789-9676-46ec-a615-d4a482e3a481 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:00.013853 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-59103789-9676-46ec-a615-d4a482e3a481 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1282 microversion: 2.1 time: 0.927358 Oct 12 22:14:00.019651 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1989/3585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:59 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1282 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:00.037908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3407ab6c-225c-4e9b-a6e3-76c124409e29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:00.046090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3407ab6c-225c-4e9b-a6e3-76c124409e29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:00.120711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3407ab6c-225c-4e9b-a6e3-76c124409e29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:00.121505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3407ab6c-225c-4e9b-a6e3-76c124409e29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:00.122176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3407ab6c-225c-4e9b-a6e3-76c124409e29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:00.123787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3407ab6c-225c-4e9b-a6e3-76c124409e29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:00.124486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3407ab6c-225c-4e9b-a6e3-76c124409e29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:00.125421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3407ab6c-225c-4e9b-a6e3-76c124409e29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:00.426376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3407ab6c-225c-4e9b-a6e3-76c124409e29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:00.451203 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3407ab6c-225c-4e9b-a6e3-76c124409e29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1222 microversion: 2.1 time: 0.423028 Oct 12 22:14:00.452764 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1990/3586] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:00 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1222 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:00.463070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-53e92d6d-97ad-4ae0-a15b-48d1760d2985 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:00.469718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-227779d8-4aae-499e-a430-df063fe63ab3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:00.471325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-227779d8-4aae-499e-a430-df063fe63ab3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:00.474482 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-53e92d6d-97ad-4ae0-a15b-48d1760d2985 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1315 microversion: 2.1 time: 1.414767 Oct 12 22:14:00.475893 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1597/3587] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:13:59 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1315 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:00.486238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-39962c2f-061c-4cc8-ba91-38779fc5ca2e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:00.492696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-39962c2f-061c-4cc8-ba91-38779fc5ca2e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:00.507000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39962c2f-061c-4cc8-ba91-38779fc5ca2e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:00.509539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-227779d8-4aae-499e-a430-df063fe63ab3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:00.516193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-227779d8-4aae-499e-a430-df063fe63ab3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:00.516193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-227779d8-4aae-499e-a430-df063fe63ab3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:00.517393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39962c2f-061c-4cc8-ba91-38779fc5ca2e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:00.518022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39962c2f-061c-4cc8-ba91-38779fc5ca2e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:00.522978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-227779d8-4aae-499e-a430-df063fe63ab3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:00.524477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-227779d8-4aae-499e-a430-df063fe63ab3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:00.526003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-227779d8-4aae-499e-a430-df063fe63ab3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:00.532289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39962c2f-061c-4cc8-ba91-38779fc5ca2e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:00.533514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39962c2f-061c-4cc8-ba91-38779fc5ca2e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:00.535203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39962c2f-061c-4cc8-ba91-38779fc5ca2e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:00.710545 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-39962c2f-061c-4cc8-ba91-38779fc5ca2e tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.233483 Oct 12 22:14:00.723776 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1598/3588] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:14:00 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments => generated 197 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:01.046024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b6bf01dd-fee9-4b62-aec8-2a53f290223c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:01.046667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b6bf01dd-fee9-4b62-aec8-2a53f290223c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:01.056618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6bf01dd-fee9-4b62-aec8-2a53f290223c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:01.057127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6bf01dd-fee9-4b62-aec8-2a53f290223c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:01.057583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6bf01dd-fee9-4b62-aec8-2a53f290223c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:01.058316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6bf01dd-fee9-4b62-aec8-2a53f290223c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:01.058778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6bf01dd-fee9-4b62-aec8-2a53f290223c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:01.059213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6bf01dd-fee9-4b62-aec8-2a53f290223c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:01.126027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-227779d8-4aae-499e-a430-df063fe63ab3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:01.129641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:01.149256 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-227779d8-4aae-499e-a430-df063fe63ab3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1508 microversion: 2.1 time: 0.687122 Oct 12 22:14:01.164242 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1991/3589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:00 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1508 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:01.425667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b6bf01dd-fee9-4b62-aec8-2a53f290223c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:01.448370 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b6bf01dd-fee9-4b62-aec8-2a53f290223c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1324 microversion: 2.1 time: 0.408121 Oct 12 22:14:01.452975 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1599/3590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:01 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1324 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:01.479158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-65292d10-54a5-4880-ba67-a86676ed88ee tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:01.481200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-65292d10-54a5-4880-ba67-a86676ed88ee tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:01.488840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65292d10-54a5-4880-ba67-a86676ed88ee tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:01.490139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65292d10-54a5-4880-ba67-a86676ed88ee tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:01.490790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65292d10-54a5-4880-ba67-a86676ed88ee tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:01.492248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65292d10-54a5-4880-ba67-a86676ed88ee tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:01.493355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65292d10-54a5-4880-ba67-a86676ed88ee tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:01.493964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65292d10-54a5-4880-ba67-a86676ed88ee tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:01.503827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1447296e-7a80-40ae-a1d1-e5f367614710 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:01.505061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1447296e-7a80-40ae-a1d1-e5f367614710 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:01.515951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1447296e-7a80-40ae-a1d1-e5f367614710 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:01.518436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1447296e-7a80-40ae-a1d1-e5f367614710 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:01.519104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1447296e-7a80-40ae-a1d1-e5f367614710 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:01.523696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1447296e-7a80-40ae-a1d1-e5f367614710 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:01.525792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1447296e-7a80-40ae-a1d1-e5f367614710 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:01.526446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1447296e-7a80-40ae-a1d1-e5f367614710 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:01.551010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:01.732354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-65292d10-54a5-4880-ba67-a86676ed88ee tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:01.756677 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-65292d10-54a5-4880-ba67-a86676ed88ee tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1278 microversion: 2.1 time: 0.272812 Oct 12 22:14:01.771280 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1992/3591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:01 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1278 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:01.781462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f11d0457-c877-4ed1-a493-867f1f5ef2f4 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:01.798403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f11d0457-c877-4ed1-a493-867f1f5ef2f4 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:01.817148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f11d0457-c877-4ed1-a493-867f1f5ef2f4 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:01.817694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f11d0457-c877-4ed1-a493-867f1f5ef2f4 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:01.821798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f11d0457-c877-4ed1-a493-867f1f5ef2f4 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:01.823516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f11d0457-c877-4ed1-a493-867f1f5ef2f4 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:01.824271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f11d0457-c877-4ed1-a493-867f1f5ef2f4 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:01.825931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f11d0457-c877-4ed1-a493-867f1f5ef2f4 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:01.930030 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f11d0457-c877-4ed1-a493-867f1f5ef2f4 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170148 Oct 12 22:14:01.930826 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1993/3592] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:14:01 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:02.194328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b0af4ce-aff8-410f-92ea-77755f6517d1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:02.195734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8b0af4ce-aff8-410f-92ea-77755f6517d1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:02.208120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b0af4ce-aff8-410f-92ea-77755f6517d1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:02.208872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b0af4ce-aff8-410f-92ea-77755f6517d1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:02.211041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b0af4ce-aff8-410f-92ea-77755f6517d1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:02.212188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b0af4ce-aff8-410f-92ea-77755f6517d1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:02.222154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b0af4ce-aff8-410f-92ea-77755f6517d1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:02.223309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b0af4ce-aff8-410f-92ea-77755f6517d1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:02.569842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b0af4ce-aff8-410f-92ea-77755f6517d1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:02.584823 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8b0af4ce-aff8-410f-92ea-77755f6517d1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1508 microversion: 2.1 time: 0.395057 Oct 12 22:14:02.604762 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1994/3593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:02 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1508 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:14:02.619606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b419f86e-f628-4a5e-95b1-10c3261102ff tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:02.620994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b419f86e-f628-4a5e-95b1-10c3261102ff tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:02.627840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1447296e-7a80-40ae-a1d1-e5f367614710 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:02.641137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b419f86e-f628-4a5e-95b1-10c3261102ff tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:02.643407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b419f86e-f628-4a5e-95b1-10c3261102ff tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:02.644278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b419f86e-f628-4a5e-95b1-10c3261102ff tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:02.648293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b419f86e-f628-4a5e-95b1-10c3261102ff tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:02.649004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b419f86e-f628-4a5e-95b1-10c3261102ff tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:02.649502 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1447296e-7a80-40ae-a1d1-e5f367614710 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1315 microversion: 2.1 time: 1.150837 Oct 12 22:14:02.650375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b419f86e-f628-4a5e-95b1-10c3261102ff tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:02.651140 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1600/3594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:01 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1315 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:02.795759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-20dfd021-12cb-46d7-a3ba-0d199e0b05c1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:02.796640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-20dfd021-12cb-46d7-a3ba-0d199e0b05c1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:02.809522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20dfd021-12cb-46d7-a3ba-0d199e0b05c1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:02.816662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20dfd021-12cb-46d7-a3ba-0d199e0b05c1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:02.818731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20dfd021-12cb-46d7-a3ba-0d199e0b05c1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:02.825833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20dfd021-12cb-46d7-a3ba-0d199e0b05c1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:02.828772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20dfd021-12cb-46d7-a3ba-0d199e0b05c1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:02.831825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20dfd021-12cb-46d7-a3ba-0d199e0b05c1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:03.206025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-20dfd021-12cb-46d7-a3ba-0d199e0b05c1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:03.224364 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-20dfd021-12cb-46d7-a3ba-0d199e0b05c1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1276 microversion: 2.1 time: 0.437950 Oct 12 22:14:03.225399 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1601/3595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:02 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1276 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:03.245747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ca903321-0d59-423e-9c7c-748e04d43c22 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:03.256586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b419f86e-f628-4a5e-95b1-10c3261102ff tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:03.266284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ca903321-0d59-423e-9c7c-748e04d43c22 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:03.271337 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b419f86e-f628-4a5e-95b1-10c3261102ff tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1324 microversion: 2.1 time: 0.662104 Oct 12 22:14:03.274402 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1995/3596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:02 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1324 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:03.285375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca903321-0d59-423e-9c7c-748e04d43c22 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:03.285890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca903321-0d59-423e-9c7c-748e04d43c22 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:03.286354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca903321-0d59-423e-9c7c-748e04d43c22 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:03.287063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca903321-0d59-423e-9c7c-748e04d43c22 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:03.287548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca903321-0d59-423e-9c7c-748e04d43c22 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:03.287982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca903321-0d59-423e-9c7c-748e04d43c22 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:03.374297 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ca903321-0d59-423e-9c7c-748e04d43c22 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145890 Oct 12 22:14:03.374907 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1602/3597] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:14:03 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:03.618936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-30a9f969-af84-4d06-972b-545ddd707f53 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:03.619951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-30a9f969-af84-4d06-972b-545ddd707f53 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:03.634726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30a9f969-af84-4d06-972b-545ddd707f53 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:03.638734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30a9f969-af84-4d06-972b-545ddd707f53 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:03.640725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30a9f969-af84-4d06-972b-545ddd707f53 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:03.642737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30a9f969-af84-4d06-972b-545ddd707f53 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:03.644915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30a9f969-af84-4d06-972b-545ddd707f53 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:03.645633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30a9f969-af84-4d06-972b-545ddd707f53 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:03.658816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-3cfbb611-46c6-45ac-8aeb-7da6cd59b27e req-b0bc1e10-dc0a-416f-941d-5090ae99c6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa125a5f-e370-48e8-ab9b-64f8f10bc1ac", "name": "network-vif-plugged", "status": "completed", "tag": "d471c95a-42c6-4ec1-adc0-1382973e1381"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:03.676705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3cfbb611-46c6-45ac-8aeb-7da6cd59b27e req-b0bc1e10-dc0a-416f-941d-5090ae99c6a6 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:03.677465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3cfbb611-46c6-45ac-8aeb-7da6cd59b27e req-b0bc1e10-dc0a-416f-941d-5090ae99c6a6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:03.678066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3cfbb611-46c6-45ac-8aeb-7da6cd59b27e req-b0bc1e10-dc0a-416f-941d-5090ae99c6a6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:03.725363 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-3cfbb611-46c6-45ac-8aeb-7da6cd59b27e req-b0bc1e10-dc0a-416f-941d-5090ae99c6a6 service nova] Creating event network-vif-plugged:d471c95a-42c6-4ec1-adc0-1382973e1381 for instance aa125a5f-e370-48e8-ab9b-64f8f10bc1ac on n-h1-861111-1 Oct 12 22:14:03.746629 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-3cfbb611-46c6-45ac-8aeb-7da6cd59b27e req-b0bc1e10-dc0a-416f-941d-5090ae99c6a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090351 Oct 12 22:14:03.748992 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1603/3598] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:14:03.780055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-03fa85d1-a7a8-4c1c-a822-1f0b84c7dae3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:03.785120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-03fa85d1-a7a8-4c1c-a822-1f0b84c7dae3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:03.804617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03fa85d1-a7a8-4c1c-a822-1f0b84c7dae3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:03.807119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03fa85d1-a7a8-4c1c-a822-1f0b84c7dae3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:03.807791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03fa85d1-a7a8-4c1c-a822-1f0b84c7dae3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:03.808707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03fa85d1-a7a8-4c1c-a822-1f0b84c7dae3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:03.810813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03fa85d1-a7a8-4c1c-a822-1f0b84c7dae3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:03.826056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03fa85d1-a7a8-4c1c-a822-1f0b84c7dae3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:04.274227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-30a9f969-af84-4d06-972b-545ddd707f53 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:04.285981 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-30a9f969-af84-4d06-972b-545ddd707f53 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1508 microversion: 2.1 time: 0.671968 Oct 12 22:14:04.292002 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1996/3599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:03 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1508 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:04.298223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e66f0454-e243-4c8f-80fd-57747a113129 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:04.304132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e66f0454-e243-4c8f-80fd-57747a113129 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:04.322346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e66f0454-e243-4c8f-80fd-57747a113129 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:04.323159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e66f0454-e243-4c8f-80fd-57747a113129 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:04.323907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e66f0454-e243-4c8f-80fd-57747a113129 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:04.324823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e66f0454-e243-4c8f-80fd-57747a113129 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:04.325462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e66f0454-e243-4c8f-80fd-57747a113129 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:04.326640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e66f0454-e243-4c8f-80fd-57747a113129 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:04.498226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e66f0454-e243-4c8f-80fd-57747a113129 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:04.512707 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e66f0454-e243-4c8f-80fd-57747a113129 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1276 microversion: 2.1 time: 0.216819 Oct 12 22:14:04.514081 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1997/3600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:04 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1276 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:04.527651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5520f992-ecdb-43df-a223-8b472305d094 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:04.528871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5520f992-ecdb-43df-a223-8b472305d094 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:04.546818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5520f992-ecdb-43df-a223-8b472305d094 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:04.549516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5520f992-ecdb-43df-a223-8b472305d094 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:04.550386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5520f992-ecdb-43df-a223-8b472305d094 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:04.553063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5520f992-ecdb-43df-a223-8b472305d094 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:04.553798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5520f992-ecdb-43df-a223-8b472305d094 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:04.556569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5520f992-ecdb-43df-a223-8b472305d094 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:04.619058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:04.825196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-03fa85d1-a7a8-4c1c-a822-1f0b84c7dae3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:04.850174 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-03fa85d1-a7a8-4c1c-a822-1f0b84c7dae3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1315 microversion: 2.1 time: 1.089427 Oct 12 22:14:04.852784 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1604/3601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:03 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1315 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:04.860015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9e6c4a3e-6eef-4578-861f-8e54c45168f3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:04.864934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9e6c4a3e-6eef-4578-861f-8e54c45168f3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:04.874904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e6c4a3e-6eef-4578-861f-8e54c45168f3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:04.875563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e6c4a3e-6eef-4578-861f-8e54c45168f3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:04.877409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e6c4a3e-6eef-4578-861f-8e54c45168f3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:04.878222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e6c4a3e-6eef-4578-861f-8e54c45168f3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:04.878758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e6c4a3e-6eef-4578-861f-8e54c45168f3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:04.879615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e6c4a3e-6eef-4578-861f-8e54c45168f3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:04.935024 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9e6c4a3e-6eef-4578-861f-8e54c45168f3 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080511 Oct 12 22:14:04.935986 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1605/3602] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:14:04 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:04.944944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-122af818-ecf0-4244-8463-e5ac5e80b558 req-1488430f-611a-4239-bc3e-46761206e20f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "722e8b56-e78f-4dde-af24-cee1dad1be26", "tag": "d849caef-b316-4cf0-8a97-f0b2d339596f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:04.957070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-122af818-ecf0-4244-8463-e5ac5e80b558 req-1488430f-611a-4239-bc3e-46761206e20f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:04.958498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-122af818-ecf0-4244-8463-e5ac5e80b558 req-1488430f-611a-4239-bc3e-46761206e20f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:04.959267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-122af818-ecf0-4244-8463-e5ac5e80b558 req-1488430f-611a-4239-bc3e-46761206e20f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:04.976967 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-122af818-ecf0-4244-8463-e5ac5e80b558 req-1488430f-611a-4239-bc3e-46761206e20f service nova] Creating event network-changed:d849caef-b316-4cf0-8a97-f0b2d339596f for instance 722e8b56-e78f-4dde-af24-cee1dad1be26 on n-h2-861111-1 Oct 12 22:14:04.981645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5520f992-ecdb-43df-a223-8b472305d094 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:04.984462 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-122af818-ecf0-4244-8463-e5ac5e80b558 req-1488430f-611a-4239-bc3e-46761206e20f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045972 Oct 12 22:14:04.986265 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1606/3603] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:04.990304 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5520f992-ecdb-43df-a223-8b472305d094 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1324 microversion: 2.1 time: 0.474850 Oct 12 22:14:04.993137 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1998/3604] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:04 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1324 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:05.320374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-de884a7d-df56-4b2d-a851-f6ba27f42fee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:05.321833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-de884a7d-df56-4b2d-a851-f6ba27f42fee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:05.344471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de884a7d-df56-4b2d-a851-f6ba27f42fee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:05.348210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de884a7d-df56-4b2d-a851-f6ba27f42fee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:05.348880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de884a7d-df56-4b2d-a851-f6ba27f42fee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:05.351551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de884a7d-df56-4b2d-a851-f6ba27f42fee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:05.356001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de884a7d-df56-4b2d-a851-f6ba27f42fee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:05.356816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de884a7d-df56-4b2d-a851-f6ba27f42fee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:05.540912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6b498c1b-8559-4ccd-abc6-1c073a258c3e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:05.542584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6b498c1b-8559-4ccd-abc6-1c073a258c3e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:05.551042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=8 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:05.554376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b498c1b-8559-4ccd-abc6-1c073a258c3e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:05.555470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b498c1b-8559-4ccd-abc6-1c073a258c3e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:05.556587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b498c1b-8559-4ccd-abc6-1c073a258c3e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:05.559616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b498c1b-8559-4ccd-abc6-1c073a258c3e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:05.560591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b498c1b-8559-4ccd-abc6-1c073a258c3e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:05.561424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b498c1b-8559-4ccd-abc6-1c073a258c3e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:05.956944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6b498c1b-8559-4ccd-abc6-1c073a258c3e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:05.967802 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6b498c1b-8559-4ccd-abc6-1c073a258c3e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1318 microversion: 2.1 time: 0.432757 Oct 12 22:14:05.968412 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 1999/3605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:05 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:05.980443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-da72f80d-ca6d-409d-9f55-fbf608e1d12b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:05.981231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-da72f80d-ca6d-409d-9f55-fbf608e1d12b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:05.999667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:06.001591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da72f80d-ca6d-409d-9f55-fbf608e1d12b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:06.002334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da72f80d-ca6d-409d-9f55-fbf608e1d12b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:06.002955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da72f80d-ca6d-409d-9f55-fbf608e1d12b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:06.003937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da72f80d-ca6d-409d-9f55-fbf608e1d12b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:06.004582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da72f80d-ca6d-409d-9f55-fbf608e1d12b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:06.005187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da72f80d-ca6d-409d-9f55-fbf608e1d12b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:06.056811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-da72f80d-ca6d-409d-9f55-fbf608e1d12b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:14:06.204806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-de884a7d-df56-4b2d-a851-f6ba27f42fee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:06.213914 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-da72f80d-ca6d-409d-9f55-fbf608e1d12b tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "DELETE /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 204 len: 0 microversion: 2.1 time: 0.236979 Oct 12 22:14:06.214526 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2000/3606] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:14:05 2022] DELETE /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:14:06.220201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e4a091f3-0901-486b-8850-73b2655f1077 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:06.220627 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-de884a7d-df56-4b2d-a851-f6ba27f42fee tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1508 microversion: 2.1 time: 0.906812 Oct 12 22:14:06.220924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e4a091f3-0901-486b-8850-73b2655f1077 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:06.221560 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1607/3607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:05 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1508 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:06.227168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0f0beb29-4ef9-4a88-aba0-a3dc48218684 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:06.230374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0f0beb29-4ef9-4a88-aba0-a3dc48218684 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:06.240033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f0beb29-4ef9-4a88-aba0-a3dc48218684 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:06.242345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f0beb29-4ef9-4a88-aba0-a3dc48218684 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:06.244318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f0beb29-4ef9-4a88-aba0-a3dc48218684 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:06.245321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f0beb29-4ef9-4a88-aba0-a3dc48218684 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:06.248174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f0beb29-4ef9-4a88-aba0-a3dc48218684 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:06.249821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f0beb29-4ef9-4a88-aba0-a3dc48218684 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:06.251800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4a091f3-0901-486b-8850-73b2655f1077 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:06.252317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4a091f3-0901-486b-8850-73b2655f1077 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:06.252762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4a091f3-0901-486b-8850-73b2655f1077 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:06.253501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4a091f3-0901-486b-8850-73b2655f1077 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:06.256131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4a091f3-0901-486b-8850-73b2655f1077 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:06.259453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4a091f3-0901-486b-8850-73b2655f1077 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:06.310082 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0f0beb29-4ef9-4a88-aba0-a3dc48218684 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086946 Oct 12 22:14:06.317362 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1608/3608] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:14:06 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:06.323974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3aa12d92-fdb3-4bd3-bdac-6348cfb2d13c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:06.324880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3aa12d92-fdb3-4bd3-bdac-6348cfb2d13c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:06.335042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3aa12d92-fdb3-4bd3-bdac-6348cfb2d13c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:06.336366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3aa12d92-fdb3-4bd3-bdac-6348cfb2d13c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:06.337300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3aa12d92-fdb3-4bd3-bdac-6348cfb2d13c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:06.338178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3aa12d92-fdb3-4bd3-bdac-6348cfb2d13c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:06.340376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3aa12d92-fdb3-4bd3-bdac-6348cfb2d13c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:06.341606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3aa12d92-fdb3-4bd3-bdac-6348cfb2d13c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:06.557924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e4a091f3-0901-486b-8850-73b2655f1077 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:06.582508 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e4a091f3-0901-486b-8850-73b2655f1077 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1503 microversion: 2.1 time: 0.363165 Oct 12 22:14:06.583998 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2001/3609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:06 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1503 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:06.590415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bff4a2b5-903d-4948-9f04-db43f240f7c9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:06.591434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bff4a2b5-903d-4948-9f04-db43f240f7c9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:06.601511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bff4a2b5-903d-4948-9f04-db43f240f7c9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:06.602223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bff4a2b5-903d-4948-9f04-db43f240f7c9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:06.602971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bff4a2b5-903d-4948-9f04-db43f240f7c9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:06.604164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bff4a2b5-903d-4948-9f04-db43f240f7c9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:06.604771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bff4a2b5-903d-4948-9f04-db43f240f7c9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:06.605373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bff4a2b5-903d-4948-9f04-db43f240f7c9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:06.678866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3aa12d92-fdb3-4bd3-bdac-6348cfb2d13c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:06.689708 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3aa12d92-fdb3-4bd3-bdac-6348cfb2d13c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1324 microversion: 2.1 time: 0.370884 Oct 12 22:14:06.698669 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1609/3610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:06 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1324 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:06.710825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a013d3a3-d52a-497b-b038-7b036c328b02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:06.714158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a013d3a3-d52a-497b-b038-7b036c328b02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:06.722883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a013d3a3-d52a-497b-b038-7b036c328b02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:06.723777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a013d3a3-d52a-497b-b038-7b036c328b02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:06.724452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a013d3a3-d52a-497b-b038-7b036c328b02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:06.725406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a013d3a3-d52a-497b-b038-7b036c328b02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:06.726069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a013d3a3-d52a-497b-b038-7b036c328b02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:06.726706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a013d3a3-d52a-497b-b038-7b036c328b02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:06.857734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bff4a2b5-903d-4948-9f04-db43f240f7c9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9463eb3ccf4028af1bfc61749c8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950d9a3e971644709e04007bf0d3a6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:06.870129 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bff4a2b5-903d-4948-9f04-db43f240f7c9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 200 len: 1665 microversion: 2.1 time: 0.283963 Oct 12 22:14:06.871329 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2002/3611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:06 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 1665 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:06.992005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ef30cb90-dbbb-4cf9-9d01-508a903e9082 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:06.992866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ef30cb90-dbbb-4cf9-9d01-508a903e9082 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:07.002166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef30cb90-dbbb-4cf9-9d01-508a903e9082 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:07.006675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef30cb90-dbbb-4cf9-9d01-508a903e9082 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:07.008433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef30cb90-dbbb-4cf9-9d01-508a903e9082 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:07.009365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef30cb90-dbbb-4cf9-9d01-508a903e9082 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:07.010129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef30cb90-dbbb-4cf9-9d01-508a903e9082 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:07.011467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef30cb90-dbbb-4cf9-9d01-508a903e9082 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:07.308415 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a013d3a3-d52a-497b-b038-7b036c328b02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac/action" status: 200 len: 14 microversion: 2.1 time: 0.607060 Oct 12 22:14:07.309788 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1610/3612] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:06 2022] POST /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac/action => generated 14 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:14:07.312302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ef30cb90-dbbb-4cf9-9d01-508a903e9082 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:07.327977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e781133d-9905-43d9-a56d-8951a57abfde tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:07.331459 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ef30cb90-dbbb-4cf9-9d01-508a903e9082 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1318 microversion: 2.1 time: 0.341074 Oct 12 22:14:07.331608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e781133d-9905-43d9-a56d-8951a57abfde tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:07.332223 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2003/3613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:06 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:14:07.348849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-23da32ef-4aac-410e-9646-eac64c9d4923 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:07.353049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-23da32ef-4aac-410e-9646-eac64c9d4923 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:07.357499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e781133d-9905-43d9-a56d-8951a57abfde tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:07.358353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e781133d-9905-43d9-a56d-8951a57abfde tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:07.359027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e781133d-9905-43d9-a56d-8951a57abfde tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:07.360801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e781133d-9905-43d9-a56d-8951a57abfde tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:07.361493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e781133d-9905-43d9-a56d-8951a57abfde tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:07.362311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e781133d-9905-43d9-a56d-8951a57abfde tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:07.368564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23da32ef-4aac-410e-9646-eac64c9d4923 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:07.369134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23da32ef-4aac-410e-9646-eac64c9d4923 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:07.369695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23da32ef-4aac-410e-9646-eac64c9d4923 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:07.372953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23da32ef-4aac-410e-9646-eac64c9d4923 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:07.373889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23da32ef-4aac-410e-9646-eac64c9d4923 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:07.374620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23da32ef-4aac-410e-9646-eac64c9d4923 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:07.432055 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-23da32ef-4aac-410e-9646-eac64c9d4923 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098407 Oct 12 22:14:07.437403 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2004/3614] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:14:07 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:14:07.525333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-47120dd2-f15d-4e2f-8387-0eead471a467 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:07.525984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-47120dd2-f15d-4e2f-8387-0eead471a467 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:07.536059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47120dd2-f15d-4e2f-8387-0eead471a467 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:07.536647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47120dd2-f15d-4e2f-8387-0eead471a467 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:07.537206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47120dd2-f15d-4e2f-8387-0eead471a467 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:07.538049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47120dd2-f15d-4e2f-8387-0eead471a467 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:07.539165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47120dd2-f15d-4e2f-8387-0eead471a467 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:07.539837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47120dd2-f15d-4e2f-8387-0eead471a467 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:07.580822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-47120dd2-f15d-4e2f-8387-0eead471a467 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:14:07.667374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:07.743971 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-47120dd2-f15d-4e2f-8387-0eead471a467 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "DELETE /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 204 len: 0 microversion: 2.1 time: 0.225257 Oct 12 22:14:07.745275 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2005/3615] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:14:07 2022] DELETE /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:14:07.756064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dac523a0-3799-4b35-8d80-e9df570670b3 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:07.757830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dac523a0-3799-4b35-8d80-e9df570670b3 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:07.768903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dac523a0-3799-4b35-8d80-e9df570670b3 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:07.769920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dac523a0-3799-4b35-8d80-e9df570670b3 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:07.770810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dac523a0-3799-4b35-8d80-e9df570670b3 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:07.771842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dac523a0-3799-4b35-8d80-e9df570670b3 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:07.774285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dac523a0-3799-4b35-8d80-e9df570670b3 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:07.774975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dac523a0-3799-4b35-8d80-e9df570670b3 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:07.901355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e781133d-9905-43d9-a56d-8951a57abfde tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:07.912239 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e781133d-9905-43d9-a56d-8951a57abfde tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1508 microversion: 2.1 time: 0.601034 Oct 12 22:14:07.913403 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1611/3616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:07 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1508 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:07.918445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ffc3df0d-f6c8-4a78-a961-8929a7a81249 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:07.919341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ffc3df0d-f6c8-4a78-a961-8929a7a81249 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:07.926487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffc3df0d-f6c8-4a78-a961-8929a7a81249 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:07.927415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffc3df0d-f6c8-4a78-a961-8929a7a81249 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:07.928126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffc3df0d-f6c8-4a78-a961-8929a7a81249 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:07.929250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffc3df0d-f6c8-4a78-a961-8929a7a81249 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:07.929970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffc3df0d-f6c8-4a78-a961-8929a7a81249 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:07.930869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffc3df0d-f6c8-4a78-a961-8929a7a81249 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:08.192152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dac523a0-3799-4b35-8d80-e9df570670b3 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:08.205020 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dac523a0-3799-4b35-8d80-e9df570670b3 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1324 microversion: 2.1 time: 0.456713 Oct 12 22:14:08.205243 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2006/3617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:07 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1324 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:08.213437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ab9e212f-a663-46ae-8dbf-1ec6e02fbcb2 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:08.213756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ab9e212f-a663-46ae-8dbf-1ec6e02fbcb2 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:08.233558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab9e212f-a663-46ae-8dbf-1ec6e02fbcb2 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:08.234186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab9e212f-a663-46ae-8dbf-1ec6e02fbcb2 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:08.234621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab9e212f-a663-46ae-8dbf-1ec6e02fbcb2 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:08.236388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab9e212f-a663-46ae-8dbf-1ec6e02fbcb2 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:08.236388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab9e212f-a663-46ae-8dbf-1ec6e02fbcb2 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:08.236817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab9e212f-a663-46ae-8dbf-1ec6e02fbcb2 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:08.444926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ffc3df0d-f6c8-4a78-a961-8929a7a81249 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:08.465607 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ffc3df0d-f6c8-4a78-a961-8929a7a81249 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 200 len: 1683 microversion: 2.1 time: 0.550794 Oct 12 22:14:08.483514 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1612/3618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:07 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 1683 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:08.494854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-f4ad82f3-8881-4127-88af-a0ac4fc77511 req-cf25894a-6f51-4473-9199-111fa3e3fa93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5691e2-2981-42cf-ae67-ba70d4131f23", "tag": "54710401-b13b-48ce-8096-4284cea6423f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:08.506974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f4ad82f3-8881-4127-88af-a0ac4fc77511 req-cf25894a-6f51-4473-9199-111fa3e3fa93 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:08.507661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f4ad82f3-8881-4127-88af-a0ac4fc77511 req-cf25894a-6f51-4473-9199-111fa3e3fa93 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:08.508290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f4ad82f3-8881-4127-88af-a0ac4fc77511 req-cf25894a-6f51-4473-9199-111fa3e3fa93 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:08.532569 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-f4ad82f3-8881-4127-88af-a0ac4fc77511 req-cf25894a-6f51-4473-9199-111fa3e3fa93 service nova] Creating event network-changed:54710401-b13b-48ce-8096-4284cea6423f for instance bd5691e2-2981-42cf-ae67-ba70d4131f23 on n-h1-861111-1 Oct 12 22:14:08.538677 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-f4ad82f3-8881-4127-88af-a0ac4fc77511 req-cf25894a-6f51-4473-9199-111fa3e3fa93 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053904 Oct 12 22:14:08.539750 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1613/3619] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:08.545864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ab9e212f-a663-46ae-8dbf-1ec6e02fbcb2 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9463eb3ccf4028af1bfc61749c8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950d9a3e971644709e04007bf0d3a6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:08.558200 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ab9e212f-a663-46ae-8dbf-1ec6e02fbcb2 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 200 len: 1665 microversion: 2.1 time: 0.348981 Oct 12 22:14:08.559514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2b39a79a-e808-4a29-8111-e82e4e9a2908 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:08.563465 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2007/3620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:08 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 1665 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:08.571811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2b39a79a-e808-4a29-8111-e82e4e9a2908 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:08.576690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2be66218-3230-4f46-ab6e-b52a62981d2f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:08.578872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2be66218-3230-4f46-ab6e-b52a62981d2f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:08.586165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2be66218-3230-4f46-ab6e-b52a62981d2f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:08.588798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2be66218-3230-4f46-ab6e-b52a62981d2f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:08.589504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2be66218-3230-4f46-ab6e-b52a62981d2f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:08.589826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b39a79a-e808-4a29-8111-e82e4e9a2908 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:08.590329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b39a79a-e808-4a29-8111-e82e4e9a2908 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:08.590765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b39a79a-e808-4a29-8111-e82e4e9a2908 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:08.591208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2be66218-3230-4f46-ab6e-b52a62981d2f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:08.592332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b39a79a-e808-4a29-8111-e82e4e9a2908 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:08.592796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2be66218-3230-4f46-ab6e-b52a62981d2f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:08.593462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2be66218-3230-4f46-ab6e-b52a62981d2f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:08.595437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b39a79a-e808-4a29-8111-e82e4e9a2908 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:08.595884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b39a79a-e808-4a29-8111-e82e4e9a2908 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:08.761453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2be66218-3230-4f46-ab6e-b52a62981d2f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:08.773198 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2be66218-3230-4f46-ab6e-b52a62981d2f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1318 microversion: 2.1 time: 0.207111 Oct 12 22:14:08.774089 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2008/3621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:08 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:08.874571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:08.928129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:08.940940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-380b29d5-6bf2-4518-8fc0-f654d06c27f0 tempest-FloatingIPDetailsNegativeTestJSON-366341346 tempest-FloatingIPDetailsNegativeTestJSON-366341346-project] Calling method '.version_select at 0x7f512c4314c0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:09.030767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-380b29d5-6bf2-4518-8fc0-f654d06c27f0 tempest-FloatingIPDetailsNegativeTestJSON-366341346 tempest-FloatingIPDetailsNegativeTestJSON-366341346-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0a028ef5-2b5d-4f31-bd86-08ac16739d55 could not be found", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:14:09.031514 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-380b29d5-6bf2-4518-8fc0-f654d06c27f0 tempest-FloatingIPDetailsNegativeTestJSON-366341346 tempest-FloatingIPDetailsNegativeTestJSON-366341346-project] HTTP exception thrown: Floating IP not found for ID 0a028ef5-2b5d-4f31-bd86-08ac16739d55 Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-380b29d5-6bf2-4518-8fc0-f654d06c27f0 tempest-FloatingIPDetailsNegativeTestJSON-366341346 tempest-FloatingIPDetailsNegativeTestJSON-366341346-project] Request method failure captured: Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-floating-ips/0a028ef5-2b5d-4f31-bd86-08ac16739d55 HTTP/1.1 Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwwq19wxUK1pGuWIFWGsUhG10UfZIBiQnVa75H6eDrDwoNW9ZadIc64qeXMB-d0CG8QAFe1Xzm2aIMbxEjdt4jLzYiOhwSBIGTl6XcAdebOnRuloVBittHcf_YEHvgl0FlnwsovZvVdYZcM3R9sc8gk4WXTcrPgVypJN7GY36_jp8c Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: c68f23da4fe34a378ecdcc42bce453df Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-366341346 Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c68f23da4fe34a378ecdcc42bce453df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c68f23da4fe34a378ecdcc42bce453df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c68f23da4fe34a378ecdcc42bce453df", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c68f23da4fe34a378ecdcc42bce453df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-366341346 Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: c68f23da4fe34a378ecdcc42bce453df Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-366341346 Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-366341346-project Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 65254414d8654d878cb4a0acecfaf5c3 Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-366341346-project Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: exception: Floating IP not found for ID 0a028ef5-2b5d-4f31-bd86-08ac16739d55 Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '0a028ef5-2b5d-4f31-bd86-08ac16739d55'} Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0a028ef5-2b5d-4f31-bd86-08ac16739d55 could not be found Oct 12 22:14:09.034176 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a55c37e7-a2dd-4fa7-9ca5-e8f420016cca'] Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0a028ef5-2b5d-4f31-bd86-08ac16739d55. Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0a028ef5-2b5d-4f31-bd86-08ac16739d55 Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0a028ef5-2b5d-4f31-bd86-08ac16739d55 Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-380b29d5-6bf2-4518-8fc0-f654d06c27f0 tempest-FloatingIPDetailsNegativeTestJSON-366341346 tempest-FloatingIPDetailsNegativeTestJSON-366341346-project] Returning 404 to user: Floating IP not found for ID 0a028ef5-2b5d-4f31-bd86-08ac16739d55 {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-380b29d5-6bf2-4518-8fc0-f654d06c27f0 tempest-FloatingIPDetailsNegativeTestJSON-366341346 tempest-FloatingIPDetailsNegativeTestJSON-366341346-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/0a028ef5-2b5d-4f31-bd86-08ac16739d55" status: 404 len: 111 microversion: 2.1 time: 0.250320 Oct 12 22:14:09.039537 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2009/3622] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 12 22:14:08 2022] GET /compute/v2.1/os-floating-ips/0a028ef5-2b5d-4f31-bd86-08ac16739d55 => generated 111 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:14:09.046320 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2b39a79a-e808-4a29-8111-e82e4e9a2908 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac/action" status: 200 len: 14 microversion: 2.1 time: 0.505010 Oct 12 22:14:09.047417 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1614/3623] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:08 2022] POST /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac/action => generated 14 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:14:09.049656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1ded9295-4475-468e-a0b3-4be72d2e029e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:09.050919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1ded9295-4475-468e-a0b3-4be72d2e029e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:09.065712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ded9295-4475-468e-a0b3-4be72d2e029e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:09.070467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ded9295-4475-468e-a0b3-4be72d2e029e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:09.072616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ded9295-4475-468e-a0b3-4be72d2e029e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:09.075890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ded9295-4475-468e-a0b3-4be72d2e029e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:09.076597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ded9295-4475-468e-a0b3-4be72d2e029e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:09.077223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ded9295-4475-468e-a0b3-4be72d2e029e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:09.233709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-148538ab-409b-4b87-9e6e-cb376724c3dd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:09.234428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-148538ab-409b-4b87-9e6e-cb376724c3dd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:09.243748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-148538ab-409b-4b87-9e6e-cb376724c3dd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:09.244283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-148538ab-409b-4b87-9e6e-cb376724c3dd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:09.244727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-148538ab-409b-4b87-9e6e-cb376724c3dd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:09.245427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-148538ab-409b-4b87-9e6e-cb376724c3dd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:09.245875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-148538ab-409b-4b87-9e6e-cb376724c3dd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:09.246297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-148538ab-409b-4b87-9e6e-cb376724c3dd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:10.015958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1ded9295-4475-468e-a0b3-4be72d2e029e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:10.027924 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1ded9295-4475-468e-a0b3-4be72d2e029e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1508 microversion: 2.1 time: 0.985951 Oct 12 22:14:10.033682 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2010/3624] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:09 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1508 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:10.056508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d4dc0138-72ae-49c3-a70f-84ee7d7e7dce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:10.060302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d4dc0138-72ae-49c3-a70f-84ee7d7e7dce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:10.077373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4dc0138-72ae-49c3-a70f-84ee7d7e7dce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:10.084261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4dc0138-72ae-49c3-a70f-84ee7d7e7dce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:10.085257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4dc0138-72ae-49c3-a70f-84ee7d7e7dce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:10.089923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4dc0138-72ae-49c3-a70f-84ee7d7e7dce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:10.097746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4dc0138-72ae-49c3-a70f-84ee7d7e7dce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:10.098274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4dc0138-72ae-49c3-a70f-84ee7d7e7dce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:10.115991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-148538ab-409b-4b87-9e6e-cb376724c3dd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:10.141271 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-148538ab-409b-4b87-9e6e-cb376724c3dd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1324 microversion: 2.1 time: 0.913264 Oct 12 22:14:10.162884 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1615/3625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:09 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1324 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:10.179885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e630581e-31ed-4462-a5f3-fafedd00f1b5 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:10.181419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e630581e-31ed-4462-a5f3-fafedd00f1b5 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:10.198457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e630581e-31ed-4462-a5f3-fafedd00f1b5 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:10.204646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e630581e-31ed-4462-a5f3-fafedd00f1b5 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:10.205099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e630581e-31ed-4462-a5f3-fafedd00f1b5 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:10.205848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e630581e-31ed-4462-a5f3-fafedd00f1b5 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:10.206303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e630581e-31ed-4462-a5f3-fafedd00f1b5 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:10.206732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e630581e-31ed-4462-a5f3-fafedd00f1b5 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:10.814856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d4dc0138-72ae-49c3-a70f-84ee7d7e7dce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:10.825853 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d4dc0138-72ae-49c3-a70f-84ee7d7e7dce tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 200 len: 1683 microversion: 2.1 time: 0.788260 Oct 12 22:14:10.826665 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2011/3626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:10 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 1683 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:10.839939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c63241f0-5ce2-4552-9abb-c4637c45afcd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:10.840573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c63241f0-5ce2-4552-9abb-c4637c45afcd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:10.855777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c63241f0-5ce2-4552-9abb-c4637c45afcd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:10.856340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c63241f0-5ce2-4552-9abb-c4637c45afcd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:10.856784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c63241f0-5ce2-4552-9abb-c4637c45afcd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:10.857529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c63241f0-5ce2-4552-9abb-c4637c45afcd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:10.859603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c63241f0-5ce2-4552-9abb-c4637c45afcd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:10.861191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c63241f0-5ce2-4552-9abb-c4637c45afcd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:10.969890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e630581e-31ed-4462-a5f3-fafedd00f1b5 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9463eb3ccf4028af1bfc61749c8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950d9a3e971644709e04007bf0d3a6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:10.991521 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e630581e-31ed-4462-a5f3-fafedd00f1b5 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 200 len: 1665 microversion: 2.1 time: 0.827300 Oct 12 22:14:10.992142 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1616/3627] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:10 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 1665 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:11.009564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cfaabbbf-7b48-40ec-8eb9-3e2607187441 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:11.012281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cfaabbbf-7b48-40ec-8eb9-3e2607187441 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:11.020526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfaabbbf-7b48-40ec-8eb9-3e2607187441 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:11.021094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfaabbbf-7b48-40ec-8eb9-3e2607187441 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:11.021634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfaabbbf-7b48-40ec-8eb9-3e2607187441 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:11.022621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfaabbbf-7b48-40ec-8eb9-3e2607187441 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:11.023333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfaabbbf-7b48-40ec-8eb9-3e2607187441 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:11.024048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfaabbbf-7b48-40ec-8eb9-3e2607187441 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:11.097017 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cfaabbbf-7b48-40ec-8eb9-3e2607187441 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac/action" status: 200 len: 14 microversion: 2.1 time: 0.101275 Oct 12 22:14:11.097780 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1617/3628] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:10 2022] POST /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:14:11.121555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b9597666-1279-4bd9-b3f3-658971f324a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:11.123767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b9597666-1279-4bd9-b3f3-658971f324a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:11.140365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9597666-1279-4bd9-b3f3-658971f324a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:11.142984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9597666-1279-4bd9-b3f3-658971f324a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:11.143580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9597666-1279-4bd9-b3f3-658971f324a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:11.145503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9597666-1279-4bd9-b3f3-658971f324a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:11.145990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9597666-1279-4bd9-b3f3-658971f324a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:11.146426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9597666-1279-4bd9-b3f3-658971f324a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:11.415604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c63241f0-5ce2-4552-9abb-c4637c45afcd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:11.437536 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c63241f0-5ce2-4552-9abb-c4637c45afcd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1318 microversion: 2.1 time: 0.609812 Oct 12 22:14:11.438995 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2012/3629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:10 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:11.449247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-da9b2929-1468-4d12-a0e8-8d2810139642 req-c5bc5b05-7356-4922-bfa5-42ae0b637413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722e8b56-e78f-4dde-af24-cee1dad1be26", "name": "network-vif-plugged", "status": "completed", "tag": "d849caef-b316-4cf0-8a97-f0b2d339596f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:11.465039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-da9b2929-1468-4d12-a0e8-8d2810139642 req-c5bc5b05-7356-4922-bfa5-42ae0b637413 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:11.465527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-da9b2929-1468-4d12-a0e8-8d2810139642 req-c5bc5b05-7356-4922-bfa5-42ae0b637413 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:11.468467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-da9b2929-1468-4d12-a0e8-8d2810139642 req-c5bc5b05-7356-4922-bfa5-42ae0b637413 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:11.481792 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-da9b2929-1468-4d12-a0e8-8d2810139642 req-c5bc5b05-7356-4922-bfa5-42ae0b637413 service nova] Creating event network-vif-plugged:d849caef-b316-4cf0-8a97-f0b2d339596f for instance 722e8b56-e78f-4dde-af24-cee1dad1be26 on n-h2-861111-1 Oct 12 22:14:11.509565 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-da9b2929-1468-4d12-a0e8-8d2810139642 req-c5bc5b05-7356-4922-bfa5-42ae0b637413 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069093 Oct 12 22:14:11.510575 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2013/3630] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:11.524597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-faea6bc8-3dbb-47d5-8c7e-a8160ac25728 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:11.525439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-faea6bc8-3dbb-47d5-8c7e-a8160ac25728 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:11.550263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faea6bc8-3dbb-47d5-8c7e-a8160ac25728 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:11.552363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faea6bc8-3dbb-47d5-8c7e-a8160ac25728 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:11.554255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faea6bc8-3dbb-47d5-8c7e-a8160ac25728 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:11.555497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faea6bc8-3dbb-47d5-8c7e-a8160ac25728 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:11.556477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faea6bc8-3dbb-47d5-8c7e-a8160ac25728 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:11.558373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faea6bc8-3dbb-47d5-8c7e-a8160ac25728 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:11.786504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b9597666-1279-4bd9-b3f3-658971f324a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:11.799710 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b9597666-1279-4bd9-b3f3-658971f324a0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1529 microversion: 2.1 time: 0.689946 Oct 12 22:14:11.800697 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1618/3631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:11 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1529 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:11.855214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d5282537-407b-42e2-89a8-aab9abd07dec tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:11.856025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d5282537-407b-42e2-89a8-aab9abd07dec tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:11.871827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5282537-407b-42e2-89a8-aab9abd07dec tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:11.883279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5282537-407b-42e2-89a8-aab9abd07dec tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:11.884243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5282537-407b-42e2-89a8-aab9abd07dec tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:11.885226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5282537-407b-42e2-89a8-aab9abd07dec tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:11.885913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5282537-407b-42e2-89a8-aab9abd07dec tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:11.886554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5282537-407b-42e2-89a8-aab9abd07dec tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:11.893384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:12.021181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-faea6bc8-3dbb-47d5-8c7e-a8160ac25728 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:12.037259 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-faea6bc8-3dbb-47d5-8c7e-a8160ac25728 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1324 microversion: 2.1 time: 0.525458 Oct 12 22:14:12.038055 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2014/3632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:11 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1324 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:12.045974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-accb490d-85b3-4318-af76-da2b1240e219 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:12.047082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-accb490d-85b3-4318-af76-da2b1240e219 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:12.058831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-accb490d-85b3-4318-af76-da2b1240e219 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:12.059353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-accb490d-85b3-4318-af76-da2b1240e219 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:12.059790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-accb490d-85b3-4318-af76-da2b1240e219 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:12.060500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-accb490d-85b3-4318-af76-da2b1240e219 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:12.060956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-accb490d-85b3-4318-af76-da2b1240e219 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:12.061380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-accb490d-85b3-4318-af76-da2b1240e219 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:12.225982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-accb490d-85b3-4318-af76-da2b1240e219 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9463eb3ccf4028af1bfc61749c8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950d9a3e971644709e04007bf0d3a6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:12.243736 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-accb490d-85b3-4318-af76-da2b1240e219 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 200 len: 1598 microversion: 2.1 time: 0.204367 Oct 12 22:14:12.244328 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2015/3633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:12 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 1598 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:12.253581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a3c619f4-ae41-4d19-a877-705692cda575 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:12.256261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a3c619f4-ae41-4d19-a877-705692cda575 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:12.277150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3c619f4-ae41-4d19-a877-705692cda575 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:12.279178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3c619f4-ae41-4d19-a877-705692cda575 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:12.280814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3c619f4-ae41-4d19-a877-705692cda575 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:12.281842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3c619f4-ae41-4d19-a877-705692cda575 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:12.284775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3c619f4-ae41-4d19-a877-705692cda575 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:12.285446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3c619f4-ae41-4d19-a877-705692cda575 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:12.369945 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a3c619f4-ae41-4d19-a877-705692cda575 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac/action" status: 200 len: 14 microversion: 2.1 time: 0.123028 Oct 12 22:14:12.377363 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2016/3634] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:12 2022] POST /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:14:12.463445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5ac87485-f6d9-457a-8a0b-6c5c0942a5f3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:12.465032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5ac87485-f6d9-457a-8a0b-6c5c0942a5f3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:12.480928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac87485-f6d9-457a-8a0b-6c5c0942a5f3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:12.484432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac87485-f6d9-457a-8a0b-6c5c0942a5f3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:12.485727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac87485-f6d9-457a-8a0b-6c5c0942a5f3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:12.487761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac87485-f6d9-457a-8a0b-6c5c0942a5f3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:12.489883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac87485-f6d9-457a-8a0b-6c5c0942a5f3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:12.490575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac87485-f6d9-457a-8a0b-6c5c0942a5f3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:12.974837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5ac87485-f6d9-457a-8a0b-6c5c0942a5f3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:12.979057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d5282537-407b-42e2-89a8-aab9abd07dec tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:12.990610 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5ac87485-f6d9-457a-8a0b-6c5c0942a5f3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1318 microversion: 2.1 time: 0.530279 Oct 12 22:14:12.993561 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2017/3635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:12 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1318 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:13.003061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1a1abc63-e07b-4a37-af8c-dd1bc06eace4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:13.005653 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d5282537-407b-42e2-89a8-aab9abd07dec tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 200 len: 1683 microversion: 2.1 time: 1.148562 Oct 12 22:14:13.006437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1a1abc63-e07b-4a37-af8c-dd1bc06eace4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:13.007758 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1619/3636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:11 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 1683 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:14:13.028675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a1abc63-e07b-4a37-af8c-dd1bc06eace4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:13.029278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a1abc63-e07b-4a37-af8c-dd1bc06eace4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:13.029815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a1abc63-e07b-4a37-af8c-dd1bc06eace4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:13.030636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a1abc63-e07b-4a37-af8c-dd1bc06eace4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:13.031182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a1abc63-e07b-4a37-af8c-dd1bc06eace4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:13.031865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a1abc63-e07b-4a37-af8c-dd1bc06eace4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:13.052520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-1c622f7b-c892-47c1-aacd-febcdd67ea30 req-0a37fcf0-1aa7-45ed-947d-dd191d60f228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "060fc715-5b23-43ea-a528-6013a979ac3e", "name": "network-vif-deleted", "tag": "d96fed9a-b440-4554-9add-7c497a701d8f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:13.074298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1c622f7b-c892-47c1-aacd-febcdd67ea30 req-0a37fcf0-1aa7-45ed-947d-dd191d60f228 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:13.081178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1c622f7b-c892-47c1-aacd-febcdd67ea30 req-0a37fcf0-1aa7-45ed-947d-dd191d60f228 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:13.083918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1c622f7b-c892-47c1-aacd-febcdd67ea30 req-0a37fcf0-1aa7-45ed-947d-dd191d60f228 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:13.143552 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-1c622f7b-c892-47c1-aacd-febcdd67ea30 req-0a37fcf0-1aa7-45ed-947d-dd191d60f228 service nova] Creating event network-vif-deleted:d96fed9a-b440-4554-9add-7c497a701d8f for instance 060fc715-5b23-43ea-a528-6013a979ac3e on n-h1-861111-1 Oct 12 22:14:13.166201 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-1c622f7b-c892-47c1-aacd-febcdd67ea30 req-0a37fcf0-1aa7-45ed-947d-dd191d60f228 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113665 Oct 12 22:14:13.169341 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1620/3637] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:13.184106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b81ba367-87a5-4e0c-8079-0f6c275e3678 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:13.186273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b81ba367-87a5-4e0c-8079-0f6c275e3678 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:13.199497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81ba367-87a5-4e0c-8079-0f6c275e3678 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:13.211530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81ba367-87a5-4e0c-8079-0f6c275e3678 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:13.212005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81ba367-87a5-4e0c-8079-0f6c275e3678 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:13.216679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81ba367-87a5-4e0c-8079-0f6c275e3678 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:13.217562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81ba367-87a5-4e0c-8079-0f6c275e3678 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:13.218006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81ba367-87a5-4e0c-8079-0f6c275e3678 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:13.462008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a1abc63-e07b-4a37-af8c-dd1bc06eace4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:13.482515 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1a1abc63-e07b-4a37-af8c-dd1bc06eace4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1529 microversion: 2.1 time: 0.487565 Oct 12 22:14:13.484828 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2018/3638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:12 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1529 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:13.492331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1a290723-4360-42de-84b9-108c3e2cb5e9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:13.493184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1a290723-4360-42de-84b9-108c3e2cb5e9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:13.502453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a290723-4360-42de-84b9-108c3e2cb5e9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:13.503386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a290723-4360-42de-84b9-108c3e2cb5e9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:13.504084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a290723-4360-42de-84b9-108c3e2cb5e9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:13.521364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a290723-4360-42de-84b9-108c3e2cb5e9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:13.522206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a290723-4360-42de-84b9-108c3e2cb5e9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:13.522904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a290723-4360-42de-84b9-108c3e2cb5e9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:13.751654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a290723-4360-42de-84b9-108c3e2cb5e9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9463eb3ccf4028af1bfc61749c8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950d9a3e971644709e04007bf0d3a6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:13.760259 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1a290723-4360-42de-84b9-108c3e2cb5e9 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 200 len: 1598 microversion: 2.1 time: 0.272385 Oct 12 22:14:13.781400 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2019/3639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:13 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 1598 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:13.792672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-520ae30d-dd59-471f-8e51-1a557d7c12ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:13.806197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-520ae30d-dd59-471f-8e51-1a557d7c12ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:13.809007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b81ba367-87a5-4e0c-8079-0f6c275e3678 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:13.813921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-520ae30d-dd59-471f-8e51-1a557d7c12ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:13.815832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-520ae30d-dd59-471f-8e51-1a557d7c12ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:13.817114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-520ae30d-dd59-471f-8e51-1a557d7c12ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:13.820133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-520ae30d-dd59-471f-8e51-1a557d7c12ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:13.820368 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b81ba367-87a5-4e0c-8079-0f6c275e3678 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1324 microversion: 2.1 time: 0.649706 Oct 12 22:14:13.821003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-520ae30d-dd59-471f-8e51-1a557d7c12ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:13.823128 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1621/3640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:13 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1324 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:13.850600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-520ae30d-dd59-471f-8e51-1a557d7c12ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:13.940279 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-520ae30d-dd59-471f-8e51-1a557d7c12ae tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac/action" status: 200 len: 14 microversion: 2.1 time: 0.157083 Oct 12 22:14:13.944210 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2020/3641] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:13 2022] POST /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:14:14.014170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-047c8b25-25af-46eb-8d77-cc04586ab357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:14.016879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-047c8b25-25af-46eb-8d77-cc04586ab357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:14.024973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-047c8b25-25af-46eb-8d77-cc04586ab357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:14.026161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-047c8b25-25af-46eb-8d77-cc04586ab357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:14.026809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-047c8b25-25af-46eb-8d77-cc04586ab357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:14.028120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-047c8b25-25af-46eb-8d77-cc04586ab357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:14.028965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-047c8b25-25af-46eb-8d77-cc04586ab357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:14.030063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-047c8b25-25af-46eb-8d77-cc04586ab357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:14.044495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-36fdd2b1-c77e-453a-a938-6d1af1341f2c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:14.045644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-36fdd2b1-c77e-453a-a938-6d1af1341f2c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:14.061081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36fdd2b1-c77e-453a-a938-6d1af1341f2c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:14.065770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36fdd2b1-c77e-453a-a938-6d1af1341f2c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:14.066236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36fdd2b1-c77e-453a-a938-6d1af1341f2c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:14.066979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36fdd2b1-c77e-453a-a938-6d1af1341f2c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:14.067471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36fdd2b1-c77e-453a-a938-6d1af1341f2c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:14.067898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36fdd2b1-c77e-453a-a938-6d1af1341f2c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:14.334643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-36fdd2b1-c77e-453a-a938-6d1af1341f2c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:14.344358 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-36fdd2b1-c77e-453a-a938-6d1af1341f2c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 200 len: 1616 microversion: 2.1 time: 0.305060 Oct 12 22:14:14.363593 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2021/3642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:14 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 1616 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:14.419693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-4ccac62d-e6fc-4c2d-ba3d-6c866a3e7252 req-de464b18-f03b-4a75-97b4-869dc5187a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feeebc28-6cfd-4f7d-8e32-d725731d0ba3", "name": "network-vif-deleted", "tag": "10b52e2e-0015-4406-ae37-d8e3d7eab6de"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:14.436148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4ccac62d-e6fc-4c2d-ba3d-6c866a3e7252 req-de464b18-f03b-4a75-97b4-869dc5187a82 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:14.439762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4ccac62d-e6fc-4c2d-ba3d-6c866a3e7252 req-de464b18-f03b-4a75-97b4-869dc5187a82 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:14.441439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4ccac62d-e6fc-4c2d-ba3d-6c866a3e7252 req-de464b18-f03b-4a75-97b4-869dc5187a82 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:14.474760 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-4ccac62d-e6fc-4c2d-ba3d-6c866a3e7252 req-de464b18-f03b-4a75-97b4-869dc5187a82 service nova] Creating event network-vif-deleted:10b52e2e-0015-4406-ae37-d8e3d7eab6de for instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 on n-h1-861111-1 Oct 12 22:14:14.488211 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-4ccac62d-e6fc-4c2d-ba3d-6c866a3e7252 req-de464b18-f03b-4a75-97b4-869dc5187a82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072062 Oct 12 22:14:14.494197 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2022/3643] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:14:14.512972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-de6f4795-94a6-4a4a-9b9e-cc883819081a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:14.513871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-de6f4795-94a6-4a4a-9b9e-cc883819081a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:14.526270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de6f4795-94a6-4a4a-9b9e-cc883819081a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:14.528586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de6f4795-94a6-4a4a-9b9e-cc883819081a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:14.530559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de6f4795-94a6-4a4a-9b9e-cc883819081a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:14.533430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de6f4795-94a6-4a4a-9b9e-cc883819081a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:14.534110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de6f4795-94a6-4a4a-9b9e-cc883819081a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:14.536470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de6f4795-94a6-4a4a-9b9e-cc883819081a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:14.627520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-047c8b25-25af-46eb-8d77-cc04586ab357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:14.648054 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-047c8b25-25af-46eb-8d77-cc04586ab357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1318 microversion: 2.1 time: 0.637989 Oct 12 22:14:14.660813 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1622/3644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:14 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1318 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:14.795176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f1f2a2a8-5c1c-4d25-86d4-769c7d08736c tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:14.795880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f1f2a2a8-5c1c-4d25-86d4-769c7d08736c tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:14.815807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1f2a2a8-5c1c-4d25-86d4-769c7d08736c tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:14.818269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1f2a2a8-5c1c-4d25-86d4-769c7d08736c tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:14.821357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1f2a2a8-5c1c-4d25-86d4-769c7d08736c tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:14.822142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1f2a2a8-5c1c-4d25-86d4-769c7d08736c tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:14.825136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1f2a2a8-5c1c-4d25-86d4-769c7d08736c tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:14.825589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1f2a2a8-5c1c-4d25-86d4-769c7d08736c tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:14.957027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1f2a2a8-5c1c-4d25-86d4-769c7d08736c tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:14.957420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1f2a2a8-5c1c-4d25-86d4-769c7d08736c tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:14.957951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1f2a2a8-5c1c-4d25-86d4-769c7d08736c tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:14.958299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-f1f2a2a8-5c1c-4d25-86d4-769c7d08736c tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lazy-loading 'fault' on Instance uuid 060fc715-5b23-43ea-a528-6013a979ac3e {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:14:15.035251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f1f2a2a8-5c1c-4d25-86d4-769c7d08736c tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9463eb3ccf4028af1bfc61749c8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950d9a3e971644709e04007bf0d3a6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:15.049987 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f1f2a2a8-5c1c-4d25-86d4-769c7d08736c tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 200 len: 1315 microversion: 2.1 time: 0.259768 Oct 12 22:14:15.053872 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1623/3645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:14 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:15.070447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5b1f7dc3-290c-4817-8187-7c065688349d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:15.082320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5b1f7dc3-290c-4817-8187-7c065688349d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:15.103170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b1f7dc3-290c-4817-8187-7c065688349d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:15.103695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b1f7dc3-290c-4817-8187-7c065688349d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:15.104199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b1f7dc3-290c-4817-8187-7c065688349d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:15.104941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b1f7dc3-290c-4817-8187-7c065688349d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:15.108623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b1f7dc3-290c-4817-8187-7c065688349d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:15.109348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b1f7dc3-290c-4817-8187-7c065688349d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:15.118131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-de6f4795-94a6-4a4a-9b9e-cc883819081a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:15.136669 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-de6f4795-94a6-4a4a-9b9e-cc883819081a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1529 microversion: 2.1 time: 0.624505 Oct 12 22:14:15.138355 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2023/3646] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:14 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1529 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:14:15.148797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a7702481-9f98-4f7a-b913-1b7ae5497b66 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:15.151679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a7702481-9f98-4f7a-b913-1b7ae5497b66 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:15.179255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7702481-9f98-4f7a-b913-1b7ae5497b66 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:15.180790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7702481-9f98-4f7a-b913-1b7ae5497b66 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:15.184196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7702481-9f98-4f7a-b913-1b7ae5497b66 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:15.187618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7702481-9f98-4f7a-b913-1b7ae5497b66 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:15.189624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7702481-9f98-4f7a-b913-1b7ae5497b66 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:15.190504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7702481-9f98-4f7a-b913-1b7ae5497b66 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:15.276119 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a7702481-9f98-4f7a-b913-1b7ae5497b66 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac/action" status: 200 len: 14 microversion: 2.1 time: 0.134729 Oct 12 22:14:15.278060 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2024/3647] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:15 2022] POST /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:14:15.373339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c7bb9e88-421e-4fb7-8d92-96832bd07652 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:15.374062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c7bb9e88-421e-4fb7-8d92-96832bd07652 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:15.394452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7bb9e88-421e-4fb7-8d92-96832bd07652 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:15.395156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7bb9e88-421e-4fb7-8d92-96832bd07652 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:15.397724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7bb9e88-421e-4fb7-8d92-96832bd07652 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:15.400096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7bb9e88-421e-4fb7-8d92-96832bd07652 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:15.401023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7bb9e88-421e-4fb7-8d92-96832bd07652 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:15.401463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7bb9e88-421e-4fb7-8d92-96832bd07652 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:15.483707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7bb9e88-421e-4fb7-8d92-96832bd07652 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:15.484451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7bb9e88-421e-4fb7-8d92-96832bd07652 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:15.485585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7bb9e88-421e-4fb7-8d92-96832bd07652 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:15.486511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-c7bb9e88-421e-4fb7-8d92-96832bd07652 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lazy-loading 'fault' on Instance uuid feeebc28-6cfd-4f7d-8e32-d725731d0ba3 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:14:15.490042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:15.567479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5b1f7dc3-290c-4817-8187-7c065688349d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:15.585280 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5b1f7dc3-290c-4817-8187-7c065688349d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1522 microversion: 2.1 time: 0.530049 Oct 12 22:14:15.599510 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1624/3648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:15 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1522 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:15.613201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4e6d87d6-746e-40bc-a530-1252636be10f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:15.613825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4e6d87d6-746e-40bc-a530-1252636be10f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:15.634214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e6d87d6-746e-40bc-a530-1252636be10f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:15.634766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e6d87d6-746e-40bc-a530-1252636be10f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:15.635208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e6d87d6-746e-40bc-a530-1252636be10f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:15.638575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e6d87d6-746e-40bc-a530-1252636be10f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:15.640936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e6d87d6-746e-40bc-a530-1252636be10f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:15.643294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e6d87d6-746e-40bc-a530-1252636be10f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:15.727342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c7bb9e88-421e-4fb7-8d92-96832bd07652 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c74a78e82f4e72a7d1f7b133074f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68913d260d084ce4a8e29daf4783c0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:15.742145 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c7bb9e88-421e-4fb7-8d92-96832bd07652 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 200 len: 1332 microversion: 2.1 time: 0.375714 Oct 12 22:14:15.768997 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2025/3649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:15 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 1332 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:14:15.774417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b5b6c3cb-a6dc-476d-9553-4cc003b2b54f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:15.788790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b5b6c3cb-a6dc-476d-9553-4cc003b2b54f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:15.810238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5b6c3cb-a6dc-476d-9553-4cc003b2b54f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:15.811056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5b6c3cb-a6dc-476d-9553-4cc003b2b54f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:15.811677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5b6c3cb-a6dc-476d-9553-4cc003b2b54f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:15.812601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5b6c3cb-a6dc-476d-9553-4cc003b2b54f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:15.813259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5b6c3cb-a6dc-476d-9553-4cc003b2b54f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:15.813844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5b6c3cb-a6dc-476d-9553-4cc003b2b54f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:16.090533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4e6d87d6-746e-40bc-a530-1252636be10f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:16.122813 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4e6d87d6-746e-40bc-a530-1252636be10f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1522 microversion: 2.1 time: 0.514157 Oct 12 22:14:16.123443 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1625/3650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:15 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:16.128164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-69ed0802-2f6c-4ec2-b617-12561005325e tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:16.139118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-69ed0802-2f6c-4ec2-b617-12561005325e tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] [instance: 060fc715-5b23-43ea-a528-6013a979ac3e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:16.167673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b5b6c3cb-a6dc-476d-9553-4cc003b2b54f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:16.169139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69ed0802-2f6c-4ec2-b617-12561005325e tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:16.171837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69ed0802-2f6c-4ec2-b617-12561005325e tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:16.172282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69ed0802-2f6c-4ec2-b617-12561005325e tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:16.174232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69ed0802-2f6c-4ec2-b617-12561005325e tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:16.174627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69ed0802-2f6c-4ec2-b617-12561005325e tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:16.175061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69ed0802-2f6c-4ec2-b617-12561005325e tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:16.179268 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b5b6c3cb-a6dc-476d-9553-4cc003b2b54f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1318 microversion: 2.1 time: 0.408705 Oct 12 22:14:16.184195 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2026/3651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:15 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1318 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:16.204255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e9d83803-9573-4c1f-a070-cf7cb391d8e8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-395998768", "metadata": {"": ""}}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e9d83803-9573-4c1f-a070-cf7cb391d8e8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Request method failure captured: Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26/action HTTP/1.1 Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 106 Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwglINEGlDOr9BocY5wO9Xx43qqChsjlqD9r61HmaIIEL6djOCkMBDTPWahASzdxBY-IxGgwHeVTq3saYQxSiCfGBziJflEANUhDnl0qNNSNbnWdyn825Mt-A7NcL8fanNSlgyJCBOxpmZTnNkYN5hmKUrlCsq_TM6iJjMlS6r6Deg Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a107edadb364defb4f2c408969c097c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a107edadb364defb4f2c408969c097c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a2c263e74d274bef8094b9d7ecfc820b Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-395998768", "metadata": {"": ""}}} Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '722e8b56-e78f-4dde-af24-cee1dad1be26', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-395998768', 'metadata': {'': ''}}}} Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'': ''} Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:14:16.223116 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e9d83803-9573-4c1f-a070-cf7cb391d8e8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:16.228810 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e9d83803-9573-4c1f-a070-cf7cb391d8e8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "POST /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26/action" status: 400 len: 170 microversion: 2.1 time: 0.041731 Oct 12 22:14:16.232585 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2027/3652] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Oct 12 22:14:16 2022] POST /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26/action => generated 170 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:14:16.234008 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-69ed0802-2f6c-4ec2-b617-12561005325e tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] HTTP exception thrown: Instance 060fc715-5b23-43ea-a528-6013a979ac3e could not be found. Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-69ed0802-2f6c-4ec2-b617-12561005325e tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Request method failure captured: Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e HTTP/1.1 Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzvnXdnPu0HAgbAKmghlh7VlwknxOGYdUZDLU7CXJTGDZTlycZnKWaa6VPWhzDzIqQYOsOz4gwCuWSLvWrbrR7fP0F4S-4I3Hf_VdITziWAePoq10PWrfyLFXoQ6uUfcPvwdcYPw8xYx-0kBxH1W9y3UUiGo0AndBZk9bXQxLydrUG0 Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 950d9a3e971644709e04007bf0d3a6e5 Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersTestFqdnHostnames-2092002540 Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/950d9a3e971644709e04007bf0d3a6e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/950d9a3e971644709e04007bf0d3a6e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_950d9a3e971644709e04007bf0d3a6e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/950d9a3e971644709e04007bf0d3a6e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersTestFqdnHostnames-2092002540 Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 950d9a3e971644709e04007bf0d3a6e5 Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-2092002540 Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersTestFqdnHostnames-2092002540-project Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 0e9463eb3ccf4028af1bfc61749c8e99 Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersTestFqdnHostnames-2092002540-project Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 060fc715-5b23-43ea-a528-6013a979ac3e could not be found. Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '060fc715-5b23-43ea-a528-6013a979ac3e'} Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 060fc715-5b23-43ea-a528-6013a979ac3e could not be found. Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 060fc715-5b23-43ea-a528-6013a979ac3e could not be found. Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:16.239794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:16.245136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:16.245136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:16.245136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:16.245136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:16.245136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:16.245136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 060fc715-5b23-43ea-a528-6013a979ac3e could not be found. Oct 12 22:14:16.245136 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:16.245136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-69ed0802-2f6c-4ec2-b617-12561005325e tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Returning 404 to user: Instance 060fc715-5b23-43ea-a528-6013a979ac3e could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:16.245136 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-69ed0802-2f6c-4ec2-b617-12561005325e tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e" status: 404 len: 111 microversion: 2.1 time: 0.117018 Oct 12 22:14:16.245870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c30bf48f-bdfe-4219-8f48-7d61f78d1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:16.245870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c30bf48f-bdfe-4219-8f48-7d61f78d1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:16.247671 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1626/3653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:16 2022] GET /compute/v2.1/servers/060fc715-5b23-43ea-a528-6013a979ac3e => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:14:16.265921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1d3b377c-1a13-4933-8344-296f2b1a4d36 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Action: 'create', calling method: .version_select at 0x7f512c51e550>, body: {"keypair": {"name": "tempest-keypair-1803936241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn/yksyyCBsezP31J+EP6ZMqwcv5LkKEabDUN1eRa97i0v8sHR+WHWSMzCNtZfgzJb6JQYIZdW7xl7UMeYBT20kqPHpCt6J8kfwDe56MIQbkXxaO3t2cn/UhsSgsPqM8w=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:16.273609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c30bf48f-bdfe-4219-8f48-7d61f78d1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:16.274367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c30bf48f-bdfe-4219-8f48-7d61f78d1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:16.274816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c30bf48f-bdfe-4219-8f48-7d61f78d1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:16.277574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c30bf48f-bdfe-4219-8f48-7d61f78d1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:16.279745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c30bf48f-bdfe-4219-8f48-7d61f78d1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:16.280970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c30bf48f-bdfe-4219-8f48-7d61f78d1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:16.305668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-1d3b377c-1a13-4933-8344-296f2b1a4d36 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Getting quotas for project d8a8bf42585148ff9e29ab4bb8f932a6. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:16.318688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-1d3b377c-1a13-4933-8344-296f2b1a4d36 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Getting quotas for user ea6c240d338349f89c5cc98058ea225c and project d8a8bf42585148ff9e29ab4bb8f932a6. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:16.383834 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1d3b377c-1a13-4933-8344-296f2b1a4d36 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.134943 Oct 12 22:14:16.384849 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1627/3654] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 12 22:14:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 22:14:16.390504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f35c6cce-5e7f-4cb5-9504-75ccdbba1f4c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:16.391303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f35c6cce-5e7f-4cb5-9504-75ccdbba1f4c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:16.400128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f35c6cce-5e7f-4cb5-9504-75ccdbba1f4c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:16.401095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f35c6cce-5e7f-4cb5-9504-75ccdbba1f4c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:16.402859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f35c6cce-5e7f-4cb5-9504-75ccdbba1f4c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:16.403784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f35c6cce-5e7f-4cb5-9504-75ccdbba1f4c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:16.404519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f35c6cce-5e7f-4cb5-9504-75ccdbba1f4c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:16.405088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f35c6cce-5e7f-4cb5-9504-75ccdbba1f4c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:16.666087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c30bf48f-bdfe-4219-8f48-7d61f78d1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:16.677891 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c30bf48f-bdfe-4219-8f48-7d61f78d1b5e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1524 microversion: 2.1 time: 0.444118 Oct 12 22:14:16.678801 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2028/3655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:16 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1524 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:16.691821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8f6201e4-3fc3-4c14-a780-6d9e57292ab7 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] Calling method '.version_select at 0x7f51230daee0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:16.742631 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8f6201e4-3fc3-4c14-a780-6d9e57292ab7 tempest-ServersTestFqdnHostnames-2092002540 tempest-ServersTestFqdnHostnames-2092002540-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-443066155" status: 202 len: 0 microversion: 2.1 time: 0.061541 Oct 12 22:14:16.743767 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2029/3656] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 12 22:14:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-443066155 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:14:16.749023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe6a104d-8087-4c4f-9a1c-16cf9becbb87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:16.776649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fe6a104d-8087-4c4f-9a1c-16cf9becbb87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:16.795360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe6a104d-8087-4c4f-9a1c-16cf9becbb87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:16.801054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe6a104d-8087-4c4f-9a1c-16cf9becbb87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:16.801680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe6a104d-8087-4c4f-9a1c-16cf9becbb87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:16.802581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe6a104d-8087-4c4f-9a1c-16cf9becbb87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:16.803195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe6a104d-8087-4c4f-9a1c-16cf9becbb87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:16.804009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe6a104d-8087-4c4f-9a1c-16cf9becbb87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:16.886671 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fe6a104d-8087-4c4f-9a1c-16cf9becbb87 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac/action" status: 200 len: 14 microversion: 2.1 time: 0.141239 Oct 12 22:14:16.891456 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2030/3657] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:16 2022] POST /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:14:16.901022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02b8dafc-9e46-44b0-82f9-c6d7b7204c93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:16.901764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-02b8dafc-9e46-44b0-82f9-c6d7b7204c93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:16.918073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b8dafc-9e46-44b0-82f9-c6d7b7204c93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:16.924184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b8dafc-9e46-44b0-82f9-c6d7b7204c93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:16.924647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b8dafc-9e46-44b0-82f9-c6d7b7204c93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:16.925395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b8dafc-9e46-44b0-82f9-c6d7b7204c93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:16.926227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b8dafc-9e46-44b0-82f9-c6d7b7204c93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:16.926588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b8dafc-9e46-44b0-82f9-c6d7b7204c93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:16.954556 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-02b8dafc-9e46-44b0-82f9-c6d7b7204c93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] HTTP exception thrown: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02b8dafc-9e46-44b0-82f9-c6d7b7204c93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Request method failure captured: Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 HTTP/1.1 Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzoV3foVnGv0suVxK_Nk7Pp5_kjAPhL8yzVHClSGl5RRxDIZH7rcf5PLHi4YXEet-A0AtHcDaHpFcS_aQR9wl8soXuphQXdzTm1zPCiMI4BUWAPu4l1z3R9DkYDtzHZhHRlT-3CEyzuxgoolPW6Gw8glco6cFnu099ScND31HIZBEC4 Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68913d260d084ce4a8e29daf4783c0bc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 13c74a78e82f4e72a7d1f7b133074f5a Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'feeebc28-6cfd-4f7d-8e32-d725731d0ba3'} Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:16.960072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:16.964859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:16.964859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:16.964859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:16.964859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:16.964859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:16.964859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. Oct 12 22:14:16.964859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:16.964859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02b8dafc-9e46-44b0-82f9-c6d7b7204c93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Returning 404 to user: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:16.964859 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-02b8dafc-9e46-44b0-82f9-c6d7b7204c93 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 404 len: 111 microversion: 2.1 time: 0.068733 Oct 12 22:14:16.969733 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2031/3658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:16 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:14:16.982219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-21f9093e-7c1e-4733-a078-ce9ef28b8d3b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '.version_select at 0x7f5123511550>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:17.029908 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-21f9093e-7c1e-4733-a078-ce9ef28b8d3b tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428081210" status: 202 len: 0 microversion: 2.1 time: 0.058067 Oct 12 22:14:17.033963 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2032/3659] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 12 22:14:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428081210 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:14:17.208150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f66ca90f-ed35-4f2a-b6e0-bcea73be7679 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:17.208768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f66ca90f-ed35-4f2a-b6e0-bcea73be7679 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:17.229592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f66ca90f-ed35-4f2a-b6e0-bcea73be7679 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:17.233197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f66ca90f-ed35-4f2a-b6e0-bcea73be7679 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:17.236095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f66ca90f-ed35-4f2a-b6e0-bcea73be7679 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:17.237047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f66ca90f-ed35-4f2a-b6e0-bcea73be7679 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:17.238047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f66ca90f-ed35-4f2a-b6e0-bcea73be7679 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:17.239094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f66ca90f-ed35-4f2a-b6e0-bcea73be7679 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:17.541512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f35c6cce-5e7f-4cb5-9504-75ccdbba1f4c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:17.561301 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f35c6cce-5e7f-4cb5-9504-75ccdbba1f4c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1522 microversion: 2.1 time: 1.167481 Oct 12 22:14:17.562000 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1628/3660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:16 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1522 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:17.592575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-f361097a-bbd7-4aa1-93e7-04a1b8e8ac42 req-3ba52883-c9b4-4044-ba7f-27c36617273b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50994542-c3c0-46a4-b994-50c452999ba2", "name": "network-vif-plugged", "status": "completed", "tag": "1ab1002b-2837-44c5-913e-110671db6764"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:17.644073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f361097a-bbd7-4aa1-93e7-04a1b8e8ac42 req-3ba52883-c9b4-4044-ba7f-27c36617273b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:17.644555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f361097a-bbd7-4aa1-93e7-04a1b8e8ac42 req-3ba52883-c9b4-4044-ba7f-27c36617273b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:17.644993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f361097a-bbd7-4aa1-93e7-04a1b8e8ac42 req-3ba52883-c9b4-4044-ba7f-27c36617273b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:17.748189 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-f361097a-bbd7-4aa1-93e7-04a1b8e8ac42 req-3ba52883-c9b4-4044-ba7f-27c36617273b service nova] Creating event network-vif-plugged:1ab1002b-2837-44c5-913e-110671db6764 for instance 50994542-c3c0-46a4-b994-50c452999ba2 on n-h2-861111-1 Oct 12 22:14:17.758313 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-f361097a-bbd7-4aa1-93e7-04a1b8e8ac42 req-3ba52883-c9b4-4044-ba7f-27c36617273b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189683 Oct 12 22:14:17.767670 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1629/3661] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:17.795506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5568b1f6-dbfd-40b3-bc3f-d94f207e9904 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:17.796551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5568b1f6-dbfd-40b3-bc3f-d94f207e9904 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:17.817335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5568b1f6-dbfd-40b3-bc3f-d94f207e9904 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:17.817836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5568b1f6-dbfd-40b3-bc3f-d94f207e9904 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:17.818334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5568b1f6-dbfd-40b3-bc3f-d94f207e9904 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:17.827961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5568b1f6-dbfd-40b3-bc3f-d94f207e9904 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:17.830626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5568b1f6-dbfd-40b3-bc3f-d94f207e9904 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:17.831633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5568b1f6-dbfd-40b3-bc3f-d94f207e9904 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:18.307194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f66ca90f-ed35-4f2a-b6e0-bcea73be7679 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:18.322885 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f66ca90f-ed35-4f2a-b6e0-bcea73be7679 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1318 microversion: 2.1 time: 1.118856 Oct 12 22:14:18.326629 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2033/3662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:17 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1318 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:14:18.340477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-267d3301-b707-4186-a915-6f24f7535a9a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:18.356569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-267d3301-b707-4186-a915-6f24f7535a9a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:18.383463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-267d3301-b707-4186-a915-6f24f7535a9a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:18.384759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-267d3301-b707-4186-a915-6f24f7535a9a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:18.388259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-267d3301-b707-4186-a915-6f24f7535a9a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:18.392634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-267d3301-b707-4186-a915-6f24f7535a9a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:18.393528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-267d3301-b707-4186-a915-6f24f7535a9a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:18.394344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-267d3301-b707-4186-a915-6f24f7535a9a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:18.724259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5568b1f6-dbfd-40b3-bc3f-d94f207e9904 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:18.739978 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5568b1f6-dbfd-40b3-bc3f-d94f207e9904 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1522 microversion: 2.1 time: 0.970223 Oct 12 22:14:18.741250 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1630/3663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:17 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1522 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:18.782526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c27ee682-620a-42bd-9e02-7641be8d06a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:18.796556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c27ee682-620a-42bd-9e02-7641be8d06a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:18.825810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c27ee682-620a-42bd-9e02-7641be8d06a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:18.826774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c27ee682-620a-42bd-9e02-7641be8d06a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:18.827504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c27ee682-620a-42bd-9e02-7641be8d06a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:18.828480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c27ee682-620a-42bd-9e02-7641be8d06a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:18.830978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c27ee682-620a-42bd-9e02-7641be8d06a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:18.831780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c27ee682-620a-42bd-9e02-7641be8d06a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:18.981339 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c27ee682-620a-42bd-9e02-7641be8d06a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac/action" status: 200 len: 8208 microversion: 2.1 time: 0.204652 Oct 12 22:14:18.987670 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1631/3664] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:18 2022] POST /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac/action => generated 8208 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:19.006731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d872657-6894-4737-9686-efa6435f7b53 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1502992885", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d872657-6894-4737-9686-efa6435f7b53 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Request method failure captured: Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26/action HTTP/1.1 Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 619 Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzwglINEGlDOr9BocY5wO9Xx43qqChsjlqD9r61HmaIIEL6djOCkMBDTPWahASzdxBY-IxGgwHeVTq3saYQxSiCfGBziJflEANUhDnl0qNNSNbnWdyn825Mt-A7NcL8fanNSlgyJCBOxpmZTnNkYN5hmKUrlCsq_TM6iJjMlS6r6Deg Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a107edadb364defb4f2c408969c097c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a107edadb364defb4f2c408969c097c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: a2c263e74d274bef8094b9d7ecfc820b Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1502992885", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '722e8b56-e78f-4dde-af24-cee1dad1be26', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1502992885', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:14:19.035879 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:14:19.039062 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:19.042079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d872657-6894-4737-9686-efa6435f7b53 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:19.044074 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5d872657-6894-4737-9686-efa6435f7b53 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "POST /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26/action" status: 400 len: 938 microversion: 2.1 time: 0.050371 Oct 12 22:14:19.044600 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1632/3665] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Oct 12 22:14:18 2022] POST /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26/action => generated 938 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:14:19.074630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-82b59412-87f9-4551-b3ca-29df32531eaf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:19.076920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-82b59412-87f9-4551-b3ca-29df32531eaf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:19.086986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82b59412-87f9-4551-b3ca-29df32531eaf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:19.087744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82b59412-87f9-4551-b3ca-29df32531eaf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:19.088355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82b59412-87f9-4551-b3ca-29df32531eaf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:19.089282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82b59412-87f9-4551-b3ca-29df32531eaf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:19.089912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82b59412-87f9-4551-b3ca-29df32531eaf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:19.090645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82b59412-87f9-4551-b3ca-29df32531eaf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:19.157896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-267d3301-b707-4186-a915-6f24f7535a9a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:19.176723 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-267d3301-b707-4186-a915-6f24f7535a9a tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1524 microversion: 2.1 time: 0.847584 Oct 12 22:14:19.177248 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2034/3666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:18 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1524 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:19.218332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f8130451-285c-46c8-af33-db0ae12d95fd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:19.227024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f8130451-285c-46c8-af33-db0ae12d95fd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:19.249950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8130451-285c-46c8-af33-db0ae12d95fd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:19.251080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8130451-285c-46c8-af33-db0ae12d95fd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:19.251507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8130451-285c-46c8-af33-db0ae12d95fd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:19.252432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8130451-285c-46c8-af33-db0ae12d95fd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:19.253059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8130451-285c-46c8-af33-db0ae12d95fd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:19.254653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8130451-285c-46c8-af33-db0ae12d95fd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:19.958199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-82b59412-87f9-4551-b3ca-29df32531eaf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:19.969697 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-82b59412-87f9-4551-b3ca-29df32531eaf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.915306 Oct 12 22:14:19.970199 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1633/3667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:19 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:19.979383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a54d4d7a-3f26-40ed-bdd7-ab914644688d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:19.980242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a54d4d7a-3f26-40ed-bdd7-ab914644688d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:20.011927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a54d4d7a-3f26-40ed-bdd7-ab914644688d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:20.012791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a54d4d7a-3f26-40ed-bdd7-ab914644688d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:20.014392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a54d4d7a-3f26-40ed-bdd7-ab914644688d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:20.015580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a54d4d7a-3f26-40ed-bdd7-ab914644688d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:20.016244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a54d4d7a-3f26-40ed-bdd7-ab914644688d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:20.016906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a54d4d7a-3f26-40ed-bdd7-ab914644688d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:20.160946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f8130451-285c-46c8-af33-db0ae12d95fd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:20.170398 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f8130451-285c-46c8-af33-db0ae12d95fd tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1522 microversion: 2.1 time: 0.968535 Oct 12 22:14:20.175622 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2035/3668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:19 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1522 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:20.191147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5a684e3c-cf35-491f-a0fa-793a4f19afc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:20.192017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5a684e3c-cf35-491f-a0fa-793a4f19afc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:20.212509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a684e3c-cf35-491f-a0fa-793a4f19afc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:20.213219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a684e3c-cf35-491f-a0fa-793a4f19afc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:20.213820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a684e3c-cf35-491f-a0fa-793a4f19afc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:20.214703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a684e3c-cf35-491f-a0fa-793a4f19afc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:20.215369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a684e3c-cf35-491f-a0fa-793a4f19afc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:20.215957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a684e3c-cf35-491f-a0fa-793a4f19afc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:20.367149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a54d4d7a-3f26-40ed-bdd7-ab914644688d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:20.376447 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a54d4d7a-3f26-40ed-bdd7-ab914644688d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1318 microversion: 2.1 time: 0.403371 Oct 12 22:14:20.380199 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1634/3669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:19 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:20.389489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-826e8a0f-3da4-41ff-a0cb-5b0d84362643 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:20.394752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-826e8a0f-3da4-41ff-a0cb-5b0d84362643 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:20.400482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:20.402147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-826e8a0f-3da4-41ff-a0cb-5b0d84362643 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:20.403002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-826e8a0f-3da4-41ff-a0cb-5b0d84362643 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:20.403372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-826e8a0f-3da4-41ff-a0cb-5b0d84362643 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:20.404154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-826e8a0f-3da4-41ff-a0cb-5b0d84362643 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:20.404870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-826e8a0f-3da4-41ff-a0cb-5b0d84362643 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:20.405464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-826e8a0f-3da4-41ff-a0cb-5b0d84362643 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:20.512939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5a684e3c-cf35-491f-a0fa-793a4f19afc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:20.530084 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5a684e3c-cf35-491f-a0fa-793a4f19afc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.351272 Oct 12 22:14:20.531455 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2036/3670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:20 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:20.541625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-84712640-00e0-4bc9-b6ce-9a747276c770 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:20.542575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-84712640-00e0-4bc9-b6ce-9a747276c770 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:20.562554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84712640-00e0-4bc9-b6ce-9a747276c770 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:20.563680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84712640-00e0-4bc9-b6ce-9a747276c770 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:20.564374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84712640-00e0-4bc9-b6ce-9a747276c770 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:20.565335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84712640-00e0-4bc9-b6ce-9a747276c770 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:20.566031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84712640-00e0-4bc9-b6ce-9a747276c770 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:20.566686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84712640-00e0-4bc9-b6ce-9a747276c770 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:20.814490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-826e8a0f-3da4-41ff-a0cb-5b0d84362643 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:20.824070 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-826e8a0f-3da4-41ff-a0cb-5b0d84362643 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1522 microversion: 2.1 time: 0.439045 Oct 12 22:14:20.830833 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1635/3671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:20 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1522 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:20.842915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ccb2a7fa-5bf5-46d9-8bfc-7b649a256510 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:20.843932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ccb2a7fa-5bf5-46d9-8bfc-7b649a256510 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:20.854528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ccb2a7fa-5bf5-46d9-8bfc-7b649a256510 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:20.868043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ccb2a7fa-5bf5-46d9-8bfc-7b649a256510 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:20.868862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ccb2a7fa-5bf5-46d9-8bfc-7b649a256510 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:20.869807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ccb2a7fa-5bf5-46d9-8bfc-7b649a256510 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:20.870481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ccb2a7fa-5bf5-46d9-8bfc-7b649a256510 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:20.871109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ccb2a7fa-5bf5-46d9-8bfc-7b649a256510 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:21.003377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-84712640-00e0-4bc9-b6ce-9a747276c770 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:21.025590 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-84712640-00e0-4bc9-b6ce-9a747276c770 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1524 microversion: 2.1 time: 0.489001 Oct 12 22:14:21.030178 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2037/3672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:20 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1524 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:21.050258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8e8ec16c-2e88-4ca2-a47e-19f32dd995c8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8e8ec16c-2e88-4ca2-a47e-19f32dd995c8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Request method failure captured: Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26/action HTTP/1.1 Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 285 Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwglINEGlDOr9BocY5wO9Xx43qqChsjlqD9r61HmaIIEL6djOCkMBDTPWahASzdxBY-IxGgwHeVTq3saYQxSiCfGBziJflEANUhDnl0qNNSNbnWdyn825Mt-A7NcL8fanNSlgyJCBOxpmZTnNkYN5hmKUrlCsq_TM6iJjMlS6r6Deg Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a107edadb364defb4f2c408969c097c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a107edadb364defb4f2c408969c097c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a2c263e74d274bef8094b9d7ecfc820b Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '722e8b56-e78f-4dde-af24-cee1dad1be26', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:21.065495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:21.070627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8e8ec16c-2e88-4ca2-a47e-19f32dd995c8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:21.074300 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8e8ec16c-2e88-4ca2-a47e-19f32dd995c8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "POST /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26/action" status: 400 len: 619 microversion: 2.1 time: 0.039275 Oct 12 22:14:21.079627 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2038/3673] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Oct 12 22:14:21 2022] POST /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26/action => generated 619 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:14:21.088568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-7595673a-1c5f-4fef-9d19-02bc7c993769 req-637371d7-0558-4c41-a294-62ace4e35bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5691e2-2981-42cf-ae67-ba70d4131f23", "name": "network-vif-plugged", "status": "completed", "tag": "54710401-b13b-48ce-8096-4284cea6423f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:21.127699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7595673a-1c5f-4fef-9d19-02bc7c993769 req-637371d7-0558-4c41-a294-62ace4e35bbe service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:21.128056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7595673a-1c5f-4fef-9d19-02bc7c993769 req-637371d7-0558-4c41-a294-62ace4e35bbe service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:21.128401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7595673a-1c5f-4fef-9d19-02bc7c993769 req-637371d7-0558-4c41-a294-62ace4e35bbe service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:21.170497 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-7595673a-1c5f-4fef-9d19-02bc7c993769 req-637371d7-0558-4c41-a294-62ace4e35bbe service nova] Creating event network-vif-plugged:54710401-b13b-48ce-8096-4284cea6423f for instance bd5691e2-2981-42cf-ae67-ba70d4131f23 on n-h1-861111-1 Oct 12 22:14:21.183933 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-7595673a-1c5f-4fef-9d19-02bc7c993769 req-637371d7-0558-4c41-a294-62ace4e35bbe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100131 Oct 12 22:14:21.184885 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2039/3674] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:21.201748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2d3354a0-90c4-4eeb-9797-3ea1b3a1fd5c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:21.217434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2d3354a0-90c4-4eeb-9797-3ea1b3a1fd5c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:21.231127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d3354a0-90c4-4eeb-9797-3ea1b3a1fd5c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:21.232005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d3354a0-90c4-4eeb-9797-3ea1b3a1fd5c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:21.232676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d3354a0-90c4-4eeb-9797-3ea1b3a1fd5c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:21.252495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d3354a0-90c4-4eeb-9797-3ea1b3a1fd5c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:21.253634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d3354a0-90c4-4eeb-9797-3ea1b3a1fd5c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:21.254098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d3354a0-90c4-4eeb-9797-3ea1b3a1fd5c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:21.649118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ccb2a7fa-5bf5-46d9-8bfc-7b649a256510 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:21.658563 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ccb2a7fa-5bf5-46d9-8bfc-7b649a256510 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.826019 Oct 12 22:14:21.671479 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1636/3675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:20 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:21.672551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6bb4626a-926f-4e8d-805b-df0bdc25aac9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:21.673661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6bb4626a-926f-4e8d-805b-df0bdc25aac9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:21.691038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb4626a-926f-4e8d-805b-df0bdc25aac9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:21.697293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb4626a-926f-4e8d-805b-df0bdc25aac9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:21.698077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb4626a-926f-4e8d-805b-df0bdc25aac9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:21.699194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb4626a-926f-4e8d-805b-df0bdc25aac9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:21.700354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb4626a-926f-4e8d-805b-df0bdc25aac9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:21.702678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb4626a-926f-4e8d-805b-df0bdc25aac9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:21.783604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2d3354a0-90c4-4eeb-9797-3ea1b3a1fd5c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:21.792589 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2d3354a0-90c4-4eeb-9797-3ea1b3a1fd5c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1522 microversion: 2.1 time: 0.603527 Oct 12 22:14:21.795576 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2040/3676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:21 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1522 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:21.822589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6510230e-b3b4-4cc2-ad0b-eb6cb1324e23 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:21.824682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6510230e-b3b4-4cc2-ad0b-eb6cb1324e23 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:21.842570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6510230e-b3b4-4cc2-ad0b-eb6cb1324e23 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:21.844140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6510230e-b3b4-4cc2-ad0b-eb6cb1324e23 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:21.846258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6510230e-b3b4-4cc2-ad0b-eb6cb1324e23 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:21.847149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6510230e-b3b4-4cc2-ad0b-eb6cb1324e23 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:21.848782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6510230e-b3b4-4cc2-ad0b-eb6cb1324e23 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:21.849972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6510230e-b3b4-4cc2-ad0b-eb6cb1324e23 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:22.145018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6bb4626a-926f-4e8d-805b-df0bdc25aac9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:22.153461 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6bb4626a-926f-4e8d-805b-df0bdc25aac9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1318 microversion: 2.1 time: 0.490105 Oct 12 22:14:22.157716 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1637/3677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:21 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1318 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:22.165314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-68a61743-9f3c-40df-8f08-586cfcd29c03 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:22.169708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-68a61743-9f3c-40df-8f08-586cfcd29c03 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:22.189176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68a61743-9f3c-40df-8f08-586cfcd29c03 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:22.189944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68a61743-9f3c-40df-8f08-586cfcd29c03 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:22.191157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68a61743-9f3c-40df-8f08-586cfcd29c03 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:22.192840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68a61743-9f3c-40df-8f08-586cfcd29c03 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:22.195472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68a61743-9f3c-40df-8f08-586cfcd29c03 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:22.196185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68a61743-9f3c-40df-8f08-586cfcd29c03 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:22.224399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6510230e-b3b4-4cc2-ad0b-eb6cb1324e23 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:22.233503 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6510230e-b3b4-4cc2-ad0b-eb6cb1324e23 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.423702 Oct 12 22:14:22.255373 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2041/3678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:21 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:22.264585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-99fc37ce-f78e-4461-b3d1-8f8655bb7718 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:22.265830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-99fc37ce-f78e-4461-b3d1-8f8655bb7718 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:22.274261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99fc37ce-f78e-4461-b3d1-8f8655bb7718 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:22.275120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99fc37ce-f78e-4461-b3d1-8f8655bb7718 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:22.275813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99fc37ce-f78e-4461-b3d1-8f8655bb7718 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:22.276758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99fc37ce-f78e-4461-b3d1-8f8655bb7718 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:22.277435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99fc37ce-f78e-4461-b3d1-8f8655bb7718 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:22.278816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99fc37ce-f78e-4461-b3d1-8f8655bb7718 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:22.738748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-68a61743-9f3c-40df-8f08-586cfcd29c03 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:22.752529 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-68a61743-9f3c-40df-8f08-586cfcd29c03 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1522 microversion: 2.1 time: 0.590954 Oct 12 22:14:22.754254 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1638/3679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:22 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1522 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:22.770628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6514f3d1-4959-4761-a3c5-7d26e67eede4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:22.771630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6514f3d1-4959-4761-a3c5-7d26e67eede4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:22.798651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6514f3d1-4959-4761-a3c5-7d26e67eede4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:22.799668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6514f3d1-4959-4761-a3c5-7d26e67eede4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:22.807420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6514f3d1-4959-4761-a3c5-7d26e67eede4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:22.808558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6514f3d1-4959-4761-a3c5-7d26e67eede4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:22.809440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6514f3d1-4959-4761-a3c5-7d26e67eede4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:22.810385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6514f3d1-4959-4761-a3c5-7d26e67eede4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:22.817263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-99fc37ce-f78e-4461-b3d1-8f8655bb7718 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:22.833134 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-99fc37ce-f78e-4461-b3d1-8f8655bb7718 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1524 microversion: 2.1 time: 0.576202 Oct 12 22:14:22.834851 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2042/3680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:22 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1524 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:22.848733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-604502ba-219e-4215-bb01-e777d64d7f8c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1220175481"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:22.855194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-604502ba-219e-4215-bb01-e777d64d7f8c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:22.862239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-604502ba-219e-4215-bb01-e777d64d7f8c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:22.863022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-604502ba-219e-4215-bb01-e777d64d7f8c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:22.864321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-604502ba-219e-4215-bb01-e777d64d7f8c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:22.865257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-604502ba-219e-4215-bb01-e777d64d7f8c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:22.866065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-604502ba-219e-4215-bb01-e777d64d7f8c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:22.866554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-604502ba-219e-4215-bb01-e777d64d7f8c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:22.903807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:22.994036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6514f3d1-4959-4761-a3c5-7d26e67eede4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Locking {{(pid=120452) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 12 22:14:23.213993 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6514f3d1-4959-4761-a3c5-7d26e67eede4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 202 len: 0 microversion: 2.1 time: 0.454176 Oct 12 22:14:23.219661 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1639/3681] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:22 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:14:23.240336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1a0c35b7-2954-4e1b-9e64-62f27210c1fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:23.242992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1a0c35b7-2954-4e1b-9e64-62f27210c1fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:23.261200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a0c35b7-2954-4e1b-9e64-62f27210c1fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:23.262139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a0c35b7-2954-4e1b-9e64-62f27210c1fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:23.264239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a0c35b7-2954-4e1b-9e64-62f27210c1fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:23.265482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a0c35b7-2954-4e1b-9e64-62f27210c1fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:23.267495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a0c35b7-2954-4e1b-9e64-62f27210c1fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:23.269269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a0c35b7-2954-4e1b-9e64-62f27210c1fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:23.488333 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-604502ba-219e-4215-bb01-e777d64d7f8c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "POST /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26/action" status: 202 len: 0 microversion: 2.1 time: 0.649875 Oct 12 22:14:23.491441 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2043/3682] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:22 2022] POST /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:14:23.513597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-700c453e-4d2d-4835-b08b-57b3f693ba38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:23.516615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-700c453e-4d2d-4835-b08b-57b3f693ba38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:23.548116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:23.560742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-700c453e-4d2d-4835-b08b-57b3f693ba38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:23.561861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-700c453e-4d2d-4835-b08b-57b3f693ba38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:23.562423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-700c453e-4d2d-4835-b08b-57b3f693ba38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:23.564181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-700c453e-4d2d-4835-b08b-57b3f693ba38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:23.564771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-700c453e-4d2d-4835-b08b-57b3f693ba38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:23.568279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-700c453e-4d2d-4835-b08b-57b3f693ba38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:23.618790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1a0c35b7-2954-4e1b-9e64-62f27210c1fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:23.639375 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1a0c35b7-2954-4e1b-9e64-62f27210c1fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1508 microversion: 2.1 time: 0.413983 Oct 12 22:14:23.640755 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1640/3683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:23 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1508 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:23.658518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1838709826", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0bc30381-a257-4187-b0f2-f1402752d657"}, {"port": "e0247182-2fee-4dd5-a752-f742140f2091", "tag": "port-1"}, {"port": "8ed1a573-7211-4891-abce-2146ad739e4b", "tag": "port-2"}, {"uuid": "4f6c9dc2-d58e-4c04-aa38-6ca4b77c3839", "tag": "net-1"}, {"uuid": "4f6c9dc2-d58e-4c04-aa38-6ca4b77c3839"}, {"uuid": "be39a632-3d64-4e13-9578-26b683d229eb", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "be39a632-3d64-4e13-9578-26b683d229eb", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ac72feb1-dbc1-4454-854e-f27ebc5f31ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "7173180d-92d5-4e2c-b8aa-d3432315b72b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6918673d-7942-43d5-95b1-ed9593543951", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1708934062"}], "key_name": "tempest-keypair-1803936241", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:23.893168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-700c453e-4d2d-4835-b08b-57b3f693ba38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:23.907871 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-700c453e-4d2d-4835-b08b-57b3f693ba38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.414639 Oct 12 22:14:23.909193 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2044/3684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:23 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:23.918909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-815c43f7-dbf5-4844-b1c2-eceedaceff68 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-712892869"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:23.921688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-815c43f7-dbf5-4844-b1c2-eceedaceff68 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:23.929370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-815c43f7-dbf5-4844-b1c2-eceedaceff68 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:23.930097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-815c43f7-dbf5-4844-b1c2-eceedaceff68 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:23.930729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-815c43f7-dbf5-4844-b1c2-eceedaceff68 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:23.931694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-815c43f7-dbf5-4844-b1c2-eceedaceff68 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:23.932313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-815c43f7-dbf5-4844-b1c2-eceedaceff68 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:23.932907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-815c43f7-dbf5-4844-b1c2-eceedaceff68 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:23.999073 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-815c43f7-dbf5-4844-b1c2-eceedaceff68 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] HTTP exception thrown: Cannot 'createImage' instance 722e8b56-e78f-4dde-af24-cee1dad1be26 while it is in task_state image_snapshot Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-815c43f7-dbf5-4844-b1c2-eceedaceff68 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Request method failure captured: Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26/action HTTP/1.1 Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 84 Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwglINEGlDOr9BocY5wO9Xx43qqChsjlqD9r61HmaIIEL6djOCkMBDTPWahASzdxBY-IxGgwHeVTq3saYQxSiCfGBziJflEANUhDnl0qNNSNbnWdyn825Mt-A7NcL8fanNSlgyJCBOxpmZTnNkYN5hmKUrlCsq_TM6iJjMlS6r6Deg Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a107edadb364defb4f2c408969c097c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a107edadb364defb4f2c408969c097c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a2c263e74d274bef8094b9d7ecfc820b Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-712892869"}} Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: exception: Cannot 'createImage' instance 722e8b56-e78f-4dde-af24-cee1dad1be26 while it is in task_state image_snapshot Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '722e8b56-e78f-4dde-af24-cee1dad1be26', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-712892869'}}} Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:14:24.015343 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 722e8b56-e78f-4dde-af24-cee1dad1be26 while it is in task_state image_snapshot Oct 12 22:14:24.020508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:24.020508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:24.020508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:24.020508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:24.020508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:24.020508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:24.020508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:24.020508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:24.020508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 722e8b56-e78f-4dde-af24-cee1dad1be26 while it is in task_state image_snapshot Oct 12 22:14:24.020508 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:24.025130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-815c43f7-dbf5-4844-b1c2-eceedaceff68 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Returning 409 to user: Cannot 'createImage' instance 722e8b56-e78f-4dde-af24-cee1dad1be26 while it is in task_state image_snapshot {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:24.031159 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-815c43f7-dbf5-4844-b1c2-eceedaceff68 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "POST /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26/action" status: 409 len: 159 microversion: 2.1 time: 0.120588 Oct 12 22:14:24.032796 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2045/3685] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:23 2022] POST /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26/action => generated 159 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:14:24.037588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] validate_networks() for [('0bc30381-a257-4187-b0f2-f1402752d657', None, None, None, None, None), (None, None, 'e0247182-2fee-4dd5-a752-f742140f2091', None, None, None), (None, None, '8ed1a573-7211-4891-abce-2146ad739e4b', None, None, None), ('4f6c9dc2-d58e-4c04-aa38-6ca4b77c3839', None, None, None, None, None), ('4f6c9dc2-d58e-4c04-aa38-6ca4b77c3839', None, None, None, None, None), ('be39a632-3d64-4e13-9578-26b683d229eb', '10.2.2.100', None, None, None, None), ('be39a632-3d64-4e13-9578-26b683d229eb', '10.2.2.200', None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:14:24.038498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e8ce1ee4-82d3-47d7-bdb6-be4e032bcb65 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:24.039501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e8ce1ee4-82d3-47d7-bdb6-be4e032bcb65 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:24.046833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8ce1ee4-82d3-47d7-bdb6-be4e032bcb65 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:24.047668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8ce1ee4-82d3-47d7-bdb6-be4e032bcb65 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:24.048323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8ce1ee4-82d3-47d7-bdb6-be4e032bcb65 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:24.049247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8ce1ee4-82d3-47d7-bdb6-be4e032bcb65 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:24.049904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8ce1ee4-82d3-47d7-bdb6-be4e032bcb65 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:24.054390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8ce1ee4-82d3-47d7-bdb6-be4e032bcb65 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:24.096187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:24.296771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e8ce1ee4-82d3-47d7-bdb6-be4e032bcb65 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:24.316309 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e8ce1ee4-82d3-47d7-bdb6-be4e032bcb65 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1508 microversion: 2.1 time: 0.282131 Oct 12 22:14:24.316902 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2046/3686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:24 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1508 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:24.329291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5b9dadda-50f7-4d7e-b88b-61483be0fadd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:24.329955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5b9dadda-50f7-4d7e-b88b-61483be0fadd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:24.348178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b9dadda-50f7-4d7e-b88b-61483be0fadd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:24.349213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b9dadda-50f7-4d7e-b88b-61483be0fadd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:24.350021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b9dadda-50f7-4d7e-b88b-61483be0fadd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:24.351026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b9dadda-50f7-4d7e-b88b-61483be0fadd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:24.351726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b9dadda-50f7-4d7e-b88b-61483be0fadd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:24.352450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b9dadda-50f7-4d7e-b88b-61483be0fadd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:24.761011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5b9dadda-50f7-4d7e-b88b-61483be0fadd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:24.773106 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5b9dadda-50f7-4d7e-b88b-61483be0fadd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1524 microversion: 2.1 time: 0.449800 Oct 12 22:14:24.774207 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2047/3687] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:24 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1524 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:24.795428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7c9d4fba-2e85-46f8-9439-45f908974af9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:24.814438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c9d4fba-2e85-46f8-9439-45f908974af9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:24.815148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c9d4fba-2e85-46f8-9439-45f908974af9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:24.815726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c9d4fba-2e85-46f8-9439-45f908974af9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:24.865135 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-7c9d4fba-2e85-46f8-9439-45f908974af9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] HTTP exception thrown: Instance 4023ebba-05d4-4225-938a-c70c2490ae29 is locked Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7c9d4fba-2e85-46f8-9439-45f908974af9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Request method failure captured: Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action HTTP/1.1 Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 15 Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzriWjH9XGk2m6XxAkFWCa5SU4u3aYbKjccJUM74Gs6m2ZTWTRgYJo3xNK7Dl1yHzUOL0UlgCpklDDkzfGl4zIrs1ucJJAHjnDilUmOFjpe-CEtT-kGaW-5sHatvR75wN517xqlZ9fiNsyKxLaujP5hWxgbqYLVY-SfHQMzPuASo904 Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 319a8f107945457a8a8f8e9690a697e5 Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319a8f107945457a8a8f8e9690a697e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 319a8f107945457a8a8f8e9690a697e5 Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerActionsTestJSON-1007032333-project Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: b29c500796d54d6188ff65056340d35f Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerActionsTestJSON-1007032333-project Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: {"os-stop": {}} Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 4023ebba-05d4-4225-938a-c70c2490ae29 is locked Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '4023ebba-05d4-4225-938a-c70c2490ae29', 'body': {'os-stop': {}}} Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 4023ebba-05d4-4225-938a-c70c2490ae29 is locked Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 4023ebba-05d4-4225-938a-c70c2490ae29 is locked Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4023ebba-05d4-4225-938a-c70c2490ae29 is locked Oct 12 22:14:24.867751 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:24.872533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7c9d4fba-2e85-46f8-9439-45f908974af9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Returning 409 to user: Instance 4023ebba-05d4-4225-938a-c70c2490ae29 is locked {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:24.872533 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7c9d4fba-2e85-46f8-9439-45f908974af9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 409 len: 107 microversion: 2.1 time: 0.093776 Oct 12 22:14:24.874996 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2048/3688] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:24 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 107 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:14:24.882339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1fcb5f86-64fb-457c-aa79-0dbd6b42e6d0 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '.version_select at 0x7f5123550c10>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:25.135066 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1fcb5f86-64fb-457c-aa79-0dbd6b42e6d0 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "DELETE /compute/v2.1/images/1e3e1947-9993-47e8-aafd-6d537fbccce8" status: 204 len: 0 microversion: 2.1 time: 0.256671 Oct 12 22:14:25.135642 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2049/3689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:24 2022] DELETE /compute/v2.1/images/1e3e1947-9993-47e8-aafd-6d537fbccce8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:14:25.277152 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3ba691c0-3284-4e7d-818f-cfb58983f82d tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] 10.222.0.16 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.134777 Oct 12 22:14:25.287425 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2050/3690] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 12 22:14:25 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 22:14:25.299653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:25.312141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:25.333394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:25.334047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:25.334999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:25.336338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:25.337809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:25.338484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:25.546801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:14:25.548345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:14:25.548957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:14:25.549479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:14:25.550011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:14:25.688384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:25.698756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:25.701689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:25.702390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:25.711562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:25.712566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:25.713258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:25.777872 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7b782ec4-e884-4e51-b675-5ed06764adc7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "POST /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23/action" status: 202 len: 1110 microversion: 2.1 time: 0.488735 Oct 12 22:14:25.797203 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2051/3691] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:25 2022] POST /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23/action => generated 1110 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 12 22:14:25.803428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1afbabc8-f462-4959-96cc-24dbf19d4fde tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:25.815748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1afbabc8-f462-4959-96cc-24dbf19d4fde tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:25.833487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1afbabc8-f462-4959-96cc-24dbf19d4fde tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:25.839551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1afbabc8-f462-4959-96cc-24dbf19d4fde tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:25.840347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1afbabc8-f462-4959-96cc-24dbf19d4fde tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:25.845300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1afbabc8-f462-4959-96cc-24dbf19d4fde tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:25.846046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1afbabc8-f462-4959-96cc-24dbf19d4fde tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:25.846718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1afbabc8-f462-4959-96cc-24dbf19d4fde tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:25.977204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1afbabc8-f462-4959-96cc-24dbf19d4fde tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Unlocking {{(pid=120453) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 12 22:14:26.140908 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1afbabc8-f462-4959-96cc-24dbf19d4fde tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 202 len: 0 microversion: 2.1 time: 0.341764 Oct 12 22:14:26.141742 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2052/3692] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:25 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:14:26.148053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eca99382-07c0-4886-a8b7-870ae68113b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:26.156362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eca99382-07c0-4886-a8b7-870ae68113b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:26.178693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eca99382-07c0-4886-a8b7-870ae68113b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:26.179974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eca99382-07c0-4886-a8b7-870ae68113b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:26.180718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eca99382-07c0-4886-a8b7-870ae68113b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:26.184159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eca99382-07c0-4886-a8b7-870ae68113b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:26.184919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eca99382-07c0-4886-a8b7-870ae68113b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:26.185586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eca99382-07c0-4886-a8b7-870ae68113b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:26.343064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:26.608666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eca99382-07c0-4886-a8b7-870ae68113b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:26.620450 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eca99382-07c0-4886-a8b7-870ae68113b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1540 microversion: 2.1 time: 0.477422 Oct 12 22:14:26.623556 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2053/3693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:26 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1540 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:26.628598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e734594c-0dca-4f5f-9ce3-19a6e2fe0f99 tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] Calling method '.version_select at 0x7f5123453c10>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:26.663511 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-e734594c-0dca-4f5f-9ce3-19a6e2fe0f99 tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] HTTP exception thrown: Image not found. Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e734594c-0dca-4f5f-9ce3-19a6e2fe0f99 tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] Request method failure captured: Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzw_L9WzlRHToo4hY0tHi4sRncCMt0AypfV6Z5FmqTYIy3nm_sgyATRxA3p4Ma8GmF2HPJhCiJXM4Tq5g9hwyTJLTEEagSxZDPzVWLCNRvQXvE1W60sPVUWL3GFUjj2_Dr9zPYReoeVYA67T3ncUTmwONbFozsQpljc1pJIRgBOyDNw Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 34da416232ee4974b9d29514304faf8c Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1754003195 Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34da416232ee4974b9d29514304faf8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34da416232ee4974b9d29514304faf8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_34da416232ee4974b9d29514304faf8c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/34da416232ee4974b9d29514304faf8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1754003195 Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 34da416232ee4974b9d29514304faf8c Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1754003195 Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesDeleteNegativeTestJSON-1754003195-project Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 506eaaeb98d44e59a31a0566cd188442 Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1754003195-project Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: exception: Image not found. Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '-1'} Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:26.665523 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e734594c-0dca-4f5f-9ce3-19a6e2fe0f99 tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] Returning 404 to user: Image not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e734594c-0dca-4f5f-9ce3-19a6e2fe0f99 tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] 10.222.0.16 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.042137 Oct 12 22:14:26.672245 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2054/3694] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Oct 12 22:14:26 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:14:26.676355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-694b2d4f-e298-4809-aa42-d891e6023f48 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:26.676355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-694b2d4f-e298-4809-aa42-d891e6023f48 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:26.694406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-694b2d4f-e298-4809-aa42-d891e6023f48 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:26.694902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-694b2d4f-e298-4809-aa42-d891e6023f48 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:26.695379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-694b2d4f-e298-4809-aa42-d891e6023f48 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:26.696097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-694b2d4f-e298-4809-aa42-d891e6023f48 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:26.698680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-694b2d4f-e298-4809-aa42-d891e6023f48 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:26.699113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-694b2d4f-e298-4809-aa42-d891e6023f48 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:27.023471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-694b2d4f-e298-4809-aa42-d891e6023f48 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:27.036989 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-694b2d4f-e298-4809-aa42-d891e6023f48 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1515 microversion: 2.1 time: 0.368220 Oct 12 22:14:27.037878 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2055/3695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:26 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1515 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:27.055413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-05d4f5df-a297-44a9-a89e-da2f117c2399 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:27.056477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-05d4f5df-a297-44a9-a89e-da2f117c2399 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:27.081393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05d4f5df-a297-44a9-a89e-da2f117c2399 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:27.083999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05d4f5df-a297-44a9-a89e-da2f117c2399 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:27.086864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05d4f5df-a297-44a9-a89e-da2f117c2399 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:27.088028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05d4f5df-a297-44a9-a89e-da2f117c2399 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:27.090033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05d4f5df-a297-44a9-a89e-da2f117c2399 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:27.092241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05d4f5df-a297-44a9-a89e-da2f117c2399 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:27.579282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-05d4f5df-a297-44a9-a89e-da2f117c2399 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:27.588259 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-05d4f5df-a297-44a9-a89e-da2f117c2399 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1524 microversion: 2.1 time: 0.548912 Oct 12 22:14:27.604575 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2056/3696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:27 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1524 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:27.615597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f510f286-bb20-448a-a341-42a7215f2cce tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:27.626505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f510f286-bb20-448a-a341-42a7215f2cce tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:27.627310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f510f286-bb20-448a-a341-42a7215f2cce tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:27.627930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f510f286-bb20-448a-a341-42a7215f2cce tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:27.664398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f510f286-bb20-448a-a341-42a7215f2cce tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Going to try to stop instance {{(pid=120453) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 22:14:27.742132 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f510f286-bb20-448a-a341-42a7215f2cce tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 202 len: 0 microversion: 2.1 time: 0.135961 Oct 12 22:14:27.745687 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2057/3697] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:27 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:14:27.749920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3fb285d4-51b5-4e1a-8045-587df28f7bc0 tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] Calling method '.version_select at 0x7f51234535e0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:27.810754 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-3fb285d4-51b5-4e1a-8045-587df28f7bc0 tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] HTTP exception thrown: Image not found. Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3fb285d4-51b5-4e1a-8045-587df28f7bc0 tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] Request method failure captured: Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/images/5be87918-0f07-4c7e-92ce-bdeff8a495cj HTTP/1.1 Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzw_L9WzlRHToo4hY0tHi4sRncCMt0AypfV6Z5FmqTYIy3nm_sgyATRxA3p4Ma8GmF2HPJhCiJXM4Tq5g9hwyTJLTEEagSxZDPzVWLCNRvQXvE1W60sPVUWL3GFUjj2_Dr9zPYReoeVYA67T3ncUTmwONbFozsQpljc1pJIRgBOyDNw Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 34da416232ee4974b9d29514304faf8c Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1754003195 Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34da416232ee4974b9d29514304faf8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34da416232ee4974b9d29514304faf8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_34da416232ee4974b9d29514304faf8c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/34da416232ee4974b9d29514304faf8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1754003195 Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 34da416232ee4974b9d29514304faf8c Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1754003195 Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesDeleteNegativeTestJSON-1754003195-project Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 506eaaeb98d44e59a31a0566cd188442 Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1754003195-project Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: exception: Image not found. Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '5be87918-0f07-4c7e-92ce-bdeff8a495cj'} Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5be87918-0f07-4c7e-92ce-bdeff8a495cj to delete Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5be87918-0f07-4c7e-92ce-bdeff8a495cj could not be found. Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:27.815651 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:14:27.820455 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:27.825029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3fb285d4-51b5-4e1a-8045-587df28f7bc0 tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] Returning 404 to user: Image not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:27.826359 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3fb285d4-51b5-4e1a-8045-587df28f7bc0 tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] 10.222.0.16 "DELETE /compute/v2.1/images/5be87918-0f07-4c7e-92ce-bdeff8a495cj" status: 404 len: 62 microversion: 2.1 time: 0.081645 Oct 12 22:14:27.827512 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2058/3698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:27 2022] DELETE /compute/v2.1/images/5be87918-0f07-4c7e-92ce-bdeff8a495cj => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:14:27.841875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-229460e4-54a9-42b5-9c3b-5df03adf9e0c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:27.853209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-229460e4-54a9-42b5-9c3b-5df03adf9e0c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:27.882498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-229460e4-54a9-42b5-9c3b-5df03adf9e0c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:27.884287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-229460e4-54a9-42b5-9c3b-5df03adf9e0c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:27.884741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-229460e4-54a9-42b5-9c3b-5df03adf9e0c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:27.885488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-229460e4-54a9-42b5-9c3b-5df03adf9e0c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:27.896228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-229460e4-54a9-42b5-9c3b-5df03adf9e0c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:27.899220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-229460e4-54a9-42b5-9c3b-5df03adf9e0c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:27.943137 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-229460e4-54a9-42b5-9c3b-5df03adf9e0c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] HTTP exception thrown: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-229460e4-54a9-42b5-9c3b-5df03adf9e0c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Request method failure captured: Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 HTTP/1.1 Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzoV3foVnGv0suVxK_Nk7Pp5_kjAPhL8yzVHClSGl5RRxDIZH7rcf5PLHi4YXEet-A0AtHcDaHpFcS_aQR9wl8soXuphQXdzTm1zPCiMI4BUWAPu4l1z3R9DkYDtzHZhHRlT-3CEyzuxgoolPW6Gw8glco6cFnu099ScND31HIZBEC4 Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68913d260d084ce4a8e29daf4783c0bc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 13c74a78e82f4e72a7d1f7b133074f5a Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'feeebc28-6cfd-4f7d-8e32-d725731d0ba3'} Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:14:27.949674 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:14:27.954670 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. Oct 12 22:14:27.954670 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:27.954670 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:27.954670 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:27.954670 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:27.954670 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:27.954670 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:27.954670 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:27.954670 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:27.954670 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. Oct 12 22:14:27.954670 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:27.956858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-229460e4-54a9-42b5-9c3b-5df03adf9e0c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Returning 404 to user: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:27.958319 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-229460e4-54a9-42b5-9c3b-5df03adf9e0c tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "DELETE /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 404 len: 111 microversion: 2.1 time: 0.129610 Oct 12 22:14:27.962564 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2059/3699] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:14:27 2022] DELETE /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:14:27.973612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2528a903-18e5-401c-92a9-2e3b9a776703 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:27.974455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2528a903-18e5-401c-92a9-2e3b9a776703 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:27.985376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2528a903-18e5-401c-92a9-2e3b9a776703 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:27.986072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2528a903-18e5-401c-92a9-2e3b9a776703 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:27.986955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2528a903-18e5-401c-92a9-2e3b9a776703 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:27.987929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2528a903-18e5-401c-92a9-2e3b9a776703 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:27.988459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2528a903-18e5-401c-92a9-2e3b9a776703 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:27.989109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2528a903-18e5-401c-92a9-2e3b9a776703 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:28.337802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2528a903-18e5-401c-92a9-2e3b9a776703 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:28.348542 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2528a903-18e5-401c-92a9-2e3b9a776703 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1540 microversion: 2.1 time: 0.380392 Oct 12 22:14:28.369018 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2060/3700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:27 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1540 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:28.379559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1ea6c531-cf37-494c-923b-229cfda54f37 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:28.380191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1ea6c531-cf37-494c-923b-229cfda54f37 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:28.386753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ea6c531-cf37-494c-923b-229cfda54f37 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:28.387282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ea6c531-cf37-494c-923b-229cfda54f37 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:28.387704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ea6c531-cf37-494c-923b-229cfda54f37 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:28.388519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ea6c531-cf37-494c-923b-229cfda54f37 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:28.388966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ea6c531-cf37-494c-923b-229cfda54f37 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:28.389908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ea6c531-cf37-494c-923b-229cfda54f37 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:28.697083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1ea6c531-cf37-494c-923b-229cfda54f37 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:28.705534 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1ea6c531-cf37-494c-923b-229cfda54f37 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1680 microversion: 2.1 time: 0.335060 Oct 12 22:14:28.723557 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2061/3701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:28 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1680 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:28.733116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b89f20c4-b0de-42f5-8f56-30d6b41ffa7e tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] Calling method '.version_select at 0x7f51235501f0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-b89f20c4-b0de-42f5-8f56-30d6b41ffa7e tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] HTTP exception thrown: Image not found. Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b89f20c4-b0de-42f5-8f56-30d6b41ffa7e tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] Request method failure captured: Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/images/fd55da51-e367-4a3c-9779-273725aa88ee1 HTTP/1.1 Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzw_L9WzlRHToo4hY0tHi4sRncCMt0AypfV6Z5FmqTYIy3nm_sgyATRxA3p4Ma8GmF2HPJhCiJXM4Tq5g9hwyTJLTEEagSxZDPzVWLCNRvQXvE1W60sPVUWL3GFUjj2_Dr9zPYReoeVYA67T3ncUTmwONbFozsQpljc1pJIRgBOyDNw Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 34da416232ee4974b9d29514304faf8c Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1754003195 Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34da416232ee4974b9d29514304faf8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34da416232ee4974b9d29514304faf8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_34da416232ee4974b9d29514304faf8c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/34da416232ee4974b9d29514304faf8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1754003195 Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 34da416232ee4974b9d29514304faf8c Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1754003195 Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesDeleteNegativeTestJSON-1754003195-project Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 506eaaeb98d44e59a31a0566cd188442 Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1754003195-project Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: exception: Image not found. Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'fd55da51-e367-4a3c-9779-273725aa88ee1'} Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fd55da51-e367-4a3c-9779-273725aa88ee1 to delete Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:14:28.761607 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fd55da51-e367-4a3c-9779-273725aa88ee1 could not be found. Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b89f20c4-b0de-42f5-8f56-30d6b41ffa7e tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] Returning 404 to user: Image not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:28.765690 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b89f20c4-b0de-42f5-8f56-30d6b41ffa7e tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] 10.222.0.16 "DELETE /compute/v2.1/images/fd55da51-e367-4a3c-9779-273725aa88ee1" status: 404 len: 62 microversion: 2.1 time: 0.040865 Oct 12 22:14:28.770052 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2062/3702] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:14:28 2022] DELETE /compute/v2.1/images/fd55da51-e367-4a3c-9779-273725aa88ee1 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:14:28.791092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-345f8900-a8f7-4629-87e2-1c44d66621c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:28.793337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-345f8900-a8f7-4629-87e2-1c44d66621c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: feeebc28-6cfd-4f7d-8e32-d725731d0ba3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:28.811342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-345f8900-a8f7-4629-87e2-1c44d66621c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:28.814913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-345f8900-a8f7-4629-87e2-1c44d66621c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:28.815470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-345f8900-a8f7-4629-87e2-1c44d66621c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:28.816224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-345f8900-a8f7-4629-87e2-1c44d66621c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:28.816700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-345f8900-a8f7-4629-87e2-1c44d66621c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:28.817138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-345f8900-a8f7-4629-87e2-1c44d66621c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:28.841440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:14:28.841964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:14:28.842311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:14:28.844685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:14:28.845185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:14:28.850742 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-345f8900-a8f7-4629-87e2-1c44d66621c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] HTTP exception thrown: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-345f8900-a8f7-4629-87e2-1c44d66621c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Request method failure captured: Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 HTTP/1.1 Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzoV3foVnGv0suVxK_Nk7Pp5_kjAPhL8yzVHClSGl5RRxDIZH7rcf5PLHi4YXEet-A0AtHcDaHpFcS_aQR9wl8soXuphQXdzTm1zPCiMI4BUWAPu4l1z3R9DkYDtzHZhHRlT-3CEyzuxgoolPW6Gw8glco6cFnu099ScND31HIZBEC4 Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68913d260d084ce4a8e29daf4783c0bc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 13c74a78e82f4e72a7d1f7b133074f5a Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'feeebc28-6cfd-4f7d-8e32-d725731d0ba3'} Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:28.852393 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:28.856556 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:28.856556 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:28.856556 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:28.856556 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:28.856556 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:28.856556 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. Oct 12 22:14:28.856556 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:28.856556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-345f8900-a8f7-4629-87e2-1c44d66621c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Returning 404 to user: Instance feeebc28-6cfd-4f7d-8e32-d725731d0ba3 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:28.856556 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-345f8900-a8f7-4629-87e2-1c44d66621c9 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3" status: 404 len: 111 microversion: 2.1 time: 0.077812 Oct 12 22:14:28.863210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:28.863811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:28.864713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:28.865766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:28.866376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:28.867018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:28.869623 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2063/3703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:28 2022] GET /compute/v2.1/servers/feeebc28-6cfd-4f7d-8e32-d725731d0ba3 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:14:28.876714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-135d55f8-55b1-4c56-baf2-9a13c7c0ca17 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:28.882787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-135d55f8-55b1-4c56-baf2-9a13c7c0ca17 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:28.894500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Getting quotas for project d8a8bf42585148ff9e29ab4bb8f932a6. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:28.901000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-135d55f8-55b1-4c56-baf2-9a13c7c0ca17 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:28.901557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-135d55f8-55b1-4c56-baf2-9a13c7c0ca17 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:28.901716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Getting quotas for user ea6c240d338349f89c5cc98058ea225c and project d8a8bf42585148ff9e29ab4bb8f932a6. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:28.902005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-135d55f8-55b1-4c56-baf2-9a13c7c0ca17 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:28.902716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-135d55f8-55b1-4c56-baf2-9a13c7c0ca17 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:28.903225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-135d55f8-55b1-4c56-baf2-9a13c7c0ca17 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:28.903887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-135d55f8-55b1-4c56-baf2-9a13c7c0ca17 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:28.913204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:29.239470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:14:29.242865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ac72feb1-dbc1-4454-854e-f27ebc5f31ef',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='7173180d-92d5-4e2c-b8aa-d3432315b72b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6918673d-7942-43d5-95b1-ed9593543951',volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:14:29.346939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-135d55f8-55b1-4c56-baf2-9a13c7c0ca17 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:29.356171 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-135d55f8-55b1-4c56-baf2-9a13c7c0ca17 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1515 microversion: 2.1 time: 0.485439 Oct 12 22:14:29.360125 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2064/3704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:28 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1515 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:29.376424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-28cd884c-79dd-421c-aef1-91f6b3a5a293 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:29.377326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-28cd884c-79dd-421c-aef1-91f6b3a5a293 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:29.395592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28cd884c-79dd-421c-aef1-91f6b3a5a293 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:29.397571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28cd884c-79dd-421c-aef1-91f6b3a5a293 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:29.398266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28cd884c-79dd-421c-aef1-91f6b3a5a293 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:29.399979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28cd884c-79dd-421c-aef1-91f6b3a5a293 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:29.401655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28cd884c-79dd-421c-aef1-91f6b3a5a293 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:29.403745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28cd884c-79dd-421c-aef1-91f6b3a5a293 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:29.825596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-28cd884c-79dd-421c-aef1-91f6b3a5a293 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:29.842951 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-28cd884c-79dd-421c-aef1-91f6b3a5a293 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1524 microversion: 2.1 time: 0.481406 Oct 12 22:14:29.846295 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2065/3705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:29 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1524 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:29.869801 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-45940d67-2cf0-4d65-b936-8c1e985ef83a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 6.226437 Oct 12 22:14:29.870463 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1641/3706] 10.222.0.16 () {62 vars in 1189 bytes} [Wed Oct 12 22:14:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 6228 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:14:29.870846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7cb6a3a9-58f2-4b32-913d-e056815327e7 tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] Calling method '.version_select at 0x7f512c3d0670>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:29.881852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-34a4d45e-5191-4fbd-b084-e0d6df4b154a tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:29.882497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-34a4d45e-5191-4fbd-b084-e0d6df4b154a tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:29.891901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34a4d45e-5191-4fbd-b084-e0d6df4b154a tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:29.892660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34a4d45e-5191-4fbd-b084-e0d6df4b154a tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:29.893473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34a4d45e-5191-4fbd-b084-e0d6df4b154a tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:29.894428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34a4d45e-5191-4fbd-b084-e0d6df4b154a tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:29.895682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34a4d45e-5191-4fbd-b084-e0d6df4b154a tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:29.896321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34a4d45e-5191-4fbd-b084-e0d6df4b154a tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:29.904189 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-7cb6a3a9-58f2-4b32-913d-e056815327e7 tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] HTTP exception thrown: Image not found. Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7cb6a3a9-58f2-4b32-913d-e056815327e7 tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] Request method failure captured: Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/images/tempest-invalid-1357071229 HTTP/1.1 Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzw_L9WzlRHToo4hY0tHi4sRncCMt0AypfV6Z5FmqTYIy3nm_sgyATRxA3p4Ma8GmF2HPJhCiJXM4Tq5g9hwyTJLTEEagSxZDPzVWLCNRvQXvE1W60sPVUWL3GFUjj2_Dr9zPYReoeVYA67T3ncUTmwONbFozsQpljc1pJIRgBOyDNw Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 34da416232ee4974b9d29514304faf8c Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1754003195 Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34da416232ee4974b9d29514304faf8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34da416232ee4974b9d29514304faf8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_34da416232ee4974b9d29514304faf8c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/34da416232ee4974b9d29514304faf8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1754003195 Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 34da416232ee4974b9d29514304faf8c Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1754003195 Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesDeleteNegativeTestJSON-1754003195-project Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 506eaaeb98d44e59a31a0566cd188442 Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1754003195-project Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: exception: Image not found. Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'tempest-invalid-1357071229'} Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1357071229 to delete Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1357071229 could not be found. Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:29.908004 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7cb6a3a9-58f2-4b32-913d-e056815327e7 tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] Returning 404 to user: Image not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:29.912789 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7cb6a3a9-58f2-4b32-913d-e056815327e7 tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] 10.222.0.16 "DELETE /compute/v2.1/images/tempest-invalid-1357071229" status: 404 len: 62 microversion: 2.1 time: 0.061997 Oct 12 22:14:29.915606 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2066/3707] 10.222.0.16 () {58 vars in 1206 bytes} [Wed Oct 12 22:14:29 2022] DELETE /compute/v2.1/images/tempest-invalid-1357071229 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:14:29.922064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-92cb0260-7aa0-467a-9eac-ef9d8bf9b7d1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:29.923158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-92cb0260-7aa0-467a-9eac-ef9d8bf9b7d1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:29.931582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92cb0260-7aa0-467a-9eac-ef9d8bf9b7d1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:29.932084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92cb0260-7aa0-467a-9eac-ef9d8bf9b7d1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:29.932521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92cb0260-7aa0-467a-9eac-ef9d8bf9b7d1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:29.933231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92cb0260-7aa0-467a-9eac-ef9d8bf9b7d1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:29.934251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92cb0260-7aa0-467a-9eac-ef9d8bf9b7d1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:29.934695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92cb0260-7aa0-467a-9eac-ef9d8bf9b7d1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:30.189618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-34a4d45e-5191-4fbd-b084-e0d6df4b154a tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:30.199028 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-34a4d45e-5191-4fbd-b084-e0d6df4b154a tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1540 microversion: 2.1 time: 0.327512 Oct 12 22:14:30.199932 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1642/3708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:29 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1540 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:30.211141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-92cb0260-7aa0-467a-9eac-ef9d8bf9b7d1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:30.215394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-628bd3cf-46e4-4c0a-8170-12465b052a62 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:30.216017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-628bd3cf-46e4-4c0a-8170-12465b052a62 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:30.227399 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-92cb0260-7aa0-467a-9eac-ef9d8bf9b7d1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1680 microversion: 2.1 time: 0.310306 Oct 12 22:14:30.228744 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2067/3709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:29 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1680 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:30.233995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-91cb8146-78c1-4ac0-9758-eb89c89cf8ce tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] Calling method '.version_select at 0x7f512c431af0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:30.265003 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-91cb8146-78c1-4ac0-9758-eb89c89cf8ce tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] HTTP exception thrown: Image not found. Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-91cb8146-78c1-4ac0-9758-eb89c89cf8ce tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] Request method failure captured: Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/images/33ca9087-3019-4d60-a301-65f245985eb5 HTTP/1.1 Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzw_L9WzlRHToo4hY0tHi4sRncCMt0AypfV6Z5FmqTYIy3nm_sgyATRxA3p4Ma8GmF2HPJhCiJXM4Tq5g9hwyTJLTEEagSxZDPzVWLCNRvQXvE1W60sPVUWL3GFUjj2_Dr9zPYReoeVYA67T3ncUTmwONbFozsQpljc1pJIRgBOyDNw Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 34da416232ee4974b9d29514304faf8c Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1754003195 Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34da416232ee4974b9d29514304faf8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34da416232ee4974b9d29514304faf8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_34da416232ee4974b9d29514304faf8c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/34da416232ee4974b9d29514304faf8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1754003195 Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 34da416232ee4974b9d29514304faf8c Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1754003195 Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesDeleteNegativeTestJSON-1754003195-project Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 506eaaeb98d44e59a31a0566cd188442 Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1754003195-project Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: exception: Image not found. Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '33ca9087-3019-4d60-a301-65f245985eb5'} Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 33ca9087-3019-4d60-a301-65f245985eb5 to delete Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 33ca9087-3019-4d60-a301-65f245985eb5 could not be found. Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:30.267077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-91cb8146-78c1-4ac0-9758-eb89c89cf8ce tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] Returning 404 to user: Image not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-91cb8146-78c1-4ac0-9758-eb89c89cf8ce tempest-ImagesDeleteNegativeTestJSON-1754003195 tempest-ImagesDeleteNegativeTestJSON-1754003195-project] 10.222.0.16 "DELETE /compute/v2.1/images/33ca9087-3019-4d60-a301-65f245985eb5" status: 404 len: 62 microversion: 2.1 time: 0.039032 Oct 12 22:14:30.271559 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2068/3710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:30 2022] DELETE /compute/v2.1/images/33ca9087-3019-4d60-a301-65f245985eb5 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:14:30.367122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-628bd3cf-46e4-4c0a-8170-12465b052a62 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:30.382624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9476bd24-8597-41ae-b494-3bf2ce07cf63 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:30.383923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9476bd24-8597-41ae-b494-3bf2ce07cf63 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:30.392123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-628bd3cf-46e4-4c0a-8170-12465b052a62 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:30.398430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9476bd24-8597-41ae-b494-3bf2ce07cf63 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:30.401209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-628bd3cf-46e4-4c0a-8170-12465b052a62 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:30.403542 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-628bd3cf-46e4-4c0a-8170-12465b052a62 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1286 microversion: 2.32 time: 0.202387 Oct 12 22:14:30.405259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9476bd24-8597-41ae-b494-3bf2ce07cf63 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:30.405941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9476bd24-8597-41ae-b494-3bf2ce07cf63 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:30.423611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9476bd24-8597-41ae-b494-3bf2ce07cf63 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:30.424054 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1643/3711] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:14:30 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1286 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:14:30.424940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9476bd24-8597-41ae-b494-3bf2ce07cf63 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:30.431601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9476bd24-8597-41ae-b494-3bf2ce07cf63 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:30.793293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9476bd24-8597-41ae-b494-3bf2ce07cf63 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:30.804736 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9476bd24-8597-41ae-b494-3bf2ce07cf63 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1515 microversion: 2.1 time: 0.426178 Oct 12 22:14:30.828887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-f21f28e9-e450-4f7c-a37f-404d167aa372 req-06130d65-b3ab-462b-aab1-6ed934df837f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722e8b56-e78f-4dde-af24-cee1dad1be26", "name": "network-vif-plugged", "status": "completed", "tag": "d849caef-b316-4cf0-8a97-f0b2d339596f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:30.838191 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2069/3712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:30 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1515 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:30.848052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f21f28e9-e450-4f7c-a37f-404d167aa372 req-06130d65-b3ab-462b-aab1-6ed934df837f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:30.849624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f21f28e9-e450-4f7c-a37f-404d167aa372 req-06130d65-b3ab-462b-aab1-6ed934df837f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:30.851836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f21f28e9-e450-4f7c-a37f-404d167aa372 req-06130d65-b3ab-462b-aab1-6ed934df837f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:30.869782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-440ba9eb-a971-464a-95ef-04f23b65e71b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:30.870755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-440ba9eb-a971-464a-95ef-04f23b65e71b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:30.883691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440ba9eb-a971-464a-95ef-04f23b65e71b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:30.885109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440ba9eb-a971-464a-95ef-04f23b65e71b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:30.886681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440ba9eb-a971-464a-95ef-04f23b65e71b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:30.888519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440ba9eb-a971-464a-95ef-04f23b65e71b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:30.893104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440ba9eb-a971-464a-95ef-04f23b65e71b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:30.893867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440ba9eb-a971-464a-95ef-04f23b65e71b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:30.903901 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-f21f28e9-e450-4f7c-a37f-404d167aa372 req-06130d65-b3ab-462b-aab1-6ed934df837f service nova] Creating event network-vif-plugged:d849caef-b316-4cf0-8a97-f0b2d339596f for instance 722e8b56-e78f-4dde-af24-cee1dad1be26 on n-h2-861111-1 Oct 12 22:14:30.922873 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-f21f28e9-e450-4f7c-a37f-404d167aa372 req-06130d65-b3ab-462b-aab1-6ed934df837f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098271 Oct 12 22:14:30.944245 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1644/3713] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:31.194459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-440ba9eb-a971-464a-95ef-04f23b65e71b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:31.220719 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-440ba9eb-a971-464a-95ef-04f23b65e71b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1524 microversion: 2.1 time: 0.354566 Oct 12 22:14:31.221215 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2070/3714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:30 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1524 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:14:31.241660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6c0359c9-5b05-4600-bc1d-64d721d9b64f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:31.245846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6c0359c9-5b05-4600-bc1d-64d721d9b64f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:31.254663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-514ac8aa-c6b8-4f76-8478-e29156937e0c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:31.255320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-514ac8aa-c6b8-4f76-8478-e29156937e0c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:31.261903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c0359c9-5b05-4600-bc1d-64d721d9b64f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:31.264566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-514ac8aa-c6b8-4f76-8478-e29156937e0c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:31.265085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-514ac8aa-c6b8-4f76-8478-e29156937e0c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:31.266400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c0359c9-5b05-4600-bc1d-64d721d9b64f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:31.267551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-514ac8aa-c6b8-4f76-8478-e29156937e0c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:31.268734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c0359c9-5b05-4600-bc1d-64d721d9b64f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:31.269295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-514ac8aa-c6b8-4f76-8478-e29156937e0c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:31.271482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-514ac8aa-c6b8-4f76-8478-e29156937e0c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:31.271932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-514ac8aa-c6b8-4f76-8478-e29156937e0c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:31.272468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c0359c9-5b05-4600-bc1d-64d721d9b64f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:31.273445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c0359c9-5b05-4600-bc1d-64d721d9b64f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:31.275825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c0359c9-5b05-4600-bc1d-64d721d9b64f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:31.542114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6c0359c9-5b05-4600-bc1d-64d721d9b64f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:31.553950 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6c0359c9-5b05-4600-bc1d-64d721d9b64f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1535 microversion: 2.1 time: 0.331476 Oct 12 22:14:31.571373 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1645/3715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:31 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1535 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:31.579039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-023ecb69-1b00-4964-95a0-931e30724f3a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:31.581112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-023ecb69-1b00-4964-95a0-931e30724f3a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:31.699770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-023ecb69-1b00-4964-95a0-931e30724f3a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:31.710525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-023ecb69-1b00-4964-95a0-931e30724f3a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:31.729414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-023ecb69-1b00-4964-95a0-931e30724f3a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:31.737664 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-023ecb69-1b00-4964-95a0-931e30724f3a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1286 microversion: 2.32 time: 0.161939 Oct 12 22:14:31.741367 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1646/3716] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:14:31 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1286 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:14:31.788174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-514ac8aa-c6b8-4f76-8478-e29156937e0c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:31.799029 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-514ac8aa-c6b8-4f76-8478-e29156937e0c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1680 microversion: 2.1 time: 0.548890 Oct 12 22:14:31.803526 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2071/3717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:31 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1680 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:31.829603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1bc0c0a0-778c-4a2b-8e27-eed007368434 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:31.830276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1bc0c0a0-778c-4a2b-8e27-eed007368434 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:31.861381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bc0c0a0-778c-4a2b-8e27-eed007368434 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:31.862173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bc0c0a0-778c-4a2b-8e27-eed007368434 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:31.867423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bc0c0a0-778c-4a2b-8e27-eed007368434 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:31.869359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bc0c0a0-778c-4a2b-8e27-eed007368434 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:31.870392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bc0c0a0-778c-4a2b-8e27-eed007368434 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:31.871415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bc0c0a0-778c-4a2b-8e27-eed007368434 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:32.118480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1bc0c0a0-778c-4a2b-8e27-eed007368434 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:32.139496 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1bc0c0a0-778c-4a2b-8e27-eed007368434 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1515 microversion: 2.1 time: 0.314810 Oct 12 22:14:32.160936 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1647/3718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:31 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1515 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:32.256106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5fdc987b-f397-40f6-be82-08492db48001 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:32.259159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5fdc987b-f397-40f6-be82-08492db48001 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:32.285112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fdc987b-f397-40f6-be82-08492db48001 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:32.286136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fdc987b-f397-40f6-be82-08492db48001 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:32.286759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fdc987b-f397-40f6-be82-08492db48001 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:32.287855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fdc987b-f397-40f6-be82-08492db48001 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:32.288471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fdc987b-f397-40f6-be82-08492db48001 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:32.289064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fdc987b-f397-40f6-be82-08492db48001 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:32.579714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e46fd3f1-e18e-42ce-b04c-e0c311482117 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:32.580540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e46fd3f1-e18e-42ce-b04c-e0c311482117 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:32.602511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e46fd3f1-e18e-42ce-b04c-e0c311482117 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:32.604713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e46fd3f1-e18e-42ce-b04c-e0c311482117 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:32.608238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e46fd3f1-e18e-42ce-b04c-e0c311482117 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:32.609106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e46fd3f1-e18e-42ce-b04c-e0c311482117 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:32.610987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e46fd3f1-e18e-42ce-b04c-e0c311482117 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:32.611727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e46fd3f1-e18e-42ce-b04c-e0c311482117 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:32.643047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5fdc987b-f397-40f6-be82-08492db48001 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:32.659251 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5fdc987b-f397-40f6-be82-08492db48001 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1524 microversion: 2.1 time: 0.414130 Oct 12 22:14:32.661218 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2072/3719] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:32 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1524 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:32.766896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7b46bb9e-f40d-4644-b838-578e3ebd5b9f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:32.767814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7b46bb9e-f40d-4644-b838-578e3ebd5b9f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:32.779209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b46bb9e-f40d-4644-b838-578e3ebd5b9f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:32.785079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b46bb9e-f40d-4644-b838-578e3ebd5b9f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:32.785776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b46bb9e-f40d-4644-b838-578e3ebd5b9f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:32.786911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b46bb9e-f40d-4644-b838-578e3ebd5b9f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:32.787585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b46bb9e-f40d-4644-b838-578e3ebd5b9f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:32.790790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b46bb9e-f40d-4644-b838-578e3ebd5b9f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:33.018273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e46fd3f1-e18e-42ce-b04c-e0c311482117 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:33.027710 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e46fd3f1-e18e-42ce-b04c-e0c311482117 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1522 microversion: 2.1 time: 0.453481 Oct 12 22:14:33.032485 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1648/3720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:32 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:33.044078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8d4d63df-f17b-44c2-a521-da6c84b0a99c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:33.044706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8d4d63df-f17b-44c2-a521-da6c84b0a99c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:33.054372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7b46bb9e-f40d-4644-b838-578e3ebd5b9f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:33.059112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d4d63df-f17b-44c2-a521-da6c84b0a99c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:33.059649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d4d63df-f17b-44c2-a521-da6c84b0a99c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:33.060088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d4d63df-f17b-44c2-a521-da6c84b0a99c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:33.063160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d4d63df-f17b-44c2-a521-da6c84b0a99c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:33.063653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d4d63df-f17b-44c2-a521-da6c84b0a99c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:33.064088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d4d63df-f17b-44c2-a521-da6c84b0a99c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:33.087274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7b46bb9e-f40d-4644-b838-578e3ebd5b9f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:33.089267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7b46bb9e-f40d-4644-b838-578e3ebd5b9f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:33.098710 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7b46bb9e-f40d-4644-b838-578e3ebd5b9f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1576 microversion: 2.32 time: 0.335020 Oct 12 22:14:33.106590 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2073/3721] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:14:32 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1576 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:14:33.122455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a946daa9-f93d-4685-b108-ae179be57411 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:33.124315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a946daa9-f93d-4685-b108-ae179be57411 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:33.155167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a946daa9-f93d-4685-b108-ae179be57411 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:33.157309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a946daa9-f93d-4685-b108-ae179be57411 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:33.161003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a946daa9-f93d-4685-b108-ae179be57411 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:33.162485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a946daa9-f93d-4685-b108-ae179be57411 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:33.164659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a946daa9-f93d-4685-b108-ae179be57411 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:33.166005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a946daa9-f93d-4685-b108-ae179be57411 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:33.243813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a946daa9-f93d-4685-b108-ae179be57411 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:14:33.480989 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a946daa9-f93d-4685-b108-ae179be57411 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "DELETE /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 204 len: 0 microversion: 2.1 time: 0.372066 Oct 12 22:14:33.482513 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2074/3722] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:14:33 2022] DELETE /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:14:33.494049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-252beb11-27db-4c7b-b790-6f67fb104d8c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:33.498227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-252beb11-27db-4c7b-b790-6f67fb104d8c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:33.512717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-252beb11-27db-4c7b-b790-6f67fb104d8c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:33.513008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8d4d63df-f17b-44c2-a521-da6c84b0a99c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:33.515589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-252beb11-27db-4c7b-b790-6f67fb104d8c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:33.517889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-252beb11-27db-4c7b-b790-6f67fb104d8c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:33.519730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-252beb11-27db-4c7b-b790-6f67fb104d8c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:33.522443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-252beb11-27db-4c7b-b790-6f67fb104d8c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:33.523756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-252beb11-27db-4c7b-b790-6f67fb104d8c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:33.528431 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8d4d63df-f17b-44c2-a521-da6c84b0a99c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1680 microversion: 2.1 time: 0.493417 Oct 12 22:14:33.546463 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1649/3723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:33 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1680 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:33.558122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-85cd720f-de09-4d2d-9bcd-3685dfe3893d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:33.561873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-85cd720f-de09-4d2d-9bcd-3685dfe3893d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:33.579476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85cd720f-de09-4d2d-9bcd-3685dfe3893d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:33.583603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85cd720f-de09-4d2d-9bcd-3685dfe3893d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:33.584257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85cd720f-de09-4d2d-9bcd-3685dfe3893d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:33.586235 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85cd720f-de09-4d2d-9bcd-3685dfe3893d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:33.588423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85cd720f-de09-4d2d-9bcd-3685dfe3893d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:33.591293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85cd720f-de09-4d2d-9bcd-3685dfe3893d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:34.030701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-85cd720f-de09-4d2d-9bcd-3685dfe3893d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:34.052944 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-85cd720f-de09-4d2d-9bcd-3685dfe3893d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1528 microversion: 2.1 time: 0.503150 Oct 12 22:14:34.054354 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1650/3724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:33 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1528 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:34.062029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-252beb11-27db-4c7b-b790-6f67fb104d8c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:34.075631 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-252beb11-27db-4c7b-b790-6f67fb104d8c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1515 microversion: 2.1 time: 0.591192 Oct 12 22:14:34.079832 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2075/3725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:33 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1515 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:34.085312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3b6db2d0-2958-469d-b3be-78ab5dd61d81 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:34.088855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3b6db2d0-2958-469d-b3be-78ab5dd61d81 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:34.099882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b6db2d0-2958-469d-b3be-78ab5dd61d81 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:34.100605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b6db2d0-2958-469d-b3be-78ab5dd61d81 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:34.101290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b6db2d0-2958-469d-b3be-78ab5dd61d81 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:34.102212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b6db2d0-2958-469d-b3be-78ab5dd61d81 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:34.102884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b6db2d0-2958-469d-b3be-78ab5dd61d81 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:34.104921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b6db2d0-2958-469d-b3be-78ab5dd61d81 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:34.491952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3b6db2d0-2958-469d-b3be-78ab5dd61d81 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:34.508306 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3b6db2d0-2958-469d-b3be-78ab5dd61d81 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1524 microversion: 2.1 time: 0.447839 Oct 12 22:14:34.508976 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1651/3726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:34 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1524 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:34.528224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6a34456e-9330-4a81-af0d-86cc14ab2531 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:34.538297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6a34456e-9330-4a81-af0d-86cc14ab2531 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:34.557060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a34456e-9330-4a81-af0d-86cc14ab2531 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:34.557553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a34456e-9330-4a81-af0d-86cc14ab2531 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:34.580303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a34456e-9330-4a81-af0d-86cc14ab2531 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:34.581387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a34456e-9330-4a81-af0d-86cc14ab2531 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:34.582027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a34456e-9330-4a81-af0d-86cc14ab2531 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:34.582624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a34456e-9330-4a81-af0d-86cc14ab2531 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:34.586907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d622b867-96e3-44dd-86b7-a6e1ecb4d62a tempest-ListImageFiltersNegativeTestJSON-214663759 tempest-ListImageFiltersNegativeTestJSON-214663759-project] Calling method '.version_select at 0x7f51233daa60>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:34.637442 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-d622b867-96e3-44dd-86b7-a6e1ecb4d62a tempest-ListImageFiltersNegativeTestJSON-214663759 tempest-ListImageFiltersNegativeTestJSON-214663759-project] HTTP exception thrown: Image not found. Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d622b867-96e3-44dd-86b7-a6e1ecb4d62a tempest-ListImageFiltersNegativeTestJSON-214663759 tempest-ListImageFiltersNegativeTestJSON-214663759-project] Request method failure captured: Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/images/52e61899-7f96-45a3-9b3b-fa376408d8ee HTTP/1.1 Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzxJkLEJ4nctE3ufoKVnx7fEh4BUQpSgggH4CXuo4JvBSl5lmxh4StdHm3KhP24rDBaLXinXETwRrclkoqMa4PuP5InXCxTNScsjBd2r6XnRExxVLJOdFLif1OvXpJIdUY7tDJm17ilbP_kcxhzGhYSBzGCAtbBJV_xcS_E8CvHu9sc Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: c0e00b435d734e229e53aa89c0ed14d6 Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-214663759 Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c0e00b435d734e229e53aa89c0ed14d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c0e00b435d734e229e53aa89c0ed14d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c0e00b435d734e229e53aa89c0ed14d6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c0e00b435d734e229e53aa89c0ed14d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-214663759 Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: c0e00b435d734e229e53aa89c0ed14d6 Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-214663759 Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ListImageFiltersNegativeTestJSON-214663759-project Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 88e1475dddf04814a3aa5f123e8b7bdd Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-214663759-project Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: exception: Image not found. Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '52e61899-7f96-45a3-9b3b-fa376408d8ee'} Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 52e61899-7f96-45a3-9b3b-fa376408d8ee Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:14:34.643306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 52e61899-7f96-45a3-9b3b-fa376408d8ee could not be found. Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:14:34.648284 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:34.656333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d622b867-96e3-44dd-86b7-a6e1ecb4d62a tempest-ListImageFiltersNegativeTestJSON-214663759 tempest-ListImageFiltersNegativeTestJSON-214663759-project] Returning 404 to user: Image not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:34.656333 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d622b867-96e3-44dd-86b7-a6e1ecb4d62a tempest-ListImageFiltersNegativeTestJSON-214663759 tempest-ListImageFiltersNegativeTestJSON-214663759-project] 10.222.0.16 "GET /compute/v2.1/images/52e61899-7f96-45a3-9b3b-fa376408d8ee" status: 404 len: 62 microversion: 2.1 time: 0.573079 Oct 12 22:14:34.656333 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2076/3727] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:14:34 2022] GET /compute/v2.1/images/52e61899-7f96-45a3-9b3b-fa376408d8ee => generated 62 bytes in 574 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:14:34.670759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7746c88c-e888-48b9-8cd5-abe8f7a8d523 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:34.683564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7746c88c-e888-48b9-8cd5-abe8f7a8d523 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:34.707313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7746c88c-e888-48b9-8cd5-abe8f7a8d523 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:34.710202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7746c88c-e888-48b9-8cd5-abe8f7a8d523 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:34.710831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7746c88c-e888-48b9-8cd5-abe8f7a8d523 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:34.712763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7746c88c-e888-48b9-8cd5-abe8f7a8d523 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:34.714861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7746c88c-e888-48b9-8cd5-abe8f7a8d523 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:34.716556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7746c88c-e888-48b9-8cd5-abe8f7a8d523 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:34.874696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6a34456e-9330-4a81-af0d-86cc14ab2531 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:34.891783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6a34456e-9330-4a81-af0d-86cc14ab2531 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:34.893265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6a34456e-9330-4a81-af0d-86cc14ab2531 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:34.894466 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6a34456e-9330-4a81-af0d-86cc14ab2531 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1594 microversion: 2.32 time: 0.384526 Oct 12 22:14:34.905120 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1652/3728] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:14:34 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1594 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:14:35.080367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-afa32d1a-cb3c-47c6-aeed-9dd7aaec5a75 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:35.080994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-afa32d1a-cb3c-47c6-aeed-9dd7aaec5a75 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:35.093222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afa32d1a-cb3c-47c6-aeed-9dd7aaec5a75 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:35.094293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afa32d1a-cb3c-47c6-aeed-9dd7aaec5a75 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:35.094743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afa32d1a-cb3c-47c6-aeed-9dd7aaec5a75 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:35.101131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afa32d1a-cb3c-47c6-aeed-9dd7aaec5a75 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:35.101687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afa32d1a-cb3c-47c6-aeed-9dd7aaec5a75 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:35.102404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afa32d1a-cb3c-47c6-aeed-9dd7aaec5a75 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:35.533002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-afa32d1a-cb3c-47c6-aeed-9dd7aaec5a75 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:35.552163 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-afa32d1a-cb3c-47c6-aeed-9dd7aaec5a75 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1528 microversion: 2.1 time: 0.474710 Oct 12 22:14:35.554154 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1653/3729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:35 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1528 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:35.569454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d31061d4-3d7a-46fa-b864-e24dba898f00 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:35.572498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d31061d4-3d7a-46fa-b864-e24dba898f00 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:35.589726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d31061d4-3d7a-46fa-b864-e24dba898f00 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:35.592593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d31061d4-3d7a-46fa-b864-e24dba898f00 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:35.594818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d31061d4-3d7a-46fa-b864-e24dba898f00 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:35.595799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d31061d4-3d7a-46fa-b864-e24dba898f00 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:35.597025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d31061d4-3d7a-46fa-b864-e24dba898f00 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:35.599000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d31061d4-3d7a-46fa-b864-e24dba898f00 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:35.762467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7746c88c-e888-48b9-8cd5-abe8f7a8d523 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:35.777569 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7746c88c-e888-48b9-8cd5-abe8f7a8d523 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1680 microversion: 2.1 time: 1.121852 Oct 12 22:14:35.791209 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2077/3730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:34 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1680 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:35.804248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-690cf5f3-2910-4ad9-bafa-b4940e712930 req-28473b27-fc7a-4bc9-ab1c-c7b1c44d93c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722e8b56-e78f-4dde-af24-cee1dad1be26", "name": "network-vif-unplugged", "status": "completed", "tag": "d849caef-b316-4cf0-8a97-f0b2d339596f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:35.879822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-690cf5f3-2910-4ad9-bafa-b4940e712930 req-28473b27-fc7a-4bc9-ab1c-c7b1c44d93c5 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:35.883101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-690cf5f3-2910-4ad9-bafa-b4940e712930 req-28473b27-fc7a-4bc9-ab1c-c7b1c44d93c5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:35.884228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-690cf5f3-2910-4ad9-bafa-b4940e712930 req-28473b27-fc7a-4bc9-ab1c-c7b1c44d93c5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:35.937420 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-690cf5f3-2910-4ad9-bafa-b4940e712930 req-28473b27-fc7a-4bc9-ab1c-c7b1c44d93c5 service nova] Creating event network-vif-unplugged:d849caef-b316-4cf0-8a97-f0b2d339596f for instance 722e8b56-e78f-4dde-af24-cee1dad1be26 on n-h2-861111-1 Oct 12 22:14:35.953166 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-690cf5f3-2910-4ad9-bafa-b4940e712930 req-28473b27-fc7a-4bc9-ab1c-c7b1c44d93c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.160448 Oct 12 22:14:35.955602 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2078/3731] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:35.972093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-941bcdf0-0939-44bd-9fdc-60bf20031580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:35.972815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-941bcdf0-0939-44bd-9fdc-60bf20031580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:35.983367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-941bcdf0-0939-44bd-9fdc-60bf20031580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:35.989111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-941bcdf0-0939-44bd-9fdc-60bf20031580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:35.990372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-941bcdf0-0939-44bd-9fdc-60bf20031580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:35.991143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-941bcdf0-0939-44bd-9fdc-60bf20031580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:35.991739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-941bcdf0-0939-44bd-9fdc-60bf20031580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:35.992379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-941bcdf0-0939-44bd-9fdc-60bf20031580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:36.548565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d31061d4-3d7a-46fa-b864-e24dba898f00 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:36.567867 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d31061d4-3d7a-46fa-b864-e24dba898f00 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1515 microversion: 2.1 time: 1.009616 Oct 12 22:14:36.568644 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1654/3732] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:35 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1515 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:36.585855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c04bc22d-ea2f-4ccb-8c88-715e9de9a943 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:36.590465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c04bc22d-ea2f-4ccb-8c88-715e9de9a943 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:36.615651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c04bc22d-ea2f-4ccb-8c88-715e9de9a943 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:36.618588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c04bc22d-ea2f-4ccb-8c88-715e9de9a943 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:36.619043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c04bc22d-ea2f-4ccb-8c88-715e9de9a943 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:36.619821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c04bc22d-ea2f-4ccb-8c88-715e9de9a943 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:36.620248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c04bc22d-ea2f-4ccb-8c88-715e9de9a943 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:36.627836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c04bc22d-ea2f-4ccb-8c88-715e9de9a943 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:36.669935 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-c04bc22d-ea2f-4ccb-8c88-715e9de9a943 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] HTTP exception thrown: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c04bc22d-ea2f-4ccb-8c88-715e9de9a943 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Request method failure captured: Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 HTTP/1.1 Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzoV3foVnGv0suVxK_Nk7Pp5_kjAPhL8yzVHClSGl5RRxDIZH7rcf5PLHi4YXEet-A0AtHcDaHpFcS_aQR9wl8soXuphQXdzTm1zPCiMI4BUWAPu4l1z3R9DkYDtzHZhHRlT-3CEyzuxgoolPW6Gw8glco6cFnu099ScND31HIZBEC4 Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68913d260d084ce4a8e29daf4783c0bc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 13c74a78e82f4e72a7d1f7b133074f5a Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2'} Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:14:36.671668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:14:36.676175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. Oct 12 22:14:36.676175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:36.676175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:36.676175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:36.676175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:36.676175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:36.676175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:36.676175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:36.676175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:36.676175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. Oct 12 22:14:36.676175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:36.677108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c04bc22d-ea2f-4ccb-8c88-715e9de9a943 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Returning 404 to user: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:36.678204 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c04bc22d-ea2f-4ccb-8c88-715e9de9a943 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 404 len: 111 microversion: 2.1 time: 0.105615 Oct 12 22:14:36.681142 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1655/3733] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:14:36 2022] DELETE /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:14:36.701254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d435e24c-5e3f-4136-aec3-e0440bc8f53b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:36.701996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d435e24c-5e3f-4136-aec3-e0440bc8f53b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:36.739549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d435e24c-5e3f-4136-aec3-e0440bc8f53b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:36.742650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d435e24c-5e3f-4136-aec3-e0440bc8f53b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:36.744804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d435e24c-5e3f-4136-aec3-e0440bc8f53b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:36.745561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d435e24c-5e3f-4136-aec3-e0440bc8f53b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:36.746028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d435e24c-5e3f-4136-aec3-e0440bc8f53b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:36.753075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d435e24c-5e3f-4136-aec3-e0440bc8f53b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:36.953988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-941bcdf0-0939-44bd-9fdc-60bf20031580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:36.966440 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-941bcdf0-0939-44bd-9fdc-60bf20031580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1524 microversion: 2.1 time: 1.009439 Oct 12 22:14:36.974167 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2079/3734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:35 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1524 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:36.994592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cdde0f81-4359-4067-a2ae-d6a762b7122c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:37.001004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cdde0f81-4359-4067-a2ae-d6a762b7122c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:37.034951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdde0f81-4359-4067-a2ae-d6a762b7122c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:37.036106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdde0f81-4359-4067-a2ae-d6a762b7122c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:37.038322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdde0f81-4359-4067-a2ae-d6a762b7122c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:37.042400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdde0f81-4359-4067-a2ae-d6a762b7122c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:37.043459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdde0f81-4359-4067-a2ae-d6a762b7122c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:37.049218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdde0f81-4359-4067-a2ae-d6a762b7122c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:37.224202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdde0f81-4359-4067-a2ae-d6a762b7122c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:37.225101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdde0f81-4359-4067-a2ae-d6a762b7122c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:37.226766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cdde0f81-4359-4067-a2ae-d6a762b7122c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:37.228337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-cdde0f81-4359-4067-a2ae-d6a762b7122c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lazy-loading 'fault' on Instance uuid 722e8b56-e78f-4dde-af24-cee1dad1be26 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:14:37.407533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cdde0f81-4359-4067-a2ae-d6a762b7122c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:37.419590 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cdde0f81-4359-4067-a2ae-d6a762b7122c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 200 len: 1314 microversion: 2.1 time: 0.443063 Oct 12 22:14:37.432740 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2080/3735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:36 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:37.473383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0d155b90-a873-4ae6-bf46-9e7491edcad2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:37.474032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0d155b90-a873-4ae6-bf46-9e7491edcad2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:37.497192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d155b90-a873-4ae6-bf46-9e7491edcad2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:37.503184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d155b90-a873-4ae6-bf46-9e7491edcad2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:37.503713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d155b90-a873-4ae6-bf46-9e7491edcad2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:37.504469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d155b90-a873-4ae6-bf46-9e7491edcad2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:37.504937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d155b90-a873-4ae6-bf46-9e7491edcad2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:37.505404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d155b90-a873-4ae6-bf46-9e7491edcad2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:37.511513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d435e24c-5e3f-4136-aec3-e0440bc8f53b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:37.535525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d435e24c-5e3f-4136-aec3-e0440bc8f53b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:37.540759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d435e24c-5e3f-4136-aec3-e0440bc8f53b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:37.546437 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d435e24c-5e3f-4136-aec3-e0440bc8f53b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1662 microversion: 2.32 time: 0.861435 Oct 12 22:14:37.548148 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1656/3736] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:14:36 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1662 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:14:37.580494 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-0d155b90-a873-4ae6-bf46-9e7491edcad2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] HTTP exception thrown: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0d155b90-a873-4ae6-bf46-9e7491edcad2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Request method failure captured: Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 HTTP/1.1 Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzoV3foVnGv0suVxK_Nk7Pp5_kjAPhL8yzVHClSGl5RRxDIZH7rcf5PLHi4YXEet-A0AtHcDaHpFcS_aQR9wl8soXuphQXdzTm1zPCiMI4BUWAPu4l1z3R9DkYDtzHZhHRlT-3CEyzuxgoolPW6Gw8glco6cFnu099ScND31HIZBEC4 Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68913d260d084ce4a8e29daf4783c0bc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 13c74a78e82f4e72a7d1f7b133074f5a Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2'} Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:37.582204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:37.586840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:37.586840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:37.586840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:37.586840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:37.586840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:37.586840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. Oct 12 22:14:37.586840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:37.587387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-97f9e37a-dc9b-4409-b028-381977f3bce1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:37.587387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-97f9e37a-dc9b-4409-b028-381977f3bce1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:37.588974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0d155b90-a873-4ae6-bf46-9e7491edcad2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Returning 404 to user: Instance e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:37.590004 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0d155b90-a873-4ae6-bf46-9e7491edcad2 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2" status: 404 len: 111 microversion: 2.1 time: 0.148667 Oct 12 22:14:37.598915 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2081/3737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:37 2022] GET /compute/v2.1/servers/e76eff2f-8fcd-4cc4-919a-61ebd1fa6df2 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:14:37.606426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-9aee5160-c589-4ad3-a04d-c137413e2c5c req-9b48eb6c-ea4e-4fd8-b9be-85f8d39c2676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722e8b56-e78f-4dde-af24-cee1dad1be26", "name": "network-vif-deleted", "tag": "d849caef-b316-4cf0-8a97-f0b2d339596f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:37.610218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97f9e37a-dc9b-4409-b028-381977f3bce1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:37.612550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97f9e37a-dc9b-4409-b028-381977f3bce1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:37.613008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97f9e37a-dc9b-4409-b028-381977f3bce1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:37.613732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97f9e37a-dc9b-4409-b028-381977f3bce1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:37.614192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97f9e37a-dc9b-4409-b028-381977f3bce1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:37.623046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97f9e37a-dc9b-4409-b028-381977f3bce1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:37.636220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9aee5160-c589-4ad3-a04d-c137413e2c5c req-9b48eb6c-ea4e-4fd8-b9be-85f8d39c2676 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:37.637013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9aee5160-c589-4ad3-a04d-c137413e2c5c req-9b48eb6c-ea4e-4fd8-b9be-85f8d39c2676 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:37.637622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9aee5160-c589-4ad3-a04d-c137413e2c5c req-9b48eb6c-ea4e-4fd8-b9be-85f8d39c2676 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:37.663078 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-9aee5160-c589-4ad3-a04d-c137413e2c5c req-9b48eb6c-ea4e-4fd8-b9be-85f8d39c2676 service nova] Creating event network-vif-deleted:d849caef-b316-4cf0-8a97-f0b2d339596f for instance 722e8b56-e78f-4dde-af24-cee1dad1be26 on n-h2-861111-1 Oct 12 22:14:37.681079 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-9aee5160-c589-4ad3-a04d-c137413e2c5c req-9b48eb6c-ea4e-4fd8-b9be-85f8d39c2676 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080439 Oct 12 22:14:37.682388 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2082/3738] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:37.703903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-47ae1780-f105-4433-8234-98e0b8772892 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:37.712277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-47ae1780-f105-4433-8234-98e0b8772892 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:37.723630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47ae1780-f105-4433-8234-98e0b8772892 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:37.724374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47ae1780-f105-4433-8234-98e0b8772892 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:37.725004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47ae1780-f105-4433-8234-98e0b8772892 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:37.725903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47ae1780-f105-4433-8234-98e0b8772892 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:37.726527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47ae1780-f105-4433-8234-98e0b8772892 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:37.731323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47ae1780-f105-4433-8234-98e0b8772892 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:38.131205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-97f9e37a-dc9b-4409-b028-381977f3bce1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:38.135574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=94,nova_cell1:UPDATE=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:38.140812 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-97f9e37a-dc9b-4409-b028-381977f3bce1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1680 microversion: 2.1 time: 0.568762 Oct 12 22:14:38.151464 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1657/3739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:37 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1680 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:38.184613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-06ccf7cc-0c7b-474f-bfad-5657d2afee5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:38.185180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-06ccf7cc-0c7b-474f-bfad-5657d2afee5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:38.211127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06ccf7cc-0c7b-474f-bfad-5657d2afee5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:38.224507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06ccf7cc-0c7b-474f-bfad-5657d2afee5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:38.227078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06ccf7cc-0c7b-474f-bfad-5657d2afee5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:38.228435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06ccf7cc-0c7b-474f-bfad-5657d2afee5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:38.229129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06ccf7cc-0c7b-474f-bfad-5657d2afee5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:38.229785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06ccf7cc-0c7b-474f-bfad-5657d2afee5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:38.301830 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-06ccf7cc-0c7b-474f-bfad-5657d2afee5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] HTTP exception thrown: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-06ccf7cc-0c7b-474f-bfad-5657d2afee5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Request method failure captured: Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 HTTP/1.1 Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzoV3foVnGv0suVxK_Nk7Pp5_kjAPhL8yzVHClSGl5RRxDIZH7rcf5PLHi4YXEet-A0AtHcDaHpFcS_aQR9wl8soXuphQXdzTm1zPCiMI4BUWAPu4l1z3R9DkYDtzHZhHRlT-3CEyzuxgoolPW6Gw8glco6cFnu099ScND31HIZBEC4 Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68913d260d084ce4a8e29daf4783c0bc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 13c74a78e82f4e72a7d1f7b133074f5a Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '77548da5-9429-4e07-bdad-7902d89d4153'} Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:14:38.307064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:14:38.311193 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. Oct 12 22:14:38.311193 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:38.311193 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:38.311193 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:38.311193 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:38.311193 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:38.311193 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:38.311193 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:38.311193 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:38.311193 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. Oct 12 22:14:38.311193 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:38.312887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-06ccf7cc-0c7b-474f-bfad-5657d2afee5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Returning 404 to user: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:38.315045 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-06ccf7cc-0c7b-474f-bfad-5657d2afee5a tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "DELETE /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 404 len: 111 microversion: 2.1 time: 0.156792 Oct 12 22:14:38.319207 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1658/3740] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:14:38 2022] DELETE /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:14:38.333113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-348a1e81-3a6c-4bbf-85cc-a28fcca8d8e7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:38.335473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-348a1e81-3a6c-4bbf-85cc-a28fcca8d8e7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:38.352650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-348a1e81-3a6c-4bbf-85cc-a28fcca8d8e7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:38.353321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-348a1e81-3a6c-4bbf-85cc-a28fcca8d8e7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:38.353879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-348a1e81-3a6c-4bbf-85cc-a28fcca8d8e7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:38.357365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-348a1e81-3a6c-4bbf-85cc-a28fcca8d8e7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:38.362802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-348a1e81-3a6c-4bbf-85cc-a28fcca8d8e7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:38.363417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-348a1e81-3a6c-4bbf-85cc-a28fcca8d8e7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:38.394610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-47ae1780-f105-4433-8234-98e0b8772892 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:38.398604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:38.411210 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-47ae1780-f105-4433-8234-98e0b8772892 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1515 microversion: 2.1 time: 0.719619 Oct 12 22:14:38.414683 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2083/3741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:37 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1515 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:38.435003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-541c95af-7fa9-403b-9f3d-d766057f9961 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:38.441839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-541c95af-7fa9-403b-9f3d-d766057f9961 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 77548da5-9429-4e07-bdad-7902d89d4153] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:38.472904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-541c95af-7fa9-403b-9f3d-d766057f9961 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:38.481951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-541c95af-7fa9-403b-9f3d-d766057f9961 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:38.482573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-541c95af-7fa9-403b-9f3d-d766057f9961 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:38.485961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-541c95af-7fa9-403b-9f3d-d766057f9961 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:38.486486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-541c95af-7fa9-403b-9f3d-d766057f9961 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:38.486922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-541c95af-7fa9-403b-9f3d-d766057f9961 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:38.536017 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-541c95af-7fa9-403b-9f3d-d766057f9961 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] HTTP exception thrown: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-541c95af-7fa9-403b-9f3d-d766057f9961 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Request method failure captured: Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 HTTP/1.1 Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzoV3foVnGv0suVxK_Nk7Pp5_kjAPhL8yzVHClSGl5RRxDIZH7rcf5PLHi4YXEet-A0AtHcDaHpFcS_aQR9wl8soXuphQXdzTm1zPCiMI4BUWAPu4l1z3R9DkYDtzHZhHRlT-3CEyzuxgoolPW6Gw8glco6cFnu099ScND31HIZBEC4 Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68913d260d084ce4a8e29daf4783c0bc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 13c74a78e82f4e72a7d1f7b133074f5a Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '77548da5-9429-4e07-bdad-7902d89d4153'} Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:38.540738 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:38.545360 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:38.545360 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:38.545360 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:38.545360 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:38.545360 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:38.545360 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. Oct 12 22:14:38.545360 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:38.560185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-541c95af-7fa9-403b-9f3d-d766057f9961 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Returning 404 to user: Instance 77548da5-9429-4e07-bdad-7902d89d4153 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:38.563833 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-541c95af-7fa9-403b-9f3d-d766057f9961 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153" status: 404 len: 111 microversion: 2.1 time: 0.147288 Oct 12 22:14:38.566329 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2084/3742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:38 2022] GET /compute/v2.1/servers/77548da5-9429-4e07-bdad-7902d89d4153 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:14:38.577389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-39b178fe-8ac1-4dd3-acc5-556377b728ca tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:38.586134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-39b178fe-8ac1-4dd3-acc5-556377b728ca tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:38.603215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39b178fe-8ac1-4dd3-acc5-556377b728ca tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:38.604901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39b178fe-8ac1-4dd3-acc5-556377b728ca tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:38.605525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39b178fe-8ac1-4dd3-acc5-556377b728ca tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:38.607050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39b178fe-8ac1-4dd3-acc5-556377b728ca tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:38.610999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39b178fe-8ac1-4dd3-acc5-556377b728ca tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:38.611970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39b178fe-8ac1-4dd3-acc5-556377b728ca tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:38.649413 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-39b178fe-8ac1-4dd3-acc5-556377b728ca tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] HTTP exception thrown: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-39b178fe-8ac1-4dd3-acc5-556377b728ca tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Request method failure captured: Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 HTTP/1.1 Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwglINEGlDOr9BocY5wO9Xx43qqChsjlqD9r61HmaIIEL6djOCkMBDTPWahASzdxBY-IxGgwHeVTq3saYQxSiCfGBziJflEANUhDnl0qNNSNbnWdyn825Mt-A7NcL8fanNSlgyJCBOxpmZTnNkYN5hmKUrlCsq_TM6iJjMlS6r6Deg Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a107edadb364defb4f2c408969c097c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a107edadb364defb4f2c408969c097c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a2c263e74d274bef8094b9d7ecfc820b Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '722e8b56-e78f-4dde-af24-cee1dad1be26'} Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:38.660749 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:38.665766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:38.665766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:38.665766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:38.665766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:38.665766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:38.665766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:38.665766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. Oct 12 22:14:38.665766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:38.667521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-39b178fe-8ac1-4dd3-acc5-556377b728ca tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Returning 404 to user: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:38.669280 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-39b178fe-8ac1-4dd3-acc5-556377b728ca tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 404 len: 111 microversion: 2.1 time: 0.096779 Oct 12 22:14:38.671108 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2085/3743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:38 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:14:38.682153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c9bbf783-b228-4043-a814-456fff26009f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:38.683332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c9bbf783-b228-4043-a814-456fff26009f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:38.703847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9bbf783-b228-4043-a814-456fff26009f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:38.705556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9bbf783-b228-4043-a814-456fff26009f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:38.710170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9bbf783-b228-4043-a814-456fff26009f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:38.712593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9bbf783-b228-4043-a814-456fff26009f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:38.713243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9bbf783-b228-4043-a814-456fff26009f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:38.714387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9bbf783-b228-4043-a814-456fff26009f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:38.884200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:39.225128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-348a1e81-3a6c-4bbf-85cc-a28fcca8d8e7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:39.233515 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-348a1e81-3a6c-4bbf-85cc-a28fcca8d8e7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1524 microversion: 2.1 time: 0.912018 Oct 12 22:14:39.234122 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1659/3744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:38 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1524 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:39.255486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-056bbdfc-48c8-4189-8732-557fa6e0f5cb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Action: 'create', calling method: .version_select at 0x7f5128717430>, body: {"keypair": {"name": "tempest-keypair-1350115581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRiiTUVlgJBBgDM4gX+myumRP8PHYLdXyrNi4Lb3l57/t8+naPP9z1x8uJ0oi+suYgQ7BNaXEPd2X7vj6XT8x69J23Co/sQBnkIkkdqqURCCd+xSHU38oHE44bDttIPzA=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:39.315872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-056bbdfc-48c8-4189-8732-557fa6e0f5cb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Getting quotas for project 5a107edadb364defb4f2c408969c097c. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:39.335324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-056bbdfc-48c8-4189-8732-557fa6e0f5cb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Getting quotas for user a2c263e74d274bef8094b9d7ecfc820b and project 5a107edadb364defb4f2c408969c097c. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:39.422182 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-056bbdfc-48c8-4189-8732-557fa6e0f5cb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.185857 Oct 12 22:14:39.422831 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1660/3745] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:14:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:39.434581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d71699e-a800-48f3-bcf9-85285a43e9b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:39.435209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5d71699e-a800-48f3-bcf9-85285a43e9b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:39.461041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d71699e-a800-48f3-bcf9-85285a43e9b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:39.461545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d71699e-a800-48f3-bcf9-85285a43e9b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:39.461986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d71699e-a800-48f3-bcf9-85285a43e9b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:39.462700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d71699e-a800-48f3-bcf9-85285a43e9b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:39.463145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d71699e-a800-48f3-bcf9-85285a43e9b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:39.470372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d71699e-a800-48f3-bcf9-85285a43e9b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:39.874760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c9bbf783-b228-4043-a814-456fff26009f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:39.885190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c9bbf783-b228-4043-a814-456fff26009f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:39.916966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c9bbf783-b228-4043-a814-456fff26009f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:39.923677 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c9bbf783-b228-4043-a814-456fff26009f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1662 microversion: 2.32 time: 1.250571 Oct 12 22:14:39.925789 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2086/3746] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:14:38 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1662 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:14:39.948020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-814094de-b5f4-45a1-a536-3e50c509fc01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:39.949198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-814094de-b5f4-45a1-a536-3e50c509fc01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:39.965362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-814094de-b5f4-45a1-a536-3e50c509fc01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:39.966254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-814094de-b5f4-45a1-a536-3e50c509fc01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:39.966932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-814094de-b5f4-45a1-a536-3e50c509fc01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:39.967963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-814094de-b5f4-45a1-a536-3e50c509fc01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:39.974664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-814094de-b5f4-45a1-a536-3e50c509fc01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:39.975628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-814094de-b5f4-45a1-a536-3e50c509fc01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:40.230792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5d71699e-a800-48f3-bcf9-85285a43e9b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:40.248951 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5d71699e-a800-48f3-bcf9-85285a43e9b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1657 microversion: 2.1 time: 0.820632 Oct 12 22:14:40.250254 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1661/3747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:39 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1657 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:40.270952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-814094de-b5f4-45a1-a536-3e50c509fc01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:40.280040 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-814094de-b5f4-45a1-a536-3e50c509fc01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1515 microversion: 2.1 time: 0.351742 Oct 12 22:14:40.296375 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2087/3748] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:39 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1515 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:40.303840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-50baaf67-2ed3-4bd4-a735-bae7767f2904 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:40.304760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-50baaf67-2ed3-4bd4-a735-bae7767f2904 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:40.314109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50baaf67-2ed3-4bd4-a735-bae7767f2904 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:40.315724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50baaf67-2ed3-4bd4-a735-bae7767f2904 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:40.316400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50baaf67-2ed3-4bd4-a735-bae7767f2904 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:40.317353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50baaf67-2ed3-4bd4-a735-bae7767f2904 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:40.320255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50baaf67-2ed3-4bd4-a735-bae7767f2904 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:40.321380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50baaf67-2ed3-4bd4-a735-bae7767f2904 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:40.569224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9557e830-5589-489f-b8af-c693bf0bb09e tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Action: 'create', calling method: .version_select at 0x7f51286eddc0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOq0hKXJxUxmDymqN0MPe9Myz4+qOERdF/9uCJL8MoUBrhYYIPnPgGVq5MXB9IH9j0lCSM2TYm7yYLcDxPL90pxKC1lQADkTqxpVhv/I3DCoaLhrb0LWCMabgY1+2CuBqw=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9557e830-5589-489f-b8af-c693bf0bb09e tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Request method failure captured: Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 257 Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzxPK1TBijpFFprZH6f-r6pZkulF3CwVNIuf-eMjhCFcPehtOCrft_UK-BXpgOlUL6cqeFafQkJ-jG28J5RIg0nbui2VQa3L7IwRsB06o1K-1nz0WEoPZQMs6tuwiI7zIv2HXz4LRuUyAfkla-74ONfQ4DkPqT1ESZ-GYkAoiWc7OW8 Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 6dcf3c945af2447aaa996609d5fba04e Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6dcf3c945af2447aaa996609d5fba04e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 6dcf3c945af2447aaa996609d5fba04e Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-KeyPairsNegativeTestJSON-760605191-project Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 87385b2ff8a349bba05a0517ce2eac58 Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-KeyPairsNegativeTestJSON-760605191-project Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOq0hKXJxUxmDymqN0MPe9Myz4+qOERdF/9uCJL8MoUBrhYYIPnPgGVq5MXB9IH9j0lCSM2TYm7yYLcDxPL90pxKC1lQADkTqxpVhv/I3DCoaLhrb0LWCMabgY1+2CuBqw=="}} Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOq0hKXJxUxmDymqN0MPe9Myz4+qOERdF/9uCJL8MoUBrhYYIPnPgGVq5MXB9IH9j0lCSM2TYm7yYLcDxPL90pxKC1lQADkTqxpVhv/I3DCoaLhrb0LWCMabgY1+2CuBqw=='}}} Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 12 22:14:40.576992 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 12 22:14:40.581345 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:40.586801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9557e830-5589-489f-b8af-c693bf0bb09e tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:40.588125 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9557e830-5589-489f-b8af-c693bf0bb09e tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.336560 Oct 12 22:14:40.589028 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1662/3749] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:14:40 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 338 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:14:40.622824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-85b19ad9-2f47-430f-b03f-e46ab902da67 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:40.668750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85b19ad9-2f47-430f-b03f-e46ab902da67 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:40.673452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85b19ad9-2f47-430f-b03f-e46ab902da67 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:40.681434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85b19ad9-2f47-430f-b03f-e46ab902da67 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:40.733460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-50baaf67-2ed3-4bd4-a735-bae7767f2904 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:40.748420 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-50baaf67-2ed3-4bd4-a735-bae7767f2904 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1524 microversion: 2.1 time: 0.450758 Oct 12 22:14:40.752398 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2088/3750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:40 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1524 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:40.768247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-85b19ad9-2f47-430f-b03f-e46ab902da67 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Going to try to start instance {{(pid=120452) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 22:14:40.769181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-51564cbe-f7c8-4719-8010-58f8bed69f88 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Action: 'create', calling method: .version_select at 0x7f512c431820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-407584304", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:40.879714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-51564cbe-f7c8-4719-8010-58f8bed69f88 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Getting quotas for project 6dcf3c945af2447aaa996609d5fba04e. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:40.901756 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-85b19ad9-2f47-430f-b03f-e46ab902da67 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 202 len: 0 microversion: 2.1 time: 0.288006 Oct 12 22:14:40.908461 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1663/3751] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:40 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:14:40.930022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-51564cbe-f7c8-4719-8010-58f8bed69f88 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Getting quotas for user 87385b2ff8a349bba05a0517ce2eac58 and project 6dcf3c945af2447aaa996609d5fba04e. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:40.945529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1b207c94-4403-488e-94d3-6e91234c3ea9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:40.967674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1b207c94-4403-488e-94d3-6e91234c3ea9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:41.006626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b207c94-4403-488e-94d3-6e91234c3ea9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:41.016875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b207c94-4403-488e-94d3-6e91234c3ea9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:41.017725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b207c94-4403-488e-94d3-6e91234c3ea9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:41.024753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b207c94-4403-488e-94d3-6e91234c3ea9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:41.028291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b207c94-4403-488e-94d3-6e91234c3ea9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:41.035367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b207c94-4403-488e-94d3-6e91234c3ea9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:41.067847 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-51564cbe-f7c8-4719-8010-58f8bed69f88 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-51564cbe-f7c8-4719-8010-58f8bed69f88 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Request method failure captured: Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 2166 Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzxPK1TBijpFFprZH6f-r6pZkulF3CwVNIuf-eMjhCFcPehtOCrft_UK-BXpgOlUL6cqeFafQkJ-jG28J5RIg0nbui2VQa3L7IwRsB06o1K-1nz0WEoPZQMs6tuwiI7zIv2HXz4LRuUyAfkla-74ONfQ4DkPqT1ESZ-GYkAoiWc7OW8 Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 6dcf3c945af2447aaa996609d5fba04e Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6dcf3c945af2447aaa996609d5fba04e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 6dcf3c945af2447aaa996609d5fba04e Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-KeyPairsNegativeTestJSON-760605191-project Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 87385b2ff8a349bba05a0517ce2eac58 Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-KeyPairsNegativeTestJSON-760605191-project Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-407584304", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:14:41.138107 n-d-861111-1 devstack@n-api.service[120453]: exception: Keypair data is invalid: failed to generate fingerprint Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-407584304', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:41.141016 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 12 22:14:41.144328 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:41.150054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-51564cbe-f7c8-4719-8010-58f8bed69f88 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:41.157213 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-51564cbe-f7c8-4719-8010-58f8bed69f88 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.402391 Oct 12 22:14:41.158788 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2089/3752] 10.222.0.16 () {60 vars in 1160 bytes} [Wed Oct 12 22:14:40 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 406 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:14:41.176630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-95b1251a-a605-4b3a-b5bb-3f4eec3a499d tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:41.177618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-95b1251a-a605-4b3a-b5bb-3f4eec3a499d tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:41.187487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95b1251a-a605-4b3a-b5bb-3f4eec3a499d tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:41.188875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95b1251a-a605-4b3a-b5bb-3f4eec3a499d tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:41.189518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95b1251a-a605-4b3a-b5bb-3f4eec3a499d tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:41.190558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95b1251a-a605-4b3a-b5bb-3f4eec3a499d tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:41.191185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95b1251a-a605-4b3a-b5bb-3f4eec3a499d tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:41.191992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95b1251a-a605-4b3a-b5bb-3f4eec3a499d tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:41.510323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-95b1251a-a605-4b3a-b5bb-3f4eec3a499d tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:41.526317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-95b1251a-a605-4b3a-b5bb-3f4eec3a499d tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:41.530097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-95b1251a-a605-4b3a-b5bb-3f4eec3a499d tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:41.536622 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-95b1251a-a605-4b3a-b5bb-3f4eec3a499d tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1709 microversion: 2.32 time: 0.374238 Oct 12 22:14:41.537455 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2090/3753] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:14:41 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1709 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:14:41.551421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87873d04-ab02-41e2-b9f1-5fed53540026 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Action: 'create', calling method: .version_select at 0x7f51233a0a60>, body: {"keypair": {"name": "tempest-keypair-684059353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPpIwO4FjsyrwiCFgizRvuSE1LrG9RHbmqhfP1SYhjRN3MWyYw2LXerbr/KRyBGq8Khc/xA2XyQ3zcZL0qrmhFS4WBMswBfbMGGkfMGVGl2fCForIz35Qt5elfIXR/SAA=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:41.580281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:41.590310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-87873d04-ab02-41e2-b9f1-5fed53540026 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Getting quotas for project 6dcf3c945af2447aaa996609d5fba04e. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:41.616494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-87873d04-ab02-41e2-b9f1-5fed53540026 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Getting quotas for user 87385b2ff8a349bba05a0517ce2eac58 and project 6dcf3c945af2447aaa996609d5fba04e. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:41.651210 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-87873d04-ab02-41e2-b9f1-5fed53540026 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.110667 Oct 12 22:14:41.652585 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2091/3754] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:14:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:41.658765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e5ff7d9d-7a92-48a9-a4e6-76961feeba79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:41.659808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e5ff7d9d-7a92-48a9-a4e6-76961feeba79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:41.668813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5ff7d9d-7a92-48a9-a4e6-76961feeba79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:41.669721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5ff7d9d-7a92-48a9-a4e6-76961feeba79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:41.670312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5ff7d9d-7a92-48a9-a4e6-76961feeba79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:41.671205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5ff7d9d-7a92-48a9-a4e6-76961feeba79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:41.672400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5ff7d9d-7a92-48a9-a4e6-76961feeba79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:41.672999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5ff7d9d-7a92-48a9-a4e6-76961feeba79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:41.731782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1b207c94-4403-488e-94d3-6e91234c3ea9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:41.744976 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1b207c94-4403-488e-94d3-6e91234c3ea9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1666 microversion: 2.1 time: 0.834020 Oct 12 22:14:41.767037 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1664/3755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:40 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1666 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:41.776946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3f390080-9cc5-432b-b707-654e0651ad50 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Action: 'create', calling method: .version_select at 0x7f51238b3280>, body: {"keypair": {"name": "tempest-keypair-684059353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp/XjmMpDj8JtvpqD0OWHx96ZHr4LMm9j7RCgKYNqG/kmyRSlggQXQO8RlHfpxGcUF0D0cmteuhAyoNLvsiTVKyIrkLh50wIpZL0fienagQlAuYY/JyaRaOiqWqUtkWQQ=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:41.834844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-3f390080-9cc5-432b-b707-654e0651ad50 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Getting quotas for project 6dcf3c945af2447aaa996609d5fba04e. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:41.853244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-3f390080-9cc5-432b-b707-654e0651ad50 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Getting quotas for user 87385b2ff8a349bba05a0517ce2eac58 and project 6dcf3c945af2447aaa996609d5fba04e. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:41.930374 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-3f390080-9cc5-432b-b707-654e0651ad50 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] HTTP exception thrown: Key pair 'tempest-keypair-684059353' already exists. Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3f390080-9cc5-432b-b707-654e0651ad50 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Request method failure captured: Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 272 Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzxPK1TBijpFFprZH6f-r6pZkulF3CwVNIuf-eMjhCFcPehtOCrft_UK-BXpgOlUL6cqeFafQkJ-jG28J5RIg0nbui2VQa3L7IwRsB06o1K-1nz0WEoPZQMs6tuwiI7zIv2HXz4LRuUyAfkla-74ONfQ4DkPqT1ESZ-GYkAoiWc7OW8 Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 6dcf3c945af2447aaa996609d5fba04e Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6dcf3c945af2447aaa996609d5fba04e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 6dcf3c945af2447aaa996609d5fba04e Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-KeyPairsNegativeTestJSON-760605191-project Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 87385b2ff8a349bba05a0517ce2eac58 Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-KeyPairsNegativeTestJSON-760605191-project Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: {"keypair": {"name": "tempest-keypair-684059353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp/XjmMpDj8JtvpqD0OWHx96ZHr4LMm9j7RCgKYNqG/kmyRSlggQXQO8RlHfpxGcUF0D0cmteuhAyoNLvsiTVKyIrkLh50wIpZL0fienagQlAuYY/JyaRaOiqWqUtkWQQ=="}} Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: exception: Key pair 'tempest-keypair-684059353' already exists. Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-684059353', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp/XjmMpDj8JtvpqD0OWHx96ZHr4LMm9j7RCgKYNqG/kmyRSlggQXQO8RlHfpxGcUF0D0cmteuhAyoNLvsiTVKyIrkLh50wIpZL0fienagQlAuYY/JyaRaOiqWqUtkWQQ=='}}} Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result.read() Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '87385b2ff8a349bba05a0517ce2eac58-tempest-keypair-684059353' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 12 22:14:41.946560 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi session.flush() Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result.read() Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 22:14:41.950435 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '87385b2ff8a349bba05a0517ce2eac58-tempest-keypair-684059353' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 12, 22, 14, 41, 904319), 'updated_at': None, 'name': 'tempest-keypair-684059353', 'user_id': '87385b2ff8a349bba05a0517ce2eac58', 'fingerprint': '27:7f:e6:a0:01:42:00:01:e5:e3:c1:1e:88:a4:0b:01', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp/XjmMpDj8JtvpqD0OWHx96ZHr4LMm9j7RCgKYNqG/kmyRSlggQXQO8RlHfpxGcUF0D0cmteuhAyoNLvsiTVKyIrkLh50wIpZL0fienagQlAuYY/JyaRaOiqWqUtkWQQ==', 'type': 'ssh'}] Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi keypair.create() Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._create() Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-684059353' already exists. Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 12 22:14:41.958552 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-684059353' already exists. Oct 12 22:14:41.972906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:41.972906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:41.972906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:41.972906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:41.972906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:41.972906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:41.972906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:41.972906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:41.972906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-684059353' already exists. Oct 12 22:14:41.972906 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:41.980387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3f390080-9cc5-432b-b707-654e0651ad50 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Returning 409 to user: Key pair 'tempest-keypair-684059353' already exists. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:41.980387 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3f390080-9cc5-432b-b707-654e0651ad50 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.208001 Oct 12 22:14:41.980387 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1665/3756] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:14:41 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 209 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:14:41.988813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7669f7d7-48dd-40d8-8520-9f7df01a7469 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:41.989781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7669f7d7-48dd-40d8-8520-9f7df01a7469 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:41.998316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:42.001652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7669f7d7-48dd-40d8-8520-9f7df01a7469 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:42.002821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7669f7d7-48dd-40d8-8520-9f7df01a7469 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:42.003828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7669f7d7-48dd-40d8-8520-9f7df01a7469 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:42.004844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7669f7d7-48dd-40d8-8520-9f7df01a7469 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:42.006022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7669f7d7-48dd-40d8-8520-9f7df01a7469 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:42.007544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7669f7d7-48dd-40d8-8520-9f7df01a7469 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:42.034455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e5ff7d9d-7a92-48a9-a4e6-76961feeba79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:42.053883 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e5ff7d9d-7a92-48a9-a4e6-76961feeba79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1515 microversion: 2.1 time: 0.399193 Oct 12 22:14:42.063378 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2092/3757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:41 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1515 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:42.082482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5c6f3708-c18b-47ff-a78e-8bbc23a58ff9 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Calling method '.version_select at 0x7f5123469280>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:42.137445 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5c6f3708-c18b-47ff-a78e-8bbc23a58ff9 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-684059353" status: 202 len: 0 microversion: 2.1 time: 0.072375 Oct 12 22:14:42.139773 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2093/3758] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 12 22:14:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-684059353 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:14:42.167674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-567407eb-218a-4229-a501-a2b450ea9541 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Action: 'create', calling method: .version_select at 0x7f51232e4160>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNyWhMrOSjiSkmqQbw+sMJ+sFnr11yt7J0Mg2bqZqJQHtnMeDNl+sMdAjLW17YAvWNyMoaZmTCY3Q+M87IGaMiTJToOtMwvTYmI/k3TMo6SHiQRmDYeVqhXsj2fRAaVlw=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-567407eb-218a-4229-a501-a2b450ea9541 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Request method failure captured: Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 247 Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzxPK1TBijpFFprZH6f-r6pZkulF3CwVNIuf-eMjhCFcPehtOCrft_UK-BXpgOlUL6cqeFafQkJ-jG28J5RIg0nbui2VQa3L7IwRsB06o1K-1nz0WEoPZQMs6tuwiI7zIv2HXz4LRuUyAfkla-74ONfQ4DkPqT1ESZ-GYkAoiWc7OW8 Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 6dcf3c945af2447aaa996609d5fba04e Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6dcf3c945af2447aaa996609d5fba04e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 6dcf3c945af2447aaa996609d5fba04e Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-KeyPairsNegativeTestJSON-760605191-project Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 87385b2ff8a349bba05a0517ce2eac58 Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-KeyPairsNegativeTestJSON-760605191-project Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNyWhMrOSjiSkmqQbw+sMJ+sFnr11yt7J0Mg2bqZqJQHtnMeDNl+sMdAjLW17YAvWNyMoaZmTCY3Q+M87IGaMiTJToOtMwvTYmI/k3TMo6SHiQRmDYeVqhXsj2fRAaVlw=="}} Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNyWhMrOSjiSkmqQbw+sMJ+sFnr11yt7J0Mg2bqZqJQHtnMeDNl+sMdAjLW17YAvWNyMoaZmTCY3Q+M87IGaMiTJToOtMwvTYmI/k3TMo6SHiQRmDYeVqhXsj2fRAaVlw=='}}} Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi '' Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:14:42.180369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:14:42.186420 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:14:42.186420 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:14:42.186420 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:14:42.186420 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:14:42.186420 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 12 22:14:42.186420 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.186420 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:42.186420 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.186420 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:42.186420 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:42.186420 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:42.186420 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:14:42.186420 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:14:42.186420 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 12 22:14:42.186420 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.194693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-567407eb-218a-4229-a501-a2b450ea9541 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:42.196286 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-567407eb-218a-4229-a501-a2b450ea9541 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.040967 Oct 12 22:14:42.200255 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2094/3759] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:14:42 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:14:42.214050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1bd1feb2-4c4c-4630-8f08-a38c64ab5c1a tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Action: 'create', calling method: .version_select at 0x7f51233814c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-533076850", "public_key": " "}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:42.273994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-1bd1feb2-4c4c-4630-8f08-a38c64ab5c1a tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Getting quotas for project 6dcf3c945af2447aaa996609d5fba04e. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:42.294460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-1bd1feb2-4c4c-4630-8f08-a38c64ab5c1a tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Getting quotas for user 87385b2ff8a349bba05a0517ce2eac58 and project 6dcf3c945af2447aaa996609d5fba04e. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:42.340121 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-1bd1feb2-4c4c-4630-8f08-a38c64ab5c1a tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1bd1feb2-4c4c-4630-8f08-a38c64ab5c1a tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Request method failure captured: Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 94 Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzxPK1TBijpFFprZH6f-r6pZkulF3CwVNIuf-eMjhCFcPehtOCrft_UK-BXpgOlUL6cqeFafQkJ-jG28J5RIg0nbui2VQa3L7IwRsB06o1K-1nz0WEoPZQMs6tuwiI7zIv2HXz4LRuUyAfkla-74ONfQ4DkPqT1ESZ-GYkAoiWc7OW8 Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 6dcf3c945af2447aaa996609d5fba04e Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6dcf3c945af2447aaa996609d5fba04e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 6dcf3c945af2447aaa996609d5fba04e Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-KeyPairsNegativeTestJSON-760605191-project Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 87385b2ff8a349bba05a0517ce2eac58 Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-KeyPairsNegativeTestJSON-760605191-project Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-533076850", "public_key": " "}} Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: exception: Keypair data is invalid: failed to generate fingerprint Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-533076850', 'public_key': ' '}}} Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:42.345593 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 12 22:14:42.350497 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.357675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1bd1feb2-4c4c-4630-8f08-a38c64ab5c1a tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:42.359054 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1bd1feb2-4c4c-4630-8f08-a38c64ab5c1a tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.153584 Oct 12 22:14:42.384783 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2095/3760] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Oct 12 22:14:42 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:14:42.435014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c72cb8a6-b235-45d0-a65b-39b1d6f919e4 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Action: 'create', calling method: .version_select at 0x7f512c431820>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9UEewes1ZNh+zXOHcbFj0Wc3E7/v6XtrYGlwVOLj2TGd+8nP5Hqu7mDX2JCSVGCEMV2iCAsJJAoh6h3b5k+8jQwIGa0wneF0Pb9EXqG2+5vSVnCWCAVRDAGiU2F0QALg=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c72cb8a6-b235-45d0-a65b-39b1d6f919e4 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Request method failure captured: Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 507 Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzxPK1TBijpFFprZH6f-r6pZkulF3CwVNIuf-eMjhCFcPehtOCrft_UK-BXpgOlUL6cqeFafQkJ-jG28J5RIg0nbui2VQa3L7IwRsB06o1K-1nz0WEoPZQMs6tuwiI7zIv2HXz4LRuUyAfkla-74ONfQ4DkPqT1ESZ-GYkAoiWc7OW8 Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 6dcf3c945af2447aaa996609d5fba04e Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6dcf3c945af2447aaa996609d5fba04e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 6dcf3c945af2447aaa996609d5fba04e Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-KeyPairsNegativeTestJSON-760605191-project Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 87385b2ff8a349bba05a0517ce2eac58 Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-KeyPairsNegativeTestJSON-760605191-project Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9UEewes1ZNh+zXOHcbFj0Wc3E7/v6XtrYGlwVOLj2TGd+8nP5Hqu7mDX2JCSVGCEMV2iCAsJJAoh6h3b5k+8jQwIGa0wneF0Pb9EXqG2+5vSVnCWCAVRDAGiU2F0QALg=="}} Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9UEewes1ZNh+zXOHcbFj0Wc3E7/v6XtrYGlwVOLj2TGd+8nP5Hqu7mDX2JCSVGCEMV2iCAsJJAoh6h3b5k+8jQwIGa0wneF0Pb9EXqG2+5vSVnCWCAVRDAGiU2F0QALg=='}}} Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 12 22:14:42.440364 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 12 22:14:42.446410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.451848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c72cb8a6-b235-45d0-a65b-39b1d6f919e4 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:42.453653 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c72cb8a6-b235-45d0-a65b-39b1d6f919e4 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.030034 Oct 12 22:14:42.454846 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2096/3761] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:14:42 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:14:42.472884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b791c00-8145-4753-9e67-00cb50d70a33 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Action: 'create', calling method: .version_select at 0x7f512826c040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1397641086", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:42.533112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-8b791c00-8145-4753-9e67-00cb50d70a33 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Getting quotas for project 6dcf3c945af2447aaa996609d5fba04e. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:42.552880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-8b791c00-8145-4753-9e67-00cb50d70a33 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Getting quotas for user 87385b2ff8a349bba05a0517ce2eac58 and project 6dcf3c945af2447aaa996609d5fba04e. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:42.599399 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-8b791c00-8145-4753-9e67-00cb50d70a33 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b791c00-8145-4753-9e67-00cb50d70a33 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Request method failure captured: Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 118 Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzxPK1TBijpFFprZH6f-r6pZkulF3CwVNIuf-eMjhCFcPehtOCrft_UK-BXpgOlUL6cqeFafQkJ-jG28J5RIg0nbui2VQa3L7IwRsB06o1K-1nz0WEoPZQMs6tuwiI7zIv2HXz4LRuUyAfkla-74ONfQ4DkPqT1ESZ-GYkAoiWc7OW8 Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 6dcf3c945af2447aaa996609d5fba04e Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6dcf3c945af2447aaa996609d5fba04e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 6dcf3c945af2447aaa996609d5fba04e Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-KeyPairsNegativeTestJSON-760605191-project Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 87385b2ff8a349bba05a0517ce2eac58 Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-KeyPairsNegativeTestJSON-760605191-project Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1397641086", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: exception: Keypair data is invalid: failed to generate fingerprint Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1397641086', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 12 22:14:42.603342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 12 22:14:42.611879 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.618262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b791c00-8145-4753-9e67-00cb50d70a33 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:42.619759 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8b791c00-8145-4753-9e67-00cb50d70a33 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.158099 Oct 12 22:14:42.621096 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2097/3762] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:14:42 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:14:42.629274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c4fe3ccd-47f4-4cb5-9129-e8be6dee9b24 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:42.630430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c4fe3ccd-47f4-4cb5-9129-e8be6dee9b24 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:42.645793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4fe3ccd-47f4-4cb5-9129-e8be6dee9b24 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:42.646695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4fe3ccd-47f4-4cb5-9129-e8be6dee9b24 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:42.647999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4fe3ccd-47f4-4cb5-9129-e8be6dee9b24 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:42.653895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4fe3ccd-47f4-4cb5-9129-e8be6dee9b24 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:42.656247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4fe3ccd-47f4-4cb5-9129-e8be6dee9b24 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:42.657039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4fe3ccd-47f4-4cb5-9129-e8be6dee9b24 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:42.817785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7669f7d7-48dd-40d8-8520-9f7df01a7469 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:42.833414 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7669f7d7-48dd-40d8-8520-9f7df01a7469 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1524 microversion: 2.1 time: 0.851061 Oct 12 22:14:42.834588 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1666/3763] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:41 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1524 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:42.850709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b48bd764-a0ed-475e-b0f6-68d8967c4e43 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Calling method '.version_select at 0x7f51238b3820>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:42.894345 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-b48bd764-a0ed-475e-b0f6-68d8967c4e43 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-835544188 not found for user 87385b2ff8a349bba05a0517ce2eac58 Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b48bd764-a0ed-475e-b0f6-68d8967c4e43 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Request method failure captured: Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-835544188 HTTP/1.1 Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzxPK1TBijpFFprZH6f-r6pZkulF3CwVNIuf-eMjhCFcPehtOCrft_UK-BXpgOlUL6cqeFafQkJ-jG28J5RIg0nbui2VQa3L7IwRsB06o1K-1nz0WEoPZQMs6tuwiI7zIv2HXz4LRuUyAfkla-74ONfQ4DkPqT1ESZ-GYkAoiWc7OW8 Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 6dcf3c945af2447aaa996609d5fba04e Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6dcf3c945af2447aaa996609d5fba04e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6dcf3c945af2447aaa996609d5fba04e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 6dcf3c945af2447aaa996609d5fba04e Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-760605191 Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-KeyPairsNegativeTestJSON-760605191-project Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 87385b2ff8a349bba05a0517ce2eac58 Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-KeyPairsNegativeTestJSON-760605191-project Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: exception: Keypair tempest-keypair-non-existent-835544188 not found for user 87385b2ff8a349bba05a0517ce2eac58 Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'tempest-keypair-non-existent-835544188'} Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-835544188 not found for user 87385b2ff8a349bba05a0517ce2eac58 Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.900651 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-835544188 not found for user 87385b2ff8a349bba05a0517ce2eac58 Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-835544188 not found for user 87385b2ff8a349bba05a0517ce2eac58 Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:42.905308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b48bd764-a0ed-475e-b0f6-68d8967c4e43 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] Returning 404 to user: Keypair tempest-keypair-non-existent-835544188 not found for user 87385b2ff8a349bba05a0517ce2eac58 {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:42.911332 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b48bd764-a0ed-475e-b0f6-68d8967c4e43 tempest-KeyPairsNegativeTestJSON-760605191 tempest-KeyPairsNegativeTestJSON-760605191-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-835544188" status: 404 len: 144 microversion: 2.1 time: 0.066439 Oct 12 22:14:42.911964 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1667/3764] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 12 22:14:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-835544188 => generated 144 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:14:42.916934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aeef5e44-ea04-4924-b75c-8ee09840d97f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:42.917552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-aeef5e44-ea04-4924-b75c-8ee09840d97f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:42.973214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aeef5e44-ea04-4924-b75c-8ee09840d97f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:42.973874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aeef5e44-ea04-4924-b75c-8ee09840d97f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:42.974321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aeef5e44-ea04-4924-b75c-8ee09840d97f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:42.974771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c4fe3ccd-47f4-4cb5-9129-e8be6dee9b24 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:42.975038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aeef5e44-ea04-4924-b75c-8ee09840d97f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:42.978333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aeef5e44-ea04-4924-b75c-8ee09840d97f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:42.978675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aeef5e44-ea04-4924-b75c-8ee09840d97f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:42.989222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c4fe3ccd-47f4-4cb5-9129-e8be6dee9b24 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:42.991741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c4fe3ccd-47f4-4cb5-9129-e8be6dee9b24 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:42.995354 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c4fe3ccd-47f4-4cb5-9129-e8be6dee9b24 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1756 microversion: 2.32 time: 0.372874 Oct 12 22:14:43.012189 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2098/3765] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:14:42 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1756 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:14:43.085225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cacd91eb-603d-46b6-af53-e946c969937e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:43.089976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cacd91eb-603d-46b6-af53-e946c969937e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:43.108578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cacd91eb-603d-46b6-af53-e946c969937e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:43.109481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cacd91eb-603d-46b6-af53-e946c969937e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:43.110279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cacd91eb-603d-46b6-af53-e946c969937e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:43.111274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cacd91eb-603d-46b6-af53-e946c969937e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:43.111889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cacd91eb-603d-46b6-af53-e946c969937e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:43.112637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cacd91eb-603d-46b6-af53-e946c969937e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:43.567161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cacd91eb-603d-46b6-af53-e946c969937e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:43.571529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-aeef5e44-ea04-4924-b75c-8ee09840d97f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:43.585307 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cacd91eb-603d-46b6-af53-e946c969937e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1515 microversion: 2.1 time: 0.503949 Oct 12 22:14:43.585950 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2099/3766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:43 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1515 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:14:43.586346 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-aeef5e44-ea04-4924-b75c-8ee09840d97f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1666 microversion: 2.1 time: 0.670486 Oct 12 22:14:43.587508 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1668/3767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:42 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1666 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:43.861993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-696fda93-f70e-42e2-828f-c349c128383d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:43.861993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-696fda93-f70e-42e2-828f-c349c128383d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:43.870241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696fda93-f70e-42e2-828f-c349c128383d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:43.870867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696fda93-f70e-42e2-828f-c349c128383d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:43.871453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696fda93-f70e-42e2-828f-c349c128383d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:43.872432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696fda93-f70e-42e2-828f-c349c128383d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:43.878778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696fda93-f70e-42e2-828f-c349c128383d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:43.879518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696fda93-f70e-42e2-828f-c349c128383d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:44.035115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-91c6c2e4-b4cd-4c15-bfec-dfeebbe71b37 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:44.036197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-91c6c2e4-b4cd-4c15-bfec-dfeebbe71b37 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:44.048406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91c6c2e4-b4cd-4c15-bfec-dfeebbe71b37 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:44.049452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91c6c2e4-b4cd-4c15-bfec-dfeebbe71b37 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:44.052268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91c6c2e4-b4cd-4c15-bfec-dfeebbe71b37 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:44.053487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91c6c2e4-b4cd-4c15-bfec-dfeebbe71b37 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:44.054239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91c6c2e4-b4cd-4c15-bfec-dfeebbe71b37 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:44.055830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91c6c2e4-b4cd-4c15-bfec-dfeebbe71b37 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:44.481141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-696fda93-f70e-42e2-828f-c349c128383d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:44.495673 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-696fda93-f70e-42e2-828f-c349c128383d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1524 microversion: 2.1 time: 0.641617 Oct 12 22:14:44.497623 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2100/3768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:43 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1524 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:44.612534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-abcd3de1-4828-486e-80cb-26d1a3d11e26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:44.614048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-abcd3de1-4828-486e-80cb-26d1a3d11e26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:44.629642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abcd3de1-4828-486e-80cb-26d1a3d11e26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:44.630338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abcd3de1-4828-486e-80cb-26d1a3d11e26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:44.630935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abcd3de1-4828-486e-80cb-26d1a3d11e26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:44.634206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abcd3de1-4828-486e-80cb-26d1a3d11e26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:44.634850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abcd3de1-4828-486e-80cb-26d1a3d11e26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:44.635472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abcd3de1-4828-486e-80cb-26d1a3d11e26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:45.236324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-abcd3de1-4828-486e-80cb-26d1a3d11e26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:45.257883 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-abcd3de1-4828-486e-80cb-26d1a3d11e26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1666 microversion: 2.1 time: 0.650804 Oct 12 22:14:45.277949 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2101/3769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:44 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1666 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:14:45.286588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-08ab7541-0978-4cc3-8cb3-be41a33852d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:45.287910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-08ab7541-0978-4cc3-8cb3-be41a33852d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:45.294882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08ab7541-0978-4cc3-8cb3-be41a33852d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:45.295685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08ab7541-0978-4cc3-8cb3-be41a33852d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:45.296719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08ab7541-0978-4cc3-8cb3-be41a33852d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:45.297856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08ab7541-0978-4cc3-8cb3-be41a33852d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:45.298476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08ab7541-0978-4cc3-8cb3-be41a33852d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:45.299082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08ab7541-0978-4cc3-8cb3-be41a33852d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:45.503489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-08ab7541-0978-4cc3-8cb3-be41a33852d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:45.514136 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-08ab7541-0978-4cc3-8cb3-be41a33852d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1515 microversion: 2.1 time: 0.234895 Oct 12 22:14:45.515497 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2102/3770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:45 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:45.528378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-696196731", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:45.627731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] validate_networks() for [('4c7ece18-e66a-43bb-9b96-c723ee75dc53', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:14:45.835646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-91c6c2e4-b4cd-4c15-bfec-dfeebbe71b37 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:45.872270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-91c6c2e4-b4cd-4c15-bfec-dfeebbe71b37 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:45.889164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-91c6c2e4-b4cd-4c15-bfec-dfeebbe71b37 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:45.894733 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-91c6c2e4-b4cd-4c15-bfec-dfeebbe71b37 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1803 microversion: 2.32 time: 1.860151 Oct 12 22:14:45.907264 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1669/3771] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:14:44 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1803 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:14:45.907975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1ee7e9d5-dfb9-4bf4-bf40-d07f5fb32e9e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:45.908777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1ee7e9d5-dfb9-4bf4-bf40-d07f5fb32e9e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:45.935848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee7e9d5-dfb9-4bf4-bf40-d07f5fb32e9e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:45.937742 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee7e9d5-dfb9-4bf4-bf40-d07f5fb32e9e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:45.941181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee7e9d5-dfb9-4bf4-bf40-d07f5fb32e9e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:45.942130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee7e9d5-dfb9-4bf4-bf40-d07f5fb32e9e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:45.945647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee7e9d5-dfb9-4bf4-bf40-d07f5fb32e9e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:45.946271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee7e9d5-dfb9-4bf4-bf40-d07f5fb32e9e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:46.326498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:14:46.328075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:14:46.329315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:14:46.331654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:14:46.333095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:14:46.348907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:46.350003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:46.350902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:46.352070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:46.352759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:46.353677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:46.377948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Getting quotas for project 5a107edadb364defb4f2c408969c097c. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:46.385001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Getting quotas for user a2c263e74d274bef8094b9d7ecfc820b and project 5a107edadb364defb4f2c408969c097c. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:46.415200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:14:46.418302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:14:46.500729 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7ce83901-b0a3-4955-922f-f7ce3a5046eb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.982414 Oct 12 22:14:46.509779 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2103/3772] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:14:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:14:46.514882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b37ffd4d-821b-48bc-9ea4-43e8b57b3616 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:46.516187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b37ffd4d-821b-48bc-9ea4-43e8b57b3616 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:46.531674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b37ffd4d-821b-48bc-9ea4-43e8b57b3616 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:46.532226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b37ffd4d-821b-48bc-9ea4-43e8b57b3616 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:46.532714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b37ffd4d-821b-48bc-9ea4-43e8b57b3616 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:46.533375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b37ffd4d-821b-48bc-9ea4-43e8b57b3616 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:46.533827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b37ffd4d-821b-48bc-9ea4-43e8b57b3616 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:46.534305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b37ffd4d-821b-48bc-9ea4-43e8b57b3616 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:46.600805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1ee7e9d5-dfb9-4bf4-bf40-d07f5fb32e9e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:46.608557 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1ee7e9d5-dfb9-4bf4-bf40-d07f5fb32e9e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1506 microversion: 2.1 time: 0.710956 Oct 12 22:14:46.609180 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1670/3773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:45 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1506 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:46.722473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b37ffd4d-821b-48bc-9ea4-43e8b57b3616 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:46.741207 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b37ffd4d-821b-48bc-9ea4-43e8b57b3616 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.230144 Oct 12 22:14:46.760989 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2104/3774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:46 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:46.776193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f987d0cd-ac30-4dd3-8c3d-a50f7bad1b41 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:46.776830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f987d0cd-ac30-4dd3-8c3d-a50f7bad1b41 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:46.904333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f987d0cd-ac30-4dd3-8c3d-a50f7bad1b41 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:46.908671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e7dedb2e-eef0-463c-96ac-9c322275264b tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Action: 'create', calling method: .version_select at 0x7f51287fcd30>, body: {"keypair": {"name": "tempest-keypair-133769295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuKCmwx/yh+X8rumm4JjBMq1YeT/4/H3C/0zowVCOonIG0anQbw6WG5rzGHTRiECiTXsew8WRqf15lBL9189aD+ahmwUEuLHisN4TA+/q/FtS8nZ3B8HJXoxqdKn627Zg=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:46.912160 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f987d0cd-ac30-4dd3-8c3d-a50f7bad1b41 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1224 microversion: 2.1 time: 0.145703 Oct 12 22:14:46.913406 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2105/3775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:46 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1224 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:46.919153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ca98cc73-a75a-4423-a973-737cdd8ace01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:46.920064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ca98cc73-a75a-4423-a973-737cdd8ace01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:46.929180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca98cc73-a75a-4423-a973-737cdd8ace01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:46.934080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca98cc73-a75a-4423-a973-737cdd8ace01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:46.934629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca98cc73-a75a-4423-a973-737cdd8ace01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:46.935519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca98cc73-a75a-4423-a973-737cdd8ace01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:46.936058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca98cc73-a75a-4423-a973-737cdd8ace01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:46.936556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca98cc73-a75a-4423-a973-737cdd8ace01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:46.960890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-e7dedb2e-eef0-463c-96ac-9c322275264b tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:46.977783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-e7dedb2e-eef0-463c-96ac-9c322275264b tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for user 8a94fb706d2849c3994911895c42407f and project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:47.040439 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e7dedb2e-eef0-463c-96ac-9c322275264b tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.410791 Oct 12 22:14:47.041968 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1671/3776] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 12 22:14:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 432 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:14:47.048336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b9312e41-3987-4733-9e2d-57b91660000d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:47.050975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b9312e41-3987-4733-9e2d-57b91660000d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:47.060579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9312e41-3987-4733-9e2d-57b91660000d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:47.061303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9312e41-3987-4733-9e2d-57b91660000d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:47.064279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9312e41-3987-4733-9e2d-57b91660000d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:47.067581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9312e41-3987-4733-9e2d-57b91660000d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:47.068838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9312e41-3987-4733-9e2d-57b91660000d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:47.070878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9312e41-3987-4733-9e2d-57b91660000d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:47.217866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ca98cc73-a75a-4423-a973-737cdd8ace01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:47.230046 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ca98cc73-a75a-4423-a973-737cdd8ace01 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1515 microversion: 2.1 time: 0.315058 Oct 12 22:14:47.231425 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2106/3777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:46 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1515 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:47.239449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f9f66706-d105-4d89-a570-c97b2cfb03f9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:47.240540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f9f66706-d105-4d89-a570-c97b2cfb03f9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:47.248479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9f66706-d105-4d89-a570-c97b2cfb03f9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:47.249304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9f66706-d105-4d89-a570-c97b2cfb03f9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:47.250705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9f66706-d105-4d89-a570-c97b2cfb03f9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:47.251964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9f66706-d105-4d89-a570-c97b2cfb03f9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:47.252612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9f66706-d105-4d89-a570-c97b2cfb03f9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:47.253214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9f66706-d105-4d89-a570-c97b2cfb03f9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:47.500081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f9f66706-d105-4d89-a570-c97b2cfb03f9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:47.513415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f9f66706-d105-4d89-a570-c97b2cfb03f9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:47.516468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f9f66706-d105-4d89-a570-c97b2cfb03f9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:47.518625 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f9f66706-d105-4d89-a570-c97b2cfb03f9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1803 microversion: 2.32 time: 0.285266 Oct 12 22:14:47.527445 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2107/3778] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:14:47 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1803 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:14:47.550375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-514ab0d3-f6e7-4758-a2e3-aa672f1e8bab tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Calling method '.version_select at 0x7f512336d790>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:47.595918 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-514ab0d3-f6e7-4758-a2e3-aa672f1e8bab tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-133769295" status: 200 len: 512 microversion: 2.2 time: 0.074387 Oct 12 22:14:47.598856 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2108/3779] 10.222.0.16 () {60 vars in 1255 bytes} [Wed Oct 12 22:14:47 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-133769295 => generated 512 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:47.624338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-123104df-c501-4c29-86eb-003fcbd9238d tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Calling method '.version_select at 0x7f51233819d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:47.683807 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-123104df-c501-4c29-86eb-003fcbd9238d tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-133769295" status: 204 len: 0 microversion: 2.2 time: 0.073533 Oct 12 22:14:47.691422 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2109/3780] 10.222.0.16 () {60 vars in 1258 bytes} [Wed Oct 12 22:14:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-133769295 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:14:47.714288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3357bef7-8158-403b-abe8-0145e4ef4a5c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:47.715090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3357bef7-8158-403b-abe8-0145e4ef4a5c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:47.732567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3357bef7-8158-403b-abe8-0145e4ef4a5c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:47.733077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3357bef7-8158-403b-abe8-0145e4ef4a5c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:47.733529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3357bef7-8158-403b-abe8-0145e4ef4a5c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:47.734297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3357bef7-8158-403b-abe8-0145e4ef4a5c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:47.734764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3357bef7-8158-403b-abe8-0145e4ef4a5c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:47.735203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3357bef7-8158-403b-abe8-0145e4ef4a5c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:48.001875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3357bef7-8158-403b-abe8-0145e4ef4a5c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:48.014365 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3357bef7-8158-403b-abe8-0145e4ef4a5c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1506 microversion: 2.1 time: 0.325542 Oct 12 22:14:48.015580 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2110/3781] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:47 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:48.025829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8c74f179-c16c-4b11-9ad2-76c09749c64c tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Action: 'create', calling method: .version_select at 0x7f512826c4c0>, body: {"keypair": {"name": "tempest-keypair-1687110493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUcv/5sjA0D91mn03mGNQNHDdGehQn3V03l/Pm16P3r0ZW2qqJWeUMzcS5NXqpZmkhG/cyC/bl9CVrB7i6F36KxnLI9jzenbbMsLZ8r/g5b72IjhXG+Hex1ITIOfJ5Fhw=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:48.053025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-8c74f179-c16c-4b11-9ad2-76c09749c64c tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:48.063184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-8c74f179-c16c-4b11-9ad2-76c09749c64c tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for user 8a94fb706d2849c3994911895c42407f and project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:48.081982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b9312e41-3987-4733-9e2d-57b91660000d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:48.094527 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b9312e41-3987-4733-9e2d-57b91660000d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 1.051215 Oct 12 22:14:48.095588 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1672/3782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:47 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:48.101162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9731133e-979c-4913-af5f-351f26465a18 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:48.102166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9731133e-979c-4913-af5f-351f26465a18 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:48.109843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9731133e-979c-4913-af5f-351f26465a18 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:48.111105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9731133e-979c-4913-af5f-351f26465a18 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:48.111717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9731133e-979c-4913-af5f-351f26465a18 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:48.114575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9731133e-979c-4913-af5f-351f26465a18 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:48.115060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9731133e-979c-4913-af5f-351f26465a18 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:48.115669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9731133e-979c-4913-af5f-351f26465a18 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:48.116911 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8c74f179-c16c-4b11-9ad2-76c09749c64c tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.099338 Oct 12 22:14:48.117856 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2111/3783] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 12 22:14:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:14:48.125095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-393a8a7a-e79e-4e79-9359-53ac2035d127 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:48.126046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-393a8a7a-e79e-4e79-9359-53ac2035d127 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:48.133489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-393a8a7a-e79e-4e79-9359-53ac2035d127 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:48.135177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-393a8a7a-e79e-4e79-9359-53ac2035d127 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:48.135713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-393a8a7a-e79e-4e79-9359-53ac2035d127 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:48.136564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-393a8a7a-e79e-4e79-9359-53ac2035d127 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:48.137196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-393a8a7a-e79e-4e79-9359-53ac2035d127 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:48.137853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-393a8a7a-e79e-4e79-9359-53ac2035d127 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:48.225240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:48.237218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-393a8a7a-e79e-4e79-9359-53ac2035d127 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Unlocking {{(pid=120453) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 12 22:14:48.292058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9731133e-979c-4913-af5f-351f26465a18 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:48.311416 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-393a8a7a-e79e-4e79-9359-53ac2035d127 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 202 len: 0 microversion: 2.1 time: 0.187638 Oct 12 22:14:48.318224 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2112/3784] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:48 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:14:48.323140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9ee5c576-0104-473c-b6dd-3056a0455138 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Calling method '.version_select at 0x7f51233dad30>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:48.326865 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9731133e-979c-4913-af5f-351f26465a18 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1276 microversion: 2.1 time: 0.229175 Oct 12 22:14:48.330067 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1673/3785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:48 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1276 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:48.353034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5e9d1e5e-5044-4d07-8b6c-d916374f0236 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:48.355114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5e9d1e5e-5044-4d07-8b6c-d916374f0236 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:48.368206 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9ee5c576-0104-473c-b6dd-3056a0455138 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687110493" status: 204 len: 0 microversion: 2.2 time: 0.048713 Oct 12 22:14:48.371869 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2113/3786] 10.222.0.16 () {60 vars in 1261 bytes} [Wed Oct 12 22:14:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687110493 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:14:48.376180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e9d1e5e-5044-4d07-8b6c-d916374f0236 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:48.376180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e9d1e5e-5044-4d07-8b6c-d916374f0236 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:48.376180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e9d1e5e-5044-4d07-8b6c-d916374f0236 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:48.376180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e9d1e5e-5044-4d07-8b6c-d916374f0236 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:48.376180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e9d1e5e-5044-4d07-8b6c-d916374f0236 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:48.380625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e9d1e5e-5044-4d07-8b6c-d916374f0236 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:48.395948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-562201c7-f6c4-4fd7-aabe-4685021e9f73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:48.396891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-562201c7-f6c4-4fd7-aabe-4685021e9f73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:48.403737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-562201c7-f6c4-4fd7-aabe-4685021e9f73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:48.404644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-562201c7-f6c4-4fd7-aabe-4685021e9f73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:48.405263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-562201c7-f6c4-4fd7-aabe-4685021e9f73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:48.406714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-562201c7-f6c4-4fd7-aabe-4685021e9f73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:48.407817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-562201c7-f6c4-4fd7-aabe-4685021e9f73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:48.409003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-562201c7-f6c4-4fd7-aabe-4685021e9f73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:48.677619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-562201c7-f6c4-4fd7-aabe-4685021e9f73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:48.707262 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-562201c7-f6c4-4fd7-aabe-4685021e9f73 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.318051 Oct 12 22:14:48.707262 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2114/3787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:48 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:48.707262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-68e2473b-bbd8-49a5-9792-5702d8ba9d69 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Action: 'create', calling method: .version_select at 0x7f5123469700>, body: {"keypair": {"name": "tempest-keypair-1009149712", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:48.722299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:48.734136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-68e2473b-bbd8-49a5-9792-5702d8ba9d69 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:48.737356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5e9d1e5e-5044-4d07-8b6c-d916374f0236 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:48.739768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-68e2473b-bbd8-49a5-9792-5702d8ba9d69 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for user 8a94fb706d2849c3994911895c42407f and project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:48.748929 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5e9d1e5e-5044-4d07-8b6c-d916374f0236 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1515 microversion: 2.1 time: 0.417335 Oct 12 22:14:48.750066 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1674/3788] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:48 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1515 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:48.754585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d6a7d3df-088c-41ee-94e2-1a7a21967496 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:48.755201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d6a7d3df-088c-41ee-94e2-1a7a21967496 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:48.800339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6a7d3df-088c-41ee-94e2-1a7a21967496 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:48.800850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6a7d3df-088c-41ee-94e2-1a7a21967496 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:48.801299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6a7d3df-088c-41ee-94e2-1a7a21967496 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:48.802023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6a7d3df-088c-41ee-94e2-1a7a21967496 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:48.802378 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-68e2473b-bbd8-49a5-9792-5702d8ba9d69 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.104421 Oct 12 22:14:48.802526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6a7d3df-088c-41ee-94e2-1a7a21967496 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:48.802893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6a7d3df-088c-41ee-94e2-1a7a21967496 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:48.803460 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2115/3789] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 12 22:14:48 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:14:48.808731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0a735e79-0da5-4c16-9876-d6a9959b52cc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:48.809551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0a735e79-0da5-4c16-9876-d6a9959b52cc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:48.825875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a735e79-0da5-4c16-9876-d6a9959b52cc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:48.826613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a735e79-0da5-4c16-9876-d6a9959b52cc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:48.827213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a735e79-0da5-4c16-9876-d6a9959b52cc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:48.829377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a735e79-0da5-4c16-9876-d6a9959b52cc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:48.832323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a735e79-0da5-4c16-9876-d6a9959b52cc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:48.832935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a735e79-0da5-4c16-9876-d6a9959b52cc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:49.145861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0a735e79-0da5-4c16-9876-d6a9959b52cc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:49.159154 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0a735e79-0da5-4c16-9876-d6a9959b52cc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.354134 Oct 12 22:14:49.162261 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2116/3790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:48 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:49.174164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-14a831a8-65e7-4d31-9cbb-51f20b83bcb9 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Calling method '.version_select at 0x7f51234295e0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:49.226647 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-14a831a8-65e7-4d31-9cbb-51f20b83bcb9 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009149712" status: 204 len: 0 microversion: 2.2 time: 0.063136 Oct 12 22:14:49.227601 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2117/3791] 10.222.0.16 () {60 vars in 1261 bytes} [Wed Oct 12 22:14:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009149712 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:14:49.234542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-59cc7a5a-db66-4709-8588-e142f97e37cd req-b94a7b4c-4631-4777-9ccd-186ee7c70f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50994542-c3c0-46a4-b994-50c452999ba2", "name": "network-vif-unplugged", "status": "completed", "tag": "1ab1002b-2837-44c5-913e-110671db6764"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:49.271441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-59cc7a5a-db66-4709-8588-e142f97e37cd req-b94a7b4c-4631-4777-9ccd-186ee7c70f12 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:49.271934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-59cc7a5a-db66-4709-8588-e142f97e37cd req-b94a7b4c-4631-4777-9ccd-186ee7c70f12 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:49.273348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-59cc7a5a-db66-4709-8588-e142f97e37cd req-b94a7b4c-4631-4777-9ccd-186ee7c70f12 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:49.296814 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-59cc7a5a-db66-4709-8588-e142f97e37cd req-b94a7b4c-4631-4777-9ccd-186ee7c70f12 service nova] Creating event network-vif-unplugged:1ab1002b-2837-44c5-913e-110671db6764 for instance 50994542-c3c0-46a4-b994-50c452999ba2 on n-h2-861111-1 Oct 12 22:14:49.301473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d6a7d3df-088c-41ee-94e2-1a7a21967496 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:49.309102 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-59cc7a5a-db66-4709-8588-e142f97e37cd req-b94a7b4c-4631-4777-9ccd-186ee7c70f12 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080222 Oct 12 22:14:49.315448 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2118/3792] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:49.321694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d6a7d3df-088c-41ee-94e2-1a7a21967496 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:49.328091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-877697cb-a0db-4afa-9a0f-a92e98ca7712 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:49.328762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d6a7d3df-088c-41ee-94e2-1a7a21967496 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:49.331096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-877697cb-a0db-4afa-9a0f-a92e98ca7712 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:49.336268 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d6a7d3df-088c-41ee-94e2-1a7a21967496 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1850 microversion: 2.32 time: 0.584948 Oct 12 22:14:49.348173 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1675/3793] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:14:48 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1850 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:14:49.348173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c069964c-55f6-4e0e-bece-047195716b2c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:49.348173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c069964c-55f6-4e0e-bece-047195716b2c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:49.353066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-877697cb-a0db-4afa-9a0f-a92e98ca7712 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:49.359123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-877697cb-a0db-4afa-9a0f-a92e98ca7712 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:49.359862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-877697cb-a0db-4afa-9a0f-a92e98ca7712 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:49.360850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-877697cb-a0db-4afa-9a0f-a92e98ca7712 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:49.361561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-877697cb-a0db-4afa-9a0f-a92e98ca7712 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:49.362219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-877697cb-a0db-4afa-9a0f-a92e98ca7712 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:49.385365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c069964c-55f6-4e0e-bece-047195716b2c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:49.389908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c069964c-55f6-4e0e-bece-047195716b2c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:49.391216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c069964c-55f6-4e0e-bece-047195716b2c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:49.392190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c069964c-55f6-4e0e-bece-047195716b2c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:49.392878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c069964c-55f6-4e0e-bece-047195716b2c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:49.394145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c069964c-55f6-4e0e-bece-047195716b2c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:49.410066 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-877697cb-a0db-4afa-9a0f-a92e98ca7712 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] HTTP exception thrown: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-877697cb-a0db-4afa-9a0f-a92e98ca7712 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Request method failure captured: Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 HTTP/1.1 Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzoV3foVnGv0suVxK_Nk7Pp5_kjAPhL8yzVHClSGl5RRxDIZH7rcf5PLHi4YXEet-A0AtHcDaHpFcS_aQR9wl8soXuphQXdzTm1zPCiMI4BUWAPu4l1z3R9DkYDtzHZhHRlT-3CEyzuxgoolPW6Gw8glco6cFnu099ScND31HIZBEC4 Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68913d260d084ce4a8e29daf4783c0bc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 13c74a78e82f4e72a7d1f7b133074f5a Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1fe4575c-4bfa-4907-80a1-6cbfeb246f72'} Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:14:49.412119 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:14:49.417915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. Oct 12 22:14:49.417915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:49.417915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:49.417915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:49.417915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:49.417915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:49.417915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:49.417915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:49.417915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:49.417915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. Oct 12 22:14:49.417915 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:49.420452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-877697cb-a0db-4afa-9a0f-a92e98ca7712 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Returning 404 to user: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:49.421610 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-877697cb-a0db-4afa-9a0f-a92e98ca7712 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72" status: 404 len: 111 microversion: 2.1 time: 0.104831 Oct 12 22:14:49.422505 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2119/3794] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:14:49 2022] DELETE /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:14:49.438647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7cf51713-c308-4d87-84bd-3a4011bbe20c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:49.441425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7cf51713-c308-4d87-84bd-3a4011bbe20c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:49.451737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cf51713-c308-4d87-84bd-3a4011bbe20c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:49.454713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cf51713-c308-4d87-84bd-3a4011bbe20c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:49.456357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cf51713-c308-4d87-84bd-3a4011bbe20c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:49.457672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cf51713-c308-4d87-84bd-3a4011bbe20c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:49.458379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cf51713-c308-4d87-84bd-3a4011bbe20c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:49.459050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cf51713-c308-4d87-84bd-3a4011bbe20c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:49.755434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7cf51713-c308-4d87-84bd-3a4011bbe20c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:49.777490 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7cf51713-c308-4d87-84bd-3a4011bbe20c tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.349877 Oct 12 22:14:49.778536 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2120/3795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:49 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:49.791919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bdf25833-7d94-4ecb-9d56-eb3e8e9c2614 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Action: 'create', calling method: .version_select at 0x7f51233ee280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1988473924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ3W+Fz6rpn+uubjE0GCpxdk7JcdHcU1A5ARfJlhNC+hrqFZAd6RSSOSECNiqj/THuASWY//iPtmcwU97/i0bqtvl4WvmYTc2mG+mNn3rwqQGv4UJccR4ppxjwwxHbjJg=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:49.822548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-bdf25833-7d94-4ecb-9d56-eb3e8e9c2614 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:49.829785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-bdf25833-7d94-4ecb-9d56-eb3e8e9c2614 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for user 8a94fb706d2849c3994911895c42407f and project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:49.864079 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bdf25833-7d94-4ecb-9d56-eb3e8e9c2614 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.083843 Oct 12 22:14:49.865291 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2121/3796] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 12 22:14:49 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 86 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:14:49.871656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6b64cfa7-5bd6-4f93-ba5c-bc9fb24e4205 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:49.872627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6b64cfa7-5bd6-4f93-ba5c-bc9fb24e4205 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:49.882798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b64cfa7-5bd6-4f93-ba5c-bc9fb24e4205 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:49.883761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b64cfa7-5bd6-4f93-ba5c-bc9fb24e4205 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:49.885644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b64cfa7-5bd6-4f93-ba5c-bc9fb24e4205 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:49.886621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b64cfa7-5bd6-4f93-ba5c-bc9fb24e4205 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:49.887643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b64cfa7-5bd6-4f93-ba5c-bc9fb24e4205 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:49.888556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b64cfa7-5bd6-4f93-ba5c-bc9fb24e4205 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:50.049977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6b64cfa7-5bd6-4f93-ba5c-bc9fb24e4205 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:50.062984 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6b64cfa7-5bd6-4f93-ba5c-bc9fb24e4205 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1284 microversion: 2.1 time: 0.195953 Oct 12 22:14:50.064166 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2122/3797] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:49 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:50.069526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8344048e-6f18-438a-909a-727d28c75293 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:50.070218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8344048e-6f18-438a-909a-727d28c75293 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] [instance: 1fe4575c-4bfa-4907-80a1-6cbfeb246f72] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:50.078075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8344048e-6f18-438a-909a-727d28c75293 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:50.078729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8344048e-6f18-438a-909a-727d28c75293 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:50.079496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8344048e-6f18-438a-909a-727d28c75293 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:50.080257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8344048e-6f18-438a-909a-727d28c75293 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:50.080768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8344048e-6f18-438a-909a-727d28c75293 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:50.081470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8344048e-6f18-438a-909a-727d28c75293 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:50.100198 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-8344048e-6f18-438a-909a-727d28c75293 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] HTTP exception thrown: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8344048e-6f18-438a-909a-727d28c75293 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Request method failure captured: Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 HTTP/1.1 Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzoV3foVnGv0suVxK_Nk7Pp5_kjAPhL8yzVHClSGl5RRxDIZH7rcf5PLHi4YXEet-A0AtHcDaHpFcS_aQR9wl8soXuphQXdzTm1zPCiMI4BUWAPu4l1z3R9DkYDtzHZhHRlT-3CEyzuxgoolPW6Gw8glco6cFnu099ScND31HIZBEC4 Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68913d260d084ce4a8e29daf4783c0bc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68913d260d084ce4a8e29daf4783c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 68913d260d084ce4a8e29daf4783c0bc Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624980927 Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 13c74a78e82f4e72a7d1f7b133074f5a Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeNegativeTest-624980927-project Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1fe4575c-4bfa-4907-80a1-6cbfeb246f72'} Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:50.102096 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:50.107034 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:50.107034 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:50.107034 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:50.107034 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:50.107034 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:50.107034 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. Oct 12 22:14:50.107034 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:14:50.107034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8344048e-6f18-438a-909a-727d28c75293 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] Returning 404 to user: Instance 1fe4575c-4bfa-4907-80a1-6cbfeb246f72 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:50.107034 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8344048e-6f18-438a-909a-727d28c75293 tempest-AttachVolumeNegativeTest-624980927 tempest-AttachVolumeNegativeTest-624980927-project] 10.222.0.16 "GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72" status: 404 len: 111 microversion: 2.1 time: 0.038707 Oct 12 22:14:50.107034 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2123/3798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:50 2022] GET /compute/v2.1/servers/1fe4575c-4bfa-4907-80a1-6cbfeb246f72 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:14:50.131641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-57167bfd-3262-44af-afa4-12ce1b7e112e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:50.134049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-57167bfd-3262-44af-afa4-12ce1b7e112e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:50.153010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57167bfd-3262-44af-afa4-12ce1b7e112e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:50.154071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57167bfd-3262-44af-afa4-12ce1b7e112e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:50.155787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57167bfd-3262-44af-afa4-12ce1b7e112e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:50.158318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57167bfd-3262-44af-afa4-12ce1b7e112e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:50.159417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57167bfd-3262-44af-afa4-12ce1b7e112e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:50.160668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57167bfd-3262-44af-afa4-12ce1b7e112e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:50.393127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-57167bfd-3262-44af-afa4-12ce1b7e112e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:50.424749 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-57167bfd-3262-44af-afa4-12ce1b7e112e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1515 microversion: 2.1 time: 0.315375 Oct 12 22:14:50.427002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c069964c-55f6-4e0e-bece-047195716b2c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:50.439392 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c069964c-55f6-4e0e-bece-047195716b2c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1506 microversion: 2.1 time: 1.098741 Oct 12 22:14:50.443624 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1676/3800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:49 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1506 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:50.445760 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2124/3800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:50 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1515 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:50.458947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-555e3fbd-53a9-4a27-a9e6-9da18781ba6e tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Action: 'create', calling method: .version_select at 0x7f5123469670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1142233916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh7FA7JZ0+V7f28+X2uY70yrmYqitpITvZ8BB4lBAq1PGOMziCXCMYuB9rGGUVjjlcFKFvwl7V8NQFCPKMKJ/FG0lDLxLq0kpaNqDlZkbTI8eQ8FdRsAvSXd7THEu3X0A=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:50.468214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-adce694e-863b-47a8-96bd-47d2c59c20ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:50.485673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-adce694e-863b-47a8-96bd-47d2c59c20ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:50.503664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-555e3fbd-53a9-4a27-a9e6-9da18781ba6e tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:50.515891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adce694e-863b-47a8-96bd-47d2c59c20ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:50.517214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adce694e-863b-47a8-96bd-47d2c59c20ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:50.518349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adce694e-863b-47a8-96bd-47d2c59c20ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:50.518791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-555e3fbd-53a9-4a27-a9e6-9da18781ba6e tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for user 8a94fb706d2849c3994911895c42407f and project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:50.520044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adce694e-863b-47a8-96bd-47d2c59c20ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:50.521374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adce694e-863b-47a8-96bd-47d2c59c20ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:50.528487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adce694e-863b-47a8-96bd-47d2c59c20ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:50.610033 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-555e3fbd-53a9-4a27-a9e6-9da18781ba6e tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.158586 Oct 12 22:14:50.610850 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2125/3801] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 12 22:14:50 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 164 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:14:50.633641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0bfe1c7e-2fef-44ad-b42b-e7453040c654 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:50.634275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0bfe1c7e-2fef-44ad-b42b-e7453040c654 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:50.655706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bfe1c7e-2fef-44ad-b42b-e7453040c654 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:50.655929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bfe1c7e-2fef-44ad-b42b-e7453040c654 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:50.656342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bfe1c7e-2fef-44ad-b42b-e7453040c654 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:50.657074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bfe1c7e-2fef-44ad-b42b-e7453040c654 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:50.657882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bfe1c7e-2fef-44ad-b42b-e7453040c654 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:50.658020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bfe1c7e-2fef-44ad-b42b-e7453040c654 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:50.742317 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-adce694e-863b-47a8-96bd-47d2c59c20ee tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 202 len: 0 microversion: 2.1 time: 0.295650 Oct 12 22:14:50.744590 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1677/3802] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:50 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:14:50.759944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d25cd35e-f88e-4c05-86a7-7804218e0f9c tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Action: 'create', calling method: .version_select at 0x7f5123416430>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1433722183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBy31NOQvf8OhBg7nTpx6r4BQDzjSc9OaZo6Tm4sir1PeY8IXgIgHbPvfCZc5bIuIu1ubqq+Q1LIg8v7tf0CPG90VBrnIs+FgK1E3/4ni19TKmS60qcnPlNiAKp0q8u+4g=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:50.802558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-d25cd35e-f88e-4c05-86a7-7804218e0f9c tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:50.810692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-d25cd35e-f88e-4c05-86a7-7804218e0f9c tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for user 8a94fb706d2849c3994911895c42407f and project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:50.853972 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d25cd35e-f88e-4c05-86a7-7804218e0f9c tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.107920 Oct 12 22:14:50.861559 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1678/3803] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 12 22:14:50 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:14:50.879054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9b56bc16-08d3-42e4-8325-f0880b6d7369 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:50.886773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9b56bc16-08d3-42e4-8325-f0880b6d7369 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:50.900234 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b56bc16-08d3-42e4-8325-f0880b6d7369 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:50.901098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b56bc16-08d3-42e4-8325-f0880b6d7369 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:50.901972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b56bc16-08d3-42e4-8325-f0880b6d7369 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:50.902942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b56bc16-08d3-42e4-8325-f0880b6d7369 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:50.905009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b56bc16-08d3-42e4-8325-f0880b6d7369 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:50.907191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b56bc16-08d3-42e4-8325-f0880b6d7369 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:51.009951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:51.118058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0bfe1c7e-2fef-44ad-b42b-e7453040c654 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:51.133088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0bfe1c7e-2fef-44ad-b42b-e7453040c654 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:51.138873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0bfe1c7e-2fef-44ad-b42b-e7453040c654 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:51.140826 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0bfe1c7e-2fef-44ad-b42b-e7453040c654 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1850 microversion: 2.32 time: 0.523700 Oct 12 22:14:51.141412 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2126/3804] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:14:50 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1850 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:14:51.155363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9fafc47b-9b01-44bc-b699-44d8688ec652 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Calling method '.version_select at 0x7f512346e160>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:51.164418 n-d-861111-1 devstack@n-api.service[120453]: WARNING oslo_db.sqlalchemy.utils [None req-9fafc47b-9b01-44bc-b699-44d8688ec652 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 22:14:51.187663 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9fafc47b-9b01-44bc-b699-44d8688ec652 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.044616 Oct 12 22:14:51.188339 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2127/3805] 10.222.0.16 () {60 vars in 1177 bytes} [Wed Oct 12 22:14:51 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:51.193210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4f9b4af2-84ec-45bb-8747-ee8edef2ae4d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:51.193586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4f9b4af2-84ec-45bb-8747-ee8edef2ae4d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:51.204530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f9b4af2-84ec-45bb-8747-ee8edef2ae4d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:51.205037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f9b4af2-84ec-45bb-8747-ee8edef2ae4d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:51.205484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f9b4af2-84ec-45bb-8747-ee8edef2ae4d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:51.206202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f9b4af2-84ec-45bb-8747-ee8edef2ae4d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:51.206663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f9b4af2-84ec-45bb-8747-ee8edef2ae4d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:51.207104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f9b4af2-84ec-45bb-8747-ee8edef2ae4d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:51.330867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4f9b4af2-84ec-45bb-8747-ee8edef2ae4d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:51.348201 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4f9b4af2-84ec-45bb-8747-ee8edef2ae4d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1282 microversion: 2.1 time: 0.155762 Oct 12 22:14:51.367490 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2128/3806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:51 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1282 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:51.377684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd1b5c63-6f04-4192-a64e-ff5375915e18 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Calling method '.version_select at 0x7f512c583310>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:51.417644 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dd1b5c63-6f04-4192-a64e-ff5375915e18 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1433722183" status: 204 len: 0 microversion: 2.2 time: 0.048190 Oct 12 22:14:51.418242 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2129/3807] 10.222.0.16 () {60 vars in 1321 bytes} [Wed Oct 12 22:14:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1433722183 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:14:51.428102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8edc3054-a849-4191-92b0-2c0eddcd6485 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Calling method '.version_select at 0x7f5123381550>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:51.472943 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8edc3054-a849-4191-92b0-2c0eddcd6485 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1142233916" status: 204 len: 0 microversion: 2.2 time: 0.049311 Oct 12 22:14:51.473339 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2130/3808] 10.222.0.16 () {60 vars in 1321 bytes} [Wed Oct 12 22:14:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1142233916 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:14:51.479335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-10d2f9fe-3063-4e8d-b9dc-8ec30383df29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:51.481091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-10d2f9fe-3063-4e8d-b9dc-8ec30383df29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:51.493188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10d2f9fe-3063-4e8d-b9dc-8ec30383df29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:51.495137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10d2f9fe-3063-4e8d-b9dc-8ec30383df29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:51.495611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10d2f9fe-3063-4e8d-b9dc-8ec30383df29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:51.496331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10d2f9fe-3063-4e8d-b9dc-8ec30383df29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:51.496791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10d2f9fe-3063-4e8d-b9dc-8ec30383df29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:51.497221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10d2f9fe-3063-4e8d-b9dc-8ec30383df29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:51.650499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9b56bc16-08d3-42e4-8325-f0880b6d7369 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:51.667996 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9b56bc16-08d3-42e4-8325-f0880b6d7369 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1675 microversion: 2.1 time: 0.801142 Oct 12 22:14:51.668668 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1679/3809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:50 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1675 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:51.682517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a5e19977-8a7c-4e20-830d-19101e9eaff5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:51.683368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a5e19977-8a7c-4e20-830d-19101e9eaff5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:51.694563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5e19977-8a7c-4e20-830d-19101e9eaff5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:51.696394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5e19977-8a7c-4e20-830d-19101e9eaff5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:51.697083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5e19977-8a7c-4e20-830d-19101e9eaff5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:51.700455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5e19977-8a7c-4e20-830d-19101e9eaff5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:51.701225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5e19977-8a7c-4e20-830d-19101e9eaff5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:51.701887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5e19977-8a7c-4e20-830d-19101e9eaff5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:51.898478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-10d2f9fe-3063-4e8d-b9dc-8ec30383df29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:51.908684 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-10d2f9fe-3063-4e8d-b9dc-8ec30383df29 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1515 microversion: 2.1 time: 0.434283 Oct 12 22:14:51.912710 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2131/3810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:51 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1515 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:51.928705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-05918b1a-2775-412e-9b4e-68ee094d1a47 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Calling method '.version_select at 0x7f5123363d30>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:51.991146 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-05918b1a-2775-412e-9b4e-68ee094d1a47 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1988473924" status: 204 len: 0 microversion: 2.2 time: 0.075587 Oct 12 22:14:51.993422 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2132/3811] 10.222.0.16 () {60 vars in 1321 bytes} [Wed Oct 12 22:14:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1988473924 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:14:52.014096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-79046630-e7e1-4b78-ae0d-fc636ba9f8f6 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Action: 'create', calling method: .version_select at 0x7f51233ee3a0>, body: {"keypair": {"name": "tempest-keypair-547402952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuXSsEYAe5akMDtSiMnCPv1kSqB/nqtaRH8ZOyGIkNv28eC2S1QM9Ub8ctJqtt3E3E2Xzrv0KCmQSdXfIu3DrSEGlJpOCgLmw88JT7eaiCN/sxui/CPLsNtfYTdSd2nxg=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:52.070309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-79046630-e7e1-4b78-ae0d-fc636ba9f8f6 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:52.084637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-79046630-e7e1-4b78-ae0d-fc636ba9f8f6 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for user 8a94fb706d2849c3994911895c42407f and project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:52.125113 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-79046630-e7e1-4b78-ae0d-fc636ba9f8f6 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.117386 Oct 12 22:14:52.127425 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2133/3812] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 12 22:14:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:14:52.149128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b550fa91-67cf-4210-805f-4a31f93cffc1 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Calling method '.version_select at 0x7f51233da160>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:52.162052 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b550fa91-67cf-4210-805f-4a31f93cffc1 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-547402952" status: 200 len: 512 microversion: 2.2 time: 0.027090 Oct 12 22:14:52.163221 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2134/3813] 10.222.0.16 () {60 vars in 1255 bytes} [Wed Oct 12 22:14:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-547402952 => generated 512 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:52.169503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-09b75961-ebd6-4849-b97c-59f197dcb2bc tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:52.170409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-09b75961-ebd6-4849-b97c-59f197dcb2bc tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:52.197198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09b75961-ebd6-4849-b97c-59f197dcb2bc tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:52.198585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09b75961-ebd6-4849-b97c-59f197dcb2bc tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:52.199387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09b75961-ebd6-4849-b97c-59f197dcb2bc tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:52.200416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09b75961-ebd6-4849-b97c-59f197dcb2bc tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:52.201107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09b75961-ebd6-4849-b97c-59f197dcb2bc tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:52.201896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09b75961-ebd6-4849-b97c-59f197dcb2bc tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:52.286299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a5e19977-8a7c-4e20-830d-19101e9eaff5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:52.296539 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a5e19977-8a7c-4e20-830d-19101e9eaff5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 200 len: 1449 microversion: 2.1 time: 0.626365 Oct 12 22:14:52.309986 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1680/3814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:51 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 1449 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:52.318132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3f483639-6a3f-4885-9492-d8e94f973896 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Calling method '.version_select at 0x7f512858f8b0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:52.329824 n-d-861111-1 devstack@n-api.service[120452]: WARNING oslo_db.sqlalchemy.utils [None req-3f483639-6a3f-4885-9492-d8e94f973896 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 22:14:52.336276 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3f483639-6a3f-4885-9492-d8e94f973896 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.024098 Oct 12 22:14:52.337462 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1681/3815] 10.222.0.16 () {60 vars in 1177 bytes} [Wed Oct 12 22:14:52 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:52.346735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:52.350154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:52.372013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:52.372535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:52.373458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:52.375333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:52.379716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:52.381157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:52.416994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:14:52.425955 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.compute.api [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Working on deleting snapshot e02b0886-433b-4cbf-a8d5-89afccbc11a3 from shelved instance... Oct 12 22:14:52.949378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-09b75961-ebd6-4849-b97c-59f197dcb2bc tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:52.968330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-09b75961-ebd6-4849-b97c-59f197dcb2bc tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:52.969962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-09b75961-ebd6-4849-b97c-59f197dcb2bc tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:52.974515 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-09b75961-ebd6-4849-b97c-59f197dcb2bc tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1850 microversion: 2.32 time: 0.806502 Oct 12 22:14:52.987425 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2135/3816] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:14:52 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1850 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:14:53.401527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d222756f-ad8a-4274-ada0-a8fd27d50876 req-2da64f5f-9415-41c6-a72a-d19fb50dba3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "tag": "880216ed-7173-47d4-946d-37845055cc79"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:53.431596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d222756f-ad8a-4274-ada0-a8fd27d50876 req-2da64f5f-9415-41c6-a72a-d19fb50dba3c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:53.432888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d222756f-ad8a-4274-ada0-a8fd27d50876 req-2da64f5f-9415-41c6-a72a-d19fb50dba3c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:53.433514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d222756f-ad8a-4274-ada0-a8fd27d50876 req-2da64f5f-9415-41c6-a72a-d19fb50dba3c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:53.450270 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d222756f-ad8a-4274-ada0-a8fd27d50876 req-2da64f5f-9415-41c6-a72a-d19fb50dba3c service nova] Creating event network-changed:880216ed-7173-47d4-946d-37845055cc79 for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:14:53.465367 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d222756f-ad8a-4274-ada0-a8fd27d50876 req-2da64f5f-9415-41c6-a72a-d19fb50dba3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.468347 Oct 12 22:14:53.466864 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2136/3817] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:14:53.475974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9efb2b7d-c8fa-4fad-aecd-f15e5b88875f tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Calling method '.version_select at 0x7f51233ee790>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:53.536456 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9efb2b7d-c8fa-4fad-aecd-f15e5b88875f tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-547402952" status: 204 len: 0 microversion: 2.2 time: 0.065122 Oct 12 22:14:53.537137 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2137/3818] 10.222.0.16 () {60 vars in 1258 bytes} [Wed Oct 12 22:14:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-547402952 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:14:53.557262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8666d00d-4fe0-434b-b775-864678b8154e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:53.558133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8666d00d-4fe0-434b-b775-864678b8154e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:53.587913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8666d00d-4fe0-434b-b775-864678b8154e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:53.588627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8666d00d-4fe0-434b-b775-864678b8154e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:53.589205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8666d00d-4fe0-434b-b775-864678b8154e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:53.589968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8666d00d-4fe0-434b-b775-864678b8154e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:53.590424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8666d00d-4fe0-434b-b775-864678b8154e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:53.590856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8666d00d-4fe0-434b-b775-864678b8154e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:53.829376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Doing local delete in cell 2bc00301-6462-4874-9c83-c889d0ff6a49(cell1) {{(pid=120452) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 12 22:14:53.830093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:53.837385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:53.838100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:53.838714 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.compute.api [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 12 22:14:53.851991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] deallocate_for_instance() {{(pid=120452) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 12 22:14:54.133816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8666d00d-4fe0-434b-b775-864678b8154e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:54.145845 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8666d00d-4fe0-434b-b775-864678b8154e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1324 microversion: 2.1 time: 0.603282 Oct 12 22:14:54.146437 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2138/3819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:53 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1324 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:54.185258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c00f2ccb-e2c3-436f-ab2a-f961be73fcd1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:54.187169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c00f2ccb-e2c3-436f-ab2a-f961be73fcd1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:54.199213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c00f2ccb-e2c3-436f-ab2a-f961be73fcd1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:54.199796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c00f2ccb-e2c3-436f-ab2a-f961be73fcd1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:54.200245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c00f2ccb-e2c3-436f-ab2a-f961be73fcd1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:54.200956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c00f2ccb-e2c3-436f-ab2a-f961be73fcd1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:54.201459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c00f2ccb-e2c3-436f-ab2a-f961be73fcd1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:54.201891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c00f2ccb-e2c3-436f-ab2a-f961be73fcd1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:54.821424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c00f2ccb-e2c3-436f-ab2a-f961be73fcd1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:54.839160 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c00f2ccb-e2c3-436f-ab2a-f961be73fcd1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1655 microversion: 2.1 time: 0.670095 Oct 12 22:14:54.840196 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2139/3820] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:54 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1655 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:54.848103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ddb419ca-43fe-4a36-ab39-9b7af461ecb0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:54.854124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ddb419ca-43fe-4a36-ab39-9b7af461ecb0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:54.857392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=5 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:54.867831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddb419ca-43fe-4a36-ab39-9b7af461ecb0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:54.868336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddb419ca-43fe-4a36-ab39-9b7af461ecb0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:54.871881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddb419ca-43fe-4a36-ab39-9b7af461ecb0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:54.872683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddb419ca-43fe-4a36-ab39-9b7af461ecb0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:54.873352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddb419ca-43fe-4a36-ab39-9b7af461ecb0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:54.873585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddb419ca-43fe-4a36-ab39-9b7af461ecb0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:55.412227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ddb419ca-43fe-4a36-ab39-9b7af461ecb0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:55.423398 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ddb419ca-43fe-4a36-ab39-9b7af461ecb0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1521 microversion: 2.1 time: 0.581872 Oct 12 22:14:55.424008 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2140/3821] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:54 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1521 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:55.435273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dcc31f84-ea29-4a30-be73-3bb87de9e4b6 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Action: 'create', calling method: .version_select at 0x7f51233dadc0>, body: {"keypair": {"name": "tempest-keypair-1492617824", "type": "x509"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:55.476428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-dcc31f84-ea29-4a30-be73-3bb87de9e4b6 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:55.494359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-dcc31f84-ea29-4a30-be73-3bb87de9e4b6 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for user 8a94fb706d2849c3994911895c42407f and project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:55.530937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.processutils [None req-dcc31f84-ea29-4a30-be73-3bb87de9e4b6 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpyxy_240r/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpyxy_240r/temp.key -subj /CN=8a94fb706d2849c3994911895c42407f -extensions v3_req_client {{(pid=120453) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 12 22:14:55.860193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.processutils [None req-dcc31f84-ea29-4a30-be73-3bb87de9e4b6 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpyxy_240r/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpyxy_240r/temp.key -subj /CN=8a94fb706d2849c3994911895c42407f -extensions v3_req_client" returned: 0 in 0.331s {{(pid=120453) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 12 22:14:55.862980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.processutils [None req-dcc31f84-ea29-4a30-be73-3bb87de9e4b6 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpyxy_240r/temp.key -password pass: {{(pid=120453) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 12 22:14:55.914026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.processutils [None req-dcc31f84-ea29-4a30-be73-3bb87de9e4b6 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpyxy_240r/temp.key -password pass:" returned: 0 in 0.050s {{(pid=120453) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 12 22:14:56.009482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-dcc31f84-ea29-4a30-be73-3bb87de9e4b6 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:14:56.042020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-dcc31f84-ea29-4a30-be73-3bb87de9e4b6 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Getting quotas for user 8a94fb706d2849c3994911895c42407f and project 5990564c36d546ea9c3794e005a9190f. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:14:56.072921 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dcc31f84-ea29-4a30-be73-3bb87de9e4b6 tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.646399 Oct 12 22:14:56.080853 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2141/3822] 10.222.0.16 () {62 vars in 1198 bytes} [Wed Oct 12 22:14:55 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 655 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:14:56.090207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9dc0848d-078c-44ab-b15c-1d58698619a4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:56.091578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9dc0848d-078c-44ab-b15c-1d58698619a4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:56.102160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9dc0848d-078c-44ab-b15c-1d58698619a4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:56.103063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9dc0848d-078c-44ab-b15c-1d58698619a4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:56.103888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9dc0848d-078c-44ab-b15c-1d58698619a4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:56.104833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9dc0848d-078c-44ab-b15c-1d58698619a4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:56.105450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9dc0848d-078c-44ab-b15c-1d58698619a4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:56.106035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9dc0848d-078c-44ab-b15c-1d58698619a4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:56.365568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:56.431457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9dc0848d-078c-44ab-b15c-1d58698619a4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:56.452294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9dc0848d-078c-44ab-b15c-1d58698619a4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:56.454151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9dc0848d-078c-44ab-b15c-1d58698619a4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:56.459026 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9dc0848d-078c-44ab-b15c-1d58698619a4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1871 microversion: 2.32 time: 0.376288 Oct 12 22:14:56.482985 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2142/3823] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:14:56 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1871 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:14:56.488932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9a05fba9-8c69-4d52-ad1e-2d9658c9ce38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:56.493967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9a05fba9-8c69-4d52-ad1e-2d9658c9ce38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:56.504266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a05fba9-8c69-4d52-ad1e-2d9658c9ce38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:56.504760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a05fba9-8c69-4d52-ad1e-2d9658c9ce38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:56.505192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a05fba9-8c69-4d52-ad1e-2d9658c9ce38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:56.505901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a05fba9-8c69-4d52-ad1e-2d9658c9ce38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:56.506350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a05fba9-8c69-4d52-ad1e-2d9658c9ce38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:56.506772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a05fba9-8c69-4d52-ad1e-2d9658c9ce38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:56.536945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:14:56.643877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Updating instance_info_cache with network_info: [] {{(pid=120452) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:14:56.671297 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9a05fba9-8c69-4d52-ad1e-2d9658c9ce38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 202 len: 0 microversion: 2.1 time: 0.185982 Oct 12 22:14:56.677171 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2143/3824] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:14:56 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:14:56.695034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a20ac191-54e4-4072-bc4e-3e88ccc3d141 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:56.697220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a20ac191-54e4-4072-bc4e-3e88ccc3d141 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:56.706307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a20ac191-54e4-4072-bc4e-3e88ccc3d141 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:56.706991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a20ac191-54e4-4072-bc4e-3e88ccc3d141 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:56.707622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a20ac191-54e4-4072-bc4e-3e88ccc3d141 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:56.723924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a20ac191-54e4-4072-bc4e-3e88ccc3d141 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:56.726510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a20ac191-54e4-4072-bc4e-3e88ccc3d141 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:56.727175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a20ac191-54e4-4072-bc4e-3e88ccc3d141 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:57.347799 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-df6c6f8b-d33b-4d72-9e8d-628ed89591aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "DELETE /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 204 len: 0 microversion: 2.1 time: 5.008894 Oct 12 22:14:57.348794 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1682/3825] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:14:52 2022] DELETE /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 0 bytes in 5011 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:14:57.354259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f853195a-e3b5-4030-bccb-29c799d930ec tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Calling method '.version_select at 0x7f51235afe50>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:57.370726 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f853195a-e3b5-4030-bccb-29c799d930ec tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1492617824" status: 200 len: 1534 microversion: 2.2 time: 0.020422 Oct 12 22:14:57.373761 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1683/3826] 10.222.0.16 () {60 vars in 1258 bytes} [Wed Oct 12 22:14:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1492617824 => generated 1534 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:57.387176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-32ebf821-7eb1-469b-aeb6-2b2395c38b60 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:57.388738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-32ebf821-7eb1-469b-aeb6-2b2395c38b60 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:57.400447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32ebf821-7eb1-469b-aeb6-2b2395c38b60 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:57.402889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32ebf821-7eb1-469b-aeb6-2b2395c38b60 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:57.403562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32ebf821-7eb1-469b-aeb6-2b2395c38b60 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:57.404562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32ebf821-7eb1-469b-aeb6-2b2395c38b60 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:57.405187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32ebf821-7eb1-469b-aeb6-2b2395c38b60 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:57.407835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32ebf821-7eb1-469b-aeb6-2b2395c38b60 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:57.589232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a20ac191-54e4-4072-bc4e-3e88ccc3d141 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:57.599830 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a20ac191-54e4-4072-bc4e-3e88ccc3d141 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1324 microversion: 2.1 time: 0.920689 Oct 12 22:14:57.600785 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2144/3827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:56 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1324 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:57.620098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-2d4d2389-c63c-4043-96cd-1c434d3237d0 req-3abf28f3-4b51-4f90-bdfc-9920cea23bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50994542-c3c0-46a4-b994-50c452999ba2", "name": "network-vif-deleted", "tag": "1ab1002b-2837-44c5-913e-110671db6764"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:57.642658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2d4d2389-c63c-4043-96cd-1c434d3237d0 req-3abf28f3-4b51-4f90-bdfc-9920cea23bfa service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:57.656884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2d4d2389-c63c-4043-96cd-1c434d3237d0 req-3abf28f3-4b51-4f90-bdfc-9920cea23bfa service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:57.657573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2d4d2389-c63c-4043-96cd-1c434d3237d0 req-3abf28f3-4b51-4f90-bdfc-9920cea23bfa service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:57.697906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.compute.server_external_events [req-2d4d2389-c63c-4043-96cd-1c434d3237d0 req-3abf28f3-4b51-4f90-bdfc-9920cea23bfa service nova] Unable to find a host for instance 50994542-c3c0-46a4-b994-50c452999ba2. Dropping event network-vif-deleted {{(pid=120453) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 12 22:14:57.699154 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-2d4d2389-c63c-4043-96cd-1c434d3237d0 req-3abf28f3-4b51-4f90-bdfc-9920cea23bfa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.092685 Oct 12 22:14:57.700141 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2145/3828] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 99 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 12 22:14:57.710986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d8e990e9-2713-4ea3-bc34-edd1cd774ba8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:57.714483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d8e990e9-2713-4ea3-bc34-edd1cd774ba8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:57.726646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8e990e9-2713-4ea3-bc34-edd1cd774ba8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:57.730463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8e990e9-2713-4ea3-bc34-edd1cd774ba8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:57.732037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8e990e9-2713-4ea3-bc34-edd1cd774ba8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:57.733258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8e990e9-2713-4ea3-bc34-edd1cd774ba8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:57.734513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8e990e9-2713-4ea3-bc34-edd1cd774ba8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:57.735119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8e990e9-2713-4ea3-bc34-edd1cd774ba8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:58.062226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-32ebf821-7eb1-469b-aeb6-2b2395c38b60 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:58.074166 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-32ebf821-7eb1-469b-aeb6-2b2395c38b60 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1521 microversion: 2.1 time: 0.695738 Oct 12 22:14:58.074835 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1684/3829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:57 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1521 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:58.092494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3269a1a9-daed-4666-818f-d4b9fd0796ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:58.095616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3269a1a9-daed-4666-818f-d4b9fd0796ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:58.121072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3269a1a9-daed-4666-818f-d4b9fd0796ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:58.121844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3269a1a9-daed-4666-818f-d4b9fd0796ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:58.122536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3269a1a9-daed-4666-818f-d4b9fd0796ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:58.123922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3269a1a9-daed-4666-818f-d4b9fd0796ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:58.124985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3269a1a9-daed-4666-818f-d4b9fd0796ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:58.131639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3269a1a9-daed-4666-818f-d4b9fd0796ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:58.167702 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-3269a1a9-daed-4666-818f-d4b9fd0796ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3269a1a9-daed-4666-818f-d4b9fd0796ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 HTTP/1.1 Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '50994542-c3c0-46a4-b994-50c452999ba2'} Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:14:58.172581 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:58.177909 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:14:58.177909 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:14:58.177909 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:14:58.177909 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:14:58.177909 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:14:58.177909 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. Oct 12 22:14:58.177909 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:14:58.180041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3269a1a9-daed-4666-818f-d4b9fd0796ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:14:58.181246 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3269a1a9-daed-4666-818f-d4b9fd0796ac tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 404 len: 111 microversion: 2.1 time: 0.104672 Oct 12 22:14:58.182393 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1685/3830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:58 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:14:58.188660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ce8b2c9e-7a69-40f5-be46-9997d4042acb tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Calling method '.version_select at 0x7f51234163a0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:58.193696 n-d-861111-1 devstack@n-api.service[120452]: WARNING oslo_db.sqlalchemy.utils [None req-ce8b2c9e-7a69-40f5-be46-9997d4042acb tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 22:14:58.199923 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ce8b2c9e-7a69-40f5-be46-9997d4042acb tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.016242 Oct 12 22:14:58.208074 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1686/3831] 10.222.0.16 () {60 vars in 1177 bytes} [Wed Oct 12 22:14:58 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:58.214436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2838ebbd-8d4b-494c-a70e-b1021fca2148 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:58.215556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2838ebbd-8d4b-494c-a70e-b1021fca2148 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:58.233013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2838ebbd-8d4b-494c-a70e-b1021fca2148 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:58.234166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2838ebbd-8d4b-494c-a70e-b1021fca2148 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:58.234764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2838ebbd-8d4b-494c-a70e-b1021fca2148 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:58.239460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2838ebbd-8d4b-494c-a70e-b1021fca2148 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:58.242847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2838ebbd-8d4b-494c-a70e-b1021fca2148 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:58.243373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2838ebbd-8d4b-494c-a70e-b1021fca2148 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:58.333500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d8e990e9-2713-4ea3-bc34-edd1cd774ba8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:58.351167 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d8e990e9-2713-4ea3-bc34-edd1cd774ba8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.647227 Oct 12 22:14:58.394915 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2146/3832] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:57 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:58.401531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-93d37ac8-4e29-475d-90b0-5c8494eee2ba tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] Calling method '.version_select at 0x7f5123363310>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:58.442116 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-93d37ac8-4e29-475d-90b0-5c8494eee2ba tempest-KeyPairsV22TestJSON-1271667058 tempest-KeyPairsV22TestJSON-1271667058-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492617824" status: 204 len: 0 microversion: 2.2 time: 0.045576 Oct 12 22:14:58.446761 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2147/3833] 10.222.0.16 () {60 vars in 1261 bytes} [Wed Oct 12 22:14:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492617824 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:14:58.455512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a4c79a66-8820-4680-b444-923b538d85fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:58.461468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a4c79a66-8820-4680-b444-923b538d85fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:58.487815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4c79a66-8820-4680-b444-923b538d85fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:58.490089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4c79a66-8820-4680-b444-923b538d85fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:58.491575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4c79a66-8820-4680-b444-923b538d85fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:58.494868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4c79a66-8820-4680-b444-923b538d85fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:58.496625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4c79a66-8820-4680-b444-923b538d85fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:58.498183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4c79a66-8820-4680-b444-923b538d85fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:58.839685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a4c79a66-8820-4680-b444-923b538d85fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:58.855597 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a4c79a66-8820-4680-b444-923b538d85fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.405383 Oct 12 22:14:58.857528 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2148/3834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:58 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:14:58.866203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-898092655", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "8a2bd9d3-e80d-4911-bb4a-296de8e90165"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:14:58.970332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] validate_networks() for [('8a2bd9d3-e80d-4911-bb4a-296de8e90165', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:14:59.476719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2838ebbd-8d4b-494c-a70e-b1021fca2148 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:59.491738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2838ebbd-8d4b-494c-a70e-b1021fca2148 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:59.497335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2838ebbd-8d4b-494c-a70e-b1021fca2148 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:14:59.498887 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2838ebbd-8d4b-494c-a70e-b1021fca2148 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1871 microversion: 2.32 time: 1.289390 Oct 12 22:14:59.500868 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1687/3835] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:14:58 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1871 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:14:59.508364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49c0df31-2286-4691-b3ae-d9cef95f9daa tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:14:59.508972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-49c0df31-2286-4691-b3ae-d9cef95f9daa tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:14:59.525830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49c0df31-2286-4691-b3ae-d9cef95f9daa tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:59.526629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49c0df31-2286-4691-b3ae-d9cef95f9daa tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:59.527279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49c0df31-2286-4691-b3ae-d9cef95f9daa tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:14:59.532458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49c0df31-2286-4691-b3ae-d9cef95f9daa tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:14:59.534310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49c0df31-2286-4691-b3ae-d9cef95f9daa tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:14:59.534921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49c0df31-2286-4691-b3ae-d9cef95f9daa tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:00.010343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:15:00.011453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:15:00.012172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:15:00.013065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:15:00.014107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:15:00.033331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:00.036704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:00.037529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:00.040998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:00.040998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:00.043357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:00.097318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Getting quotas for project 4b898b5d0208478e996b7fee2060ed64. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:15:00.117484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Getting quotas for user 11096cece79f4b8fad4b92270f51b299 and project 4b898b5d0208478e996b7fee2060ed64. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:15:00.137239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:15:00.143442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-49c0df31-2286-4691-b3ae-d9cef95f9daa tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:00.174038 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-49c0df31-2286-4691-b3ae-d9cef95f9daa tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1324 microversion: 2.1 time: 0.669189 Oct 12 22:15:00.174709 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1688/3836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:14:59 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1324 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:00.176772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:15:00.189747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d741ad6e-26ad-43d2-84ad-d0c5f364d8bc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:00.190754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d741ad6e-26ad-43d2-84ad-d0c5f364d8bc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:00.212937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d741ad6e-26ad-43d2-84ad-d0c5f364d8bc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:00.213723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d741ad6e-26ad-43d2-84ad-d0c5f364d8bc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:00.232197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d741ad6e-26ad-43d2-84ad-d0c5f364d8bc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:00.234478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d741ad6e-26ad-43d2-84ad-d0c5f364d8bc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:00.241795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d741ad6e-26ad-43d2-84ad-d0c5f364d8bc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:00.243804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d741ad6e-26ad-43d2-84ad-d0c5f364d8bc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:00.348602 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-366f6201-ccce-439d-aea3-3fbebcdcee5b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.488256 Oct 12 22:15:00.351323 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2149/3837] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:14:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:15:00.361447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b9e1c473-bb73-4ce7-939f-451285f496d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:00.364029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b9e1c473-bb73-4ce7-939f-451285f496d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:00.392738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9e1c473-bb73-4ce7-939f-451285f496d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:00.393512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9e1c473-bb73-4ce7-939f-451285f496d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:00.394765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9e1c473-bb73-4ce7-939f-451285f496d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:00.396868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9e1c473-bb73-4ce7-939f-451285f496d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:00.397622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9e1c473-bb73-4ce7-939f-451285f496d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:00.398295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9e1c473-bb73-4ce7-939f-451285f496d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:00.823963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=26 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:00.865092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b9e1c473-bb73-4ce7-939f-451285f496d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:00.875453 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b9e1c473-bb73-4ce7-939f-451285f496d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1521 microversion: 2.1 time: 0.521809 Oct 12 22:15:00.900142 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2150/3838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:00 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1521 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:00.910442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-92846b91-2245-4e61-bada-f104ff967bf6 req-ccf23cd1-848e-4bd0-9724-1c0149603e6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "tag": "e0247182-2fee-4dd5-a752-f742140f2091"}, {"name": "network-changed", "server_uuid": "ed9f061a-d6d4-4590-8e8e-e2891a1a68bd", "tag": "b6310d43-1827-49df-94bd-713373426524"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:00.945301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-92846b91-2245-4e61-bada-f104ff967bf6 req-ccf23cd1-848e-4bd0-9724-1c0149603e6e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:00.948014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-92846b91-2245-4e61-bada-f104ff967bf6 req-ccf23cd1-848e-4bd0-9724-1c0149603e6e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:00.948916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-92846b91-2245-4e61-bada-f104ff967bf6 req-ccf23cd1-848e-4bd0-9724-1c0149603e6e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:00.978881 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-92846b91-2245-4e61-bada-f104ff967bf6 req-ccf23cd1-848e-4bd0-9724-1c0149603e6e service nova] Creating event network-changed:e0247182-2fee-4dd5-a752-f742140f2091 for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:15:00.979827 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-92846b91-2245-4e61-bada-f104ff967bf6 req-ccf23cd1-848e-4bd0-9724-1c0149603e6e service nova] Creating event network-changed:b6310d43-1827-49df-94bd-713373426524 for instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd on n-h2-861111-1 Oct 12 22:15:01.011717 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-92846b91-2245-4e61-bada-f104ff967bf6 req-ccf23cd1-848e-4bd0-9724-1c0149603e6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.109394 Oct 12 22:15:01.017326 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2151/3839] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:01.024319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3bcd287f-f81c-4b8b-918d-b59813b771b8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:01.025256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3bcd287f-f81c-4b8b-918d-b59813b771b8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:01.302278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d741ad6e-26ad-43d2-84ad-d0c5f364d8bc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:01.314263 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d741ad6e-26ad-43d2-84ad-d0c5f364d8bc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 1.138295 Oct 12 22:15:01.334097 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1689/3840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:00 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:01.353196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c5d7480c-63c6-46f7-9b51-a845105e2ac7 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:01.354600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c5d7480c-63c6-46f7-9b51-a845105e2ac7 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:01.375583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5d7480c-63c6-46f7-9b51-a845105e2ac7 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:01.376513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5d7480c-63c6-46f7-9b51-a845105e2ac7 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:01.377444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5d7480c-63c6-46f7-9b51-a845105e2ac7 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:01.378319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5d7480c-63c6-46f7-9b51-a845105e2ac7 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:01.379009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5d7480c-63c6-46f7-9b51-a845105e2ac7 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:01.379684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5d7480c-63c6-46f7-9b51-a845105e2ac7 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:01.597180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3bcd287f-f81c-4b8b-918d-b59813b771b8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:01.609579 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3bcd287f-f81c-4b8b-918d-b59813b771b8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1214 microversion: 2.1 time: 0.590677 Oct 12 22:15:01.610566 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2152/3841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:01 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1214 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:01.782006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c5d7480c-63c6-46f7-9b51-a845105e2ac7 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:01.794009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c5d7480c-63c6-46f7-9b51-a845105e2ac7 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:01.796670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c5d7480c-63c6-46f7-9b51-a845105e2ac7 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:01.798347 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c5d7480c-63c6-46f7-9b51-a845105e2ac7 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1892 microversion: 2.32 time: 0.462946 Oct 12 22:15:01.803110 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1690/3842] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:01 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1892 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:01.809269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fd16cd00-297f-4d58-90f1-3b83577be797 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:01.810105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fd16cd00-297f-4d58-90f1-3b83577be797 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:01.818239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd16cd00-297f-4d58-90f1-3b83577be797 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:01.819125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd16cd00-297f-4d58-90f1-3b83577be797 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:01.819830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd16cd00-297f-4d58-90f1-3b83577be797 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:01.820856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd16cd00-297f-4d58-90f1-3b83577be797 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:01.821571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd16cd00-297f-4d58-90f1-3b83577be797 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:01.822419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd16cd00-297f-4d58-90f1-3b83577be797 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:01.890138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d4aecace-d06e-4b9c-9b5f-7c8a16455a81 req-1fad9c9b-c5f0-44cf-99a7-29054de52162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5691e2-2981-42cf-ae67-ba70d4131f23", "name": "network-vif-plugged", "status": "completed", "tag": "54710401-b13b-48ce-8096-4284cea6423f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:01.908265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d4aecace-d06e-4b9c-9b5f-7c8a16455a81 req-1fad9c9b-c5f0-44cf-99a7-29054de52162 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:01.908756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d4aecace-d06e-4b9c-9b5f-7c8a16455a81 req-1fad9c9b-c5f0-44cf-99a7-29054de52162 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:01.909193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d4aecace-d06e-4b9c-9b5f-7c8a16455a81 req-1fad9c9b-c5f0-44cf-99a7-29054de52162 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:01.934055 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d4aecace-d06e-4b9c-9b5f-7c8a16455a81 req-1fad9c9b-c5f0-44cf-99a7-29054de52162 service nova] Creating event network-vif-plugged:54710401-b13b-48ce-8096-4284cea6423f for instance bd5691e2-2981-42cf-ae67-ba70d4131f23 on n-h1-861111-1 Oct 12 22:15:01.945213 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d4aecace-d06e-4b9c-9b5f-7c8a16455a81 req-1fad9c9b-c5f0-44cf-99a7-29054de52162 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.333045 Oct 12 22:15:01.946097 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2153/3843] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:01.967385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a4455815-0b47-40c8-8383-2fc27ffe7090 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:01.968144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a4455815-0b47-40c8-8383-2fc27ffe7090 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:01.986501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4455815-0b47-40c8-8383-2fc27ffe7090 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:01.988373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4455815-0b47-40c8-8383-2fc27ffe7090 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:01.989018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4455815-0b47-40c8-8383-2fc27ffe7090 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:01.992127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4455815-0b47-40c8-8383-2fc27ffe7090 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:01.992802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4455815-0b47-40c8-8383-2fc27ffe7090 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:01.993415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4455815-0b47-40c8-8383-2fc27ffe7090 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:02.369753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fd16cd00-297f-4d58-90f1-3b83577be797 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:02.374237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a4455815-0b47-40c8-8383-2fc27ffe7090 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:02.381782 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fd16cd00-297f-4d58-90f1-3b83577be797 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1324 microversion: 2.1 time: 0.576587 Oct 12 22:15:02.391331 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1691/3844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:01 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1324 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:02.391331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-35612399-5327-4ca9-a48e-75b2fe213fb8 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:02.391777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-35612399-5327-4ca9-a48e-75b2fe213fb8 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:02.408840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35612399-5327-4ca9-a48e-75b2fe213fb8 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:02.411061 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a4455815-0b47-40c8-8383-2fc27ffe7090 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.463133 Oct 12 22:15:02.411812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35612399-5327-4ca9-a48e-75b2fe213fb8 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:02.412454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35612399-5327-4ca9-a48e-75b2fe213fb8 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:02.413564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35612399-5327-4ca9-a48e-75b2fe213fb8 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:02.414363 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2154/3845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:01 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:02.435331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35612399-5327-4ca9-a48e-75b2fe213fb8 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:02.435771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35612399-5327-4ca9-a48e-75b2fe213fb8 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:02.443018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-109a311e-6a97-475f-8d59-61c64fa5922a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:02.448885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-109a311e-6a97-475f-8d59-61c64fa5922a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:02.463820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-109a311e-6a97-475f-8d59-61c64fa5922a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:02.465680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-109a311e-6a97-475f-8d59-61c64fa5922a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:02.471360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-109a311e-6a97-475f-8d59-61c64fa5922a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:02.476157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-109a311e-6a97-475f-8d59-61c64fa5922a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:02.477097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-109a311e-6a97-475f-8d59-61c64fa5922a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:02.477740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-109a311e-6a97-475f-8d59-61c64fa5922a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:02.803600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-109a311e-6a97-475f-8d59-61c64fa5922a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:02.813014 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-109a311e-6a97-475f-8d59-61c64fa5922a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.374916 Oct 12 22:15:02.839842 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2155/3846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:02 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:02.855484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-52f9961b-e0ed-45c3-bb6c-a292413b9f7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:02.856110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-52f9961b-e0ed-45c3-bb6c-a292413b9f7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:02.876257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52f9961b-e0ed-45c3-bb6c-a292413b9f7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:02.881890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52f9961b-e0ed-45c3-bb6c-a292413b9f7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:02.882450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52f9961b-e0ed-45c3-bb6c-a292413b9f7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:02.886261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52f9961b-e0ed-45c3-bb6c-a292413b9f7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:02.888351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52f9961b-e0ed-45c3-bb6c-a292413b9f7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:02.889834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52f9961b-e0ed-45c3-bb6c-a292413b9f7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:03.094129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-52f9961b-e0ed-45c3-bb6c-a292413b9f7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:03.109495 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-52f9961b-e0ed-45c3-bb6c-a292413b9f7c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1210 microversion: 2.1 time: 0.261447 Oct 12 22:15:03.134569 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2156/3847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:02 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1210 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:03.153625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-79fc047b-260d-4c86-aa67-3607665dd71a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:03.157711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-79fc047b-260d-4c86-aa67-3607665dd71a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:03.173817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79fc047b-260d-4c86-aa67-3607665dd71a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:03.178003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79fc047b-260d-4c86-aa67-3607665dd71a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:03.179847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79fc047b-260d-4c86-aa67-3607665dd71a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:03.183380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79fc047b-260d-4c86-aa67-3607665dd71a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:03.184212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79fc047b-260d-4c86-aa67-3607665dd71a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:03.185776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79fc047b-260d-4c86-aa67-3607665dd71a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:03.738272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-79fc047b-260d-4c86-aa67-3607665dd71a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:03.762160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-79fc047b-260d-4c86-aa67-3607665dd71a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:03.769955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-35612399-5327-4ca9-a48e-75b2fe213fb8 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:03.773222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-79fc047b-260d-4c86-aa67-3607665dd71a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:03.777400 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-79fc047b-260d-4c86-aa67-3607665dd71a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1892 microversion: 2.32 time: 0.635028 Oct 12 22:15:03.778747 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2157/3848] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:03 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1892 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:03.785912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-72ff06b6-41a1-481f-bfb4-97d740d5653f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:03.786694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-72ff06b6-41a1-481f-bfb4-97d740d5653f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:03.795361 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-35612399-5327-4ca9-a48e-75b2fe213fb8 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1521 microversion: 2.1 time: 1.406040 Oct 12 22:15:03.801567 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1692/3849] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:02 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1521 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:03.813004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-ecdbeb84-b8c8-43ff-96eb-97f845043f6c req-6bd70872-c9f7-4eb1-a67b-57a0a2bc68ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "tag": "8ed1a573-7211-4891-abce-2146ad739e4b"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:03.822416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72ff06b6-41a1-481f-bfb4-97d740d5653f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:03.823760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72ff06b6-41a1-481f-bfb4-97d740d5653f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:03.826859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72ff06b6-41a1-481f-bfb4-97d740d5653f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:03.831288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72ff06b6-41a1-481f-bfb4-97d740d5653f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:03.832182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72ff06b6-41a1-481f-bfb4-97d740d5653f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:03.833720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72ff06b6-41a1-481f-bfb4-97d740d5653f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:03.844300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ecdbeb84-b8c8-43ff-96eb-97f845043f6c req-6bd70872-c9f7-4eb1-a67b-57a0a2bc68ff service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:03.844799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ecdbeb84-b8c8-43ff-96eb-97f845043f6c req-6bd70872-c9f7-4eb1-a67b-57a0a2bc68ff service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:03.845220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ecdbeb84-b8c8-43ff-96eb-97f845043f6c req-6bd70872-c9f7-4eb1-a67b-57a0a2bc68ff service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:03.885024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:03.887268 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-ecdbeb84-b8c8-43ff-96eb-97f845043f6c req-6bd70872-c9f7-4eb1-a67b-57a0a2bc68ff service nova] Creating event network-changed:8ed1a573-7211-4891-abce-2146ad739e4b for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:15:03.901387 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-ecdbeb84-b8c8-43ff-96eb-97f845043f6c req-6bd70872-c9f7-4eb1-a67b-57a0a2bc68ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096988 Oct 12 22:15:03.902968 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1693/3850] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:03.910863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a9cbf8a-6e86-4a00-9c29-d0cbee533951 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:03.911631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7a9cbf8a-6e86-4a00-9c29-d0cbee533951 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:03.919765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a9cbf8a-6e86-4a00-9c29-d0cbee533951 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:03.921314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a9cbf8a-6e86-4a00-9c29-d0cbee533951 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:03.921934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a9cbf8a-6e86-4a00-9c29-d0cbee533951 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:03.922826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a9cbf8a-6e86-4a00-9c29-d0cbee533951 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:03.923570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a9cbf8a-6e86-4a00-9c29-d0cbee533951 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:03.924160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a9cbf8a-6e86-4a00-9c29-d0cbee533951 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:04.345659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-72ff06b6-41a1-481f-bfb4-97d740d5653f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:04.353889 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-72ff06b6-41a1-481f-bfb4-97d740d5653f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.572020 Oct 12 22:15:04.354801 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2158/3851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:03 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:04.360806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cfbd6e60-4d14-4c38-81e7-b48b1437b601 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:04.366256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cfbd6e60-4d14-4c38-81e7-b48b1437b601 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:04.384382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfbd6e60-4d14-4c38-81e7-b48b1437b601 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:04.385272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfbd6e60-4d14-4c38-81e7-b48b1437b601 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:04.385995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfbd6e60-4d14-4c38-81e7-b48b1437b601 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:04.387039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfbd6e60-4d14-4c38-81e7-b48b1437b601 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:04.387857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfbd6e60-4d14-4c38-81e7-b48b1437b601 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:04.388674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfbd6e60-4d14-4c38-81e7-b48b1437b601 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:04.542958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cfbd6e60-4d14-4c38-81e7-b48b1437b601 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:04.558136 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cfbd6e60-4d14-4c38-81e7-b48b1437b601 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1272 microversion: 2.1 time: 0.201873 Oct 12 22:15:04.559332 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2159/3852] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:04 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1272 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:04.805705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-28511f54-7f39-4db0-9e8f-25c0bfd4804a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:04.806432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-28511f54-7f39-4db0-9e8f-25c0bfd4804a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:04.820089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28511f54-7f39-4db0-9e8f-25c0bfd4804a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:04.820606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28511f54-7f39-4db0-9e8f-25c0bfd4804a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:04.821060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28511f54-7f39-4db0-9e8f-25c0bfd4804a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:04.821814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28511f54-7f39-4db0-9e8f-25c0bfd4804a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:04.822303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28511f54-7f39-4db0-9e8f-25c0bfd4804a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:04.822746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28511f54-7f39-4db0-9e8f-25c0bfd4804a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:05.398914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-28511f54-7f39-4db0-9e8f-25c0bfd4804a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:05.413945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-28511f54-7f39-4db0-9e8f-25c0bfd4804a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:05.418003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-28511f54-7f39-4db0-9e8f-25c0bfd4804a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:05.420047 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-28511f54-7f39-4db0-9e8f-25c0bfd4804a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1892 microversion: 2.32 time: 0.619120 Oct 12 22:15:05.423158 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2160/3853] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:04 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1892 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:15:05.434173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f5db49ea-af1e-4d26-98ab-bf2bda0e61d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:05.435191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f5db49ea-af1e-4d26-98ab-bf2bda0e61d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:05.448506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5db49ea-af1e-4d26-98ab-bf2bda0e61d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:05.451601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5db49ea-af1e-4d26-98ab-bf2bda0e61d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:05.452771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5db49ea-af1e-4d26-98ab-bf2bda0e61d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:05.453874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5db49ea-af1e-4d26-98ab-bf2bda0e61d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:05.462373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5db49ea-af1e-4d26-98ab-bf2bda0e61d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:05.465568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5db49ea-af1e-4d26-98ab-bf2bda0e61d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:05.651711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a9cbf8a-6e86-4a00-9c29-d0cbee533951 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:05.661468 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7a9cbf8a-6e86-4a00-9c29-d0cbee533951 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1324 microversion: 2.1 time: 1.756631 Oct 12 22:15:05.662047 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1694/3854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:03 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1324 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:05.695580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-97a74bbf-34fe-452d-bb13-4d6fb629f622 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:05.698742 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-97a74bbf-34fe-452d-bb13-4d6fb629f622 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:05.716439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97a74bbf-34fe-452d-bb13-4d6fb629f622 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:05.718255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97a74bbf-34fe-452d-bb13-4d6fb629f622 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:05.719756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97a74bbf-34fe-452d-bb13-4d6fb629f622 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:05.727563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97a74bbf-34fe-452d-bb13-4d6fb629f622 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:05.728104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97a74bbf-34fe-452d-bb13-4d6fb629f622 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:05.728553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97a74bbf-34fe-452d-bb13-4d6fb629f622 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:06.066050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f5db49ea-af1e-4d26-98ab-bf2bda0e61d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:06.079622 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f5db49ea-af1e-4d26-98ab-bf2bda0e61d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1506 microversion: 2.1 time: 0.654960 Oct 12 22:15:06.107120 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2161/3855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:05 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1506 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:06.119415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4d853500-c3ed-4ebe-b06a-d72c3b680a79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:06.120313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4d853500-c3ed-4ebe-b06a-d72c3b680a79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:06.141246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d853500-c3ed-4ebe-b06a-d72c3b680a79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:06.142530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d853500-c3ed-4ebe-b06a-d72c3b680a79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:06.143770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d853500-c3ed-4ebe-b06a-d72c3b680a79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:06.146843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d853500-c3ed-4ebe-b06a-d72c3b680a79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:06.147549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d853500-c3ed-4ebe-b06a-d72c3b680a79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:06.148152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d853500-c3ed-4ebe-b06a-d72c3b680a79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:06.359661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-97a74bbf-34fe-452d-bb13-4d6fb629f622 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:06.368941 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-97a74bbf-34fe-452d-bb13-4d6fb629f622 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1272 microversion: 2.1 time: 0.682390 Oct 12 22:15:06.373169 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1695/3856] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:05 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1272 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:06.388069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-dfa8cd2e-8c1b-4fee-bc0d-547bec11178c req-4f58fdc0-5d8f-445b-a28f-207bc9ec8520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "tag": "52643e8f-ddae-453b-8aab-3913248201fd"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:06.415457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dfa8cd2e-8c1b-4fee-bc0d-547bec11178c req-4f58fdc0-5d8f-445b-a28f-207bc9ec8520 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:06.417125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dfa8cd2e-8c1b-4fee-bc0d-547bec11178c req-4f58fdc0-5d8f-445b-a28f-207bc9ec8520 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:06.417885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dfa8cd2e-8c1b-4fee-bc0d-547bec11178c req-4f58fdc0-5d8f-445b-a28f-207bc9ec8520 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:06.450730 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-dfa8cd2e-8c1b-4fee-bc0d-547bec11178c req-4f58fdc0-5d8f-445b-a28f-207bc9ec8520 service nova] Creating event network-changed:52643e8f-ddae-453b-8aab-3913248201fd for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:15:06.466540 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-dfa8cd2e-8c1b-4fee-bc0d-547bec11178c req-4f58fdc0-5d8f-445b-a28f-207bc9ec8520 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086051 Oct 12 22:15:06.469459 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1696/3857] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:06.483665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ba009d80-bbf0-4865-86ad-f6c46870d72e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:06.485541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ba009d80-bbf0-4865-86ad-f6c46870d72e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:06.509153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba009d80-bbf0-4865-86ad-f6c46870d72e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:06.513328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba009d80-bbf0-4865-86ad-f6c46870d72e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:06.514972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba009d80-bbf0-4865-86ad-f6c46870d72e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:06.520471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba009d80-bbf0-4865-86ad-f6c46870d72e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:06.521473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba009d80-bbf0-4865-86ad-f6c46870d72e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:06.522114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba009d80-bbf0-4865-86ad-f6c46870d72e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:06.668906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4d853500-c3ed-4ebe-b06a-d72c3b680a79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:06.690029 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4d853500-c3ed-4ebe-b06a-d72c3b680a79 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 200 len: 1506 microversion: 2.1 time: 0.579793 Oct 12 22:15:06.691815 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2162/3858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:06 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 1506 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:06.703839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4e814f91-694a-4ec1-9281-4a715701f1cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:06.705036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4e814f91-694a-4ec1-9281-4a715701f1cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:06.719091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e814f91-694a-4ec1-9281-4a715701f1cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:06.723137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e814f91-694a-4ec1-9281-4a715701f1cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:06.723999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e814f91-694a-4ec1-9281-4a715701f1cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:06.725829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e814f91-694a-4ec1-9281-4a715701f1cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:06.730287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e814f91-694a-4ec1-9281-4a715701f1cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:06.731191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e814f91-694a-4ec1-9281-4a715701f1cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:07.036233 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba009d80-bbf0-4865-86ad-f6c46870d72e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:07.051938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba009d80-bbf0-4865-86ad-f6c46870d72e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:07.062690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba009d80-bbf0-4865-86ad-f6c46870d72e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:07.063949 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ba009d80-bbf0-4865-86ad-f6c46870d72e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1892 microversion: 2.32 time: 0.592762 Oct 12 22:15:07.075274 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1697/3859] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:06 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1892 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:07.086217 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-91e86725-23d5-4f04-8096-86f864440c93 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:07.086217 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-91e86725-23d5-4f04-8096-86f864440c93 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:07.090127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91e86725-23d5-4f04-8096-86f864440c93 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:07.090625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91e86725-23d5-4f04-8096-86f864440c93 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:07.091058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91e86725-23d5-4f04-8096-86f864440c93 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:07.091788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91e86725-23d5-4f04-8096-86f864440c93 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:07.092243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91e86725-23d5-4f04-8096-86f864440c93 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:07.092717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91e86725-23d5-4f04-8096-86f864440c93 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:07.167100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-91e86725-23d5-4f04-8096-86f864440c93 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:15:07.275273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4e814f91-694a-4ec1-9281-4a715701f1cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:07.282646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:07.302960 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4e814f91-694a-4ec1-9281-4a715701f1cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1324 microversion: 2.1 time: 0.609865 Oct 12 22:15:07.304783 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2163/3860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:06 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1324 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:07.328412 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-91e86725-23d5-4f04-8096-86f864440c93 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 204 len: 0 microversion: 2.1 time: 0.262008 Oct 12 22:15:07.329119 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1698/3861] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:15:07 2022] DELETE /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:15:07.398138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7d2c117e-d919-4901-8df1-3f4d7e1c07d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:07.398939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7d2c117e-d919-4901-8df1-3f4d7e1c07d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:07.410208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d2c117e-d919-4901-8df1-3f4d7e1c07d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:07.410716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d2c117e-d919-4901-8df1-3f4d7e1c07d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:07.411196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d2c117e-d919-4901-8df1-3f4d7e1c07d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:07.418763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d2c117e-d919-4901-8df1-3f4d7e1c07d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:07.419322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d2c117e-d919-4901-8df1-3f4d7e1c07d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:07.420178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d2c117e-d919-4901-8df1-3f4d7e1c07d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:07.556046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1513240875", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "c7dc26d4-2a62-4792-b299-a59c618c0313"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:07.577630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:07.637571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7d2c117e-d919-4901-8df1-3f4d7e1c07d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:07.658287 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7d2c117e-d919-4901-8df1-3f4d7e1c07d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1272 microversion: 2.1 time: 0.265041 Oct 12 22:15:07.661859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] validate_networks() for [('c7dc26d4-2a62-4792-b299-a59c618c0313', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:15:07.663504 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2164/3862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:07 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1272 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:07.742619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-0ea8738b-4055-4a58-89f7-4ab232765e74 req-196f4086-c09c-44df-8d81-af95b10821a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9f061a-d6d4-4590-8e8e-e2891a1a68bd", "name": "network-vif-plugged", "status": "completed", "tag": "b6310d43-1827-49df-94bd-713373426524"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:07.773134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0ea8738b-4055-4a58-89f7-4ab232765e74 req-196f4086-c09c-44df-8d81-af95b10821a1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:07.774552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0ea8738b-4055-4a58-89f7-4ab232765e74 req-196f4086-c09c-44df-8d81-af95b10821a1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:07.775026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0ea8738b-4055-4a58-89f7-4ab232765e74 req-196f4086-c09c-44df-8d81-af95b10821a1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:07.805390 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-0ea8738b-4055-4a58-89f7-4ab232765e74 req-196f4086-c09c-44df-8d81-af95b10821a1 service nova] Creating event network-vif-plugged:b6310d43-1827-49df-94bd-713373426524 for instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd on n-h2-861111-1 Oct 12 22:15:07.812243 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-0ea8738b-4055-4a58-89f7-4ab232765e74 req-196f4086-c09c-44df-8d81-af95b10821a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074344 Oct 12 22:15:07.814897 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2165/3863] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:08.098972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-84479960-9d42-49eb-b218-bcb631ae92da tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:08.102280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-84479960-9d42-49eb-b218-bcb631ae92da tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:08.115928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84479960-9d42-49eb-b218-bcb631ae92da tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:08.116710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84479960-9d42-49eb-b218-bcb631ae92da tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:08.117350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84479960-9d42-49eb-b218-bcb631ae92da tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:08.118385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84479960-9d42-49eb-b218-bcb631ae92da tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:08.119015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84479960-9d42-49eb-b218-bcb631ae92da tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:08.119808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84479960-9d42-49eb-b218-bcb631ae92da tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:09.118515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-84479960-9d42-49eb-b218-bcb631ae92da tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:09.138054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-84479960-9d42-49eb-b218-bcb631ae92da tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:09.145809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-84479960-9d42-49eb-b218-bcb631ae92da tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:09.150210 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-84479960-9d42-49eb-b218-bcb631ae92da tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1892 microversion: 2.32 time: 1.057029 Oct 12 22:15:09.152306 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2166/3864] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:08 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1892 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:09.165048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cea4227c-6191-4983-b41d-16fc422c975c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:09.168390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cea4227c-6191-4983-b41d-16fc422c975c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:09.180464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cea4227c-6191-4983-b41d-16fc422c975c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:09.181665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cea4227c-6191-4983-b41d-16fc422c975c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:09.183885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cea4227c-6191-4983-b41d-16fc422c975c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:09.185959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cea4227c-6191-4983-b41d-16fc422c975c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:09.186711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cea4227c-6191-4983-b41d-16fc422c975c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:09.187652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cea4227c-6191-4983-b41d-16fc422c975c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:09.531488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cea4227c-6191-4983-b41d-16fc422c975c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:09.541181 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cea4227c-6191-4983-b41d-16fc422c975c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1324 microversion: 2.1 time: 0.386281 Oct 12 22:15:09.555646 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2167/3865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:09 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1324 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:09.562352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-134dad3c-13df-4cef-a5ac-ce577cadd86b req-bc875d15-9a00-4630-9a7e-24516be1348f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "tag": "248cb9c1-00e2-425c-b33a-9885e240c15a"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:09.573132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-134dad3c-13df-4cef-a5ac-ce577cadd86b req-bc875d15-9a00-4630-9a7e-24516be1348f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:09.573877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-134dad3c-13df-4cef-a5ac-ce577cadd86b req-bc875d15-9a00-4630-9a7e-24516be1348f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:09.574471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-134dad3c-13df-4cef-a5ac-ce577cadd86b req-bc875d15-9a00-4630-9a7e-24516be1348f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:09.588784 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-134dad3c-13df-4cef-a5ac-ce577cadd86b req-bc875d15-9a00-4630-9a7e-24516be1348f service nova] Creating event network-changed:248cb9c1-00e2-425c-b33a-9885e240c15a for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:15:09.595009 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-134dad3c-13df-4cef-a5ac-ce577cadd86b req-bc875d15-9a00-4630-9a7e-24516be1348f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037791 Oct 12 22:15:09.596190 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2168/3866] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:09.602424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b92734be-5ed3-4541-91f5-4745503cc522 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:09.603483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b92734be-5ed3-4541-91f5-4745503cc522 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:09.610954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b92734be-5ed3-4541-91f5-4745503cc522 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:09.611722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b92734be-5ed3-4541-91f5-4745503cc522 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:09.612326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b92734be-5ed3-4541-91f5-4745503cc522 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:09.613193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b92734be-5ed3-4541-91f5-4745503cc522 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:09.613832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b92734be-5ed3-4541-91f5-4745503cc522 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:09.614418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b92734be-5ed3-4541-91f5-4745503cc522 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:09.877842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b92734be-5ed3-4541-91f5-4745503cc522 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:09.895962 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b92734be-5ed3-4541-91f5-4745503cc522 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1314 microversion: 2.1 time: 0.298356 Oct 12 22:15:09.896864 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2169/3867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:09 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:09.978114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:15:09.979196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:15:09.984493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:15:09.988972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:15:09.989432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:15:10.022098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:10.023722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:10.024386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:10.026248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:10.026998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:10.028891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:10.063231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Getting quotas for project 8adffdfcc17442a88c91f6804787279a. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:15:10.086933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Getting quotas for user 06066387f835419c914fa6bebf0f3411 and project 8adffdfcc17442a88c91f6804787279a. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:15:10.108605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:15:10.109008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:15:10.184322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2825ee9a-b9e8-4808-a403-19d4dbd2cc76 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:10.185689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2825ee9a-b9e8-4808-a403-19d4dbd2cc76 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:10.188793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:10.190737 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-85c30773-5227-42d7-a6a8-d40c29dd3838 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.639945 Oct 12 22:15:10.192015 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1699/3868] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:15:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:15:10.205592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bde26ac4-7515-488e-8c20-f6f873d3c535 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:10.205719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bde26ac4-7515-488e-8c20-f6f873d3c535 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:10.207821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2825ee9a-b9e8-4808-a403-19d4dbd2cc76 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:10.208577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2825ee9a-b9e8-4808-a403-19d4dbd2cc76 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:10.209243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2825ee9a-b9e8-4808-a403-19d4dbd2cc76 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:10.210415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2825ee9a-b9e8-4808-a403-19d4dbd2cc76 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:10.211098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2825ee9a-b9e8-4808-a403-19d4dbd2cc76 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:10.211758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2825ee9a-b9e8-4808-a403-19d4dbd2cc76 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:10.460010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bde26ac4-7515-488e-8c20-f6f873d3c535 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:10.473455 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bde26ac4-7515-488e-8c20-f6f873d3c535 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1218 microversion: 2.1 time: 0.273014 Oct 12 22:15:10.488423 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1700/3869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:10 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1218 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:10.566554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6997e7c9-fed5-49b4-895a-3de3cb37e60b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:10.567176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6997e7c9-fed5-49b4-895a-3de3cb37e60b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:10.582907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6997e7c9-fed5-49b4-895a-3de3cb37e60b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:10.583593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6997e7c9-fed5-49b4-895a-3de3cb37e60b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:10.584082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6997e7c9-fed5-49b4-895a-3de3cb37e60b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:10.585069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6997e7c9-fed5-49b4-895a-3de3cb37e60b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:10.585527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6997e7c9-fed5-49b4-895a-3de3cb37e60b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:10.586027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6997e7c9-fed5-49b4-895a-3de3cb37e60b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:10.627461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2825ee9a-b9e8-4808-a403-19d4dbd2cc76 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:10.644927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2825ee9a-b9e8-4808-a403-19d4dbd2cc76 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:10.650333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2825ee9a-b9e8-4808-a403-19d4dbd2cc76 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:10.655701 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2825ee9a-b9e8-4808-a403-19d4dbd2cc76 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.473677 Oct 12 22:15:10.657958 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2170/3870] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:10 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:15:11.011101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-29c2c076-4ac2-4809-957f-6170db834c64 req-9bc4b246-9b8c-4b0e-9878-44006d7b48f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "tag": "36ee1470-0e2f-4c4f-8e19-2e2a700d74d0"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:11.016376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:11.037576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-29c2c076-4ac2-4809-957f-6170db834c64 req-9bc4b246-9b8c-4b0e-9878-44006d7b48f5 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:11.038081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-29c2c076-4ac2-4809-957f-6170db834c64 req-9bc4b246-9b8c-4b0e-9878-44006d7b48f5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:11.067970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-29c2c076-4ac2-4809-957f-6170db834c64 req-9bc4b246-9b8c-4b0e-9878-44006d7b48f5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:11.110081 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-29c2c076-4ac2-4809-957f-6170db834c64 req-9bc4b246-9b8c-4b0e-9878-44006d7b48f5 service nova] Creating event network-changed:36ee1470-0e2f-4c4f-8e19-2e2a700d74d0 for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:15:11.125149 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-29c2c076-4ac2-4809-957f-6170db834c64 req-9bc4b246-9b8c-4b0e-9878-44006d7b48f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.402203 Oct 12 22:15:11.129511 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2171/3871] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:11.143851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c77985c8-5438-446a-93eb-54caecae3f2d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:11.144872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c77985c8-5438-446a-93eb-54caecae3f2d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:11.155829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c77985c8-5438-446a-93eb-54caecae3f2d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:11.156793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c77985c8-5438-446a-93eb-54caecae3f2d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:11.157445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c77985c8-5438-446a-93eb-54caecae3f2d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:11.158562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c77985c8-5438-446a-93eb-54caecae3f2d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:11.159338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c77985c8-5438-446a-93eb-54caecae3f2d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:11.159991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c77985c8-5438-446a-93eb-54caecae3f2d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:11.393741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c77985c8-5438-446a-93eb-54caecae3f2d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:11.403679 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c77985c8-5438-446a-93eb-54caecae3f2d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1314 microversion: 2.1 time: 0.271231 Oct 12 22:15:11.405582 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2172/3872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:11 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:11.501165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f4f91cab-0d21-4a3b-8981-fc402818593f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:11.501801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f4f91cab-0d21-4a3b-8981-fc402818593f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:11.516800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4f91cab-0d21-4a3b-8981-fc402818593f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:11.517242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4f91cab-0d21-4a3b-8981-fc402818593f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:11.517688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4f91cab-0d21-4a3b-8981-fc402818593f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:11.518414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4f91cab-0d21-4a3b-8981-fc402818593f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:11.518874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4f91cab-0d21-4a3b-8981-fc402818593f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:11.525174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4f91cab-0d21-4a3b-8981-fc402818593f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:11.603548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=60 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:11.681068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f4f91cab-0d21-4a3b-8981-fc402818593f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:11.694783 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f4f91cab-0d21-4a3b-8981-fc402818593f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1270 microversion: 2.1 time: 0.197932 Oct 12 22:15:11.696070 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2173/3873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:11 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1270 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:11.708765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2ef78406-c42f-40fe-9d44-eff9a93fa231 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:11.709651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2ef78406-c42f-40fe-9d44-eff9a93fa231 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:11.724056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ef78406-c42f-40fe-9d44-eff9a93fa231 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:11.724811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ef78406-c42f-40fe-9d44-eff9a93fa231 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:11.725452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ef78406-c42f-40fe-9d44-eff9a93fa231 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:11.726340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ef78406-c42f-40fe-9d44-eff9a93fa231 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:11.726970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ef78406-c42f-40fe-9d44-eff9a93fa231 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:11.727593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ef78406-c42f-40fe-9d44-eff9a93fa231 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:11.917350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6997e7c9-fed5-49b4-895a-3de3cb37e60b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:11.926945 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6997e7c9-fed5-49b4-895a-3de3cb37e60b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1521 microversion: 2.1 time: 1.364181 Oct 12 22:15:11.946946 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1701/3874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:10 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1521 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:11.963892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cdd0b742-6faf-4031-8216-c4e45fc83606 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:11.964739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cdd0b742-6faf-4031-8216-c4e45fc83606 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:11.977460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdd0b742-6faf-4031-8216-c4e45fc83606 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:11.978180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdd0b742-6faf-4031-8216-c4e45fc83606 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:11.978937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdd0b742-6faf-4031-8216-c4e45fc83606 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:11.992376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdd0b742-6faf-4031-8216-c4e45fc83606 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:11.993182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdd0b742-6faf-4031-8216-c4e45fc83606 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:11.993818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdd0b742-6faf-4031-8216-c4e45fc83606 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:12.242037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2ef78406-c42f-40fe-9d44-eff9a93fa231 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:12.256717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2ef78406-c42f-40fe-9d44-eff9a93fa231 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:12.259264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2ef78406-c42f-40fe-9d44-eff9a93fa231 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:12.260821 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2ef78406-c42f-40fe-9d44-eff9a93fa231 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.562766 Oct 12 22:15:12.262243 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2174/3875] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:11 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:12.353377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-e9990119-9187-4f56-8075-ce8f51189be2 req-74177501-1273-443e-99aa-fa8535ebcc40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5691e2-2981-42cf-ae67-ba70d4131f23", "name": "network-vif-deleted", "tag": "54710401-b13b-48ce-8096-4284cea6423f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:12.393526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e9990119-9187-4f56-8075-ce8f51189be2 req-74177501-1273-443e-99aa-fa8535ebcc40 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:12.394735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e9990119-9187-4f56-8075-ce8f51189be2 req-74177501-1273-443e-99aa-fa8535ebcc40 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:12.398690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e9990119-9187-4f56-8075-ce8f51189be2 req-74177501-1273-443e-99aa-fa8535ebcc40 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:12.423562 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-e9990119-9187-4f56-8075-ce8f51189be2 req-74177501-1273-443e-99aa-fa8535ebcc40 service nova] Creating event network-vif-deleted:54710401-b13b-48ce-8096-4284cea6423f for instance bd5691e2-2981-42cf-ae67-ba70d4131f23 on n-h1-861111-1 Oct 12 22:15:12.456255 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-e9990119-9187-4f56-8075-ce8f51189be2 req-74177501-1273-443e-99aa-fa8535ebcc40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106374 Oct 12 22:15:12.463333 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2175/3876] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:15:12.482280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f22ea200-7686-42c3-9e33-32e0dd922d49 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:12.483421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f22ea200-7686-42c3-9e33-32e0dd922d49 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:12.505569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f22ea200-7686-42c3-9e33-32e0dd922d49 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:12.506494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f22ea200-7686-42c3-9e33-32e0dd922d49 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:12.507811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f22ea200-7686-42c3-9e33-32e0dd922d49 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:12.512019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f22ea200-7686-42c3-9e33-32e0dd922d49 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:12.512587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f22ea200-7686-42c3-9e33-32e0dd922d49 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:12.513097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f22ea200-7686-42c3-9e33-32e0dd922d49 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:12.711273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f22ea200-7686-42c3-9e33-32e0dd922d49 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:12.728389 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f22ea200-7686-42c3-9e33-32e0dd922d49 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1314 microversion: 2.1 time: 0.261187 Oct 12 22:15:12.729567 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2176/3877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:12 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:12.735646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-78c38065-9f57-48df-9640-932f47ad04d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:12.736630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-78c38065-9f57-48df-9640-932f47ad04d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:12.749327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c38065-9f57-48df-9640-932f47ad04d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:12.749999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c38065-9f57-48df-9640-932f47ad04d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:12.772292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c38065-9f57-48df-9640-932f47ad04d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:12.773491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c38065-9f57-48df-9640-932f47ad04d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:12.773803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c38065-9f57-48df-9640-932f47ad04d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:12.774225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c38065-9f57-48df-9640-932f47ad04d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:12.880565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-78c38065-9f57-48df-9640-932f47ad04d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:12.888635 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-78c38065-9f57-48df-9640-932f47ad04d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1276 microversion: 2.1 time: 0.157568 Oct 12 22:15:12.889261 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2177/3878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:12 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:12.890284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cdd0b742-6faf-4031-8216-c4e45fc83606 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:12.899818 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cdd0b742-6faf-4031-8216-c4e45fc83606 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1521 microversion: 2.1 time: 0.944093 Oct 12 22:15:12.901124 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1702/3879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:11 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1521 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:15:12.923925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-628c0f76-e21f-4eed-8f4e-2268fac91ec7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-22502747"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:12.926454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-628c0f76-e21f-4eed-8f4e-2268fac91ec7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:12.933621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-628c0f76-e21f-4eed-8f4e-2268fac91ec7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:12.934125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-628c0f76-e21f-4eed-8f4e-2268fac91ec7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:12.934561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-628c0f76-e21f-4eed-8f4e-2268fac91ec7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:12.935363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-628c0f76-e21f-4eed-8f4e-2268fac91ec7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:12.936113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-628c0f76-e21f-4eed-8f4e-2268fac91ec7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:12.936540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-628c0f76-e21f-4eed-8f4e-2268fac91ec7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:13.176334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-2401153a-478d-44d4-8f8d-5d65c7105c79 req-d222b783-78b9-449f-a47e-d5b99166a975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "tag": "dfea1e40-7a7f-4c90-a02f-bdc09fd3cd9c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:13.229696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2401153a-478d-44d4-8f8d-5d65c7105c79 req-d222b783-78b9-449f-a47e-d5b99166a975 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:13.231055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2401153a-478d-44d4-8f8d-5d65c7105c79 req-d222b783-78b9-449f-a47e-d5b99166a975 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:13.231747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2401153a-478d-44d4-8f8d-5d65c7105c79 req-d222b783-78b9-449f-a47e-d5b99166a975 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:13.266176 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-2401153a-478d-44d4-8f8d-5d65c7105c79 req-d222b783-78b9-449f-a47e-d5b99166a975 service nova] Creating event network-changed:dfea1e40-7a7f-4c90-a02f-bdc09fd3cd9c for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:15:13.282399 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-628c0f76-e21f-4eed-8f4e-2268fac91ec7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "POST /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd/action" status: 202 len: 0 microversion: 2.1 time: 0.362690 Oct 12 22:15:13.286464 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2178/3880] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:15:12 2022] POST /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:15:13.292944 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-2401153a-478d-44d4-8f8d-5d65c7105c79 req-d222b783-78b9-449f-a47e-d5b99166a975 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127363 Oct 12 22:15:13.296899 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1703/3881] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 12 22:15:13.304021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8855f0f3-31e0-4c09-9b2e-f441eb9b8649 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '.version_select at 0x7f51233d3040>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:13.312538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9441c056-bb35-4d06-9a2f-1cbe1d22e087 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:13.314656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9441c056-bb35-4d06-9a2f-1cbe1d22e087 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:13.327446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9441c056-bb35-4d06-9a2f-1cbe1d22e087 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:13.327778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9441c056-bb35-4d06-9a2f-1cbe1d22e087 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:13.328215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9441c056-bb35-4d06-9a2f-1cbe1d22e087 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:13.328909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9441c056-bb35-4d06-9a2f-1cbe1d22e087 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:13.335361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9441c056-bb35-4d06-9a2f-1cbe1d22e087 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:13.336281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9441c056-bb35-4d06-9a2f-1cbe1d22e087 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:13.606157 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8855f0f3-31e0-4c09-9b2e-f441eb9b8649 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "DELETE /compute/v2.1/images/d6037a57-c73a-4c58-8a57-7b87f3ff2f07" status: 204 len: 0 microversion: 2.1 time: 0.305554 Oct 12 22:15:13.606815 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1704/3882] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:13 2022] DELETE /compute/v2.1/images/d6037a57-c73a-4c58-8a57-7b87f3ff2f07 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:15:13.616461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-26347dee-bb9a-495d-857f-141f50fba60c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '.version_select at 0x7f5123401310>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:13.657111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9441c056-bb35-4d06-9a2f-1cbe1d22e087 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:13.657673 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-26347dee-bb9a-495d-857f-141f50fba60c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] HTTP exception thrown: Image not found. Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-26347dee-bb9a-495d-857f-141f50fba60c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Request method failure captured: Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/images/d6037a57-c73a-4c58-8a57-7b87f3ff2f07 HTTP/1.1 Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzwglINEGlDOr9BocY5wO9Xx43qqChsjlqD9r61HmaIIEL6djOCkMBDTPWahASzdxBY-IxGgwHeVTq3saYQxSiCfGBziJflEANUhDnl0qNNSNbnWdyn825Mt-A7NcL8fanNSlgyJCBOxpmZTnNkYN5hmKUrlCsq_TM6iJjMlS6r6Deg Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a107edadb364defb4f2c408969c097c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a107edadb364defb4f2c408969c097c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: a2c263e74d274bef8094b9d7ecfc820b Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: exception: Image not found. Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'd6037a57-c73a-4c58-8a57-7b87f3ff2f07'} Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d6037a57-c73a-4c58-8a57-7b87f3ff2f07 Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:15:13.659308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d6037a57-c73a-4c58-8a57-7b87f3ff2f07 could not be found. Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-26347dee-bb9a-495d-857f-141f50fba60c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Returning 404 to user: Image not found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-26347dee-bb9a-495d-857f-141f50fba60c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/images/d6037a57-c73a-4c58-8a57-7b87f3ff2f07" status: 404 len: 62 microversion: 2.1 time: 0.049099 Oct 12 22:15:13.665822 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1705/3883] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 12 22:15:13 2022] GET /compute/v2.1/images/d6037a57-c73a-4c58-8a57-7b87f3ff2f07 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 12 22:15:13.674501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9441c056-bb35-4d06-9a2f-1cbe1d22e087 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:13.675929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9441c056-bb35-4d06-9a2f-1cbe1d22e087 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:13.676469 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9441c056-bb35-4d06-9a2f-1cbe1d22e087 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.385731 Oct 12 22:15:13.677054 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2179/3884] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:13 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:13.678019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-32ffc8ad-aa95-40b2-b76a-767ab1897c72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:13.684431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-32ffc8ad-aa95-40b2-b76a-767ab1897c72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:13.701455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32ffc8ad-aa95-40b2-b76a-767ab1897c72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:13.702093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32ffc8ad-aa95-40b2-b76a-767ab1897c72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:13.702446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32ffc8ad-aa95-40b2-b76a-767ab1897c72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:13.703173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32ffc8ad-aa95-40b2-b76a-767ab1897c72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:13.703694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32ffc8ad-aa95-40b2-b76a-767ab1897c72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:13.704108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32ffc8ad-aa95-40b2-b76a-767ab1897c72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:13.759291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f5a1a463-81c0-4494-b558-263ee917efe3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:13.759291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f5a1a463-81c0-4494-b558-263ee917efe3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:13.766080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5a1a463-81c0-4494-b558-263ee917efe3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:13.766940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5a1a463-81c0-4494-b558-263ee917efe3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:13.767848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5a1a463-81c0-4494-b558-263ee917efe3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:13.769060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5a1a463-81c0-4494-b558-263ee917efe3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:13.769765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5a1a463-81c0-4494-b558-263ee917efe3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:13.770412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5a1a463-81c0-4494-b558-263ee917efe3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:13.973761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f5a1a463-81c0-4494-b558-263ee917efe3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:13.982158 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f5a1a463-81c0-4494-b558-263ee917efe3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1314 microversion: 2.1 time: 0.231714 Oct 12 22:15:13.984141 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2180/3885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:13 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:15:13.990377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4e17f39a-a3a4-44df-93a1-6394d9a9b37b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:13.991313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4e17f39a-a3a4-44df-93a1-6394d9a9b37b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:13.997663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e17f39a-a3a4-44df-93a1-6394d9a9b37b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:13.998492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e17f39a-a3a4-44df-93a1-6394d9a9b37b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:13.999327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e17f39a-a3a4-44df-93a1-6394d9a9b37b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:14.000419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e17f39a-a3a4-44df-93a1-6394d9a9b37b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:14.001105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e17f39a-a3a4-44df-93a1-6394d9a9b37b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:14.001761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e17f39a-a3a4-44df-93a1-6394d9a9b37b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:14.125937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4e17f39a-a3a4-44df-93a1-6394d9a9b37b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:14.128764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:14.137332 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4e17f39a-a3a4-44df-93a1-6394d9a9b37b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1276 microversion: 2.1 time: 0.151397 Oct 12 22:15:14.143974 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2181/3886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:13 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:14.579315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-32ffc8ad-aa95-40b2-b76a-767ab1897c72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:14.589320 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-32ffc8ad-aa95-40b2-b76a-767ab1897c72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1533 microversion: 2.1 time: 0.923730 Oct 12 22:15:14.590068 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1706/3887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:13 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1533 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:14.710181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7cefffcb-78c0-41aa-80ea-da0c2db10e77 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:14.710811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7cefffcb-78c0-41aa-80ea-da0c2db10e77 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:14.723935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cefffcb-78c0-41aa-80ea-da0c2db10e77 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:14.725171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cefffcb-78c0-41aa-80ea-da0c2db10e77 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:14.726038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cefffcb-78c0-41aa-80ea-da0c2db10e77 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:14.727581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cefffcb-78c0-41aa-80ea-da0c2db10e77 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:14.728736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cefffcb-78c0-41aa-80ea-da0c2db10e77 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:14.729485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cefffcb-78c0-41aa-80ea-da0c2db10e77 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:15.022312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a8bd7ac0-f4d5-4923-a024-533b3fa88641 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:15.023292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a8bd7ac0-f4d5-4923-a024-533b3fa88641 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:15.065591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8bd7ac0-f4d5-4923-a024-533b3fa88641 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:15.066143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8bd7ac0-f4d5-4923-a024-533b3fa88641 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:15.066588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8bd7ac0-f4d5-4923-a024-533b3fa88641 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:15.067316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8bd7ac0-f4d5-4923-a024-533b3fa88641 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:15.067772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8bd7ac0-f4d5-4923-a024-533b3fa88641 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:15.068195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8bd7ac0-f4d5-4923-a024-533b3fa88641 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:15.361164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7cefffcb-78c0-41aa-80ea-da0c2db10e77 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:15.373735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7cefffcb-78c0-41aa-80ea-da0c2db10e77 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:15.375599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7cefffcb-78c0-41aa-80ea-da0c2db10e77 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:15.377147 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7cefffcb-78c0-41aa-80ea-da0c2db10e77 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.676163 Oct 12 22:15:15.379230 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2182/3888] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:14 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:15:15.385633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-97edb54a-6738-4a40-936d-380af27f54b4 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:15.386858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-97edb54a-6738-4a40-936d-380af27f54b4 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:15.394983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97edb54a-6738-4a40-936d-380af27f54b4 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:15.395728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97edb54a-6738-4a40-936d-380af27f54b4 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:15.398740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97edb54a-6738-4a40-936d-380af27f54b4 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:15.398740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97edb54a-6738-4a40-936d-380af27f54b4 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:15.398740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97edb54a-6738-4a40-936d-380af27f54b4 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:15.398740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97edb54a-6738-4a40-936d-380af27f54b4 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:15.506480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-97edb54a-6738-4a40-936d-380af27f54b4 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:15.514810 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-97edb54a-6738-4a40-936d-380af27f54b4 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1276 microversion: 2.1 time: 0.133692 Oct 12 22:15:15.518646 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2183/3889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:15 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:15.613165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-759458c6-fb2c-4107-ac51-8e7270ca6639 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:15.614223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-759458c6-fb2c-4107-ac51-8e7270ca6639 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:15.620900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-759458c6-fb2c-4107-ac51-8e7270ca6639 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:15.621925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-759458c6-fb2c-4107-ac51-8e7270ca6639 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:15.622565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-759458c6-fb2c-4107-ac51-8e7270ca6639 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:15.624067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-759458c6-fb2c-4107-ac51-8e7270ca6639 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:15.624736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-759458c6-fb2c-4107-ac51-8e7270ca6639 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:15.625621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-759458c6-fb2c-4107-ac51-8e7270ca6639 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:15.920840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-759458c6-fb2c-4107-ac51-8e7270ca6639 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:15.929730 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-759458c6-fb2c-4107-ac51-8e7270ca6639 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1539 microversion: 2.1 time: 0.321656 Oct 12 22:15:15.947642 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2184/3890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:15 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1539 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:15:15.953929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d9d845e9-9219-43db-b209-ee7f63660ea2 req-f3890939-28f7-4b01-ab2a-f58f35157f71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23d18a30-56c9-4666-bb85-83c8a6c0c82c", "tag": "d3cc0f7a-bbaa-4c36-8dfc-43f33a6b0f5b"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:15.965740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d9d845e9-9219-43db-b209-ee7f63660ea2 req-f3890939-28f7-4b01-ab2a-f58f35157f71 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:15.966508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d9d845e9-9219-43db-b209-ee7f63660ea2 req-f3890939-28f7-4b01-ab2a-f58f35157f71 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:15.967661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d9d845e9-9219-43db-b209-ee7f63660ea2 req-f3890939-28f7-4b01-ab2a-f58f35157f71 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:15.979686 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d9d845e9-9219-43db-b209-ee7f63660ea2 req-f3890939-28f7-4b01-ab2a-f58f35157f71 service nova] Creating event network-changed:d3cc0f7a-bbaa-4c36-8dfc-43f33a6b0f5b for instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c on n-h2-861111-1 Oct 12 22:15:15.986403 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d9d845e9-9219-43db-b209-ee7f63660ea2 req-f3890939-28f7-4b01-ab2a-f58f35157f71 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037215 Oct 12 22:15:15.987009 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2185/3891] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:16.079603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a8bd7ac0-f4d5-4923-a024-533b3fa88641 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:16.091313 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a8bd7ac0-f4d5-4923-a024-533b3fa88641 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1314 microversion: 2.1 time: 1.088854 Oct 12 22:15:16.093016 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1707/3892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:15 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1314 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:16.413816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-108c5f14-7c84-4874-b4d3-bd1ec0a44ed5 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:16.414752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-108c5f14-7c84-4874-b4d3-bd1ec0a44ed5 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:16.422813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-108c5f14-7c84-4874-b4d3-bd1ec0a44ed5 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:16.423704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-108c5f14-7c84-4874-b4d3-bd1ec0a44ed5 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:16.424318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-108c5f14-7c84-4874-b4d3-bd1ec0a44ed5 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:16.430209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-108c5f14-7c84-4874-b4d3-bd1ec0a44ed5 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:16.431039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-108c5f14-7c84-4874-b4d3-bd1ec0a44ed5 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:16.431915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-108c5f14-7c84-4874-b4d3-bd1ec0a44ed5 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:16.551344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-72423f37-297c-412a-a283-db5ffd42a6ed tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:16.552637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-72423f37-297c-412a-a283-db5ffd42a6ed tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:16.567888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72423f37-297c-412a-a283-db5ffd42a6ed tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:16.568588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72423f37-297c-412a-a283-db5ffd42a6ed tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:16.569127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72423f37-297c-412a-a283-db5ffd42a6ed tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:16.570398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72423f37-297c-412a-a283-db5ffd42a6ed tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:16.572489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72423f37-297c-412a-a283-db5ffd42a6ed tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:16.573221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72423f37-297c-412a-a283-db5ffd42a6ed tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:16.827042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-108c5f14-7c84-4874-b4d3-bd1ec0a44ed5 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:16.845321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-108c5f14-7c84-4874-b4d3-bd1ec0a44ed5 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:16.847463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-108c5f14-7c84-4874-b4d3-bd1ec0a44ed5 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:16.849251 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-108c5f14-7c84-4874-b4d3-bd1ec0a44ed5 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.442667 Oct 12 22:15:16.849909 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2186/3893] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:16 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:16.960849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ffa9ab9d-0804-48e2-b214-dd7d46724132 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:16.963633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ffa9ab9d-0804-48e2-b214-dd7d46724132 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:17.020632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffa9ab9d-0804-48e2-b214-dd7d46724132 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:17.022015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffa9ab9d-0804-48e2-b214-dd7d46724132 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:17.024840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffa9ab9d-0804-48e2-b214-dd7d46724132 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:17.030118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffa9ab9d-0804-48e2-b214-dd7d46724132 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:17.032196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffa9ab9d-0804-48e2-b214-dd7d46724132 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:17.034239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffa9ab9d-0804-48e2-b214-dd7d46724132 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:17.363122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ffa9ab9d-0804-48e2-b214-dd7d46724132 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:17.378720 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ffa9ab9d-0804-48e2-b214-dd7d46724132 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1539 microversion: 2.1 time: 0.427358 Oct 12 22:15:17.391265 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2187/3894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:16 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1539 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:15:17.391265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02314f26-f74d-44ef-ac9e-7ec2bbf2a9b5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:17.391265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-02314f26-f74d-44ef-ac9e-7ec2bbf2a9b5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:17.392611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02314f26-f74d-44ef-ac9e-7ec2bbf2a9b5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:17.393553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02314f26-f74d-44ef-ac9e-7ec2bbf2a9b5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:17.394249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02314f26-f74d-44ef-ac9e-7ec2bbf2a9b5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:17.395184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02314f26-f74d-44ef-ac9e-7ec2bbf2a9b5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:17.395884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02314f26-f74d-44ef-ac9e-7ec2bbf2a9b5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:17.396531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02314f26-f74d-44ef-ac9e-7ec2bbf2a9b5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:18.045808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-02314f26-f74d-44ef-ac9e-7ec2bbf2a9b5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:18.055396 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-02314f26-f74d-44ef-ac9e-7ec2bbf2a9b5 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1314 microversion: 2.1 time: 0.674435 Oct 12 22:15:18.058866 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2188/3895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:17 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:18.065686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e2ccb8b4-137f-47fc-b74e-fc00dd410a94 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:18.066626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e2ccb8b4-137f-47fc-b74e-fc00dd410a94 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:18.108626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2ccb8b4-137f-47fc-b74e-fc00dd410a94 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:18.109526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2ccb8b4-137f-47fc-b74e-fc00dd410a94 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:18.110086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2ccb8b4-137f-47fc-b74e-fc00dd410a94 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:18.115505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2ccb8b4-137f-47fc-b74e-fc00dd410a94 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:18.116125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2ccb8b4-137f-47fc-b74e-fc00dd410a94 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:18.116933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2ccb8b4-137f-47fc-b74e-fc00dd410a94 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:18.478686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e2ccb8b4-137f-47fc-b74e-fc00dd410a94 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:18.493698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e2ccb8b4-137f-47fc-b74e-fc00dd410a94 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:18.497691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e2ccb8b4-137f-47fc-b74e-fc00dd410a94 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:18.500053 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e2ccb8b4-137f-47fc-b74e-fc00dd410a94 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.439986 Oct 12 22:15:18.501036 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2189/3896] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:18 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:18.542068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9667dcd3-4664-4b7d-bedc-62a398851f42 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:18.546140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9667dcd3-4664-4b7d-bedc-62a398851f42 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:18.560088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9667dcd3-4664-4b7d-bedc-62a398851f42 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:18.560582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9667dcd3-4664-4b7d-bedc-62a398851f42 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:18.561887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9667dcd3-4664-4b7d-bedc-62a398851f42 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:18.562917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9667dcd3-4664-4b7d-bedc-62a398851f42 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:18.563627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9667dcd3-4664-4b7d-bedc-62a398851f42 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:18.564602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9667dcd3-4664-4b7d-bedc-62a398851f42 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:18.689652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-72423f37-297c-412a-a283-db5ffd42a6ed tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:18.708159 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-72423f37-297c-412a-a283-db5ffd42a6ed tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1318 microversion: 2.1 time: 2.170563 Oct 12 22:15:18.710446 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1708/3897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:16 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1318 bytes in 2174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:18.804329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9667dcd3-4664-4b7d-bedc-62a398851f42 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:18.814370 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9667dcd3-4664-4b7d-bedc-62a398851f42 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1539 microversion: 2.1 time: 0.284810 Oct 12 22:15:18.815337 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2190/3898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:18 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1539 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:19.085610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-30913968-2e54-4353-b2be-00e0d72fc6d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:19.086542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-30913968-2e54-4353-b2be-00e0d72fc6d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:19.097521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30913968-2e54-4353-b2be-00e0d72fc6d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:19.101067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30913968-2e54-4353-b2be-00e0d72fc6d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:19.101848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30913968-2e54-4353-b2be-00e0d72fc6d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:19.102718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30913968-2e54-4353-b2be-00e0d72fc6d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:19.103443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30913968-2e54-4353-b2be-00e0d72fc6d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:19.104114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30913968-2e54-4353-b2be-00e0d72fc6d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:19.531428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aff7c5f2-75d8-4aba-a998-8d9cd02b9980 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:19.532056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aff7c5f2-75d8-4aba-a998-8d9cd02b9980 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:19.549584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aff7c5f2-75d8-4aba-a998-8d9cd02b9980 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:19.550982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aff7c5f2-75d8-4aba-a998-8d9cd02b9980 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:19.551479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aff7c5f2-75d8-4aba-a998-8d9cd02b9980 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:19.552202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aff7c5f2-75d8-4aba-a998-8d9cd02b9980 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:19.552665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aff7c5f2-75d8-4aba-a998-8d9cd02b9980 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:19.553210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aff7c5f2-75d8-4aba-a998-8d9cd02b9980 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:19.803967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-30913968-2e54-4353-b2be-00e0d72fc6d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:19.814179 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-30913968-2e54-4353-b2be-00e0d72fc6d8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1314 microversion: 2.1 time: 0.732628 Oct 12 22:15:19.825605 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1709/3899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:19 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1314 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:19.830869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-632960b5-b84a-4fe0-a3c3-cfcdbc4a94ec tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:19.831943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-632960b5-b84a-4fe0-a3c3-cfcdbc4a94ec tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:19.845992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-632960b5-b84a-4fe0-a3c3-cfcdbc4a94ec tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:19.846491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-632960b5-b84a-4fe0-a3c3-cfcdbc4a94ec tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:19.846928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-632960b5-b84a-4fe0-a3c3-cfcdbc4a94ec tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:19.852434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-632960b5-b84a-4fe0-a3c3-cfcdbc4a94ec tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:19.853356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-632960b5-b84a-4fe0-a3c3-cfcdbc4a94ec tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:19.853755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-632960b5-b84a-4fe0-a3c3-cfcdbc4a94ec tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:19.972694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aff7c5f2-75d8-4aba-a998-8d9cd02b9980 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:19.984473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aff7c5f2-75d8-4aba-a998-8d9cd02b9980 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:19.985940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aff7c5f2-75d8-4aba-a998-8d9cd02b9980 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:19.987352 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aff7c5f2-75d8-4aba-a998-8d9cd02b9980 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.459953 Oct 12 22:15:19.988422 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2191/3900] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:19 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:19.993123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c2e9b5a4-03c7-4a7e-aaf0-5aa2ee08c161 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:19.993806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c2e9b5a4-03c7-4a7e-aaf0-5aa2ee08c161 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:19.999947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2e9b5a4-03c7-4a7e-aaf0-5aa2ee08c161 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:20.000435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2e9b5a4-03c7-4a7e-aaf0-5aa2ee08c161 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:20.000877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2e9b5a4-03c7-4a7e-aaf0-5aa2ee08c161 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:20.001672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2e9b5a4-03c7-4a7e-aaf0-5aa2ee08c161 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:20.002135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2e9b5a4-03c7-4a7e-aaf0-5aa2ee08c161 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:20.002570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2e9b5a4-03c7-4a7e-aaf0-5aa2ee08c161 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:20.054179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:20.269826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c2e9b5a4-03c7-4a7e-aaf0-5aa2ee08c161 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:20.281595 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c2e9b5a4-03c7-4a7e-aaf0-5aa2ee08c161 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1534 microversion: 2.1 time: 0.291960 Oct 12 22:15:20.282425 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2192/3901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:19 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1534 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:20.302771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-0456485f-630d-45b9-92b5-db55f5a2d24b req-13fcd4fb-76a1-45e6-b010-3cd0a4dabf2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9f061a-d6d4-4590-8e8e-e2891a1a68bd", "name": "network-vif-plugged", "status": "completed", "tag": "b6310d43-1827-49df-94bd-713373426524"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:20.314437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0456485f-630d-45b9-92b5-db55f5a2d24b req-13fcd4fb-76a1-45e6-b010-3cd0a4dabf2f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:20.315456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0456485f-630d-45b9-92b5-db55f5a2d24b req-13fcd4fb-76a1-45e6-b010-3cd0a4dabf2f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:20.315897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0456485f-630d-45b9-92b5-db55f5a2d24b req-13fcd4fb-76a1-45e6-b010-3cd0a4dabf2f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:20.328660 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-0456485f-630d-45b9-92b5-db55f5a2d24b req-13fcd4fb-76a1-45e6-b010-3cd0a4dabf2f service nova] Creating event network-vif-plugged:b6310d43-1827-49df-94bd-713373426524 for instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd on n-h2-861111-1 Oct 12 22:15:20.335741 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-0456485f-630d-45b9-92b5-db55f5a2d24b req-13fcd4fb-76a1-45e6-b010-3cd0a4dabf2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036516 Oct 12 22:15:20.336660 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2193/3902] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:20.464978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:20.777745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-632960b5-b84a-4fe0-a3c3-cfcdbc4a94ec tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:20.789363 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-632960b5-b84a-4fe0-a3c3-cfcdbc4a94ec tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1318 microversion: 2.1 time: 0.962402 Oct 12 22:15:20.790587 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1710/3903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:19 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1318 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:20.849695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cbbcc03c-0905-46d0-a387-07af8b32ce0f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:20.850916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cbbcc03c-0905-46d0-a387-07af8b32ce0f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:20.859495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbbcc03c-0905-46d0-a387-07af8b32ce0f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:20.859983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbbcc03c-0905-46d0-a387-07af8b32ce0f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:20.860422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbbcc03c-0905-46d0-a387-07af8b32ce0f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:20.861122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbbcc03c-0905-46d0-a387-07af8b32ce0f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:20.861761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbbcc03c-0905-46d0-a387-07af8b32ce0f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:20.862190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbbcc03c-0905-46d0-a387-07af8b32ce0f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:21.018781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3549aa4a-e9da-4aaa-9b98-25f78da72ef4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:21.020357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3549aa4a-e9da-4aaa-9b98-25f78da72ef4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:21.027178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3549aa4a-e9da-4aaa-9b98-25f78da72ef4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:21.028709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3549aa4a-e9da-4aaa-9b98-25f78da72ef4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:21.031639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3549aa4a-e9da-4aaa-9b98-25f78da72ef4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:21.033323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3549aa4a-e9da-4aaa-9b98-25f78da72ef4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:21.034677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3549aa4a-e9da-4aaa-9b98-25f78da72ef4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:21.036296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3549aa4a-e9da-4aaa-9b98-25f78da72ef4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:21.046321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cbbcc03c-0905-46d0-a387-07af8b32ce0f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:21.056708 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cbbcc03c-0905-46d0-a387-07af8b32ce0f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1314 microversion: 2.1 time: 0.211273 Oct 12 22:15:21.074449 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2194/3904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:20 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:21.312228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cded40e1-c15e-4a58-add9-614cfcfd59d9 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:21.313469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cded40e1-c15e-4a58-add9-614cfcfd59d9 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:21.323261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cded40e1-c15e-4a58-add9-614cfcfd59d9 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:21.324608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cded40e1-c15e-4a58-add9-614cfcfd59d9 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:21.326133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cded40e1-c15e-4a58-add9-614cfcfd59d9 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:21.328113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cded40e1-c15e-4a58-add9-614cfcfd59d9 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:21.328847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cded40e1-c15e-4a58-add9-614cfcfd59d9 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:21.329552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cded40e1-c15e-4a58-add9-614cfcfd59d9 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:21.534012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cded40e1-c15e-4a58-add9-614cfcfd59d9 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:21.545745 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cded40e1-c15e-4a58-add9-614cfcfd59d9 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1534 microversion: 2.1 time: 0.237857 Oct 12 22:15:21.547335 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2195/3905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:21 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1534 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:21.796575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3549aa4a-e9da-4aaa-9b98-25f78da72ef4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:21.814024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-67db6379-d3df-4dd3-b1d9-b5ab3d6f2da3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:21.815847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-67db6379-d3df-4dd3-b1d9-b5ab3d6f2da3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:21.816870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3549aa4a-e9da-4aaa-9b98-25f78da72ef4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:21.819124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3549aa4a-e9da-4aaa-9b98-25f78da72ef4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:21.822940 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3549aa4a-e9da-4aaa-9b98-25f78da72ef4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.808676 Oct 12 22:15:21.825058 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1711/3906] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:21 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:15:21.825452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67db6379-d3df-4dd3-b1d9-b5ab3d6f2da3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:21.827131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67db6379-d3df-4dd3-b1d9-b5ab3d6f2da3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:21.828324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67db6379-d3df-4dd3-b1d9-b5ab3d6f2da3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:21.829718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67db6379-d3df-4dd3-b1d9-b5ab3d6f2da3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:21.830664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67db6379-d3df-4dd3-b1d9-b5ab3d6f2da3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:21.832162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67db6379-d3df-4dd3-b1d9-b5ab3d6f2da3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:22.056437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-67db6379-d3df-4dd3-b1d9-b5ab3d6f2da3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:22.084583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dc43a1bd-19c8-403f-acf4-dfa6a4e219fe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:22.085207 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-67db6379-d3df-4dd3-b1d9-b5ab3d6f2da3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1318 microversion: 2.1 time: 0.271731 Oct 12 22:15:22.085835 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2196/3907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:21 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:15:22.087997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dc43a1bd-19c8-403f-acf4-dfa6a4e219fe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:22.097764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc43a1bd-19c8-403f-acf4-dfa6a4e219fe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:22.101273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc43a1bd-19c8-403f-acf4-dfa6a4e219fe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:22.101977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc43a1bd-19c8-403f-acf4-dfa6a4e219fe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:22.104642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc43a1bd-19c8-403f-acf4-dfa6a4e219fe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:22.105984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc43a1bd-19c8-403f-acf4-dfa6a4e219fe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:22.107333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc43a1bd-19c8-403f-acf4-dfa6a4e219fe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:22.376566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5eb8cf4f-8cf8-445b-ac59-3aaaac0aa658 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Action: 'create', calling method: .version_select at 0x7f5122f921f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-424000352", "description": "tempest-description-409940767"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:22.687617 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5eb8cf4f-8cf8-445b-ac59-3aaaac0aa658 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.491007 Oct 12 22:15:22.697152 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2197/3908] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:15:22 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:22.702171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-22de0678-72b8-4e12-a0c2-04af2e2290f7 req-40a0b16a-a7ca-4fd3-b492-adb8600edcd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e7a353-6197-41c1-a105-6ca3ca06f195", "tag": "4d7852af-515a-4d0f-9f75-f01702943902"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:22.718612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-22de0678-72b8-4e12-a0c2-04af2e2290f7 req-40a0b16a-a7ca-4fd3-b492-adb8600edcd3 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:22.720632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-22de0678-72b8-4e12-a0c2-04af2e2290f7 req-40a0b16a-a7ca-4fd3-b492-adb8600edcd3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:22.721613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-22de0678-72b8-4e12-a0c2-04af2e2290f7 req-40a0b16a-a7ca-4fd3-b492-adb8600edcd3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:22.738351 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-22de0678-72b8-4e12-a0c2-04af2e2290f7 req-40a0b16a-a7ca-4fd3-b492-adb8600edcd3 service nova] Creating event network-changed:4d7852af-515a-4d0f-9f75-f01702943902 for instance 84e7a353-6197-41c1-a105-6ca3ca06f195 on n-h1-861111-1 Oct 12 22:15:22.744282 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-22de0678-72b8-4e12-a0c2-04af2e2290f7 req-40a0b16a-a7ca-4fd3-b492-adb8600edcd3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049841 Oct 12 22:15:22.745255 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2198/3909] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:22.753002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dff95d3d-db1a-49bc-9247-859a63243a7f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:22.754580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dff95d3d-db1a-49bc-9247-859a63243a7f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:22.759514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dc43a1bd-19c8-403f-acf4-dfa6a4e219fe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:22.763501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dff95d3d-db1a-49bc-9247-859a63243a7f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:22.765028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dff95d3d-db1a-49bc-9247-859a63243a7f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:22.765775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dff95d3d-db1a-49bc-9247-859a63243a7f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:22.766668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dff95d3d-db1a-49bc-9247-859a63243a7f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:22.767756 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dc43a1bd-19c8-403f-acf4-dfa6a4e219fe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1314 microversion: 2.1 time: 0.688082 Oct 12 22:15:22.768428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dff95d3d-db1a-49bc-9247-859a63243a7f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:22.769250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dff95d3d-db1a-49bc-9247-859a63243a7f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:22.795628 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1712/3910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:22 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:15:22.801143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6820fee8-2af3-4a5e-aba6-d04bb0eadf53 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Action: 'create', calling method: .version_select at 0x7f5123763c10>, body: {"security_group_rule": {"parent_group_id": "9980fc5c-74fb-4246-ba0a-ba30b5141606", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:23.015646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dff95d3d-db1a-49bc-9247-859a63243a7f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:23.036866 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dff95d3d-db1a-49bc-9247-859a63243a7f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1521 microversion: 2.1 time: 0.289631 Oct 12 22:15:23.042568 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2199/3911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:22 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:23.069759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-73274de6-288b-48ee-85dc-f71c46bcffa9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:23.071191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-73274de6-288b-48ee-85dc-f71c46bcffa9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:23.082364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73274de6-288b-48ee-85dc-f71c46bcffa9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:23.083106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73274de6-288b-48ee-85dc-f71c46bcffa9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:23.084024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73274de6-288b-48ee-85dc-f71c46bcffa9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:23.085347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73274de6-288b-48ee-85dc-f71c46bcffa9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:23.086235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73274de6-288b-48ee-85dc-f71c46bcffa9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:23.086956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73274de6-288b-48ee-85dc-f71c46bcffa9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:23.361074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-73274de6-288b-48ee-85dc-f71c46bcffa9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:23.373604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-73274de6-288b-48ee-85dc-f71c46bcffa9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:23.376295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-73274de6-288b-48ee-85dc-f71c46bcffa9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:23.377759 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-73274de6-288b-48ee-85dc-f71c46bcffa9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.332868 Oct 12 22:15:23.391669 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2200/3912] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:23 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:23.395190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-703dafb8-5e6e-4459-9ae5-872644472f91 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:23.396968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-703dafb8-5e6e-4459-9ae5-872644472f91 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:23.408779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-703dafb8-5e6e-4459-9ae5-872644472f91 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:23.411605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-703dafb8-5e6e-4459-9ae5-872644472f91 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:23.414794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-703dafb8-5e6e-4459-9ae5-872644472f91 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:23.415790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-703dafb8-5e6e-4459-9ae5-872644472f91 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:23.416450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-703dafb8-5e6e-4459-9ae5-872644472f91 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:23.420700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-703dafb8-5e6e-4459-9ae5-872644472f91 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:23.452966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:23.485877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-703dafb8-5e6e-4459-9ae5-872644472f91 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:15:23.632552 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-703dafb8-5e6e-4459-9ae5-872644472f91 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 204 len: 0 microversion: 2.1 time: 0.250607 Oct 12 22:15:23.638219 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2201/3913] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:15:23 2022] DELETE /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:15:23.645091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e4430bbb-db02-443d-9f9e-74f4363c65d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:23.646051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e4430bbb-db02-443d-9f9e-74f4363c65d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:23.653264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4430bbb-db02-443d-9f9e-74f4363c65d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:23.654062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4430bbb-db02-443d-9f9e-74f4363c65d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:23.655691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4430bbb-db02-443d-9f9e-74f4363c65d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:23.657957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4430bbb-db02-443d-9f9e-74f4363c65d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:23.658718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4430bbb-db02-443d-9f9e-74f4363c65d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:23.659429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4430bbb-db02-443d-9f9e-74f4363c65d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:23.863374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e4430bbb-db02-443d-9f9e-74f4363c65d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:23.897962 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e4430bbb-db02-443d-9f9e-74f4363c65d1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1318 microversion: 2.1 time: 0.254822 Oct 12 22:15:23.899289 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2202/3914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:23 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:23.916002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2ef1a87c-ceb1-418b-a998-d945b6de8d67 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:23.920567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2ef1a87c-ceb1-418b-a998-d945b6de8d67 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:23.929280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ef1a87c-ceb1-418b-a998-d945b6de8d67 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:23.929879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ef1a87c-ceb1-418b-a998-d945b6de8d67 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:23.930382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ef1a87c-ceb1-418b-a998-d945b6de8d67 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:23.931167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ef1a87c-ceb1-418b-a998-d945b6de8d67 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:23.931983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ef1a87c-ceb1-418b-a998-d945b6de8d67 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:23.932499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ef1a87c-ceb1-418b-a998-d945b6de8d67 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:24.002746 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6820fee8-2af3-4a5e-aba6-d04bb0eadf53 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.205926 Oct 12 22:15:24.003670 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1713/3915] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 12 22:15:22 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:24.009227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e873a633-6f4a-4c19-b868-d33737f9d6dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:24.010072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e873a633-6f4a-4c19-b868-d33737f9d6dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:24.023746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e873a633-6f4a-4c19-b868-d33737f9d6dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:24.024998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e873a633-6f4a-4c19-b868-d33737f9d6dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:24.026155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e873a633-6f4a-4c19-b868-d33737f9d6dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:24.028598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e873a633-6f4a-4c19-b868-d33737f9d6dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:24.030439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e873a633-6f4a-4c19-b868-d33737f9d6dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:24.031721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e873a633-6f4a-4c19-b868-d33737f9d6dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:24.178129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2ef1a87c-ceb1-418b-a998-d945b6de8d67 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:24.190030 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2ef1a87c-ceb1-418b-a998-d945b6de8d67 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1527 microversion: 2.1 time: 0.289673 Oct 12 22:15:24.191121 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2203/3916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:23 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1527 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:24.196460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e54be762-b263-4d13-97cd-fcf67113e8b1 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Action: 'create', calling method: .version_select at 0x7f5123055160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1667143288", "description": "tempest-description-2039150983"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:24.430596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e873a633-6f4a-4c19-b868-d33737f9d6dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:24.440514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:24.449153 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e873a633-6f4a-4c19-b868-d33737f9d6dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1314 microversion: 2.1 time: 0.443988 Oct 12 22:15:24.459834 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1714/3917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:24 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:24.465529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e967c3e4-66f3-4e6b-b685-0a4eb714f115 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:24.466147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e967c3e4-66f3-4e6b-b685-0a4eb714f115 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:24.486520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e967c3e4-66f3-4e6b-b685-0a4eb714f115 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:24.487264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e967c3e4-66f3-4e6b-b685-0a4eb714f115 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:24.490555 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e54be762-b263-4d13-97cd-fcf67113e8b1 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.298110 Oct 12 22:15:24.492251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e967c3e4-66f3-4e6b-b685-0a4eb714f115 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:24.493013 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2204/3918] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:15:24 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:24.493166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e967c3e4-66f3-4e6b-b685-0a4eb714f115 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:24.493728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e967c3e4-66f3-4e6b-b685-0a4eb714f115 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:24.494166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e967c3e4-66f3-4e6b-b685-0a4eb714f115 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:24.506304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-36b78a1d-8e2e-4757-8dfd-e31bf6f3368e tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Action: 'create', calling method: .version_select at 0x7f5122fb6550>, body: {"security_group_rule": {"parent_group_id": "abc0f5b3-257e-4311-bed2-132ff673efb1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:24.790722 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-36b78a1d-8e2e-4757-8dfd-e31bf6f3368e tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.290017 Oct 12 22:15:24.791687 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2205/3919] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 12 22:15:24 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:15:24.805234 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48c85da0-9026-41f8-a0db-ee91b9ee29bf tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Action: 'create', calling method: .version_select at 0x7f5122fe01f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-548474755", "description": "tempest-description-1484622905"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:24.842532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e967c3e4-66f3-4e6b-b685-0a4eb714f115 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:24.854210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e967c3e4-66f3-4e6b-b685-0a4eb714f115 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:24.855828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e967c3e4-66f3-4e6b-b685-0a4eb714f115 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:24.857035 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e967c3e4-66f3-4e6b-b685-0a4eb714f115 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.395899 Oct 12 22:15:24.869969 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1715/3920] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:24 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:24.933009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ceee809e-29c3-40eb-984a-f92329213dea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:24.934753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ceee809e-29c3-40eb-984a-f92329213dea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:24.942346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceee809e-29c3-40eb-984a-f92329213dea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:24.942844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceee809e-29c3-40eb-984a-f92329213dea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:24.943310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceee809e-29c3-40eb-984a-f92329213dea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:24.944021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceee809e-29c3-40eb-984a-f92329213dea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:24.944533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceee809e-29c3-40eb-984a-f92329213dea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:24.944964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceee809e-29c3-40eb-984a-f92329213dea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:25.155265 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-48c85da0-9026-41f8-a0db-ee91b9ee29bf tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.353864 Oct 12 22:15:25.164051 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2206/3921] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:15:24 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:15:25.182791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-73e6400b-f551-48f4-aa0a-f3f9c98ed4f7 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Action: 'create', calling method: .version_select at 0x7f5122f8df70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2033946313", "description": "tempest-description-637693897"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:25.244128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ceee809e-29c3-40eb-984a-f92329213dea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:25.253995 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ceee809e-29c3-40eb-984a-f92329213dea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1318 microversion: 2.1 time: 0.325019 Oct 12 22:15:25.257044 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1716/3922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:24 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:25.287133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c3d308d6-7368-43f1-95ef-5a6d014f8756 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:25.291035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c3d308d6-7368-43f1-95ef-5a6d014f8756 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:25.306213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d308d6-7368-43f1-95ef-5a6d014f8756 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:25.310362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d308d6-7368-43f1-95ef-5a6d014f8756 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:25.311577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d308d6-7368-43f1-95ef-5a6d014f8756 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:25.312424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d308d6-7368-43f1-95ef-5a6d014f8756 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:25.313819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d308d6-7368-43f1-95ef-5a6d014f8756 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:25.315716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d308d6-7368-43f1-95ef-5a6d014f8756 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:25.450321 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-73e6400b-f551-48f4-aa0a-f3f9c98ed4f7 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.284192 Oct 12 22:15:25.451031 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2207/3923] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:15:25 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:25.470048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-58b5571e-59fb-4d20-9837-b022d79ec282 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Action: 'create', calling method: .version_select at 0x7f5122f8daf0>, body: {"security_group_rule": {"parent_group_id": "5cd3ce0c-8262-4ab0-8bba-4a6ac7369d4b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "cc0e675c-0cf0-4b1d-bb3b-db038e081aa6"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:25.942910 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-58b5571e-59fb-4d20-9837-b022d79ec282 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.477351 Oct 12 22:15:25.944182 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2208/3924] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 12 22:15:25 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:25.948986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8c32f2d2-e6c4-48db-b67a-6790610774fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:25.950567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8c32f2d2-e6c4-48db-b67a-6790610774fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:25.963292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c32f2d2-e6c4-48db-b67a-6790610774fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:25.966264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c32f2d2-e6c4-48db-b67a-6790610774fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:25.967002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c32f2d2-e6c4-48db-b67a-6790610774fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:25.967992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c32f2d2-e6c4-48db-b67a-6790610774fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:25.968599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c32f2d2-e6c4-48db-b67a-6790610774fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:25.969173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c32f2d2-e6c4-48db-b67a-6790610774fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:26.167027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8c32f2d2-e6c4-48db-b67a-6790610774fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:26.177450 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8c32f2d2-e6c4-48db-b67a-6790610774fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1314 microversion: 2.1 time: 0.231892 Oct 12 22:15:26.179267 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2209/3925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:25 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:26.196042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6999b887-c8cf-4db1-ac1a-b6b8f0d26883 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:26.197651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6999b887-c8cf-4db1-ac1a-b6b8f0d26883 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:26.210643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6999b887-c8cf-4db1-ac1a-b6b8f0d26883 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:26.211955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6999b887-c8cf-4db1-ac1a-b6b8f0d26883 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:26.212627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6999b887-c8cf-4db1-ac1a-b6b8f0d26883 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:26.213719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6999b887-c8cf-4db1-ac1a-b6b8f0d26883 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:26.214699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6999b887-c8cf-4db1-ac1a-b6b8f0d26883 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:26.215699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6999b887-c8cf-4db1-ac1a-b6b8f0d26883 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:26.423627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c3d308d6-7368-43f1-95ef-5a6d014f8756 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:26.433440 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c3d308d6-7368-43f1-95ef-5a6d014f8756 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1527 microversion: 2.1 time: 1.174215 Oct 12 22:15:26.442580 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1717/3926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:25 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1527 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:26.469034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9366c926-206e-48fc-b568-896eec80787f tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Action: 'create', calling method: .version_select at 0x7f512343d4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1694536136", "description": "tempest-description-520783908"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:26.674338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6999b887-c8cf-4db1-ac1a-b6b8f0d26883 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:26.688497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6999b887-c8cf-4db1-ac1a-b6b8f0d26883 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:26.694198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6999b887-c8cf-4db1-ac1a-b6b8f0d26883 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:26.696919 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6999b887-c8cf-4db1-ac1a-b6b8f0d26883 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.515828 Oct 12 22:15:26.707222 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2210/3927] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:26 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:26.714094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6ca5267a-2bef-4c40-a764-bd2eaf5ec045 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:26.715753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6ca5267a-2bef-4c40-a764-bd2eaf5ec045 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:26.726572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ca5267a-2bef-4c40-a764-bd2eaf5ec045 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:26.727463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ca5267a-2bef-4c40-a764-bd2eaf5ec045 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:26.737564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ca5267a-2bef-4c40-a764-bd2eaf5ec045 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:26.758642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ca5267a-2bef-4c40-a764-bd2eaf5ec045 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:26.767640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ca5267a-2bef-4c40-a764-bd2eaf5ec045 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:26.768527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ca5267a-2bef-4c40-a764-bd2eaf5ec045 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:27.018559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6ca5267a-2bef-4c40-a764-bd2eaf5ec045 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:27.030968 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6ca5267a-2bef-4c40-a764-bd2eaf5ec045 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1318 microversion: 2.1 time: 0.321565 Oct 12 22:15:27.031853 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2211/3928] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:26 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:27.070670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-b3dc0d93-1cd6-4703-b0a1-74aba137463c req-e788369b-db10-4b31-8976-535d2cd27f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d18a30-56c9-4666-bb85-83c8a6c0c82c", "name": "network-vif-plugged", "status": "completed", "tag": "d3cc0f7a-bbaa-4c36-8dfc-43f33a6b0f5b"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:27.088782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b3dc0d93-1cd6-4703-b0a1-74aba137463c req-e788369b-db10-4b31-8976-535d2cd27f69 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:27.090024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b3dc0d93-1cd6-4703-b0a1-74aba137463c req-e788369b-db10-4b31-8976-535d2cd27f69 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:27.092059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b3dc0d93-1cd6-4703-b0a1-74aba137463c req-e788369b-db10-4b31-8976-535d2cd27f69 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:27.132013 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-b3dc0d93-1cd6-4703-b0a1-74aba137463c req-e788369b-db10-4b31-8976-535d2cd27f69 service nova] Creating event network-vif-plugged:d3cc0f7a-bbaa-4c36-8dfc-43f33a6b0f5b for instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c on n-h2-861111-1 Oct 12 22:15:27.157428 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-b3dc0d93-1cd6-4703-b0a1-74aba137463c req-e788369b-db10-4b31-8976-535d2cd27f69 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106483 Oct 12 22:15:27.158378 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2212/3929] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:27.203437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6fd79d77-2890-49dd-87a2-01048e5009fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:27.204106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6fd79d77-2890-49dd-87a2-01048e5009fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:27.219126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fd79d77-2890-49dd-87a2-01048e5009fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:27.219656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fd79d77-2890-49dd-87a2-01048e5009fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:27.240292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fd79d77-2890-49dd-87a2-01048e5009fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:27.241086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fd79d77-2890-49dd-87a2-01048e5009fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:27.241577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fd79d77-2890-49dd-87a2-01048e5009fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:27.242057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fd79d77-2890-49dd-87a2-01048e5009fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:27.490060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6fd79d77-2890-49dd-87a2-01048e5009fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:27.498739 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6fd79d77-2890-49dd-87a2-01048e5009fd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1314 microversion: 2.1 time: 0.300383 Oct 12 22:15:27.515951 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2213/3930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:27 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:15:27.526195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a05ee1ee-08b9-4ce2-84d2-930a37a68634 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:27.526999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a05ee1ee-08b9-4ce2-84d2-930a37a68634 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:27.539183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a05ee1ee-08b9-4ce2-84d2-930a37a68634 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:27.539785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a05ee1ee-08b9-4ce2-84d2-930a37a68634 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:27.540418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a05ee1ee-08b9-4ce2-84d2-930a37a68634 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:27.552359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a05ee1ee-08b9-4ce2-84d2-930a37a68634 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:27.553325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a05ee1ee-08b9-4ce2-84d2-930a37a68634 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:27.553863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a05ee1ee-08b9-4ce2-84d2-930a37a68634 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:27.890312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a05ee1ee-08b9-4ce2-84d2-930a37a68634 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:27.902632 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a05ee1ee-08b9-4ce2-84d2-930a37a68634 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1527 microversion: 2.1 time: 0.384894 Oct 12 22:15:27.903402 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2214/3931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:27 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1527 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:27.908940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7f70e75d-7ebd-4d13-a116-a37186dd24fe tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:27.909855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7f70e75d-7ebd-4d13-a116-a37186dd24fe tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:27.926420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f70e75d-7ebd-4d13-a116-a37186dd24fe tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:27.927570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f70e75d-7ebd-4d13-a116-a37186dd24fe tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:27.928172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f70e75d-7ebd-4d13-a116-a37186dd24fe tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:27.929524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f70e75d-7ebd-4d13-a116-a37186dd24fe tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:27.930445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f70e75d-7ebd-4d13-a116-a37186dd24fe tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:27.931106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f70e75d-7ebd-4d13-a116-a37186dd24fe tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:28.215300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7f70e75d-7ebd-4d13-a116-a37186dd24fe tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:28.229826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7f70e75d-7ebd-4d13-a116-a37186dd24fe tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:28.231927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7f70e75d-7ebd-4d13-a116-a37186dd24fe tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:28.234130 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7f70e75d-7ebd-4d13-a116-a37186dd24fe tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.329208 Oct 12 22:15:28.247923 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2215/3932] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:27 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:28.247923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c06d5179-c8a6-439a-b17f-65091dba57af tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:28.247923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c06d5179-c8a6-439a-b17f-65091dba57af tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:28.255569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c06d5179-c8a6-439a-b17f-65091dba57af tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:28.257138 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9366c926-206e-48fc-b568-896eec80787f tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.813414 Oct 12 22:15:28.257567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c06d5179-c8a6-439a-b17f-65091dba57af tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:28.258097 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1718/3933] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:15:26 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:28.259750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c06d5179-c8a6-439a-b17f-65091dba57af tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:28.263847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c06d5179-c8a6-439a-b17f-65091dba57af tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:28.264854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c06d5179-c8a6-439a-b17f-65091dba57af tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:28.265552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c06d5179-c8a6-439a-b17f-65091dba57af tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:28.270393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9da1a920-9a8c-4d49-ac53-e7243330e454 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Action: 'create', calling method: .version_select at 0x7f51233d3310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-531384291", "description": "tempest-description-1991149606"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:28.489225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c06d5179-c8a6-439a-b17f-65091dba57af tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:28.500061 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c06d5179-c8a6-439a-b17f-65091dba57af tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1318 microversion: 2.1 time: 0.258201 Oct 12 22:15:28.500661 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2216/3934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:28 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:28.522559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b51ddda9-16de-495d-8440-7e2291148a66 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:28.523681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b51ddda9-16de-495d-8440-7e2291148a66 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:28.532799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b51ddda9-16de-495d-8440-7e2291148a66 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:28.533299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b51ddda9-16de-495d-8440-7e2291148a66 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:28.533745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b51ddda9-16de-495d-8440-7e2291148a66 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:28.534603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b51ddda9-16de-495d-8440-7e2291148a66 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:28.535072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b51ddda9-16de-495d-8440-7e2291148a66 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:28.535535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b51ddda9-16de-495d-8440-7e2291148a66 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:28.827613 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9da1a920-9a8c-4d49-ac53-e7243330e454 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.560671 Oct 12 22:15:28.837758 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1719/3935] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:15:28 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:28.839467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b51ddda9-16de-495d-8440-7e2291148a66 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:28.840114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-a8e9d55f-9bf6-4794-93b0-2996f8b3e0a0 req-ba242481-e55c-4340-ab06-c367a90fa732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9f061a-d6d4-4590-8e8e-e2891a1a68bd", "name": "network-vif-deleted", "tag": "b6310d43-1827-49df-94bd-713373426524"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:28.853391 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b51ddda9-16de-495d-8440-7e2291148a66 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1314 microversion: 2.1 time: 0.335095 Oct 12 22:15:28.855721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a8e9d55f-9bf6-4794-93b0-2996f8b3e0a0 req-ba242481-e55c-4340-ab06-c367a90fa732 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:28.855911 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2217/3936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:28 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:28.856772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a8e9d55f-9bf6-4794-93b0-2996f8b3e0a0 req-ba242481-e55c-4340-ab06-c367a90fa732 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:28.857405 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a8e9d55f-9bf6-4794-93b0-2996f8b3e0a0 req-ba242481-e55c-4340-ab06-c367a90fa732 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:28.869825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0f38747b-0b7d-42a2-954e-89a75a90fb87 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Action: 'create', calling method: .version_select at 0x7f5122faf3a0>, body: {"security_group_rule": {"parent_group_id": "a295c57e-af2f-4d28-bf2c-3dc23ae1066e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c0dbf5c9-a8c4-4c4b-9ded-9e7a88b5d80d"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:28.870557 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-a8e9d55f-9bf6-4794-93b0-2996f8b3e0a0 req-ba242481-e55c-4340-ab06-c367a90fa732 service nova] Creating event network-vif-deleted:b6310d43-1827-49df-94bd-713373426524 for instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd on n-h2-861111-1 Oct 12 22:15:28.876543 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-a8e9d55f-9bf6-4794-93b0-2996f8b3e0a0 req-ba242481-e55c-4340-ab06-c367a90fa732 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045606 Oct 12 22:15:28.881166 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1720/3937] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:28.926710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cc8d3b80-c6af-4fbb-9685-388b1daf9b72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:28.927437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cc8d3b80-c6af-4fbb-9685-388b1daf9b72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:28.935879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc8d3b80-c6af-4fbb-9685-388b1daf9b72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:28.936370 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc8d3b80-c6af-4fbb-9685-388b1daf9b72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:28.937092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc8d3b80-c6af-4fbb-9685-388b1daf9b72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:28.937789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc8d3b80-c6af-4fbb-9685-388b1daf9b72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:28.938240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc8d3b80-c6af-4fbb-9685-388b1daf9b72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:28.938850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc8d3b80-c6af-4fbb-9685-388b1daf9b72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:29.014105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc8d3b80-c6af-4fbb-9685-388b1daf9b72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:29.015043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc8d3b80-c6af-4fbb-9685-388b1daf9b72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:29.016961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc8d3b80-c6af-4fbb-9685-388b1daf9b72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:29.018554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-cc8d3b80-c6af-4fbb-9685-388b1daf9b72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lazy-loading 'fault' on Instance uuid ed9f061a-d6d4-4590-8e8e-e2891a1a68bd {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:15:29.150486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cc8d3b80-c6af-4fbb-9685-388b1daf9b72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:29.179144 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cc8d3b80-c6af-4fbb-9685-388b1daf9b72 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 200 len: 1314 microversion: 2.1 time: 0.253454 Oct 12 22:15:29.181057 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1721/3938] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:28 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:15:29.204307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-89f72e51-82d6-4d1e-aab2-f3652deda609 req-6aa019ae-84dc-4172-9bcc-6d08b9150455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9f061a-d6d4-4590-8e8e-e2891a1a68bd", "name": "network-vif-unplugged", "status": "completed", "tag": "b6310d43-1827-49df-94bd-713373426524"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:29.229998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-89f72e51-82d6-4d1e-aab2-f3652deda609 req-6aa019ae-84dc-4172-9bcc-6d08b9150455 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:29.230463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-89f72e51-82d6-4d1e-aab2-f3652deda609 req-6aa019ae-84dc-4172-9bcc-6d08b9150455 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:29.230918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-89f72e51-82d6-4d1e-aab2-f3652deda609 req-6aa019ae-84dc-4172-9bcc-6d08b9150455 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:29.261736 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-89f72e51-82d6-4d1e-aab2-f3652deda609 req-6aa019ae-84dc-4172-9bcc-6d08b9150455 service nova] Creating event network-vif-unplugged:b6310d43-1827-49df-94bd-713373426524 for instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd on n-h2-861111-1 Oct 12 22:15:29.271455 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-89f72e51-82d6-4d1e-aab2-f3652deda609 req-6aa019ae-84dc-4172-9bcc-6d08b9150455 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072996 Oct 12 22:15:29.280087 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1722/3939] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:29.293333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2218ca35-c7cc-442f-b208-ee74e3dd6d32 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:29.297277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2218ca35-c7cc-442f-b208-ee74e3dd6d32 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:29.315329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2218ca35-c7cc-442f-b208-ee74e3dd6d32 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:29.317402 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0f38747b-0b7d-42a2-954e-89a75a90fb87 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.460567 Oct 12 22:15:29.318302 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2218/3940] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 12 22:15:28 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:29.318723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2218ca35-c7cc-442f-b208-ee74e3dd6d32 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:29.319485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2218ca35-c7cc-442f-b208-ee74e3dd6d32 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:29.321047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2218ca35-c7cc-442f-b208-ee74e3dd6d32 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:29.322854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2218ca35-c7cc-442f-b208-ee74e3dd6d32 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:29.324311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2218ca35-c7cc-442f-b208-ee74e3dd6d32 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:29.330524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-20724b81-b517-49ae-b149-1d46fa87a1c3 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Calling method '.version_select at 0x7f5122fb6f70>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:29.699853 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-20724b81-b517-49ae-b149-1d46fa87a1c3 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c0dbf5c9-a8c4-4c4b-9ded-9e7a88b5d80d" status: 202 len: 0 microversion: 2.1 time: 0.373137 Oct 12 22:15:29.703938 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2219/3941] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:15:29 2022] DELETE /compute/v2.1/os-security-groups/c0dbf5c9-a8c4-4c4b-9ded-9e7a88b5d80d => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:15:29.710061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b092ca74-e271-49b1-954d-ea535cdff38d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:29.710691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b092ca74-e271-49b1-954d-ea535cdff38d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:29.720183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2218ca35-c7cc-442f-b208-ee74e3dd6d32 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:29.723974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b092ca74-e271-49b1-954d-ea535cdff38d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:29.724781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b092ca74-e271-49b1-954d-ea535cdff38d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:29.725458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b092ca74-e271-49b1-954d-ea535cdff38d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:29.726391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b092ca74-e271-49b1-954d-ea535cdff38d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:29.727069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b092ca74-e271-49b1-954d-ea535cdff38d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:29.727756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b092ca74-e271-49b1-954d-ea535cdff38d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:29.732422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2218ca35-c7cc-442f-b208-ee74e3dd6d32 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:29.736109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2218ca35-c7cc-442f-b208-ee74e3dd6d32 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:29.737603 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2218ca35-c7cc-442f-b208-ee74e3dd6d32 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.455966 Oct 12 22:15:29.753406 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1723/3942] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:29 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:29.768541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-36169bd1-c5b7-4a93-b9f1-f167ec3eda2a tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Calling method '.version_select at 0x7f51233bec10>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:29.865958 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-36169bd1-c5b7-4a93-b9f1-f167ec3eda2a tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/a295c57e-af2f-4d28-bf2c-3dc23ae1066e" status: 200 len: 247 microversion: 2.1 time: 0.110612 Oct 12 22:15:29.867134 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1724/3943] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 12 22:15:29 2022] GET /compute/v2.1/os-security-groups/a295c57e-af2f-4d28-bf2c-3dc23ae1066e => generated 247 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:29.880366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4f058423-c9e4-41b7-bad0-b48800ca7abc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:29.881273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4f058423-c9e4-41b7-bad0-b48800ca7abc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:29.891906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f058423-c9e4-41b7-bad0-b48800ca7abc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:29.892601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f058423-c9e4-41b7-bad0-b48800ca7abc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:29.893514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f058423-c9e4-41b7-bad0-b48800ca7abc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:29.897100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f058423-c9e4-41b7-bad0-b48800ca7abc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:29.897589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f058423-c9e4-41b7-bad0-b48800ca7abc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:29.898022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f058423-c9e4-41b7-bad0-b48800ca7abc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:29.926831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b092ca74-e271-49b1-954d-ea535cdff38d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:29.935979 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b092ca74-e271-49b1-954d-ea535cdff38d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1318 microversion: 2.1 time: 0.229810 Oct 12 22:15:29.938181 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2220/3944] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:29 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:29.944818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0a82f2fe-2f40-4fbf-bb0c-bddeb0ee7de5 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Action: 'create', calling method: .version_select at 0x7f5123577a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1445922225", "description": "tempest-description-116533805"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:30.199468 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0a82f2fe-2f40-4fbf-bb0c-bddeb0ee7de5 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.259974 Oct 12 22:15:30.200340 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2221/3945] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:15:29 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:30.213937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e8b94d77-cb44-44fb-95b2-8c736f63fc3b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:30.214705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e8b94d77-cb44-44fb-95b2-8c736f63fc3b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:30.221648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8b94d77-cb44-44fb-95b2-8c736f63fc3b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:30.222306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8b94d77-cb44-44fb-95b2-8c736f63fc3b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:30.223116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8b94d77-cb44-44fb-95b2-8c736f63fc3b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:30.224069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8b94d77-cb44-44fb-95b2-8c736f63fc3b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:30.224756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8b94d77-cb44-44fb-95b2-8c736f63fc3b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:30.225514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8b94d77-cb44-44fb-95b2-8c736f63fc3b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:30.242822 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-e8b94d77-cb44-44fb-95b2-8c736f63fc3b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] HTTP exception thrown: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e8b94d77-cb44-44fb-95b2-8c736f63fc3b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Request method failure captured: Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd HTTP/1.1 Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwglINEGlDOr9BocY5wO9Xx43qqChsjlqD9r61HmaIIEL6djOCkMBDTPWahASzdxBY-IxGgwHeVTq3saYQxSiCfGBziJflEANUhDnl0qNNSNbnWdyn825Mt-A7NcL8fanNSlgyJCBOxpmZTnNkYN5hmKUrlCsq_TM6iJjMlS6r6Deg Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a107edadb364defb4f2c408969c097c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a107edadb364defb4f2c408969c097c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a2c263e74d274bef8094b9d7ecfc820b Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'ed9f061a-d6d4-4590-8e8e-e2891a1a68bd'} Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:30.245209 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:30.250757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:30.250757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:30.250757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:30.250757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:30.250757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:15:30.250757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:15:30.250757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. Oct 12 22:15:30.250757 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:30.252721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e8b94d77-cb44-44fb-95b2-8c736f63fc3b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Returning 404 to user: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:15:30.253675 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e8b94d77-cb44-44fb-95b2-8c736f63fc3b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 404 len: 111 microversion: 2.1 time: 0.044236 Oct 12 22:15:30.254337 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2222/3946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:30 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:15:30.264954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4f058423-c9e4-41b7-bad0-b48800ca7abc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:30.268084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0a3ba53e-c321-4a68-a55f-56185dd20447 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Action: 'create', calling method: .version_select at 0x7f5122f8d9d0>, body: {"security_group_rule": {"parent_group_id": "cd44e62c-2046-4083-a259-a0fa401ca671", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:30.279401 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4f058423-c9e4-41b7-bad0-b48800ca7abc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1501 microversion: 2.1 time: 0.403023 Oct 12 22:15:30.291337 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1725/3947] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:29 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1501 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:15:30.304440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6ce109b1-f2a8-4117-8f4f-440dd4c743a3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:30.312398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ce109b1-f2a8-4117-8f4f-440dd4c743a3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:30.313108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ce109b1-f2a8-4117-8f4f-440dd4c743a3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:30.313729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ce109b1-f2a8-4117-8f4f-440dd4c743a3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:30.340265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6ce109b1-f2a8-4117-8f4f-440dd4c743a3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Going to try to stop instance {{(pid=120452) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 22:15:30.387644 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6ce109b1-f2a8-4117-8f4f-440dd4c743a3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "POST /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c/action" status: 202 len: 0 microversion: 2.1 time: 0.086733 Oct 12 22:15:30.393860 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1726/3948] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:15:30 2022] POST /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:15:30.400173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-55c4056b-bfc2-49bd-8cc1-8d832647a2e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:30.401161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-55c4056b-bfc2-49bd-8cc1-8d832647a2e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:30.409587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55c4056b-bfc2-49bd-8cc1-8d832647a2e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:30.410408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55c4056b-bfc2-49bd-8cc1-8d832647a2e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:30.411108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55c4056b-bfc2-49bd-8cc1-8d832647a2e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:30.411840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55c4056b-bfc2-49bd-8cc1-8d832647a2e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:30.412455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55c4056b-bfc2-49bd-8cc1-8d832647a2e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:30.413223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55c4056b-bfc2-49bd-8cc1-8d832647a2e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:30.611134 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0a3ba53e-c321-4a68-a55f-56185dd20447 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.355228 Oct 12 22:15:30.611883 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2223/3949] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 12 22:15:30 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:30.621799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-619081019", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:30.643049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-55c4056b-bfc2-49bd-8cc1-8d832647a2e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:30.655527 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-55c4056b-bfc2-49bd-8cc1-8d832647a2e1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1511 microversion: 2.1 time: 0.259705 Oct 12 22:15:30.658457 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1727/3950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:30 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1511 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:30.665541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b424163-eb47-4f1d-b5c8-8198ef6ffe07 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Action: 'create', calling method: .version_select at 0x7f51233acdc0>, body: {"security_group_rule": {"parent_group_id": "cd44e62c-2046-4083-a259-a0fa401ca671", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:30.693743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] validate_networks() for [('4c7ece18-e66a-43bb-9b96-c723ee75dc53', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:15:30.926786 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6b424163-eb47-4f1d-b5c8-8198ef6ffe07 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.266820 Oct 12 22:15:30.927514 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1728/3951] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 12 22:15:30 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:30.938875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-27b187b4-d49d-4eef-b0ca-744b916191fd tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:30.940539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-27b187b4-d49d-4eef-b0ca-744b916191fd tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:30.948490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27b187b4-d49d-4eef-b0ca-744b916191fd tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:30.949489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27b187b4-d49d-4eef-b0ca-744b916191fd tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:30.950009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27b187b4-d49d-4eef-b0ca-744b916191fd tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:30.950798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27b187b4-d49d-4eef-b0ca-744b916191fd tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:30.951746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27b187b4-d49d-4eef-b0ca-744b916191fd tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:30.952178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27b187b4-d49d-4eef-b0ca-744b916191fd tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:31.169909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-27b187b4-d49d-4eef-b0ca-744b916191fd tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:31.181359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-27b187b4-d49d-4eef-b0ca-744b916191fd tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:31.182850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-27b187b4-d49d-4eef-b0ca-744b916191fd tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:31.187823 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-27b187b4-d49d-4eef-b0ca-744b916191fd tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.259059 Oct 12 22:15:31.188407 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1729/3952] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:30 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:31.188563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:15:31.190491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:15:31.191202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:15:31.191840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:15:31.192321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:15:31.193907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-04bf02a2-3305-4a28-907c-38f7975936e5 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Calling method '.version_select at 0x7f512338b550>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:31.206611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:31.210127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:31.210929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:31.217237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:31.220284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:31.222121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:31.258222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Getting quotas for project 5a107edadb364defb4f2c408969c097c. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:15:31.264741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Getting quotas for user a2c263e74d274bef8094b9d7ecfc820b and project 5a107edadb364defb4f2c408969c097c. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:15:31.269380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:31.284053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:15:31.286854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:15:31.297097 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-04bf02a2-3305-4a28-907c-38f7975936e5 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/cd44e62c-2046-4083-a259-a0fa401ca671" status: 200 len: 664 microversion: 2.1 time: 0.106852 Oct 12 22:15:31.297684 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1730/3953] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 12 22:15:31 2022] GET /compute/v2.1/os-security-groups/cd44e62c-2046-4083-a259-a0fa401ca671 => generated 664 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:31.302910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9bf5145c-4857-4ec1-a250-53466dc86252 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:31.303931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9bf5145c-4857-4ec1-a250-53466dc86252 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:31.312762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bf5145c-4857-4ec1-a250-53466dc86252 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:31.313720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bf5145c-4857-4ec1-a250-53466dc86252 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:31.314317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bf5145c-4857-4ec1-a250-53466dc86252 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:31.315586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bf5145c-4857-4ec1-a250-53466dc86252 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:31.316196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bf5145c-4857-4ec1-a250-53466dc86252 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:31.317131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bf5145c-4857-4ec1-a250-53466dc86252 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:31.357567 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eb444e77-7129-4e69-a250-a82a5e608c3d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.744339 Oct 12 22:15:31.358343 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2224/3954] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:15:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:15:31.372002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7c5d851c-1124-4225-857b-9c9a21d5850a tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Calling method '.version_select at 0x7f5122faf1f0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:31.530098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9bf5145c-4857-4ec1-a250-53466dc86252 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:31.540099 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9bf5145c-4857-4ec1-a250-53466dc86252 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1318 microversion: 2.1 time: 0.239382 Oct 12 22:15:31.540859 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1731/3955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:31 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:31.545434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-f57de1d4-3dc2-4df9-b1f1-3b0f121d44a6 req-09f240d7-bc1d-42cb-a30f-020048985e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e7a353-6197-41c1-a105-6ca3ca06f195", "name": "network-vif-plugged", "status": "completed", "tag": "4d7852af-515a-4d0f-9f75-f01702943902"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:31.556596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f57de1d4-3dc2-4df9-b1f1-3b0f121d44a6 req-09f240d7-bc1d-42cb-a30f-020048985e78 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:31.557070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f57de1d4-3dc2-4df9-b1f1-3b0f121d44a6 req-09f240d7-bc1d-42cb-a30f-020048985e78 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:31.557499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f57de1d4-3dc2-4df9-b1f1-3b0f121d44a6 req-09f240d7-bc1d-42cb-a30f-020048985e78 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:31.571206 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-f57de1d4-3dc2-4df9-b1f1-3b0f121d44a6 req-09f240d7-bc1d-42cb-a30f-020048985e78 service nova] Creating event network-vif-plugged:4d7852af-515a-4d0f-9f75-f01702943902 for instance 84e7a353-6197-41c1-a105-6ca3ca06f195 on n-h1-861111-1 Oct 12 22:15:31.588486 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-f57de1d4-3dc2-4df9-b1f1-3b0f121d44a6 req-09f240d7-bc1d-42cb-a30f-020048985e78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036178 Oct 12 22:15:31.602133 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1732/3956] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:31.617516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7ab6c79e-0c1d-4d88-a76a-83ffd0803831 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:31.618413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7ab6c79e-0c1d-4d88-a76a-83ffd0803831 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:31.667265 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7c5d851c-1124-4225-857b-9c9a21d5850a tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/b137d56f-b1a0-4db3-9818-b436a596dffe" status: 202 len: 0 microversion: 2.1 time: 0.307191 Oct 12 22:15:31.668658 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2225/3957] 10.222.0.16 () {58 vars in 1287 bytes} [Wed Oct 12 22:15:31 2022] DELETE /compute/v2.1/os-security-group-rules/b137d56f-b1a0-4db3-9818-b436a596dffe => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:15:31.683665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fde522b9-4bb3-4434-ae8e-7363f9d322a3 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Calling method '.version_select at 0x7f51230de280>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:31.770203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7ab6c79e-0c1d-4d88-a76a-83ffd0803831 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:31.779535 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7ab6c79e-0c1d-4d88-a76a-83ffd0803831 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 200 len: 1224 microversion: 2.1 time: 0.181748 Oct 12 22:15:31.781270 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1733/3958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:31 2022] GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 1224 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:31.791047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7fef30f0-8542-4889-810a-f9afe203cf2b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:31.792184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7fef30f0-8542-4889-810a-f9afe203cf2b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:31.808772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fef30f0-8542-4889-810a-f9afe203cf2b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:31.810131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fef30f0-8542-4889-810a-f9afe203cf2b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:31.811282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fef30f0-8542-4889-810a-f9afe203cf2b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:31.812250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fef30f0-8542-4889-810a-f9afe203cf2b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:31.812870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fef30f0-8542-4889-810a-f9afe203cf2b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:31.813459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fef30f0-8542-4889-810a-f9afe203cf2b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:31.993584 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fde522b9-4bb3-4434-ae8e-7363f9d322a3 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/cd44e62c-2046-4083-a259-a0fa401ca671" status: 202 len: 0 microversion: 2.1 time: 0.319909 Oct 12 22:15:31.994815 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2226/3959] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:15:31 2022] DELETE /compute/v2.1/os-security-groups/cd44e62c-2046-4083-a259-a0fa401ca671 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:15:31.997698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7fef30f0-8542-4889-810a-f9afe203cf2b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:32.004286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-166c866b-caa3-4559-bbe0-223bc118af0a tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Calling method '.version_select at 0x7f5122f50ca0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:32.009070 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7fef30f0-8542-4889-810a-f9afe203cf2b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1511 microversion: 2.1 time: 0.224778 Oct 12 22:15:32.025180 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1734/3960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:31 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1511 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:32.067834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-166c866b-caa3-4559-bbe0-223bc118af0a tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c0dbf5c9-a8c4-4c4b-9ded-9e7a88b5d80d does not exist", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:15:32.068726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.security_group_api [None req-166c866b-caa3-4559-bbe0-223bc118af0a tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Neutron security group c0dbf5c9-a8c4-4c4b-9ded-9e7a88b5d80d not found {{(pid=120453) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:15:32.069432 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-166c866b-caa3-4559-bbe0-223bc118af0a tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] HTTP exception thrown: Security group c0dbf5c9-a8c4-4c4b-9ded-9e7a88b5d80d does not exist Oct 12 22:15:32.069432 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-83f4def8-8254-43de-845e-f3ba39b12e2f'] Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-166c866b-caa3-4559-bbe0-223bc118af0a tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Request method failure captured: Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/os-security-groups/c0dbf5c9-a8c4-4c4b-9ded-9e7a88b5d80d HTTP/1.1 Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzx6M2zfi8WiIckpmX0x36jWZD-agK0JdRzOeM2dWoETCpyuqEQrkNbsyCQlUWIBAFp5URvqaVHKg-fP9lsFgfVhvc07_8qppWG5rtNV_-cWFyxcX-T2I2VyMs0_3f67AuMTJrJgosQu8k_GRovofcsXkrPy7HOPjjyQuw3sLbp0cj0 Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 99d72cb5a88a410ebea70b94c00ded8e Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1710661622 Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99d72cb5a88a410ebea70b94c00ded8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99d72cb5a88a410ebea70b94c00ded8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_99d72cb5a88a410ebea70b94c00ded8e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/99d72cb5a88a410ebea70b94c00ded8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1710661622 Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 99d72cb5a88a410ebea70b94c00ded8e Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1710661622 Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupRulesTestJSON-1710661622-project Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 67084d3406a04d129ccd8d0dc8d24017 Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1710661622-project Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: exception: Security group c0dbf5c9-a8c4-4c4b-9ded-9e7a88b5d80d does not exist Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-83f4def8-8254-43de-845e-f3ba39b12e2f'] Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'c0dbf5c9-a8c4-4c4b-9ded-9e7a88b5d80d'} Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:15:32.071584 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c0dbf5c9-a8c4-4c4b-9ded-9e7a88b5d80d does not exist Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83f4def8-8254-43de-845e-f3ba39b12e2f'] Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c0dbf5c9-a8c4-4c4b-9ded-9e7a88b5d80d does not exist Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83f4def8-8254-43de-845e-f3ba39b12e2f'] Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c0dbf5c9-a8c4-4c4b-9ded-9e7a88b5d80d does not exist Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83f4def8-8254-43de-845e-f3ba39b12e2f'] Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c0dbf5c9-a8c4-4c4b-9ded-9e7a88b5d80d does not exist Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83f4def8-8254-43de-845e-f3ba39b12e2f'] Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-166c866b-caa3-4559-bbe0-223bc118af0a tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Returning 404 to user: Security group c0dbf5c9-a8c4-4c4b-9ded-9e7a88b5d80d does not exist Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-83f4def8-8254-43de-845e-f3ba39b12e2f'] {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-166c866b-caa3-4559-bbe0-223bc118af0a tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c0dbf5c9-a8c4-4c4b-9ded-9e7a88b5d80d" status: 404 len: 194 microversion: 2.1 time: 0.074182 Oct 12 22:15:32.078928 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2227/3961] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:15:31 2022] DELETE /compute/v2.1/os-security-groups/c0dbf5c9-a8c4-4c4b-9ded-9e7a88b5d80d => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:15:32.087268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e356a0c2-2b20-4352-8a37-40ff61533bdb tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Calling method '.version_select at 0x7f51235bd820>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:32.217651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87c81e74-8506-4fd4-8b91-607fdaeeff7c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:32.220192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-87c81e74-8506-4fd4-8b91-607fdaeeff7c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:32.238240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c81e74-8506-4fd4-8b91-607fdaeeff7c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:32.241045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c81e74-8506-4fd4-8b91-607fdaeeff7c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:32.242139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c81e74-8506-4fd4-8b91-607fdaeeff7c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:32.242991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c81e74-8506-4fd4-8b91-607fdaeeff7c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:32.243348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c81e74-8506-4fd4-8b91-607fdaeeff7c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:32.246082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87c81e74-8506-4fd4-8b91-607fdaeeff7c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:32.350029 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e356a0c2-2b20-4352-8a37-40ff61533bdb tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a295c57e-af2f-4d28-bf2c-3dc23ae1066e" status: 202 len: 0 microversion: 2.1 time: 0.270839 Oct 12 22:15:32.351576 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1735/3962] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:15:32 2022] DELETE /compute/v2.1/os-security-groups/a295c57e-af2f-4d28-bf2c-3dc23ae1066e => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:15:32.361629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-152ca457-791d-48fa-b8b8-910bc37d28fe tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Calling method '.version_select at 0x7f51233b73a0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:32.565359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-87c81e74-8506-4fd4-8b91-607fdaeeff7c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:32.577007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-87c81e74-8506-4fd4-8b91-607fdaeeff7c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:32.578719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-87c81e74-8506-4fd4-8b91-607fdaeeff7c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:32.581132 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-87c81e74-8506-4fd4-8b91-607fdaeeff7c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.370687 Oct 12 22:15:32.581758 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2228/3963] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:32 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:32.599205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-debd27a0-01ba-4945-8c44-6f4271552d97 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:32.602769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-debd27a0-01ba-4945-8c44-6f4271552d97 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:32.619898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-debd27a0-01ba-4945-8c44-6f4271552d97 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:32.620482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-debd27a0-01ba-4945-8c44-6f4271552d97 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:32.621242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-debd27a0-01ba-4945-8c44-6f4271552d97 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:32.622036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-debd27a0-01ba-4945-8c44-6f4271552d97 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:32.622565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-debd27a0-01ba-4945-8c44-6f4271552d97 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:32.623100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-debd27a0-01ba-4945-8c44-6f4271552d97 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:32.743670 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-152ca457-791d-48fa-b8b8-910bc37d28fe tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/cc0e675c-0cf0-4b1d-bb3b-db038e081aa6" status: 202 len: 0 microversion: 2.1 time: 0.385204 Oct 12 22:15:32.744344 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1736/3964] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:15:32 2022] DELETE /compute/v2.1/os-security-groups/cc0e675c-0cf0-4b1d-bb3b-db038e081aa6 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:15:32.752728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9b023731-9afd-45ce-bd99-ff4c2e146d56 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Calling method '.version_select at 0x7f512338b4c0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:32.808521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-debd27a0-01ba-4945-8c44-6f4271552d97 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:32.822404 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-debd27a0-01ba-4945-8c44-6f4271552d97 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1318 microversion: 2.1 time: 0.239088 Oct 12 22:15:32.823152 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2229/3965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:32 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:32.828129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f95c70ee-15b1-452d-8c74-56715042b2cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:32.828992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f95c70ee-15b1-452d-8c74-56715042b2cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:32.844145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f95c70ee-15b1-452d-8c74-56715042b2cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:32.844980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f95c70ee-15b1-452d-8c74-56715042b2cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:32.845761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f95c70ee-15b1-452d-8c74-56715042b2cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:32.846703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f95c70ee-15b1-452d-8c74-56715042b2cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:32.847422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f95c70ee-15b1-452d-8c74-56715042b2cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:32.848049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f95c70ee-15b1-452d-8c74-56715042b2cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:32.895131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:32.968865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f95c70ee-15b1-452d-8c74-56715042b2cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:32.978365 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f95c70ee-15b1-452d-8c74-56715042b2cc tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 200 len: 1276 microversion: 2.1 time: 0.153890 Oct 12 22:15:32.979192 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2230/3966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:32 2022] GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 1276 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:33.016601 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9b023731-9afd-45ce-bd99-ff4c2e146d56 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/5cd3ce0c-8262-4ab0-8bba-4a6ac7369d4b" status: 202 len: 0 microversion: 2.1 time: 0.267880 Oct 12 22:15:33.017593 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1737/3967] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:15:32 2022] DELETE /compute/v2.1/os-security-groups/5cd3ce0c-8262-4ab0-8bba-4a6ac7369d4b => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:15:33.025680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7af4cf46-ccc7-4bf5-81d8-754b50275cab tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Calling method '.version_select at 0x7f5122f8d4c0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:33.036589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c5a6251a-ed14-4ac8-b13f-dbc2c1c68786 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:33.037443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c5a6251a-ed14-4ac8-b13f-dbc2c1c68786 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:33.049213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5a6251a-ed14-4ac8-b13f-dbc2c1c68786 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:33.049984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5a6251a-ed14-4ac8-b13f-dbc2c1c68786 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:33.050435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5a6251a-ed14-4ac8-b13f-dbc2c1c68786 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:33.051586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5a6251a-ed14-4ac8-b13f-dbc2c1c68786 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:33.052091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5a6251a-ed14-4ac8-b13f-dbc2c1c68786 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:33.052917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5a6251a-ed14-4ac8-b13f-dbc2c1c68786 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:33.350692 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7af4cf46-ccc7-4bf5-81d8-754b50275cab tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/abc0f5b3-257e-4311-bed2-132ff673efb1" status: 202 len: 0 microversion: 2.1 time: 0.328775 Oct 12 22:15:33.358584 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2231/3968] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:15:33 2022] DELETE /compute/v2.1/os-security-groups/abc0f5b3-257e-4311-bed2-132ff673efb1 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:15:33.389558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a3976b52-849a-4972-ba24-4a8aef5597f8 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] Calling method '.version_select at 0x7f5122f8d430>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:33.393311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c5a6251a-ed14-4ac8-b13f-dbc2c1c68786 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:33.404744 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c5a6251a-ed14-4ac8-b13f-dbc2c1c68786 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1511 microversion: 2.1 time: 0.373013 Oct 12 22:15:33.407481 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1738/3969] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:33 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1511 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:33.608238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3f3bc32f-e004-4a79-b2cc-8c6e0d3c41e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:33.608912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3f3bc32f-e004-4a79-b2cc-8c6e0d3c41e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:33.616391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f3bc32f-e004-4a79-b2cc-8c6e0d3c41e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:33.617126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f3bc32f-e004-4a79-b2cc-8c6e0d3c41e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:33.617747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f3bc32f-e004-4a79-b2cc-8c6e0d3c41e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:33.618627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f3bc32f-e004-4a79-b2cc-8c6e0d3c41e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:33.619307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f3bc32f-e004-4a79-b2cc-8c6e0d3c41e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:33.619959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f3bc32f-e004-4a79-b2cc-8c6e0d3c41e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:33.663346 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a3976b52-849a-4972-ba24-4a8aef5597f8 tempest-SecurityGroupRulesTestJSON-1710661622 tempest-SecurityGroupRulesTestJSON-1710661622-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/9980fc5c-74fb-4246-ba0a-ba30b5141606" status: 202 len: 0 microversion: 2.1 time: 0.300520 Oct 12 22:15:33.664599 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2232/3970] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:15:33 2022] DELETE /compute/v2.1/os-security-groups/9980fc5c-74fb-4246-ba0a-ba30b5141606 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:15:33.847926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-de40652c-fd20-4042-8ecd-d6858f2866da tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:33.848585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-de40652c-fd20-4042-8ecd-d6858f2866da tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:33.862691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de40652c-fd20-4042-8ecd-d6858f2866da tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:33.863521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de40652c-fd20-4042-8ecd-d6858f2866da tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:33.866075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de40652c-fd20-4042-8ecd-d6858f2866da tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:33.868877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de40652c-fd20-4042-8ecd-d6858f2866da tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:33.870901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de40652c-fd20-4042-8ecd-d6858f2866da tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:33.872870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de40652c-fd20-4042-8ecd-d6858f2866da tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:34.115953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3f3bc32f-e004-4a79-b2cc-8c6e0d3c41e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:34.130676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3f3bc32f-e004-4a79-b2cc-8c6e0d3c41e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:34.134271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3f3bc32f-e004-4a79-b2cc-8c6e0d3c41e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:34.135062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-de40652c-fd20-4042-8ecd-d6858f2866da tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:34.135508 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3f3bc32f-e004-4a79-b2cc-8c6e0d3c41e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.531604 Oct 12 22:15:34.136087 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1739/3971] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:33 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:15:34.151718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-40038f89-0baa-417c-b0b3-0ccb105d9b00 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:34.153523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-40038f89-0baa-417c-b0b3-0ccb105d9b00 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:34.154790 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-de40652c-fd20-4042-8ecd-d6858f2866da tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1507 microversion: 2.1 time: 0.312176 Oct 12 22:15:34.156696 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2233/3972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:33 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1507 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:34.161825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40038f89-0baa-417c-b0b3-0ccb105d9b00 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:34.162317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40038f89-0baa-417c-b0b3-0ccb105d9b00 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:34.162755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40038f89-0baa-417c-b0b3-0ccb105d9b00 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:34.163491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40038f89-0baa-417c-b0b3-0ccb105d9b00 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:34.164175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40038f89-0baa-417c-b0b3-0ccb105d9b00 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:34.164838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40038f89-0baa-417c-b0b3-0ccb105d9b00 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:34.183160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0d549882-1ed1-4e47-bdb0-71c08e8a3c85 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:34.183849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0d549882-1ed1-4e47-bdb0-71c08e8a3c85 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:34.193935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d549882-1ed1-4e47-bdb0-71c08e8a3c85 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:34.194432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d549882-1ed1-4e47-bdb0-71c08e8a3c85 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:34.194880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d549882-1ed1-4e47-bdb0-71c08e8a3c85 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:34.198063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d549882-1ed1-4e47-bdb0-71c08e8a3c85 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:34.201265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d549882-1ed1-4e47-bdb0-71c08e8a3c85 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:34.202413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d549882-1ed1-4e47-bdb0-71c08e8a3c85 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:34.278476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-40038f89-0baa-417c-b0b3-0ccb105d9b00 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:34.289122 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-40038f89-0baa-417c-b0b3-0ccb105d9b00 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 200 len: 1282 microversion: 2.1 time: 0.151911 Oct 12 22:15:34.290289 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1740/3973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:34 2022] GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 1282 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:34.431590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-247c2d90-5ea8-4292-83c4-96daced73db7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:34.433628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-247c2d90-5ea8-4292-83c4-96daced73db7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:34.446653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-247c2d90-5ea8-4292-83c4-96daced73db7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:34.447791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-247c2d90-5ea8-4292-83c4-96daced73db7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:34.448430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-247c2d90-5ea8-4292-83c4-96daced73db7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:34.450096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-247c2d90-5ea8-4292-83c4-96daced73db7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:34.451860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-247c2d90-5ea8-4292-83c4-96daced73db7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:34.453006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-247c2d90-5ea8-4292-83c4-96daced73db7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:34.460393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:34.636540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0d549882-1ed1-4e47-bdb0-71c08e8a3c85 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:34.650297 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0d549882-1ed1-4e47-bdb0-71c08e8a3c85 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1507 microversion: 2.1 time: 0.470870 Oct 12 22:15:34.651698 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2234/3974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:34 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1507 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:34.685631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9c6bb3f7-38b4-4faa-b186-b848c73856ca tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:34.689731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9c6bb3f7-38b4-4faa-b186-b848c73856ca tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:34.698951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c6bb3f7-38b4-4faa-b186-b848c73856ca tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:34.700662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c6bb3f7-38b4-4faa-b186-b848c73856ca tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:34.701549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c6bb3f7-38b4-4faa-b186-b848c73856ca tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:34.702968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c6bb3f7-38b4-4faa-b186-b848c73856ca tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:34.703767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c6bb3f7-38b4-4faa-b186-b848c73856ca tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:34.705485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c6bb3f7-38b4-4faa-b186-b848c73856ca tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:34.834758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-247c2d90-5ea8-4292-83c4-96daced73db7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:34.843935 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-247c2d90-5ea8-4292-83c4-96daced73db7 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1511 microversion: 2.1 time: 0.416695 Oct 12 22:15:34.852875 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1741/3975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:34 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1511 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:34.893999 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9c6bb3f7-38b4-4faa-b186-b848c73856ca tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "PUT /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1079 microversion: 2.1 time: 0.215560 Oct 12 22:15:34.905697 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2235/3976] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 12 22:15:34 2022] PUT /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1079 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:34.935546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f8ebfba1-da9e-4fd5-ba26-4fd65cc9ee10 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:34.937139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f8ebfba1-da9e-4fd5-ba26-4fd65cc9ee10 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:34.950161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8ebfba1-da9e-4fd5-ba26-4fd65cc9ee10 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:34.950673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8ebfba1-da9e-4fd5-ba26-4fd65cc9ee10 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:34.951682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8ebfba1-da9e-4fd5-ba26-4fd65cc9ee10 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:34.952415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8ebfba1-da9e-4fd5-ba26-4fd65cc9ee10 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:34.952889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8ebfba1-da9e-4fd5-ba26-4fd65cc9ee10 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:34.953372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8ebfba1-da9e-4fd5-ba26-4fd65cc9ee10 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:35.171321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d2d70ec6-13bf-482e-af6d-fd250dd41924 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:35.171863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d2d70ec6-13bf-482e-af6d-fd250dd41924 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:35.180509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2d70ec6-13bf-482e-af6d-fd250dd41924 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:35.181059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2d70ec6-13bf-482e-af6d-fd250dd41924 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:35.181500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2d70ec6-13bf-482e-af6d-fd250dd41924 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:35.182604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2d70ec6-13bf-482e-af6d-fd250dd41924 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:35.182749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2d70ec6-13bf-482e-af6d-fd250dd41924 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:35.183407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2d70ec6-13bf-482e-af6d-fd250dd41924 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:35.220967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f8ebfba1-da9e-4fd5-ba26-4fd65cc9ee10 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:35.235107 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f8ebfba1-da9e-4fd5-ba26-4fd65cc9ee10 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1505 microversion: 2.1 time: 0.309520 Oct 12 22:15:35.235743 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1742/3977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:34 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1505 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:35.264566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ce32fd00-cef1-4c30-8c48-d685b74553ab tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:35.265200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ce32fd00-cef1-4c30-8c48-d685b74553ab tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:35.271289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce32fd00-cef1-4c30-8c48-d685b74553ab tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:35.271791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce32fd00-cef1-4c30-8c48-d685b74553ab tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:35.272230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce32fd00-cef1-4c30-8c48-d685b74553ab tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:35.272944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce32fd00-cef1-4c30-8c48-d685b74553ab tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:35.273401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce32fd00-cef1-4c30-8c48-d685b74553ab tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:35.273834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce32fd00-cef1-4c30-8c48-d685b74553ab tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:35.674158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ce32fd00-cef1-4c30-8c48-d685b74553ab tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:35.690133 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ce32fd00-cef1-4c30-8c48-d685b74553ab tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1505 microversion: 2.1 time: 0.434887 Oct 12 22:15:35.690920 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1743/3978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:35 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:15:35.716311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c76f9a21-2aaf-4359-a9ca-b17c11e681b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:35.717457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c76f9a21-2aaf-4359-a9ca-b17c11e681b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:35.731230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c76f9a21-2aaf-4359-a9ca-b17c11e681b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:35.731761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c76f9a21-2aaf-4359-a9ca-b17c11e681b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:35.732475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c76f9a21-2aaf-4359-a9ca-b17c11e681b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:35.734141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c76f9a21-2aaf-4359-a9ca-b17c11e681b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:35.734833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c76f9a21-2aaf-4359-a9ca-b17c11e681b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:35.735483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c76f9a21-2aaf-4359-a9ca-b17c11e681b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:35.885056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d2d70ec6-13bf-482e-af6d-fd250dd41924 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:35.908983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d2d70ec6-13bf-482e-af6d-fd250dd41924 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:35.910402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d2d70ec6-13bf-482e-af6d-fd250dd41924 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:35.911658 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d2d70ec6-13bf-482e-af6d-fd250dd41924 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.748761 Oct 12 22:15:35.915139 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2236/3979] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:35 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:15:35.931366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:35.934556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:35.951835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:35.952640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:35.953271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:35.954172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:35.956239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:35.956857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:36.079707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c76f9a21-2aaf-4359-a9ca-b17c11e681b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:36.096073 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c76f9a21-2aaf-4359-a9ca-b17c11e681b1 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 200 len: 1324 microversion: 2.1 time: 0.403767 Oct 12 22:15:36.112061 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1744/3980] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:35 2022] GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 1324 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:36.123422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-30621a1b-2eb0-4bbc-8918-e03be636a7ad tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:36.127680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-30621a1b-2eb0-4bbc-8918-e03be636a7ad tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:36.133330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:15:36.137862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:15:36.138612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:15:36.140468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30621a1b-2eb0-4bbc-8918-e03be636a7ad tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:36.141193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:15:36.141882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:15:36.143924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30621a1b-2eb0-4bbc-8918-e03be636a7ad tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:36.144934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30621a1b-2eb0-4bbc-8918-e03be636a7ad tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:36.146705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30621a1b-2eb0-4bbc-8918-e03be636a7ad tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:36.150240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30621a1b-2eb0-4bbc-8918-e03be636a7ad tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:36.151037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30621a1b-2eb0-4bbc-8918-e03be636a7ad tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:36.302372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:36.319101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:36.319839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:36.320457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:36.321383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:36.322054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:36.322705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:36.385229 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-085ac503-1593-42cf-868c-2f0be2d0af69 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "POST /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195/action" status: 202 len: 1111 microversion: 2.1 time: 0.468603 Oct 12 22:15:36.386167 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2237/3981] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:15:35 2022] POST /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195/action => generated 1111 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 12 22:15:36.419614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-55220bca-5591-485e-9057-bb371c2b126b req-5c133925-f977-4bd0-adc6-da198039b99d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66ff558-28a9-418c-a920-2b8f0ec8009a", "tag": "1cd617e2-2789-4ff2-a9d5-082964909b1f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:36.458383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-55220bca-5591-485e-9057-bb371c2b126b req-5c133925-f977-4bd0-adc6-da198039b99d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:36.459095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-55220bca-5591-485e-9057-bb371c2b126b req-5c133925-f977-4bd0-adc6-da198039b99d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:36.460085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-55220bca-5591-485e-9057-bb371c2b126b req-5c133925-f977-4bd0-adc6-da198039b99d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:36.481449 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-55220bca-5591-485e-9057-bb371c2b126b req-5c133925-f977-4bd0-adc6-da198039b99d service nova] Creating event network-changed:1cd617e2-2789-4ff2-a9d5-082964909b1f for instance b66ff558-28a9-418c-a920-2b8f0ec8009a on n-h2-861111-1 Oct 12 22:15:36.486663 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-55220bca-5591-485e-9057-bb371c2b126b req-5c133925-f977-4bd0-adc6-da198039b99d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080841 Oct 12 22:15:36.491941 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2238/3982] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:36.514416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-756e8c23-d35c-4201-8e93-d7294e25e357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:36.515126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-756e8c23-d35c-4201-8e93-d7294e25e357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:36.531365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-756e8c23-d35c-4201-8e93-d7294e25e357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:36.532111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-756e8c23-d35c-4201-8e93-d7294e25e357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:36.532739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-756e8c23-d35c-4201-8e93-d7294e25e357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:36.534072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-756e8c23-d35c-4201-8e93-d7294e25e357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:36.535067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-756e8c23-d35c-4201-8e93-d7294e25e357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:36.535711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-756e8c23-d35c-4201-8e93-d7294e25e357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:36.681751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-30621a1b-2eb0-4bbc-8918-e03be636a7ad tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:36.692829 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-30621a1b-2eb0-4bbc-8918-e03be636a7ad tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1511 microversion: 2.1 time: 0.579435 Oct 12 22:15:36.707802 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1745/3983] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:36 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1511 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:36.949854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-05897cd6-aed9-48f6-ac3e-f16d10ee3e09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:36.952004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-05897cd6-aed9-48f6-ac3e-f16d10ee3e09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:36.972276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05897cd6-aed9-48f6-ac3e-f16d10ee3e09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:36.976195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05897cd6-aed9-48f6-ac3e-f16d10ee3e09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:36.977346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05897cd6-aed9-48f6-ac3e-f16d10ee3e09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:36.979202 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05897cd6-aed9-48f6-ac3e-f16d10ee3e09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:36.981279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05897cd6-aed9-48f6-ac3e-f16d10ee3e09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:36.982951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05897cd6-aed9-48f6-ac3e-f16d10ee3e09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:37.010617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-756e8c23-d35c-4201-8e93-d7294e25e357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:37.019365 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-756e8c23-d35c-4201-8e93-d7294e25e357 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.514749 Oct 12 22:15:37.020122 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2239/3984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:36 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:37.126444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-49a8f100-d93c-4a46-b7c9-351436c48fa4 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:37.127061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-49a8f100-d93c-4a46-b7c9-351436c48fa4 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:37.139757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49a8f100-d93c-4a46-b7c9-351436c48fa4 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:37.140257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49a8f100-d93c-4a46-b7c9-351436c48fa4 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:37.140703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49a8f100-d93c-4a46-b7c9-351436c48fa4 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:37.141413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49a8f100-d93c-4a46-b7c9-351436c48fa4 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:37.141862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49a8f100-d93c-4a46-b7c9-351436c48fa4 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:37.145736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49a8f100-d93c-4a46-b7c9-351436c48fa4 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:37.285119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-05897cd6-aed9-48f6-ac3e-f16d10ee3e09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:37.297215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-05897cd6-aed9-48f6-ac3e-f16d10ee3e09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:37.298693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-05897cd6-aed9-48f6-ac3e-f16d10ee3e09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:37.300925 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-05897cd6-aed9-48f6-ac3e-f16d10ee3e09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.361657 Oct 12 22:15:37.302672 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1746/3985] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:36 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:37.466267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-49a8f100-d93c-4a46-b7c9-351436c48fa4 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:37.474766 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-49a8f100-d93c-4a46-b7c9-351436c48fa4 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 200 len: 1324 microversion: 2.1 time: 0.352282 Oct 12 22:15:37.475366 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2240/3986] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:37 2022] GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 1324 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:37.719549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c1973e35-eae8-47a5-b8d6-14e4a8f6bfc3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:37.720165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c1973e35-eae8-47a5-b8d6-14e4a8f6bfc3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:37.735118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:37.739680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1973e35-eae8-47a5-b8d6-14e4a8f6bfc3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:37.744162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1973e35-eae8-47a5-b8d6-14e4a8f6bfc3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:37.746477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1973e35-eae8-47a5-b8d6-14e4a8f6bfc3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:37.751170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1973e35-eae8-47a5-b8d6-14e4a8f6bfc3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:37.753730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1973e35-eae8-47a5-b8d6-14e4a8f6bfc3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:37.755099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1973e35-eae8-47a5-b8d6-14e4a8f6bfc3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:37.997393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c1973e35-eae8-47a5-b8d6-14e4a8f6bfc3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:38.008913 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c1973e35-eae8-47a5-b8d6-14e4a8f6bfc3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1511 microversion: 2.1 time: 0.293654 Oct 12 22:15:38.024047 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1747/3987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:37 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1511 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:38.049496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-44ba6ea4-7719-4470-90c3-4ad16aa70759 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:38.050130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-44ba6ea4-7719-4470-90c3-4ad16aa70759 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:38.060839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44ba6ea4-7719-4470-90c3-4ad16aa70759 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:38.061842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44ba6ea4-7719-4470-90c3-4ad16aa70759 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:38.062481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44ba6ea4-7719-4470-90c3-4ad16aa70759 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:38.063419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44ba6ea4-7719-4470-90c3-4ad16aa70759 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:38.064112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44ba6ea4-7719-4470-90c3-4ad16aa70759 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:38.065586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44ba6ea4-7719-4470-90c3-4ad16aa70759 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:38.330485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f0d90b3a-869a-4039-b53e-8b559f1b6ad4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:38.331594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f0d90b3a-869a-4039-b53e-8b559f1b6ad4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:38.336273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-44ba6ea4-7719-4470-90c3-4ad16aa70759 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:38.343032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0d90b3a-869a-4039-b53e-8b559f1b6ad4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:38.343564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0d90b3a-869a-4039-b53e-8b559f1b6ad4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:38.344007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0d90b3a-869a-4039-b53e-8b559f1b6ad4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:38.344721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0d90b3a-869a-4039-b53e-8b559f1b6ad4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:38.345176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0d90b3a-869a-4039-b53e-8b559f1b6ad4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:38.345649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0d90b3a-869a-4039-b53e-8b559f1b6ad4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:38.352063 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-44ba6ea4-7719-4470-90c3-4ad16aa70759 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.308290 Oct 12 22:15:38.367262 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2241/3988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:38 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:38.500276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-19754223-81b6-4553-aff5-8e0d0230c0b8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:38.504009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-19754223-81b6-4553-aff5-8e0d0230c0b8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:38.524028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19754223-81b6-4553-aff5-8e0d0230c0b8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:38.528032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19754223-81b6-4553-aff5-8e0d0230c0b8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:38.529646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19754223-81b6-4553-aff5-8e0d0230c0b8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:38.532286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19754223-81b6-4553-aff5-8e0d0230c0b8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:38.532966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19754223-81b6-4553-aff5-8e0d0230c0b8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:38.535367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19754223-81b6-4553-aff5-8e0d0230c0b8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:38.613114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f0d90b3a-869a-4039-b53e-8b559f1b6ad4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:38.625837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f0d90b3a-869a-4039-b53e-8b559f1b6ad4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:38.628042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f0d90b3a-869a-4039-b53e-8b559f1b6ad4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:38.629504 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f0d90b3a-869a-4039-b53e-8b559f1b6ad4 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.304785 Oct 12 22:15:38.630669 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1748/3989] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:38 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:38.829096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-19754223-81b6-4553-aff5-8e0d0230c0b8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:38.851081 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-19754223-81b6-4553-aff5-8e0d0230c0b8 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 200 len: 1324 microversion: 2.1 time: 0.356513 Oct 12 22:15:38.852083 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2242/3990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:38 2022] GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 1324 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:39.034696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d810ad0f-5c0c-45ac-8755-7a10a44f12c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:39.035422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d810ad0f-5c0c-45ac-8755-7a10a44f12c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:39.050913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d810ad0f-5c0c-45ac-8755-7a10a44f12c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:39.052820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d810ad0f-5c0c-45ac-8755-7a10a44f12c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:39.059307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d810ad0f-5c0c-45ac-8755-7a10a44f12c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:39.060136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d810ad0f-5c0c-45ac-8755-7a10a44f12c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:39.060614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d810ad0f-5c0c-45ac-8755-7a10a44f12c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:39.061189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d810ad0f-5c0c-45ac-8755-7a10a44f12c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:39.378245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0ff66ed6-7add-4ba6-b7c0-06f52a60f2ea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:39.378873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0ff66ed6-7add-4ba6-b7c0-06f52a60f2ea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:39.389830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ff66ed6-7add-4ba6-b7c0-06f52a60f2ea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:39.391177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ff66ed6-7add-4ba6-b7c0-06f52a60f2ea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:39.392974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ff66ed6-7add-4ba6-b7c0-06f52a60f2ea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:39.393897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ff66ed6-7add-4ba6-b7c0-06f52a60f2ea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:39.394498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ff66ed6-7add-4ba6-b7c0-06f52a60f2ea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:39.395112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ff66ed6-7add-4ba6-b7c0-06f52a60f2ea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:39.654294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0ff66ed6-7add-4ba6-b7c0-06f52a60f2ea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:39.663205 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0ff66ed6-7add-4ba6-b7c0-06f52a60f2ea tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.288833 Oct 12 22:15:39.675481 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2243/3991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:39 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:39.685699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b793d540-ea83-4be3-8577-153bf3bf3a47 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:39.686661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b793d540-ea83-4be3-8577-153bf3bf3a47 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:39.694168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b793d540-ea83-4be3-8577-153bf3bf3a47 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:39.695045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b793d540-ea83-4be3-8577-153bf3bf3a47 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:39.695740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b793d540-ea83-4be3-8577-153bf3bf3a47 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:39.696688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b793d540-ea83-4be3-8577-153bf3bf3a47 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:39.698389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b793d540-ea83-4be3-8577-153bf3bf3a47 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:39.699103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b793d540-ea83-4be3-8577-153bf3bf3a47 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:39.745760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d810ad0f-5c0c-45ac-8755-7a10a44f12c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:39.782232 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d810ad0f-5c0c-45ac-8755-7a10a44f12c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1511 microversion: 2.1 time: 0.750490 Oct 12 22:15:39.783516 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1749/3992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:39 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1511 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:39.877651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4988f14e-96f3-4c8a-a4fb-78ea1b6057fb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:39.878536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4988f14e-96f3-4c8a-a4fb-78ea1b6057fb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:39.900043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4988f14e-96f3-4c8a-a4fb-78ea1b6057fb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:39.900043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4988f14e-96f3-4c8a-a4fb-78ea1b6057fb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:39.900043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4988f14e-96f3-4c8a-a4fb-78ea1b6057fb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:39.900043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4988f14e-96f3-4c8a-a4fb-78ea1b6057fb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:39.904474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4988f14e-96f3-4c8a-a4fb-78ea1b6057fb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:39.905434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4988f14e-96f3-4c8a-a4fb-78ea1b6057fb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:40.052716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b793d540-ea83-4be3-8577-153bf3bf3a47 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:40.067063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b793d540-ea83-4be3-8577-153bf3bf3a47 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:40.072168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b793d540-ea83-4be3-8577-153bf3bf3a47 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:40.073638 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b793d540-ea83-4be3-8577-153bf3bf3a47 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.396845 Oct 12 22:15:40.076326 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2244/3993] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:39 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:40.412772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4988f14e-96f3-4c8a-a4fb-78ea1b6057fb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:40.423489 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4988f14e-96f3-4c8a-a4fb-78ea1b6057fb tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 200 len: 1324 microversion: 2.1 time: 0.551929 Oct 12 22:15:40.436390 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1750/3994] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:39 2022] GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 1324 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:15:40.687801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b020ca74-736d-44cf-a4b8-3781ab93e912 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:40.688353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b020ca74-736d-44cf-a4b8-3781ab93e912 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:40.696729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b020ca74-736d-44cf-a4b8-3781ab93e912 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:40.697439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b020ca74-736d-44cf-a4b8-3781ab93e912 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:40.698071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b020ca74-736d-44cf-a4b8-3781ab93e912 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:40.698957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b020ca74-736d-44cf-a4b8-3781ab93e912 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:40.699612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b020ca74-736d-44cf-a4b8-3781ab93e912 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:40.700207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b020ca74-736d-44cf-a4b8-3781ab93e912 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:40.809905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c7546a26-447b-4f2a-80c6-301b6a785ccb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:40.811102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c7546a26-447b-4f2a-80c6-301b6a785ccb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:40.831991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7546a26-447b-4f2a-80c6-301b6a785ccb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:40.832623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7546a26-447b-4f2a-80c6-301b6a785ccb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:40.836963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7546a26-447b-4f2a-80c6-301b6a785ccb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:40.840600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7546a26-447b-4f2a-80c6-301b6a785ccb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:40.841513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7546a26-447b-4f2a-80c6-301b6a785ccb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:40.842171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7546a26-447b-4f2a-80c6-301b6a785ccb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:40.968372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b020ca74-736d-44cf-a4b8-3781ab93e912 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:40.976467 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b020ca74-736d-44cf-a4b8-3781ab93e912 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.293399 Oct 12 22:15:40.977056 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2245/3995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:40 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:41.105957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1a6ff682-9d18-435f-8513-74561fadd574 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:41.106845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1a6ff682-9d18-435f-8513-74561fadd574 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:41.119089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a6ff682-9d18-435f-8513-74561fadd574 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:41.122177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a6ff682-9d18-435f-8513-74561fadd574 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:41.123796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a6ff682-9d18-435f-8513-74561fadd574 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:41.126758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a6ff682-9d18-435f-8513-74561fadd574 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:41.128062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a6ff682-9d18-435f-8513-74561fadd574 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:41.129934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a6ff682-9d18-435f-8513-74561fadd574 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:41.133118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c7546a26-447b-4f2a-80c6-301b6a785ccb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:41.145325 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c7546a26-447b-4f2a-80c6-301b6a785ccb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1511 microversion: 2.1 time: 0.340067 Oct 12 22:15:41.147350 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1751/3996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:40 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1511 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:15:41.243723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:41.279452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:41.403417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a6ff682-9d18-435f-8513-74561fadd574 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:41.414901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a6ff682-9d18-435f-8513-74561fadd574 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:41.416427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a6ff682-9d18-435f-8513-74561fadd574 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:41.420232 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1a6ff682-9d18-435f-8513-74561fadd574 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.316117 Oct 12 22:15:41.420232 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2246/3997] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:41 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:41.453394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9a9f3210-218b-4a32-8ee5-4977b1a8276c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:41.454348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9a9f3210-218b-4a32-8ee5-4977b1a8276c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:41.474212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a9f3210-218b-4a32-8ee5-4977b1a8276c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:41.474887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a9f3210-218b-4a32-8ee5-4977b1a8276c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:41.479673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a9f3210-218b-4a32-8ee5-4977b1a8276c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:41.480588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a9f3210-218b-4a32-8ee5-4977b1a8276c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:41.481058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a9f3210-218b-4a32-8ee5-4977b1a8276c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:41.481496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a9f3210-218b-4a32-8ee5-4977b1a8276c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:41.700868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9a9f3210-218b-4a32-8ee5-4977b1a8276c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:41.711345 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9a9f3210-218b-4a32-8ee5-4977b1a8276c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 200 len: 1324 microversion: 2.1 time: 0.265813 Oct 12 22:15:41.712392 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1752/3998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:41 2022] GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 1324 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:42.005498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c15dd6ab-d305-4f01-beba-4738f81600ba tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:42.006121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c15dd6ab-d305-4f01-beba-4738f81600ba tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:42.016026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15dd6ab-d305-4f01-beba-4738f81600ba tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:42.016585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15dd6ab-d305-4f01-beba-4738f81600ba tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:42.016848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15dd6ab-d305-4f01-beba-4738f81600ba tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:42.018796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15dd6ab-d305-4f01-beba-4738f81600ba tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:42.019684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15dd6ab-d305-4f01-beba-4738f81600ba tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:42.020163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15dd6ab-d305-4f01-beba-4738f81600ba tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:42.023882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:42.170567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bca0ce46-2725-412e-b551-4fb9e54b24bd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:42.171810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bca0ce46-2725-412e-b551-4fb9e54b24bd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:42.190662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:42.193356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bca0ce46-2725-412e-b551-4fb9e54b24bd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:42.194378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bca0ce46-2725-412e-b551-4fb9e54b24bd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:42.194823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bca0ce46-2725-412e-b551-4fb9e54b24bd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:42.195765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bca0ce46-2725-412e-b551-4fb9e54b24bd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:42.196476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bca0ce46-2725-412e-b551-4fb9e54b24bd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:42.197525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bca0ce46-2725-412e-b551-4fb9e54b24bd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:42.254887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c15dd6ab-d305-4f01-beba-4738f81600ba tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:42.268985 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c15dd6ab-d305-4f01-beba-4738f81600ba tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.267492 Oct 12 22:15:42.272959 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2247/3999] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:42 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:15:42.446056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6f3e3a4b-ef9f-4929-a2b2-a53affc3a8bb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:42.447001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6f3e3a4b-ef9f-4929-a2b2-a53affc3a8bb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:42.457551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f3e3a4b-ef9f-4929-a2b2-a53affc3a8bb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:42.462587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f3e3a4b-ef9f-4929-a2b2-a53affc3a8bb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:42.464124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f3e3a4b-ef9f-4929-a2b2-a53affc3a8bb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:42.465054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f3e3a4b-ef9f-4929-a2b2-a53affc3a8bb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:42.467029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f3e3a4b-ef9f-4929-a2b2-a53affc3a8bb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:42.468617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f3e3a4b-ef9f-4929-a2b2-a53affc3a8bb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:42.511598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bca0ce46-2725-412e-b551-4fb9e54b24bd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:42.521380 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bca0ce46-2725-412e-b551-4fb9e54b24bd tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1511 microversion: 2.1 time: 0.354670 Oct 12 22:15:42.521959 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1753/4000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:42 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1511 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:42.741314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1733a5f7-7454-4ea7-a2e1-a3ff78536a77 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:42.741945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1733a5f7-7454-4ea7-a2e1-a3ff78536a77 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:42.754609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1733a5f7-7454-4ea7-a2e1-a3ff78536a77 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:42.755715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1733a5f7-7454-4ea7-a2e1-a3ff78536a77 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:42.756469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1733a5f7-7454-4ea7-a2e1-a3ff78536a77 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:42.757593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1733a5f7-7454-4ea7-a2e1-a3ff78536a77 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:42.758860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1733a5f7-7454-4ea7-a2e1-a3ff78536a77 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:42.759534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1733a5f7-7454-4ea7-a2e1-a3ff78536a77 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:42.824831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6f3e3a4b-ef9f-4929-a2b2-a53affc3a8bb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:42.836505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6f3e3a4b-ef9f-4929-a2b2-a53affc3a8bb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:42.838268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6f3e3a4b-ef9f-4929-a2b2-a53affc3a8bb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:42.839737 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6f3e3a4b-ef9f-4929-a2b2-a53affc3a8bb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.398165 Oct 12 22:15:42.840862 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2248/4001] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:42 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:15:43.020900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1733a5f7-7454-4ea7-a2e1-a3ff78536a77 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:43.029084 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1733a5f7-7454-4ea7-a2e1-a3ff78536a77 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 200 len: 1324 microversion: 2.1 time: 0.296172 Oct 12 22:15:43.030281 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1754/4002] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:42 2022] GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 1324 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:43.297421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e728cf0-e426-46d4-9cd5-54bee5356fe7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:43.298030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9e728cf0-e426-46d4-9cd5-54bee5356fe7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:43.309201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e728cf0-e426-46d4-9cd5-54bee5356fe7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:43.310353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e728cf0-e426-46d4-9cd5-54bee5356fe7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:43.310793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e728cf0-e426-46d4-9cd5-54bee5356fe7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:43.322821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e728cf0-e426-46d4-9cd5-54bee5356fe7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:43.323569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e728cf0-e426-46d4-9cd5-54bee5356fe7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:43.324010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e728cf0-e426-46d4-9cd5-54bee5356fe7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:43.553149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ac02a2b9-dd6c-4af6-901d-57adab38e6fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:43.554546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ac02a2b9-dd6c-4af6-901d-57adab38e6fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:43.563576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac02a2b9-dd6c-4af6-901d-57adab38e6fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:43.567308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9e728cf0-e426-46d4-9cd5-54bee5356fe7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:43.575633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac02a2b9-dd6c-4af6-901d-57adab38e6fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:43.576124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac02a2b9-dd6c-4af6-901d-57adab38e6fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:43.577320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac02a2b9-dd6c-4af6-901d-57adab38e6fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:43.577320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac02a2b9-dd6c-4af6-901d-57adab38e6fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:43.577717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac02a2b9-dd6c-4af6-901d-57adab38e6fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:43.578551 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9e728cf0-e426-46d4-9cd5-54bee5356fe7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.285743 Oct 12 22:15:43.579364 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2249/4003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:43 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:43.783725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fd4a6e90-11a7-4f4f-91f4-2cd2b05acc91 tempest-PortsAdminExtendedAttrsTestJSON-1385354625 tempest-PortsAdminExtendedAttrsTestJSON-1385354625-project-admin] Calling method '.version_select at 0x7f5122f9e0d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:43.787042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd4a6e90-11a7-4f4f-91f4-2cd2b05acc91 tempest-PortsAdminExtendedAttrsTestJSON-1385354625 tempest-PortsAdminExtendedAttrsTestJSON-1385354625-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:43.788958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd4a6e90-11a7-4f4f-91f4-2cd2b05acc91 tempest-PortsAdminExtendedAttrsTestJSON-1385354625 tempest-PortsAdminExtendedAttrsTestJSON-1385354625-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:43.789574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd4a6e90-11a7-4f4f-91f4-2cd2b05acc91 tempest-PortsAdminExtendedAttrsTestJSON-1385354625 tempest-PortsAdminExtendedAttrsTestJSON-1385354625-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:43.808255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd4a6e90-11a7-4f4f-91f4-2cd2b05acc91 tempest-PortsAdminExtendedAttrsTestJSON-1385354625 tempest-PortsAdminExtendedAttrsTestJSON-1385354625-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:43.808982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd4a6e90-11a7-4f4f-91f4-2cd2b05acc91 tempest-PortsAdminExtendedAttrsTestJSON-1385354625 tempest-PortsAdminExtendedAttrsTestJSON-1385354625-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:43.809622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd4a6e90-11a7-4f4f-91f4-2cd2b05acc91 tempest-PortsAdminExtendedAttrsTestJSON-1385354625 tempest-PortsAdminExtendedAttrsTestJSON-1385354625-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:43.822639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd4a6e90-11a7-4f4f-91f4-2cd2b05acc91 tempest-PortsAdminExtendedAttrsTestJSON-1385354625 tempest-PortsAdminExtendedAttrsTestJSON-1385354625-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:43.824096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd4a6e90-11a7-4f4f-91f4-2cd2b05acc91 tempest-PortsAdminExtendedAttrsTestJSON-1385354625 tempest-PortsAdminExtendedAttrsTestJSON-1385354625-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:43.824771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd4a6e90-11a7-4f4f-91f4-2cd2b05acc91 tempest-PortsAdminExtendedAttrsTestJSON-1385354625 tempest-PortsAdminExtendedAttrsTestJSON-1385354625-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:43.831851 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fd4a6e90-11a7-4f4f-91f4-2cd2b05acc91 tempest-PortsAdminExtendedAttrsTestJSON-1385354625 tempest-PortsAdminExtendedAttrsTestJSON-1385354625-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.202423 Oct 12 22:15:43.833034 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2250/4004] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:15:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:43.873718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ac02a2b9-dd6c-4af6-901d-57adab38e6fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:43.874841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1838d2a9-fe14-4a6c-a466-5d44036c0a79 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:43.875620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1838d2a9-fe14-4a6c-a466-5d44036c0a79 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:43.882669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1838d2a9-fe14-4a6c-a466-5d44036c0a79 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:43.883275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1838d2a9-fe14-4a6c-a466-5d44036c0a79 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:43.883549 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ac02a2b9-dd6c-4af6-901d-57adab38e6fb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1511 microversion: 2.1 time: 0.335624 Oct 12 22:15:43.883869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1838d2a9-fe14-4a6c-a466-5d44036c0a79 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:43.884185 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1755/4005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:43 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1511 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:15:43.894928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1838d2a9-fe14-4a6c-a466-5d44036c0a79 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:43.895937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1838d2a9-fe14-4a6c-a466-5d44036c0a79 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:43.896652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1838d2a9-fe14-4a6c-a466-5d44036c0a79 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:44.055140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-18b9ffae-0256-4f3f-ad10-d352814d9aa7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:44.055701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-18b9ffae-0256-4f3f-ad10-d352814d9aa7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:44.062423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18b9ffae-0256-4f3f-ad10-d352814d9aa7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:44.063208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18b9ffae-0256-4f3f-ad10-d352814d9aa7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:44.064102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18b9ffae-0256-4f3f-ad10-d352814d9aa7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:44.065015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18b9ffae-0256-4f3f-ad10-d352814d9aa7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:44.065681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18b9ffae-0256-4f3f-ad10-d352814d9aa7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:44.066332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18b9ffae-0256-4f3f-ad10-d352814d9aa7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:44.237807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1838d2a9-fe14-4a6c-a466-5d44036c0a79 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:44.254537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1838d2a9-fe14-4a6c-a466-5d44036c0a79 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:44.256437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1838d2a9-fe14-4a6c-a466-5d44036c0a79 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:44.257874 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1838d2a9-fe14-4a6c-a466-5d44036c0a79 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.392996 Oct 12 22:15:44.272723 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2251/4006] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:43 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:15:44.278581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-18b9ffae-0256-4f3f-ad10-d352814d9aa7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:44.287735 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-18b9ffae-0256-4f3f-ad10-d352814d9aa7 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 200 len: 1324 microversion: 2.1 time: 0.236393 Oct 12 22:15:44.288689 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1756/4007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:44 2022] GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 1324 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:44.604532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0a20d610-e667-4977-8f59-b29e44fe3eef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:44.605881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0a20d610-e667-4977-8f59-b29e44fe3eef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:44.618965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a20d610-e667-4977-8f59-b29e44fe3eef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:44.619816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a20d610-e667-4977-8f59-b29e44fe3eef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:44.621078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a20d610-e667-4977-8f59-b29e44fe3eef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:44.624426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a20d610-e667-4977-8f59-b29e44fe3eef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:44.631094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-18f93856-5151-4a3b-bade-41de23322778 req-77adecac-0341-49e3-8a16-1ba8b5bcaccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66ff558-28a9-418c-a920-2b8f0ec8009a", "name": "network-vif-plugged", "status": "completed", "tag": "1cd617e2-2789-4ff2-a9d5-082964909b1f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:44.635212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a20d610-e667-4977-8f59-b29e44fe3eef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:44.636739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a20d610-e667-4977-8f59-b29e44fe3eef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:44.652124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-18f93856-5151-4a3b-bade-41de23322778 req-77adecac-0341-49e3-8a16-1ba8b5bcaccb service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:44.652605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-18f93856-5151-4a3b-bade-41de23322778 req-77adecac-0341-49e3-8a16-1ba8b5bcaccb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:44.653037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-18f93856-5151-4a3b-bade-41de23322778 req-77adecac-0341-49e3-8a16-1ba8b5bcaccb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:44.691306 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-18f93856-5151-4a3b-bade-41de23322778 req-77adecac-0341-49e3-8a16-1ba8b5bcaccb service nova] Creating event network-vif-plugged:1cd617e2-2789-4ff2-a9d5-082964909b1f for instance b66ff558-28a9-418c-a920-2b8f0ec8009a on n-h2-861111-1 Oct 12 22:15:44.696921 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-18f93856-5151-4a3b-bade-41de23322778 req-77adecac-0341-49e3-8a16-1ba8b5bcaccb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070291 Oct 12 22:15:44.698005 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1757/4008] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:15:44.909691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0a20d610-e667-4977-8f59-b29e44fe3eef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:44.912184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c4727654-bd66-468c-a579-a40a3f014c12 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:44.922062 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0a20d610-e667-4977-8f59-b29e44fe3eef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.321686 Oct 12 22:15:44.924820 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2252/4009] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:44 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:44.927501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c4727654-bd66-468c-a579-a40a3f014c12 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:44.937760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4727654-bd66-468c-a579-a40a3f014c12 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:44.938255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4727654-bd66-468c-a579-a40a3f014c12 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:44.938688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4727654-bd66-468c-a579-a40a3f014c12 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:44.940066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4727654-bd66-468c-a579-a40a3f014c12 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:44.940691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4727654-bd66-468c-a579-a40a3f014c12 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:44.941283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4727654-bd66-468c-a579-a40a3f014c12 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:44.991950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:45.288087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-18f5332e-0a68-48eb-9eb8-a061a3779750 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:45.288773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-18f5332e-0a68-48eb-9eb8-a061a3779750 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:45.299674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18f5332e-0a68-48eb-9eb8-a061a3779750 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:45.300289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c4727654-bd66-468c-a579-a40a3f014c12 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:45.301900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18f5332e-0a68-48eb-9eb8-a061a3779750 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:45.305874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18f5332e-0a68-48eb-9eb8-a061a3779750 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:45.305874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18f5332e-0a68-48eb-9eb8-a061a3779750 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:45.306780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18f5332e-0a68-48eb-9eb8-a061a3779750 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:45.307327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18f5332e-0a68-48eb-9eb8-a061a3779750 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:45.312922 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c4727654-bd66-468c-a579-a40a3f014c12 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1511 microversion: 2.1 time: 0.405700 Oct 12 22:15:45.314172 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1758/4010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:44 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1511 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:45.324881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3afbe365-d580-4f5d-860b-81e4e2acdd26 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:45.326497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3afbe365-d580-4f5d-860b-81e4e2acdd26 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:45.349644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3afbe365-d580-4f5d-860b-81e4e2acdd26 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:45.350126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3afbe365-d580-4f5d-860b-81e4e2acdd26 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:45.350562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3afbe365-d580-4f5d-860b-81e4e2acdd26 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:45.356826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3afbe365-d580-4f5d-860b-81e4e2acdd26 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:45.357313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3afbe365-d580-4f5d-860b-81e4e2acdd26 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:45.357756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3afbe365-d580-4f5d-860b-81e4e2acdd26 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:45.670263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3afbe365-d580-4f5d-860b-81e4e2acdd26 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:45.679416 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3afbe365-d580-4f5d-860b-81e4e2acdd26 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 200 len: 1324 microversion: 2.1 time: 0.363375 Oct 12 22:15:45.680076 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1759/4011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:45 2022] GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 1324 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:45.950165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5265dfa4-4002-4095-8a1e-fd6e0bafd8bb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:45.952634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5265dfa4-4002-4095-8a1e-fd6e0bafd8bb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:45.967381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5265dfa4-4002-4095-8a1e-fd6e0bafd8bb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:45.968129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5265dfa4-4002-4095-8a1e-fd6e0bafd8bb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:45.968768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5265dfa4-4002-4095-8a1e-fd6e0bafd8bb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:45.969674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5265dfa4-4002-4095-8a1e-fd6e0bafd8bb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:45.977240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5265dfa4-4002-4095-8a1e-fd6e0bafd8bb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:45.977967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5265dfa4-4002-4095-8a1e-fd6e0bafd8bb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:45.990161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-18f5332e-0a68-48eb-9eb8-a061a3779750 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:46.001836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-18f5332e-0a68-48eb-9eb8-a061a3779750 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:46.003496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-18f5332e-0a68-48eb-9eb8-a061a3779750 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:46.005224 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-18f5332e-0a68-48eb-9eb8-a061a3779750 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.722936 Oct 12 22:15:46.006413 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2253/4012] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:45 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:15:46.343715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3a5bcde5-8716-44bf-83d2-15cc47239cd2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:46.344501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3a5bcde5-8716-44bf-83d2-15cc47239cd2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:46.356102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a5bcde5-8716-44bf-83d2-15cc47239cd2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:46.356929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a5bcde5-8716-44bf-83d2-15cc47239cd2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:46.357605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a5bcde5-8716-44bf-83d2-15cc47239cd2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:46.358328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a5bcde5-8716-44bf-83d2-15cc47239cd2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:46.359657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a5bcde5-8716-44bf-83d2-15cc47239cd2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:46.360096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a5bcde5-8716-44bf-83d2-15cc47239cd2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:46.538387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3a5bcde5-8716-44bf-83d2-15cc47239cd2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:46.547625 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3a5bcde5-8716-44bf-83d2-15cc47239cd2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1511 microversion: 2.1 time: 0.211259 Oct 12 22:15:46.553586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5265dfa4-4002-4095-8a1e-fd6e0bafd8bb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:46.563710 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2254/4013] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:46 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1511 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:46.566312 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5265dfa4-4002-4095-8a1e-fd6e0bafd8bb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.620058 Oct 12 22:15:46.567097 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1760/4014] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:45 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:46.703823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8d1b512e-1fe7-4c9c-9b29-64a885945927 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:46.704384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8d1b512e-1fe7-4c9c-9b29-64a885945927 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:46.712201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d1b512e-1fe7-4c9c-9b29-64a885945927 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:46.712972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d1b512e-1fe7-4c9c-9b29-64a885945927 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:46.713599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d1b512e-1fe7-4c9c-9b29-64a885945927 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:46.714489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d1b512e-1fe7-4c9c-9b29-64a885945927 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:46.715329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d1b512e-1fe7-4c9c-9b29-64a885945927 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:46.716517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d1b512e-1fe7-4c9c-9b29-64a885945927 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:46.923285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8d1b512e-1fe7-4c9c-9b29-64a885945927 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:46.938839 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8d1b512e-1fe7-4c9c-9b29-64a885945927 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 200 len: 1522 microversion: 2.1 time: 0.239325 Oct 12 22:15:46.939474 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2255/4015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:46 2022] GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:46.964434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-223ba4da-1dbc-448a-84a6-5d17e388ad5f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:46.964956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-223ba4da-1dbc-448a-84a6-5d17e388ad5f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:46.971951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-223ba4da-1dbc-448a-84a6-5d17e388ad5f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:46.972543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-223ba4da-1dbc-448a-84a6-5d17e388ad5f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:46.973327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-223ba4da-1dbc-448a-84a6-5d17e388ad5f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:46.974207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-223ba4da-1dbc-448a-84a6-5d17e388ad5f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:46.974772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-223ba4da-1dbc-448a-84a6-5d17e388ad5f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:46.975089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-223ba4da-1dbc-448a-84a6-5d17e388ad5f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:47.003047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-223ba4da-1dbc-448a-84a6-5d17e388ad5f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:15:47.033050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8c83ceb4-e749-488c-a009-dfd001874bca tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:47.034254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8c83ceb4-e749-488c-a009-dfd001874bca tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:47.044273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c83ceb4-e749-488c-a009-dfd001874bca tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:47.046399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c83ceb4-e749-488c-a009-dfd001874bca tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:47.047080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c83ceb4-e749-488c-a009-dfd001874bca tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:47.047997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c83ceb4-e749-488c-a009-dfd001874bca tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:47.049780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c83ceb4-e749-488c-a009-dfd001874bca tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:47.051224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c83ceb4-e749-488c-a009-dfd001874bca tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:47.147844 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-223ba4da-1dbc-448a-84a6-5d17e388ad5f tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 204 len: 0 microversion: 2.1 time: 0.186790 Oct 12 22:15:47.149515 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1761/4016] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:15:46 2022] DELETE /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:15:47.162209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ec0f41d5-1564-47d8-b516-8567217a9f3e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:47.163126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ec0f41d5-1564-47d8-b516-8567217a9f3e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:47.173472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec0f41d5-1564-47d8-b516-8567217a9f3e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:47.174520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec0f41d5-1564-47d8-b516-8567217a9f3e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:47.175151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec0f41d5-1564-47d8-b516-8567217a9f3e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:47.176241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec0f41d5-1564-47d8-b516-8567217a9f3e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:47.177589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec0f41d5-1564-47d8-b516-8567217a9f3e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:47.178547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec0f41d5-1564-47d8-b516-8567217a9f3e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:47.490972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8c83ceb4-e749-488c-a009-dfd001874bca tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:47.504205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8c83ceb4-e749-488c-a009-dfd001874bca tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:47.506086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8c83ceb4-e749-488c-a009-dfd001874bca tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:47.507669 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8c83ceb4-e749-488c-a009-dfd001874bca tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.479445 Oct 12 22:15:47.508783 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2256/4017] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:47 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:47.571930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-51efebdc-bcb9-4e7b-b810-1aecb50bf80e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:47.573257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-51efebdc-bcb9-4e7b-b810-1aecb50bf80e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:47.584934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51efebdc-bcb9-4e7b-b810-1aecb50bf80e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:47.586122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51efebdc-bcb9-4e7b-b810-1aecb50bf80e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:47.588914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51efebdc-bcb9-4e7b-b810-1aecb50bf80e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:47.589849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51efebdc-bcb9-4e7b-b810-1aecb50bf80e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:47.593495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51efebdc-bcb9-4e7b-b810-1aecb50bf80e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:47.593951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51efebdc-bcb9-4e7b-b810-1aecb50bf80e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:47.598711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ec0f41d5-1564-47d8-b516-8567217a9f3e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:47.612669 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ec0f41d5-1564-47d8-b516-8567217a9f3e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 200 len: 1528 microversion: 2.1 time: 0.455519 Oct 12 22:15:47.614367 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1762/4018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:47 2022] GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 1528 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:47.624468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3207eb17-53ea-4aad-90f0-c736a8905ec5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:47.625434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3207eb17-53ea-4aad-90f0-c736a8905ec5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:47.641667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3207eb17-53ea-4aad-90f0-c736a8905ec5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:47.643849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3207eb17-53ea-4aad-90f0-c736a8905ec5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:47.644526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3207eb17-53ea-4aad-90f0-c736a8905ec5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:47.646625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3207eb17-53ea-4aad-90f0-c736a8905ec5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:47.648670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3207eb17-53ea-4aad-90f0-c736a8905ec5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:47.649341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3207eb17-53ea-4aad-90f0-c736a8905ec5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:47.760023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-51efebdc-bcb9-4e7b-b810-1aecb50bf80e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:47.771417 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-51efebdc-bcb9-4e7b-b810-1aecb50bf80e tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1511 microversion: 2.1 time: 0.202315 Oct 12 22:15:47.772223 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2257/4019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:47 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:15:48.031306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3207eb17-53ea-4aad-90f0-c736a8905ec5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:48.039370 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3207eb17-53ea-4aad-90f0-c736a8905ec5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.423428 Oct 12 22:15:48.055212 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1763/4020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:47 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:48.495496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ec9b28b6-de23-4b5e-9419-a9a78531febc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:48.498564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ec9b28b6-de23-4b5e-9419-a9a78531febc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:48.505561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec9b28b6-de23-4b5e-9419-a9a78531febc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:48.521863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec9b28b6-de23-4b5e-9419-a9a78531febc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:48.524555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec9b28b6-de23-4b5e-9419-a9a78531febc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:48.526307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec9b28b6-de23-4b5e-9419-a9a78531febc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:48.527118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec9b28b6-de23-4b5e-9419-a9a78531febc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:48.529686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec9b28b6-de23-4b5e-9419-a9a78531febc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:48.534548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3d786f1c-664b-4a9d-9629-4d9e7de78622 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:48.535186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3d786f1c-664b-4a9d-9629-4d9e7de78622 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:48.554763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d786f1c-664b-4a9d-9629-4d9e7de78622 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:48.555347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d786f1c-664b-4a9d-9629-4d9e7de78622 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:48.555813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d786f1c-664b-4a9d-9629-4d9e7de78622 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:48.556563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d786f1c-664b-4a9d-9629-4d9e7de78622 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:48.557059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d786f1c-664b-4a9d-9629-4d9e7de78622 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:48.557500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d786f1c-664b-4a9d-9629-4d9e7de78622 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:48.641816 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ec9b28b6-de23-4b5e-9419-a9a78531febc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 202 len: 0 microversion: 2.1 time: 0.150013 Oct 12 22:15:48.643307 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2258/4021] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:15:48 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:15:48.649549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0e489259-0558-4220-8eb8-208450ebcb27 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:48.650506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0e489259-0558-4220-8eb8-208450ebcb27 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:48.658101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e489259-0558-4220-8eb8-208450ebcb27 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:48.659118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e489259-0558-4220-8eb8-208450ebcb27 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:48.659865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e489259-0558-4220-8eb8-208450ebcb27 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:48.660838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e489259-0558-4220-8eb8-208450ebcb27 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:48.661594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e489259-0558-4220-8eb8-208450ebcb27 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:48.662549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e489259-0558-4220-8eb8-208450ebcb27 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:48.950920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0e489259-0558-4220-8eb8-208450ebcb27 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:48.966273 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0e489259-0558-4220-8eb8-208450ebcb27 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 200 len: 1528 microversion: 2.1 time: 0.320806 Oct 12 22:15:48.968085 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2259/4022] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:48 2022] GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 1528 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:48.976479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1bf71490-85a9-4100-950a-21b4e516a918 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:48.977526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1bf71490-85a9-4100-950a-21b4e516a918 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:48.988012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bf71490-85a9-4100-950a-21b4e516a918 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:48.988857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bf71490-85a9-4100-950a-21b4e516a918 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:48.989441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bf71490-85a9-4100-950a-21b4e516a918 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:48.990591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bf71490-85a9-4100-950a-21b4e516a918 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:48.991228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bf71490-85a9-4100-950a-21b4e516a918 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:48.991926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bf71490-85a9-4100-950a-21b4e516a918 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:49.224971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1bf71490-85a9-4100-950a-21b4e516a918 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:49.234058 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1bf71490-85a9-4100-950a-21b4e516a918 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1672 microversion: 2.1 time: 0.264672 Oct 12 22:15:49.249806 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2260/4023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:48 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1672 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:49.262073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a83e9a6e-d4da-48f4-b694-787c0be39b42 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:49.266973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a83e9a6e-d4da-48f4-b694-787c0be39b42 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:49.274936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a83e9a6e-d4da-48f4-b694-787c0be39b42 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:49.275725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a83e9a6e-d4da-48f4-b694-787c0be39b42 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:49.276351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a83e9a6e-d4da-48f4-b694-787c0be39b42 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:49.277354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a83e9a6e-d4da-48f4-b694-787c0be39b42 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:49.277975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a83e9a6e-d4da-48f4-b694-787c0be39b42 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:49.278601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a83e9a6e-d4da-48f4-b694-787c0be39b42 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:49.445298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3d786f1c-664b-4a9d-9629-4d9e7de78622 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:49.495891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3d786f1c-664b-4a9d-9629-4d9e7de78622 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:49.497889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3d786f1c-664b-4a9d-9629-4d9e7de78622 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:49.499450 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3d786f1c-664b-4a9d-9629-4d9e7de78622 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.968748 Oct 12 22:15:49.500201 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1764/4024] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:48 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:15:49.535365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ba81f116-83ef-4db1-bb9a-2fc661b76821 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:49.535994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ba81f116-83ef-4db1-bb9a-2fc661b76821 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:49.542641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba81f116-83ef-4db1-bb9a-2fc661b76821 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:49.543129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba81f116-83ef-4db1-bb9a-2fc661b76821 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:49.543764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba81f116-83ef-4db1-bb9a-2fc661b76821 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:49.544784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba81f116-83ef-4db1-bb9a-2fc661b76821 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:49.545411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba81f116-83ef-4db1-bb9a-2fc661b76821 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:49.546005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba81f116-83ef-4db1-bb9a-2fc661b76821 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:49.790219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a83e9a6e-d4da-48f4-b694-787c0be39b42 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:49.802088 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a83e9a6e-d4da-48f4-b694-787c0be39b42 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1511 microversion: 2.1 time: 0.550885 Oct 12 22:15:49.802690 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2261/4025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:49 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1511 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:50.012246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d3e71d1f-3a95-4ff9-897a-1f1f9df95c53 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:50.013219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d3e71d1f-3a95-4ff9-897a-1f1f9df95c53 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:50.025857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e71d1f-3a95-4ff9-897a-1f1f9df95c53 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:50.029349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e71d1f-3a95-4ff9-897a-1f1f9df95c53 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:50.030030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e71d1f-3a95-4ff9-897a-1f1f9df95c53 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:50.030957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e71d1f-3a95-4ff9-897a-1f1f9df95c53 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:50.034275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e71d1f-3a95-4ff9-897a-1f1f9df95c53 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:50.034917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e71d1f-3a95-4ff9-897a-1f1f9df95c53 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:50.257912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba81f116-83ef-4db1-bb9a-2fc661b76821 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:50.265895 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ba81f116-83ef-4db1-bb9a-2fc661b76821 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.764477 Oct 12 22:15:50.266487 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1765/4026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:49 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:50.281984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d95f54ea-e82a-4f5a-a3e4-8fadd3f2934d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:50.282548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d95f54ea-e82a-4f5a-a3e4-8fadd3f2934d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:50.298844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d95f54ea-e82a-4f5a-a3e4-8fadd3f2934d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:50.299376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d95f54ea-e82a-4f5a-a3e4-8fadd3f2934d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:50.300006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d95f54ea-e82a-4f5a-a3e4-8fadd3f2934d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:50.300884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d95f54ea-e82a-4f5a-a3e4-8fadd3f2934d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:50.301546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d95f54ea-e82a-4f5a-a3e4-8fadd3f2934d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:50.302199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d95f54ea-e82a-4f5a-a3e4-8fadd3f2934d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:50.682143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d3e71d1f-3a95-4ff9-897a-1f1f9df95c53 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:50.685655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:50.699600 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d3e71d1f-3a95-4ff9-897a-1f1f9df95c53 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 200 len: 1528 microversion: 2.1 time: 0.691015 Oct 12 22:15:50.700847 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2262/4027] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:50 2022] GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 1528 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:50.715359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-77edbfa8-872c-465e-9805-6c5c7b85646b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:50.716511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-77edbfa8-872c-465e-9805-6c5c7b85646b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:50.732703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77edbfa8-872c-465e-9805-6c5c7b85646b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:50.733647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77edbfa8-872c-465e-9805-6c5c7b85646b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:50.734278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77edbfa8-872c-465e-9805-6c5c7b85646b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:50.735470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77edbfa8-872c-465e-9805-6c5c7b85646b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:50.736180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77edbfa8-872c-465e-9805-6c5c7b85646b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:50.736927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77edbfa8-872c-465e-9805-6c5c7b85646b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:50.788507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d95f54ea-e82a-4f5a-a3e4-8fadd3f2934d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:50.800967 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d95f54ea-e82a-4f5a-a3e4-8fadd3f2934d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1672 microversion: 2.1 time: 0.523393 Oct 12 22:15:50.801568 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1766/4028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:50 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1672 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:50.840378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1b7d6058-6ac9-4108-985b-896b9a96633c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:50.842029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1b7d6058-6ac9-4108-985b-896b9a96633c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:50.857621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b7d6058-6ac9-4108-985b-896b9a96633c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:50.859821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b7d6058-6ac9-4108-985b-896b9a96633c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:50.860453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b7d6058-6ac9-4108-985b-896b9a96633c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:50.861364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b7d6058-6ac9-4108-985b-896b9a96633c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:50.864835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b7d6058-6ac9-4108-985b-896b9a96633c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:50.865461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b7d6058-6ac9-4108-985b-896b9a96633c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:51.294593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1b7d6058-6ac9-4108-985b-896b9a96633c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:51.310639 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1b7d6058-6ac9-4108-985b-896b9a96633c tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1511 microversion: 2.1 time: 0.485238 Oct 12 22:15:51.311297 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1767/4029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:50 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1511 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:15:51.343582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2c957cc3-caa3-4353-a670-b9fff72079e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:51.344212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2c957cc3-caa3-4353-a670-b9fff72079e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:51.364093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-77edbfa8-872c-465e-9805-6c5c7b85646b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:51.376084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c957cc3-caa3-4353-a670-b9fff72079e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:51.376890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c957cc3-caa3-4353-a670-b9fff72079e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:51.377977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c957cc3-caa3-4353-a670-b9fff72079e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:51.380164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c957cc3-caa3-4353-a670-b9fff72079e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:51.381262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c957cc3-caa3-4353-a670-b9fff72079e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:51.384750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c957cc3-caa3-4353-a670-b9fff72079e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:51.390072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-77edbfa8-872c-465e-9805-6c5c7b85646b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:51.392029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-77edbfa8-872c-465e-9805-6c5c7b85646b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:51.393993 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-77edbfa8-872c-465e-9805-6c5c7b85646b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.690336 Oct 12 22:15:51.395534 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2263/4030] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:50 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:51.650055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-260fa4da-c6fd-4654-972e-5c5c1c1ed0a6 req-0c10b06b-ebfb-4aaf-8531-7904c331230c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66ff558-28a9-418c-a920-2b8f0ec8009a", "name": "network-vif-deleted", "tag": "1cd617e2-2789-4ff2-a9d5-082964909b1f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:51.685214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-260fa4da-c6fd-4654-972e-5c5c1c1ed0a6 req-0c10b06b-ebfb-4aaf-8531-7904c331230c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:51.685702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-260fa4da-c6fd-4654-972e-5c5c1c1ed0a6 req-0c10b06b-ebfb-4aaf-8531-7904c331230c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:51.686135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-260fa4da-c6fd-4654-972e-5c5c1c1ed0a6 req-0c10b06b-ebfb-4aaf-8531-7904c331230c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:51.729008 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-260fa4da-c6fd-4654-972e-5c5c1c1ed0a6 req-0c10b06b-ebfb-4aaf-8531-7904c331230c service nova] Creating event network-vif-deleted:1cd617e2-2789-4ff2-a9d5-082964909b1f for instance b66ff558-28a9-418c-a920-2b8f0ec8009a on n-h2-861111-1 Oct 12 22:15:51.750489 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-260fa4da-c6fd-4654-972e-5c5c1c1ed0a6 req-0c10b06b-ebfb-4aaf-8531-7904c331230c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105111 Oct 12 22:15:51.753785 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2264/4031] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:15:51.776061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fbca4664-654c-4885-a2f8-47ffe26b1d0e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:51.779231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fbca4664-654c-4885-a2f8-47ffe26b1d0e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:51.793843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fbca4664-654c-4885-a2f8-47ffe26b1d0e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:51.799918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fbca4664-654c-4885-a2f8-47ffe26b1d0e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:51.800744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fbca4664-654c-4885-a2f8-47ffe26b1d0e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:51.801759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fbca4664-654c-4885-a2f8-47ffe26b1d0e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:51.802445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fbca4664-654c-4885-a2f8-47ffe26b1d0e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:51.803209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fbca4664-654c-4885-a2f8-47ffe26b1d0e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:51.891143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2c957cc3-caa3-4353-a670-b9fff72079e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:51.904539 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2c957cc3-caa3-4353-a670-b9fff72079e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.575396 Oct 12 22:15:51.904539 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1768/4032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:51 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:51.920462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1cea4e40-4413-444f-9b68-b72825cb5285 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:51.920462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1cea4e40-4413-444f-9b68-b72825cb5285 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:51.922765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cea4e40-4413-444f-9b68-b72825cb5285 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:51.923882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cea4e40-4413-444f-9b68-b72825cb5285 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:51.924565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cea4e40-4413-444f-9b68-b72825cb5285 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:51.925383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cea4e40-4413-444f-9b68-b72825cb5285 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:51.927591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cea4e40-4413-444f-9b68-b72825cb5285 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:51.928103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cea4e40-4413-444f-9b68-b72825cb5285 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:52.028967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fbca4664-654c-4885-a2f8-47ffe26b1d0e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c263e74d274bef8094b9d7ecfc820b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a107edadb364defb4f2c408969c097c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:52.052568 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fbca4664-654c-4885-a2f8-47ffe26b1d0e tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 200 len: 1309 microversion: 2.1 time: 0.285580 Oct 12 22:15:52.064259 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2265/4033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:51 2022] GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 1309 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:52.288653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1cea4e40-4413-444f-9b68-b72825cb5285 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:52.300843 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1cea4e40-4413-444f-9b68-b72825cb5285 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.395242 Oct 12 22:15:52.301729 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1769/4034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:51 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:52.337299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-31652a96-f02c-4d93-acfb-a7d42cb9fcec tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:52.338737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-31652a96-f02c-4d93-acfb-a7d42cb9fcec tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:52.350784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31652a96-f02c-4d93-acfb-a7d42cb9fcec tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:52.351612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31652a96-f02c-4d93-acfb-a7d42cb9fcec tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:52.360396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31652a96-f02c-4d93-acfb-a7d42cb9fcec tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:52.361432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31652a96-f02c-4d93-acfb-a7d42cb9fcec tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:52.362083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31652a96-f02c-4d93-acfb-a7d42cb9fcec tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:52.362689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31652a96-f02c-4d93-acfb-a7d42cb9fcec tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:52.427999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-982d07c1-bd0a-4b54-b469-85001235fb2a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:52.428624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-982d07c1-bd0a-4b54-b469-85001235fb2a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:52.455574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982d07c1-bd0a-4b54-b469-85001235fb2a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:52.456075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982d07c1-bd0a-4b54-b469-85001235fb2a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:52.470641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982d07c1-bd0a-4b54-b469-85001235fb2a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:52.477016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982d07c1-bd0a-4b54-b469-85001235fb2a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:52.479809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982d07c1-bd0a-4b54-b469-85001235fb2a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:52.488123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982d07c1-bd0a-4b54-b469-85001235fb2a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:52.753261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-31652a96-f02c-4d93-acfb-a7d42cb9fcec tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:52.766261 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-31652a96-f02c-4d93-acfb-a7d42cb9fcec tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1511 microversion: 2.1 time: 0.433031 Oct 12 22:15:52.767225 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2266/4035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:52 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1511 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:52.831784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a4ce962b-713f-43d6-a597-cc70c7c71391 tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Calling method '.version_select at 0x7f5122f6b430>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:52.863969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-a4ce962b-713f-43d6-a597-cc70c7c71391 tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 43ec61cb-7fa3-4ee7-b8e7-ea1d8813bed0 does not exist", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:15:52.864538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.security_group_api [None req-a4ce962b-713f-43d6-a597-cc70c7c71391 tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Neutron security group 43ec61cb-7fa3-4ee7-b8e7-ea1d8813bed0 not found {{(pid=120453) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:15:52.865101 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-a4ce962b-713f-43d6-a597-cc70c7c71391 tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] HTTP exception thrown: Security group 43ec61cb-7fa3-4ee7-b8e7-ea1d8813bed0 does not exist Oct 12 22:15:52.865101 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-a16068af-028f-4eed-8b3c-f5e84cbebc7d'] Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a4ce962b-713f-43d6-a597-cc70c7c71391 tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Request method failure captured: Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/os-security-groups/43ec61cb-7fa3-4ee7-b8e7-ea1d8813bed0 HTTP/1.1 Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzyY6niXEloMqd1LLTYACKo3UeaOjGRWjWOXb5-mvZd7lQMix0A3hUGBO7lSaQfNQT3dS2rbVOiLrDIhMFljhS8gQ03gNV006u2jBr98n00CP8brMTFE8gNNKOGTTixUdFr2-vTD9IS6vcKR_W26dhlr2dRsAVrG_7qDKyacUeLqwqk Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1f7056b27be84056a0506e67ca63c25b Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-752860751 Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f7056b27be84056a0506e67ca63c25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f7056b27be84056a0506e67ca63c25b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1f7056b27be84056a0506e67ca63c25b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1f7056b27be84056a0506e67ca63c25b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-752860751 Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1f7056b27be84056a0506e67ca63c25b Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-752860751 Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupsNegativeTestJSON-752860751-project Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: eeade8501d2a4bbc84a67d0ac90f6da3 Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-752860751-project Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: exception: Security group 43ec61cb-7fa3-4ee7-b8e7-ea1d8813bed0 does not exist Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-a16068af-028f-4eed-8b3c-f5e84cbebc7d'] Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '43ec61cb-7fa3-4ee7-b8e7-ea1d8813bed0'} Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:15:52.867063 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 43ec61cb-7fa3-4ee7-b8e7-ea1d8813bed0 does not exist Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a16068af-028f-4eed-8b3c-f5e84cbebc7d'] Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 43ec61cb-7fa3-4ee7-b8e7-ea1d8813bed0 does not exist Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a16068af-028f-4eed-8b3c-f5e84cbebc7d'] Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 43ec61cb-7fa3-4ee7-b8e7-ea1d8813bed0 does not exist Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a16068af-028f-4eed-8b3c-f5e84cbebc7d'] Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 43ec61cb-7fa3-4ee7-b8e7-ea1d8813bed0 does not exist Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a16068af-028f-4eed-8b3c-f5e84cbebc7d'] Oct 12 22:15:52.872864 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:52.878276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a4ce962b-713f-43d6-a597-cc70c7c71391 tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Returning 404 to user: Security group 43ec61cb-7fa3-4ee7-b8e7-ea1d8813bed0 does not exist Oct 12 22:15:52.878276 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-a16068af-028f-4eed-8b3c-f5e84cbebc7d'] {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:15:52.878276 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a4ce962b-713f-43d6-a597-cc70c7c71391 tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/43ec61cb-7fa3-4ee7-b8e7-ea1d8813bed0" status: 404 len: 194 microversion: 2.1 time: 0.109355 Oct 12 22:15:52.878276 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2267/4036] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:15:52 2022] DELETE /compute/v2.1/os-security-groups/43ec61cb-7fa3-4ee7-b8e7-ea1d8813bed0 => generated 194 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:15:52.888052 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c10a6431-abb6-4303-839b-9443fb366760 tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004271 Oct 12 22:15:52.889131 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2268/4037] 10.222.0.16 () {58 vars in 1164 bytes} [Wed Oct 12 22:15:52 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 12 22:15:52.900644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bf871242-26a3-4f21-9427-8f842e793298 tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Calling method '.version_select at 0x7f5122f11ee0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:53.125780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-982d07c1-bd0a-4b54-b469-85001235fb2a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:53.140418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-982d07c1-bd0a-4b54-b469-85001235fb2a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:53.147977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-982d07c1-bd0a-4b54-b469-85001235fb2a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:53.149825 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-982d07c1-bd0a-4b54-b469-85001235fb2a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.731196 Oct 12 22:15:53.162571 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bf871242-26a3-4f21-9427-8f842e793298 tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.267015 Oct 12 22:15:53.163153 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2269/4038] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 12 22:15:52 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:15:53.171142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8e0aeb00-dfc5-4fce-b293-6916dabb51db tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:53.171527 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1770/4039] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:52 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:15:53.172210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8e0aeb00-dfc5-4fce-b293-6916dabb51db tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:53.182917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e0aeb00-dfc5-4fce-b293-6916dabb51db tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:53.183452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e0aeb00-dfc5-4fce-b293-6916dabb51db tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:53.183897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e0aeb00-dfc5-4fce-b293-6916dabb51db tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:53.190156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e0aeb00-dfc5-4fce-b293-6916dabb51db tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:53.190743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1a28993-7160-4fce-a8b4-b412728df786 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:53.191993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a1a28993-7160-4fce-a8b4-b412728df786 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: b66ff558-28a9-418c-a920-2b8f0ec8009a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:53.194721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e0aeb00-dfc5-4fce-b293-6916dabb51db tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:53.195303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e0aeb00-dfc5-4fce-b293-6916dabb51db tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:53.199393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1a28993-7160-4fce-a8b4-b412728df786 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:53.209831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1a28993-7160-4fce-a8b4-b412728df786 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:53.210531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1a28993-7160-4fce-a8b4-b412728df786 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:53.211464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1a28993-7160-4fce-a8b4-b412728df786 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:53.227632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1a28993-7160-4fce-a8b4-b412728df786 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:53.228385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1a28993-7160-4fce-a8b4-b412728df786 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:53.260918 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-a1a28993-7160-4fce-a8b4-b412728df786 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] HTTP exception thrown: Instance b66ff558-28a9-418c-a920-2b8f0ec8009a could not be found. Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1a28993-7160-4fce-a8b4-b412728df786 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Request method failure captured: Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a HTTP/1.1 Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzwglINEGlDOr9BocY5wO9Xx43qqChsjlqD9r61HmaIIEL6djOCkMBDTPWahASzdxBY-IxGgwHeVTq3saYQxSiCfGBziJflEANUhDnl0qNNSNbnWdyn825Mt-A7NcL8fanNSlgyJCBOxpmZTnNkYN5hmKUrlCsq_TM6iJjMlS6r6Deg Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a107edadb364defb4f2c408969c097c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a107edadb364defb4f2c408969c097c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: a2c263e74d274bef8094b9d7ecfc820b Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance b66ff558-28a9-418c-a920-2b8f0ec8009a could not be found. Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'b66ff558-28a9-418c-a920-2b8f0ec8009a'} Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b66ff558-28a9-418c-a920-2b8f0ec8009a could not be found. Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b66ff558-28a9-418c-a920-2b8f0ec8009a could not be found. Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.268180 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.273604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.273604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.273604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:53.273604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:53.273604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:15:53.273604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:15:53.273604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b66ff558-28a9-418c-a920-2b8f0ec8009a could not be found. Oct 12 22:15:53.273604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.276142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1a28993-7160-4fce-a8b4-b412728df786 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Returning 404 to user: Instance b66ff558-28a9-418c-a920-2b8f0ec8009a could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:15:53.277231 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a1a28993-7160-4fce-a8b4-b412728df786 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a" status: 404 len: 111 microversion: 2.1 time: 0.104019 Oct 12 22:15:53.277961 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1771/4040] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:53 2022] GET /compute/v2.1/servers/b66ff558-28a9-418c-a920-2b8f0ec8009a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:15:53.284039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2ce232b3-228e-45f3-a365-2a9a459ffbcb tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Calling method '.version_select at 0x7f51233bef70>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:53.401014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8e0aeb00-dfc5-4fce-b293-6916dabb51db tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:53.413009 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8e0aeb00-dfc5-4fce-b293-6916dabb51db tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.248145 Oct 12 22:15:53.414879 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2270/4041] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:53 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:53.429880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-57227df6-f306-4f34-93f7-2fbefea1129c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '.version_select at 0x7f5122f25670>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:53.477016 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-57227df6-f306-4f34-93f7-2fbefea1129c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] HTTP exception thrown: Image not found. Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-57227df6-f306-4f34-93f7-2fbefea1129c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Request method failure captured: Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/images/d6037a57-c73a-4c58-8a57-7b87f3ff2f07 HTTP/1.1 Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwglINEGlDOr9BocY5wO9Xx43qqChsjlqD9r61HmaIIEL6djOCkMBDTPWahASzdxBY-IxGgwHeVTq3saYQxSiCfGBziJflEANUhDnl0qNNSNbnWdyn825Mt-A7NcL8fanNSlgyJCBOxpmZTnNkYN5hmKUrlCsq_TM6iJjMlS6r6Deg Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a107edadb364defb4f2c408969c097c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a107edadb364defb4f2c408969c097c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a2c263e74d274bef8094b9d7ecfc820b Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: exception: Image not found. Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'd6037a57-c73a-4c58-8a57-7b87f3ff2f07'} Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d6037a57-c73a-4c58-8a57-7b87f3ff2f07 to delete Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d6037a57-c73a-4c58-8a57-7b87f3ff2f07 could not be found. Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.480036 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:15:53.486367 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.490348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-57227df6-f306-4f34-93f7-2fbefea1129c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Returning 404 to user: Image not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:15:53.491517 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-57227df6-f306-4f34-93f7-2fbefea1129c tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "DELETE /compute/v2.1/images/d6037a57-c73a-4c58-8a57-7b87f3ff2f07" status: 404 len: 62 microversion: 2.1 time: 0.072695 Oct 12 22:15:53.492312 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2271/4042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:53 2022] DELETE /compute/v2.1/images/d6037a57-c73a-4c58-8a57-7b87f3ff2f07 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:15:53.501202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-44dfb786-92f8-40c7-bade-07bb9e7dcd1b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:53.502677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-44dfb786-92f8-40c7-bade-07bb9e7dcd1b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:53.511598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44dfb786-92f8-40c7-bade-07bb9e7dcd1b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:53.513045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44dfb786-92f8-40c7-bade-07bb9e7dcd1b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:53.513755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44dfb786-92f8-40c7-bade-07bb9e7dcd1b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:53.514848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44dfb786-92f8-40c7-bade-07bb9e7dcd1b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:53.515657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44dfb786-92f8-40c7-bade-07bb9e7dcd1b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:53.516342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44dfb786-92f8-40c7-bade-07bb9e7dcd1b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:53.537845 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-44dfb786-92f8-40c7-bade-07bb9e7dcd1b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] HTTP exception thrown: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-44dfb786-92f8-40c7-bade-07bb9e7dcd1b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Request method failure captured: Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd HTTP/1.1 Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwglINEGlDOr9BocY5wO9Xx43qqChsjlqD9r61HmaIIEL6djOCkMBDTPWahASzdxBY-IxGgwHeVTq3saYQxSiCfGBziJflEANUhDnl0qNNSNbnWdyn825Mt-A7NcL8fanNSlgyJCBOxpmZTnNkYN5hmKUrlCsq_TM6iJjMlS6r6Deg Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a107edadb364defb4f2c408969c097c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a107edadb364defb4f2c408969c097c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a2c263e74d274bef8094b9d7ecfc820b Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'ed9f061a-d6d4-4590-8e8e-e2891a1a68bd'} Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:15:53.541061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:15:53.545781 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. Oct 12 22:15:53.545781 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.545781 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.545781 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.545781 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.545781 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:53.545781 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:53.545781 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:15:53.545781 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:15:53.545781 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. Oct 12 22:15:53.545781 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.548424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-44dfb786-92f8-40c7-bade-07bb9e7dcd1b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Returning 404 to user: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:15:53.550432 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-44dfb786-92f8-40c7-bade-07bb9e7dcd1b tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 404 len: 111 microversion: 2.1 time: 0.053698 Oct 12 22:15:53.551703 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2272/4043] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:15:53 2022] DELETE /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:15:53.561979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fa958b82-5816-44f5-90c9-d491b22ad079 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:53.563559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fa958b82-5816-44f5-90c9-d491b22ad079 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: ed9f061a-d6d4-4590-8e8e-e2891a1a68bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:53.566849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG neutronclient.v2_0.client [None req-2ce232b3-228e-45f3-a365-2a9a459ffbcb tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120452) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:15:53.567571 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-2ce232b3-228e-45f3-a365-2a9a459ffbcb tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 12 22:15:53.567571 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-071e0978-9de4-4590-a092-e381d20f3b3f'] Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2ce232b3-228e-45f3-a365-2a9a459ffbcb tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Request method failure captured: Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/os-security-groups/caba2972-2011-45d7-8728-fc481fd92da8 HTTP/1.1 Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzyY6niXEloMqd1LLTYACKo3UeaOjGRWjWOXb5-mvZd7lQMix0A3hUGBO7lSaQfNQT3dS2rbVOiLrDIhMFljhS8gQ03gNV006u2jBr98n00CP8brMTFE8gNNKOGTTixUdFr2-vTD9IS6vcKR_W26dhlr2dRsAVrG_7qDKyacUeLqwqk Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1f7056b27be84056a0506e67ca63c25b Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-752860751 Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f7056b27be84056a0506e67ca63c25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f7056b27be84056a0506e67ca63c25b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1f7056b27be84056a0506e67ca63c25b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1f7056b27be84056a0506e67ca63c25b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-752860751 Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1f7056b27be84056a0506e67ca63c25b Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-752860751 Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-SecurityGroupsNegativeTestJSON-752860751-project Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: eeade8501d2a4bbc84a67d0ac90f6da3 Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-752860751-project Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: exception: Insufficient rights for removing default security group. Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-071e0978-9de4-4590-a092-e381d20f3b3f'] Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'caba2972-2011-45d7-8728-fc481fd92da8'} Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:15:53.569473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-071e0978-9de4-4590-a092-e381d20f3b3f'] Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-071e0978-9de4-4590-a092-e381d20f3b3f'] Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-071e0978-9de4-4590-a092-e381d20f3b3f'] Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-071e0978-9de4-4590-a092-e381d20f3b3f'] Oct 12 22:15:53.576393 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.587574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa958b82-5816-44f5-90c9-d491b22ad079 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:53.587574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa958b82-5816-44f5-90c9-d491b22ad079 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:53.587574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa958b82-5816-44f5-90c9-d491b22ad079 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:53.587574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa958b82-5816-44f5-90c9-d491b22ad079 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:53.587574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa958b82-5816-44f5-90c9-d491b22ad079 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:53.587574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa958b82-5816-44f5-90c9-d491b22ad079 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:53.588667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2ce232b3-228e-45f3-a365-2a9a459ffbcb tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 12 22:15:53.588667 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-071e0978-9de4-4590-a092-e381d20f3b3f'] {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:15:53.589244 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2ce232b3-228e-45f3-a365-2a9a459ffbcb tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/caba2972-2011-45d7-8728-fc481fd92da8" status: 400 len: 182 microversion: 2.1 time: 0.307986 Oct 12 22:15:53.590034 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1772/4044] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:15:53 2022] DELETE /compute/v2.1/os-security-groups/caba2972-2011-45d7-8728-fc481fd92da8 => generated 182 bytes in 311 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:15:53.598964 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-fa958b82-5816-44f5-90c9-d491b22ad079 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] HTTP exception thrown: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fa958b82-5816-44f5-90c9-d491b22ad079 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Request method failure captured: Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd HTTP/1.1 Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwglINEGlDOr9BocY5wO9Xx43qqChsjlqD9r61HmaIIEL6djOCkMBDTPWahASzdxBY-IxGgwHeVTq3saYQxSiCfGBziJflEANUhDnl0qNNSNbnWdyn825Mt-A7NcL8fanNSlgyJCBOxpmZTnNkYN5hmKUrlCsq_TM6iJjMlS6r6Deg Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a107edadb364defb4f2c408969c097c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a107edadb364defb4f2c408969c097c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a2c263e74d274bef8094b9d7ecfc820b Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'ed9f061a-d6d4-4590-8e8e-e2891a1a68bd'} Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.600920 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.605759 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.605759 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.605759 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:53.605759 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:53.605759 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:15:53.605759 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:15:53.605759 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. Oct 12 22:15:53.605759 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.605759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fa958b82-5816-44f5-90c9-d491b22ad079 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Returning 404 to user: Instance ed9f061a-d6d4-4590-8e8e-e2891a1a68bd could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:15:53.605759 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fa958b82-5816-44f5-90c9-d491b22ad079 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd" status: 404 len: 111 microversion: 2.1 time: 0.045372 Oct 12 22:15:53.609476 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2273/4045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:53 2022] GET /compute/v2.1/servers/ed9f061a-d6d4-4590-8e8e-e2891a1a68bd => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:15:53.613029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-46396f97-ead0-488d-9205-eb5c843cdc04 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '.version_select at 0x7f5122f6baf0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:53.624253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-44d78863-a7e1-4cf1-8b58-9250d8a5fd0e tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Calling method '.version_select at 0x7f51233be8b0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:53.640671 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-46396f97-ead0-488d-9205-eb5c843cdc04 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1350115581" status: 202 len: 0 microversion: 2.1 time: 0.031713 Oct 12 22:15:53.641249 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2274/4046] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 12 22:15:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1350115581 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:15:53.707727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG neutronclient.v2_0.client [None req-44d78863-a7e1-4cf1-8b58-9250d8a5fd0e tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2c300570-f0b2-4752-95f5-0cecc505ba99 does not exist", "detail": ""}} {{(pid=120452) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:15:53.708543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.security_group_api [None req-44d78863-a7e1-4cf1-8b58-9250d8a5fd0e tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Neutron security group 2c300570-f0b2-4752-95f5-0cecc505ba99 not found {{(pid=120452) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:15:53.709058 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-44d78863-a7e1-4cf1-8b58-9250d8a5fd0e tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] HTTP exception thrown: Security group 2c300570-f0b2-4752-95f5-0cecc505ba99 does not exist Oct 12 22:15:53.709058 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-8e8d3e58-9047-492c-aad5-54cf437df423'] Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-44d78863-a7e1-4cf1-8b58-9250d8a5fd0e tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Request method failure captured: Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-security-groups/2c300570-f0b2-4752-95f5-0cecc505ba99 HTTP/1.1 Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzyY6niXEloMqd1LLTYACKo3UeaOjGRWjWOXb5-mvZd7lQMix0A3hUGBO7lSaQfNQT3dS2rbVOiLrDIhMFljhS8gQ03gNV006u2jBr98n00CP8brMTFE8gNNKOGTTixUdFr2-vTD9IS6vcKR_W26dhlr2dRsAVrG_7qDKyacUeLqwqk Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1f7056b27be84056a0506e67ca63c25b Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-752860751 Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f7056b27be84056a0506e67ca63c25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f7056b27be84056a0506e67ca63c25b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1f7056b27be84056a0506e67ca63c25b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1f7056b27be84056a0506e67ca63c25b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-752860751 Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1f7056b27be84056a0506e67ca63c25b Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-752860751 Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-SecurityGroupsNegativeTestJSON-752860751-project Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: eeade8501d2a4bbc84a67d0ac90f6da3 Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-752860751-project Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: exception: Security group 2c300570-f0b2-4752-95f5-0cecc505ba99 does not exist Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-8e8d3e58-9047-492c-aad5-54cf437df423'] Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '2c300570-f0b2-4752-95f5-0cecc505ba99'} Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:15:53.711176 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2c300570-f0b2-4752-95f5-0cecc505ba99 does not exist Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e8d3e58-9047-492c-aad5-54cf437df423'] Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2c300570-f0b2-4752-95f5-0cecc505ba99 does not exist Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e8d3e58-9047-492c-aad5-54cf437df423'] Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2c300570-f0b2-4752-95f5-0cecc505ba99 does not exist Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e8d3e58-9047-492c-aad5-54cf437df423'] Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2c300570-f0b2-4752-95f5-0cecc505ba99 does not exist Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e8d3e58-9047-492c-aad5-54cf437df423'] Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-44d78863-a7e1-4cf1-8b58-9250d8a5fd0e tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Returning 404 to user: Security group 2c300570-f0b2-4752-95f5-0cecc505ba99 does not exist Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: Neutron server returns request_ids: ['req-8e8d3e58-9047-492c-aad5-54cf437df423'] {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-44d78863-a7e1-4cf1-8b58-9250d8a5fd0e tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/2c300570-f0b2-4752-95f5-0cecc505ba99" status: 404 len: 194 microversion: 2.1 time: 0.114185 Oct 12 22:15:53.717616 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1773/4047] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 12 22:15:53 2022] GET /compute/v2.1/os-security-groups/2c300570-f0b2-4752-95f5-0cecc505ba99 => generated 194 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:15:53.727526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bbebdd1b-eff2-4b2d-81c6-d0e5f87a188c tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Action: 'update', calling method: .version_select at 0x7f5122f01310>, body: {"security_group": {"name": "tempest-sg-292799855", "description": "tempest-description-1654651000"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:53.796476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4b9bf069-28e1-4a30-b52a-297907a839f0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:53.797333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4b9bf069-28e1-4a30-b52a-297907a839f0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:53.807661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b9bf069-28e1-4a30-b52a-297907a839f0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:53.809345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b9bf069-28e1-4a30-b52a-297907a839f0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:53.811498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b9bf069-28e1-4a30-b52a-297907a839f0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:53.814265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b9bf069-28e1-4a30-b52a-297907a839f0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:53.815336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b9bf069-28e1-4a30-b52a-297907a839f0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:53.817076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b9bf069-28e1-4a30-b52a-297907a839f0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:53.846280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG neutronclient.v2_0.client [None req-bbebdd1b-eff2-4b2d-81c6-d0e5f87a188c tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 409e4eb4-731a-4cc0-84aa-e877df2b01d7 does not exist", "detail": ""}} {{(pid=120453) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:15:53.846912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.security_group_api [None req-bbebdd1b-eff2-4b2d-81c6-d0e5f87a188c tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Neutron security group 409e4eb4-731a-4cc0-84aa-e877df2b01d7 not found {{(pid=120453) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:15:53.850129 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-bbebdd1b-eff2-4b2d-81c6-d0e5f87a188c tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] HTTP exception thrown: Security group 409e4eb4-731a-4cc0-84aa-e877df2b01d7 does not exist Oct 12 22:15:53.850129 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-d904b527-580e-4cf7-8430-d434e31ee226'] Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bbebdd1b-eff2-4b2d-81c6-d0e5f87a188c tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Request method failure captured: Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: request: PUT /compute/v2.1/os-security-groups/409e4eb4-731a-4cc0-84aa-e877df2b01d7 HTTP/1.1 Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 101 Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzyY6niXEloMqd1LLTYACKo3UeaOjGRWjWOXb5-mvZd7lQMix0A3hUGBO7lSaQfNQT3dS2rbVOiLrDIhMFljhS8gQ03gNV006u2jBr98n00CP8brMTFE8gNNKOGTTixUdFr2-vTD9IS6vcKR_W26dhlr2dRsAVrG_7qDKyacUeLqwqk Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1f7056b27be84056a0506e67ca63c25b Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-752860751 Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f7056b27be84056a0506e67ca63c25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f7056b27be84056a0506e67ca63c25b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1f7056b27be84056a0506e67ca63c25b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1f7056b27be84056a0506e67ca63c25b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-752860751 Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1f7056b27be84056a0506e67ca63c25b Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-752860751 Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-SecurityGroupsNegativeTestJSON-752860751-project Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: eeade8501d2a4bbc84a67d0ac90f6da3 Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-752860751-project Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: {"security_group": {"name": "tempest-sg-292799855", "description": "tempest-description-1654651000"}} Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: exception: Security group 409e4eb4-731a-4cc0-84aa-e877df2b01d7 does not exist Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-d904b527-580e-4cf7-8430-d434e31ee226'] Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '409e4eb4-731a-4cc0-84aa-e877df2b01d7', 'body': {'security_group': {'name': 'tempest-sg-292799855', 'description': 'tempest-description-1654651000'}}} Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:15:53.853401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 409e4eb4-731a-4cc0-84aa-e877df2b01d7 does not exist Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d904b527-580e-4cf7-8430-d434e31ee226'] Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 409e4eb4-731a-4cc0-84aa-e877df2b01d7 does not exist Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d904b527-580e-4cf7-8430-d434e31ee226'] Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 409e4eb4-731a-4cc0-84aa-e877df2b01d7 does not exist Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d904b527-580e-4cf7-8430-d434e31ee226'] Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 409e4eb4-731a-4cc0-84aa-e877df2b01d7 does not exist Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d904b527-580e-4cf7-8430-d434e31ee226'] Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bbebdd1b-eff2-4b2d-81c6-d0e5f87a188c tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] Returning 404 to user: Security group 409e4eb4-731a-4cc0-84aa-e877df2b01d7 does not exist Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: Neutron server returns request_ids: ['req-d904b527-580e-4cf7-8430-d434e31ee226'] {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bbebdd1b-eff2-4b2d-81c6-d0e5f87a188c tempest-SecurityGroupsNegativeTestJSON-752860751 tempest-SecurityGroupsNegativeTestJSON-752860751-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/409e4eb4-731a-4cc0-84aa-e877df2b01d7" status: 404 len: 194 microversion: 2.1 time: 0.133010 Oct 12 22:15:53.863933 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2275/4048] 10.222.0.16 () {60 vars in 1290 bytes} [Wed Oct 12 22:15:53 2022] PUT /compute/v2.1/os-security-groups/409e4eb4-731a-4cc0-84aa-e877df2b01d7 => generated 194 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:15:54.180002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c9b2116f-3ac1-4d0f-b6a8-7c02c416596e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:54.181030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c9b2116f-3ac1-4d0f-b6a8-7c02c416596e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:54.195973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9b2116f-3ac1-4d0f-b6a8-7c02c416596e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:54.198073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9b2116f-3ac1-4d0f-b6a8-7c02c416596e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:54.200790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9b2116f-3ac1-4d0f-b6a8-7c02c416596e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:54.204364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9b2116f-3ac1-4d0f-b6a8-7c02c416596e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:54.205717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9b2116f-3ac1-4d0f-b6a8-7c02c416596e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:54.206642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9b2116f-3ac1-4d0f-b6a8-7c02c416596e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:54.684073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4b9bf069-28e1-4a30-b52a-297907a839f0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:54.702951 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4b9bf069-28e1-4a30-b52a-297907a839f0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1511 microversion: 2.1 time: 0.911183 Oct 12 22:15:54.708342 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1774/4049] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:53 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1511 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:15:54.734311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1256966-fcae-4029-aa3b-d49f53df481b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:54.735437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a1256966-fcae-4029-aa3b-d49f53df481b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:54.763450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1256966-fcae-4029-aa3b-d49f53df481b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:54.766453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1256966-fcae-4029-aa3b-d49f53df481b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:54.767093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1256966-fcae-4029-aa3b-d49f53df481b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:54.773568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1256966-fcae-4029-aa3b-d49f53df481b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:54.780358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1256966-fcae-4029-aa3b-d49f53df481b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:54.782308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1256966-fcae-4029-aa3b-d49f53df481b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:55.229009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a1256966-fcae-4029-aa3b-d49f53df481b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:55.246380 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a1256966-fcae-4029-aa3b-d49f53df481b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.534979 Oct 12 22:15:55.249004 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1775/4050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:54 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:55.364471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c9b2116f-3ac1-4d0f-b6a8-7c02c416596e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:55.379165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c9b2116f-3ac1-4d0f-b6a8-7c02c416596e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:55.381023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c9b2116f-3ac1-4d0f-b6a8-7c02c416596e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:55.383123 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c9b2116f-3ac1-4d0f-b6a8-7c02c416596e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 1.208974 Oct 12 22:15:55.384318 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2276/4051] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:54 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:15:55.733244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-46d852fd-6c2a-4fda-9057-560b93cfa621 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:55.735590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-46d852fd-6c2a-4fda-9057-560b93cfa621 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:55.792234 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46d852fd-6c2a-4fda-9057-560b93cfa621 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:55.797492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46d852fd-6c2a-4fda-9057-560b93cfa621 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:55.798067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46d852fd-6c2a-4fda-9057-560b93cfa621 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:55.798847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46d852fd-6c2a-4fda-9057-560b93cfa621 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:55.820244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46d852fd-6c2a-4fda-9057-560b93cfa621 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:55.820244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46d852fd-6c2a-4fda-9057-560b93cfa621 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:55.820244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:55.943669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0634bec3-d0d2-42a3-b2c5-2f74fe9e883d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '.version_select at 0x7f51230de310>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:55.988408 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-0634bec3-d0d2-42a3-b2c5-2f74fe9e883d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] HTTP exception thrown: Image not found. Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0634bec3-d0d2-42a3-b2c5-2f74fe9e883d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Request method failure captured: Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/images/1e3e1947-9993-47e8-aafd-6d537fbccce8 HTTP/1.1 Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwglINEGlDOr9BocY5wO9Xx43qqChsjlqD9r61HmaIIEL6djOCkMBDTPWahASzdxBY-IxGgwHeVTq3saYQxSiCfGBziJflEANUhDnl0qNNSNbnWdyn825Mt-A7NcL8fanNSlgyJCBOxpmZTnNkYN5hmKUrlCsq_TM6iJjMlS6r6Deg Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a107edadb364defb4f2c408969c097c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a107edadb364defb4f2c408969c097c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a2c263e74d274bef8094b9d7ecfc820b Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: exception: Image not found. Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1e3e1947-9993-47e8-aafd-6d537fbccce8'} Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1e3e1947-9993-47e8-aafd-6d537fbccce8 to delete Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1e3e1947-9993-47e8-aafd-6d537fbccce8 could not be found. Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:55.990448 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:15:55.996022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:55.998950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0634bec3-d0d2-42a3-b2c5-2f74fe9e883d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Returning 404 to user: Image not found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:15:56.000035 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0634bec3-d0d2-42a3-b2c5-2f74fe9e883d tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "DELETE /compute/v2.1/images/1e3e1947-9993-47e8-aafd-6d537fbccce8" status: 404 len: 62 microversion: 2.1 time: 0.070577 Oct 12 22:15:56.004061 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2277/4052] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:55 2022] DELETE /compute/v2.1/images/1e3e1947-9993-47e8-aafd-6d537fbccce8 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:15:56.009885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-86632793-e875-46f5-8fcb-da234825f642 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:56.010624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-86632793-e875-46f5-8fcb-da234825f642 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:56.019785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:15:56.021959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86632793-e875-46f5-8fcb-da234825f642 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:56.026827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86632793-e875-46f5-8fcb-da234825f642 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:56.027577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86632793-e875-46f5-8fcb-da234825f642 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:56.029248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86632793-e875-46f5-8fcb-da234825f642 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:56.029865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86632793-e875-46f5-8fcb-da234825f642 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:56.030887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86632793-e875-46f5-8fcb-da234825f642 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:56.072752 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-86632793-e875-46f5-8fcb-da234825f642 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] HTTP exception thrown: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-86632793-e875-46f5-8fcb-da234825f642 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Request method failure captured: Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 HTTP/1.1 Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwglINEGlDOr9BocY5wO9Xx43qqChsjlqD9r61HmaIIEL6djOCkMBDTPWahASzdxBY-IxGgwHeVTq3saYQxSiCfGBziJflEANUhDnl0qNNSNbnWdyn825Mt-A7NcL8fanNSlgyJCBOxpmZTnNkYN5hmKUrlCsq_TM6iJjMlS6r6Deg Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a107edadb364defb4f2c408969c097c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a107edadb364defb4f2c408969c097c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a2c263e74d274bef8094b9d7ecfc820b Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '722e8b56-e78f-4dde-af24-cee1dad1be26'} Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:15:56.075707 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:15:56.081400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. Oct 12 22:15:56.081400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:56.081400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:56.081400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:56.081400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:56.081400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:56.081400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:56.081400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:15:56.081400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:15:56.081400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. Oct 12 22:15:56.081400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:56.081400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-86632793-e875-46f5-8fcb-da234825f642 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Returning 404 to user: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:15:56.083497 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-86632793-e875-46f5-8fcb-da234825f642 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "DELETE /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 404 len: 111 microversion: 2.1 time: 0.076902 Oct 12 22:15:56.087006 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2278/4053] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:15:56 2022] DELETE /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:15:56.098013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-10999178-4b7b-4706-8473-c119b7578a50 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:56.099700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-10999178-4b7b-4706-8473-c119b7578a50 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] [instance: 722e8b56-e78f-4dde-af24-cee1dad1be26] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:56.112177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10999178-4b7b-4706-8473-c119b7578a50 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:56.112177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10999178-4b7b-4706-8473-c119b7578a50 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:56.112377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10999178-4b7b-4706-8473-c119b7578a50 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:56.113168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10999178-4b7b-4706-8473-c119b7578a50 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:56.113602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10999178-4b7b-4706-8473-c119b7578a50 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:56.114193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10999178-4b7b-4706-8473-c119b7578a50 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:56.136757 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-10999178-4b7b-4706-8473-c119b7578a50 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] HTTP exception thrown: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-10999178-4b7b-4706-8473-c119b7578a50 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Request method failure captured: Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 HTTP/1.1 Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwglINEGlDOr9BocY5wO9Xx43qqChsjlqD9r61HmaIIEL6djOCkMBDTPWahASzdxBY-IxGgwHeVTq3saYQxSiCfGBziJflEANUhDnl0qNNSNbnWdyn825Mt-A7NcL8fanNSlgyJCBOxpmZTnNkYN5hmKUrlCsq_TM6iJjMlS6r6Deg Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a107edadb364defb4f2c408969c097c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a107edadb364defb4f2c408969c097c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a107edadb364defb4f2c408969c097c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 5a107edadb364defb4f2c408969c097c Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708 Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a2c263e74d274bef8094b9d7ecfc820b Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1492853708-project Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '722e8b56-e78f-4dde-af24-cee1dad1be26'} Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:56.145575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:15:56.150313 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:56.150313 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:15:56.150313 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:15:56.150313 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:15:56.150313 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:15:56.150313 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:15:56.150313 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. Oct 12 22:15:56.150313 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:15:56.150313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-10999178-4b7b-4706-8473-c119b7578a50 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] Returning 404 to user: Instance 722e8b56-e78f-4dde-af24-cee1dad1be26 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:15:56.150313 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-10999178-4b7b-4706-8473-c119b7578a50 tempest-ImagesOneServerNegativeTestJSON-1492853708 tempest-ImagesOneServerNegativeTestJSON-1492853708-project] 10.222.0.16 "GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26" status: 404 len: 111 microversion: 2.1 time: 0.061219 Oct 12 22:15:56.153273 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2279/4054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:56 2022] GET /compute/v2.1/servers/722e8b56-e78f-4dde-af24-cee1dad1be26 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:15:56.273099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-90db6f95-9c6a-4570-9d6a-8878e4b70097 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:56.274333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-90db6f95-9c6a-4570-9d6a-8878e4b70097 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:56.296720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90db6f95-9c6a-4570-9d6a-8878e4b70097 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:56.299408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90db6f95-9c6a-4570-9d6a-8878e4b70097 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:56.300172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90db6f95-9c6a-4570-9d6a-8878e4b70097 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:56.301196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90db6f95-9c6a-4570-9d6a-8878e4b70097 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:56.301881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90db6f95-9c6a-4570-9d6a-8878e4b70097 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:56.302553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90db6f95-9c6a-4570-9d6a-8878e4b70097 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:56.622078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-46d852fd-6c2a-4fda-9057-560b93cfa621 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:56.632083 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-46d852fd-6c2a-4fda-9057-560b93cfa621 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1488 microversion: 2.1 time: 0.906476 Oct 12 22:15:56.635702 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1776/4055] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:55 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1488 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:56.646284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d0283bf4-7d3e-40ad-bb2e-968935819f72 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:56.648353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d0283bf4-7d3e-40ad-bb2e-968935819f72 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:56.663575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0283bf4-7d3e-40ad-bb2e-968935819f72 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:56.664148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0283bf4-7d3e-40ad-bb2e-968935819f72 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:56.664819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0283bf4-7d3e-40ad-bb2e-968935819f72 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:56.670967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0283bf4-7d3e-40ad-bb2e-968935819f72 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:56.671580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0283bf4-7d3e-40ad-bb2e-968935819f72 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:56.672095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0283bf4-7d3e-40ad-bb2e-968935819f72 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:56.787600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-90db6f95-9c6a-4570-9d6a-8878e4b70097 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:56.802607 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-90db6f95-9c6a-4570-9d6a-8878e4b70097 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.533037 Oct 12 22:15:56.817898 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2280/4056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:56 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:56.827437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-629b344c-d474-4b91-b0d8-4da774b41a84 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:56.828437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-629b344c-d474-4b91-b0d8-4da774b41a84 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:56.838221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-629b344c-d474-4b91-b0d8-4da774b41a84 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:56.839320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-629b344c-d474-4b91-b0d8-4da774b41a84 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:56.840079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-629b344c-d474-4b91-b0d8-4da774b41a84 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:56.841743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-629b344c-d474-4b91-b0d8-4da774b41a84 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:56.842501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-629b344c-d474-4b91-b0d8-4da774b41a84 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:56.843152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-629b344c-d474-4b91-b0d8-4da774b41a84 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:56.893311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-629b344c-d474-4b91-b0d8-4da774b41a84 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:15:57.070968 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-629b344c-d474-4b91-b0d8-4da774b41a84 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "DELETE /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 204 len: 0 microversion: 2.1 time: 0.251328 Oct 12 22:15:57.071863 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2281/4057] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:15:56 2022] DELETE /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:15:57.085947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-92aa12e6-022e-4600-bbdd-8741e18c5986 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:57.088463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-92aa12e6-022e-4600-bbdd-8741e18c5986 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:57.118944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92aa12e6-022e-4600-bbdd-8741e18c5986 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:57.120233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92aa12e6-022e-4600-bbdd-8741e18c5986 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:57.121188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92aa12e6-022e-4600-bbdd-8741e18c5986 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:57.123223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92aa12e6-022e-4600-bbdd-8741e18c5986 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:57.124242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92aa12e6-022e-4600-bbdd-8741e18c5986 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:57.124921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92aa12e6-022e-4600-bbdd-8741e18c5986 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:57.323813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-92aa12e6-022e-4600-bbdd-8741e18c5986 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:57.338174 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-92aa12e6-022e-4600-bbdd-8741e18c5986 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1494 microversion: 2.1 time: 0.257093 Oct 12 22:15:57.341479 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2282/4058] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:57 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1494 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:57.480739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d0283bf4-7d3e-40ad-bb2e-968935819f72 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:57.498465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d0283bf4-7d3e-40ad-bb2e-968935819f72 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:57.504899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d0283bf4-7d3e-40ad-bb2e-968935819f72 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:57.506141 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d0283bf4-7d3e-40ad-bb2e-968935819f72 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.869035 Oct 12 22:15:57.506726 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1777/4059] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:56 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:57.831395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1cfdf3ff-9c3a-48aa-b46a-18a558e90cad tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:57.832022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1cfdf3ff-9c3a-48aa-b46a-18a558e90cad tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:57.846094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1cfdf3ff-9c3a-48aa-b46a-18a558e90cad tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:57.846930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1cfdf3ff-9c3a-48aa-b46a-18a558e90cad tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:57.847679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1cfdf3ff-9c3a-48aa-b46a-18a558e90cad tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:57.848646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1cfdf3ff-9c3a-48aa-b46a-18a558e90cad tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:57.850093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1cfdf3ff-9c3a-48aa-b46a-18a558e90cad tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:57.850629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1cfdf3ff-9c3a-48aa-b46a-18a558e90cad tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:58.265392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1cfdf3ff-9c3a-48aa-b46a-18a558e90cad tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:58.277654 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1cfdf3ff-9c3a-48aa-b46a-18a558e90cad tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.450651 Oct 12 22:15:58.279504 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2283/4060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:57 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:58.363623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-99e88d0e-0759-4c36-b6c8-d7699d364d40 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:58.364515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-99e88d0e-0759-4c36-b6c8-d7699d364d40 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:58.372019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99e88d0e-0759-4c36-b6c8-d7699d364d40 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:58.372774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99e88d0e-0759-4c36-b6c8-d7699d364d40 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:58.373624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99e88d0e-0759-4c36-b6c8-d7699d364d40 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:58.374520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99e88d0e-0759-4c36-b6c8-d7699d364d40 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:58.375146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99e88d0e-0759-4c36-b6c8-d7699d364d40 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:58.375770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99e88d0e-0759-4c36-b6c8-d7699d364d40 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:58.533891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e928619c-f3d5-4f1a-b791-5b2e2068ca63 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:58.534797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e928619c-f3d5-4f1a-b791-5b2e2068ca63 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:58.542872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e928619c-f3d5-4f1a-b791-5b2e2068ca63 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:58.544091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e928619c-f3d5-4f1a-b791-5b2e2068ca63 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:58.544892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e928619c-f3d5-4f1a-b791-5b2e2068ca63 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:58.545955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e928619c-f3d5-4f1a-b791-5b2e2068ca63 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:58.547408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e928619c-f3d5-4f1a-b791-5b2e2068ca63 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:58.548080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e928619c-f3d5-4f1a-b791-5b2e2068ca63 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:58.794305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-99e88d0e-0759-4c36-b6c8-d7699d364d40 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:58.802905 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-99e88d0e-0759-4c36-b6c8-d7699d364d40 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1494 microversion: 2.1 time: 0.443353 Oct 12 22:15:58.804133 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1778/4061] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:58 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1494 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:15:58.809610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-51f28fd4-1c1e-41a3-b56f-9c92454fc0fd tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Action: 'create', calling method: .version_select at 0x7f512331ce50>, body: {"keypair": {"name": "tempest-keypair-1798670009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1gOHj51nUKGYln4nDdACCs1/PZ+FmonJQHLD3gJABHTdqj3f2IyTyt2Ntdya5SWnMfELCfx7f9MK1hABq3fLJYTearlsrCI1S8qmCcwP0ZApYIaqcEzueGxkZVTvkmfg=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:58.826885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-51f28fd4-1c1e-41a3-b56f-9c92454fc0fd tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Getting quotas for project 6f247890f1bf4ff29af359f4d1cd405c. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:15:58.832703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-51f28fd4-1c1e-41a3-b56f-9c92454fc0fd tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Getting quotas for user def9100040524da08268b700ba75c68a and project 6f247890f1bf4ff29af359f4d1cd405c. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:15:58.880838 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-51f28fd4-1c1e-41a3-b56f-9c92454fc0fd tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.075106 Oct 12 22:15:58.881302 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1779/4062] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 12 22:15:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 22:15:59.026290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e928619c-f3d5-4f1a-b791-5b2e2068ca63 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:59.036062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e928619c-f3d5-4f1a-b791-5b2e2068ca63 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:59.037515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e928619c-f3d5-4f1a-b791-5b2e2068ca63 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:15:59.038675 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e928619c-f3d5-4f1a-b791-5b2e2068ca63 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.509927 Oct 12 22:15:59.053073 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2284/4063] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:15:58 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:15:59.302705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bea1dd1f-46bf-4e83-9f18-f8e97119332a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:59.303308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bea1dd1f-46bf-4e83-9f18-f8e97119332a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:59.325145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bea1dd1f-46bf-4e83-9f18-f8e97119332a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:59.325877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bea1dd1f-46bf-4e83-9f18-f8e97119332a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:59.326489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bea1dd1f-46bf-4e83-9f18-f8e97119332a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:59.334116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bea1dd1f-46bf-4e83-9f18-f8e97119332a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:59.334936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bea1dd1f-46bf-4e83-9f18-f8e97119332a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:59.335399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bea1dd1f-46bf-4e83-9f18-f8e97119332a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:59.630984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-25957868-d306-4ab6-93ec-c1f01c02aa9a req-4c9dd47f-43c2-49f2-8bb6-969367c7cc1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "name": "network-vif-plugged", "status": "completed", "tag": "36ee1470-0e2f-4c4f-8e19-2e2a700d74d0"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:15:59.643815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-25957868-d306-4ab6-93ec-c1f01c02aa9a req-4c9dd47f-43c2-49f2-8bb6-969367c7cc1b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:59.656353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-25957868-d306-4ab6-93ec-c1f01c02aa9a req-4c9dd47f-43c2-49f2-8bb6-969367c7cc1b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:59.670046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-25957868-d306-4ab6-93ec-c1f01c02aa9a req-4c9dd47f-43c2-49f2-8bb6-969367c7cc1b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:59.702570 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-25957868-d306-4ab6-93ec-c1f01c02aa9a req-4c9dd47f-43c2-49f2-8bb6-969367c7cc1b service nova] Creating event network-vif-plugged:36ee1470-0e2f-4c4f-8e19-2e2a700d74d0 for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:15:59.717091 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-25957868-d306-4ab6-93ec-c1f01c02aa9a req-4c9dd47f-43c2-49f2-8bb6-969367c7cc1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090106 Oct 12 22:15:59.718424 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2285/4064] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:15:59.830063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d527c57d-956d-4bfe-be1b-84f0b391f84d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:15:59.830850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d527c57d-956d-4bfe-be1b-84f0b391f84d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:15:59.842954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d527c57d-956d-4bfe-be1b-84f0b391f84d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:59.844077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d527c57d-956d-4bfe-be1b-84f0b391f84d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:59.844785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d527c57d-956d-4bfe-be1b-84f0b391f84d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:15:59.847980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d527c57d-956d-4bfe-be1b-84f0b391f84d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:15:59.848775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d527c57d-956d-4bfe-be1b-84f0b391f84d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:15:59.849276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d527c57d-956d-4bfe-be1b-84f0b391f84d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:00.049945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bea1dd1f-46bf-4e83-9f18-f8e97119332a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:00.060233 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bea1dd1f-46bf-4e83-9f18-f8e97119332a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.762033 Oct 12 22:16:00.064445 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1780/4065] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:59 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:00.088180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f383f092-c0a5-4348-8cdd-de63835b9844 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:00.090499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f383f092-c0a5-4348-8cdd-de63835b9844 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:00.104546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f383f092-c0a5-4348-8cdd-de63835b9844 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:00.105406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f383f092-c0a5-4348-8cdd-de63835b9844 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:00.107571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f383f092-c0a5-4348-8cdd-de63835b9844 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:00.108795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f383f092-c0a5-4348-8cdd-de63835b9844 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:00.110382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f383f092-c0a5-4348-8cdd-de63835b9844 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:00.110999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f383f092-c0a5-4348-8cdd-de63835b9844 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:00.215108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d527c57d-956d-4bfe-be1b-84f0b391f84d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:00.228330 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d527c57d-956d-4bfe-be1b-84f0b391f84d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1452 microversion: 2.1 time: 0.403548 Oct 12 22:16:00.235482 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2286/4066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:15:59 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1452 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:00.788806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-976729f1-2bea-4fc7-9361-c6a022061903 req-59f83eae-3ae6-42fd-a3e1-66aa17afbdcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d18a30-56c9-4666-bb85-83c8a6c0c82c", "name": "network-vif-deleted", "tag": "d3cc0f7a-bbaa-4c36-8dfc-43f33a6b0f5b"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:00.816201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-976729f1-2bea-4fc7-9361-c6a022061903 req-59f83eae-3ae6-42fd-a3e1-66aa17afbdcc service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:00.816915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-976729f1-2bea-4fc7-9361-c6a022061903 req-59f83eae-3ae6-42fd-a3e1-66aa17afbdcc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:00.817375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-976729f1-2bea-4fc7-9361-c6a022061903 req-59f83eae-3ae6-42fd-a3e1-66aa17afbdcc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:00.875308 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-976729f1-2bea-4fc7-9361-c6a022061903 req-59f83eae-3ae6-42fd-a3e1-66aa17afbdcc service nova] Creating event network-vif-deleted:d3cc0f7a-bbaa-4c36-8dfc-43f33a6b0f5b for instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c on n-h2-861111-1 Oct 12 22:16:00.883270 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-976729f1-2bea-4fc7-9361-c6a022061903 req-59f83eae-3ae6-42fd-a3e1-66aa17afbdcc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100378 Oct 12 22:16:00.893269 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2287/4067] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:16:01.094241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8df9127f-560c-4e66-a226-2a88e8bffd06 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:01.095345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8df9127f-560c-4e66-a226-2a88e8bffd06 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:01.104903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f383f092-c0a5-4348-8cdd-de63835b9844 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:01.123597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f383f092-c0a5-4348-8cdd-de63835b9844 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:01.126788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8df9127f-560c-4e66-a226-2a88e8bffd06 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:01.129886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8df9127f-560c-4e66-a226-2a88e8bffd06 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:01.131699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8df9127f-560c-4e66-a226-2a88e8bffd06 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:01.135938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8df9127f-560c-4e66-a226-2a88e8bffd06 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:01.136645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8df9127f-560c-4e66-a226-2a88e8bffd06 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:01.136948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f383f092-c0a5-4348-8cdd-de63835b9844 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:01.141640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8df9127f-560c-4e66-a226-2a88e8bffd06 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:01.145299 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f383f092-c0a5-4348-8cdd-de63835b9844 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 1.064234 Oct 12 22:16:01.149392 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1781/4068] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:00 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:01.262745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b71fea1c-0a82-4a99-99cc-a6f0cee91181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:01.263468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b71fea1c-0a82-4a99-99cc-a6f0cee91181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:01.276074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b71fea1c-0a82-4a99-99cc-a6f0cee91181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:01.276074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b71fea1c-0a82-4a99-99cc-a6f0cee91181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:01.276416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b71fea1c-0a82-4a99-99cc-a6f0cee91181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:01.279186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b71fea1c-0a82-4a99-99cc-a6f0cee91181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:01.279738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b71fea1c-0a82-4a99-99cc-a6f0cee91181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:01.280248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b71fea1c-0a82-4a99-99cc-a6f0cee91181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:01.376355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b71fea1c-0a82-4a99-99cc-a6f0cee91181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:01.376957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b71fea1c-0a82-4a99-99cc-a6f0cee91181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:01.377283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b71fea1c-0a82-4a99-99cc-a6f0cee91181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:01.377741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-b71fea1c-0a82-4a99-99cc-a6f0cee91181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lazy-loading 'fault' on Instance uuid 23d18a30-56c9-4666-bb85-83c8a6c0c82c {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:16:01.467062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8df9127f-560c-4e66-a226-2a88e8bffd06 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:01.483044 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8df9127f-560c-4e66-a226-2a88e8bffd06 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.393505 Oct 12 22:16:01.483957 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2288/4069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:01 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:01.600727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b71fea1c-0a82-4a99-99cc-a6f0cee91181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:01.612576 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b71fea1c-0a82-4a99-99cc-a6f0cee91181 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 200 len: 1304 microversion: 2.1 time: 0.353828 Oct 12 22:16:01.629483 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1782/4070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:01 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 1304 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:01.860064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a82e4cae-709b-4733-ab23-55fc865066de req-88fbafc4-7d2f-4158-ac4e-8a9cd5efd047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "name": "network-vif-plugged", "status": "completed", "tag": "e0247182-2fee-4dd5-a752-f742140f2091"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:01.878683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a82e4cae-709b-4733-ab23-55fc865066de req-88fbafc4-7d2f-4158-ac4e-8a9cd5efd047 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:01.879102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a82e4cae-709b-4733-ab23-55fc865066de req-88fbafc4-7d2f-4158-ac4e-8a9cd5efd047 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:01.879639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a82e4cae-709b-4733-ab23-55fc865066de req-88fbafc4-7d2f-4158-ac4e-8a9cd5efd047 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:01.896848 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a82e4cae-709b-4733-ab23-55fc865066de req-88fbafc4-7d2f-4158-ac4e-8a9cd5efd047 service nova] Creating event network-vif-plugged:e0247182-2fee-4dd5-a752-f742140f2091 for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:16:01.903390 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a82e4cae-709b-4733-ab23-55fc865066de req-88fbafc4-7d2f-4158-ac4e-8a9cd5efd047 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046671 Oct 12 22:16:01.904597 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2289/4071] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:02.172143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8e0c9c01-17b2-407d-8eca-13d939eeb24e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:02.172793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8e0c9c01-17b2-407d-8eca-13d939eeb24e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:02.190529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e0c9c01-17b2-407d-8eca-13d939eeb24e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:02.191443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e0c9c01-17b2-407d-8eca-13d939eeb24e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:02.192151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e0c9c01-17b2-407d-8eca-13d939eeb24e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:02.193830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e0c9c01-17b2-407d-8eca-13d939eeb24e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:02.195594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e0c9c01-17b2-407d-8eca-13d939eeb24e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:02.197408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e0c9c01-17b2-407d-8eca-13d939eeb24e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:02.512506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d2554f3a-f647-4c27-b038-5e1dfb16f85a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:02.514657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d2554f3a-f647-4c27-b038-5e1dfb16f85a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:02.533256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2554f3a-f647-4c27-b038-5e1dfb16f85a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:02.541685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2554f3a-f647-4c27-b038-5e1dfb16f85a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:02.542374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2554f3a-f647-4c27-b038-5e1dfb16f85a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:02.544746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2554f3a-f647-4c27-b038-5e1dfb16f85a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:02.545856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2554f3a-f647-4c27-b038-5e1dfb16f85a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:02.547518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2554f3a-f647-4c27-b038-5e1dfb16f85a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:02.554819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:02.787446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d2554f3a-f647-4c27-b038-5e1dfb16f85a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:02.803631 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d2554f3a-f647-4c27-b038-5e1dfb16f85a tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1516 microversion: 2.1 time: 0.301047 Oct 12 22:16:02.804972 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2290/4072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:02 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1516 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:16:02.811424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-98cf23f3-1650-4b16-a292-6f3bb700ea62 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:02.812637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-98cf23f3-1650-4b16-a292-6f3bb700ea62 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:02.820148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98cf23f3-1650-4b16-a292-6f3bb700ea62 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:02.820895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98cf23f3-1650-4b16-a292-6f3bb700ea62 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:02.824004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98cf23f3-1650-4b16-a292-6f3bb700ea62 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:02.826132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98cf23f3-1650-4b16-a292-6f3bb700ea62 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:02.826963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98cf23f3-1650-4b16-a292-6f3bb700ea62 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:02.827672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98cf23f3-1650-4b16-a292-6f3bb700ea62 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:02.848145 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-98cf23f3-1650-4b16-a292-6f3bb700ea62 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-98cf23f3-1650-4b16-a292-6f3bb700ea62 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c HTTP/1.1 Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '23d18a30-56c9-4666-bb85-83c8a6c0c82c'} Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:02.850614 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:02.855228 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:02.855228 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:02.855228 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:02.855228 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:02.855228 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:02.855228 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. Oct 12 22:16:02.855228 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:02.855228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-98cf23f3-1650-4b16-a292-6f3bb700ea62 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:02.860795 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-98cf23f3-1650-4b16-a292-6f3bb700ea62 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 404 len: 111 microversion: 2.1 time: 0.050195 Oct 12 22:16:02.860795 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2291/4073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:02 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:03.065067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-535302527", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "8a2bd9d3-e80d-4911-bb4a-296de8e90165"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:03.209148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] validate_networks() for [('8a2bd9d3-e80d-4911-bb4a-296de8e90165', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:16:03.218255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8e0c9c01-17b2-407d-8eca-13d939eeb24e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:03.239139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8e0c9c01-17b2-407d-8eca-13d939eeb24e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:03.245706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8e0c9c01-17b2-407d-8eca-13d939eeb24e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:03.250824 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8e0c9c01-17b2-407d-8eca-13d939eeb24e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 1.082773 Oct 12 22:16:03.256254 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1783/4074] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:02 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:03.810944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:16:03.812072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:16:03.812677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:16:03.813093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:16:03.813523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:16:03.825172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:03.826081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:03.826331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b5337938-0524-41d6-bc93-17cd821e547e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:03.826711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:03.826949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b5337938-0524-41d6-bc93-17cd821e547e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:03.827473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:03.828236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:03.828873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:03.835685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5337938-0524-41d6-bc93-17cd821e547e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:03.836629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5337938-0524-41d6-bc93-17cd821e547e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:03.837298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5337938-0524-41d6-bc93-17cd821e547e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:03.838954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5337938-0524-41d6-bc93-17cd821e547e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:03.839659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5337938-0524-41d6-bc93-17cd821e547e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:03.841380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5337938-0524-41d6-bc93-17cd821e547e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:03.865209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Getting quotas for project 4b898b5d0208478e996b7fee2060ed64. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:16:03.882301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Getting quotas for user 11096cece79f4b8fad4b92270f51b299 and project 4b898b5d0208478e996b7fee2060ed64. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:16:03.896721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:16:03.899726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:16:03.966985 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a64bc408-284d-4a10-a3f9-18b40de99580 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908639 Oct 12 22:16:03.978623 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2292/4075] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:16:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:16:03.978623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-2b7624eb-d931-4f85-b531-e9cb1ed13ab8 req-01fa3b97-5115-4154-ac74-eb149b602d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "name": "network-vif-plugged", "status": "completed", "tag": "8ed1a573-7211-4891-abce-2146ad739e4b"}, {"server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "name": "network-vif-plugged", "status": "completed", "tag": "52643e8f-ddae-453b-8aab-3913248201fd"}, {"server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "name": "network-vif-plugged", "status": "completed", "tag": "880216ed-7173-47d4-946d-37845055cc79"}, {"server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "name": "network-vif-plugged", "status": "completed", "tag": "dfea1e40-7a7f-4c90-a02f-bdc09fd3cd9c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:03.990219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2b7624eb-d931-4f85-b531-e9cb1ed13ab8 req-01fa3b97-5115-4154-ac74-eb149b602d0b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:03.990695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2b7624eb-d931-4f85-b531-e9cb1ed13ab8 req-01fa3b97-5115-4154-ac74-eb149b602d0b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:03.991376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2b7624eb-d931-4f85-b531-e9cb1ed13ab8 req-01fa3b97-5115-4154-ac74-eb149b602d0b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:04.004165 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-2b7624eb-d931-4f85-b531-e9cb1ed13ab8 req-01fa3b97-5115-4154-ac74-eb149b602d0b service nova] Creating event network-vif-plugged:8ed1a573-7211-4891-abce-2146ad739e4b for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:16:04.005092 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-2b7624eb-d931-4f85-b531-e9cb1ed13ab8 req-01fa3b97-5115-4154-ac74-eb149b602d0b service nova] Creating event network-vif-plugged:52643e8f-ddae-453b-8aab-3913248201fd for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:16:04.006024 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-2b7624eb-d931-4f85-b531-e9cb1ed13ab8 req-01fa3b97-5115-4154-ac74-eb149b602d0b service nova] Creating event network-vif-plugged:880216ed-7173-47d4-946d-37845055cc79 for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:16:04.006822 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-2b7624eb-d931-4f85-b531-e9cb1ed13ab8 req-01fa3b97-5115-4154-ac74-eb149b602d0b service nova] Creating event network-vif-plugged:dfea1e40-7a7f-4c90-a02f-bdc09fd3cd9c for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:16:04.015429 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-2b7624eb-d931-4f85-b531-e9cb1ed13ab8 req-01fa3b97-5115-4154-ac74-eb149b602d0b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.041065 Oct 12 22:16:04.016823 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2293/4076] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:04.023878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8d0217ef-b00f-4d02-9425-8720500a78b1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:04.024917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8d0217ef-b00f-4d02-9425-8720500a78b1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:04.209578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8d0217ef-b00f-4d02-9425-8720500a78b1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:04.227024 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8d0217ef-b00f-4d02-9425-8720500a78b1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1214 microversion: 2.1 time: 0.208698 Oct 12 22:16:04.228511 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2294/4077] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:04 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1214 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:04.278936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-21f47ee8-18e2-4113-9650-3a9dd2820b4a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:04.280470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-21f47ee8-18e2-4113-9650-3a9dd2820b4a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:04.296669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21f47ee8-18e2-4113-9650-3a9dd2820b4a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:04.298087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21f47ee8-18e2-4113-9650-3a9dd2820b4a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:04.299051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21f47ee8-18e2-4113-9650-3a9dd2820b4a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:04.302117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21f47ee8-18e2-4113-9650-3a9dd2820b4a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:04.303488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21f47ee8-18e2-4113-9650-3a9dd2820b4a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:04.304258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21f47ee8-18e2-4113-9650-3a9dd2820b4a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:04.341548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b5337938-0524-41d6-bc93-17cd821e547e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:04.351133 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b5337938-0524-41d6-bc93-17cd821e547e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1522 microversion: 2.1 time: 0.529067 Oct 12 22:16:04.359088 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1784/4078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:03 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1522 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:16:04.813904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-21f47ee8-18e2-4113-9650-3a9dd2820b4a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:04.829080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-21f47ee8-18e2-4113-9650-3a9dd2820b4a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:04.831118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-21f47ee8-18e2-4113-9650-3a9dd2820b4a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:04.833004 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-21f47ee8-18e2-4113-9650-3a9dd2820b4a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.558684 Oct 12 22:16:04.834651 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2295/4079] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:04 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:16:05.259804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-52b0859e-1898-409a-a791-182c9b49c3d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:05.260530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-52b0859e-1898-409a-a791-182c9b49c3d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:05.268601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52b0859e-1898-409a-a791-182c9b49c3d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:05.269178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52b0859e-1898-409a-a791-182c9b49c3d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:05.269707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52b0859e-1898-409a-a791-182c9b49c3d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:05.270484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52b0859e-1898-409a-a791-182c9b49c3d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:05.271190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52b0859e-1898-409a-a791-182c9b49c3d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:05.272464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52b0859e-1898-409a-a791-182c9b49c3d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:05.389700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-881cc36c-fbf0-41a5-91a3-65fa9390b453 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:05.390691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-881cc36c-fbf0-41a5-91a3-65fa9390b453 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:05.413739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-881cc36c-fbf0-41a5-91a3-65fa9390b453 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:05.415464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-881cc36c-fbf0-41a5-91a3-65fa9390b453 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:05.416284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-881cc36c-fbf0-41a5-91a3-65fa9390b453 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:05.417820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-881cc36c-fbf0-41a5-91a3-65fa9390b453 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:05.420011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-881cc36c-fbf0-41a5-91a3-65fa9390b453 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:05.421105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-881cc36c-fbf0-41a5-91a3-65fa9390b453 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:05.436866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-52b0859e-1898-409a-a791-182c9b49c3d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:05.450160 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-52b0859e-1898-409a-a791-182c9b49c3d3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1266 microversion: 2.1 time: 0.192205 Oct 12 22:16:05.452692 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1785/4080] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:05 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:05.530195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-258133754", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a52db127-98d8-45ba-8f76-20c217e360fd"}, {"port": "e36d7f37-98a6-4136-be81-33925899d2c1", "tag": "port-1"}, {"port": "784c9be8-8f1d-4448-96ec-73464800451b", "tag": "port-2"}, {"uuid": "fd311dfc-92b1-466a-8874-5a860bd1a565", "tag": "net-1"}, {"uuid": "fd311dfc-92b1-466a-8874-5a860bd1a565"}, {"uuid": "474eb2d0-575d-4f5c-94f3-538c89b97c9a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "474eb2d0-575d-4f5c-94f3-538c89b97c9a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "431cd3ed-5dd4-404f-82af-beb7646b8b6a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "eaf0c5bf-7f96-48bd-9ddd-9d4b6a06699d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6c682eb9-a5b7-4479-b404-7b6b878cb2ce", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1304253270"}], "key_name": "tempest-keypair-1798670009", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:05.871733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] validate_networks() for [('a52db127-98d8-45ba-8f76-20c217e360fd', None, None, None, None, None), (None, None, 'e36d7f37-98a6-4136-be81-33925899d2c1', None, None, None), (None, None, '784c9be8-8f1d-4448-96ec-73464800451b', None, None, None), ('fd311dfc-92b1-466a-8874-5a860bd1a565', None, None, None, None, None), ('fd311dfc-92b1-466a-8874-5a860bd1a565', None, None, None, None, None), ('474eb2d0-575d-4f5c-94f3-538c89b97c9a', '10.2.2.100', None, None, None, None), ('474eb2d0-575d-4f5c-94f3-538c89b97c9a', '10.2.2.200', None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:16:05.901454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-881cc36c-fbf0-41a5-91a3-65fa9390b453 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:05.909834 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-881cc36c-fbf0-41a5-91a3-65fa9390b453 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1522 microversion: 2.1 time: 0.528786 Oct 12 22:16:05.925960 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2296/4081] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:05 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1522 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:16:05.933315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-16a1b7dc-179d-4a26-9244-42b4992beb35 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:05.933701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-16a1b7dc-179d-4a26-9244-42b4992beb35 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:05.940377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16a1b7dc-179d-4a26-9244-42b4992beb35 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:05.941138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16a1b7dc-179d-4a26-9244-42b4992beb35 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:05.941827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16a1b7dc-179d-4a26-9244-42b4992beb35 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:05.942791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16a1b7dc-179d-4a26-9244-42b4992beb35 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:05.943507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16a1b7dc-179d-4a26-9244-42b4992beb35 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:05.944169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16a1b7dc-179d-4a26-9244-42b4992beb35 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:06.239906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-16a1b7dc-179d-4a26-9244-42b4992beb35 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:06.267332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-16a1b7dc-179d-4a26-9244-42b4992beb35 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:06.272310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-16a1b7dc-179d-4a26-9244-42b4992beb35 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:06.272310 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-16a1b7dc-179d-4a26-9244-42b4992beb35 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.346201 Oct 12 22:16:06.277462 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2297/4082] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:05 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:06.292242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-90c7b0c6-0d52-432b-9a3a-4f1723dc123d req-7041fd48-6736-4054-96ae-0abae2851f83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "name": "network-vif-plugged", "status": "completed", "tag": "248cb9c1-00e2-425c-b33a-9885e240c15a"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:06.316354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-90c7b0c6-0d52-432b-9a3a-4f1723dc123d req-7041fd48-6736-4054-96ae-0abae2851f83 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:06.316867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-90c7b0c6-0d52-432b-9a3a-4f1723dc123d req-7041fd48-6736-4054-96ae-0abae2851f83 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:06.319266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-90c7b0c6-0d52-432b-9a3a-4f1723dc123d req-7041fd48-6736-4054-96ae-0abae2851f83 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:06.354275 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-90c7b0c6-0d52-432b-9a3a-4f1723dc123d req-7041fd48-6736-4054-96ae-0abae2851f83 service nova] Creating event network-vif-plugged:248cb9c1-00e2-425c-b33a-9885e240c15a for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:16:06.371216 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-90c7b0c6-0d52-432b-9a3a-4f1723dc123d req-7041fd48-6736-4054-96ae-0abae2851f83 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089312 Oct 12 22:16:06.379553 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2298/4083] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:06.485336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-44cddac0-7de8-4273-9578-c6831db081b3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:06.486143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-44cddac0-7de8-4273-9578-c6831db081b3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:06.496361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44cddac0-7de8-4273-9578-c6831db081b3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:06.497469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44cddac0-7de8-4273-9578-c6831db081b3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:06.497965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44cddac0-7de8-4273-9578-c6831db081b3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:06.498792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44cddac0-7de8-4273-9578-c6831db081b3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:06.499307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44cddac0-7de8-4273-9578-c6831db081b3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:06.499777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44cddac0-7de8-4273-9578-c6831db081b3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:07.193469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-44cddac0-7de8-4273-9578-c6831db081b3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:07.205560 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-44cddac0-7de8-4273-9578-c6831db081b3 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1314 microversion: 2.1 time: 0.729342 Oct 12 22:16:07.219425 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2299/4084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:06 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1314 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:07.739830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5fdb5732-7a42-468e-bf06-a281cf0a64c4 tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-858011689", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:07.744255 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-5fdb5732-7a42-468e-bf06-a281cf0a64c4 tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] HTTP exception thrown: min_count must be <= max_count Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5fdb5732-7a42-468e-bf06-a281cf0a64c4 tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] Request method failure captured: Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 183 Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzymVKe3jrYoxzoLoeL_RQipJUej22fJu61Jbb37kGZss2MGWlKvP0GNywKHyZ_1iKNSNd9914cK27iLNjZzQPa9TmUFeBOdlEJw6s-KzhkRWSKLIMmc52ur9rqiafQR-BmvlJeWxqhlRJzGkzB5JX21UviU1INJ7J3iHkeb-12x0N8 Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7bb9074ae1564ef0a07eec148380f699 Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-421326765 Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb9074ae1564ef0a07eec148380f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb9074ae1564ef0a07eec148380f699"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7bb9074ae1564ef0a07eec148380f699", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7bb9074ae1564ef0a07eec148380f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-421326765 Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7bb9074ae1564ef0a07eec148380f699 Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-421326765 Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-MultipleCreateNegativeTestJSON-421326765-project Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 0b74d2905de347759f7a78ddfc4ed6a0 Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-421326765-project Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-858011689", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: exception: min_count must be <= max_count Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-858011689', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 12 22:16:07.749010 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:07.757243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5fdb5732-7a42-468e-bf06-a281cf0a64c4 tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] Returning 400 to user: min_count must be <= max_count {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:07.760717 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5fdb5732-7a42-468e-bf06-a281cf0a64c4 tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.538819 Oct 12 22:16:07.779901 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2300/4085] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:16:07 2022] POST /compute/v2.1/servers => generated 74 bytes in 559 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:16:07.791366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-56c7ba1c-bf7c-4ea3-8053-a9d4e48bde82 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:07.795617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-56c7ba1c-bf7c-4ea3-8053-a9d4e48bde82 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:07.812169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56c7ba1c-bf7c-4ea3-8053-a9d4e48bde82 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:07.815188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56c7ba1c-bf7c-4ea3-8053-a9d4e48bde82 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:07.816436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56c7ba1c-bf7c-4ea3-8053-a9d4e48bde82 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:07.820416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56c7ba1c-bf7c-4ea3-8053-a9d4e48bde82 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:07.822631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56c7ba1c-bf7c-4ea3-8053-a9d4e48bde82 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:07.825187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56c7ba1c-bf7c-4ea3-8053-a9d4e48bde82 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:08.118329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-56c7ba1c-bf7c-4ea3-8053-a9d4e48bde82 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:08.133462 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-56c7ba1c-bf7c-4ea3-8053-a9d4e48bde82 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1522 microversion: 2.1 time: 0.352122 Oct 12 22:16:08.134307 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2301/4086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:07 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:08.156162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-09cc89ea-063d-4aab-9bb0-578978ffc2ce tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:08.157030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-09cc89ea-063d-4aab-9bb0-578978ffc2ce tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:08.163752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09cc89ea-063d-4aab-9bb0-578978ffc2ce tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:08.164527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09cc89ea-063d-4aab-9bb0-578978ffc2ce tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:08.165149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09cc89ea-063d-4aab-9bb0-578978ffc2ce tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:08.166028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09cc89ea-063d-4aab-9bb0-578978ffc2ce tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:08.166652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09cc89ea-063d-4aab-9bb0-578978ffc2ce tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:08.167268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09cc89ea-063d-4aab-9bb0-578978ffc2ce tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:08.610231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-09cc89ea-063d-4aab-9bb0-578978ffc2ce tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:08.631386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-09cc89ea-063d-4aab-9bb0-578978ffc2ce tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:08.635199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-09cc89ea-063d-4aab-9bb0-578978ffc2ce tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:08.639958 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-09cc89ea-063d-4aab-9bb0-578978ffc2ce tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1880 microversion: 2.32 time: 0.495122 Oct 12 22:16:08.640538 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2302/4087] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:08 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1880 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:08.661774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48e465a0-836b-47f8-9f97-4f4ea1b60ffc tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1003334260", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "max_count": 0}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48e465a0-836b-47f8-9f97-4f4ea1b60ffc tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] Request method failure captured: Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 168 Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzymVKe3jrYoxzoLoeL_RQipJUej22fJu61Jbb37kGZss2MGWlKvP0GNywKHyZ_1iKNSNd9914cK27iLNjZzQPa9TmUFeBOdlEJw6s-KzhkRWSKLIMmc52ur9rqiafQR-BmvlJeWxqhlRJzGkzB5JX21UviU1INJ7J3iHkeb-12x0N8 Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7bb9074ae1564ef0a07eec148380f699 Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-421326765 Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb9074ae1564ef0a07eec148380f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb9074ae1564ef0a07eec148380f699"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7bb9074ae1564ef0a07eec148380f699", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7bb9074ae1564ef0a07eec148380f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-421326765 Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7bb9074ae1564ef0a07eec148380f699 Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-421326765 Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-MultipleCreateNegativeTestJSON-421326765-project Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 0b74d2905de347759f7a78ddfc4ed6a0 Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-421326765-project Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1003334260", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "max_count": 0}} Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1003334260', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'max_count': 0}}} Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 0 Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:16:08.666107 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48e465a0-836b-47f8-9f97-4f4ea1b60ffc tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-48e465a0-836b-47f8-9f97-4f4ea1b60ffc tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.024140 Oct 12 22:16:08.674787 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2303/4088] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:16:08 2022] POST /compute/v2.1/servers => generated 130 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:16:08.677915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6fe02eaf-3d48-4f8b-9275-f5ff64bcb438 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:08.677915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6fe02eaf-3d48-4f8b-9275-f5ff64bcb438 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:08.694656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fe02eaf-3d48-4f8b-9275-f5ff64bcb438 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:08.695155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fe02eaf-3d48-4f8b-9275-f5ff64bcb438 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:08.695633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fe02eaf-3d48-4f8b-9275-f5ff64bcb438 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:08.696351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fe02eaf-3d48-4f8b-9275-f5ff64bcb438 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:08.696804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fe02eaf-3d48-4f8b-9275-f5ff64bcb438 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:08.697231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fe02eaf-3d48-4f8b-9275-f5ff64bcb438 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:08.849399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:08.958630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6fe02eaf-3d48-4f8b-9275-f5ff64bcb438 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:08.969653 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6fe02eaf-3d48-4f8b-9275-f5ff64bcb438 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1314 microversion: 2.1 time: 0.299366 Oct 12 22:16:08.971192 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2304/4089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:08 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:08.976990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-100fdbfc-d308-4f97-a2b3-544ff90388c8 req-a0f37883-5574-4662-ab9e-793f3d5f42a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e7a353-6197-41c1-a105-6ca3ca06f195", "name": "network-vif-unplugged", "status": "completed", "tag": "4d7852af-515a-4d0f-9f75-f01702943902"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:08.988595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-100fdbfc-d308-4f97-a2b3-544ff90388c8 req-a0f37883-5574-4662-ab9e-793f3d5f42a0 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:08.989182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-100fdbfc-d308-4f97-a2b3-544ff90388c8 req-a0f37883-5574-4662-ab9e-793f3d5f42a0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:08.989717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-100fdbfc-d308-4f97-a2b3-544ff90388c8 req-a0f37883-5574-4662-ab9e-793f3d5f42a0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:09.003365 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-100fdbfc-d308-4f97-a2b3-544ff90388c8 req-a0f37883-5574-4662-ab9e-793f3d5f42a0 service nova] Creating event network-vif-unplugged:4d7852af-515a-4d0f-9f75-f01702943902 for instance 84e7a353-6197-41c1-a105-6ca3ca06f195 on n-h1-861111-1 Oct 12 22:16:09.008965 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-100fdbfc-d308-4f97-a2b3-544ff90388c8 req-a0f37883-5574-4662-ab9e-793f3d5f42a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036343 Oct 12 22:16:09.010168 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2305/4090] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:09.164246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fb0902cf-a941-48c8-b74c-3ce69edd51e8 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Action: 'create', calling method: .version_select at 0x7f5122f34790>, body: {"keypair": {"name": "tempest-keypair-680544099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHtEw8tg6iOAG27vAdqxwRHkTrjTqk75qvpr5diGfd3hdbZeMOJmcHfkTFaZ+W/TWAY3ZDSJUG/ptUCOr6FHYUMIDJOpQW5uobhJXmdVBuSFLuKNcGUgcqQJO3dWEZh/Q=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:09.186777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-fb0902cf-a941-48c8-b74c-3ce69edd51e8 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Getting quotas for project 3f0b4d0c1802407b8cf1f93dd04c1c85. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:16:09.194024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-fb0902cf-a941-48c8-b74c-3ce69edd51e8 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Getting quotas for user c77f44543f8543fca2a6bb1b8a7c74e2 and project 3f0b4d0c1802407b8cf1f93dd04c1c85. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:16:09.234471 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fb0902cf-a941-48c8-b74c-3ce69edd51e8 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.222541 Oct 12 22:16:09.235353 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2306/4091] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:16:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:09.240536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-30caabb8-0be4-4b10-8b55-e795fd927709 tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1153481959", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "max_count": 2.5}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-30caabb8-0be4-4b10-8b55-e795fd927709 tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] Request method failure captured: Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 170 Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzymVKe3jrYoxzoLoeL_RQipJUej22fJu61Jbb37kGZss2MGWlKvP0GNywKHyZ_1iKNSNd9914cK27iLNjZzQPa9TmUFeBOdlEJw6s-KzhkRWSKLIMmc52ur9rqiafQR-BmvlJeWxqhlRJzGkzB5JX21UviU1INJ7J3iHkeb-12x0N8 Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7bb9074ae1564ef0a07eec148380f699 Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-421326765 Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb9074ae1564ef0a07eec148380f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb9074ae1564ef0a07eec148380f699"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7bb9074ae1564ef0a07eec148380f699", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7bb9074ae1564ef0a07eec148380f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-421326765 Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7bb9074ae1564ef0a07eec148380f699 Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-421326765 Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-MultipleCreateNegativeTestJSON-421326765-project Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 0b74d2905de347759f7a78ddfc4ed6a0 Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-421326765-project Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1153481959", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "max_count": 2.5}} Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1153481959', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'max_count': 2.5}}} Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 2.5 Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:16:09.245445 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:16:09.250745 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:16:09.250745 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:16:09.250745 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:16:09.250745 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:16:09.250745 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 22:16:09.250745 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:09.250745 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:09.250745 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:09.250745 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:09.250745 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:09.250745 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:09.250745 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:16:09.250745 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:16:09.250745 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 22:16:09.250745 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:09.250745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-30caabb8-0be4-4b10-8b55-e795fd927709 tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:09.250745 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-30caabb8-0be4-4b10-8b55-e795fd927709 tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010363 Oct 12 22:16:09.261528 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2307/4092] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:16:09 2022] POST /compute/v2.1/servers => generated 139 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:16:09.267737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3149e99c-7844-46f9-aacf-4132a9977255 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:09.268490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3149e99c-7844-46f9-aacf-4132a9977255 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:09.286199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3149e99c-7844-46f9-aacf-4132a9977255 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:09.287010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3149e99c-7844-46f9-aacf-4132a9977255 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:09.287650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3149e99c-7844-46f9-aacf-4132a9977255 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:09.288562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3149e99c-7844-46f9-aacf-4132a9977255 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:09.289184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3149e99c-7844-46f9-aacf-4132a9977255 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:09.289795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3149e99c-7844-46f9-aacf-4132a9977255 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:09.702417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3149e99c-7844-46f9-aacf-4132a9977255 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:09.711181 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3149e99c-7844-46f9-aacf-4132a9977255 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1522 microversion: 2.1 time: 0.447979 Oct 12 22:16:09.712671 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2308/4093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:09 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:09.732157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-64a5bffa-4276-45b7-8f8e-25d577645fd8 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Calling method '.version_select at 0x7f5123290a60>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:09.744731 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-64a5bffa-4276-45b7-8f8e-25d577645fd8 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-680544099" status: 200 len: 497 microversion: 2.1 time: 0.030104 Oct 12 22:16:09.746058 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2309/4094] 10.222.0.16 () {58 vars in 1215 bytes} [Wed Oct 12 22:16:09 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-680544099 => generated 497 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:09.750933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-34a2fd0c-8f41-49fb-bfd6-43a04b62cad1 tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1861553856", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "min_count": 0}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-34a2fd0c-8f41-49fb-bfd6-43a04b62cad1 tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] Request method failure captured: Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 168 Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzymVKe3jrYoxzoLoeL_RQipJUej22fJu61Jbb37kGZss2MGWlKvP0GNywKHyZ_1iKNSNd9914cK27iLNjZzQPa9TmUFeBOdlEJw6s-KzhkRWSKLIMmc52ur9rqiafQR-BmvlJeWxqhlRJzGkzB5JX21UviU1INJ7J3iHkeb-12x0N8 Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7bb9074ae1564ef0a07eec148380f699 Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-421326765 Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb9074ae1564ef0a07eec148380f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb9074ae1564ef0a07eec148380f699"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7bb9074ae1564ef0a07eec148380f699", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7bb9074ae1564ef0a07eec148380f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-421326765 Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7bb9074ae1564ef0a07eec148380f699 Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-421326765 Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-MultipleCreateNegativeTestJSON-421326765-project Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 0b74d2905de347759f7a78ddfc4ed6a0 Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-421326765-project Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1861553856", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "min_count": 0}} Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1861553856', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'min_count': 0}}} Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 0 Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:16:09.755491 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:16:09.761831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:16:09.761831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:16:09.761831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:16:09.761831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:16:09.761831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 12 22:16:09.761831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:09.761831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:09.761831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:09.761831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:09.761831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:09.761831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:09.761831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:16:09.761831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:16:09.761831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 12 22:16:09.761831 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:09.764685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-34a2fd0c-8f41-49fb-bfd6-43a04b62cad1 tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:09.765775 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-34a2fd0c-8f41-49fb-bfd6-43a04b62cad1 tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.018464 Oct 12 22:16:09.780024 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2310/4095] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:16:09 2022] POST /compute/v2.1/servers => generated 130 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:16:09.802463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-4640e2a0-9cdb-47da-ab9a-ba6013b0b6fa req-5b6b8a89-6bf3-4182-a070-b8171e1a18dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c509c8f-4240-4742-ae58-8f1ba3737348", "tag": "61fa2de7-5767-4ba1-89e1-bf5fe1923f9a"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:09.827044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4640e2a0-9cdb-47da-ab9a-ba6013b0b6fa req-5b6b8a89-6bf3-4182-a070-b8171e1a18dc service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:09.831026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4640e2a0-9cdb-47da-ab9a-ba6013b0b6fa req-5b6b8a89-6bf3-4182-a070-b8171e1a18dc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:09.832794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4640e2a0-9cdb-47da-ab9a-ba6013b0b6fa req-5b6b8a89-6bf3-4182-a070-b8171e1a18dc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:09.860112 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-4640e2a0-9cdb-47da-ab9a-ba6013b0b6fa req-5b6b8a89-6bf3-4182-a070-b8171e1a18dc service nova] Creating event network-changed:61fa2de7-5767-4ba1-89e1-bf5fe1923f9a for instance 9c509c8f-4240-4742-ae58-8f1ba3737348 on n-h2-861111-1 Oct 12 22:16:09.866344 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-4640e2a0-9cdb-47da-ab9a-ba6013b0b6fa req-5b6b8a89-6bf3-4182-a070-b8171e1a18dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073657 Oct 12 22:16:09.867403 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2311/4096] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:09.874851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-228ba06e-b1fe-4c7d-9298-abbab683697f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:09.875970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-228ba06e-b1fe-4c7d-9298-abbab683697f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:09.884394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-228ba06e-b1fe-4c7d-9298-abbab683697f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:09.885036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-228ba06e-b1fe-4c7d-9298-abbab683697f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:09.885772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-228ba06e-b1fe-4c7d-9298-abbab683697f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:09.886737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-228ba06e-b1fe-4c7d-9298-abbab683697f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:09.887560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-228ba06e-b1fe-4c7d-9298-abbab683697f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:09.888222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-228ba06e-b1fe-4c7d-9298-abbab683697f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:10.162435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-228ba06e-b1fe-4c7d-9298-abbab683697f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:10.176312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-228ba06e-b1fe-4c7d-9298-abbab683697f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:10.178287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-228ba06e-b1fe-4c7d-9298-abbab683697f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:10.181950 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-228ba06e-b1fe-4c7d-9298-abbab683697f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 2834 microversion: 2.32 time: 0.312655 Oct 12 22:16:10.182804 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2312/4097] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:09 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 2834 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:10.189133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-738afdc8-1627-4761-8a54-815b27003465 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Calling method '.version_select at 0x7f5122f25a60>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:10.213179 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-738afdc8-1627-4761-8a54-815b27003465 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-680544099" status: 202 len: 0 microversion: 2.1 time: 0.029158 Oct 12 22:16:10.213957 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2313/4098] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 12 22:16:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-680544099 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:16:10.222367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bbf83b06-5b94-4ea8-a9c3-a982578cf8cd tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1996178543", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "min_count": 2.5}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bbf83b06-5b94-4ea8-a9c3-a982578cf8cd tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] Request method failure captured: Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 170 Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzymVKe3jrYoxzoLoeL_RQipJUej22fJu61Jbb37kGZss2MGWlKvP0GNywKHyZ_1iKNSNd9914cK27iLNjZzQPa9TmUFeBOdlEJw6s-KzhkRWSKLIMmc52ur9rqiafQR-BmvlJeWxqhlRJzGkzB5JX21UviU1INJ7J3iHkeb-12x0N8 Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7bb9074ae1564ef0a07eec148380f699 Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-421326765 Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb9074ae1564ef0a07eec148380f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb9074ae1564ef0a07eec148380f699"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7bb9074ae1564ef0a07eec148380f699", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7bb9074ae1564ef0a07eec148380f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-421326765 Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7bb9074ae1564ef0a07eec148380f699 Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-421326765 Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-MultipleCreateNegativeTestJSON-421326765-project Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 0b74d2905de347759f7a78ddfc4ed6a0 Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-421326765-project Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1996178543", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "min_count": 2.5}} Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1996178543', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'min_count': 2.5}}} Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 2.5 Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:16:10.227498 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:16:10.232951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:16:10.232951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:16:10.232951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:16:10.232951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:16:10.232951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 22:16:10.232951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:10.232951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:10.232951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:10.232951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:10.232951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:10.232951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:10.232951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:16:10.232951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:16:10.232951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 22:16:10.232951 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:10.232951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bbf83b06-5b94-4ea8-a9c3-a982578cf8cd tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:10.235407 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bbf83b06-5b94-4ea8-a9c3-a982578cf8cd tempest-MultipleCreateNegativeTestJSON-421326765 tempest-MultipleCreateNegativeTestJSON-421326765-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.015168 Oct 12 22:16:10.235407 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2314/4099] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:16:10 2022] POST /compute/v2.1/servers => generated 139 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:16:10.246826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5db99bb2-0fee-4fd3-97b1-95f69f566983 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:10.249990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5db99bb2-0fee-4fd3-97b1-95f69f566983 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:10.257316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5db99bb2-0fee-4fd3-97b1-95f69f566983 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:10.257929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5db99bb2-0fee-4fd3-97b1-95f69f566983 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:10.258477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5db99bb2-0fee-4fd3-97b1-95f69f566983 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:10.259335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5db99bb2-0fee-4fd3-97b1-95f69f566983 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:10.259907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5db99bb2-0fee-4fd3-97b1-95f69f566983 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:10.260446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5db99bb2-0fee-4fd3-97b1-95f69f566983 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:10.461239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5db99bb2-0fee-4fd3-97b1-95f69f566983 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:10.473867 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5db99bb2-0fee-4fd3-97b1-95f69f566983 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1314 microversion: 2.1 time: 0.231508 Oct 12 22:16:10.474708 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2315/4100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:10 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:10.480081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6ca486ce-0509-4d6a-8862-2d5b4c8f3821 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:10.481067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6ca486ce-0509-4d6a-8862-2d5b4c8f3821 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:10.497991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:10.507381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ca486ce-0509-4d6a-8862-2d5b4c8f3821 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:10.508235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ca486ce-0509-4d6a-8862-2d5b4c8f3821 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:10.508832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ca486ce-0509-4d6a-8862-2d5b4c8f3821 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:10.509923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ca486ce-0509-4d6a-8862-2d5b4c8f3821 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:10.510603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ca486ce-0509-4d6a-8862-2d5b4c8f3821 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:10.511264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ca486ce-0509-4d6a-8862-2d5b4c8f3821 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:10.692885 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6ca486ce-0509-4d6a-8862-2d5b4c8f3821 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.216580 Oct 12 22:16:10.693756 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2316/4101] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 12 22:16:10 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0/os-interface => generated 1831 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:10.700098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f5fe6ae6-ba27-4859-b6e5-841c6c27371b tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Action: 'create', calling method: .version_select at 0x7f5122f25a60>, body: {"keypair": {"name": "tempest-keypair-638048549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfeQqrimBCMNHKJTo4mqYiKGgNwqo2roaOtLmlqhZSa1CpQIP19jDqZYTUMe4dPQ8MuPTcY4ycihI6JHZHw5geswrb5W1xC7K3e7O35MR3RrLNHu1aXLEineE0kfZnP3w=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:10.753844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-f5fe6ae6-ba27-4859-b6e5-841c6c27371b tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Getting quotas for project 3f0b4d0c1802407b8cf1f93dd04c1c85. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:16:10.760512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-f5fe6ae6-ba27-4859-b6e5-841c6c27371b tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Getting quotas for user c77f44543f8543fca2a6bb1b8a7c74e2 and project 3f0b4d0c1802407b8cf1f93dd04c1c85. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:16:10.799484 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f5fe6ae6-ba27-4859-b6e5-841c6c27371b tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.104306 Oct 12 22:16:10.803361 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2317/4102] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:16:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:10.818158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-21d3810c-3d6d-425f-a401-9a00b819d5ef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:10.819166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-21d3810c-3d6d-425f-a401-9a00b819d5ef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:10.830481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21d3810c-3d6d-425f-a401-9a00b819d5ef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:10.834491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21d3810c-3d6d-425f-a401-9a00b819d5ef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:10.836483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21d3810c-3d6d-425f-a401-9a00b819d5ef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:10.837653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21d3810c-3d6d-425f-a401-9a00b819d5ef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:10.838845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21d3810c-3d6d-425f-a401-9a00b819d5ef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:10.841598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21d3810c-3d6d-425f-a401-9a00b819d5ef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:11.129463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-21d3810c-3d6d-425f-a401-9a00b819d5ef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:11.138967 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-21d3810c-3d6d-425f-a401-9a00b819d5ef tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1522 microversion: 2.1 time: 0.328475 Oct 12 22:16:11.143396 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2318/4103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:10 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:11.147530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-86fc9d6e-b4f3-4307-92b6-c6411ecef5b7 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Calling method '.version_select at 0x7f5122ec91f0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:11.168975 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-86fc9d6e-b4f3-4307-92b6-c6411ecef5b7 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-638048549" status: 202 len: 0 microversion: 2.1 time: 0.027603 Oct 12 22:16:11.169920 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2319/4104] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 12 22:16:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-638048549 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:16:11.176056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-cae9d312-d697-42e7-b5cf-d4e709cdc566 req-ce5e447b-da83-4b0a-8a96-cdd184a93290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e7a353-6197-41c1-a105-6ca3ca06f195", "name": "network-vif-plugged", "status": "completed", "tag": "4d7852af-515a-4d0f-9f75-f01702943902"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:11.187275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cae9d312-d697-42e7-b5cf-d4e709cdc566 req-ce5e447b-da83-4b0a-8a96-cdd184a93290 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:11.187756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cae9d312-d697-42e7-b5cf-d4e709cdc566 req-ce5e447b-da83-4b0a-8a96-cdd184a93290 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:11.188494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cae9d312-d697-42e7-b5cf-d4e709cdc566 req-ce5e447b-da83-4b0a-8a96-cdd184a93290 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:11.198986 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-cae9d312-d697-42e7-b5cf-d4e709cdc566 req-ce5e447b-da83-4b0a-8a96-cdd184a93290 service nova] Creating event network-vif-plugged:4d7852af-515a-4d0f-9f75-f01702943902 for instance 84e7a353-6197-41c1-a105-6ca3ca06f195 on n-h1-861111-1 Oct 12 22:16:11.204896 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-cae9d312-d697-42e7-b5cf-d4e709cdc566 req-ce5e447b-da83-4b0a-8a96-cdd184a93290 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033359 Oct 12 22:16:11.205982 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2320/4105] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:11.214662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-329d8a28-aaa1-40bb-b849-0167aae5cd68 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Action: 'create', calling method: .version_select at 0x7f5122f5a700>, body: {"keypair": {"name": "tempest-keypair-1727555126", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:11.237862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-329d8a28-aaa1-40bb-b849-0167aae5cd68 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Getting quotas for project 3f0b4d0c1802407b8cf1f93dd04c1c85. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:16:11.244337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-329d8a28-aaa1-40bb-b849-0167aae5cd68 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Getting quotas for user c77f44543f8543fca2a6bb1b8a7c74e2 and project 3f0b4d0c1802407b8cf1f93dd04c1c85. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:16:11.287478 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-329d8a28-aaa1-40bb-b849-0167aae5cd68 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.079775 Oct 12 22:16:11.293733 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2321/4106] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:16:11 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:11.313051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c65a847e-3452-41ca-b7d2-ad04e60e12f2 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Calling method '.version_select at 0x7f5122ec4820>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:11.354898 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c65a847e-3452-41ca-b7d2-ad04e60e12f2 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1727555126" status: 202 len: 0 microversion: 2.1 time: 0.058624 Oct 12 22:16:11.357188 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2322/4107] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 12 22:16:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1727555126 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:16:11.369328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dc5f92b7-882d-45f9-b276-2fba333cab45 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Action: 'create', calling method: .version_select at 0x7f5122f34a60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1897759748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwkMCKE1CMG+nbt+cXByDZh1Ey0lB0tiqvP0lAoZNhrhoJZondXTjEJcnQpQAi8ACuwVMmUqpC0QxJFjSPQzvPvvQHYXt4l5Qgg2rM82WCkWnTKYor5jHXxoCuuOiU1xg=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:11.391617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-dc5f92b7-882d-45f9-b276-2fba333cab45 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Getting quotas for project 3f0b4d0c1802407b8cf1f93dd04c1c85. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:16:11.397976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-dc5f92b7-882d-45f9-b276-2fba333cab45 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Getting quotas for user c77f44543f8543fca2a6bb1b8a7c74e2 and project 3f0b4d0c1802407b8cf1f93dd04c1c85. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:16:11.430473 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dc5f92b7-882d-45f9-b276-2fba333cab45 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.065592 Oct 12 22:16:11.440166 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2323/4108] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:16:11 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:16:11.447041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-13e5d41e-69e1-4c13-a38c-eb6ab69a0a15 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Action: 'create', calling method: .version_select at 0x7f5122ec15e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-850693839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNSJqUjXWmvd71B3h3OhIv3E+xj/iR9lTsMMPbLxdu/OI2NgcfdP3hoj9sYEaO1zfG9YMjNofdNKD4xrnlBpQTT39iwvp5gBt/cfBa0GYPvwsTAb9KIe8UcqT2IHLXiFw=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:11.467103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-13e5d41e-69e1-4c13-a38c-eb6ab69a0a15 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Getting quotas for project 3f0b4d0c1802407b8cf1f93dd04c1c85. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:16:11.480213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-13e5d41e-69e1-4c13-a38c-eb6ab69a0a15 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Getting quotas for user c77f44543f8543fca2a6bb1b8a7c74e2 and project 3f0b4d0c1802407b8cf1f93dd04c1c85. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:16:11.512615 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-13e5d41e-69e1-4c13-a38c-eb6ab69a0a15 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.069457 Oct 12 22:16:11.513841 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2324/4109] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:16:11 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:11.519674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-39503811-4451-4d9f-a59b-005264146841 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:11.520119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-39503811-4451-4d9f-a59b-005264146841 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:11.528859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39503811-4451-4d9f-a59b-005264146841 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:11.529593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39503811-4451-4d9f-a59b-005264146841 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:11.530206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39503811-4451-4d9f-a59b-005264146841 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:11.531153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39503811-4451-4d9f-a59b-005264146841 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:11.531645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39503811-4451-4d9f-a59b-005264146841 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:11.532070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-39503811-4451-4d9f-a59b-005264146841 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:11.782314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:16:11.783755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:16:11.784438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:16:11.784849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:16:11.785257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:16:11.787930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:11.802645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:11.803395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:11.804165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:11.805088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:11.805713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:11.806347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:11.834698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Getting quotas for project 6f247890f1bf4ff29af359f4d1cd405c. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:16:11.850675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Getting quotas for user def9100040524da08268b700ba75c68a and project 6f247890f1bf4ff29af359f4d1cd405c. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:16:11.911471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-39503811-4451-4d9f-a59b-005264146841 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:11.918662 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-39503811-4451-4d9f-a59b-005264146841 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1314 microversion: 2.1 time: 0.403202 Oct 12 22:16:11.929664 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2325/4110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:11 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:11.935742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4ce43a82-91a6-4b3d-b006-3fb4d2efdf0f tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Action: 'create', calling method: .version_select at 0x7f5122f25550>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-640206930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz22Aq7+GUffXRoS0OtahuY303AC2wKDM8Onln4dg2diefvrTRF2jwKYfaGqEHKtKM3vpLDzQhinpI9vahXv2uXfUUzfauaU9CSrdsLDwdWX0Zar6ZO97ryBc5+8fvvTA=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:11.973306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-4ce43a82-91a6-4b3d-b006-3fb4d2efdf0f tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Getting quotas for project 3f0b4d0c1802407b8cf1f93dd04c1c85. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:16:11.982560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-4ce43a82-91a6-4b3d-b006-3fb4d2efdf0f tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Getting quotas for user c77f44543f8543fca2a6bb1b8a7c74e2 and project 3f0b4d0c1802407b8cf1f93dd04c1c85. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:16:12.029581 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4ce43a82-91a6-4b3d-b006-3fb4d2efdf0f tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.098553 Oct 12 22:16:12.030329 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2326/4111] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:16:11 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:12.040986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6942d55f-e8b9-4c7e-bb40-a95519d1cf2d tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Calling method '.version_select at 0x7f5122ec1af0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:12.052812 n-d-861111-1 devstack@n-api.service[120453]: WARNING oslo_db.sqlalchemy.utils [None req-6942d55f-e8b9-4c7e-bb40-a95519d1cf2d tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 22:16:12.061185 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6942d55f-e8b9-4c7e-bb40-a95519d1cf2d tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.023998 Oct 12 22:16:12.067043 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2327/4112] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:16:12 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:12.073037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:16:12.073723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e0b132c5-ba23-4d94-93b6-c48893a52133 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Calling method '.version_select at 0x7f5122f5a280>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:12.075972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='431cd3ed-5dd4-404f-82af-beb7646b8b6a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='eaf0c5bf-7f96-48bd-9ddd-9d4b6a06699d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c682eb9-a5b7-4479-b404-7b6b878cb2ce',volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:16:12.116667 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e0b132c5-ba23-4d94-93b6-c48893a52133 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-640206930" status: 202 len: 0 microversion: 2.1 time: 0.047547 Oct 12 22:16:12.127710 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2328/4113] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:16:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-640206930 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:16:12.136060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-66225443-9e38-487f-b158-faa3dedb67ba tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Calling method '.version_select at 0x7f5122f1a790>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:12.161560 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-66225443-9e38-487f-b158-faa3dedb67ba tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-850693839" status: 202 len: 0 microversion: 2.1 time: 0.030852 Oct 12 22:16:12.175523 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2329/4114] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:16:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-850693839 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:16:12.216140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c827a30a-9ece-4f76-8616-37119c527fc5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:12.217142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c827a30a-9ece-4f76-8616-37119c527fc5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:12.228519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c827a30a-9ece-4f76-8616-37119c527fc5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:12.229237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c827a30a-9ece-4f76-8616-37119c527fc5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:12.230258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c827a30a-9ece-4f76-8616-37119c527fc5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:12.232147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c827a30a-9ece-4f76-8616-37119c527fc5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:12.232610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c827a30a-9ece-4f76-8616-37119c527fc5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:12.233021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c827a30a-9ece-4f76-8616-37119c527fc5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:12.510708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c827a30a-9ece-4f76-8616-37119c527fc5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:12.514355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:12.529355 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c827a30a-9ece-4f76-8616-37119c527fc5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1522 microversion: 2.1 time: 0.346476 Oct 12 22:16:12.530307 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2330/4115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:12 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:12.538402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-29310cc5-53ac-441f-8b05-a9bc6cd50d61 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] Calling method '.version_select at 0x7f5122f5aa60>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:12.628933 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-29310cc5-53ac-441f-8b05-a9bc6cd50d61 tempest-KeyPairsV2TestJSON-1634550415 tempest-KeyPairsV2TestJSON-1634550415-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1897759748" status: 202 len: 0 microversion: 2.1 time: 0.097412 Oct 12 22:16:12.629800 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2331/4116] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 12 22:16:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1897759748 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:16:12.656766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-71d540fb-2e58-48c7-b601-42a950f9a588 req-8f765b18-aba0-413b-a917-2de4b7e4adae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "tag": "880216ed-7173-47d4-946d-37845055cc79"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:12.702025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-71d540fb-2e58-48c7-b601-42a950f9a588 req-8f765b18-aba0-413b-a917-2de4b7e4adae service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:12.702503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-71d540fb-2e58-48c7-b601-42a950f9a588 req-8f765b18-aba0-413b-a917-2de4b7e4adae service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:12.702936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-71d540fb-2e58-48c7-b601-42a950f9a588 req-8f765b18-aba0-413b-a917-2de4b7e4adae service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:12.737506 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-71d540fb-2e58-48c7-b601-42a950f9a588 req-8f765b18-aba0-413b-a917-2de4b7e4adae service nova] Creating event network-changed:880216ed-7173-47d4-946d-37845055cc79 for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:16:12.752415 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-71d540fb-2e58-48c7-b601-42a950f9a588 req-8f765b18-aba0-413b-a917-2de4b7e4adae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111052 Oct 12 22:16:12.754377 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2332/4117] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:12.843608 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e20b4bed-2175-4101-b7a9-aa1ae7721911 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 7.317477 Oct 12 22:16:12.847517 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1786/4118] 10.222.0.16 () {62 vars in 1189 bytes} [Wed Oct 12 22:16:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 7324 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:16:12.862010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2d5b6822-2e91-42d1-92df-07d71c2abf7c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:12.862921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2d5b6822-2e91-42d1-92df-07d71c2abf7c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:12.943904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dd492e42-ea21-4e70-b344-72d10f1a4278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:12.945073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dd492e42-ea21-4e70-b344-72d10f1a4278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:12.956308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd492e42-ea21-4e70-b344-72d10f1a4278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:12.958479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd492e42-ea21-4e70-b344-72d10f1a4278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:12.961016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd492e42-ea21-4e70-b344-72d10f1a4278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:12.962041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd492e42-ea21-4e70-b344-72d10f1a4278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:12.962750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd492e42-ea21-4e70-b344-72d10f1a4278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:12.965331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd492e42-ea21-4e70-b344-72d10f1a4278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:13.049273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2d5b6822-2e91-42d1-92df-07d71c2abf7c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:13.062802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2d5b6822-2e91-42d1-92df-07d71c2abf7c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:13.070372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2d5b6822-2e91-42d1-92df-07d71c2abf7c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:13.071664 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2d5b6822-2e91-42d1-92df-07d71c2abf7c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1285 microversion: 2.42 time: 0.216134 Oct 12 22:16:13.076098 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2333/4119] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:12 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1285 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:13.495979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dd492e42-ea21-4e70-b344-72d10f1a4278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:13.512395 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dd492e42-ea21-4e70-b344-72d10f1a4278 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1314 microversion: 2.1 time: 0.571910 Oct 12 22:16:13.512995 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1787/4120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:12 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:16:13.552866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-66c06a53-3403-4a03-8d21-3bdee8c7d943 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:13.553696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-66c06a53-3403-4a03-8d21-3bdee8c7d943 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:13.578726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66c06a53-3403-4a03-8d21-3bdee8c7d943 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:13.579265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66c06a53-3403-4a03-8d21-3bdee8c7d943 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:13.579709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66c06a53-3403-4a03-8d21-3bdee8c7d943 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:13.587294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66c06a53-3403-4a03-8d21-3bdee8c7d943 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:13.587732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66c06a53-3403-4a03-8d21-3bdee8c7d943 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:13.588133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66c06a53-3403-4a03-8d21-3bdee8c7d943 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:13.838859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:13.993346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-66c06a53-3403-4a03-8d21-3bdee8c7d943 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:14.009047 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-66c06a53-3403-4a03-8d21-3bdee8c7d943 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1507 microversion: 2.1 time: 0.460106 Oct 12 22:16:14.010169 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2334/4121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:13 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1507 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:14.040423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-385d8892-4f6b-493d-bd71-acbe63e7701e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:14.041669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-385d8892-4f6b-493d-bd71-acbe63e7701e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:14.051767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-385d8892-4f6b-493d-bd71-acbe63e7701e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:14.055189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-385d8892-4f6b-493d-bd71-acbe63e7701e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:14.055685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-385d8892-4f6b-493d-bd71-acbe63e7701e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:14.056426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-385d8892-4f6b-493d-bd71-acbe63e7701e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:14.059960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-385d8892-4f6b-493d-bd71-acbe63e7701e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:14.060349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-385d8892-4f6b-493d-bd71-acbe63e7701e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:14.103927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9647ea9b-3d16-4045-a7ef-d4a67937cf79 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:14.104547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9647ea9b-3d16-4045-a7ef-d4a67937cf79 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:14.110262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=5 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:14.314612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9647ea9b-3d16-4045-a7ef-d4a67937cf79 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:14.324144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9647ea9b-3d16-4045-a7ef-d4a67937cf79 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:14.326103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9647ea9b-3d16-4045-a7ef-d4a67937cf79 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:14.327586 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9647ea9b-3d16-4045-a7ef-d4a67937cf79 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1285 microversion: 2.42 time: 0.229411 Oct 12 22:16:14.328654 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2335/4122] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:14 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:16:14.540673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-90567047-5e99-4896-b68c-919d0214773d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:14.541522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-90567047-5e99-4896-b68c-919d0214773d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:14.548811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90567047-5e99-4896-b68c-919d0214773d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:14.560994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90567047-5e99-4896-b68c-919d0214773d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:14.564714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90567047-5e99-4896-b68c-919d0214773d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:14.565643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90567047-5e99-4896-b68c-919d0214773d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:14.566974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90567047-5e99-4896-b68c-919d0214773d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:14.567791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90567047-5e99-4896-b68c-919d0214773d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:15.069404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-90567047-5e99-4896-b68c-919d0214773d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:15.089433 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-90567047-5e99-4896-b68c-919d0214773d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1314 microversion: 2.1 time: 0.553702 Oct 12 22:16:15.090080 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2336/4123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:14 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:16:15.130620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-385d8892-4f6b-493d-bd71-acbe63e7701e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:15.140877 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-385d8892-4f6b-493d-bd71-acbe63e7701e tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 200 len: 1507 microversion: 2.1 time: 1.104273 Oct 12 22:16:15.141463 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1788/4124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:14 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 1507 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:15.166957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2381e00c-5b32-4cfe-90b5-d382dd566294 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:15.168159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2381e00c-5b32-4cfe-90b5-d382dd566294 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:15.181174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2381e00c-5b32-4cfe-90b5-d382dd566294 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:15.181683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2381e00c-5b32-4cfe-90b5-d382dd566294 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:15.182128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2381e00c-5b32-4cfe-90b5-d382dd566294 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:15.182850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2381e00c-5b32-4cfe-90b5-d382dd566294 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:15.183332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2381e00c-5b32-4cfe-90b5-d382dd566294 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:15.184318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2381e00c-5b32-4cfe-90b5-d382dd566294 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:15.245782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2381e00c-5b32-4cfe-90b5-d382dd566294 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:16:15.359642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fe86b43e-3de6-42f0-8792-f27f41896f74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:15.361203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fe86b43e-3de6-42f0-8792-f27f41896f74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:15.373251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe86b43e-3de6-42f0-8792-f27f41896f74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:15.374145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe86b43e-3de6-42f0-8792-f27f41896f74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:15.375644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe86b43e-3de6-42f0-8792-f27f41896f74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:15.378054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe86b43e-3de6-42f0-8792-f27f41896f74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:15.378873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe86b43e-3de6-42f0-8792-f27f41896f74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:15.379585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe86b43e-3de6-42f0-8792-f27f41896f74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:15.469509 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2381e00c-5b32-4cfe-90b5-d382dd566294 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "DELETE /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 204 len: 0 microversion: 2.1 time: 0.305920 Oct 12 22:16:15.470820 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2337/4125] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:16:15 2022] DELETE /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:16:15.650382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fe86b43e-3de6-42f0-8792-f27f41896f74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:15.678145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fe86b43e-3de6-42f0-8792-f27f41896f74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:15.685476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fe86b43e-3de6-42f0-8792-f27f41896f74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:15.697151 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fe86b43e-3de6-42f0-8792-f27f41896f74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1583 microversion: 2.42 time: 0.339094 Oct 12 22:16:15.698986 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1789/4126] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:15 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1583 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:16:15.760995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1702976188", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "c7dc26d4-2a62-4792-b299-a59c618c0313"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:15.875955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] validate_networks() for [('c7dc26d4-2a62-4792-b299-a59c618c0313', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:16:16.115687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8fdd499d-a0b5-4404-9db0-d3caf37b504d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:16.116323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8fdd499d-a0b5-4404-9db0-d3caf37b504d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:16.133148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fdd499d-a0b5-4404-9db0-d3caf37b504d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:16.134609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fdd499d-a0b5-4404-9db0-d3caf37b504d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:16.135255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fdd499d-a0b5-4404-9db0-d3caf37b504d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:16.137342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fdd499d-a0b5-4404-9db0-d3caf37b504d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:16.138058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fdd499d-a0b5-4404-9db0-d3caf37b504d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:16.138649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8fdd499d-a0b5-4404-9db0-d3caf37b504d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:16.519263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8fdd499d-a0b5-4404-9db0-d3caf37b504d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:16.535571 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8fdd499d-a0b5-4404-9db0-d3caf37b504d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1314 microversion: 2.1 time: 0.425164 Oct 12 22:16:16.537232 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1790/4127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:16 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:16:16.816666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-15b80795-3e67-4d60-b13b-f7b44c526538 tempest-AZV2TestJSON-1441200671 tempest-AZV2TestJSON-1441200671-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:16.818419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15b80795-3e67-4d60-b13b-f7b44c526538 tempest-AZV2TestJSON-1441200671 tempest-AZV2TestJSON-1441200671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:16.819163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15b80795-3e67-4d60-b13b-f7b44c526538 tempest-AZV2TestJSON-1441200671 tempest-AZV2TestJSON-1441200671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:16.819908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15b80795-3e67-4d60-b13b-f7b44c526538 tempest-AZV2TestJSON-1441200671 tempest-AZV2TestJSON-1441200671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:16.820905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15b80795-3e67-4d60-b13b-f7b44c526538 tempest-AZV2TestJSON-1441200671 tempest-AZV2TestJSON-1441200671-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:16.822292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15b80795-3e67-4d60-b13b-f7b44c526538 tempest-AZV2TestJSON-1441200671 tempest-AZV2TestJSON-1441200671-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:16.822958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15b80795-3e67-4d60-b13b-f7b44c526538 tempest-AZV2TestJSON-1441200671 tempest-AZV2TestJSON-1441200671-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:16.861384 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-15b80795-3e67-4d60-b13b-f7b44c526538 tempest-AZV2TestJSON-1441200671 tempest-AZV2TestJSON-1441200671-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.306406 Oct 12 22:16:16.862484 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1791/4128] 10.222.0.16 () {58 vars in 1164 bytes} [Wed Oct 12 22:16:16 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:16:16.869776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-29fcc4d1-7c24-4248-9e31-45fce36ded9e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:16.872955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-29fcc4d1-7c24-4248-9e31-45fce36ded9e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:16.881385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29fcc4d1-7c24-4248-9e31-45fce36ded9e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:16.882288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29fcc4d1-7c24-4248-9e31-45fce36ded9e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:16.882970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29fcc4d1-7c24-4248-9e31-45fce36ded9e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:16.883921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29fcc4d1-7c24-4248-9e31-45fce36ded9e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:16.884651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29fcc4d1-7c24-4248-9e31-45fce36ded9e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:16.885404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29fcc4d1-7c24-4248-9e31-45fce36ded9e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:17.021280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-29fcc4d1-7c24-4248-9e31-45fce36ded9e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:17.036342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-29fcc4d1-7c24-4248-9e31-45fce36ded9e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:17.041924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-29fcc4d1-7c24-4248-9e31-45fce36ded9e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:17.046256 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-29fcc4d1-7c24-4248-9e31-45fce36ded9e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1593 microversion: 2.42 time: 0.182270 Oct 12 22:16:17.065422 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1792/4129] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:16 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1593 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:17.561597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3e292571-2357-40c5-9f6b-0eac4a13b18b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:17.562311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3e292571-2357-40c5-9f6b-0eac4a13b18b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:17.583132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e292571-2357-40c5-9f6b-0eac4a13b18b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:17.591607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e292571-2357-40c5-9f6b-0eac4a13b18b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:17.592380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e292571-2357-40c5-9f6b-0eac4a13b18b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:17.594598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e292571-2357-40c5-9f6b-0eac4a13b18b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:17.600220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e292571-2357-40c5-9f6b-0eac4a13b18b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:17.604898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e292571-2357-40c5-9f6b-0eac4a13b18b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:18.398384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:16:18.399930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:16:18.400594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:16:18.401546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:16:18.401723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:16:18.438914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:18.440806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:18.443580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:18.446881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:18.447567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:18.449626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:18.521028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Getting quotas for project 8adffdfcc17442a88c91f6804787279a. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:16:18.545239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Getting quotas for user 06066387f835419c914fa6bebf0f3411 and project 8adffdfcc17442a88c91f6804787279a. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:16:18.592265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:16:18.595000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:16:18.773157 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-70471dfa-d8d0-4c11-8225-650f634a05cc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.016381 Oct 12 22:16:18.773417 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2338/4130] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:16:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:16:18.789225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1a079b31-76c2-4f63-b162-3a1aae1d44cc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:18.790094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1a079b31-76c2-4f63-b162-3a1aae1d44cc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:18.800638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a079b31-76c2-4f63-b162-3a1aae1d44cc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:18.808013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a079b31-76c2-4f63-b162-3a1aae1d44cc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:18.808762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a079b31-76c2-4f63-b162-3a1aae1d44cc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:18.809672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a079b31-76c2-4f63-b162-3a1aae1d44cc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:18.810302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a079b31-76c2-4f63-b162-3a1aae1d44cc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:18.811827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a079b31-76c2-4f63-b162-3a1aae1d44cc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:18.900424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3e292571-2357-40c5-9f6b-0eac4a13b18b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:18.915232 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3e292571-2357-40c5-9f6b-0eac4a13b18b tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1314 microversion: 2.1 time: 1.358139 Oct 12 22:16:18.944972 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1793/4131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:17 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1314 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:18.958222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-dd1c7a77-af6b-4b24-8ae9-26e8d6a375af req-8d5c32fc-a576-4b0a-ad8f-96f77a609ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e7a353-6197-41c1-a105-6ca3ca06f195", "name": "network-vif-deleted", "tag": "4d7852af-515a-4d0f-9f75-f01702943902"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:18.978180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dd1c7a77-af6b-4b24-8ae9-26e8d6a375af req-8d5c32fc-a576-4b0a-ad8f-96f77a609ba8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:18.981733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dd1c7a77-af6b-4b24-8ae9-26e8d6a375af req-8d5c32fc-a576-4b0a-ad8f-96f77a609ba8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:18.983685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dd1c7a77-af6b-4b24-8ae9-26e8d6a375af req-8d5c32fc-a576-4b0a-ad8f-96f77a609ba8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:19.029344 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-dd1c7a77-af6b-4b24-8ae9-26e8d6a375af req-8d5c32fc-a576-4b0a-ad8f-96f77a609ba8 service nova] Creating event network-vif-deleted:4d7852af-515a-4d0f-9f75-f01702943902 for instance 84e7a353-6197-41c1-a105-6ca3ca06f195 on n-h1-861111-1 Oct 12 22:16:19.044784 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-dd1c7a77-af6b-4b24-8ae9-26e8d6a375af req-8d5c32fc-a576-4b0a-ad8f-96f77a609ba8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096697 Oct 12 22:16:19.048530 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1794/4132] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:19.066438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-07be0f8e-689e-4138-977a-9885e7552f53 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:19.068805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-07be0f8e-689e-4138-977a-9885e7552f53 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:19.276305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-07be0f8e-689e-4138-977a-9885e7552f53 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:19.316208 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-07be0f8e-689e-4138-977a-9885e7552f53 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1218 microversion: 2.1 time: 0.234919 Oct 12 22:16:19.316969 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1795/4133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:19 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1218 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:19.657597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a079b31-76c2-4f63-b162-3a1aae1d44cc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:19.696888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a079b31-76c2-4f63-b162-3a1aae1d44cc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:19.702882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a079b31-76c2-4f63-b162-3a1aae1d44cc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:19.707348 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1a079b31-76c2-4f63-b162-3a1aae1d44cc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1661 microversion: 2.42 time: 0.932845 Oct 12 22:16:19.710347 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2339/4134] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:18 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1661 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:19.833597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-2c1a0530-c176-4969-8fa8-6f475552997e req-49fd614c-7eaf-487d-ad94-c127a3af2cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c509c8f-4240-4742-ae58-8f1ba3737348", "name": "network-vif-plugged", "status": "completed", "tag": "61fa2de7-5767-4ba1-89e1-bf5fe1923f9a"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:19.868602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2c1a0530-c176-4969-8fa8-6f475552997e req-49fd614c-7eaf-487d-ad94-c127a3af2cee service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:19.872032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2c1a0530-c176-4969-8fa8-6f475552997e req-49fd614c-7eaf-487d-ad94-c127a3af2cee service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:19.874451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2c1a0530-c176-4969-8fa8-6f475552997e req-49fd614c-7eaf-487d-ad94-c127a3af2cee service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:19.925396 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-2c1a0530-c176-4969-8fa8-6f475552997e req-49fd614c-7eaf-487d-ad94-c127a3af2cee service nova] Creating event network-vif-plugged:61fa2de7-5767-4ba1-89e1-bf5fe1923f9a for instance 9c509c8f-4240-4742-ae58-8f1ba3737348 on n-h2-861111-1 Oct 12 22:16:19.940441 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-2c1a0530-c176-4969-8fa8-6f475552997e req-49fd614c-7eaf-487d-ad94-c127a3af2cee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110886 Oct 12 22:16:19.942336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2a310bae-3f96-48af-97b0-f0b4aa3c4a68 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:19.943299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2a310bae-3f96-48af-97b0-f0b4aa3c4a68 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:19.948456 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1796/4135] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:19.992596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a310bae-3f96-48af-97b0-f0b4aa3c4a68 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:19.997845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a310bae-3f96-48af-97b0-f0b4aa3c4a68 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:19.998301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a310bae-3f96-48af-97b0-f0b4aa3c4a68 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:19.999748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a310bae-3f96-48af-97b0-f0b4aa3c4a68 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:20.000237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a310bae-3f96-48af-97b0-f0b4aa3c4a68 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:20.004833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a310bae-3f96-48af-97b0-f0b4aa3c4a68 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:20.351865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9fbb3c07-7802-41fd-bd23-6f0f8fafe9e9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:20.352958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9fbb3c07-7802-41fd-bd23-6f0f8fafe9e9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:20.361465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fbb3c07-7802-41fd-bd23-6f0f8fafe9e9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:20.362302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fbb3c07-7802-41fd-bd23-6f0f8fafe9e9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:20.363074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fbb3c07-7802-41fd-bd23-6f0f8fafe9e9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:20.364212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fbb3c07-7802-41fd-bd23-6f0f8fafe9e9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:20.365005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fbb3c07-7802-41fd-bd23-6f0f8fafe9e9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:20.365652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fbb3c07-7802-41fd-bd23-6f0f8fafe9e9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:20.388101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:20.591318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9fbb3c07-7802-41fd-bd23-6f0f8fafe9e9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:20.606463 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9fbb3c07-7802-41fd-bd23-6f0f8fafe9e9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1222 microversion: 2.1 time: 0.263881 Oct 12 22:16:20.607995 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1797/4136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:20 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1222 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:20.746338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-64777a0b-52c1-4398-a0ac-c39b0952c5c5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:20.747022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-64777a0b-52c1-4398-a0ac-c39b0952c5c5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:20.762949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64777a0b-52c1-4398-a0ac-c39b0952c5c5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:20.763482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64777a0b-52c1-4398-a0ac-c39b0952c5c5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:20.771856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64777a0b-52c1-4398-a0ac-c39b0952c5c5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:20.772972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64777a0b-52c1-4398-a0ac-c39b0952c5c5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:20.775679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64777a0b-52c1-4398-a0ac-c39b0952c5c5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:20.780570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64777a0b-52c1-4398-a0ac-c39b0952c5c5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:20.972732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2a310bae-3f96-48af-97b0-f0b4aa3c4a68 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:21.006812 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2a310bae-3f96-48af-97b0-f0b4aa3c4a68 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1314 microversion: 2.1 time: 1.066056 Oct 12 22:16:21.031464 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2340/4137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:19 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1314 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:21.161021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-64777a0b-52c1-4398-a0ac-c39b0952c5c5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:21.182671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-64777a0b-52c1-4398-a0ac-c39b0952c5c5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:21.194439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-64777a0b-52c1-4398-a0ac-c39b0952c5c5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:21.199890 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-64777a0b-52c1-4398-a0ac-c39b0952c5c5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1708 microversion: 2.42 time: 0.457530 Oct 12 22:16:21.224176 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1798/4138] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:20 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1708 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:21.634647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-84966c49-ae03-41d8-9223-4996b53a02b0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:21.635362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-84966c49-ae03-41d8-9223-4996b53a02b0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:21.653722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84966c49-ae03-41d8-9223-4996b53a02b0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:21.654518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84966c49-ae03-41d8-9223-4996b53a02b0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:21.656132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84966c49-ae03-41d8-9223-4996b53a02b0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:21.661453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84966c49-ae03-41d8-9223-4996b53a02b0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:21.662169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84966c49-ae03-41d8-9223-4996b53a02b0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:21.662634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84966c49-ae03-41d8-9223-4996b53a02b0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:21.885566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-84966c49-ae03-41d8-9223-4996b53a02b0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:21.905027 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-84966c49-ae03-41d8-9223-4996b53a02b0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1270 microversion: 2.1 time: 0.274500 Oct 12 22:16:21.908040 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2341/4139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:21 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1270 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:16:22.059373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-48da8faa-679e-4614-8972-33946dbfb8c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:22.061337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-48da8faa-679e-4614-8972-33946dbfb8c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:22.101183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48da8faa-679e-4614-8972-33946dbfb8c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:22.104538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48da8faa-679e-4614-8972-33946dbfb8c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:22.105288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48da8faa-679e-4614-8972-33946dbfb8c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:22.106326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48da8faa-679e-4614-8972-33946dbfb8c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:22.110939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48da8faa-679e-4614-8972-33946dbfb8c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:22.114767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48da8faa-679e-4614-8972-33946dbfb8c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:22.231730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b28fd933-131c-43a3-b3b1-cf29fa6772b6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:22.233048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b28fd933-131c-43a3-b3b1-cf29fa6772b6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:22.248247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b28fd933-131c-43a3-b3b1-cf29fa6772b6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:22.249152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b28fd933-131c-43a3-b3b1-cf29fa6772b6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:22.251344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b28fd933-131c-43a3-b3b1-cf29fa6772b6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:22.252435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b28fd933-131c-43a3-b3b1-cf29fa6772b6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:22.254800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b28fd933-131c-43a3-b3b1-cf29fa6772b6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:22.255532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b28fd933-131c-43a3-b3b1-cf29fa6772b6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:22.831147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b28fd933-131c-43a3-b3b1-cf29fa6772b6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:22.837213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-48da8faa-679e-4614-8972-33946dbfb8c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:22.848695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b28fd933-131c-43a3-b3b1-cf29fa6772b6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:22.850697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b28fd933-131c-43a3-b3b1-cf29fa6772b6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:22.852126 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b28fd933-131c-43a3-b3b1-cf29fa6772b6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1708 microversion: 2.42 time: 0.624518 Oct 12 22:16:22.853559 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2342/4140] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:22 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1708 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:22.857240 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-48da8faa-679e-4614-8972-33946dbfb8c8 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1501 microversion: 2.1 time: 0.820162 Oct 12 22:16:22.857817 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1799/4141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:22 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1501 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:22.896551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a2360846-3dac-49f7-a814-d7150c92fdfa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:22.897128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a2360846-3dac-49f7-a814-d7150c92fdfa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:22.912296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2360846-3dac-49f7-a814-d7150c92fdfa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:22.912806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2360846-3dac-49f7-a814-d7150c92fdfa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:22.913251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2360846-3dac-49f7-a814-d7150c92fdfa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:22.913976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2360846-3dac-49f7-a814-d7150c92fdfa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:22.914432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2360846-3dac-49f7-a814-d7150c92fdfa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:22.914960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2360846-3dac-49f7-a814-d7150c92fdfa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:22.934871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1294c876-f9bc-4700-99f9-814bbe7dd091 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:22.936540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1294c876-f9bc-4700-99f9-814bbe7dd091 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:22.954954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-a2360846-3dac-49f7-a814-d7150c92fdfa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lazy-loading 'flavor' on Instance uuid 9c509c8f-4240-4742-ae58-8f1ba3737348 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:16:22.962661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1294c876-f9bc-4700-99f9-814bbe7dd091 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:22.963157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1294c876-f9bc-4700-99f9-814bbe7dd091 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:22.963616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1294c876-f9bc-4700-99f9-814bbe7dd091 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:22.965202 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1294c876-f9bc-4700-99f9-814bbe7dd091 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:22.965643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1294c876-f9bc-4700-99f9-814bbe7dd091 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:22.967039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1294c876-f9bc-4700-99f9-814bbe7dd091 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:23.110129 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a2360846-3dac-49f7-a814-d7150c92fdfa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "POST /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348/action" status: 202 len: 0 microversion: 2.1 time: 0.217175 Oct 12 22:16:23.110836 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2343/4142] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:16:22 2022] POST /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:16:23.138366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-519413ee-b123-481b-8ec0-fae3c9c1cb47 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:23.144097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-519413ee-b123-481b-8ec0-fae3c9c1cb47 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:23.153760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-519413ee-b123-481b-8ec0-fae3c9c1cb47 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:23.154653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-519413ee-b123-481b-8ec0-fae3c9c1cb47 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:23.155464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-519413ee-b123-481b-8ec0-fae3c9c1cb47 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:23.158128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-519413ee-b123-481b-8ec0-fae3c9c1cb47 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:23.158866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-519413ee-b123-481b-8ec0-fae3c9c1cb47 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:23.159526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-519413ee-b123-481b-8ec0-fae3c9c1cb47 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:23.215542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1294c876-f9bc-4700-99f9-814bbe7dd091 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:23.227277 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1294c876-f9bc-4700-99f9-814bbe7dd091 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1276 microversion: 2.1 time: 0.296993 Oct 12 22:16:23.245151 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1800/4143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:22 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1276 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:23.884032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-146bd490-b3eb-417d-96ba-39c4aa0cbbc2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:23.886320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-146bd490-b3eb-417d-96ba-39c4aa0cbbc2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:23.898669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-146bd490-b3eb-417d-96ba-39c4aa0cbbc2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:23.899476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-146bd490-b3eb-417d-96ba-39c4aa0cbbc2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:23.900113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-146bd490-b3eb-417d-96ba-39c4aa0cbbc2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:23.902350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-146bd490-b3eb-417d-96ba-39c4aa0cbbc2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:23.905994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-146bd490-b3eb-417d-96ba-39c4aa0cbbc2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:23.906833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-146bd490-b3eb-417d-96ba-39c4aa0cbbc2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:24.059371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-519413ee-b123-481b-8ec0-fae3c9c1cb47 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:24.072850 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-519413ee-b123-481b-8ec0-fae3c9c1cb47 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1509 microversion: 2.1 time: 0.944243 Oct 12 22:16:24.073507 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2344/4144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:23 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1509 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:16:24.254387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-69967801-3735-4fb7-bd36-b26eab7357e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:24.255044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-69967801-3735-4fb7-bd36-b26eab7357e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:24.267669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69967801-3735-4fb7-bd36-b26eab7357e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:24.268185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69967801-3735-4fb7-bd36-b26eab7357e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:24.270841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69967801-3735-4fb7-bd36-b26eab7357e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:24.271652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69967801-3735-4fb7-bd36-b26eab7357e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:24.272134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69967801-3735-4fb7-bd36-b26eab7357e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:24.272570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69967801-3735-4fb7-bd36-b26eab7357e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:24.497227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-146bd490-b3eb-417d-96ba-39c4aa0cbbc2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:24.520442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-146bd490-b3eb-417d-96ba-39c4aa0cbbc2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:24.523915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-146bd490-b3eb-417d-96ba-39c4aa0cbbc2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:24.525186 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-146bd490-b3eb-417d-96ba-39c4aa0cbbc2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1755 microversion: 2.42 time: 0.645753 Oct 12 22:16:24.525768 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1801/4145] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:23 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1755 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:25.105803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-12b12828-c94a-43a7-834d-3758e2378d95 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:25.106747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-12b12828-c94a-43a7-834d-3758e2378d95 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:25.122306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12b12828-c94a-43a7-834d-3758e2378d95 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:25.123421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12b12828-c94a-43a7-834d-3758e2378d95 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:25.124231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12b12828-c94a-43a7-834d-3758e2378d95 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:25.126972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12b12828-c94a-43a7-834d-3758e2378d95 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:25.127691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12b12828-c94a-43a7-834d-3758e2378d95 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:25.128993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12b12828-c94a-43a7-834d-3758e2378d95 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:25.415585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-69967801-3735-4fb7-bd36-b26eab7357e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:25.426955 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-69967801-3735-4fb7-bd36-b26eab7357e0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1318 microversion: 2.1 time: 1.176398 Oct 12 22:16:25.427863 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2345/4146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:24 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1318 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:16:25.554623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d4352814-2987-42b2-bbb8-f1aca210be01 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:25.555806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d4352814-2987-42b2-bbb8-f1aca210be01 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:25.567933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4352814-2987-42b2-bbb8-f1aca210be01 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:25.570877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4352814-2987-42b2-bbb8-f1aca210be01 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:25.574003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4352814-2987-42b2-bbb8-f1aca210be01 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:25.575017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4352814-2987-42b2-bbb8-f1aca210be01 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:25.575634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4352814-2987-42b2-bbb8-f1aca210be01 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:25.580501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4352814-2987-42b2-bbb8-f1aca210be01 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:25.612582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-12b12828-c94a-43a7-834d-3758e2378d95 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:25.622959 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-12b12828-c94a-43a7-834d-3758e2378d95 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1492 microversion: 2.1 time: 0.522343 Oct 12 22:16:25.627510 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1802/4147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:25 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1492 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:25.650559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e7e6b3cc-a974-4c61-827b-a478147b8c3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:25.651191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e7e6b3cc-a974-4c61-827b-a478147b8c3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:25.658931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7e6b3cc-a974-4c61-827b-a478147b8c3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:25.665217 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7e6b3cc-a974-4c61-827b-a478147b8c3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:25.666786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7e6b3cc-a974-4c61-827b-a478147b8c3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:25.670031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7e6b3cc-a974-4c61-827b-a478147b8c3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:25.670934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7e6b3cc-a974-4c61-827b-a478147b8c3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:25.671701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7e6b3cc-a974-4c61-827b-a478147b8c3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:25.711205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e7e6b3cc-a974-4c61-827b-a478147b8c3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:16:25.827874 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e7e6b3cc-a974-4c61-827b-a478147b8c3f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 204 len: 0 microversion: 2.1 time: 0.180932 Oct 12 22:16:25.833455 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1803/4148] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:16:25 2022] DELETE /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:16:25.851940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-17037af0-7785-45ca-aada-e478a8ada96d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:25.852740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-17037af0-7785-45ca-aada-e478a8ada96d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:25.860800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17037af0-7785-45ca-aada-e478a8ada96d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:25.861295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17037af0-7785-45ca-aada-e478a8ada96d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:25.861741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17037af0-7785-45ca-aada-e478a8ada96d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:25.871848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17037af0-7785-45ca-aada-e478a8ada96d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:25.872369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17037af0-7785-45ca-aada-e478a8ada96d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:25.872802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17037af0-7785-45ca-aada-e478a8ada96d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:26.021052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d4352814-2987-42b2-bbb8-f1aca210be01 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:26.030501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d4352814-2987-42b2-bbb8-f1aca210be01 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:26.032284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d4352814-2987-42b2-bbb8-f1aca210be01 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:26.033681 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d4352814-2987-42b2-bbb8-f1aca210be01 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1755 microversion: 2.42 time: 0.483540 Oct 12 22:16:26.051163 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2346/4149] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:25 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1755 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:26.279960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-17037af0-7785-45ca-aada-e478a8ada96d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:26.295090 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-17037af0-7785-45ca-aada-e478a8ada96d tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1498 microversion: 2.1 time: 0.458814 Oct 12 22:16:26.296948 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1804/4150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:25 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1498 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:26.454260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1d16ae93-a73b-4319-99c8-cdc7a121ec5f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:26.455484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1d16ae93-a73b-4319-99c8-cdc7a121ec5f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:26.469785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d16ae93-a73b-4319-99c8-cdc7a121ec5f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:26.470284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d16ae93-a73b-4319-99c8-cdc7a121ec5f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:26.470735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d16ae93-a73b-4319-99c8-cdc7a121ec5f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:26.471490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d16ae93-a73b-4319-99c8-cdc7a121ec5f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:26.471947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d16ae93-a73b-4319-99c8-cdc7a121ec5f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:26.478090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d16ae93-a73b-4319-99c8-cdc7a121ec5f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:27.061985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ae37850a-dc78-4807-b289-77a99b86fac6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:27.062610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ae37850a-dc78-4807-b289-77a99b86fac6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:27.064668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:27.085343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae37850a-dc78-4807-b289-77a99b86fac6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:27.086613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae37850a-dc78-4807-b289-77a99b86fac6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:27.086613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae37850a-dc78-4807-b289-77a99b86fac6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:27.088093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae37850a-dc78-4807-b289-77a99b86fac6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:27.088748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae37850a-dc78-4807-b289-77a99b86fac6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:27.089186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae37850a-dc78-4807-b289-77a99b86fac6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:27.218467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1d16ae93-a73b-4319-99c8-cdc7a121ec5f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:27.233702 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1d16ae93-a73b-4319-99c8-cdc7a121ec5f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1318 microversion: 2.1 time: 0.783505 Oct 12 22:16:27.237609 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2347/4151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:26 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1318 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:16:27.322822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c14be046-1e2b-4dcb-9834-18aff718d443 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:27.325019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c14be046-1e2b-4dcb-9834-18aff718d443 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:27.332718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c14be046-1e2b-4dcb-9834-18aff718d443 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:27.336788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c14be046-1e2b-4dcb-9834-18aff718d443 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:27.340941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c14be046-1e2b-4dcb-9834-18aff718d443 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:27.342547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c14be046-1e2b-4dcb-9834-18aff718d443 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:27.343211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c14be046-1e2b-4dcb-9834-18aff718d443 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:27.344009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c14be046-1e2b-4dcb-9834-18aff718d443 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:27.363813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:27.891512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c14be046-1e2b-4dcb-9834-18aff718d443 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:27.901252 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c14be046-1e2b-4dcb-9834-18aff718d443 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1498 microversion: 2.1 time: 0.582780 Oct 12 22:16:27.905329 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2348/4152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:27 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1498 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:28.154840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-97efa110-ee8c-45c4-a0e0-4dcfdd412ce7 req-7a55998b-c18b-48ba-b81f-954a449f5a2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2346df42-7c4c-4187-9ea6-400fa07498dc", "tag": "5523dcec-a392-49fd-a057-74da510575dc"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:28.189237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-97efa110-ee8c-45c4-a0e0-4dcfdd412ce7 req-7a55998b-c18b-48ba-b81f-954a449f5a2c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:28.189737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-97efa110-ee8c-45c4-a0e0-4dcfdd412ce7 req-7a55998b-c18b-48ba-b81f-954a449f5a2c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:28.191346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-97efa110-ee8c-45c4-a0e0-4dcfdd412ce7 req-7a55998b-c18b-48ba-b81f-954a449f5a2c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:28.217314 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-97efa110-ee8c-45c4-a0e0-4dcfdd412ce7 req-7a55998b-c18b-48ba-b81f-954a449f5a2c service nova] Creating event network-changed:5523dcec-a392-49fd-a057-74da510575dc for instance 2346df42-7c4c-4187-9ea6-400fa07498dc on n-h1-861111-1 Oct 12 22:16:28.231579 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-97efa110-ee8c-45c4-a0e0-4dcfdd412ce7 req-7a55998b-c18b-48ba-b81f-954a449f5a2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086285 Oct 12 22:16:28.232498 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2349/4153] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:16:28.263571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7a50aa8f-c838-4e66-a475-4d050784338b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:28.264270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7a50aa8f-c838-4e66-a475-4d050784338b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:28.276278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a50aa8f-c838-4e66-a475-4d050784338b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:28.279339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a50aa8f-c838-4e66-a475-4d050784338b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:28.279998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a50aa8f-c838-4e66-a475-4d050784338b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:28.281402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a50aa8f-c838-4e66-a475-4d050784338b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:28.283674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a50aa8f-c838-4e66-a475-4d050784338b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:28.284333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a50aa8f-c838-4e66-a475-4d050784338b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:28.474724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:28.573377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7a50aa8f-c838-4e66-a475-4d050784338b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:28.576590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=42 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:28.588097 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7a50aa8f-c838-4e66-a475-4d050784338b tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1318 microversion: 2.1 time: 0.329289 Oct 12 22:16:28.607633 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2350/4154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:28 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:28.653319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ae37850a-dc78-4807-b289-77a99b86fac6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:28.664590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ae37850a-dc78-4807-b289-77a99b86fac6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:28.671861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ae37850a-dc78-4807-b289-77a99b86fac6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:28.680841 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ae37850a-dc78-4807-b289-77a99b86fac6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1802 microversion: 2.42 time: 1.623447 Oct 12 22:16:28.681613 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1805/4155] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:27 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1802 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:16:28.934061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1ce279bc-e082-40a4-aba3-d70c8b5bc3c1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:28.935395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1ce279bc-e082-40a4-aba3-d70c8b5bc3c1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:28.956698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ce279bc-e082-40a4-aba3-d70c8b5bc3c1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:28.957206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ce279bc-e082-40a4-aba3-d70c8b5bc3c1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:28.957822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ce279bc-e082-40a4-aba3-d70c8b5bc3c1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:28.958716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ce279bc-e082-40a4-aba3-d70c8b5bc3c1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:28.959637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ce279bc-e082-40a4-aba3-d70c8b5bc3c1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:28.960426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ce279bc-e082-40a4-aba3-d70c8b5bc3c1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:29.453436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1ce279bc-e082-40a4-aba3-d70c8b5bc3c1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:29.466252 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1ce279bc-e082-40a4-aba3-d70c8b5bc3c1 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1498 microversion: 2.1 time: 0.537092 Oct 12 22:16:29.470979 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2351/4156] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:28 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1498 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:29.613971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-555de48e-453d-4dc4-a268-df4f347273d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:29.615046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-555de48e-453d-4dc4-a268-df4f347273d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:29.617895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:29.642043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-555de48e-453d-4dc4-a268-df4f347273d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:29.642573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-555de48e-453d-4dc4-a268-df4f347273d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:29.642993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-555de48e-453d-4dc4-a268-df4f347273d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:29.643753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-555de48e-453d-4dc4-a268-df4f347273d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:29.644206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-555de48e-453d-4dc4-a268-df4f347273d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:29.644629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-555de48e-453d-4dc4-a268-df4f347273d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:29.720735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2fc5615a-6fbd-42c5-9945-af46e52eb7a5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:29.721352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2fc5615a-6fbd-42c5-9945-af46e52eb7a5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:29.739437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2fc5615a-6fbd-42c5-9945-af46e52eb7a5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:29.740085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2fc5615a-6fbd-42c5-9945-af46e52eb7a5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:29.740524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2fc5615a-6fbd-42c5-9945-af46e52eb7a5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:29.741423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2fc5615a-6fbd-42c5-9945-af46e52eb7a5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:29.742196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2fc5615a-6fbd-42c5-9945-af46e52eb7a5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:29.742789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2fc5615a-6fbd-42c5-9945-af46e52eb7a5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:30.456456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2fc5615a-6fbd-42c5-9945-af46e52eb7a5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:30.473010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2fc5615a-6fbd-42c5-9945-af46e52eb7a5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:30.484657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2fc5615a-6fbd-42c5-9945-af46e52eb7a5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:30.486113 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2fc5615a-6fbd-42c5-9945-af46e52eb7a5 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1802 microversion: 2.42 time: 0.769522 Oct 12 22:16:30.487215 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2352/4157] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:29 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1802 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:30.499640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ae74dfaa-855a-4ede-90ea-e3af1f9130aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:30.500614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ae74dfaa-855a-4ede-90ea-e3af1f9130aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:30.512288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae74dfaa-855a-4ede-90ea-e3af1f9130aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:30.513118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae74dfaa-855a-4ede-90ea-e3af1f9130aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:30.513988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae74dfaa-855a-4ede-90ea-e3af1f9130aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:30.519349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae74dfaa-855a-4ede-90ea-e3af1f9130aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:30.520102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae74dfaa-855a-4ede-90ea-e3af1f9130aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:30.520741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae74dfaa-855a-4ede-90ea-e3af1f9130aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:30.661745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ae74dfaa-855a-4ede-90ea-e3af1f9130aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:30.677335 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ae74dfaa-855a-4ede-90ea-e3af1f9130aa tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1456 microversion: 2.1 time: 0.181463 Oct 12 22:16:30.678260 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2353/4158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:30 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1456 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:16:31.081987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-e2fe98be-7e67-44ec-a3f1-db77cfa81750 req-0502cba5-3442-430f-bd48-54603fc60024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c509c8f-4240-4742-ae58-8f1ba3737348", "name": "network-vif-deleted", "tag": "61fa2de7-5767-4ba1-89e1-bf5fe1923f9a"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:31.112897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e2fe98be-7e67-44ec-a3f1-db77cfa81750 req-0502cba5-3442-430f-bd48-54603fc60024 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:31.114729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e2fe98be-7e67-44ec-a3f1-db77cfa81750 req-0502cba5-3442-430f-bd48-54603fc60024 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:31.116355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e2fe98be-7e67-44ec-a3f1-db77cfa81750 req-0502cba5-3442-430f-bd48-54603fc60024 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:31.172213 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-e2fe98be-7e67-44ec-a3f1-db77cfa81750 req-0502cba5-3442-430f-bd48-54603fc60024 service nova] Creating event network-vif-deleted:61fa2de7-5767-4ba1-89e1-bf5fe1923f9a for instance 9c509c8f-4240-4742-ae58-8f1ba3737348 on n-h2-861111-1 Oct 12 22:16:31.184712 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-e2fe98be-7e67-44ec-a3f1-db77cfa81750 req-0502cba5-3442-430f-bd48-54603fc60024 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106408 Oct 12 22:16:31.186501 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2354/4159] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:16:31.247259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-555de48e-453d-4dc4-a268-df4f347273d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:31.257557 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-555de48e-453d-4dc4-a268-df4f347273d5 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1318 microversion: 2.1 time: 1.647401 Oct 12 22:16:31.288882 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1806/4160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:29 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1318 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:31.513270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5528de26-54a7-430e-85fd-812ab878cfd2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:31.514037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5528de26-54a7-430e-85fd-812ab878cfd2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:31.533545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5528de26-54a7-430e-85fd-812ab878cfd2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:31.534253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5528de26-54a7-430e-85fd-812ab878cfd2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:31.534706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5528de26-54a7-430e-85fd-812ab878cfd2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:31.537526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5528de26-54a7-430e-85fd-812ab878cfd2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:31.539944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5528de26-54a7-430e-85fd-812ab878cfd2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:31.540636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5528de26-54a7-430e-85fd-812ab878cfd2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:31.704715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0cb71bc9-a644-4da1-b644-713571b3352f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:31.706046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0cb71bc9-a644-4da1-b644-713571b3352f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:31.722081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cb71bc9-a644-4da1-b644-713571b3352f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:31.722885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cb71bc9-a644-4da1-b644-713571b3352f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:31.723769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cb71bc9-a644-4da1-b644-713571b3352f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:31.726193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cb71bc9-a644-4da1-b644-713571b3352f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:31.726876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cb71bc9-a644-4da1-b644-713571b3352f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:31.731112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cb71bc9-a644-4da1-b644-713571b3352f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:31.807385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cb71bc9-a644-4da1-b644-713571b3352f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:31.815812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cb71bc9-a644-4da1-b644-713571b3352f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:31.816080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cb71bc9-a644-4da1-b644-713571b3352f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:31.816400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-0cb71bc9-a644-4da1-b644-713571b3352f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lazy-loading 'fault' on Instance uuid 9c509c8f-4240-4742-ae58-8f1ba3737348 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:16:31.977163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5528de26-54a7-430e-85fd-812ab878cfd2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:32.006523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5528de26-54a7-430e-85fd-812ab878cfd2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:32.008024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5528de26-54a7-430e-85fd-812ab878cfd2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:32.009218 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5528de26-54a7-430e-85fd-812ab878cfd2 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1849 microversion: 2.42 time: 0.500728 Oct 12 22:16:32.017689 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2355/4161] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:31 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1849 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:32.044354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0cb71bc9-a644-4da1-b644-713571b3352f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11096cece79f4b8fad4b92270f51b299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b898b5d0208478e996b7fee2060ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:32.055211 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0cb71bc9-a644-4da1-b644-713571b3352f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 200 len: 1304 microversion: 2.1 time: 0.354680 Oct 12 22:16:32.060402 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1807/4162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:31 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 1304 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:32.284233 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0ec96b0b-1efa-4021-996d-b764bc962d0c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:32.285844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0ec96b0b-1efa-4021-996d-b764bc962d0c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:32.316706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ec96b0b-1efa-4021-996d-b764bc962d0c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:32.317220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ec96b0b-1efa-4021-996d-b764bc962d0c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:32.317863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ec96b0b-1efa-4021-996d-b764bc962d0c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:32.318547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ec96b0b-1efa-4021-996d-b764bc962d0c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:32.319200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ec96b0b-1efa-4021-996d-b764bc962d0c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:32.321012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ec96b0b-1efa-4021-996d-b764bc962d0c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:32.570593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-252615691", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "54cb3138-0344-4e7c-b9e2-cb2617ec222e"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:32.682660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] validate_networks() for [('54cb3138-0344-4e7c-b9e2-cb2617ec222e', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:16:33.990577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0ec96b0b-1efa-4021-996d-b764bc962d0c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:34.014880 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0ec96b0b-1efa-4021-996d-b764bc962d0c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1318 microversion: 2.1 time: 1.737892 Oct 12 22:16:34.020195 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1808/4163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:32 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1318 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:34.039036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dff3c879-7198-4c05-b163-667dc884c27d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:34.045778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dff3c879-7198-4c05-b163-667dc884c27d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:34.067587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dff3c879-7198-4c05-b163-667dc884c27d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:34.068199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dff3c879-7198-4c05-b163-667dc884c27d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:34.068643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dff3c879-7198-4c05-b163-667dc884c27d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:34.069485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dff3c879-7198-4c05-b163-667dc884c27d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:34.069859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dff3c879-7198-4c05-b163-667dc884c27d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:34.075126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dff3c879-7198-4c05-b163-667dc884c27d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:34.846755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:16:34.848048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:16:34.850644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:16:34.852408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:16:34.853670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:16:34.885114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:34.889652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:34.890273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:34.891549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:34.892242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:34.892960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:34.919023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Getting quotas for project 9b3174da88ba4d25a458649cdb4e1e77. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:16:34.925557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Getting quotas for user 536c3ebddaa54c19b13d3602d8bb1efe and project 9b3174da88ba4d25a458649cdb4e1e77. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:16:34.935828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dff3c879-7198-4c05-b163-667dc884c27d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:34.941113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:16:34.944172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:16:34.947811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dff3c879-7198-4c05-b163-667dc884c27d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:34.956511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dff3c879-7198-4c05-b163-667dc884c27d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:34.958063 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dff3c879-7198-4c05-b163-667dc884c27d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1849 microversion: 2.42 time: 0.936697 Oct 12 22:16:34.962143 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1809/4164] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:34 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1849 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:34.983885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9e9a4094-ba38-4ed8-a462-4aea3641b8dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:34.986796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9e9a4094-ba38-4ed8-a462-4aea3641b8dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:35.013922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e9a4094-ba38-4ed8-a462-4aea3641b8dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.017376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e9a4094-ba38-4ed8-a462-4aea3641b8dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:35.020452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e9a4094-ba38-4ed8-a462-4aea3641b8dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:35.021492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e9a4094-ba38-4ed8-a462-4aea3641b8dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.022134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e9a4094-ba38-4ed8-a462-4aea3641b8dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:35.022733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e9a4094-ba38-4ed8-a462-4aea3641b8dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:35.031567 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d679c555-90b5-482e-a2e6-9a01ae663e89 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.747322 Oct 12 22:16:35.032331 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2356/4165] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:16:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:16:35.051956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-10fd3f2c-9458-48c4-88dd-11934db5e1c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:35.052574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-10fd3f2c-9458-48c4-88dd-11934db5e1c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:35.073910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10fd3f2c-9458-48c4-88dd-11934db5e1c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.074368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10fd3f2c-9458-48c4-88dd-11934db5e1c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:35.074807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10fd3f2c-9458-48c4-88dd-11934db5e1c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:35.075553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10fd3f2c-9458-48c4-88dd-11934db5e1c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.076003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10fd3f2c-9458-48c4-88dd-11934db5e1c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:35.076489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10fd3f2c-9458-48c4-88dd-11934db5e1c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:35.082258 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-9e9a4094-ba38-4ed8-a462-4aea3641b8dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9e9a4094-ba38-4ed8-a462-4aea3641b8dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 HTTP/1.1 Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '9c509c8f-4240-4742-ae58-8f1ba3737348'} Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:35.089973 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.094757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.094757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:35.094757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:35.094757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:35.094757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:35.094757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. Oct 12 22:16:35.094757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.097109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9e9a4094-ba38-4ed8-a462-4aea3641b8dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:35.099826 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9e9a4094-ba38-4ed8-a462-4aea3641b8dc tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 404 len: 111 microversion: 2.1 time: 0.132210 Oct 12 22:16:35.109127 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1810/4166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:34 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:35.119006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6561b4ba-ec30-48ea-bc45-46928fefe153 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:35.120019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6561b4ba-ec30-48ea-bc45-46928fefe153 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:35.270150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6561b4ba-ec30-48ea-bc45-46928fefe153 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:35.287679 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6561b4ba-ec30-48ea-bc45-46928fefe153 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1216 microversion: 2.1 time: 0.177034 Oct 12 22:16:35.302070 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1811/4167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:35 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1216 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:35.313596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2a5688ad-038f-4a9e-bb28-b410fed294c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:35.314929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2a5688ad-038f-4a9e-bb28-b410fed294c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:35.331990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a5688ad-038f-4a9e-bb28-b410fed294c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.341894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a5688ad-038f-4a9e-bb28-b410fed294c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:35.342557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a5688ad-038f-4a9e-bb28-b410fed294c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:35.343557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a5688ad-038f-4a9e-bb28-b410fed294c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.345719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a5688ad-038f-4a9e-bb28-b410fed294c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:35.349285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a5688ad-038f-4a9e-bb28-b410fed294c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:35.403695 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-2a5688ad-038f-4a9e-bb28-b410fed294c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2a5688ad-038f-4a9e-bb28-b410fed294c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 HTTP/1.1 Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '9c509c8f-4240-4742-ae58-8f1ba3737348'} Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:35.411434 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:35.418748 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. Oct 12 22:16:35.418748 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.418748 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:35.418748 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.418748 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.418748 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:35.418748 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:35.418748 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:35.418748 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:35.418748 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. Oct 12 22:16:35.418748 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.428112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2a5688ad-038f-4a9e-bb28-b410fed294c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:35.430815 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2a5688ad-038f-4a9e-bb28-b410fed294c0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 404 len: 111 microversion: 2.1 time: 0.127459 Oct 12 22:16:35.434190 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1812/4168] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:16:35 2022] DELETE /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:35.450851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-70aa4d58-5155-442f-8aa1-5df5d2ecddbe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:35.453207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-70aa4d58-5155-442f-8aa1-5df5d2ecddbe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 9c509c8f-4240-4742-ae58-8f1ba3737348] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:35.466249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70aa4d58-5155-442f-8aa1-5df5d2ecddbe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.470786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70aa4d58-5155-442f-8aa1-5df5d2ecddbe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:35.471630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70aa4d58-5155-442f-8aa1-5df5d2ecddbe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:35.472481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70aa4d58-5155-442f-8aa1-5df5d2ecddbe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.474494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70aa4d58-5155-442f-8aa1-5df5d2ecddbe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:35.475053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70aa4d58-5155-442f-8aa1-5df5d2ecddbe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:35.511699 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-70aa4d58-5155-442f-8aa1-5df5d2ecddbe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-70aa4d58-5155-442f-8aa1-5df5d2ecddbe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 HTTP/1.1 Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '9c509c8f-4240-4742-ae58-8f1ba3737348'} Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:35.514035 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.518590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.518590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:35.518590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:35.518590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:35.518590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:35.518590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. Oct 12 22:16:35.518590 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.518590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-70aa4d58-5155-442f-8aa1-5df5d2ecddbe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 9c509c8f-4240-4742-ae58-8f1ba3737348 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:35.520009 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-70aa4d58-5155-442f-8aa1-5df5d2ecddbe tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348" status: 404 len: 111 microversion: 2.1 time: 0.080024 Oct 12 22:16:35.520009 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1813/4169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:35 2022] GET /compute/v2.1/servers/9c509c8f-4240-4742-ae58-8f1ba3737348 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:35.532718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6e362427-dc68-491a-a9a7-8b07ac8921b0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:35.535166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6e362427-dc68-491a-a9a7-8b07ac8921b0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:35.558766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e362427-dc68-491a-a9a7-8b07ac8921b0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.565696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e362427-dc68-491a-a9a7-8b07ac8921b0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:35.570112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e362427-dc68-491a-a9a7-8b07ac8921b0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:35.572201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e362427-dc68-491a-a9a7-8b07ac8921b0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.573124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e362427-dc68-491a-a9a7-8b07ac8921b0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:35.574659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e362427-dc68-491a-a9a7-8b07ac8921b0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:35.613574 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-6e362427-dc68-491a-a9a7-8b07ac8921b0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6e362427-dc68-491a-a9a7-8b07ac8921b0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c HTTP/1.1 Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '23d18a30-56c9-4666-bb85-83c8a6c0c82c'} Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:35.618477 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:35.623001 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. Oct 12 22:16:35.623001 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.623001 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:35.623001 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.623001 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.623001 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:35.623001 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:35.623001 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:35.623001 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:35.623001 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. Oct 12 22:16:35.623001 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.623001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6e362427-dc68-491a-a9a7-8b07ac8921b0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:35.623001 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6e362427-dc68-491a-a9a7-8b07ac8921b0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "DELETE /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 404 len: 111 microversion: 2.1 time: 0.098153 Oct 12 22:16:35.625150 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1814/4170] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:16:35 2022] DELETE /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:35.640470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-044bd4f5-664b-4303-80d6-ec30aa010e90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:35.641353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-044bd4f5-664b-4303-80d6-ec30aa010e90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 23d18a30-56c9-4666-bb85-83c8a6c0c82c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:35.656579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-044bd4f5-664b-4303-80d6-ec30aa010e90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.658545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-044bd4f5-664b-4303-80d6-ec30aa010e90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:35.660518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-044bd4f5-664b-4303-80d6-ec30aa010e90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:35.661453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-044bd4f5-664b-4303-80d6-ec30aa010e90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.662743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-044bd4f5-664b-4303-80d6-ec30aa010e90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:35.663906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-044bd4f5-664b-4303-80d6-ec30aa010e90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:35.703642 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-044bd4f5-664b-4303-80d6-ec30aa010e90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-044bd4f5-664b-4303-80d6-ec30aa010e90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c HTTP/1.1 Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '23d18a30-56c9-4666-bb85-83c8a6c0c82c'} Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:35.708742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.718102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.718102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:35.718102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:35.718102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:35.718102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:35.718102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. Oct 12 22:16:35.718102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.723218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-044bd4f5-664b-4303-80d6-ec30aa010e90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 23d18a30-56c9-4666-bb85-83c8a6c0c82c could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:35.723218 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-044bd4f5-664b-4303-80d6-ec30aa010e90 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c" status: 404 len: 111 microversion: 2.1 time: 0.092120 Oct 12 22:16:35.723218 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1815/4171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:35 2022] GET /compute/v2.1/servers/23d18a30-56c9-4666-bb85-83c8a6c0c82c => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:35.742314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-349d43d0-fc5a-43fd-b1fd-7da7b2fb861f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:35.744271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-349d43d0-fc5a-43fd-b1fd-7da7b2fb861f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:35.761603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-349d43d0-fc5a-43fd-b1fd-7da7b2fb861f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.764071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-349d43d0-fc5a-43fd-b1fd-7da7b2fb861f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:35.764821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-349d43d0-fc5a-43fd-b1fd-7da7b2fb861f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:35.766472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-349d43d0-fc5a-43fd-b1fd-7da7b2fb861f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.768586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-349d43d0-fc5a-43fd-b1fd-7da7b2fb861f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:35.769246 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-349d43d0-fc5a-43fd-b1fd-7da7b2fb861f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:35.815350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:35.821457 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-349d43d0-fc5a-43fd-b1fd-7da7b2fb861f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-349d43d0-fc5a-43fd-b1fd-7da7b2fb861f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 HTTP/1.1 Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '50994542-c3c0-46a4-b994-50c452999ba2'} Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:35.828433 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:35.836528 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. Oct 12 22:16:35.836528 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.836528 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:35.836528 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.836528 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.836528 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:35.836528 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:35.836528 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:35.836528 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:35.836528 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. Oct 12 22:16:35.836528 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.836528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-349d43d0-fc5a-43fd-b1fd-7da7b2fb861f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:35.836528 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-349d43d0-fc5a-43fd-b1fd-7da7b2fb861f tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "DELETE /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 404 len: 111 microversion: 2.1 time: 0.102923 Oct 12 22:16:35.836528 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1816/4172] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:16:35 2022] DELETE /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:35.850060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-50cad424-6118-46e5-bd30-a147365e0db4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:35.852128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-50cad424-6118-46e5-bd30-a147365e0db4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 50994542-c3c0-46a4-b994-50c452999ba2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:35.875305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50cad424-6118-46e5-bd30-a147365e0db4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.876630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50cad424-6118-46e5-bd30-a147365e0db4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:35.877195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50cad424-6118-46e5-bd30-a147365e0db4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:35.878156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50cad424-6118-46e5-bd30-a147365e0db4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.878635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50cad424-6118-46e5-bd30-a147365e0db4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:35.886465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50cad424-6118-46e5-bd30-a147365e0db4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:35.897297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-10fd3f2c-9458-48c4-88dd-11934db5e1c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:35.911031 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-10fd3f2c-9458-48c4-88dd-11934db5e1c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1318 microversion: 2.1 time: 0.862809 Oct 12 22:16:35.914281 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2357/4173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:35 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1318 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:35.938043 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-50cad424-6118-46e5-bd30-a147365e0db4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-50cad424-6118-46e5-bd30-a147365e0db4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 HTTP/1.1 Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '50994542-c3c0-46a4-b994-50c452999ba2'} Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:35.942645 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.949190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:35.949190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:35.949190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:35.949190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:35.949190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:35.949190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. Oct 12 22:16:35.949190 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:35.952224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-50cad424-6118-46e5-bd30-a147365e0db4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 50994542-c3c0-46a4-b994-50c452999ba2 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:35.953420 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-50cad424-6118-46e5-bd30-a147365e0db4 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2" status: 404 len: 111 microversion: 2.1 time: 0.115507 Oct 12 22:16:35.956642 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1817/4174] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:35 2022] GET /compute/v2.1/servers/50994542-c3c0-46a4-b994-50c452999ba2 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:35.966564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-79df66db-11cf-4eb4-989b-0cddccc30b97 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:35.967079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-79df66db-11cf-4eb4-989b-0cddccc30b97 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:35.978373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79df66db-11cf-4eb4-989b-0cddccc30b97 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.981617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79df66db-11cf-4eb4-989b-0cddccc30b97 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:35.982438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79df66db-11cf-4eb4-989b-0cddccc30b97 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:35.984025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79df66db-11cf-4eb4-989b-0cddccc30b97 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:35.993895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f97df1d-2974-435a-ba12-2e4c393cca07 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:35.994761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8f97df1d-2974-435a-ba12-2e4c393cca07 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:36.002419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79df66db-11cf-4eb4-989b-0cddccc30b97 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:36.003107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79df66db-11cf-4eb4-989b-0cddccc30b97 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:36.010644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f97df1d-2974-435a-ba12-2e4c393cca07 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:36.011963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f97df1d-2974-435a-ba12-2e4c393cca07 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:36.013172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f97df1d-2974-435a-ba12-2e4c393cca07 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:36.014331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f97df1d-2974-435a-ba12-2e4c393cca07 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:36.017222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f97df1d-2974-435a-ba12-2e4c393cca07 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:36.017890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f97df1d-2974-435a-ba12-2e4c393cca07 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:36.041407 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-79df66db-11cf-4eb4-989b-0cddccc30b97 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-79df66db-11cf-4eb4-989b-0cddccc30b97 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 HTTP/1.1 Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '295cbe61-8ee8-4a38-b2e8-4045383c2f61'} Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:36.046320 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:36.050924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. Oct 12 22:16:36.050924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.050924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:36.050924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.050924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:36.050924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:36.050924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:36.050924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:36.050924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:36.050924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. Oct 12 22:16:36.050924 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.050924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-79df66db-11cf-4eb4-989b-0cddccc30b97 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:36.050924 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-79df66db-11cf-4eb4-989b-0cddccc30b97 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "DELETE /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 404 len: 111 microversion: 2.1 time: 0.088567 Oct 12 22:16:36.055099 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2358/4175] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:16:35 2022] DELETE /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:36.078402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a21f5d35-8efe-4e83-a039-ca197ede3c8b req-084d6255-dcf3-4a1b-b5c5-86d0c8e0c7cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "tag": "a21af4ca-546d-4eb8-a73d-42ffccc0349b"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:36.124120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a21f5d35-8efe-4e83-a039-ca197ede3c8b req-084d6255-dcf3-4a1b-b5c5-86d0c8e0c7cf service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:36.124862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a21f5d35-8efe-4e83-a039-ca197ede3c8b req-084d6255-dcf3-4a1b-b5c5-86d0c8e0c7cf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:36.125501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a21f5d35-8efe-4e83-a039-ca197ede3c8b req-084d6255-dcf3-4a1b-b5c5-86d0c8e0c7cf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:36.143842 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a21f5d35-8efe-4e83-a039-ca197ede3c8b req-084d6255-dcf3-4a1b-b5c5-86d0c8e0c7cf service nova] Creating event network-changed:a21af4ca-546d-4eb8-a73d-42ffccc0349b for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:16:36.153050 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a21f5d35-8efe-4e83-a039-ca197ede3c8b req-084d6255-dcf3-4a1b-b5c5-86d0c8e0c7cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095346 Oct 12 22:16:36.154324 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2359/4176] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:36.166758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-490e6db6-3f3f-4511-982c-83f24baf2465 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:36.167983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-490e6db6-3f3f-4511-982c-83f24baf2465 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 295cbe61-8ee8-4a38-b2e8-4045383c2f61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:36.177858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-490e6db6-3f3f-4511-982c-83f24baf2465 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:36.179877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-490e6db6-3f3f-4511-982c-83f24baf2465 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:36.180583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-490e6db6-3f3f-4511-982c-83f24baf2465 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:36.182093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-490e6db6-3f3f-4511-982c-83f24baf2465 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:36.183418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-490e6db6-3f3f-4511-982c-83f24baf2465 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:36.184177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-490e6db6-3f3f-4511-982c-83f24baf2465 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:36.231853 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-490e6db6-3f3f-4511-982c-83f24baf2465 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-490e6db6-3f3f-4511-982c-83f24baf2465 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 HTTP/1.1 Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '295cbe61-8ee8-4a38-b2e8-4045383c2f61'} Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:36.235126 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.241566 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:36.241566 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:36.241566 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:36.241566 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:36.241566 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:36.241566 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. Oct 12 22:16:36.241566 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.244374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-490e6db6-3f3f-4511-982c-83f24baf2465 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 295cbe61-8ee8-4a38-b2e8-4045383c2f61 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:36.246128 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-490e6db6-3f3f-4511-982c-83f24baf2465 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61" status: 404 len: 111 microversion: 2.1 time: 0.088613 Oct 12 22:16:36.247326 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2360/4177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:36 2022] GET /compute/v2.1/servers/295cbe61-8ee8-4a38-b2e8-4045383c2f61 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:36.256544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9ddbe761-b1ef-43e2-96dd-fdb418486bdb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:36.257501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9ddbe761-b1ef-43e2-96dd-fdb418486bdb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 934f8d4a-d673-424d-a2b8-498156de4c86] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:36.266762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ddbe761-b1ef-43e2-96dd-fdb418486bdb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:36.267573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ddbe761-b1ef-43e2-96dd-fdb418486bdb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:36.268250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ddbe761-b1ef-43e2-96dd-fdb418486bdb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:36.269066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ddbe761-b1ef-43e2-96dd-fdb418486bdb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:36.269944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ddbe761-b1ef-43e2-96dd-fdb418486bdb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:36.270656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ddbe761-b1ef-43e2-96dd-fdb418486bdb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:36.289787 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-9ddbe761-b1ef-43e2-96dd-fdb418486bdb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9ddbe761-b1ef-43e2-96dd-fdb418486bdb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/934f8d4a-d673-424d-a2b8-498156de4c86 HTTP/1.1 Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '934f8d4a-d673-424d-a2b8-498156de4c86'} Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:36.291839 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:36.300772 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. Oct 12 22:16:36.300772 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.300772 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:36.300772 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.300772 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:36.300772 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:36.300772 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:36.300772 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:36.300772 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:36.300772 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. Oct 12 22:16:36.300772 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.304099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9ddbe761-b1ef-43e2-96dd-fdb418486bdb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:36.305232 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9ddbe761-b1ef-43e2-96dd-fdb418486bdb tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "DELETE /compute/v2.1/servers/934f8d4a-d673-424d-a2b8-498156de4c86" status: 404 len: 111 microversion: 2.1 time: 0.054218 Oct 12 22:16:36.307058 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2361/4178] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:16:36 2022] DELETE /compute/v2.1/servers/934f8d4a-d673-424d-a2b8-498156de4c86 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:36.327280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-300b3ff0-ecdb-4cab-a6dc-d9f39991ff56 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:36.336539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-300b3ff0-ecdb-4cab-a6dc-d9f39991ff56 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 934f8d4a-d673-424d-a2b8-498156de4c86] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:36.363382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-300b3ff0-ecdb-4cab-a6dc-d9f39991ff56 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:36.365738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-300b3ff0-ecdb-4cab-a6dc-d9f39991ff56 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:36.368680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-300b3ff0-ecdb-4cab-a6dc-d9f39991ff56 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:36.370055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-300b3ff0-ecdb-4cab-a6dc-d9f39991ff56 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:36.371672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-300b3ff0-ecdb-4cab-a6dc-d9f39991ff56 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:36.373848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-300b3ff0-ecdb-4cab-a6dc-d9f39991ff56 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:36.420592 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-300b3ff0-ecdb-4cab-a6dc-d9f39991ff56 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-300b3ff0-ecdb-4cab-a6dc-d9f39991ff56 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/934f8d4a-d673-424d-a2b8-498156de4c86 HTTP/1.1 Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '934f8d4a-d673-424d-a2b8-498156de4c86'} Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:36.425342 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.433495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:36.433495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:36.433495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:36.433495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:36.433495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:36.433495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. Oct 12 22:16:36.433495 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:36.439105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-300b3ff0-ecdb-4cab-a6dc-d9f39991ff56 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 934f8d4a-d673-424d-a2b8-498156de4c86 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:36.440264 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-300b3ff0-ecdb-4cab-a6dc-d9f39991ff56 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/934f8d4a-d673-424d-a2b8-498156de4c86" status: 404 len: 111 microversion: 2.1 time: 0.128684 Oct 12 22:16:36.442082 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2362/4179] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:36 2022] GET /compute/v2.1/servers/934f8d4a-d673-424d-a2b8-498156de4c86 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:16:36.457151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b5e3eb55-f7b1-4e4c-8c77-7436106adb26 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:36.461220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b5e3eb55-f7b1-4e4c-8c77-7436106adb26 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:36.491745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5e3eb55-f7b1-4e4c-8c77-7436106adb26 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:36.493580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5e3eb55-f7b1-4e4c-8c77-7436106adb26 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:36.495795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5e3eb55-f7b1-4e4c-8c77-7436106adb26 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:36.499725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5e3eb55-f7b1-4e4c-8c77-7436106adb26 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:36.503895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5e3eb55-f7b1-4e4c-8c77-7436106adb26 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:36.504761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5e3eb55-f7b1-4e4c-8c77-7436106adb26 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:37.178925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b5e3eb55-f7b1-4e4c-8c77-7436106adb26 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:37.194297 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b5e3eb55-f7b1-4e4c-8c77-7436106adb26 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1212 microversion: 2.1 time: 0.748307 Oct 12 22:16:37.196085 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2363/4180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:36 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1212 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:37.230001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-257fc8b7-8a63-45f0-a415-e7d74818a6d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:37.233209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-257fc8b7-8a63-45f0-a415-e7d74818a6d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:37.246564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-257fc8b7-8a63-45f0-a415-e7d74818a6d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:37.249958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-257fc8b7-8a63-45f0-a415-e7d74818a6d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:37.254727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-257fc8b7-8a63-45f0-a415-e7d74818a6d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:37.255886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-257fc8b7-8a63-45f0-a415-e7d74818a6d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:37.256616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-257fc8b7-8a63-45f0-a415-e7d74818a6d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:37.257301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-257fc8b7-8a63-45f0-a415-e7d74818a6d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:37.325031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f97df1d-2974-435a-ba12-2e4c393cca07 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:37.346971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f97df1d-2974-435a-ba12-2e4c393cca07 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:37.356310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f97df1d-2974-435a-ba12-2e4c393cca07 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:37.367742 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f97df1d-2974-435a-ba12-2e4c393cca07 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1849 microversion: 2.42 time: 1.373785 Oct 12 22:16:37.369597 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1818/4181] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:35 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1849 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:16:37.737473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-257fc8b7-8a63-45f0-a415-e7d74818a6d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:37.749034 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-257fc8b7-8a63-45f0-a415-e7d74818a6d2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1318 microversion: 2.1 time: 0.533351 Oct 12 22:16:37.749343 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2364/4182] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:37 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:38.128772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-5f32ebd5-6f4f-4c4e-a8b9-f618392b9473 req-8287b2c8-b903-49ce-a7de-faf3078cca3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2346df42-7c4c-4187-9ea6-400fa07498dc", "name": "network-vif-plugged", "status": "completed", "tag": "5523dcec-a392-49fd-a057-74da510575dc"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:38.151131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5f32ebd5-6f4f-4c4e-a8b9-f618392b9473 req-8287b2c8-b903-49ce-a7de-faf3078cca3b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:38.151767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5f32ebd5-6f4f-4c4e-a8b9-f618392b9473 req-8287b2c8-b903-49ce-a7de-faf3078cca3b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:38.152388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5f32ebd5-6f4f-4c4e-a8b9-f618392b9473 req-8287b2c8-b903-49ce-a7de-faf3078cca3b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:38.181231 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-5f32ebd5-6f4f-4c4e-a8b9-f618392b9473 req-8287b2c8-b903-49ce-a7de-faf3078cca3b service nova] Creating event network-vif-plugged:5523dcec-a392-49fd-a057-74da510575dc for instance 2346df42-7c4c-4187-9ea6-400fa07498dc on n-h1-861111-1 Oct 12 22:16:38.193922 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-5f32ebd5-6f4f-4c4e-a8b9-f618392b9473 req-8287b2c8-b903-49ce-a7de-faf3078cca3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069876 Oct 12 22:16:38.197810 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1819/4183] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:38.225289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f4a5c958-8cd7-4909-ba72-7148b0233015 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:38.225916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f4a5c958-8cd7-4909-ba72-7148b0233015 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:38.237518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4a5c958-8cd7-4909-ba72-7148b0233015 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:38.242238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4a5c958-8cd7-4909-ba72-7148b0233015 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:38.242912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4a5c958-8cd7-4909-ba72-7148b0233015 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:38.253172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4a5c958-8cd7-4909-ba72-7148b0233015 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:38.253936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4a5c958-8cd7-4909-ba72-7148b0233015 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:38.254601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4a5c958-8cd7-4909-ba72-7148b0233015 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:38.405224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a10b7006-3592-41b5-9bf6-7d3a2222f677 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:38.406183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a10b7006-3592-41b5-9bf6-7d3a2222f677 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:38.421070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a10b7006-3592-41b5-9bf6-7d3a2222f677 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:38.423138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a10b7006-3592-41b5-9bf6-7d3a2222f677 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:38.424626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a10b7006-3592-41b5-9bf6-7d3a2222f677 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:38.427063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a10b7006-3592-41b5-9bf6-7d3a2222f677 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:38.430537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a10b7006-3592-41b5-9bf6-7d3a2222f677 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:38.431332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a10b7006-3592-41b5-9bf6-7d3a2222f677 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:38.470809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f4a5c958-8cd7-4909-ba72-7148b0233015 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:38.494033 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f4a5c958-8cd7-4909-ba72-7148b0233015 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1274 microversion: 2.1 time: 0.269433 Oct 12 22:16:38.495400 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2365/4184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:38 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1274 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:38.774804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f3cb31ce-bdee-49cb-a64b-03f78fc1dedc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:38.775912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f3cb31ce-bdee-49cb-a64b-03f78fc1dedc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:38.798547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3cb31ce-bdee-49cb-a64b-03f78fc1dedc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:38.800055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3cb31ce-bdee-49cb-a64b-03f78fc1dedc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:38.800786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3cb31ce-bdee-49cb-a64b-03f78fc1dedc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:38.803688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3cb31ce-bdee-49cb-a64b-03f78fc1dedc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:38.804478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3cb31ce-bdee-49cb-a64b-03f78fc1dedc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:38.806903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3cb31ce-bdee-49cb-a64b-03f78fc1dedc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:39.450137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f3cb31ce-bdee-49cb-a64b-03f78fc1dedc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:39.458026 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f3cb31ce-bdee-49cb-a64b-03f78fc1dedc tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1318 microversion: 2.1 time: 0.689617 Oct 12 22:16:39.458610 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2366/4185] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:38 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:39.559535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-863ee023-9223-4336-8c41-208216d4d629 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Action: 'create', calling method: .version_select at 0x7f5122ec4ca0>, body: {"keypair": {"name": "tempest-keypair-134388822", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPKm0CnMRCD76rK/EcTQWbY66hVbJj0Ee66qTalDhItCcd33SpeLNxeTmtPNtzyhXNxJ/Ft2ipgNmPA7gC/ex089xgDFD1SFobosjeL1zDl6K0filKcuDosXNU63ndb7w=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:39.583507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:39.621517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-863ee023-9223-4336-8c41-208216d4d629 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Getting quotas for project a4fd7e7319ef437cb50910cd8ad84b7a. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:16:39.632366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-863ee023-9223-4336-8c41-208216d4d629 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Getting quotas for user 89a0d9b605d543b79d1cd9065187ed3d and project a4fd7e7319ef437cb50910cd8ad84b7a. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:16:39.723375 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-863ee023-9223-4336-8c41-208216d4d629 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.263632 Oct 12 22:16:39.724500 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2367/4186] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:16:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:39.731119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f9a7b6bc-04ac-41b9-a25d-a69523a85c1e tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:39.745885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f9a7b6bc-04ac-41b9-a25d-a69523a85c1e tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:39.773625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9a7b6bc-04ac-41b9-a25d-a69523a85c1e tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:39.774339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9a7b6bc-04ac-41b9-a25d-a69523a85c1e tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:39.774957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9a7b6bc-04ac-41b9-a25d-a69523a85c1e tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:39.775937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9a7b6bc-04ac-41b9-a25d-a69523a85c1e tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:39.776601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9a7b6bc-04ac-41b9-a25d-a69523a85c1e tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:39.780032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9a7b6bc-04ac-41b9-a25d-a69523a85c1e tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:40.070682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a10b7006-3592-41b5-9bf6-7d3a2222f677 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:40.114551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a10b7006-3592-41b5-9bf6-7d3a2222f677 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:40.118051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a10b7006-3592-41b5-9bf6-7d3a2222f677 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:40.119516 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a10b7006-3592-41b5-9bf6-7d3a2222f677 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1870 microversion: 2.42 time: 1.720823 Oct 12 22:16:40.120287 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1820/4187] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:38 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1870 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:40.166562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f9a7b6bc-04ac-41b9-a25d-a69523a85c1e tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:40.178102 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f9a7b6bc-04ac-41b9-a25d-a69523a85c1e tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1274 microversion: 2.1 time: 0.451167 Oct 12 22:16:40.180332 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2368/4188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:39 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1274 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:40.488943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-492ef444-d17c-40ac-a79a-6712a946b0d7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:40.489559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-492ef444-d17c-40ac-a79a-6712a946b0d7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:40.506042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-492ef444-d17c-40ac-a79a-6712a946b0d7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:40.508602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-492ef444-d17c-40ac-a79a-6712a946b0d7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:40.508602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-492ef444-d17c-40ac-a79a-6712a946b0d7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:40.508602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-492ef444-d17c-40ac-a79a-6712a946b0d7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:40.508602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-492ef444-d17c-40ac-a79a-6712a946b0d7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:40.508602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-492ef444-d17c-40ac-a79a-6712a946b0d7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:41.152647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-53b9e7d2-5a83-4d06-ad7d-1c9c40ac124e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:41.153432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-53b9e7d2-5a83-4d06-ad7d-1c9c40ac124e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:41.163316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53b9e7d2-5a83-4d06-ad7d-1c9c40ac124e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:41.163820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53b9e7d2-5a83-4d06-ad7d-1c9c40ac124e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:41.164265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53b9e7d2-5a83-4d06-ad7d-1c9c40ac124e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:41.164990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53b9e7d2-5a83-4d06-ad7d-1c9c40ac124e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:41.165668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53b9e7d2-5a83-4d06-ad7d-1c9c40ac124e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:41.166491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53b9e7d2-5a83-4d06-ad7d-1c9c40ac124e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:42.158182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-492ef444-d17c-40ac-a79a-6712a946b0d7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:42.184739 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-492ef444-d17c-40ac-a79a-6712a946b0d7 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1318 microversion: 2.1 time: 1.698702 Oct 12 22:16:42.199367 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1821/4189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:40 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1318 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:42.208431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-29eb7f57-3814-462e-b12e-f0486d9ef5e4 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:42.209067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-29eb7f57-3814-462e-b12e-f0486d9ef5e4 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:42.225970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:42.232749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29eb7f57-3814-462e-b12e-f0486d9ef5e4 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:42.233286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29eb7f57-3814-462e-b12e-f0486d9ef5e4 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:42.234490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29eb7f57-3814-462e-b12e-f0486d9ef5e4 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:42.235265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29eb7f57-3814-462e-b12e-f0486d9ef5e4 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:42.235728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29eb7f57-3814-462e-b12e-f0486d9ef5e4 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:42.236153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29eb7f57-3814-462e-b12e-f0486d9ef5e4 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:42.512640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-53b9e7d2-5a83-4d06-ad7d-1c9c40ac124e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:42.544538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-53b9e7d2-5a83-4d06-ad7d-1c9c40ac124e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:42.546038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-53b9e7d2-5a83-4d06-ad7d-1c9c40ac124e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:42.564852 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-53b9e7d2-5a83-4d06-ad7d-1c9c40ac124e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1870 microversion: 2.42 time: 1.416334 Oct 12 22:16:42.565458 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2369/4190] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:41 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1870 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:42.570355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-6fdd5f85-29d8-4039-a001-d24a129318ca req-9ed43246-cd6a-4939-ae5a-81577cc174bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "tag": "e36d7f37-98a6-4136-be81-33925899d2c1"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:42.615464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6fdd5f85-29d8-4039-a001-d24a129318ca req-9ed43246-cd6a-4939-ae5a-81577cc174bf service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:42.616239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6fdd5f85-29d8-4039-a001-d24a129318ca req-9ed43246-cd6a-4939-ae5a-81577cc174bf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:42.616845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6fdd5f85-29d8-4039-a001-d24a129318ca req-9ed43246-cd6a-4939-ae5a-81577cc174bf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:42.645850 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6fdd5f85-29d8-4039-a001-d24a129318ca req-9ed43246-cd6a-4939-ae5a-81577cc174bf service nova] Creating event network-changed:e36d7f37-98a6-4136-be81-33925899d2c1 for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:16:42.665963 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-6fdd5f85-29d8-4039-a001-d24a129318ca req-9ed43246-cd6a-4939-ae5a-81577cc174bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096951 Oct 12 22:16:42.666611 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2370/4191] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:43.211758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-08452374-d2cd-46c2-bcd9-7cc669a0f990 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:43.212474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-08452374-d2cd-46c2-bcd9-7cc669a0f990 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:43.225023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08452374-d2cd-46c2-bcd9-7cc669a0f990 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:43.225526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08452374-d2cd-46c2-bcd9-7cc669a0f990 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:43.225969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08452374-d2cd-46c2-bcd9-7cc669a0f990 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:43.226676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08452374-d2cd-46c2-bcd9-7cc669a0f990 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:43.227131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08452374-d2cd-46c2-bcd9-7cc669a0f990 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:43.227585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08452374-d2cd-46c2-bcd9-7cc669a0f990 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:43.989028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-29eb7f57-3814-462e-b12e-f0486d9ef5e4 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:44.004321 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-29eb7f57-3814-462e-b12e-f0486d9ef5e4 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1316 microversion: 2.1 time: 1.815092 Oct 12 22:16:44.007383 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1822/4192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:42 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1316 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:44.016118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6e064b5f-60b8-423f-8f3d-a26d81fb7a1e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:44.016733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6e064b5f-60b8-423f-8f3d-a26d81fb7a1e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:44.043074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e064b5f-60b8-423f-8f3d-a26d81fb7a1e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:44.043631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e064b5f-60b8-423f-8f3d-a26d81fb7a1e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:44.044072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e064b5f-60b8-423f-8f3d-a26d81fb7a1e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:44.044793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e064b5f-60b8-423f-8f3d-a26d81fb7a1e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:44.045240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e064b5f-60b8-423f-8f3d-a26d81fb7a1e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:44.056139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e064b5f-60b8-423f-8f3d-a26d81fb7a1e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:44.218067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-08452374-d2cd-46c2-bcd9-7cc669a0f990 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:44.228919 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-08452374-d2cd-46c2-bcd9-7cc669a0f990 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1508 microversion: 2.1 time: 1.022468 Oct 12 22:16:44.234394 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2371/4193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:43 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1508 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:16:44.262502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e18255c7-6999-468b-97c1-ff3a3b6035b1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:44.263624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e18255c7-6999-468b-97c1-ff3a3b6035b1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:44.275971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e18255c7-6999-468b-97c1-ff3a3b6035b1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:44.277230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e18255c7-6999-468b-97c1-ff3a3b6035b1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:44.277873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e18255c7-6999-468b-97c1-ff3a3b6035b1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:44.279075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e18255c7-6999-468b-97c1-ff3a3b6035b1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:44.279803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e18255c7-6999-468b-97c1-ff3a3b6035b1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:44.285425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e18255c7-6999-468b-97c1-ff3a3b6035b1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:44.290305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:44.804148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e18255c7-6999-468b-97c1-ff3a3b6035b1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:44.820223 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e18255c7-6999-468b-97c1-ff3a3b6035b1 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1508 microversion: 2.1 time: 0.563253 Oct 12 22:16:44.835269 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2372/4194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:44 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1508 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:44.835269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3f844fc8-451d-4dba-887a-3584672536ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:44.835269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3f844fc8-451d-4dba-887a-3584672536ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:44.861385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f844fc8-451d-4dba-887a-3584672536ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:44.862102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f844fc8-451d-4dba-887a-3584672536ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:44.863031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f844fc8-451d-4dba-887a-3584672536ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:44.863965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f844fc8-451d-4dba-887a-3584672536ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:44.864777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f844fc8-451d-4dba-887a-3584672536ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:44.865542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f844fc8-451d-4dba-887a-3584672536ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:44.897913 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-3f844fc8-451d-4dba-887a-3584672536ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3f844fc8-451d-4dba-887a-3584672536ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 HTTP/1.1 Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'ed4377e1-7ac3-4b36-ad3d-ac212282c090'} Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:44.899698 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:44.904843 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:16:44.904843 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:44.904843 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:44.904843 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:44.904843 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:44.904843 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:44.904843 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:44.904843 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:44.904843 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:44.904843 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:16:44.904843 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:44.904843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3f844fc8-451d-4dba-887a-3584672536ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:44.904843 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3f844fc8-451d-4dba-887a-3584672536ba tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 404 len: 111 microversion: 2.1 time: 0.078928 Oct 12 22:16:44.904843 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2373/4195] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:16:44 2022] DELETE /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:44.917015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e2b92f5e-f547-44f2-b5ca-f428a2155e8d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:44.919503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e2b92f5e-f547-44f2-b5ca-f428a2155e8d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:44.922418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:44.934901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2b92f5e-f547-44f2-b5ca-f428a2155e8d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:44.942795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2b92f5e-f547-44f2-b5ca-f428a2155e8d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:44.943621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2b92f5e-f547-44f2-b5ca-f428a2155e8d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:44.944618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2b92f5e-f547-44f2-b5ca-f428a2155e8d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:44.945399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2b92f5e-f547-44f2-b5ca-f428a2155e8d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:44.946078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2b92f5e-f547-44f2-b5ca-f428a2155e8d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:44.995792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6e064b5f-60b8-423f-8f3d-a26d81fb7a1e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:45.015011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6e064b5f-60b8-423f-8f3d-a26d81fb7a1e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:45.016671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6e064b5f-60b8-423f-8f3d-a26d81fb7a1e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:45.019794 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6e064b5f-60b8-423f-8f3d-a26d81fb7a1e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1891 microversion: 2.42 time: 1.007413 Oct 12 22:16:45.029381 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1823/4196] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:44 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1891 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:45.039876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-90c9a7ae-f889-4b77-9a33-d44da68ffc96 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:45.040651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-90c9a7ae-f889-4b77-9a33-d44da68ffc96 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: ed4377e1-7ac3-4b36-ad3d-ac212282c090] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:45.062058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90c9a7ae-f889-4b77-9a33-d44da68ffc96 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:45.065113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90c9a7ae-f889-4b77-9a33-d44da68ffc96 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:45.065879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90c9a7ae-f889-4b77-9a33-d44da68ffc96 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:45.066822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90c9a7ae-f889-4b77-9a33-d44da68ffc96 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:45.067976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90c9a7ae-f889-4b77-9a33-d44da68ffc96 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:45.071932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90c9a7ae-f889-4b77-9a33-d44da68ffc96 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:45.119950 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-90c9a7ae-f889-4b77-9a33-d44da68ffc96 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:16:45.127270 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e2b92f5e-f547-44f2-b5ca-f428a2155e8d tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "PUT /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1080 microversion: 2.1 time: 0.224522 Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-90c9a7ae-f889-4b77-9a33-d44da68ffc96 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 HTTP/1.1 Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'ed4377e1-7ac3-4b36-ad3d-ac212282c090'} Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:45.128749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:45.134308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:45.134308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:45.134308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:45.134308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:45.134308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:45.134308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. Oct 12 22:16:45.134308 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:45.134308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-90c9a7ae-f889-4b77-9a33-d44da68ffc96 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance ed4377e1-7ac3-4b36-ad3d-ac212282c090 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:45.134308 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-90c9a7ae-f889-4b77-9a33-d44da68ffc96 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090" status: 404 len: 111 microversion: 2.1 time: 0.100132 Oct 12 22:16:45.135284 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1824/4198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:45 2022] GET /compute/v2.1/servers/ed4377e1-7ac3-4b36-ad3d-ac212282c090 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:45.135501 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2374/4198] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 12 22:16:44 2022] PUT /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1080 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:45.154349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83a78379-6a40-4957-b91f-09ebb5b2d8f2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:45.155701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-759c425a-8300-4f3f-bcaa-abb3ba6b9925 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:45.156444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-83a78379-6a40-4957-b91f-09ebb5b2d8f2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:45.157240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-759c425a-8300-4f3f-bcaa-abb3ba6b9925 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:45.182766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83a78379-6a40-4957-b91f-09ebb5b2d8f2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:45.184695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-759c425a-8300-4f3f-bcaa-abb3ba6b9925 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:45.185411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83a78379-6a40-4957-b91f-09ebb5b2d8f2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:45.186389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-759c425a-8300-4f3f-bcaa-abb3ba6b9925 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:45.186862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83a78379-6a40-4957-b91f-09ebb5b2d8f2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:45.187796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83a78379-6a40-4957-b91f-09ebb5b2d8f2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:45.188418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-759c425a-8300-4f3f-bcaa-abb3ba6b9925 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:45.189306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-759c425a-8300-4f3f-bcaa-abb3ba6b9925 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:45.189952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83a78379-6a40-4957-b91f-09ebb5b2d8f2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:45.190563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83a78379-6a40-4957-b91f-09ebb5b2d8f2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:45.191384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-759c425a-8300-4f3f-bcaa-abb3ba6b9925 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:45.196363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-759c425a-8300-4f3f-bcaa-abb3ba6b9925 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:45.220870 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-83a78379-6a40-4957-b91f-09ebb5b2d8f2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83a78379-6a40-4957-b91f-09ebb5b2d8f2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 HTTP/1.1 Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '73e3560f-1bb0-482f-84cc-fc83097d0327'} Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:45.225217 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:45.232243 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. Oct 12 22:16:45.232243 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:45.232243 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:45.232243 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:45.232243 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:45.232243 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:45.232243 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:45.232243 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:45.232243 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:45.232243 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. Oct 12 22:16:45.232243 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:16:45.232243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83a78379-6a40-4957-b91f-09ebb5b2d8f2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:45.232243 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-83a78379-6a40-4957-b91f-09ebb5b2d8f2 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "DELETE /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 404 len: 111 microversion: 2.1 time: 0.088932 Oct 12 22:16:45.237495 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1825/4199] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:16:45 2022] DELETE /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:45.242836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c509580d-3246-4858-8ef9-f14b68c0cea3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:45.243492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c509580d-3246-4858-8ef9-f14b68c0cea3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:45.258589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c509580d-3246-4858-8ef9-f14b68c0cea3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:45.259102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c509580d-3246-4858-8ef9-f14b68c0cea3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:45.259705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c509580d-3246-4858-8ef9-f14b68c0cea3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:45.260991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c509580d-3246-4858-8ef9-f14b68c0cea3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:45.261537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c509580d-3246-4858-8ef9-f14b68c0cea3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:45.262000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c509580d-3246-4858-8ef9-f14b68c0cea3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:45.330544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:45.497753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-759c425a-8300-4f3f-bcaa-abb3ba6b9925 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:45.508796 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-759c425a-8300-4f3f-bcaa-abb3ba6b9925 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1316 microversion: 2.1 time: 0.370867 Oct 12 22:16:45.524402 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2375/4200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:45 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:45.540826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a04a1d6d-ecc4-4166-82eb-0c223d6befa0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:45.545941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a04a1d6d-ecc4-4166-82eb-0c223d6befa0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] [instance: 73e3560f-1bb0-482f-84cc-fc83097d0327] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:45.556010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a04a1d6d-ecc4-4166-82eb-0c223d6befa0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:45.556821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a04a1d6d-ecc4-4166-82eb-0c223d6befa0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:45.558135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a04a1d6d-ecc4-4166-82eb-0c223d6befa0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:45.559038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a04a1d6d-ecc4-4166-82eb-0c223d6befa0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:45.559849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a04a1d6d-ecc4-4166-82eb-0c223d6befa0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:45.560474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a04a1d6d-ecc4-4166-82eb-0c223d6befa0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:45.584467 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-a04a1d6d-ecc4-4166-82eb-0c223d6befa0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] HTTP exception thrown: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a04a1d6d-ecc4-4166-82eb-0c223d6befa0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Request method failure captured: Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 HTTP/1.1 Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzt6Kx_zWnrlKmamJpb4X6quvNgM6VWzLEgvNcxAUQgRPuopheLjTl5-GxsVLNAWQHWwAkcsmv92BgZBIxqsD3tXIQeSqOkklBBmeEIVV2tz9D-VxH1mTjKbiV5sLPMivNK-6jhjBXYfG6bwJZqMN0HjV_zn2FKod0XDsAkrRZgmErk Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b898b5d0208478e996b7fee2060ed64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b898b5d0208478e996b7fee2060ed64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 4b898b5d0208478e996b7fee2060ed64 Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-DeleteServersTestJSON-540076773 Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 11096cece79f4b8fad4b92270f51b299 Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-DeleteServersTestJSON-540076773-project Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '73e3560f-1bb0-482f-84cc-fc83097d0327'} Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:45.589730 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:45.594477 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:45.594477 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:45.594477 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:45.594477 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:45.594477 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:45.594477 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. Oct 12 22:16:45.594477 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:45.596579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a04a1d6d-ecc4-4166-82eb-0c223d6befa0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] Returning 404 to user: Instance 73e3560f-1bb0-482f-84cc-fc83097d0327 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:45.597667 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a04a1d6d-ecc4-4166-82eb-0c223d6befa0 tempest-DeleteServersTestJSON-540076773 tempest-DeleteServersTestJSON-540076773-project] 10.222.0.16 "GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327" status: 404 len: 111 microversion: 2.1 time: 0.071976 Oct 12 22:16:45.602563 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2376/4201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:45 2022] GET /compute/v2.1/servers/73e3560f-1bb0-482f-84cc-fc83097d0327 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:45.718872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-424bac16-6bb5-4785-a998-eb05ce6f2581 req-580717c4-ec5e-4b62-90dc-32c7b3559168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "tag": "784c9be8-8f1d-4448-96ec-73464800451b"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:45.746212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-424bac16-6bb5-4785-a998-eb05ce6f2581 req-580717c4-ec5e-4b62-90dc-32c7b3559168 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:45.748266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-424bac16-6bb5-4785-a998-eb05ce6f2581 req-580717c4-ec5e-4b62-90dc-32c7b3559168 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:45.748724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-424bac16-6bb5-4785-a998-eb05ce6f2581 req-580717c4-ec5e-4b62-90dc-32c7b3559168 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:45.779340 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-424bac16-6bb5-4785-a998-eb05ce6f2581 req-580717c4-ec5e-4b62-90dc-32c7b3559168 service nova] Creating event network-changed:784c9be8-8f1d-4448-96ec-73464800451b for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:16:45.792750 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-424bac16-6bb5-4785-a998-eb05ce6f2581 req-580717c4-ec5e-4b62-90dc-32c7b3559168 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085278 Oct 12 22:16:45.793939 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2377/4202] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:45.794085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c509580d-3246-4858-8ef9-f14b68c0cea3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:45.806506 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c509580d-3246-4858-8ef9-f14b68c0cea3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1506 microversion: 2.1 time: 0.563648 Oct 12 22:16:45.818535 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1826/4203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:45 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1506 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:45.836992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-25d14467-3b2d-43f1-ae41-6add09937802 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:45.838004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-25d14467-3b2d-43f1-ae41-6add09937802 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:45.851527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25d14467-3b2d-43f1-ae41-6add09937802 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:45.852439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25d14467-3b2d-43f1-ae41-6add09937802 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:45.856061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25d14467-3b2d-43f1-ae41-6add09937802 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:45.857018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25d14467-3b2d-43f1-ae41-6add09937802 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:45.857661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25d14467-3b2d-43f1-ae41-6add09937802 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:45.858396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25d14467-3b2d-43f1-ae41-6add09937802 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:46.063192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b5d54c0f-107d-4b22-998f-dc6bb73f1ec1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:46.063805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b5d54c0f-107d-4b22-998f-dc6bb73f1ec1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:46.078819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5d54c0f-107d-4b22-998f-dc6bb73f1ec1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:46.079383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5d54c0f-107d-4b22-998f-dc6bb73f1ec1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:46.079845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5d54c0f-107d-4b22-998f-dc6bb73f1ec1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:46.080614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5d54c0f-107d-4b22-998f-dc6bb73f1ec1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:46.081229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5d54c0f-107d-4b22-998f-dc6bb73f1ec1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:46.081528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5d54c0f-107d-4b22-998f-dc6bb73f1ec1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:46.777186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-25d14467-3b2d-43f1-ae41-6add09937802 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:46.797188 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-25d14467-3b2d-43f1-ae41-6add09937802 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1506 microversion: 2.1 time: 0.958727 Oct 12 22:16:46.814570 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2378/4204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:45 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1506 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:46.825631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-35b7aae1-92ff-4e67-b648-7f749b02c5b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:46.826536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-35b7aae1-92ff-4e67-b648-7f749b02c5b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:46.833727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35b7aae1-92ff-4e67-b648-7f749b02c5b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:46.835040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35b7aae1-92ff-4e67-b648-7f749b02c5b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:46.835694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35b7aae1-92ff-4e67-b648-7f749b02c5b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:46.841157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35b7aae1-92ff-4e67-b648-7f749b02c5b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:46.841901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35b7aae1-92ff-4e67-b648-7f749b02c5b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:46.842563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35b7aae1-92ff-4e67-b648-7f749b02c5b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:47.146992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b5d54c0f-107d-4b22-998f-dc6bb73f1ec1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:47.162636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b5d54c0f-107d-4b22-998f-dc6bb73f1ec1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:47.171350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b5d54c0f-107d-4b22-998f-dc6bb73f1ec1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:47.173550 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b5d54c0f-107d-4b22-998f-dc6bb73f1ec1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1891 microversion: 2.42 time: 1.114715 Oct 12 22:16:47.174679 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1827/4205] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:46 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1891 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:16:47.179974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5b4f181c-e564-4f56-a44b-d3237d4a6681 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:47.183740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5b4f181c-e564-4f56-a44b-d3237d4a6681 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:47.190694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b4f181c-e564-4f56-a44b-d3237d4a6681 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:47.192026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b4f181c-e564-4f56-a44b-d3237d4a6681 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:47.192825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b4f181c-e564-4f56-a44b-d3237d4a6681 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:47.194138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b4f181c-e564-4f56-a44b-d3237d4a6681 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:47.194772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b4f181c-e564-4f56-a44b-d3237d4a6681 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:47.195405 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b4f181c-e564-4f56-a44b-d3237d4a6681 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:47.299531 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5b4f181c-e564-4f56-a44b-d3237d4a6681 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "PUT /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1082 microversion: 2.1 time: 0.122653 Oct 12 22:16:47.300568 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1828/4206] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 12 22:16:47 2022] PUT /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1082 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:47.324576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e4b34754-6e1e-4fff-b3b5-8d18f472085f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:47.325491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e4b34754-6e1e-4fff-b3b5-8d18f472085f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:47.338090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4b34754-6e1e-4fff-b3b5-8d18f472085f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:47.339680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4b34754-6e1e-4fff-b3b5-8d18f472085f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:47.340328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4b34754-6e1e-4fff-b3b5-8d18f472085f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:47.342404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4b34754-6e1e-4fff-b3b5-8d18f472085f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:47.343353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4b34754-6e1e-4fff-b3b5-8d18f472085f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:47.344000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4b34754-6e1e-4fff-b3b5-8d18f472085f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:47.367945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-35b7aae1-92ff-4e67-b648-7f749b02c5b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:47.378762 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-35b7aae1-92ff-4e67-b648-7f749b02c5b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1316 microversion: 2.1 time: 0.562896 Oct 12 22:16:47.394384 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2379/4207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:46 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1316 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:47.715437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-684869343", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "180387b5-7c1f-409e-b180-cf02bc17271b"}], "security_groups": [{"name": "tempest-securitygroup--933458971"}], "key_name": "tempest-keypair-134388822", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:47.851984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e4b34754-6e1e-4fff-b3b5-8d18f472085f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:47.862093 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e4b34754-6e1e-4fff-b3b5-8d18f472085f tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1508 microversion: 2.1 time: 0.543142 Oct 12 22:16:47.868345 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1829/4208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:47 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1508 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:16:47.873891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-5963b7f5-abc3-4731-b88c-2e042b0dc7ca req-a3bfeda0-ddd0-4c8a-bb2a-e3335043b738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b226cba4-8ff4-40e3-9a10-a295671b467a", "tag": "071cde5f-05b7-400a-9635-c535a9c7c9ea"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:47.899030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5963b7f5-abc3-4731-b88c-2e042b0dc7ca req-a3bfeda0-ddd0-4c8a-bb2a-e3335043b738 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:47.899533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5963b7f5-abc3-4731-b88c-2e042b0dc7ca req-a3bfeda0-ddd0-4c8a-bb2a-e3335043b738 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:47.899968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5963b7f5-abc3-4731-b88c-2e042b0dc7ca req-a3bfeda0-ddd0-4c8a-bb2a-e3335043b738 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:47.928125 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-5963b7f5-abc3-4731-b88c-2e042b0dc7ca req-a3bfeda0-ddd0-4c8a-bb2a-e3335043b738 service nova] Creating event network-changed:071cde5f-05b7-400a-9635-c535a9c7c9ea for instance b226cba4-8ff4-40e3-9a10-a295671b467a on n-h2-861111-1 Oct 12 22:16:47.934566 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-5963b7f5-abc3-4731-b88c-2e042b0dc7ca req-a3bfeda0-ddd0-4c8a-bb2a-e3335043b738 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064061 Oct 12 22:16:47.935680 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1830/4209] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:47.942103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e9d89e4b-ac8d-4145-b3cf-ef1b303939fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:47.943091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e9d89e4b-ac8d-4145-b3cf-ef1b303939fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:47.950222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9d89e4b-ac8d-4145-b3cf-ef1b303939fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:47.951071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9d89e4b-ac8d-4145-b3cf-ef1b303939fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:47.951945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9d89e4b-ac8d-4145-b3cf-ef1b303939fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:47.953911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9d89e4b-ac8d-4145-b3cf-ef1b303939fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:47.954597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9d89e4b-ac8d-4145-b3cf-ef1b303939fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:47.955267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9d89e4b-ac8d-4145-b3cf-ef1b303939fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:48.257671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e9d89e4b-ac8d-4145-b3cf-ef1b303939fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:48.268583 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e9d89e4b-ac8d-4145-b3cf-ef1b303939fb tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1508 microversion: 2.1 time: 0.331411 Oct 12 22:16:48.269391 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1831/4210] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:47 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1508 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:48.276747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-232a6707-3501-4373-a384-1f38803de822 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:48.277649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-232a6707-3501-4373-a384-1f38803de822 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:48.288693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-232a6707-3501-4373-a384-1f38803de822 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:48.289539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-232a6707-3501-4373-a384-1f38803de822 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:48.290200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-232a6707-3501-4373-a384-1f38803de822 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:48.291456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-232a6707-3501-4373-a384-1f38803de822 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:48.292181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-232a6707-3501-4373-a384-1f38803de822 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:48.292809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-232a6707-3501-4373-a384-1f38803de822 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:48.312860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] validate_networks() for [('180387b5-7c1f-409e-b180-cf02bc17271b', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:16:48.780878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-232a6707-3501-4373-a384-1f38803de822 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:48.800084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-232a6707-3501-4373-a384-1f38803de822 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:48.802237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-232a6707-3501-4373-a384-1f38803de822 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:48.803718 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-232a6707-3501-4373-a384-1f38803de822 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1891 microversion: 2.42 time: 0.533118 Oct 12 22:16:48.820430 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1832/4211] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:48 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1891 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:48.834110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-23952d00-e764-4434-b8c0-2a016fcce6c0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:48.835216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-23952d00-e764-4434-b8c0-2a016fcce6c0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:48.841938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23952d00-e764-4434-b8c0-2a016fcce6c0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:48.842574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23952d00-e764-4434-b8c0-2a016fcce6c0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:48.843366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23952d00-e764-4434-b8c0-2a016fcce6c0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:48.844380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23952d00-e764-4434-b8c0-2a016fcce6c0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:48.844963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23952d00-e764-4434-b8c0-2a016fcce6c0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:48.845505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23952d00-e764-4434-b8c0-2a016fcce6c0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:48.907079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-23952d00-e764-4434-b8c0-2a016fcce6c0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:16:49.079993 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-23952d00-e764-4434-b8c0-2a016fcce6c0 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 204 len: 0 microversion: 2.1 time: 0.255227 Oct 12 22:16:49.081450 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1833/4212] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:16:48 2022] DELETE /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:16:49.090700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6118bb6e-30b3-44c1-b852-eea8303b3d81 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:49.091666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6118bb6e-30b3-44c1-b852-eea8303b3d81 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:49.098523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6118bb6e-30b3-44c1-b852-eea8303b3d81 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:49.099023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6118bb6e-30b3-44c1-b852-eea8303b3d81 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:49.099902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6118bb6e-30b3-44c1-b852-eea8303b3d81 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:49.100678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6118bb6e-30b3-44c1-b852-eea8303b3d81 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:49.101134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6118bb6e-30b3-44c1-b852-eea8303b3d81 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:49.101633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6118bb6e-30b3-44c1-b852-eea8303b3d81 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:49.126758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:49.280835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Getting quotas for project a4fd7e7319ef437cb50910cd8ad84b7a. Resources: dict_keys(['metadata_items']) {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:16:49.289033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Getting quotas for user 89a0d9b605d543b79d1cd9065187ed3d and project a4fd7e7319ef437cb50910cd8ad84b7a. Resources: dict_keys(['metadata_items']) {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:16:49.308156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:16:49.309091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:16:49.313857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6118bb6e-30b3-44c1-b852-eea8303b3d81 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:49.320566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:16:49.321169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:16:49.322214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:16:49.327954 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6118bb6e-30b3-44c1-b852-eea8303b3d81 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1316 microversion: 2.1 time: 0.243857 Oct 12 22:16:49.330111 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1834/4213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:49 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:49.336779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2f3f31d7-43a9-4dd4-89f1-c85eb7d55d62 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:49.337617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f3f31d7-43a9-4dd4-89f1-c85eb7d55d62 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:49.348274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f3f31d7-43a9-4dd4-89f1-c85eb7d55d62 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:49.348853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:49.349180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f3f31d7-43a9-4dd4-89f1-c85eb7d55d62 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:49.349365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:49.350007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f3f31d7-43a9-4dd4-89f1-c85eb7d55d62 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:49.352661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:49.352800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f3f31d7-43a9-4dd4-89f1-c85eb7d55d62 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:49.353392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f3f31d7-43a9-4dd4-89f1-c85eb7d55d62 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:49.353573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:49.354151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f3f31d7-43a9-4dd4-89f1-c85eb7d55d62 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:49.355104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:49.355855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:49.391204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f3f31d7-43a9-4dd4-89f1-c85eb7d55d62 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:16:49.393329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Getting quotas for project a4fd7e7319ef437cb50910cd8ad84b7a. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:16:49.406440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Getting quotas for user 89a0d9b605d543b79d1cd9065187ed3d and project a4fd7e7319ef437cb50910cd8ad84b7a. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:16:49.443131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:16:49.450978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:16:49.457340 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.compute.api [None req-2f3f31d7-43a9-4dd4-89f1-c85eb7d55d62 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Instance is already in deleting state, ignoring this request Oct 12 22:16:49.458356 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2f3f31d7-43a9-4dd4-89f1-c85eb7d55d62 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 204 len: 0 microversion: 2.1 time: 0.126732 Oct 12 22:16:49.460270 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1835/4214] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:16:49 2022] DELETE /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:16:49.470880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-89bf10f3-7ae7-442f-8b58-81c16cd739fd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:49.472030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-89bf10f3-7ae7-442f-8b58-81c16cd739fd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:49.486450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89bf10f3-7ae7-442f-8b58-81c16cd739fd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:49.487416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89bf10f3-7ae7-442f-8b58-81c16cd739fd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:49.488275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89bf10f3-7ae7-442f-8b58-81c16cd739fd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:49.490032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89bf10f3-7ae7-442f-8b58-81c16cd739fd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:49.490847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89bf10f3-7ae7-442f-8b58-81c16cd739fd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:49.492438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89bf10f3-7ae7-442f-8b58-81c16cd739fd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:49.560002 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-03693495-f26d-4df4-962f-e16e3ce73aa5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.865905 Oct 12 22:16:49.561322 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2380/4215] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:16:47 2022] POST /compute/v2.1/servers => generated 408 bytes in 1870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:16:49.577626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bc47e6b3-550e-4576-9933-d9f0e6bfdbc4 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:49.578646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bc47e6b3-550e-4576-9933-d9f0e6bfdbc4 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:49.681480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bc47e6b3-550e-4576-9933-d9f0e6bfdbc4 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:49.689900 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bc47e6b3-550e-4576-9933-d9f0e6bfdbc4 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1276 microversion: 2.1 time: 0.118399 Oct 12 22:16:49.701100 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2381/4216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:49 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:49.834427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6ef5a5d5-7503-498b-9599-c87b5e242a74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:49.835516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6ef5a5d5-7503-498b-9599-c87b5e242a74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:49.859448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ef5a5d5-7503-498b-9599-c87b5e242a74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:49.861567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ef5a5d5-7503-498b-9599-c87b5e242a74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:49.863182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ef5a5d5-7503-498b-9599-c87b5e242a74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:49.864871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ef5a5d5-7503-498b-9599-c87b5e242a74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:49.865542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ef5a5d5-7503-498b-9599-c87b5e242a74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:49.867081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ef5a5d5-7503-498b-9599-c87b5e242a74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:49.909091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-89bf10f3-7ae7-442f-8b58-81c16cd739fd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:49.929946 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-89bf10f3-7ae7-442f-8b58-81c16cd739fd tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1514 microversion: 2.1 time: 0.462855 Oct 12 22:16:49.931009 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1836/4217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:49 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1514 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:50.047198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-da79469a-c721-4a70-a1d1-f689cb0bf29b req-6c3981db-5e7c-4882-9428-a8143785c025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "tag": "f6a6b535-1aed-4471-b5a4-a99246939f71"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:50.096676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-da79469a-c721-4a70-a1d1-f689cb0bf29b req-6c3981db-5e7c-4882-9428-a8143785c025 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:50.097367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-da79469a-c721-4a70-a1d1-f689cb0bf29b req-6c3981db-5e7c-4882-9428-a8143785c025 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:50.099187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-da79469a-c721-4a70-a1d1-f689cb0bf29b req-6c3981db-5e7c-4882-9428-a8143785c025 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:50.133464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6ef5a5d5-7503-498b-9599-c87b5e242a74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:50.147527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6ef5a5d5-7503-498b-9599-c87b5e242a74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:50.149508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6ef5a5d5-7503-498b-9599-c87b5e242a74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:50.152306 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6ef5a5d5-7503-498b-9599-c87b5e242a74 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1891 microversion: 2.42 time: 0.321947 Oct 12 22:16:50.153591 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2382/4218] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:49 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1891 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:50.166936 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-da79469a-c721-4a70-a1d1-f689cb0bf29b req-6c3981db-5e7c-4882-9428-a8143785c025 service nova] Creating event network-changed:f6a6b535-1aed-4471-b5a4-a99246939f71 for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:16:50.186240 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-da79469a-c721-4a70-a1d1-f689cb0bf29b req-6c3981db-5e7c-4882-9428-a8143785c025 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142047 Oct 12 22:16:50.189527 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1837/4219] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:50.357133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b78fa3c-a2f0-4a21-8935-2316c661f753 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:50.357804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8b78fa3c-a2f0-4a21-8935-2316c661f753 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:50.368587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b78fa3c-a2f0-4a21-8935-2316c661f753 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:50.369100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b78fa3c-a2f0-4a21-8935-2316c661f753 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:50.370048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b78fa3c-a2f0-4a21-8935-2316c661f753 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:50.370769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b78fa3c-a2f0-4a21-8935-2316c661f753 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:50.380240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b78fa3c-a2f0-4a21-8935-2316c661f753 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:50.382998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b78fa3c-a2f0-4a21-8935-2316c661f753 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:50.726862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bac52479-6756-4b6c-a3f3-a5b49232f039 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:50.727930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bac52479-6756-4b6c-a3f3-a5b49232f039 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:50.738382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bac52479-6756-4b6c-a3f3-a5b49232f039 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:50.739404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bac52479-6756-4b6c-a3f3-a5b49232f039 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:50.740273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bac52479-6756-4b6c-a3f3-a5b49232f039 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:50.743299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bac52479-6756-4b6c-a3f3-a5b49232f039 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:50.743990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bac52479-6756-4b6c-a3f3-a5b49232f039 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:50.745172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bac52479-6756-4b6c-a3f3-a5b49232f039 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:51.170240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b78fa3c-a2f0-4a21-8935-2316c661f753 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:51.178833 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8b78fa3c-a2f0-4a21-8935-2316c661f753 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1316 microversion: 2.1 time: 0.827518 Oct 12 22:16:51.183067 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2383/4220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:50 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1316 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:51.188146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a01d64bd-31f3-4f0d-b23e-6920dae96e2c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:51.188804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a01d64bd-31f3-4f0d-b23e-6920dae96e2c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:51.207628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a01d64bd-31f3-4f0d-b23e-6920dae96e2c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:51.209112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a01d64bd-31f3-4f0d-b23e-6920dae96e2c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:51.210012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a01d64bd-31f3-4f0d-b23e-6920dae96e2c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:51.211225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a01d64bd-31f3-4f0d-b23e-6920dae96e2c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:51.211913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a01d64bd-31f3-4f0d-b23e-6920dae96e2c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:51.212490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a01d64bd-31f3-4f0d-b23e-6920dae96e2c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:51.238837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bac52479-6756-4b6c-a3f3-a5b49232f039 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:51.250134 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bac52479-6756-4b6c-a3f3-a5b49232f039 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1272 microversion: 2.1 time: 0.532564 Oct 12 22:16:51.251403 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1838/4221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:50 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1272 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:16:51.258330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-52513c68-19c2-43ef-878b-b36b782125a1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:51.259210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-52513c68-19c2-43ef-878b-b36b782125a1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:51.271185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52513c68-19c2-43ef-878b-b36b782125a1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:51.271976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52513c68-19c2-43ef-878b-b36b782125a1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:51.273126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52513c68-19c2-43ef-878b-b36b782125a1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:51.274218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52513c68-19c2-43ef-878b-b36b782125a1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:51.274963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52513c68-19c2-43ef-878b-b36b782125a1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:51.275681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52513c68-19c2-43ef-878b-b36b782125a1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:51.517990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a01d64bd-31f3-4f0d-b23e-6920dae96e2c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:51.530434 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a01d64bd-31f3-4f0d-b23e-6920dae96e2c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1514 microversion: 2.1 time: 0.346008 Oct 12 22:16:51.533679 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2384/4222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:51 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1514 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:52.211542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c8e9c580-821d-4965-bec7-239a6fc950b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:52.212458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c8e9c580-821d-4965-bec7-239a6fc950b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:52.230700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8e9c580-821d-4965-bec7-239a6fc950b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:52.231505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8e9c580-821d-4965-bec7-239a6fc950b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:52.232852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8e9c580-821d-4965-bec7-239a6fc950b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:52.233829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8e9c580-821d-4965-bec7-239a6fc950b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:52.234194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-52513c68-19c2-43ef-878b-b36b782125a1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:52.236115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8e9c580-821d-4965-bec7-239a6fc950b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:52.237493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8e9c580-821d-4965-bec7-239a6fc950b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:52.247117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-52513c68-19c2-43ef-878b-b36b782125a1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:52.248620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-52513c68-19c2-43ef-878b-b36b782125a1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:52.252357 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-52513c68-19c2-43ef-878b-b36b782125a1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.998568 Oct 12 22:16:52.257864 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1839/4223] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:51 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:52.280555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ec77eba3-1cb2-4e64-9dc4-b5ebba400eab tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:52.282388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ec77eba3-1cb2-4e64-9dc4-b5ebba400eab tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:52.296855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec77eba3-1cb2-4e64-9dc4-b5ebba400eab tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:52.297366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec77eba3-1cb2-4e64-9dc4-b5ebba400eab tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:52.298655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec77eba3-1cb2-4e64-9dc4-b5ebba400eab tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:52.299900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec77eba3-1cb2-4e64-9dc4-b5ebba400eab tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:52.300482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec77eba3-1cb2-4e64-9dc4-b5ebba400eab tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:52.300913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec77eba3-1cb2-4e64-9dc4-b5ebba400eab tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:52.514035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c8e9c580-821d-4965-bec7-239a6fc950b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:52.520519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ec77eba3-1cb2-4e64-9dc4-b5ebba400eab tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:52.545456 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c8e9c580-821d-4965-bec7-239a6fc950b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1316 microversion: 2.1 time: 0.341720 Oct 12 22:16:52.548479 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ec77eba3-1cb2-4e64-9dc4-b5ebba400eab tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1334 microversion: 2.1 time: 0.271616 Oct 12 22:16:52.549017 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2385/4224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:52 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:16:52.550039 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1840/4225] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:52 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1334 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:16:52.560187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2f1403da-9104-4434-918b-44d5e5535bdf tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:52.561097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2f1403da-9104-4434-918b-44d5e5535bdf tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:52.570643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f1403da-9104-4434-918b-44d5e5535bdf tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:52.571140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f1403da-9104-4434-918b-44d5e5535bdf tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:52.571796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f1403da-9104-4434-918b-44d5e5535bdf tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:52.572585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f1403da-9104-4434-918b-44d5e5535bdf tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:52.573970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f1403da-9104-4434-918b-44d5e5535bdf tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:52.574600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f1403da-9104-4434-918b-44d5e5535bdf tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:52.849275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2f1403da-9104-4434-918b-44d5e5535bdf tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:52.861739 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2f1403da-9104-4434-918b-44d5e5535bdf tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1514 microversion: 2.1 time: 0.307456 Oct 12 22:16:52.875264 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2386/4226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:52 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1514 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:53.288832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1470baa4-7f72-45bc-a72a-526a4ce2503b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:53.292985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1470baa4-7f72-45bc-a72a-526a4ce2503b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:53.308804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1470baa4-7f72-45bc-a72a-526a4ce2503b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:53.309337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1470baa4-7f72-45bc-a72a-526a4ce2503b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:53.309797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1470baa4-7f72-45bc-a72a-526a4ce2503b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:53.310522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1470baa4-7f72-45bc-a72a-526a4ce2503b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:53.310978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1470baa4-7f72-45bc-a72a-526a4ce2503b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:53.311446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1470baa4-7f72-45bc-a72a-526a4ce2503b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:53.573376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-77f56895-182f-4d6a-99a0-46a68c8cd20a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:53.574673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-77f56895-182f-4d6a-99a0-46a68c8cd20a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:53.584779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77f56895-182f-4d6a-99a0-46a68c8cd20a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:53.585482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77f56895-182f-4d6a-99a0-46a68c8cd20a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:53.586126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77f56895-182f-4d6a-99a0-46a68c8cd20a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:53.587045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77f56895-182f-4d6a-99a0-46a68c8cd20a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:53.587807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77f56895-182f-4d6a-99a0-46a68c8cd20a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:53.589108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-77f56895-182f-4d6a-99a0-46a68c8cd20a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:54.182881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1470baa4-7f72-45bc-a72a-526a4ce2503b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:54.187913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-77f56895-182f-4d6a-99a0-46a68c8cd20a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:54.194133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1470baa4-7f72-45bc-a72a-526a4ce2503b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:54.195537 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-77f56895-182f-4d6a-99a0-46a68c8cd20a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1316 microversion: 2.1 time: 0.627374 Oct 12 22:16:54.196106 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2387/4227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:53 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1316 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:16:54.199921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1470baa4-7f72-45bc-a72a-526a4ce2503b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:54.201845 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1470baa4-7f72-45bc-a72a-526a4ce2503b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.916966 Oct 12 22:16:54.206407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b434dab7-1678-4022-b4f4-2dfe3fe3dcf7 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:54.210096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b434dab7-1678-4022-b4f4-2dfe3fe3dcf7 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:54.219463 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1841/4228] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:53 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:54.220120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b434dab7-1678-4022-b4f4-2dfe3fe3dcf7 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:54.220624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b434dab7-1678-4022-b4f4-2dfe3fe3dcf7 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:54.221064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b434dab7-1678-4022-b4f4-2dfe3fe3dcf7 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:54.221794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b434dab7-1678-4022-b4f4-2dfe3fe3dcf7 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:54.222256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b434dab7-1678-4022-b4f4-2dfe3fe3dcf7 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:54.222665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b434dab7-1678-4022-b4f4-2dfe3fe3dcf7 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:54.227727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-58aaf94f-fe77-4228-afd6-6372fe837d49 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:54.230921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-58aaf94f-fe77-4228-afd6-6372fe837d49 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:54.242764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58aaf94f-fe77-4228-afd6-6372fe837d49 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:54.245830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58aaf94f-fe77-4228-afd6-6372fe837d49 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:54.246451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58aaf94f-fe77-4228-afd6-6372fe837d49 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:54.247351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58aaf94f-fe77-4228-afd6-6372fe837d49 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:54.251908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58aaf94f-fe77-4228-afd6-6372fe837d49 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:54.253296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58aaf94f-fe77-4228-afd6-6372fe837d49 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:54.320676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58aaf94f-fe77-4228-afd6-6372fe837d49 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:54.321319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58aaf94f-fe77-4228-afd6-6372fe837d49 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:54.321734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58aaf94f-fe77-4228-afd6-6372fe837d49 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:54.323398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-58aaf94f-fe77-4228-afd6-6372fe837d49 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lazy-loading 'fault' on Instance uuid 2346df42-7c4c-4187-9ea6-400fa07498dc {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:16:54.358205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b434dab7-1678-4022-b4f4-2dfe3fe3dcf7 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:54.367373 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b434dab7-1678-4022-b4f4-2dfe3fe3dcf7 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1334 microversion: 2.1 time: 0.164513 Oct 12 22:16:54.368717 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2388/4229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:54 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1334 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:54.374343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-e4d7673f-f3c1-4938-a420-2f8bf77f81cd req-f5636141-bd7d-4942-9a18-0e5e85f4df83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2346df42-7c4c-4187-9ea6-400fa07498dc", "name": "network-vif-deleted", "tag": "5523dcec-a392-49fd-a057-74da510575dc"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:54.388107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e4d7673f-f3c1-4938-a420-2f8bf77f81cd req-f5636141-bd7d-4942-9a18-0e5e85f4df83 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:54.389072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e4d7673f-f3c1-4938-a420-2f8bf77f81cd req-f5636141-bd7d-4942-9a18-0e5e85f4df83 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:54.389792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e4d7673f-f3c1-4938-a420-2f8bf77f81cd req-f5636141-bd7d-4942-9a18-0e5e85f4df83 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:54.404464 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-e4d7673f-f3c1-4938-a420-2f8bf77f81cd req-f5636141-bd7d-4942-9a18-0e5e85f4df83 service nova] Creating event network-vif-deleted:5523dcec-a392-49fd-a057-74da510575dc for instance 2346df42-7c4c-4187-9ea6-400fa07498dc on n-h1-861111-1 Oct 12 22:16:54.414128 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-e4d7673f-f3c1-4938-a420-2f8bf77f81cd req-f5636141-bd7d-4942-9a18-0e5e85f4df83 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043791 Oct 12 22:16:54.415385 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2389/4230] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:54.519444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-58aaf94f-fe77-4228-afd6-6372fe837d49 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06066387f835419c914fa6bebf0f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8adffdfcc17442a88c91f6804787279a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:54.530761 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-58aaf94f-fe77-4228-afd6-6372fe837d49 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 200 len: 1308 microversion: 2.1 time: 0.309283 Oct 12 22:16:54.531487 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1842/4231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:54 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 1308 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:54.975038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-31b798b1-5aaa-4422-96df-b9a0fc25ff9a req-38f787b4-d5ae-4458-84ce-77b8e4da8478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b226cba4-8ff4-40e3-9a10-a295671b467a", "name": "network-vif-plugged", "status": "completed", "tag": "071cde5f-05b7-400a-9635-c535a9c7c9ea"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:55.002037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-31b798b1-5aaa-4422-96df-b9a0fc25ff9a req-38f787b4-d5ae-4458-84ce-77b8e4da8478 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:55.008032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-31b798b1-5aaa-4422-96df-b9a0fc25ff9a req-38f787b4-d5ae-4458-84ce-77b8e4da8478 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:55.008688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-31b798b1-5aaa-4422-96df-b9a0fc25ff9a req-38f787b4-d5ae-4458-84ce-77b8e4da8478 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:55.032042 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-31b798b1-5aaa-4422-96df-b9a0fc25ff9a req-38f787b4-d5ae-4458-84ce-77b8e4da8478 service nova] Creating event network-vif-plugged:071cde5f-05b7-400a-9635-c535a9c7c9ea for instance b226cba4-8ff4-40e3-9a10-a295671b467a on n-h2-861111-1 Oct 12 22:16:55.044023 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-31b798b1-5aaa-4422-96df-b9a0fc25ff9a req-38f787b4-d5ae-4458-84ce-77b8e4da8478 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074047 Oct 12 22:16:55.045208 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2390/4232] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:55.229770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bc7a4625-7aa5-45fa-ac85-eee988df9ffa tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:55.231651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bc7a4625-7aa5-45fa-ac85-eee988df9ffa tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:55.234070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f27968c1-15d1-4fac-8511-42824229993b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:55.234782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f27968c1-15d1-4fac-8511-42824229993b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:55.244601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc7a4625-7aa5-45fa-ac85-eee988df9ffa tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:55.245898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc7a4625-7aa5-45fa-ac85-eee988df9ffa tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:55.246598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc7a4625-7aa5-45fa-ac85-eee988df9ffa tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:55.247444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f27968c1-15d1-4fac-8511-42824229993b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:55.247960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f27968c1-15d1-4fac-8511-42824229993b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:55.248385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f27968c1-15d1-4fac-8511-42824229993b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:55.248993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc7a4625-7aa5-45fa-ac85-eee988df9ffa tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:55.249096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f27968c1-15d1-4fac-8511-42824229993b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:55.249543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f27968c1-15d1-4fac-8511-42824229993b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:55.251423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc7a4625-7aa5-45fa-ac85-eee988df9ffa tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:55.252148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc7a4625-7aa5-45fa-ac85-eee988df9ffa tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:55.254455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f27968c1-15d1-4fac-8511-42824229993b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:55.666288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f27968c1-15d1-4fac-8511-42824229993b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:55.687083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f27968c1-15d1-4fac-8511-42824229993b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:55.699274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f27968c1-15d1-4fac-8511-42824229993b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:55.702434 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f27968c1-15d1-4fac-8511-42824229993b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.472854 Oct 12 22:16:55.719273 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2391/4233] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:55 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:16:55.719273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-abbdc95d-1035-4399-b5ae-fbbbc8502713 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:55.719273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-abbdc95d-1035-4399-b5ae-fbbbc8502713 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:55.719273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abbdc95d-1035-4399-b5ae-fbbbc8502713 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:55.719273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abbdc95d-1035-4399-b5ae-fbbbc8502713 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:55.719273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abbdc95d-1035-4399-b5ae-fbbbc8502713 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:55.719273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abbdc95d-1035-4399-b5ae-fbbbc8502713 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:55.719921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abbdc95d-1035-4399-b5ae-fbbbc8502713 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:55.720457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abbdc95d-1035-4399-b5ae-fbbbc8502713 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:55.754923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bc7a4625-7aa5-45fa-ac85-eee988df9ffa tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:55.763999 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bc7a4625-7aa5-45fa-ac85-eee988df9ffa tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1316 microversion: 2.1 time: 0.548136 Oct 12 22:16:55.770770 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1843/4234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:55 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1316 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:55.784974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4423f2b8-e810-4cf4-b456-fbe7e44c3e4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:55.785739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4423f2b8-e810-4cf4-b456-fbe7e44c3e4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:55.801343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4423f2b8-e810-4cf4-b456-fbe7e44c3e4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:55.801847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4423f2b8-e810-4cf4-b456-fbe7e44c3e4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:55.802557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4423f2b8-e810-4cf4-b456-fbe7e44c3e4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:55.803313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4423f2b8-e810-4cf4-b456-fbe7e44c3e4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:55.803773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4423f2b8-e810-4cf4-b456-fbe7e44c3e4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:55.804200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4423f2b8-e810-4cf4-b456-fbe7e44c3e4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:56.222850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-abbdc95d-1035-4399-b5ae-fbbbc8502713 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:56.240863 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-abbdc95d-1035-4399-b5ae-fbbbc8502713 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1401 microversion: 2.1 time: 0.534526 Oct 12 22:16:56.241764 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2392/4235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:55 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1401 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:56.259221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af714017-9705-4957-a5de-1255196ad6f9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:56.260182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-af714017-9705-4957-a5de-1255196ad6f9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 2346df42-7c4c-4187-9ea6-400fa07498dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:56.274332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af714017-9705-4957-a5de-1255196ad6f9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:56.275488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af714017-9705-4957-a5de-1255196ad6f9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:56.276635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af714017-9705-4957-a5de-1255196ad6f9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:56.277538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af714017-9705-4957-a5de-1255196ad6f9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:56.278158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af714017-9705-4957-a5de-1255196ad6f9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:56.278754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af714017-9705-4957-a5de-1255196ad6f9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:56.286618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:56.313913 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-af714017-9705-4957-a5de-1255196ad6f9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] HTTP exception thrown: Instance 2346df42-7c4c-4187-9ea6-400fa07498dc could not be found. Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af714017-9705-4957-a5de-1255196ad6f9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Request method failure captured: Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc HTTP/1.1 Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwkZ6AudS7rJ-2IgmH0RPQpaU8SdPyt_-Rl7OOUsoupD5pDt5JEoT0qPe_xm1SDTc_NwA2iUUGIo_Ou7H-RCYzI_LgmRO8dTgnyo8JlBZYB2exX-e-8fA-c2fM10ncExHrbWPFxYxY6j5remsUiKomu5jW3gBb-fgCv0YHuNX64cMg Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8adffdfcc17442a88c91f6804787279a Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerDiskConfigTestJSON-853620555 Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8adffdfcc17442a88c91f6804787279a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8adffdfcc17442a88c91f6804787279a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8adffdfcc17442a88c91f6804787279a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8adffdfcc17442a88c91f6804787279a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerDiskConfigTestJSON-853620555 Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8adffdfcc17442a88c91f6804787279a Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-853620555 Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerDiskConfigTestJSON-853620555-project Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 06066387f835419c914fa6bebf0f3411 Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerDiskConfigTestJSON-853620555-project Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 2346df42-7c4c-4187-9ea6-400fa07498dc could not be found. Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '2346df42-7c4c-4187-9ea6-400fa07498dc'} Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2346df42-7c4c-4187-9ea6-400fa07498dc could not be found. Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2346df42-7c4c-4187-9ea6-400fa07498dc could not be found. Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:56.316412 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.320431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:56.320431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:56.320431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:56.320431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:56.320431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:56.320431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2346df42-7c4c-4187-9ea6-400fa07498dc could not be found. Oct 12 22:16:56.320431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.320431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af714017-9705-4957-a5de-1255196ad6f9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Returning 404 to user: Instance 2346df42-7c4c-4187-9ea6-400fa07498dc could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:56.320431 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-af714017-9705-4957-a5de-1255196ad6f9 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc" status: 404 len: 111 microversion: 2.1 time: 0.075502 Oct 12 22:16:56.320431 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2393/4236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:56 2022] GET /compute/v2.1/servers/2346df42-7c4c-4187-9ea6-400fa07498dc => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:56.330333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-477da80a-ee10-4c37-924e-fdb60e9cf3f2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:56.330785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-477da80a-ee10-4c37-924e-fdb60e9cf3f2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:56.341901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-477da80a-ee10-4c37-924e-fdb60e9cf3f2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:56.342425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-477da80a-ee10-4c37-924e-fdb60e9cf3f2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:56.342931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-477da80a-ee10-4c37-924e-fdb60e9cf3f2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:56.343795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-477da80a-ee10-4c37-924e-fdb60e9cf3f2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:56.345319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-477da80a-ee10-4c37-924e-fdb60e9cf3f2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:56.346229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-477da80a-ee10-4c37-924e-fdb60e9cf3f2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:56.371514 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-477da80a-ee10-4c37-924e-fdb60e9cf3f2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] HTTP exception thrown: Instance 84e7a353-6197-41c1-a105-6ca3ca06f195 could not be found. Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-477da80a-ee10-4c37-924e-fdb60e9cf3f2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Request method failure captured: Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 HTTP/1.1 Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwkZ6AudS7rJ-2IgmH0RPQpaU8SdPyt_-Rl7OOUsoupD5pDt5JEoT0qPe_xm1SDTc_NwA2iUUGIo_Ou7H-RCYzI_LgmRO8dTgnyo8JlBZYB2exX-e-8fA-c2fM10ncExHrbWPFxYxY6j5remsUiKomu5jW3gBb-fgCv0YHuNX64cMg Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8adffdfcc17442a88c91f6804787279a Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerDiskConfigTestJSON-853620555 Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8adffdfcc17442a88c91f6804787279a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8adffdfcc17442a88c91f6804787279a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8adffdfcc17442a88c91f6804787279a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8adffdfcc17442a88c91f6804787279a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerDiskConfigTestJSON-853620555 Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8adffdfcc17442a88c91f6804787279a Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-853620555 Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerDiskConfigTestJSON-853620555-project Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 06066387f835419c914fa6bebf0f3411 Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerDiskConfigTestJSON-853620555-project Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 84e7a353-6197-41c1-a105-6ca3ca06f195 could not be found. Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '84e7a353-6197-41c1-a105-6ca3ca06f195'} Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e7a353-6197-41c1-a105-6ca3ca06f195 could not be found. Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:56.373578 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:56.376641 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e7a353-6197-41c1-a105-6ca3ca06f195 could not be found. Oct 12 22:16:56.376641 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.376641 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:56.376641 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.376641 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:56.376641 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:56.376641 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:56.376641 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:56.376641 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:56.376641 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e7a353-6197-41c1-a105-6ca3ca06f195 could not be found. Oct 12 22:16:56.376641 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.376641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-477da80a-ee10-4c37-924e-fdb60e9cf3f2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Returning 404 to user: Instance 84e7a353-6197-41c1-a105-6ca3ca06f195 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:56.376641 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-477da80a-ee10-4c37-924e-fdb60e9cf3f2 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "DELETE /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 404 len: 111 microversion: 2.1 time: 0.050231 Oct 12 22:16:56.380023 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2394/4237] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:16:56 2022] DELETE /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:56.387978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b296931c-09e1-4010-908e-60ba6f9721c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:56.388610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b296931c-09e1-4010-908e-60ba6f9721c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: 84e7a353-6197-41c1-a105-6ca3ca06f195] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:56.396709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b296931c-09e1-4010-908e-60ba6f9721c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:56.397659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b296931c-09e1-4010-908e-60ba6f9721c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:56.398110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b296931c-09e1-4010-908e-60ba6f9721c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:56.398991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b296931c-09e1-4010-908e-60ba6f9721c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:56.399590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b296931c-09e1-4010-908e-60ba6f9721c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:56.400490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b296931c-09e1-4010-908e-60ba6f9721c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:56.428082 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-b296931c-09e1-4010-908e-60ba6f9721c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] HTTP exception thrown: Instance 84e7a353-6197-41c1-a105-6ca3ca06f195 could not be found. Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b296931c-09e1-4010-908e-60ba6f9721c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Request method failure captured: Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 HTTP/1.1 Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwkZ6AudS7rJ-2IgmH0RPQpaU8SdPyt_-Rl7OOUsoupD5pDt5JEoT0qPe_xm1SDTc_NwA2iUUGIo_Ou7H-RCYzI_LgmRO8dTgnyo8JlBZYB2exX-e-8fA-c2fM10ncExHrbWPFxYxY6j5remsUiKomu5jW3gBb-fgCv0YHuNX64cMg Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8adffdfcc17442a88c91f6804787279a Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerDiskConfigTestJSON-853620555 Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8adffdfcc17442a88c91f6804787279a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8adffdfcc17442a88c91f6804787279a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8adffdfcc17442a88c91f6804787279a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8adffdfcc17442a88c91f6804787279a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerDiskConfigTestJSON-853620555 Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8adffdfcc17442a88c91f6804787279a Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-853620555 Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerDiskConfigTestJSON-853620555-project Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 06066387f835419c914fa6bebf0f3411 Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerDiskConfigTestJSON-853620555-project Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 84e7a353-6197-41c1-a105-6ca3ca06f195 could not be found. Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '84e7a353-6197-41c1-a105-6ca3ca06f195'} Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e7a353-6197-41c1-a105-6ca3ca06f195 could not be found. Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e7a353-6197-41c1-a105-6ca3ca06f195 could not be found. Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:56.430219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.433337 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:56.433337 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:56.433337 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:56.433337 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:56.433337 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:56.433337 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e7a353-6197-41c1-a105-6ca3ca06f195 could not be found. Oct 12 22:16:56.433337 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.433337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b296931c-09e1-4010-908e-60ba6f9721c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Returning 404 to user: Instance 84e7a353-6197-41c1-a105-6ca3ca06f195 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:56.433719 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b296931c-09e1-4010-908e-60ba6f9721c3 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195" status: 404 len: 111 microversion: 2.1 time: 0.052476 Oct 12 22:16:56.438159 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2395/4238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:56 2022] GET /compute/v2.1/servers/84e7a353-6197-41c1-a105-6ca3ca06f195 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:56.447271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe0fc7c3-3d6f-4937-905c-09ee50d57e4c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:56.448028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fe0fc7c3-3d6f-4937-905c-09ee50d57e4c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:56.454834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe0fc7c3-3d6f-4937-905c-09ee50d57e4c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:56.455666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe0fc7c3-3d6f-4937-905c-09ee50d57e4c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:56.456115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe0fc7c3-3d6f-4937-905c-09ee50d57e4c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:56.456836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe0fc7c3-3d6f-4937-905c-09ee50d57e4c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:56.457308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe0fc7c3-3d6f-4937-905c-09ee50d57e4c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:56.457840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe0fc7c3-3d6f-4937-905c-09ee50d57e4c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:56.482813 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-fe0fc7c3-3d6f-4937-905c-09ee50d57e4c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] HTTP exception thrown: Instance bd5691e2-2981-42cf-ae67-ba70d4131f23 could not be found. Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe0fc7c3-3d6f-4937-905c-09ee50d57e4c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Request method failure captured: Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 HTTP/1.1 Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwkZ6AudS7rJ-2IgmH0RPQpaU8SdPyt_-Rl7OOUsoupD5pDt5JEoT0qPe_xm1SDTc_NwA2iUUGIo_Ou7H-RCYzI_LgmRO8dTgnyo8JlBZYB2exX-e-8fA-c2fM10ncExHrbWPFxYxY6j5remsUiKomu5jW3gBb-fgCv0YHuNX64cMg Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8adffdfcc17442a88c91f6804787279a Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerDiskConfigTestJSON-853620555 Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8adffdfcc17442a88c91f6804787279a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8adffdfcc17442a88c91f6804787279a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8adffdfcc17442a88c91f6804787279a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8adffdfcc17442a88c91f6804787279a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerDiskConfigTestJSON-853620555 Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8adffdfcc17442a88c91f6804787279a Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-853620555 Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerDiskConfigTestJSON-853620555-project Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 06066387f835419c914fa6bebf0f3411 Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerDiskConfigTestJSON-853620555-project Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance bd5691e2-2981-42cf-ae67-ba70d4131f23 could not be found. Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'bd5691e2-2981-42cf-ae67-ba70d4131f23'} Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5691e2-2981-42cf-ae67-ba70d4131f23 could not be found. Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:56.485221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:56.488138 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5691e2-2981-42cf-ae67-ba70d4131f23 could not be found. Oct 12 22:16:56.488138 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.488138 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:56.488138 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.488138 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:56.488138 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:56.488138 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:56.488138 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:56.488138 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:56.488138 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5691e2-2981-42cf-ae67-ba70d4131f23 could not be found. Oct 12 22:16:56.488138 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.488138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe0fc7c3-3d6f-4937-905c-09ee50d57e4c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Returning 404 to user: Instance bd5691e2-2981-42cf-ae67-ba70d4131f23 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:56.488138 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fe0fc7c3-3d6f-4937-905c-09ee50d57e4c tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 404 len: 111 microversion: 2.1 time: 0.043351 Oct 12 22:16:56.488138 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2396/4239] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:16:56 2022] DELETE /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:56.497083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6e6fe7ab-6a53-4554-9bd7-148266f37b99 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:56.497712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6e6fe7ab-6a53-4554-9bd7-148266f37b99 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] [instance: bd5691e2-2981-42cf-ae67-ba70d4131f23] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:56.507078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e6fe7ab-6a53-4554-9bd7-148266f37b99 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:56.507699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e6fe7ab-6a53-4554-9bd7-148266f37b99 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:56.508404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e6fe7ab-6a53-4554-9bd7-148266f37b99 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:56.509347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e6fe7ab-6a53-4554-9bd7-148266f37b99 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:56.509827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e6fe7ab-6a53-4554-9bd7-148266f37b99 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:56.510967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e6fe7ab-6a53-4554-9bd7-148266f37b99 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:56.534212 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-6e6fe7ab-6a53-4554-9bd7-148266f37b99 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] HTTP exception thrown: Instance bd5691e2-2981-42cf-ae67-ba70d4131f23 could not be found. Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6e6fe7ab-6a53-4554-9bd7-148266f37b99 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Request method failure captured: Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 HTTP/1.1 Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzwkZ6AudS7rJ-2IgmH0RPQpaU8SdPyt_-Rl7OOUsoupD5pDt5JEoT0qPe_xm1SDTc_NwA2iUUGIo_Ou7H-RCYzI_LgmRO8dTgnyo8JlBZYB2exX-e-8fA-c2fM10ncExHrbWPFxYxY6j5remsUiKomu5jW3gBb-fgCv0YHuNX64cMg Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8adffdfcc17442a88c91f6804787279a Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerDiskConfigTestJSON-853620555 Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8adffdfcc17442a88c91f6804787279a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8adffdfcc17442a88c91f6804787279a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8adffdfcc17442a88c91f6804787279a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8adffdfcc17442a88c91f6804787279a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerDiskConfigTestJSON-853620555 Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8adffdfcc17442a88c91f6804787279a Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-853620555 Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerDiskConfigTestJSON-853620555-project Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 06066387f835419c914fa6bebf0f3411 Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerDiskConfigTestJSON-853620555-project Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance bd5691e2-2981-42cf-ae67-ba70d4131f23 could not be found. Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'bd5691e2-2981-42cf-ae67-ba70d4131f23'} Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5691e2-2981-42cf-ae67-ba70d4131f23 could not be found. Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5691e2-2981-42cf-ae67-ba70d4131f23 could not be found. Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:16:56.536035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.538984 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:16:56.538984 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:16:56.538984 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:16:56.538984 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:16:56.538984 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:16:56.538984 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5691e2-2981-42cf-ae67-ba70d4131f23 could not be found. Oct 12 22:16:56.538984 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:16:56.538984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6e6fe7ab-6a53-4554-9bd7-148266f37b99 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] Returning 404 to user: Instance bd5691e2-2981-42cf-ae67-ba70d4131f23 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:16:56.538984 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6e6fe7ab-6a53-4554-9bd7-148266f37b99 tempest-ServerDiskConfigTestJSON-853620555 tempest-ServerDiskConfigTestJSON-853620555-project] 10.222.0.16 "GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23" status: 404 len: 111 microversion: 2.1 time: 0.044616 Oct 12 22:16:56.543585 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2397/4240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:56 2022] GET /compute/v2.1/servers/bd5691e2-2981-42cf-ae67-ba70d4131f23 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:16:56.607882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-fb3d8f9f-a140-49fc-b3e2-a72346d7d15a req-d2e0e68d-b858-44d8-8a13-b8ff54f5b4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "tag": "0fdc0365-5474-47b8-9674-e807e2942529"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:56.626745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fb3d8f9f-a140-49fc-b3e2-a72346d7d15a req-d2e0e68d-b858-44d8-8a13-b8ff54f5b4e7 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:56.629241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fb3d8f9f-a140-49fc-b3e2-a72346d7d15a req-d2e0e68d-b858-44d8-8a13-b8ff54f5b4e7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:56.629921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-fb3d8f9f-a140-49fc-b3e2-a72346d7d15a req-d2e0e68d-b858-44d8-8a13-b8ff54f5b4e7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:56.662574 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-fb3d8f9f-a140-49fc-b3e2-a72346d7d15a req-d2e0e68d-b858-44d8-8a13-b8ff54f5b4e7 service nova] Creating event network-changed:0fdc0365-5474-47b8-9674-e807e2942529 for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:16:56.672304 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-fb3d8f9f-a140-49fc-b3e2-a72346d7d15a req-d2e0e68d-b858-44d8-8a13-b8ff54f5b4e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072740 Oct 12 22:16:56.673676 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2398/4241] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:56.749381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4423f2b8-e810-4cf4-b456-fbe7e44c3e4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:56.759547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dba585fb-cd5f-44cd-9d90-34239d79b7fd tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:56.761867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dba585fb-cd5f-44cd-9d90-34239d79b7fd tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:56.762287 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4423f2b8-e810-4cf4-b456-fbe7e44c3e4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.987487 Oct 12 22:16:56.763378 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1844/4242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:55 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:56.768970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:56.777408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dba585fb-cd5f-44cd-9d90-34239d79b7fd tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:56.778132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dba585fb-cd5f-44cd-9d90-34239d79b7fd tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:56.778875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dba585fb-cd5f-44cd-9d90-34239d79b7fd tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:56.779868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dba585fb-cd5f-44cd-9d90-34239d79b7fd tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:56.780533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dba585fb-cd5f-44cd-9d90-34239d79b7fd tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:56.781186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dba585fb-cd5f-44cd-9d90-34239d79b7fd tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:56.792968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1eeaa64c-994e-4ff7-b10f-e55fec748037 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:56.793502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1eeaa64c-994e-4ff7-b10f-e55fec748037 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:56.804090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eeaa64c-994e-4ff7-b10f-e55fec748037 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:56.804796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eeaa64c-994e-4ff7-b10f-e55fec748037 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:56.805422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eeaa64c-994e-4ff7-b10f-e55fec748037 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:56.813540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eeaa64c-994e-4ff7-b10f-e55fec748037 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:56.814185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eeaa64c-994e-4ff7-b10f-e55fec748037 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:56.814800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eeaa64c-994e-4ff7-b10f-e55fec748037 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:57.627895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1eeaa64c-994e-4ff7-b10f-e55fec748037 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:57.651997 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1eeaa64c-994e-4ff7-b10f-e55fec748037 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1316 microversion: 2.1 time: 0.859659 Oct 12 22:16:57.652986 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1845/4243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:56 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1316 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:57.661126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1b07718c-f777-4754-843c-533d242e94df tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:57.665424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1b07718c-f777-4754-843c-533d242e94df tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:57.676589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b07718c-f777-4754-843c-533d242e94df tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:57.677010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b07718c-f777-4754-843c-533d242e94df tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:57.677583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b07718c-f777-4754-843c-533d242e94df tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:57.678516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b07718c-f777-4754-843c-533d242e94df tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:57.678979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b07718c-f777-4754-843c-533d242e94df tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:57.680386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b07718c-f777-4754-843c-533d242e94df tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:57.737142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dba585fb-cd5f-44cd-9d90-34239d79b7fd tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:57.752635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dba585fb-cd5f-44cd-9d90-34239d79b7fd tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:57.754313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dba585fb-cd5f-44cd-9d90-34239d79b7fd tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:57.757259 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dba585fb-cd5f-44cd-9d90-34239d79b7fd tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 1.025569 Oct 12 22:16:57.758763 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2399/4244] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:56 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:57.779803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7c7667be-d727-49c2-93ce-57c8c5616744 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:57.784364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7c7667be-d727-49c2-93ce-57c8c5616744 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:57.801003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c7667be-d727-49c2-93ce-57c8c5616744 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:57.801507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c7667be-d727-49c2-93ce-57c8c5616744 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:57.804627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c7667be-d727-49c2-93ce-57c8c5616744 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:57.805352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c7667be-d727-49c2-93ce-57c8c5616744 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:57.805820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c7667be-d727-49c2-93ce-57c8c5616744 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:57.806260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c7667be-d727-49c2-93ce-57c8c5616744 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:58.269189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7c7667be-d727-49c2-93ce-57c8c5616744 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:58.279952 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7c7667be-d727-49c2-93ce-57c8c5616744 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1401 microversion: 2.1 time: 0.519512 Oct 12 22:16:58.283637 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2400/4245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:57 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1401 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:58.287781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1b07718c-f777-4754-843c-533d242e94df tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:58.302716 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1b07718c-f777-4754-843c-533d242e94df tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.647331 Oct 12 22:16:58.303933 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1846/4246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:57 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:58.327066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-91e259ff-5f20-472e-b163-f4eb6e3173b7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:58.328383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-91e259ff-5f20-472e-b163-f4eb6e3173b7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:58.335973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91e259ff-5f20-472e-b163-f4eb6e3173b7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:58.336706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91e259ff-5f20-472e-b163-f4eb6e3173b7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:58.337356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91e259ff-5f20-472e-b163-f4eb6e3173b7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:58.338807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91e259ff-5f20-472e-b163-f4eb6e3173b7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:58.339492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91e259ff-5f20-472e-b163-f4eb6e3173b7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:58.340381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91e259ff-5f20-472e-b163-f4eb6e3173b7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:58.571307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-91e259ff-5f20-472e-b163-f4eb6e3173b7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:58.582910 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-91e259ff-5f20-472e-b163-f4eb6e3173b7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.260254 Oct 12 22:16:58.584015 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2401/4247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:58 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:58.608217 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-02cd4ee0-5d54-4266-a27f-5abdd441d46a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:58.609033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-02cd4ee0-5d54-4266-a27f-5abdd441d46a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:58.615666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02cd4ee0-5d54-4266-a27f-5abdd441d46a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:58.616287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02cd4ee0-5d54-4266-a27f-5abdd441d46a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:58.616903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02cd4ee0-5d54-4266-a27f-5abdd441d46a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:58.617598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02cd4ee0-5d54-4266-a27f-5abdd441d46a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:58.618037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02cd4ee0-5d54-4266-a27f-5abdd441d46a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:58.620160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02cd4ee0-5d54-4266-a27f-5abdd441d46a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:58.675021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dcdc29c8-2d6f-4144-a454-7b7171f3b465 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:58.675972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dcdc29c8-2d6f-4144-a454-7b7171f3b465 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:58.684119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcdc29c8-2d6f-4144-a454-7b7171f3b465 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:58.684119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcdc29c8-2d6f-4144-a454-7b7171f3b465 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:58.684403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcdc29c8-2d6f-4144-a454-7b7171f3b465 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:58.685284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcdc29c8-2d6f-4144-a454-7b7171f3b465 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:58.685744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcdc29c8-2d6f-4144-a454-7b7171f3b465 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:58.686189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcdc29c8-2d6f-4144-a454-7b7171f3b465 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:59.014227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dcdc29c8-2d6f-4144-a454-7b7171f3b465 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:59.047804 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dcdc29c8-2d6f-4144-a454-7b7171f3b465 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1504 microversion: 2.1 time: 0.376475 Oct 12 22:16:59.064966 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2402/4248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:58 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1504 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:59.079520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d3e74f6d-45e0-431f-aae4-4220f40bd8d1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:59.080165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d3e74f6d-45e0-431f-aae4-4220f40bd8d1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:59.098560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e74f6d-45e0-431f-aae4-4220f40bd8d1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:59.105049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e74f6d-45e0-431f-aae4-4220f40bd8d1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:59.105519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e74f6d-45e0-431f-aae4-4220f40bd8d1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:59.106422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e74f6d-45e0-431f-aae4-4220f40bd8d1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:59.107048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e74f6d-45e0-431f-aae4-4220f40bd8d1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:59.107555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e74f6d-45e0-431f-aae4-4220f40bd8d1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:59.123428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-02cd4ee0-5d54-4266-a27f-5abdd441d46a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:59.163927 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-02cd4ee0-5d54-4266-a27f-5abdd441d46a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.559916 Oct 12 22:16:59.168176 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1847/4249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:58 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:16:59.175320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-f3ab2296-fde1-429a-aab4-de63c1eb0d84 req-ab8c810b-012d-4d2d-8fac-ad278f8306d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "tag": "410e58b4-a020-44fa-a570-283cadbd980e"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:16:59.226121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f3ab2296-fde1-429a-aab4-de63c1eb0d84 req-ab8c810b-012d-4d2d-8fac-ad278f8306d8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:59.226874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f3ab2296-fde1-429a-aab4-de63c1eb0d84 req-ab8c810b-012d-4d2d-8fac-ad278f8306d8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:59.227394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f3ab2296-fde1-429a-aab4-de63c1eb0d84 req-ab8c810b-012d-4d2d-8fac-ad278f8306d8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:59.270375 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-f3ab2296-fde1-429a-aab4-de63c1eb0d84 req-ab8c810b-012d-4d2d-8fac-ad278f8306d8 service nova] Creating event network-changed:410e58b4-a020-44fa-a570-283cadbd980e for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:16:59.282673 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-f3ab2296-fde1-429a-aab4-de63c1eb0d84 req-ab8c810b-012d-4d2d-8fac-ad278f8306d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112130 Oct 12 22:16:59.297633 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1848/4250] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:59.315346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b60cbf4b-86b6-4928-a4c1-aa2db354336c tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:59.315882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b60cbf4b-86b6-4928-a4c1-aa2db354336c tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:59.345651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b60cbf4b-86b6-4928-a4c1-aa2db354336c tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:59.346209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b60cbf4b-86b6-4928-a4c1-aa2db354336c tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:59.346666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b60cbf4b-86b6-4928-a4c1-aa2db354336c tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:59.348983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b60cbf4b-86b6-4928-a4c1-aa2db354336c tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:59.350647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b60cbf4b-86b6-4928-a4c1-aa2db354336c tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:59.351850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b60cbf4b-86b6-4928-a4c1-aa2db354336c tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:59.377333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:59.405617 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b60cbf4b-86b6-4928-a4c1-aa2db354336c tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a/ips" status: 200 len: 108 microversion: 2.1 time: 0.106455 Oct 12 22:16:59.414901 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1849/4251] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 22:16:59 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a/ips => generated 108 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:59.421648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-30663921-1f58-4503-9a08-63ea9cfdd70e tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:59.422829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-30663921-1f58-4503-9a08-63ea9cfdd70e tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:59.435104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30663921-1f58-4503-9a08-63ea9cfdd70e tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:59.436294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30663921-1f58-4503-9a08-63ea9cfdd70e tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:59.437043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30663921-1f58-4503-9a08-63ea9cfdd70e tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:59.437958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30663921-1f58-4503-9a08-63ea9cfdd70e tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:59.438690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30663921-1f58-4503-9a08-63ea9cfdd70e tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:59.439923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30663921-1f58-4503-9a08-63ea9cfdd70e tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:59.686717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=22 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:16:59.836744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d3e74f6d-45e0-431f-aae4-4220f40bd8d1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:59.851711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d3e74f6d-45e0-431f-aae4-4220f40bd8d1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:59.853616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d3e74f6d-45e0-431f-aae4-4220f40bd8d1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:16:59.855338 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d3e74f6d-45e0-431f-aae4-4220f40bd8d1 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.789238 Oct 12 22:16:59.877269 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2403/4252] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:16:59 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:16:59.888599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-10f2dd26-dbb3-460f-a1fa-638d8f67ea39 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:16:59.889569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-10f2dd26-dbb3-460f-a1fa-638d8f67ea39 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:16:59.914841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10f2dd26-dbb3-460f-a1fa-638d8f67ea39 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:59.915711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10f2dd26-dbb3-460f-a1fa-638d8f67ea39 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:59.916500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10f2dd26-dbb3-460f-a1fa-638d8f67ea39 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:59.918106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10f2dd26-dbb3-460f-a1fa-638d8f67ea39 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:16:59.919105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10f2dd26-dbb3-460f-a1fa-638d8f67ea39 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:16:59.919777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10f2dd26-dbb3-460f-a1fa-638d8f67ea39 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:16:59.954569 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-10f2dd26-dbb3-460f-a1fa-638d8f67ea39 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a/ips" status: 200 len: 108 microversion: 2.1 time: 0.075684 Oct 12 22:16:59.956088 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2404/4253] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 22:16:59 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a/ips => generated 108 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:16:59.965750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1936788472", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "68fd94b2-ed36-4c67-ae5b-2f754d0450a2"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:00.044738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] validate_networks() for [('68fd94b2-ed36-4c67-ae5b-2f754d0450a2', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:17:00.307635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-30663921-1f58-4503-9a08-63ea9cfdd70e tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:00.315796 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-30663921-1f58-4503-9a08-63ea9cfdd70e tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1401 microversion: 2.1 time: 0.899185 Oct 12 22:17:00.331693 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1850/4254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:16:59 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1401 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:00.337638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9f829909-2602-41f4-9051-623796c76147 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:00.338164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9f829909-2602-41f4-9051-623796c76147 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:00.350833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f829909-2602-41f4-9051-623796c76147 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:00.351641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f829909-2602-41f4-9051-623796c76147 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:00.354509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f829909-2602-41f4-9051-623796c76147 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:00.355476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f829909-2602-41f4-9051-623796c76147 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:00.357598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f829909-2602-41f4-9051-623796c76147 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:00.358190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f829909-2602-41f4-9051-623796c76147 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:00.383230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:00.387914 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9f829909-2602-41f4-9051-623796c76147 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a/ips/tempest-ServerAddressesTestJSON-264045566-network" status: 200 len: 93 microversion: 2.1 time: 0.054865 Oct 12 22:17:00.393259 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1851/4255] 10.222.0.16 () {58 vars in 1398 bytes} [Wed Oct 12 22:17:00 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a/ips/tempest-ServerAddressesTestJSON-264045566-network => generated 93 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:17:00.407474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-506d9c8b-dcdd-400d-acb2-095a18bc65b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:00.407971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-506d9c8b-dcdd-400d-acb2-095a18bc65b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:00.421590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-506d9c8b-dcdd-400d-acb2-095a18bc65b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:00.422082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-506d9c8b-dcdd-400d-acb2-095a18bc65b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:00.422680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-506d9c8b-dcdd-400d-acb2-095a18bc65b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:00.423623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-506d9c8b-dcdd-400d-acb2-095a18bc65b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:00.424246 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-506d9c8b-dcdd-400d-acb2-095a18bc65b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:00.424820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-506d9c8b-dcdd-400d-acb2-095a18bc65b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:00.472214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-506d9c8b-dcdd-400d-acb2-095a18bc65b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:17:00.635744 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-506d9c8b-dcdd-400d-acb2-095a18bc65b5 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 204 len: 0 microversion: 2.1 time: 0.233007 Oct 12 22:17:00.640273 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1852/4256] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:17:00 2022] DELETE /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:17:00.648420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dac78f26-a70d-496a-a375-ac723247d865 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:00.649228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dac78f26-a70d-496a-a375-ac723247d865 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:00.663342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dac78f26-a70d-496a-a375-ac723247d865 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:00.664795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dac78f26-a70d-496a-a375-ac723247d865 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:00.665440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dac78f26-a70d-496a-a375-ac723247d865 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:00.667761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dac78f26-a70d-496a-a375-ac723247d865 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:00.668473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dac78f26-a70d-496a-a375-ac723247d865 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:00.670183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dac78f26-a70d-496a-a375-ac723247d865 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:01.000939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dac78f26-a70d-496a-a375-ac723247d865 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:01.012971 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dac78f26-a70d-496a-a375-ac723247d865 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1510 microversion: 2.1 time: 0.369655 Oct 12 22:17:01.018058 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1853/4257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:00 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:01.022889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fa804b5d-33e7-4f15-a3f0-f6b457033f13 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:01.023512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fa804b5d-33e7-4f15-a3f0-f6b457033f13 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:01.038895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa804b5d-33e7-4f15-a3f0-f6b457033f13 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:01.039413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa804b5d-33e7-4f15-a3f0-f6b457033f13 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:01.056910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa804b5d-33e7-4f15-a3f0-f6b457033f13 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:01.059340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa804b5d-33e7-4f15-a3f0-f6b457033f13 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:01.060057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa804b5d-33e7-4f15-a3f0-f6b457033f13 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:01.061910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa804b5d-33e7-4f15-a3f0-f6b457033f13 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:01.450324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fa804b5d-33e7-4f15-a3f0-f6b457033f13 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:01.470395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fa804b5d-33e7-4f15-a3f0-f6b457033f13 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:01.473095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fa804b5d-33e7-4f15-a3f0-f6b457033f13 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:01.476703 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fa804b5d-33e7-4f15-a3f0-f6b457033f13 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.457587 Oct 12 22:17:01.485106 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1854/4258] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:01 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:01.491386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-513191d2-500c-4259-b911-e090bfeece77 req-17fba2bf-389f-4c4e-9b61-ab4a57325b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a36c67e5-7222-4dc7-a676-7a533420b956", "tag": "bff8a9cc-f808-44cf-8562-6821ab7f4770"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:01.517884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-513191d2-500c-4259-b911-e090bfeece77 req-17fba2bf-389f-4c4e-9b61-ab4a57325b8f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:01.525649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-513191d2-500c-4259-b911-e090bfeece77 req-17fba2bf-389f-4c4e-9b61-ab4a57325b8f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:01.526339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-513191d2-500c-4259-b911-e090bfeece77 req-17fba2bf-389f-4c4e-9b61-ab4a57325b8f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:01.550965 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-513191d2-500c-4259-b911-e090bfeece77 req-17fba2bf-389f-4c4e-9b61-ab4a57325b8f service nova] Creating event network-changed:bff8a9cc-f808-44cf-8562-6821ab7f4770 for instance a36c67e5-7222-4dc7-a676-7a533420b956 on n-h1-861111-1 Oct 12 22:17:01.560799 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-513191d2-500c-4259-b911-e090bfeece77 req-17fba2bf-389f-4c4e-9b61-ab4a57325b8f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073207 Oct 12 22:17:01.563602 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1855/4259] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:17:01.576445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fde734fa-8099-4108-b862-954260b552f1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:01.579634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fde734fa-8099-4108-b862-954260b552f1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:01.595381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fde734fa-8099-4108-b862-954260b552f1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:01.595887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fde734fa-8099-4108-b862-954260b552f1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:01.596325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fde734fa-8099-4108-b862-954260b552f1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:01.597148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fde734fa-8099-4108-b862-954260b552f1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:01.597602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fde734fa-8099-4108-b862-954260b552f1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:01.598029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fde734fa-8099-4108-b862-954260b552f1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:01.928648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:17:01.929070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:17:01.929514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:17:01.930112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:17:01.931186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:17:01.955624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:01.956251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:01.956695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:01.957420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:01.958027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:01.958601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:02.001320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Getting quotas for project 319a8f107945457a8a8f8e9690a697e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:17:02.008336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fde734fa-8099-4108-b862-954260b552f1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:02.017558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Getting quotas for user b29c500796d54d6188ff65056340d35f and project 319a8f107945457a8a8f8e9690a697e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:17:02.022294 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fde734fa-8099-4108-b862-954260b552f1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1401 microversion: 2.1 time: 0.457145 Oct 12 22:17:02.023269 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1856/4260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:01 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1401 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:02.037836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-56676faa-661b-47d7-b69e-d2a01e187fe6 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:02.038511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-56676faa-661b-47d7-b69e-d2a01e187fe6 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:02.044105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:17:02.046446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:17:02.054853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56676faa-661b-47d7-b69e-d2a01e187fe6 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:02.054853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56676faa-661b-47d7-b69e-d2a01e187fe6 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:02.054853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56676faa-661b-47d7-b69e-d2a01e187fe6 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:02.054853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56676faa-661b-47d7-b69e-d2a01e187fe6 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:02.055227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56676faa-661b-47d7-b69e-d2a01e187fe6 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:02.055557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56676faa-661b-47d7-b69e-d2a01e187fe6 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:02.161975 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ed767c8a-8871-4a44-af78-600a167cf594 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.204296 Oct 12 22:17:02.167620 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2405/4261] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:16:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:17:02.178653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bd3f10ff-fee3-4d3e-9743-a19caf65e2b2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:02.179313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bd3f10ff-fee3-4d3e-9743-a19caf65e2b2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:02.320435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bd3f10ff-fee3-4d3e-9743-a19caf65e2b2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:02.329387 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bd3f10ff-fee3-4d3e-9743-a19caf65e2b2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1215 microversion: 2.1 time: 0.158925 Oct 12 22:17:02.334545 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2406/4262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:02 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1215 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:02.512988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ad03c436-2b83-4a25-89a0-8095ade1f98c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:02.513860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ad03c436-2b83-4a25-89a0-8095ade1f98c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:02.520310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad03c436-2b83-4a25-89a0-8095ade1f98c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:02.526794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad03c436-2b83-4a25-89a0-8095ade1f98c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:02.527426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad03c436-2b83-4a25-89a0-8095ade1f98c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:02.528332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad03c436-2b83-4a25-89a0-8095ade1f98c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:02.528937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad03c436-2b83-4a25-89a0-8095ade1f98c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:02.529575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad03c436-2b83-4a25-89a0-8095ade1f98c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:02.694751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-56676faa-661b-47d7-b69e-d2a01e187fe6 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:02.712282 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-56676faa-661b-47d7-b69e-d2a01e187fe6 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1510 microversion: 2.1 time: 0.678198 Oct 12 22:17:02.712927 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1857/4263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:02 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1510 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:17:03.061877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5eca1382-c0d1-40f1-8622-60e57abf335d tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:03.064849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5eca1382-c0d1-40f1-8622-60e57abf335d tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:03.087448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5eca1382-c0d1-40f1-8622-60e57abf335d tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:03.090994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5eca1382-c0d1-40f1-8622-60e57abf335d tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:03.091751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5eca1382-c0d1-40f1-8622-60e57abf335d tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:03.092956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5eca1382-c0d1-40f1-8622-60e57abf335d tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:03.094877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5eca1382-c0d1-40f1-8622-60e57abf335d tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:03.096214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5eca1382-c0d1-40f1-8622-60e57abf335d tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:03.128732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ad03c436-2b83-4a25-89a0-8095ade1f98c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:03.147272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ad03c436-2b83-4a25-89a0-8095ade1f98c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:03.154802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ad03c436-2b83-4a25-89a0-8095ade1f98c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:03.158182 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ad03c436-2b83-4a25-89a0-8095ade1f98c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.649234 Oct 12 22:17:03.159074 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2407/4264] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:02 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:17:03.360349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f0c6b13b-9589-4071-b80b-1db88252ccd6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:03.361166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f0c6b13b-9589-4071-b80b-1db88252ccd6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:03.383701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0c6b13b-9589-4071-b80b-1db88252ccd6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:03.387427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0c6b13b-9589-4071-b80b-1db88252ccd6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:03.387920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0c6b13b-9589-4071-b80b-1db88252ccd6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:03.388684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0c6b13b-9589-4071-b80b-1db88252ccd6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:03.390011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0c6b13b-9589-4071-b80b-1db88252ccd6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:03.390125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0c6b13b-9589-4071-b80b-1db88252ccd6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:03.513568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f0c6b13b-9589-4071-b80b-1db88252ccd6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:03.521327 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f0c6b13b-9589-4071-b80b-1db88252ccd6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1267 microversion: 2.1 time: 0.166772 Oct 12 22:17:03.530869 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2408/4265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:03 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:17:03.594001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-1265c5a4-19ed-465b-b269-d3a4eb9f409f req-e38397e3-19c3-44b2-aab2-4d9fa38f642b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "tag": "f460a2f6-34cf-42a8-85f6-522777a2dd9f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:03.616281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1265c5a4-19ed-465b-b269-d3a4eb9f409f req-e38397e3-19c3-44b2-aab2-4d9fa38f642b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:03.616765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1265c5a4-19ed-465b-b269-d3a4eb9f409f req-e38397e3-19c3-44b2-aab2-4d9fa38f642b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:03.617200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1265c5a4-19ed-465b-b269-d3a4eb9f409f req-e38397e3-19c3-44b2-aab2-4d9fa38f642b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:03.634777 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-1265c5a4-19ed-465b-b269-d3a4eb9f409f req-e38397e3-19c3-44b2-aab2-4d9fa38f642b service nova] Creating event network-changed:f460a2f6-34cf-42a8-85f6-522777a2dd9f for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:17:03.646619 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-1265c5a4-19ed-465b-b269-d3a4eb9f409f req-e38397e3-19c3-44b2-aab2-4d9fa38f642b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056181 Oct 12 22:17:03.647232 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2409/4266] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:17:03.739797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-45e46bc5-4201-42a9-95bc-dab418af5bc7 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:03.740581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-45e46bc5-4201-42a9-95bc-dab418af5bc7 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:03.760054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45e46bc5-4201-42a9-95bc-dab418af5bc7 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:03.760539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45e46bc5-4201-42a9-95bc-dab418af5bc7 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:03.760997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45e46bc5-4201-42a9-95bc-dab418af5bc7 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:03.761920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45e46bc5-4201-42a9-95bc-dab418af5bc7 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:03.762381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45e46bc5-4201-42a9-95bc-dab418af5bc7 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:03.762809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45e46bc5-4201-42a9-95bc-dab418af5bc7 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:04.167535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-45e46bc5-4201-42a9-95bc-dab418af5bc7 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:04.191669 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-45e46bc5-4201-42a9-95bc-dab418af5bc7 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1510 microversion: 2.1 time: 0.456096 Oct 12 22:17:04.196385 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2410/4267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:03 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1510 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:04.205815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c4ea746f-08ac-4dbf-851c-7b9e68432a96 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:04.207779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c4ea746f-08ac-4dbf-851c-7b9e68432a96 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:04.216860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4ea746f-08ac-4dbf-851c-7b9e68432a96 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:04.216860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4ea746f-08ac-4dbf-851c-7b9e68432a96 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:04.218155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4ea746f-08ac-4dbf-851c-7b9e68432a96 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:04.218880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4ea746f-08ac-4dbf-851c-7b9e68432a96 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:04.220447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4ea746f-08ac-4dbf-851c-7b9e68432a96 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:04.221100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4ea746f-08ac-4dbf-851c-7b9e68432a96 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:04.277703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5eca1382-c0d1-40f1-8622-60e57abf335d tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:04.288293 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5eca1382-c0d1-40f1-8622-60e57abf335d tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1401 microversion: 2.1 time: 1.240795 Oct 12 22:17:04.289451 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1858/4268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:03 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1401 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:04.550248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-445483d5-ebde-4ec0-a551-1120f20de64e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:04.552959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-445483d5-ebde-4ec0-a551-1120f20de64e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:04.566361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-445483d5-ebde-4ec0-a551-1120f20de64e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:04.568434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-445483d5-ebde-4ec0-a551-1120f20de64e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:04.571707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-445483d5-ebde-4ec0-a551-1120f20de64e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:04.577002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-445483d5-ebde-4ec0-a551-1120f20de64e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:04.577516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-445483d5-ebde-4ec0-a551-1120f20de64e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:04.579594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-445483d5-ebde-4ec0-a551-1120f20de64e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:04.734772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c4ea746f-08ac-4dbf-851c-7b9e68432a96 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:04.746931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c4ea746f-08ac-4dbf-851c-7b9e68432a96 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:04.749813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c4ea746f-08ac-4dbf-851c-7b9e68432a96 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:04.751923 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c4ea746f-08ac-4dbf-851c-7b9e68432a96 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.553582 Oct 12 22:17:04.754053 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2411/4269] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:04 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:04.802122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-445483d5-ebde-4ec0-a551-1120f20de64e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:04.820380 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-445483d5-ebde-4ec0-a551-1120f20de64e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1273 microversion: 2.1 time: 0.275344 Oct 12 22:17:04.823439 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1859/4270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:04 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1273 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:05.226308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4561d4cf-10ee-4627-af5f-c6acb246e73a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:05.228208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4561d4cf-10ee-4627-af5f-c6acb246e73a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:05.260855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4561d4cf-10ee-4627-af5f-c6acb246e73a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:05.261654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4561d4cf-10ee-4627-af5f-c6acb246e73a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:05.262392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4561d4cf-10ee-4627-af5f-c6acb246e73a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:05.264228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4561d4cf-10ee-4627-af5f-c6acb246e73a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:05.267639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4561d4cf-10ee-4627-af5f-c6acb246e73a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:05.269324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4561d4cf-10ee-4627-af5f-c6acb246e73a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:05.312132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-310ad5ed-8585-46d7-bbd3-64fb08608bfe tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:05.313191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-310ad5ed-8585-46d7-bbd3-64fb08608bfe tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:05.326737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-310ad5ed-8585-46d7-bbd3-64fb08608bfe tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:05.328916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-310ad5ed-8585-46d7-bbd3-64fb08608bfe tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:05.333492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-310ad5ed-8585-46d7-bbd3-64fb08608bfe tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:05.349028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-310ad5ed-8585-46d7-bbd3-64fb08608bfe tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:05.349938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-310ad5ed-8585-46d7-bbd3-64fb08608bfe tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:05.350568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-310ad5ed-8585-46d7-bbd3-64fb08608bfe tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:05.370827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4561d4cf-10ee-4627-af5f-c6acb246e73a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:05.371605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4561d4cf-10ee-4627-af5f-c6acb246e73a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:05.372209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4561d4cf-10ee-4627-af5f-c6acb246e73a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:05.372823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-4561d4cf-10ee-4627-af5f-c6acb246e73a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lazy-loading 'fault' on Instance uuid b226cba4-8ff4-40e3-9a10-a295671b467a {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:17:05.571564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4561d4cf-10ee-4627-af5f-c6acb246e73a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536c3ebddaa54c19b13d3602d8bb1efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3174da88ba4d25a458649cdb4e1e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:05.607416 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4561d4cf-10ee-4627-af5f-c6acb246e73a tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 200 len: 1306 microversion: 2.1 time: 0.387271 Oct 12 22:17:05.612856 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2412/4271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:05 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 1306 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:05.748589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-4da09624-47c2-4c43-a9ec-c99f45c02a4b req-fe4d1512-c081-43dc-8fba-d2e6ebadb96f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b226cba4-8ff4-40e3-9a10-a295671b467a", "name": "network-vif-deleted", "tag": "071cde5f-05b7-400a-9635-c535a9c7c9ea"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:05.776526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4da09624-47c2-4c43-a9ec-c99f45c02a4b req-fe4d1512-c081-43dc-8fba-d2e6ebadb96f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:05.777040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4da09624-47c2-4c43-a9ec-c99f45c02a4b req-fe4d1512-c081-43dc-8fba-d2e6ebadb96f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:05.777784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4da09624-47c2-4c43-a9ec-c99f45c02a4b req-fe4d1512-c081-43dc-8fba-d2e6ebadb96f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:05.790652 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-4da09624-47c2-4c43-a9ec-c99f45c02a4b req-fe4d1512-c081-43dc-8fba-d2e6ebadb96f service nova] Creating event network-vif-deleted:071cde5f-05b7-400a-9635-c535a9c7c9ea for instance b226cba4-8ff4-40e3-9a10-a295671b467a on n-h2-861111-1 Oct 12 22:17:05.797536 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-4da09624-47c2-4c43-a9ec-c99f45c02a4b req-fe4d1512-c081-43dc-8fba-d2e6ebadb96f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070231 Oct 12 22:17:05.798448 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2413/4272] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:17:05.805030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ba0dcc9f-bf74-49c1-97ac-67ba43767b0f tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:05.805757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ba0dcc9f-bf74-49c1-97ac-67ba43767b0f tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:05.814010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba0dcc9f-bf74-49c1-97ac-67ba43767b0f tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:05.814985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba0dcc9f-bf74-49c1-97ac-67ba43767b0f tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:05.815505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba0dcc9f-bf74-49c1-97ac-67ba43767b0f tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:05.816237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba0dcc9f-bf74-49c1-97ac-67ba43767b0f tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:05.816705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba0dcc9f-bf74-49c1-97ac-67ba43767b0f tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:05.817142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba0dcc9f-bf74-49c1-97ac-67ba43767b0f tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:06.004581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-310ad5ed-8585-46d7-bbd3-64fb08608bfe tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:06.019639 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-310ad5ed-8585-46d7-bbd3-64fb08608bfe tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1401 microversion: 2.1 time: 0.710906 Oct 12 22:17:06.020598 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1860/4273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:05 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1401 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:06.031379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-020d7903-4883-4c3f-b33e-ebc70db59b42 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:06.040610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-020d7903-4883-4c3f-b33e-ebc70db59b42 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:06.051455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-020d7903-4883-4c3f-b33e-ebc70db59b42 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:06.052717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-020d7903-4883-4c3f-b33e-ebc70db59b42 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:06.053618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-020d7903-4883-4c3f-b33e-ebc70db59b42 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:06.054654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-020d7903-4883-4c3f-b33e-ebc70db59b42 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:06.055385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-020d7903-4883-4c3f-b33e-ebc70db59b42 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:06.056388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-020d7903-4883-4c3f-b33e-ebc70db59b42 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:06.221339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-020d7903-4883-4c3f-b33e-ebc70db59b42 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:06.232780 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-020d7903-4883-4c3f-b33e-ebc70db59b42 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1273 microversion: 2.1 time: 0.210423 Oct 12 22:17:06.233379 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1861/4274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:06 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1273 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:06.248303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-bfaee286-83d1-46d0-81f4-11f49c09aad2 req-418c6685-8b64-4dc2-bddd-9f2393c7988b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36c67e5-7222-4dc7-a676-7a533420b956", "name": "network-vif-plugged", "status": "completed", "tag": "bff8a9cc-f808-44cf-8562-6821ab7f4770"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:06.262557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-bfaee286-83d1-46d0-81f4-11f49c09aad2 req-418c6685-8b64-4dc2-bddd-9f2393c7988b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:06.263057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-bfaee286-83d1-46d0-81f4-11f49c09aad2 req-418c6685-8b64-4dc2-bddd-9f2393c7988b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:06.274637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-bfaee286-83d1-46d0-81f4-11f49c09aad2 req-418c6685-8b64-4dc2-bddd-9f2393c7988b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:06.290836 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-bfaee286-83d1-46d0-81f4-11f49c09aad2 req-418c6685-8b64-4dc2-bddd-9f2393c7988b service nova] Creating event network-vif-plugged:bff8a9cc-f808-44cf-8562-6821ab7f4770 for instance a36c67e5-7222-4dc7-a676-7a533420b956 on n-h1-861111-1 Oct 12 22:17:06.298990 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-bfaee286-83d1-46d0-81f4-11f49c09aad2 req-418c6685-8b64-4dc2-bddd-9f2393c7988b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063124 Oct 12 22:17:06.300349 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1862/4275] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:17:06.301796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ba0dcc9f-bf74-49c1-97ac-67ba43767b0f tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:06.316740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ba0dcc9f-bf74-49c1-97ac-67ba43767b0f tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:06.318762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ba0dcc9f-bf74-49c1-97ac-67ba43767b0f tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:06.320269 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ba0dcc9f-bf74-49c1-97ac-67ba43767b0f tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.520722 Oct 12 22:17:06.345151 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2414/4276] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:05 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:06.638567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-276e257a-aee6-4871-9e8f-01dd26a6d205 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:06.640399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-276e257a-aee6-4871-9e8f-01dd26a6d205 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] [instance: b226cba4-8ff4-40e3-9a10-a295671b467a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:06.664155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-276e257a-aee6-4871-9e8f-01dd26a6d205 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:06.665123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-276e257a-aee6-4871-9e8f-01dd26a6d205 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:06.670049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-276e257a-aee6-4871-9e8f-01dd26a6d205 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:06.672529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-276e257a-aee6-4871-9e8f-01dd26a6d205 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:06.675106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-276e257a-aee6-4871-9e8f-01dd26a6d205 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:06.678482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-276e257a-aee6-4871-9e8f-01dd26a6d205 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:06.723191 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-276e257a-aee6-4871-9e8f-01dd26a6d205 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] HTTP exception thrown: Instance b226cba4-8ff4-40e3-9a10-a295671b467a could not be found. Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-276e257a-aee6-4871-9e8f-01dd26a6d205 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Request method failure captured: Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a HTTP/1.1 Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzy_sZmoKwxacdko-q54JxeEb9tpwS-59zUcwElKKJqJ4lGUDiX9mVA0j6XwpqoH079hQCq4P63gZOn8rgK6DJpCELTSQJuOHsrnFUkJLIZWamWk-F-CINiRPnc_OENjiNz6b3LFUtknoEDBI9ZC8gogDzgRlhmO6sZiTu5QdS9v2Mg Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 9b3174da88ba4d25a458649cdb4e1e77 Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerAddressesTestJSON-593289583 Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3174da88ba4d25a458649cdb4e1e77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3174da88ba4d25a458649cdb4e1e77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b3174da88ba4d25a458649cdb4e1e77", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b3174da88ba4d25a458649cdb4e1e77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerAddressesTestJSON-593289583 Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 9b3174da88ba4d25a458649cdb4e1e77 Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerAddressesTestJSON-593289583 Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerAddressesTestJSON-593289583-project Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 536c3ebddaa54c19b13d3602d8bb1efe Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerAddressesTestJSON-593289583-project Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance b226cba4-8ff4-40e3-9a10-a295671b467a could not be found. Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'b226cba4-8ff4-40e3-9a10-a295671b467a'} Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b226cba4-8ff4-40e3-9a10-a295671b467a could not be found. Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b226cba4-8ff4-40e3-9a10-a295671b467a could not be found. Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:17:06.725874 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:06.729724 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:06.729724 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:17:06.729724 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:17:06.729724 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:17:06.729724 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:17:06.729724 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b226cba4-8ff4-40e3-9a10-a295671b467a could not be found. Oct 12 22:17:06.729724 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:06.730626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-276e257a-aee6-4871-9e8f-01dd26a6d205 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] Returning 404 to user: Instance b226cba4-8ff4-40e3-9a10-a295671b467a could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:17:06.732037 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-276e257a-aee6-4871-9e8f-01dd26a6d205 tempest-ServerAddressesTestJSON-593289583 tempest-ServerAddressesTestJSON-593289583-project] 10.222.0.16 "GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a" status: 404 len: 111 microversion: 2.1 time: 0.100445 Oct 12 22:17:06.732994 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1863/4277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:06 2022] GET /compute/v2.1/servers/b226cba4-8ff4-40e3-9a10-a295671b467a => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:17:07.047725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e49545a0-6dc4-46fb-ab5b-698990054e39 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:07.048396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e49545a0-6dc4-46fb-ab5b-698990054e39 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:07.069392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e49545a0-6dc4-46fb-ab5b-698990054e39 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:07.069828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e49545a0-6dc4-46fb-ab5b-698990054e39 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:07.070272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e49545a0-6dc4-46fb-ab5b-698990054e39 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:07.070988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e49545a0-6dc4-46fb-ab5b-698990054e39 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:07.071665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e49545a0-6dc4-46fb-ab5b-698990054e39 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:07.072795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e49545a0-6dc4-46fb-ab5b-698990054e39 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:07.081742 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a73f45ce-44c7-4830-8ba7-cd9dba0a04aa tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:07.083716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a73f45ce-44c7-4830-8ba7-cd9dba0a04aa tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:07.099853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a73f45ce-44c7-4830-8ba7-cd9dba0a04aa tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:07.103902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a73f45ce-44c7-4830-8ba7-cd9dba0a04aa tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:07.105561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a73f45ce-44c7-4830-8ba7-cd9dba0a04aa tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:07.106830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a73f45ce-44c7-4830-8ba7-cd9dba0a04aa tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:07.108802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a73f45ce-44c7-4830-8ba7-cd9dba0a04aa tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:07.110619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a73f45ce-44c7-4830-8ba7-cd9dba0a04aa tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:07.657619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e49545a0-6dc4-46fb-ab5b-698990054e39 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:07.667728 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e49545a0-6dc4-46fb-ab5b-698990054e39 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1401 microversion: 2.1 time: 0.623882 Oct 12 22:17:07.669208 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2415/4278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:07 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1401 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:07.674471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-15d0b39c-8a97-4bb0-b024-7d6cc455dc07 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:07.675481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-15d0b39c-8a97-4bb0-b024-7d6cc455dc07 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:07.684258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15d0b39c-8a97-4bb0-b024-7d6cc455dc07 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:07.684840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15d0b39c-8a97-4bb0-b024-7d6cc455dc07 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:07.686030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15d0b39c-8a97-4bb0-b024-7d6cc455dc07 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:07.686846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15d0b39c-8a97-4bb0-b024-7d6cc455dc07 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:07.687541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15d0b39c-8a97-4bb0-b024-7d6cc455dc07 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:07.688351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15d0b39c-8a97-4bb0-b024-7d6cc455dc07 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:07.726258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a73f45ce-44c7-4830-8ba7-cd9dba0a04aa tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:07.745898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a73f45ce-44c7-4830-8ba7-cd9dba0a04aa tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:07.766854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a73f45ce-44c7-4830-8ba7-cd9dba0a04aa tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:07.769445 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a73f45ce-44c7-4830-8ba7-cd9dba0a04aa tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 2953 microversion: 2.32 time: 0.702030 Oct 12 22:17:07.771179 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1864/4279] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:07 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 2953 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:07.781435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2423809a-6792-4b23-858d-581899d7cd89 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:07.782329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2423809a-6792-4b23-858d-581899d7cd89 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:07.792122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:07.794612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2423809a-6792-4b23-858d-581899d7cd89 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:07.795303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2423809a-6792-4b23-858d-581899d7cd89 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:07.796050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2423809a-6792-4b23-858d-581899d7cd89 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:07.799940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2423809a-6792-4b23-858d-581899d7cd89 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:07.801382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2423809a-6792-4b23-858d-581899d7cd89 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:07.802844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2423809a-6792-4b23-858d-581899d7cd89 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:08.026704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-15d0b39c-8a97-4bb0-b024-7d6cc455dc07 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:08.029698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:08.047382 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-15d0b39c-8a97-4bb0-b024-7d6cc455dc07 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1315 microversion: 2.1 time: 0.376780 Oct 12 22:17:08.059892 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2416/4280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:07 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:08.076046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2317fcaa-a6f9-4104-9a4a-da48bf55729b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:08.076553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2317fcaa-a6f9-4104-9a4a-da48bf55729b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:08.104396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2317fcaa-a6f9-4104-9a4a-da48bf55729b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:08.104898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2317fcaa-a6f9-4104-9a4a-da48bf55729b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:08.105382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2317fcaa-a6f9-4104-9a4a-da48bf55729b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:08.106408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2317fcaa-a6f9-4104-9a4a-da48bf55729b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:08.107072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2317fcaa-a6f9-4104-9a4a-da48bf55729b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:08.107695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2317fcaa-a6f9-4104-9a4a-da48bf55729b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:08.343097 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2317fcaa-a6f9-4104-9a4a-da48bf55729b tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.280822 Oct 12 22:17:08.343948 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2417/4281] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 12 22:17:08 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0/os-interface => generated 1831 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:08.456186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2423809a-6792-4b23-858d-581899d7cd89 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:08.466962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2423809a-6792-4b23-858d-581899d7cd89 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:08.475442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2423809a-6792-4b23-858d-581899d7cd89 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:08.476794 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2423809a-6792-4b23-858d-581899d7cd89 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.704250 Oct 12 22:17:08.477457 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1865/4282] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:07 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:08.691298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-63d3a012-d195-477c-90b0-2d05d449f0ad tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:08.692553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-63d3a012-d195-477c-90b0-2d05d449f0ad tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:08.700603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63d3a012-d195-477c-90b0-2d05d449f0ad tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:08.703062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63d3a012-d195-477c-90b0-2d05d449f0ad tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:08.706368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63d3a012-d195-477c-90b0-2d05d449f0ad tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:08.710889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63d3a012-d195-477c-90b0-2d05d449f0ad tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:08.711720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63d3a012-d195-477c-90b0-2d05d449f0ad tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:08.712423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63d3a012-d195-477c-90b0-2d05d449f0ad tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:09.074656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d7d427f8-3b99-433d-a6fe-b94d35d4108e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:09.075952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d7d427f8-3b99-433d-a6fe-b94d35d4108e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:09.086472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7d427f8-3b99-433d-a6fe-b94d35d4108e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:09.086975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7d427f8-3b99-433d-a6fe-b94d35d4108e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:09.087456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7d427f8-3b99-433d-a6fe-b94d35d4108e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:09.088690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7d427f8-3b99-433d-a6fe-b94d35d4108e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:09.089138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7d427f8-3b99-433d-a6fe-b94d35d4108e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:09.089581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7d427f8-3b99-433d-a6fe-b94d35d4108e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:09.384307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-63d3a012-d195-477c-90b0-2d05d449f0ad tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:09.402895 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-63d3a012-d195-477c-90b0-2d05d449f0ad tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1588 microversion: 2.1 time: 0.715499 Oct 12 22:17:09.403808 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2418/4283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:08 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1588 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:09.432892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b3d7f9ce-a67a-4690-b4bd-838efd97c562 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:09.433585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b3d7f9ce-a67a-4690-b4bd-838efd97c562 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:09.444289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3d7f9ce-a67a-4690-b4bd-838efd97c562 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:09.445071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3d7f9ce-a67a-4690-b4bd-838efd97c562 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:09.446726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3d7f9ce-a67a-4690-b4bd-838efd97c562 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:09.447698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3d7f9ce-a67a-4690-b4bd-838efd97c562 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:09.452295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3d7f9ce-a67a-4690-b4bd-838efd97c562 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:09.452986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3d7f9ce-a67a-4690-b4bd-838efd97c562 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:09.718727 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b3d7f9ce-a67a-4690-b4bd-838efd97c562 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.291333 Oct 12 22:17:09.719410 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2419/4284] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:17:09 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956/os-interface => generated 284 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:17:09.731373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1712ddfd-c5ab-4171-ba5e-e04bf3707633 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:09.732364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1712ddfd-c5ab-4171-ba5e-e04bf3707633 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:09.750644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1712ddfd-c5ab-4171-ba5e-e04bf3707633 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:09.751521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1712ddfd-c5ab-4171-ba5e-e04bf3707633 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:09.752171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1712ddfd-c5ab-4171-ba5e-e04bf3707633 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:09.753079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1712ddfd-c5ab-4171-ba5e-e04bf3707633 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:09.753719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1712ddfd-c5ab-4171-ba5e-e04bf3707633 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:09.754330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1712ddfd-c5ab-4171-ba5e-e04bf3707633 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:10.049830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d7d427f8-3b99-433d-a6fe-b94d35d4108e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:10.067975 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d7d427f8-3b99-433d-a6fe-b94d35d4108e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1315 microversion: 2.1 time: 0.996925 Oct 12 22:17:10.069451 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1866/4285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:09 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1315 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:17:10.657889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d2340294-56f6-453f-929c-983773a192fa req-51648214-5533-4177-89c5-d0f58ff18a1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1", "tag": "0d84b6a8-d25c-4301-a1f2-c5f7340cc9e7"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:10.687810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d2340294-56f6-453f-929c-983773a192fa req-51648214-5533-4177-89c5-d0f58ff18a1d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:10.688298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d2340294-56f6-453f-929c-983773a192fa req-51648214-5533-4177-89c5-d0f58ff18a1d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:10.688738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d2340294-56f6-453f-929c-983773a192fa req-51648214-5533-4177-89c5-d0f58ff18a1d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:10.711059 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d2340294-56f6-453f-929c-983773a192fa req-51648214-5533-4177-89c5-d0f58ff18a1d service nova] Creating event network-changed:0d84b6a8-d25c-4301-a1f2-c5f7340cc9e7 for instance ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 on n-h1-861111-1 Oct 12 22:17:10.717690 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d2340294-56f6-453f-929c-983773a192fa req-51648214-5533-4177-89c5-d0f58ff18a1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065330 Oct 12 22:17:10.718870 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1867/4286] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:17:10.951117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1712ddfd-c5ab-4171-ba5e-e04bf3707633 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:10.961702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1712ddfd-c5ab-4171-ba5e-e04bf3707633 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:10.970966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1712ddfd-c5ab-4171-ba5e-e04bf3707633 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:10.972699 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1712ddfd-c5ab-4171-ba5e-e04bf3707633 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 1.251999 Oct 12 22:17:10.976418 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2420/4287] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:09 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:11.092690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5526cf2b-e59b-4531-8524-f6501dd00dd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:11.093499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5526cf2b-e59b-4531-8524-f6501dd00dd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:11.105555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5526cf2b-e59b-4531-8524-f6501dd00dd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:11.108736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5526cf2b-e59b-4531-8524-f6501dd00dd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:11.109379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5526cf2b-e59b-4531-8524-f6501dd00dd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:11.113289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5526cf2b-e59b-4531-8524-f6501dd00dd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:11.113965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5526cf2b-e59b-4531-8524-f6501dd00dd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:11.114578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5526cf2b-e59b-4531-8524-f6501dd00dd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:11.932702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5526cf2b-e59b-4531-8524-f6501dd00dd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:11.947175 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5526cf2b-e59b-4531-8524-f6501dd00dd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1315 microversion: 2.1 time: 0.857382 Oct 12 22:17:11.948091 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1868/4288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:11 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1315 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:12.003512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c93443de-d8b6-4c25-ae69-6b72c58c5612 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:12.004136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c93443de-d8b6-4c25-ae69-6b72c58c5612 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:12.012549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:12.026459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93443de-d8b6-4c25-ae69-6b72c58c5612 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:12.027214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93443de-d8b6-4c25-ae69-6b72c58c5612 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:12.027843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93443de-d8b6-4c25-ae69-6b72c58c5612 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:12.028777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93443de-d8b6-4c25-ae69-6b72c58c5612 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:12.030245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93443de-d8b6-4c25-ae69-6b72c58c5612 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:12.031883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93443de-d8b6-4c25-ae69-6b72c58c5612 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:12.328228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=8 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:12.975463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-24abf86f-72bc-4944-abd4-fb044383de46 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:12.976156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-24abf86f-72bc-4944-abd4-fb044383de46 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:12.990178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24abf86f-72bc-4944-abd4-fb044383de46 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:12.990900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24abf86f-72bc-4944-abd4-fb044383de46 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:13.000118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24abf86f-72bc-4944-abd4-fb044383de46 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:13.001170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24abf86f-72bc-4944-abd4-fb044383de46 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:13.007350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24abf86f-72bc-4944-abd4-fb044383de46 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:13.008021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24abf86f-72bc-4944-abd4-fb044383de46 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:13.014461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:13.465136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-24abf86f-72bc-4944-abd4-fb044383de46 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:13.491650 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-24abf86f-72bc-4944-abd4-fb044383de46 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1315 microversion: 2.1 time: 0.523863 Oct 12 22:17:13.492547 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1869/4289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:12 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:17:13.709434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c93443de-d8b6-4c25-ae69-6b72c58c5612 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:13.719780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c93443de-d8b6-4c25-ae69-6b72c58c5612 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:13.726984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c93443de-d8b6-4c25-ae69-6b72c58c5612 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:13.731342 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c93443de-d8b6-4c25-ae69-6b72c58c5612 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 1.731197 Oct 12 22:17:13.734204 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2421/4290] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:11 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:14.537505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6acad76f-4781-495c-9b80-c174da168b27 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:14.544684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6acad76f-4781-495c-9b80-c174da168b27 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:14.567811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6acad76f-4781-495c-9b80-c174da168b27 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:14.575898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6acad76f-4781-495c-9b80-c174da168b27 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:14.578178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6acad76f-4781-495c-9b80-c174da168b27 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:14.580490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6acad76f-4781-495c-9b80-c174da168b27 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:14.581238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6acad76f-4781-495c-9b80-c174da168b27 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:14.583704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6acad76f-4781-495c-9b80-c174da168b27 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:14.760491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c7dd08ac-6e6c-4666-88b9-26e5764662ca tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:14.761695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c7dd08ac-6e6c-4666-88b9-26e5764662ca tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:14.779650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7dd08ac-6e6c-4666-88b9-26e5764662ca tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:14.782048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7dd08ac-6e6c-4666-88b9-26e5764662ca tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:14.782510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7dd08ac-6e6c-4666-88b9-26e5764662ca tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:14.783455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7dd08ac-6e6c-4666-88b9-26e5764662ca tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:14.783922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7dd08ac-6e6c-4666-88b9-26e5764662ca tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:14.784377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7dd08ac-6e6c-4666-88b9-26e5764662ca tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:15.430784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6acad76f-4781-495c-9b80-c174da168b27 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:15.445229 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6acad76f-4781-495c-9b80-c174da168b27 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1315 microversion: 2.1 time: 0.932699 Oct 12 22:17:15.446470 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1870/4291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:14 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1315 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:15.772588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-19e1d038-90a7-4bae-921b-f2a9ee2cc7ce tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:15.774472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-19e1d038-90a7-4bae-921b-f2a9ee2cc7ce tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:15.793036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19e1d038-90a7-4bae-921b-f2a9ee2cc7ce tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:15.794939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19e1d038-90a7-4bae-921b-f2a9ee2cc7ce tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:15.795903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19e1d038-90a7-4bae-921b-f2a9ee2cc7ce tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:15.796685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19e1d038-90a7-4bae-921b-f2a9ee2cc7ce tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:15.797144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19e1d038-90a7-4bae-921b-f2a9ee2cc7ce tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:15.797578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19e1d038-90a7-4bae-921b-f2a9ee2cc7ce tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:15.833278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c7dd08ac-6e6c-4666-88b9-26e5764662ca tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:15.851013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c7dd08ac-6e6c-4666-88b9-26e5764662ca tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:15.861573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c7dd08ac-6e6c-4666-88b9-26e5764662ca tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:15.871533 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c7dd08ac-6e6c-4666-88b9-26e5764662ca tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 1.108122 Oct 12 22:17:15.873875 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2422/4292] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:14 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:15.884213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-4b3ab0f2-b9ce-4859-9583-ac5c0f2c160f req-f945e015-7d87-43da-b6be-43e21eb614cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a36c67e5-7222-4dc7-a676-7a533420b956", "tag": "bff8a9cc-f808-44cf-8562-6821ab7f4770"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:15.920213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4b3ab0f2-b9ce-4859-9583-ac5c0f2c160f req-f945e015-7d87-43da-b6be-43e21eb614cd service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:15.924404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4b3ab0f2-b9ce-4859-9583-ac5c0f2c160f req-f945e015-7d87-43da-b6be-43e21eb614cd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:15.925190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4b3ab0f2-b9ce-4859-9583-ac5c0f2c160f req-f945e015-7d87-43da-b6be-43e21eb614cd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:15.962856 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-4b3ab0f2-b9ce-4859-9583-ac5c0f2c160f req-f945e015-7d87-43da-b6be-43e21eb614cd service nova] Creating event network-changed:bff8a9cc-f808-44cf-8562-6821ab7f4770 for instance a36c67e5-7222-4dc7-a676-7a533420b956 on n-h1-861111-1 Oct 12 22:17:15.986757 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-4b3ab0f2-b9ce-4859-9583-ac5c0f2c160f req-f945e015-7d87-43da-b6be-43e21eb614cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109752 Oct 12 22:17:15.991719 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2423/4293] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:17:16.473661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ea0e637f-e30d-42a1-8783-97f6967985e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:16.474733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ea0e637f-e30d-42a1-8783-97f6967985e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:16.485928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea0e637f-e30d-42a1-8783-97f6967985e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:16.496213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea0e637f-e30d-42a1-8783-97f6967985e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:16.496934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea0e637f-e30d-42a1-8783-97f6967985e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:16.497582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea0e637f-e30d-42a1-8783-97f6967985e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:16.498062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea0e637f-e30d-42a1-8783-97f6967985e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:16.498503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea0e637f-e30d-42a1-8783-97f6967985e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:16.953018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ea0e637f-e30d-42a1-8783-97f6967985e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:16.975890 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ea0e637f-e30d-42a1-8783-97f6967985e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1315 microversion: 2.1 time: 0.506289 Oct 12 22:17:16.976501 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2424/4294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:16 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:16.986742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bfe1cd26-5e5e-49be-9787-17a03d6bc100 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:16.988276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bfe1cd26-5e5e-49be-9787-17a03d6bc100 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:17.012115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfe1cd26-5e5e-49be-9787-17a03d6bc100 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:17.016101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfe1cd26-5e5e-49be-9787-17a03d6bc100 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:17.017226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfe1cd26-5e5e-49be-9787-17a03d6bc100 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:17.020734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfe1cd26-5e5e-49be-9787-17a03d6bc100 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:17.022003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfe1cd26-5e5e-49be-9787-17a03d6bc100 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:17.022596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfe1cd26-5e5e-49be-9787-17a03d6bc100 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:17.259892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-19e1d038-90a7-4bae-921b-f2a9ee2cc7ce tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:17.270299 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-19e1d038-90a7-4bae-921b-f2a9ee2cc7ce tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1588 microversion: 2.1 time: 1.502213 Oct 12 22:17:17.301202 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1871/4295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:15 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1588 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:17.612060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bfe1cd26-5e5e-49be-9787-17a03d6bc100 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:17.629246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bfe1cd26-5e5e-49be-9787-17a03d6bc100 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:17.631688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bfe1cd26-5e5e-49be-9787-17a03d6bc100 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:17.633879 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bfe1cd26-5e5e-49be-9787-17a03d6bc100 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.656139 Oct 12 22:17:17.635212 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2425/4296] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:16 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:18.006968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0b0b7bad-cea1-4332-a864-07800f5e31b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:18.008528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0b0b7bad-cea1-4332-a864-07800f5e31b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:18.027700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bad-cea1-4332-a864-07800f5e31b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:18.030021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bad-cea1-4332-a864-07800f5e31b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:18.030947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bad-cea1-4332-a864-07800f5e31b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:18.034460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bad-cea1-4332-a864-07800f5e31b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:18.035064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bad-cea1-4332-a864-07800f5e31b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:18.036548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bad-cea1-4332-a864-07800f5e31b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:18.662862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c5141e08-98d2-48fd-98dd-22b57925fc78 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:18.664525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c5141e08-98d2-48fd-98dd-22b57925fc78 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:18.677771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5141e08-98d2-48fd-98dd-22b57925fc78 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:18.678613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5141e08-98d2-48fd-98dd-22b57925fc78 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:18.679404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5141e08-98d2-48fd-98dd-22b57925fc78 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:18.680476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5141e08-98d2-48fd-98dd-22b57925fc78 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:18.681671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5141e08-98d2-48fd-98dd-22b57925fc78 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:18.682564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5141e08-98d2-48fd-98dd-22b57925fc78 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:19.177213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c5141e08-98d2-48fd-98dd-22b57925fc78 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:19.194430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c5141e08-98d2-48fd-98dd-22b57925fc78 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:19.196065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c5141e08-98d2-48fd-98dd-22b57925fc78 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:19.203416 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c5141e08-98d2-48fd-98dd-22b57925fc78 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.544949 Oct 12 22:17:19.211284 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2426/4297] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:18 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:17:19.417953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0b0b7bad-cea1-4332-a864-07800f5e31b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:19.431921 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0b0b7bad-cea1-4332-a864-07800f5e31b6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1315 microversion: 2.1 time: 1.431332 Oct 12 22:17:19.432517 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1872/4298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:17 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1315 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:19.668032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-05237197-fd8c-42d9-9fb5-47e0e62f7ddb req-0cf69358-8e76-4929-a512-7998ca44855b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1", "name": "network-vif-plugged", "status": "completed", "tag": "0d84b6a8-d25c-4301-a1f2-c5f7340cc9e7"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:19.697619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-05237197-fd8c-42d9-9fb5-47e0e62f7ddb req-0cf69358-8e76-4929-a512-7998ca44855b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:19.698100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-05237197-fd8c-42d9-9fb5-47e0e62f7ddb req-0cf69358-8e76-4929-a512-7998ca44855b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:19.698533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-05237197-fd8c-42d9-9fb5-47e0e62f7ddb req-0cf69358-8e76-4929-a512-7998ca44855b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:19.714193 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-05237197-fd8c-42d9-9fb5-47e0e62f7ddb req-0cf69358-8e76-4929-a512-7998ca44855b service nova] Creating event network-vif-plugged:0d84b6a8-d25c-4301-a1f2-c5f7340cc9e7 for instance ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 on n-h1-861111-1 Oct 12 22:17:19.730599 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-05237197-fd8c-42d9-9fb5-47e0e62f7ddb req-0cf69358-8e76-4929-a512-7998ca44855b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066823 Oct 12 22:17:19.731533 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2427/4299] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:17:20.230297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4e018351-260a-454c-a8ac-bd6f137b126c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:20.231109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4e018351-260a-454c-a8ac-bd6f137b126c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:20.245480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e018351-260a-454c-a8ac-bd6f137b126c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:20.246141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e018351-260a-454c-a8ac-bd6f137b126c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:20.246736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e018351-260a-454c-a8ac-bd6f137b126c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:20.247491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e018351-260a-454c-a8ac-bd6f137b126c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:20.247949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e018351-260a-454c-a8ac-bd6f137b126c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:20.248373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e018351-260a-454c-a8ac-bd6f137b126c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:20.455770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-420577ac-7bb6-4419-9b4e-956173cf970b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:20.456719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-420577ac-7bb6-4419-9b4e-956173cf970b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:20.464003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-420577ac-7bb6-4419-9b4e-956173cf970b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:20.464654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-420577ac-7bb6-4419-9b4e-956173cf970b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:20.465405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-420577ac-7bb6-4419-9b4e-956173cf970b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:20.466266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-420577ac-7bb6-4419-9b4e-956173cf970b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:20.466868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-420577ac-7bb6-4419-9b4e-956173cf970b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:20.467468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-420577ac-7bb6-4419-9b4e-956173cf970b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:20.789824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-420577ac-7bb6-4419-9b4e-956173cf970b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:20.803463 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-420577ac-7bb6-4419-9b4e-956173cf970b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1315 microversion: 2.1 time: 0.351722 Oct 12 22:17:20.807349 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2428/4300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:20 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:17:20.916095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4e018351-260a-454c-a8ac-bd6f137b126c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:20.931597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4e018351-260a-454c-a8ac-bd6f137b126c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:20.935049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4e018351-260a-454c-a8ac-bd6f137b126c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:20.940030 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4e018351-260a-454c-a8ac-bd6f137b126c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.713671 Oct 12 22:17:20.940743 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1873/4301] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:20 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:21.289698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1688903403", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "78e9c2a6-5fb7-4d73-af4f-9d97f2a57ff2"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:21.382964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] validate_networks() for [('78e9c2a6-5fb7-4d73-af4f-9d97f2a57ff2', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:17:21.829798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-704fec3b-8945-4f9f-bfcb-0a94e71ad8c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:21.830502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-704fec3b-8945-4f9f-bfcb-0a94e71ad8c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:21.842356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-704fec3b-8945-4f9f-bfcb-0a94e71ad8c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:21.842921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-704fec3b-8945-4f9f-bfcb-0a94e71ad8c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:21.848054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-704fec3b-8945-4f9f-bfcb-0a94e71ad8c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:21.849515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-704fec3b-8945-4f9f-bfcb-0a94e71ad8c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:21.850320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-704fec3b-8945-4f9f-bfcb-0a94e71ad8c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:21.851007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-704fec3b-8945-4f9f-bfcb-0a94e71ad8c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:22.132402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:17:22.135010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:17:22.137046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:17:22.138202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:17:22.138827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:17:22.153716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:22.158404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:22.159824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:22.160824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:22.161578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:22.162330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:22.231276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Getting quotas for project d68e79ea36f8462cb135f79be5b80ce0. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:17:22.244642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Getting quotas for user 27c6aba556084cb8a4063110d899604b and project d68e79ea36f8462cb135f79be5b80ce0. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:17:22.259784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:17:22.262356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:17:22.268250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-704fec3b-8945-4f9f-bfcb-0a94e71ad8c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:22.285409 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-704fec3b-8945-4f9f-bfcb-0a94e71ad8c9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1502 microversion: 2.1 time: 0.459606 Oct 12 22:17:22.296987 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1874/4302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:21 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1502 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:17:22.306936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7aac76ca-3873-4d48-898b-5e583589a9ae tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:22.307607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7aac76ca-3873-4d48-898b-5e583589a9ae tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:22.324894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7aac76ca-3873-4d48-898b-5e583589a9ae tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:22.327117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7aac76ca-3873-4d48-898b-5e583589a9ae tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:22.327660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7aac76ca-3873-4d48-898b-5e583589a9ae tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:22.329804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7aac76ca-3873-4d48-898b-5e583589a9ae tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:22.330021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7aac76ca-3873-4d48-898b-5e583589a9ae tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:22.332247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7aac76ca-3873-4d48-898b-5e583589a9ae tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:22.361383 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-87e7ccc4-d612-49e9-b6d5-eafa4d74f0fc tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.550133 Oct 12 22:17:22.363146 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2429/4303] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 22:17:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1555 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:17:22.555278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c3658a9f-5fde-4d6e-9d9c-be93b350f1c6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1314292499", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": "none"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:22.638417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-c3658a9f-5fde-4d6e-9d9c-be93b350f1c6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:17:22.639421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-c3658a9f-5fde-4d6e-9d9c-be93b350f1c6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:17:22.639994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-c3658a9f-5fde-4d6e-9d9c-be93b350f1c6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:17:22.640621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-c3658a9f-5fde-4d6e-9d9c-be93b350f1c6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:17:22.641235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-c3658a9f-5fde-4d6e-9d9c-be93b350f1c6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:17:22.666499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3658a9f-5fde-4d6e-9d9c-be93b350f1c6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:22.667116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3658a9f-5fde-4d6e-9d9c-be93b350f1c6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:22.667703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3658a9f-5fde-4d6e-9d9c-be93b350f1c6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:22.669546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3658a9f-5fde-4d6e-9d9c-be93b350f1c6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:22.670364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3658a9f-5fde-4d6e-9d9c-be93b350f1c6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:22.672796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3658a9f-5fde-4d6e-9d9c-be93b350f1c6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:22.733573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-c3658a9f-5fde-4d6e-9d9c-be93b350f1c6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Getting quotas for project a0382ff053c849d19c8fbeac978b7bae. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:17:22.739389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:22.740906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-c3658a9f-5fde-4d6e-9d9c-be93b350f1c6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Getting quotas for user 4c98f8f74048434391366b25d0c539f4 and project a0382ff053c849d19c8fbeac978b7bae. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:17:22.791691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c3658a9f-5fde-4d6e-9d9c-be93b350f1c6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:17:22.793947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c3658a9f-5fde-4d6e-9d9c-be93b350f1c6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:17:22.885928 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c3658a9f-5fde-4d6e-9d9c-be93b350f1c6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.519211 Oct 12 22:17:22.887338 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2430/4304] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 22:17:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:17:22.896942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9cb177eb-ae3b-4277-9221-b55652a6aa65 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:22.897745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9cb177eb-ae3b-4277-9221-b55652a6aa65 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:22.905312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cb177eb-ae3b-4277-9221-b55652a6aa65 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:22.905997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cb177eb-ae3b-4277-9221-b55652a6aa65 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:22.906600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cb177eb-ae3b-4277-9221-b55652a6aa65 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:22.907526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cb177eb-ae3b-4277-9221-b55652a6aa65 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:22.908138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cb177eb-ae3b-4277-9221-b55652a6aa65 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:22.908728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cb177eb-ae3b-4277-9221-b55652a6aa65 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:23.273444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7aac76ca-3873-4d48-898b-5e583589a9ae tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:23.294620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7aac76ca-3873-4d48-898b-5e583589a9ae tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:23.299006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7aac76ca-3873-4d48-898b-5e583589a9ae tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:23.301173 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7aac76ca-3873-4d48-898b-5e583589a9ae tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 1.006638 Oct 12 22:17:23.301903 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1875/4305] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:22 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:23.340675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-459fc88f-6234-453b-b51f-d2db432e7581 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:23.341959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-459fc88f-6234-453b-b51f-d2db432e7581 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:23.364068 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.network.security_group_api [None req-9cb177eb-ae3b-4277-9221-b55652a6aa65 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Removing security group 87f6b9c1-71f2-4688-9379-f1e9b115dd69 from port 0d84b6a8-d25c-4301-a1f2-c5f7340cc9e7 Oct 12 22:17:23.371571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-459fc88f-6234-453b-b51f-d2db432e7581 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:23.372077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-459fc88f-6234-453b-b51f-d2db432e7581 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:23.375603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-459fc88f-6234-453b-b51f-d2db432e7581 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:23.376442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-459fc88f-6234-453b-b51f-d2db432e7581 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:23.376894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-459fc88f-6234-453b-b51f-d2db432e7581 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:23.377362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-459fc88f-6234-453b-b51f-d2db432e7581 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:23.736965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-459fc88f-6234-453b-b51f-d2db432e7581 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:23.748391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-459fc88f-6234-453b-b51f-d2db432e7581 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:23.762329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-459fc88f-6234-453b-b51f-d2db432e7581 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:23.784365 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-459fc88f-6234-453b-b51f-d2db432e7581 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1263 microversion: 2.21 time: 0.466919 Oct 12 22:17:23.801190 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1876/4306] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:23 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1263 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:23.806244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fbf2657c-65eb-4443-84b1-d7f28dc76ef6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:23.812986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fbf2657c-65eb-4443-84b1-d7f28dc76ef6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:23.956725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fbf2657c-65eb-4443-84b1-d7f28dc76ef6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:23.964777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fbf2657c-65eb-4443-84b1-d7f28dc76ef6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:23.971321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fbf2657c-65eb-4443-84b1-d7f28dc76ef6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:23.972589 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fbf2657c-65eb-4443-84b1-d7f28dc76ef6 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1278 microversion: 2.54 time: 0.170304 Oct 12 22:17:23.988060 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1877/4307] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:23 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:24.334550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e1d1d554-9164-4ae2-ac52-b8d15dea789b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:24.335276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e1d1d554-9164-4ae2-ac52-b8d15dea789b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:24.342926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1d1d554-9164-4ae2-ac52-b8d15dea789b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:24.354539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1d1d554-9164-4ae2-ac52-b8d15dea789b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:24.355103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1d1d554-9164-4ae2-ac52-b8d15dea789b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:24.355925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1d1d554-9164-4ae2-ac52-b8d15dea789b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:24.356395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1d1d554-9164-4ae2-ac52-b8d15dea789b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:24.362949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1d1d554-9164-4ae2-ac52-b8d15dea789b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:24.787933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e1d1d554-9164-4ae2-ac52-b8d15dea789b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:24.806969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e1d1d554-9164-4ae2-ac52-b8d15dea789b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:24.811925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e1d1d554-9164-4ae2-ac52-b8d15dea789b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:24.816331 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e1d1d554-9164-4ae2-ac52-b8d15dea789b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.486768 Oct 12 22:17:24.835268 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1878/4308] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:24 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:24.835268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ff34ac2d-f35e-469f-addf-a8846ddfc5e3 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:24.835268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ff34ac2d-f35e-469f-addf-a8846ddfc5e3 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:24.852948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff34ac2d-f35e-469f-addf-a8846ddfc5e3 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:24.855153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff34ac2d-f35e-469f-addf-a8846ddfc5e3 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:24.858678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff34ac2d-f35e-469f-addf-a8846ddfc5e3 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:24.859664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff34ac2d-f35e-469f-addf-a8846ddfc5e3 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:24.860279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff34ac2d-f35e-469f-addf-a8846ddfc5e3 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:24.860858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff34ac2d-f35e-469f-addf-a8846ddfc5e3 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:25.103229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ff34ac2d-f35e-469f-addf-a8846ddfc5e3 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:25.130531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ff34ac2d-f35e-469f-addf-a8846ddfc5e3 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:25.132629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ff34ac2d-f35e-469f-addf-a8846ddfc5e3 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:25.146300 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ff34ac2d-f35e-469f-addf-a8846ddfc5e3 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1311 microversion: 2.21 time: 0.316899 Oct 12 22:17:25.151716 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1879/4309] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:24 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1311 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:25.160259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c289e129-95ec-446a-9244-5a7bd83089d3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:25.172339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c289e129-95ec-446a-9244-5a7bd83089d3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:25.198229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c289e129-95ec-446a-9244-5a7bd83089d3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:25.199092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c289e129-95ec-446a-9244-5a7bd83089d3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:25.200007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c289e129-95ec-446a-9244-5a7bd83089d3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:25.201023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c289e129-95ec-446a-9244-5a7bd83089d3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:25.202789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c289e129-95ec-446a-9244-5a7bd83089d3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:25.205523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c289e129-95ec-446a-9244-5a7bd83089d3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:25.472513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c289e129-95ec-446a-9244-5a7bd83089d3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:25.483181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c289e129-95ec-446a-9244-5a7bd83089d3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:25.493123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c289e129-95ec-446a-9244-5a7bd83089d3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:25.506140 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c289e129-95ec-446a-9244-5a7bd83089d3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1330 microversion: 2.54 time: 0.352803 Oct 12 22:17:25.528301 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1880/4310] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:25 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1330 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:25.659654 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9cb177eb-ae3b-4277-9221-b55652a6aa65 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1/action" status: 202 len: 0 microversion: 2.1 time: 2.770947 Oct 12 22:17:25.664228 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2431/4311] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:17:22 2022] POST /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1/action => generated 0 bytes in 2775 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:17:25.670242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-acee802d-52f6-412b-90a8-7864dae34d81 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:25.671192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-acee802d-52f6-412b-90a8-7864dae34d81 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:25.683879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acee802d-52f6-412b-90a8-7864dae34d81 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:25.685731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acee802d-52f6-412b-90a8-7864dae34d81 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:25.687841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acee802d-52f6-412b-90a8-7864dae34d81 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:25.691225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acee802d-52f6-412b-90a8-7864dae34d81 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:25.692477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acee802d-52f6-412b-90a8-7864dae34d81 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:25.695000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acee802d-52f6-412b-90a8-7864dae34d81 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:25.832616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-361c3422-bd4a-4800-9715-e1bb9f5c52a1 req-67752639-0257-4824-b183-fb308ab481dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1", "tag": "0d84b6a8-d25c-4301-a1f2-c5f7340cc9e7"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:25.852078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-361c3422-bd4a-4800-9715-e1bb9f5c52a1 req-67752639-0257-4824-b183-fb308ab481dc service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:25.852832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-361c3422-bd4a-4800-9715-e1bb9f5c52a1 req-67752639-0257-4824-b183-fb308ab481dc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:25.855086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-361c3422-bd4a-4800-9715-e1bb9f5c52a1 req-67752639-0257-4824-b183-fb308ab481dc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:25.889216 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-361c3422-bd4a-4800-9715-e1bb9f5c52a1 req-67752639-0257-4824-b183-fb308ab481dc service nova] Creating event network-changed:0d84b6a8-d25c-4301-a1f2-c5f7340cc9e7 for instance ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 on n-h1-861111-1 Oct 12 22:17:25.896313 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-361c3422-bd4a-4800-9715-e1bb9f5c52a1 req-67752639-0257-4824-b183-fb308ab481dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067968 Oct 12 22:17:25.906343 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2432/4312] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:17:25.917670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5ccc36e5-f7c5-4596-85eb-33be5534cbc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:25.918521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5ccc36e5-f7c5-4596-85eb-33be5534cbc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:25.936809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ccc36e5-f7c5-4596-85eb-33be5534cbc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:25.937835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ccc36e5-f7c5-4596-85eb-33be5534cbc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:25.938408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ccc36e5-f7c5-4596-85eb-33be5534cbc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:25.939262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ccc36e5-f7c5-4596-85eb-33be5534cbc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:25.939877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ccc36e5-f7c5-4596-85eb-33be5534cbc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:25.945071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ccc36e5-f7c5-4596-85eb-33be5534cbc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:26.150790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-acee802d-52f6-412b-90a8-7864dae34d81 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:26.162960 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-acee802d-52f6-412b-90a8-7864dae34d81 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1460 microversion: 2.1 time: 0.496575 Oct 12 22:17:26.167132 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1881/4313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:25 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1460 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:26.178954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ac3938bd-f9f5-429f-831c-041f9987bd56 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:26.179849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ac3938bd-f9f5-429f-831c-041f9987bd56 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:26.208465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3938bd-f9f5-429f-831c-041f9987bd56 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:26.209513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3938bd-f9f5-429f-831c-041f9987bd56 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:26.210188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3938bd-f9f5-429f-831c-041f9987bd56 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:26.211139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3938bd-f9f5-429f-831c-041f9987bd56 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:26.212396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3938bd-f9f5-429f-831c-041f9987bd56 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:26.213051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3938bd-f9f5-429f-831c-041f9987bd56 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:26.467651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5ccc36e5-f7c5-4596-85eb-33be5534cbc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:26.484981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5ccc36e5-f7c5-4596-85eb-33be5534cbc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:26.488455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5ccc36e5-f7c5-4596-85eb-33be5534cbc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:26.493597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ac3938bd-f9f5-429f-831c-041f9987bd56 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:26.509339 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5ccc36e5-f7c5-4596-85eb-33be5534cbc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.599687 Oct 12 22:17:26.510313 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2433/4314] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:25 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:26.510752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ac3938bd-f9f5-429f-831c-041f9987bd56 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:26.520620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ac3938bd-f9f5-429f-831c-041f9987bd56 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:26.530448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bf5451d1-e329-4cad-b07f-72941b0f1c1d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:26.531274 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ac3938bd-f9f5-429f-831c-041f9987bd56 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1317 microversion: 2.21 time: 0.354273 Oct 12 22:17:26.545694 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1882/4315] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:26 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:26.558233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bf5451d1-e329-4cad-b07f-72941b0f1c1d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:26.567433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9b343451-9baf-416f-8bba-0277f75fb887 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:26.569066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9b343451-9baf-416f-8bba-0277f75fb887 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:26.574358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5451d1-e329-4cad-b07f-72941b0f1c1d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:26.577101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b343451-9baf-416f-8bba-0277f75fb887 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:26.579650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b343451-9baf-416f-8bba-0277f75fb887 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:26.581107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b343451-9baf-416f-8bba-0277f75fb887 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:26.582345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b343451-9baf-416f-8bba-0277f75fb887 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:26.583426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b343451-9baf-416f-8bba-0277f75fb887 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:26.584337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b343451-9baf-416f-8bba-0277f75fb887 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:26.586552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5451d1-e329-4cad-b07f-72941b0f1c1d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:26.611307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5451d1-e329-4cad-b07f-72941b0f1c1d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:26.612083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5451d1-e329-4cad-b07f-72941b0f1c1d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:26.615340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5451d1-e329-4cad-b07f-72941b0f1c1d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:26.619040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf5451d1-e329-4cad-b07f-72941b0f1c1d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:27.210588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9b343451-9baf-416f-8bba-0277f75fb887 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:27.221204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9b343451-9baf-416f-8bba-0277f75fb887 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:27.222667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9b343451-9baf-416f-8bba-0277f75fb887 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:27.223879 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9b343451-9baf-416f-8bba-0277f75fb887 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1336 microversion: 2.54 time: 0.661094 Oct 12 22:17:27.236366 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1883/4316] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:26 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1336 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:27.330754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bf5451d1-e329-4cad-b07f-72941b0f1c1d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:27.344294 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bf5451d1-e329-4cad-b07f-72941b0f1c1d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.830349 Oct 12 22:17:27.346283 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2434/4317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:26 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:27.384642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5cb2bdcd-1d62-4581-925c-c0874fa1a23d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:27.385428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5cb2bdcd-1d62-4581-925c-c0874fa1a23d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:27.395703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cb2bdcd-1d62-4581-925c-c0874fa1a23d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:27.396212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cb2bdcd-1d62-4581-925c-c0874fa1a23d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:27.396660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cb2bdcd-1d62-4581-925c-c0874fa1a23d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:27.397386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cb2bdcd-1d62-4581-925c-c0874fa1a23d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:27.397844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cb2bdcd-1d62-4581-925c-c0874fa1a23d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:27.398280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cb2bdcd-1d62-4581-925c-c0874fa1a23d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:27.540716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bf3ca1fa-5bdb-42f7-9e10-9cc36818fd8e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:27.541760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bf3ca1fa-5bdb-42f7-9e10-9cc36818fd8e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:27.559666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf3ca1fa-5bdb-42f7-9e10-9cc36818fd8e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:27.562380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf3ca1fa-5bdb-42f7-9e10-9cc36818fd8e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:27.565978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf3ca1fa-5bdb-42f7-9e10-9cc36818fd8e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:27.566869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf3ca1fa-5bdb-42f7-9e10-9cc36818fd8e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:27.575533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf3ca1fa-5bdb-42f7-9e10-9cc36818fd8e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:27.577719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf3ca1fa-5bdb-42f7-9e10-9cc36818fd8e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:28.041691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5cb2bdcd-1d62-4581-925c-c0874fa1a23d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:28.054556 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5cb2bdcd-1d62-4581-925c-c0874fa1a23d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.679079 Oct 12 22:17:28.055163 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1884/4318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:27 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:28.071826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-def5af4e-a9a3-4082-9053-03751859151b tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:28.073041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-def5af4e-a9a3-4082-9053-03751859151b tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:28.086598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-def5af4e-a9a3-4082-9053-03751859151b tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:28.093491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-def5af4e-a9a3-4082-9053-03751859151b tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:28.094803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-def5af4e-a9a3-4082-9053-03751859151b tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:28.095623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-def5af4e-a9a3-4082-9053-03751859151b tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:28.099465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-def5af4e-a9a3-4082-9053-03751859151b tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:28.100034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-def5af4e-a9a3-4082-9053-03751859151b tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:28.324398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-def5af4e-a9a3-4082-9053-03751859151b tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:28.335231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-def5af4e-a9a3-4082-9053-03751859151b tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:28.337705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-def5af4e-a9a3-4082-9053-03751859151b tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:28.339459 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-def5af4e-a9a3-4082-9053-03751859151b tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1317 microversion: 2.21 time: 0.279605 Oct 12 22:17:28.352545 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1885/4319] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:28 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:28.363701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-208a65c5-6570-46f6-aeea-6eed8cab3a8f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:28.364330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-208a65c5-6570-46f6-aeea-6eed8cab3a8f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:28.372432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-208a65c5-6570-46f6-aeea-6eed8cab3a8f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:28.373166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-208a65c5-6570-46f6-aeea-6eed8cab3a8f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:28.373878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-208a65c5-6570-46f6-aeea-6eed8cab3a8f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:28.374773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-208a65c5-6570-46f6-aeea-6eed8cab3a8f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:28.375410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-208a65c5-6570-46f6-aeea-6eed8cab3a8f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:28.376478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-208a65c5-6570-46f6-aeea-6eed8cab3a8f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:28.535371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bf3ca1fa-5bdb-42f7-9e10-9cc36818fd8e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:28.546310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bf3ca1fa-5bdb-42f7-9e10-9cc36818fd8e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:28.554189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bf3ca1fa-5bdb-42f7-9e10-9cc36818fd8e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:28.556210 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bf3ca1fa-5bdb-42f7-9e10-9cc36818fd8e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 1.019457 Oct 12 22:17:28.558373 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2435/4320] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:27 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:17:28.563749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c5c158cd-e6ad-4fbd-8311-1b2c867c4ba5 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:28.564546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c5c158cd-e6ad-4fbd-8311-1b2c867c4ba5 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:28.571181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5c158cd-e6ad-4fbd-8311-1b2c867c4ba5 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:28.572384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5c158cd-e6ad-4fbd-8311-1b2c867c4ba5 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:28.572990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5c158cd-e6ad-4fbd-8311-1b2c867c4ba5 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:28.573852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5c158cd-e6ad-4fbd-8311-1b2c867c4ba5 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:28.574461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5c158cd-e6ad-4fbd-8311-1b2c867c4ba5 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:28.575044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5c158cd-e6ad-4fbd-8311-1b2c867c4ba5 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:28.645529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-208a65c5-6570-46f6-aeea-6eed8cab3a8f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:28.654199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:28.658913 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-208a65c5-6570-46f6-aeea-6eed8cab3a8f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.304904 Oct 12 22:17:28.661115 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1886/4321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:28 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:28.690090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2235e15d-8d38-469c-aacf-8b5dc284b681 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:28.690886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2235e15d-8d38-469c-aacf-8b5dc284b681 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:28.699899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2235e15d-8d38-469c-aacf-8b5dc284b681 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:28.700559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2235e15d-8d38-469c-aacf-8b5dc284b681 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:28.706950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2235e15d-8d38-469c-aacf-8b5dc284b681 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:28.710610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2235e15d-8d38-469c-aacf-8b5dc284b681 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:28.713285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2235e15d-8d38-469c-aacf-8b5dc284b681 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:28.723270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2235e15d-8d38-469c-aacf-8b5dc284b681 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:28.932878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c5c158cd-e6ad-4fbd-8311-1b2c867c4ba5 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:28.952499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c5c158cd-e6ad-4fbd-8311-1b2c867c4ba5 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:28.954233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c5c158cd-e6ad-4fbd-8311-1b2c867c4ba5 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:28.958384 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c5c158cd-e6ad-4fbd-8311-1b2c867c4ba5 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1336 microversion: 2.54 time: 0.398599 Oct 12 22:17:28.959572 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2436/4322] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:28 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1336 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:29.304008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2235e15d-8d38-469c-aacf-8b5dc284b681 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:29.327185 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2235e15d-8d38-469c-aacf-8b5dc284b681 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.647477 Oct 12 22:17:29.331136 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1887/4323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:28 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:29.367673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1fcff3b4-225f-453c-979e-dd1f29ae1aac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:29.368347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1fcff3b4-225f-453c-979e-dd1f29ae1aac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:29.376640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fcff3b4-225f-453c-979e-dd1f29ae1aac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:29.377143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fcff3b4-225f-453c-979e-dd1f29ae1aac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:29.377594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fcff3b4-225f-453c-979e-dd1f29ae1aac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:29.378307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fcff3b4-225f-453c-979e-dd1f29ae1aac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:29.378773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fcff3b4-225f-453c-979e-dd1f29ae1aac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:29.379210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fcff3b4-225f-453c-979e-dd1f29ae1aac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:29.587979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1c7369c4-e8f8-474a-98b0-786c2370cece tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:29.588598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1c7369c4-e8f8-474a-98b0-786c2370cece tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:29.601701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c7369c4-e8f8-474a-98b0-786c2370cece tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:29.602978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c7369c4-e8f8-474a-98b0-786c2370cece tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:29.603624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c7369c4-e8f8-474a-98b0-786c2370cece tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:29.604521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c7369c4-e8f8-474a-98b0-786c2370cece tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:29.605131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c7369c4-e8f8-474a-98b0-786c2370cece tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:29.605712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c7369c4-e8f8-474a-98b0-786c2370cece tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:29.788100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1fcff3b4-225f-453c-979e-dd1f29ae1aac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:29.795122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:29.802406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1fcff3b4-225f-453c-979e-dd1f29ae1aac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:29.803957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1fcff3b4-225f-453c-979e-dd1f29ae1aac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:29.805171 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1fcff3b4-225f-453c-979e-dd1f29ae1aac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1359 microversion: 2.21 time: 0.441442 Oct 12 22:17:29.816128 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2437/4324] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:29 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1359 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:29.851386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1461666766", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "68fd94b2-ed36-4c67-ae5b-2f754d0450a2"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:29.922160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] validate_networks() for [('68fd94b2-ed36-4c67-ae5b-2f754d0450a2', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:17:30.283616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1c7369c4-e8f8-474a-98b0-786c2370cece tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:30.308156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1c7369c4-e8f8-474a-98b0-786c2370cece tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:30.311406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1c7369c4-e8f8-474a-98b0-786c2370cece tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:30.313145 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1c7369c4-e8f8-474a-98b0-786c2370cece tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.729913 Oct 12 22:17:30.314241 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1888/4325] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:29 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:17:30.322589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-38e2eaf6-154b-4a5e-9d04-c498c0946238 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:30.324138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-38e2eaf6-154b-4a5e-9d04-c498c0946238 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:30.334615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38e2eaf6-154b-4a5e-9d04-c498c0946238 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:30.364068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38e2eaf6-154b-4a5e-9d04-c498c0946238 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:30.366705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38e2eaf6-154b-4a5e-9d04-c498c0946238 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:30.368777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38e2eaf6-154b-4a5e-9d04-c498c0946238 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:30.369755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38e2eaf6-154b-4a5e-9d04-c498c0946238 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:30.370462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38e2eaf6-154b-4a5e-9d04-c498c0946238 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:30.532357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-38e2eaf6-154b-4a5e-9d04-c498c0946238 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:30.547038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-38e2eaf6-154b-4a5e-9d04-c498c0946238 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:30.548796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-38e2eaf6-154b-4a5e-9d04-c498c0946238 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:30.550134 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-38e2eaf6-154b-4a5e-9d04-c498c0946238 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1336 microversion: 2.54 time: 0.234641 Oct 12 22:17:30.550873 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1889/4326] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:30 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1336 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:30.841618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-77bd5064-4880-41d1-b196-854ad7562aac req-afebc36b-35b6-4ad9-935e-8e2bfcfe80e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "522963ce-473f-4d06-94a6-f329fc0d1fc2", "tag": "0ab78bef-0d04-4c8b-8835-499165a55dea"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:30.865421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-77bd5064-4880-41d1-b196-854ad7562aac req-afebc36b-35b6-4ad9-935e-8e2bfcfe80e0 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:30.871631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-77bd5064-4880-41d1-b196-854ad7562aac req-afebc36b-35b6-4ad9-935e-8e2bfcfe80e0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:30.872109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-77bd5064-4880-41d1-b196-854ad7562aac req-afebc36b-35b6-4ad9-935e-8e2bfcfe80e0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:30.913385 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-77bd5064-4880-41d1-b196-854ad7562aac req-afebc36b-35b6-4ad9-935e-8e2bfcfe80e0 service nova] Creating event network-changed:0ab78bef-0d04-4c8b-8835-499165a55dea for instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 on n-h2-861111-1 Oct 12 22:17:30.925641 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-77bd5064-4880-41d1-b196-854ad7562aac req-afebc36b-35b6-4ad9-935e-8e2bfcfe80e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091141 Oct 12 22:17:30.927175 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1890/4327] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:17:30.938173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bf996e66-e1e9-4bc5-954c-300e4db8a544 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:30.941177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bf996e66-e1e9-4bc5-954c-300e4db8a544 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:30.961015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf996e66-e1e9-4bc5-954c-300e4db8a544 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:30.961514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf996e66-e1e9-4bc5-954c-300e4db8a544 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:30.961998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf996e66-e1e9-4bc5-954c-300e4db8a544 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:30.964957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf996e66-e1e9-4bc5-954c-300e4db8a544 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:30.966127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf996e66-e1e9-4bc5-954c-300e4db8a544 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:30.966590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf996e66-e1e9-4bc5-954c-300e4db8a544 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:31.257365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:17:31.258113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:17:31.259575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:17:31.261581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:17:31.262235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:17:31.272624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:31.273461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:31.274076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:31.275770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:31.276420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:31.277034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:31.326737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Getting quotas for project 319a8f107945457a8a8f8e9690a697e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:17:31.338956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Getting quotas for user b29c500796d54d6188ff65056340d35f and project 319a8f107945457a8a8f8e9690a697e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:17:31.357155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:17:31.359817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:17:31.441526 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-413baaf5-7492-4299-8999-224446a5eca2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.608172 Oct 12 22:17:31.442205 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2438/4328] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:17:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:17:31.558547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1531605586", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "5cd0cf41-4709-416a-b5b5-af7b0e620a7a"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:31.607460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bf996e66-e1e9-4bc5-954c-300e4db8a544 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:31.617216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bf996e66-e1e9-4bc5-954c-300e4db8a544 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:31.619569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bf996e66-e1e9-4bc5-954c-300e4db8a544 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:31.620622 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bf996e66-e1e9-4bc5-954c-300e4db8a544 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1359 microversion: 2.21 time: 0.692114 Oct 12 22:17:31.621180 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1891/4329] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:30 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1359 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:31.627160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8ca0fa7f-ad5a-424e-b622-78ce2dfa8ad6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:31.628213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8ca0fa7f-ad5a-424e-b622-78ce2dfa8ad6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:31.635832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ca0fa7f-ad5a-424e-b622-78ce2dfa8ad6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:31.636640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ca0fa7f-ad5a-424e-b622-78ce2dfa8ad6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:31.637854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ca0fa7f-ad5a-424e-b622-78ce2dfa8ad6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:31.638801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ca0fa7f-ad5a-424e-b622-78ce2dfa8ad6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:31.640065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ca0fa7f-ad5a-424e-b622-78ce2dfa8ad6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:31.640684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ca0fa7f-ad5a-424e-b622-78ce2dfa8ad6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:31.683203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] validate_networks() for [('5cd0cf41-4709-416a-b5b5-af7b0e620a7a', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:17:32.014109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8ca0fa7f-ad5a-424e-b622-78ce2dfa8ad6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:32.042684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8ca0fa7f-ad5a-424e-b622-78ce2dfa8ad6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:32.045585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8ca0fa7f-ad5a-424e-b622-78ce2dfa8ad6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:32.048131 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8ca0fa7f-ad5a-424e-b622-78ce2dfa8ad6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.425255 Oct 12 22:17:32.049662 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1892/4330] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:31 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:32.054777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1a50cdca-e368-4a78-ac91-2230974d7559 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:32.055744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1a50cdca-e368-4a78-ac91-2230974d7559 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:32.346437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1a50cdca-e368-4a78-ac91-2230974d7559 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:32.358839 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1a50cdca-e368-4a78-ac91-2230974d7559 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1215 microversion: 2.1 time: 0.307852 Oct 12 22:17:32.360381 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1893/4331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:32 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1215 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:32.371015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f5589da2-76d0-4bd3-813b-836a6468258e tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:32.376350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f5589da2-76d0-4bd3-813b-836a6468258e tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:32.385001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5589da2-76d0-4bd3-813b-836a6468258e tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:32.385863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5589da2-76d0-4bd3-813b-836a6468258e tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:32.386542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5589da2-76d0-4bd3-813b-836a6468258e tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:32.387654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5589da2-76d0-4bd3-813b-836a6468258e tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:32.388488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5589da2-76d0-4bd3-813b-836a6468258e tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:32.389068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5589da2-76d0-4bd3-813b-836a6468258e tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:32.517299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f5589da2-76d0-4bd3-813b-836a6468258e tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:32.532634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f5589da2-76d0-4bd3-813b-836a6468258e tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:32.535678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f5589da2-76d0-4bd3-813b-836a6468258e tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:32.537082 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f5589da2-76d0-4bd3-813b-836a6468258e tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1357 microversion: 2.54 time: 0.174844 Oct 12 22:17:32.541165 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1894/4332] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:32 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:32.570716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6cc01cde-61a5-45f1-b8c7-a4dded51d4af tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Action: 'create', calling method: .version_select at 0x7f512392d670>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-654743225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCytXod9eUMWN0gSi/GFebwnODFKqFlX9BvZ1+MwTP1+UAHzu3mSBSI6fduiKP1WWGFqwTgrgWW7uwaSLSor9nlBoEW7+YgO2MNCKLGrxF2HuFhp0PNDLCA04JoaUp/6bA=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:32.601553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-6cc01cde-61a5-45f1-b8c7-a4dded51d4af tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Getting quotas for project a0382ff053c849d19c8fbeac978b7bae. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:17:32.616289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-6cc01cde-61a5-45f1-b8c7-a4dded51d4af tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Getting quotas for user 4c98f8f74048434391366b25d0c539f4 and project a0382ff053c849d19c8fbeac978b7bae. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:17:32.674413 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6cc01cde-61a5-45f1-b8c7-a4dded51d4af tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.108722 Oct 12 22:17:32.675038 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1895/4333] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 12 22:17:32 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 12 22:17:32.681347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f87ed0e-5d8c-468f-ab02-1c426d2a9648 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:32.685220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8f87ed0e-5d8c-468f-ab02-1c426d2a9648 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:32.697067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f87ed0e-5d8c-468f-ab02-1c426d2a9648 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:32.702236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f87ed0e-5d8c-468f-ab02-1c426d2a9648 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:32.703063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f87ed0e-5d8c-468f-ab02-1c426d2a9648 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:32.705074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f87ed0e-5d8c-468f-ab02-1c426d2a9648 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:32.705772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f87ed0e-5d8c-468f-ab02-1c426d2a9648 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:32.707225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f87ed0e-5d8c-468f-ab02-1c426d2a9648 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:33.200789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f87ed0e-5d8c-468f-ab02-1c426d2a9648 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:33.210393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f87ed0e-5d8c-468f-ab02-1c426d2a9648 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:33.212586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f87ed0e-5d8c-468f-ab02-1c426d2a9648 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:33.213749 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f87ed0e-5d8c-468f-ab02-1c426d2a9648 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1359 microversion: 2.21 time: 0.537497 Oct 12 22:17:33.228474 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1896/4334] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:32 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1359 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:33.233753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-654743225", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:33.236763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:33.257151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:33.257663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:33.258112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:33.259418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:33.259886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:33.260329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:33.421762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:17:33.425429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:17:33.426048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:17:33.428879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:17:33.429477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:17:33.435658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:17:33.436217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:17:33.436741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:17:33.437374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:17:33.437888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:17:33.457100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:33.457604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:33.458096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:33.460998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:33.471676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:33.472272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:33.545852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Getting quotas for project 1a5493a20eda476e8843381f175baf1b. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:17:33.551835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Getting quotas for user 519ae2ddba1d412e96e40782c6b46337 and project 1a5493a20eda476e8843381f175baf1b. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:17:33.584735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:17:33.587684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:17:33.590070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:33.604229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:33.604739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:33.605179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:33.611117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:33.612593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:33.613101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:33.692548 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-914e8087-9e94-4967-a999-d922af82410d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "POST /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c/action" status: 202 len: 1139 microversion: 2.54 time: 0.461825 Oct 12 22:17:33.695187 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1897/4335] 10.222.0.16 () {62 vars in 1320 bytes} [Wed Oct 12 22:17:33 2022] POST /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c/action => generated 1139 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 12 22:17:33.713995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4aa2424e-abcc-4089-bc3d-4444e3c97a9d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:33.715074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4aa2424e-abcc-4089-bc3d-4444e3c97a9d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:33.717154 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-65f3cc93-dbfc-4229-8e74-d08d2e27279f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.273765 Oct 12 22:17:33.728087 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2439/4336] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:17:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:17:33.740106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b13cae61-d8bf-467f-8dbf-1374134117a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:33.743878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4aa2424e-abcc-4089-bc3d-4444e3c97a9d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:33.744086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4aa2424e-abcc-4089-bc3d-4444e3c97a9d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:33.748875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b13cae61-d8bf-467f-8dbf-1374134117a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:33.760677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4aa2424e-abcc-4089-bc3d-4444e3c97a9d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:33.762555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4aa2424e-abcc-4089-bc3d-4444e3c97a9d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:33.764745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4aa2424e-abcc-4089-bc3d-4444e3c97a9d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:33.765977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4aa2424e-abcc-4089-bc3d-4444e3c97a9d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:33.776880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b13cae61-d8bf-467f-8dbf-1374134117a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:33.779407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b13cae61-d8bf-467f-8dbf-1374134117a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:33.791658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b13cae61-d8bf-467f-8dbf-1374134117a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:33.792676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b13cae61-d8bf-467f-8dbf-1374134117a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:33.793213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b13cae61-d8bf-467f-8dbf-1374134117a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:33.794676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b13cae61-d8bf-467f-8dbf-1374134117a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:34.037124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b13cae61-d8bf-467f-8dbf-1374134117a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:34.045613 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b13cae61-d8bf-467f-8dbf-1374134117a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1285 microversion: 2.1 time: 0.315415 Oct 12 22:17:34.046209 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2440/4337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:33 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1285 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:34.078254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7e16b07c-c21f-406c-96df-32841ff8ef16 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:34.082051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7e16b07c-c21f-406c-96df-32841ff8ef16 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:34.113975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e16b07c-c21f-406c-96df-32841ff8ef16 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:34.122712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e16b07c-c21f-406c-96df-32841ff8ef16 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:34.125079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e16b07c-c21f-406c-96df-32841ff8ef16 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:34.126187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e16b07c-c21f-406c-96df-32841ff8ef16 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:34.132888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e16b07c-c21f-406c-96df-32841ff8ef16 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:34.133560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e16b07c-c21f-406c-96df-32841ff8ef16 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:34.319095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7e16b07c-c21f-406c-96df-32841ff8ef16 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:34.370934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7e16b07c-c21f-406c-96df-32841ff8ef16 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:34.382898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7e16b07c-c21f-406c-96df-32841ff8ef16 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:34.387264 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7e16b07c-c21f-406c-96df-32841ff8ef16 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.340022 Oct 12 22:17:34.387877 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2441/4338] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:34 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:34.404804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6e225c33-351a-4aa1-9e81-d348ed1bff0d tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:34.407118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6e225c33-351a-4aa1-9e81-d348ed1bff0d tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:34.490850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4aa2424e-abcc-4089-bc3d-4444e3c97a9d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:34.509380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4aa2424e-abcc-4089-bc3d-4444e3c97a9d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:34.511018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4aa2424e-abcc-4089-bc3d-4444e3c97a9d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:34.516426 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4aa2424e-abcc-4089-bc3d-4444e3c97a9d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.814830 Oct 12 22:17:34.519721 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1898/4339] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:33 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:34.535718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c9afa040-94a7-4c20-8de1-214d598df5d9 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:34.536557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c9afa040-94a7-4c20-8de1-214d598df5d9 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:34.545540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6e225c33-351a-4aa1-9e81-d348ed1bff0d tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ae2ddba1d412e96e40782c6b46337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5493a20eda476e8843381f175baf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:34.551474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9afa040-94a7-4c20-8de1-214d598df5d9 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:34.552146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9afa040-94a7-4c20-8de1-214d598df5d9 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:34.554000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9afa040-94a7-4c20-8de1-214d598df5d9 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:34.555096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9afa040-94a7-4c20-8de1-214d598df5d9 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:34.558538 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6e225c33-351a-4aa1-9e81-d348ed1bff0d tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 200 len: 1225 microversion: 2.1 time: 0.164634 Oct 12 22:17:34.567371 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2442/4340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:34 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 1225 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:34.568275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9afa040-94a7-4c20-8de1-214d598df5d9 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:34.572037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9afa040-94a7-4c20-8de1-214d598df5d9 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:35.070655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c9afa040-94a7-4c20-8de1-214d598df5d9 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:35.080453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-091d4662-9f55-41c7-8b46-8ecfa84b28a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:35.081141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-091d4662-9f55-41c7-8b46-8ecfa84b28a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:35.100237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c9afa040-94a7-4c20-8de1-214d598df5d9 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:35.101733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c9afa040-94a7-4c20-8de1-214d598df5d9 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:35.106211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-091d4662-9f55-41c7-8b46-8ecfa84b28a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:35.112206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-091d4662-9f55-41c7-8b46-8ecfa84b28a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:35.113227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-091d4662-9f55-41c7-8b46-8ecfa84b28a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:35.114706 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c9afa040-94a7-4c20-8de1-214d598df5d9 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1359 microversion: 2.21 time: 0.593723 Oct 12 22:17:35.124457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-091d4662-9f55-41c7-8b46-8ecfa84b28a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:35.125200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-091d4662-9f55-41c7-8b46-8ecfa84b28a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:35.126951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-091d4662-9f55-41c7-8b46-8ecfa84b28a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:35.127675 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1899/4341] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:34 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1359 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:35.250740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-091d4662-9f55-41c7-8b46-8ecfa84b28a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:35.263128 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-091d4662-9f55-41c7-8b46-8ecfa84b28a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1273 microversion: 2.1 time: 0.196629 Oct 12 22:17:35.268264 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2443/4342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:35 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1273 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:17:35.413271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1bc65cd4-e591-4fa0-af03-105f61cff936 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:35.414261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1bc65cd4-e591-4fa0-af03-105f61cff936 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:35.434377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bc65cd4-e591-4fa0-af03-105f61cff936 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:35.434894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bc65cd4-e591-4fa0-af03-105f61cff936 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:35.435369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bc65cd4-e591-4fa0-af03-105f61cff936 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:35.436098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bc65cd4-e591-4fa0-af03-105f61cff936 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:35.436622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bc65cd4-e591-4fa0-af03-105f61cff936 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:35.437148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1bc65cd4-e591-4fa0-af03-105f61cff936 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:35.546625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5ab2949e-adca-419e-bc0c-5ce649b968c9 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:35.547360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5ab2949e-adca-419e-bc0c-5ce649b968c9 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:35.565785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ab2949e-adca-419e-bc0c-5ce649b968c9 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:35.568597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ab2949e-adca-419e-bc0c-5ce649b968c9 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:35.569228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ab2949e-adca-419e-bc0c-5ce649b968c9 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:35.574611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ab2949e-adca-419e-bc0c-5ce649b968c9 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:35.575194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ab2949e-adca-419e-bc0c-5ce649b968c9 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:35.577069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ab2949e-adca-419e-bc0c-5ce649b968c9 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:35.616994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1bc65cd4-e591-4fa0-af03-105f61cff936 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:35.628469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1bc65cd4-e591-4fa0-af03-105f61cff936 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:35.629941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1bc65cd4-e591-4fa0-af03-105f61cff936 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:35.631347 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1bc65cd4-e591-4fa0-af03-105f61cff936 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.222027 Oct 12 22:17:35.631916 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1900/4343] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:35 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:35.647508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ea9fc5dc-88f5-45d3-940b-0572f261fc5f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:35.651090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ea9fc5dc-88f5-45d3-940b-0572f261fc5f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:35.661478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea9fc5dc-88f5-45d3-940b-0572f261fc5f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:35.664515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea9fc5dc-88f5-45d3-940b-0572f261fc5f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:35.665707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea9fc5dc-88f5-45d3-940b-0572f261fc5f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:35.666641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea9fc5dc-88f5-45d3-940b-0572f261fc5f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:35.670039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea9fc5dc-88f5-45d3-940b-0572f261fc5f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:35.670709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea9fc5dc-88f5-45d3-940b-0572f261fc5f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:35.776919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ea9fc5dc-88f5-45d3-940b-0572f261fc5f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ae2ddba1d412e96e40782c6b46337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5493a20eda476e8843381f175baf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:35.790317 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ea9fc5dc-88f5-45d3-940b-0572f261fc5f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 200 len: 1277 microversion: 2.1 time: 0.151027 Oct 12 22:17:35.804558 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1901/4344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:35 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:36.029452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5ab2949e-adca-419e-bc0c-5ce649b968c9 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:36.057690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5ab2949e-adca-419e-bc0c-5ce649b968c9 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:36.067024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5ab2949e-adca-419e-bc0c-5ce649b968c9 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:36.070200 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5ab2949e-adca-419e-bc0c-5ce649b968c9 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.528022 Oct 12 22:17:36.079564 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2444/4345] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:35 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:36.144345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-234b4398-fd9b-451f-bc73-63460d6b3ddf tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:36.145080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-234b4398-fd9b-451f-bc73-63460d6b3ddf tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:36.155315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-234b4398-fd9b-451f-bc73-63460d6b3ddf tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:36.160289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-234b4398-fd9b-451f-bc73-63460d6b3ddf tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:36.160839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-234b4398-fd9b-451f-bc73-63460d6b3ddf tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:36.164073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-234b4398-fd9b-451f-bc73-63460d6b3ddf tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:36.167515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-234b4398-fd9b-451f-bc73-63460d6b3ddf tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:36.169389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-234b4398-fd9b-451f-bc73-63460d6b3ddf tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:36.288804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-df3f417d-c953-4392-87d1-333dca15b004 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:36.290167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-df3f417d-c953-4392-87d1-333dca15b004 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:36.306245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df3f417d-c953-4392-87d1-333dca15b004 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:36.307112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df3f417d-c953-4392-87d1-333dca15b004 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:36.307776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df3f417d-c953-4392-87d1-333dca15b004 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:36.308760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df3f417d-c953-4392-87d1-333dca15b004 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:36.309403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df3f417d-c953-4392-87d1-333dca15b004 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:36.309982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df3f417d-c953-4392-87d1-333dca15b004 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:36.601194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-df3f417d-c953-4392-87d1-333dca15b004 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:36.616894 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-df3f417d-c953-4392-87d1-333dca15b004 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1315 microversion: 2.1 time: 0.332438 Oct 12 22:17:36.634186 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2445/4346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:36 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:36.663413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a0be4a09-43f6-477f-a38b-c8bebf3e2e02 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:36.664215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a0be4a09-43f6-477f-a38b-c8bebf3e2e02 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:36.672578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0be4a09-43f6-477f-a38b-c8bebf3e2e02 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:36.673650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0be4a09-43f6-477f-a38b-c8bebf3e2e02 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:36.674283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0be4a09-43f6-477f-a38b-c8bebf3e2e02 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:36.675158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0be4a09-43f6-477f-a38b-c8bebf3e2e02 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:36.675793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0be4a09-43f6-477f-a38b-c8bebf3e2e02 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:36.676542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0be4a09-43f6-477f-a38b-c8bebf3e2e02 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:36.778630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a0be4a09-43f6-477f-a38b-c8bebf3e2e02 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:36.790516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a0be4a09-43f6-477f-a38b-c8bebf3e2e02 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:36.792290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a0be4a09-43f6-477f-a38b-c8bebf3e2e02 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:36.793652 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a0be4a09-43f6-477f-a38b-c8bebf3e2e02 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.135833 Oct 12 22:17:36.794368 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2446/4347] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:36 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:36.824061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dfdbdee8-8cd1-43e9-a5bd-15add5b4c9eb tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:36.824683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dfdbdee8-8cd1-43e9-a5bd-15add5b4c9eb tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:36.838908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfdbdee8-8cd1-43e9-a5bd-15add5b4c9eb tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:36.841570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfdbdee8-8cd1-43e9-a5bd-15add5b4c9eb tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:36.842844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfdbdee8-8cd1-43e9-a5bd-15add5b4c9eb tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:36.843826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfdbdee8-8cd1-43e9-a5bd-15add5b4c9eb tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:36.845591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfdbdee8-8cd1-43e9-a5bd-15add5b4c9eb tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:36.846899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfdbdee8-8cd1-43e9-a5bd-15add5b4c9eb tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:36.958472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dfdbdee8-8cd1-43e9-a5bd-15add5b4c9eb tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ae2ddba1d412e96e40782c6b46337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5493a20eda476e8843381f175baf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:36.968441 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dfdbdee8-8cd1-43e9-a5bd-15add5b4c9eb tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 200 len: 1283 microversion: 2.1 time: 0.156867 Oct 12 22:17:36.983671 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2447/4348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:36 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 1283 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:37.045635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-234b4398-fd9b-451f-bc73-63460d6b3ddf tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:37.054146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-234b4398-fd9b-451f-bc73-63460d6b3ddf tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:37.056499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-234b4398-fd9b-451f-bc73-63460d6b3ddf tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:37.057636 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-234b4398-fd9b-451f-bc73-63460d6b3ddf tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1359 microversion: 2.21 time: 0.918102 Oct 12 22:17:37.075660 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1902/4349] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:36 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1359 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:37.101680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aa4a79a1-660c-4a97-8ba3-1e60da86b6bb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:37.102346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aa4a79a1-660c-4a97-8ba3-1e60da86b6bb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:37.109643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa4a79a1-660c-4a97-8ba3-1e60da86b6bb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:37.110143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa4a79a1-660c-4a97-8ba3-1e60da86b6bb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:37.110753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa4a79a1-660c-4a97-8ba3-1e60da86b6bb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:37.111892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa4a79a1-660c-4a97-8ba3-1e60da86b6bb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:37.113056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa4a79a1-660c-4a97-8ba3-1e60da86b6bb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:37.113529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa4a79a1-660c-4a97-8ba3-1e60da86b6bb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:37.460078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aa4a79a1-660c-4a97-8ba3-1e60da86b6bb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:37.490281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aa4a79a1-660c-4a97-8ba3-1e60da86b6bb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:37.494575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aa4a79a1-660c-4a97-8ba3-1e60da86b6bb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:37.496596 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aa4a79a1-660c-4a97-8ba3-1e60da86b6bb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.399240 Oct 12 22:17:37.503958 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2448/4350] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:37 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:37.648798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bd3a5c9d-c262-4aca-a8cd-2ec17881ca62 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:37.652484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bd3a5c9d-c262-4aca-a8cd-2ec17881ca62 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:37.673895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd3a5c9d-c262-4aca-a8cd-2ec17881ca62 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:37.674972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd3a5c9d-c262-4aca-a8cd-2ec17881ca62 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:37.678534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd3a5c9d-c262-4aca-a8cd-2ec17881ca62 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:37.684227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd3a5c9d-c262-4aca-a8cd-2ec17881ca62 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:37.687344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd3a5c9d-c262-4aca-a8cd-2ec17881ca62 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:37.688041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd3a5c9d-c262-4aca-a8cd-2ec17881ca62 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:37.821771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48b39dab-2878-4038-9751-d8c622b2ebe3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:37.822600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-48b39dab-2878-4038-9751-d8c622b2ebe3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:37.833693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b39dab-2878-4038-9751-d8c622b2ebe3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:37.834545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b39dab-2878-4038-9751-d8c622b2ebe3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:37.835276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b39dab-2878-4038-9751-d8c622b2ebe3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:37.836227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b39dab-2878-4038-9751-d8c622b2ebe3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:37.837711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b39dab-2878-4038-9751-d8c622b2ebe3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:37.843736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b39dab-2878-4038-9751-d8c622b2ebe3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:38.013867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-48b39dab-2878-4038-9751-d8c622b2ebe3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:38.016542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd3a5c9d-c262-4aca-a8cd-2ec17881ca62 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:38.020823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:38.031584 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bd3a5c9d-c262-4aca-a8cd-2ec17881ca62 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1315 microversion: 2.1 time: 0.390329 Oct 12 22:17:38.032436 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1903/4351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:37 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:38.045514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-48b39dab-2878-4038-9751-d8c622b2ebe3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:38.048056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-48b39dab-2878-4038-9751-d8c622b2ebe3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:38.052204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4498c366-ff5d-4dc8-be32-4f11c5dbf39c tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:38.053961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4498c366-ff5d-4dc8-be32-4f11c5dbf39c tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:38.056852 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-48b39dab-2878-4038-9751-d8c622b2ebe3 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.238002 Oct 12 22:17:38.059152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:38.059579 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2449/4352] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:37 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:38.075148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4498c366-ff5d-4dc8-be32-4f11c5dbf39c tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:38.075913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4498c366-ff5d-4dc8-be32-4f11c5dbf39c tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:38.076513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4498c366-ff5d-4dc8-be32-4f11c5dbf39c tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:38.077754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4498c366-ff5d-4dc8-be32-4f11c5dbf39c tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:38.078408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4498c366-ff5d-4dc8-be32-4f11c5dbf39c tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:38.078984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4498c366-ff5d-4dc8-be32-4f11c5dbf39c tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:38.083953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cf8dd73e-9b59-4f17-940b-89f866cf6637 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:38.085197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cf8dd73e-9b59-4f17-940b-89f866cf6637 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:38.092641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf8dd73e-9b59-4f17-940b-89f866cf6637 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:38.093291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf8dd73e-9b59-4f17-940b-89f866cf6637 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:38.093867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf8dd73e-9b59-4f17-940b-89f866cf6637 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:38.094890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf8dd73e-9b59-4f17-940b-89f866cf6637 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:38.095511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf8dd73e-9b59-4f17-940b-89f866cf6637 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:38.096300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf8dd73e-9b59-4f17-940b-89f866cf6637 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:38.477710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cf8dd73e-9b59-4f17-940b-89f866cf6637 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:38.486917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cf8dd73e-9b59-4f17-940b-89f866cf6637 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:38.488827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cf8dd73e-9b59-4f17-940b-89f866cf6637 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:38.490932 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cf8dd73e-9b59-4f17-940b-89f866cf6637 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1359 microversion: 2.21 time: 0.410644 Oct 12 22:17:38.491749 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2450/4353] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:38 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1359 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:17:38.496642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f879345c-4113-429e-bdbc-5c8611463cf7 req-fb9e3cf3-5832-4da7-b68a-f8effdeeaec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642", "tag": "8e2b35e6-0fa9-488d-886e-79503ed3c9fb"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:38.512435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f879345c-4113-429e-bdbc-5c8611463cf7 req-fb9e3cf3-5832-4da7-b68a-f8effdeeaec0 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:38.522725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f879345c-4113-429e-bdbc-5c8611463cf7 req-fb9e3cf3-5832-4da7-b68a-f8effdeeaec0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:38.528324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f879345c-4113-429e-bdbc-5c8611463cf7 req-fb9e3cf3-5832-4da7-b68a-f8effdeeaec0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:38.547340 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f879345c-4113-429e-bdbc-5c8611463cf7 req-fb9e3cf3-5832-4da7-b68a-f8effdeeaec0 service nova] Creating event network-changed:8e2b35e6-0fa9-488d-886e-79503ed3c9fb for instance e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 on n-h1-861111-1 Oct 12 22:17:38.558738 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f879345c-4113-429e-bdbc-5c8611463cf7 req-fb9e3cf3-5832-4da7-b68a-f8effdeeaec0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064647 Oct 12 22:17:38.560049 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2451/4354] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:17:38.569465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4498c366-ff5d-4dc8-be32-4f11c5dbf39c tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ae2ddba1d412e96e40782c6b46337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5493a20eda476e8843381f175baf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:38.582036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d4c6fc63-7b82-4f93-89f4-c76f94616ec7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:38.582961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d4c6fc63-7b82-4f93-89f4-c76f94616ec7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:38.589741 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4498c366-ff5d-4dc8-be32-4f11c5dbf39c tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 200 len: 1325 microversion: 2.1 time: 0.554346 Oct 12 22:17:38.590692 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1904/4355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:38 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 1325 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:38.608018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4c6fc63-7b82-4f93-89f4-c76f94616ec7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:38.608532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4c6fc63-7b82-4f93-89f4-c76f94616ec7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:38.608980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4c6fc63-7b82-4f93-89f4-c76f94616ec7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:38.609711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4c6fc63-7b82-4f93-89f4-c76f94616ec7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:38.610172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4c6fc63-7b82-4f93-89f4-c76f94616ec7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:38.610613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4c6fc63-7b82-4f93-89f4-c76f94616ec7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:39.000591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d4c6fc63-7b82-4f93-89f4-c76f94616ec7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:39.018594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d4c6fc63-7b82-4f93-89f4-c76f94616ec7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:39.020466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d4c6fc63-7b82-4f93-89f4-c76f94616ec7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:39.021902 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d4c6fc63-7b82-4f93-89f4-c76f94616ec7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.460477 Oct 12 22:17:39.026786 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2452/4356] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:38 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:39.062005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6d81a53a-0069-4480-9aba-fb25ca62ee0f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:39.062815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6d81a53a-0069-4480-9aba-fb25ca62ee0f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:39.073333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d81a53a-0069-4480-9aba-fb25ca62ee0f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:39.078821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d81a53a-0069-4480-9aba-fb25ca62ee0f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:39.079483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d81a53a-0069-4480-9aba-fb25ca62ee0f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:39.081527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d81a53a-0069-4480-9aba-fb25ca62ee0f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:39.082123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d81a53a-0069-4480-9aba-fb25ca62ee0f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:39.083741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d81a53a-0069-4480-9aba-fb25ca62ee0f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:39.085729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-69544a4c-93bb-40bd-a863-9cad4395318f tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:39.087318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-69544a4c-93bb-40bd-a863-9cad4395318f tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:39.107050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69544a4c-93bb-40bd-a863-9cad4395318f tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:39.107875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69544a4c-93bb-40bd-a863-9cad4395318f tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:39.108502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69544a4c-93bb-40bd-a863-9cad4395318f tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:39.109844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69544a4c-93bb-40bd-a863-9cad4395318f tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:39.111207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69544a4c-93bb-40bd-a863-9cad4395318f tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:39.112998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69544a4c-93bb-40bd-a863-9cad4395318f tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:39.249696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-69544a4c-93bb-40bd-a863-9cad4395318f tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:39.258133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-69544a4c-93bb-40bd-a863-9cad4395318f tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:39.260146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-69544a4c-93bb-40bd-a863-9cad4395318f tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:39.261499 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-69544a4c-93bb-40bd-a863-9cad4395318f tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.181271 Oct 12 22:17:39.267704 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2453/4357] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:39 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:17:39.383815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6d81a53a-0069-4480-9aba-fb25ca62ee0f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:39.397156 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6d81a53a-0069-4480-9aba-fb25ca62ee0f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1315 microversion: 2.1 time: 0.339134 Oct 12 22:17:39.413885 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1905/4358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:39 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:39.521625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-58ae3683-f1c0-4bb3-b8cd-cd085e7c80c1 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:39.522596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-58ae3683-f1c0-4bb3-b8cd-cd085e7c80c1 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:39.546596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58ae3683-f1c0-4bb3-b8cd-cd085e7c80c1 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:39.547604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58ae3683-f1c0-4bb3-b8cd-cd085e7c80c1 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:39.548511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58ae3683-f1c0-4bb3-b8cd-cd085e7c80c1 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:39.551522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58ae3683-f1c0-4bb3-b8cd-cd085e7c80c1 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:39.552214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58ae3683-f1c0-4bb3-b8cd-cd085e7c80c1 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:39.553908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58ae3683-f1c0-4bb3-b8cd-cd085e7c80c1 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:39.614669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-efcd0e64-8697-42f7-abe3-ac36bebf2c50 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:39.615593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-efcd0e64-8697-42f7-abe3-ac36bebf2c50 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:39.623529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efcd0e64-8697-42f7-abe3-ac36bebf2c50 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:39.624281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efcd0e64-8697-42f7-abe3-ac36bebf2c50 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:39.624891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efcd0e64-8697-42f7-abe3-ac36bebf2c50 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:39.625769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efcd0e64-8697-42f7-abe3-ac36bebf2c50 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:39.626381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efcd0e64-8697-42f7-abe3-ac36bebf2c50 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:39.627144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efcd0e64-8697-42f7-abe3-ac36bebf2c50 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:39.848781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-58ae3683-f1c0-4bb3-b8cd-cd085e7c80c1 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:39.860602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-58ae3683-f1c0-4bb3-b8cd-cd085e7c80c1 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:39.865548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-58ae3683-f1c0-4bb3-b8cd-cd085e7c80c1 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:39.867146 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-58ae3683-f1c0-4bb3-b8cd-cd085e7c80c1 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1359 microversion: 2.21 time: 0.353419 Oct 12 22:17:39.869215 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2454/4359] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:39 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1359 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:39.965731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-efcd0e64-8697-42f7-abe3-ac36bebf2c50 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ae2ddba1d412e96e40782c6b46337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5493a20eda476e8843381f175baf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:39.976361 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-efcd0e64-8697-42f7-abe3-ac36bebf2c50 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 200 len: 1325 microversion: 2.1 time: 0.364089 Oct 12 22:17:39.995613 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1906/4360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:39 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 1325 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:40.053892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9b81db4e-ed60-4d21-aa60-e7cbb187d3d7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:40.054654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9b81db4e-ed60-4d21-aa60-e7cbb187d3d7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:40.061561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b81db4e-ed60-4d21-aa60-e7cbb187d3d7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:40.062688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b81db4e-ed60-4d21-aa60-e7cbb187d3d7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:40.063274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b81db4e-ed60-4d21-aa60-e7cbb187d3d7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:40.064056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b81db4e-ed60-4d21-aa60-e7cbb187d3d7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:40.064583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b81db4e-ed60-4d21-aa60-e7cbb187d3d7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:40.065084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b81db4e-ed60-4d21-aa60-e7cbb187d3d7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:40.289996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c0abf1f7-832f-4231-af6c-397cbbac2950 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:40.290717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c0abf1f7-832f-4231-af6c-397cbbac2950 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:40.297762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0abf1f7-832f-4231-af6c-397cbbac2950 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:40.298253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0abf1f7-832f-4231-af6c-397cbbac2950 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:40.298704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0abf1f7-832f-4231-af6c-397cbbac2950 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:40.299821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0abf1f7-832f-4231-af6c-397cbbac2950 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:40.300459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0abf1f7-832f-4231-af6c-397cbbac2950 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:40.300890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0abf1f7-832f-4231-af6c-397cbbac2950 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:40.377249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9b81db4e-ed60-4d21-aa60-e7cbb187d3d7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:40.394300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9b81db4e-ed60-4d21-aa60-e7cbb187d3d7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:40.399222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9b81db4e-ed60-4d21-aa60-e7cbb187d3d7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:40.400540 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9b81db4e-ed60-4d21-aa60-e7cbb187d3d7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.351467 Oct 12 22:17:40.425256 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2455/4361] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:40 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:40.463009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7f7be1ba-8c8e-4ed3-8009-dfed67faa137 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:40.463769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c0abf1f7-832f-4231-af6c-397cbbac2950 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:40.464506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7f7be1ba-8c8e-4ed3-8009-dfed67faa137 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:40.473050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c0abf1f7-832f-4231-af6c-397cbbac2950 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:40.474788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c0abf1f7-832f-4231-af6c-397cbbac2950 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:40.476290 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c0abf1f7-832f-4231-af6c-397cbbac2950 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.191271 Oct 12 22:17:40.476941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f7be1ba-8c8e-4ed3-8009-dfed67faa137 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:40.477304 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1907/4362] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:40 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:40.495347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f7be1ba-8c8e-4ed3-8009-dfed67faa137 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:40.495831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f7be1ba-8c8e-4ed3-8009-dfed67faa137 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:40.497907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f7be1ba-8c8e-4ed3-8009-dfed67faa137 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:40.501351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f7be1ba-8c8e-4ed3-8009-dfed67faa137 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:40.501727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f7be1ba-8c8e-4ed3-8009-dfed67faa137 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:40.577993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-829094dc-34dd-412c-97cc-8f3fdfe592cb req-f13cd84a-14c0-4c7f-b87a-86ef3cabffd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93c312a-dce8-4a49-9942-515527b3103f", "tag": "60debe36-34ee-4c09-8e82-1896cb229077"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:40.590122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-829094dc-34dd-412c-97cc-8f3fdfe592cb req-f13cd84a-14c0-4c7f-b87a-86ef3cabffd9 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:40.590775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-829094dc-34dd-412c-97cc-8f3fdfe592cb req-f13cd84a-14c0-4c7f-b87a-86ef3cabffd9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:40.591423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-829094dc-34dd-412c-97cc-8f3fdfe592cb req-f13cd84a-14c0-4c7f-b87a-86ef3cabffd9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:40.603820 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-829094dc-34dd-412c-97cc-8f3fdfe592cb req-f13cd84a-14c0-4c7f-b87a-86ef3cabffd9 service nova] Creating event network-changed:60debe36-34ee-4c09-8e82-1896cb229077 for instance d93c312a-dce8-4a49-9942-515527b3103f on n-h1-861111-1 Oct 12 22:17:40.609522 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-829094dc-34dd-412c-97cc-8f3fdfe592cb req-f13cd84a-14c0-4c7f-b87a-86ef3cabffd9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035707 Oct 12 22:17:40.610317 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1908/4363] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:17:40.788716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7f7be1ba-8c8e-4ed3-8009-dfed67faa137 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:40.797679 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7f7be1ba-8c8e-4ed3-8009-dfed67faa137 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1315 microversion: 2.1 time: 0.353923 Oct 12 22:17:40.798518 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2456/4364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:40 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:40.896990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7daeeaf2-6e7f-41da-88f8-af4a49789aed tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:40.897699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7daeeaf2-6e7f-41da-88f8-af4a49789aed tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:40.911554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7daeeaf2-6e7f-41da-88f8-af4a49789aed tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:40.912289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7daeeaf2-6e7f-41da-88f8-af4a49789aed tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:40.913940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7daeeaf2-6e7f-41da-88f8-af4a49789aed tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:40.914959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7daeeaf2-6e7f-41da-88f8-af4a49789aed tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:40.915926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7daeeaf2-6e7f-41da-88f8-af4a49789aed tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:40.917351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7daeeaf2-6e7f-41da-88f8-af4a49789aed tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:41.005127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-80abff85-70b3-4b21-9e26-a12647460d39 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:41.007339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-80abff85-70b3-4b21-9e26-a12647460d39 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:41.020060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80abff85-70b3-4b21-9e26-a12647460d39 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:41.021560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80abff85-70b3-4b21-9e26-a12647460d39 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:41.022524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80abff85-70b3-4b21-9e26-a12647460d39 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:41.024265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80abff85-70b3-4b21-9e26-a12647460d39 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:41.027480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80abff85-70b3-4b21-9e26-a12647460d39 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:41.028146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80abff85-70b3-4b21-9e26-a12647460d39 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:41.047645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:41.254823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7daeeaf2-6e7f-41da-88f8-af4a49789aed tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:41.272649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7daeeaf2-6e7f-41da-88f8-af4a49789aed tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:41.274540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7daeeaf2-6e7f-41da-88f8-af4a49789aed tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:41.275851 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7daeeaf2-6e7f-41da-88f8-af4a49789aed tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1359 microversion: 2.21 time: 0.383083 Oct 12 22:17:41.276821 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1909/4365] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:40 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1359 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:41.433451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1e48f9ce-aba9-418a-b747-8ce6aef2b830 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:41.434095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1e48f9ce-aba9-418a-b747-8ce6aef2b830 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:41.440728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e48f9ce-aba9-418a-b747-8ce6aef2b830 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:41.441223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e48f9ce-aba9-418a-b747-8ce6aef2b830 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:41.441664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e48f9ce-aba9-418a-b747-8ce6aef2b830 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:41.442370 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e48f9ce-aba9-418a-b747-8ce6aef2b830 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:41.442846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e48f9ce-aba9-418a-b747-8ce6aef2b830 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:41.443274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e48f9ce-aba9-418a-b747-8ce6aef2b830 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:41.621005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-80abff85-70b3-4b21-9e26-a12647460d39 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ae2ddba1d412e96e40782c6b46337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5493a20eda476e8843381f175baf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:41.633931 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-80abff85-70b3-4b21-9e26-a12647460d39 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 200 len: 1325 microversion: 2.1 time: 0.637511 Oct 12 22:17:41.647700 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2457/4366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:40 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 1325 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:17:41.659670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b0b577c-2957-436f-b889-d3ebdcfd85f2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:41.660535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8b0b577c-2957-436f-b889-d3ebdcfd85f2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:41.676202 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1e48f9ce-aba9-418a-b747-8ce6aef2b830 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:41.678785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b0b577c-2957-436f-b889-d3ebdcfd85f2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:41.679519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b0b577c-2957-436f-b889-d3ebdcfd85f2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:41.680688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b0b577c-2957-436f-b889-d3ebdcfd85f2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:41.681602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b0b577c-2957-436f-b889-d3ebdcfd85f2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:41.682212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b0b577c-2957-436f-b889-d3ebdcfd85f2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:41.682780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b0b577c-2957-436f-b889-d3ebdcfd85f2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:41.691664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1e48f9ce-aba9-418a-b747-8ce6aef2b830 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:41.693503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1e48f9ce-aba9-418a-b747-8ce6aef2b830 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:41.695656 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1e48f9ce-aba9-418a-b747-8ce6aef2b830 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.266804 Oct 12 22:17:41.696769 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1910/4367] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:41 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:17:41.785317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b0b577c-2957-436f-b889-d3ebdcfd85f2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:41.798263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b0b577c-2957-436f-b889-d3ebdcfd85f2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:41.800280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b0b577c-2957-436f-b889-d3ebdcfd85f2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:41.802057 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8b0b577c-2957-436f-b889-d3ebdcfd85f2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.153237 Oct 12 22:17:41.803196 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2458/4368] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:41 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:41.832512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-25849b71-5481-4f53-8736-a483f5a5c7fc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:41.833899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-25849b71-5481-4f53-8736-a483f5a5c7fc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:41.842203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25849b71-5481-4f53-8736-a483f5a5c7fc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:41.842984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25849b71-5481-4f53-8736-a483f5a5c7fc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:41.843595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25849b71-5481-4f53-8736-a483f5a5c7fc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:41.844299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25849b71-5481-4f53-8736-a483f5a5c7fc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:41.845174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25849b71-5481-4f53-8736-a483f5a5c7fc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:41.845747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25849b71-5481-4f53-8736-a483f5a5c7fc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:42.013354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-25849b71-5481-4f53-8736-a483f5a5c7fc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:42.022374 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-25849b71-5481-4f53-8736-a483f5a5c7fc tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1315 microversion: 2.1 time: 0.197759 Oct 12 22:17:42.023657 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1911/4369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:41 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:42.302855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9283bf64-1ce2-4013-b721-7c75926716ac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:42.303823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9283bf64-1ce2-4013-b721-7c75926716ac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:42.311294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9283bf64-1ce2-4013-b721-7c75926716ac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:42.312223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9283bf64-1ce2-4013-b721-7c75926716ac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:42.312669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9283bf64-1ce2-4013-b721-7c75926716ac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:42.313376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9283bf64-1ce2-4013-b721-7c75926716ac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:42.313824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9283bf64-1ce2-4013-b721-7c75926716ac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:42.314405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9283bf64-1ce2-4013-b721-7c75926716ac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:42.615403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9283bf64-1ce2-4013-b721-7c75926716ac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:42.629926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9283bf64-1ce2-4013-b721-7c75926716ac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:42.631417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9283bf64-1ce2-4013-b721-7c75926716ac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:42.634297 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9283bf64-1ce2-4013-b721-7c75926716ac tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1359 microversion: 2.21 time: 0.335320 Oct 12 22:17:42.635061 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2459/4370] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:42 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1359 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:17:42.660871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c5aaddd1-9bfe-4f8f-a4de-0f4397d94e96 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:42.661648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c5aaddd1-9bfe-4f8f-a4de-0f4397d94e96 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:42.669335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:42.674054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5aaddd1-9bfe-4f8f-a4de-0f4397d94e96 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:42.675072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5aaddd1-9bfe-4f8f-a4de-0f4397d94e96 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:42.675212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5aaddd1-9bfe-4f8f-a4de-0f4397d94e96 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:42.680513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5aaddd1-9bfe-4f8f-a4de-0f4397d94e96 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:42.681487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5aaddd1-9bfe-4f8f-a4de-0f4397d94e96 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:42.682139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5aaddd1-9bfe-4f8f-a4de-0f4397d94e96 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:42.726119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eb0e7d70-4d7f-4c78-8c9a-d5ebb30c02df tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:42.726830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eb0e7d70-4d7f-4c78-8c9a-d5ebb30c02df tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:42.739655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb0e7d70-4d7f-4c78-8c9a-d5ebb30c02df tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:42.743280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb0e7d70-4d7f-4c78-8c9a-d5ebb30c02df tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:42.744147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb0e7d70-4d7f-4c78-8c9a-d5ebb30c02df tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:42.745456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb0e7d70-4d7f-4c78-8c9a-d5ebb30c02df tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:42.747398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb0e7d70-4d7f-4c78-8c9a-d5ebb30c02df tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:42.748161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb0e7d70-4d7f-4c78-8c9a-d5ebb30c02df tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:43.111669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eb0e7d70-4d7f-4c78-8c9a-d5ebb30c02df tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:43.122857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eb0e7d70-4d7f-4c78-8c9a-d5ebb30c02df tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:43.124756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eb0e7d70-4d7f-4c78-8c9a-d5ebb30c02df tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:43.126221 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eb0e7d70-4d7f-4c78-8c9a-d5ebb30c02df tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.405298 Oct 12 22:17:43.145435 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2460/4371] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:42 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:17:43.153439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-909aee36-bece-432c-91c6-837bfd668249 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:43.154426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-909aee36-bece-432c-91c6-837bfd668249 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:43.161327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:43.164970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-909aee36-bece-432c-91c6-837bfd668249 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:43.165967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-909aee36-bece-432c-91c6-837bfd668249 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:43.166764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-909aee36-bece-432c-91c6-837bfd668249 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:43.167996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-909aee36-bece-432c-91c6-837bfd668249 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:43.169427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-909aee36-bece-432c-91c6-837bfd668249 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:43.170165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-909aee36-bece-432c-91c6-837bfd668249 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:43.195770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c5aaddd1-9bfe-4f8f-a4de-0f4397d94e96 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ae2ddba1d412e96e40782c6b46337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5493a20eda476e8843381f175baf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:43.203527 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c5aaddd1-9bfe-4f8f-a4de-0f4397d94e96 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 200 len: 1325 microversion: 2.1 time: 0.546821 Oct 12 22:17:43.204123 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1912/4372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:42 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 1325 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:43.223407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ceec3413-f764-49eb-b51f-1c783f872b35 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:43.224337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ceec3413-f764-49eb-b51f-1c783f872b35 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:43.231395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceec3413-f764-49eb-b51f-1c783f872b35 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:43.232250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceec3413-f764-49eb-b51f-1c783f872b35 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:43.232946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceec3413-f764-49eb-b51f-1c783f872b35 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:43.233877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceec3413-f764-49eb-b51f-1c783f872b35 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:43.234557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceec3413-f764-49eb-b51f-1c783f872b35 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:43.235199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceec3413-f764-49eb-b51f-1c783f872b35 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:43.327751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-909aee36-bece-432c-91c6-837bfd668249 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:43.337600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-909aee36-bece-432c-91c6-837bfd668249 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:43.339077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-909aee36-bece-432c-91c6-837bfd668249 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:43.340325 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-909aee36-bece-432c-91c6-837bfd668249 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.193518 Oct 12 22:17:43.372203 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2461/4373] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:43 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:43.467756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ceec3413-f764-49eb-b51f-1c783f872b35 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:43.488071 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ceec3413-f764-49eb-b51f-1c783f872b35 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1315 microversion: 2.1 time: 0.267964 Oct 12 22:17:43.497885 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1913/4374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:43 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:43.607510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-b5909036-667d-4b13-a273-3c3172322807 req-0c146a62-9568-49e7-aa9f-32dc1fdbc2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "name": "network-vif-plugged", "status": "completed", "tag": "a21af4ca-546d-4eb8-a73d-42ffccc0349b"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:43.613001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=8 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:43.620668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b5909036-667d-4b13-a273-3c3172322807 req-0c146a62-9568-49e7-aa9f-32dc1fdbc2ef service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:43.621084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b5909036-667d-4b13-a273-3c3172322807 req-0c146a62-9568-49e7-aa9f-32dc1fdbc2ef service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:43.621522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b5909036-667d-4b13-a273-3c3172322807 req-0c146a62-9568-49e7-aa9f-32dc1fdbc2ef service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:43.641420 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-b5909036-667d-4b13-a273-3c3172322807 req-0c146a62-9568-49e7-aa9f-32dc1fdbc2ef service nova] Creating event network-vif-plugged:a21af4ca-546d-4eb8-a73d-42ffccc0349b for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:17:43.649545 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-b5909036-667d-4b13-a273-3c3172322807 req-0c146a62-9568-49e7-aa9f-32dc1fdbc2ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050144 Oct 12 22:17:43.650761 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2462/4375] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:17:43.662913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-52718bb3-6bb6-4002-8c7b-d333cf77d1b2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:43.663371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-52718bb3-6bb6-4002-8c7b-d333cf77d1b2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:43.673405 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52718bb3-6bb6-4002-8c7b-d333cf77d1b2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:43.673901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52718bb3-6bb6-4002-8c7b-d333cf77d1b2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:43.674343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52718bb3-6bb6-4002-8c7b-d333cf77d1b2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:43.675052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52718bb3-6bb6-4002-8c7b-d333cf77d1b2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:43.675543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52718bb3-6bb6-4002-8c7b-d333cf77d1b2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:43.675970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52718bb3-6bb6-4002-8c7b-d333cf77d1b2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:43.927224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-52718bb3-6bb6-4002-8c7b-d333cf77d1b2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:43.937434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-52718bb3-6bb6-4002-8c7b-d333cf77d1b2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:43.939122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-52718bb3-6bb6-4002-8c7b-d333cf77d1b2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:43.940324 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-52718bb3-6bb6-4002-8c7b-d333cf77d1b2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1359 microversion: 2.21 time: 0.283489 Oct 12 22:17:43.940896 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1914/4376] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:43 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1359 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:44.160089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0ba1b5b2-a368-4c9b-abd6-85efbc6ebb21 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:44.161041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0ba1b5b2-a368-4c9b-abd6-85efbc6ebb21 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:44.167848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ba1b5b2-a368-4c9b-abd6-85efbc6ebb21 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:44.168337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ba1b5b2-a368-4c9b-abd6-85efbc6ebb21 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:44.168772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ba1b5b2-a368-4c9b-abd6-85efbc6ebb21 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:44.169649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ba1b5b2-a368-4c9b-abd6-85efbc6ebb21 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:44.170096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ba1b5b2-a368-4c9b-abd6-85efbc6ebb21 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:44.170524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ba1b5b2-a368-4c9b-abd6-85efbc6ebb21 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:44.226069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c82a1276-798d-46ec-a2cb-6d62cd6d9ab4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:44.226596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c82a1276-798d-46ec-a2cb-6d62cd6d9ab4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:44.234575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c82a1276-798d-46ec-a2cb-6d62cd6d9ab4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:44.235259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c82a1276-798d-46ec-a2cb-6d62cd6d9ab4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:44.235854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c82a1276-798d-46ec-a2cb-6d62cd6d9ab4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:44.237174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c82a1276-798d-46ec-a2cb-6d62cd6d9ab4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:44.237935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c82a1276-798d-46ec-a2cb-6d62cd6d9ab4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:44.238560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c82a1276-798d-46ec-a2cb-6d62cd6d9ab4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:44.386214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0ba1b5b2-a368-4c9b-abd6-85efbc6ebb21 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:44.395858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0ba1b5b2-a368-4c9b-abd6-85efbc6ebb21 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:44.398062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0ba1b5b2-a368-4c9b-abd6-85efbc6ebb21 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:44.399231 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0ba1b5b2-a368-4c9b-abd6-85efbc6ebb21 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.243636 Oct 12 22:17:44.400122 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2463/4377] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:44 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:44.424187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c60062a3-3a13-4fa7-a74d-e504c1508d6d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:44.424882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c60062a3-3a13-4fa7-a74d-e504c1508d6d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:44.431915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c60062a3-3a13-4fa7-a74d-e504c1508d6d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:44.432565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c60062a3-3a13-4fa7-a74d-e504c1508d6d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:44.433179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c60062a3-3a13-4fa7-a74d-e504c1508d6d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:44.434078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c60062a3-3a13-4fa7-a74d-e504c1508d6d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:44.434760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c60062a3-3a13-4fa7-a74d-e504c1508d6d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:44.435361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c60062a3-3a13-4fa7-a74d-e504c1508d6d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:44.494040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c82a1276-798d-46ec-a2cb-6d62cd6d9ab4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ae2ddba1d412e96e40782c6b46337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5493a20eda476e8843381f175baf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:44.507094 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c82a1276-798d-46ec-a2cb-6d62cd6d9ab4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 200 len: 1325 microversion: 2.1 time: 0.283455 Oct 12 22:17:44.523018 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1915/4378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:44 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 1325 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:44.523018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-81774664-8706-48ec-a0af-f5a4adea65a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:44.523018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-81774664-8706-48ec-a0af-f5a4adea65a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:44.528787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c60062a3-3a13-4fa7-a74d-e504c1508d6d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:44.531424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81774664-8706-48ec-a0af-f5a4adea65a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:44.531958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81774664-8706-48ec-a0af-f5a4adea65a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:44.532431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81774664-8706-48ec-a0af-f5a4adea65a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:44.533153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81774664-8706-48ec-a0af-f5a4adea65a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:44.533621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81774664-8706-48ec-a0af-f5a4adea65a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:44.534067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81774664-8706-48ec-a0af-f5a4adea65a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:44.541723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c60062a3-3a13-4fa7-a74d-e504c1508d6d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:44.544005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c60062a3-3a13-4fa7-a74d-e504c1508d6d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:44.548130 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c60062a3-3a13-4fa7-a74d-e504c1508d6d tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.127967 Oct 12 22:17:44.567025 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2464/4379] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:44 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:44.790918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-81774664-8706-48ec-a0af-f5a4adea65a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:44.799947 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-81774664-8706-48ec-a0af-f5a4adea65a5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1315 microversion: 2.1 time: 0.285589 Oct 12 22:17:44.801006 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1916/4380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:44 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:44.967005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-59cbb916-c27c-4a1e-af5c-93fbe8854886 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:44.968445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-59cbb916-c27c-4a1e-af5c-93fbe8854886 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:44.970462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=26 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:44.978539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59cbb916-c27c-4a1e-af5c-93fbe8854886 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:44.979037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59cbb916-c27c-4a1e-af5c-93fbe8854886 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:44.979508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59cbb916-c27c-4a1e-af5c-93fbe8854886 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:44.980224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59cbb916-c27c-4a1e-af5c-93fbe8854886 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:44.980747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59cbb916-c27c-4a1e-af5c-93fbe8854886 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:44.981346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59cbb916-c27c-4a1e-af5c-93fbe8854886 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:45.124307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-59cbb916-c27c-4a1e-af5c-93fbe8854886 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:45.133112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-59cbb916-c27c-4a1e-af5c-93fbe8854886 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:45.134862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-59cbb916-c27c-4a1e-af5c-93fbe8854886 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:45.136032 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-59cbb916-c27c-4a1e-af5c-93fbe8854886 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1359 microversion: 2.21 time: 0.173362 Oct 12 22:17:45.137058 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2465/4381] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:44 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:45.427598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b00e38b2-22ff-4be3-8fd5-501341bdcb92 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:45.428462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b00e38b2-22ff-4be3-8fd5-501341bdcb92 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:45.451185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b00e38b2-22ff-4be3-8fd5-501341bdcb92 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:45.451835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b00e38b2-22ff-4be3-8fd5-501341bdcb92 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:45.452797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b00e38b2-22ff-4be3-8fd5-501341bdcb92 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:45.456970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b00e38b2-22ff-4be3-8fd5-501341bdcb92 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:45.457475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b00e38b2-22ff-4be3-8fd5-501341bdcb92 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:45.458050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b00e38b2-22ff-4be3-8fd5-501341bdcb92 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:45.535466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0a8004e1-bae2-40a7-8d06-e09a296a4c33 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:45.536439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0a8004e1-bae2-40a7-8d06-e09a296a4c33 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:45.543830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a8004e1-bae2-40a7-8d06-e09a296a4c33 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:45.544476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a8004e1-bae2-40a7-8d06-e09a296a4c33 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:45.545159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a8004e1-bae2-40a7-8d06-e09a296a4c33 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:45.545992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a8004e1-bae2-40a7-8d06-e09a296a4c33 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:45.546547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a8004e1-bae2-40a7-8d06-e09a296a4c33 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:45.547073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a8004e1-bae2-40a7-8d06-e09a296a4c33 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:45.713432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0a8004e1-bae2-40a7-8d06-e09a296a4c33 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ae2ddba1d412e96e40782c6b46337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5493a20eda476e8843381f175baf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:45.722164 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0a8004e1-bae2-40a7-8d06-e09a296a4c33 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 200 len: 1325 microversion: 2.1 time: 0.195145 Oct 12 22:17:45.723273 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2466/4382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:45 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 1325 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:17:45.728665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ad6675ed-24ac-49bc-8f82-23c72c6351d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:45.729446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ad6675ed-24ac-49bc-8f82-23c72c6351d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:45.735369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad6675ed-24ac-49bc-8f82-23c72c6351d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:45.735957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad6675ed-24ac-49bc-8f82-23c72c6351d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:45.736396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad6675ed-24ac-49bc-8f82-23c72c6351d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:45.737355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad6675ed-24ac-49bc-8f82-23c72c6351d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:45.737814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad6675ed-24ac-49bc-8f82-23c72c6351d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:45.738249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad6675ed-24ac-49bc-8f82-23c72c6351d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:45.808968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b00e38b2-22ff-4be3-8fd5-501341bdcb92 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:45.815609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ad6675ed-24ac-49bc-8f82-23c72c6351d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:45.825153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ad6675ed-24ac-49bc-8f82-23c72c6351d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:45.826988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ad6675ed-24ac-49bc-8f82-23c72c6351d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:45.827464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b00e38b2-22ff-4be3-8fd5-501341bdcb92 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:45.828451 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ad6675ed-24ac-49bc-8f82-23c72c6351d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.104026 Oct 12 22:17:45.829270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b00e38b2-22ff-4be3-8fd5-501341bdcb92 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:45.829389 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2467/4383] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:45 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:45.830794 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b00e38b2-22ff-4be3-8fd5-501341bdcb92 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.408782 Oct 12 22:17:45.831799 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1917/4384] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:45 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:45.837881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6c79e565-3c97-4470-9537-b9153f7c9747 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:45.838484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6c79e565-3c97-4470-9537-b9153f7c9747 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:45.844648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c79e565-3c97-4470-9537-b9153f7c9747 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:45.845302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c79e565-3c97-4470-9537-b9153f7c9747 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:45.845903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c79e565-3c97-4470-9537-b9153f7c9747 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:45.847489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c79e565-3c97-4470-9537-b9153f7c9747 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:45.848135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c79e565-3c97-4470-9537-b9153f7c9747 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:45.848754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c79e565-3c97-4470-9537-b9153f7c9747 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:45.854522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-8807a25b-37df-4ee4-81e4-e3d4ef766771 req-9fb82548-808a-4a52-83bb-6f030cc3d549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642", "name": "network-vif-plugged", "status": "completed", "tag": "8e2b35e6-0fa9-488d-886e-79503ed3c9fb"}, {"server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "name": "network-vif-plugged", "status": "completed", "tag": "e36d7f37-98a6-4136-be81-33925899d2c1"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:45.868280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8807a25b-37df-4ee4-81e4-e3d4ef766771 req-9fb82548-808a-4a52-83bb-6f030cc3d549 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:45.868763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8807a25b-37df-4ee4-81e4-e3d4ef766771 req-9fb82548-808a-4a52-83bb-6f030cc3d549 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:45.869188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8807a25b-37df-4ee4-81e4-e3d4ef766771 req-9fb82548-808a-4a52-83bb-6f030cc3d549 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:45.891287 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-8807a25b-37df-4ee4-81e4-e3d4ef766771 req-9fb82548-808a-4a52-83bb-6f030cc3d549 service nova] Creating event network-vif-plugged:8e2b35e6-0fa9-488d-886e-79503ed3c9fb for instance e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 on n-h1-861111-1 Oct 12 22:17:45.892074 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-8807a25b-37df-4ee4-81e4-e3d4ef766771 req-9fb82548-808a-4a52-83bb-6f030cc3d549 service nova] Creating event network-vif-plugged:e36d7f37-98a6-4136-be81-33925899d2c1 for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:17:45.903931 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-8807a25b-37df-4ee4-81e4-e3d4ef766771 req-9fb82548-808a-4a52-83bb-6f030cc3d549 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073284 Oct 12 22:17:45.905036 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2468/4385] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:17:46.066358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6c79e565-3c97-4470-9537-b9153f7c9747 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:46.082406 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6c79e565-3c97-4470-9537-b9153f7c9747 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1315 microversion: 2.1 time: 0.245244 Oct 12 22:17:46.083136 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1918/4386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:45 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:46.163614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b118a1e1-af64-41f0-9950-902f381cdb69 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:46.165117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b118a1e1-af64-41f0-9950-902f381cdb69 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:46.178505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b118a1e1-af64-41f0-9950-902f381cdb69 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:46.179077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b118a1e1-af64-41f0-9950-902f381cdb69 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:46.179774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b118a1e1-af64-41f0-9950-902f381cdb69 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:46.180708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b118a1e1-af64-41f0-9950-902f381cdb69 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:46.181412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b118a1e1-af64-41f0-9950-902f381cdb69 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:46.181926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b118a1e1-af64-41f0-9950-902f381cdb69 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:46.398297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b118a1e1-af64-41f0-9950-902f381cdb69 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:46.407600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b118a1e1-af64-41f0-9950-902f381cdb69 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:46.410288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b118a1e1-af64-41f0-9950-902f381cdb69 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:46.411886 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b118a1e1-af64-41f0-9950-902f381cdb69 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1359 microversion: 2.21 time: 0.253896 Oct 12 22:17:46.412470 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2469/4387] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:46 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1359 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:17:46.747463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b5e0ab7-7a4b-415d-b971-8d080649d9b8 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:46.749499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6b5e0ab7-7a4b-415d-b971-8d080649d9b8 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:46.757332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b5e0ab7-7a4b-415d-b971-8d080649d9b8 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:46.758682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b5e0ab7-7a4b-415d-b971-8d080649d9b8 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:46.760378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b5e0ab7-7a4b-415d-b971-8d080649d9b8 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:46.761308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b5e0ab7-7a4b-415d-b971-8d080649d9b8 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:46.761959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b5e0ab7-7a4b-415d-b971-8d080649d9b8 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:46.763793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b5e0ab7-7a4b-415d-b971-8d080649d9b8 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:46.858752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ad7563e4-a70c-41e8-b7e7-3469f8afaf6a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:46.859582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ad7563e4-a70c-41e8-b7e7-3469f8afaf6a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:46.869185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad7563e4-a70c-41e8-b7e7-3469f8afaf6a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:46.869684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad7563e4-a70c-41e8-b7e7-3469f8afaf6a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:46.870225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad7563e4-a70c-41e8-b7e7-3469f8afaf6a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:46.870817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad7563e4-a70c-41e8-b7e7-3469f8afaf6a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:46.871286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad7563e4-a70c-41e8-b7e7-3469f8afaf6a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:46.871881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad7563e4-a70c-41e8-b7e7-3469f8afaf6a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:46.945998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6b5e0ab7-7a4b-415d-b971-8d080649d9b8 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ae2ddba1d412e96e40782c6b46337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5493a20eda476e8843381f175baf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:46.954951 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6b5e0ab7-7a4b-415d-b971-8d080649d9b8 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 200 len: 1325 microversion: 2.1 time: 0.212014 Oct 12 22:17:46.955575 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1919/4388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:46 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 1325 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:46.962066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-81300346-ff27-4e93-bb78-fa3fefd58dbf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:46.963113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-81300346-ff27-4e93-bb78-fa3fefd58dbf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:46.968323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ad7563e4-a70c-41e8-b7e7-3469f8afaf6a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:46.971035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81300346-ff27-4e93-bb78-fa3fefd58dbf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:46.971630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81300346-ff27-4e93-bb78-fa3fefd58dbf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:46.972210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81300346-ff27-4e93-bb78-fa3fefd58dbf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:46.972958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81300346-ff27-4e93-bb78-fa3fefd58dbf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:46.973486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81300346-ff27-4e93-bb78-fa3fefd58dbf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:46.974194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81300346-ff27-4e93-bb78-fa3fefd58dbf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:46.982491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ad7563e4-a70c-41e8-b7e7-3469f8afaf6a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:46.984292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ad7563e4-a70c-41e8-b7e7-3469f8afaf6a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:46.986152 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ad7563e4-a70c-41e8-b7e7-3469f8afaf6a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.131646 Oct 12 22:17:46.986735 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2470/4389] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:46 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:17:47.112566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-272bce08-547a-43ec-adf2-85224846fdc0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:47.113191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-272bce08-547a-43ec-adf2-85224846fdc0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:47.120063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-272bce08-547a-43ec-adf2-85224846fdc0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:47.120922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-272bce08-547a-43ec-adf2-85224846fdc0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:47.121609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-272bce08-547a-43ec-adf2-85224846fdc0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:47.122475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-272bce08-547a-43ec-adf2-85224846fdc0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:47.123085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-272bce08-547a-43ec-adf2-85224846fdc0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:47.123790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-272bce08-547a-43ec-adf2-85224846fdc0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:47.232559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-81300346-ff27-4e93-bb78-fa3fefd58dbf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:47.246437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-81300346-ff27-4e93-bb78-fa3fefd58dbf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:47.248214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-81300346-ff27-4e93-bb78-fa3fefd58dbf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:47.249704 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-81300346-ff27-4e93-bb78-fa3fefd58dbf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.292931 Oct 12 22:17:47.250592 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1920/4390] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:46 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:47.391974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-272bce08-547a-43ec-adf2-85224846fdc0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:47.421250 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-272bce08-547a-43ec-adf2-85224846fdc0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1315 microversion: 2.1 time: 0.317207 Oct 12 22:17:47.423261 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2471/4391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:47 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:17:47.437951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b970ae84-4998-4380-8572-e73f1d56c5d4 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:47.438856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b970ae84-4998-4380-8572-e73f1d56c5d4 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:47.445069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b970ae84-4998-4380-8572-e73f1d56c5d4 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:47.445604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b970ae84-4998-4380-8572-e73f1d56c5d4 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:47.446043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b970ae84-4998-4380-8572-e73f1d56c5d4 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:47.446761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b970ae84-4998-4380-8572-e73f1d56c5d4 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:47.447572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b970ae84-4998-4380-8572-e73f1d56c5d4 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:47.447998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b970ae84-4998-4380-8572-e73f1d56c5d4 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:47.452814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:47.682822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b970ae84-4998-4380-8572-e73f1d56c5d4 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:47.697289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b970ae84-4998-4380-8572-e73f1d56c5d4 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:47.699396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b970ae84-4998-4380-8572-e73f1d56c5d4 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:47.700804 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b970ae84-4998-4380-8572-e73f1d56c5d4 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1359 microversion: 2.21 time: 0.266812 Oct 12 22:17:47.701989 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1921/4392] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:47 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1359 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:47.973932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-026f7e40-b62a-4712-ac0d-11b26bc80787 req-b53d79d4-5d59-408d-bbe8-afb474396e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93c312a-dce8-4a49-9942-515527b3103f", "name": "network-vif-plugged", "status": "completed", "tag": "60debe36-34ee-4c09-8e82-1896cb229077"}, {"server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "name": "network-vif-plugged", "status": "completed", "tag": "f460a2f6-34cf-42a8-85f6-522777a2dd9f"}, {"server_uuid": "522963ce-473f-4d06-94a6-f329fc0d1fc2", "name": "network-vif-plugged", "status": "completed", "tag": "0ab78bef-0d04-4c8b-8835-499165a55dea"}, {"server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "name": "network-vif-plugged", "status": "completed", "tag": "784c9be8-8f1d-4448-96ec-73464800451b"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:47.982371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d735780-9d2a-45b5-ae81-9eaac859b265 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:47.983702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9d735780-9d2a-45b5-ae81-9eaac859b265 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:47.990581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-026f7e40-b62a-4712-ac0d-11b26bc80787 req-b53d79d4-5d59-408d-bbe8-afb474396e76 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:47.991522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-026f7e40-b62a-4712-ac0d-11b26bc80787 req-b53d79d4-5d59-408d-bbe8-afb474396e76 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:47.992825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-026f7e40-b62a-4712-ac0d-11b26bc80787 req-b53d79d4-5d59-408d-bbe8-afb474396e76 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:47.994626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d735780-9d2a-45b5-ae81-9eaac859b265 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:47.995279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d735780-9d2a-45b5-ae81-9eaac859b265 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:47.995857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d735780-9d2a-45b5-ae81-9eaac859b265 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:47.996676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d735780-9d2a-45b5-ae81-9eaac859b265 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:47.997314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d735780-9d2a-45b5-ae81-9eaac859b265 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:47.997984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d735780-9d2a-45b5-ae81-9eaac859b265 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:48.013855 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-026f7e40-b62a-4712-ac0d-11b26bc80787 req-b53d79d4-5d59-408d-bbe8-afb474396e76 service nova] Creating event network-vif-plugged:60debe36-34ee-4c09-8e82-1896cb229077 for instance d93c312a-dce8-4a49-9942-515527b3103f on n-h1-861111-1 Oct 12 22:17:48.014619 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-026f7e40-b62a-4712-ac0d-11b26bc80787 req-b53d79d4-5d59-408d-bbe8-afb474396e76 service nova] Creating event network-vif-plugged:f460a2f6-34cf-42a8-85f6-522777a2dd9f for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:17:48.015350 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-026f7e40-b62a-4712-ac0d-11b26bc80787 req-b53d79d4-5d59-408d-bbe8-afb474396e76 service nova] Creating event network-vif-plugged:0ab78bef-0d04-4c8b-8835-499165a55dea for instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 on n-h2-861111-1 Oct 12 22:17:48.016191 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-026f7e40-b62a-4712-ac0d-11b26bc80787 req-b53d79d4-5d59-408d-bbe8-afb474396e76 service nova] Creating event network-vif-plugged:784c9be8-8f1d-4448-96ec-73464800451b for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:17:48.029446 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-026f7e40-b62a-4712-ac0d-11b26bc80787 req-b53d79d4-5d59-408d-bbe8-afb474396e76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.060004 Oct 12 22:17:48.030564 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2472/4393] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:17:48.039537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-61e4dc57-7025-4243-978a-a69e6a5b3b07 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:48.040864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-61e4dc57-7025-4243-978a-a69e6a5b3b07 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:48.050014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61e4dc57-7025-4243-978a-a69e6a5b3b07 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:48.050840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61e4dc57-7025-4243-978a-a69e6a5b3b07 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:48.051542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61e4dc57-7025-4243-978a-a69e6a5b3b07 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:48.053323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61e4dc57-7025-4243-978a-a69e6a5b3b07 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:48.069147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61e4dc57-7025-4243-978a-a69e6a5b3b07 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:48.073138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61e4dc57-7025-4243-978a-a69e6a5b3b07 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:48.196628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-61e4dc57-7025-4243-978a-a69e6a5b3b07 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:48.208933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-61e4dc57-7025-4243-978a-a69e6a5b3b07 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:48.210686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-61e4dc57-7025-4243-978a-a69e6a5b3b07 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:48.212284 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-61e4dc57-7025-4243-978a-a69e6a5b3b07 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.180160 Oct 12 22:17:48.212865 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2473/4394] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:48 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:48.276509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2d8a1b79-a03a-4216-987e-1c1cad8b65bf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:48.277286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2d8a1b79-a03a-4216-987e-1c1cad8b65bf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:48.284599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d8a1b79-a03a-4216-987e-1c1cad8b65bf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:48.285277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d8a1b79-a03a-4216-987e-1c1cad8b65bf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:48.285946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d8a1b79-a03a-4216-987e-1c1cad8b65bf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:48.286909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d8a1b79-a03a-4216-987e-1c1cad8b65bf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:48.287466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d8a1b79-a03a-4216-987e-1c1cad8b65bf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:48.288088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d8a1b79-a03a-4216-987e-1c1cad8b65bf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:48.492311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9d735780-9d2a-45b5-ae81-9eaac859b265 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ae2ddba1d412e96e40782c6b46337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5493a20eda476e8843381f175baf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:48.508673 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9d735780-9d2a-45b5-ae81-9eaac859b265 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 200 len: 1325 microversion: 2.1 time: 0.533284 Oct 12 22:17:48.515041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2d8a1b79-a03a-4216-987e-1c1cad8b65bf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:48.532886 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1922/4395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:47 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 1325 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:48.538587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ff06a98d-2936-4cee-855e-e158fd6617b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:48.540264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ff06a98d-2936-4cee-855e-e158fd6617b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:48.546324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2d8a1b79-a03a-4216-987e-1c1cad8b65bf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:48.546957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff06a98d-2936-4cee-855e-e158fd6617b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:48.547726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff06a98d-2936-4cee-855e-e158fd6617b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:48.548389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff06a98d-2936-4cee-855e-e158fd6617b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:48.548585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2d8a1b79-a03a-4216-987e-1c1cad8b65bf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:48.549433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff06a98d-2936-4cee-855e-e158fd6617b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:48.550005 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2d8a1b79-a03a-4216-987e-1c1cad8b65bf tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.277941 Oct 12 22:17:48.550407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff06a98d-2936-4cee-855e-e158fd6617b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:48.551033 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2474/4396] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:48 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:48.551472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff06a98d-2936-4cee-855e-e158fd6617b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:48.697716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ff06a98d-2936-4cee-855e-e158fd6617b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:48.706876 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ff06a98d-2936-4cee-855e-e158fd6617b1 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1503 microversion: 2.1 time: 0.172239 Oct 12 22:17:48.707834 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1923/4397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:48 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:48.730167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-02001713-2afd-4799-a6e0-18c222a7471e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:48.730987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-02001713-2afd-4799-a6e0-18c222a7471e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:48.737714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e96f7e0-902a-46e5-92de-9ed47b45da45 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:48.738396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02001713-2afd-4799-a6e0-18c222a7471e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:48.739087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02001713-2afd-4799-a6e0-18c222a7471e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:48.740261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02001713-2afd-4799-a6e0-18c222a7471e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:48.740861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9e96f7e0-902a-46e5-92de-9ed47b45da45 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:48.741178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02001713-2afd-4799-a6e0-18c222a7471e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:48.741632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02001713-2afd-4799-a6e0-18c222a7471e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:48.743132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02001713-2afd-4799-a6e0-18c222a7471e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:48.754068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e96f7e0-902a-46e5-92de-9ed47b45da45 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:48.754768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e96f7e0-902a-46e5-92de-9ed47b45da45 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:48.755355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e96f7e0-902a-46e5-92de-9ed47b45da45 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:48.756217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e96f7e0-902a-46e5-92de-9ed47b45da45 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:48.756990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e96f7e0-902a-46e5-92de-9ed47b45da45 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:48.757535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e96f7e0-902a-46e5-92de-9ed47b45da45 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:48.838348 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-02001713-2afd-4799-a6e0-18c222a7471e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642/action" status: 202 len: 0 microversion: 2.1 time: 0.111762 Oct 12 22:17:48.842894 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1924/4398] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:17:48 2022] POST /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:17:48.850968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ee2ddb8b-1028-4de5-bf22-732b8847190e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:48.852178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ee2ddb8b-1028-4de5-bf22-732b8847190e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:48.861294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee2ddb8b-1028-4de5-bf22-732b8847190e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:48.862194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee2ddb8b-1028-4de5-bf22-732b8847190e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:48.862902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee2ddb8b-1028-4de5-bf22-732b8847190e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:48.863886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee2ddb8b-1028-4de5-bf22-732b8847190e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:48.864626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee2ddb8b-1028-4de5-bf22-732b8847190e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:48.865899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee2ddb8b-1028-4de5-bf22-732b8847190e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:49.011888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9e96f7e0-902a-46e5-92de-9ed47b45da45 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:49.020309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9e96f7e0-902a-46e5-92de-9ed47b45da45 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:49.021775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9e96f7e0-902a-46e5-92de-9ed47b45da45 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:49.022933 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9e96f7e0-902a-46e5-92de-9ed47b45da45 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1359 microversion: 2.21 time: 0.300948 Oct 12 22:17:49.027015 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2475/4399] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:48 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1359 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:49.083396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ee2ddb8b-1028-4de5-bf22-732b8847190e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:49.093485 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ee2ddb8b-1028-4de5-bf22-732b8847190e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1508 microversion: 2.1 time: 0.249060 Oct 12 22:17:49.094861 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1925/4400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:48 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1508 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:49.239504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e519e8ef-4892-435c-90cc-8265c3727192 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:49.240347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e519e8ef-4892-435c-90cc-8265c3727192 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:49.248277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e519e8ef-4892-435c-90cc-8265c3727192 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:49.248775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e519e8ef-4892-435c-90cc-8265c3727192 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:49.249219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e519e8ef-4892-435c-90cc-8265c3727192 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:49.250098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e519e8ef-4892-435c-90cc-8265c3727192 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:49.250559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e519e8ef-4892-435c-90cc-8265c3727192 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:49.250989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e519e8ef-4892-435c-90cc-8265c3727192 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:49.255480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:49.351147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e519e8ef-4892-435c-90cc-8265c3727192 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:49.366541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e519e8ef-4892-435c-90cc-8265c3727192 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:49.371005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e519e8ef-4892-435c-90cc-8265c3727192 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:49.372298 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e519e8ef-4892-435c-90cc-8265c3727192 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.137351 Oct 12 22:17:49.383513 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2476/4401] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:49 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:49.540980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c4f442b7-a482-4a19-bb57-16497a104e61 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:49.542067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c4f442b7-a482-4a19-bb57-16497a104e61 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:49.548735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4f442b7-a482-4a19-bb57-16497a104e61 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:49.549527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4f442b7-a482-4a19-bb57-16497a104e61 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:49.550028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4f442b7-a482-4a19-bb57-16497a104e61 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:49.550944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4f442b7-a482-4a19-bb57-16497a104e61 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:49.551508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4f442b7-a482-4a19-bb57-16497a104e61 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:49.552232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4f442b7-a482-4a19-bb57-16497a104e61 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:49.576980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ee3a070c-e008-46fa-a740-042dfe7f3330 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:49.577609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ee3a070c-e008-46fa-a740-042dfe7f3330 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:49.587968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee3a070c-e008-46fa-a740-042dfe7f3330 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:49.598362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee3a070c-e008-46fa-a740-042dfe7f3330 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:49.598875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee3a070c-e008-46fa-a740-042dfe7f3330 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:49.599838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee3a070c-e008-46fa-a740-042dfe7f3330 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:49.600482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee3a070c-e008-46fa-a740-042dfe7f3330 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:49.601123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee3a070c-e008-46fa-a740-042dfe7f3330 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:49.755665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c4f442b7-a482-4a19-bb57-16497a104e61 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ae2ddba1d412e96e40782c6b46337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5493a20eda476e8843381f175baf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:49.769638 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c4f442b7-a482-4a19-bb57-16497a104e61 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 200 len: 1325 microversion: 2.1 time: 0.233041 Oct 12 22:17:49.775024 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1926/4402] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:49 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 1325 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:49.905581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ee3a070c-e008-46fa-a740-042dfe7f3330 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:49.915349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ee3a070c-e008-46fa-a740-042dfe7f3330 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:49.916814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ee3a070c-e008-46fa-a740-042dfe7f3330 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:49.918174 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ee3a070c-e008-46fa-a740-042dfe7f3330 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.345203 Oct 12 22:17:49.936144 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2477/4403] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:49 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:50.052721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-04964abd-be95-4aa8-bdad-4463ab1274e2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:50.053351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-04964abd-be95-4aa8-bdad-4463ab1274e2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:50.058875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-9924167f-cbf7-452d-85f7-719d9cfee294 req-7a249a23-98b5-4dac-80ab-ed2e592f6410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "name": "network-vif-plugged", "status": "completed", "tag": "410e58b4-a020-44fa-a570-283cadbd980e"}, {"server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "name": "network-vif-plugged", "status": "completed", "tag": "f6a6b535-1aed-4471-b5a4-a99246939f71"}, {"server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "name": "network-vif-plugged", "status": "completed", "tag": "0fdc0365-5474-47b8-9674-e807e2942529"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:50.078985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04964abd-be95-4aa8-bdad-4463ab1274e2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.079516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04964abd-be95-4aa8-bdad-4463ab1274e2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.083631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9924167f-cbf7-452d-85f7-719d9cfee294 req-7a249a23-98b5-4dac-80ab-ed2e592f6410 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.084374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9924167f-cbf7-452d-85f7-719d9cfee294 req-7a249a23-98b5-4dac-80ab-ed2e592f6410 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.084791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9924167f-cbf7-452d-85f7-719d9cfee294 req-7a249a23-98b5-4dac-80ab-ed2e592f6410 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:50.088038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04964abd-be95-4aa8-bdad-4463ab1274e2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:50.088624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04964abd-be95-4aa8-bdad-4463ab1274e2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.089097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04964abd-be95-4aa8-bdad-4463ab1274e2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.089533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04964abd-be95-4aa8-bdad-4463ab1274e2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:50.121171 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-9924167f-cbf7-452d-85f7-719d9cfee294 req-7a249a23-98b5-4dac-80ab-ed2e592f6410 service nova] Creating event network-vif-plugged:410e58b4-a020-44fa-a570-283cadbd980e for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:17:50.121568 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-9924167f-cbf7-452d-85f7-719d9cfee294 req-7a249a23-98b5-4dac-80ab-ed2e592f6410 service nova] Creating event network-vif-plugged:f6a6b535-1aed-4471-b5a4-a99246939f71 for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:17:50.122076 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-9924167f-cbf7-452d-85f7-719d9cfee294 req-7a249a23-98b5-4dac-80ab-ed2e592f6410 service nova] Creating event network-vif-plugged:0fdc0365-5474-47b8-9674-e807e2942529 for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:17:50.140798 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-9924167f-cbf7-452d-85f7-719d9cfee294 req-7a249a23-98b5-4dac-80ab-ed2e592f6410 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.093675 Oct 12 22:17:50.145017 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1927/4404] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:17:50.155577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fa550f34-e0bb-4a27-8bc8-b1915d39a5d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:50.156327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fa550f34-e0bb-4a27-8bc8-b1915d39a5d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:50.184077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa550f34-e0bb-4a27-8bc8-b1915d39a5d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.184584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa550f34-e0bb-4a27-8bc8-b1915d39a5d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.187215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa550f34-e0bb-4a27-8bc8-b1915d39a5d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:50.188964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa550f34-e0bb-4a27-8bc8-b1915d39a5d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.189452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa550f34-e0bb-4a27-8bc8-b1915d39a5d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.191719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa550f34-e0bb-4a27-8bc8-b1915d39a5d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:50.310314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-04964abd-be95-4aa8-bdad-4463ab1274e2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:50.319812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-04964abd-be95-4aa8-bdad-4463ab1274e2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:50.321328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-04964abd-be95-4aa8-bdad-4463ab1274e2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:50.322536 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-04964abd-be95-4aa8-bdad-4463ab1274e2 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1552 microversion: 2.21 time: 0.273942 Oct 12 22:17:50.323253 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2478/4405] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:50 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1552 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:50.332463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-274550e2-a7ce-4951-a96e-e73a977ac3b9 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:50.339334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-274550e2-a7ce-4951-a96e-e73a977ac3b9 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:50.340154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-274550e2-a7ce-4951-a96e-e73a977ac3b9 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Searching by: {'deleted': False, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:17:50.346271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-274550e2-a7ce-4951-a96e-e73a977ac3b9 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.346769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-274550e2-a7ce-4951-a96e-e73a977ac3b9 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.347209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-274550e2-a7ce-4951-a96e-e73a977ac3b9 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:50.350741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-274550e2-a7ce-4951-a96e-e73a977ac3b9 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.351167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-274550e2-a7ce-4951-a96e-e73a977ac3b9 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.351712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-274550e2-a7ce-4951-a96e-e73a977ac3b9 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:50.380805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-274550e2-a7ce-4951-a96e-e73a977ac3b9 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:17:50.418646 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-274550e2-a7ce-4951-a96e-e73a977ac3b9 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.093772 Oct 12 22:17:50.424987 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2479/4406] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 12 22:17:50 2022] GET /compute/v2.1/servers => generated 339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:17:50.430777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-552c8a31-043c-4d43-8fba-88a1dc10e19a tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:50.431413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-552c8a31-043c-4d43-8fba-88a1dc10e19a tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:50.448405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-552c8a31-043c-4d43-8fba-88a1dc10e19a tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.448913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-552c8a31-043c-4d43-8fba-88a1dc10e19a tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.450203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-552c8a31-043c-4d43-8fba-88a1dc10e19a tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:50.450932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-552c8a31-043c-4d43-8fba-88a1dc10e19a tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.451450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-552c8a31-043c-4d43-8fba-88a1dc10e19a tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.451919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-552c8a31-043c-4d43-8fba-88a1dc10e19a tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:50.486200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-552c8a31-043c-4d43-8fba-88a1dc10e19a tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:17:50.581128 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-552c8a31-043c-4d43-8fba-88a1dc10e19a tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "DELETE /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 204 len: 0 microversion: 2.21 time: 0.153906 Oct 12 22:17:50.582909 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2480/4407] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:17:50 2022] DELETE /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:17:50.590566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-428cacaf-cf69-4774-9ae0-70466684667b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:50.591625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-428cacaf-cf69-4774-9ae0-70466684667b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:50.598498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-428cacaf-cf69-4774-9ae0-70466684667b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.599293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-428cacaf-cf69-4774-9ae0-70466684667b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.599887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-428cacaf-cf69-4774-9ae0-70466684667b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:50.600821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-428cacaf-cf69-4774-9ae0-70466684667b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.602821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-428cacaf-cf69-4774-9ae0-70466684667b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.603515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-428cacaf-cf69-4774-9ae0-70466684667b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:50.691596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-428cacaf-cf69-4774-9ae0-70466684667b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:50.704470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-428cacaf-cf69-4774-9ae0-70466684667b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:50.706055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-428cacaf-cf69-4774-9ae0-70466684667b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:50.707410 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-428cacaf-cf69-4774-9ae0-70466684667b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.123046 Oct 12 22:17:50.708096 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2481/4408] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:50 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:50.714724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1f66de7e-0e04-4245-8c15-9f716cbb9040 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:50.719926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1f66de7e-0e04-4245-8c15-9f716cbb9040 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:50.720808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1f66de7e-0e04-4245-8c15-9f716cbb9040 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Searching by: {'deleted': False, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:17:50.727271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f66de7e-0e04-4245-8c15-9f716cbb9040 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.727815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f66de7e-0e04-4245-8c15-9f716cbb9040 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.728254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f66de7e-0e04-4245-8c15-9f716cbb9040 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:50.729184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f66de7e-0e04-4245-8c15-9f716cbb9040 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.729625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f66de7e-0e04-4245-8c15-9f716cbb9040 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.730291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f66de7e-0e04-4245-8c15-9f716cbb9040 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:50.760107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-1f66de7e-0e04-4245-8c15-9f716cbb9040 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:17:50.799204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1f66de7e-0e04-4245-8c15-9f716cbb9040 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:50.805954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f66de7e-0e04-4245-8c15-9f716cbb9040 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.806444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f66de7e-0e04-4245-8c15-9f716cbb9040 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.806889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f66de7e-0e04-4245-8c15-9f716cbb9040 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:50.872759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fa550f34-e0bb-4a27-8bc8-b1915d39a5d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:50.882359 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fa550f34-e0bb-4a27-8bc8-b1915d39a5d5 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1488 microversion: 2.1 time: 0.736001 Oct 12 22:17:50.884645 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1928/4409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:50 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1488 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:50.891377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-15c0b5fd-46da-42d4-9350-653b111d2eef tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:50.892347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-15c0b5fd-46da-42d4-9350-653b111d2eef tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:50.902250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15c0b5fd-46da-42d4-9350-653b111d2eef tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.902824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15c0b5fd-46da-42d4-9350-653b111d2eef tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.903442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15c0b5fd-46da-42d4-9350-653b111d2eef tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:50.904286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15c0b5fd-46da-42d4-9350-653b111d2eef tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.904889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15c0b5fd-46da-42d4-9350-653b111d2eef tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.905402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15c0b5fd-46da-42d4-9350-653b111d2eef tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:50.959437 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1f66de7e-0e04-4245-8c15-9f716cbb9040 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.248343 Oct 12 22:17:50.962325 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2482/4410] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:17:50 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:50.966131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c93864e4-efdd-47b3-83f4-13ee705b9fc4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:50.966495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c93864e4-efdd-47b3-83f4-13ee705b9fc4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:50.974502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93864e4-efdd-47b3-83f4-13ee705b9fc4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.974928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93864e4-efdd-47b3-83f4-13ee705b9fc4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.976002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93864e4-efdd-47b3-83f4-13ee705b9fc4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:50.976405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93864e4-efdd-47b3-83f4-13ee705b9fc4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:50.976913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93864e4-efdd-47b3-83f4-13ee705b9fc4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:50.977469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93864e4-efdd-47b3-83f4-13ee705b9fc4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:51.128109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c93864e4-efdd-47b3-83f4-13ee705b9fc4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ae2ddba1d412e96e40782c6b46337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5493a20eda476e8843381f175baf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:51.137130 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c93864e4-efdd-47b3-83f4-13ee705b9fc4 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 200 len: 1521 microversion: 2.1 time: 0.175644 Oct 12 22:17:51.138053 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2483/4411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:50 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:51.150669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c951982d-99b2-4f9d-b085-f989f79cc4cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:51.151618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c951982d-99b2-4f9d-b085-f989f79cc4cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:51.158838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c951982d-99b2-4f9d-b085-f989f79cc4cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:51.159611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c951982d-99b2-4f9d-b085-f989f79cc4cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:51.160057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c951982d-99b2-4f9d-b085-f989f79cc4cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:51.160795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c951982d-99b2-4f9d-b085-f989f79cc4cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:51.161400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c951982d-99b2-4f9d-b085-f989f79cc4cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:51.161834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c951982d-99b2-4f9d-b085-f989f79cc4cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:51.193759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-c951982d-99b2-4f9d-b085-f989f79cc4cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lazy-loading 'flavor' on Instance uuid e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:17:51.291169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-15c0b5fd-46da-42d4-9350-653b111d2eef tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:51.304647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-15c0b5fd-46da-42d4-9350-653b111d2eef tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:51.306410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-15c0b5fd-46da-42d4-9350-653b111d2eef tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:51.307790 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-15c0b5fd-46da-42d4-9350-653b111d2eef tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1558 microversion: 2.21 time: 0.421435 Oct 12 22:17:51.322919 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1929/4412] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:50 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1558 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:51.322919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-701238e2-9207-4e55-8d02-78784b54e50e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:51.322919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-701238e2-9207-4e55-8d02-78784b54e50e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:51.322919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-701238e2-9207-4e55-8d02-78784b54e50e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:51.322919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-701238e2-9207-4e55-8d02-78784b54e50e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:51.322919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-701238e2-9207-4e55-8d02-78784b54e50e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:51.322919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-701238e2-9207-4e55-8d02-78784b54e50e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:51.322919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-701238e2-9207-4e55-8d02-78784b54e50e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:51.324562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-701238e2-9207-4e55-8d02-78784b54e50e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:51.460353 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c951982d-99b2-4f9d-b085-f989f79cc4cd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642/action" status: 202 len: 0 microversion: 2.1 time: 0.313949 Oct 12 22:17:51.462120 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2484/4413] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:17:51 2022] POST /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:17:51.471751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2670b4eb-d924-4022-be86-4083426edca7 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:51.486873 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2670b4eb-d924-4022-be86-4083426edca7 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023326 Oct 12 22:17:51.495317 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2485/4414] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:17:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:17:51.495317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3820dfc9-d02d-47b7-9919-2dea94c6e390 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:51.495632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3820dfc9-d02d-47b7-9919-2dea94c6e390 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:51.503108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3820dfc9-d02d-47b7-9919-2dea94c6e390 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:51.503712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3820dfc9-d02d-47b7-9919-2dea94c6e390 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:51.504235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3820dfc9-d02d-47b7-9919-2dea94c6e390 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:51.505085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3820dfc9-d02d-47b7-9919-2dea94c6e390 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:51.505623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3820dfc9-d02d-47b7-9919-2dea94c6e390 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:51.506154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3820dfc9-d02d-47b7-9919-2dea94c6e390 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:51.541056 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-3820dfc9-d02d-47b7-9919-2dea94c6e390 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] HTTP exception thrown: Action 999 not found Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3820dfc9-d02d-47b7-9919-2dea94c6e390 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Request method failure captured: Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f/os-instance-actions/999 HTTP/1.1 Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzz6h4n_cE2xA_lgk9J35YkvEZdbhpFfWMI3Nhwz3ldpfuz7ug5pgDe0aKBkhE6WTDYCvIAmu2MXf3g0nHSOzQ5aFWZwnSWhWjJrY80-O9sXznDeGlLdiN6lpif5Z0YWbRLHmcNOdUX6hJlI2-q4itdhwQ36U9ucN2-0IZJ0VRoITMM Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1a5493a20eda476e8843381f175baf1b Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1839918939 Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5493a20eda476e8843381f175baf1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5493a20eda476e8843381f175baf1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a5493a20eda476e8843381f175baf1b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a5493a20eda476e8843381f175baf1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1839918939 Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1a5493a20eda476e8843381f175baf1b Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1839918939 Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-InstanceActionsNegativeTestJSON-1839918939-project Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 519ae2ddba1d412e96e40782c6b46337 Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1839918939-project Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: exception: Action 999 not found Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'server_id': 'd93c312a-dce8-4a49-9942-515527b3103f', 'id': '999'} Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 12 22:17:51.548557 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:51.551883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3820dfc9-d02d-47b7-9919-2dea94c6e390 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Returning 404 to user: Action 999 not found {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:17:51.551883 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3820dfc9-d02d-47b7-9919-2dea94c6e390 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.060884 Oct 12 22:17:51.551883 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2486/4415] 10.222.0.16 () {58 vars in 1308 bytes} [Wed Oct 12 22:17:51 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f/os-instance-actions/999 => generated 66 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:17:51.556862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-98507c78-8736-4641-8a90-81922a968b99 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:51.557398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-98507c78-8736-4641-8a90-81922a968b99 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:51.563544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98507c78-8736-4641-8a90-81922a968b99 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:51.564031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98507c78-8736-4641-8a90-81922a968b99 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:51.564468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98507c78-8736-4641-8a90-81922a968b99 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:51.565166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98507c78-8736-4641-8a90-81922a968b99 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:51.565716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98507c78-8736-4641-8a90-81922a968b99 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:51.566154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-98507c78-8736-4641-8a90-81922a968b99 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:51.655185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-701238e2-9207-4e55-8d02-78784b54e50e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:51.669556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-701238e2-9207-4e55-8d02-78784b54e50e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:51.672763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-701238e2-9207-4e55-8d02-78784b54e50e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:51.674337 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-701238e2-9207-4e55-8d02-78784b54e50e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.364475 Oct 12 22:17:51.675761 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1930/4416] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:51 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:51.682481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d45b17a-f49b-4214-953b-dd6f00fe9f50 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '.version_select at 0x7f51286b0160>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:51.683400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9d45b17a-f49b-4214-953b-dd6f00fe9f50 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: 16da9859-ad12-4415-bbdf-8f699b2180d9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:51.690688 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-9d45b17a-f49b-4214-953b-dd6f00fe9f50 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] HTTP exception thrown: Instance 16da9859-ad12-4415-bbdf-8f699b2180d9 could not be found. Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d45b17a-f49b-4214-953b-dd6f00fe9f50 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Request method failure captured: Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/16da9859-ad12-4415-bbdf-8f699b2180d9/os-instance-actions HTTP/1.1 Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzz6h4n_cE2xA_lgk9J35YkvEZdbhpFfWMI3Nhwz3ldpfuz7ug5pgDe0aKBkhE6WTDYCvIAmu2MXf3g0nHSOzQ5aFWZwnSWhWjJrY80-O9sXznDeGlLdiN6lpif5Z0YWbRLHmcNOdUX6hJlI2-q4itdhwQ36U9ucN2-0IZJ0VRoITMM Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1a5493a20eda476e8843381f175baf1b Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1839918939 Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5493a20eda476e8843381f175baf1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5493a20eda476e8843381f175baf1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a5493a20eda476e8843381f175baf1b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a5493a20eda476e8843381f175baf1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1839918939 Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1a5493a20eda476e8843381f175baf1b Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1839918939 Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-InstanceActionsNegativeTestJSON-1839918939-project Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 519ae2ddba1d412e96e40782c6b46337 Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1839918939-project Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 16da9859-ad12-4415-bbdf-8f699b2180d9 could not be found. Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'server_id': '16da9859-ad12-4415-bbdf-8f699b2180d9'} Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16da9859-ad12-4415-bbdf-8f699b2180d9 could not be found. Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:17:51.693185 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:17:51.697088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16da9859-ad12-4415-bbdf-8f699b2180d9 could not be found. Oct 12 22:17:51.697088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:51.697088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:17:51.697088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:51.697088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:51.697088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:17:51.697088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:17:51.697088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:17:51.697088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:17:51.697088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16da9859-ad12-4415-bbdf-8f699b2180d9 could not be found. Oct 12 22:17:51.697088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:51.699139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d45b17a-f49b-4214-953b-dd6f00fe9f50 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Returning 404 to user: Instance 16da9859-ad12-4415-bbdf-8f699b2180d9 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:17:51.700316 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9d45b17a-f49b-4214-953b-dd6f00fe9f50 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/16da9859-ad12-4415-bbdf-8f699b2180d9/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.022802 Oct 12 22:17:51.705844 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1931/4417] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Oct 12 22:17:51 2022] GET /compute/v2.1/servers/16da9859-ad12-4415-bbdf-8f699b2180d9/os-instance-actions => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:17:51.711870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-de7e879d-fe03-4603-99ea-ca34dd109a0b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:51.712785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-de7e879d-fe03-4603-99ea-ca34dd109a0b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:51.720477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de7e879d-fe03-4603-99ea-ca34dd109a0b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:51.721927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de7e879d-fe03-4603-99ea-ca34dd109a0b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:51.722596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de7e879d-fe03-4603-99ea-ca34dd109a0b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:51.723685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de7e879d-fe03-4603-99ea-ca34dd109a0b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:51.724419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de7e879d-fe03-4603-99ea-ca34dd109a0b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:51.725089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de7e879d-fe03-4603-99ea-ca34dd109a0b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:51.745032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-98507c78-8736-4641-8a90-81922a968b99 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:51.759378 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-98507c78-8736-4641-8a90-81922a968b99 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1494 microversion: 2.1 time: 0.203877 Oct 12 22:17:51.759378 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2487/4418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:51 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1494 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:51.762880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-38c4e81c-d83c-4c5a-9a1d-c778b53b0487 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:51.763575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-38c4e81c-d83c-4c5a-9a1d-c778b53b0487 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:51.766481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-de7e879d-fe03-4603-99ea-ca34dd109a0b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:17:51.770469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38c4e81c-d83c-4c5a-9a1d-c778b53b0487 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:51.770958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38c4e81c-d83c-4c5a-9a1d-c778b53b0487 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:51.771474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38c4e81c-d83c-4c5a-9a1d-c778b53b0487 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:51.772555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38c4e81c-d83c-4c5a-9a1d-c778b53b0487 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:51.772677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38c4e81c-d83c-4c5a-9a1d-c778b53b0487 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:51.773052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38c4e81c-d83c-4c5a-9a1d-c778b53b0487 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:51.847123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-38c4e81c-d83c-4c5a-9a1d-c778b53b0487 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:51.866198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-38c4e81c-d83c-4c5a-9a1d-c778b53b0487 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:51.876728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-38c4e81c-d83c-4c5a-9a1d-c778b53b0487 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:51.901731 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-38c4e81c-d83c-4c5a-9a1d-c778b53b0487 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.142280 Oct 12 22:17:51.915139 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2488/4419] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:51 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:51.922544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-12cc5fe4-d026-4177-88e8-6aae023918c5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:51.923054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-12cc5fe4-d026-4177-88e8-6aae023918c5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:51.936819 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-de7e879d-fe03-4603-99ea-ca34dd109a0b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 204 len: 0 microversion: 2.1 time: 0.229332 Oct 12 22:17:51.937415 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1932/4420] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:17:51 2022] DELETE /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:17:51.941336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12cc5fe4-d026-4177-88e8-6aae023918c5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:51.941706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12cc5fe4-d026-4177-88e8-6aae023918c5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:51.942156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12cc5fe4-d026-4177-88e8-6aae023918c5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:51.942898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12cc5fe4-d026-4177-88e8-6aae023918c5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:51.943472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12cc5fe4-d026-4177-88e8-6aae023918c5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:51.943853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12cc5fe4-d026-4177-88e8-6aae023918c5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:51.947658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-99db5318-5b93-4998-ae3d-fadfcc141f0a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:51.948369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-99db5318-5b93-4998-ae3d-fadfcc141f0a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:51.960578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99db5318-5b93-4998-ae3d-fadfcc141f0a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:51.961041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:51.961590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99db5318-5b93-4998-ae3d-fadfcc141f0a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:51.962260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99db5318-5b93-4998-ae3d-fadfcc141f0a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:51.963571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99db5318-5b93-4998-ae3d-fadfcc141f0a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:51.964345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99db5318-5b93-4998-ae3d-fadfcc141f0a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:51.964985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99db5318-5b93-4998-ae3d-fadfcc141f0a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:51.994404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-12cc5fe4-d026-4177-88e8-6aae023918c5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:17:52.115710 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-12cc5fe4-d026-4177-88e8-6aae023918c5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 204 len: 0 microversion: 2.1 time: 0.199053 Oct 12 22:17:52.117761 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2489/4421] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:17:51 2022] DELETE /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:17:52.131645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dcd64f8f-69e3-40e6-bdbf-cdf327dc4355 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:52.132372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dcd64f8f-69e3-40e6-bdbf-cdf327dc4355 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:52.141318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcd64f8f-69e3-40e6-bdbf-cdf327dc4355 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:52.141829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcd64f8f-69e3-40e6-bdbf-cdf327dc4355 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:52.142279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcd64f8f-69e3-40e6-bdbf-cdf327dc4355 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:52.143175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcd64f8f-69e3-40e6-bdbf-cdf327dc4355 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:52.144021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcd64f8f-69e3-40e6-bdbf-cdf327dc4355 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:52.145143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcd64f8f-69e3-40e6-bdbf-cdf327dc4355 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:52.188525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-99db5318-5b93-4998-ae3d-fadfcc141f0a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ae2ddba1d412e96e40782c6b46337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5493a20eda476e8843381f175baf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:52.206718 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-99db5318-5b93-4998-ae3d-fadfcc141f0a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 200 len: 1527 microversion: 2.1 time: 0.264068 Oct 12 22:17:52.209687 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1933/4422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:51 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 1527 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:52.333424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fca33b7b-c153-46a8-824b-ad0a4ccfb5e7 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:52.334449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fca33b7b-c153-46a8-824b-ad0a4ccfb5e7 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:52.345578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fca33b7b-c153-46a8-824b-ad0a4ccfb5e7 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:52.346408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fca33b7b-c153-46a8-824b-ad0a4ccfb5e7 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:52.347134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fca33b7b-c153-46a8-824b-ad0a4ccfb5e7 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:52.348141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fca33b7b-c153-46a8-824b-ad0a4ccfb5e7 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:52.348925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fca33b7b-c153-46a8-824b-ad0a4ccfb5e7 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:52.349757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fca33b7b-c153-46a8-824b-ad0a4ccfb5e7 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:52.393454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dcd64f8f-69e3-40e6-bdbf-cdf327dc4355 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:52.405539 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dcd64f8f-69e3-40e6-bdbf-cdf327dc4355 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1712 microversion: 2.1 time: 0.279898 Oct 12 22:17:52.406134 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2490/4423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:52 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1712 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:17:52.513103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fca33b7b-c153-46a8-824b-ad0a4ccfb5e7 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:52.525366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fca33b7b-c153-46a8-824b-ad0a4ccfb5e7 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:52.528883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fca33b7b-c153-46a8-824b-ad0a4ccfb5e7 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:52.530115 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fca33b7b-c153-46a8-824b-ad0a4ccfb5e7 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1558 microversion: 2.21 time: 0.200938 Oct 12 22:17:52.531410 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1934/4424] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:52 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1558 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:17:52.705984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f81dfc5e-a4cb-40e8-a38d-be8a2f6d889c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:52.707369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f81dfc5e-a4cb-40e8-a38d-be8a2f6d889c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:52.715716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f81dfc5e-a4cb-40e8-a38d-be8a2f6d889c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:52.716222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f81dfc5e-a4cb-40e8-a38d-be8a2f6d889c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:52.716846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f81dfc5e-a4cb-40e8-a38d-be8a2f6d889c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:52.717577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f81dfc5e-a4cb-40e8-a38d-be8a2f6d889c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:52.718156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f81dfc5e-a4cb-40e8-a38d-be8a2f6d889c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:52.718620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f81dfc5e-a4cb-40e8-a38d-be8a2f6d889c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:52.788724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a7735c84-a32a-4cb5-97ab-a0910aaeda68 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:52.791498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a7735c84-a32a-4cb5-97ab-a0910aaeda68 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:52.798486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7735c84-a32a-4cb5-97ab-a0910aaeda68 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:52.799132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7735c84-a32a-4cb5-97ab-a0910aaeda68 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:52.799843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7735c84-a32a-4cb5-97ab-a0910aaeda68 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:52.800770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7735c84-a32a-4cb5-97ab-a0910aaeda68 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:52.801473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7735c84-a32a-4cb5-97ab-a0910aaeda68 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:52.801999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7735c84-a32a-4cb5-97ab-a0910aaeda68 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:53.011643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a7735c84-a32a-4cb5-97ab-a0910aaeda68 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:53.040232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f81dfc5e-a4cb-40e8-a38d-be8a2f6d889c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:53.040785 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a7735c84-a32a-4cb5-97ab-a0910aaeda68 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1515 microversion: 2.1 time: 0.255881 Oct 12 22:17:53.055611 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1935/4425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:52 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1515 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:53.066713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-91539665-f3a7-4a91-bd24-1f7dae30000a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:53.069739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-91539665-f3a7-4a91-bd24-1f7dae30000a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:53.074566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f81dfc5e-a4cb-40e8-a38d-be8a2f6d889c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:53.077382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f81dfc5e-a4cb-40e8-a38d-be8a2f6d889c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:53.078284 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f81dfc5e-a4cb-40e8-a38d-be8a2f6d889c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1879 microversion: 2.42 time: 0.377015 Oct 12 22:17:53.079802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91539665-f3a7-4a91-bd24-1f7dae30000a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:53.080502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91539665-f3a7-4a91-bd24-1f7dae30000a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:53.081152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91539665-f3a7-4a91-bd24-1f7dae30000a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:53.095456 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2491/4426] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:52 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1879 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:17:53.096838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91539665-f3a7-4a91-bd24-1f7dae30000a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:53.097518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91539665-f3a7-4a91-bd24-1f7dae30000a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:53.103376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91539665-f3a7-4a91-bd24-1f7dae30000a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:53.233245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d8d93ed1-262c-4ee8-b06b-b4903e3b2b6f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:53.234110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d8d93ed1-262c-4ee8-b06b-b4903e3b2b6f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:53.246281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8d93ed1-262c-4ee8-b06b-b4903e3b2b6f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:53.246484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8d93ed1-262c-4ee8-b06b-b4903e3b2b6f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:53.253163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8d93ed1-262c-4ee8-b06b-b4903e3b2b6f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:53.254366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8d93ed1-262c-4ee8-b06b-b4903e3b2b6f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:53.255015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8d93ed1-262c-4ee8-b06b-b4903e3b2b6f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:53.255497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8d93ed1-262c-4ee8-b06b-b4903e3b2b6f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:53.265652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-91539665-f3a7-4a91-bd24-1f7dae30000a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:53.276109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:53.280126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-91539665-f3a7-4a91-bd24-1f7dae30000a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:53.282883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-91539665-f3a7-4a91-bd24-1f7dae30000a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:53.284651 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-91539665-f3a7-4a91-bd24-1f7dae30000a tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.227337 Oct 12 22:17:53.298442 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1936/4427] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:53 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:53.306533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-01e61b2a-22b5-47ac-990b-5f91e95eab5e req-6bd51221-5de9-4888-b5bf-457e5541eb63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522963ce-473f-4d06-94a6-f329fc0d1fc2", "name": "network-vif-deleted", "tag": "0ab78bef-0d04-4c8b-8835-499165a55dea"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:53.323396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-01e61b2a-22b5-47ac-990b-5f91e95eab5e req-6bd51221-5de9-4888-b5bf-457e5541eb63 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:53.324231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-01e61b2a-22b5-47ac-990b-5f91e95eab5e req-6bd51221-5de9-4888-b5bf-457e5541eb63 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:53.326678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-01e61b2a-22b5-47ac-990b-5f91e95eab5e req-6bd51221-5de9-4888-b5bf-457e5541eb63 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:53.350763 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-01e61b2a-22b5-47ac-990b-5f91e95eab5e req-6bd51221-5de9-4888-b5bf-457e5541eb63 service nova] Creating event network-vif-deleted:0ab78bef-0d04-4c8b-8835-499165a55dea for instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 on n-h2-861111-1 Oct 12 22:17:53.359563 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-01e61b2a-22b5-47ac-990b-5f91e95eab5e req-6bd51221-5de9-4888-b5bf-457e5541eb63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056443 Oct 12 22:17:53.361423 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1937/4428] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:17:53.442637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-515c3b7f-7fbd-4fff-b57a-a94780d1ea12 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:53.443408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-515c3b7f-7fbd-4fff-b57a-a94780d1ea12 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:53.457126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-515c3b7f-7fbd-4fff-b57a-a94780d1ea12 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:53.458007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-515c3b7f-7fbd-4fff-b57a-a94780d1ea12 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:53.458548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-515c3b7f-7fbd-4fff-b57a-a94780d1ea12 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:53.459522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-515c3b7f-7fbd-4fff-b57a-a94780d1ea12 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:53.464049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-515c3b7f-7fbd-4fff-b57a-a94780d1ea12 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:53.464776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-515c3b7f-7fbd-4fff-b57a-a94780d1ea12 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:53.501377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d8d93ed1-262c-4ee8-b06b-b4903e3b2b6f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ae2ddba1d412e96e40782c6b46337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5493a20eda476e8843381f175baf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:53.511424 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d8d93ed1-262c-4ee8-b06b-b4903e3b2b6f tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 200 len: 1527 microversion: 2.1 time: 0.283058 Oct 12 22:17:53.517398 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2492/4429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:53 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 1527 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:17:53.557086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-09ba90c2-ca05-431a-8402-fcb57a079f90 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:53.557760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-09ba90c2-ca05-431a-8402-fcb57a079f90 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:53.567141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09ba90c2-ca05-431a-8402-fcb57a079f90 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:53.572102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09ba90c2-ca05-431a-8402-fcb57a079f90 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:53.573670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09ba90c2-ca05-431a-8402-fcb57a079f90 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:53.574618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09ba90c2-ca05-431a-8402-fcb57a079f90 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:53.575456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09ba90c2-ca05-431a-8402-fcb57a079f90 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:53.576232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09ba90c2-ca05-431a-8402-fcb57a079f90 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:53.659736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09ba90c2-ca05-431a-8402-fcb57a079f90 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:53.660479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09ba90c2-ca05-431a-8402-fcb57a079f90 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:53.664589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09ba90c2-ca05-431a-8402-fcb57a079f90 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:53.665415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-09ba90c2-ca05-431a-8402-fcb57a079f90 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lazy-loading 'fault' on Instance uuid 522963ce-473f-4d06-94a6-f329fc0d1fc2 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:17:53.749477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-09ba90c2-ca05-431a-8402-fcb57a079f90 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:53.758795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-09ba90c2-ca05-431a-8402-fcb57a079f90 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:53.760457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-09ba90c2-ca05-431a-8402-fcb57a079f90 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c6aba556084cb8a4063110d899604b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68e79ea36f8462cb135f79be5b80ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:53.762009 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-09ba90c2-ca05-431a-8402-fcb57a079f90 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 200 len: 1349 microversion: 2.21 time: 0.209805 Oct 12 22:17:53.762742 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2493/4430] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:53 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 1349 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:17:53.782140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-515c3b7f-7fbd-4fff-b57a-a94780d1ea12 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:53.791850 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-515c3b7f-7fbd-4fff-b57a-a94780d1ea12 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1712 microversion: 2.1 time: 0.364738 Oct 12 22:17:53.808437 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1938/4431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:53 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1712 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:54.067538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3c88cb12-8d18-473d-816c-c10febb5a865 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:54.068794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3c88cb12-8d18-473d-816c-c10febb5a865 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:54.088205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c88cb12-8d18-473d-816c-c10febb5a865 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:54.091002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c88cb12-8d18-473d-816c-c10febb5a865 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:54.091625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c88cb12-8d18-473d-816c-c10febb5a865 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:54.092775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c88cb12-8d18-473d-816c-c10febb5a865 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:54.094299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c88cb12-8d18-473d-816c-c10febb5a865 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:54.094753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c88cb12-8d18-473d-816c-c10febb5a865 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:54.113714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8d0eb150-7536-4274-ab21-0ed7bbbd4dc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:54.114382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8d0eb150-7536-4274-ab21-0ed7bbbd4dc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:54.124191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d0eb150-7536-4274-ab21-0ed7bbbd4dc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:54.125481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d0eb150-7536-4274-ab21-0ed7bbbd4dc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:54.126117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d0eb150-7536-4274-ab21-0ed7bbbd4dc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:54.127381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d0eb150-7536-4274-ab21-0ed7bbbd4dc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:54.127988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d0eb150-7536-4274-ab21-0ed7bbbd4dc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:54.128560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d0eb150-7536-4274-ab21-0ed7bbbd4dc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:54.382323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8d0eb150-7536-4274-ab21-0ed7bbbd4dc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:54.396164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8d0eb150-7536-4274-ab21-0ed7bbbd4dc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:54.399099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8d0eb150-7536-4274-ab21-0ed7bbbd4dc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:54.400663 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8d0eb150-7536-4274-ab21-0ed7bbbd4dc0 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 2838 microversion: 2.42 time: 0.291481 Oct 12 22:17:54.413327 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1939/4432] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:54 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 2838 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:54.418814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3b0db4a6-d9e3-4ccf-a659-0f99023aa1ca tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:54.419508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3b0db4a6-d9e3-4ccf-a659-0f99023aa1ca tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:54.426604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b0db4a6-d9e3-4ccf-a659-0f99023aa1ca tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:54.427219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b0db4a6-d9e3-4ccf-a659-0f99023aa1ca tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:54.427726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b0db4a6-d9e3-4ccf-a659-0f99023aa1ca tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:54.428470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b0db4a6-d9e3-4ccf-a659-0f99023aa1ca tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:54.428958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b0db4a6-d9e3-4ccf-a659-0f99023aa1ca tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:54.429486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b0db4a6-d9e3-4ccf-a659-0f99023aa1ca tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:54.448435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3c88cb12-8d18-473d-816c-c10febb5a865 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:54.462485 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3c88cb12-8d18-473d-816c-c10febb5a865 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1515 microversion: 2.1 time: 0.400614 Oct 12 22:17:54.463697 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2494/4433] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:54 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1515 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:54.470563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-35925a35-03ae-41d6-81cd-c988d79562ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:54.471272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-35925a35-03ae-41d6-81cd-c988d79562ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:54.481410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35925a35-03ae-41d6-81cd-c988d79562ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:54.482184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35925a35-03ae-41d6-81cd-c988d79562ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:54.483484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35925a35-03ae-41d6-81cd-c988d79562ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:54.485940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35925a35-03ae-41d6-81cd-c988d79562ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:54.486753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35925a35-03ae-41d6-81cd-c988d79562ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:54.487674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35925a35-03ae-41d6-81cd-c988d79562ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:54.574269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3b0db4a6-d9e3-4ccf-a659-0f99023aa1ca tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:54.587629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3b0db4a6-d9e3-4ccf-a659-0f99023aa1ca tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:54.592499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3b0db4a6-d9e3-4ccf-a659-0f99023aa1ca tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:54.594633 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3b0db4a6-d9e3-4ccf-a659-0f99023aa1ca tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.179966 Oct 12 22:17:54.598589 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1940/4434] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:54 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:54.611147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-51abce51-d3ba-4d8a-904c-dab6f7ebc68a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:54.612032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-51abce51-d3ba-4d8a-904c-dab6f7ebc68a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:54.624125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51abce51-d3ba-4d8a-904c-dab6f7ebc68a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:54.629169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51abce51-d3ba-4d8a-904c-dab6f7ebc68a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:54.630002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51abce51-d3ba-4d8a-904c-dab6f7ebc68a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:54.630775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51abce51-d3ba-4d8a-904c-dab6f7ebc68a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:54.631464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51abce51-d3ba-4d8a-904c-dab6f7ebc68a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:54.632083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51abce51-d3ba-4d8a-904c-dab6f7ebc68a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:54.949977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-51abce51-d3ba-4d8a-904c-dab6f7ebc68a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ae2ddba1d412e96e40782c6b46337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5493a20eda476e8843381f175baf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:54.969843 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-51abce51-d3ba-4d8a-904c-dab6f7ebc68a tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 200 len: 1527 microversion: 2.1 time: 0.369829 Oct 12 22:17:54.971685 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1941/4435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:54 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 1527 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:54.979598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0f2c9853-96bc-4687-8289-65257113bc04 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:54.988958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0f2c9853-96bc-4687-8289-65257113bc04 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:54.998266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f2c9853-96bc-4687-8289-65257113bc04 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:55.002701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f2c9853-96bc-4687-8289-65257113bc04 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:55.003538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f2c9853-96bc-4687-8289-65257113bc04 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:55.006390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f2c9853-96bc-4687-8289-65257113bc04 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:55.007210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f2c9853-96bc-4687-8289-65257113bc04 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:55.011943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f2c9853-96bc-4687-8289-65257113bc04 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:55.049643 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-0f2c9853-96bc-4687-8289-65257113bc04 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] HTTP exception thrown: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0f2c9853-96bc-4687-8289-65257113bc04 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Request method failure captured: Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 HTTP/1.1 Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzzwiCUB11ApZ1uL3qV-mrrh2nMG_PGkprGg_SuRPc18j-UYEOJPruFo8MXF2VtUIx7r-lk8SEuU492fMBWcBVuAvL3DNMGctbYWPftGXfS8Hl9ak1UdQBOdseycR5Fa2nIod3xO0fOoMuttRxQXLN3csgztnFUSYMLk-krAthsgfqU Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-Openstack-Nova-Api-Version: 2.21 Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: d68e79ea36f8462cb135f79be5b80ce0 Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2034441905 Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d68e79ea36f8462cb135f79be5b80ce0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d68e79ea36f8462cb135f79be5b80ce0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d68e79ea36f8462cb135f79be5b80ce0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d68e79ea36f8462cb135f79be5b80ce0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-InstanceActionsV221TestJSON-2034441905 Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: d68e79ea36f8462cb135f79be5b80ce0 Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2034441905 Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-InstanceActionsV221TestJSON-2034441905-project Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 27c6aba556084cb8a4063110d899604b Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-InstanceActionsV221TestJSON-2034441905-project Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '522963ce-473f-4d06-94a6-f329fc0d1fc2'} Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:55.052010 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:17:55.055918 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:55.055918 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:55.055918 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:17:55.055918 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:17:55.055918 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:17:55.055918 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:17:55.055918 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. Oct 12 22:17:55.055918 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:55.056943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0f2c9853-96bc-4687-8289-65257113bc04 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Returning 404 to user: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:17:55.058788 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0f2c9853-96bc-4687-8289-65257113bc04 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 404 len: 111 microversion: 2.21 time: 0.085276 Oct 12 22:17:55.059606 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1942/4436] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:54 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:17:55.064920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ca3945e3-b73d-4617-99fc-2e17dc41ad81 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:55.065451 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-35925a35-03ae-41d6-81cd-c988d79562ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.600424 Oct 12 22:17:55.066021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ca3945e3-b73d-4617-99fc-2e17dc41ad81 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:55.066158 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2495/4437] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 12 22:17:54 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00/os-interface => generated 1832 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:55.071229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-317bb48e-e98a-4641-802b-7588d6b1ce65 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '.version_select at 0x7f512341b5e0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:55.071879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-317bb48e-e98a-4641-802b-7588d6b1ce65 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:55.074277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca3945e3-b73d-4617-99fc-2e17dc41ad81 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:55.082318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca3945e3-b73d-4617-99fc-2e17dc41ad81 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:55.082780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca3945e3-b73d-4617-99fc-2e17dc41ad81 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:55.083546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca3945e3-b73d-4617-99fc-2e17dc41ad81 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:55.084258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca3945e3-b73d-4617-99fc-2e17dc41ad81 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:55.084390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-317bb48e-e98a-4641-802b-7588d6b1ce65 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:55.084873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-317bb48e-e98a-4641-802b-7588d6b1ce65 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:55.085151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca3945e3-b73d-4617-99fc-2e17dc41ad81 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:55.085316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-317bb48e-e98a-4641-802b-7588d6b1ce65 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:55.086587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-317bb48e-e98a-4641-802b-7588d6b1ce65 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:55.087049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-317bb48e-e98a-4641-802b-7588d6b1ce65 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:55.087511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-317bb48e-e98a-4641-802b-7588d6b1ce65 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:55.181083 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-317bb48e-e98a-4641-802b-7588d6b1ce65 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.113972 Oct 12 22:17:55.182505 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2496/4438] 10.222.0.16 () {60 vars in 1337 bytes} [Wed Oct 12 22:17:55 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2/os-instance-actions => generated 611 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:17:55.196779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f49e4494-fc21-4862-a2bf-755466a6cc71 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:55.197287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f49e4494-fc21-4862-a2bf-755466a6cc71 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:55.213484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f49e4494-fc21-4862-a2bf-755466a6cc71 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:55.217650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f49e4494-fc21-4862-a2bf-755466a6cc71 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:55.220563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f49e4494-fc21-4862-a2bf-755466a6cc71 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:55.221466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f49e4494-fc21-4862-a2bf-755466a6cc71 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:55.222082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f49e4494-fc21-4862-a2bf-755466a6cc71 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:55.222697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f49e4494-fc21-4862-a2bf-755466a6cc71 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:55.244574 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-f49e4494-fc21-4862-a2bf-755466a6cc71 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] HTTP exception thrown: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f49e4494-fc21-4862-a2bf-755466a6cc71 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Request method failure captured: Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 HTTP/1.1 Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzzwiCUB11ApZ1uL3qV-mrrh2nMG_PGkprGg_SuRPc18j-UYEOJPruFo8MXF2VtUIx7r-lk8SEuU492fMBWcBVuAvL3DNMGctbYWPftGXfS8Hl9ak1UdQBOdseycR5Fa2nIod3xO0fOoMuttRxQXLN3csgztnFUSYMLk-krAthsgfqU Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.21 Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: d68e79ea36f8462cb135f79be5b80ce0 Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2034441905 Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d68e79ea36f8462cb135f79be5b80ce0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d68e79ea36f8462cb135f79be5b80ce0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d68e79ea36f8462cb135f79be5b80ce0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d68e79ea36f8462cb135f79be5b80ce0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-InstanceActionsV221TestJSON-2034441905 Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: d68e79ea36f8462cb135f79be5b80ce0 Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2034441905 Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-InstanceActionsV221TestJSON-2034441905-project Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 27c6aba556084cb8a4063110d899604b Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-InstanceActionsV221TestJSON-2034441905-project Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '522963ce-473f-4d06-94a6-f329fc0d1fc2'} Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:17:55.256918 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:17:55.260814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. Oct 12 22:17:55.260814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:55.260814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:17:55.260814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:55.260814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:55.260814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:17:55.260814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:17:55.260814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:17:55.260814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:17:55.260814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. Oct 12 22:17:55.260814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:55.260814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f49e4494-fc21-4862-a2bf-755466a6cc71 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Returning 404 to user: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:17:55.260814 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f49e4494-fc21-4862-a2bf-755466a6cc71 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "DELETE /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 404 len: 111 microversion: 2.21 time: 0.066839 Oct 12 22:17:55.272026 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2497/4439] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:17:55 2022] DELETE /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 12 22:17:55.277175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-80ea63c0-faf7-4d21-9fb9-d0769a6cb307 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:55.288401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-80ea63c0-faf7-4d21-9fb9-d0769a6cb307 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] [instance: 522963ce-473f-4d06-94a6-f329fc0d1fc2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:55.301849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80ea63c0-faf7-4d21-9fb9-d0769a6cb307 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:55.302350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80ea63c0-faf7-4d21-9fb9-d0769a6cb307 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:55.302793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80ea63c0-faf7-4d21-9fb9-d0769a6cb307 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:55.303543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80ea63c0-faf7-4d21-9fb9-d0769a6cb307 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:55.304007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80ea63c0-faf7-4d21-9fb9-d0769a6cb307 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:55.305007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80ea63c0-faf7-4d21-9fb9-d0769a6cb307 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:55.327147 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-80ea63c0-faf7-4d21-9fb9-d0769a6cb307 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] HTTP exception thrown: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-80ea63c0-faf7-4d21-9fb9-d0769a6cb307 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Request method failure captured: Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 HTTP/1.1 Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzzwiCUB11ApZ1uL3qV-mrrh2nMG_PGkprGg_SuRPc18j-UYEOJPruFo8MXF2VtUIx7r-lk8SEuU492fMBWcBVuAvL3DNMGctbYWPftGXfS8Hl9ak1UdQBOdseycR5Fa2nIod3xO0fOoMuttRxQXLN3csgztnFUSYMLk-krAthsgfqU Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.21 Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: d68e79ea36f8462cb135f79be5b80ce0 Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2034441905 Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d68e79ea36f8462cb135f79be5b80ce0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d68e79ea36f8462cb135f79be5b80ce0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d68e79ea36f8462cb135f79be5b80ce0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d68e79ea36f8462cb135f79be5b80ce0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-InstanceActionsV221TestJSON-2034441905 Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: d68e79ea36f8462cb135f79be5b80ce0 Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2034441905 Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-InstanceActionsV221TestJSON-2034441905-project Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 27c6aba556084cb8a4063110d899604b Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-InstanceActionsV221TestJSON-2034441905-project Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '522963ce-473f-4d06-94a6-f329fc0d1fc2'} Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:55.329256 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:17:55.332521 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:55.332521 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:55.332521 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:17:55.332521 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:17:55.332521 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:17:55.332521 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:17:55.332521 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. Oct 12 22:17:55.332521 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:55.332521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-80ea63c0-faf7-4d21-9fb9-d0769a6cb307 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] Returning 404 to user: Instance 522963ce-473f-4d06-94a6-f329fc0d1fc2 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:17:55.332521 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-80ea63c0-faf7-4d21-9fb9-d0769a6cb307 tempest-InstanceActionsV221TestJSON-2034441905 tempest-InstanceActionsV221TestJSON-2034441905-project] 10.222.0.16 "GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2" status: 404 len: 111 microversion: 2.21 time: 0.057738 Oct 12 22:17:55.332521 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2498/4440] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:55 2022] GET /compute/v2.1/servers/522963ce-473f-4d06-94a6-f329fc0d1fc2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:17:55.489926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-280b5ccc-01a2-4c55-82db-85c8f7436938 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:55.490706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-280b5ccc-01a2-4c55-82db-85c8f7436938 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:55.504363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-280b5ccc-01a2-4c55-82db-85c8f7436938 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:55.505428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-280b5ccc-01a2-4c55-82db-85c8f7436938 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:55.506192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-280b5ccc-01a2-4c55-82db-85c8f7436938 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:55.509001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-280b5ccc-01a2-4c55-82db-85c8f7436938 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:55.509635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-280b5ccc-01a2-4c55-82db-85c8f7436938 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:55.510080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-280b5ccc-01a2-4c55-82db-85c8f7436938 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:55.640684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ca3945e3-b73d-4617-99fc-2e17dc41ad81 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:55.656506 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ca3945e3-b73d-4617-99fc-2e17dc41ad81 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1712 microversion: 2.1 time: 0.595510 Oct 12 22:17:55.658055 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1943/4441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:55 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1712 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:55.663417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-716f271f-058b-4fd3-bc65-fb43850f7017 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:55.664885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-716f271f-058b-4fd3-bc65-fb43850f7017 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:55.671204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716f271f-058b-4fd3-bc65-fb43850f7017 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:55.672039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716f271f-058b-4fd3-bc65-fb43850f7017 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:55.672700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716f271f-058b-4fd3-bc65-fb43850f7017 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:55.673631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716f271f-058b-4fd3-bc65-fb43850f7017 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:55.674323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716f271f-058b-4fd3-bc65-fb43850f7017 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:55.674952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716f271f-058b-4fd3-bc65-fb43850f7017 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:55.860276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-716f271f-058b-4fd3-bc65-fb43850f7017 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:55.894962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-716f271f-058b-4fd3-bc65-fb43850f7017 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:55.904982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-716f271f-058b-4fd3-bc65-fb43850f7017 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:55.906897 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-716f271f-058b-4fd3-bc65-fb43850f7017 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.247278 Oct 12 22:17:55.926322 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1944/4442] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:55 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:55.995394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e001f9b9-2d9c-498b-8ebd-4c622d24004b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:55.996332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e001f9b9-2d9c-498b-8ebd-4c622d24004b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:56.009368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e001f9b9-2d9c-498b-8ebd-4c622d24004b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:56.010532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e001f9b9-2d9c-498b-8ebd-4c622d24004b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:56.011179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e001f9b9-2d9c-498b-8ebd-4c622d24004b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:56.013756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e001f9b9-2d9c-498b-8ebd-4c622d24004b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:56.015002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e001f9b9-2d9c-498b-8ebd-4c622d24004b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:56.019499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e001f9b9-2d9c-498b-8ebd-4c622d24004b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:56.064395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-280b5ccc-01a2-4c55-82db-85c8f7436938 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:56.087472 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-280b5ccc-01a2-4c55-82db-85c8f7436938 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1510 microversion: 2.1 time: 0.599158 Oct 12 22:17:56.110148 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2499/4443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:55 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1510 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:17:56.127072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-54b7558b-6a63-419a-a0f6-4938eb26e216 req-57698207-fab5-4c08-b226-d6385d068451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93c312a-dce8-4a49-9942-515527b3103f", "name": "network-vif-deleted", "tag": "60debe36-34ee-4c09-8e82-1896cb229077"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:56.149953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-54b7558b-6a63-419a-a0f6-4938eb26e216 req-57698207-fab5-4c08-b226-d6385d068451 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:56.163073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-54b7558b-6a63-419a-a0f6-4938eb26e216 req-57698207-fab5-4c08-b226-d6385d068451 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:56.164274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-54b7558b-6a63-419a-a0f6-4938eb26e216 req-57698207-fab5-4c08-b226-d6385d068451 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:56.205350 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-54b7558b-6a63-419a-a0f6-4938eb26e216 req-57698207-fab5-4c08-b226-d6385d068451 service nova] Creating event network-vif-deleted:60debe36-34ee-4c09-8e82-1896cb229077 for instance d93c312a-dce8-4a49-9942-515527b3103f on n-h1-861111-1 Oct 12 22:17:56.213837 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-54b7558b-6a63-419a-a0f6-4938eb26e216 req-57698207-fab5-4c08-b226-d6385d068451 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101242 Oct 12 22:17:56.218944 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2500/4444] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:17:56.322260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-68684c49-553d-49a0-9625-e4bd946776d0 req-c8db6096-5c88-4c14-a199-c2c0185e041d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642", "name": "network-vif-plugged", "status": "completed", "tag": "8e2b35e6-0fa9-488d-886e-79503ed3c9fb"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:56.324856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e001f9b9-2d9c-498b-8ebd-4c622d24004b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ae2ddba1d412e96e40782c6b46337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5493a20eda476e8843381f175baf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:56.341378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-68684c49-553d-49a0-9625-e4bd946776d0 req-c8db6096-5c88-4c14-a199-c2c0185e041d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:56.344076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-68684c49-553d-49a0-9625-e4bd946776d0 req-c8db6096-5c88-4c14-a199-c2c0185e041d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:56.344759 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e001f9b9-2d9c-498b-8ebd-4c622d24004b tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 200 len: 1485 microversion: 2.1 time: 0.352334 Oct 12 22:17:56.345519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-68684c49-553d-49a0-9625-e4bd946776d0 req-c8db6096-5c88-4c14-a199-c2c0185e041d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:56.364168 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1945/4445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:55 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 1485 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:56.424920 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-68684c49-553d-49a0-9625-e4bd946776d0 req-c8db6096-5c88-4c14-a199-c2c0185e041d service nova] Creating event network-vif-plugged:8e2b35e6-0fa9-488d-886e-79503ed3c9fb for instance e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 on n-h1-861111-1 Oct 12 22:17:56.434387 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-68684c49-553d-49a0-9625-e4bd946776d0 req-c8db6096-5c88-4c14-a199-c2c0185e041d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116959 Oct 12 22:17:56.438778 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2501/4446] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:17:56.687705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3ebb40bb-228f-4294-a80b-0bea0696798b tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:56.688327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3ebb40bb-228f-4294-a80b-0bea0696798b tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:56.698502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ebb40bb-228f-4294-a80b-0bea0696798b tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:56.710591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ebb40bb-228f-4294-a80b-0bea0696798b tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:56.714278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ebb40bb-228f-4294-a80b-0bea0696798b tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:56.715781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ebb40bb-228f-4294-a80b-0bea0696798b tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:56.718450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ebb40bb-228f-4294-a80b-0bea0696798b tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:56.721397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ebb40bb-228f-4294-a80b-0bea0696798b tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:56.939592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c3e5a548-8126-42bb-a8b3-c3c30a42097b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:56.940875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c3e5a548-8126-42bb-a8b3-c3c30a42097b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:56.987729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3e5a548-8126-42bb-a8b3-c3c30a42097b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:56.991557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3e5a548-8126-42bb-a8b3-c3c30a42097b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:56.992332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3e5a548-8126-42bb-a8b3-c3c30a42097b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:56.993271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3e5a548-8126-42bb-a8b3-c3c30a42097b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:56.994985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3e5a548-8126-42bb-a8b3-c3c30a42097b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:56.996890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3e5a548-8126-42bb-a8b3-c3c30a42097b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:57.199610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3ebb40bb-228f-4294-a80b-0bea0696798b tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:57.215982 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3ebb40bb-228f-4294-a80b-0bea0696798b tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1645 microversion: 2.1 time: 0.534286 Oct 12 22:17:57.231751 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1946/4447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:56 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1645 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:57.238695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ceb8d2a4-8c1c-42ca-839e-dea22122dead tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:57.239653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ceb8d2a4-8c1c-42ca-839e-dea22122dead tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:57.246633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceb8d2a4-8c1c-42ca-839e-dea22122dead tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:57.247465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceb8d2a4-8c1c-42ca-839e-dea22122dead tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:57.248109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceb8d2a4-8c1c-42ca-839e-dea22122dead tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:57.249054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceb8d2a4-8c1c-42ca-839e-dea22122dead tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:57.249712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceb8d2a4-8c1c-42ca-839e-dea22122dead tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:57.250349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ceb8d2a4-8c1c-42ca-839e-dea22122dead tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:57.379144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c3e5a548-8126-42bb-a8b3-c3c30a42097b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:57.395435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c3e5a548-8126-42bb-a8b3-c3c30a42097b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:57.401466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c3e5a548-8126-42bb-a8b3-c3c30a42097b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:57.401466 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c3e5a548-8126-42bb-a8b3-c3c30a42097b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.466069 Oct 12 22:17:57.408138 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2502/4448] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:56 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:17:57.433507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aa60b285-1dea-473e-a8a4-d2bfc62cc9e1 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:57.434136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aa60b285-1dea-473e-a8a4-d2bfc62cc9e1 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] [instance: d93c312a-dce8-4a49-9942-515527b3103f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:57.444475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:57.449454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa60b285-1dea-473e-a8a4-d2bfc62cc9e1 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:57.449942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa60b285-1dea-473e-a8a4-d2bfc62cc9e1 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:57.450564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa60b285-1dea-473e-a8a4-d2bfc62cc9e1 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:57.451678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa60b285-1dea-473e-a8a4-d2bfc62cc9e1 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:57.459957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa60b285-1dea-473e-a8a4-d2bfc62cc9e1 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:57.460699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa60b285-1dea-473e-a8a4-d2bfc62cc9e1 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:57.504066 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-aa60b285-1dea-473e-a8a4-d2bfc62cc9e1 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] HTTP exception thrown: Instance d93c312a-dce8-4a49-9942-515527b3103f could not be found. Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aa60b285-1dea-473e-a8a4-d2bfc62cc9e1 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Request method failure captured: Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f HTTP/1.1 Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzz6h4n_cE2xA_lgk9J35YkvEZdbhpFfWMI3Nhwz3ldpfuz7ug5pgDe0aKBkhE6WTDYCvIAmu2MXf3g0nHSOzQ5aFWZwnSWhWjJrY80-O9sXznDeGlLdiN6lpif5Z0YWbRLHmcNOdUX6hJlI2-q4itdhwQ36U9ucN2-0IZJ0VRoITMM Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1a5493a20eda476e8843381f175baf1b Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1839918939 Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5493a20eda476e8843381f175baf1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a5493a20eda476e8843381f175baf1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a5493a20eda476e8843381f175baf1b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a5493a20eda476e8843381f175baf1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1839918939 Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1a5493a20eda476e8843381f175baf1b Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1839918939 Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-InstanceActionsNegativeTestJSON-1839918939-project Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 519ae2ddba1d412e96e40782c6b46337 Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1839918939-project Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance d93c312a-dce8-4a49-9942-515527b3103f could not be found. Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'd93c312a-dce8-4a49-9942-515527b3103f'} Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93c312a-dce8-4a49-9942-515527b3103f could not be found. Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93c312a-dce8-4a49-9942-515527b3103f could not be found. Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:57.506046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:17:57.509803 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:57.509803 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:57.509803 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:17:57.509803 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:17:57.509803 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:17:57.509803 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:17:57.509803 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93c312a-dce8-4a49-9942-515527b3103f could not be found. Oct 12 22:17:57.509803 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:17:57.511207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aa60b285-1dea-473e-a8a4-d2bfc62cc9e1 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] Returning 404 to user: Instance d93c312a-dce8-4a49-9942-515527b3103f could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:17:57.512331 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aa60b285-1dea-473e-a8a4-d2bfc62cc9e1 tempest-InstanceActionsNegativeTestJSON-1839918939 tempest-InstanceActionsNegativeTestJSON-1839918939-project] 10.222.0.16 "GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f" status: 404 len: 111 microversion: 2.1 time: 0.103131 Oct 12 22:17:57.516431 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2503/4449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:57 2022] GET /compute/v2.1/servers/d93c312a-dce8-4a49-9942-515527b3103f => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:17:57.819557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ceb8d2a4-8c1c-42ca-839e-dea22122dead tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:57.837616 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ceb8d2a4-8c1c-42ca-839e-dea22122dead tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1510 microversion: 2.1 time: 0.603109 Oct 12 22:17:57.838407 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1947/4450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:57 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1510 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:58.243329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-505e216b-81b8-41a2-9f5e-4547a1b71ab1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:58.243952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-505e216b-81b8-41a2-9f5e-4547a1b71ab1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:58.264673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-505e216b-81b8-41a2-9f5e-4547a1b71ab1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:58.265333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-505e216b-81b8-41a2-9f5e-4547a1b71ab1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:58.265945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-505e216b-81b8-41a2-9f5e-4547a1b71ab1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:58.266797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-505e216b-81b8-41a2-9f5e-4547a1b71ab1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:58.267442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-505e216b-81b8-41a2-9f5e-4547a1b71ab1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:58.268018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-505e216b-81b8-41a2-9f5e-4547a1b71ab1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:58.270398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-903fc404-2cd0-48f4-8c13-42da74b394d2 req-8166e8d8-7da7-4047-aa4d-cfe696a7c5fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36c67e5-7222-4dc7-a676-7a533420b956", "name": "network-vif-deleted", "tag": "bff8a9cc-f808-44cf-8562-6821ab7f4770"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:17:58.328631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-903fc404-2cd0-48f4-8c13-42da74b394d2 req-8166e8d8-7da7-4047-aa4d-cfe696a7c5fa service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:58.329187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-903fc404-2cd0-48f4-8c13-42da74b394d2 req-8166e8d8-7da7-4047-aa4d-cfe696a7c5fa service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:58.334557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-903fc404-2cd0-48f4-8c13-42da74b394d2 req-8166e8d8-7da7-4047-aa4d-cfe696a7c5fa service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:58.344367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-505e216b-81b8-41a2-9f5e-4547a1b71ab1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:58.344367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-505e216b-81b8-41a2-9f5e-4547a1b71ab1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:58.344367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-505e216b-81b8-41a2-9f5e-4547a1b71ab1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:58.344614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-505e216b-81b8-41a2-9f5e-4547a1b71ab1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lazy-loading 'fault' on Instance uuid a36c67e5-7222-4dc7-a676-7a533420b956 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:17:58.376386 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-903fc404-2cd0-48f4-8c13-42da74b394d2 req-8166e8d8-7da7-4047-aa4d-cfe696a7c5fa service nova] Creating event network-vif-deleted:bff8a9cc-f808-44cf-8562-6821ab7f4770 for instance a36c67e5-7222-4dc7-a676-7a533420b956 on n-h1-861111-1 Oct 12 22:17:58.399076 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-903fc404-2cd0-48f4-8c13-42da74b394d2 req-8166e8d8-7da7-4047-aa4d-cfe696a7c5fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140833 Oct 12 22:17:58.411961 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1948/4451] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:17:58.438725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c40577f3-abb2-48ae-9a5f-cd69bb3562e2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:58.442132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c40577f3-abb2-48ae-9a5f-cd69bb3562e2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:58.468729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c40577f3-abb2-48ae-9a5f-cd69bb3562e2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:58.469238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c40577f3-abb2-48ae-9a5f-cd69bb3562e2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:58.469686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c40577f3-abb2-48ae-9a5f-cd69bb3562e2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:58.470412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c40577f3-abb2-48ae-9a5f-cd69bb3562e2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:58.470872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c40577f3-abb2-48ae-9a5f-cd69bb3562e2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:58.471332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c40577f3-abb2-48ae-9a5f-cd69bb3562e2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:58.572961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-505e216b-81b8-41a2-9f5e-4547a1b71ab1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a0d9b605d543b79d1cd9065187ed3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fd7e7319ef437cb50910cd8ad84b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:58.592073 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-505e216b-81b8-41a2-9f5e-4547a1b71ab1 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 200 len: 1366 microversion: 2.1 time: 0.345673 Oct 12 22:17:58.593458 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2504/4452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:58 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:17:58.691645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c40577f3-abb2-48ae-9a5f-cd69bb3562e2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:58.710993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c40577f3-abb2-48ae-9a5f-cd69bb3562e2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:58.713878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c40577f3-abb2-48ae-9a5f-cd69bb3562e2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:17:58.718246 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c40577f3-abb2-48ae-9a5f-cd69bb3562e2 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.287668 Oct 12 22:17:58.721176 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1949/4453] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:58 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:17:58.862741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b9dc9f56-1a3c-4ede-b005-df1060bf3baa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:58.863554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b9dc9f56-1a3c-4ede-b005-df1060bf3baa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:58.886882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9dc9f56-1a3c-4ede-b005-df1060bf3baa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:58.889758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9dc9f56-1a3c-4ede-b005-df1060bf3baa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:58.890423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9dc9f56-1a3c-4ede-b005-df1060bf3baa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:58.892056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9dc9f56-1a3c-4ede-b005-df1060bf3baa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:58.900025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9dc9f56-1a3c-4ede-b005-df1060bf3baa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:58.907647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9dc9f56-1a3c-4ede-b005-df1060bf3baa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:59.616182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-55d36561-ae56-4f34-b0ce-2fc4608e5139 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:59.617375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-55d36561-ae56-4f34-b0ce-2fc4608e5139 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] [instance: a36c67e5-7222-4dc7-a676-7a533420b956] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:59.634006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55d36561-ae56-4f34-b0ce-2fc4608e5139 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:59.637934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55d36561-ae56-4f34-b0ce-2fc4608e5139 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:59.640608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55d36561-ae56-4f34-b0ce-2fc4608e5139 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:59.643868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55d36561-ae56-4f34-b0ce-2fc4608e5139 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:59.646442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55d36561-ae56-4f34-b0ce-2fc4608e5139 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:59.647685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55d36561-ae56-4f34-b0ce-2fc4608e5139 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:59.702685 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-55d36561-ae56-4f34-b0ce-2fc4608e5139 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] HTTP exception thrown: Instance a36c67e5-7222-4dc7-a676-7a533420b956 could not be found. Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-55d36561-ae56-4f34-b0ce-2fc4608e5139 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Request method failure captured: Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 HTTP/1.1 Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzzHi7BbVuzYmmITaEaKijKugX9_QJxHFdaoMpC0Xi3_74WfK7FltLClPlG1CQH7bkmmmmIC5fu119E42nEP-464Vv3cAC1cMtMnshrbxnrLfJ89N-iFsz4ELVxNR8-wTqmUy52g_KORlNQYb7Sr2VzyDNkBAeJg0L8F5dX0VRVHDj8 Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: a4fd7e7319ef437cb50910cd8ad84b7a Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersTestManualDisk-1423611330 Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4fd7e7319ef437cb50910cd8ad84b7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4fd7e7319ef437cb50910cd8ad84b7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a4fd7e7319ef437cb50910cd8ad84b7a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a4fd7e7319ef437cb50910cd8ad84b7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersTestManualDisk-1423611330 Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: a4fd7e7319ef437cb50910cd8ad84b7a Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersTestManualDisk-1423611330 Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersTestManualDisk-1423611330-project Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 89a0d9b605d543b79d1cd9065187ed3d Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersTestManualDisk-1423611330-project Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance a36c67e5-7222-4dc7-a676-7a533420b956 could not be found. Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'a36c67e5-7222-4dc7-a676-7a533420b956'} Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a36c67e5-7222-4dc7-a676-7a533420b956 could not be found. Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a36c67e5-7222-4dc7-a676-7a533420b956 could not be found. Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:17:59.710045 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:59.714856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:17:59.714856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:17:59.714856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:17:59.714856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:17:59.714856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:17:59.714856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a36c67e5-7222-4dc7-a676-7a533420b956 could not be found. Oct 12 22:17:59.714856 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:17:59.723165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-55d36561-ae56-4f34-b0ce-2fc4608e5139 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Returning 404 to user: Instance a36c67e5-7222-4dc7-a676-7a533420b956 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:17:59.726756 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-55d36561-ae56-4f34-b0ce-2fc4608e5139 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956" status: 404 len: 111 microversion: 2.1 time: 0.114578 Oct 12 22:17:59.731626 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1950/4454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:59 2022] GET /compute/v2.1/servers/a36c67e5-7222-4dc7-a676-7a533420b956 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:17:59.743793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2724d750-5482-4cdf-b718-0d043821fba5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] Calling method '.version_select at 0x7f512862db80>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:59.792902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:17:59.804952 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2724d750-5482-4cdf-b718-0d043821fba5 tempest-ServersTestManualDisk-1423611330 tempest-ServersTestManualDisk-1423611330-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-134388822" status: 202 len: 0 microversion: 2.1 time: 0.069560 Oct 12 22:17:59.816325 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1951/4455] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 12 22:17:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-134388822 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:17:59.822028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3142085e-62e2-4513-981b-79ebc8a71eb7 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:17:59.822656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3142085e-62e2-4513-981b-79ebc8a71eb7 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:17:59.842905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3142085e-62e2-4513-981b-79ebc8a71eb7 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:59.843446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3142085e-62e2-4513-981b-79ebc8a71eb7 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:59.843900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3142085e-62e2-4513-981b-79ebc8a71eb7 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:17:59.844625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3142085e-62e2-4513-981b-79ebc8a71eb7 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:17:59.845088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3142085e-62e2-4513-981b-79ebc8a71eb7 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:17:59.845518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3142085e-62e2-4513-981b-79ebc8a71eb7 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:00.048956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b9dc9f56-1a3c-4ede-b005-df1060bf3baa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:00.065991 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b9dc9f56-1a3c-4ede-b005-df1060bf3baa tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1510 microversion: 2.1 time: 1.206206 Oct 12 22:18:00.067981 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2505/4456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:17:58 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1510 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:00.112550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-b38f2246-a767-4802-9169-ee44aee0d7ae req-6c414f46-34f6-48b5-bbba-0dfc7dca9235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "tag": "a21af4ca-546d-4eb8-a73d-42ffccc0349b"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:00.139972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b38f2246-a767-4802-9169-ee44aee0d7ae req-6c414f46-34f6-48b5-bbba-0dfc7dca9235 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:00.143386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b38f2246-a767-4802-9169-ee44aee0d7ae req-6c414f46-34f6-48b5-bbba-0dfc7dca9235 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:00.145398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b38f2246-a767-4802-9169-ee44aee0d7ae req-6c414f46-34f6-48b5-bbba-0dfc7dca9235 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:00.151000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3142085e-62e2-4513-981b-79ebc8a71eb7 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:00.159850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3142085e-62e2-4513-981b-79ebc8a71eb7 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:00.161371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3142085e-62e2-4513-981b-79ebc8a71eb7 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:00.162605 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3142085e-62e2-4513-981b-79ebc8a71eb7 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1408 microversion: 2.54 time: 0.344960 Oct 12 22:18:00.188396 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1952/4457] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:17:59 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1408 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:18:00.200435 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-b38f2246-a767-4802-9169-ee44aee0d7ae req-6c414f46-34f6-48b5-bbba-0dfc7dca9235 service nova] Creating event network-changed:a21af4ca-546d-4eb8-a73d-42ffccc0349b for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:18:00.220225 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-b38f2246-a767-4802-9169-ee44aee0d7ae req-6c414f46-34f6-48b5-bbba-0dfc7dca9235 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108773 Oct 12 22:18:00.224031 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2506/4458] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:18:01.090973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-888a8f2d-da35-4a1c-a3d6-b99c48308649 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:01.091639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-888a8f2d-da35-4a1c-a3d6-b99c48308649 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:01.106247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-888a8f2d-da35-4a1c-a3d6-b99c48308649 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:01.106681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-888a8f2d-da35-4a1c-a3d6-b99c48308649 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:01.109416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-888a8f2d-da35-4a1c-a3d6-b99c48308649 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:01.110191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-888a8f2d-da35-4a1c-a3d6-b99c48308649 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:01.112638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-888a8f2d-da35-4a1c-a3d6-b99c48308649 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:01.113116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-888a8f2d-da35-4a1c-a3d6-b99c48308649 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:01.192330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-350bb71d-33e0-49e8-8640-ca47f516e576 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:01.193054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-350bb71d-33e0-49e8-8640-ca47f516e576 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:01.197036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:01.198380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:01.210462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-350bb71d-33e0-49e8-8640-ca47f516e576 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:01.212215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-350bb71d-33e0-49e8-8640-ca47f516e576 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:01.214989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-350bb71d-33e0-49e8-8640-ca47f516e576 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:01.215969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-350bb71d-33e0-49e8-8640-ca47f516e576 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:01.220565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-350bb71d-33e0-49e8-8640-ca47f516e576 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:01.221307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-350bb71d-33e0-49e8-8640-ca47f516e576 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:01.540496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-888a8f2d-da35-4a1c-a3d6-b99c48308649 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:01.552569 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-888a8f2d-da35-4a1c-a3d6-b99c48308649 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1510 microversion: 2.1 time: 0.465615 Oct 12 22:18:01.553618 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1953/4459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:01 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1510 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:01.666793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-350bb71d-33e0-49e8-8640-ca47f516e576 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:01.670198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:01.681540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-350bb71d-33e0-49e8-8640-ca47f516e576 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:01.698248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-350bb71d-33e0-49e8-8640-ca47f516e576 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:01.700081 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-350bb71d-33e0-49e8-8640-ca47f516e576 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1414 microversion: 2.54 time: 0.512002 Oct 12 22:18:01.700801 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2507/4460] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:18:01 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1414 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:18:02.581170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-28caa5d4-e236-4591-8ac1-5b603e01dd34 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:02.582429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-28caa5d4-e236-4591-8ac1-5b603e01dd34 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:02.604106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28caa5d4-e236-4591-8ac1-5b603e01dd34 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:02.605078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28caa5d4-e236-4591-8ac1-5b603e01dd34 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:02.605761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28caa5d4-e236-4591-8ac1-5b603e01dd34 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:02.606722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28caa5d4-e236-4591-8ac1-5b603e01dd34 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:02.609088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28caa5d4-e236-4591-8ac1-5b603e01dd34 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:02.610308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28caa5d4-e236-4591-8ac1-5b603e01dd34 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:02.733065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-896b4640-af94-42c7-b524-338d1ab98f48 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:02.734781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-896b4640-af94-42c7-b524-338d1ab98f48 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:02.753962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-896b4640-af94-42c7-b524-338d1ab98f48 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:02.755937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-896b4640-af94-42c7-b524-338d1ab98f48 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:02.758560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-896b4640-af94-42c7-b524-338d1ab98f48 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:02.759800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-896b4640-af94-42c7-b524-338d1ab98f48 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:02.761467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-896b4640-af94-42c7-b524-338d1ab98f48 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:02.764353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-896b4640-af94-42c7-b524-338d1ab98f48 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:03.242387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-28caa5d4-e236-4591-8ac1-5b603e01dd34 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:03.251407 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-28caa5d4-e236-4591-8ac1-5b603e01dd34 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1510 microversion: 2.1 time: 0.675498 Oct 12 22:18:03.267400 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1954/4461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:02 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1510 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:03.494865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-896b4640-af94-42c7-b524-338d1ab98f48 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:03.512261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-896b4640-af94-42c7-b524-338d1ab98f48 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:03.514700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-896b4640-af94-42c7-b524-338d1ab98f48 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:03.518495 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-896b4640-af94-42c7-b524-338d1ab98f48 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1414 microversion: 2.54 time: 0.791145 Oct 12 22:18:03.543260 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2508/4462] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:18:02 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1414 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:18:04.280989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4b69b473-414b-4e93-855a-b965303fab26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:04.283038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4b69b473-414b-4e93-855a-b965303fab26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:04.301859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b69b473-414b-4e93-855a-b965303fab26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:04.302350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b69b473-414b-4e93-855a-b965303fab26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:04.317912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b69b473-414b-4e93-855a-b965303fab26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:04.318834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b69b473-414b-4e93-855a-b965303fab26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:04.323441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b69b473-414b-4e93-855a-b965303fab26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:04.329242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b69b473-414b-4e93-855a-b965303fab26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:04.551388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cc3ce57e-699c-41d2-8848-d816632ba279 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:04.552054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cc3ce57e-699c-41d2-8848-d816632ba279 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:04.564807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc3ce57e-699c-41d2-8848-d816632ba279 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:04.566312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc3ce57e-699c-41d2-8848-d816632ba279 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:04.568231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc3ce57e-699c-41d2-8848-d816632ba279 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:04.570376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc3ce57e-699c-41d2-8848-d816632ba279 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:04.571019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc3ce57e-699c-41d2-8848-d816632ba279 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:04.572556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc3ce57e-699c-41d2-8848-d816632ba279 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:04.698466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cc3ce57e-699c-41d2-8848-d816632ba279 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:04.710693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cc3ce57e-699c-41d2-8848-d816632ba279 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:04.714100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cc3ce57e-699c-41d2-8848-d816632ba279 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:04.717431 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cc3ce57e-699c-41d2-8848-d816632ba279 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1414 microversion: 2.54 time: 0.171323 Oct 12 22:18:04.722039 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2509/4463] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:18:04 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1414 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:18:05.183988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4b69b473-414b-4e93-855a-b965303fab26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:05.201624 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4b69b473-414b-4e93-855a-b965303fab26 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1510 microversion: 2.1 time: 0.928480 Oct 12 22:18:05.215269 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1955/4464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:04 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1510 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:05.761711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c667e472-3137-4654-b57b-10aaf0fbdc31 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:05.764147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c667e472-3137-4654-b57b-10aaf0fbdc31 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:05.783263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c667e472-3137-4654-b57b-10aaf0fbdc31 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:05.784278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c667e472-3137-4654-b57b-10aaf0fbdc31 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:05.784949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c667e472-3137-4654-b57b-10aaf0fbdc31 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:05.785846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c667e472-3137-4654-b57b-10aaf0fbdc31 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:05.786546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c667e472-3137-4654-b57b-10aaf0fbdc31 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:05.787138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c667e472-3137-4654-b57b-10aaf0fbdc31 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:05.953485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c667e472-3137-4654-b57b-10aaf0fbdc31 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:05.970825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c667e472-3137-4654-b57b-10aaf0fbdc31 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:05.973666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c667e472-3137-4654-b57b-10aaf0fbdc31 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:05.982235 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c667e472-3137-4654-b57b-10aaf0fbdc31 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1399 microversion: 2.54 time: 0.232377 Oct 12 22:18:05.983525 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2510/4465] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:18:05 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1399 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:18:06.015694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d4de599d-d035-4dc0-a162-f8cead15637b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '.version_select at 0x7f51286639d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:06.067815 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d4de599d-d035-4dc0-a162-f8cead15637b tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-654743225" status: 204 len: 0 microversion: 2.54 time: 0.044571 Oct 12 22:18:06.069301 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1956/4466] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 12 22:18:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-654743225 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:18:06.089517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-318e277a-c43b-4935-b4f7-83760148ce88 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:06.091909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-318e277a-c43b-4935-b4f7-83760148ce88 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:06.126092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-318e277a-c43b-4935-b4f7-83760148ce88 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:06.128013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-318e277a-c43b-4935-b4f7-83760148ce88 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:06.131212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-318e277a-c43b-4935-b4f7-83760148ce88 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:06.132377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-318e277a-c43b-4935-b4f7-83760148ce88 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:06.135908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-318e277a-c43b-4935-b4f7-83760148ce88 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:06.138016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-318e277a-c43b-4935-b4f7-83760148ce88 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:06.185115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-318e277a-c43b-4935-b4f7-83760148ce88 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:18:06.232658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4967fb71-5db1-416e-a301-95b6b4140d5f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:06.244113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4967fb71-5db1-416e-a301-95b6b4140d5f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:06.265301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4967fb71-5db1-416e-a301-95b6b4140d5f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:06.265812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4967fb71-5db1-416e-a301-95b6b4140d5f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:06.266259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4967fb71-5db1-416e-a301-95b6b4140d5f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:06.271766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4967fb71-5db1-416e-a301-95b6b4140d5f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:06.272522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4967fb71-5db1-416e-a301-95b6b4140d5f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:06.273180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4967fb71-5db1-416e-a301-95b6b4140d5f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:06.419736 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-318e277a-c43b-4935-b4f7-83760148ce88 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "DELETE /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 204 len: 0 microversion: 2.54 time: 0.339553 Oct 12 22:18:06.422473 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2511/4467] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:18:06 2022] DELETE /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:18:06.438026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2cb2b483-2575-4802-b620-1ff284212a60 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:06.441349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2cb2b483-2575-4802-b620-1ff284212a60 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:06.458326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb2b483-2575-4802-b620-1ff284212a60 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:06.461540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb2b483-2575-4802-b620-1ff284212a60 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:06.462562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb2b483-2575-4802-b620-1ff284212a60 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:06.464224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb2b483-2575-4802-b620-1ff284212a60 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:06.466048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb2b483-2575-4802-b620-1ff284212a60 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:06.466687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb2b483-2575-4802-b620-1ff284212a60 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:06.857665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2cb2b483-2575-4802-b620-1ff284212a60 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:06.867276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2cb2b483-2575-4802-b620-1ff284212a60 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:06.868775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2cb2b483-2575-4802-b620-1ff284212a60 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:06.880852 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2cb2b483-2575-4802-b620-1ff284212a60 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1405 microversion: 2.54 time: 0.453235 Oct 12 22:18:06.881741 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2512/4468] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:18:06 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:18:07.280205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4967fb71-5db1-416e-a301-95b6b4140d5f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:07.297487 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4967fb71-5db1-416e-a301-95b6b4140d5f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1510 microversion: 2.1 time: 1.070174 Oct 12 22:18:07.298979 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1957/4469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:06 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1510 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:07.911662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-989f9baa-39f4-433a-8c6b-074fb6efe1b9 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:07.912483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-989f9baa-39f4-433a-8c6b-074fb6efe1b9 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:07.925530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-989f9baa-39f4-433a-8c6b-074fb6efe1b9 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:07.926027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-989f9baa-39f4-433a-8c6b-074fb6efe1b9 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:07.926468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-989f9baa-39f4-433a-8c6b-074fb6efe1b9 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:07.927185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-989f9baa-39f4-433a-8c6b-074fb6efe1b9 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:07.927672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-989f9baa-39f4-433a-8c6b-074fb6efe1b9 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:07.928102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-989f9baa-39f4-433a-8c6b-074fb6efe1b9 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:08.181029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-989f9baa-39f4-433a-8c6b-074fb6efe1b9 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:08.192885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-989f9baa-39f4-433a-8c6b-074fb6efe1b9 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:08.194460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-989f9baa-39f4-433a-8c6b-074fb6efe1b9 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:08.195825 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-989f9baa-39f4-433a-8c6b-074fb6efe1b9 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1405 microversion: 2.54 time: 0.288723 Oct 12 22:18:08.211736 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2513/4470] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:18:07 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1405 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:18:08.323659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8013fe71-021d-4fa9-b42b-29038712f6ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:08.324350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8013fe71-021d-4fa9-b42b-29038712f6ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:08.354241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8013fe71-021d-4fa9-b42b-29038712f6ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:08.357030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8013fe71-021d-4fa9-b42b-29038712f6ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:08.357030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8013fe71-021d-4fa9-b42b-29038712f6ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:08.357030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8013fe71-021d-4fa9-b42b-29038712f6ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:08.359635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8013fe71-021d-4fa9-b42b-29038712f6ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:08.360242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8013fe71-021d-4fa9-b42b-29038712f6ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:08.375434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:08.929745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8013fe71-021d-4fa9-b42b-29038712f6ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:08.942863 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8013fe71-021d-4fa9-b42b-29038712f6ea tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1510 microversion: 2.1 time: 0.623006 Oct 12 22:18:08.945000 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1958/4471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:08 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1510 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:09.248647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-68ff3735-9c3c-4bde-9775-23f5395523d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:09.251954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-68ff3735-9c3c-4bde-9775-23f5395523d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:09.281877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68ff3735-9c3c-4bde-9775-23f5395523d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:09.284844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68ff3735-9c3c-4bde-9775-23f5395523d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:09.287905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68ff3735-9c3c-4bde-9775-23f5395523d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:09.289527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68ff3735-9c3c-4bde-9775-23f5395523d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:09.293944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68ff3735-9c3c-4bde-9775-23f5395523d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:09.294579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68ff3735-9c3c-4bde-9775-23f5395523d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:09.673743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-68ff3735-9c3c-4bde-9775-23f5395523d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:09.704580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-68ff3735-9c3c-4bde-9775-23f5395523d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:09.717390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-68ff3735-9c3c-4bde-9775-23f5395523d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c98f8f74048434391366b25d0c539f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0382ff053c849d19c8fbeac978b7bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:09.725323 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-68ff3735-9c3c-4bde-9775-23f5395523d4 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 200 len: 1405 microversion: 2.54 time: 0.487289 Oct 12 22:18:09.735633 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2514/4472] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:18:09 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 1405 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:18:09.977810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d874f0af-8503-4354-bdb7-c015bf4aa269 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:09.978551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d874f0af-8503-4354-bdb7-c015bf4aa269 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:10.008376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d874f0af-8503-4354-bdb7-c015bf4aa269 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:10.011918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d874f0af-8503-4354-bdb7-c015bf4aa269 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:10.014325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d874f0af-8503-4354-bdb7-c015bf4aa269 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:10.017716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d874f0af-8503-4354-bdb7-c015bf4aa269 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:10.019682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d874f0af-8503-4354-bdb7-c015bf4aa269 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:10.022410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d874f0af-8503-4354-bdb7-c015bf4aa269 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:10.775451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d874f0af-8503-4354-bdb7-c015bf4aa269 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:10.780204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4011b0de-4d58-4d80-a7a5-477993f4b499 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:10.783163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4011b0de-4d58-4d80-a7a5-477993f4b499 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] [instance: 21e48810-8135-4476-a6bb-62bb6ae6437c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:10.803476 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d874f0af-8503-4354-bdb7-c015bf4aa269 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1510 microversion: 2.1 time: 0.831311 Oct 12 22:18:10.804930 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1959/4473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:09 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1510 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:10.810620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4011b0de-4d58-4d80-a7a5-477993f4b499 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:10.811483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4011b0de-4d58-4d80-a7a5-477993f4b499 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:10.812801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4011b0de-4d58-4d80-a7a5-477993f4b499 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:10.815699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4011b0de-4d58-4d80-a7a5-477993f4b499 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:10.817663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4011b0de-4d58-4d80-a7a5-477993f4b499 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:10.819094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4011b0de-4d58-4d80-a7a5-477993f4b499 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:10.858333 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-4011b0de-4d58-4d80-a7a5-477993f4b499 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] HTTP exception thrown: Instance 21e48810-8135-4476-a6bb-62bb6ae6437c could not be found. Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4011b0de-4d58-4d80-a7a5-477993f4b499 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Request method failure captured: Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c HTTP/1.1 Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzzxfHJcnDr1DEqfm_3HzO__WcfoCdF2nXnp4uo0i_9BhS5bXrv0nuQtrJqGgJkxU_K8y52x6hcFKZ_pAw0EHfIX6QFSPc15eEw-FUq1GRmvMV5FqU4DX49226LoUhAn6exkTGHEv-xsUUGZWEUBmpnmqkLzrUrRQZXnuAc68z_1WQw Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.54 Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: a0382ff053c849d19c8fbeac978b7bae Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerShowV254Test-1614567807 Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a0382ff053c849d19c8fbeac978b7bae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a0382ff053c849d19c8fbeac978b7bae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a0382ff053c849d19c8fbeac978b7bae", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a0382ff053c849d19c8fbeac978b7bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerShowV254Test-1614567807 Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: a0382ff053c849d19c8fbeac978b7bae Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerShowV254Test-1614567807 Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerShowV254Test-1614567807-project Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 4c98f8f74048434391366b25d0c539f4 Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerShowV254Test-1614567807-project Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 21e48810-8135-4476-a6bb-62bb6ae6437c could not be found. Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '21e48810-8135-4476-a6bb-62bb6ae6437c'} Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e48810-8135-4476-a6bb-62bb6ae6437c could not be found. Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e48810-8135-4476-a6bb-62bb6ae6437c could not be found. Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:10.866099 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:10.873583 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:10.873583 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:10.873583 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:10.873583 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:18:10.873583 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:18:10.873583 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e48810-8135-4476-a6bb-62bb6ae6437c could not be found. Oct 12 22:18:10.873583 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:10.878842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4011b0de-4d58-4d80-a7a5-477993f4b499 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] Returning 404 to user: Instance 21e48810-8135-4476-a6bb-62bb6ae6437c could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:18:10.882851 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4011b0de-4d58-4d80-a7a5-477993f4b499 tempest-ServerShowV254Test-1614567807 tempest-ServerShowV254Test-1614567807-project] 10.222.0.16 "GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c" status: 404 len: 111 microversion: 2.54 time: 0.111319 Oct 12 22:18:10.884093 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2515/4474] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:18:10 2022] GET /compute/v2.1/servers/21e48810-8135-4476-a6bb-62bb6ae6437c => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:18:11.841720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c8bebccf-8d2b-40c2-9a78-d1a4bbef272f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:11.843129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c8bebccf-8d2b-40c2-9a78-d1a4bbef272f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:11.862215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8bebccf-8d2b-40c2-9a78-d1a4bbef272f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:11.863413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8bebccf-8d2b-40c2-9a78-d1a4bbef272f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:11.864072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8bebccf-8d2b-40c2-9a78-d1a4bbef272f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:11.865475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8bebccf-8d2b-40c2-9a78-d1a4bbef272f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:11.867811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8bebccf-8d2b-40c2-9a78-d1a4bbef272f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:11.868482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8bebccf-8d2b-40c2-9a78-d1a4bbef272f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:13.461606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c8bebccf-8d2b-40c2-9a78-d1a4bbef272f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:13.489960 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c8bebccf-8d2b-40c2-9a78-d1a4bbef272f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1510 microversion: 2.1 time: 1.652829 Oct 12 22:18:13.498557 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1960/4475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:11 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1510 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:14.521662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-85e8679a-204d-492e-9b07-ee6da147cf89 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:14.525414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-85e8679a-204d-492e-9b07-ee6da147cf89 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:14.556406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85e8679a-204d-492e-9b07-ee6da147cf89 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:14.557204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85e8679a-204d-492e-9b07-ee6da147cf89 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:14.558860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85e8679a-204d-492e-9b07-ee6da147cf89 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:14.573740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85e8679a-204d-492e-9b07-ee6da147cf89 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:14.586619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85e8679a-204d-492e-9b07-ee6da147cf89 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:14.588189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85e8679a-204d-492e-9b07-ee6da147cf89 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:15.210784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-85e8679a-204d-492e-9b07-ee6da147cf89 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:15.219746 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-85e8679a-204d-492e-9b07-ee6da147cf89 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1510 microversion: 2.1 time: 0.702825 Oct 12 22:18:15.220341 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2516/4476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:14 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1510 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:16.245069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-67c92ac9-adda-46c5-8082-915ee6e57ce3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:16.245984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-67c92ac9-adda-46c5-8082-915ee6e57ce3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:16.265264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67c92ac9-adda-46c5-8082-915ee6e57ce3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:16.266192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67c92ac9-adda-46c5-8082-915ee6e57ce3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:16.267851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67c92ac9-adda-46c5-8082-915ee6e57ce3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:16.268629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67c92ac9-adda-46c5-8082-915ee6e57ce3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:16.269109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67c92ac9-adda-46c5-8082-915ee6e57ce3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:16.269649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67c92ac9-adda-46c5-8082-915ee6e57ce3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:17.155736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-67c92ac9-adda-46c5-8082-915ee6e57ce3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:17.168866 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-67c92ac9-adda-46c5-8082-915ee6e57ce3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1510 microversion: 2.1 time: 0.929256 Oct 12 22:18:17.174711 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1961/4477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:16 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1510 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:18.202444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-964ba901-f29d-420f-b800-7f9cd6ce1356 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:18.203802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-964ba901-f29d-420f-b800-7f9cd6ce1356 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:18.217129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964ba901-f29d-420f-b800-7f9cd6ce1356 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:18.220057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964ba901-f29d-420f-b800-7f9cd6ce1356 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:18.221327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964ba901-f29d-420f-b800-7f9cd6ce1356 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:18.223083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964ba901-f29d-420f-b800-7f9cd6ce1356 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:18.227270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964ba901-f29d-420f-b800-7f9cd6ce1356 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:18.227964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964ba901-f29d-420f-b800-7f9cd6ce1356 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:18.549266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-964ba901-f29d-420f-b800-7f9cd6ce1356 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:18.573327 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-964ba901-f29d-420f-b800-7f9cd6ce1356 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1510 microversion: 2.1 time: 0.375854 Oct 12 22:18:18.574320 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2517/4478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:18 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:19.606575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6e42a35e-5697-4225-b20f-28c1732b5f90 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:19.611835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6e42a35e-5697-4225-b20f-28c1732b5f90 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:19.648362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e42a35e-5697-4225-b20f-28c1732b5f90 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:19.651030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e42a35e-5697-4225-b20f-28c1732b5f90 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:19.651965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e42a35e-5697-4225-b20f-28c1732b5f90 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:19.654608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e42a35e-5697-4225-b20f-28c1732b5f90 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:19.655402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e42a35e-5697-4225-b20f-28c1732b5f90 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:19.657663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e42a35e-5697-4225-b20f-28c1732b5f90 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:20.101568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6e42a35e-5697-4225-b20f-28c1732b5f90 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:20.113333 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6e42a35e-5697-4225-b20f-28c1732b5f90 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1510 microversion: 2.1 time: 0.512563 Oct 12 22:18:20.131218 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1962/4479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:19 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1510 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:21.138528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2cf21c96-31c8-4ccc-97e3-46f32ad4140a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:21.139809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2cf21c96-31c8-4ccc-97e3-46f32ad4140a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:21.157120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cf21c96-31c8-4ccc-97e3-46f32ad4140a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:21.157906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cf21c96-31c8-4ccc-97e3-46f32ad4140a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:21.158633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cf21c96-31c8-4ccc-97e3-46f32ad4140a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:21.160472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cf21c96-31c8-4ccc-97e3-46f32ad4140a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:21.161202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cf21c96-31c8-4ccc-97e3-46f32ad4140a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:21.161831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cf21c96-31c8-4ccc-97e3-46f32ad4140a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:21.606599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2cf21c96-31c8-4ccc-97e3-46f32ad4140a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:21.616524 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2cf21c96-31c8-4ccc-97e3-46f32ad4140a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1510 microversion: 2.1 time: 0.481368 Oct 12 22:18:21.623144 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2518/4480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:21 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1510 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:22.642737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6f36080b-d56e-4ae1-8f78-7ac5142fca04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:22.644812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6f36080b-d56e-4ae1-8f78-7ac5142fca04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:22.659412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f36080b-d56e-4ae1-8f78-7ac5142fca04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:22.659914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f36080b-d56e-4ae1-8f78-7ac5142fca04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:22.660362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f36080b-d56e-4ae1-8f78-7ac5142fca04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:22.661088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f36080b-d56e-4ae1-8f78-7ac5142fca04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:22.661549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f36080b-d56e-4ae1-8f78-7ac5142fca04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:22.661983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f36080b-d56e-4ae1-8f78-7ac5142fca04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:24.142040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6f36080b-d56e-4ae1-8f78-7ac5142fca04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:24.165848 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6f36080b-d56e-4ae1-8f78-7ac5142fca04 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1510 microversion: 2.1 time: 1.527288 Oct 12 22:18:24.169767 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1963/4481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:22 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1510 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:25.196271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bca4a630-2222-4b0b-946d-52127d4ea27a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:25.197725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bca4a630-2222-4b0b-946d-52127d4ea27a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:25.219871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bca4a630-2222-4b0b-946d-52127d4ea27a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:25.220413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bca4a630-2222-4b0b-946d-52127d4ea27a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:25.223359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bca4a630-2222-4b0b-946d-52127d4ea27a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:25.225263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bca4a630-2222-4b0b-946d-52127d4ea27a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:25.225757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bca4a630-2222-4b0b-946d-52127d4ea27a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:25.226204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bca4a630-2222-4b0b-946d-52127d4ea27a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:25.523104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bca4a630-2222-4b0b-946d-52127d4ea27a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:25.537505 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bca4a630-2222-4b0b-946d-52127d4ea27a tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1507 microversion: 2.1 time: 0.343225 Oct 12 22:18:25.541932 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2519/4482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:25 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1507 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:25.925133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-545788431", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "53ff3060-94f8-4390-b836-18a687f49480"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:26.017936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] validate_networks() for [('53ff3060-94f8-4390-b836-18a687f49480', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:18:26.566836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d9dddd48-27c6-494e-80c2-678ae3f84965 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:26.567495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d9dddd48-27c6-494e-80c2-678ae3f84965 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:26.581508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9dddd48-27c6-494e-80c2-678ae3f84965 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:26.582969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9dddd48-27c6-494e-80c2-678ae3f84965 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:26.587568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9dddd48-27c6-494e-80c2-678ae3f84965 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:26.588803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9dddd48-27c6-494e-80c2-678ae3f84965 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:26.589502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9dddd48-27c6-494e-80c2-678ae3f84965 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:26.590087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9dddd48-27c6-494e-80c2-678ae3f84965 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:27.214636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d9dddd48-27c6-494e-80c2-678ae3f84965 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:27.222914 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d9dddd48-27c6-494e-80c2-678ae3f84965 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1507 microversion: 2.1 time: 0.660403 Oct 12 22:18:27.227324 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2520/4483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:26 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1507 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:18:27.654210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:18:27.655389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:18:27.657795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:18:27.658391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:18:27.660690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:18:27.674716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:27.675575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:27.677165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:27.678309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:27.678924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:27.679550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:27.755710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Getting quotas for project d7f6763b291c4352b3de289993940a82. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:18:27.763982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Getting quotas for user 06dfdee42ca44284ab3ebbbbf8b74faf and project d7f6763b291c4352b3de289993940a82. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:18:27.817916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:18:27.823879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:18:28.009743 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f6ac884-cbe7-448b-8078-5d52ca2d7c3d tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.394281 Oct 12 22:18:28.011032 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1964/4484] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:18:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:18:28.026268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a6de28a1-6884-4e5d-96a8-b80c4503d7fd tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:28.027409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a6de28a1-6884-4e5d-96a8-b80c4503d7fd tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:28.214279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a6de28a1-6884-4e5d-96a8-b80c4503d7fd tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:28.223083 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a6de28a1-6884-4e5d-96a8-b80c4503d7fd tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1224 microversion: 2.1 time: 0.205018 Oct 12 22:18:28.223765 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2521/4485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:28 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1224 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:28.254867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-612c95e1-0b0d-45a6-8983-448add02ab2d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:28.255662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-612c95e1-0b0d-45a6-8983-448add02ab2d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:28.267722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-612c95e1-0b0d-45a6-8983-448add02ab2d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:28.269321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-612c95e1-0b0d-45a6-8983-448add02ab2d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:28.275388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-612c95e1-0b0d-45a6-8983-448add02ab2d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:28.276674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-612c95e1-0b0d-45a6-8983-448add02ab2d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:28.277490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-612c95e1-0b0d-45a6-8983-448add02ab2d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:28.278075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-612c95e1-0b0d-45a6-8983-448add02ab2d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:29.144931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-612c95e1-0b0d-45a6-8983-448add02ab2d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:29.169150 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-612c95e1-0b0d-45a6-8983-448add02ab2d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1507 microversion: 2.1 time: 0.915442 Oct 12 22:18:29.171127 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1965/4486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:28 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1507 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:29.247050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fc63749c-86a4-45d5-94b8-0dcc2e6124b4 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:29.247756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fc63749c-86a4-45d5-94b8-0dcc2e6124b4 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:29.261578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:29.264917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc63749c-86a4-45d5-94b8-0dcc2e6124b4 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:29.270399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc63749c-86a4-45d5-94b8-0dcc2e6124b4 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:29.272303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc63749c-86a4-45d5-94b8-0dcc2e6124b4 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:29.281249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc63749c-86a4-45d5-94b8-0dcc2e6124b4 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:29.282436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc63749c-86a4-45d5-94b8-0dcc2e6124b4 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:29.283108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc63749c-86a4-45d5-94b8-0dcc2e6124b4 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:29.464644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fc63749c-86a4-45d5-94b8-0dcc2e6124b4 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:29.475469 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fc63749c-86a4-45d5-94b8-0dcc2e6124b4 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1228 microversion: 2.1 time: 0.232300 Oct 12 22:18:29.491622 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2522/4487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:29 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1228 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:30.032172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-9402d2de-09cb-444a-9a26-df8275cf47c3 req-53e97863-a46e-4ba7-b7a1-c493187933be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642", "name": "network-vif-unplugged", "status": "completed", "tag": "8e2b35e6-0fa9-488d-886e-79503ed3c9fb"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:30.065399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:30.070188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9402d2de-09cb-444a-9a26-df8275cf47c3 req-53e97863-a46e-4ba7-b7a1-c493187933be service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:30.071091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9402d2de-09cb-444a-9a26-df8275cf47c3 req-53e97863-a46e-4ba7-b7a1-c493187933be service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:30.071955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9402d2de-09cb-444a-9a26-df8275cf47c3 req-53e97863-a46e-4ba7-b7a1-c493187933be service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:30.120566 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-9402d2de-09cb-444a-9a26-df8275cf47c3 req-53e97863-a46e-4ba7-b7a1-c493187933be service nova] Creating event network-vif-unplugged:8e2b35e6-0fa9-488d-886e-79503ed3c9fb for instance e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 on n-h1-861111-1 Oct 12 22:18:30.133886 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-9402d2de-09cb-444a-9a26-df8275cf47c3 req-53e97863-a46e-4ba7-b7a1-c493187933be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107033 Oct 12 22:18:30.135376 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1966/4488] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:18:30.197074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6d683fbe-d06a-4747-a186-73b3c2d93756 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:30.198151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6d683fbe-d06a-4747-a186-73b3c2d93756 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:30.221467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d683fbe-d06a-4747-a186-73b3c2d93756 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:30.223980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d683fbe-d06a-4747-a186-73b3c2d93756 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:30.227839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d683fbe-d06a-4747-a186-73b3c2d93756 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:30.228612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d683fbe-d06a-4747-a186-73b3c2d93756 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:30.230781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d683fbe-d06a-4747-a186-73b3c2d93756 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:30.231249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d683fbe-d06a-4747-a186-73b3c2d93756 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:30.500201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c67b9015-3838-48fc-82ca-a4b38a3c11f1 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:30.501104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c67b9015-3838-48fc-82ca-a4b38a3c11f1 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:30.519885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c67b9015-3838-48fc-82ca-a4b38a3c11f1 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:30.531698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c67b9015-3838-48fc-82ca-a4b38a3c11f1 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:30.532559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c67b9015-3838-48fc-82ca-a4b38a3c11f1 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:30.533601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c67b9015-3838-48fc-82ca-a4b38a3c11f1 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:30.534283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c67b9015-3838-48fc-82ca-a4b38a3c11f1 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:30.535548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c67b9015-3838-48fc-82ca-a4b38a3c11f1 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:30.749238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6d683fbe-d06a-4747-a186-73b3c2d93756 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:30.780392 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6d683fbe-d06a-4747-a186-73b3c2d93756 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1507 microversion: 2.1 time: 0.587336 Oct 12 22:18:30.795275 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2523/4489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:30 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1507 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:30.814211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c67b9015-3838-48fc-82ca-a4b38a3c11f1 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:30.830628 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c67b9015-3838-48fc-82ca-a4b38a3c11f1 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1294 microversion: 2.1 time: 0.334362 Oct 12 22:18:30.831365 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1967/4490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:30 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1294 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:30.927155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-19518326", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "f0451602-65c9-4377-86bb-844c8c5d61b8"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:31.065496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] validate_networks() for [('f0451602-65c9-4377-86bb-844c8c5d61b8', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:18:31.808189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3d1e915c-a37b-42ce-af26-2c100ccb5f02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:31.809707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3d1e915c-a37b-42ce-af26-2c100ccb5f02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:31.831025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d1e915c-a37b-42ce-af26-2c100ccb5f02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:31.832187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d1e915c-a37b-42ce-af26-2c100ccb5f02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:31.835393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d1e915c-a37b-42ce-af26-2c100ccb5f02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:31.837330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d1e915c-a37b-42ce-af26-2c100ccb5f02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:31.837992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d1e915c-a37b-42ce-af26-2c100ccb5f02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:31.839457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d1e915c-a37b-42ce-af26-2c100ccb5f02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:32.871675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:18:32.873453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:18:32.874517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:18:32.875181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:18:32.876054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:18:32.899123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:32.901845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:32.902651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:32.905093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:32.906338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:32.908305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:32.932634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:32.980515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Getting quotas for project f3336d74185d4f72a3626f6faaf7a984. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:18:32.994212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Getting quotas for user 6c0a1153dcc24b3bb32c7570d878ba84 and project f3336d74185d4f72a3626f6faaf7a984. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:18:33.029419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:18:33.037725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:18:33.158209 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-82749b93-ca64-41c3-998a-9471c764cc94 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.373024 Oct 12 22:18:33.171470 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2524/4491] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:18:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:18:33.179006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-505eabc1-a954-4fdc-842b-adc51fce1893 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:33.184111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-505eabc1-a954-4fdc-842b-adc51fce1893 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:33.204134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-505eabc1-a954-4fdc-842b-adc51fce1893 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:33.205149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-505eabc1-a954-4fdc-842b-adc51fce1893 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:33.205797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-505eabc1-a954-4fdc-842b-adc51fce1893 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:33.206875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-505eabc1-a954-4fdc-842b-adc51fce1893 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:33.207644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-505eabc1-a954-4fdc-842b-adc51fce1893 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:33.208293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-505eabc1-a954-4fdc-842b-adc51fce1893 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:33.369006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3d1e915c-a37b-42ce-af26-2c100ccb5f02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:33.378674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-505eabc1-a954-4fdc-842b-adc51fce1893 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:33.388070 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3d1e915c-a37b-42ce-af26-2c100ccb5f02 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 200 len: 1510 microversion: 2.1 time: 1.583659 Oct 12 22:18:33.391120 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1968/4492] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:31 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 1510 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:33.402660 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-505eabc1-a954-4fdc-842b-adc51fce1893 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1282 microversion: 2.1 time: 0.225752 Oct 12 22:18:33.408498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-778e3b30-8f5d-451b-85ef-9502d5ed9693 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:33.409512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-778e3b30-8f5d-451b-85ef-9502d5ed9693 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:33.424329 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2525/4493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:33 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1282 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:33.433584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-676dade3-061e-4c18-9f7e-37efda70d842 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:33.438834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-676dade3-061e-4c18-9f7e-37efda70d842 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:33.446968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-676dade3-061e-4c18-9f7e-37efda70d842 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:33.447742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-676dade3-061e-4c18-9f7e-37efda70d842 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:33.448588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-676dade3-061e-4c18-9f7e-37efda70d842 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:33.449789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-676dade3-061e-4c18-9f7e-37efda70d842 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:33.450407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-676dade3-061e-4c18-9f7e-37efda70d842 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:33.450996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-676dade3-061e-4c18-9f7e-37efda70d842 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:33.561072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-778e3b30-8f5d-451b-85ef-9502d5ed9693 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:33.581672 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-778e3b30-8f5d-451b-85ef-9502d5ed9693 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1222 microversion: 2.1 time: 0.177383 Oct 12 22:18:33.585840 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1969/4494] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:33 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1222 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:33.748960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-676dade3-061e-4c18-9f7e-37efda70d842 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:33.765726 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-676dade3-061e-4c18-9f7e-37efda70d842 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.337844 Oct 12 22:18:33.767407 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2526/4495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:33 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:33.796655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-305b6cca-fd49-43e7-8dfb-ae050bdfa450 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:33.797443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-305b6cca-fd49-43e7-8dfb-ae050bdfa450 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:33.808988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-305b6cca-fd49-43e7-8dfb-ae050bdfa450 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:33.809663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-305b6cca-fd49-43e7-8dfb-ae050bdfa450 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:33.811252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-305b6cca-fd49-43e7-8dfb-ae050bdfa450 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:33.815010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-305b6cca-fd49-43e7-8dfb-ae050bdfa450 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:33.816009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-305b6cca-fd49-43e7-8dfb-ae050bdfa450 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:33.817175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-305b6cca-fd49-43e7-8dfb-ae050bdfa450 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:34.422078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-305b6cca-fd49-43e7-8dfb-ae050bdfa450 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:34.431909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd2d787d-5238-4b65-89f3-5f6e9e076a3e tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:34.432622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dd2d787d-5238-4b65-89f3-5f6e9e076a3e tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:34.444672 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-305b6cca-fd49-43e7-8dfb-ae050bdfa450 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.651325 Oct 12 22:18:34.446804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd2d787d-5238-4b65-89f3-5f6e9e076a3e tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:34.450303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd2d787d-5238-4b65-89f3-5f6e9e076a3e tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:34.452192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd2d787d-5238-4b65-89f3-5f6e9e076a3e tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:34.455001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd2d787d-5238-4b65-89f3-5f6e9e076a3e tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:34.456664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd2d787d-5238-4b65-89f3-5f6e9e076a3e tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:34.458663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd2d787d-5238-4b65-89f3-5f6e9e076a3e tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:34.481592 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1970/4496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:33 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:34.502335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-37773dee-6b78-4b5c-bf56-0771e873520e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:34.504428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-37773dee-6b78-4b5c-bf56-0771e873520e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:34.519684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37773dee-6b78-4b5c-bf56-0771e873520e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:34.532890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37773dee-6b78-4b5c-bf56-0771e873520e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:34.535168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37773dee-6b78-4b5c-bf56-0771e873520e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:34.537709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37773dee-6b78-4b5c-bf56-0771e873520e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:34.540085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37773dee-6b78-4b5c-bf56-0771e873520e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:34.542670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37773dee-6b78-4b5c-bf56-0771e873520e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:35.005354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dd2d787d-5238-4b65-89f3-5f6e9e076a3e tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:35.018196 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dd2d787d-5238-4b65-89f3-5f6e9e076a3e tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1324 microversion: 2.1 time: 0.591607 Oct 12 22:18:35.020202 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2527/4497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:34 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1324 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:18:35.058425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-96b8300f-7b27-44b2-9514-aad17ad20720 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:35.059623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-96b8300f-7b27-44b2-9514-aad17ad20720 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:35.070260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96b8300f-7b27-44b2-9514-aad17ad20720 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:35.070764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96b8300f-7b27-44b2-9514-aad17ad20720 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:35.071295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96b8300f-7b27-44b2-9514-aad17ad20720 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:35.073097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96b8300f-7b27-44b2-9514-aad17ad20720 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:35.074293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96b8300f-7b27-44b2-9514-aad17ad20720 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:35.075065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96b8300f-7b27-44b2-9514-aad17ad20720 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:35.256563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-96b8300f-7b27-44b2-9514-aad17ad20720 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:35.273971 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-96b8300f-7b27-44b2-9514-aad17ad20720 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1274 microversion: 2.1 time: 0.251704 Oct 12 22:18:35.276256 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2528/4498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:35 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1274 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:35.457119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-37773dee-6b78-4b5c-bf56-0771e873520e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:35.494249 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-37773dee-6b78-4b5c-bf56-0771e873520e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 1.008082 Oct 12 22:18:35.507832 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1971/4499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:34 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:35.686756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-580502597", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:35.797584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] validate_networks() for [('57899def-7285-4d34-a6b9-8c4bdfce7a65', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:18:35.853993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aec99ee1-c304-46fb-a231-631eee297f0e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:35.855193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aec99ee1-c304-46fb-a231-631eee297f0e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:35.863041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aec99ee1-c304-46fb-a231-631eee297f0e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:35.863985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aec99ee1-c304-46fb-a231-631eee297f0e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:35.864744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aec99ee1-c304-46fb-a231-631eee297f0e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:35.865767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aec99ee1-c304-46fb-a231-631eee297f0e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:35.867368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aec99ee1-c304-46fb-a231-631eee297f0e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:35.869663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aec99ee1-c304-46fb-a231-631eee297f0e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:36.177211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aec99ee1-c304-46fb-a231-631eee297f0e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:36.190179 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aec99ee1-c304-46fb-a231-631eee297f0e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.666613 Oct 12 22:18:36.203676 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2529/4500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:35 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:36.219122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a8b88da8-fd35-42c2-9e4d-a6652eb5442f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:36.220105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a8b88da8-fd35-42c2-9e4d-a6652eb5442f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:36.239965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8b88da8-fd35-42c2-9e4d-a6652eb5442f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:36.243113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8b88da8-fd35-42c2-9e4d-a6652eb5442f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:36.244569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8b88da8-fd35-42c2-9e4d-a6652eb5442f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:36.249027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8b88da8-fd35-42c2-9e4d-a6652eb5442f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:36.249757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8b88da8-fd35-42c2-9e4d-a6652eb5442f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:36.254935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8b88da8-fd35-42c2-9e4d-a6652eb5442f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:36.815333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a8b88da8-fd35-42c2-9e4d-a6652eb5442f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:36.831176 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a8b88da8-fd35-42c2-9e4d-a6652eb5442f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1324 microversion: 2.1 time: 0.618207 Oct 12 22:18:36.832720 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2530/4501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:36 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1324 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:36.876012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d3cf8c1f-b59e-473b-b0ad-2c6e7f0214a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:36.886263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3cf8c1f-b59e-473b-b0ad-2c6e7f0214a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:36.886814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3cf8c1f-b59e-473b-b0ad-2c6e7f0214a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:36.891088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3cf8c1f-b59e-473b-b0ad-2c6e7f0214a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:36.940933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d3cf8c1f-b59e-473b-b0ad-2c6e7f0214a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Going to try to stop instance {{(pid=120453) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 22:18:37.039830 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d3cf8c1f-b59e-473b-b0ad-2c6e7f0214a8 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 202 len: 0 microversion: 2.1 time: 0.153811 Oct 12 22:18:37.046646 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2531/4502] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:18:36 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:18:37.060720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9c471a3e-ece2-462e-91cb-f1f600570ad7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:37.061800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9c471a3e-ece2-462e-91cb-f1f600570ad7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:37.075894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c471a3e-ece2-462e-91cb-f1f600570ad7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:37.077275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c471a3e-ece2-462e-91cb-f1f600570ad7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:37.078146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c471a3e-ece2-462e-91cb-f1f600570ad7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:37.079505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c471a3e-ece2-462e-91cb-f1f600570ad7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:37.080839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c471a3e-ece2-462e-91cb-f1f600570ad7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:37.081517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c471a3e-ece2-462e-91cb-f1f600570ad7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:37.213551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9c471a3e-ece2-462e-91cb-f1f600570ad7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:37.254293 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9c471a3e-ece2-462e-91cb-f1f600570ad7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1280 microversion: 2.1 time: 0.204549 Oct 12 22:18:37.262166 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2532/4503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:37 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1280 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:37.298714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5ee25ce7-dd0d-4f5e-900c-68af025d57e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:37.299752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5ee25ce7-dd0d-4f5e-900c-68af025d57e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:37.309452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ee25ce7-dd0d-4f5e-900c-68af025d57e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:37.310114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ee25ce7-dd0d-4f5e-900c-68af025d57e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:37.310693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ee25ce7-dd0d-4f5e-900c-68af025d57e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:37.311898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ee25ce7-dd0d-4f5e-900c-68af025d57e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:37.312491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ee25ce7-dd0d-4f5e-900c-68af025d57e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:37.313132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ee25ce7-dd0d-4f5e-900c-68af025d57e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:37.357885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:18:37.359212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:18:37.359845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:18:37.360263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:18:37.360901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:18:37.381817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:37.389066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:37.391555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:37.393436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:37.393982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:37.394373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:37.425167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Getting quotas for project 1945a103d7df4bdc8519c3fd6e3f774c. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:18:37.434329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Getting quotas for user db077881dc7b4893a480d71484c5cba9 and project 1945a103d7df4bdc8519c3fd6e3f774c. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:18:37.451786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:18:37.457630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:18:37.525847 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-be85f02b-493c-4f62-9440-8cda7dbadbb0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.946086 Oct 12 22:18:37.527279 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1972/4504] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:18:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:18:37.543911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-54ddc5f8-2271-4c9a-83f7-26cf15554575 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:37.545894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-54ddc5f8-2271-4c9a-83f7-26cf15554575 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:37.731668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-54ddc5f8-2271-4c9a-83f7-26cf15554575 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:37.753330 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-54ddc5f8-2271-4c9a-83f7-26cf15554575 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1216 microversion: 2.1 time: 0.218640 Oct 12 22:18:37.766898 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1973/4505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:37 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1216 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:37.866698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-78b86178-a4cd-4fbe-886b-cac8900d1f79 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:37.867621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-78b86178-a4cd-4fbe-886b-cac8900d1f79 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:37.890694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78b86178-a4cd-4fbe-886b-cac8900d1f79 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:37.891211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78b86178-a4cd-4fbe-886b-cac8900d1f79 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:37.894695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78b86178-a4cd-4fbe-886b-cac8900d1f79 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:37.897862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78b86178-a4cd-4fbe-886b-cac8900d1f79 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:37.898441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78b86178-a4cd-4fbe-886b-cac8900d1f79 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:37.903936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78b86178-a4cd-4fbe-886b-cac8900d1f79 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:38.007214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5ee25ce7-dd0d-4f5e-900c-68af025d57e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:38.026635 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5ee25ce7-dd0d-4f5e-900c-68af025d57e3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1680 microversion: 2.1 time: 0.730214 Oct 12 22:18:38.032320 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2533/4506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:37 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1680 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:38.291527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7d9a6b38-834c-44d7-b823-681028710315 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:38.292164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7d9a6b38-834c-44d7-b823-681028710315 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:38.310315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d9a6b38-834c-44d7-b823-681028710315 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:38.313183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d9a6b38-834c-44d7-b823-681028710315 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:38.313961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d9a6b38-834c-44d7-b823-681028710315 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:38.320275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d9a6b38-834c-44d7-b823-681028710315 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:38.321783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d9a6b38-834c-44d7-b823-681028710315 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:38.325105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7d9a6b38-834c-44d7-b823-681028710315 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:38.573098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7d9a6b38-834c-44d7-b823-681028710315 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:38.591606 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7d9a6b38-834c-44d7-b823-681028710315 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1280 microversion: 2.1 time: 0.303285 Oct 12 22:18:38.600244 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2534/4507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:38 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1280 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:38.784671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1d37a694-eff5-4e5d-9e25-2fb0e2e9e339 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:38.785675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1d37a694-eff5-4e5d-9e25-2fb0e2e9e339 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:38.807817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d37a694-eff5-4e5d-9e25-2fb0e2e9e339 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:38.808347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d37a694-eff5-4e5d-9e25-2fb0e2e9e339 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:38.811455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d37a694-eff5-4e5d-9e25-2fb0e2e9e339 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:38.812310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d37a694-eff5-4e5d-9e25-2fb0e2e9e339 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:38.813165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d37a694-eff5-4e5d-9e25-2fb0e2e9e339 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:38.816082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d37a694-eff5-4e5d-9e25-2fb0e2e9e339 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:39.080322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1d37a694-eff5-4e5d-9e25-2fb0e2e9e339 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:39.098696 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1d37a694-eff5-4e5d-9e25-2fb0e2e9e339 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1220 microversion: 2.1 time: 0.317122 Oct 12 22:18:39.102531 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2535/4508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:38 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1220 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:39.123503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3c3788e1-a879-4bb4-9b33-060ed7229078 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:39.125308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3c3788e1-a879-4bb4-9b33-060ed7229078 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:39.141869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c3788e1-a879-4bb4-9b33-060ed7229078 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:39.142550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c3788e1-a879-4bb4-9b33-060ed7229078 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:39.144411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c3788e1-a879-4bb4-9b33-060ed7229078 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:39.146989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c3788e1-a879-4bb4-9b33-060ed7229078 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:39.147765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c3788e1-a879-4bb4-9b33-060ed7229078 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:39.148781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c3788e1-a879-4bb4-9b33-060ed7229078 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:39.179425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-78b86178-a4cd-4fbe-886b-cac8900d1f79 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:39.182633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=75 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:39.191493 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-78b86178-a4cd-4fbe-886b-cac8900d1f79 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1324 microversion: 2.1 time: 1.330733 Oct 12 22:18:39.209437 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1974/4509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:37 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1324 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:39.623028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-17e33567-cce5-4a6e-b56c-3a358cd222b7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:39.624497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-17e33567-cce5-4a6e-b56c-3a358cd222b7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:39.657932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17e33567-cce5-4a6e-b56c-3a358cd222b7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:39.659033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17e33567-cce5-4a6e-b56c-3a358cd222b7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:39.659693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17e33567-cce5-4a6e-b56c-3a358cd222b7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:39.661175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17e33567-cce5-4a6e-b56c-3a358cd222b7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:39.665682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17e33567-cce5-4a6e-b56c-3a358cd222b7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:39.667768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17e33567-cce5-4a6e-b56c-3a358cd222b7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:40.549549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3c3788e1-a879-4bb4-9b33-060ed7229078 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:40.559374 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3c3788e1-a879-4bb4-9b33-060ed7229078 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1680 microversion: 2.1 time: 1.455451 Oct 12 22:18:40.559968 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2536/4510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:39 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1680 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:40.585731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f99659cf-f0dd-4722-9a81-bb6c521dafbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:40.590456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f99659cf-f0dd-4722-9a81-bb6c521dafbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:40.604212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f99659cf-f0dd-4722-9a81-bb6c521dafbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:40.604956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f99659cf-f0dd-4722-9a81-bb6c521dafbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:40.605748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f99659cf-f0dd-4722-9a81-bb6c521dafbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:40.606803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f99659cf-f0dd-4722-9a81-bb6c521dafbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:40.607458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f99659cf-f0dd-4722-9a81-bb6c521dafbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:40.608031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f99659cf-f0dd-4722-9a81-bb6c521dafbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:40.789753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f99659cf-f0dd-4722-9a81-bb6c521dafbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:40.816466 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f99659cf-f0dd-4722-9a81-bb6c521dafbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1274 microversion: 2.1 time: 0.255137 Oct 12 22:18:40.818431 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2537/4511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:40 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1274 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:40.823753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-350bb7c5-7113-4c8b-9550-5b0fca84e6d5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:40.824905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-350bb7c5-7113-4c8b-9550-5b0fca84e6d5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:40.833453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-350bb7c5-7113-4c8b-9550-5b0fca84e6d5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:40.834621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-350bb7c5-7113-4c8b-9550-5b0fca84e6d5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:40.835063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-350bb7c5-7113-4c8b-9550-5b0fca84e6d5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:40.845284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-350bb7c5-7113-4c8b-9550-5b0fca84e6d5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:40.865841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-350bb7c5-7113-4c8b-9550-5b0fca84e6d5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:40.868158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-350bb7c5-7113-4c8b-9550-5b0fca84e6d5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:40.963476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-17e33567-cce5-4a6e-b56c-3a358cd222b7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:40.976233 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-17e33567-cce5-4a6e-b56c-3a358cd222b7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1322 microversion: 2.1 time: 1.355925 Oct 12 22:18:40.978518 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1975/4512] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:39 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1322 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:41.095307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d2414c6d-2d52-48f1-b827-481292271cef req-3a3f35e3-c62a-4273-b4b1-5e91fb5ebcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b932bf7-cc37-4542-860e-efaa7ad47fa5", "tag": "7452409c-2f82-4fb9-8e36-8f34a323a328"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:41.108806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d2414c6d-2d52-48f1-b827-481292271cef req-3a3f35e3-c62a-4273-b4b1-5e91fb5ebcd0 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:41.109296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d2414c6d-2d52-48f1-b827-481292271cef req-3a3f35e3-c62a-4273-b4b1-5e91fb5ebcd0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:41.109750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d2414c6d-2d52-48f1-b827-481292271cef req-3a3f35e3-c62a-4273-b4b1-5e91fb5ebcd0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:41.134670 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d2414c6d-2d52-48f1-b827-481292271cef req-3a3f35e3-c62a-4273-b4b1-5e91fb5ebcd0 service nova] Creating event network-changed:7452409c-2f82-4fb9-8e36-8f34a323a328 for instance 4b932bf7-cc37-4542-860e-efaa7ad47fa5 on n-h2-861111-1 Oct 12 22:18:41.152373 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d2414c6d-2d52-48f1-b827-481292271cef req-3a3f35e3-c62a-4273-b4b1-5e91fb5ebcd0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060881 Oct 12 22:18:41.153595 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1976/4513] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:18:41.282820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-350bb7c5-7113-4c8b-9550-5b0fca84e6d5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:41.299089 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-350bb7c5-7113-4c8b-9550-5b0fca84e6d5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1324 microversion: 2.1 time: 0.479081 Oct 12 22:18:41.315458 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2538/4514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:40 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1324 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:41.591187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-37cda1ba-9eb4-4fbe-bb80-df24586cbaac tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:41.592059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-37cda1ba-9eb4-4fbe-bb80-df24586cbaac tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:41.615789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37cda1ba-9eb4-4fbe-bb80-df24586cbaac tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:41.623328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37cda1ba-9eb4-4fbe-bb80-df24586cbaac tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:41.624189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37cda1ba-9eb4-4fbe-bb80-df24586cbaac tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:41.625148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37cda1ba-9eb4-4fbe-bb80-df24586cbaac tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:41.627794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37cda1ba-9eb4-4fbe-bb80-df24586cbaac tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:41.628315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37cda1ba-9eb4-4fbe-bb80-df24586cbaac tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:41.840960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b7210b00-8399-4f90-9a34-c905492b9961 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:41.842638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b7210b00-8399-4f90-9a34-c905492b9961 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:41.853900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7210b00-8399-4f90-9a34-c905492b9961 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:41.854645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7210b00-8399-4f90-9a34-c905492b9961 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:41.855325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7210b00-8399-4f90-9a34-c905492b9961 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:41.856206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7210b00-8399-4f90-9a34-c905492b9961 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:41.856854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7210b00-8399-4f90-9a34-c905492b9961 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:41.857636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7210b00-8399-4f90-9a34-c905492b9961 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:42.013847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b7210b00-8399-4f90-9a34-c905492b9961 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:42.025732 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b7210b00-8399-4f90-9a34-c905492b9961 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1274 microversion: 2.1 time: 0.188590 Oct 12 22:18:42.041195 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2539/4515] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:41 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1274 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:18:42.041195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7783a7bf-fa54-4200-ab89-7531925cf220 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:42.041195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7783a7bf-fa54-4200-ab89-7531925cf220 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:42.046000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7783a7bf-fa54-4200-ab89-7531925cf220 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:42.047118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7783a7bf-fa54-4200-ab89-7531925cf220 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:42.047924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7783a7bf-fa54-4200-ab89-7531925cf220 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:42.049070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7783a7bf-fa54-4200-ab89-7531925cf220 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:42.050571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7783a7bf-fa54-4200-ab89-7531925cf220 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:42.051413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7783a7bf-fa54-4200-ab89-7531925cf220 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:42.080809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:42.260111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7783a7bf-fa54-4200-ab89-7531925cf220 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:42.269449 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7783a7bf-fa54-4200-ab89-7531925cf220 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1322 microversion: 2.1 time: 0.235508 Oct 12 22:18:42.270045 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2540/4516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:42 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:42.329997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd31af13-132c-4e71-a9c5-56c37f5fef06 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:42.331889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dd31af13-132c-4e71-a9c5-56c37f5fef06 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:42.345941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd31af13-132c-4e71-a9c5-56c37f5fef06 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:42.346685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd31af13-132c-4e71-a9c5-56c37f5fef06 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:42.347692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd31af13-132c-4e71-a9c5-56c37f5fef06 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:42.348819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd31af13-132c-4e71-a9c5-56c37f5fef06 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:42.349678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd31af13-132c-4e71-a9c5-56c37f5fef06 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:42.350449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd31af13-132c-4e71-a9c5-56c37f5fef06 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:42.612232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-37cda1ba-9eb4-4fbe-bb80-df24586cbaac tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:42.623376 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-37cda1ba-9eb4-4fbe-bb80-df24586cbaac tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1680 microversion: 2.1 time: 1.037539 Oct 12 22:18:42.624628 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1977/4517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:41 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1680 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:18:42.686170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dd31af13-132c-4e71-a9c5-56c37f5fef06 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:42.698110 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dd31af13-132c-4e71-a9c5-56c37f5fef06 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1324 microversion: 2.1 time: 0.377098 Oct 12 22:18:42.698723 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2541/4518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:42 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1324 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:43.065530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-12590237-6ef0-4095-a26c-ffea56028280 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:43.067588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-12590237-6ef0-4095-a26c-ffea56028280 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:43.078968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12590237-6ef0-4095-a26c-ffea56028280 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:43.081801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12590237-6ef0-4095-a26c-ffea56028280 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:43.082547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12590237-6ef0-4095-a26c-ffea56028280 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:43.083609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12590237-6ef0-4095-a26c-ffea56028280 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:43.084819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12590237-6ef0-4095-a26c-ffea56028280 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:43.085494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12590237-6ef0-4095-a26c-ffea56028280 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:43.278647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-12590237-6ef0-4095-a26c-ffea56028280 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:43.298028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c1090da3-e42a-4c89-97f2-7edbe00063b8 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:43.302403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c1090da3-e42a-4c89-97f2-7edbe00063b8 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:43.319474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:43.322308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=8 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:43.324315 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-12590237-6ef0-4095-a26c-ffea56028280 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1274 microversion: 2.1 time: 0.269174 Oct 12 22:18:43.343045 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1978/4519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:43 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1274 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:43.361803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1090da3-e42a-4c89-97f2-7edbe00063b8 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:43.376402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1090da3-e42a-4c89-97f2-7edbe00063b8 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:43.378851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1090da3-e42a-4c89-97f2-7edbe00063b8 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:43.382267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1090da3-e42a-4c89-97f2-7edbe00063b8 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:43.384012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1090da3-e42a-4c89-97f2-7edbe00063b8 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:43.385422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1090da3-e42a-4c89-97f2-7edbe00063b8 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:43.571710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-777770172", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "9a2a02c7-ec66-4732-948f-0b65dc9d1bd0"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:43.678599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] validate_networks() for [('9a2a02c7-ec66-4732-948f-0b65dc9d1bd0', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:18:43.839424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c1090da3-e42a-4c89-97f2-7edbe00063b8 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:43.852002 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c1090da3-e42a-4c89-97f2-7edbe00063b8 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1322 microversion: 2.1 time: 0.562642 Oct 12 22:18:43.852926 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2542/4520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:43 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1322 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:43.857967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-06447b4e-f256-4d56-8313-383d04a68fa2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:43.862506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-06447b4e-f256-4d56-8313-383d04a68fa2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:43.879639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06447b4e-f256-4d56-8313-383d04a68fa2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:43.882957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06447b4e-f256-4d56-8313-383d04a68fa2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:43.883536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06447b4e-f256-4d56-8313-383d04a68fa2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:43.884980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06447b4e-f256-4d56-8313-383d04a68fa2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:43.886772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06447b4e-f256-4d56-8313-383d04a68fa2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:43.887614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06447b4e-f256-4d56-8313-383d04a68fa2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:44.262783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-06447b4e-f256-4d56-8313-383d04a68fa2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:44.272880 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-06447b4e-f256-4d56-8313-383d04a68fa2 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1680 microversion: 2.1 time: 0.418548 Oct 12 22:18:44.275970 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2543/4521] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:43 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1680 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:44.287806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5a4deb7f-a1ae-40f8-b7ba-b5a99cf972b5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:44.288687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5a4deb7f-a1ae-40f8-b7ba-b5a99cf972b5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:44.301329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a4deb7f-a1ae-40f8-b7ba-b5a99cf972b5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:44.302113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a4deb7f-a1ae-40f8-b7ba-b5a99cf972b5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:44.303307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a4deb7f-a1ae-40f8-b7ba-b5a99cf972b5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:44.304235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a4deb7f-a1ae-40f8-b7ba-b5a99cf972b5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:44.308522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a4deb7f-a1ae-40f8-b7ba-b5a99cf972b5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:44.309396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a4deb7f-a1ae-40f8-b7ba-b5a99cf972b5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:44.760826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5a4deb7f-a1ae-40f8-b7ba-b5a99cf972b5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:44.778092 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5a4deb7f-a1ae-40f8-b7ba-b5a99cf972b5 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1324 microversion: 2.1 time: 0.498992 Oct 12 22:18:44.778859 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2544/4522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:44 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1324 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:44.788220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-df419a18-464a-44c6-be43-060b893d88aa req-a4b97f39-fa13-419a-8457-9078cab2c9fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c3d25fc-6847-4002-96d8-72d6291ec58f", "tag": "483f65fb-53cf-4486-9f4e-74a36babcc9f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:44.801146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-df419a18-464a-44c6-be43-060b893d88aa req-a4b97f39-fa13-419a-8457-9078cab2c9fe service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:44.801965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-df419a18-464a-44c6-be43-060b893d88aa req-a4b97f39-fa13-419a-8457-9078cab2c9fe service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:44.803786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-df419a18-464a-44c6-be43-060b893d88aa req-a4b97f39-fa13-419a-8457-9078cab2c9fe service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:44.825202 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-df419a18-464a-44c6-be43-060b893d88aa req-a4b97f39-fa13-419a-8457-9078cab2c9fe service nova] Creating event network-changed:483f65fb-53cf-4486-9f4e-74a36babcc9f for instance 8c3d25fc-6847-4002-96d8-72d6291ec58f on n-h1-861111-1 Oct 12 22:18:44.831955 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-df419a18-464a-44c6-be43-060b893d88aa req-a4b97f39-fa13-419a-8457-9078cab2c9fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050329 Oct 12 22:18:44.833410 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2545/4523] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:18:44.840207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-22043ba3-4eef-45b2-8ca7-49b3f6431953 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:44.841374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-22043ba3-4eef-45b2-8ca7-49b3f6431953 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:44.849826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22043ba3-4eef-45b2-8ca7-49b3f6431953 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:44.850817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22043ba3-4eef-45b2-8ca7-49b3f6431953 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:44.851663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22043ba3-4eef-45b2-8ca7-49b3f6431953 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:44.853208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22043ba3-4eef-45b2-8ca7-49b3f6431953 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:44.853987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22043ba3-4eef-45b2-8ca7-49b3f6431953 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:44.855284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22043ba3-4eef-45b2-8ca7-49b3f6431953 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:45.308380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-22043ba3-4eef-45b2-8ca7-49b3f6431953 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:45.324015 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-22043ba3-4eef-45b2-8ca7-49b3f6431953 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1316 microversion: 2.1 time: 0.487499 Oct 12 22:18:45.327080 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2546/4524] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:44 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:45.335035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-488d9c5a-7782-4797-9c08-62c1ee9c9784 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:45.335925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-488d9c5a-7782-4797-9c08-62c1ee9c9784 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:45.365259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-488d9c5a-7782-4797-9c08-62c1ee9c9784 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:45.365764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-488d9c5a-7782-4797-9c08-62c1ee9c9784 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:45.367573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-488d9c5a-7782-4797-9c08-62c1ee9c9784 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:45.368612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-488d9c5a-7782-4797-9c08-62c1ee9c9784 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:45.370398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-488d9c5a-7782-4797-9c08-62c1ee9c9784 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:45.371012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-488d9c5a-7782-4797-9c08-62c1ee9c9784 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:45.433365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:18:45.433865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:18:45.434235 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:18:45.434701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:18:45.435117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:18:45.456775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:45.457392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:45.458034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:45.460034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:45.461295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:45.464094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:45.550876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Getting quotas for project 64f851076c8e418e8247f942acb9355d. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:18:45.558685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Getting quotas for user 9abff5207f9f49d294f0a47342e0a9c2 and project 64f851076c8e418e8247f942acb9355d. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:18:45.574732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Going to run 3 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:18:45.577687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 198da671-4118-49da-ad40-506db4c1ce48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:18:45.633205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: c95fbb6a-0a59-41eb-8b29-fab44a51d53f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=198da671-4118-49da-ad40-506db4c1ce48,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:18:45.697247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=c95fbb6a-0a59-41eb-8b29-fab44a51d53f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:18:45.792893 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f81360bc-4781-4266-af36-58ef7988ca44 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.289721 Oct 12 22:18:45.794246 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1979/4525] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:18:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:18:45.799382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-91b7673f-78ca-4a0e-94b5-feebfb3f9cb9 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:45.800185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-91b7673f-78ca-4a0e-94b5-feebfb3f9cb9 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:45.807080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91b7673f-78ca-4a0e-94b5-feebfb3f9cb9 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:45.808020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91b7673f-78ca-4a0e-94b5-feebfb3f9cb9 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:45.808658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91b7673f-78ca-4a0e-94b5-feebfb3f9cb9 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:45.810829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91b7673f-78ca-4a0e-94b5-feebfb3f9cb9 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:45.812274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91b7673f-78ca-4a0e-94b5-feebfb3f9cb9 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:45.812896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91b7673f-78ca-4a0e-94b5-feebfb3f9cb9 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:46.066080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-488d9c5a-7782-4797-9c08-62c1ee9c9784 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:46.090307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-488d9c5a-7782-4797-9c08-62c1ee9c9784 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:46.091973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-488d9c5a-7782-4797-9c08-62c1ee9c9784 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:46.100887 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-488d9c5a-7782-4797-9c08-62c1ee9c9784 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 2957 microversion: 2.42 time: 0.772327 Oct 12 22:18:46.101929 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2547/4526] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:18:45 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 2957 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:18:46.120559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2aa0e37a-ae93-468f-b88e-e749eaf5f996 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:46.121228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2aa0e37a-ae93-468f-b88e-e749eaf5f996 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:46.146645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2aa0e37a-ae93-468f-b88e-e749eaf5f996 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:46.149344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2aa0e37a-ae93-468f-b88e-e749eaf5f996 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:46.154264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2aa0e37a-ae93-468f-b88e-e749eaf5f996 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:46.156354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2aa0e37a-ae93-468f-b88e-e749eaf5f996 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:46.158226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2aa0e37a-ae93-468f-b88e-e749eaf5f996 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:46.158692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2aa0e37a-ae93-468f-b88e-e749eaf5f996 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:46.400947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-91b7673f-78ca-4a0e-94b5-feebfb3f9cb9 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:46.432923 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-91b7673f-78ca-4a0e-94b5-feebfb3f9cb9 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1322 microversion: 2.1 time: 0.637416 Oct 12 22:18:46.448369 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1980/4527] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:45 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1322 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:46.468843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-df22fb47-5aa5-4831-87b3-70fae23e0fa6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:46.473552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-df22fb47-5aa5-4831-87b3-70fae23e0fa6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:46.490956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df22fb47-5aa5-4831-87b3-70fae23e0fa6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:46.491515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df22fb47-5aa5-4831-87b3-70fae23e0fa6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:46.499310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df22fb47-5aa5-4831-87b3-70fae23e0fa6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:46.523553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df22fb47-5aa5-4831-87b3-70fae23e0fa6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:46.524127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df22fb47-5aa5-4831-87b3-70fae23e0fa6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:46.524585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df22fb47-5aa5-4831-87b3-70fae23e0fa6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:46.739477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2aa0e37a-ae93-468f-b88e-e749eaf5f996 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:46.755176 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2aa0e37a-ae93-468f-b88e-e749eaf5f996 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1680 microversion: 2.1 time: 0.652080 Oct 12 22:18:46.760002 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2548/4528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:46 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1680 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:46.773056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b97174cc-7e4a-473a-adee-36357aad7fcd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:46.791160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b97174cc-7e4a-473a-adee-36357aad7fcd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:46.798478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b97174cc-7e4a-473a-adee-36357aad7fcd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Searching by: {'deleted': False, 'project_id': '64f851076c8e418e8247f942acb9355d'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:18:46.848697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b97174cc-7e4a-473a-adee-36357aad7fcd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:46.853842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b97174cc-7e4a-473a-adee-36357aad7fcd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:46.854364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b97174cc-7e4a-473a-adee-36357aad7fcd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:46.855589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b97174cc-7e4a-473a-adee-36357aad7fcd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:46.865978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b97174cc-7e4a-473a-adee-36357aad7fcd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:46.866836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b97174cc-7e4a-473a-adee-36357aad7fcd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:46.904932 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b97174cc-7e4a-473a-adee-36357aad7fcd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.142644 Oct 12 22:18:46.909907 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2549/4529] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 12 22:18:46 2022] GET /compute/v2.1/servers => generated 1015 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:46.920779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-191f8132-f5e0-4abd-a72b-e28cebaf4650 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:46.922684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-191f8132-f5e0-4abd-a72b-e28cebaf4650 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:46.942131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-191f8132-f5e0-4abd-a72b-e28cebaf4650 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:46.943472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-191f8132-f5e0-4abd-a72b-e28cebaf4650 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:46.944462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-191f8132-f5e0-4abd-a72b-e28cebaf4650 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:46.947560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-191f8132-f5e0-4abd-a72b-e28cebaf4650 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:46.953053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-191f8132-f5e0-4abd-a72b-e28cebaf4650 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:46.953980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-191f8132-f5e0-4abd-a72b-e28cebaf4650 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:47.083000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-df22fb47-5aa5-4831-87b3-70fae23e0fa6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:47.093642 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-df22fb47-5aa5-4831-87b3-70fae23e0fa6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1324 microversion: 2.1 time: 0.640642 Oct 12 22:18:47.097905 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1981/4530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:46 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1324 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:47.113144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-064dd571-bea0-419c-9828-23c6fc209c6f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:47.120824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-064dd571-bea0-419c-9828-23c6fc209c6f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:47.138832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-064dd571-bea0-419c-9828-23c6fc209c6f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:47.139613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-064dd571-bea0-419c-9828-23c6fc209c6f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:47.146526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-064dd571-bea0-419c-9828-23c6fc209c6f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:47.147527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-064dd571-bea0-419c-9828-23c6fc209c6f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:47.148192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-064dd571-bea0-419c-9828-23c6fc209c6f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:47.150361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-064dd571-bea0-419c-9828-23c6fc209c6f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:47.219889 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-191f8132-f5e0-4abd-a72b-e28cebaf4650 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.303419 Oct 12 22:18:47.230316 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2550/4531] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 12 22:18:46 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00/os-interface => generated 1832 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:18:47.230316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4deb4027-0af0-4826-83ff-b3c9cf643494 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:47.230316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4deb4027-0af0-4826-83ff-b3c9cf643494 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:47.902773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-064dd571-bea0-419c-9828-23c6fc209c6f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:47.920624 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-064dd571-bea0-419c-9828-23c6fc209c6f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1316 microversion: 2.1 time: 0.820849 Oct 12 22:18:47.923680 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1982/4532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:47 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1316 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:47.945556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4deb4027-0af0-4826-83ff-b3c9cf643494 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:47.952305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-611e413b-4f3f-47d2-b6e9-0ddd82cc7533 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:47.952970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-611e413b-4f3f-47d2-b6e9-0ddd82cc7533 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:47.975444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-611e413b-4f3f-47d2-b6e9-0ddd82cc7533 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:47.975931 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4deb4027-0af0-4826-83ff-b3c9cf643494 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 200 len: 1222 microversion: 2.1 time: 0.751082 Oct 12 22:18:47.977588 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2551/4533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:47 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 1222 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:47.978294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-611e413b-4f3f-47d2-b6e9-0ddd82cc7533 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:47.978941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-611e413b-4f3f-47d2-b6e9-0ddd82cc7533 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:47.982639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-611e413b-4f3f-47d2-b6e9-0ddd82cc7533 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:47.983869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-611e413b-4f3f-47d2-b6e9-0ddd82cc7533 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:47.984552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-611e413b-4f3f-47d2-b6e9-0ddd82cc7533 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:48.011670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f45f21d8-c7d6-4f72-b322-e5fe48261fd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:48.017708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f45f21d8-c7d6-4f72-b322-e5fe48261fd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:48.057439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f45f21d8-c7d6-4f72-b322-e5fe48261fd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:48.058013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f45f21d8-c7d6-4f72-b322-e5fe48261fd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:48.058475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f45f21d8-c7d6-4f72-b322-e5fe48261fd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:48.059386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f45f21d8-c7d6-4f72-b322-e5fe48261fd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:48.067616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f45f21d8-c7d6-4f72-b322-e5fe48261fd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:48.072549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f45f21d8-c7d6-4f72-b322-e5fe48261fd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:48.524730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-611e413b-4f3f-47d2-b6e9-0ddd82cc7533 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:48.545002 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-611e413b-4f3f-47d2-b6e9-0ddd82cc7533 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1322 microversion: 2.1 time: 0.615850 Oct 12 22:18:48.546225 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1983/4534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:47 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1322 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:48.562354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c2f1f188-1276-49ca-9b22-4ce1186768d6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:48.563199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c2f1f188-1276-49ca-9b22-4ce1186768d6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:48.589400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2f1f188-1276-49ca-9b22-4ce1186768d6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:48.592040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2f1f188-1276-49ca-9b22-4ce1186768d6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:48.593568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2f1f188-1276-49ca-9b22-4ce1186768d6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:48.597222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2f1f188-1276-49ca-9b22-4ce1186768d6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:48.599373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2f1f188-1276-49ca-9b22-4ce1186768d6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:48.601169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2f1f188-1276-49ca-9b22-4ce1186768d6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:48.871830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f45f21d8-c7d6-4f72-b322-e5fe48261fd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:48.889812 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f45f21d8-c7d6-4f72-b322-e5fe48261fd7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1657 microversion: 2.1 time: 0.908756 Oct 12 22:18:48.904068 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2552/4535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:47 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1657 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:48.904068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-ca0f1d44-0608-47b9-bd7e-c61003cb039c req-98e40e1e-0a37-4761-a8bb-d3e2827b6219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02be5cee-72e9-4cc6-94a2-c3517ec178bd", "tag": "ba67b2ed-d4b3-4942-b9cd-37eda012789a"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:48.921304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ca0f1d44-0608-47b9-bd7e-c61003cb039c req-98e40e1e-0a37-4761-a8bb-d3e2827b6219 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:48.922254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ca0f1d44-0608-47b9-bd7e-c61003cb039c req-98e40e1e-0a37-4761-a8bb-d3e2827b6219 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:48.928447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ca0f1d44-0608-47b9-bd7e-c61003cb039c req-98e40e1e-0a37-4761-a8bb-d3e2827b6219 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:48.956030 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-ca0f1d44-0608-47b9-bd7e-c61003cb039c req-98e40e1e-0a37-4761-a8bb-d3e2827b6219 service nova] Creating event network-changed:ba67b2ed-d4b3-4942-b9cd-37eda012789a for instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd on n-h2-861111-1 Oct 12 22:18:48.964170 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-ca0f1d44-0608-47b9-bd7e-c61003cb039c req-98e40e1e-0a37-4761-a8bb-d3e2827b6219 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069229 Oct 12 22:18:48.964814 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2553/4536] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:18:48.970103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9f6222dd-bf8b-4c58-b3cb-8ffadfe2ba24 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:48.977582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f6222dd-bf8b-4c58-b3cb-8ffadfe2ba24 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:48.978115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f6222dd-bf8b-4c58-b3cb-8ffadfe2ba24 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:48.978614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f6222dd-bf8b-4c58-b3cb-8ffadfe2ba24 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:49.005121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9f6222dd-bf8b-4c58-b3cb-8ffadfe2ba24 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Going to try to start instance {{(pid=120453) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 22:18:49.029285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c2f1f188-1276-49ca-9b22-4ce1186768d6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:49.041101 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c2f1f188-1276-49ca-9b22-4ce1186768d6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1324 microversion: 2.1 time: 0.491826 Oct 12 22:18:49.044046 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1984/4537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:48 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1324 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:49.057352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d23eeaed-bdd1-4875-8fa3-7c20a71d873d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:49.058405 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d23eeaed-bdd1-4875-8fa3-7c20a71d873d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:49.076944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d23eeaed-bdd1-4875-8fa3-7c20a71d873d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:49.078081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d23eeaed-bdd1-4875-8fa3-7c20a71d873d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:49.078802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d23eeaed-bdd1-4875-8fa3-7c20a71d873d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:49.080100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d23eeaed-bdd1-4875-8fa3-7c20a71d873d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:49.081447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d23eeaed-bdd1-4875-8fa3-7c20a71d873d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:49.082275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d23eeaed-bdd1-4875-8fa3-7c20a71d873d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:49.092420 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9f6222dd-bf8b-4c58-b3cb-8ffadfe2ba24 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 202 len: 0 microversion: 2.1 time: 0.126185 Oct 12 22:18:49.096081 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2554/4538] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:18:48 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:18:49.110179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a709a918-2918-4d03-8dad-60ed14b4ddd8 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:49.115712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a709a918-2918-4d03-8dad-60ed14b4ddd8 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:49.131940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a709a918-2918-4d03-8dad-60ed14b4ddd8 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:49.133910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a709a918-2918-4d03-8dad-60ed14b4ddd8 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:49.134596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a709a918-2918-4d03-8dad-60ed14b4ddd8 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:49.137083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a709a918-2918-4d03-8dad-60ed14b4ddd8 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:49.137865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a709a918-2918-4d03-8dad-60ed14b4ddd8 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:49.139194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a709a918-2918-4d03-8dad-60ed14b4ddd8 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:49.251270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a709a918-2918-4d03-8dad-60ed14b4ddd8 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:49.273420 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a709a918-2918-4d03-8dad-60ed14b4ddd8 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 200 len: 1218 microversion: 2.1 time: 0.173974 Oct 12 22:18:49.276597 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2555/4539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:49 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 1218 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:49.293531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-75e784de-1bba-443e-bc97-0a9b8ff45734 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:49.296450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-75e784de-1bba-443e-bc97-0a9b8ff45734 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:49.316289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75e784de-1bba-443e-bc97-0a9b8ff45734 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:49.317305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75e784de-1bba-443e-bc97-0a9b8ff45734 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:49.318906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75e784de-1bba-443e-bc97-0a9b8ff45734 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:49.322429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75e784de-1bba-443e-bc97-0a9b8ff45734 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:49.323088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75e784de-1bba-443e-bc97-0a9b8ff45734 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:49.323734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75e784de-1bba-443e-bc97-0a9b8ff45734 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:50.066229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-75e784de-1bba-443e-bc97-0a9b8ff45734 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:50.081548 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-75e784de-1bba-443e-bc97-0a9b8ff45734 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1666 microversion: 2.1 time: 0.799798 Oct 12 22:18:50.082440 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2556/4540] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:49 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1666 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:50.095776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-75f0d835-4066-4a9d-812c-0cf57546c841 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:50.097991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-75f0d835-4066-4a9d-812c-0cf57546c841 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:50.115392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75f0d835-4066-4a9d-812c-0cf57546c841 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:50.115916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75f0d835-4066-4a9d-812c-0cf57546c841 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:50.119518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75f0d835-4066-4a9d-812c-0cf57546c841 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:50.120276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75f0d835-4066-4a9d-812c-0cf57546c841 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:50.120745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75f0d835-4066-4a9d-812c-0cf57546c841 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:50.121177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75f0d835-4066-4a9d-812c-0cf57546c841 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:50.191975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d23eeaed-bdd1-4875-8fa3-7c20a71d873d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:50.203558 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d23eeaed-bdd1-4875-8fa3-7c20a71d873d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1316 microversion: 2.1 time: 1.158110 Oct 12 22:18:50.204826 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1985/4541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:49 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1316 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:50.211866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0a89b098-50a2-468d-862f-92c2bb33340c tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:50.212771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0a89b098-50a2-468d-862f-92c2bb33340c tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:50.223524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a89b098-50a2-468d-862f-92c2bb33340c tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:50.224922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a89b098-50a2-468d-862f-92c2bb33340c tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:50.225749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a89b098-50a2-468d-862f-92c2bb33340c tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:50.227377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a89b098-50a2-468d-862f-92c2bb33340c tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:50.228063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a89b098-50a2-468d-862f-92c2bb33340c tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:50.233377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a89b098-50a2-468d-862f-92c2bb33340c tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:50.399457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-75f0d835-4066-4a9d-812c-0cf57546c841 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:50.414165 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-75f0d835-4066-4a9d-812c-0cf57546c841 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1322 microversion: 2.1 time: 0.326569 Oct 12 22:18:50.424353 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2557/4542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:50 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:50.431662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d986673f-4b64-441e-8a04-f74ce7f09682 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:50.432527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d986673f-4b64-441e-8a04-f74ce7f09682 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:50.445087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d986673f-4b64-441e-8a04-f74ce7f09682 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:50.448333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d986673f-4b64-441e-8a04-f74ce7f09682 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:50.449110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d986673f-4b64-441e-8a04-f74ce7f09682 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:50.450876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d986673f-4b64-441e-8a04-f74ce7f09682 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:50.452024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d986673f-4b64-441e-8a04-f74ce7f09682 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:50.453159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d986673f-4b64-441e-8a04-f74ce7f09682 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:50.638640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d986673f-4b64-441e-8a04-f74ce7f09682 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:50.653321 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d986673f-4b64-441e-8a04-f74ce7f09682 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 200 len: 1274 microversion: 2.1 time: 0.227458 Oct 12 22:18:50.654492 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2558/4543] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:50 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 1274 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:51.068571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0a89b098-50a2-468d-862f-92c2bb33340c tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:51.080531 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0a89b098-50a2-468d-862f-92c2bb33340c tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1324 microversion: 2.1 time: 0.874053 Oct 12 22:18:51.081316 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1986/4544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:50 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1324 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:51.110587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6692c86a-85e9-4369-9ce3-4c99e2df6283 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:51.113275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6692c86a-85e9-4369-9ce3-4c99e2df6283 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:51.122705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6692c86a-85e9-4369-9ce3-4c99e2df6283 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:51.125729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6692c86a-85e9-4369-9ce3-4c99e2df6283 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:51.126453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6692c86a-85e9-4369-9ce3-4c99e2df6283 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:51.127521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6692c86a-85e9-4369-9ce3-4c99e2df6283 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:51.128448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6692c86a-85e9-4369-9ce3-4c99e2df6283 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:51.129616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6692c86a-85e9-4369-9ce3-4c99e2df6283 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:51.155524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:51.231819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e6885f89-005c-47a2-8d12-c9f891477d1a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:51.233189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e6885f89-005c-47a2-8d12-c9f891477d1a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:51.244921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6885f89-005c-47a2-8d12-c9f891477d1a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:51.253563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6885f89-005c-47a2-8d12-c9f891477d1a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:51.255938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6885f89-005c-47a2-8d12-c9f891477d1a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:51.257722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6885f89-005c-47a2-8d12-c9f891477d1a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:51.258654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6885f89-005c-47a2-8d12-c9f891477d1a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:51.259372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6885f89-005c-47a2-8d12-c9f891477d1a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:51.523581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6692c86a-85e9-4369-9ce3-4c99e2df6283 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:51.534688 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6692c86a-85e9-4369-9ce3-4c99e2df6283 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1666 microversion: 2.1 time: 0.428620 Oct 12 22:18:51.550907 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2559/4545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:51 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1666 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:51.556191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7ae03e34-87e4-45b0-be6e-dcdb265d8ccc tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:51.557010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7ae03e34-87e4-45b0-be6e-dcdb265d8ccc tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:51.564272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ae03e34-87e4-45b0-be6e-dcdb265d8ccc tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:51.565060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ae03e34-87e4-45b0-be6e-dcdb265d8ccc tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:51.565681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ae03e34-87e4-45b0-be6e-dcdb265d8ccc tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:51.566597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ae03e34-87e4-45b0-be6e-dcdb265d8ccc tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:51.568503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ae03e34-87e4-45b0-be6e-dcdb265d8ccc tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:51.569104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ae03e34-87e4-45b0-be6e-dcdb265d8ccc tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:51.771091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e6885f89-005c-47a2-8d12-c9f891477d1a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:51.784047 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e6885f89-005c-47a2-8d12-c9f891477d1a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1316 microversion: 2.1 time: 0.557085 Oct 12 22:18:51.799977 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1987/4546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:51 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1316 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:51.812053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2c86028f-7d14-4e31-8501-ea25cdcf2df0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:51.813044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2c86028f-7d14-4e31-8501-ea25cdcf2df0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:51.831935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c86028f-7d14-4e31-8501-ea25cdcf2df0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:51.832633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c86028f-7d14-4e31-8501-ea25cdcf2df0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:51.833164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c86028f-7d14-4e31-8501-ea25cdcf2df0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:51.834744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c86028f-7d14-4e31-8501-ea25cdcf2df0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:51.835403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c86028f-7d14-4e31-8501-ea25cdcf2df0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:51.836014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c86028f-7d14-4e31-8501-ea25cdcf2df0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:51.890317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7ae03e34-87e4-45b0-be6e-dcdb265d8ccc tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:51.916031 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7ae03e34-87e4-45b0-be6e-dcdb265d8ccc tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1322 microversion: 2.1 time: 0.363209 Oct 12 22:18:51.917175 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2560/4547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:51 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1322 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:51.948176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2c86028f-7d14-4e31-8501-ea25cdcf2df0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:51.959099 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2c86028f-7d14-4e31-8501-ea25cdcf2df0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 200 len: 1280 microversion: 2.1 time: 0.157409 Oct 12 22:18:51.976564 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1988/4548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:51 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 1280 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:52.096765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-dca446c8-d46a-415b-ae5f-858b9d6de136 req-1b4ead76-a921-4478-80d5-1da1d79ddf28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b932bf7-cc37-4542-860e-efaa7ad47fa5", "name": "network-vif-plugged", "status": "completed", "tag": "7452409c-2f82-4fb9-8e36-8f34a323a328"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:52.107536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5a2dab5a-e4e6-4d64-abfb-5db5ef0d9b36 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:52.108200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5a2dab5a-e4e6-4d64-abfb-5db5ef0d9b36 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:52.109509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-dca446c8-d46a-415b-ae5f-858b9d6de136 req-1b4ead76-a921-4478-80d5-1da1d79ddf28 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:52.112001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-dca446c8-d46a-415b-ae5f-858b9d6de136 req-1b4ead76-a921-4478-80d5-1da1d79ddf28 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:52.113171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-dca446c8-d46a-415b-ae5f-858b9d6de136 req-1b4ead76-a921-4478-80d5-1da1d79ddf28 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:52.120933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a2dab5a-e4e6-4d64-abfb-5db5ef0d9b36 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:52.121444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a2dab5a-e4e6-4d64-abfb-5db5ef0d9b36 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:52.121895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a2dab5a-e4e6-4d64-abfb-5db5ef0d9b36 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:52.122620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a2dab5a-e4e6-4d64-abfb-5db5ef0d9b36 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:52.123136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a2dab5a-e4e6-4d64-abfb-5db5ef0d9b36 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:52.123539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a2dab5a-e4e6-4d64-abfb-5db5ef0d9b36 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:52.132107 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-dca446c8-d46a-415b-ae5f-858b9d6de136 req-1b4ead76-a921-4478-80d5-1da1d79ddf28 service nova] Creating event network-vif-plugged:7452409c-2f82-4fb9-8e36-8f34a323a328 for instance 4b932bf7-cc37-4542-860e-efaa7ad47fa5 on n-h2-861111-1 Oct 12 22:18:52.142886 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-dca446c8-d46a-415b-ae5f-858b9d6de136 req-1b4ead76-a921-4478-80d5-1da1d79ddf28 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051295 Oct 12 22:18:52.144168 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2561/4549] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:18:52.390862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-8fc9817b-5b1a-4708-ac3b-c85904785194 req-d8a77bea-57bb-4aba-8d4a-c1dff7bf9ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c95fbb6a-0a59-41eb-8b29-fab44a51d53f", "tag": "c65dbf77-2cd0-431f-8e52-bd6287b6e637"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:52.416731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8fc9817b-5b1a-4708-ac3b-c85904785194 req-d8a77bea-57bb-4aba-8d4a-c1dff7bf9ecc service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:52.420105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8fc9817b-5b1a-4708-ac3b-c85904785194 req-d8a77bea-57bb-4aba-8d4a-c1dff7bf9ecc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:52.422404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8fc9817b-5b1a-4708-ac3b-c85904785194 req-d8a77bea-57bb-4aba-8d4a-c1dff7bf9ecc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:52.447864 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-8fc9817b-5b1a-4708-ac3b-c85904785194 req-d8a77bea-57bb-4aba-8d4a-c1dff7bf9ecc service nova] Creating event network-changed:c65dbf77-2cd0-431f-8e52-bd6287b6e637 for instance c95fbb6a-0a59-41eb-8b29-fab44a51d53f on n-h2-861111-1 Oct 12 22:18:52.455639 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-8fc9817b-5b1a-4708-ac3b-c85904785194 req-d8a77bea-57bb-4aba-8d4a-c1dff7bf9ecc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079248 Oct 12 22:18:52.456696 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2562/4550] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:18:52.515303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5a2dab5a-e4e6-4d64-abfb-5db5ef0d9b36 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:52.524074 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5a2dab5a-e4e6-4d64-abfb-5db5ef0d9b36 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1324 microversion: 2.1 time: 0.420985 Oct 12 22:18:52.524962 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1989/4551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:52 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1324 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:18:52.559515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1ae4fbc3-58c4-4945-b297-6ad7f67d9e8d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:52.560804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1ae4fbc3-58c4-4945-b297-6ad7f67d9e8d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:52.567147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ae4fbc3-58c4-4945-b297-6ad7f67d9e8d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:52.568037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ae4fbc3-58c4-4945-b297-6ad7f67d9e8d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:52.569247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ae4fbc3-58c4-4945-b297-6ad7f67d9e8d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:52.570794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ae4fbc3-58c4-4945-b297-6ad7f67d9e8d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:52.571459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ae4fbc3-58c4-4945-b297-6ad7f67d9e8d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:52.572036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ae4fbc3-58c4-4945-b297-6ad7f67d9e8d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:52.807597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3c78d9f9-4009-4927-a777-96146a388672 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:52.809749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3c78d9f9-4009-4927-a777-96146a388672 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:52.820531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c78d9f9-4009-4927-a777-96146a388672 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:52.823613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c78d9f9-4009-4927-a777-96146a388672 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:52.824988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c78d9f9-4009-4927-a777-96146a388672 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:52.827874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c78d9f9-4009-4927-a777-96146a388672 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:52.829378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c78d9f9-4009-4927-a777-96146a388672 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:52.829978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c78d9f9-4009-4927-a777-96146a388672 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:52.843771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1ae4fbc3-58c4-4945-b297-6ad7f67d9e8d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:52.853100 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1ae4fbc3-58c4-4945-b297-6ad7f67d9e8d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1666 microversion: 2.1 time: 0.298749 Oct 12 22:18:52.856934 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2563/4552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:52 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1666 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:52.945119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ff5347e4-dfa2-408c-91fb-787a230cee29 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:52.946216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ff5347e4-dfa2-408c-91fb-787a230cee29 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:52.961372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:52.972803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff5347e4-dfa2-408c-91fb-787a230cee29 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:52.979955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff5347e4-dfa2-408c-91fb-787a230cee29 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:52.980674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff5347e4-dfa2-408c-91fb-787a230cee29 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:52.983105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff5347e4-dfa2-408c-91fb-787a230cee29 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:52.991993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff5347e4-dfa2-408c-91fb-787a230cee29 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:52.992491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff5347e4-dfa2-408c-91fb-787a230cee29 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:53.755956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ff5347e4-dfa2-408c-91fb-787a230cee29 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:53.813175 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ff5347e4-dfa2-408c-91fb-787a230cee29 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1322 microversion: 2.1 time: 0.872357 Oct 12 22:18:53.819132 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2564/4553] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:52 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1322 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:53.842450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-deaf8ec0-ade2-4d4d-ba53-2b00d4052768 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:53.843104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-deaf8ec0-ade2-4d4d-ba53-2b00d4052768 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:53.853178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3c78d9f9-4009-4927-a777-96146a388672 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:53.859727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-deaf8ec0-ade2-4d4d-ba53-2b00d4052768 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:53.860238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-deaf8ec0-ade2-4d4d-ba53-2b00d4052768 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:53.861177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-deaf8ec0-ade2-4d4d-ba53-2b00d4052768 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:53.862111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-deaf8ec0-ade2-4d4d-ba53-2b00d4052768 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:53.862936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-deaf8ec0-ade2-4d4d-ba53-2b00d4052768 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:53.863507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-deaf8ec0-ade2-4d4d-ba53-2b00d4052768 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:53.864424 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3c78d9f9-4009-4927-a777-96146a388672 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1316 microversion: 2.1 time: 1.060736 Oct 12 22:18:53.868568 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1990/4554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:52 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1316 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:53.874830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8619c28d-65fa-425b-8ee3-7f3993dfb209 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:53.875779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8619c28d-65fa-425b-8ee3-7f3993dfb209 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:53.884248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8619c28d-65fa-425b-8ee3-7f3993dfb209 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:53.885081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8619c28d-65fa-425b-8ee3-7f3993dfb209 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:53.885751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8619c28d-65fa-425b-8ee3-7f3993dfb209 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:53.887298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8619c28d-65fa-425b-8ee3-7f3993dfb209 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:53.888288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8619c28d-65fa-425b-8ee3-7f3993dfb209 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:53.888950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8619c28d-65fa-425b-8ee3-7f3993dfb209 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:54.025193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-deaf8ec0-ade2-4d4d-ba53-2b00d4052768 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:54.036138 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-deaf8ec0-ade2-4d4d-ba53-2b00d4052768 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 200 len: 1280 microversion: 2.1 time: 0.212354 Oct 12 22:18:54.038160 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2565/4555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:53 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 1280 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:54.044931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-03efe7d9-7fe2-43dd-938e-dcaf20238bcf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:54.045803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-03efe7d9-7fe2-43dd-938e-dcaf20238bcf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:54.061967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03efe7d9-7fe2-43dd-938e-dcaf20238bcf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:54.063201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03efe7d9-7fe2-43dd-938e-dcaf20238bcf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:54.064502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03efe7d9-7fe2-43dd-938e-dcaf20238bcf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:54.065892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03efe7d9-7fe2-43dd-938e-dcaf20238bcf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:54.066514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03efe7d9-7fe2-43dd-938e-dcaf20238bcf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:54.067151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03efe7d9-7fe2-43dd-938e-dcaf20238bcf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:54.366209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-03efe7d9-7fe2-43dd-938e-dcaf20238bcf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:54.374681 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-03efe7d9-7fe2-43dd-938e-dcaf20238bcf tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1666 microversion: 2.1 time: 0.335153 Oct 12 22:18:54.375683 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2566/4556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:54 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1666 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:54.380484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-1c499adc-f076-4b21-aa0a-48a983e7c5ab req-a5fb2325-891f-4e13-9f78-260448ffe907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c3d25fc-6847-4002-96d8-72d6291ec58f", "name": "network-vif-plugged", "status": "completed", "tag": "483f65fb-53cf-4486-9f4e-74a36babcc9f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:54.396580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1c499adc-f076-4b21-aa0a-48a983e7c5ab req-a5fb2325-891f-4e13-9f78-260448ffe907 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:54.397071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1c499adc-f076-4b21-aa0a-48a983e7c5ab req-a5fb2325-891f-4e13-9f78-260448ffe907 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:54.397512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1c499adc-f076-4b21-aa0a-48a983e7c5ab req-a5fb2325-891f-4e13-9f78-260448ffe907 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:54.411675 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-1c499adc-f076-4b21-aa0a-48a983e7c5ab req-a5fb2325-891f-4e13-9f78-260448ffe907 service nova] Creating event network-vif-plugged:483f65fb-53cf-4486-9f4e-74a36babcc9f for instance 8c3d25fc-6847-4002-96d8-72d6291ec58f on n-h1-861111-1 Oct 12 22:18:54.418094 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-1c499adc-f076-4b21-aa0a-48a983e7c5ab req-a5fb2325-891f-4e13-9f78-260448ffe907 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040905 Oct 12 22:18:54.418502 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2567/4557] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:18:54.662634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8619c28d-65fa-425b-8ee3-7f3993dfb209 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:54.675960 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8619c28d-65fa-425b-8ee3-7f3993dfb209 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1324 microversion: 2.1 time: 0.806111 Oct 12 22:18:54.676791 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1991/4558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:53 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1324 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:54.844105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e7df03a8-a72a-4635-a0fa-6ff8cee88c3d tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:54.846103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e7df03a8-a72a-4635-a0fa-6ff8cee88c3d tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:54.865204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7df03a8-a72a-4635-a0fa-6ff8cee88c3d tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:54.866625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7df03a8-a72a-4635-a0fa-6ff8cee88c3d tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:54.867274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7df03a8-a72a-4635-a0fa-6ff8cee88c3d tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:54.868957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7df03a8-a72a-4635-a0fa-6ff8cee88c3d tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:54.869601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7df03a8-a72a-4635-a0fa-6ff8cee88c3d tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:54.871200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7df03a8-a72a-4635-a0fa-6ff8cee88c3d tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:54.894497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-07863823-1cd2-4a1c-9f65-cd503f21dd35 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:54.895118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-07863823-1cd2-4a1c-9f65-cd503f21dd35 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:54.903861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07863823-1cd2-4a1c-9f65-cd503f21dd35 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:54.904357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07863823-1cd2-4a1c-9f65-cd503f21dd35 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:54.904791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07863823-1cd2-4a1c-9f65-cd503f21dd35 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:54.905495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07863823-1cd2-4a1c-9f65-cd503f21dd35 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:54.905956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07863823-1cd2-4a1c-9f65-cd503f21dd35 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:54.906371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07863823-1cd2-4a1c-9f65-cd503f21dd35 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:55.111838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e7df03a8-a72a-4635-a0fa-6ff8cee88c3d tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:55.122562 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e7df03a8-a72a-4635-a0fa-6ff8cee88c3d tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1322 microversion: 2.1 time: 0.284041 Oct 12 22:18:55.137218 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2568/4559] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:54 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:55.149018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b1547b58-f384-46ae-9b40-20b137d76881 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:55.149867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b1547b58-f384-46ae-9b40-20b137d76881 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:55.158217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1547b58-f384-46ae-9b40-20b137d76881 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:55.158875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1547b58-f384-46ae-9b40-20b137d76881 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:55.159587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1547b58-f384-46ae-9b40-20b137d76881 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:55.160437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1547b58-f384-46ae-9b40-20b137d76881 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:55.161233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1547b58-f384-46ae-9b40-20b137d76881 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:55.161807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1547b58-f384-46ae-9b40-20b137d76881 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:55.336136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-07863823-1cd2-4a1c-9f65-cd503f21dd35 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:55.359429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:55.362146 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-07863823-1cd2-4a1c-9f65-cd503f21dd35 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1316 microversion: 2.1 time: 0.472031 Oct 12 22:18:55.368164 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1992/4560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:54 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:18:55.401424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-09cff622-c5cb-4a5b-9260-d62b3f462e72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:55.402047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-09cff622-c5cb-4a5b-9260-d62b3f462e72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:55.416247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09cff622-c5cb-4a5b-9260-d62b3f462e72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:55.418146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09cff622-c5cb-4a5b-9260-d62b3f462e72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:55.419142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09cff622-c5cb-4a5b-9260-d62b3f462e72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:55.420215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09cff622-c5cb-4a5b-9260-d62b3f462e72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:55.420874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09cff622-c5cb-4a5b-9260-d62b3f462e72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:55.421299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09cff622-c5cb-4a5b-9260-d62b3f462e72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:55.496937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b1547b58-f384-46ae-9b40-20b137d76881 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:55.517916 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b1547b58-f384-46ae-9b40-20b137d76881 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 200 len: 1322 microversion: 2.1 time: 0.374192 Oct 12 22:18:55.518673 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2569/4561] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:55 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:55.540275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:55.568704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=22 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:55.706727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c223458b-33aa-43c1-bd4f-e47ce870f65f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:55.707416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c223458b-33aa-43c1-bd4f-e47ce870f65f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:55.714943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c223458b-33aa-43c1-bd4f-e47ce870f65f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:55.715650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c223458b-33aa-43c1-bd4f-e47ce870f65f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:55.716091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c223458b-33aa-43c1-bd4f-e47ce870f65f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:55.716800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c223458b-33aa-43c1-bd4f-e47ce870f65f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:55.717252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c223458b-33aa-43c1-bd4f-e47ce870f65f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:55.717858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c223458b-33aa-43c1-bd4f-e47ce870f65f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:55.964143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-09cff622-c5cb-4a5b-9260-d62b3f462e72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:55.978247 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-09cff622-c5cb-4a5b-9260-d62b3f462e72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1666 microversion: 2.1 time: 0.583039 Oct 12 22:18:55.979994 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1993/4562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:55 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1666 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:56.157871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6be3e8d3-af1f-4af4-b54e-3e9ef3ec1a3b tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:56.158853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6be3e8d3-af1f-4af4-b54e-3e9ef3ec1a3b tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:56.172631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be3e8d3-af1f-4af4-b54e-3e9ef3ec1a3b tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:56.173144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be3e8d3-af1f-4af4-b54e-3e9ef3ec1a3b tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:56.173640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be3e8d3-af1f-4af4-b54e-3e9ef3ec1a3b tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:56.174377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be3e8d3-af1f-4af4-b54e-3e9ef3ec1a3b tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:56.174842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be3e8d3-af1f-4af4-b54e-3e9ef3ec1a3b tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:56.181004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be3e8d3-af1f-4af4-b54e-3e9ef3ec1a3b tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:56.192030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c223458b-33aa-43c1-bd4f-e47ce870f65f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:56.206314 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c223458b-33aa-43c1-bd4f-e47ce870f65f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1324 microversion: 2.1 time: 0.504258 Oct 12 22:18:56.207590 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2570/4563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:55 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1324 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:18:56.363914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-54835900-f77a-4403-82ba-df539ea58cbe req-8fb9ea9f-211c-4bc7-94c2-6f9d12ea87ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198da671-4118-49da-ad40-506db4c1ce48", "tag": "8b928845-d81b-4599-996d-6e7920586d83"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:56.378132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-54835900-f77a-4403-82ba-df539ea58cbe req-8fb9ea9f-211c-4bc7-94c2-6f9d12ea87ae service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:56.378868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-54835900-f77a-4403-82ba-df539ea58cbe req-8fb9ea9f-211c-4bc7-94c2-6f9d12ea87ae service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:56.379487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-54835900-f77a-4403-82ba-df539ea58cbe req-8fb9ea9f-211c-4bc7-94c2-6f9d12ea87ae service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:56.394856 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-54835900-f77a-4403-82ba-df539ea58cbe req-8fb9ea9f-211c-4bc7-94c2-6f9d12ea87ae service nova] Creating event network-changed:8b928845-d81b-4599-996d-6e7920586d83 for instance 198da671-4118-49da-ad40-506db4c1ce48 on n-h1-861111-1 Oct 12 22:18:56.401447 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-54835900-f77a-4403-82ba-df539ea58cbe req-8fb9ea9f-211c-4bc7-94c2-6f9d12ea87ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041269 Oct 12 22:18:56.403068 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2571/4564] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:18:56.410659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02ad259a-7418-4cb2-bc34-0e2b55eae607 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:56.412179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-02ad259a-7418-4cb2-bc34-0e2b55eae607 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:56.419790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02ad259a-7418-4cb2-bc34-0e2b55eae607 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:56.420511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02ad259a-7418-4cb2-bc34-0e2b55eae607 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:56.420952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02ad259a-7418-4cb2-bc34-0e2b55eae607 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:56.421683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02ad259a-7418-4cb2-bc34-0e2b55eae607 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:56.422139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02ad259a-7418-4cb2-bc34-0e2b55eae607 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:56.422563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02ad259a-7418-4cb2-bc34-0e2b55eae607 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:56.580421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-02ad259a-7418-4cb2-bc34-0e2b55eae607 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:56.592434 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-02ad259a-7418-4cb2-bc34-0e2b55eae607 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1316 microversion: 2.1 time: 0.187193 Oct 12 22:18:56.607658 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2572/4565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:56 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1316 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:56.607658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ede60c60-91ac-4db1-8c1d-f0c65cc6c3e9 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:56.607658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ede60c60-91ac-4db1-8c1d-f0c65cc6c3e9 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:56.607658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ede60c60-91ac-4db1-8c1d-f0c65cc6c3e9 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:56.607658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ede60c60-91ac-4db1-8c1d-f0c65cc6c3e9 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:56.607658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ede60c60-91ac-4db1-8c1d-f0c65cc6c3e9 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:56.607658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ede60c60-91ac-4db1-8c1d-f0c65cc6c3e9 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:56.607658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ede60c60-91ac-4db1-8c1d-f0c65cc6c3e9 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:56.607658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ede60c60-91ac-4db1-8c1d-f0c65cc6c3e9 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:56.753133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ede60c60-91ac-4db1-8c1d-f0c65cc6c3e9 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:56.766916 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ede60c60-91ac-4db1-8c1d-f0c65cc6c3e9 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 200 len: 1322 microversion: 2.1 time: 0.172633 Oct 12 22:18:56.773657 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2573/4566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:56 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:57.004311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fb802d29-1d94-46e4-bcb8-4fe8ae013e6e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:57.005734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fb802d29-1d94-46e4-bcb8-4fe8ae013e6e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:57.009575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:57.013706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fb802d29-1d94-46e4-bcb8-4fe8ae013e6e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:57.014355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fb802d29-1d94-46e4-bcb8-4fe8ae013e6e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:57.014887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fb802d29-1d94-46e4-bcb8-4fe8ae013e6e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:57.015734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fb802d29-1d94-46e4-bcb8-4fe8ae013e6e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:57.016309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fb802d29-1d94-46e4-bcb8-4fe8ae013e6e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:57.016830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fb802d29-1d94-46e4-bcb8-4fe8ae013e6e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:57.078036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6be3e8d3-af1f-4af4-b54e-3e9ef3ec1a3b tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:57.094857 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6be3e8d3-af1f-4af4-b54e-3e9ef3ec1a3b tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1517 microversion: 2.1 time: 0.948912 Oct 12 22:18:57.098995 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1994/4567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:56 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1517 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:57.168786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d2c72285-e841-4862-92d7-c07c944f1c58 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-807931223", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "f0451602-65c9-4377-86bb-844c8c5d61b8"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d2c72285-e841-4862-92d7-c07c944f1c58 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Request method failure captured: Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 242 Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz02ywsmbbJR4guYrjJbn8t6VIKMwCOlBYUJ2Wsew2sZOSima6NrGR66HSxkk_bNf2cwVDx0KZ1nOANp2VIHeMb6JahYfj5MwvYWqQf-m5RrhmQ4t9cBNehaeGqg105v7MzN1sSE8ouhcVAgwdTefgFUGGVb0Kff-b6_5jhNcoTzCsI Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: f3336d74185d4f72a3626f6faaf7a984 Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f3336d74185d4f72a3626f6faaf7a984", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: f3336d74185d4f72a3626f6faaf7a984 Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerMetadataNegativeTestJSON-543201631-project Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 6c0a1153dcc24b3bb32c7570d878ba84 Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-543201631-project Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-807931223", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "f0451602-65c9-4377-86bb-844c8c5d61b8"}]}} Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-807931223', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'f0451602-65c9-4377-86bb-844c8c5d61b8'}]}}} Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:18:57.174672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:18:57.179821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:18:57.179821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:18:57.179821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:18:57.179821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:18:57.179821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:18:57.179821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:18:57.179821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:57.179821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.179821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:57.179821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.179821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:57.179821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:57.179821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:57.179821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:18:57.179821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:18:57.179821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:57.179821 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.182439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d2c72285-e841-4862-92d7-c07c944f1c58 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:18:57.184165 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d2c72285-e841-4862-92d7-c07c944f1c58 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.019755 Oct 12 22:18:57.184756 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1995/4568] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:18:57 2022] POST /compute/v2.1/servers => generated 175 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:18:57.185586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fb802d29-1d94-46e4-bcb8-4fe8ae013e6e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:57.196327 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fb802d29-1d94-46e4-bcb8-4fe8ae013e6e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.195994 Oct 12 22:18:57.196981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-819fd45a-dd0b-492f-9d61-8c5d16f0ec46 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:57.196981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-819fd45a-dd0b-492f-9d61-8c5d16f0ec46 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: a7387140-afa9-400c-b372-2e4f8d027b33] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:57.203936 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-819fd45a-dd0b-492f-9d61-8c5d16f0ec46 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] HTTP exception thrown: Instance a7387140-afa9-400c-b372-2e4f8d027b33 could not be found. Oct 12 22:18:57.209717 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2574/4569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:56 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-819fd45a-dd0b-492f-9d61-8c5d16f0ec46 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Request method failure captured: Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/a7387140-afa9-400c-b372-2e4f8d027b33/metadata HTTP/1.1 Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz02ywsmbbJR4guYrjJbn8t6VIKMwCOlBYUJ2Wsew2sZOSima6NrGR66HSxkk_bNf2cwVDx0KZ1nOANp2VIHeMb6JahYfj5MwvYWqQf-m5RrhmQ4t9cBNehaeGqg105v7MzN1sSE8ouhcVAgwdTefgFUGGVb0Kff-b6_5jhNcoTzCsI Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: f3336d74185d4f72a3626f6faaf7a984 Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f3336d74185d4f72a3626f6faaf7a984", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: f3336d74185d4f72a3626f6faaf7a984 Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerMetadataNegativeTestJSON-543201631-project Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 6c0a1153dcc24b3bb32c7570d878ba84 Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-543201631-project Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance a7387140-afa9-400c-b372-2e4f8d027b33 could not be found. Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'server_id': 'a7387140-afa9-400c-b372-2e4f8d027b33'} Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7387140-afa9-400c-b372-2e4f8d027b33 could not be found. Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7387140-afa9-400c-b372-2e4f8d027b33 could not be found. Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:57.210738 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:57.214105 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:18:57.214105 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:18:57.214105 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7387140-afa9-400c-b372-2e4f8d027b33 could not be found. Oct 12 22:18:57.214105 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.216947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-819fd45a-dd0b-492f-9d61-8c5d16f0ec46 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Returning 404 to user: Instance a7387140-afa9-400c-b372-2e4f8d027b33 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:18:57.218184 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-819fd45a-dd0b-492f-9d61-8c5d16f0ec46 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/a7387140-afa9-400c-b372-2e4f8d027b33/metadata" status: 404 len: 111 microversion: 2.1 time: 0.027155 Oct 12 22:18:57.219270 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1996/4570] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:18:57 2022] GET /compute/v2.1/servers/a7387140-afa9-400c-b372-2e4f8d027b33/metadata => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:18:57.224504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e81cb177-ffb0-4f1e-b298-dcd8a27e9026 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:57.225132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e81cb177-ffb0-4f1e-b298-dcd8a27e9026 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:57.231463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e81cb177-ffb0-4f1e-b298-dcd8a27e9026 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:57.232166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e81cb177-ffb0-4f1e-b298-dcd8a27e9026 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:57.232786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e81cb177-ffb0-4f1e-b298-dcd8a27e9026 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:57.233796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-46598571-82cf-40fb-ad85-cbf807a4fa94 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:57.234505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e81cb177-ffb0-4f1e-b298-dcd8a27e9026 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:57.234622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-46598571-82cf-40fb-ad85-cbf807a4fa94 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:57.235205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e81cb177-ffb0-4f1e-b298-dcd8a27e9026 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:57.235810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e81cb177-ffb0-4f1e-b298-dcd8a27e9026 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:57.242379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:57.251527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46598571-82cf-40fb-ad85-cbf807a4fa94 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:57.252176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46598571-82cf-40fb-ad85-cbf807a4fa94 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:57.255933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46598571-82cf-40fb-ad85-cbf807a4fa94 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:57.256864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46598571-82cf-40fb-ad85-cbf807a4fa94 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:57.257772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46598571-82cf-40fb-ad85-cbf807a4fa94 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:57.259647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46598571-82cf-40fb-ad85-cbf807a4fa94 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:57.401026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e81cb177-ffb0-4f1e-b298-dcd8a27e9026 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:57.409621 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e81cb177-ffb0-4f1e-b298-dcd8a27e9026 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.191982 Oct 12 22:18:57.410391 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2575/4571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:57 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:18:57.417133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4fc6c3f4-aca2-47d2-ae43-f73dd352851e tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1976469220", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f0451602-65c9-4377-86bb-844c8c5d61b8"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4fc6c3f4-aca2-47d2-ae43-f73dd352851e tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Request method failure captured: Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 499 Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz02ywsmbbJR4guYrjJbn8t6VIKMwCOlBYUJ2Wsew2sZOSima6NrGR66HSxkk_bNf2cwVDx0KZ1nOANp2VIHeMb6JahYfj5MwvYWqQf-m5RrhmQ4t9cBNehaeGqg105v7MzN1sSE8ouhcVAgwdTefgFUGGVb0Kff-b6_5jhNcoTzCsI Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: f3336d74185d4f72a3626f6faaf7a984 Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f3336d74185d4f72a3626f6faaf7a984", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: f3336d74185d4f72a3626f6faaf7a984 Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerMetadataNegativeTestJSON-543201631-project Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6c0a1153dcc24b3bb32c7570d878ba84 Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-543201631-project Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1976469220", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f0451602-65c9-4377-86bb-844c8c5d61b8"}]}} Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1976469220', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f0451602-65c9-4377-86bb-844c8c5d61b8'}]}}} Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 22:18:57.422361 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:57.425514 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.428886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4fc6c3f4-aca2-47d2-ae43-f73dd352851e tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:18:57.429996 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4fc6c3f4-aca2-47d2-ae43-f73dd352851e tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.018178 Oct 12 22:18:57.430721 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2576/4572] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:18:57 2022] POST /compute/v2.1/servers => generated 687 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:18:57.436755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-22ba7e93-9461-4842-b90c-26e9347777f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:57.437522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-22ba7e93-9461-4842-b90c-26e9347777f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:57.449458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22ba7e93-9461-4842-b90c-26e9347777f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:57.449957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22ba7e93-9461-4842-b90c-26e9347777f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:57.451011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22ba7e93-9461-4842-b90c-26e9347777f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:57.452102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22ba7e93-9461-4842-b90c-26e9347777f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:57.452562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22ba7e93-9461-4842-b90c-26e9347777f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:57.452994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22ba7e93-9461-4842-b90c-26e9347777f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:57.626584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-22ba7e93-9461-4842-b90c-26e9347777f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:57.652007 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-22ba7e93-9461-4842-b90c-26e9347777f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.219836 Oct 12 22:18:57.652924 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2577/4573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:57 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:57.658396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-42836774-a7fd-4314-bd19-c753e67b25c0 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2029025650", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f0451602-65c9-4377-86bb-844c8c5d61b8"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-42836774-a7fd-4314-bd19-c753e67b25c0 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Request method failure captured: Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 500 Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz02ywsmbbJR4guYrjJbn8t6VIKMwCOlBYUJ2Wsew2sZOSima6NrGR66HSxkk_bNf2cwVDx0KZ1nOANp2VIHeMb6JahYfj5MwvYWqQf-m5RrhmQ4t9cBNehaeGqg105v7MzN1sSE8ouhcVAgwdTefgFUGGVb0Kff-b6_5jhNcoTzCsI Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: f3336d74185d4f72a3626f6faaf7a984 Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f3336d74185d4f72a3626f6faaf7a984", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: f3336d74185d4f72a3626f6faaf7a984 Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerMetadataNegativeTestJSON-543201631-project Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6c0a1153dcc24b3bb32c7570d878ba84 Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-543201631-project Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2029025650", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f0451602-65c9-4377-86bb-844c8c5d61b8"}]}} Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2029025650', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f0451602-65c9-4377-86bb-844c8c5d61b8'}]}}} Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 22:18:57.666689 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:57.670391 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:57.673316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-46598571-82cf-40fb-ad85-cbf807a4fa94 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:57.675102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-42836774-a7fd-4314-bd19-c753e67b25c0 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:18:57.677484 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-42836774-a7fd-4314-bd19-c753e67b25c0 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.022777 Oct 12 22:18:57.678332 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2578/4574] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:18:57 2022] POST /compute/v2.1/servers => generated 689 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:18:57.689781 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-46598571-82cf-40fb-ad85-cbf807a4fa94 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1522 microversion: 2.1 time: 0.460310 Oct 12 22:18:57.690396 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1997/4575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:57 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:18:57.702574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-abe52b0e-ec20-4cd6-9e54-6fc2fa8d1c36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:57.716298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-abe52b0e-ec20-4cd6-9e54-6fc2fa8d1c36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:57.716736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f9508a68-9723-4d04-923c-dc5249290fdc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:57.716736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f9508a68-9723-4d04-923c-dc5249290fdc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:57.723443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abe52b0e-ec20-4cd6-9e54-6fc2fa8d1c36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:57.724712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abe52b0e-ec20-4cd6-9e54-6fc2fa8d1c36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:57.728249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abe52b0e-ec20-4cd6-9e54-6fc2fa8d1c36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:57.729159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abe52b0e-ec20-4cd6-9e54-6fc2fa8d1c36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:57.729781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abe52b0e-ec20-4cd6-9e54-6fc2fa8d1c36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:57.731456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abe52b0e-ec20-4cd6-9e54-6fc2fa8d1c36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:57.753263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9508a68-9723-4d04-923c-dc5249290fdc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:57.753776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9508a68-9723-4d04-923c-dc5249290fdc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:57.754222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9508a68-9723-4d04-923c-dc5249290fdc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:57.755528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9508a68-9723-4d04-923c-dc5249290fdc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:57.757999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9508a68-9723-4d04-923c-dc5249290fdc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:57.758443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9508a68-9723-4d04-923c-dc5249290fdc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:57.956923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:57.988816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f9508a68-9723-4d04-923c-dc5249290fdc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:58.005350 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f9508a68-9723-4d04-923c-dc5249290fdc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1316 microversion: 2.1 time: 0.325146 Oct 12 22:18:58.006303 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2579/4576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:57 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:58.011739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4567e4e1-36ab-4866-a585-58977ee53514 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:58.012495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4567e4e1-36ab-4866-a585-58977ee53514 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:58.019354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4567e4e1-36ab-4866-a585-58977ee53514 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.020122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4567e4e1-36ab-4866-a585-58977ee53514 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.021293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4567e4e1-36ab-4866-a585-58977ee53514 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.022196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4567e4e1-36ab-4866-a585-58977ee53514 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.022847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4567e4e1-36ab-4866-a585-58977ee53514 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.023306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4567e4e1-36ab-4866-a585-58977ee53514 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.060042 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-4567e4e1-36ab-4866-a585-58977ee53514 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] HTTP exception thrown: Instance is not a member of specified network Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4567e4e1-36ab-4866-a585-58977ee53514 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Request method failure captured: Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5/ips/invalid HTTP/1.1 Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz0xIiWM_gb_2PngAY-Xgw37rqfbOPiJOFIc9n4_blYOBn7Eatx_UXahJhmixc1htiPVWDXbe8JqCUQBxewpjPv6EQcMOq9DIBPPjuJmHrep011mhwrpkj-TmmiDYfgtt8ZBvqW-CeLoY9iyYk00bRp1vwPUK3NQmVo8YLNfcHz6aFo Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: d7f6763b291c4352b3de289993940a82 Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2037846096 Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7f6763b291c4352b3de289993940a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7f6763b291c4352b3de289993940a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d7f6763b291c4352b3de289993940a82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d7f6763b291c4352b3de289993940a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2037846096 Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: d7f6763b291c4352b3de289993940a82 Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2037846096 Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerAddressesNegativeTestJSON-2037846096-project Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 06dfdee42ca44284ab3ebbbbf8b74faf Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2037846096-project Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance is not a member of specified network Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'server_id': '4b932bf7-cc37-4542-860e-efaa7ad47fa5', 'id': 'invalid'} Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 12 22:18:58.069678 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.074778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4567e4e1-36ab-4866-a585-58977ee53514 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:18:58.076125 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4567e4e1-36ab-4866-a585-58977ee53514 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.068135 Oct 12 22:18:58.077224 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2580/4577] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:18:58 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5/ips/invalid => generated 91 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:18:58.086992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-612b3b4c-c450-43e5-8081-10db2e9602b2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:58.092812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-612b3b4c-c450-43e5-8081-10db2e9602b2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:58.102239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-612b3b4c-c450-43e5-8081-10db2e9602b2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.103037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-612b3b4c-c450-43e5-8081-10db2e9602b2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.103754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-612b3b4c-c450-43e5-8081-10db2e9602b2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.105292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-612b3b4c-c450-43e5-8081-10db2e9602b2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.106147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-612b3b4c-c450-43e5-8081-10db2e9602b2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.106766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-612b3b4c-c450-43e5-8081-10db2e9602b2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.143004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:18:58.202642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-abe52b0e-ec20-4cd6-9e54-6fc2fa8d1c36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:58.215565 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-abe52b0e-ec20-4cd6-9e54-6fc2fa8d1c36 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.516701 Oct 12 22:18:58.221831 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1998/4578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:57 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:58.233827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-770ea7ca-139e-4937-9fa0-5b0f6d688f6d tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-678223809", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f0451602-65c9-4377-86bb-844c8c5d61b8"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-770ea7ca-139e-4937-9fa0-5b0f6d688f6d tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Request method failure captured: Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 753 Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz02ywsmbbJR4guYrjJbn8t6VIKMwCOlBYUJ2Wsew2sZOSima6NrGR66HSxkk_bNf2cwVDx0KZ1nOANp2VIHeMb6JahYfj5MwvYWqQf-m5RrhmQ4t9cBNehaeGqg105v7MzN1sSE8ouhcVAgwdTefgFUGGVb0Kff-b6_5jhNcoTzCsI Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: f3336d74185d4f72a3626f6faaf7a984 Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f3336d74185d4f72a3626f6faaf7a984", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: f3336d74185d4f72a3626f6faaf7a984 Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerMetadataNegativeTestJSON-543201631-project Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 6c0a1153dcc24b3bb32c7570d878ba84 Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-543201631-project Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-678223809", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f0451602-65c9-4377-86bb-844c8c5d61b8"}]}} Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-678223809', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f0451602-65c9-4377-86bb-844c8c5d61b8'}]}}} Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:18:58.239251 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:18:58.241605 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:18:58.243640 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:58.243640 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.244881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-770ea7ca-139e-4937-9fa0-5b0f6d688f6d tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:18:58.245767 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-770ea7ca-139e-4937-9fa0-5b0f6d688f6d tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.022882 Oct 12 22:18:58.255660 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1999/4579] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:18:58 2022] POST /compute/v2.1/servers => generated 1197 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 12 22:18:58.261531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-e5c83e22-0c9f-48a4-afb0-ce114a901aea req-1710b42e-0247-49d7-8e27-ea08bdf175c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02be5cee-72e9-4cc6-94a2-c3517ec178bd", "name": "network-vif-plugged", "status": "completed", "tag": "ba67b2ed-d4b3-4942-b9cd-37eda012789a"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:58.277537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e5c83e22-0c9f-48a4-afb0-ce114a901aea req-1710b42e-0247-49d7-8e27-ea08bdf175c8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.278378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e5c83e22-0c9f-48a4-afb0-ce114a901aea req-1710b42e-0247-49d7-8e27-ea08bdf175c8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.279641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e5c83e22-0c9f-48a4-afb0-ce114a901aea req-1710b42e-0247-49d7-8e27-ea08bdf175c8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.292690 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-e5c83e22-0c9f-48a4-afb0-ce114a901aea req-1710b42e-0247-49d7-8e27-ea08bdf175c8 service nova] Creating event network-vif-plugged:ba67b2ed-d4b3-4942-b9cd-37eda012789a for instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd on n-h2-861111-1 Oct 12 22:18:58.299201 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-e5c83e22-0c9f-48a4-afb0-ce114a901aea req-1710b42e-0247-49d7-8e27-ea08bdf175c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042041 Oct 12 22:18:58.300382 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2000/4580] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:18:58.309181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49aa5e6c-65d9-4b89-803a-c92db3a48c32 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:58.309872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-49aa5e6c-65d9-4b89-803a-c92db3a48c32 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Failed to fetch instance by id 999 {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 22:18:58.310489 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-49aa5e6c-65d9-4b89-803a-c92db3a48c32 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] HTTP exception thrown: Instance 999 could not be found. Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49aa5e6c-65d9-4b89-803a-c92db3a48c32 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Request method failure captured: Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz0xIiWM_gb_2PngAY-Xgw37rqfbOPiJOFIc9n4_blYOBn7Eatx_UXahJhmixc1htiPVWDXbe8JqCUQBxewpjPv6EQcMOq9DIBPPjuJmHrep011mhwrpkj-TmmiDYfgtt8ZBvqW-CeLoY9iyYk00bRp1vwPUK3NQmVo8YLNfcHz6aFo Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: d7f6763b291c4352b3de289993940a82 Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2037846096 Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7f6763b291c4352b3de289993940a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7f6763b291c4352b3de289993940a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d7f6763b291c4352b3de289993940a82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d7f6763b291c4352b3de289993940a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2037846096 Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: d7f6763b291c4352b3de289993940a82 Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2037846096 Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerAddressesNegativeTestJSON-2037846096-project Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 06dfdee42ca44284ab3ebbbbf8b74faf Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2037846096-project Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 999 could not be found. Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'server_id': '999'} Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 12 22:18:58.312676 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.316396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49aa5e6c-65d9-4b89-803a-c92db3a48c32 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:18:58.316396 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-49aa5e6c-65d9-4b89-803a-c92db3a48c32 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.012599 Oct 12 22:18:58.316396 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2001/4581] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 12 22:18:58 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:18:58.322959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fe890c52-d941-46b1-a542-96c8ec36c8e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:58.324163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fe890c52-d941-46b1-a542-96c8ec36c8e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:58.333955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe890c52-d941-46b1-a542-96c8ec36c8e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.334637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe890c52-d941-46b1-a542-96c8ec36c8e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.335083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe890c52-d941-46b1-a542-96c8ec36c8e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.335996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe890c52-d941-46b1-a542-96c8ec36c8e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.336882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe890c52-d941-46b1-a542-96c8ec36c8e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.337321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe890c52-d941-46b1-a542-96c8ec36c8e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.376004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-612b3b4c-c450-43e5-8081-10db2e9602b2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:58.389565 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-612b3b4c-c450-43e5-8081-10db2e9602b2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 200 len: 1322 microversion: 2.1 time: 0.310749 Oct 12 22:18:58.399445 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2581/4582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:58 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:58.403534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-41c55a10-396c-41e4-a212-515bbfb31258 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:58.404042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-41c55a10-396c-41e4-a212-515bbfb31258 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:58.411851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41c55a10-396c-41e4-a212-515bbfb31258 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.412348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41c55a10-396c-41e4-a212-515bbfb31258 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.412763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41c55a10-396c-41e4-a212-515bbfb31258 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.413467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41c55a10-396c-41e4-a212-515bbfb31258 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.413917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41c55a10-396c-41e4-a212-515bbfb31258 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.414495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41c55a10-396c-41e4-a212-515bbfb31258 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.441665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-41c55a10-396c-41e4-a212-515bbfb31258 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:18:58.529086 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-41c55a10-396c-41e4-a212-515bbfb31258 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 204 len: 0 microversion: 2.1 time: 0.137248 Oct 12 22:18:58.529881 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2582/4583] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:18:58 2022] DELETE /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:18:58.535350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e3867051-e314-4463-a72f-8024b872d866 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-239926781", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f0451602-65c9-4377-86bb-844c8c5d61b8"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e3867051-e314-4463-a72f-8024b872d866 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Request method failure captured: Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 1265 Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz02ywsmbbJR4guYrjJbn8t6VIKMwCOlBYUJ2Wsew2sZOSima6NrGR66HSxkk_bNf2cwVDx0KZ1nOANp2VIHeMb6JahYfj5MwvYWqQf-m5RrhmQ4t9cBNehaeGqg105v7MzN1sSE8ouhcVAgwdTefgFUGGVb0Kff-b6_5jhNcoTzCsI Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: f3336d74185d4f72a3626f6faaf7a984 Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f3336d74185d4f72a3626f6faaf7a984", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: f3336d74185d4f72a3626f6faaf7a984 Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerMetadataNegativeTestJSON-543201631-project Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6c0a1153dcc24b3bb32c7570d878ba84 Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-543201631-project Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-239926781", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f0451602-65c9-4377-86bb-844c8c5d61b8"}]}} Oct 12 22:18:58.539954 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:18:58.541947 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:58.541947 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-239926781', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f0451602-65c9-4377-86bb-844c8c5d61b8'}]}}} Oct 12 22:18:58.541947 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:18:58.541947 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:58.541947 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:18:58.541947 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:18:58.541947 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:18:58.541947 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:18:58.541947 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:58.541947 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.541947 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 12 22:18:58.541947 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 22:18:58.541947 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 22:18:58.541947 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 22:18:58.541947 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 22:18:58.541947 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.541947 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:18:58.542931 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:18:58.544499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:18:58.544499 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.544499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e3867051-e314-4463-a72f-8024b872d866 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:18:58.544499 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e3867051-e314-4463-a72f-8024b872d866 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.010579 Oct 12 22:18:58.544499 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2583/4584] 10.222.0.16 () {60 vars in 1148 bytes} [Wed Oct 12 22:18:58 2022] POST /compute/v2.1/servers => generated 2221 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 12 22:18:58.548315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f8cd7aa5-709c-4cc6-8f03-78770f8cdea0 req-57cc11f2-f2fd-4a80-b103-fe084a77db4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c64ea4-1e95-44f2-a14c-f4edf4be2468", "tag": "72c16ae9-fc18-459a-ac2d-49f958ee5b78"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:58.557729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fe890c52-d941-46b1-a542-96c8ec36c8e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:58.557925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f8cd7aa5-709c-4cc6-8f03-78770f8cdea0 req-57cc11f2-f2fd-4a80-b103-fe084a77db4a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.558268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f8cd7aa5-709c-4cc6-8f03-78770f8cdea0 req-57cc11f2-f2fd-4a80-b103-fe084a77db4a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.558732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f8cd7aa5-709c-4cc6-8f03-78770f8cdea0 req-57cc11f2-f2fd-4a80-b103-fe084a77db4a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.566291 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fe890c52-d941-46b1-a542-96c8ec36c8e6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.249531 Oct 12 22:18:58.567950 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2002/4585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:58 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:58.572703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-724f2996-4758-4f41-924c-c88a538cc8f2 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:58.573395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-724f2996-4758-4f41-924c-c88a538cc8f2 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:58.578235 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f8cd7aa5-709c-4cc6-8f03-78770f8cdea0 req-57cc11f2-f2fd-4a80-b103-fe084a77db4a service nova] Creating event network-changed:72c16ae9-fc18-459a-ac2d-49f958ee5b78 for instance 03c64ea4-1e95-44f2-a14c-f4edf4be2468 on n-h1-861111-1 Oct 12 22:18:58.579561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-724f2996-4758-4f41-924c-c88a538cc8f2 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.580276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-724f2996-4758-4f41-924c-c88a538cc8f2 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.580949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-724f2996-4758-4f41-924c-c88a538cc8f2 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.581881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-724f2996-4758-4f41-924c-c88a538cc8f2 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.582541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-724f2996-4758-4f41-924c-c88a538cc8f2 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.583249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-724f2996-4758-4f41-924c-c88a538cc8f2 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.585483 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f8cd7aa5-709c-4cc6-8f03-78770f8cdea0 req-57cc11f2-f2fd-4a80-b103-fe084a77db4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041912 Oct 12 22:18:58.586526 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2584/4586] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:18:58.591881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd8aebad-72be-4d4e-9d26-010006fbdb95 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:58.592471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dd8aebad-72be-4d4e-9d26-010006fbdb95 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 4a883618-7ebb-471d-bf85-42aebb9eb931] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:58.598980 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-dd8aebad-72be-4d4e-9d26-010006fbdb95 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] HTTP exception thrown: Instance 4a883618-7ebb-471d-bf85-42aebb9eb931 could not be found. Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd8aebad-72be-4d4e-9d26-010006fbdb95 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Request method failure captured: Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/4a883618-7ebb-471d-bf85-42aebb9eb931/metadata/test2 HTTP/1.1 Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz02ywsmbbJR4guYrjJbn8t6VIKMwCOlBYUJ2Wsew2sZOSima6NrGR66HSxkk_bNf2cwVDx0KZ1nOANp2VIHeMb6JahYfj5MwvYWqQf-m5RrhmQ4t9cBNehaeGqg105v7MzN1sSE8ouhcVAgwdTefgFUGGVb0Kff-b6_5jhNcoTzCsI Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: f3336d74185d4f72a3626f6faaf7a984 Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f3336d74185d4f72a3626f6faaf7a984", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: f3336d74185d4f72a3626f6faaf7a984 Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerMetadataNegativeTestJSON-543201631-project Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 6c0a1153dcc24b3bb32c7570d878ba84 Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-543201631-project Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 4a883618-7ebb-471d-bf85-42aebb9eb931 could not be found. Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'server_id': '4a883618-7ebb-471d-bf85-42aebb9eb931', 'id': 'test2'} Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a883618-7ebb-471d-bf85-42aebb9eb931 could not be found. Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a883618-7ebb-471d-bf85-42aebb9eb931 could not be found. Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:18:58.600862 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:18:58.604852 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:18:58.604852 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:18:58.604852 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a883618-7ebb-471d-bf85-42aebb9eb931 could not be found. Oct 12 22:18:58.604852 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:18:58.604852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd8aebad-72be-4d4e-9d26-010006fbdb95 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Returning 404 to user: Instance 4a883618-7ebb-471d-bf85-42aebb9eb931 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:18:58.604852 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dd8aebad-72be-4d4e-9d26-010006fbdb95 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/4a883618-7ebb-471d-bf85-42aebb9eb931/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.014526 Oct 12 22:18:58.604852 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2585/4587] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Oct 12 22:18:58 2022] GET /compute/v2.1/servers/4a883618-7ebb-471d-bf85-42aebb9eb931/metadata/test2 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:18:58.622700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87bba9a2-de90-453e-af3a-56526bc6e1c7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:18:58.623271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-87bba9a2-de90-453e-af3a-56526bc6e1c7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:58.632803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87bba9a2-de90-453e-af3a-56526bc6e1c7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.633299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87bba9a2-de90-453e-af3a-56526bc6e1c7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.633735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87bba9a2-de90-453e-af3a-56526bc6e1c7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.634529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87bba9a2-de90-453e-af3a-56526bc6e1c7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.634881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87bba9a2-de90-453e-af3a-56526bc6e1c7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.635330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87bba9a2-de90-453e-af3a-56526bc6e1c7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.664872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-87bba9a2-de90-453e-af3a-56526bc6e1c7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lazy-loading 'flavor' on Instance uuid 4023ebba-05d4-4225-938a-c70c2490ae29 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:18:58.777582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-724f2996-4758-4f41-924c-c88a538cc8f2 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:58.790987 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-724f2996-4758-4f41-924c-c88a538cc8f2 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1528 microversion: 2.1 time: 0.221689 Oct 12 22:18:58.791880 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-87bba9a2-de90-453e-af3a-56526bc6e1c7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 202 len: 0 microversion: 2.1 time: 0.186946 Oct 12 22:18:58.792712 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2003/4588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:58 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1528 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:58.793252 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2586/4589] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:18:58 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:18:58.798128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a5c24cad-f3c3-4f90-b092-01aec15ddbd7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:58.798735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a5c24cad-f3c3-4f90-b092-01aec15ddbd7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:58.805690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5c24cad-f3c3-4f90-b092-01aec15ddbd7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.806443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5c24cad-f3c3-4f90-b092-01aec15ddbd7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.807101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5c24cad-f3c3-4f90-b092-01aec15ddbd7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.807523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-73a7c306-1f5b-48be-9b52-94222293d005 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:58.808360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5c24cad-f3c3-4f90-b092-01aec15ddbd7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.808471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-73a7c306-1f5b-48be-9b52-94222293d005 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:58.809151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5c24cad-f3c3-4f90-b092-01aec15ddbd7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.809782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5c24cad-f3c3-4f90-b092-01aec15ddbd7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.815203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73a7c306-1f5b-48be-9b52-94222293d005 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.815731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73a7c306-1f5b-48be-9b52-94222293d005 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.816232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73a7c306-1f5b-48be-9b52-94222293d005 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.819116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73a7c306-1f5b-48be-9b52-94222293d005 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.819636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73a7c306-1f5b-48be-9b52-94222293d005 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.820082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73a7c306-1f5b-48be-9b52-94222293d005 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.843614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a5c24cad-f3c3-4f90-b092-01aec15ddbd7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:18:58.938863 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a5c24cad-f3c3-4f90-b092-01aec15ddbd7 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 204 len: 0 microversion: 2.1 time: 0.144422 Oct 12 22:18:58.939480 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2004/4590] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:18:58 2022] DELETE /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:18:58.950475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-290ea8d9-c4f2-493c-aae3-af3836fbfdfd tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:58.951452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-290ea8d9-c4f2-493c-aae3-af3836fbfdfd tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:58.959562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-290ea8d9-c4f2-493c-aae3-af3836fbfdfd tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.960057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-290ea8d9-c4f2-493c-aae3-af3836fbfdfd tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.960627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-290ea8d9-c4f2-493c-aae3-af3836fbfdfd tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:58.961468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-290ea8d9-c4f2-493c-aae3-af3836fbfdfd tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:58.962881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-290ea8d9-c4f2-493c-aae3-af3836fbfdfd tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:58.962881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-290ea8d9-c4f2-493c-aae3-af3836fbfdfd tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:59.033159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-73a7c306-1f5b-48be-9b52-94222293d005 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:59.042669 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-73a7c306-1f5b-48be-9b52-94222293d005 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1678 microversion: 2.1 time: 0.242118 Oct 12 22:18:59.043267 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2587/4591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:58 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1678 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:59.059506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e4cca108-8ea4-42a9-8097-66b3cb8a79f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:59.060321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e4cca108-8ea4-42a9-8097-66b3cb8a79f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:59.066564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4cca108-8ea4-42a9-8097-66b3cb8a79f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:59.067380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4cca108-8ea4-42a9-8097-66b3cb8a79f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:59.068206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4cca108-8ea4-42a9-8097-66b3cb8a79f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:59.068907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4cca108-8ea4-42a9-8097-66b3cb8a79f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:59.069877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4cca108-8ea4-42a9-8097-66b3cb8a79f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:59.070314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4cca108-8ea4-42a9-8097-66b3cb8a79f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:59.108873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-290ea8d9-c4f2-493c-aae3-af3836fbfdfd tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:59.117032 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-290ea8d9-c4f2-493c-aae3-af3836fbfdfd tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1523 microversion: 2.1 time: 0.172857 Oct 12 22:18:59.117715 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2005/4592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:58 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:18:59.296677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e4cca108-8ea4-42a9-8097-66b3cb8a79f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:59.305827 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e4cca108-8ea4-42a9-8097-66b3cb8a79f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1316 microversion: 2.1 time: 0.256709 Oct 12 22:18:59.306414 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2588/4593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:59 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:59.414300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4e271849-0098-47ae-802d-be6cee9bf34d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:59.415084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4e271849-0098-47ae-802d-be6cee9bf34d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:59.422238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e271849-0098-47ae-802d-be6cee9bf34d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:59.423004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e271849-0098-47ae-802d-be6cee9bf34d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:59.423477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e271849-0098-47ae-802d-be6cee9bf34d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:59.424192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e271849-0098-47ae-802d-be6cee9bf34d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:59.424751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e271849-0098-47ae-802d-be6cee9bf34d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:59.425216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e271849-0098-47ae-802d-be6cee9bf34d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:59.589342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4e271849-0098-47ae-802d-be6cee9bf34d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:59.597647 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4e271849-0098-47ae-802d-be6cee9bf34d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 200 len: 1322 microversion: 2.1 time: 0.188723 Oct 12 22:18:59.598744 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2006/4594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:59 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:18:59.814782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dda7dfff-2479-475f-bd7b-86bd06cf554f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:18:59.815525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dda7dfff-2479-475f-bd7b-86bd06cf554f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:18:59.821986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dda7dfff-2479-475f-bd7b-86bd06cf554f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:59.822537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dda7dfff-2479-475f-bd7b-86bd06cf554f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:59.823050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dda7dfff-2479-475f-bd7b-86bd06cf554f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:59.823842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dda7dfff-2479-475f-bd7b-86bd06cf554f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:18:59.824367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dda7dfff-2479-475f-bd7b-86bd06cf554f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:18:59.824846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dda7dfff-2479-475f-bd7b-86bd06cf554f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:18:59.972576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dda7dfff-2479-475f-bd7b-86bd06cf554f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:18:59.982847 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dda7dfff-2479-475f-bd7b-86bd06cf554f tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1528 microversion: 2.1 time: 0.172030 Oct 12 22:18:59.991323 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2589/4595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:18:59 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1528 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:00.066045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-47c87c50-d1ea-46f9-b696-13ad02883249 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:00.067153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-47c87c50-d1ea-46f9-b696-13ad02883249 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:00.074384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47c87c50-d1ea-46f9-b696-13ad02883249 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:00.075193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47c87c50-d1ea-46f9-b696-13ad02883249 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:00.075887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47c87c50-d1ea-46f9-b696-13ad02883249 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:00.076956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47c87c50-d1ea-46f9-b696-13ad02883249 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:00.077616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47c87c50-d1ea-46f9-b696-13ad02883249 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:00.078248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47c87c50-d1ea-46f9-b696-13ad02883249 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:00.140435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-18c5e26a-9e1f-419a-ad78-0ff667fd9369 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:00.141065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-18c5e26a-9e1f-419a-ad78-0ff667fd9369 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:00.153611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18c5e26a-9e1f-419a-ad78-0ff667fd9369 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:00.154415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18c5e26a-9e1f-419a-ad78-0ff667fd9369 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:00.155011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18c5e26a-9e1f-419a-ad78-0ff667fd9369 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:00.155913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18c5e26a-9e1f-419a-ad78-0ff667fd9369 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:00.156656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18c5e26a-9e1f-419a-ad78-0ff667fd9369 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:00.157307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18c5e26a-9e1f-419a-ad78-0ff667fd9369 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:00.325689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-18c5e26a-9e1f-419a-ad78-0ff667fd9369 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:00.338935 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-18c5e26a-9e1f-419a-ad78-0ff667fd9369 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1523 microversion: 2.1 time: 0.202264 Oct 12 22:19:00.340180 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2590/4596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:00 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:00.355210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b9a871e3-073e-4328-b9a0-f4948b394e37 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:00.356361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b9a871e3-073e-4328-b9a0-f4948b394e37 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:00.363415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9a871e3-073e-4328-b9a0-f4948b394e37 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:00.364516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9a871e3-073e-4328-b9a0-f4948b394e37 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:00.365029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9a871e3-073e-4328-b9a0-f4948b394e37 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:00.366062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9a871e3-073e-4328-b9a0-f4948b394e37 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:00.366654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9a871e3-073e-4328-b9a0-f4948b394e37 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:00.367599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9a871e3-073e-4328-b9a0-f4948b394e37 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:00.553561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-47c87c50-d1ea-46f9-b696-13ad02883249 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:00.562795 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-47c87c50-d1ea-46f9-b696-13ad02883249 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1678 microversion: 2.1 time: 0.500717 Oct 12 22:19:00.576198 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2007/4597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:00 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1678 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:00.630790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f274fc33-721a-42e9-94a6-c4814e957b48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:00.631808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f274fc33-721a-42e9-94a6-c4814e957b48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:00.645096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f274fc33-721a-42e9-94a6-c4814e957b48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:00.646173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f274fc33-721a-42e9-94a6-c4814e957b48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:00.647210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f274fc33-721a-42e9-94a6-c4814e957b48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:00.649207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f274fc33-721a-42e9-94a6-c4814e957b48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:00.652154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f274fc33-721a-42e9-94a6-c4814e957b48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:00.652789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f274fc33-721a-42e9-94a6-c4814e957b48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:00.737063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b9a871e3-073e-4328-b9a0-f4948b394e37 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:00.749802 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b9a871e3-073e-4328-b9a0-f4948b394e37 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1316 microversion: 2.1 time: 0.408226 Oct 12 22:19:00.750837 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2591/4598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:00 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:01.007078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ff7aa38d-b581-4d9c-884b-d11eb4b23e8a tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:01.007803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ff7aa38d-b581-4d9c-884b-d11eb4b23e8a tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:01.027384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff7aa38d-b581-4d9c-884b-d11eb4b23e8a tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:01.028598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff7aa38d-b581-4d9c-884b-d11eb4b23e8a tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:01.029221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff7aa38d-b581-4d9c-884b-d11eb4b23e8a tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:01.030246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff7aa38d-b581-4d9c-884b-d11eb4b23e8a tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:01.035860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff7aa38d-b581-4d9c-884b-d11eb4b23e8a tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:01.037714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff7aa38d-b581-4d9c-884b-d11eb4b23e8a tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:01.334785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ff7aa38d-b581-4d9c-884b-d11eb4b23e8a tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:01.345854 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ff7aa38d-b581-4d9c-884b-d11eb4b23e8a tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1528 microversion: 2.1 time: 0.343654 Oct 12 22:19:01.361839 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2592/4599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:01 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1528 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:01.371232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-abd2b0e4-5656-4c3e-a204-e251ace405ff tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:01.371883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-abd2b0e4-5656-4c3e-a204-e251ace405ff tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:01.385921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abd2b0e4-5656-4c3e-a204-e251ace405ff tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:01.387427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abd2b0e4-5656-4c3e-a204-e251ace405ff tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:01.387427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abd2b0e4-5656-4c3e-a204-e251ace405ff tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:01.388744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abd2b0e4-5656-4c3e-a204-e251ace405ff tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:01.389703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abd2b0e4-5656-4c3e-a204-e251ace405ff tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:01.390328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abd2b0e4-5656-4c3e-a204-e251ace405ff tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:01.516907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-abd2b0e4-5656-4c3e-a204-e251ace405ff tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:01.533735 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-abd2b0e4-5656-4c3e-a204-e251ace405ff tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1481 microversion: 2.1 time: 0.170685 Oct 12 22:19:01.534332 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2593/4600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:01 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1481 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:01.568054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-11ab4583-e3d1-4188-8a1d-1dcb91060d97 req-6a17d491-3e18-4bcc-8f8c-1802d9d70098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c3d25fc-6847-4002-96d8-72d6291ec58f", "name": "network-vif-deleted", "tag": "483f65fb-53cf-4486-9f4e-74a36babcc9f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:01.585704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-11ab4583-e3d1-4188-8a1d-1dcb91060d97 req-6a17d491-3e18-4bcc-8f8c-1802d9d70098 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:01.586198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-11ab4583-e3d1-4188-8a1d-1dcb91060d97 req-6a17d491-3e18-4bcc-8f8c-1802d9d70098 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:01.586656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-11ab4583-e3d1-4188-8a1d-1dcb91060d97 req-6a17d491-3e18-4bcc-8f8c-1802d9d70098 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:01.611526 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-11ab4583-e3d1-4188-8a1d-1dcb91060d97 req-6a17d491-3e18-4bcc-8f8c-1802d9d70098 service nova] Creating event network-vif-deleted:483f65fb-53cf-4486-9f4e-74a36babcc9f for instance 8c3d25fc-6847-4002-96d8-72d6291ec58f on n-h1-861111-1 Oct 12 22:19:01.617183 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-11ab4583-e3d1-4188-8a1d-1dcb91060d97 req-6a17d491-3e18-4bcc-8f8c-1802d9d70098 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053601 Oct 12 22:19:01.618049 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2594/4601] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:19:01.624415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2adba654-339e-4490-b0ec-d12e90cb8f40 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:01.625296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2adba654-339e-4490-b0ec-d12e90cb8f40 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:01.632714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2adba654-339e-4490-b0ec-d12e90cb8f40 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:01.633423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2adba654-339e-4490-b0ec-d12e90cb8f40 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:01.634014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2adba654-339e-4490-b0ec-d12e90cb8f40 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:01.634892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2adba654-339e-4490-b0ec-d12e90cb8f40 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:01.635525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2adba654-339e-4490-b0ec-d12e90cb8f40 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:01.636106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2adba654-339e-4490-b0ec-d12e90cb8f40 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:01.668285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f274fc33-721a-42e9-94a6-c4814e957b48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:01.677788 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f274fc33-721a-42e9-94a6-c4814e957b48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 200 len: 1322 microversion: 2.1 time: 1.055797 Oct 12 22:19:01.679165 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2008/4602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:00 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 1322 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:01.772164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4866eb47-4812-413f-bd3c-4a35f1f6e6ad tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:01.772901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4866eb47-4812-413f-bd3c-4a35f1f6e6ad tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:01.787921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4866eb47-4812-413f-bd3c-4a35f1f6e6ad tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:01.788600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4866eb47-4812-413f-bd3c-4a35f1f6e6ad tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:01.794194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4866eb47-4812-413f-bd3c-4a35f1f6e6ad tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:01.795222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4866eb47-4812-413f-bd3c-4a35f1f6e6ad tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:01.797052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4866eb47-4812-413f-bd3c-4a35f1f6e6ad tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:01.797651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4866eb47-4812-413f-bd3c-4a35f1f6e6ad tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:01.919819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2adba654-339e-4490-b0ec-d12e90cb8f40 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:01.936307 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2adba654-339e-4490-b0ec-d12e90cb8f40 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1661 microversion: 2.1 time: 0.316727 Oct 12 22:19:01.937428 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2595/4603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:01 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1661 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:01.960800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f0ba9bba-f1ec-4f21-ba0f-7d136b50088f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:01.961674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f0ba9bba-f1ec-4f21-ba0f-7d136b50088f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:01.969983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0ba9bba-f1ec-4f21-ba0f-7d136b50088f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:01.970946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0ba9bba-f1ec-4f21-ba0f-7d136b50088f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:01.971731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0ba9bba-f1ec-4f21-ba0f-7d136b50088f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:01.972906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0ba9bba-f1ec-4f21-ba0f-7d136b50088f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:01.974264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0ba9bba-f1ec-4f21-ba0f-7d136b50088f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:01.974962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0ba9bba-f1ec-4f21-ba0f-7d136b50088f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:02.064783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:02.076716 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f0ba9bba-f1ec-4f21-ba0f-7d136b50088f tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action" status: 202 len: 0 microversion: 2.1 time: 0.120581 Oct 12 22:19:02.078190 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2596/4604] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:19:01 2022] POST /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:19:02.088430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-034d537f-905d-48c6-9137-5431dcf06dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:02.089427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-034d537f-905d-48c6-9137-5431dcf06dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:02.105618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-034d537f-905d-48c6-9137-5431dcf06dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:02.106285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-034d537f-905d-48c6-9137-5431dcf06dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:02.106813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-034d537f-905d-48c6-9137-5431dcf06dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:02.108370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-034d537f-905d-48c6-9137-5431dcf06dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:02.108928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-034d537f-905d-48c6-9137-5431dcf06dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:02.110249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-034d537f-905d-48c6-9137-5431dcf06dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:02.277706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-034d537f-905d-48c6-9137-5431dcf06dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:02.289305 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-034d537f-905d-48c6-9137-5431dcf06dcd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1667 microversion: 2.1 time: 0.206537 Oct 12 22:19:02.295322 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2597/4605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:02 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1667 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:02.375962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1e830951-e498-4a21-8277-2cf29362c1f6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:02.377229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1e830951-e498-4a21-8277-2cf29362c1f6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:02.393959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e830951-e498-4a21-8277-2cf29362c1f6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:02.394738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e830951-e498-4a21-8277-2cf29362c1f6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:02.395566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e830951-e498-4a21-8277-2cf29362c1f6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:02.397462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e830951-e498-4a21-8277-2cf29362c1f6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:02.408756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e830951-e498-4a21-8277-2cf29362c1f6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:02.409363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e830951-e498-4a21-8277-2cf29362c1f6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:02.541311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4866eb47-4812-413f-bd3c-4a35f1f6e6ad tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:02.558497 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4866eb47-4812-413f-bd3c-4a35f1f6e6ad tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1316 microversion: 2.1 time: 0.790152 Oct 12 22:19:02.559129 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2009/4606] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:01 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1316 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:02.564182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e2345f0b-b676-4805-9e02-be14141dffc5 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:02.574302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e2345f0b-b676-4805-9e02-be14141dffc5 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:02.580815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2345f0b-b676-4805-9e02-be14141dffc5 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:02.581479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2345f0b-b676-4805-9e02-be14141dffc5 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:02.582254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2345f0b-b676-4805-9e02-be14141dffc5 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:02.583089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2345f0b-b676-4805-9e02-be14141dffc5 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:02.583566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2345f0b-b676-4805-9e02-be14141dffc5 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:02.584243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2345f0b-b676-4805-9e02-be14141dffc5 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:02.644702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1e830951-e498-4a21-8277-2cf29362c1f6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:02.649225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2345f0b-b676-4805-9e02-be14141dffc5 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:02.650026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2345f0b-b676-4805-9e02-be14141dffc5 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:02.650621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2345f0b-b676-4805-9e02-be14141dffc5 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:02.651296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-e2345f0b-b676-4805-9e02-be14141dffc5 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lazy-loading 'fault' on Instance uuid 8c3d25fc-6847-4002-96d8-72d6291ec58f {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:19:02.657862 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1e830951-e498-4a21-8277-2cf29362c1f6 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1528 microversion: 2.1 time: 0.286483 Oct 12 22:19:02.659880 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2598/4607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:02 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1528 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:02.687307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-5b7d14e1-ebe9-4764-a923-3670f01477ef req-f6a91db6-77c4-4b1b-9645-bf26f6f71281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198da671-4118-49da-ad40-506db4c1ce48", "name": "network-vif-plugged", "status": "completed", "tag": "8b928845-d81b-4599-996d-6e7920586d83"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:02.711661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5b7d14e1-ebe9-4764-a923-3670f01477ef req-f6a91db6-77c4-4b1b-9645-bf26f6f71281 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:02.712373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5b7d14e1-ebe9-4764-a923-3670f01477ef req-f6a91db6-77c4-4b1b-9645-bf26f6f71281 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:02.713056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5b7d14e1-ebe9-4764-a923-3670f01477ef req-f6a91db6-77c4-4b1b-9645-bf26f6f71281 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:02.728416 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-5b7d14e1-ebe9-4764-a923-3670f01477ef req-f6a91db6-77c4-4b1b-9645-bf26f6f71281 service nova] Creating event network-vif-plugged:8b928845-d81b-4599-996d-6e7920586d83 for instance 198da671-4118-49da-ad40-506db4c1ce48 on n-h1-861111-1 Oct 12 22:19:02.733533 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-5b7d14e1-ebe9-4764-a923-3670f01477ef req-f6a91db6-77c4-4b1b-9645-bf26f6f71281 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060716 Oct 12 22:19:02.734400 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2599/4608] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:02.743780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fa6ad6fb-59f6-48d3-87b4-86168d76877d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:02.744674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fa6ad6fb-59f6-48d3-87b4-86168d76877d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:02.761016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa6ad6fb-59f6-48d3-87b4-86168d76877d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:02.762620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa6ad6fb-59f6-48d3-87b4-86168d76877d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:02.763835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa6ad6fb-59f6-48d3-87b4-86168d76877d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:02.764646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa6ad6fb-59f6-48d3-87b4-86168d76877d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:02.765188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa6ad6fb-59f6-48d3-87b4-86168d76877d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:02.765749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa6ad6fb-59f6-48d3-87b4-86168d76877d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:02.853627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e2345f0b-b676-4805-9e02-be14141dffc5 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0a1153dcc24b3bb32c7570d878ba84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3336d74185d4f72a3626f6faaf7a984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:02.862355 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e2345f0b-b676-4805-9e02-be14141dffc5 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 200 len: 1312 microversion: 2.1 time: 0.301637 Oct 12 22:19:02.863016 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2010/4609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:02 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 1312 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:02.994536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fa6ad6fb-59f6-48d3-87b4-86168d76877d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:03.007519 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fa6ad6fb-59f6-48d3-87b4-86168d76877d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 200 len: 1322 microversion: 2.1 time: 0.271351 Oct 12 22:19:03.025073 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2600/4610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:02 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:03.314806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ecba048f-f794-4f65-95c0-d39e5b95ccc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:03.315670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ecba048f-f794-4f65-95c0-d39e5b95ccc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:03.325703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecba048f-f794-4f65-95c0-d39e5b95ccc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:03.326289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecba048f-f794-4f65-95c0-d39e5b95ccc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:03.326805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecba048f-f794-4f65-95c0-d39e5b95ccc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:03.327630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecba048f-f794-4f65-95c0-d39e5b95ccc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:03.328332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecba048f-f794-4f65-95c0-d39e5b95ccc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:03.328830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecba048f-f794-4f65-95c0-d39e5b95ccc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:03.531634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-e5853890-0d9b-4275-a5a0-58d38fc24d49 req-5bff0f99-466f-45af-9d70-113d40894084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b932bf7-cc37-4542-860e-efaa7ad47fa5", "name": "network-vif-deleted", "tag": "7452409c-2f82-4fb9-8e36-8f34a323a328"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:03.542310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e5853890-0d9b-4275-a5a0-58d38fc24d49 req-5bff0f99-466f-45af-9d70-113d40894084 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:03.542724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e5853890-0d9b-4275-a5a0-58d38fc24d49 req-5bff0f99-466f-45af-9d70-113d40894084 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:03.543283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e5853890-0d9b-4275-a5a0-58d38fc24d49 req-5bff0f99-466f-45af-9d70-113d40894084 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:03.567720 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-e5853890-0d9b-4275-a5a0-58d38fc24d49 req-5bff0f99-466f-45af-9d70-113d40894084 service nova] Creating event network-vif-deleted:7452409c-2f82-4fb9-8e36-8f34a323a328 for instance 4b932bf7-cc37-4542-860e-efaa7ad47fa5 on n-h2-861111-1 Oct 12 22:19:03.573603 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-e5853890-0d9b-4275-a5a0-58d38fc24d49 req-5bff0f99-466f-45af-9d70-113d40894084 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046300 Oct 12 22:19:03.574380 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2601/4611] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:19:03.585044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe3ba91d-4c2f-44d9-b0f6-64f2c10ba32d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:03.586146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fe3ba91d-4c2f-44d9-b0f6-64f2c10ba32d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:03.602265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe3ba91d-4c2f-44d9-b0f6-64f2c10ba32d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:03.602764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe3ba91d-4c2f-44d9-b0f6-64f2c10ba32d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:03.603226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe3ba91d-4c2f-44d9-b0f6-64f2c10ba32d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:03.604933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe3ba91d-4c2f-44d9-b0f6-64f2c10ba32d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:03.605400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe3ba91d-4c2f-44d9-b0f6-64f2c10ba32d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:03.605831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe3ba91d-4c2f-44d9-b0f6-64f2c10ba32d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:03.721098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ecba048f-f794-4f65-95c0-d39e5b95ccc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:03.734136 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ecba048f-f794-4f65-95c0-d39e5b95ccc9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1667 microversion: 2.1 time: 0.423172 Oct 12 22:19:03.747262 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2011/4612] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:03 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1667 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:03.747888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-53b741fa-ac8a-41a1-bb09-97f4fb83dff0 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:03.749926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-53b741fa-ac8a-41a1-bb09-97f4fb83dff0 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:03.768827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53b741fa-ac8a-41a1-bb09-97f4fb83dff0 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:03.770350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53b741fa-ac8a-41a1-bb09-97f4fb83dff0 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:03.771028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53b741fa-ac8a-41a1-bb09-97f4fb83dff0 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:03.775623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53b741fa-ac8a-41a1-bb09-97f4fb83dff0 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:03.776464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53b741fa-ac8a-41a1-bb09-97f4fb83dff0 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:03.777796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53b741fa-ac8a-41a1-bb09-97f4fb83dff0 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:03.782855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:03.783985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fe3ba91d-4c2f-44d9-b0f6-64f2c10ba32d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:03.794882 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fe3ba91d-4c2f-44d9-b0f6-64f2c10ba32d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.216385 Oct 12 22:19:03.804568 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2602/4613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:03 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:03.822342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53b741fa-ac8a-41a1-bb09-97f4fb83dff0 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:03.822784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53b741fa-ac8a-41a1-bb09-97f4fb83dff0 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:03.823223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53b741fa-ac8a-41a1-bb09-97f4fb83dff0 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:03.823708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-53b741fa-ac8a-41a1-bb09-97f4fb83dff0 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lazy-loading 'fault' on Instance uuid 4b932bf7-cc37-4542-860e-efaa7ad47fa5 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:19:03.876559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1673242087", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:03.916936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-53b741fa-ac8a-41a1-bb09-97f4fb83dff0 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dfdee42ca44284ab3ebbbbf8b74faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f6763b291c4352b3de289993940a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:03.931661 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-53b741fa-ac8a-41a1-bb09-97f4fb83dff0 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 200 len: 1314 microversion: 2.1 time: 0.190251 Oct 12 22:19:03.932271 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2012/4614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:03 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:03.938447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] validate_networks() for [('57899def-7285-4d34-a6b9-8c4bdfce7a65', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:19:03.956629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e1f588fb-020f-4758-90e1-fb54c7993b09 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:03.957602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e1f588fb-020f-4758-90e1-fb54c7993b09 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] [instance: 8c3d25fc-6847-4002-96d8-72d6291ec58f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:03.964767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f588fb-020f-4758-90e1-fb54c7993b09 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:03.965560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f588fb-020f-4758-90e1-fb54c7993b09 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:03.966293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f588fb-020f-4758-90e1-fb54c7993b09 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:03.967373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f588fb-020f-4758-90e1-fb54c7993b09 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:03.968154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f588fb-020f-4758-90e1-fb54c7993b09 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:03.968775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f588fb-020f-4758-90e1-fb54c7993b09 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:03.985469 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-e1f588fb-020f-4758-90e1-fb54c7993b09 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] HTTP exception thrown: Instance 8c3d25fc-6847-4002-96d8-72d6291ec58f could not be found. Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e1f588fb-020f-4758-90e1-fb54c7993b09 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Request method failure captured: Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f HTTP/1.1 Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz02ywsmbbJR4guYrjJbn8t6VIKMwCOlBYUJ2Wsew2sZOSima6NrGR66HSxkk_bNf2cwVDx0KZ1nOANp2VIHeMb6JahYfj5MwvYWqQf-m5RrhmQ4t9cBNehaeGqg105v7MzN1sSE8ouhcVAgwdTefgFUGGVb0Kff-b6_5jhNcoTzCsI Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: f3336d74185d4f72a3626f6faaf7a984 Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f3336d74185d4f72a3626f6faaf7a984", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f3336d74185d4f72a3626f6faaf7a984"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: f3336d74185d4f72a3626f6faaf7a984 Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-543201631 Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerMetadataNegativeTestJSON-543201631-project Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 6c0a1153dcc24b3bb32c7570d878ba84 Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-543201631-project Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 8c3d25fc-6847-4002-96d8-72d6291ec58f could not be found. Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '8c3d25fc-6847-4002-96d8-72d6291ec58f'} Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c3d25fc-6847-4002-96d8-72d6291ec58f could not be found. Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c3d25fc-6847-4002-96d8-72d6291ec58f could not be found. Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:03.987705 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:03.993052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:03.993052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:03.993052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:03.993052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:03.993052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:03.993052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:03.993052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c3d25fc-6847-4002-96d8-72d6291ec58f could not be found. Oct 12 22:19:03.993052 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:03.994987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e1f588fb-020f-4758-90e1-fb54c7993b09 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] Returning 404 to user: Instance 8c3d25fc-6847-4002-96d8-72d6291ec58f could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:03.996130 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e1f588fb-020f-4758-90e1-fb54c7993b09 tempest-ServerMetadataNegativeTestJSON-543201631 tempest-ServerMetadataNegativeTestJSON-543201631-project] 10.222.0.16 "GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f" status: 404 len: 111 microversion: 2.1 time: 0.056147 Oct 12 22:19:04.000877 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2013/4615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:03 2022] GET /compute/v2.1/servers/8c3d25fc-6847-4002-96d8-72d6291ec58f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:19:04.034835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1aaa079e-a55a-4602-8807-553df5d6cb67 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:04.035633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1aaa079e-a55a-4602-8807-553df5d6cb67 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:04.042891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1aaa079e-a55a-4602-8807-553df5d6cb67 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:04.043589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1aaa079e-a55a-4602-8807-553df5d6cb67 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:04.044426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1aaa079e-a55a-4602-8807-553df5d6cb67 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:04.045283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1aaa079e-a55a-4602-8807-553df5d6cb67 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:04.045865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1aaa079e-a55a-4602-8807-553df5d6cb67 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:04.046427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1aaa079e-a55a-4602-8807-553df5d6cb67 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:04.511146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1aaa079e-a55a-4602-8807-553df5d6cb67 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:04.519007 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1aaa079e-a55a-4602-8807-553df5d6cb67 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 200 len: 1322 microversion: 2.1 time: 0.492836 Oct 12 22:19:04.523707 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2014/4616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:04 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:04.762209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e5fcf3aa-1842-41c1-baea-8937ac74594b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:04.764481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e5fcf3aa-1842-41c1-baea-8937ac74594b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:04.772183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5fcf3aa-1842-41c1-baea-8937ac74594b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:04.773086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5fcf3aa-1842-41c1-baea-8937ac74594b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:04.773597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5fcf3aa-1842-41c1-baea-8937ac74594b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:04.774349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5fcf3aa-1842-41c1-baea-8937ac74594b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:04.774780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5fcf3aa-1842-41c1-baea-8937ac74594b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:04.783764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5fcf3aa-1842-41c1-baea-8937ac74594b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:05.068717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e5fcf3aa-1842-41c1-baea-8937ac74594b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:05.078075 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e5fcf3aa-1842-41c1-baea-8937ac74594b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1667 microversion: 2.1 time: 0.320067 Oct 12 22:19:05.084012 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2015/4617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:04 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1667 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:05.090873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-6b20fbc9-1fc4-40d1-ac7c-254b8843cd7d req-12f789fd-0802-4b3e-9f8b-fe2d1604d437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c95fbb6a-0a59-41eb-8b29-fab44a51d53f", "name": "network-vif-plugged", "status": "completed", "tag": "c65dbf77-2cd0-431f-8e52-bd6287b6e637"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:05.111844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6b20fbc9-1fc4-40d1-ac7c-254b8843cd7d req-12f789fd-0802-4b3e-9f8b-fe2d1604d437 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:05.115061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6b20fbc9-1fc4-40d1-ac7c-254b8843cd7d req-12f789fd-0802-4b3e-9f8b-fe2d1604d437 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:05.115748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6b20fbc9-1fc4-40d1-ac7c-254b8843cd7d req-12f789fd-0802-4b3e-9f8b-fe2d1604d437 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:05.128023 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-6b20fbc9-1fc4-40d1-ac7c-254b8843cd7d req-12f789fd-0802-4b3e-9f8b-fe2d1604d437 service nova] Creating event network-vif-plugged:c65dbf77-2cd0-431f-8e52-bd6287b6e637 for instance c95fbb6a-0a59-41eb-8b29-fab44a51d53f on n-h2-861111-1 Oct 12 22:19:05.135808 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-6b20fbc9-1fc4-40d1-ac7c-254b8843cd7d req-12f789fd-0802-4b3e-9f8b-fe2d1604d437 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051002 Oct 12 22:19:05.137545 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2016/4618] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:05.143478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a9725423-2229-41e4-b895-3244417b2533 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:05.144793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a9725423-2229-41e4-b895-3244417b2533 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] [instance: 4b932bf7-cc37-4542-860e-efaa7ad47fa5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:05.152137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9725423-2229-41e4-b895-3244417b2533 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:05.153015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9725423-2229-41e4-b895-3244417b2533 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:05.153750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9725423-2229-41e4-b895-3244417b2533 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:05.155690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9725423-2229-41e4-b895-3244417b2533 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:05.156347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9725423-2229-41e4-b895-3244417b2533 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:05.157211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9725423-2229-41e4-b895-3244417b2533 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:05.183154 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-a9725423-2229-41e4-b895-3244417b2533 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] HTTP exception thrown: Instance 4b932bf7-cc37-4542-860e-efaa7ad47fa5 could not be found. Oct 12 22:19:05.193639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a9725423-2229-41e4-b895-3244417b2533 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Request method failure captured: Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 HTTP/1.1 Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz0xIiWM_gb_2PngAY-Xgw37rqfbOPiJOFIc9n4_blYOBn7Eatx_UXahJhmixc1htiPVWDXbe8JqCUQBxewpjPv6EQcMOq9DIBPPjuJmHrep011mhwrpkj-TmmiDYfgtt8ZBvqW-CeLoY9iyYk00bRp1vwPUK3NQmVo8YLNfcHz6aFo Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: d7f6763b291c4352b3de289993940a82 Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2037846096 Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7f6763b291c4352b3de289993940a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7f6763b291c4352b3de289993940a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d7f6763b291c4352b3de289993940a82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d7f6763b291c4352b3de289993940a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2037846096 Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: d7f6763b291c4352b3de289993940a82 Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2037846096 Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerAddressesNegativeTestJSON-2037846096-project Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 06dfdee42ca44284ab3ebbbbf8b74faf Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2037846096-project Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 4b932bf7-cc37-4542-860e-efaa7ad47fa5 could not be found. Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '4b932bf7-cc37-4542-860e-efaa7ad47fa5'} Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b932bf7-cc37-4542-860e-efaa7ad47fa5 could not be found. Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b932bf7-cc37-4542-860e-efaa7ad47fa5 could not be found. Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:05.194151 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:05.198649 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:05.198649 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:05.198649 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:05.198649 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:05.198649 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:05.198649 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:05.198649 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b932bf7-cc37-4542-860e-efaa7ad47fa5 could not be found. Oct 12 22:19:05.198649 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:05.199151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:19:05.199252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a9725423-2229-41e4-b895-3244417b2533 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] Returning 404 to user: Instance 4b932bf7-cc37-4542-860e-efaa7ad47fa5 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:05.199787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:19:05.199787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:19:05.199787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:19:05.200185 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a9725423-2229-41e4-b895-3244417b2533 tempest-ServerAddressesNegativeTestJSON-2037846096 tempest-ServerAddressesNegativeTestJSON-2037846096-project] 10.222.0.16 "GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5" status: 404 len: 111 microversion: 2.1 time: 0.056461 Oct 12 22:19:05.200185 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2017/4619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:05 2022] GET /compute/v2.1/servers/4b932bf7-cc37-4542-860e-efaa7ad47fa5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:19:05.216031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:05.216538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:05.216990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:05.218415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:05.218888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:05.219350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:05.264165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Getting quotas for project 1945a103d7df4bdc8519c3fd6e3f774c. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:19:05.280702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Getting quotas for user db077881dc7b4893a480d71484c5cba9 and project 1945a103d7df4bdc8519c3fd6e3f774c. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:19:05.303946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:19:05.314629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:19:05.438174 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2a1fac27-a300-44f7-b567-8ea9058daccc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.565462 Oct 12 22:19:05.443124 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2603/4620] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:19:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:19:05.462299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8905b70c-6905-4700-94ed-463817845cee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:05.463282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8905b70c-6905-4700-94ed-463817845cee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:05.542088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c2d56d28-c962-47a4-8f6c-1d2875806469 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:05.542625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c2d56d28-c962-47a4-8f6c-1d2875806469 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:05.561762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d56d28-c962-47a4-8f6c-1d2875806469 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:05.562263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d56d28-c962-47a4-8f6c-1d2875806469 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:05.562707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d56d28-c962-47a4-8f6c-1d2875806469 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:05.563468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d56d28-c962-47a4-8f6c-1d2875806469 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:05.563958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d56d28-c962-47a4-8f6c-1d2875806469 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:05.564384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2d56d28-c962-47a4-8f6c-1d2875806469 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:05.609269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8905b70c-6905-4700-94ed-463817845cee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:05.623252 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8905b70c-6905-4700-94ed-463817845cee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 200 len: 1217 microversion: 2.1 time: 0.170737 Oct 12 22:19:05.627742 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2018/4621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:05 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:05.910362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c2d56d28-c962-47a4-8f6c-1d2875806469 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:05.931144 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c2d56d28-c962-47a4-8f6c-1d2875806469 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 200 len: 1322 microversion: 2.1 time: 0.392951 Oct 12 22:19:05.932158 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2604/4622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:05 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 1322 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:06.113538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4d262621-858b-4c82-9da9-63f6671f8b91 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:06.117614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4d262621-858b-4c82-9da9-63f6671f8b91 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:06.143400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d262621-858b-4c82-9da9-63f6671f8b91 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:06.145292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d262621-858b-4c82-9da9-63f6671f8b91 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:06.147221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d262621-858b-4c82-9da9-63f6671f8b91 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:06.148857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d262621-858b-4c82-9da9-63f6671f8b91 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:06.149774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d262621-858b-4c82-9da9-63f6671f8b91 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:06.151050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d262621-858b-4c82-9da9-63f6671f8b91 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:06.408608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4d262621-858b-4c82-9da9-63f6671f8b91 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:06.420903 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4d262621-858b-4c82-9da9-63f6671f8b91 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.318188 Oct 12 22:19:06.422054 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2019/4623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:06 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:06.448103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dfe3f23c-8792-4cc9-b4c9-ecf7b0624597 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:06.449518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dfe3f23c-8792-4cc9-b4c9-ecf7b0624597 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:06.459190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfe3f23c-8792-4cc9-b4c9-ecf7b0624597 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:06.460178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfe3f23c-8792-4cc9-b4c9-ecf7b0624597 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:06.460849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfe3f23c-8792-4cc9-b4c9-ecf7b0624597 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:06.461813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfe3f23c-8792-4cc9-b4c9-ecf7b0624597 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:06.462449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfe3f23c-8792-4cc9-b4c9-ecf7b0624597 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:06.463140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfe3f23c-8792-4cc9-b4c9-ecf7b0624597 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:06.649438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4bab21ce-4db1-42c6-b8f5-2decb4e02666 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:06.650319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4bab21ce-4db1-42c6-b8f5-2decb4e02666 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:06.664757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bab21ce-4db1-42c6-b8f5-2decb4e02666 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:06.665590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bab21ce-4db1-42c6-b8f5-2decb4e02666 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:06.666389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bab21ce-4db1-42c6-b8f5-2decb4e02666 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:06.667388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bab21ce-4db1-42c6-b8f5-2decb4e02666 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:06.670528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bab21ce-4db1-42c6-b8f5-2decb4e02666 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:06.671329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bab21ce-4db1-42c6-b8f5-2decb4e02666 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:06.803934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4bab21ce-4db1-42c6-b8f5-2decb4e02666 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:06.830233 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4bab21ce-4db1-42c6-b8f5-2decb4e02666 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 200 len: 1269 microversion: 2.1 time: 0.186708 Oct 12 22:19:06.848579 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2020/4624] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:06 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 1269 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:06.962390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c202e965-6e9b-4b29-8eeb-f5911fcf18f2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:06.963360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c202e965-6e9b-4b29-8eeb-f5911fcf18f2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:06.974330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c202e965-6e9b-4b29-8eeb-f5911fcf18f2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:06.976676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c202e965-6e9b-4b29-8eeb-f5911fcf18f2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:06.979032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c202e965-6e9b-4b29-8eeb-f5911fcf18f2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:06.982453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c202e965-6e9b-4b29-8eeb-f5911fcf18f2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:06.982951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c202e965-6e9b-4b29-8eeb-f5911fcf18f2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:06.983438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c202e965-6e9b-4b29-8eeb-f5911fcf18f2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:07.115969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dfe3f23c-8792-4cc9-b4c9-ecf7b0624597 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:07.128604 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dfe3f23c-8792-4cc9-b4c9-ecf7b0624597 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1670 microversion: 2.1 time: 0.686443 Oct 12 22:19:07.132535 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2605/4625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:06 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1670 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:07.155438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:07.155942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:07.170723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:07.171435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:07.172102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:07.172961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:07.173568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:07.174174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:07.210986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:19:07.227169 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.compute.api [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Working on deleting snapshot 599cb477-7368-4c4e-92fb-d7e0dc6288e2 from shelved instance... Oct 12 22:19:07.555128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c202e965-6e9b-4b29-8eeb-f5911fcf18f2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:07.572620 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c202e965-6e9b-4b29-8eeb-f5911fcf18f2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 200 len: 1322 microversion: 2.1 time: 0.620261 Oct 12 22:19:07.579421 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2021/4626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:06 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 1322 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:07.860475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7566cdff-12bf-4d37-8a7c-c8187fc3028f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:07.861113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7566cdff-12bf-4d37-8a7c-c8187fc3028f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:07.875875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7566cdff-12bf-4d37-8a7c-c8187fc3028f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:07.876496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7566cdff-12bf-4d37-8a7c-c8187fc3028f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:07.877037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7566cdff-12bf-4d37-8a7c-c8187fc3028f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:07.877762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7566cdff-12bf-4d37-8a7c-c8187fc3028f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:07.878235 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7566cdff-12bf-4d37-8a7c-c8187fc3028f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:07.878688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7566cdff-12bf-4d37-8a7c-c8187fc3028f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:08.107171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7566cdff-12bf-4d37-8a7c-c8187fc3028f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:08.120908 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7566cdff-12bf-4d37-8a7c-c8187fc3028f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 200 len: 1275 microversion: 2.1 time: 0.264687 Oct 12 22:19:08.121776 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2022/4627] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:07 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 1275 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:08.266800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:08.268973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Doing local delete in cell 2bc00301-6462-4874-9c83-c889d0ff6a49(cell1) {{(pid=120453) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 12 22:19:08.269853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:08.270452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:08.271056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:08.271810 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.compute.api [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 12 22:19:08.278044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] deallocate_for_instance() {{(pid=120453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 12 22:19:08.601681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2f1e3d4c-7e54-43f4-9553-ca318c114f9d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:08.602226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f1e3d4c-7e54-43f4-9553-ca318c114f9d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:08.615287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f1e3d4c-7e54-43f4-9553-ca318c114f9d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:08.616132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f1e3d4c-7e54-43f4-9553-ca318c114f9d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:08.616925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f1e3d4c-7e54-43f4-9553-ca318c114f9d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:08.618148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f1e3d4c-7e54-43f4-9553-ca318c114f9d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:08.618924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f1e3d4c-7e54-43f4-9553-ca318c114f9d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:08.619602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f1e3d4c-7e54-43f4-9553-ca318c114f9d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:08.906295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f1e3d4c-7e54-43f4-9553-ca318c114f9d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:08.922200 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2f1e3d4c-7e54-43f4-9553-ca318c114f9d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 200 len: 1322 microversion: 2.1 time: 0.324322 Oct 12 22:19:08.925401 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2023/4628] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:08 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:08.954392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-0ea553b4-efdc-497f-9c34-c9b1b8ef7b85 req-dadd1c37-4e10-4e69-a01e-45361cdf9ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c64ea4-1e95-44f2-a14c-f4edf4be2468", "name": "network-vif-plugged", "status": "completed", "tag": "72c16ae9-fc18-459a-ac2d-49f958ee5b78"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:08.970624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0ea553b4-efdc-497f-9c34-c9b1b8ef7b85 req-dadd1c37-4e10-4e69-a01e-45361cdf9ae3 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:08.971113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0ea553b4-efdc-497f-9c34-c9b1b8ef7b85 req-dadd1c37-4e10-4e69-a01e-45361cdf9ae3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:08.971573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0ea553b4-efdc-497f-9c34-c9b1b8ef7b85 req-dadd1c37-4e10-4e69-a01e-45361cdf9ae3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:08.994959 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-0ea553b4-efdc-497f-9c34-c9b1b8ef7b85 req-dadd1c37-4e10-4e69-a01e-45361cdf9ae3 service nova] Creating event network-vif-plugged:72c16ae9-fc18-459a-ac2d-49f958ee5b78 for instance 03c64ea4-1e95-44f2-a14c-f4edf4be2468 on n-h1-861111-1 Oct 12 22:19:09.011486 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-0ea553b4-efdc-497f-9c34-c9b1b8ef7b85 req-dadd1c37-4e10-4e69-a01e-45361cdf9ae3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061073 Oct 12 22:19:09.032799 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2024/4629] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:09.148296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb41e52a-d8b7-4a45-b30c-b1637ee58b82 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:09.149196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eb41e52a-d8b7-4a45-b30c-b1637ee58b82 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:09.164421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb41e52a-d8b7-4a45-b30c-b1637ee58b82 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:09.164929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb41e52a-d8b7-4a45-b30c-b1637ee58b82 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:09.168610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb41e52a-d8b7-4a45-b30c-b1637ee58b82 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:09.169470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb41e52a-d8b7-4a45-b30c-b1637ee58b82 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:09.169949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb41e52a-d8b7-4a45-b30c-b1637ee58b82 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:09.170390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb41e52a-d8b7-4a45-b30c-b1637ee58b82 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:09.960579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eb41e52a-d8b7-4a45-b30c-b1637ee58b82 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:09.981463 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb41e52a-d8b7-4a45-b30c-b1637ee58b82 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 200 len: 1317 microversion: 2.1 time: 0.839876 Oct 12 22:19:09.982854 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2025/4630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:09 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 1317 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:10.003642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4949cb03-2986-4146-8e2c-64343b2e0004 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:10.005319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4949cb03-2986-4146-8e2c-64343b2e0004 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:10.035022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4949cb03-2986-4146-8e2c-64343b2e0004 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:10.038257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4949cb03-2986-4146-8e2c-64343b2e0004 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:10.038971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4949cb03-2986-4146-8e2c-64343b2e0004 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:10.056099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4949cb03-2986-4146-8e2c-64343b2e0004 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:10.057353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4949cb03-2986-4146-8e2c-64343b2e0004 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:10.060189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4949cb03-2986-4146-8e2c-64343b2e0004 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:10.355304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Updating instance_info_cache with network_info: [] {{(pid=120453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:19:10.717817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4949cb03-2986-4146-8e2c-64343b2e0004 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:10.764563 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4949cb03-2986-4146-8e2c-64343b2e0004 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 200 len: 1322 microversion: 2.1 time: 0.747290 Oct 12 22:19:10.773028 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2026/4631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:09 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 1322 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:10.793708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-c96783a5-12ff-45eb-bf83-a63ca4be7f5f req-65af5673-073a-40b6-87ad-1ddc43cb882f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642", "name": "network-vif-deleted", "tag": "8e2b35e6-0fa9-488d-886e-79503ed3c9fb"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:10.826140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c96783a5-12ff-45eb-bf83-a63ca4be7f5f req-65af5673-073a-40b6-87ad-1ddc43cb882f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:10.834174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c96783a5-12ff-45eb-bf83-a63ca4be7f5f req-65af5673-073a-40b6-87ad-1ddc43cb882f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:10.835022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c96783a5-12ff-45eb-bf83-a63ca4be7f5f req-65af5673-073a-40b6-87ad-1ddc43cb882f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:10.885226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.compute.server_external_events [req-c96783a5-12ff-45eb-bf83-a63ca4be7f5f req-65af5673-073a-40b6-87ad-1ddc43cb882f service nova] Unable to find a host for instance e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642. Dropping event network-vif-deleted {{(pid=120452) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 12 22:19:10.898772 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-c96783a5-12ff-45eb-bf83-a63ca4be7f5f req-65af5673-073a-40b6-87ad-1ddc43cb882f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.124255 Oct 12 22:19:10.905060 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2027/4632] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 131 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 12 22:19:11.009973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e06c03ca-d5de-4adc-b289-b03688a05481 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:11.011325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e06c03ca-d5de-4adc-b289-b03688a05481 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:11.020949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e06c03ca-d5de-4adc-b289-b03688a05481 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:11.023863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e06c03ca-d5de-4adc-b289-b03688a05481 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:11.032380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e06c03ca-d5de-4adc-b289-b03688a05481 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:11.036055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e06c03ca-d5de-4adc-b289-b03688a05481 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:11.037961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e06c03ca-d5de-4adc-b289-b03688a05481 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:11.039125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e06c03ca-d5de-4adc-b289-b03688a05481 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:11.140644 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bebd807f-5b93-4c1f-bc99-e7fd253808a4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 204 len: 0 microversion: 2.1 time: 3.989345 Oct 12 22:19:11.141613 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2606/4633] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:19:07 2022] DELETE /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 0 bytes in 3991 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:19:11.153493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5e5c4373-f7ca-47ff-966a-926828ea863e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:11.154564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5e5c4373-f7ca-47ff-966a-926828ea863e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:11.178365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e5c4373-f7ca-47ff-966a-926828ea863e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:11.180644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e5c4373-f7ca-47ff-966a-926828ea863e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:11.181374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e5c4373-f7ca-47ff-966a-926828ea863e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:11.186262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e5c4373-f7ca-47ff-966a-926828ea863e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:11.188380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e5c4373-f7ca-47ff-966a-926828ea863e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:11.190677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e5c4373-f7ca-47ff-966a-926828ea863e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:11.228437 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-5e5c4373-f7ca-47ff-966a-926828ea863e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] HTTP exception thrown: Instance e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 could not be found. Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5e5c4373-f7ca-47ff-966a-926828ea863e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Request method failure captured: Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 HTTP/1.1 Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzriWjH9XGk2m6XxAkFWCa5SU4u3aYbKjccJUM74Gs6m2ZTWTRgYJo3xNK7Dl1yHzUOL0UlgCpklDDkzfGl4zIrs1ucJJAHjnDilUmOFjpe-CEtT-kGaW-5sHatvR75wN517xqlZ9fiNsyKxLaujP5hWxgbqYLVY-SfHQMzPuASo904 Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 319a8f107945457a8a8f8e9690a697e5 Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319a8f107945457a8a8f8e9690a697e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 319a8f107945457a8a8f8e9690a697e5 Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerActionsTestJSON-1007032333-project Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: b29c500796d54d6188ff65056340d35f Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerActionsTestJSON-1007032333-project Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 could not be found. Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642'} Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 could not be found. Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 could not be found. Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:11.232061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:11.235881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:11.235881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:11.235881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:11.235881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:11.235881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:11.235881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 could not be found. Oct 12 22:19:11.235881 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:11.240970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5e5c4373-f7ca-47ff-966a-926828ea863e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Returning 404 to user: Instance e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:11.245409 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5e5c4373-f7ca-47ff-966a-926828ea863e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642" status: 404 len: 111 microversion: 2.1 time: 0.098886 Oct 12 22:19:11.247346 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2607/4634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:11 2022] GET /compute/v2.1/servers/e8915d6c-f9d1-4d6c-b8c6-b6b6fb0bc642 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:19:11.255039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6e7c5a7a-9093-41de-aa38-09052c77df85 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:11.256634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6e7c5a7a-9093-41de-aa38-09052c77df85 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:11.266403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e7c5a7a-9093-41de-aa38-09052c77df85 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:11.267178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e7c5a7a-9093-41de-aa38-09052c77df85 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:11.267858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e7c5a7a-9093-41de-aa38-09052c77df85 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:11.268980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e7c5a7a-9093-41de-aa38-09052c77df85 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:11.273387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e7c5a7a-9093-41de-aa38-09052c77df85 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:11.273965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e7c5a7a-9093-41de-aa38-09052c77df85 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:11.311512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6e7c5a7a-9093-41de-aa38-09052c77df85 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:19:11.358400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:11.462568 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6e7c5a7a-9093-41de-aa38-09052c77df85 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 204 len: 0 microversion: 2.1 time: 0.211642 Oct 12 22:19:11.463550 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2608/4635] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:19:11 2022] DELETE /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:19:11.474646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7dd0f25a-2185-4893-8b4c-99fcdfba4b38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:11.476732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7dd0f25a-2185-4893-8b4c-99fcdfba4b38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:11.492934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dd0f25a-2185-4893-8b4c-99fcdfba4b38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:11.493461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dd0f25a-2185-4893-8b4c-99fcdfba4b38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:11.494780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dd0f25a-2185-4893-8b4c-99fcdfba4b38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:11.495808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dd0f25a-2185-4893-8b4c-99fcdfba4b38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:11.497743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dd0f25a-2185-4893-8b4c-99fcdfba4b38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:11.499218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dd0f25a-2185-4893-8b4c-99fcdfba4b38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:11.813252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7dd0f25a-2185-4893-8b4c-99fcdfba4b38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:11.826896 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7dd0f25a-2185-4893-8b4c-99fcdfba4b38 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1466 microversion: 2.1 time: 0.357552 Oct 12 22:19:11.829894 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2609/4636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:11 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1466 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:11.851223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5c38abf3-5b33-45ac-b287-1d802cac2bed tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:11.853561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5c38abf3-5b33-45ac-b287-1d802cac2bed tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:11.869285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c38abf3-5b33-45ac-b287-1d802cac2bed tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:11.869795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c38abf3-5b33-45ac-b287-1d802cac2bed tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:11.870245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c38abf3-5b33-45ac-b287-1d802cac2bed tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:11.874871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c38abf3-5b33-45ac-b287-1d802cac2bed tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:11.882448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c38abf3-5b33-45ac-b287-1d802cac2bed tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:11.882987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c38abf3-5b33-45ac-b287-1d802cac2bed tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:11.898438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e06c03ca-d5de-4adc-b289-b03688a05481 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:11.910680 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e06c03ca-d5de-4adc-b289-b03688a05481 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 200 len: 1317 microversion: 2.1 time: 0.909877 Oct 12 22:19:11.919666 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2028/4637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:10 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 1317 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:12.218757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5c38abf3-5b33-45ac-b287-1d802cac2bed tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:12.231446 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5c38abf3-5b33-45ac-b287-1d802cac2bed tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 200 len: 1516 microversion: 2.1 time: 0.398886 Oct 12 22:19:12.232496 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2610/4638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:11 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 1516 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:12.255081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8baf4285-5713-4385-bd2e-a232c9371855 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:12.255981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8baf4285-5713-4385-bd2e-a232c9371855 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: c95fbb6a-0a59-41eb-8b29-fab44a51d53f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:12.266919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8baf4285-5713-4385-bd2e-a232c9371855 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:12.267371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8baf4285-5713-4385-bd2e-a232c9371855 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:12.267818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8baf4285-5713-4385-bd2e-a232c9371855 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:12.268531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8baf4285-5713-4385-bd2e-a232c9371855 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:12.268984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8baf4285-5713-4385-bd2e-a232c9371855 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:12.272384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8baf4285-5713-4385-bd2e-a232c9371855 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:12.427505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-0d9a6eab-a9c2-45e5-8a8b-3f0673aa423c req-5fc02d93-6074-4787-8e97-b63fc08f6112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd026e6-7533-4efb-88f5-1573116d8f08", "tag": "5464a150-633c-4044-a3cb-dbe841354308"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:12.446432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0d9a6eab-a9c2-45e5-8a8b-3f0673aa423c req-5fc02d93-6074-4787-8e97-b63fc08f6112 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:12.446913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0d9a6eab-a9c2-45e5-8a8b-3f0673aa423c req-5fc02d93-6074-4787-8e97-b63fc08f6112 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:12.447558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0d9a6eab-a9c2-45e5-8a8b-3f0673aa423c req-5fc02d93-6074-4787-8e97-b63fc08f6112 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:12.469745 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-0d9a6eab-a9c2-45e5-8a8b-3f0673aa423c req-5fc02d93-6074-4787-8e97-b63fc08f6112 service nova] Creating event network-changed:5464a150-633c-4044-a3cb-dbe841354308 for instance 1cd026e6-7533-4efb-88f5-1573116d8f08 on n-h2-861111-1 Oct 12 22:19:12.476542 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-0d9a6eab-a9c2-45e5-8a8b-3f0673aa423c req-5fc02d93-6074-4787-8e97-b63fc08f6112 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053848 Oct 12 22:19:12.477727 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2611/4639] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:12.744524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8baf4285-5713-4385-bd2e-a232c9371855 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:12.757865 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8baf4285-5713-4385-bd2e-a232c9371855 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/c95fbb6a-0a59-41eb-8b29-fab44a51d53f" status: 200 len: 1515 microversion: 2.1 time: 0.507022 Oct 12 22:19:12.771969 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2029/4640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:12 2022] GET /compute/v2.1/servers/c95fbb6a-0a59-41eb-8b29-fab44a51d53f => generated 1515 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:12.784418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ffe45b22-d77b-42ec-ac9b-81743ea63743 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:12.785132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ffe45b22-d77b-42ec-ac9b-81743ea63743 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 198da671-4118-49da-ad40-506db4c1ce48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:12.792988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffe45b22-d77b-42ec-ac9b-81743ea63743 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:12.793530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffe45b22-d77b-42ec-ac9b-81743ea63743 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:12.793970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffe45b22-d77b-42ec-ac9b-81743ea63743 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:12.794680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffe45b22-d77b-42ec-ac9b-81743ea63743 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:12.795134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffe45b22-d77b-42ec-ac9b-81743ea63743 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:12.795585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ffe45b22-d77b-42ec-ac9b-81743ea63743 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:12.857892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1ab7354-419c-4d13-95e9-65e82a807c15 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:12.858614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a1ab7354-419c-4d13-95e9-65e82a807c15 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:12.869346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1ab7354-419c-4d13-95e9-65e82a807c15 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:12.871874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1ab7354-419c-4d13-95e9-65e82a807c15 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:12.872696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1ab7354-419c-4d13-95e9-65e82a807c15 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:12.873608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1ab7354-419c-4d13-95e9-65e82a807c15 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:12.876012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1ab7354-419c-4d13-95e9-65e82a807c15 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:12.886522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1ab7354-419c-4d13-95e9-65e82a807c15 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:13.050686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ffe45b22-d77b-42ec-ac9b-81743ea63743 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:13.065069 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ffe45b22-d77b-42ec-ac9b-81743ea63743 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48" status: 200 len: 1515 microversion: 2.1 time: 0.284742 Oct 12 22:19:13.079263 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2612/4641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:12 2022] GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48 => generated 1515 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:13.086138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-97b30cf9-e0e4-4ae8-ace2-1c5bbc3697dc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:13.086138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-97b30cf9-e0e4-4ae8-ace2-1c5bbc3697dc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:13.098221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97b30cf9-e0e4-4ae8-ace2-1c5bbc3697dc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:13.106683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97b30cf9-e0e4-4ae8-ace2-1c5bbc3697dc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:13.107475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97b30cf9-e0e4-4ae8-ace2-1c5bbc3697dc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:13.108341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97b30cf9-e0e4-4ae8-ace2-1c5bbc3697dc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:13.111402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97b30cf9-e0e4-4ae8-ace2-1c5bbc3697dc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:13.112206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97b30cf9-e0e4-4ae8-ace2-1c5bbc3697dc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:13.132944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a1ab7354-419c-4d13-95e9-65e82a807c15 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:13.146085 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a1ab7354-419c-4d13-95e9-65e82a807c15 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1466 microversion: 2.1 time: 0.291304 Oct 12 22:19:13.147828 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2030/4642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:12 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1466 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:13.155004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d254f340-5288-4587-ab6a-5a2b38aa8f69 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:13.155812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d254f340-5288-4587-ab6a-5a2b38aa8f69 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 198da671-4118-49da-ad40-506db4c1ce48] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:13.171863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d254f340-5288-4587-ab6a-5a2b38aa8f69 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:13.172798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d254f340-5288-4587-ab6a-5a2b38aa8f69 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:13.173456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d254f340-5288-4587-ab6a-5a2b38aa8f69 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:13.181287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d254f340-5288-4587-ab6a-5a2b38aa8f69 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:13.182129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d254f340-5288-4587-ab6a-5a2b38aa8f69 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:13.183205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d254f340-5288-4587-ab6a-5a2b38aa8f69 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:13.245349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d254f340-5288-4587-ab6a-5a2b38aa8f69 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 198da671-4118-49da-ad40-506db4c1ce48] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:19:13.287390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:13.370130 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d254f340-5288-4587-ab6a-5a2b38aa8f69 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "DELETE /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48" status: 204 len: 0 microversion: 2.1 time: 0.220490 Oct 12 22:19:13.371963 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2031/4643] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:19:13 2022] DELETE /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:19:13.578668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-25132aaf-e317-4260-beb2-426279e09fa0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:13.579571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-25132aaf-e317-4260-beb2-426279e09fa0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:13.603960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25132aaf-e317-4260-beb2-426279e09fa0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:13.605240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25132aaf-e317-4260-beb2-426279e09fa0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:13.607055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25132aaf-e317-4260-beb2-426279e09fa0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:13.610017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25132aaf-e317-4260-beb2-426279e09fa0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:13.611637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25132aaf-e317-4260-beb2-426279e09fa0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:13.618288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25132aaf-e317-4260-beb2-426279e09fa0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:13.678330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-25132aaf-e317-4260-beb2-426279e09fa0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:19:13.761771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-97b30cf9-e0e4-4ae8-ace2-1c5bbc3697dc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:13.788804 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-97b30cf9-e0e4-4ae8-ace2-1c5bbc3697dc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 200 len: 1317 microversion: 2.1 time: 0.719407 Oct 12 22:19:13.790025 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2613/4644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:13 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 1317 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:13.803687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5894316b-169e-4149-a476-76e249e1cc66 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:13.804238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5894316b-169e-4149-a476-76e249e1cc66 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 198da671-4118-49da-ad40-506db4c1ce48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:13.820207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5894316b-169e-4149-a476-76e249e1cc66 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:13.820711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5894316b-169e-4149-a476-76e249e1cc66 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:13.821161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5894316b-169e-4149-a476-76e249e1cc66 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:13.821885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5894316b-169e-4149-a476-76e249e1cc66 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:13.822346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5894316b-169e-4149-a476-76e249e1cc66 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:13.822777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5894316b-169e-4149-a476-76e249e1cc66 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:13.853658 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-25132aaf-e317-4260-beb2-426279e09fa0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "DELETE /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 204 len: 0 microversion: 2.32 time: 0.478173 Oct 12 22:19:13.854870 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2032/4645] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:19:13 2022] DELETE /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:19:13.865841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5f4962f3-641a-4eaa-990f-05b4bf5bfe8c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:13.867284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5f4962f3-641a-4eaa-990f-05b4bf5bfe8c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:13.883086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f4962f3-641a-4eaa-990f-05b4bf5bfe8c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:13.883629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f4962f3-641a-4eaa-990f-05b4bf5bfe8c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:13.884070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f4962f3-641a-4eaa-990f-05b4bf5bfe8c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:13.884785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f4962f3-641a-4eaa-990f-05b4bf5bfe8c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:13.885242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f4962f3-641a-4eaa-990f-05b4bf5bfe8c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:13.885855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f4962f3-641a-4eaa-990f-05b4bf5bfe8c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:14.147327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5f4962f3-641a-4eaa-990f-05b4bf5bfe8c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:14.158098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5f4962f3-641a-4eaa-990f-05b4bf5bfe8c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:14.159717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5f4962f3-641a-4eaa-990f-05b4bf5bfe8c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:14.162684 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5f4962f3-641a-4eaa-990f-05b4bf5bfe8c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 2959 microversion: 2.32 time: 0.302497 Oct 12 22:19:14.163862 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2033/4646] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:13 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 2959 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:14.179295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fd79d531-b1bd-4cd2-82c8-09afbfcc51ed tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:14.181338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fd79d531-b1bd-4cd2-82c8-09afbfcc51ed tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:14.196191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd79d531-b1bd-4cd2-82c8-09afbfcc51ed tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:14.196959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd79d531-b1bd-4cd2-82c8-09afbfcc51ed tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:14.197927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd79d531-b1bd-4cd2-82c8-09afbfcc51ed tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:14.200302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd79d531-b1bd-4cd2-82c8-09afbfcc51ed tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:14.202656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd79d531-b1bd-4cd2-82c8-09afbfcc51ed tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:14.203816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd79d531-b1bd-4cd2-82c8-09afbfcc51ed tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:14.298406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fd79d531-b1bd-4cd2-82c8-09afbfcc51ed tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:14.308586 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fd79d531-b1bd-4cd2-82c8-09afbfcc51ed tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1466 microversion: 2.1 time: 0.138505 Oct 12 22:19:14.325567 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2034/4647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:14 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1466 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:14.359039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5894316b-169e-4149-a476-76e249e1cc66 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:14.374095 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5894316b-169e-4149-a476-76e249e1cc66 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48" status: 200 len: 1521 microversion: 2.1 time: 0.582512 Oct 12 22:19:14.376130 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2614/4648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:13 2022] GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48 => generated 1521 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:14.537149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-443422e5-da00-4611-ae67-52505de5029b req-f700e549-e8e0-41ba-8c95-a2239dd744c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1", "name": "network-vif-deleted", "tag": "0d84b6a8-d25c-4301-a1f2-c5f7340cc9e7"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:14.576121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-443422e5-da00-4611-ae67-52505de5029b req-f700e549-e8e0-41ba-8c95-a2239dd744c3 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:14.576621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-443422e5-da00-4611-ae67-52505de5029b req-f700e549-e8e0-41ba-8c95-a2239dd744c3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:14.577073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-443422e5-da00-4611-ae67-52505de5029b req-f700e549-e8e0-41ba-8c95-a2239dd744c3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:14.630077 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-443422e5-da00-4611-ae67-52505de5029b req-f700e549-e8e0-41ba-8c95-a2239dd744c3 service nova] Creating event network-vif-deleted:0d84b6a8-d25c-4301-a1f2-c5f7340cc9e7 for instance ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 on n-h1-861111-1 Oct 12 22:19:14.644132 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-443422e5-da00-4611-ae67-52505de5029b req-f700e549-e8e0-41ba-8c95-a2239dd744c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111840 Oct 12 22:19:14.653974 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2035/4649] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:14.812213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b1713606-1051-461d-ab05-076c5aa5bdc2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:14.813019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b1713606-1051-461d-ab05-076c5aa5bdc2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:14.822113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1713606-1051-461d-ab05-076c5aa5bdc2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:14.822786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1713606-1051-461d-ab05-076c5aa5bdc2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:14.823428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1713606-1051-461d-ab05-076c5aa5bdc2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:14.824278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1713606-1051-461d-ab05-076c5aa5bdc2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:14.824968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1713606-1051-461d-ab05-076c5aa5bdc2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:14.825622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1713606-1051-461d-ab05-076c5aa5bdc2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:15.118773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b1713606-1051-461d-ab05-076c5aa5bdc2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:15.126488 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b1713606-1051-461d-ab05-076c5aa5bdc2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 200 len: 1317 microversion: 2.1 time: 0.318421 Oct 12 22:19:15.127079 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2615/4650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:14 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:15.199470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b5a9f12e-30c3-4eb7-8956-a62b63001702 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:15.200267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b5a9f12e-30c3-4eb7-8956-a62b63001702 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:15.218755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5a9f12e-30c3-4eb7-8956-a62b63001702 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:15.219284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5a9f12e-30c3-4eb7-8956-a62b63001702 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:15.219745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5a9f12e-30c3-4eb7-8956-a62b63001702 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:15.220536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5a9f12e-30c3-4eb7-8956-a62b63001702 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:15.220994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5a9f12e-30c3-4eb7-8956-a62b63001702 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:15.221501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5a9f12e-30c3-4eb7-8956-a62b63001702 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:15.333350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fd07bb8d-b38b-41fd-90dd-670b0c27300b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:15.334274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fd07bb8d-b38b-41fd-90dd-670b0c27300b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:15.343503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:15.344158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:15.346558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd07bb8d-b38b-41fd-90dd-670b0c27300b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:15.352550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd07bb8d-b38b-41fd-90dd-670b0c27300b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:15.352550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd07bb8d-b38b-41fd-90dd-670b0c27300b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:15.352550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd07bb8d-b38b-41fd-90dd-670b0c27300b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:15.352952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd07bb8d-b38b-41fd-90dd-670b0c27300b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:15.353292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd07bb8d-b38b-41fd-90dd-670b0c27300b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:15.490988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fd07bb8d-b38b-41fd-90dd-670b0c27300b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:15.505142 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fd07bb8d-b38b-41fd-90dd-670b0c27300b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1300 microversion: 2.1 time: 0.175196 Oct 12 22:19:15.506065 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2616/4651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:15 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1300 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:15.511678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-85cae0cd-6ae2-4dea-bd43-6cd1949f10fe tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:15.513104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-85cae0cd-6ae2-4dea-bd43-6cd1949f10fe tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 198da671-4118-49da-ad40-506db4c1ce48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:15.548593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85cae0cd-6ae2-4dea-bd43-6cd1949f10fe tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:15.549100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85cae0cd-6ae2-4dea-bd43-6cd1949f10fe tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:15.549549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85cae0cd-6ae2-4dea-bd43-6cd1949f10fe tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:15.550357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85cae0cd-6ae2-4dea-bd43-6cd1949f10fe tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:15.550714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85cae0cd-6ae2-4dea-bd43-6cd1949f10fe tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:15.551204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85cae0cd-6ae2-4dea-bd43-6cd1949f10fe tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:15.622438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:15.630919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b5a9f12e-30c3-4eb7-8956-a62b63001702 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:15.646220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b5a9f12e-30c3-4eb7-8956-a62b63001702 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:15.650540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b5a9f12e-30c3-4eb7-8956-a62b63001702 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:15.654169 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b5a9f12e-30c3-4eb7-8956-a62b63001702 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 2959 microversion: 2.32 time: 0.460773 Oct 12 22:19:15.656770 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2036/4652] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:15 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 2959 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:16.154281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e6e772d8-d9b2-4c44-82e6-758eed0b5c09 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:16.155316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e6e772d8-d9b2-4c44-82e6-758eed0b5c09 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:16.168782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:16.169841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-85cae0cd-6ae2-4dea-bd43-6cd1949f10fe tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:16.182310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6e772d8-d9b2-4c44-82e6-758eed0b5c09 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:16.183460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6e772d8-d9b2-4c44-82e6-758eed0b5c09 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:16.183790 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-85cae0cd-6ae2-4dea-bd43-6cd1949f10fe tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48" status: 200 len: 1521 microversion: 2.1 time: 0.675042 Oct 12 22:19:16.185030 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2617/4653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:15 2022] GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48 => generated 1521 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:16.188296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6e772d8-d9b2-4c44-82e6-758eed0b5c09 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:16.189357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6e772d8-d9b2-4c44-82e6-758eed0b5c09 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:16.190881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6e772d8-d9b2-4c44-82e6-758eed0b5c09 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:16.192053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6e772d8-d9b2-4c44-82e6-758eed0b5c09 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:16.529473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-10c9b757-e2a9-4005-8d44-bdb636a500d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:16.530351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-10c9b757-e2a9-4005-8d44-bdb636a500d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:16.537626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10c9b757-e2a9-4005-8d44-bdb636a500d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:16.538499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10c9b757-e2a9-4005-8d44-bdb636a500d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:16.539192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10c9b757-e2a9-4005-8d44-bdb636a500d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:16.540249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10c9b757-e2a9-4005-8d44-bdb636a500d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:16.543306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10c9b757-e2a9-4005-8d44-bdb636a500d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:16.544056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10c9b757-e2a9-4005-8d44-bdb636a500d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:16.687528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-10c9b757-e2a9-4005-8d44-bdb636a500d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:16.700117 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-10c9b757-e2a9-4005-8d44-bdb636a500d7 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1300 microversion: 2.1 time: 0.174761 Oct 12 22:19:16.720786 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2618/4654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:16 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1300 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:16.720786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7b0d6da4-97ff-4bbb-8486-925f4fb5fe05 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:16.720786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7b0d6da4-97ff-4bbb-8486-925f4fb5fe05 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:16.736402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b0d6da4-97ff-4bbb-8486-925f4fb5fe05 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:16.738727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b0d6da4-97ff-4bbb-8486-925f4fb5fe05 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:16.739308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b0d6da4-97ff-4bbb-8486-925f4fb5fe05 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:16.744246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b0d6da4-97ff-4bbb-8486-925f4fb5fe05 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:16.745059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b0d6da4-97ff-4bbb-8486-925f4fb5fe05 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:16.745619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b0d6da4-97ff-4bbb-8486-925f4fb5fe05 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:17.081135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7b0d6da4-97ff-4bbb-8486-925f4fb5fe05 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:17.099167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7b0d6da4-97ff-4bbb-8486-925f4fb5fe05 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:17.100766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7b0d6da4-97ff-4bbb-8486-925f4fb5fe05 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:17.102104 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7b0d6da4-97ff-4bbb-8486-925f4fb5fe05 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 2959 microversion: 2.32 time: 0.395804 Oct 12 22:19:17.102679 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2619/4655] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:16 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 2959 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:17.213035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f6fa7b97-7876-48ac-862b-bffffdc54657 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:17.213658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f6fa7b97-7876-48ac-862b-bffffdc54657 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 198da671-4118-49da-ad40-506db4c1ce48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:17.230840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6fa7b97-7876-48ac-862b-bffffdc54657 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:17.233591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6fa7b97-7876-48ac-862b-bffffdc54657 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:17.234117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6fa7b97-7876-48ac-862b-bffffdc54657 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:17.235044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6fa7b97-7876-48ac-862b-bffffdc54657 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:17.235616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6fa7b97-7876-48ac-862b-bffffdc54657 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:17.236036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6fa7b97-7876-48ac-862b-bffffdc54657 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:17.678914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f6fa7b97-7876-48ac-862b-bffffdc54657 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:17.683648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e6e772d8-d9b2-4c44-82e6-758eed0b5c09 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:17.687778 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f6fa7b97-7876-48ac-862b-bffffdc54657 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48" status: 200 len: 1521 microversion: 2.1 time: 0.478910 Oct 12 22:19:17.704722 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e6e772d8-d9b2-4c44-82e6-758eed0b5c09 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 200 len: 1317 microversion: 2.1 time: 1.557744 Oct 12 22:19:17.705930 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2037/4656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:16 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 1317 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:17.712133 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2620/4657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:17 2022] GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48 => generated 1521 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:17.729962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c0767b52-f699-4863-bb5c-df43836c0e11 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:17.730634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c0767b52-f699-4863-bb5c-df43836c0e11 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:17.739908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0767b52-f699-4863-bb5c-df43836c0e11 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:17.740407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0767b52-f699-4863-bb5c-df43836c0e11 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:17.740849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0767b52-f699-4863-bb5c-df43836c0e11 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:17.741559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0767b52-f699-4863-bb5c-df43836c0e11 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:17.742014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0767b52-f699-4863-bb5c-df43836c0e11 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:17.749427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0767b52-f699-4863-bb5c-df43836c0e11 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:17.826037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0767b52-f699-4863-bb5c-df43836c0e11 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:17.826909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0767b52-f699-4863-bb5c-df43836c0e11 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:17.828847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0767b52-f699-4863-bb5c-df43836c0e11 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:17.829555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-c0767b52-f699-4863-bb5c-df43836c0e11 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lazy-loading 'fault' on Instance uuid ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:19:18.008467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c0767b52-f699-4863-bb5c-df43836c0e11 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:18.022021 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c0767b52-f699-4863-bb5c-df43836c0e11 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 200 len: 1305 microversion: 2.1 time: 0.295868 Oct 12 22:19:18.036902 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2038/4658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:17 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 1305 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:18.136278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8b3784a5-6599-4727-802a-b59269b7f05f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:18.137118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8b3784a5-6599-4727-802a-b59269b7f05f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:18.175730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b3784a5-6599-4727-802a-b59269b7f05f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:18.180673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b3784a5-6599-4727-802a-b59269b7f05f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:18.183006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b3784a5-6599-4727-802a-b59269b7f05f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:18.183993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b3784a5-6599-4727-802a-b59269b7f05f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:18.189396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b3784a5-6599-4727-802a-b59269b7f05f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:18.190860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8b3784a5-6599-4727-802a-b59269b7f05f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:18.720230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-40eaf0ed-f3cc-4305-8720-084fee72c5d2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:18.720906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-40eaf0ed-f3cc-4305-8720-084fee72c5d2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 198da671-4118-49da-ad40-506db4c1ce48] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:18.732905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40eaf0ed-f3cc-4305-8720-084fee72c5d2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:18.740959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40eaf0ed-f3cc-4305-8720-084fee72c5d2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:18.742790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40eaf0ed-f3cc-4305-8720-084fee72c5d2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:18.743747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40eaf0ed-f3cc-4305-8720-084fee72c5d2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:18.747094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40eaf0ed-f3cc-4305-8720-084fee72c5d2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:18.751089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40eaf0ed-f3cc-4305-8720-084fee72c5d2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:19.055416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b3784a5-6599-4727-802a-b59269b7f05f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:19.068282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b3784a5-6599-4727-802a-b59269b7f05f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:19.084636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8b3784a5-6599-4727-802a-b59269b7f05f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:19.087824 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8b3784a5-6599-4727-802a-b59269b7f05f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 2959 microversion: 2.32 time: 0.955973 Oct 12 22:19:19.091556 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2621/4659] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:18 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 2959 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:19.103609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8a8c2e8e-2426-4b83-b6bb-904c7581aec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:19.106850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8a8c2e8e-2426-4b83-b6bb-904c7581aec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:19.133358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a8c2e8e-2426-4b83-b6bb-904c7581aec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:19.139448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a8c2e8e-2426-4b83-b6bb-904c7581aec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:19.140473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a8c2e8e-2426-4b83-b6bb-904c7581aec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:19.144027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a8c2e8e-2426-4b83-b6bb-904c7581aec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:19.146159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a8c2e8e-2426-4b83-b6bb-904c7581aec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:19.146806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a8c2e8e-2426-4b83-b6bb-904c7581aec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:19.400392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-40eaf0ed-f3cc-4305-8720-084fee72c5d2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:19.413115 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-40eaf0ed-f3cc-4305-8720-084fee72c5d2 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48" status: 200 len: 1521 microversion: 2.1 time: 0.697168 Oct 12 22:19:19.419803 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2039/4660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:18 2022] GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48 => generated 1521 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:19.425198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8b092af3-7a74-4338-95ff-2e54a95e8ae9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:19.426909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8b092af3-7a74-4338-95ff-2e54a95e8ae9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:19.434079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b092af3-7a74-4338-95ff-2e54a95e8ae9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:19.434583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b092af3-7a74-4338-95ff-2e54a95e8ae9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:19.435023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b092af3-7a74-4338-95ff-2e54a95e8ae9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:19.435965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b092af3-7a74-4338-95ff-2e54a95e8ae9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:19.436447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b092af3-7a74-4338-95ff-2e54a95e8ae9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:19.436872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8b092af3-7a74-4338-95ff-2e54a95e8ae9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:19.465154 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-8b092af3-7a74-4338-95ff-2e54a95e8ae9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] HTTP exception thrown: Instance ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 could not be found. Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8b092af3-7a74-4338-95ff-2e54a95e8ae9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Request method failure captured: Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 HTTP/1.1 Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzriWjH9XGk2m6XxAkFWCa5SU4u3aYbKjccJUM74Gs6m2ZTWTRgYJo3xNK7Dl1yHzUOL0UlgCpklDDkzfGl4zIrs1ucJJAHjnDilUmOFjpe-CEtT-kGaW-5sHatvR75wN517xqlZ9fiNsyKxLaujP5hWxgbqYLVY-SfHQMzPuASo904 Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 319a8f107945457a8a8f8e9690a697e5 Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319a8f107945457a8a8f8e9690a697e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 319a8f107945457a8a8f8e9690a697e5 Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerActionsTestJSON-1007032333-project Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: b29c500796d54d6188ff65056340d35f Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerActionsTestJSON-1007032333-project Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 could not be found. Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1'} Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 could not be found. Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 could not be found. Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:19.466895 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:19.471270 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:19.471270 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:19.471270 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:19.471270 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:19.471270 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:19.471270 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 could not be found. Oct 12 22:19:19.471270 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:19.471270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8b092af3-7a74-4338-95ff-2e54a95e8ae9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Returning 404 to user: Instance ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:19.472085 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8b092af3-7a74-4338-95ff-2e54a95e8ae9 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1" status: 404 len: 111 microversion: 2.1 time: 0.050229 Oct 12 22:19:19.477854 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2040/4661] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:19 2022] GET /compute/v2.1/servers/ff8bfe0c-3071-4a8e-bcd0-d78edc551cb1 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:19:19.694630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fa1358e1-f69f-41e2-bab1-8519565b1e5a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1332097525", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": "none"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:19.773160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-fa1358e1-f69f-41e2-bab1-8519565b1e5a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:19:19.773805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-fa1358e1-f69f-41e2-bab1-8519565b1e5a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:19:19.774378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-fa1358e1-f69f-41e2-bab1-8519565b1e5a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:19:19.774906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-fa1358e1-f69f-41e2-bab1-8519565b1e5a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:19:19.777919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-fa1358e1-f69f-41e2-bab1-8519565b1e5a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:19:19.790047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa1358e1-f69f-41e2-bab1-8519565b1e5a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:19.792757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa1358e1-f69f-41e2-bab1-8519565b1e5a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:19.793458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa1358e1-f69f-41e2-bab1-8519565b1e5a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:19.795146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa1358e1-f69f-41e2-bab1-8519565b1e5a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:19.796907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa1358e1-f69f-41e2-bab1-8519565b1e5a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:19.797562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa1358e1-f69f-41e2-bab1-8519565b1e5a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:19.837394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-fa1358e1-f69f-41e2-bab1-8519565b1e5a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Getting quotas for project 1a156d49115943af93cfc2164918987f. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:19:19.854833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-fa1358e1-f69f-41e2-bab1-8519565b1e5a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Getting quotas for user 550933af3c7c44b5a33b00092c24737a and project 1a156d49115943af93cfc2164918987f. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:19:19.890273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fa1358e1-f69f-41e2-bab1-8519565b1e5a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:19:19.894410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fa1358e1-f69f-41e2-bab1-8519565b1e5a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 4c012c96-e0db-4fae-9045-2237c25029e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:19:19.992168 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fa1358e1-f69f-41e2-bab1-8519565b1e5a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.511496 Oct 12 22:19:19.994684 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2041/4662] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 22:19:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:19:20.007855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bffe15f8-c644-4805-8d4b-0d6d9ee97a7d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:20.009542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bffe15f8-c644-4805-8d4b-0d6d9ee97a7d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:20.025397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bffe15f8-c644-4805-8d4b-0d6d9ee97a7d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:20.026911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bffe15f8-c644-4805-8d4b-0d6d9ee97a7d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:20.028207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bffe15f8-c644-4805-8d4b-0d6d9ee97a7d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:20.034225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bffe15f8-c644-4805-8d4b-0d6d9ee97a7d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:20.035984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bffe15f8-c644-4805-8d4b-0d6d9ee97a7d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:20.036710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bffe15f8-c644-4805-8d4b-0d6d9ee97a7d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:20.095149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bffe15f8-c644-4805-8d4b-0d6d9ee97a7d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:19:20.250123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8a8c2e8e-2426-4b83-b6bb-904c7581aec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:20.270839 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8a8c2e8e-2426-4b83-b6bb-904c7581aec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 200 len: 1317 microversion: 2.1 time: 1.176291 Oct 12 22:19:20.274784 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2622/4663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:19 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 1317 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:20.288906 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bffe15f8-c644-4805-8d4b-0d6d9ee97a7d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 204 len: 0 microversion: 2.1 time: 0.290651 Oct 12 22:19:20.289944 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2042/4664] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:19:19 2022] DELETE /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:19:20.296720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-765cb81e-eba3-4b7e-ba04-b652f03da4f2 req-3d5b127e-9f5b-459c-8c55-1bacb4fb38d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198da671-4118-49da-ad40-506db4c1ce48", "name": "network-vif-deleted", "tag": "8b928845-d81b-4599-996d-6e7920586d83"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:20.302744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1edebc35-0a5e-454e-945b-7efce559883d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:20.303572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1edebc35-0a5e-454e-945b-7efce559883d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 4c012c96-e0db-4fae-9045-2237c25029e8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:20.319652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-765cb81e-eba3-4b7e-ba04-b652f03da4f2 req-3d5b127e-9f5b-459c-8c55-1bacb4fb38d8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:20.321251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-765cb81e-eba3-4b7e-ba04-b652f03da4f2 req-3d5b127e-9f5b-459c-8c55-1bacb4fb38d8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:20.323006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-765cb81e-eba3-4b7e-ba04-b652f03da4f2 req-3d5b127e-9f5b-459c-8c55-1bacb4fb38d8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:20.359157 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-765cb81e-eba3-4b7e-ba04-b652f03da4f2 req-3d5b127e-9f5b-459c-8c55-1bacb4fb38d8 service nova] Creating event network-vif-deleted:8b928845-d81b-4599-996d-6e7920586d83 for instance 198da671-4118-49da-ad40-506db4c1ce48 on n-h1-861111-1 Oct 12 22:19:20.375618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1edebc35-0a5e-454e-945b-7efce559883d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:20.375951 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-765cb81e-eba3-4b7e-ba04-b652f03da4f2 req-3d5b127e-9f5b-459c-8c55-1bacb4fb38d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098695 Oct 12 22:19:20.377070 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2623/4665] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:20.387288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e1cf5787-72b1-4fac-a200-08609e261dab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:20.388000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e1cf5787-72b1-4fac-a200-08609e261dab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:20.388889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1edebc35-0a5e-454e-945b-7efce559883d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:20.392483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1edebc35-0a5e-454e-945b-7efce559883d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:20.394369 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1edebc35-0a5e-454e-945b-7efce559883d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/4c012c96-e0db-4fae-9045-2237c25029e8" status: 200 len: 1278 microversion: 2.47 time: 0.102314 Oct 12 22:19:20.395732 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2043/4666] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:20 2022] GET /compute/v2.1/servers/4c012c96-e0db-4fae-9045-2237c25029e8 => generated 1278 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:20.401094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-09aa5eb6-5331-4ef3-baca-3b09f928b4fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:20.401966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-09aa5eb6-5331-4ef3-baca-3b09f928b4fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:20.420730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1cf5787-72b1-4fac-a200-08609e261dab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:20.421231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1cf5787-72b1-4fac-a200-08609e261dab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:20.421774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1cf5787-72b1-4fac-a200-08609e261dab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:20.422366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1cf5787-72b1-4fac-a200-08609e261dab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:20.427694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09aa5eb6-5331-4ef3-baca-3b09f928b4fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:20.428444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09aa5eb6-5331-4ef3-baca-3b09f928b4fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:20.429038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09aa5eb6-5331-4ef3-baca-3b09f928b4fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:20.429980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09aa5eb6-5331-4ef3-baca-3b09f928b4fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:20.432679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1cf5787-72b1-4fac-a200-08609e261dab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:20.433233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1cf5787-72b1-4fac-a200-08609e261dab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:20.440230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09aa5eb6-5331-4ef3-baca-3b09f928b4fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:20.444511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09aa5eb6-5331-4ef3-baca-3b09f928b4fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:20.684827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-09aa5eb6-5331-4ef3-baca-3b09f928b4fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:20.694929 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-09aa5eb6-5331-4ef3-baca-3b09f928b4fd tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1509 microversion: 2.1 time: 0.297739 Oct 12 22:19:20.696722 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2044/4667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:20 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1509 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:20.702255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2a8bdbf4-44e1-4190-98ee-988ff1d523b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:20.703292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2a8bdbf4-44e1-4190-98ee-988ff1d523b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 198da671-4118-49da-ad40-506db4c1ce48] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:20.710917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a8bdbf4-44e1-4190-98ee-988ff1d523b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:20.711702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a8bdbf4-44e1-4190-98ee-988ff1d523b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:20.712325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a8bdbf4-44e1-4190-98ee-988ff1d523b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:20.713353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a8bdbf4-44e1-4190-98ee-988ff1d523b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:20.713958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a8bdbf4-44e1-4190-98ee-988ff1d523b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:20.714523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a8bdbf4-44e1-4190-98ee-988ff1d523b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:20.764153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a8bdbf4-44e1-4190-98ee-988ff1d523b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:20.764660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a8bdbf4-44e1-4190-98ee-988ff1d523b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:20.765107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a8bdbf4-44e1-4190-98ee-988ff1d523b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:20.765613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-2a8bdbf4-44e1-4190-98ee-988ff1d523b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lazy-loading 'fault' on Instance uuid 198da671-4118-49da-ad40-506db4c1ce48 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:19:20.834615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2a8bdbf4-44e1-4190-98ee-988ff1d523b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:20.851102 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2a8bdbf4-44e1-4190-98ee-988ff1d523b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48" status: 200 len: 1312 microversion: 2.1 time: 0.150038 Oct 12 22:19:20.853018 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2045/4668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:20 2022] GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48 => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:20.866948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-78e1dc42-2e3e-4f19-9340-a188efe74a9f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-963208450", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": "none"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:20.969098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-78e1dc42-2e3e-4f19-9340-a188efe74a9f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:19:20.969521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-78e1dc42-2e3e-4f19-9340-a188efe74a9f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:19:20.975272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-78e1dc42-2e3e-4f19-9340-a188efe74a9f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:19:20.977698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-78e1dc42-2e3e-4f19-9340-a188efe74a9f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:19:20.978347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-78e1dc42-2e3e-4f19-9340-a188efe74a9f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:19:21.001651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78e1dc42-2e3e-4f19-9340-a188efe74a9f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:21.003439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78e1dc42-2e3e-4f19-9340-a188efe74a9f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:21.005000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78e1dc42-2e3e-4f19-9340-a188efe74a9f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:21.008737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78e1dc42-2e3e-4f19-9340-a188efe74a9f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:21.011778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78e1dc42-2e3e-4f19-9340-a188efe74a9f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:21.013184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78e1dc42-2e3e-4f19-9340-a188efe74a9f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:21.073672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-78e1dc42-2e3e-4f19-9340-a188efe74a9f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Getting quotas for project 1a156d49115943af93cfc2164918987f. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:19:21.088935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-78e1dc42-2e3e-4f19-9340-a188efe74a9f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Getting quotas for user 550933af3c7c44b5a33b00092c24737a and project 1a156d49115943af93cfc2164918987f. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:19:21.132867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-78e1dc42-2e3e-4f19-9340-a188efe74a9f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:19:21.138793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-78e1dc42-2e3e-4f19-9340-a188efe74a9f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:19:21.171177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e1cf5787-72b1-4fac-a200-08609e261dab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:21.203222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e1cf5787-72b1-4fac-a200-08609e261dab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:21.205545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e1cf5787-72b1-4fac-a200-08609e261dab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:21.209004 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e1cf5787-72b1-4fac-a200-08609e261dab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 2959 microversion: 2.32 time: 0.825378 Oct 12 22:19:21.230998 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2624/4669] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:20 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 2959 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:21.264766 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-78e1dc42-2e3e-4f19-9340-a188efe74a9f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.409019 Oct 12 22:19:21.266833 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2046/4670] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 22:19:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:19:21.281030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-532d6a2a-4382-4c58-be5b-3ea1b938da4e tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:21.284315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-532d6a2a-4382-4c58-be5b-3ea1b938da4e tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:21.305776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-abc824f5-7565-4fd3-b82e-bdf2f0e3b20b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:21.307880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-abc824f5-7565-4fd3-b82e-bdf2f0e3b20b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:21.324674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abc824f5-7565-4fd3-b82e-bdf2f0e3b20b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:21.326638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abc824f5-7565-4fd3-b82e-bdf2f0e3b20b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:21.328940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abc824f5-7565-4fd3-b82e-bdf2f0e3b20b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:21.331698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abc824f5-7565-4fd3-b82e-bdf2f0e3b20b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:21.333983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abc824f5-7565-4fd3-b82e-bdf2f0e3b20b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:21.335654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abc824f5-7565-4fd3-b82e-bdf2f0e3b20b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:21.377245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:21.398902 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-532d6a2a-4382-4c58-be5b-3ea1b938da4e tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "PUT /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 991 microversion: 2.47 time: 0.121174 Oct 12 22:19:21.411290 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2625/4671] 10.222.0.16 () {62 vars in 1297 bytes} [Wed Oct 12 22:19:21 2022] PUT /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 991 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:19:21.425960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4c5c37aa-2008-4720-84b2-3e1345de44f3 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:21.426583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4c5c37aa-2008-4720-84b2-3e1345de44f3 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:21.645743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4c5c37aa-2008-4720-84b2-3e1345de44f3 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:21.666605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4c5c37aa-2008-4720-84b2-3e1345de44f3 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:21.668410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4c5c37aa-2008-4720-84b2-3e1345de44f3 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:21.669596 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4c5c37aa-2008-4720-84b2-3e1345de44f3 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1277 microversion: 2.47 time: 0.247824 Oct 12 22:19:21.670175 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2626/4672] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:21 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:19:21.724295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-24a2f5a1-255b-4448-a820-3d650b6ef29b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:21.724931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-24a2f5a1-255b-4448-a820-3d650b6ef29b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:21.734502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24a2f5a1-255b-4448-a820-3d650b6ef29b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:21.735010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24a2f5a1-255b-4448-a820-3d650b6ef29b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:21.737708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24a2f5a1-255b-4448-a820-3d650b6ef29b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:21.738634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24a2f5a1-255b-4448-a820-3d650b6ef29b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:21.739279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24a2f5a1-255b-4448-a820-3d650b6ef29b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:21.739867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24a2f5a1-255b-4448-a820-3d650b6ef29b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:21.879523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-abc824f5-7565-4fd3-b82e-bdf2f0e3b20b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:21.890889 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-abc824f5-7565-4fd3-b82e-bdf2f0e3b20b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 200 len: 1317 microversion: 2.1 time: 0.590422 Oct 12 22:19:21.891518 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2047/4673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:21 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 1317 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:21.899382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-954b09f9-f5ec-4446-ba3b-3c8354866db5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:21.902325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-954b09f9-f5ec-4446-ba3b-3c8354866db5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 198da671-4118-49da-ad40-506db4c1ce48] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:21.919774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-954b09f9-f5ec-4446-ba3b-3c8354866db5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:21.920539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-954b09f9-f5ec-4446-ba3b-3c8354866db5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:21.922447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-954b09f9-f5ec-4446-ba3b-3c8354866db5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:21.923379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-954b09f9-f5ec-4446-ba3b-3c8354866db5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:21.933759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-954b09f9-f5ec-4446-ba3b-3c8354866db5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:21.934514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-954b09f9-f5ec-4446-ba3b-3c8354866db5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:21.956126 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-954b09f9-f5ec-4446-ba3b-3c8354866db5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] HTTP exception thrown: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-954b09f9-f5ec-4446-ba3b-3c8354866db5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Request method failure captured: Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48 HTTP/1.1 Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz1DRhJTIn6t8VuVJ6IdaFF7sHtf1tvLIRzVhFL9gB42p-x7PAKwE-n0mz-dRUvZbqBw8q8KlB1oECioxlfFeXhjfBUBJjYc7v_-2tUwVwDwu-6rMgOsGK7UxOmbaWvAjjOFppIwKHVnkS8zXa97mUnOQuaaOU7J4ayTuG3yIZfX8Fs Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 64f851076c8e418e8247f942acb9355d Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64f851076c8e418e8247f942acb9355d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64f851076c8e418e8247f942acb9355d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_64f851076c8e418e8247f942acb9355d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/64f851076c8e418e8247f942acb9355d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 64f851076c8e418e8247f942acb9355d Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ListServersNegativeTestJSON-1626347454-project Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 9abff5207f9f49d294f0a47342e0a9c2 Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ListServersNegativeTestJSON-1626347454-project Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '198da671-4118-49da-ad40-506db4c1ce48'} Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:21.962673 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:21.966464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:21.966464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:21.966464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:21.966464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:21.966464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:21.966464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:21.966464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. Oct 12 22:19:21.966464 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:21.968611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-954b09f9-f5ec-4446-ba3b-3c8354866db5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Returning 404 to user: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:21.970208 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-954b09f9-f5ec-4446-ba3b-3c8354866db5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48" status: 404 len: 111 microversion: 2.1 time: 0.077295 Oct 12 22:19:21.971009 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2048/4674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:21 2022] GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:19:21.984422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d43173d8-0afe-4e91-bc26-ed5f7e302a48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:21.994966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-24a2f5a1-255b-4448-a820-3d650b6ef29b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:21.999595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d43173d8-0afe-4e91-bc26-ed5f7e302a48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:22.002289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d43173d8-0afe-4e91-bc26-ed5f7e302a48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '64f851076c8e418e8247f942acb9355d'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:19:22.002901 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-24a2f5a1-255b-4448-a820-3d650b6ef29b tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1467 microversion: 2.1 time: 0.283349 Oct 12 22:19:22.016948 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2627/4675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:21 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1467 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:22.036093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d43173d8-0afe-4e91-bc26-ed5f7e302a48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:22.037712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d43173d8-0afe-4e91-bc26-ed5f7e302a48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:22.038419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d43173d8-0afe-4e91-bc26-ed5f7e302a48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:22.041517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d43173d8-0afe-4e91-bc26-ed5f7e302a48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:22.042215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d43173d8-0afe-4e91-bc26-ed5f7e302a48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:22.047530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d43173d8-0afe-4e91-bc26-ed5f7e302a48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:22.234591 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d43173d8-0afe-4e91-bc26-ed5f7e302a48 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.257758 Oct 12 22:19:22.235650 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2049/4676] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 12 22:19:21 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:19:22.245405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02bdc4a2-1be6-4f37-96c1-6709c62f12eb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:22.246615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-02bdc4a2-1be6-4f37-96c1-6709c62f12eb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:22.251570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d896ac3-52ba-4db7-8775-a3331610b3b9 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d896ac3-52ba-4db7-8775-a3331610b3b9 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Request method failure captured: Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz1DRhJTIn6t8VuVJ6IdaFF7sHtf1tvLIRzVhFL9gB42p-x7PAKwE-n0mz-dRUvZbqBw8q8KlB1oECioxlfFeXhjfBUBJjYc7v_-2tUwVwDwu-6rMgOsGK7UxOmbaWvAjjOFppIwKHVnkS8zXa97mUnOQuaaOU7J4ayTuG3yIZfX8Fs Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 64f851076c8e418e8247f942acb9355d Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64f851076c8e418e8247f942acb9355d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64f851076c8e418e8247f942acb9355d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_64f851076c8e418e8247f942acb9355d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/64f851076c8e418e8247f942acb9355d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 64f851076c8e418e8247f942acb9355d Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ListServersNegativeTestJSON-1626347454-project Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 9abff5207f9f49d294f0a47342e0a9c2 Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ListServersNegativeTestJSON-1626347454-project Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: action_args: {} Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 12 22:19:22.256252 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:19:22.260768 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:19:22.260768 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:19:22.260768 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:19:22.260768 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 12 22:19:22.260768 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.260768 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:22.260768 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.260768 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:22.260768 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:22.260768 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:22.260768 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:19:22.260768 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:19:22.260768 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 12 22:19:22.260768 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.260768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d896ac3-52ba-4db7-8775-a3331610b3b9 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:22.261784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02bdc4a2-1be6-4f37-96c1-6709c62f12eb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:22.262761 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5d896ac3-52ba-4db7-8775-a3331610b3b9 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.017298 Oct 12 22:19:22.263646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02bdc4a2-1be6-4f37-96c1-6709c62f12eb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:22.263979 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2050/4677] 10.222.0.16 () {58 vars in 1182 bytes} [Wed Oct 12 22:19:22 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:19:22.264511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02bdc4a2-1be6-4f37-96c1-6709c62f12eb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:22.265257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02bdc4a2-1be6-4f37-96c1-6709c62f12eb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:22.265727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02bdc4a2-1be6-4f37-96c1-6709c62f12eb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:22.266167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02bdc4a2-1be6-4f37-96c1-6709c62f12eb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:22.279303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:22.281158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-067fbc39-9dcd-4bd8-a05e-ea6e9cca968a tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:22.294300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-067fbc39-9dcd-4bd8-a05e-ea6e9cca968a tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:22.297188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-067fbc39-9dcd-4bd8-a05e-ea6e9cca968a tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Searching by: {'deleted': False, 'project_id': '64f851076c8e418e8247f942acb9355d'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:19:22.318422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-067fbc39-9dcd-4bd8-a05e-ea6e9cca968a tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:22.320434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-067fbc39-9dcd-4bd8-a05e-ea6e9cca968a tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:22.321784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-067fbc39-9dcd-4bd8-a05e-ea6e9cca968a tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:22.338424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-067fbc39-9dcd-4bd8-a05e-ea6e9cca968a tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:22.340150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-067fbc39-9dcd-4bd8-a05e-ea6e9cca968a tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:22.341255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-067fbc39-9dcd-4bd8-a05e-ea6e9cca968a tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:22.427389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.multi_cell_list [None req-067fbc39-9dcd-4bd8-a05e-ea6e9cca968a tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:19:22.481317 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-067fbc39-9dcd-4bd8-a05e-ea6e9cca968a tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.210691 Oct 12 22:19:22.481913 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2051/4678] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 12 22:19:22 2022] GET /compute/v2.1/servers => generated 681 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:22.487448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-08a1a85a-6450-4145-af75-4b41a3d3ae8f req-30da61ac-49f3-42be-b00e-9007f22e09dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa125a5f-e370-48e8-ab9b-64f8f10bc1ac", "name": "network-vif-deleted", "tag": "d471c95a-42c6-4ec1-adc0-1382973e1381"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:22.509956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-08a1a85a-6450-4145-af75-4b41a3d3ae8f req-30da61ac-49f3-42be-b00e-9007f22e09dc service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:22.511014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-08a1a85a-6450-4145-af75-4b41a3d3ae8f req-30da61ac-49f3-42be-b00e-9007f22e09dc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:22.511581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-08a1a85a-6450-4145-af75-4b41a3d3ae8f req-30da61ac-49f3-42be-b00e-9007f22e09dc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:22.530809 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-08a1a85a-6450-4145-af75-4b41a3d3ae8f req-30da61ac-49f3-42be-b00e-9007f22e09dc service nova] Creating event network-vif-deleted:d471c95a-42c6-4ec1-adc0-1382973e1381 for instance aa125a5f-e370-48e8-ab9b-64f8f10bc1ac on n-h1-861111-1 Oct 12 22:19:22.539808 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-08a1a85a-6450-4145-af75-4b41a3d3ae8f req-30da61ac-49f3-42be-b00e-9007f22e09dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055978 Oct 12 22:19:22.543578 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2052/4679] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:22.568319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-47b5f11a-a6d1-45a6-b935-c6f4e63ab549 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:22.574865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-47b5f11a-a6d1-45a6-b935-c6f4e63ab549 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:22.575458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.compute.servers [None req-47b5f11a-a6d1-45a6-b935-c6f4e63ab549 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Removing options 'limit' from query {{(pid=120452) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 12 22:19:22.576466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-47b5f11a-a6d1-45a6-b935-c6f4e63ab549 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Searching by: {'deleted': False, 'project_id': '64f851076c8e418e8247f942acb9355d'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:19:22.583226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b5f11a-a6d1-45a6-b935-c6f4e63ab549 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:22.584211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b5f11a-a6d1-45a6-b935-c6f4e63ab549 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:22.584825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b5f11a-a6d1-45a6-b935-c6f4e63ab549 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:22.585830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b5f11a-a6d1-45a6-b935-c6f4e63ab549 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:22.586691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b5f11a-a6d1-45a6-b935-c6f4e63ab549 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:22.587670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b5f11a-a6d1-45a6-b935-c6f4e63ab549 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:22.626296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.multi_cell_list [None req-47b5f11a-a6d1-45a6-b935-c6f4e63ab549 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:19:22.666708 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-47b5f11a-a6d1-45a6-b935-c6f4e63ab549 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.118595 Oct 12 22:19:22.682027 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2053/4680] 10.222.0.16 () {58 vars in 1144 bytes} [Wed Oct 12 22:19:22 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:22.692330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-b2a62de6-4a66-433d-af07-49722bfe3b74 req-4aee51df-3aca-4668-856d-a9794b775027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd026e6-7533-4efb-88f5-1573116d8f08", "name": "network-vif-plugged", "status": "completed", "tag": "5464a150-633c-4044-a3cb-dbe841354308"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:22.711516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b2a62de6-4a66-433d-af07-49722bfe3b74 req-4aee51df-3aca-4668-856d-a9794b775027 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:22.713848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b2a62de6-4a66-433d-af07-49722bfe3b74 req-4aee51df-3aca-4668-856d-a9794b775027 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:22.714531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b2a62de6-4a66-433d-af07-49722bfe3b74 req-4aee51df-3aca-4668-856d-a9794b775027 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:22.734259 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-b2a62de6-4a66-433d-af07-49722bfe3b74 req-4aee51df-3aca-4668-856d-a9794b775027 service nova] Creating event network-vif-plugged:5464a150-633c-4044-a3cb-dbe841354308 for instance 1cd026e6-7533-4efb-88f5-1573116d8f08 on n-h2-861111-1 Oct 12 22:19:22.741034 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-b2a62de6-4a66-433d-af07-49722bfe3b74 req-4aee51df-3aca-4668-856d-a9794b775027 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056108 Oct 12 22:19:22.741821 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2054/4681] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:22.747390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-42b369ad-9ffb-4410-abd7-cfda71780893 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-42b369ad-9ffb-4410-abd7-cfda71780893 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Request method failure captured: Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz1DRhJTIn6t8VuVJ6IdaFF7sHtf1tvLIRzVhFL9gB42p-x7PAKwE-n0mz-dRUvZbqBw8q8KlB1oECioxlfFeXhjfBUBJjYc7v_-2tUwVwDwu-6rMgOsGK7UxOmbaWvAjjOFppIwKHVnkS8zXa97mUnOQuaaOU7J4ayTuG3yIZfX8Fs Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 64f851076c8e418e8247f942acb9355d Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64f851076c8e418e8247f942acb9355d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64f851076c8e418e8247f942acb9355d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_64f851076c8e418e8247f942acb9355d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/64f851076c8e418e8247f942acb9355d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 64f851076c8e418e8247f942acb9355d Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ListServersNegativeTestJSON-1626347454-project Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 9abff5207f9f49d294f0a47342e0a9c2 Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ListServersNegativeTestJSON-1626347454-project Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: action_args: {} Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi '-1' Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 12 22:19:22.752597 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 12 22:19:22.757436 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:19:22.757436 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:19:22.757436 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:19:22.757436 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:19:22.757436 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 12 22:19:22.757436 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.757436 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:22.757436 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.757436 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:22.757436 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:22.757436 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:22.757436 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:19:22.757436 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:19:22.757436 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 12 22:19:22.757436 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.759814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-42b369ad-9ffb-4410-abd7-cfda71780893 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:22.761062 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-42b369ad-9ffb-4410-abd7-cfda71780893 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.017895 Oct 12 22:19:22.762307 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2055/4682] 10.222.0.16 () {58 vars in 1142 bytes} [Wed Oct 12 22:19:22 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:19:22.779700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2eef4bc1-3e23-443d-be7f-fc6ed2bf0646 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:22.781422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2eef4bc1-3e23-443d-be7f-fc6ed2bf0646 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:22.790598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2eef4bc1-3e23-443d-be7f-fc6ed2bf0646 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:22.791498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2eef4bc1-3e23-443d-be7f-fc6ed2bf0646 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:22.792149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2eef4bc1-3e23-443d-be7f-fc6ed2bf0646 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:22.793126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2eef4bc1-3e23-443d-be7f-fc6ed2bf0646 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:22.793935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2eef4bc1-3e23-443d-be7f-fc6ed2bf0646 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:22.794554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2eef4bc1-3e23-443d-be7f-fc6ed2bf0646 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:22.851618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-02bdc4a2-1be6-4f37-96c1-6709c62f12eb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:22.868169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-02bdc4a2-1be6-4f37-96c1-6709c62f12eb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:22.871683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-02bdc4a2-1be6-4f37-96c1-6709c62f12eb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:22.875052 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-02bdc4a2-1be6-4f37-96c1-6709c62f12eb tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 2938 microversion: 2.32 time: 0.634044 Oct 12 22:19:22.876849 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2628/4683] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:22 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 2938 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:22.887306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2d23290c-af46-4580-8f7f-74bf63bcbdd0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2d23290c-af46-4580-8f7f-74bf63bcbdd0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Request method failure captured: Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz1DRhJTIn6t8VuVJ6IdaFF7sHtf1tvLIRzVhFL9gB42p-x7PAKwE-n0mz-dRUvZbqBw8q8KlB1oECioxlfFeXhjfBUBJjYc7v_-2tUwVwDwu-6rMgOsGK7UxOmbaWvAjjOFppIwKHVnkS8zXa97mUnOQuaaOU7J4ayTuG3yIZfX8Fs Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 64f851076c8e418e8247f942acb9355d Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64f851076c8e418e8247f942acb9355d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64f851076c8e418e8247f942acb9355d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_64f851076c8e418e8247f942acb9355d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/64f851076c8e418e8247f942acb9355d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 64f851076c8e418e8247f942acb9355d Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ListServersNegativeTestJSON-1626347454-project Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 9abff5207f9f49d294f0a47342e0a9c2 Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ListServersNegativeTestJSON-1626347454-project Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: action_args: {} Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'testing' Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 12 22:19:22.891586 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 12 22:19:22.896182 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:19:22.896182 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:19:22.896182 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:19:22.896182 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:19:22.896182 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 12 22:19:22.896182 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.896182 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:22.896182 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.896182 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:22.896182 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:22.896182 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:22.896182 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:19:22.896182 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:19:22.896182 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 12 22:19:22.896182 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:22.898306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2d23290c-af46-4580-8f7f-74bf63bcbdd0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:22.900248 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2d23290c-af46-4580-8f7f-74bf63bcbdd0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.022298 Oct 12 22:19:22.900991 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2629/4684] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:19:22 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:19:22.907031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2eef4bc1-3e23-443d-be7f-fc6ed2bf0646 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:22.915150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f5abce46-49aa-4441-b259-8566c96f7af8 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:22.915443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2eef4bc1-3e23-443d-be7f-fc6ed2bf0646 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:22.922544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f5abce46-49aa-4441-b259-8566c96f7af8 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:22.924187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2eef4bc1-3e23-443d-be7f-fc6ed2bf0646 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:22.926739 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2eef4bc1-3e23-443d-be7f-fc6ed2bf0646 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1273 microversion: 2.47 time: 0.162575 Oct 12 22:19:22.927492 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2056/4685] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:22 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1273 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:22.929692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f5abce46-49aa-4441-b259-8566c96f7af8 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '64f851076c8e418e8247f942acb9355d'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:19:22.940577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-68264c9b-0ff4-4e3a-84ed-7c18786b8289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:22.942938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-68264c9b-0ff4-4e3a-84ed-7c18786b8289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:22.951188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.compute.servers [None req-f5abce46-49aa-4441-b259-8566c96f7af8 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Flavor 'non_existing_flavor' could not be found {{(pid=120453) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 12 22:19:22.953599 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f5abce46-49aa-4441-b259-8566c96f7af8 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.043302 Oct 12 22:19:22.955872 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2630/4686] 10.222.0.16 () {58 vars in 1178 bytes} [Wed Oct 12 22:19:22 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:19:22.959934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68264c9b-0ff4-4e3a-84ed-7c18786b8289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:22.961011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68264c9b-0ff4-4e3a-84ed-7c18786b8289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:22.961673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68264c9b-0ff4-4e3a-84ed-7c18786b8289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:22.968829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68264c9b-0ff4-4e3a-84ed-7c18786b8289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:22.970397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68264c9b-0ff4-4e3a-84ed-7c18786b8289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:22.971357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af5bcf5c-92be-48bc-8aa2-ffab034a4eff tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:22.972918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68264c9b-0ff4-4e3a-84ed-7c18786b8289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:22.986714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-af5bcf5c-92be-48bc-8aa2-ffab034a4eff tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:22.992563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-af5bcf5c-92be-48bc-8aa2-ffab034a4eff tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '64f851076c8e418e8247f942acb9355d'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:19:23.001712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af5bcf5c-92be-48bc-8aa2-ffab034a4eff tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:23.002199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af5bcf5c-92be-48bc-8aa2-ffab034a4eff tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:23.002950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af5bcf5c-92be-48bc-8aa2-ffab034a4eff tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:23.005007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af5bcf5c-92be-48bc-8aa2-ffab034a4eff tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:23.005709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af5bcf5c-92be-48bc-8aa2-ffab034a4eff tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:23.006369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af5bcf5c-92be-48bc-8aa2-ffab034a4eff tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:23.110119 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-af5bcf5c-92be-48bc-8aa2-ffab034a4eff tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.144638 Oct 12 22:19:23.111453 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2631/4687] 10.222.0.16 () {58 vars in 1174 bytes} [Wed Oct 12 22:19:22 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:19:23.117790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-16ed9c55-6bd9-4ef4-ae41-2fe4c46061ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:23.118723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-16ed9c55-6bd9-4ef4-ae41-2fe4c46061ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:23.124974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16ed9c55-6bd9-4ef4-ae41-2fe4c46061ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:23.125746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16ed9c55-6bd9-4ef4-ae41-2fe4c46061ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:23.126441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16ed9c55-6bd9-4ef4-ae41-2fe4c46061ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:23.127403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16ed9c55-6bd9-4ef4-ae41-2fe4c46061ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:23.128084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16ed9c55-6bd9-4ef4-ae41-2fe4c46061ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:23.128895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16ed9c55-6bd9-4ef4-ae41-2fe4c46061ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:23.169337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16ed9c55-6bd9-4ef4-ae41-2fe4c46061ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:23.170128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16ed9c55-6bd9-4ef4-ae41-2fe4c46061ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:23.170808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16ed9c55-6bd9-4ef4-ae41-2fe4c46061ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:23.171551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-16ed9c55-6bd9-4ef4-ae41-2fe4c46061ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lazy-loading 'fault' on Instance uuid aa125a5f-e370-48e8-ab9b-64f8f10bc1ac {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:19:23.242907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-16ed9c55-6bd9-4ef4-ae41-2fe4c46061ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:23.255717 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-16ed9c55-6bd9-4ef4-ae41-2fe4c46061ab tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 200 len: 1305 microversion: 2.1 time: 0.142924 Oct 12 22:19:23.257072 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2632/4688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:23 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 1305 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:23.264099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-725ba256-f2dc-4837-bef7-bcc26ebe02b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:23.277620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-725ba256-f2dc-4837-bef7-bcc26ebe02b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:23.278877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-725ba256-f2dc-4837-bef7-bcc26ebe02b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '64f851076c8e418e8247f942acb9355d'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:19:23.285922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-725ba256-f2dc-4837-bef7-bcc26ebe02b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:23.286914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-725ba256-f2dc-4837-bef7-bcc26ebe02b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:23.287595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-725ba256-f2dc-4837-bef7-bcc26ebe02b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:23.288968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-725ba256-f2dc-4837-bef7-bcc26ebe02b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:23.289689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-725ba256-f2dc-4837-bef7-bcc26ebe02b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:23.290906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-725ba256-f2dc-4837-bef7-bcc26ebe02b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:23.366026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-68264c9b-0ff4-4e3a-84ed-7c18786b8289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:23.379332 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-68264c9b-0ff4-4e3a-84ed-7c18786b8289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 200 len: 1317 microversion: 2.1 time: 0.448207 Oct 12 22:19:23.380028 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2057/4689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:22 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:23.431184 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-725ba256-f2dc-4837-bef7-bcc26ebe02b5 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.172803 Oct 12 22:19:23.432520 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2633/4690] 10.222.0.16 () {58 vars in 1184 bytes} [Wed Oct 12 22:19:23 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:19:23.444907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f545eb3d-42b3-4b3a-84c2-a909f73f51b7 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:23.450004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f545eb3d-42b3-4b3a-84c2-a909f73f51b7 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:23.450861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f545eb3d-42b3-4b3a-84c2-a909f73f51b7 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Searching by: {'deleted': False, 'project_id': '64f851076c8e418e8247f942acb9355d'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:19:23.456314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f545eb3d-42b3-4b3a-84c2-a909f73f51b7 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:23.457569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f545eb3d-42b3-4b3a-84c2-a909f73f51b7 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:23.458016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f545eb3d-42b3-4b3a-84c2-a909f73f51b7 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:23.459028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f545eb3d-42b3-4b3a-84c2-a909f73f51b7 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:23.459507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f545eb3d-42b3-4b3a-84c2-a909f73f51b7 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:23.460093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f545eb3d-42b3-4b3a-84c2-a909f73f51b7 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:23.499202 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.multi_cell_list [None req-f545eb3d-42b3-4b3a-84c2-a909f73f51b7 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:19:23.544730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f545eb3d-42b3-4b3a-84c2-a909f73f51b7 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:23.553293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f545eb3d-42b3-4b3a-84c2-a909f73f51b7 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:23.554051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f545eb3d-42b3-4b3a-84c2-a909f73f51b7 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:23.554646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f545eb3d-42b3-4b3a-84c2-a909f73f51b7 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:23.906379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f87a4d42-5ad1-4f0c-9297-ba2b0f054b46 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:23.907718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f87a4d42-5ad1-4f0c-9297-ba2b0f054b46 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:23.922316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f87a4d42-5ad1-4f0c-9297-ba2b0f054b46 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:23.922826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f87a4d42-5ad1-4f0c-9297-ba2b0f054b46 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:23.923295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f87a4d42-5ad1-4f0c-9297-ba2b0f054b46 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:23.924019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f87a4d42-5ad1-4f0c-9297-ba2b0f054b46 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:23.927528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f87a4d42-5ad1-4f0c-9297-ba2b0f054b46 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:23.928206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f87a4d42-5ad1-4f0c-9297-ba2b0f054b46 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:24.258501 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f545eb3d-42b3-4b3a-84c2-a909f73f51b7 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.817526 Oct 12 22:19:24.259217 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2058/4691] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:19:23 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:24.277100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-acc95933-0507-416d-8e52-5e27b7075a03 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:24.278007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-acc95933-0507-416d-8e52-5e27b7075a03 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:24.284549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acc95933-0507-416d-8e52-5e27b7075a03 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:24.285879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acc95933-0507-416d-8e52-5e27b7075a03 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:24.286565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acc95933-0507-416d-8e52-5e27b7075a03 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:24.287526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acc95933-0507-416d-8e52-5e27b7075a03 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:24.288201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acc95933-0507-416d-8e52-5e27b7075a03 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:24.289246 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acc95933-0507-416d-8e52-5e27b7075a03 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:24.398518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-acc95933-0507-416d-8e52-5e27b7075a03 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:24.413074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-acc95933-0507-416d-8e52-5e27b7075a03 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:24.414518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-acc95933-0507-416d-8e52-5e27b7075a03 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:24.416253 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-acc95933-0507-416d-8e52-5e27b7075a03 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1329 microversion: 2.47 time: 0.155978 Oct 12 22:19:24.417512 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2059/4692] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:24 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1329 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:24.429953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-26112e5d-1bf1-4e86-98d6-86c3a4d4f469 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:24.434691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-26112e5d-1bf1-4e86-98d6-86c3a4d4f469 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: aa125a5f-e370-48e8-ab9b-64f8f10bc1ac] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:24.443818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26112e5d-1bf1-4e86-98d6-86c3a4d4f469 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:24.444404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26112e5d-1bf1-4e86-98d6-86c3a4d4f469 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:24.444919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26112e5d-1bf1-4e86-98d6-86c3a4d4f469 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:24.446334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26112e5d-1bf1-4e86-98d6-86c3a4d4f469 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:24.446879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26112e5d-1bf1-4e86-98d6-86c3a4d4f469 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:24.448537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26112e5d-1bf1-4e86-98d6-86c3a4d4f469 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:24.471720 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-26112e5d-1bf1-4e86-98d6-86c3a4d4f469 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] HTTP exception thrown: Instance aa125a5f-e370-48e8-ab9b-64f8f10bc1ac could not be found. Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-26112e5d-1bf1-4e86-98d6-86c3a4d4f469 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Request method failure captured: Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac HTTP/1.1 Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzriWjH9XGk2m6XxAkFWCa5SU4u3aYbKjccJUM74Gs6m2ZTWTRgYJo3xNK7Dl1yHzUOL0UlgCpklDDkzfGl4zIrs1ucJJAHjnDilUmOFjpe-CEtT-kGaW-5sHatvR75wN517xqlZ9fiNsyKxLaujP5hWxgbqYLVY-SfHQMzPuASo904 Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 319a8f107945457a8a8f8e9690a697e5 Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319a8f107945457a8a8f8e9690a697e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 319a8f107945457a8a8f8e9690a697e5 Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerActionsTestJSON-1007032333-project Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: b29c500796d54d6188ff65056340d35f Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerActionsTestJSON-1007032333-project Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance aa125a5f-e370-48e8-ab9b-64f8f10bc1ac could not be found. Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'aa125a5f-e370-48e8-ab9b-64f8f10bc1ac'} Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa125a5f-e370-48e8-ab9b-64f8f10bc1ac could not be found. Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa125a5f-e370-48e8-ab9b-64f8f10bc1ac could not be found. Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:24.474683 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:24.478838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:24.478838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:24.478838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:24.478838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:24.478838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:24.478838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa125a5f-e370-48e8-ab9b-64f8f10bc1ac could not be found. Oct 12 22:19:24.478838 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:24.478838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-26112e5d-1bf1-4e86-98d6-86c3a4d4f469 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Returning 404 to user: Instance aa125a5f-e370-48e8-ab9b-64f8f10bc1ac could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:24.480498 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-26112e5d-1bf1-4e86-98d6-86c3a4d4f469 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac" status: 404 len: 111 microversion: 2.1 time: 0.060282 Oct 12 22:19:24.483618 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2060/4693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:24 2022] GET /compute/v2.1/servers/aa125a5f-e370-48e8-ab9b-64f8f10bc1ac => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:19:24.488073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-551bbc18-95f9-40b0-96f6-f73217612c81 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:24.494803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-551bbc18-95f9-40b0-96f6-f73217612c81 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:24.496645 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-551bbc18-95f9-40b0-96f6-f73217612c81 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.013220 Oct 12 22:19:24.498525 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2061/4694] 10.222.0.16 () {58 vars in 1178 bytes} [Wed Oct 12 22:19:24 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:19:24.514413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ab2e513c-45c0-416c-b0bc-492b21863402 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:24.515477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ab2e513c-45c0-416c-b0bc-492b21863402 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:24.525473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab2e513c-45c0-416c-b0bc-492b21863402 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:24.526169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab2e513c-45c0-416c-b0bc-492b21863402 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:24.526787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab2e513c-45c0-416c-b0bc-492b21863402 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:24.527677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab2e513c-45c0-416c-b0bc-492b21863402 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:24.528281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab2e513c-45c0-416c-b0bc-492b21863402 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:24.528859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab2e513c-45c0-416c-b0bc-492b21863402 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:24.565562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f87a4d42-5ad1-4f0c-9297-ba2b0f054b46 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:24.584819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f87a4d42-5ad1-4f0c-9297-ba2b0f054b46 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:24.588807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f87a4d42-5ad1-4f0c-9297-ba2b0f054b46 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:24.595835 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f87a4d42-5ad1-4f0c-9297-ba2b0f054b46 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 2917 microversion: 2.32 time: 0.689598 Oct 12 22:19:24.598143 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2634/4695] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:23 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 2917 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:19:24.606444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d0e77986-ba50-4dbe-b692-686cf0b01a72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:24.607869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d0e77986-ba50-4dbe-b692-686cf0b01a72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:24.616078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0e77986-ba50-4dbe-b692-686cf0b01a72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:24.616801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0e77986-ba50-4dbe-b692-686cf0b01a72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:24.618261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0e77986-ba50-4dbe-b692-686cf0b01a72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:24.619167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0e77986-ba50-4dbe-b692-686cf0b01a72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:24.619798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0e77986-ba50-4dbe-b692-686cf0b01a72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:24.620398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0e77986-ba50-4dbe-b692-686cf0b01a72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:24.678530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d0e77986-ba50-4dbe-b692-686cf0b01a72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:19:24.801131 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d0e77986-ba50-4dbe-b692-686cf0b01a72 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 204 len: 0 microversion: 2.1 time: 0.198675 Oct 12 22:19:24.805276 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2635/4696] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:19:24 2022] DELETE /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:19:24.817978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6bc18523-5b95-4918-a90c-d72d9eb9d2f0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:24.842100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6bc18523-5b95-4918-a90c-d72d9eb9d2f0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:24.842935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6bc18523-5b95-4918-a90c-d72d9eb9d2f0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Searching by: {'deleted': False, 'project_id': '64f851076c8e418e8247f942acb9355d'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:19:24.858820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6bc18523-5b95-4918-a90c-d72d9eb9d2f0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:24.859352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6bc18523-5b95-4918-a90c-d72d9eb9d2f0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:24.864759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6bc18523-5b95-4918-a90c-d72d9eb9d2f0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:24.867727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6bc18523-5b95-4918-a90c-d72d9eb9d2f0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:24.869179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6bc18523-5b95-4918-a90c-d72d9eb9d2f0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:24.870706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6bc18523-5b95-4918-a90c-d72d9eb9d2f0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:24.953584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-6bc18523-5b95-4918-a90c-d72d9eb9d2f0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:19:25.042224 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6bc18523-5b95-4918-a90c-d72d9eb9d2f0 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.236322 Oct 12 22:19:25.047297 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2636/4697] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 12 22:19:24 2022] GET /compute/v2.1/servers => generated 681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:25.058815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b62e2bcb-71c5-4aeb-8646-a992eb8cf8c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:25.064100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b62e2bcb-71c5-4aeb-8646-a992eb8cf8c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:25.079392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b62e2bcb-71c5-4aeb-8646-a992eb8cf8c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:25.081559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b62e2bcb-71c5-4aeb-8646-a992eb8cf8c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:25.081559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b62e2bcb-71c5-4aeb-8646-a992eb8cf8c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:25.085164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b62e2bcb-71c5-4aeb-8646-a992eb8cf8c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:25.085332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b62e2bcb-71c5-4aeb-8646-a992eb8cf8c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:25.085836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b62e2bcb-71c5-4aeb-8646-a992eb8cf8c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:25.251228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ab2e513c-45c0-416c-b0bc-492b21863402 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:25.261086 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ab2e513c-45c0-416c-b0bc-492b21863402 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 200 len: 1317 microversion: 2.1 time: 0.761111 Oct 12 22:19:25.281153 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2062/4698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:24 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 1317 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:25.287832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-254010ce-31c1-4cd4-802f-822489eb2850 req-eeb30c97-b652-42e2-80f4-1188de8fbd37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "name": "network-vif-unplugged", "status": "completed", "tag": "36ee1470-0e2f-4c4f-8e19-2e2a700d74d0"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:25.299026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-254010ce-31c1-4cd4-802f-822489eb2850 req-eeb30c97-b652-42e2-80f4-1188de8fbd37 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:25.299983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-254010ce-31c1-4cd4-802f-822489eb2850 req-eeb30c97-b652-42e2-80f4-1188de8fbd37 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:25.300721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-254010ce-31c1-4cd4-802f-822489eb2850 req-eeb30c97-b652-42e2-80f4-1188de8fbd37 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:25.315963 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-254010ce-31c1-4cd4-802f-822489eb2850 req-eeb30c97-b652-42e2-80f4-1188de8fbd37 service nova] Creating event network-vif-unplugged:36ee1470-0e2f-4c4f-8e19-2e2a700d74d0 for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:19:25.323868 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-254010ce-31c1-4cd4-802f-822489eb2850 req-eeb30c97-b652-42e2-80f4-1188de8fbd37 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040682 Oct 12 22:19:25.324952 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2063/4699] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:25.332534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bea87612-5b25-46dd-9952-5df2b06a0702 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:25.333529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bea87612-5b25-46dd-9952-5df2b06a0702 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 198da671-4118-49da-ad40-506db4c1ce48] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:25.340769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bea87612-5b25-46dd-9952-5df2b06a0702 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:25.343875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bea87612-5b25-46dd-9952-5df2b06a0702 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:25.344588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bea87612-5b25-46dd-9952-5df2b06a0702 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:25.345471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bea87612-5b25-46dd-9952-5df2b06a0702 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:25.346078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bea87612-5b25-46dd-9952-5df2b06a0702 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:25.346765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bea87612-5b25-46dd-9952-5df2b06a0702 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:25.366202 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-bea87612-5b25-46dd-9952-5df2b06a0702 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] HTTP exception thrown: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bea87612-5b25-46dd-9952-5df2b06a0702 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Request method failure captured: Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48 HTTP/1.1 Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz1DRhJTIn6t8VuVJ6IdaFF7sHtf1tvLIRzVhFL9gB42p-x7PAKwE-n0mz-dRUvZbqBw8q8KlB1oECioxlfFeXhjfBUBJjYc7v_-2tUwVwDwu-6rMgOsGK7UxOmbaWvAjjOFppIwKHVnkS8zXa97mUnOQuaaOU7J4ayTuG3yIZfX8Fs Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 64f851076c8e418e8247f942acb9355d Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64f851076c8e418e8247f942acb9355d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64f851076c8e418e8247f942acb9355d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_64f851076c8e418e8247f942acb9355d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/64f851076c8e418e8247f942acb9355d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 64f851076c8e418e8247f942acb9355d Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ListServersNegativeTestJSON-1626347454-project Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 9abff5207f9f49d294f0a47342e0a9c2 Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ListServersNegativeTestJSON-1626347454-project Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '198da671-4118-49da-ad40-506db4c1ce48'} Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:19:25.368892 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:19:25.373163 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. Oct 12 22:19:25.373163 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:25.373163 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:25.373163 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:25.373163 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:25.373163 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:25.373163 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:25.373163 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:25.373163 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:25.373163 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. Oct 12 22:19:25.373163 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:25.375350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bea87612-5b25-46dd-9952-5df2b06a0702 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Returning 404 to user: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:25.376724 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bea87612-5b25-46dd-9952-5df2b06a0702 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "DELETE /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48" status: 404 len: 111 microversion: 2.1 time: 0.050094 Oct 12 22:19:25.381808 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2064/4700] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:19:25 2022] DELETE /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:19:25.387416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-456189e0-26e0-4292-b964-ccc3f6d78d99 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:25.388149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-456189e0-26e0-4292-b964-ccc3f6d78d99 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: c95fbb6a-0a59-41eb-8b29-fab44a51d53f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:25.395879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-456189e0-26e0-4292-b964-ccc3f6d78d99 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:25.396581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-456189e0-26e0-4292-b964-ccc3f6d78d99 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:25.397369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-456189e0-26e0-4292-b964-ccc3f6d78d99 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:25.398228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-456189e0-26e0-4292-b964-ccc3f6d78d99 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:25.399616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-456189e0-26e0-4292-b964-ccc3f6d78d99 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:25.400255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-456189e0-26e0-4292-b964-ccc3f6d78d99 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:25.462027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-456189e0-26e0-4292-b964-ccc3f6d78d99 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: c95fbb6a-0a59-41eb-8b29-fab44a51d53f] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:19:25.572140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b62e2bcb-71c5-4aeb-8646-a992eb8cf8c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:25.584574 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b62e2bcb-71c5-4aeb-8646-a992eb8cf8c4 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1495 microversion: 2.1 time: 0.536345 Oct 12 22:19:25.603009 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2637/4701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:25 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1495 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:25.614130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e3c7cccb-f11e-4501-b835-71bac4dae110 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:25.614936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e3c7cccb-f11e-4501-b835-71bac4dae110 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:25.633181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3c7cccb-f11e-4501-b835-71bac4dae110 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:25.634409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3c7cccb-f11e-4501-b835-71bac4dae110 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:25.636093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3c7cccb-f11e-4501-b835-71bac4dae110 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:25.638366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3c7cccb-f11e-4501-b835-71bac4dae110 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:25.639797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3c7cccb-f11e-4501-b835-71bac4dae110 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:25.641548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3c7cccb-f11e-4501-b835-71bac4dae110 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:25.666577 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-456189e0-26e0-4292-b964-ccc3f6d78d99 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c95fbb6a-0a59-41eb-8b29-fab44a51d53f" status: 204 len: 0 microversion: 2.1 time: 0.283123 Oct 12 22:19:25.671753 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2065/4702] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:19:25 2022] DELETE /compute/v2.1/servers/c95fbb6a-0a59-41eb-8b29-fab44a51d53f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:19:25.683647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a8f26e86-8595-4d84-8782-da2fbf025807 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:25.687076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a8f26e86-8595-4d84-8782-da2fbf025807 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:25.691142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:25.705283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f26e86-8595-4d84-8782-da2fbf025807 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:25.706034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f26e86-8595-4d84-8782-da2fbf025807 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:25.707290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f26e86-8595-4d84-8782-da2fbf025807 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:25.710330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f26e86-8595-4d84-8782-da2fbf025807 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:25.711042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f26e86-8595-4d84-8782-da2fbf025807 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:25.712221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f26e86-8595-4d84-8782-da2fbf025807 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:26.026563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e3c7cccb-f11e-4501-b835-71bac4dae110 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:26.042217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e3c7cccb-f11e-4501-b835-71bac4dae110 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:26.045565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e3c7cccb-f11e-4501-b835-71bac4dae110 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:26.049243 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e3c7cccb-f11e-4501-b835-71bac4dae110 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1347 microversion: 2.47 time: 0.444648 Oct 12 22:19:26.054109 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2638/4703] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:25 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1347 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:26.065019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5fcee86d-5d9d-4d37-8321-4fd9ac7e3953 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:26.065857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5fcee86d-5d9d-4d37-8321-4fd9ac7e3953 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:26.076348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fcee86d-5d9d-4d37-8321-4fd9ac7e3953 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:26.077115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fcee86d-5d9d-4d37-8321-4fd9ac7e3953 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:26.077721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fcee86d-5d9d-4d37-8321-4fd9ac7e3953 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:26.078705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fcee86d-5d9d-4d37-8321-4fd9ac7e3953 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:26.079515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fcee86d-5d9d-4d37-8321-4fd9ac7e3953 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:26.080119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fcee86d-5d9d-4d37-8321-4fd9ac7e3953 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:26.116071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5fcee86d-5d9d-4d37-8321-4fd9ac7e3953 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:19:26.184249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a8f26e86-8595-4d84-8782-da2fbf025807 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:26.196156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a8f26e86-8595-4d84-8782-da2fbf025807 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:26.198684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a8f26e86-8595-4d84-8782-da2fbf025807 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:26.199740 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a8f26e86-8595-4d84-8782-da2fbf025807 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 2870 microversion: 2.32 time: 0.525260 Oct 12 22:19:26.200756 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2066/4704] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:25 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 2870 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:26.220674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d15f3a0a-862e-443d-a191-48a5436431b1 req-84b5c6f1-d00d-408b-b508-5f13e297e4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "name": "network-vif-deleted", "tag": "dfea1e40-7a7f-4c90-a02f-bdc09fd3cd9c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:26.239201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d15f3a0a-862e-443d-a191-48a5436431b1 req-84b5c6f1-d00d-408b-b508-5f13e297e4c9 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:26.239905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d15f3a0a-862e-443d-a191-48a5436431b1 req-84b5c6f1-d00d-408b-b508-5f13e297e4c9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:26.240523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d15f3a0a-862e-443d-a191-48a5436431b1 req-84b5c6f1-d00d-408b-b508-5f13e297e4c9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:26.266157 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5fcee86d-5d9d-4d37-8321-4fd9ac7e3953 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "DELETE /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 204 len: 0 microversion: 2.1 time: 0.209250 Oct 12 22:19:26.266842 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2639/4705] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:19:26 2022] DELETE /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:19:26.274765 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d15f3a0a-862e-443d-a191-48a5436431b1 req-84b5c6f1-d00d-408b-b508-5f13e297e4c9 service nova] Creating event network-vif-deleted:dfea1e40-7a7f-4c90-a02f-bdc09fd3cd9c for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:19:26.275760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48b6a2db-0772-4cbb-8d95-df3786de3e57 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:26.276505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-48b6a2db-0772-4cbb-8d95-df3786de3e57 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 198da671-4118-49da-ad40-506db4c1ce48] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:26.282506 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d15f3a0a-862e-443d-a191-48a5436431b1 req-84b5c6f1-d00d-408b-b508-5f13e297e4c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080421 Oct 12 22:19:26.283964 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2067/4706] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:26.287058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:26.294854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-47938a21-2997-4824-9b90-509f410aa1bb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:26.297976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b6a2db-0772-4cbb-8d95-df3786de3e57 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:26.299860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b6a2db-0772-4cbb-8d95-df3786de3e57 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:26.300345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-47938a21-2997-4824-9b90-509f410aa1bb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:26.303279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b6a2db-0772-4cbb-8d95-df3786de3e57 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:26.304576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b6a2db-0772-4cbb-8d95-df3786de3e57 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:26.305280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b6a2db-0772-4cbb-8d95-df3786de3e57 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:26.307993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48b6a2db-0772-4cbb-8d95-df3786de3e57 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:26.323133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47938a21-2997-4824-9b90-509f410aa1bb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:26.323975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47938a21-2997-4824-9b90-509f410aa1bb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:26.324690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47938a21-2997-4824-9b90-509f410aa1bb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:26.325625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47938a21-2997-4824-9b90-509f410aa1bb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:26.326422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47938a21-2997-4824-9b90-509f410aa1bb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:26.327060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47938a21-2997-4824-9b90-509f410aa1bb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:26.365100 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-48b6a2db-0772-4cbb-8d95-df3786de3e57 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] HTTP exception thrown: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48b6a2db-0772-4cbb-8d95-df3786de3e57 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Request method failure captured: Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48 HTTP/1.1 Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz1DRhJTIn6t8VuVJ6IdaFF7sHtf1tvLIRzVhFL9gB42p-x7PAKwE-n0mz-dRUvZbqBw8q8KlB1oECioxlfFeXhjfBUBJjYc7v_-2tUwVwDwu-6rMgOsGK7UxOmbaWvAjjOFppIwKHVnkS8zXa97mUnOQuaaOU7J4ayTuG3yIZfX8Fs Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 64f851076c8e418e8247f942acb9355d Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64f851076c8e418e8247f942acb9355d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64f851076c8e418e8247f942acb9355d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_64f851076c8e418e8247f942acb9355d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/64f851076c8e418e8247f942acb9355d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 64f851076c8e418e8247f942acb9355d Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ListServersNegativeTestJSON-1626347454-project Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 9abff5207f9f49d294f0a47342e0a9c2 Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ListServersNegativeTestJSON-1626347454-project Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '198da671-4118-49da-ad40-506db4c1ce48'} Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:26.369355 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:26.373350 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:26.373350 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:26.373350 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:26.373350 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:26.373350 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:26.373350 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:26.373350 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. Oct 12 22:19:26.373350 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:26.373350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48b6a2db-0772-4cbb-8d95-df3786de3e57 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Returning 404 to user: Instance 198da671-4118-49da-ad40-506db4c1ce48 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:26.373350 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-48b6a2db-0772-4cbb-8d95-df3786de3e57 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48" status: 404 len: 111 microversion: 2.1 time: 0.099769 Oct 12 22:19:26.373350 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2640/4707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:26 2022] GET /compute/v2.1/servers/198da671-4118-49da-ad40-506db4c1ce48 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:19:26.383618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9c876519-f9e3-4ee0-976e-05911088e566 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:26.384251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9c876519-f9e3-4ee0-976e-05911088e566 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: c95fbb6a-0a59-41eb-8b29-fab44a51d53f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:26.391540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c876519-f9e3-4ee0-976e-05911088e566 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:26.392317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c876519-f9e3-4ee0-976e-05911088e566 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:26.392669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c876519-f9e3-4ee0-976e-05911088e566 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:26.393785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c876519-f9e3-4ee0-976e-05911088e566 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:26.395373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c876519-f9e3-4ee0-976e-05911088e566 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:26.395693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c876519-f9e3-4ee0-976e-05911088e566 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:26.750709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-47938a21-2997-4824-9b90-509f410aa1bb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:26.765580 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-47938a21-2997-4824-9b90-509f410aa1bb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 200 len: 1506 microversion: 2.1 time: 0.479556 Oct 12 22:19:26.786566 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2068/4708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:26 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 1506 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:26.798935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c3084e04-d7aa-4697-843a-6955e014e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:26.799897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c3084e04-d7aa-4697-843a-6955e014e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:26.808355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3084e04-d7aa-4697-843a-6955e014e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:26.809077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3084e04-d7aa-4697-843a-6955e014e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:26.809695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3084e04-d7aa-4697-843a-6955e014e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:26.811837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3084e04-d7aa-4697-843a-6955e014e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:26.812468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3084e04-d7aa-4697-843a-6955e014e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:26.813056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3084e04-d7aa-4697-843a-6955e014e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:26.841884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:26.842387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9c876519-f9e3-4ee0-976e-05911088e566 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:26.853779 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9c876519-f9e3-4ee0-976e-05911088e566 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/c95fbb6a-0a59-41eb-8b29-fab44a51d53f" status: 200 len: 1521 microversion: 2.1 time: 0.474499 Oct 12 22:19:26.857970 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2641/4709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:26 2022] GET /compute/v2.1/servers/c95fbb6a-0a59-41eb-8b29-fab44a51d53f => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:26.871712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e5adbb11-dd21-4556-9910-70b521d28e8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:26.872515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e5adbb11-dd21-4556-9910-70b521d28e8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:26.886058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5adbb11-dd21-4556-9910-70b521d28e8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:26.890103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5adbb11-dd21-4556-9910-70b521d28e8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:26.894498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5adbb11-dd21-4556-9910-70b521d28e8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:26.895737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5adbb11-dd21-4556-9910-70b521d28e8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:26.896755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5adbb11-dd21-4556-9910-70b521d28e8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:26.897379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5adbb11-dd21-4556-9910-70b521d28e8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:26.961477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e5adbb11-dd21-4556-9910-70b521d28e8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:19:27.139599 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e5adbb11-dd21-4556-9910-70b521d28e8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 204 len: 0 microversion: 2.1 time: 0.279797 Oct 12 22:19:27.141386 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2642/4710] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:19:26 2022] DELETE /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:19:27.156958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c3084e04-d7aa-4697-843a-6955e014e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:27.162250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e343b7fb-1c9e-4732-8fb3-9eae93518664 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:27.162969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e343b7fb-1c9e-4732-8fb3-9eae93518664 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:27.170920 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c3084e04-d7aa-4697-843a-6955e014e1c3 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1453 microversion: 2.1 time: 0.382877 Oct 12 22:19:27.172237 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2069/4711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:26 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1453 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:27.177497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-19e7565b-916f-4ec4-940f-0d161141899b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:27.178331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-19e7565b-916f-4ec4-940f-0d161141899b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:27.184989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19e7565b-916f-4ec4-940f-0d161141899b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:27.185697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19e7565b-916f-4ec4-940f-0d161141899b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:27.186299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19e7565b-916f-4ec4-940f-0d161141899b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:27.187338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19e7565b-916f-4ec4-940f-0d161141899b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:27.187961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19e7565b-916f-4ec4-940f-0d161141899b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:27.189456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e343b7fb-1c9e-4732-8fb3-9eae93518664 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:27.190127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e343b7fb-1c9e-4732-8fb3-9eae93518664 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:27.190474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19e7565b-916f-4ec4-940f-0d161141899b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:27.190857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e343b7fb-1c9e-4732-8fb3-9eae93518664 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:27.191973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e343b7fb-1c9e-4732-8fb3-9eae93518664 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:27.192821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e343b7fb-1c9e-4732-8fb3-9eae93518664 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:27.193285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e343b7fb-1c9e-4732-8fb3-9eae93518664 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:27.198148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:27.357100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e343b7fb-1c9e-4732-8fb3-9eae93518664 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:27.366936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e343b7fb-1c9e-4732-8fb3-9eae93518664 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:27.368555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e343b7fb-1c9e-4732-8fb3-9eae93518664 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:27.369817 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e343b7fb-1c9e-4732-8fb3-9eae93518664 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1335 microversion: 2.47 time: 0.224546 Oct 12 22:19:27.401601 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2643/4712] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:27 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1335 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:27.413278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-712f4f20-a304-4566-ac40-147ace8917b8 req-31796893-3fa3-4eb0-b7d2-5638bcb2bcb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1dff38-e8eb-433d-8e67-2f53de91034b", "name": "network-vif-deleted", "tag": "b053f354-90ab-466d-a60d-b883c1ca228d"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:27.426835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-712f4f20-a304-4566-ac40-147ace8917b8 req-31796893-3fa3-4eb0-b7d2-5638bcb2bcb8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:27.427975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-712f4f20-a304-4566-ac40-147ace8917b8 req-31796893-3fa3-4eb0-b7d2-5638bcb2bcb8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:27.429058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-712f4f20-a304-4566-ac40-147ace8917b8 req-31796893-3fa3-4eb0-b7d2-5638bcb2bcb8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:27.446010 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-712f4f20-a304-4566-ac40-147ace8917b8 req-31796893-3fa3-4eb0-b7d2-5638bcb2bcb8 service nova] Creating event network-vif-deleted:b053f354-90ab-466d-a60d-b883c1ca228d for instance 3c1dff38-e8eb-433d-8e67-2f53de91034b on n-h2-861111-1 Oct 12 22:19:27.452609 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-712f4f20-a304-4566-ac40-147ace8917b8 req-31796893-3fa3-4eb0-b7d2-5638bcb2bcb8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048676 Oct 12 22:19:27.453339 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2644/4713] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:27.459917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-684dfc32-45f2-493d-b654-eb24e1539a13 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:27.461601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-684dfc32-45f2-493d-b654-eb24e1539a13 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:27.474519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-684dfc32-45f2-493d-b654-eb24e1539a13 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:27.475258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-684dfc32-45f2-493d-b654-eb24e1539a13 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:27.475905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-684dfc32-45f2-493d-b654-eb24e1539a13 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:27.476584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-684dfc32-45f2-493d-b654-eb24e1539a13 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:27.477030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-684dfc32-45f2-493d-b654-eb24e1539a13 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:27.477709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-684dfc32-45f2-493d-b654-eb24e1539a13 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:27.574163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-19e7565b-916f-4ec4-940f-0d161141899b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:27.590038 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-19e7565b-916f-4ec4-940f-0d161141899b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 200 len: 1512 microversion: 2.1 time: 0.416382 Oct 12 22:19:27.591042 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2070/4714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:27 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 1512 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:27.612504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-009be2c3-aea7-4999-a0b2-0e34f63f8c2c req-868b73e9-8fc5-4dfc-a319-4d8185fc2c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "name": "network-vif-unplugged", "status": "completed", "tag": "880216ed-7173-47d4-946d-37845055cc79"}, {"server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "name": "network-vif-unplugged", "status": "completed", "tag": "248cb9c1-00e2-425c-b33a-9885e240c15a"}, {"server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "name": "network-vif-unplugged", "status": "completed", "tag": "52643e8f-ddae-453b-8aab-3913248201fd"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:27.624649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-009be2c3-aea7-4999-a0b2-0e34f63f8c2c req-868b73e9-8fc5-4dfc-a319-4d8185fc2c9b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:27.626011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-009be2c3-aea7-4999-a0b2-0e34f63f8c2c req-868b73e9-8fc5-4dfc-a319-4d8185fc2c9b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:27.626689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-009be2c3-aea7-4999-a0b2-0e34f63f8c2c req-868b73e9-8fc5-4dfc-a319-4d8185fc2c9b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:27.648014 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-009be2c3-aea7-4999-a0b2-0e34f63f8c2c req-868b73e9-8fc5-4dfc-a319-4d8185fc2c9b service nova] Creating event network-vif-unplugged:880216ed-7173-47d4-946d-37845055cc79 for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:19:27.648867 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-009be2c3-aea7-4999-a0b2-0e34f63f8c2c req-868b73e9-8fc5-4dfc-a319-4d8185fc2c9b service nova] Creating event network-vif-unplugged:248cb9c1-00e2-425c-b33a-9885e240c15a for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:19:27.649736 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-009be2c3-aea7-4999-a0b2-0e34f63f8c2c req-868b73e9-8fc5-4dfc-a319-4d8185fc2c9b service nova] Creating event network-vif-unplugged:52643e8f-ddae-453b-8aab-3913248201fd for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:19:27.655813 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-009be2c3-aea7-4999-a0b2-0e34f63f8c2c req-868b73e9-8fc5-4dfc-a319-4d8185fc2c9b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.048702 Oct 12 22:19:27.656733 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2071/4715] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:27.885815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c9d593ee-6632-47fb-8b56-464189dee065 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:27.886718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c9d593ee-6632-47fb-8b56-464189dee065 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: c95fbb6a-0a59-41eb-8b29-fab44a51d53f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:27.901990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9d593ee-6632-47fb-8b56-464189dee065 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:27.902749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9d593ee-6632-47fb-8b56-464189dee065 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:27.905203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9d593ee-6632-47fb-8b56-464189dee065 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:27.906116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9d593ee-6632-47fb-8b56-464189dee065 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:27.914775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9d593ee-6632-47fb-8b56-464189dee065 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:27.915731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9d593ee-6632-47fb-8b56-464189dee065 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:27.940605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-684dfc32-45f2-493d-b654-eb24e1539a13 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:27.951523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-684dfc32-45f2-493d-b654-eb24e1539a13 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:27.952991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-684dfc32-45f2-493d-b654-eb24e1539a13 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:27.955308 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-684dfc32-45f2-493d-b654-eb24e1539a13 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 2709 microversion: 2.32 time: 0.499633 Oct 12 22:19:27.959937 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2645/4716] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:27 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 2709 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:28.212371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6904aba4-4308-4faa-895e-e2b54af082f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:28.215014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6904aba4-4308-4faa-895e-e2b54af082f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:28.223904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6904aba4-4308-4faa-895e-e2b54af082f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:28.225347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6904aba4-4308-4faa-895e-e2b54af082f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:28.226325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6904aba4-4308-4faa-895e-e2b54af082f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:28.227229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6904aba4-4308-4faa-895e-e2b54af082f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:28.228537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6904aba4-4308-4faa-895e-e2b54af082f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:28.229165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6904aba4-4308-4faa-895e-e2b54af082f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:28.292799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c9d593ee-6632-47fb-8b56-464189dee065 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:28.304202 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c9d593ee-6632-47fb-8b56-464189dee065 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/c95fbb6a-0a59-41eb-8b29-fab44a51d53f" status: 200 len: 1521 microversion: 2.1 time: 0.423683 Oct 12 22:19:28.319929 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2072/4717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:27 2022] GET /compute/v2.1/servers/c95fbb6a-0a59-41eb-8b29-fab44a51d53f => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:28.406023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d13e13d3-7887-45c7-bea3-49f116840e83 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:28.410376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d13e13d3-7887-45c7-bea3-49f116840e83 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:28.428120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d13e13d3-7887-45c7-bea3-49f116840e83 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:28.432461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d13e13d3-7887-45c7-bea3-49f116840e83 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:28.432994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d13e13d3-7887-45c7-bea3-49f116840e83 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:28.433830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d13e13d3-7887-45c7-bea3-49f116840e83 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:28.436896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d13e13d3-7887-45c7-bea3-49f116840e83 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:28.438269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d13e13d3-7887-45c7-bea3-49f116840e83 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:28.454932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6904aba4-4308-4faa-895e-e2b54af082f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:28.470658 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6904aba4-4308-4faa-895e-e2b54af082f6 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 200 len: 1287 microversion: 2.1 time: 0.277522 Oct 12 22:19:28.472114 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2646/4718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:28 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 1287 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:28.519178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f190fe67-72ca-4615-8811-f774897bdbe7 req-0445d63b-5229-4b97-b5da-612148dc83f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "name": "network-vif-deleted", "tag": "880216ed-7173-47d4-946d-37845055cc79"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:28.534144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f190fe67-72ca-4615-8811-f774897bdbe7 req-0445d63b-5229-4b97-b5da-612148dc83f1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:28.535446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f190fe67-72ca-4615-8811-f774897bdbe7 req-0445d63b-5229-4b97-b5da-612148dc83f1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:28.536156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f190fe67-72ca-4615-8811-f774897bdbe7 req-0445d63b-5229-4b97-b5da-612148dc83f1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:28.554191 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f190fe67-72ca-4615-8811-f774897bdbe7 req-0445d63b-5229-4b97-b5da-612148dc83f1 service nova] Creating event network-vif-deleted:880216ed-7173-47d4-946d-37845055cc79 for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:19:28.560829 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f190fe67-72ca-4615-8811-f774897bdbe7 req-0445d63b-5229-4b97-b5da-612148dc83f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080284 Oct 12 22:19:28.562009 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2647/4719] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:28.590118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d13e13d3-7887-45c7-bea3-49f116840e83 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:28.604340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d13e13d3-7887-45c7-bea3-49f116840e83 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:28.606469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d13e13d3-7887-45c7-bea3-49f116840e83 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:28.608639 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d13e13d3-7887-45c7-bea3-49f116840e83 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1335 microversion: 2.47 time: 0.209360 Oct 12 22:19:28.617763 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2073/4720] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:28 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1335 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:28.631149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-902d2460-2cc1-48d2-b162-77a610d527aa tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:28.632450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-902d2460-2cc1-48d2-b162-77a610d527aa tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:28.641931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-902d2460-2cc1-48d2-b162-77a610d527aa tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:28.642844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-902d2460-2cc1-48d2-b162-77a610d527aa tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:28.643498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-902d2460-2cc1-48d2-b162-77a610d527aa tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:28.644255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-902d2460-2cc1-48d2-b162-77a610d527aa tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:28.644709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-902d2460-2cc1-48d2-b162-77a610d527aa tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:28.645135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-902d2460-2cc1-48d2-b162-77a610d527aa tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:28.987063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4639d000-b446-44b4-ab26-e1bf5756bced tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:28.988611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4639d000-b446-44b4-ab26-e1bf5756bced tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:28.999705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4639d000-b446-44b4-ab26-e1bf5756bced tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:29.012083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4639d000-b446-44b4-ab26-e1bf5756bced tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:29.015926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4639d000-b446-44b4-ab26-e1bf5756bced tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:29.016814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4639d000-b446-44b4-ab26-e1bf5756bced tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:29.017402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4639d000-b446-44b4-ab26-e1bf5756bced tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:29.018069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4639d000-b446-44b4-ab26-e1bf5756bced tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:29.453443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-902d2460-2cc1-48d2-b162-77a610d527aa tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:29.467525 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-902d2460-2cc1-48d2-b162-77a610d527aa tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 200 len: 1512 microversion: 2.1 time: 0.847051 Oct 12 22:19:29.480098 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2648/4721] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:28 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 1512 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:29.489388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e1b2ad2-e630-4df5-943e-9b832af552dd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:29.490244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9e1b2ad2-e630-4df5-943e-9b832af552dd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: c95fbb6a-0a59-41eb-8b29-fab44a51d53f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:29.499481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e1b2ad2-e630-4df5-943e-9b832af552dd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:29.500639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e1b2ad2-e630-4df5-943e-9b832af552dd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:29.501653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e1b2ad2-e630-4df5-943e-9b832af552dd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:29.502369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e1b2ad2-e630-4df5-943e-9b832af552dd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:29.502977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e1b2ad2-e630-4df5-943e-9b832af552dd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:29.504191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e1b2ad2-e630-4df5-943e-9b832af552dd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:29.729035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4639d000-b446-44b4-ab26-e1bf5756bced tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:29.743677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4639d000-b446-44b4-ab26-e1bf5756bced tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:29.745744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4639d000-b446-44b4-ab26-e1bf5756bced tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:29.755999 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4639d000-b446-44b4-ab26-e1bf5756bced tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 2421 microversion: 2.32 time: 0.772934 Oct 12 22:19:29.783392 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2074/4722] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:28 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 2421 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:19:29.790357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4f1af27f-a80a-4506-9d56-916182e90353 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:29.795144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4f1af27f-a80a-4506-9d56-916182e90353 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 3c1dff38-e8eb-433d-8e67-2f53de91034b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:29.803042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f1af27f-a80a-4506-9d56-916182e90353 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:29.803810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f1af27f-a80a-4506-9d56-916182e90353 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:29.804929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f1af27f-a80a-4506-9d56-916182e90353 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:29.805873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f1af27f-a80a-4506-9d56-916182e90353 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:29.806563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f1af27f-a80a-4506-9d56-916182e90353 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:29.807214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f1af27f-a80a-4506-9d56-916182e90353 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:29.834522 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-4f1af27f-a80a-4506-9d56-916182e90353 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] HTTP exception thrown: Instance 3c1dff38-e8eb-433d-8e67-2f53de91034b could not be found. Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4f1af27f-a80a-4506-9d56-916182e90353 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Request method failure captured: Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b HTTP/1.1 Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzriWjH9XGk2m6XxAkFWCa5SU4u3aYbKjccJUM74Gs6m2ZTWTRgYJo3xNK7Dl1yHzUOL0UlgCpklDDkzfGl4zIrs1ucJJAHjnDilUmOFjpe-CEtT-kGaW-5sHatvR75wN517xqlZ9fiNsyKxLaujP5hWxgbqYLVY-SfHQMzPuASo904 Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 319a8f107945457a8a8f8e9690a697e5 Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319a8f107945457a8a8f8e9690a697e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 319a8f107945457a8a8f8e9690a697e5 Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerActionsTestJSON-1007032333-project Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: b29c500796d54d6188ff65056340d35f Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerActionsTestJSON-1007032333-project Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 3c1dff38-e8eb-433d-8e67-2f53de91034b could not be found. Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '3c1dff38-e8eb-433d-8e67-2f53de91034b'} Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c1dff38-e8eb-433d-8e67-2f53de91034b could not be found. Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c1dff38-e8eb-433d-8e67-2f53de91034b could not be found. Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:29.838504 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:29.842644 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:29.842644 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:29.842644 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:29.842644 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:29.842644 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:29.842644 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c1dff38-e8eb-433d-8e67-2f53de91034b could not be found. Oct 12 22:19:29.842644 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:29.842644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4f1af27f-a80a-4506-9d56-916182e90353 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Returning 404 to user: Instance 3c1dff38-e8eb-433d-8e67-2f53de91034b could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:29.842644 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4f1af27f-a80a-4506-9d56-916182e90353 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b" status: 404 len: 111 microversion: 2.1 time: 0.055205 Oct 12 22:19:29.843641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9e1b2ad2-e630-4df5-943e-9b832af552dd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:29.854137 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9e1b2ad2-e630-4df5-943e-9b832af552dd tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/c95fbb6a-0a59-41eb-8b29-fab44a51d53f" status: 200 len: 1521 microversion: 2.1 time: 0.372699 Oct 12 22:19:29.855935 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2075/4723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:29 2022] GET /compute/v2.1/servers/3c1dff38-e8eb-433d-8e67-2f53de91034b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:19:29.856718 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2649/4724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:29 2022] GET /compute/v2.1/servers/c95fbb6a-0a59-41eb-8b29-fab44a51d53f => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:29.863144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-24413193-5ed5-4c14-9ba6-a5f6070cf717 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:29.863386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8a471f10-dbd1-4418-8794-2fd7a880175d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:29.863803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-24413193-5ed5-4c14-9ba6-a5f6070cf717 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:29.870885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8a471f10-dbd1-4418-8794-2fd7a880175d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:29.874391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24413193-5ed5-4c14-9ba6-a5f6070cf717 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:29.875360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24413193-5ed5-4c14-9ba6-a5f6070cf717 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:29.882919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a471f10-dbd1-4418-8794-2fd7a880175d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:29.883486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a471f10-dbd1-4418-8794-2fd7a880175d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:29.883934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a471f10-dbd1-4418-8794-2fd7a880175d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:29.884653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a471f10-dbd1-4418-8794-2fd7a880175d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:29.885124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a471f10-dbd1-4418-8794-2fd7a880175d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:29.885801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a471f10-dbd1-4418-8794-2fd7a880175d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:29.887938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24413193-5ed5-4c14-9ba6-a5f6070cf717 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:29.889115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24413193-5ed5-4c14-9ba6-a5f6070cf717 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:29.889708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24413193-5ed5-4c14-9ba6-a5f6070cf717 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:29.891726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24413193-5ed5-4c14-9ba6-a5f6070cf717 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:29.934787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8a471f10-dbd1-4418-8794-2fd7a880175d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:19:30.060968 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8a471f10-dbd1-4418-8794-2fd7a880175d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 204 len: 0 microversion: 2.1 time: 0.202341 Oct 12 22:19:30.062048 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2650/4725] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:19:29 2022] DELETE /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:19:30.076130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-24d8e523-928a-4348-9c44-4ea4605ce364 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:30.077548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-24d8e523-928a-4348-9c44-4ea4605ce364 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:30.103156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24d8e523-928a-4348-9c44-4ea4605ce364 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:30.104038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24d8e523-928a-4348-9c44-4ea4605ce364 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:30.104506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24d8e523-928a-4348-9c44-4ea4605ce364 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:30.105257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24d8e523-928a-4348-9c44-4ea4605ce364 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:30.105718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24d8e523-928a-4348-9c44-4ea4605ce364 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:30.108324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24d8e523-928a-4348-9c44-4ea4605ce364 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:30.294072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-24413193-5ed5-4c14-9ba6-a5f6070cf717 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:30.312386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-24413193-5ed5-4c14-9ba6-a5f6070cf717 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:30.313851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-24413193-5ed5-4c14-9ba6-a5f6070cf717 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:30.315265 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-24413193-5ed5-4c14-9ba6-a5f6070cf717 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1356 microversion: 2.47 time: 0.458281 Oct 12 22:19:30.317030 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2076/4726] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:29 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1356 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:30.351558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:30.355660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:30.386858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:30.388462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:30.390035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:30.394752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:30.396062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:30.396865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:30.488605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-24d8e523-928a-4348-9c44-4ea4605ce364 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:30.497452 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-24d8e523-928a-4348-9c44-4ea4605ce364 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1676 microversion: 2.1 time: 0.431120 Oct 12 22:19:30.502522 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2651/4727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:30 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1676 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:30.594743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:19:30.594980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:19:30.599869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:19:30.600475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:19:30.601071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:19:30.642554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1500293426", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:30.744555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:30.761079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] validate_networks() for [('49f84747-5e93-4ad6-a379-e2b377cb642c', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:19:30.815377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:30.816143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:30.818132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:30.821736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:30.822503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:30.823517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:30.889369 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3164eca4-32e1-4831-8259-aae8aeb8eb28 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "POST /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d/action" status: 202 len: 1078 microversion: 2.47 time: 0.542248 Oct 12 22:19:30.890772 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2077/4728] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 12 22:19:30 2022] POST /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d/action => generated 1078 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 12 22:19:30.898077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-508670b0-6a11-494b-a96e-11dce1aca915 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:30.898896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-508670b0-6a11-494b-a96e-11dce1aca915 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:30.906012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-508670b0-6a11-494b-a96e-11dce1aca915 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:30.907029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-508670b0-6a11-494b-a96e-11dce1aca915 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:30.908069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-508670b0-6a11-494b-a96e-11dce1aca915 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:30.910527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-508670b0-6a11-494b-a96e-11dce1aca915 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:30.911481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-508670b0-6a11-494b-a96e-11dce1aca915 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:30.912187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-508670b0-6a11-494b-a96e-11dce1aca915 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:31.649857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:31.705141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-508670b0-6a11-494b-a96e-11dce1aca915 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:31.714281 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-508670b0-6a11-494b-a96e-11dce1aca915 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 200 len: 1512 microversion: 2.1 time: 0.821705 Oct 12 22:19:31.721140 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2078/4729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:30 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 1512 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:31.736930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-70d301dc-f39b-4189-8015-95058f96d6e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:31.741976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-70d301dc-f39b-4189-8015-95058f96d6e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:31.774566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70d301dc-f39b-4189-8015-95058f96d6e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:31.775062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70d301dc-f39b-4189-8015-95058f96d6e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:31.775488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70d301dc-f39b-4189-8015-95058f96d6e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:31.776265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70d301dc-f39b-4189-8015-95058f96d6e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:31.779552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70d301dc-f39b-4189-8015-95058f96d6e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:31.780389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70d301dc-f39b-4189-8015-95058f96d6e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:32.265036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-70d301dc-f39b-4189-8015-95058f96d6e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:32.275437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-70d301dc-f39b-4189-8015-95058f96d6e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:32.277121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-70d301dc-f39b-4189-8015-95058f96d6e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:32.278538 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-70d301dc-f39b-4189-8015-95058f96d6e6 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 2327 microversion: 2.32 time: 0.554338 Oct 12 22:19:32.279595 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2079/4730] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:31 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 2327 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:32.284319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-295c4945-41df-4350-b9f2-7b00fc6d9d84 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:32.285160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-295c4945-41df-4350-b9f2-7b00fc6d9d84 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: c95fbb6a-0a59-41eb-8b29-fab44a51d53f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:32.291172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-295c4945-41df-4350-b9f2-7b00fc6d9d84 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:32.291874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-295c4945-41df-4350-b9f2-7b00fc6d9d84 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:32.292540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-295c4945-41df-4350-b9f2-7b00fc6d9d84 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:32.293669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-295c4945-41df-4350-b9f2-7b00fc6d9d84 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:32.294363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-295c4945-41df-4350-b9f2-7b00fc6d9d84 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:32.294993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-295c4945-41df-4350-b9f2-7b00fc6d9d84 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:32.350050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-295c4945-41df-4350-b9f2-7b00fc6d9d84 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:32.350865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-295c4945-41df-4350-b9f2-7b00fc6d9d84 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:32.351677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-295c4945-41df-4350-b9f2-7b00fc6d9d84 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:32.352337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-295c4945-41df-4350-b9f2-7b00fc6d9d84 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lazy-loading 'fault' on Instance uuid c95fbb6a-0a59-41eb-8b29-fab44a51d53f {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:19:32.538695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-295c4945-41df-4350-b9f2-7b00fc6d9d84 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abff5207f9f49d294f0a47342e0a9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f851076c8e418e8247f942acb9355d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:32.551069 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-295c4945-41df-4350-b9f2-7b00fc6d9d84 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/c95fbb6a-0a59-41eb-8b29-fab44a51d53f" status: 200 len: 1312 microversion: 2.1 time: 0.269738 Oct 12 22:19:32.560990 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2080/4731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:32 2022] GET /compute/v2.1/servers/c95fbb6a-0a59-41eb-8b29-fab44a51d53f => generated 1312 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:32.566414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fcbada78-3774-4cc0-b69b-367473d0e66d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:32.567024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fcbada78-3774-4cc0-b69b-367473d0e66d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:32.586832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcbada78-3774-4cc0-b69b-367473d0e66d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:32.587630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcbada78-3774-4cc0-b69b-367473d0e66d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:32.588076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcbada78-3774-4cc0-b69b-367473d0e66d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:32.588784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcbada78-3774-4cc0-b69b-367473d0e66d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:32.589237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcbada78-3774-4cc0-b69b-367473d0e66d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:32.589659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcbada78-3774-4cc0-b69b-367473d0e66d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:32.656501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:19:32.657841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:19:32.659060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:19:32.660691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:19:32.662106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:19:32.700050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:32.703022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:32.703504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:32.706850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:32.707670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:32.711604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:32.718881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fcbada78-3774-4cc0-b69b-367473d0e66d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:32.743875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fcbada78-3774-4cc0-b69b-367473d0e66d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:32.761168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fcbada78-3774-4cc0-b69b-367473d0e66d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:32.766195 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fcbada78-3774-4cc0-b69b-367473d0e66d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1365 microversion: 2.47 time: 0.203843 Oct 12 22:19:32.771011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Getting quotas for project 0a0c4d9f435a4c009bd0b5eb2618829b. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:19:32.775641 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2081/4732] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:32 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:32.779189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Getting quotas for user afec4a3808b84463900b744ecd9352b6 and project 0a0c4d9f435a4c009bd0b5eb2618829b. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:19:32.785796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-79d2064e-1b29-4d2b-b2a0-5cf1ace8ea0c req-7af89978-5871-4f9a-b27a-930eab6ce565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "name": "network-vif-deleted", "tag": "36ee1470-0e2f-4c4f-8e19-2e2a700d74d0"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:32.801888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:19:32.807609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-79d2064e-1b29-4d2b-b2a0-5cf1ace8ea0c req-7af89978-5871-4f9a-b27a-930eab6ce565 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:32.808309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-79d2064e-1b29-4d2b-b2a0-5cf1ace8ea0c req-7af89978-5871-4f9a-b27a-930eab6ce565 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:32.808503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:19:32.810489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-79d2064e-1b29-4d2b-b2a0-5cf1ace8ea0c req-7af89978-5871-4f9a-b27a-930eab6ce565 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:32.837030 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-79d2064e-1b29-4d2b-b2a0-5cf1ace8ea0c req-7af89978-5871-4f9a-b27a-930eab6ce565 service nova] Creating event network-vif-deleted:36ee1470-0e2f-4c4f-8e19-2e2a700d74d0 for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:19:32.843770 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-79d2064e-1b29-4d2b-b2a0-5cf1ace8ea0c req-7af89978-5871-4f9a-b27a-930eab6ce565 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066320 Oct 12 22:19:32.845606 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2082/4733] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:32.854632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-e2db3c80-d9bc-4d57-97f6-c6ae0b1760c0 req-ddc6bd6c-d3cb-413f-91a7-d7cda1ccfe0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c95fbb6a-0a59-41eb-8b29-fab44a51d53f", "name": "network-vif-deleted", "tag": "c65dbf77-2cd0-431f-8e52-bd6287b6e637"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:32.865095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e2db3c80-d9bc-4d57-97f6-c6ae0b1760c0 req-ddc6bd6c-d3cb-413f-91a7-d7cda1ccfe0c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:32.865887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e2db3c80-d9bc-4d57-97f6-c6ae0b1760c0 req-ddc6bd6c-d3cb-413f-91a7-d7cda1ccfe0c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:32.866674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e2db3c80-d9bc-4d57-97f6-c6ae0b1760c0 req-ddc6bd6c-d3cb-413f-91a7-d7cda1ccfe0c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:32.885256 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-e2db3c80-d9bc-4d57-97f6-c6ae0b1760c0 req-ddc6bd6c-d3cb-413f-91a7-d7cda1ccfe0c service nova] Creating event network-vif-deleted:c65dbf77-2cd0-431f-8e52-bd6287b6e637 for instance c95fbb6a-0a59-41eb-8b29-fab44a51d53f on n-h2-861111-1 Oct 12 22:19:32.890988 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-e2db3c80-d9bc-4d57-97f6-c6ae0b1760c0 req-ddc6bd6c-d3cb-413f-91a7-d7cda1ccfe0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043016 Oct 12 22:19:32.892045 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2083/4734] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:32.898200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0694a7c2-2e28-4ffd-a3b9-0b0c73b1898d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:32.899033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0694a7c2-2e28-4ffd-a3b9-0b0c73b1898d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:32.906958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0694a7c2-2e28-4ffd-a3b9-0b0c73b1898d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:32.907556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0694a7c2-2e28-4ffd-a3b9-0b0c73b1898d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:32.908191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0694a7c2-2e28-4ffd-a3b9-0b0c73b1898d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:32.909067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0694a7c2-2e28-4ffd-a3b9-0b0c73b1898d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:32.915375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0694a7c2-2e28-4ffd-a3b9-0b0c73b1898d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:32.916010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0694a7c2-2e28-4ffd-a3b9-0b0c73b1898d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:32.948830 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1acfcd2a-5a03-4c66-8870-475751b6e3e6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.445013 Oct 12 22:19:32.958128 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2652/4735] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:19:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 2455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:19:32.965920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7e5af65c-8516-41a6-a5b7-a6c20de0cd8a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:32.966777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7e5af65c-8516-41a6-a5b7-a6c20de0cd8a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:32.978301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e5af65c-8516-41a6-a5b7-a6c20de0cd8a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:32.979033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e5af65c-8516-41a6-a5b7-a6c20de0cd8a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:32.979729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e5af65c-8516-41a6-a5b7-a6c20de0cd8a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:32.980969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e5af65c-8516-41a6-a5b7-a6c20de0cd8a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:32.981599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e5af65c-8516-41a6-a5b7-a6c20de0cd8a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:32.982189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e5af65c-8516-41a6-a5b7-a6c20de0cd8a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:33.061469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e5af65c-8516-41a6-a5b7-a6c20de0cd8a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:33.062011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e5af65c-8516-41a6-a5b7-a6c20de0cd8a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:33.062703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e5af65c-8516-41a6-a5b7-a6c20de0cd8a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:33.065294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-7e5af65c-8516-41a6-a5b7-a6c20de0cd8a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lazy-loading 'fault' on Instance uuid 1cd026e6-7533-4efb-88f5-1573116d8f08 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:19:33.161892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7e5af65c-8516-41a6-a5b7-a6c20de0cd8a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:33.171870 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7e5af65c-8516-41a6-a5b7-a6c20de0cd8a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 200 len: 1307 microversion: 2.1 time: 0.211614 Oct 12 22:19:33.173124 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2653/4736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:32 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 1307 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:33.178467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-64251ef1-41b9-4b21-9653-5625b1812c0b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:33.179218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-64251ef1-41b9-4b21-9653-5625b1812c0b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:33.250044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-64251ef1-41b9-4b21-9653-5625b1812c0b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:33.259284 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-64251ef1-41b9-4b21-9653-5625b1812c0b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1222 microversion: 2.1 time: 0.083910 Oct 12 22:19:33.272539 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2654/4737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:33 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:33.310832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-82ae4c3a-b64a-4b41-99d8-6d18e48fdebf tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:33.311889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-82ae4c3a-b64a-4b41-99d8-6d18e48fdebf tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:33.333046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82ae4c3a-b64a-4b41-99d8-6d18e48fdebf tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:33.333506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82ae4c3a-b64a-4b41-99d8-6d18e48fdebf tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:33.335435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82ae4c3a-b64a-4b41-99d8-6d18e48fdebf tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:33.339716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82ae4c3a-b64a-4b41-99d8-6d18e48fdebf tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:33.340220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82ae4c3a-b64a-4b41-99d8-6d18e48fdebf tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:33.340960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82ae4c3a-b64a-4b41-99d8-6d18e48fdebf tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:33.466327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=12 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:33.529386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-82ae4c3a-b64a-4b41-99d8-6d18e48fdebf tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:33.540617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=16 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:33.547923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-82ae4c3a-b64a-4b41-99d8-6d18e48fdebf tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:33.554226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-82ae4c3a-b64a-4b41-99d8-6d18e48fdebf tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:33.556528 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-82ae4c3a-b64a-4b41-99d8-6d18e48fdebf tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1605 microversion: 2.32 time: 0.249949 Oct 12 22:19:33.560059 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2655/4738] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:33 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1605 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:33.573515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-460011685", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:33.651792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0694a7c2-2e28-4ffd-a3b9-0b0c73b1898d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:33.663228 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0694a7c2-2e28-4ffd-a3b9-0b0c73b1898d tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1676 microversion: 2.1 time: 0.769836 Oct 12 22:19:33.674062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] validate_networks() for [('49f84747-5e93-4ad6-a379-e2b377cb642c', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:19:33.695693 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2084/4739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:32 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1676 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:33.719068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1f21bd4d-3772-4a64-8a24-052b756ee73d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:33.721570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1f21bd4d-3772-4a64-8a24-052b756ee73d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: c95fbb6a-0a59-41eb-8b29-fab44a51d53f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:33.734935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f21bd4d-3772-4a64-8a24-052b756ee73d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:33.736701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f21bd4d-3772-4a64-8a24-052b756ee73d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:33.737166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f21bd4d-3772-4a64-8a24-052b756ee73d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:33.738433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f21bd4d-3772-4a64-8a24-052b756ee73d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:33.738897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f21bd4d-3772-4a64-8a24-052b756ee73d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:33.739355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1f21bd4d-3772-4a64-8a24-052b756ee73d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:33.789086 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-1f21bd4d-3772-4a64-8a24-052b756ee73d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] HTTP exception thrown: Instance c95fbb6a-0a59-41eb-8b29-fab44a51d53f could not be found. Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1f21bd4d-3772-4a64-8a24-052b756ee73d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Request method failure captured: Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/c95fbb6a-0a59-41eb-8b29-fab44a51d53f HTTP/1.1 Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz1DRhJTIn6t8VuVJ6IdaFF7sHtf1tvLIRzVhFL9gB42p-x7PAKwE-n0mz-dRUvZbqBw8q8KlB1oECioxlfFeXhjfBUBJjYc7v_-2tUwVwDwu-6rMgOsGK7UxOmbaWvAjjOFppIwKHVnkS8zXa97mUnOQuaaOU7J4ayTuG3yIZfX8Fs Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 64f851076c8e418e8247f942acb9355d Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64f851076c8e418e8247f942acb9355d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64f851076c8e418e8247f942acb9355d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_64f851076c8e418e8247f942acb9355d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/64f851076c8e418e8247f942acb9355d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 64f851076c8e418e8247f942acb9355d Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ListServersNegativeTestJSON-1626347454-project Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 9abff5207f9f49d294f0a47342e0a9c2 Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ListServersNegativeTestJSON-1626347454-project Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance c95fbb6a-0a59-41eb-8b29-fab44a51d53f could not be found. Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'c95fbb6a-0a59-41eb-8b29-fab44a51d53f'} Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c95fbb6a-0a59-41eb-8b29-fab44a51d53f could not be found. Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c95fbb6a-0a59-41eb-8b29-fab44a51d53f could not be found. Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:33.799088 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:33.805110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:33.805110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:33.805110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:33.805110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:33.805110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:33.805110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:33.805110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c95fbb6a-0a59-41eb-8b29-fab44a51d53f could not be found. Oct 12 22:19:33.805110 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:33.805110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1f21bd4d-3772-4a64-8a24-052b756ee73d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Returning 404 to user: Instance c95fbb6a-0a59-41eb-8b29-fab44a51d53f could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:33.805110 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1f21bd4d-3772-4a64-8a24-052b756ee73d tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/c95fbb6a-0a59-41eb-8b29-fab44a51d53f" status: 404 len: 111 microversion: 2.1 time: 0.106146 Oct 12 22:19:33.807319 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2085/4740] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:33 2022] GET /compute/v2.1/servers/c95fbb6a-0a59-41eb-8b29-fab44a51d53f => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:19:33.818660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7aa2d446-1400-4492-b948-903e19bb7570 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:33.819157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7aa2d446-1400-4492-b948-903e19bb7570 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:33.830310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7aa2d446-1400-4492-b948-903e19bb7570 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:33.835298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7aa2d446-1400-4492-b948-903e19bb7570 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:33.836380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7aa2d446-1400-4492-b948-903e19bb7570 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:33.838292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7aa2d446-1400-4492-b948-903e19bb7570 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:33.839210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7aa2d446-1400-4492-b948-903e19bb7570 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:33.839935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7aa2d446-1400-4492-b948-903e19bb7570 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:34.004308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7aa2d446-1400-4492-b948-903e19bb7570 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:34.016360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7aa2d446-1400-4492-b948-903e19bb7570 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:34.021710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7aa2d446-1400-4492-b948-903e19bb7570 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:34.021710 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7aa2d446-1400-4492-b948-903e19bb7570 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1365 microversion: 2.47 time: 0.212488 Oct 12 22:19:34.046107 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2086/4741] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:33 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:34.053530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-44cf6704-da84-4c69-b605-6d3c9f497660 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:34.056876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-44cf6704-da84-4c69-b605-6d3c9f497660 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] [instance: 03c64ea4-1e95-44f2-a14c-f4edf4be2468] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:34.070440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44cf6704-da84-4c69-b605-6d3c9f497660 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:34.073726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44cf6704-da84-4c69-b605-6d3c9f497660 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:34.074417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44cf6704-da84-4c69-b605-6d3c9f497660 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:34.075953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44cf6704-da84-4c69-b605-6d3c9f497660 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:34.077675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44cf6704-da84-4c69-b605-6d3c9f497660 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:34.079366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44cf6704-da84-4c69-b605-6d3c9f497660 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:34.113241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:34.115545 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-44cf6704-da84-4c69-b605-6d3c9f497660 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] HTTP exception thrown: Instance 03c64ea4-1e95-44f2-a14c-f4edf4be2468 could not be found. Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-44cf6704-da84-4c69-b605-6d3c9f497660 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Request method failure captured: Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 HTTP/1.1 Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz1DRhJTIn6t8VuVJ6IdaFF7sHtf1tvLIRzVhFL9gB42p-x7PAKwE-n0mz-dRUvZbqBw8q8KlB1oECioxlfFeXhjfBUBJjYc7v_-2tUwVwDwu-6rMgOsGK7UxOmbaWvAjjOFppIwKHVnkS8zXa97mUnOQuaaOU7J4ayTuG3yIZfX8Fs Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 64f851076c8e418e8247f942acb9355d Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64f851076c8e418e8247f942acb9355d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64f851076c8e418e8247f942acb9355d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_64f851076c8e418e8247f942acb9355d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/64f851076c8e418e8247f942acb9355d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 64f851076c8e418e8247f942acb9355d Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1626347454 Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ListServersNegativeTestJSON-1626347454-project Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 9abff5207f9f49d294f0a47342e0a9c2 Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ListServersNegativeTestJSON-1626347454-project Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 03c64ea4-1e95-44f2-a14c-f4edf4be2468 could not be found. Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '03c64ea4-1e95-44f2-a14c-f4edf4be2468'} Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c64ea4-1e95-44f2-a14c-f4edf4be2468 could not be found. Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c64ea4-1e95-44f2-a14c-f4edf4be2468 could not be found. Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:34.120749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:34.125746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:34.125746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:34.125746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:34.125746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:34.125746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:34.125746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:34.125746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c64ea4-1e95-44f2-a14c-f4edf4be2468 could not be found. Oct 12 22:19:34.125746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:34.126317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-44cf6704-da84-4c69-b605-6d3c9f497660 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] Returning 404 to user: Instance 03c64ea4-1e95-44f2-a14c-f4edf4be2468 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:34.129884 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-44cf6704-da84-4c69-b605-6d3c9f497660 tempest-ListServersNegativeTestJSON-1626347454 tempest-ListServersNegativeTestJSON-1626347454-project] 10.222.0.16 "GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468" status: 404 len: 111 microversion: 2.1 time: 0.082545 Oct 12 22:19:34.134200 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2087/4742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:34 2022] GET /compute/v2.1/servers/03c64ea4-1e95-44f2-a14c-f4edf4be2468 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:19:34.194429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ce874561-610a-4eab-8dbb-e1a6de7a577d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:34.194748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ce874561-610a-4eab-8dbb-e1a6de7a577d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:34.204100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce874561-610a-4eab-8dbb-e1a6de7a577d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:34.211353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce874561-610a-4eab-8dbb-e1a6de7a577d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:34.212247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce874561-610a-4eab-8dbb-e1a6de7a577d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:34.213560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce874561-610a-4eab-8dbb-e1a6de7a577d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:34.215081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce874561-610a-4eab-8dbb-e1a6de7a577d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:34.215804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce874561-610a-4eab-8dbb-e1a6de7a577d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:34.302236 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-ce874561-610a-4eab-8dbb-e1a6de7a577d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ce874561-610a-4eab-8dbb-e1a6de7a577d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 HTTP/1.1 Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '1cd026e6-7533-4efb-88f5-1573116d8f08'} Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:34.304503 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:34.309375 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:34.309375 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:34.309375 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:34.309375 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:34.309375 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:34.309375 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:19:34.309375 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:34.312922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ce874561-610a-4eab-8dbb-e1a6de7a577d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:34.313992 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ce874561-610a-4eab-8dbb-e1a6de7a577d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 404 len: 111 microversion: 2.1 time: 0.123902 Oct 12 22:19:34.315159 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2088/4743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:34 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:19:34.327112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-20b0ff10-b27e-4824-b5eb-fbc7a0c49ec0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:34.328585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-20b0ff10-b27e-4824-b5eb-fbc7a0c49ec0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:34.344291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20b0ff10-b27e-4824-b5eb-fbc7a0c49ec0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:34.347778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20b0ff10-b27e-4824-b5eb-fbc7a0c49ec0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:34.350210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20b0ff10-b27e-4824-b5eb-fbc7a0c49ec0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:34.354535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20b0ff10-b27e-4824-b5eb-fbc7a0c49ec0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:34.356208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20b0ff10-b27e-4824-b5eb-fbc7a0c49ec0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:34.358039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20b0ff10-b27e-4824-b5eb-fbc7a0c49ec0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:34.483756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:19:34.484311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:19:34.484868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:19:34.485382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:19:34.485858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:19:34.508829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:34.510684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:34.511424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:34.513997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:34.516815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:34.518707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:34.578106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Getting quotas for project 0a0c4d9f435a4c009bd0b5eb2618829b. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:19:34.591974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Getting quotas for user afec4a3808b84463900b744ecd9352b6 and project 0a0c4d9f435a4c009bd0b5eb2618829b. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:19:34.621258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:19:34.626465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:19:34.696634 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d512f3f6-db13-4fed-9820-8b2d5577cde9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.135242 Oct 12 22:19:34.698542 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2656/4744] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:19:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:19:34.719223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eb769954-f5db-4c06-87dc-dc31d96e2e0f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:34.720099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eb769954-f5db-4c06-87dc-dc31d96e2e0f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:34.730454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb769954-f5db-4c06-87dc-dc31d96e2e0f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:34.730953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb769954-f5db-4c06-87dc-dc31d96e2e0f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:34.731433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb769954-f5db-4c06-87dc-dc31d96e2e0f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:34.732214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb769954-f5db-4c06-87dc-dc31d96e2e0f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:34.732673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb769954-f5db-4c06-87dc-dc31d96e2e0f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:34.733112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb769954-f5db-4c06-87dc-dc31d96e2e0f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:34.902314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eb769954-f5db-4c06-87dc-dc31d96e2e0f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:34.918801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eb769954-f5db-4c06-87dc-dc31d96e2e0f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:34.924670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eb769954-f5db-4c06-87dc-dc31d96e2e0f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:34.928138 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eb769954-f5db-4c06-87dc-dc31d96e2e0f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1605 microversion: 2.32 time: 0.226807 Oct 12 22:19:34.949827 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2657/4745] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:34 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1605 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:34.957634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-965a00e1-92df-4d5b-91cb-08be6b7af7a0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:34.958956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-965a00e1-92df-4d5b-91cb-08be6b7af7a0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:34.966505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-965a00e1-92df-4d5b-91cb-08be6b7af7a0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:34.966999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-965a00e1-92df-4d5b-91cb-08be6b7af7a0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:34.967544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-965a00e1-92df-4d5b-91cb-08be6b7af7a0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:34.968765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-965a00e1-92df-4d5b-91cb-08be6b7af7a0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:34.969366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-965a00e1-92df-4d5b-91cb-08be6b7af7a0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:34.969943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-965a00e1-92df-4d5b-91cb-08be6b7af7a0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:35.139423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-965a00e1-92df-4d5b-91cb-08be6b7af7a0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:35.151998 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-965a00e1-92df-4d5b-91cb-08be6b7af7a0 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1608 microversion: 2.1 time: 0.198691 Oct 12 22:19:35.170286 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2658/4746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:34 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1608 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:35.181963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f2f191a3-b072-4f86-8485-1c48deb98c38 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:35.182605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f2f191a3-b072-4f86-8485-1c48deb98c38 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:35.203628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-20b0ff10-b27e-4824-b5eb-fbc7a0c49ec0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:35.214009 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-20b0ff10-b27e-4824-b5eb-fbc7a0c49ec0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.893343 Oct 12 22:19:35.214409 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2089/4747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:34 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:35.260520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-96cd3723-9cba-4d97-bff4-b9ad3b5f5799 req-018486c1-5bf4-4670-9686-bf880cb6b6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "name": "network-vif-deleted", "tag": "248cb9c1-00e2-425c-b33a-9885e240c15a"}, {"server_uuid": "76adeecb-a1c3-4d3b-8643-47bcb8c759e0", "name": "network-vif-deleted", "tag": "52643e8f-ddae-453b-8aab-3913248201fd"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:35.300758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-96cd3723-9cba-4d97-bff4-b9ad3b5f5799 req-018486c1-5bf4-4670-9686-bf880cb6b6e4 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:35.301700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-96cd3723-9cba-4d97-bff4-b9ad3b5f5799 req-018486c1-5bf4-4670-9686-bf880cb6b6e4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:35.302158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-96cd3723-9cba-4d97-bff4-b9ad3b5f5799 req-018486c1-5bf4-4670-9686-bf880cb6b6e4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:35.347659 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-96cd3723-9cba-4d97-bff4-b9ad3b5f5799 req-018486c1-5bf4-4670-9686-bf880cb6b6e4 service nova] Creating event network-vif-deleted:248cb9c1-00e2-425c-b33a-9885e240c15a for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:19:35.349153 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-96cd3723-9cba-4d97-bff4-b9ad3b5f5799 req-018486c1-5bf4-4670-9686-bf880cb6b6e4 service nova] Creating event network-vif-deleted:52643e8f-ddae-453b-8aab-3913248201fd for instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 on n-h1-861111-1 Oct 12 22:19:35.367418 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-96cd3723-9cba-4d97-bff4-b9ad3b5f5799 req-018486c1-5bf4-4670-9686-bf880cb6b6e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.120783 Oct 12 22:19:35.375376 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2090/4748] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:35.396530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4873d8fe-e29b-4aed-8b94-854490274535 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:35.404575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4873d8fe-e29b-4aed-8b94-854490274535 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:35.413433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f2f191a3-b072-4f86-8485-1c48deb98c38 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:35.423787 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f2f191a3-b072-4f86-8485-1c48deb98c38 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1221 microversion: 2.1 time: 0.250121 Oct 12 22:19:35.427875 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2659/4749] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:35 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1221 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:35.434270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d9f7546f-1d31-4b2d-8e56-76238bb2f959 req-cd587fe8-b66b-4ab5-9e67-1a5e259d7a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c64ea4-1e95-44f2-a14c-f4edf4be2468", "name": "network-vif-deleted", "tag": "72c16ae9-fc18-459a-ac2d-49f958ee5b78"}, {"server_uuid": "1cd026e6-7533-4efb-88f5-1573116d8f08", "name": "network-vif-deleted", "tag": "5464a150-633c-4044-a3cb-dbe841354308"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:35.457487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4873d8fe-e29b-4aed-8b94-854490274535 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:35.457487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4873d8fe-e29b-4aed-8b94-854490274535 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:35.457487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4873d8fe-e29b-4aed-8b94-854490274535 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:35.460236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4873d8fe-e29b-4aed-8b94-854490274535 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:35.460962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4873d8fe-e29b-4aed-8b94-854490274535 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:35.464680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4873d8fe-e29b-4aed-8b94-854490274535 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:35.487617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d9f7546f-1d31-4b2d-8e56-76238bb2f959 req-cd587fe8-b66b-4ab5-9e67-1a5e259d7a67 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:35.488763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d9f7546f-1d31-4b2d-8e56-76238bb2f959 req-cd587fe8-b66b-4ab5-9e67-1a5e259d7a67 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:35.489186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d9f7546f-1d31-4b2d-8e56-76238bb2f959 req-cd587fe8-b66b-4ab5-9e67-1a5e259d7a67 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:35.527670 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d9f7546f-1d31-4b2d-8e56-76238bb2f959 req-cd587fe8-b66b-4ab5-9e67-1a5e259d7a67 service nova] Creating event network-vif-deleted:72c16ae9-fc18-459a-ac2d-49f958ee5b78 for instance 03c64ea4-1e95-44f2-a14c-f4edf4be2468 on n-h1-861111-1 Oct 12 22:19:35.528047 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d9f7546f-1d31-4b2d-8e56-76238bb2f959 req-cd587fe8-b66b-4ab5-9e67-1a5e259d7a67 service nova] Creating event network-vif-deleted:5464a150-633c-4044-a3cb-dbe841354308 for instance 1cd026e6-7533-4efb-88f5-1573116d8f08 on n-h2-861111-1 Oct 12 22:19:35.555631 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d9f7546f-1d31-4b2d-8e56-76238bb2f959 req-cd587fe8-b66b-4ab5-9e67-1a5e259d7a67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.125394 Oct 12 22:19:35.562474 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2660/4750] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:35.568127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8bc6e487-f1ac-437a-b8f6-0078e90587e1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8bc6e487-f1ac-437a-b8f6-0078e90587e1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 163 Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": 12345, "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'networks': [{'uuid': '57899def-7285-4d34-a6b9-8c4bdfce7a65'}]}}} Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 12345 Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:19:35.586906 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:19:35.591506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:19:35.591506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 12 22:19:35.591506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:35.591506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:35.591506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:35.591506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:35.591506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:35.591506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:35.591506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:19:35.591506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:19:35.591506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 12 22:19:35.591506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:35.591506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8bc6e487-f1ac-437a-b8f6-0078e90587e1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:35.591506 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8bc6e487-f1ac-437a-b8f6-0078e90587e1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.024441 Oct 12 22:19:35.591506 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2661/4751] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:19:35 2022] POST /compute/v2.1/servers => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:19:35.607830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b2dcdc4a-0de7-44fe-bf6e-a881d45485b6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:35.608477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b2dcdc4a-0de7-44fe-bf6e-a881d45485b6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:35.652206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2dcdc4a-0de7-44fe-bf6e-a881d45485b6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:35.652720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2dcdc4a-0de7-44fe-bf6e-a881d45485b6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:35.653160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2dcdc4a-0de7-44fe-bf6e-a881d45485b6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:35.654453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2dcdc4a-0de7-44fe-bf6e-a881d45485b6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:35.655069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2dcdc4a-0de7-44fe-bf6e-a881d45485b6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:35.655694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b2dcdc4a-0de7-44fe-bf6e-a881d45485b6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:36.213715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b2dcdc4a-0de7-44fe-bf6e-a881d45485b6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:36.222769 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b2dcdc4a-0de7-44fe-bf6e-a881d45485b6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.618118 Oct 12 22:19:36.244696 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2662/4752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:35 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:36.259186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eee0412f-01ce-48c7-ad19-8c6081a166a0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:36.260007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eee0412f-01ce-48c7-ad19-8c6081a166a0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:36.272149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4873d8fe-e29b-4aed-8b94-854490274535 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:36.275744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eee0412f-01ce-48c7-ad19-8c6081a166a0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:36.277340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eee0412f-01ce-48c7-ad19-8c6081a166a0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:36.280005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eee0412f-01ce-48c7-ad19-8c6081a166a0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:36.281097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eee0412f-01ce-48c7-ad19-8c6081a166a0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:36.281888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eee0412f-01ce-48c7-ad19-8c6081a166a0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:36.283878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eee0412f-01ce-48c7-ad19-8c6081a166a0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:36.286507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4873d8fe-e29b-4aed-8b94-854490274535 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:36.289896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4873d8fe-e29b-4aed-8b94-854490274535 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:36.296054 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4873d8fe-e29b-4aed-8b94-854490274535 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1365 microversion: 2.47 time: 0.919317 Oct 12 22:19:36.299969 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2091/4753] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:35 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1365 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:36.323975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-16b75bb2-d7cf-4981-a89c-17b4dcafee4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:36.326027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-16b75bb2-d7cf-4981-a89c-17b4dcafee4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:36.344038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16b75bb2-d7cf-4981-a89c-17b4dcafee4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:36.348073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16b75bb2-d7cf-4981-a89c-17b4dcafee4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:36.350118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16b75bb2-d7cf-4981-a89c-17b4dcafee4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:36.354464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16b75bb2-d7cf-4981-a89c-17b4dcafee4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:36.357191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16b75bb2-d7cf-4981-a89c-17b4dcafee4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:36.358560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16b75bb2-d7cf-4981-a89c-17b4dcafee4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:36.429851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16b75bb2-d7cf-4981-a89c-17b4dcafee4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:36.430520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16b75bb2-d7cf-4981-a89c-17b4dcafee4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:36.431470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16b75bb2-d7cf-4981-a89c-17b4dcafee4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:36.432115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-16b75bb2-d7cf-4981-a89c-17b4dcafee4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lazy-loading 'fault' on Instance uuid 4023ebba-05d4-4225-938a-c70c2490ae29 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:19:36.454539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eee0412f-01ce-48c7-ad19-8c6081a166a0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:36.467721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eee0412f-01ce-48c7-ad19-8c6081a166a0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:36.473363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eee0412f-01ce-48c7-ad19-8c6081a166a0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:36.481089 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eee0412f-01ce-48c7-ad19-8c6081a166a0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1605 microversion: 2.32 time: 0.235025 Oct 12 22:19:36.481902 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2663/4754] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:36 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1605 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:36.505600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-16b75bb2-d7cf-4981-a89c-17b4dcafee4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c500796d54d6188ff65056340d35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319a8f107945457a8a8f8e9690a697e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:36.517460 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-16b75bb2-d7cf-4981-a89c-17b4dcafee4e tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 200 len: 1329 microversion: 2.1 time: 0.213147 Oct 12 22:19:36.519336 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2092/4755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:36 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 1329 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:36.536801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bbee63f1-9d55-47aa-9209-d3deefe928f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:36.537798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bbee63f1-9d55-47aa-9209-d3deefe928f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:36.549388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbee63f1-9d55-47aa-9209-d3deefe928f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:36.550781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c294d6cd-15b5-4b3c-acc5-1f4f05ad3fff tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:36.551598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c294d6cd-15b5-4b3c-acc5-1f4f05ad3fff tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:36.552915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbee63f1-9d55-47aa-9209-d3deefe928f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:36.553913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbee63f1-9d55-47aa-9209-d3deefe928f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:36.557089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbee63f1-9d55-47aa-9209-d3deefe928f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:36.557841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbee63f1-9d55-47aa-9209-d3deefe928f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:36.558490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c294d6cd-15b5-4b3c-acc5-1f4f05ad3fff tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:36.559093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c294d6cd-15b5-4b3c-acc5-1f4f05ad3fff tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:36.559564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbee63f1-9d55-47aa-9209-d3deefe928f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:36.559749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c294d6cd-15b5-4b3c-acc5-1f4f05ad3fff tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:36.560559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c294d6cd-15b5-4b3c-acc5-1f4f05ad3fff tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:36.567171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c294d6cd-15b5-4b3c-acc5-1f4f05ad3fff tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:36.567810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c294d6cd-15b5-4b3c-acc5-1f4f05ad3fff tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:36.615069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:36.742374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bbee63f1-9d55-47aa-9209-d3deefe928f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:36.767658 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bbee63f1-9d55-47aa-9209-d3deefe928f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1273 microversion: 2.1 time: 0.246970 Oct 12 22:19:36.780252 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2093/4756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:36 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1273 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:36.983613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c294d6cd-15b5-4b3c-acc5-1f4f05ad3fff tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:36.992447 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c294d6cd-15b5-4b3c-acc5-1f4f05ad3fff tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.491192 Oct 12 22:19:36.997417 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2664/4757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:36 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:37.331817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7bb8b14b-e036-4174-9883-d2d7e957dd4a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:37.332441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7bb8b14b-e036-4174-9883-d2d7e957dd4a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:37.359924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7bb8b14b-e036-4174-9883-d2d7e957dd4a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:37.360901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7bb8b14b-e036-4174-9883-d2d7e957dd4a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:37.361725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7bb8b14b-e036-4174-9883-d2d7e957dd4a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:37.362703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7bb8b14b-e036-4174-9883-d2d7e957dd4a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:37.363576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7bb8b14b-e036-4174-9883-d2d7e957dd4a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:37.364869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7bb8b14b-e036-4174-9883-d2d7e957dd4a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:37.512783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-74c72381-9174-4737-b9bc-67804f48eaf9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:37.514255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-74c72381-9174-4737-b9bc-67804f48eaf9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:37.525179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c72381-9174-4737-b9bc-67804f48eaf9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:37.539715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c72381-9174-4737-b9bc-67804f48eaf9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:37.540182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c72381-9174-4737-b9bc-67804f48eaf9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:37.543593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c72381-9174-4737-b9bc-67804f48eaf9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:37.544074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c72381-9174-4737-b9bc-67804f48eaf9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:37.544521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c72381-9174-4737-b9bc-67804f48eaf9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:37.728098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-74c72381-9174-4737-b9bc-67804f48eaf9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:37.749593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-74c72381-9174-4737-b9bc-67804f48eaf9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:37.751101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-74c72381-9174-4737-b9bc-67804f48eaf9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:37.752440 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-74c72381-9174-4737-b9bc-67804f48eaf9 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1605 microversion: 2.32 time: 0.245075 Oct 12 22:19:37.753383 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2665/4758] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:37 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1605 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:19:37.758451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0cc6a763-042a-4232-916e-57cd2724bf50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:37.759501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0cc6a763-042a-4232-916e-57cd2724bf50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] [instance: 4023ebba-05d4-4225-938a-c70c2490ae29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:37.772845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cc6a763-042a-4232-916e-57cd2724bf50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:37.773186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cc6a763-042a-4232-916e-57cd2724bf50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:37.773629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cc6a763-042a-4232-916e-57cd2724bf50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:37.775946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cc6a763-042a-4232-916e-57cd2724bf50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:37.776646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cc6a763-042a-4232-916e-57cd2724bf50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:37.777101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cc6a763-042a-4232-916e-57cd2724bf50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:37.796262 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-0cc6a763-042a-4232-916e-57cd2724bf50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] HTTP exception thrown: Instance 4023ebba-05d4-4225-938a-c70c2490ae29 could not be found. Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0cc6a763-042a-4232-916e-57cd2724bf50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Request method failure captured: Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 HTTP/1.1 Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzriWjH9XGk2m6XxAkFWCa5SU4u3aYbKjccJUM74Gs6m2ZTWTRgYJo3xNK7Dl1yHzUOL0UlgCpklDDkzfGl4zIrs1ucJJAHjnDilUmOFjpe-CEtT-kGaW-5sHatvR75wN517xqlZ9fiNsyKxLaujP5hWxgbqYLVY-SfHQMzPuASo904 Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 319a8f107945457a8a8f8e9690a697e5 Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319a8f107945457a8a8f8e9690a697e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319a8f107945457a8a8f8e9690a697e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 319a8f107945457a8a8f8e9690a697e5 Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerActionsTestJSON-1007032333 Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerActionsTestJSON-1007032333-project Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: b29c500796d54d6188ff65056340d35f Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerActionsTestJSON-1007032333-project Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 4023ebba-05d4-4225-938a-c70c2490ae29 could not be found. Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '4023ebba-05d4-4225-938a-c70c2490ae29'} Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4023ebba-05d4-4225-938a-c70c2490ae29 could not be found. Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4023ebba-05d4-4225-938a-c70c2490ae29 could not be found. Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:37.798431 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:37.803672 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:37.803672 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:37.803672 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:37.803672 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:37.803672 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:37.803672 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4023ebba-05d4-4225-938a-c70c2490ae29 could not be found. Oct 12 22:19:37.803672 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:37.805588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0cc6a763-042a-4232-916e-57cd2724bf50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Returning 404 to user: Instance 4023ebba-05d4-4225-938a-c70c2490ae29 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:37.806792 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0cc6a763-042a-4232-916e-57cd2724bf50 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29" status: 404 len: 111 microversion: 2.1 time: 0.052093 Oct 12 22:19:37.811046 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2666/4759] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:37 2022] GET /compute/v2.1/servers/4023ebba-05d4-4225-938a-c70c2490ae29 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:19:37.817329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-97695392-6e6f-4afa-95b8-9aaef0a87e98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:37.818191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-97695392-6e6f-4afa-95b8-9aaef0a87e98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:37.825731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97695392-6e6f-4afa-95b8-9aaef0a87e98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:37.826508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97695392-6e6f-4afa-95b8-9aaef0a87e98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:37.826925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97695392-6e6f-4afa-95b8-9aaef0a87e98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:37.827834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97695392-6e6f-4afa-95b8-9aaef0a87e98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:37.828345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97695392-6e6f-4afa-95b8-9aaef0a87e98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:37.828778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97695392-6e6f-4afa-95b8-9aaef0a87e98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:37.911434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7bb8b14b-e036-4174-9883-d2d7e957dd4a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:37.926623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7bb8b14b-e036-4174-9883-d2d7e957dd4a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:37.928215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7bb8b14b-e036-4174-9883-d2d7e957dd4a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:37.933283 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7bb8b14b-e036-4174-9883-d2d7e957dd4a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1365 microversion: 2.47 time: 0.606796 Oct 12 22:19:37.936858 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2094/4760] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:37 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1365 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:37.949296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-927c342f-6b1a-4e9d-ad96-aa1a7286bb78 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] Calling method '.version_select at 0x7f51232918b0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:37.971476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-97695392-6e6f-4afa-95b8-9aaef0a87e98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:37.982703 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-97695392-6e6f-4afa-95b8-9aaef0a87e98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1279 microversion: 2.1 time: 0.169937 Oct 12 22:19:37.983677 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2667/4761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:37 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1279 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:37.994834 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-927c342f-6b1a-4e9d-ad96-aa1a7286bb78 tempest-ServerActionsTestJSON-1007032333 tempest-ServerActionsTestJSON-1007032333-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1625673439" status: 202 len: 0 microversion: 2.1 time: 0.056652 Oct 12 22:19:37.995760 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2095/4762] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 12 22:19:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1625673439 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:19:38.009593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-cfd89f8e-6dbd-4824-9a75-9b4552792d04 req-cdaedbba-b6ae-41dc-923c-d61da807e2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4023ebba-05d4-4225-938a-c70c2490ae29", "name": "network-vif-deleted", "tag": "16f27b0f-2034-49b1-8fc7-d037682a37a4"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:38.020459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:38.033496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cfd89f8e-6dbd-4824-9a75-9b4552792d04 req-cdaedbba-b6ae-41dc-923c-d61da807e2db service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:38.039201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cfd89f8e-6dbd-4824-9a75-9b4552792d04 req-cdaedbba-b6ae-41dc-923c-d61da807e2db service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:38.040050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cfd89f8e-6dbd-4824-9a75-9b4552792d04 req-cdaedbba-b6ae-41dc-923c-d61da807e2db service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:38.095032 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-cfd89f8e-6dbd-4824-9a75-9b4552792d04 req-cdaedbba-b6ae-41dc-923c-d61da807e2db service nova] Creating event network-vif-deleted:16f27b0f-2034-49b1-8fc7-d037682a37a4 for instance 4023ebba-05d4-4225-938a-c70c2490ae29 on n-h2-861111-1 Oct 12 22:19:38.116416 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-cfd89f8e-6dbd-4824-9a75-9b4552792d04 req-cdaedbba-b6ae-41dc-923c-d61da807e2db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123682 Oct 12 22:19:38.117056 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2668/4763] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:38.780685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-32897715-5c5d-4e71-a52a-6f710b0b17d1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:38.781311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-32897715-5c5d-4e71-a52a-6f710b0b17d1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:38.803052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32897715-5c5d-4e71-a52a-6f710b0b17d1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:38.803839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32897715-5c5d-4e71-a52a-6f710b0b17d1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:38.806135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32897715-5c5d-4e71-a52a-6f710b0b17d1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:38.807251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32897715-5c5d-4e71-a52a-6f710b0b17d1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:38.808288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32897715-5c5d-4e71-a52a-6f710b0b17d1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:38.810062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32897715-5c5d-4e71-a52a-6f710b0b17d1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:38.973626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f8595c83-b7c5-4695-9942-4b20c7923c18 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:38.974476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f8595c83-b7c5-4695-9942-4b20c7923c18 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:38.993732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8595c83-b7c5-4695-9942-4b20c7923c18 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:38.994415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8595c83-b7c5-4695-9942-4b20c7923c18 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:38.994989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8595c83-b7c5-4695-9942-4b20c7923c18 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:38.995853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8595c83-b7c5-4695-9942-4b20c7923c18 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:38.997988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8595c83-b7c5-4695-9942-4b20c7923c18 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:38.999131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8595c83-b7c5-4695-9942-4b20c7923c18 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:39.127626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f8595c83-b7c5-4695-9942-4b20c7923c18 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:39.145987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f8595c83-b7c5-4695-9942-4b20c7923c18 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:39.148236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f8595c83-b7c5-4695-9942-4b20c7923c18 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:39.149652 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f8595c83-b7c5-4695-9942-4b20c7923c18 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1365 microversion: 2.47 time: 0.188885 Oct 12 22:19:39.150711 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2669/4764] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:38 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:39.156272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0e41cc0d-5288-4185-89f9-6fb3a0651c1c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:39.157124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0e41cc0d-5288-4185-89f9-6fb3a0651c1c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:39.165261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e41cc0d-5288-4185-89f9-6fb3a0651c1c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:39.166068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e41cc0d-5288-4185-89f9-6fb3a0651c1c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:39.166674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e41cc0d-5288-4185-89f9-6fb3a0651c1c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:39.167724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e41cc0d-5288-4185-89f9-6fb3a0651c1c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:39.168477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e41cc0d-5288-4185-89f9-6fb3a0651c1c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:39.169119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e41cc0d-5288-4185-89f9-6fb3a0651c1c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:39.212099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-32897715-5c5d-4e71-a52a-6f710b0b17d1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:39.230265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-32897715-5c5d-4e71-a52a-6f710b0b17d1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:39.234558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-32897715-5c5d-4e71-a52a-6f710b0b17d1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:39.237466 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-32897715-5c5d-4e71-a52a-6f710b0b17d1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1605 microversion: 2.32 time: 0.462686 Oct 12 22:19:39.239497 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2096/4765] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:38 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1605 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:39.309725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0e41cc0d-5288-4185-89f9-6fb3a0651c1c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:39.325902 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0e41cc0d-5288-4185-89f9-6fb3a0651c1c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1279 microversion: 2.1 time: 0.173799 Oct 12 22:19:39.327294 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2670/4766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:39 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1279 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:40.188230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-47b3bafb-b247-45fd-96ba-835377ca74a9 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:40.190337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-47b3bafb-b247-45fd-96ba-835377ca74a9 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:40.214564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b3bafb-b247-45fd-96ba-835377ca74a9 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:40.215170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b3bafb-b247-45fd-96ba-835377ca74a9 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:40.216658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b3bafb-b247-45fd-96ba-835377ca74a9 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:40.218913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b3bafb-b247-45fd-96ba-835377ca74a9 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:40.221942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b3bafb-b247-45fd-96ba-835377ca74a9 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:40.222919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47b3bafb-b247-45fd-96ba-835377ca74a9 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:40.246211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-63d81455-e6cc-4e92-9540-1164428a296f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2129341688", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "2fb656fd-93ce-46fa-abdb-6dc7090eaeeb", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:40.377983 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-63d81455-e6cc-4e92-9540-1164428a296f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Block Device 2fb656fd-93ce-46fa-abdb-6dc7090eaeeb is not bootable. Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-63d81455-e6cc-4e92-9540-1164428a296f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 358 Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2129341688", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "2fb656fd-93ce-46fa-abdb-6dc7090eaeeb", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: exception: Block Device 2fb656fd-93ce-46fa-abdb-6dc7090eaeeb is not bootable. Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2129341688', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '2fb656fd-93ce-46fa-abdb-6dc7090eaeeb'}], 'networks': [{'uuid': '57899def-7285-4d34-a6b9-8c4bdfce7a65'}]}}} Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 2fb656fd-93ce-46fa-abdb-6dc7090eaeeb is not bootable. Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:40.388725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 2fb656fd-93ce-46fa-abdb-6dc7090eaeeb is not bootable. Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 2fb656fd-93ce-46fa-abdb-6dc7090eaeeb is not bootable. Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-63d81455-e6cc-4e92-9540-1164428a296f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 400 to user: Block Device 2fb656fd-93ce-46fa-abdb-6dc7090eaeeb is not bootable. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-63d81455-e6cc-4e92-9540-1164428a296f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.148221 Oct 12 22:19:40.395571 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2671/4767] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:19:40 2022] POST /compute/v2.1/servers => generated 110 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:19:40.400255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f61de102-b737-4c5d-a8bc-b228ba5c20ab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:40.400883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f61de102-b737-4c5d-a8bc-b228ba5c20ab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:40.417148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f61de102-b737-4c5d-a8bc-b228ba5c20ab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:40.417925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f61de102-b737-4c5d-a8bc-b228ba5c20ab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:40.418536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f61de102-b737-4c5d-a8bc-b228ba5c20ab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:40.419426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f61de102-b737-4c5d-a8bc-b228ba5c20ab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:40.420035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f61de102-b737-4c5d-a8bc-b228ba5c20ab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:40.420615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f61de102-b737-4c5d-a8bc-b228ba5c20ab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:40.572414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f61de102-b737-4c5d-a8bc-b228ba5c20ab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:40.591265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f61de102-b737-4c5d-a8bc-b228ba5c20ab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:40.593035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f61de102-b737-4c5d-a8bc-b228ba5c20ab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:40.594414 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f61de102-b737-4c5d-a8bc-b228ba5c20ab tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1605 microversion: 2.32 time: 0.198065 Oct 12 22:19:40.595146 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2672/4768] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:40 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1605 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:40.599880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-684ab201-b554-4769-9d2e-7a745053f02a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:40.603985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-684ab201-b554-4769-9d2e-7a745053f02a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:40.626765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-684ab201-b554-4769-9d2e-7a745053f02a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:40.627564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-684ab201-b554-4769-9d2e-7a745053f02a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:40.628748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-684ab201-b554-4769-9d2e-7a745053f02a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:40.629638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-684ab201-b554-4769-9d2e-7a745053f02a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:40.630253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-684ab201-b554-4769-9d2e-7a745053f02a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:40.630845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-684ab201-b554-4769-9d2e-7a745053f02a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:40.723773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-47b3bafb-b247-45fd-96ba-835377ca74a9 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:40.732256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-47b3bafb-b247-45fd-96ba-835377ca74a9 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:40.733697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-47b3bafb-b247-45fd-96ba-835377ca74a9 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:40.734877 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-47b3bafb-b247-45fd-96ba-835377ca74a9 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1365 microversion: 2.47 time: 0.560567 Oct 12 22:19:40.750390 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2097/4769] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:40 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1365 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:40.773877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5db39966-7ecb-405b-9397-4d224ffaf840 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:40.774700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5db39966-7ecb-405b-9397-4d224ffaf840 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:40.781591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5db39966-7ecb-405b-9397-4d224ffaf840 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:40.782284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5db39966-7ecb-405b-9397-4d224ffaf840 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:40.783049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5db39966-7ecb-405b-9397-4d224ffaf840 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:40.791896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5db39966-7ecb-405b-9397-4d224ffaf840 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:40.792587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5db39966-7ecb-405b-9397-4d224ffaf840 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:40.793188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5db39966-7ecb-405b-9397-4d224ffaf840 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:40.917551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-684ab201-b554-4769-9d2e-7a745053f02a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:40.937595 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-684ab201-b554-4769-9d2e-7a745053f02a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1321 microversion: 2.1 time: 0.341156 Oct 12 22:19:40.938415 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2673/4770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:40 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:41.620038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fad62b6f-f7e2-4248-a5f4-adb19a8de64c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:41.621435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fad62b6f-f7e2-4248-a5f4-adb19a8de64c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:41.632590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fad62b6f-f7e2-4248-a5f4-adb19a8de64c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:41.633623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fad62b6f-f7e2-4248-a5f4-adb19a8de64c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:41.635738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fad62b6f-f7e2-4248-a5f4-adb19a8de64c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:41.636573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fad62b6f-f7e2-4248-a5f4-adb19a8de64c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:41.642511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fad62b6f-f7e2-4248-a5f4-adb19a8de64c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:41.643065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fad62b6f-f7e2-4248-a5f4-adb19a8de64c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:41.754730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fad62b6f-f7e2-4248-a5f4-adb19a8de64c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:41.777730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fad62b6f-f7e2-4248-a5f4-adb19a8de64c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:41.786778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fad62b6f-f7e2-4248-a5f4-adb19a8de64c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:41.792852 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fad62b6f-f7e2-4248-a5f4-adb19a8de64c tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1605 microversion: 2.32 time: 0.174941 Oct 12 22:19:41.805508 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2674/4771] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:41 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1605 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:41.820157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-40c466fa-1cb6-4082-ad29-c2297d356eb7 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:41.820726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-40c466fa-1cb6-4082-ad29-c2297d356eb7 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:41.828951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40c466fa-1cb6-4082-ad29-c2297d356eb7 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:41.833384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40c466fa-1cb6-4082-ad29-c2297d356eb7 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:41.834725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40c466fa-1cb6-4082-ad29-c2297d356eb7 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:41.835521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40c466fa-1cb6-4082-ad29-c2297d356eb7 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:41.836354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40c466fa-1cb6-4082-ad29-c2297d356eb7 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:41.836968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-40c466fa-1cb6-4082-ad29-c2297d356eb7 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:41.948439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5db39966-7ecb-405b-9397-4d224ffaf840 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:41.976735 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5db39966-7ecb-405b-9397-4d224ffaf840 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 1.224983 Oct 12 22:19:41.977883 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2098/4772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:40 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:41.983961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bf91866a-eb3a-452b-96a9-fbe719386c6d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:41.984747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bf91866a-eb3a-452b-96a9-fbe719386c6d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:41.993855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf91866a-eb3a-452b-96a9-fbe719386c6d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:41.994566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf91866a-eb3a-452b-96a9-fbe719386c6d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:41.995188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf91866a-eb3a-452b-96a9-fbe719386c6d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:41.996120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf91866a-eb3a-452b-96a9-fbe719386c6d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:41.996911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf91866a-eb3a-452b-96a9-fbe719386c6d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:41.997810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf91866a-eb3a-452b-96a9-fbe719386c6d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:42.090235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-40c466fa-1cb6-4082-ad29-c2297d356eb7 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:42.107511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-40c466fa-1cb6-4082-ad29-c2297d356eb7 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:42.107511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-40c466fa-1cb6-4082-ad29-c2297d356eb7 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:42.107511 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-40c466fa-1cb6-4082-ad29-c2297d356eb7 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1365 microversion: 2.47 time: 0.298122 Oct 12 22:19:42.107511 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2675/4773] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:41 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:42.117519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6e339e17-9d13-42cd-8dec-5776adf7d13b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:42.122857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6e339e17-9d13-42cd-8dec-5776adf7d13b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:42.136107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e339e17-9d13-42cd-8dec-5776adf7d13b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:42.138141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e339e17-9d13-42cd-8dec-5776adf7d13b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:42.138695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e339e17-9d13-42cd-8dec-5776adf7d13b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:42.139889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e339e17-9d13-42cd-8dec-5776adf7d13b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:42.144167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e339e17-9d13-42cd-8dec-5776adf7d13b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:42.144987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e339e17-9d13-42cd-8dec-5776adf7d13b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:42.890448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6e339e17-9d13-42cd-8dec-5776adf7d13b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:42.907656 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6e339e17-9d13-42cd-8dec-5776adf7d13b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.799614 Oct 12 22:19:42.909318 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2676/4774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:42 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:42.917953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-99f10384-04b2-42c0-8766-b26b1bf23a49 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:42.918848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-99f10384-04b2-42c0-8766-b26b1bf23a49 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:42.928191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99f10384-04b2-42c0-8766-b26b1bf23a49 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:42.931642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99f10384-04b2-42c0-8766-b26b1bf23a49 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:42.932422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99f10384-04b2-42c0-8766-b26b1bf23a49 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:42.936895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99f10384-04b2-42c0-8766-b26b1bf23a49 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:42.938471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99f10384-04b2-42c0-8766-b26b1bf23a49 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:42.941249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99f10384-04b2-42c0-8766-b26b1bf23a49 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:43.266820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bf91866a-eb3a-452b-96a9-fbe719386c6d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:43.281713 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bf91866a-eb3a-452b-96a9-fbe719386c6d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1321 microversion: 2.1 time: 1.300621 Oct 12 22:19:43.287522 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2099/4775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:41 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1321 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:43.303207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8716b41c-4d57-481f-8b63-728258754fcd tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:43.305385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8716b41c-4d57-481f-8b63-728258754fcd tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:43.333076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8716b41c-4d57-481f-8b63-728258754fcd tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:43.335094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8716b41c-4d57-481f-8b63-728258754fcd tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:43.343314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8716b41c-4d57-481f-8b63-728258754fcd tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:43.344583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8716b41c-4d57-481f-8b63-728258754fcd tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:43.346407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8716b41c-4d57-481f-8b63-728258754fcd tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:43.348570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8716b41c-4d57-481f-8b63-728258754fcd tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:43.424525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-99f10384-04b2-42c0-8766-b26b1bf23a49 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:43.469993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-99f10384-04b2-42c0-8766-b26b1bf23a49 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:43.482043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-99f10384-04b2-42c0-8766-b26b1bf23a49 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:43.488389 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-99f10384-04b2-42c0-8766-b26b1bf23a49 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1605 microversion: 2.32 time: 0.577617 Oct 12 22:19:43.494116 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2677/4776] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:42 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1605 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:44.314649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5e8cfe61-cba3-4bf2-8630-03f8294c1ee6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:44.316340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5e8cfe61-cba3-4bf2-8630-03f8294c1ee6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:44.336912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e8cfe61-cba3-4bf2-8630-03f8294c1ee6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:44.338309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e8cfe61-cba3-4bf2-8630-03f8294c1ee6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:44.339016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e8cfe61-cba3-4bf2-8630-03f8294c1ee6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:44.340029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e8cfe61-cba3-4bf2-8630-03f8294c1ee6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:44.340901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e8cfe61-cba3-4bf2-8630-03f8294c1ee6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:44.341659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e8cfe61-cba3-4bf2-8630-03f8294c1ee6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:44.378375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8716b41c-4d57-481f-8b63-728258754fcd tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:44.393041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8716b41c-4d57-481f-8b63-728258754fcd tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:44.395483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8716b41c-4d57-481f-8b63-728258754fcd tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:44.402201 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8716b41c-4d57-481f-8b63-728258754fcd tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1365 microversion: 2.47 time: 1.110787 Oct 12 22:19:44.405496 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2100/4777] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:43 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1365 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:44.518212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f6a96c20-dd62-4031-8238-c213fc17bee8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:44.519671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f6a96c20-dd62-4031-8238-c213fc17bee8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:44.547208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6a96c20-dd62-4031-8238-c213fc17bee8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:44.548435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6a96c20-dd62-4031-8238-c213fc17bee8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:44.549348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6a96c20-dd62-4031-8238-c213fc17bee8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:44.552055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6a96c20-dd62-4031-8238-c213fc17bee8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:44.552847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6a96c20-dd62-4031-8238-c213fc17bee8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:44.553464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6a96c20-dd62-4031-8238-c213fc17bee8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:44.564188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=10 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:44.727559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5e8cfe61-cba3-4bf2-8630-03f8294c1ee6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:44.736545 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5e8cfe61-cba3-4bf2-8630-03f8294c1ee6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1321 microversion: 2.1 time: 0.433048 Oct 12 22:19:44.739218 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2678/4778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:44 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1321 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:44.834563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f6a96c20-dd62-4031-8238-c213fc17bee8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:44.850957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f6a96c20-dd62-4031-8238-c213fc17bee8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:44.856298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f6a96c20-dd62-4031-8238-c213fc17bee8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:44.857534 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f6a96c20-dd62-4031-8238-c213fc17bee8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1605 microversion: 2.32 time: 0.344104 Oct 12 22:19:44.858114 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2101/4779] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:44 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1605 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:19:45.436968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a7712590-2520-4df8-95a1-ea3d92fb111c tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:45.437607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a7712590-2520-4df8-95a1-ea3d92fb111c tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:45.445279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=16 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:45.461259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7712590-2520-4df8-95a1-ea3d92fb111c tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:45.462440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7712590-2520-4df8-95a1-ea3d92fb111c tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:45.463185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7712590-2520-4df8-95a1-ea3d92fb111c tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:45.464422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7712590-2520-4df8-95a1-ea3d92fb111c tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:45.465251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7712590-2520-4df8-95a1-ea3d92fb111c tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:45.483298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7712590-2520-4df8-95a1-ea3d92fb111c tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:45.624051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a7712590-2520-4df8-95a1-ea3d92fb111c tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:45.641795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a7712590-2520-4df8-95a1-ea3d92fb111c tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:45.645699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a7712590-2520-4df8-95a1-ea3d92fb111c tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:45.648923 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a7712590-2520-4df8-95a1-ea3d92fb111c tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1365 microversion: 2.47 time: 0.216590 Oct 12 22:19:45.666023 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2679/4780] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:45 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:45.760640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-877c14c4-d51c-4510-ac8f-88f1bb90accb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:45.761260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-877c14c4-d51c-4510-ac8f-88f1bb90accb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:45.775836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-877c14c4-d51c-4510-ac8f-88f1bb90accb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:45.779276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-877c14c4-d51c-4510-ac8f-88f1bb90accb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:45.780991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-877c14c4-d51c-4510-ac8f-88f1bb90accb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:45.781714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-877c14c4-d51c-4510-ac8f-88f1bb90accb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:45.790733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-877c14c4-d51c-4510-ac8f-88f1bb90accb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:45.793152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-877c14c4-d51c-4510-ac8f-88f1bb90accb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:45.894847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f016f397-b4d1-4cee-a314-589fa508419a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:45.896951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f016f397-b4d1-4cee-a314-589fa508419a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:45.908350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f016f397-b4d1-4cee-a314-589fa508419a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:45.912674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f016f397-b4d1-4cee-a314-589fa508419a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:45.915541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f016f397-b4d1-4cee-a314-589fa508419a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:45.916396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f016f397-b4d1-4cee-a314-589fa508419a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:45.917037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f016f397-b4d1-4cee-a314-589fa508419a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:45.917478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f016f397-b4d1-4cee-a314-589fa508419a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:46.040853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f016f397-b4d1-4cee-a314-589fa508419a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:46.056854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f016f397-b4d1-4cee-a314-589fa508419a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:46.060618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f016f397-b4d1-4cee-a314-589fa508419a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:46.062041 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f016f397-b4d1-4cee-a314-589fa508419a tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1605 microversion: 2.32 time: 0.173024 Oct 12 22:19:46.071858 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2680/4781] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:45 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1605 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:46.088362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a35085be-8c21-4f3d-a836-103faaeeed4e req-f0e52a60-b722-4e36-a1fc-66216ccf865e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7013657e-c4d1-4af9-b593-b891d2d1c66b", "tag": "aa91f8c1-414a-41aa-a5f3-ac7cbe6b2ab9"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:46.107914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a35085be-8c21-4f3d-a836-103faaeeed4e req-f0e52a60-b722-4e36-a1fc-66216ccf865e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:46.119976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a35085be-8c21-4f3d-a836-103faaeeed4e req-f0e52a60-b722-4e36-a1fc-66216ccf865e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:46.120656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a35085be-8c21-4f3d-a836-103faaeeed4e req-f0e52a60-b722-4e36-a1fc-66216ccf865e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:46.140843 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a35085be-8c21-4f3d-a836-103faaeeed4e req-f0e52a60-b722-4e36-a1fc-66216ccf865e service nova] Creating event network-changed:aa91f8c1-414a-41aa-a5f3-ac7cbe6b2ab9 for instance 7013657e-c4d1-4af9-b593-b891d2d1c66b on n-h2-861111-1 Oct 12 22:19:46.148834 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a35085be-8c21-4f3d-a836-103faaeeed4e req-f0e52a60-b722-4e36-a1fc-66216ccf865e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075668 Oct 12 22:19:46.151649 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2681/4782] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:46.161927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9b4b931b-6d69-4ee8-8062-5f9e5e99e435 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-545149547", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d1e68057-c368-47a5-ab06-787819be7f9c", "destination_type": "local"}, {"source_type": "volume", "uuid": "3471014e-9faf-46f9-8e2e-cd34fcc31869", "destination_type": "invalid"}], "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9b4b931b-6d69-4ee8-8062-5f9e5e99e435 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 494 Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-545149547", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d1e68057-c368-47a5-ab06-787819be7f9c", "destination_type": "local"}, {"source_type": "volume", "uuid": "3471014e-9faf-46f9-8e2e-cd34fcc31869", "destination_type": "invalid"}], "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-545149547', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '3471014e-9faf-46f9-8e2e-cd34fcc31869', 'destination_type': 'invalid'}], 'networks': [{'uuid': '57899def-7285-4d34-a6b9-8c4bdfce7a65'}]}}} Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'invalid' Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:46.170820 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 12 22:19:46.174602 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:46.179094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9b4b931b-6d69-4ee8-8062-5f9e5e99e435 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:46.184325 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9b4b931b-6d69-4ee8-8062-5f9e5e99e435 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.031372 Oct 12 22:19:46.185445 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2682/4783] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:19:46 2022] POST /compute/v2.1/servers => generated 155 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:19:46.197080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7fda3955-383b-42c7-895b-53087715719f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:46.198085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7fda3955-383b-42c7-895b-53087715719f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:46.218815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fda3955-383b-42c7-895b-53087715719f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:46.232005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fda3955-383b-42c7-895b-53087715719f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:46.232721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fda3955-383b-42c7-895b-53087715719f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:46.233637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fda3955-383b-42c7-895b-53087715719f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:46.234249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fda3955-383b-42c7-895b-53087715719f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:46.234840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fda3955-383b-42c7-895b-53087715719f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:46.298164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-877c14c4-d51c-4510-ac8f-88f1bb90accb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:46.310107 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-877c14c4-d51c-4510-ac8f-88f1bb90accb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1321 microversion: 2.1 time: 0.553430 Oct 12 22:19:46.313067 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2102/4784] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:45 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1321 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:46.678021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-36c8dbe9-c0d2-4884-80bb-73bb3dad0f7f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:46.678806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-36c8dbe9-c0d2-4884-80bb-73bb3dad0f7f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:46.690649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36c8dbe9-c0d2-4884-80bb-73bb3dad0f7f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:46.691319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36c8dbe9-c0d2-4884-80bb-73bb3dad0f7f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:46.692043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36c8dbe9-c0d2-4884-80bb-73bb3dad0f7f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:46.692775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36c8dbe9-c0d2-4884-80bb-73bb3dad0f7f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:46.693267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36c8dbe9-c0d2-4884-80bb-73bb3dad0f7f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:46.693863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36c8dbe9-c0d2-4884-80bb-73bb3dad0f7f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:46.775986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7fda3955-383b-42c7-895b-53087715719f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:46.797443 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7fda3955-383b-42c7-895b-53087715719f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.606946 Oct 12 22:19:46.803291 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2683/4785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:46 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:46.824201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe37c681-eb64-4863-a3a7-902c2af2d908 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:46.824828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fe37c681-eb64-4863-a3a7-902c2af2d908 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:46.832421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe37c681-eb64-4863-a3a7-902c2af2d908 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:46.833421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe37c681-eb64-4863-a3a7-902c2af2d908 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:46.834352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe37c681-eb64-4863-a3a7-902c2af2d908 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:46.835266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe37c681-eb64-4863-a3a7-902c2af2d908 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:46.835887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe37c681-eb64-4863-a3a7-902c2af2d908 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:46.836476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe37c681-eb64-4863-a3a7-902c2af2d908 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:47.030922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-36c8dbe9-c0d2-4884-80bb-73bb3dad0f7f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:47.040892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-36c8dbe9-c0d2-4884-80bb-73bb3dad0f7f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:47.046883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-36c8dbe9-c0d2-4884-80bb-73bb3dad0f7f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:47.048200 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-36c8dbe9-c0d2-4884-80bb-73bb3dad0f7f tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1365 microversion: 2.47 time: 0.374138 Oct 12 22:19:47.049381 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2103/4786] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:46 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1365 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:47.097927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fd544e03-ec9d-4ec0-8b07-e61b3246bdd1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:47.098539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fd544e03-ec9d-4ec0-8b07-e61b3246bdd1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:47.099965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fe37c681-eb64-4863-a3a7-902c2af2d908 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:47.102678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:47.108386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd544e03-ec9d-4ec0-8b07-e61b3246bdd1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:47.108889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd544e03-ec9d-4ec0-8b07-e61b3246bdd1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:47.111011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd544e03-ec9d-4ec0-8b07-e61b3246bdd1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:47.116324 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fe37c681-eb64-4863-a3a7-902c2af2d908 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.295596 Oct 12 22:19:47.116651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd544e03-ec9d-4ec0-8b07-e61b3246bdd1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:47.117516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd544e03-ec9d-4ec0-8b07-e61b3246bdd1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:47.117877 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2684/4787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:46 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:47.118281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd544e03-ec9d-4ec0-8b07-e61b3246bdd1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:47.274997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-18678437-4016-4699-a83b-93d5377b584b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-417421627", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-18678437-4016-4699-a83b-93d5377b584b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 491 Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-417421627", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-417421627', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '57899def-7285-4d34-a6b9-8c4bdfce7a65'}]}}} Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:47.279475 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 12 22:19:47.282249 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:47.288590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-18678437-4016-4699-a83b-93d5377b584b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:47.290203 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-18678437-4016-4699-a83b-93d5377b584b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.019792 Oct 12 22:19:47.296661 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2685/4788] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:19:47 2022] POST /compute/v2.1/servers => generated 624 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 12 22:19:47.306798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fd544e03-ec9d-4ec0-8b07-e61b3246bdd1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:47.309318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6236f3ac-d9ed-43cc-9941-ad33302e6d51 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:47.311218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6236f3ac-d9ed-43cc-9941-ad33302e6d51 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:47.325628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6236f3ac-d9ed-43cc-9941-ad33302e6d51 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:47.327091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fd544e03-ec9d-4ec0-8b07-e61b3246bdd1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:47.328666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fd544e03-ec9d-4ec0-8b07-e61b3246bdd1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:47.328802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6236f3ac-d9ed-43cc-9941-ad33302e6d51 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:47.329799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6236f3ac-d9ed-43cc-9941-ad33302e6d51 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:47.329917 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fd544e03-ec9d-4ec0-8b07-e61b3246bdd1 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1605 microversion: 2.32 time: 0.235877 Oct 12 22:19:47.330571 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2104/4789] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:47 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1605 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:19:47.335901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e57a5e18-8bac-45e3-a0bf-ad6f394ec4c5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:47.336505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e57a5e18-8bac-45e3-a0bf-ad6f394ec4c5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:47.350611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e57a5e18-8bac-45e3-a0bf-ad6f394ec4c5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:47.351397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e57a5e18-8bac-45e3-a0bf-ad6f394ec4c5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:47.351554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e57a5e18-8bac-45e3-a0bf-ad6f394ec4c5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:47.353254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6236f3ac-d9ed-43cc-9941-ad33302e6d51 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:47.353891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6236f3ac-d9ed-43cc-9941-ad33302e6d51 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:47.354498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6236f3ac-d9ed-43cc-9941-ad33302e6d51 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:47.355005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e57a5e18-8bac-45e3-a0bf-ad6f394ec4c5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:47.360546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e57a5e18-8bac-45e3-a0bf-ad6f394ec4c5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:47.361235 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e57a5e18-8bac-45e3-a0bf-ad6f394ec4c5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:47.702918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6236f3ac-d9ed-43cc-9941-ad33302e6d51 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:47.712716 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6236f3ac-d9ed-43cc-9941-ad33302e6d51 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.413431 Oct 12 22:19:47.713592 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2686/4790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:47 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:47.741839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-72d228ca-72c1-4258-bf5e-1f5340df2446 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:47.744556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-72d228ca-72c1-4258-bf5e-1f5340df2446 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:47.756976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72d228ca-72c1-4258-bf5e-1f5340df2446 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:47.759564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72d228ca-72c1-4258-bf5e-1f5340df2446 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:47.761845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72d228ca-72c1-4258-bf5e-1f5340df2446 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:47.766827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72d228ca-72c1-4258-bf5e-1f5340df2446 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:47.769937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72d228ca-72c1-4258-bf5e-1f5340df2446 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:47.770567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72d228ca-72c1-4258-bf5e-1f5340df2446 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:47.973028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-72d228ca-72c1-4258-bf5e-1f5340df2446 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:48.010476 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-72d228ca-72c1-4258-bf5e-1f5340df2446 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.273099 Oct 12 22:19:48.012328 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2687/4791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:47 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:48.048995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e57a5e18-8bac-45e3-a0bf-ad6f394ec4c5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:48.077296 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e57a5e18-8bac-45e3-a0bf-ad6f394ec4c5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1321 microversion: 2.1 time: 0.742432 Oct 12 22:19:48.079584 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2105/4792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:47 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1321 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:48.097345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d22a48b1-5b09-4c2a-94a5-488dbe1b7375 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:48.098140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d22a48b1-5b09-4c2a-94a5-488dbe1b7375 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:48.114974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d22a48b1-5b09-4c2a-94a5-488dbe1b7375 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:48.115515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d22a48b1-5b09-4c2a-94a5-488dbe1b7375 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:48.115966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d22a48b1-5b09-4c2a-94a5-488dbe1b7375 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:48.116691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d22a48b1-5b09-4c2a-94a5-488dbe1b7375 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:48.123312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d22a48b1-5b09-4c2a-94a5-488dbe1b7375 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:48.124150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d22a48b1-5b09-4c2a-94a5-488dbe1b7375 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:48.258934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-23fccdbb-1031-4464-8726-6af8597d61f6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:48.260719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d22a48b1-5b09-4c2a-94a5-488dbe1b7375 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-23fccdbb-1031-4464-8726-6af8597d61f6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 416 Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'networks': [{'uuid': '57899def-7285-4d34-a6b9-8c4bdfce7a65'}]}}} Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:48.263310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:19:48.266355 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:48.267936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-23fccdbb-1031-4464-8726-6af8597d61f6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:48.267936 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-23fccdbb-1031-4464-8726-6af8597d61f6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.012863 Oct 12 22:19:48.269880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d22a48b1-5b09-4c2a-94a5-488dbe1b7375 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:48.271764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d22a48b1-5b09-4c2a-94a5-488dbe1b7375 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:48.272260 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2106/4793] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:19:48 2022] POST /compute/v2.1/servers => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:19:48.273310 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d22a48b1-5b09-4c2a-94a5-488dbe1b7375 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1365 microversion: 2.47 time: 0.199192 Oct 12 22:19:48.274412 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2688/4794] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:48 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:48.284194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dd923028-14aa-414f-be40-e2954aa9ba81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:48.285053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dd923028-14aa-414f-be40-e2954aa9ba81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:48.303663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd923028-14aa-414f-be40-e2954aa9ba81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:48.304831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd923028-14aa-414f-be40-e2954aa9ba81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:48.313919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd923028-14aa-414f-be40-e2954aa9ba81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:48.316738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd923028-14aa-414f-be40-e2954aa9ba81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:48.317499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd923028-14aa-414f-be40-e2954aa9ba81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:48.318040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd923028-14aa-414f-be40-e2954aa9ba81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:48.336483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:48.363672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e0490f86-3203-43df-a40c-d7b281cb07e0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:48.364291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e0490f86-3203-43df-a40c-d7b281cb07e0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:48.371536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0490f86-3203-43df-a40c-d7b281cb07e0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:48.372232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0490f86-3203-43df-a40c-d7b281cb07e0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:48.372675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0490f86-3203-43df-a40c-d7b281cb07e0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:48.373382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0490f86-3203-43df-a40c-d7b281cb07e0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:48.374769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0490f86-3203-43df-a40c-d7b281cb07e0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:48.375340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0490f86-3203-43df-a40c-d7b281cb07e0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:48.454876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e0490f86-3203-43df-a40c-d7b281cb07e0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:48.467278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e0490f86-3203-43df-a40c-d7b281cb07e0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:48.469662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e0490f86-3203-43df-a40c-d7b281cb07e0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:48.470938 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e0490f86-3203-43df-a40c-d7b281cb07e0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1605 microversion: 2.32 time: 0.111576 Oct 12 22:19:48.481808 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2689/4795] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:48 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1605 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:19:48.503519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-ddd99375-0522-4806-9bc1-60d110597759 req-d811cb6e-0904-454a-aa03-7c25bfdfbd87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feda1f68-7489-4648-8f7a-ab12030e50b3", "tag": "3c29066c-14d0-4255-a92b-549d245ed144"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:48.513890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ddd99375-0522-4806-9bc1-60d110597759 req-d811cb6e-0904-454a-aa03-7c25bfdfbd87 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:48.514597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ddd99375-0522-4806-9bc1-60d110597759 req-d811cb6e-0904-454a-aa03-7c25bfdfbd87 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:48.515321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ddd99375-0522-4806-9bc1-60d110597759 req-d811cb6e-0904-454a-aa03-7c25bfdfbd87 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:48.536016 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-ddd99375-0522-4806-9bc1-60d110597759 req-d811cb6e-0904-454a-aa03-7c25bfdfbd87 service nova] Creating event network-changed:3c29066c-14d0-4255-a92b-549d245ed144 for instance feda1f68-7489-4648-8f7a-ab12030e50b3 on n-h2-861111-1 Oct 12 22:19:48.542334 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-ddd99375-0522-4806-9bc1-60d110597759 req-d811cb6e-0904-454a-aa03-7c25bfdfbd87 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043553 Oct 12 22:19:48.543984 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2690/4796] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:19:48.813299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dd923028-14aa-414f-be40-e2954aa9ba81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:48.828047 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dd923028-14aa-414f-be40-e2954aa9ba81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.554648 Oct 12 22:19:48.828651 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2107/4797] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:48 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:48.857033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d6cdbf94-b250-4aef-ad04-3af8c2d19055 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:48.858627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d6cdbf94-b250-4aef-ad04-3af8c2d19055 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:48.878033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6cdbf94-b250-4aef-ad04-3af8c2d19055 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:48.881056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6cdbf94-b250-4aef-ad04-3af8c2d19055 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:48.882998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6cdbf94-b250-4aef-ad04-3af8c2d19055 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:48.888846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6cdbf94-b250-4aef-ad04-3af8c2d19055 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:48.889874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6cdbf94-b250-4aef-ad04-3af8c2d19055 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:48.890597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6cdbf94-b250-4aef-ad04-3af8c2d19055 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:49.094236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d6cdbf94-b250-4aef-ad04-3af8c2d19055 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:49.104235 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4c253710-d4c0-4cc9-ab22-d8fce00e46d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:49.105411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4c253710-d4c0-4cc9-ab22-d8fce00e46d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:49.106650 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d6cdbf94-b250-4aef-ad04-3af8c2d19055 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.256283 Oct 12 22:19:49.109533 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2691/4798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:48 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:49.117341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c253710-d4c0-4cc9-ab22-d8fce00e46d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:49.119610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c253710-d4c0-4cc9-ab22-d8fce00e46d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:49.120390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c253710-d4c0-4cc9-ab22-d8fce00e46d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:49.122108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c253710-d4c0-4cc9-ab22-d8fce00e46d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:49.124083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c253710-d4c0-4cc9-ab22-d8fce00e46d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:49.124795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c253710-d4c0-4cc9-ab22-d8fce00e46d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:49.303083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dfbfa438-8e46-4cc3-ba13-9b56f129103a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:49.304394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dfbfa438-8e46-4cc3-ba13-9b56f129103a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:49.313062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfbfa438-8e46-4cc3-ba13-9b56f129103a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:49.314033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfbfa438-8e46-4cc3-ba13-9b56f129103a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:49.314932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfbfa438-8e46-4cc3-ba13-9b56f129103a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:49.317020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfbfa438-8e46-4cc3-ba13-9b56f129103a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:49.317729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfbfa438-8e46-4cc3-ba13-9b56f129103a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:49.318390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfbfa438-8e46-4cc3-ba13-9b56f129103a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:49.425436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4c253710-d4c0-4cc9-ab22-d8fce00e46d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:49.434553 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4c253710-d4c0-4cc9-ab22-d8fce00e46d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1321 microversion: 2.1 time: 0.334442 Oct 12 22:19:49.442552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dfbfa438-8e46-4cc3-ba13-9b56f129103a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:49.443641 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2108/4799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:49 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:49.449707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a9595064-d486-4b29-a52b-f95da84b35f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-838752334", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": -1, "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:49.460394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dfbfa438-8e46-4cc3-ba13-9b56f129103a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:49.463636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dfbfa438-8e46-4cc3-ba13-9b56f129103a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:49.464854 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dfbfa438-8e46-4cc3-ba13-9b56f129103a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1365 microversion: 2.47 time: 0.168230 Oct 12 22:19:49.465417 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2692/4800] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:49 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:19:49.486565 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-a9595064-d486-4b29-a52b-f95da84b35f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Flavor -1 could not be found. Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a9595064-d486-4b29-a52b-f95da84b35f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 205 Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-838752334", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": -1, "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: exception: Flavor -1 could not be found. Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-838752334', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': -1, 'networks': [{'uuid': '57899def-7285-4d34-a6b9-8c4bdfce7a65'}]}}} Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:49.490241 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 12 22:19:49.498517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:49.503798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a9595064-d486-4b29-a52b-f95da84b35f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:49.503968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fdbf5bfc-8b36-4042-8089-158fc8f46049 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:49.504128 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a9595064-d486-4b29-a52b-f95da84b35f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.057581 Oct 12 22:19:49.504318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fdbf5bfc-8b36-4042-8089-158fc8f46049 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:49.510517 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2109/4801] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:19:49 2022] POST /compute/v2.1/servers => generated 73 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:19:49.517126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd70a27f-d140-4a7e-9b8e-63328964491a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:49.519499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cd70a27f-d140-4a7e-9b8e-63328964491a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:49.521539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdbf5bfc-8b36-4042-8089-158fc8f46049 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:49.522338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdbf5bfc-8b36-4042-8089-158fc8f46049 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:49.522718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdbf5bfc-8b36-4042-8089-158fc8f46049 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:49.523793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdbf5bfc-8b36-4042-8089-158fc8f46049 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:49.526049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdbf5bfc-8b36-4042-8089-158fc8f46049 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:49.527251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdbf5bfc-8b36-4042-8089-158fc8f46049 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:49.529469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd70a27f-d140-4a7e-9b8e-63328964491a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:49.529964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd70a27f-d140-4a7e-9b8e-63328964491a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:49.530407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd70a27f-d140-4a7e-9b8e-63328964491a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:49.531112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd70a27f-d140-4a7e-9b8e-63328964491a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:49.531612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd70a27f-d140-4a7e-9b8e-63328964491a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:49.532032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd70a27f-d140-4a7e-9b8e-63328964491a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:49.724861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fdbf5bfc-8b36-4042-8089-158fc8f46049 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:49.740373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fdbf5bfc-8b36-4042-8089-158fc8f46049 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:49.748469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fdbf5bfc-8b36-4042-8089-158fc8f46049 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:49.752261 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fdbf5bfc-8b36-4042-8089-158fc8f46049 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1605 microversion: 2.32 time: 0.257682 Oct 12 22:19:49.767674 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2693/4802] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:49 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1605 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:50.066754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cd70a27f-d140-4a7e-9b8e-63328964491a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:50.078462 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cd70a27f-d140-4a7e-9b8e-63328964491a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.566369 Oct 12 22:19:50.081694 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2110/4803] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:49 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:50.110202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-70d96089-2a97-44d2-8cab-eeabaea5403b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:50.114305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-70d96089-2a97-44d2-8cab-eeabaea5403b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:50.127384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70d96089-2a97-44d2-8cab-eeabaea5403b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:50.132594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70d96089-2a97-44d2-8cab-eeabaea5403b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:50.135513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70d96089-2a97-44d2-8cab-eeabaea5403b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:50.136630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70d96089-2a97-44d2-8cab-eeabaea5403b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:50.140841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70d96089-2a97-44d2-8cab-eeabaea5403b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:50.141619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70d96089-2a97-44d2-8cab-eeabaea5403b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:50.458992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-783a4b5f-7ff8-4d24-abc1-cdce665d2f60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:50.459674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-783a4b5f-7ff8-4d24-abc1-cdce665d2f60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:50.478919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-783a4b5f-7ff8-4d24-abc1-cdce665d2f60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:50.479753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-783a4b5f-7ff8-4d24-abc1-cdce665d2f60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:50.480360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-783a4b5f-7ff8-4d24-abc1-cdce665d2f60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:50.481249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-783a4b5f-7ff8-4d24-abc1-cdce665d2f60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:50.481864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-783a4b5f-7ff8-4d24-abc1-cdce665d2f60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:50.482480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-783a4b5f-7ff8-4d24-abc1-cdce665d2f60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:50.868875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-783a4b5f-7ff8-4d24-abc1-cdce665d2f60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:50.881534 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-783a4b5f-7ff8-4d24-abc1-cdce665d2f60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1321 microversion: 2.1 time: 0.427814 Oct 12 22:19:50.883764 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2111/4804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:50 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1321 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:50.892703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-70d96089-2a97-44d2-8cab-eeabaea5403b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:50.904496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1639083d-e622-4f20-8632-41c7fdc0d156 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:50.905762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1639083d-e622-4f20-8632-41c7fdc0d156 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:50.912148 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-70d96089-2a97-44d2-8cab-eeabaea5403b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.806588 Oct 12 22:19:50.916365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:50.917356 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2694/4805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:50 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:50.920829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1639083d-e622-4f20-8632-41c7fdc0d156 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:50.921624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1639083d-e622-4f20-8632-41c7fdc0d156 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:50.922337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1639083d-e622-4f20-8632-41c7fdc0d156 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:50.924332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1639083d-e622-4f20-8632-41c7fdc0d156 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:50.927319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1639083d-e622-4f20-8632-41c7fdc0d156 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:50.928121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1639083d-e622-4f20-8632-41c7fdc0d156 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:50.929167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-df46e55f-ad62-47ad-98cf-c6d830c52769 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:50.929864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-df46e55f-ad62-47ad-98cf-c6d830c52769 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:50.940124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df46e55f-ad62-47ad-98cf-c6d830c52769 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:50.940939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df46e55f-ad62-47ad-98cf-c6d830c52769 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:50.943030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df46e55f-ad62-47ad-98cf-c6d830c52769 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:50.954794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df46e55f-ad62-47ad-98cf-c6d830c52769 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:50.961023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df46e55f-ad62-47ad-98cf-c6d830c52769 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:50.968168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df46e55f-ad62-47ad-98cf-c6d830c52769 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:51.066437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1639083d-e622-4f20-8632-41c7fdc0d156 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:51.081471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1639083d-e622-4f20-8632-41c7fdc0d156 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:51.091727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1639083d-e622-4f20-8632-41c7fdc0d156 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:51.094120 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1639083d-e622-4f20-8632-41c7fdc0d156 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1365 microversion: 2.47 time: 0.208995 Oct 12 22:19:51.095819 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2112/4806] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:50 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:51.111421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-654c2fec-5bfc-4bf7-b0a4-13e87cda02e0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1739856865", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-654c2fec-5bfc-4bf7-b0a4-13e87cda02e0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 173 Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1739856865", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1739856865', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '57899def-7285-4d34-a6b9-8c4bdfce7a65'}]}}} Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi -1 Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:19:51.147861 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:19:51.158334 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:19:51.158334 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:19:51.158334 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:19:51.158334 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 12 22:19:51.158334 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:51.158334 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:51.158334 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:51.158334 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:51.158334 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:51.158334 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:51.158334 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:19:51.158334 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:19:51.158334 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 12 22:19:51.158334 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:51.158334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-654c2fec-5bfc-4bf7-b0a4-13e87cda02e0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:51.158334 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-654c2fec-5bfc-4bf7-b0a4-13e87cda02e0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.051268 Oct 12 22:19:51.158334 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2113/4807] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:19:51 2022] POST /compute/v2.1/servers => generated 145 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:19:51.161529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-009b98c3-66c9-428b-a476-d56cd8c42aed tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:51.162212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-009b98c3-66c9-428b-a476-d56cd8c42aed tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:51.171581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-009b98c3-66c9-428b-a476-d56cd8c42aed tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:51.172472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-009b98c3-66c9-428b-a476-d56cd8c42aed tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:51.172923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-009b98c3-66c9-428b-a476-d56cd8c42aed tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:51.173654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-009b98c3-66c9-428b-a476-d56cd8c42aed tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:51.174233 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-009b98c3-66c9-428b-a476-d56cd8c42aed tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:51.175502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-009b98c3-66c9-428b-a476-d56cd8c42aed tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:51.218424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-df46e55f-ad62-47ad-98cf-c6d830c52769 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:51.236672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-df46e55f-ad62-47ad-98cf-c6d830c52769 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:51.243039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-df46e55f-ad62-47ad-98cf-c6d830c52769 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:51.247944 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-df46e55f-ad62-47ad-98cf-c6d830c52769 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1605 microversion: 2.32 time: 0.326791 Oct 12 22:19:51.249217 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2695/4808] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:50 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1605 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:51.557191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-009b98c3-66c9-428b-a476-d56cd8c42aed tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:51.577620 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-009b98c3-66c9-428b-a476-d56cd8c42aed tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.416407 Oct 12 22:19:51.605007 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2114/4809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:51 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:51.611359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7c509ad9-fd99-4dad-b9bc-adef80bbb0ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:51.612882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7c509ad9-fd99-4dad-b9bc-adef80bbb0ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:51.626905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c509ad9-fd99-4dad-b9bc-adef80bbb0ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:51.628124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c509ad9-fd99-4dad-b9bc-adef80bbb0ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:51.629491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c509ad9-fd99-4dad-b9bc-adef80bbb0ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:51.630467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c509ad9-fd99-4dad-b9bc-adef80bbb0ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:51.632043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c509ad9-fd99-4dad-b9bc-adef80bbb0ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:51.633417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c509ad9-fd99-4dad-b9bc-adef80bbb0ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:51.908213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4818c18a-58bc-4a4b-b82a-081240fad0aa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:51.909745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4818c18a-58bc-4a4b-b82a-081240fad0aa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:51.926671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4818c18a-58bc-4a4b-b82a-081240fad0aa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:51.928772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4818c18a-58bc-4a4b-b82a-081240fad0aa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:51.929519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4818c18a-58bc-4a4b-b82a-081240fad0aa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:51.932697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4818c18a-58bc-4a4b-b82a-081240fad0aa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:51.933360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4818c18a-58bc-4a4b-b82a-081240fad0aa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:51.933962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4818c18a-58bc-4a4b-b82a-081240fad0aa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:52.146970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7c509ad9-fd99-4dad-b9bc-adef80bbb0ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:52.160301 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7c509ad9-fd99-4dad-b9bc-adef80bbb0ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.553605 Oct 12 22:19:52.161388 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2696/4810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:51 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:52.182443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-355d51c3-f1e6-4c03-af28-f52e03d0ce96 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:52.184182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-355d51c3-f1e6-4c03-af28-f52e03d0ce96 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:52.211491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-355d51c3-f1e6-4c03-af28-f52e03d0ce96 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:52.218408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-355d51c3-f1e6-4c03-af28-f52e03d0ce96 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:52.221032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-355d51c3-f1e6-4c03-af28-f52e03d0ce96 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:52.224000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-355d51c3-f1e6-4c03-af28-f52e03d0ce96 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:52.226040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-355d51c3-f1e6-4c03-af28-f52e03d0ce96 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:52.227015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-355d51c3-f1e6-4c03-af28-f52e03d0ce96 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:52.641008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-355d51c3-f1e6-4c03-af28-f52e03d0ce96 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:52.652970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-355d51c3-f1e6-4c03-af28-f52e03d0ce96 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:52.655349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-355d51c3-f1e6-4c03-af28-f52e03d0ce96 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:52.661482 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-355d51c3-f1e6-4c03-af28-f52e03d0ce96 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1365 microversion: 2.47 time: 0.494403 Oct 12 22:19:52.664039 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2697/4811] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:52 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1365 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:52.681402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4818c18a-58bc-4a4b-b82a-081240fad0aa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:52.692079 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4818c18a-58bc-4a4b-b82a-081240fad0aa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1321 microversion: 2.1 time: 0.786737 Oct 12 22:19:52.695130 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2115/4812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:51 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1321 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:52.699387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-32f81a15-1c4f-406d-aca9-351d4a03e1e8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:52.700140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-32f81a15-1c4f-406d-aca9-351d4a03e1e8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:52.724072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4516114f-d257-4596-85f3-f357f180c4ac tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-65410974", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:52.731812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32f81a15-1c4f-406d-aca9-351d4a03e1e8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:52.732286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32f81a15-1c4f-406d-aca9-351d4a03e1e8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:52.735300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32f81a15-1c4f-406d-aca9-351d4a03e1e8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:52.736077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32f81a15-1c4f-406d-aca9-351d4a03e1e8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:52.736595 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-4516114f-d257-4596-85f3-f357f180c4ac tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 12 22:19:52.737927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32f81a15-1c4f-406d-aca9-351d4a03e1e8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:52.738422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32f81a15-1c4f-406d-aca9-351d4a03e1e8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4516114f-d257-4596-85f3-f357f180c4ac tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 214 Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-65410974", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-65410974', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:52.743646 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:52.747915 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:52.747915 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:52.747915 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:52.747915 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:52.747915 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:52.747915 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:52.747915 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 12 22:19:52.747915 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:52.747915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4516114f-d257-4596-85f3-f357f180c4ac tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:52.747915 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4516114f-d257-4596-85f3-f357f180c4ac tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.046135 Oct 12 22:19:52.747915 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2116/4813] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:19:52 2022] POST /compute/v2.1/servers => generated 123 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:19:52.757989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-69551a98-7142-4f81-9792-d1176182b68e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:52.758530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-69551a98-7142-4f81-9792-d1176182b68e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:52.775000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69551a98-7142-4f81-9792-d1176182b68e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:52.775532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69551a98-7142-4f81-9792-d1176182b68e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:52.775979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69551a98-7142-4f81-9792-d1176182b68e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:52.776696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69551a98-7142-4f81-9792-d1176182b68e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:52.777478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69551a98-7142-4f81-9792-d1176182b68e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:52.777585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69551a98-7142-4f81-9792-d1176182b68e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:52.965925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-32f81a15-1c4f-406d-aca9-351d4a03e1e8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:52.986780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-32f81a15-1c4f-406d-aca9-351d4a03e1e8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:52.992198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-32f81a15-1c4f-406d-aca9-351d4a03e1e8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:52.996774 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-32f81a15-1c4f-406d-aca9-351d4a03e1e8 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1605 microversion: 2.32 time: 0.320182 Oct 12 22:19:52.997963 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2698/4814] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:52 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1605 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:53.709975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7f5b929f-2df3-4399-903b-5a4a9bd8c79a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:53.711564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7f5b929f-2df3-4399-903b-5a4a9bd8c79a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:53.720162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f5b929f-2df3-4399-903b-5a4a9bd8c79a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:53.721097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f5b929f-2df3-4399-903b-5a4a9bd8c79a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:53.721724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f5b929f-2df3-4399-903b-5a4a9bd8c79a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:53.722912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f5b929f-2df3-4399-903b-5a4a9bd8c79a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:53.723589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f5b929f-2df3-4399-903b-5a4a9bd8c79a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:53.724179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f5b929f-2df3-4399-903b-5a4a9bd8c79a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:53.762461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-69551a98-7142-4f81-9792-d1176182b68e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:53.778717 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-69551a98-7142-4f81-9792-d1176182b68e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 1.026292 Oct 12 22:19:53.780996 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2117/4815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:52 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:53.799563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-05d3c22d-072d-4bf7-8b5f-ee6cc5cc2f28 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:53.800612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-05d3c22d-072d-4bf7-8b5f-ee6cc5cc2f28 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:53.812221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05d3c22d-072d-4bf7-8b5f-ee6cc5cc2f28 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:53.814059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05d3c22d-072d-4bf7-8b5f-ee6cc5cc2f28 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:53.814604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05d3c22d-072d-4bf7-8b5f-ee6cc5cc2f28 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:53.816913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05d3c22d-072d-4bf7-8b5f-ee6cc5cc2f28 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:53.822292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05d3c22d-072d-4bf7-8b5f-ee6cc5cc2f28 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:53.822836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05d3c22d-072d-4bf7-8b5f-ee6cc5cc2f28 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:53.947810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7f5b929f-2df3-4399-903b-5a4a9bd8c79a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:53.961104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7f5b929f-2df3-4399-903b-5a4a9bd8c79a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:53.963840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7f5b929f-2df3-4399-903b-5a4a9bd8c79a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:53.965186 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7f5b929f-2df3-4399-903b-5a4a9bd8c79a tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1365 microversion: 2.47 time: 0.272418 Oct 12 22:19:53.965842 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2699/4816] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:53 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:53.999920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0b9d96f5-1d99-4894-b5da-348f23757ec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:54.000768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0b9d96f5-1d99-4894-b5da-348f23757ec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:54.020891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b9d96f5-1d99-4894-b5da-348f23757ec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:54.021512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b9d96f5-1d99-4894-b5da-348f23757ec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:54.025053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b9d96f5-1d99-4894-b5da-348f23757ec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:54.026878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b9d96f5-1d99-4894-b5da-348f23757ec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:54.030293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b9d96f5-1d99-4894-b5da-348f23757ec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:54.030707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b9d96f5-1d99-4894-b5da-348f23757ec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:54.503684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0b9d96f5-1d99-4894-b5da-348f23757ec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:54.518757 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0b9d96f5-1d99-4894-b5da-348f23757ec2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.550100 Oct 12 22:19:54.520740 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2700/4817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:53 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:54.544850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7b848512-355a-4ce6-972d-b945da1a3d09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:54.545885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7b848512-355a-4ce6-972d-b945da1a3d09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:54.575268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-05d3c22d-072d-4bf7-8b5f-ee6cc5cc2f28 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:54.590890 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-05d3c22d-072d-4bf7-8b5f-ee6cc5cc2f28 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1321 microversion: 2.1 time: 0.803563 Oct 12 22:19:54.593247 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2118/4818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:53 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1321 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:54.601259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b848512-355a-4ce6-972d-b945da1a3d09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:54.603517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b848512-355a-4ce6-972d-b945da1a3d09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:54.604816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b848512-355a-4ce6-972d-b945da1a3d09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:54.608146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b848512-355a-4ce6-972d-b945da1a3d09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:54.608944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b848512-355a-4ce6-972d-b945da1a3d09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:54.610124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b848512-355a-4ce6-972d-b945da1a3d09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:54.684380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-34bca1a8-a5ea-4073-866b-710acbcb5fcc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1092092824", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "key_name": "tempest-key-260098466", "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:54.790281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-34bca1a8-a5ea-4073-866b-710acbcb5fcc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] validate_networks() for [('57899def-7285-4d34-a6b9-8c4bdfce7a65', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:19:54.818443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7b848512-355a-4ce6-972d-b945da1a3d09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:54.839442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7b848512-355a-4ce6-972d-b945da1a3d09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:54.841128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7b848512-355a-4ce6-972d-b945da1a3d09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:54.843951 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7b848512-355a-4ce6-972d-b945da1a3d09 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1605 microversion: 2.32 time: 0.319892 Oct 12 22:19:54.845591 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2701/4819] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:54 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1605 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:55.000197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a8dadd28-04cc-4343-b49e-8325fd85e785 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:55.003780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a8dadd28-04cc-4343-b49e-8325fd85e785 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:55.030183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8dadd28-04cc-4343-b49e-8325fd85e785 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:55.031265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8dadd28-04cc-4343-b49e-8325fd85e785 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:55.032101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8dadd28-04cc-4343-b49e-8325fd85e785 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:55.035764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8dadd28-04cc-4343-b49e-8325fd85e785 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:55.037638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8dadd28-04cc-4343-b49e-8325fd85e785 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:55.038788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8dadd28-04cc-4343-b49e-8325fd85e785 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:55.261705 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-34bca1a8-a5ea-4073-866b-710acbcb5fcc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Invalid key_name provided. Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-34bca1a8-a5ea-4073-866b-710acbcb5fcc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 246 Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1092092824", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "key_name": "tempest-key-260098466", "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid key_name provided. Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1092092824', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'key_name': 'tempest-key-260098466', 'networks': [{'uuid': '57899def-7285-4d34-a6b9-8c4bdfce7a65'}]}}} Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-260098466 not found for user db077881dc7b4893a480d71484c5cba9 Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:55.263580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-34bca1a8-a5ea-4073-866b-710acbcb5fcc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 400 to user: Invalid key_name provided. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-34bca1a8-a5ea-4073-866b-710acbcb5fcc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.591726 Oct 12 22:19:55.268019 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2119/4820] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:19:54 2022] POST /compute/v2.1/servers => generated 70 bytes in 593 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:19:55.279344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ed0f0c9b-d481-4353-9323-f27316a3e0c9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:55.279977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ed0f0c9b-d481-4353-9323-f27316a3e0c9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:55.286666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed0f0c9b-d481-4353-9323-f27316a3e0c9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:55.287153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed0f0c9b-d481-4353-9323-f27316a3e0c9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:55.287802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed0f0c9b-d481-4353-9323-f27316a3e0c9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:55.288737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed0f0c9b-d481-4353-9323-f27316a3e0c9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:55.289347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed0f0c9b-d481-4353-9323-f27316a3e0c9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:55.289934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed0f0c9b-d481-4353-9323-f27316a3e0c9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:55.476065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ed0f0c9b-d481-4353-9323-f27316a3e0c9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:55.486175 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ed0f0c9b-d481-4353-9323-f27316a3e0c9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.211277 Oct 12 22:19:55.498451 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2120/4821] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:55 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:55.519184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-51d0e918-06d5-455b-b2e3-b98bed3fe692 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:55.519835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-51d0e918-06d5-455b-b2e3-b98bed3fe692 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:55.536705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51d0e918-06d5-455b-b2e3-b98bed3fe692 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:55.537452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51d0e918-06d5-455b-b2e3-b98bed3fe692 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:55.538061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51d0e918-06d5-455b-b2e3-b98bed3fe692 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:55.541775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51d0e918-06d5-455b-b2e3-b98bed3fe692 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:55.542527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51d0e918-06d5-455b-b2e3-b98bed3fe692 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:55.543272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51d0e918-06d5-455b-b2e3-b98bed3fe692 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:55.786232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-51d0e918-06d5-455b-b2e3-b98bed3fe692 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:55.794509 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-51d0e918-06d5-455b-b2e3-b98bed3fe692 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.284222 Oct 12 22:19:55.795157 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2121/4822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:55 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:55.823175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b375d40d-22e1-4049-bcce-889a2f8b6ee8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:55.824012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b375d40d-22e1-4049-bcce-889a2f8b6ee8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:55.832054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b375d40d-22e1-4049-bcce-889a2f8b6ee8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:55.832553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b375d40d-22e1-4049-bcce-889a2f8b6ee8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:55.833007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b375d40d-22e1-4049-bcce-889a2f8b6ee8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:55.834012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b375d40d-22e1-4049-bcce-889a2f8b6ee8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:55.834472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b375d40d-22e1-4049-bcce-889a2f8b6ee8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:55.834916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b375d40d-22e1-4049-bcce-889a2f8b6ee8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:56.140393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a8dadd28-04cc-4343-b49e-8325fd85e785 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:56.150719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b375d40d-22e1-4049-bcce-889a2f8b6ee8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:56.159569 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b375d40d-22e1-4049-bcce-889a2f8b6ee8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1321 microversion: 2.1 time: 0.350377 Oct 12 22:19:56.163417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a8dadd28-04cc-4343-b49e-8325fd85e785 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:56.170906 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2122/4823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:55 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:56.179124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bac6b269-8eef-4f00-99c0-237cc4f0a06f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:56.182542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bac6b269-8eef-4f00-99c0-237cc4f0a06f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:56.186111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a8dadd28-04cc-4343-b49e-8325fd85e785 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:56.191611 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a8dadd28-04cc-4343-b49e-8325fd85e785 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1365 microversion: 2.47 time: 1.195007 Oct 12 22:19:56.192258 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2702/4824] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:54 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1365 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:56.209105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bac6b269-8eef-4f00-99c0-237cc4f0a06f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:56.209524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bac6b269-8eef-4f00-99c0-237cc4f0a06f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:56.209966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bac6b269-8eef-4f00-99c0-237cc4f0a06f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:56.210680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bac6b269-8eef-4f00-99c0-237cc4f0a06f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:56.211139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bac6b269-8eef-4f00-99c0-237cc4f0a06f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:56.212653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af282cf6-3a69-42d0-a8bf-f2cdb31b2d81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2083435943", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:56.224913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bac6b269-8eef-4f00-99c0-237cc4f0a06f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:56.340819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bac6b269-8eef-4f00-99c0-237cc4f0a06f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:56.343964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bac6b269-8eef-4f00-99c0-237cc4f0a06f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:56.344631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bac6b269-8eef-4f00-99c0-237cc4f0a06f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:56.345320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-bac6b269-8eef-4f00-99c0-237cc4f0a06f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lazy-loading 'fault' on Instance uuid 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:19:56.481056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.security_group_api [None req-af282cf6-3a69-42d0-a8bf-f2cdb31b2d81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Neutron security group does_not_exist not found {{(pid=120453) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 12 22:19:56.481855 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-af282cf6-3a69-42d0-a8bf-f2cdb31b2d81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 12 22:19:56.487595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bac6b269-8eef-4f00-99c0-237cc4f0a06f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af282cf6-3a69-42d0-a8bf-f2cdb31b2d81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 258 Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2083435943", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2083435943', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '57899def-7285-4d34-a6b9-8c4bdfce7a65'}]}}} Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 12 22:19:56.491478 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 12 22:19:56.496656 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:56.503690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af282cf6-3a69-42d0-a8bf-f2cdb31b2d81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:56.504177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bac6b269-8eef-4f00-99c0-237cc4f0a06f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:56.504576 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-af282cf6-3a69-42d0-a8bf-f2cdb31b2d81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.309823 Oct 12 22:19:56.505774 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2703/4825] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:19:56 2022] POST /compute/v2.1/servers => generated 106 bytes in 313 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:19:56.507614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bac6b269-8eef-4f00-99c0-237cc4f0a06f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:56.513549 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bac6b269-8eef-4f00-99c0-237cc4f0a06f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1610 microversion: 2.32 time: 0.339233 Oct 12 22:19:56.514320 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2123/4826] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:56 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1610 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:56.516128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-8504b1b9-0b8c-453d-aaea-b14599eb9635 req-544db160-88fb-44a3-b333-7ef4924fd332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7013657e-c4d1-4af9-b593-b891d2d1c66b", "name": "network-vif-plugged", "status": "completed", "tag": "aa91f8c1-414a-41aa-a5f3-ac7cbe6b2ab9"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:56.531449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2be0a050-7276-49f5-9937-a14fcfc9f1f5 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:56.532086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2be0a050-7276-49f5-9937-a14fcfc9f1f5 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:56.532605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8504b1b9-0b8c-453d-aaea-b14599eb9635 req-544db160-88fb-44a3-b333-7ef4924fd332 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:56.533268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8504b1b9-0b8c-453d-aaea-b14599eb9635 req-544db160-88fb-44a3-b333-7ef4924fd332 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:56.534838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8504b1b9-0b8c-453d-aaea-b14599eb9635 req-544db160-88fb-44a3-b333-7ef4924fd332 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:56.553070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2be0a050-7276-49f5-9937-a14fcfc9f1f5 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:56.553627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2be0a050-7276-49f5-9937-a14fcfc9f1f5 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:56.554074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2be0a050-7276-49f5-9937-a14fcfc9f1f5 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:56.554810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2be0a050-7276-49f5-9937-a14fcfc9f1f5 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:56.559601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2be0a050-7276-49f5-9937-a14fcfc9f1f5 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:56.560237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2be0a050-7276-49f5-9937-a14fcfc9f1f5 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:56.564101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:56.568289 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-8504b1b9-0b8c-453d-aaea-b14599eb9635 req-544db160-88fb-44a3-b333-7ef4924fd332 service nova] Creating event network-vif-plugged:aa91f8c1-414a-41aa-a5f3-ac7cbe6b2ab9 for instance 7013657e-c4d1-4af9-b593-b891d2d1c66b on n-h2-861111-1 Oct 12 22:19:56.575278 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-8504b1b9-0b8c-453d-aaea-b14599eb9635 req-544db160-88fb-44a3-b333-7ef4924fd332 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067894 Oct 12 22:19:56.576165 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2704/4827] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:56.936870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2be0a050-7276-49f5-9937-a14fcfc9f1f5 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:56.956277 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2be0a050-7276-49f5-9937-a14fcfc9f1f5 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.439592 Oct 12 22:19:56.958914 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2124/4828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:56 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:56.981176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7fe1a5b9-5b61-4917-93da-9e752ad49b2a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:56.982511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7fe1a5b9-5b61-4917-93da-9e752ad49b2a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:56.999499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fe1a5b9-5b61-4917-93da-9e752ad49b2a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:57.003509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fe1a5b9-5b61-4917-93da-9e752ad49b2a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:57.003964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fe1a5b9-5b61-4917-93da-9e752ad49b2a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:57.004708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fe1a5b9-5b61-4917-93da-9e752ad49b2a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:57.005174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fe1a5b9-5b61-4917-93da-9e752ad49b2a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:57.005606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fe1a5b9-5b61-4917-93da-9e752ad49b2a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:57.198248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ea1a3b39-e5ef-4fbc-b1ff-6a2ac4706b0e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:57.199002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ea1a3b39-e5ef-4fbc-b1ff-6a2ac4706b0e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:57.207864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea1a3b39-e5ef-4fbc-b1ff-6a2ac4706b0e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:57.210732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea1a3b39-e5ef-4fbc-b1ff-6a2ac4706b0e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:57.211187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea1a3b39-e5ef-4fbc-b1ff-6a2ac4706b0e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:57.211961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea1a3b39-e5ef-4fbc-b1ff-6a2ac4706b0e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:57.212422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea1a3b39-e5ef-4fbc-b1ff-6a2ac4706b0e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:57.212855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea1a3b39-e5ef-4fbc-b1ff-6a2ac4706b0e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:57.328281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7fe1a5b9-5b61-4917-93da-9e752ad49b2a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:57.341120 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7fe1a5b9-5b61-4917-93da-9e752ad49b2a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.365021 Oct 12 22:19:57.341711 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2705/4829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:56 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:57.359506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bcddc7e5-03e0-4de4-87d2-27cc7eb3244d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:57.360379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bcddc7e5-03e0-4de4-87d2-27cc7eb3244d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:57.366841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcddc7e5-03e0-4de4-87d2-27cc7eb3244d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:57.367345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcddc7e5-03e0-4de4-87d2-27cc7eb3244d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:57.367785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcddc7e5-03e0-4de4-87d2-27cc7eb3244d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:57.368505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcddc7e5-03e0-4de4-87d2-27cc7eb3244d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:57.368969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcddc7e5-03e0-4de4-87d2-27cc7eb3244d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:57.369613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcddc7e5-03e0-4de4-87d2-27cc7eb3244d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:57.479146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bcddc7e5-03e0-4de4-87d2-27cc7eb3244d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:57.488956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bcddc7e5-03e0-4de4-87d2-27cc7eb3244d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:57.494034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bcddc7e5-03e0-4de4-87d2-27cc7eb3244d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:57.497566 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bcddc7e5-03e0-4de4-87d2-27cc7eb3244d tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1365 microversion: 2.47 time: 0.153286 Oct 12 22:19:57.516333 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2706/4830] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:57 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:57.529483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f6b03ff5-8b3e-47c9-b593-8046148a7532 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:57.533553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f6b03ff5-8b3e-47c9-b593-8046148a7532 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 83378749-5217-4785-9ebc-dd66d2d837f1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:57.547799 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-f6b03ff5-8b3e-47c9-b593-8046148a7532 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 83378749-5217-4785-9ebc-dd66d2d837f1 could not be found. Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f6b03ff5-8b3e-47c9-b593-8046148a7532 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/83378749-5217-4785-9ebc-dd66d2d837f1 HTTP/1.1 Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 83378749-5217-4785-9ebc-dd66d2d837f1 could not be found. Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '83378749-5217-4785-9ebc-dd66d2d837f1'} Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83378749-5217-4785-9ebc-dd66d2d837f1 could not be found. Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83378749-5217-4785-9ebc-dd66d2d837f1 could not be found. Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:57.549874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:57.554423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:57.554423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:57.554423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:57.554423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:57.554423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:57.554423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:57.554423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83378749-5217-4785-9ebc-dd66d2d837f1 could not be found. Oct 12 22:19:57.554423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:57.556152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f6b03ff5-8b3e-47c9-b593-8046148a7532 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 83378749-5217-4785-9ebc-dd66d2d837f1 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:57.568499 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f6b03ff5-8b3e-47c9-b593-8046148a7532 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "DELETE /compute/v2.1/servers/83378749-5217-4785-9ebc-dd66d2d837f1" status: 404 len: 111 microversion: 2.1 time: 0.050818 Oct 12 22:19:57.569394 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2707/4831] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:19:57 2022] DELETE /compute/v2.1/servers/83378749-5217-4785-9ebc-dd66d2d837f1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:19:57.576888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4f88216c-459c-4b95-a5bb-1167881805d0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:57.577165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ea1a3b39-e5ef-4fbc-b1ff-6a2ac4706b0e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:57.578029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4f88216c-459c-4b95-a5bb-1167881805d0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:57.588696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f88216c-459c-4b95-a5bb-1167881805d0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:57.591097 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ea1a3b39-e5ef-4fbc-b1ff-6a2ac4706b0e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1321 microversion: 2.1 time: 0.395610 Oct 12 22:19:57.591854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f88216c-459c-4b95-a5bb-1167881805d0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:57.593202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f88216c-459c-4b95-a5bb-1167881805d0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:57.595446 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2125/4832] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:57 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:19:57.596457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f88216c-459c-4b95-a5bb-1167881805d0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:57.597133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f88216c-459c-4b95-a5bb-1167881805d0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:57.597757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f88216c-459c-4b95-a5bb-1167881805d0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:57.604274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c3073f0c-d52b-42e1-bc2c-7029ec11c694 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:57.604907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c3073f0c-d52b-42e1-bc2c-7029ec11c694 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:57.618025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3073f0c-d52b-42e1-bc2c-7029ec11c694 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:57.618528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3073f0c-d52b-42e1-bc2c-7029ec11c694 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:57.618973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3073f0c-d52b-42e1-bc2c-7029ec11c694 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:57.620344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3073f0c-d52b-42e1-bc2c-7029ec11c694 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:57.625340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3073f0c-d52b-42e1-bc2c-7029ec11c694 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:57.625798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3073f0c-d52b-42e1-bc2c-7029ec11c694 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:57.674304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f88216c-459c-4b95-a5bb-1167881805d0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:57.674955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f88216c-459c-4b95-a5bb-1167881805d0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:57.681054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f88216c-459c-4b95-a5bb-1167881805d0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:57.681923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-4f88216c-459c-4b95-a5bb-1167881805d0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lazy-loading 'fault' on Instance uuid 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:19:57.752366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4f88216c-459c-4b95-a5bb-1167881805d0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:57.774369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4f88216c-459c-4b95-a5bb-1167881805d0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:57.780212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4f88216c-459c-4b95-a5bb-1167881805d0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6c240d338349f89c5cc98058ea225c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8bf42585148ff9e29ab4bb8f932a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:57.785385 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4f88216c-459c-4b95-a5bb-1167881805d0 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 200 len: 1610 microversion: 2.32 time: 0.214543 Oct 12 22:19:57.787946 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2708/4833] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:57 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 1610 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:58.094613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c3073f0c-d52b-42e1-bc2c-7029ec11c694 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:58.119873 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c3073f0c-d52b-42e1-bc2c-7029ec11c694 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.523184 Oct 12 22:19:58.120580 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2126/4834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:57 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:58.144696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9086e33e-96ac-43d1-9c0d-db94d193119a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:58.145508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9086e33e-96ac-43d1-9c0d-db94d193119a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:58.155096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9086e33e-96ac-43d1-9c0d-db94d193119a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:58.156953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9086e33e-96ac-43d1-9c0d-db94d193119a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:58.157651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9086e33e-96ac-43d1-9c0d-db94d193119a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:58.158654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9086e33e-96ac-43d1-9c0d-db94d193119a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:58.159428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9086e33e-96ac-43d1-9c0d-db94d193119a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:58.160110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9086e33e-96ac-43d1-9c0d-db94d193119a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:58.498736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9086e33e-96ac-43d1-9c0d-db94d193119a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:58.520032 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9086e33e-96ac-43d1-9c0d-db94d193119a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.379755 Oct 12 22:19:58.520915 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2709/4835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:58 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:58.538694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ba458806-8813-45a1-98bd-f243d64b7456 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:58.539659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ba458806-8813-45a1-98bd-f243d64b7456 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:58.545941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af28320a-acf4-4d32-a5c6-fb5e0cc6f69b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:58.549675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-af28320a-acf4-4d32-a5c6-fb5e0cc6f69b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 22:19:58.550576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba458806-8813-45a1-98bd-f243d64b7456 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:58.551078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba458806-8813-45a1-98bd-f243d64b7456 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:58.552992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba458806-8813-45a1-98bd-f243d64b7456 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:58.553401 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-af28320a-acf4-4d32-a5c6-fb5e0cc6f69b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 12 22:19:58.553746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba458806-8813-45a1-98bd-f243d64b7456 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:58.554211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba458806-8813-45a1-98bd-f243d64b7456 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:58.554650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba458806-8813-45a1-98bd-f243d64b7456 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af28320a-acf4-4d32-a5c6-fb5e0cc6f69b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 9223372036854775808 could not be found. Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '9223372036854775808'} Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:58.555970 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:58.560713 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:58.560713 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:58.560713 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:58.560713 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 12 22:19:58.560713 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:58.567981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af28320a-acf4-4d32-a5c6-fb5e0cc6f69b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:58.570573 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-af28320a-acf4-4d32-a5c6-fb5e0cc6f69b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.031067 Oct 12 22:19:58.571682 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2710/4836] 10.222.0.16 () {58 vars in 1188 bytes} [Wed Oct 12 22:19:58 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:19:58.582268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-457be33c-8b55-4b94-96b6-f82e333ff155 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:58.583155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-457be33c-8b55-4b94-96b6-f82e333ff155 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:58.593747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-457be33c-8b55-4b94-96b6-f82e333ff155 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:58.594580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-457be33c-8b55-4b94-96b6-f82e333ff155 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:58.595289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-457be33c-8b55-4b94-96b6-f82e333ff155 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:58.596948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-457be33c-8b55-4b94-96b6-f82e333ff155 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:58.597658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-457be33c-8b55-4b94-96b6-f82e333ff155 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:58.598290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-457be33c-8b55-4b94-96b6-f82e333ff155 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:58.683695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba458806-8813-45a1-98bd-f243d64b7456 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:58.686158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:19:58.701577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba458806-8813-45a1-98bd-f243d64b7456 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:58.706561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba458806-8813-45a1-98bd-f243d64b7456 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:58.714393 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ba458806-8813-45a1-98bd-f243d64b7456 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1371 microversion: 2.47 time: 0.174588 Oct 12 22:19:58.715859 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2127/4837] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:58 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:19:58.724679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fa673cd0-a9b8-49cf-8ba8-05ca39073cc3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:58.726352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fa673cd0-a9b8-49cf-8ba8-05ca39073cc3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:58.735117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa673cd0-a9b8-49cf-8ba8-05ca39073cc3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:58.736107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa673cd0-a9b8-49cf-8ba8-05ca39073cc3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:58.737825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa673cd0-a9b8-49cf-8ba8-05ca39073cc3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:58.739213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa673cd0-a9b8-49cf-8ba8-05ca39073cc3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:58.740849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa673cd0-a9b8-49cf-8ba8-05ca39073cc3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:58.741722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa673cd0-a9b8-49cf-8ba8-05ca39073cc3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:58.956501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-457be33c-8b55-4b94-96b6-f82e333ff155 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:58.975821 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-457be33c-8b55-4b94-96b6-f82e333ff155 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.398596 Oct 12 22:19:58.977741 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2711/4838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:58 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:58.988199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ee586a40-a77a-4bb6-aa72-e108c436a797 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:58.989525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ee586a40-a77a-4bb6-aa72-e108c436a797 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:59.004191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee586a40-a77a-4bb6-aa72-e108c436a797 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:59.005371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee586a40-a77a-4bb6-aa72-e108c436a797 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:59.005990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee586a40-a77a-4bb6-aa72-e108c436a797 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:59.006863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee586a40-a77a-4bb6-aa72-e108c436a797 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:59.007361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee586a40-a77a-4bb6-aa72-e108c436a797 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:59.007785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee586a40-a77a-4bb6-aa72-e108c436a797 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:59.022894 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-ee586a40-a77a-4bb6-aa72-e108c436a797 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] HTTP exception thrown: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ee586a40-a77a-4bb6-aa72-e108c436a797 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Request method failure captured: Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 HTTP/1.1 Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzvxvMP8af9d7xsjbdJozhiVPQiRQBrxh35M-_RLfTwgweT9hsqfTZrhM2F4o8wY9xU2P22DfzxouAhl4xhmG_FjQjwllnXmkziv1YibXjaNomu9qHVhB1P6z-oCqFEgEo9fG8uT_dkuKtckQW2h616PCowNZNZV8Jzw68tAHQGQ_ok Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.32 Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: d8a8bf42585148ff9e29ab4bb8f932a6 Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TaggedBootDevicesTest-1238568002 Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d8a8bf42585148ff9e29ab4bb8f932a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d8a8bf42585148ff9e29ab4bb8f932a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d8a8bf42585148ff9e29ab4bb8f932a6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d8a8bf42585148ff9e29ab4bb8f932a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TaggedBootDevicesTest-1238568002 Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: d8a8bf42585148ff9e29ab4bb8f932a6 Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1238568002 Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TaggedBootDevicesTest-1238568002-project Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: ea6c240d338349f89c5cc98058ea225c Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TaggedBootDevicesTest-1238568002-project Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '76adeecb-a1c3-4d3b-8643-47bcb8c759e0'} Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:59.024818 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:59.028841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:59.028841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:59.028841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:59.028841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:59.028841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:59.028841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:59.028841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. Oct 12 22:19:59.028841 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:59.030718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ee586a40-a77a-4bb6-aa72-e108c436a797 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Returning 404 to user: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:59.031803 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ee586a40-a77a-4bb6-aa72-e108c436a797 tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 404 len: 111 microversion: 2.32 time: 0.052870 Oct 12 22:19:59.032382 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2712/4839] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:58 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:19:59.037802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-49e66707-a777-4768-8e8e-4e5caf067505 req-cf0691e7-66ee-4d07-b7d5-b17c3f6c9cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feda1f68-7489-4648-8f7a-ab12030e50b3", "name": "network-vif-plugged", "status": "completed", "tag": "3c29066c-14d0-4255-a92b-549d245ed144"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:19:59.048989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-49e66707-a777-4768-8e8e-4e5caf067505 req-cf0691e7-66ee-4d07-b7d5-b17c3f6c9cbc service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:59.049919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-49e66707-a777-4768-8e8e-4e5caf067505 req-cf0691e7-66ee-4d07-b7d5-b17c3f6c9cbc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:59.050538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-49e66707-a777-4768-8e8e-4e5caf067505 req-cf0691e7-66ee-4d07-b7d5-b17c3f6c9cbc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:59.063011 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-49e66707-a777-4768-8e8e-4e5caf067505 req-cf0691e7-66ee-4d07-b7d5-b17c3f6c9cbc service nova] Creating event network-vif-plugged:3c29066c-14d0-4255-a92b-549d245ed144 for instance feda1f68-7489-4648-8f7a-ab12030e50b3 on n-h2-861111-1 Oct 12 22:19:59.087277 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-49e66707-a777-4768-8e8e-4e5caf067505 req-cf0691e7-66ee-4d07-b7d5-b17c3f6c9cbc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052277 Oct 12 22:19:59.089375 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2713/4840] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:19:59.094616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fa673cd0-a9b8-49cf-8ba8-05ca39073cc3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:59.105146 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fa673cd0-a9b8-49cf-8ba8-05ca39073cc3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1321 microversion: 2.1 time: 0.387774 Oct 12 22:19:59.106822 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2128/4841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:58 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:59.124444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e00c2f19-6d40-46a6-a785-b43cd88ecb40 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:59.124690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-32b00dd7-e10d-4438-b33a-b5d9ec500c7e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '.version_select at 0x7f51282e24c0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:59.129090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e00c2f19-6d40-46a6-a785-b43cd88ecb40 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:59.154192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e00c2f19-6d40-46a6-a785-b43cd88ecb40 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:59.154794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e00c2f19-6d40-46a6-a785-b43cd88ecb40 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:59.155360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e00c2f19-6d40-46a6-a785-b43cd88ecb40 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:59.156258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e00c2f19-6d40-46a6-a785-b43cd88ecb40 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:59.156942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e00c2f19-6d40-46a6-a785-b43cd88ecb40 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:59.157586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e00c2f19-6d40-46a6-a785-b43cd88ecb40 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:59.164700 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-32b00dd7-e10d-4438-b33a-b5d9ec500c7e tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1803936241" status: 204 len: 0 microversion: 2.32 time: 0.054734 Oct 12 22:19:59.165486 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2129/4842] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 12 22:19:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1803936241 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:19:59.728625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e00c2f19-6d40-46a6-a785-b43cd88ecb40 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:59.740692 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e00c2f19-6d40-46a6-a785-b43cd88ecb40 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.641076 Oct 12 22:19:59.741980 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2714/4843] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:59 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:19:59.743778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2f8722fa-5d47-4a5e-9436-6af833869056 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:59.744408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f8722fa-5d47-4a5e-9436-6af833869056 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:59.754623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f8722fa-5d47-4a5e-9436-6af833869056 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:59.755118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f8722fa-5d47-4a5e-9436-6af833869056 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:59.755597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f8722fa-5d47-4a5e-9436-6af833869056 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:59.756316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f8722fa-5d47-4a5e-9436-6af833869056 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:59.756776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f8722fa-5d47-4a5e-9436-6af833869056 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:59.757207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f8722fa-5d47-4a5e-9436-6af833869056 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:59.765747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-512d518b-9812-46b5-81e5-6886164a07f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:59.766590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-512d518b-9812-46b5-81e5-6886164a07f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Failed to fetch instance by id -1 {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 22:19:59.768479 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-512d518b-9812-46b5-81e5-6886164a07f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance -1 could not be found. Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-512d518b-9812-46b5-81e5-6886164a07f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance -1 could not be found. Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '-1'} Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:19:59.770401 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:19:59.774155 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:19:59.774155 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:19:59.774155 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 12 22:19:59.774155 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:19:59.776509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-512d518b-9812-46b5-81e5-6886164a07f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:19:59.779581 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-512d518b-9812-46b5-81e5-6886164a07f8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.017737 Oct 12 22:19:59.783579 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2715/4844] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:19:59 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:19:59.790712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5c9e45e9-4ff4-45d0-a757-29df56c1c8f1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:19:59.791681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5c9e45e9-4ff4-45d0-a757-29df56c1c8f1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:19:59.799370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c9e45e9-4ff4-45d0-a757-29df56c1c8f1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:59.799861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c9e45e9-4ff4-45d0-a757-29df56c1c8f1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:59.800541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c9e45e9-4ff4-45d0-a757-29df56c1c8f1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:59.801993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c9e45e9-4ff4-45d0-a757-29df56c1c8f1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:19:59.802671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c9e45e9-4ff4-45d0-a757-29df56c1c8f1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:19:59.803275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c9e45e9-4ff4-45d0-a757-29df56c1c8f1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:19:59.865972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f8722fa-5d47-4a5e-9436-6af833869056 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:59.876329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f8722fa-5d47-4a5e-9436-6af833869056 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:59.879338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f8722fa-5d47-4a5e-9436-6af833869056 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:19:59.880922 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2f8722fa-5d47-4a5e-9436-6af833869056 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1371 microversion: 2.47 time: 0.141949 Oct 12 22:19:59.895854 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2130/4845] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:19:59 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:20:00.135636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0cac7a8a-eba0-4105-a071-6c2a0cce197a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:00.137622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0cac7a8a-eba0-4105-a071-6c2a0cce197a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:00.150796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cac7a8a-eba0-4105-a071-6c2a0cce197a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:00.151511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cac7a8a-eba0-4105-a071-6c2a0cce197a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:00.153444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cac7a8a-eba0-4105-a071-6c2a0cce197a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:00.154265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cac7a8a-eba0-4105-a071-6c2a0cce197a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:00.155103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cac7a8a-eba0-4105-a071-6c2a0cce197a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:00.155912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cac7a8a-eba0-4105-a071-6c2a0cce197a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:00.232193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5c9e45e9-4ff4-45d0-a757-29df56c1c8f1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:00.243038 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5c9e45e9-4ff4-45d0-a757-29df56c1c8f1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.457740 Oct 12 22:20:00.244307 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2716/4846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:19:59 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:00.269546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8ac836a7-0df2-4267-8791-8705ebf49137 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:00.270191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8ac836a7-0df2-4267-8791-8705ebf49137 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:00.290500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ac836a7-0df2-4267-8791-8705ebf49137 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:00.291029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ac836a7-0df2-4267-8791-8705ebf49137 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:00.291504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ac836a7-0df2-4267-8791-8705ebf49137 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:00.293584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ac836a7-0df2-4267-8791-8705ebf49137 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:00.293584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ac836a7-0df2-4267-8791-8705ebf49137 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:00.294131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ac836a7-0df2-4267-8791-8705ebf49137 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:00.375478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0cac7a8a-eba0-4105-a071-6c2a0cce197a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:00.386246 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0cac7a8a-eba0-4105-a071-6c2a0cce197a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1321 microversion: 2.1 time: 0.256813 Oct 12 22:20:00.386730 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2131/4847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:00 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:00.912424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bd2310a8-d00d-4937-b47c-b6b98410f3a0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:00.913060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bd2310a8-d00d-4937-b47c-b6b98410f3a0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:00.929461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd2310a8-d00d-4937-b47c-b6b98410f3a0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:00.931886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd2310a8-d00d-4937-b47c-b6b98410f3a0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:00.932424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd2310a8-d00d-4937-b47c-b6b98410f3a0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:00.933867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd2310a8-d00d-4937-b47c-b6b98410f3a0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:00.934544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd2310a8-d00d-4937-b47c-b6b98410f3a0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:00.935188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd2310a8-d00d-4937-b47c-b6b98410f3a0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:01.028203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd2310a8-d00d-4937-b47c-b6b98410f3a0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:01.039027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd2310a8-d00d-4937-b47c-b6b98410f3a0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:01.040529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd2310a8-d00d-4937-b47c-b6b98410f3a0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:01.044074 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bd2310a8-d00d-4937-b47c-b6b98410f3a0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1356 microversion: 2.47 time: 0.136538 Oct 12 22:20:01.045538 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2132/4848] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:00 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1356 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:20:01.070771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0185e72e-8b57-4e64-8307-d393d0d649c0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:01.077495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0185e72e-8b57-4e64-8307-d393d0d649c0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:01.078788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0185e72e-8b57-4e64-8307-d393d0d649c0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Searching by: {'deleted': False, 'project_id': '1a156d49115943af93cfc2164918987f'} {{(pid=120452) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:20:01.088725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0185e72e-8b57-4e64-8307-d393d0d649c0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:01.095375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0185e72e-8b57-4e64-8307-d393d0d649c0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:01.095903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0185e72e-8b57-4e64-8307-d393d0d649c0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:01.096855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0185e72e-8b57-4e64-8307-d393d0d649c0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:01.097511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0185e72e-8b57-4e64-8307-d393d0d649c0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:01.098108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0185e72e-8b57-4e64-8307-d393d0d649c0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:01.289698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.multi_cell_list [None req-0185e72e-8b57-4e64-8307-d393d0d649c0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:20:01.409251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0185e72e-8b57-4e64-8307-d393d0d649c0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:01.419556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0185e72e-8b57-4e64-8307-d393d0d649c0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:01.420415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0185e72e-8b57-4e64-8307-d393d0d649c0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:01.420924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0185e72e-8b57-4e64-8307-d393d0d649c0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:01.438130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0185e72e-8b57-4e64-8307-d393d0d649c0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:01.440893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0185e72e-8b57-4e64-8307-d393d0d649c0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:01.483079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8ac836a7-0df2-4267-8791-8705ebf49137 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:01.500441 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0185e72e-8b57-4e64-8307-d393d0d649c0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.433626 Oct 12 22:20:01.501897 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2133/4849] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 12 22:20:01 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:20:01.509031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-72cbe577-ea85-4d82-a1d2-e189cdfa55f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:01.510131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-72cbe577-ea85-4d82-a1d2-e189cdfa55f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:01.516831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72cbe577-ea85-4d82-a1d2-e189cdfa55f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:01.517623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72cbe577-ea85-4d82-a1d2-e189cdfa55f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:01.519472 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8ac836a7-0df2-4267-8791-8705ebf49137 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 1.254598 Oct 12 22:20:01.520189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72cbe577-ea85-4d82-a1d2-e189cdfa55f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:01.521286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72cbe577-ea85-4d82-a1d2-e189cdfa55f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:01.521955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72cbe577-ea85-4d82-a1d2-e189cdfa55f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:01.522616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72cbe577-ea85-4d82-a1d2-e189cdfa55f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:01.531663 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2717/4850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:00 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:01.547591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6dc47694-69f8-4107-bd68-1d0db1f366b8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:01.560490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6dc47694-69f8-4107-bd68-1d0db1f366b8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:01.568264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dc47694-69f8-4107-bd68-1d0db1f366b8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:01.568792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dc47694-69f8-4107-bd68-1d0db1f366b8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:01.569233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dc47694-69f8-4107-bd68-1d0db1f366b8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:01.570211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dc47694-69f8-4107-bd68-1d0db1f366b8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:01.570882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dc47694-69f8-4107-bd68-1d0db1f366b8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:01.571501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dc47694-69f8-4107-bd68-1d0db1f366b8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:01.611978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6dc47694-69f8-4107-bd68-1d0db1f366b8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:20:01.697001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:01.708201 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6dc47694-69f8-4107-bd68-1d0db1f366b8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 204 len: 0 microversion: 2.47 time: 0.175081 Oct 12 22:20:01.709767 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2718/4851] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:20:01 2022] DELETE /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:20:01.716206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fcef92aa-a422-4d91-abde-be047216fce9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:01.717288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fcef92aa-a422-4d91-abde-be047216fce9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 5065e039-6345-4dfb-a9e7-ed09ed906028] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:01.724749 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-fcef92aa-a422-4d91-abde-be047216fce9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 5065e039-6345-4dfb-a9e7-ed09ed906028 could not be found. Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fcef92aa-a422-4d91-abde-be047216fce9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/5065e039-6345-4dfb-a9e7-ed09ed906028/action HTTP/1.1 Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 19 Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: {"forceDelete": {}} Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 5065e039-6345-4dfb-a9e7-ed09ed906028 could not be found. Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '5065e039-6345-4dfb-a9e7-ed09ed906028', 'body': {'forceDelete': {}}} Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5065e039-6345-4dfb-a9e7-ed09ed906028 could not be found. Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5065e039-6345-4dfb-a9e7-ed09ed906028 could not be found. Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:01.735011 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:01.740348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:01.740348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:01.740348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5065e039-6345-4dfb-a9e7-ed09ed906028 could not be found. Oct 12 22:20:01.740348 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:01.740348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fcef92aa-a422-4d91-abde-be047216fce9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 5065e039-6345-4dfb-a9e7-ed09ed906028 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:01.740348 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fcef92aa-a422-4d91-abde-be047216fce9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/5065e039-6345-4dfb-a9e7-ed09ed906028/action" status: 404 len: 111 microversion: 2.1 time: 0.025438 Oct 12 22:20:01.740348 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2719/4852] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:01 2022] POST /compute/v2.1/servers/5065e039-6345-4dfb-a9e7-ed09ed906028/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:20:01.744719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fcd00700-4263-4b04-b835-6ab1705610e8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:01.745459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fcd00700-4263-4b04-b835-6ab1705610e8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:01.753740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd00700-4263-4b04-b835-6ab1705610e8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:01.754161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd00700-4263-4b04-b835-6ab1705610e8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:01.754612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd00700-4263-4b04-b835-6ab1705610e8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:01.755341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd00700-4263-4b04-b835-6ab1705610e8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:01.756016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd00700-4263-4b04-b835-6ab1705610e8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:01.756635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd00700-4263-4b04-b835-6ab1705610e8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:01.884137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fcd00700-4263-4b04-b835-6ab1705610e8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:01.884597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-72cbe577-ea85-4d82-a1d2-e189cdfa55f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:01.892413 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-72cbe577-ea85-4d82-a1d2-e189cdfa55f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1516 microversion: 2.1 time: 0.389271 Oct 12 22:20:01.893345 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2134/4853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:01 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1516 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:01.901655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fcd00700-4263-4b04-b835-6ab1705610e8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:01.902498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fcd00700-4263-4b04-b835-6ab1705610e8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:01.907877 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fcd00700-4263-4b04-b835-6ab1705610e8 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1362 microversion: 2.47 time: 0.168610 Oct 12 22:20:01.909175 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2720/4854] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:01 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:20:01.914170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-082df5b6-8b2f-4582-a40a-2def4ac9e577 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:01.915198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-082df5b6-8b2f-4582-a40a-2def4ac9e577 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:01.917090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-574727b3-2df8-46f4-807d-fa8881f844c4 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:01.920519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-574727b3-2df8-46f4-807d-fa8881f844c4 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:01.923625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-082df5b6-8b2f-4582-a40a-2def4ac9e577 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:01.925876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-082df5b6-8b2f-4582-a40a-2def4ac9e577 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:01.926565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-082df5b6-8b2f-4582-a40a-2def4ac9e577 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:01.927558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-082df5b6-8b2f-4582-a40a-2def4ac9e577 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:01.928357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-574727b3-2df8-46f4-807d-fa8881f844c4 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:01.928865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-574727b3-2df8-46f4-807d-fa8881f844c4 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:01.929228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-082df5b6-8b2f-4582-a40a-2def4ac9e577 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:01.929341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-574727b3-2df8-46f4-807d-fa8881f844c4 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:01.930033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-082df5b6-8b2f-4582-a40a-2def4ac9e577 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:01.930456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-574727b3-2df8-46f4-807d-fa8881f844c4 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:01.930934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-574727b3-2df8-46f4-807d-fa8881f844c4 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:01.931395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-574727b3-2df8-46f4-807d-fa8881f844c4 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:01.963571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-574727b3-2df8-46f4-807d-fa8881f844c4 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lazy-loading 'flavor' on Instance uuid feda1f68-7489-4648-8f7a-ab12030e50b3 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:20:02.087812 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-574727b3-2df8-46f4-807d-fa8881f844c4 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "POST /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3/action" status: 200 len: 32 microversion: 2.1 time: 0.171701 Oct 12 22:20:02.092847 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2721/4855] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:01 2022] POST /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:20:02.113635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-414a06f2-3f23-49ab-8e66-b222aca84724 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:02.114410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-414a06f2-3f23-49ab-8e66-b222aca84724 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:02.124501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-414a06f2-3f23-49ab-8e66-b222aca84724 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:02.125041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-414a06f2-3f23-49ab-8e66-b222aca84724 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:02.125495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-414a06f2-3f23-49ab-8e66-b222aca84724 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:02.126326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-414a06f2-3f23-49ab-8e66-b222aca84724 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:02.126758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-414a06f2-3f23-49ab-8e66-b222aca84724 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:02.127805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-414a06f2-3f23-49ab-8e66-b222aca84724 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:02.483805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-082df5b6-8b2f-4582-a40a-2def4ac9e577 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:02.501782 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-082df5b6-8b2f-4582-a40a-2def4ac9e577 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.607174 Oct 12 22:20:02.503889 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2135/4856] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:01 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:02.527947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ebd1ee49-5eac-4b36-9cdc-b0f16ed5b2c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:02.529301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ebd1ee49-5eac-4b36-9cdc-b0f16ed5b2c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:02.551114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebd1ee49-5eac-4b36-9cdc-b0f16ed5b2c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:02.552409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebd1ee49-5eac-4b36-9cdc-b0f16ed5b2c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:02.552969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebd1ee49-5eac-4b36-9cdc-b0f16ed5b2c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:02.553874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebd1ee49-5eac-4b36-9cdc-b0f16ed5b2c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:02.554451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebd1ee49-5eac-4b36-9cdc-b0f16ed5b2c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:02.555047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebd1ee49-5eac-4b36-9cdc-b0f16ed5b2c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:02.594952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-414a06f2-3f23-49ab-8e66-b222aca84724 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:02.598387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:02.608211 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-414a06f2-3f23-49ab-8e66-b222aca84724 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.501303 Oct 12 22:20:02.619540 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2722/4857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:02 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:02.943121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f36d1717-ee42-4247-9b13-75fe01452653 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:02.944064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f36d1717-ee42-4247-9b13-75fe01452653 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:02.952470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f36d1717-ee42-4247-9b13-75fe01452653 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:02.953205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f36d1717-ee42-4247-9b13-75fe01452653 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:02.953845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f36d1717-ee42-4247-9b13-75fe01452653 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:02.954986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f36d1717-ee42-4247-9b13-75fe01452653 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:02.956573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f36d1717-ee42-4247-9b13-75fe01452653 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:02.957170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f36d1717-ee42-4247-9b13-75fe01452653 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:03.059159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ebd1ee49-5eac-4b36-9cdc-b0f16ed5b2c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:03.069750 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ebd1ee49-5eac-4b36-9cdc-b0f16ed5b2c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.546696 Oct 12 22:20:03.070336 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2136/4858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:02 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:03.093060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-01e8b2c1-776e-4593-9b32-e6b1f849a9e7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:03.095685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-01e8b2c1-776e-4593-9b32-e6b1f849a9e7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 147a7c6e-011e-4e35-8208-9408a1f2aa52] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:03.102082 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-01e8b2c1-776e-4593-9b32-e6b1f849a9e7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 147a7c6e-011e-4e35-8208-9408a1f2aa52 could not be found. Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-01e8b2c1-776e-4593-9b32-e6b1f849a9e7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/147a7c6e-011e-4e35-8208-9408a1f2aa52/action HTTP/1.1 Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 39 Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: {"os-getConsoleOutput": {"length": 10}} Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 147a7c6e-011e-4e35-8208-9408a1f2aa52 could not be found. Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '147a7c6e-011e-4e35-8208-9408a1f2aa52', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 147a7c6e-011e-4e35-8208-9408a1f2aa52 could not be found. Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 147a7c6e-011e-4e35-8208-9408a1f2aa52 could not be found. Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:03.112295 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:03.118825 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:03.118825 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:03.118825 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:03.118825 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:03.118825 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 147a7c6e-011e-4e35-8208-9408a1f2aa52 could not be found. Oct 12 22:20:03.118825 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:03.119473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f36d1717-ee42-4247-9b13-75fe01452653 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:03.120657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-01e8b2c1-776e-4593-9b32-e6b1f849a9e7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 147a7c6e-011e-4e35-8208-9408a1f2aa52 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:03.121710 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-01e8b2c1-776e-4593-9b32-e6b1f849a9e7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/147a7c6e-011e-4e35-8208-9408a1f2aa52/action" status: 404 len: 111 microversion: 2.1 time: 0.033716 Oct 12 22:20:03.126232 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2137/4859] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:03 2022] POST /compute/v2.1/servers/147a7c6e-011e-4e35-8208-9408a1f2aa52/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:20:03.132715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b1eb3fed-026a-4568-ab1b-15e16b768bd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:03.133386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f36d1717-ee42-4247-9b13-75fe01452653 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:03.133901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b1eb3fed-026a-4568-ab1b-15e16b768bd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:03.134883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f36d1717-ee42-4247-9b13-75fe01452653 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:03.136339 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f36d1717-ee42-4247-9b13-75fe01452653 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 200 len: 1362 microversion: 2.47 time: 0.198171 Oct 12 22:20:03.142598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1eb3fed-026a-4568-ab1b-15e16b768bd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:03.143928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1eb3fed-026a-4568-ab1b-15e16b768bd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:03.145154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1eb3fed-026a-4568-ab1b-15e16b768bd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:03.146068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1eb3fed-026a-4568-ab1b-15e16b768bd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:03.146729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1eb3fed-026a-4568-ab1b-15e16b768bd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:03.147835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1eb3fed-026a-4568-ab1b-15e16b768bd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:03.171336 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2723/4860] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:02 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:20:03.620911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1676041102", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "93d21ab5-b69b-4ecd-a8c9-b483ad69db8b"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:03.636434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b1eb3fed-026a-4568-ab1b-15e16b768bd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:03.649679 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b1eb3fed-026a-4568-ab1b-15e16b768bd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.518332 Oct 12 22:20:03.667273 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2138/4861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:03 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:03.667273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3a611e87-bd67-467c-bd76-2d2ded04a0a8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:03.667273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3a611e87-bd67-467c-bd76-2d2ded04a0a8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:03.668523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a611e87-bd67-467c-bd76-2d2ded04a0a8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:03.669562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a611e87-bd67-467c-bd76-2d2ded04a0a8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:03.670484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a611e87-bd67-467c-bd76-2d2ded04a0a8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:03.672034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a611e87-bd67-467c-bd76-2d2ded04a0a8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:03.673170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a611e87-bd67-467c-bd76-2d2ded04a0a8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:03.673170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a611e87-bd67-467c-bd76-2d2ded04a0a8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:03.714109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] validate_networks() for [('93d21ab5-b69b-4ecd-a8c9-b483ad69db8b', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:20:04.167540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3a611e87-bd67-467c-bd76-2d2ded04a0a8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:04.179916 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3a611e87-bd67-467c-bd76-2d2ded04a0a8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.526245 Oct 12 22:20:04.181230 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2139/4862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:03 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:04.186473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b82ccd87-d7e0-414c-9963-96aab8c3f29a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:04.187554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b82ccd87-d7e0-414c-9963-96aab8c3f29a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:04.194968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b82ccd87-d7e0-414c-9963-96aab8c3f29a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:04.195834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b82ccd87-d7e0-414c-9963-96aab8c3f29a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:04.196785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b82ccd87-d7e0-414c-9963-96aab8c3f29a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:04.197983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b82ccd87-d7e0-414c-9963-96aab8c3f29a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:04.198592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b82ccd87-d7e0-414c-9963-96aab8c3f29a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:04.199158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b82ccd87-d7e0-414c-9963-96aab8c3f29a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:04.718702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b82ccd87-d7e0-414c-9963-96aab8c3f29a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:04.737968 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b82ccd87-d7e0-414c-9963-96aab8c3f29a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.555272 Oct 12 22:20:04.754793 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2140/4863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:04 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:04.754793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ec33acdc-2fe4-49ac-9a9f-dfb5f35f5750 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:04.754793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ec33acdc-2fe4-49ac-9a9f-dfb5f35f5750 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:04.754793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec33acdc-2fe4-49ac-9a9f-dfb5f35f5750 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:04.754793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec33acdc-2fe4-49ac-9a9f-dfb5f35f5750 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:04.754793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec33acdc-2fe4-49ac-9a9f-dfb5f35f5750 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:04.754793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec33acdc-2fe4-49ac-9a9f-dfb5f35f5750 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:04.755991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec33acdc-2fe4-49ac-9a9f-dfb5f35f5750 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:04.755991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec33acdc-2fe4-49ac-9a9f-dfb5f35f5750 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:04.789229 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-ec33acdc-2fe4-49ac-9a9f-dfb5f35f5750 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] HTTP exception thrown: Instance 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d could not be found. Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ec33acdc-2fe4-49ac-9a9f-dfb5f35f5750 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Request method failure captured: Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d HTTP/1.1 Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz1nwvIprmZznjAeKA3vcIm-NwTfSrPbvqhFp-E2TXSCZNSM56LDhUX_csk59kLrudTDPOy3aI7hM3DlUr9dS6VaK7W0ueUmPEMk85Pm3NsSsEw4jcwvOthPcnjyyih_3eVVJd0m94FU9qXoYTQhgvNLrWVrwRxvmpE-jrLICwZ500Q Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-Openstack-Nova-Api-Version: 2.47 Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1a156d49115943af93cfc2164918987f Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerShowV247Test-1689072830 Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a156d49115943af93cfc2164918987f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a156d49115943af93cfc2164918987f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a156d49115943af93cfc2164918987f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a156d49115943af93cfc2164918987f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerShowV247Test-1689072830 Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1a156d49115943af93cfc2164918987f Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerShowV247Test-1689072830 Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerShowV247Test-1689072830-project Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 550933af3c7c44b5a33b00092c24737a Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerShowV247Test-1689072830-project Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d could not be found. Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '3b30fdce-5345-4ac1-b45d-f6d4a0400b2d'} Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d could not be found. Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d could not be found. Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:04.790954 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:04.796600 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:04.796600 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:04.796600 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:04.796600 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:04.796600 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:04.796600 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d could not be found. Oct 12 22:20:04.796600 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:04.796600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ec33acdc-2fe4-49ac-9a9f-dfb5f35f5750 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Returning 404 to user: Instance 3b30fdce-5345-4ac1-b45d-f6d4a0400b2d could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:04.796600 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ec33acdc-2fe4-49ac-9a9f-dfb5f35f5750 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d" status: 404 len: 111 microversion: 2.47 time: 0.054047 Oct 12 22:20:04.796600 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2141/4864] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:04 2022] GET /compute/v2.1/servers/3b30fdce-5345-4ac1-b45d-f6d4a0400b2d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:20:04.805050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-578dfa16-ad49-46be-af49-dfd09daff828 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:04.805473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-578dfa16-ad49-46be-af49-dfd09daff828 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 46bf49dd-556c-46d7-8d00-fed72da8ea45] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:04.812147 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-578dfa16-ad49-46be-af49-dfd09daff828 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 46bf49dd-556c-46d7-8d00-fed72da8ea45 could not be found. Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-578dfa16-ad49-46be-af49-dfd09daff828 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/46bf49dd-556c-46d7-8d00-fed72da8ea45 HTTP/1.1 Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 46bf49dd-556c-46d7-8d00-fed72da8ea45 could not be found. Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '46bf49dd-556c-46d7-8d00-fed72da8ea45'} Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46bf49dd-556c-46d7-8d00-fed72da8ea45 could not be found. Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46bf49dd-556c-46d7-8d00-fed72da8ea45 could not be found. Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:04.813757 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:04.819143 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:04.819143 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:04.819143 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:04.819143 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46bf49dd-556c-46d7-8d00-fed72da8ea45 could not be found. Oct 12 22:20:04.819143 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:04.819143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-578dfa16-ad49-46be-af49-dfd09daff828 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 46bf49dd-556c-46d7-8d00-fed72da8ea45 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:04.819143 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-578dfa16-ad49-46be-af49-dfd09daff828 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/46bf49dd-556c-46d7-8d00-fed72da8ea45" status: 404 len: 111 microversion: 2.1 time: 0.018264 Oct 12 22:20:04.824533 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2142/4865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:04 2022] GET /compute/v2.1/servers/46bf49dd-556c-46d7-8d00-fed72da8ea45 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:20:04.827795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-befb579b-d7fe-471d-91a8-27b5cbddf542 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:04.828401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-befb579b-d7fe-471d-91a8-27b5cbddf542 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 4c012c96-e0db-4fae-9045-2237c25029e8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:04.837520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-befb579b-d7fe-471d-91a8-27b5cbddf542 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:04.838154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-befb579b-d7fe-471d-91a8-27b5cbddf542 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:04.838897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-befb579b-d7fe-471d-91a8-27b5cbddf542 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:04.840094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-befb579b-d7fe-471d-91a8-27b5cbddf542 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:04.840670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-befb579b-d7fe-471d-91a8-27b5cbddf542 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:04.841250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-befb579b-d7fe-471d-91a8-27b5cbddf542 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:04.873036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-befb579b-d7fe-471d-91a8-27b5cbddf542 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 4c012c96-e0db-4fae-9045-2237c25029e8] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:20:05.048824 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-befb579b-d7fe-471d-91a8-27b5cbddf542 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4c012c96-e0db-4fae-9045-2237c25029e8" status: 204 len: 0 microversion: 2.47 time: 0.226948 Oct 12 22:20:05.049370 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2143/4866] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:20:04 2022] DELETE /compute/v2.1/servers/4c012c96-e0db-4fae-9045-2237c25029e8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:20:05.055967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7e1d2d7d-ce54-4b51-b839-2f91ce223eb4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:05.056694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7e1d2d7d-ce54-4b51-b839-2f91ce223eb4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:05.062809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e1d2d7d-ce54-4b51-b839-2f91ce223eb4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:05.063346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e1d2d7d-ce54-4b51-b839-2f91ce223eb4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:05.063823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e1d2d7d-ce54-4b51-b839-2f91ce223eb4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:05.065231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e1d2d7d-ce54-4b51-b839-2f91ce223eb4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:05.065713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e1d2d7d-ce54-4b51-b839-2f91ce223eb4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:05.066143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e1d2d7d-ce54-4b51-b839-2f91ce223eb4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:05.100182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:20:05.100700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:20:05.101198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:20:05.101764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:20:05.102315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:20:05.117270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:05.125356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:05.125923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:05.126980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:05.130040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:05.130741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:05.176170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Getting quotas for project ee6c241409484307a7db7060346af159. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:20:05.187459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Getting quotas for user 6bd7262befc64279bac6f4aaf9c7f20d and project ee6c241409484307a7db7060346af159. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:20:05.214935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:20:05.218196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:20:05.341437 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ec5f4a96-2790-42c2-ab33-ca7c6198c2d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.893940 Oct 12 22:20:05.342821 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2724/4867] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:20:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:20:05.363225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6e06feac-adeb-45e1-9551-31f586eba880 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:05.364214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6e06feac-adeb-45e1-9551-31f586eba880 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 4c012c96-e0db-4fae-9045-2237c25029e8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:05.379584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e06feac-adeb-45e1-9551-31f586eba880 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:05.380088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e06feac-adeb-45e1-9551-31f586eba880 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:05.380524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e06feac-adeb-45e1-9551-31f586eba880 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:05.381466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e06feac-adeb-45e1-9551-31f586eba880 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:05.382101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e06feac-adeb-45e1-9551-31f586eba880 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:05.382835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e06feac-adeb-45e1-9551-31f586eba880 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:05.425926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e1d2d7d-ce54-4b51-b839-2f91ce223eb4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:05.434305 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7e1d2d7d-ce54-4b51-b839-2f91ce223eb4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.383635 Oct 12 22:20:05.440393 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2144/4868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:05 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:05.462769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aaf6a81d-e71b-46a3-947b-66b69a5cff1a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:05.463764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-aaf6a81d-e71b-46a3-947b-66b69a5cff1a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:05.480002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aaf6a81d-e71b-46a3-947b-66b69a5cff1a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:05.480992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aaf6a81d-e71b-46a3-947b-66b69a5cff1a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:05.481664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aaf6a81d-e71b-46a3-947b-66b69a5cff1a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:05.482959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aaf6a81d-e71b-46a3-947b-66b69a5cff1a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:05.484368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aaf6a81d-e71b-46a3-947b-66b69a5cff1a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:05.484968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aaf6a81d-e71b-46a3-947b-66b69a5cff1a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:05.575964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6e06feac-adeb-45e1-9551-31f586eba880 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:05.585200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6e06feac-adeb-45e1-9551-31f586eba880 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:05.586670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6e06feac-adeb-45e1-9551-31f586eba880 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:05.597723 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6e06feac-adeb-45e1-9551-31f586eba880 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/4c012c96-e0db-4fae-9045-2237c25029e8" status: 200 len: 1363 microversion: 2.47 time: 0.245154 Oct 12 22:20:05.598336 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2725/4869] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:05 2022] GET /compute/v2.1/servers/4c012c96-e0db-4fae-9045-2237c25029e8 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:20:05.615378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5616bd58-e00d-4112-b3d0-8f53ff8c0068 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:05.616289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5616bd58-e00d-4112-b3d0-8f53ff8c0068 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:05.754222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5616bd58-e00d-4112-b3d0-8f53ff8c0068 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd7262befc64279bac6f4aaf9c7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6c241409484307a7db7060346af159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:05.771619 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5616bd58-e00d-4112-b3d0-8f53ff8c0068 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98" status: 200 len: 1216 microversion: 2.1 time: 0.171124 Oct 12 22:20:05.773494 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2726/4870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:05 2022] GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 => generated 1216 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:05.778402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-97eea5f0-c948-4fcd-8bea-2fa3370b09eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:05.779202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-97eea5f0-c948-4fcd-8bea-2fa3370b09eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:05.790687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97eea5f0-c948-4fcd-8bea-2fa3370b09eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:05.800719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97eea5f0-c948-4fcd-8bea-2fa3370b09eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:05.801220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97eea5f0-c948-4fcd-8bea-2fa3370b09eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:05.802045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97eea5f0-c948-4fcd-8bea-2fa3370b09eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:05.802706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97eea5f0-c948-4fcd-8bea-2fa3370b09eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:05.802943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97eea5f0-c948-4fcd-8bea-2fa3370b09eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:06.217289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-97eea5f0-c948-4fcd-8bea-2fa3370b09eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:06.229566 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-97eea5f0-c948-4fcd-8bea-2fa3370b09eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.454840 Oct 12 22:20:06.230397 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2727/4871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:05 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:06.254903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-aaf6a81d-e71b-46a3-947b-66b69a5cff1a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:06.278012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:06.282073 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-aaf6a81d-e71b-46a3-947b-66b69a5cff1a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.838947 Oct 12 22:20:06.288113 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2145/4872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:05 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:06.434649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fc36b99f-d1ac-4589-bf8b-c8be7f7b11c7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-292151315", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fc36b99f-d1ac-4589-bf8b-c8be7f7b11c7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 237 Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-292151315", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-292151315', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '57899def-7285-4d34-a6b9-8c4bdfce7a65'}]}}} Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:06.461404 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fc36b99f-d1ac-4589-bf8b-c8be7f7b11c7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fc36b99f-d1ac-4589-bf8b-c8be7f7b11c7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.045868 Oct 12 22:20:06.465610 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2728/4873] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:20:06 2022] POST /compute/v2.1/servers => generated 139 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:20:06.472592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d2d2cad9-a4a9-4730-b2ad-0a6edac144e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:06.473276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d2d2cad9-a4a9-4730-b2ad-0a6edac144e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:06.485220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2d2cad9-a4a9-4730-b2ad-0a6edac144e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:06.486156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2d2cad9-a4a9-4730-b2ad-0a6edac144e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:06.487724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2d2cad9-a4a9-4730-b2ad-0a6edac144e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:06.488834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2d2cad9-a4a9-4730-b2ad-0a6edac144e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:06.489453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2d2cad9-a4a9-4730-b2ad-0a6edac144e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:06.490023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2d2cad9-a4a9-4730-b2ad-0a6edac144e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:06.630168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7c2044c9-d5e0-4d93-8e90-fda509bc1631 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:06.630938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7c2044c9-d5e0-4d93-8e90-fda509bc1631 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 4c012c96-e0db-4fae-9045-2237c25029e8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:06.651500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c2044c9-d5e0-4d93-8e90-fda509bc1631 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:06.653108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c2044c9-d5e0-4d93-8e90-fda509bc1631 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:06.653974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c2044c9-d5e0-4d93-8e90-fda509bc1631 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:06.660759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c2044c9-d5e0-4d93-8e90-fda509bc1631 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:06.662289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c2044c9-d5e0-4d93-8e90-fda509bc1631 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:06.662749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c2044c9-d5e0-4d93-8e90-fda509bc1631 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:06.826372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7c2044c9-d5e0-4d93-8e90-fda509bc1631 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:06.836322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7c2044c9-d5e0-4d93-8e90-fda509bc1631 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:06.847344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7c2044c9-d5e0-4d93-8e90-fda509bc1631 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:06.849341 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7c2044c9-d5e0-4d93-8e90-fda509bc1631 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/4c012c96-e0db-4fae-9045-2237c25029e8" status: 200 len: 1363 microversion: 2.47 time: 0.223648 Oct 12 22:20:06.850068 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2729/4874] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:06 2022] GET /compute/v2.1/servers/4c012c96-e0db-4fae-9045-2237c25029e8 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:20:06.870024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4a1e01bc-e9bf-4e59-8e7f-1d938861a34f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:06.870617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4a1e01bc-e9bf-4e59-8e7f-1d938861a34f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:06.881007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a1e01bc-e9bf-4e59-8e7f-1d938861a34f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:06.881987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a1e01bc-e9bf-4e59-8e7f-1d938861a34f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:06.882667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a1e01bc-e9bf-4e59-8e7f-1d938861a34f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:06.883508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a1e01bc-e9bf-4e59-8e7f-1d938861a34f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:06.884213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a1e01bc-e9bf-4e59-8e7f-1d938861a34f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:06.886244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a1e01bc-e9bf-4e59-8e7f-1d938861a34f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:06.927721 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-4a1e01bc-e9bf-4e59-8e7f-1d938861a34f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] HTTP exception thrown: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4a1e01bc-e9bf-4e59-8e7f-1d938861a34f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Request method failure captured: Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 HTTP/1.1 Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzvxvMP8af9d7xsjbdJozhiVPQiRQBrxh35M-_RLfTwgweT9hsqfTZrhM2F4o8wY9xU2P22DfzxouAhl4xhmG_FjQjwllnXmkziv1YibXjaNomu9qHVhB1P6z-oCqFEgEo9fG8uT_dkuKtckQW2h616PCowNZNZV8Jzw68tAHQGQ_ok Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.32 Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: d8a8bf42585148ff9e29ab4bb8f932a6 Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TaggedBootDevicesTest-1238568002 Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d8a8bf42585148ff9e29ab4bb8f932a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d8a8bf42585148ff9e29ab4bb8f932a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d8a8bf42585148ff9e29ab4bb8f932a6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d8a8bf42585148ff9e29ab4bb8f932a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TaggedBootDevicesTest-1238568002 Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: d8a8bf42585148ff9e29ab4bb8f932a6 Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1238568002 Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TaggedBootDevicesTest-1238568002-project Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: ea6c240d338349f89c5cc98058ea225c Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TaggedBootDevicesTest-1238568002-project Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '76adeecb-a1c3-4d3b-8643-47bcb8c759e0'} Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:06.930687 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:06.935018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. Oct 12 22:20:06.935018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:06.935018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:06.935018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:06.935018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:06.935018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:06.935018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:06.935018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:06.935018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:06.935018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. Oct 12 22:20:06.935018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:06.940934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4a1e01bc-e9bf-4e59-8e7f-1d938861a34f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Returning 404 to user: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:06.943815 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4a1e01bc-e9bf-4e59-8e7f-1d938861a34f tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "DELETE /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 404 len: 111 microversion: 2.32 time: 0.086163 Oct 12 22:20:06.952609 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2730/4875] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:20:06 2022] DELETE /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:20:06.962059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6510d07a-8082-429c-95d9-cf62697668cb tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:06.963099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6510d07a-8082-429c-95d9-cf62697668cb tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:06.983356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6510d07a-8082-429c-95d9-cf62697668cb tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:06.988279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6510d07a-8082-429c-95d9-cf62697668cb tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:06.988958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6510d07a-8082-429c-95d9-cf62697668cb tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:06.989944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6510d07a-8082-429c-95d9-cf62697668cb tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:06.992330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6510d07a-8082-429c-95d9-cf62697668cb tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:06.992953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6510d07a-8082-429c-95d9-cf62697668cb tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:07.047404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d2d2cad9-a4a9-4730-b2ad-0a6edac144e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:07.056270 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d2d2cad9-a4a9-4730-b2ad-0a6edac144e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.588159 Oct 12 22:20:07.072673 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2146/4876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:06 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:07.081816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1eeb5489-5f9b-428a-8082-8b6b2adacfde tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:07.087695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1eeb5489-5f9b-428a-8082-8b6b2adacfde tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] [instance: 76adeecb-a1c3-4d3b-8643-47bcb8c759e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:07.099845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eeb5489-5f9b-428a-8082-8b6b2adacfde tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:07.100353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eeb5489-5f9b-428a-8082-8b6b2adacfde tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:07.100822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eeb5489-5f9b-428a-8082-8b6b2adacfde tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:07.101541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eeb5489-5f9b-428a-8082-8b6b2adacfde tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:07.102002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eeb5489-5f9b-428a-8082-8b6b2adacfde tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:07.102434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1eeb5489-5f9b-428a-8082-8b6b2adacfde tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:07.121439 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-1eeb5489-5f9b-428a-8082-8b6b2adacfde tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] HTTP exception thrown: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1eeb5489-5f9b-428a-8082-8b6b2adacfde tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Request method failure captured: Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 HTTP/1.1 Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzvxvMP8af9d7xsjbdJozhiVPQiRQBrxh35M-_RLfTwgweT9hsqfTZrhM2F4o8wY9xU2P22DfzxouAhl4xhmG_FjQjwllnXmkziv1YibXjaNomu9qHVhB1P6z-oCqFEgEo9fG8uT_dkuKtckQW2h616PCowNZNZV8Jzw68tAHQGQ_ok Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-Openstack-Nova-Api-Version: 2.32 Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: d8a8bf42585148ff9e29ab4bb8f932a6 Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TaggedBootDevicesTest-1238568002 Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d8a8bf42585148ff9e29ab4bb8f932a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d8a8bf42585148ff9e29ab4bb8f932a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d8a8bf42585148ff9e29ab4bb8f932a6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d8a8bf42585148ff9e29ab4bb8f932a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TaggedBootDevicesTest-1238568002 Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: d8a8bf42585148ff9e29ab4bb8f932a6 Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1238568002 Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TaggedBootDevicesTest-1238568002-project Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: ea6c240d338349f89c5cc98058ea225c Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TaggedBootDevicesTest-1238568002-project Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '76adeecb-a1c3-4d3b-8643-47bcb8c759e0'} Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:07.123957 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:07.128427 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:07.128427 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:07.128427 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:07.128427 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:07.128427 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:07.128427 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:07.128427 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. Oct 12 22:20:07.128427 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:07.129887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1eeb5489-5f9b-428a-8082-8b6b2adacfde tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] Returning 404 to user: Instance 76adeecb-a1c3-4d3b-8643-47bcb8c759e0 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:07.131052 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1eeb5489-5f9b-428a-8082-8b6b2adacfde tempest-TaggedBootDevicesTest-1238568002 tempest-TaggedBootDevicesTest-1238568002-project] 10.222.0.16 "GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0" status: 404 len: 111 microversion: 2.32 time: 0.057285 Oct 12 22:20:07.131827 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2147/4877] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:07 2022] GET /compute/v2.1/servers/76adeecb-a1c3-4d3b-8643-47bcb8c759e0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:20:07.138558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e9ed1434-c0ae-449d-a9e2-89d591f64e84 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:07.139415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e9ed1434-c0ae-449d-a9e2-89d591f64e84 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:07.147941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9ed1434-c0ae-449d-a9e2-89d591f64e84 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:07.148655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9ed1434-c0ae-449d-a9e2-89d591f64e84 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:07.149273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9ed1434-c0ae-449d-a9e2-89d591f64e84 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:07.150236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9ed1434-c0ae-449d-a9e2-89d591f64e84 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:07.150861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9ed1434-c0ae-449d-a9e2-89d591f64e84 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:07.151508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9ed1434-c0ae-449d-a9e2-89d591f64e84 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:07.421867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6510d07a-8082-429c-95d9-cf62697668cb tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd7262befc64279bac6f4aaf9c7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6c241409484307a7db7060346af159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:07.434532 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6510d07a-8082-429c-95d9-cf62697668cb tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98" status: 200 len: 1212 microversion: 2.1 time: 0.479532 Oct 12 22:20:07.440234 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2731/4878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:06 2022] GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 => generated 1212 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:07.446675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5fba17bb-7a22-482f-b412-6dfddae944d3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:07.447876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5fba17bb-7a22-482f-b412-6dfddae944d3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:07.457239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fba17bb-7a22-482f-b412-6dfddae944d3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:07.467169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fba17bb-7a22-482f-b412-6dfddae944d3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:07.469671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fba17bb-7a22-482f-b412-6dfddae944d3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:07.470681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fba17bb-7a22-482f-b412-6dfddae944d3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:07.472835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fba17bb-7a22-482f-b412-6dfddae944d3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:07.476610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fba17bb-7a22-482f-b412-6dfddae944d3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:07.522144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e9ed1434-c0ae-449d-a9e2-89d591f64e84 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:07.538096 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e9ed1434-c0ae-449d-a9e2-89d591f64e84 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.405023 Oct 12 22:20:07.541912 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2148/4879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:07 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:07.637603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a49741d3-e082-465b-9027-6edb2dce4299 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-929503874", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a49741d3-e082-465b-9027-6edb2dce4299 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 234 Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-929503874", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-929503874', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '57899def-7285-4d34-a6b9-8c4bdfce7a65'}]}}} Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:07.651593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:07.655627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a49741d3-e082-465b-9027-6edb2dce4299 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:07.657157 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a49741d3-e082-465b-9027-6edb2dce4299 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.023452 Oct 12 22:20:07.662182 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2149/4880] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:20:07 2022] POST /compute/v2.1/servers => generated 133 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:20:07.681487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a29953ed-ae7a-44c7-afab-7078c67e4ca3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:07.683299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a29953ed-ae7a-44c7-afab-7078c67e4ca3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:07.701113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a29953ed-ae7a-44c7-afab-7078c67e4ca3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:07.702938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a29953ed-ae7a-44c7-afab-7078c67e4ca3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:07.704743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a29953ed-ae7a-44c7-afab-7078c67e4ca3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:07.706285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a29953ed-ae7a-44c7-afab-7078c67e4ca3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:07.710769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a29953ed-ae7a-44c7-afab-7078c67e4ca3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:07.712331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a29953ed-ae7a-44c7-afab-7078c67e4ca3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:07.962621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a29953ed-ae7a-44c7-afab-7078c67e4ca3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:07.973012 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a29953ed-ae7a-44c7-afab-7078c67e4ca3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.303691 Oct 12 22:20:07.977422 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2150/4881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:07 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:07.983166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a8b73cd-aed9-4be9-bbbb-6216a37616e0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:07.985570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7a8b73cd-aed9-4be9-bbbb-6216a37616e0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 4c012c96-e0db-4fae-9045-2237c25029e8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:08.007719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a8b73cd-aed9-4be9-bbbb-6216a37616e0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:08.009469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a8b73cd-aed9-4be9-bbbb-6216a37616e0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:08.010153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a8b73cd-aed9-4be9-bbbb-6216a37616e0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:08.011221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a8b73cd-aed9-4be9-bbbb-6216a37616e0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:08.011929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a8b73cd-aed9-4be9-bbbb-6216a37616e0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:08.012997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a8b73cd-aed9-4be9-bbbb-6216a37616e0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:08.105120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a8b73cd-aed9-4be9-bbbb-6216a37616e0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:08.106398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a8b73cd-aed9-4be9-bbbb-6216a37616e0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:08.107600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a8b73cd-aed9-4be9-bbbb-6216a37616e0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:08.109113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-7a8b73cd-aed9-4be9-bbbb-6216a37616e0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lazy-loading 'fault' on Instance uuid 4c012c96-e0db-4fae-9045-2237c25029e8 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:20:08.190177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a8b73cd-aed9-4be9-bbbb-6216a37616e0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:08.203567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a8b73cd-aed9-4be9-bbbb-6216a37616e0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:08.205057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a8b73cd-aed9-4be9-bbbb-6216a37616e0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550933af3c7c44b5a33b00092c24737a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a156d49115943af93cfc2164918987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:08.206286 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7a8b73cd-aed9-4be9-bbbb-6216a37616e0 tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/4c012c96-e0db-4fae-9045-2237c25029e8" status: 200 len: 1368 microversion: 2.47 time: 0.227597 Oct 12 22:20:08.206852 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2151/4882] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:07 2022] GET /compute/v2.1/servers/4c012c96-e0db-4fae-9045-2237c25029e8 => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:20:08.231560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d74fc357-eb59-4084-af83-a829bcacee81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:08.232383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d74fc357-eb59-4084-af83-a829bcacee81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:08.239477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d74fc357-eb59-4084-af83-a829bcacee81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:08.240544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d74fc357-eb59-4084-af83-a829bcacee81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:08.241139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d74fc357-eb59-4084-af83-a829bcacee81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:08.241997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d74fc357-eb59-4084-af83-a829bcacee81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:08.242604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d74fc357-eb59-4084-af83-a829bcacee81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:08.243199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d74fc357-eb59-4084-af83-a829bcacee81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:08.498275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5fba17bb-7a22-482f-b412-6dfddae944d3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:08.517613 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5fba17bb-7a22-482f-b412-6dfddae944d3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 1.074813 Oct 12 22:20:08.519381 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2732/4883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:07 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:08.534977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6703966d-bb30-4d8d-9e7e-18720664217b tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:08.542268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6703966d-bb30-4d8d-9e7e-18720664217b tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:08.575311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6703966d-bb30-4d8d-9e7e-18720664217b tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:08.575804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6703966d-bb30-4d8d-9e7e-18720664217b tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:08.576269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6703966d-bb30-4d8d-9e7e-18720664217b tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:08.580096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6703966d-bb30-4d8d-9e7e-18720664217b tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:08.581772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d74fc357-eb59-4084-af83-a829bcacee81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:08.586082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6703966d-bb30-4d8d-9e7e-18720664217b tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:08.587175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6703966d-bb30-4d8d-9e7e-18720664217b tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:08.594145 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d74fc357-eb59-4084-af83-a829bcacee81 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.365516 Oct 12 22:20:08.601642 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2152/4884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:08 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:08.623436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-061ed06a-ddcb-4a3f-a84f-23bf62e89da7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:08.624344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-061ed06a-ddcb-4a3f-a84f-23bf62e89da7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: b5df1fc3-34af-49e0-a152-441b8162ba33] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:08.634815 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-061ed06a-ddcb-4a3f-a84f-23bf62e89da7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance b5df1fc3-34af-49e0-a152-441b8162ba33 could not be found. Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-061ed06a-ddcb-4a3f-a84f-23bf62e89da7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/b5df1fc3-34af-49e0-a152-441b8162ba33/action HTTP/1.1 Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 13 Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: {"pause": {}} Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance b5df1fc3-34af-49e0-a152-441b8162ba33 could not be found. Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'b5df1fc3-34af-49e0-a152-441b8162ba33', 'body': {'pause': {}}} Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5df1fc3-34af-49e0-a152-441b8162ba33 could not be found. Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5df1fc3-34af-49e0-a152-441b8162ba33 could not be found. Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:08.641473 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:08.649439 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:08.649439 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:08.649439 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5df1fc3-34af-49e0-a152-441b8162ba33 could not be found. Oct 12 22:20:08.649439 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:08.649439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-061ed06a-ddcb-4a3f-a84f-23bf62e89da7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance b5df1fc3-34af-49e0-a152-441b8162ba33 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:08.649439 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-061ed06a-ddcb-4a3f-a84f-23bf62e89da7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/b5df1fc3-34af-49e0-a152-441b8162ba33/action" status: 404 len: 111 microversion: 2.1 time: 0.027167 Oct 12 22:20:08.649439 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2153/4885] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:08 2022] POST /compute/v2.1/servers/b5df1fc3-34af-49e0-a152-441b8162ba33/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:20:08.657872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2028d2e9-ba7e-470a-9926-87fb15c4f91a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:08.663778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2028d2e9-ba7e-470a-9926-87fb15c4f91a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:08.676498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2028d2e9-ba7e-470a-9926-87fb15c4f91a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:08.677207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2028d2e9-ba7e-470a-9926-87fb15c4f91a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:08.677995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2028d2e9-ba7e-470a-9926-87fb15c4f91a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:08.678960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2028d2e9-ba7e-470a-9926-87fb15c4f91a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:08.679814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2028d2e9-ba7e-470a-9926-87fb15c4f91a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:08.680645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2028d2e9-ba7e-470a-9926-87fb15c4f91a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:08.812334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6703966d-bb30-4d8d-9e7e-18720664217b tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd7262befc64279bac6f4aaf9c7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6c241409484307a7db7060346af159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:08.826500 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6703966d-bb30-4d8d-9e7e-18720664217b tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98" status: 200 len: 1274 microversion: 2.1 time: 0.305469 Oct 12 22:20:08.827217 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2733/4886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:08 2022] GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 => generated 1274 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:08.915961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2028d2e9-ba7e-470a-9926-87fb15c4f91a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:08.944845 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2028d2e9-ba7e-470a-9926-87fb15c4f91a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.285421 Oct 12 22:20:08.946024 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2154/4887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:08 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:08.982548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eefeab40-a94c-4a2f-8c25-63c3f1495632 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:08.983500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eefeab40-a94c-4a2f-8c25-63c3f1495632 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:08.990967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eefeab40-a94c-4a2f-8c25-63c3f1495632 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:08.995011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eefeab40-a94c-4a2f-8c25-63c3f1495632 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:08.995599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eefeab40-a94c-4a2f-8c25-63c3f1495632 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:08.996425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eefeab40-a94c-4a2f-8c25-63c3f1495632 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:08.998244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eefeab40-a94c-4a2f-8c25-63c3f1495632 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:08.998761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eefeab40-a94c-4a2f-8c25-63c3f1495632 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:09.233001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0aee8fc3-1588-4a98-8c33-ae995b7a0eae tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:09.233623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0aee8fc3-1588-4a98-8c33-ae995b7a0eae tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] [instance: 4c012c96-e0db-4fae-9045-2237c25029e8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:09.244177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0aee8fc3-1588-4a98-8c33-ae995b7a0eae tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:09.250437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0aee8fc3-1588-4a98-8c33-ae995b7a0eae tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:09.251148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0aee8fc3-1588-4a98-8c33-ae995b7a0eae tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:09.252162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0aee8fc3-1588-4a98-8c33-ae995b7a0eae tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:09.252809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0aee8fc3-1588-4a98-8c33-ae995b7a0eae tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:09.253407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0aee8fc3-1588-4a98-8c33-ae995b7a0eae tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:09.280910 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-0aee8fc3-1588-4a98-8c33-ae995b7a0eae tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] HTTP exception thrown: Instance 4c012c96-e0db-4fae-9045-2237c25029e8 could not be found. Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0aee8fc3-1588-4a98-8c33-ae995b7a0eae tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Request method failure captured: Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/4c012c96-e0db-4fae-9045-2237c25029e8 HTTP/1.1 Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz1nwvIprmZznjAeKA3vcIm-NwTfSrPbvqhFp-E2TXSCZNSM56LDhUX_csk59kLrudTDPOy3aI7hM3DlUr9dS6VaK7W0ueUmPEMk85Pm3NsSsEw4jcwvOthPcnjyyih_3eVVJd0m94FU9qXoYTQhgvNLrWVrwRxvmpE-jrLICwZ500Q Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-Openstack-Nova-Api-Version: 2.47 Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1a156d49115943af93cfc2164918987f Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerShowV247Test-1689072830 Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a156d49115943af93cfc2164918987f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a156d49115943af93cfc2164918987f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a156d49115943af93cfc2164918987f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a156d49115943af93cfc2164918987f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerShowV247Test-1689072830 Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1a156d49115943af93cfc2164918987f Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerShowV247Test-1689072830 Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerShowV247Test-1689072830-project Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 550933af3c7c44b5a33b00092c24737a Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerShowV247Test-1689072830-project Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 4c012c96-e0db-4fae-9045-2237c25029e8 could not be found. Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '4c012c96-e0db-4fae-9045-2237c25029e8'} Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c012c96-e0db-4fae-9045-2237c25029e8 could not be found. Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c012c96-e0db-4fae-9045-2237c25029e8 could not be found. Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:09.283580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:09.288392 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:09.288392 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:09.288392 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:09.288392 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:09.288392 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:09.288392 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c012c96-e0db-4fae-9045-2237c25029e8 could not be found. Oct 12 22:20:09.288392 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:09.288392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0aee8fc3-1588-4a98-8c33-ae995b7a0eae tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] Returning 404 to user: Instance 4c012c96-e0db-4fae-9045-2237c25029e8 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:09.289151 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0aee8fc3-1588-4a98-8c33-ae995b7a0eae tempest-ServerShowV247Test-1689072830 tempest-ServerShowV247Test-1689072830-project] 10.222.0.16 "GET /compute/v2.1/servers/4c012c96-e0db-4fae-9045-2237c25029e8" status: 404 len: 111 microversion: 2.47 time: 0.059402 Oct 12 22:20:09.294888 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2155/4888] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:09 2022] GET /compute/v2.1/servers/4c012c96-e0db-4fae-9045-2237c25029e8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:20:09.544647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d9f80062-b965-4208-94ab-d807a4e2a59d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:09.545269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d9f80062-b965-4208-94ab-d807a4e2a59d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:09.555942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9f80062-b965-4208-94ab-d807a4e2a59d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:09.556774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9f80062-b965-4208-94ab-d807a4e2a59d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:09.559066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9f80062-b965-4208-94ab-d807a4e2a59d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:09.560145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9f80062-b965-4208-94ab-d807a4e2a59d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:09.561749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9f80062-b965-4208-94ab-d807a4e2a59d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:09.562384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9f80062-b965-4208-94ab-d807a4e2a59d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:09.776451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eefeab40-a94c-4a2f-8c25-63c3f1495632 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:09.790537 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eefeab40-a94c-4a2f-8c25-63c3f1495632 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.820868 Oct 12 22:20:09.791203 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2734/4889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:08 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:09.814961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c5752e60-eb99-4b6f-a616-c3779d81aed3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:09.815972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c5752e60-eb99-4b6f-a616-c3779d81aed3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:09.822226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5752e60-eb99-4b6f-a616-c3779d81aed3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:09.822963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5752e60-eb99-4b6f-a616-c3779d81aed3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:09.823789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5752e60-eb99-4b6f-a616-c3779d81aed3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:09.824663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5752e60-eb99-4b6f-a616-c3779d81aed3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:09.825269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5752e60-eb99-4b6f-a616-c3779d81aed3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:09.825842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5752e60-eb99-4b6f-a616-c3779d81aed3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:09.917866 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c5752e60-eb99-4b6f-a616-c3779d81aed3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action" status: 202 len: 0 microversion: 2.1 time: 0.106523 Oct 12 22:20:09.919555 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2735/4890] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:09 2022] POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:20:09.942560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9a068ee1-c8d5-431d-91a7-a36877cc9dc6 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:09.943889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9a068ee1-c8d5-431d-91a7-a36877cc9dc6 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:09.957458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a068ee1-c8d5-431d-91a7-a36877cc9dc6 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:09.958646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a068ee1-c8d5-431d-91a7-a36877cc9dc6 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:09.960504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a068ee1-c8d5-431d-91a7-a36877cc9dc6 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:09.961518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a068ee1-c8d5-431d-91a7-a36877cc9dc6 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:09.962229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a068ee1-c8d5-431d-91a7-a36877cc9dc6 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:09.963093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a068ee1-c8d5-431d-91a7-a36877cc9dc6 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:09.963231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d9f80062-b965-4208-94ab-d807a4e2a59d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:09.972660 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d9f80062-b965-4208-94ab-d807a4e2a59d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.433223 Oct 12 22:20:09.977281 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2156/4891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:09 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:09.985006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8bf862cf-025c-4b03-948e-88f3115cb5c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:09.985907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8bf862cf-025c-4b03-948e-88f3115cb5c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:10.005992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:10.007915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bf862cf-025c-4b03-948e-88f3115cb5c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:10.011497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bf862cf-025c-4b03-948e-88f3115cb5c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:10.012141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bf862cf-025c-4b03-948e-88f3115cb5c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:10.014000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bf862cf-025c-4b03-948e-88f3115cb5c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:10.014765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bf862cf-025c-4b03-948e-88f3115cb5c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:10.017046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bf862cf-025c-4b03-948e-88f3115cb5c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:10.161537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9a068ee1-c8d5-431d-91a7-a36877cc9dc6 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd7262befc64279bac6f4aaf9c7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6c241409484307a7db7060346af159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:10.172292 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9a068ee1-c8d5-431d-91a7-a36877cc9dc6 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98" status: 200 len: 1274 microversion: 2.1 time: 0.251293 Oct 12 22:20:10.177368 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2736/4892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:09 2022] GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 => generated 1274 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:10.464115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8bf862cf-025c-4b03-948e-88f3115cb5c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:10.473825 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8bf862cf-025c-4b03-948e-88f3115cb5c3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1509 microversion: 2.1 time: 0.492570 Oct 12 22:20:10.487583 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2157/4893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:09 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1509 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:11.004526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-28e5c15b-3540-407e-bff3-1233680709c1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:11.005783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-28e5c15b-3540-407e-bff3-1233680709c1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:11.025462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28e5c15b-3540-407e-bff3-1233680709c1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:11.026318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28e5c15b-3540-407e-bff3-1233680709c1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:11.026931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28e5c15b-3540-407e-bff3-1233680709c1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:11.027827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28e5c15b-3540-407e-bff3-1233680709c1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:11.028430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28e5c15b-3540-407e-bff3-1233680709c1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:11.029040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28e5c15b-3540-407e-bff3-1233680709c1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:11.202481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c3c43a74-3d55-4070-919a-9f130b6cfa56 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:11.203998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c3c43a74-3d55-4070-919a-9f130b6cfa56 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:11.210524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:11.224412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3c43a74-3d55-4070-919a-9f130b6cfa56 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:11.225447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3c43a74-3d55-4070-919a-9f130b6cfa56 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:11.226885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3c43a74-3d55-4070-919a-9f130b6cfa56 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:11.228107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3c43a74-3d55-4070-919a-9f130b6cfa56 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:11.228825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3c43a74-3d55-4070-919a-9f130b6cfa56 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:11.229433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3c43a74-3d55-4070-919a-9f130b6cfa56 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:11.401662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:11.474814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-28e5c15b-3540-407e-bff3-1233680709c1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:11.485986 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-28e5c15b-3540-407e-bff3-1233680709c1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.487842 Oct 12 22:20:11.499277 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2737/4894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:10 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:11.501500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-687a1cc5-d5e2-40b3-b033-4d8db749218a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:11.502672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-687a1cc5-d5e2-40b3-b033-4d8db749218a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:11.513566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-687a1cc5-d5e2-40b3-b033-4d8db749218a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:11.514066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-687a1cc5-d5e2-40b3-b033-4d8db749218a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:11.514502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-687a1cc5-d5e2-40b3-b033-4d8db749218a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:11.520858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-687a1cc5-d5e2-40b3-b033-4d8db749218a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:11.521702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-687a1cc5-d5e2-40b3-b033-4d8db749218a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:11.522328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-687a1cc5-d5e2-40b3-b033-4d8db749218a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:12.018744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c3c43a74-3d55-4070-919a-9f130b6cfa56 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd7262befc64279bac6f4aaf9c7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6c241409484307a7db7060346af159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:12.029504 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c3c43a74-3d55-4070-919a-9f130b6cfa56 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98" status: 200 len: 1316 microversion: 2.1 time: 0.832413 Oct 12 22:20:12.029951 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2158/4895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:11 2022] GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 => generated 1316 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:12.328581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-687a1cc5-d5e2-40b3-b033-4d8db749218a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:12.343631 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-687a1cc5-d5e2-40b3-b033-4d8db749218a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1489 microversion: 2.1 time: 0.845176 Oct 12 22:20:12.347473 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2738/4896] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:11 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1489 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:12.375268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-df6c271e-027e-42d4-b9cd-30dcc9269747 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:12.378714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-df6c271e-027e-42d4-b9cd-30dcc9269747 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:12.394446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df6c271e-027e-42d4-b9cd-30dcc9269747 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:12.395367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df6c271e-027e-42d4-b9cd-30dcc9269747 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:12.396018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df6c271e-027e-42d4-b9cd-30dcc9269747 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:12.400897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df6c271e-027e-42d4-b9cd-30dcc9269747 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:12.403530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df6c271e-027e-42d4-b9cd-30dcc9269747 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:12.404663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df6c271e-027e-42d4-b9cd-30dcc9269747 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:12.480746 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-df6c271e-027e-42d4-b9cd-30dcc9269747 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Cannot 'pause' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state paused Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-df6c271e-027e-42d4-b9cd-30dcc9269747 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action HTTP/1.1 Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 13 Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: {"pause": {}} Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: exception: Cannot 'pause' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state paused Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '02be5cee-72e9-4cc6-94a2-c3517ec178bd', 'body': {'pause': {}}} Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd in vm_state paused. Cannot pause while the instance is in this state. Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state paused Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:12.482677 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:12.486581 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:12.486581 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:12.486581 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:12.486581 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state paused Oct 12 22:20:12.486581 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:12.486581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-df6c271e-027e-42d4-b9cd-30dcc9269747 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 409 to user: Cannot 'pause' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state paused {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:12.492351 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-df6c271e-027e-42d4-b9cd-30dcc9269747 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action" status: 409 len: 143 microversion: 2.1 time: 0.123578 Oct 12 22:20:12.493268 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2739/4897] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:12 2022] POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action => generated 143 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 12 22:20:12.501213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-30961d56-e883-43bd-887e-88c3d7b5e0d8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:12.502296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-30961d56-e883-43bd-887e-88c3d7b5e0d8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:12.513987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30961d56-e883-43bd-887e-88c3d7b5e0d8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:12.514492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30961d56-e883-43bd-887e-88c3d7b5e0d8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:12.514961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30961d56-e883-43bd-887e-88c3d7b5e0d8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:12.515720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30961d56-e883-43bd-887e-88c3d7b5e0d8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:12.516183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30961d56-e883-43bd-887e-88c3d7b5e0d8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:12.516641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-30961d56-e883-43bd-887e-88c3d7b5e0d8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:12.595156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1512848148", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:12.664926 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-30961d56-e883-43bd-887e-88c3d7b5e0d8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action" status: 202 len: 0 microversion: 2.1 time: 0.167238 Oct 12 22:20:12.669585 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2740/4898] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:12 2022] POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:20:12.692712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f403f54c-355a-4db3-be94-210e9164f31d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:12.694631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f403f54c-355a-4db3-be94-210e9164f31d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:12.722764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] validate_networks() for [('95ebd2a8-3052-4905-a297-eef07be03e1f', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:20:12.733807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f403f54c-355a-4db3-be94-210e9164f31d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:12.734760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f403f54c-355a-4db3-be94-210e9164f31d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:12.736893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f403f54c-355a-4db3-be94-210e9164f31d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:12.737867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f403f54c-355a-4db3-be94-210e9164f31d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:12.738569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f403f54c-355a-4db3-be94-210e9164f31d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:12.739224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f403f54c-355a-4db3-be94-210e9164f31d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:12.744312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:12.986247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f403f54c-355a-4db3-be94-210e9164f31d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:12.999749 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f403f54c-355a-4db3-be94-210e9164f31d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.327186 Oct 12 22:20:13.002482 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2741/4899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:12 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:13.015553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f580f2bf-be8e-4da9-b122-2cc84a893680 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:13.025959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f580f2bf-be8e-4da9-b122-2cc84a893680 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:13.050781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f580f2bf-be8e-4da9-b122-2cc84a893680 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:13.051710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f580f2bf-be8e-4da9-b122-2cc84a893680 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:13.052957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f580f2bf-be8e-4da9-b122-2cc84a893680 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:13.053881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f580f2bf-be8e-4da9-b122-2cc84a893680 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:13.056926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f580f2bf-be8e-4da9-b122-2cc84a893680 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:13.057942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f580f2bf-be8e-4da9-b122-2cc84a893680 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:13.582479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f580f2bf-be8e-4da9-b122-2cc84a893680 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:13.595690 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f580f2bf-be8e-4da9-b122-2cc84a893680 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.585952 Oct 12 22:20:13.596253 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2742/4900] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:13 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:13.636649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fdc77e84-a8c8-4aa2-99ee-0ecce4f7a443 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:13.637368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fdc77e84-a8c8-4aa2-99ee-0ecce4f7a443 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:13.663004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdc77e84-a8c8-4aa2-99ee-0ecce4f7a443 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:13.663780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdc77e84-a8c8-4aa2-99ee-0ecce4f7a443 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:13.664383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdc77e84-a8c8-4aa2-99ee-0ecce4f7a443 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:13.665278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdc77e84-a8c8-4aa2-99ee-0ecce4f7a443 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:13.671717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdc77e84-a8c8-4aa2-99ee-0ecce4f7a443 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:13.672188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fdc77e84-a8c8-4aa2-99ee-0ecce4f7a443 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:14.025049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fdc77e84-a8c8-4aa2-99ee-0ecce4f7a443 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd7262befc64279bac6f4aaf9c7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6c241409484307a7db7060346af159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:14.034244 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fdc77e84-a8c8-4aa2-99ee-0ecce4f7a443 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98" status: 200 len: 1316 microversion: 2.1 time: 0.424246 Oct 12 22:20:14.042325 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2743/4901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:13 2022] GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:14.360269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-1b72d1d8-8818-49f8-b6ed-25554860cfae req-ade6558b-d69f-4151-8988-5efc1c6d0f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efa646d0-6df2-47ae-829b-71ccb036fb98", "tag": "224435d9-441b-4ffa-8613-89a9c0f35c47"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:14.378057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:20:14.379957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:20:14.381322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:20:14.382010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:20:14.382690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:20:14.384708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1b72d1d8-8818-49f8-b6ed-25554860cfae req-ade6558b-d69f-4151-8988-5efc1c6d0f8c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:14.385193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1b72d1d8-8818-49f8-b6ed-25554860cfae req-ade6558b-d69f-4151-8988-5efc1c6d0f8c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:14.392070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1b72d1d8-8818-49f8-b6ed-25554860cfae req-ade6558b-d69f-4151-8988-5efc1c6d0f8c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:14.400756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:14.404330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:14.404982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:14.409583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:14.410398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:14.411102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:14.435117 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-1b72d1d8-8818-49f8-b6ed-25554860cfae req-ade6558b-d69f-4151-8988-5efc1c6d0f8c service nova] Creating event network-changed:224435d9-441b-4ffa-8613-89a9c0f35c47 for instance efa646d0-6df2-47ae-829b-71ccb036fb98 on n-h1-861111-1 Oct 12 22:20:14.451725 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-1b72d1d8-8818-49f8-b6ed-25554860cfae req-ade6558b-d69f-4151-8988-5efc1c6d0f8c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.407988 Oct 12 22:20:14.452348 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2744/4902] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:20:14.460448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Getting quotas for project 7c3184d24b3941a8b7eb9b4196469db6. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:20:14.473197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Getting quotas for user 16d95a9556e14cecb4a80265aa2dc322 and project 7c3184d24b3941a8b7eb9b4196469db6. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:20:14.477297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e70d5c6e-4547-4b79-8c71-5be62e099520 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:14.478056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e70d5c6e-4547-4b79-8c71-5be62e099520 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:14.504745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e70d5c6e-4547-4b79-8c71-5be62e099520 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:14.507417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e70d5c6e-4547-4b79-8c71-5be62e099520 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:14.508755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:20:14.509416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e70d5c6e-4547-4b79-8c71-5be62e099520 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:14.511969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e70d5c6e-4547-4b79-8c71-5be62e099520 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:14.512628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e70d5c6e-4547-4b79-8c71-5be62e099520 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:14.513997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:20:14.520470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e70d5c6e-4547-4b79-8c71-5be62e099520 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:14.664020 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6488885c-9961-40cc-8e9b-a280efa11be5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.366136 Oct 12 22:20:14.674467 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2159/4903] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:20:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 2380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:20:14.692149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ccd5cfb8-e70d-4dd0-8dd1-154b7367daa0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:14.693160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ccd5cfb8-e70d-4dd0-8dd1-154b7367daa0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:14.728548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ccd5cfb8-e70d-4dd0-8dd1-154b7367daa0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:14.731878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ccd5cfb8-e70d-4dd0-8dd1-154b7367daa0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:14.733261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ccd5cfb8-e70d-4dd0-8dd1-154b7367daa0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:14.734398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ccd5cfb8-e70d-4dd0-8dd1-154b7367daa0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:14.737491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ccd5cfb8-e70d-4dd0-8dd1-154b7367daa0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:14.738125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ccd5cfb8-e70d-4dd0-8dd1-154b7367daa0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:14.881749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e70d5c6e-4547-4b79-8c71-5be62e099520 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:14.902307 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e70d5c6e-4547-4b79-8c71-5be62e099520 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.443655 Oct 12 22:20:14.903779 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2745/4904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:14 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:14.918861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-19fe6cb0-d7e3-4762-80b6-8e79ad1f9313 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:14.922569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-19fe6cb0-d7e3-4762-80b6-8e79ad1f9313 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:15.016214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-19fe6cb0-d7e3-4762-80b6-8e79ad1f9313 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:15.027664 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-19fe6cb0-d7e3-4762-80b6-8e79ad1f9313 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1223 microversion: 2.1 time: 0.121185 Oct 12 22:20:15.028247 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2746/4905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:14 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1223 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:15.041121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2f04a1bb-bce3-463c-b44a-895b5c5c9f97 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:15.053009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2f04a1bb-bce3-463c-b44a-895b5c5c9f97 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:15.072518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f04a1bb-bce3-463c-b44a-895b5c5c9f97 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:15.076615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f04a1bb-bce3-463c-b44a-895b5c5c9f97 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:15.077175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f04a1bb-bce3-463c-b44a-895b5c5c9f97 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:15.078530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f04a1bb-bce3-463c-b44a-895b5c5c9f97 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:15.079010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f04a1bb-bce3-463c-b44a-895b5c5c9f97 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:15.079477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f04a1bb-bce3-463c-b44a-895b5c5c9f97 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:15.122714 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-2f04a1bb-bce3-463c-b44a-895b5c5c9f97 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2f04a1bb-bce3-463c-b44a-895b5c5c9f97 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08/action HTTP/1.1 Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 28 Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: {"reboot": {"type": "SOFT"}} Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1cd026e6-7533-4efb-88f5-1573116d8f08', 'body': {'reboot': {'type': 'SOFT'}}} Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:15.126140 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:15.129950 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:20:15.129950 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:15.129950 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:15.129950 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:15.129950 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:15.129950 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:15.129950 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:15.129950 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:15.129950 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:15.129950 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:20:15.129950 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:15.129950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2f04a1bb-bce3-463c-b44a-895b5c5c9f97 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:15.131458 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2f04a1bb-bce3-463c-b44a-895b5c5c9f97 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08/action" status: 404 len: 111 microversion: 2.1 time: 0.095915 Oct 12 22:20:15.132492 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2747/4906] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:15 2022] POST /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08/action => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:20:15.146817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-178b4858-3eb5-4ce8-aeed-4948c8e9f7d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:15.147630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-178b4858-3eb5-4ce8-aeed-4948c8e9f7d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:15.156069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:15.159912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-178b4858-3eb5-4ce8-aeed-4948c8e9f7d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:15.160897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-178b4858-3eb5-4ce8-aeed-4948c8e9f7d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:15.161691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-178b4858-3eb5-4ce8-aeed-4948c8e9f7d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:15.162902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-178b4858-3eb5-4ce8-aeed-4948c8e9f7d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:15.163639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-178b4858-3eb5-4ce8-aeed-4948c8e9f7d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:15.164458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-178b4858-3eb5-4ce8-aeed-4948c8e9f7d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:15.349748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ccd5cfb8-e70d-4dd0-8dd1-154b7367daa0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:15.360368 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ccd5cfb8-e70d-4dd0-8dd1-154b7367daa0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.684203 Oct 12 22:20:15.371956 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2160/4907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:14 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:15.388406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b71e80a-676e-40c6-8ab1-b596c1b74ac1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:15.390026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6b71e80a-676e-40c6-8ab1-b596c1b74ac1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:15.399182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b71e80a-676e-40c6-8ab1-b596c1b74ac1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:15.399749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b71e80a-676e-40c6-8ab1-b596c1b74ac1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:15.400133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b71e80a-676e-40c6-8ab1-b596c1b74ac1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:15.402673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b71e80a-676e-40c6-8ab1-b596c1b74ac1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:15.405507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b71e80a-676e-40c6-8ab1-b596c1b74ac1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:15.407248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b71e80a-676e-40c6-8ab1-b596c1b74ac1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:15.503772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-178b4858-3eb5-4ce8-aeed-4948c8e9f7d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd7262befc64279bac6f4aaf9c7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6c241409484307a7db7060346af159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:15.530448 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-178b4858-3eb5-4ce8-aeed-4948c8e9f7d9 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98" status: 200 len: 1316 microversion: 2.1 time: 0.396591 Oct 12 22:20:15.531719 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2748/4908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:15 2022] GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:16.051641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-09eb1185-17d9-4651-9902-37408ed3d0fe tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:16.053252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-09eb1185-17d9-4651-9902-37408ed3d0fe tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:16.065422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09eb1185-17d9-4651-9902-37408ed3d0fe tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:16.082803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09eb1185-17d9-4651-9902-37408ed3d0fe tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:16.084016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09eb1185-17d9-4651-9902-37408ed3d0fe tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:16.087474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09eb1185-17d9-4651-9902-37408ed3d0fe tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:16.087952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09eb1185-17d9-4651-9902-37408ed3d0fe tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:16.088392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09eb1185-17d9-4651-9902-37408ed3d0fe tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:16.238367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6b71e80a-676e-40c6-8ab1-b596c1b74ac1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:16.249927 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6b71e80a-676e-40c6-8ab1-b596c1b74ac1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.875862 Oct 12 22:20:16.252703 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2161/4909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:15 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:16.281702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-caf34295-1c95-4811-ba84-15f3cd56dea1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:16.282511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-caf34295-1c95-4811-ba84-15f3cd56dea1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:16.292431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caf34295-1c95-4811-ba84-15f3cd56dea1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:16.301361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-09eb1185-17d9-4651-9902-37408ed3d0fe tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:16.306617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caf34295-1c95-4811-ba84-15f3cd56dea1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:16.312494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caf34295-1c95-4811-ba84-15f3cd56dea1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:16.313477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caf34295-1c95-4811-ba84-15f3cd56dea1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:16.314859 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-09eb1185-17d9-4651-9902-37408ed3d0fe tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1219 microversion: 2.1 time: 0.268767 Oct 12 22:20:16.315827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caf34295-1c95-4811-ba84-15f3cd56dea1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:16.316455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-caf34295-1c95-4811-ba84-15f3cd56dea1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:16.317359 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2749/4910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:16 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1219 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:16.397567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6c755651-3252-47d9-9bd2-fbf4e7284aae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:16.398208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6c755651-3252-47d9-9bd2-fbf4e7284aae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:16.406762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c755651-3252-47d9-9bd2-fbf4e7284aae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:16.411796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c755651-3252-47d9-9bd2-fbf4e7284aae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:16.425547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c755651-3252-47d9-9bd2-fbf4e7284aae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:16.426995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c755651-3252-47d9-9bd2-fbf4e7284aae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:16.435937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c755651-3252-47d9-9bd2-fbf4e7284aae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:16.438847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c755651-3252-47d9-9bd2-fbf4e7284aae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:16.714268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6c755651-3252-47d9-9bd2-fbf4e7284aae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:16.728581 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6c755651-3252-47d9-9bd2-fbf4e7284aae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.335048 Oct 12 22:20:16.729369 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2750/4911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:16 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:16.747210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e02af4c3-efd2-4847-bf81-b0f443798708 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:16.747861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e02af4c3-efd2-4847-bf81-b0f443798708 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:16.779712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e02af4c3-efd2-4847-bf81-b0f443798708 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:16.780595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e02af4c3-efd2-4847-bf81-b0f443798708 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:16.781227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e02af4c3-efd2-4847-bf81-b0f443798708 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:16.783079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e02af4c3-efd2-4847-bf81-b0f443798708 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:16.800024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e02af4c3-efd2-4847-bf81-b0f443798708 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:16.806947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e02af4c3-efd2-4847-bf81-b0f443798708 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:16.913332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-caf34295-1c95-4811-ba84-15f3cd56dea1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:16.928210 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-caf34295-1c95-4811-ba84-15f3cd56dea1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.649778 Oct 12 22:20:16.928868 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2162/4912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:16 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:16.958044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b402df64-fd49-4dc3-8df8-4e6bcfd551f6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:16.961414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b402df64-fd49-4dc3-8df8-4e6bcfd551f6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 131a22d3-935f-4f34-90fd-a0951192ad45] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:16.982281 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-b402df64-fd49-4dc3-8df8-4e6bcfd551f6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 131a22d3-935f-4f34-90fd-a0951192ad45 could not be found. Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b402df64-fd49-4dc3-8df8-4e6bcfd551f6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/131a22d3-935f-4f34-90fd-a0951192ad45/action HTTP/1.1 Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 28 Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: {"reboot": {"type": "SOFT"}} Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 131a22d3-935f-4f34-90fd-a0951192ad45 could not be found. Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '131a22d3-935f-4f34-90fd-a0951192ad45', 'body': {'reboot': {'type': 'SOFT'}}} Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 131a22d3-935f-4f34-90fd-a0951192ad45 could not be found. Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 131a22d3-935f-4f34-90fd-a0951192ad45 could not be found. Oct 12 22:20:16.985229 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:16.993296 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:16.993296 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:16.993296 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:16.993296 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:16.993296 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:16.993296 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:16.993296 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:16.993296 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 131a22d3-935f-4f34-90fd-a0951192ad45 could not be found. Oct 12 22:20:16.993296 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:16.993296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b402df64-fd49-4dc3-8df8-4e6bcfd551f6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 131a22d3-935f-4f34-90fd-a0951192ad45 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:16.993296 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b402df64-fd49-4dc3-8df8-4e6bcfd551f6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/131a22d3-935f-4f34-90fd-a0951192ad45/action" status: 404 len: 111 microversion: 2.1 time: 0.037054 Oct 12 22:20:16.993296 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2163/4913] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:16 2022] POST /compute/v2.1/servers/131a22d3-935f-4f34-90fd-a0951192ad45/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:20:17.004077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dfd194c4-2ba1-45c8-9d61-174146a17b6c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:17.004709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dfd194c4-2ba1-45c8-9d61-174146a17b6c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:17.019827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfd194c4-2ba1-45c8-9d61-174146a17b6c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:17.020339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfd194c4-2ba1-45c8-9d61-174146a17b6c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:17.020789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfd194c4-2ba1-45c8-9d61-174146a17b6c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:17.023533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfd194c4-2ba1-45c8-9d61-174146a17b6c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:17.024027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfd194c4-2ba1-45c8-9d61-174146a17b6c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:17.024470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfd194c4-2ba1-45c8-9d61-174146a17b6c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:17.325194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e02af4c3-efd2-4847-bf81-b0f443798708 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd7262befc64279bac6f4aaf9c7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6c241409484307a7db7060346af159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:17.347113 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e02af4c3-efd2-4847-bf81-b0f443798708 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98" status: 200 len: 1316 microversion: 2.1 time: 0.616248 Oct 12 22:20:17.366088 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2751/4914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:16 2022] GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 => generated 1316 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:17.375298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ae19cd21-85fc-4d7d-8a00-be396fbab7b3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:17.375955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ae19cd21-85fc-4d7d-8a00-be396fbab7b3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:17.400691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae19cd21-85fc-4d7d-8a00-be396fbab7b3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:17.401304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae19cd21-85fc-4d7d-8a00-be396fbab7b3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:17.401977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae19cd21-85fc-4d7d-8a00-be396fbab7b3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:17.402999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae19cd21-85fc-4d7d-8a00-be396fbab7b3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:17.404601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae19cd21-85fc-4d7d-8a00-be396fbab7b3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:17.405217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae19cd21-85fc-4d7d-8a00-be396fbab7b3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:17.514019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ae19cd21-85fc-4d7d-8a00-be396fbab7b3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:17.526467 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ae19cd21-85fc-4d7d-8a00-be396fbab7b3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1293 microversion: 2.1 time: 0.159056 Oct 12 22:20:17.527993 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2752/4915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:17 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1293 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:17.757166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dfd194c4-2ba1-45c8-9d61-174146a17b6c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:17.762007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8fb44108-aa35-4079-bce1-f08763cca6fb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:17.765029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8fb44108-aa35-4079-bce1-f08763cca6fb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:17.776599 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dfd194c4-2ba1-45c8-9d61-174146a17b6c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.783920 Oct 12 22:20:17.789068 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2164/4916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:16 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:17.791825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fb44108-aa35-4079-bce1-f08763cca6fb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:17.793451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fb44108-aa35-4079-bce1-f08763cca6fb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:17.795527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fb44108-aa35-4079-bce1-f08763cca6fb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:17.796476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fb44108-aa35-4079-bce1-f08763cca6fb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:17.798317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fb44108-aa35-4079-bce1-f08763cca6fb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:17.799223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fb44108-aa35-4079-bce1-f08763cca6fb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:17.817112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f24b9ea4-d941-430f-9d24-18bb760cca95 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:17.819525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f24b9ea4-d941-430f-9d24-18bb760cca95 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:17.837943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f24b9ea4-d941-430f-9d24-18bb760cca95 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:17.841139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f24b9ea4-d941-430f-9d24-18bb760cca95 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:17.845962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f24b9ea4-d941-430f-9d24-18bb760cca95 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:17.859099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f24b9ea4-d941-430f-9d24-18bb760cca95 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:17.861513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f24b9ea4-d941-430f-9d24-18bb760cca95 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:17.869715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f24b9ea4-d941-430f-9d24-18bb760cca95 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:18.160410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8fb44108-aa35-4079-bce1-f08763cca6fb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:18.182897 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8fb44108-aa35-4079-bce1-f08763cca6fb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.431477 Oct 12 22:20:18.184206 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2753/4917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:17 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:18.374299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e132b62a-ebdd-45c0-89bc-da1d52238dc8 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:18.374941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e132b62a-ebdd-45c0-89bc-da1d52238dc8 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:18.386130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e132b62a-ebdd-45c0-89bc-da1d52238dc8 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:18.386633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e132b62a-ebdd-45c0-89bc-da1d52238dc8 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:18.387138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e132b62a-ebdd-45c0-89bc-da1d52238dc8 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:18.387898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e132b62a-ebdd-45c0-89bc-da1d52238dc8 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:18.388420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e132b62a-ebdd-45c0-89bc-da1d52238dc8 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:18.388761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e132b62a-ebdd-45c0-89bc-da1d52238dc8 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:18.670970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e132b62a-ebdd-45c0-89bc-da1d52238dc8 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd7262befc64279bac6f4aaf9c7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6c241409484307a7db7060346af159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:18.683574 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e132b62a-ebdd-45c0-89bc-da1d52238dc8 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98" status: 200 len: 1316 microversion: 2.1 time: 0.310562 Oct 12 22:20:18.685553 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2754/4918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:18 2022] GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:18.699961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b6585c1e-cd56-4db2-8bdd-9a53b63ea6fb tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:18.700775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b6585c1e-cd56-4db2-8bdd-9a53b63ea6fb tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:18.711319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6585c1e-cd56-4db2-8bdd-9a53b63ea6fb tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:18.712565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6585c1e-cd56-4db2-8bdd-9a53b63ea6fb tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:18.713296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6585c1e-cd56-4db2-8bdd-9a53b63ea6fb tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:18.714472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6585c1e-cd56-4db2-8bdd-9a53b63ea6fb tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:18.716052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6585c1e-cd56-4db2-8bdd-9a53b63ea6fb tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:18.716646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6585c1e-cd56-4db2-8bdd-9a53b63ea6fb tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:18.880278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b6585c1e-cd56-4db2-8bdd-9a53b63ea6fb tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:18.894417 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b6585c1e-cd56-4db2-8bdd-9a53b63ea6fb tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1281 microversion: 2.1 time: 0.207583 Oct 12 22:20:18.896442 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2755/4919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:18 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1281 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:19.165603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f24b9ea4-d941-430f-9d24-18bb760cca95 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:19.175343 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f24b9ea4-d941-430f-9d24-18bb760cca95 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 1.362724 Oct 12 22:20:19.180215 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2165/4920] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:17 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:19.213118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-312f25af-afe3-4ba5-8a72-1aab59de253e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:19.217385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8d4c78d0-eb4c-40ce-ba1d-b53b6ea15722 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:19.217385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8d4c78d0-eb4c-40ce-ba1d-b53b6ea15722 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:19.229027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-312f25af-afe3-4ba5-8a72-1aab59de253e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:19.238924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-312f25af-afe3-4ba5-8a72-1aab59de253e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:19.239756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-312f25af-afe3-4ba5-8a72-1aab59de253e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:19.240380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-312f25af-afe3-4ba5-8a72-1aab59de253e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:19.241906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-312f25af-afe3-4ba5-8a72-1aab59de253e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:19.242524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-312f25af-afe3-4ba5-8a72-1aab59de253e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:19.243111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-312f25af-afe3-4ba5-8a72-1aab59de253e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:19.252408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d4c78d0-eb4c-40ce-ba1d-b53b6ea15722 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:19.254628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d4c78d0-eb4c-40ce-ba1d-b53b6ea15722 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:19.255511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d4c78d0-eb4c-40ce-ba1d-b53b6ea15722 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:19.259773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d4c78d0-eb4c-40ce-ba1d-b53b6ea15722 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:19.260703 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-312f25af-afe3-4ba5-8a72-1aab59de253e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:20:19.261940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d4c78d0-eb4c-40ce-ba1d-b53b6ea15722 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-312f25af-afe3-4ba5-8a72-1aab59de253e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08/action HTTP/1.1 Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 65 Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: {"rebuild": {"imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c"}} Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1cd026e6-7533-4efb-88f5-1573116d8f08', 'body': {'rebuild': {'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c'}}} Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 12 22:20:19.263403 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 12 22:20:19.268377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 22:20:19.268377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:20:19.268377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:20:19.268377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:19.268377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:19.268377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:20:19.268377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:19.268377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:19.268377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:19.268377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:19.268377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:19.268377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:19.268377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:19.268377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:19.268377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:20:19.268377 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:19.270145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d4c78d0-eb4c-40ce-ba1d-b53b6ea15722 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:19.271807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-312f25af-afe3-4ba5-8a72-1aab59de253e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:19.272967 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-312f25af-afe3-4ba5-8a72-1aab59de253e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08/action" status: 404 len: 111 microversion: 2.1 time: 0.074300 Oct 12 22:20:19.275705 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2756/4921] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:19 2022] POST /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08/action => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:20:19.284174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a2add8f7-c24c-4341-803f-1863120f3e78 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:19.285113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a2add8f7-c24c-4341-803f-1863120f3e78 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:19.293975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2add8f7-c24c-4341-803f-1863120f3e78 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:19.294800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2add8f7-c24c-4341-803f-1863120f3e78 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:19.295459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2add8f7-c24c-4341-803f-1863120f3e78 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:19.296651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2add8f7-c24c-4341-803f-1863120f3e78 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:19.297354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2add8f7-c24c-4341-803f-1863120f3e78 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:19.297990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2add8f7-c24c-4341-803f-1863120f3e78 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:19.601700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a2add8f7-c24c-4341-803f-1863120f3e78 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:19.623470 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a2add8f7-c24c-4341-803f-1863120f3e78 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.344108 Oct 12 22:20:19.635365 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2757/4922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:19 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:19.762382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8d4c78d0-eb4c-40ce-ba1d-b53b6ea15722 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:19.779770 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8d4c78d0-eb4c-40ce-ba1d-b53b6ea15722 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.573130 Oct 12 22:20:19.780432 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2166/4923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:19 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:19.795799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb2aa452-9a79-4597-bee7-d840f8e9e9f4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:19.796424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eb2aa452-9a79-4597-bee7-d840f8e9e9f4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:19.809046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb2aa452-9a79-4597-bee7-d840f8e9e9f4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:19.809732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb2aa452-9a79-4597-bee7-d840f8e9e9f4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:19.810593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb2aa452-9a79-4597-bee7-d840f8e9e9f4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:19.811663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb2aa452-9a79-4597-bee7-d840f8e9e9f4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:19.812285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb2aa452-9a79-4597-bee7-d840f8e9e9f4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:19.812869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb2aa452-9a79-4597-bee7-d840f8e9e9f4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:19.817409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:20.127308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-121bff15-8fd9-4c7d-ae09-a7d8eff09612 req-18f8e4f5-4592-4f38-a585-c66bfecb5f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efa646d0-6df2-47ae-829b-71ccb036fb98", "name": "network-vif-plugged", "status": "completed", "tag": "224435d9-441b-4ffa-8613-89a9c0f35c47"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:20.155727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-121bff15-8fd9-4c7d-ae09-a7d8eff09612 req-18f8e4f5-4592-4f38-a585-c66bfecb5f76 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:20.156211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-121bff15-8fd9-4c7d-ae09-a7d8eff09612 req-18f8e4f5-4592-4f38-a585-c66bfecb5f76 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:20.156644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-121bff15-8fd9-4c7d-ae09-a7d8eff09612 req-18f8e4f5-4592-4f38-a585-c66bfecb5f76 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:20.193885 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-121bff15-8fd9-4c7d-ae09-a7d8eff09612 req-18f8e4f5-4592-4f38-a585-c66bfecb5f76 service nova] Creating event network-vif-plugged:224435d9-441b-4ffa-8613-89a9c0f35c47 for instance efa646d0-6df2-47ae-829b-71ccb036fb98 on n-h1-861111-1 Oct 12 22:20:20.213285 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-121bff15-8fd9-4c7d-ae09-a7d8eff09612 req-18f8e4f5-4592-4f38-a585-c66bfecb5f76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.583346 Oct 12 22:20:20.216287 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2758/4924] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:20:20.250334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ea4f79b8-4c31-47cf-89ca-3b896b80d25d tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:20.251047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ea4f79b8-4c31-47cf-89ca-3b896b80d25d tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:20.293089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea4f79b8-4c31-47cf-89ca-3b896b80d25d tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:20.295542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea4f79b8-4c31-47cf-89ca-3b896b80d25d tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:20.297142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea4f79b8-4c31-47cf-89ca-3b896b80d25d tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:20.298904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea4f79b8-4c31-47cf-89ca-3b896b80d25d tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:20.303276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea4f79b8-4c31-47cf-89ca-3b896b80d25d tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:20.304058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea4f79b8-4c31-47cf-89ca-3b896b80d25d tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:20.357085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eb2aa452-9a79-4597-bee7-d840f8e9e9f4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:20.371270 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb2aa452-9a79-4597-bee7-d840f8e9e9f4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.576995 Oct 12 22:20:20.371914 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2167/4925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:19 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:20.404665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7e58a61f-5928-4623-b0dc-45ee0c7b3ac4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:20.406962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7e58a61f-5928-4623-b0dc-45ee0c7b3ac4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:20.433482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e58a61f-5928-4623-b0dc-45ee0c7b3ac4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:20.436296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e58a61f-5928-4623-b0dc-45ee0c7b3ac4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:20.437623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e58a61f-5928-4623-b0dc-45ee0c7b3ac4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:20.438690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e58a61f-5928-4623-b0dc-45ee0c7b3ac4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:20.441159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e58a61f-5928-4623-b0dc-45ee0c7b3ac4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:20.442359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e58a61f-5928-4623-b0dc-45ee0c7b3ac4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:20.805575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ea4f79b8-4c31-47cf-89ca-3b896b80d25d tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd7262befc64279bac6f4aaf9c7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6c241409484307a7db7060346af159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:20.817049 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ea4f79b8-4c31-47cf-89ca-3b896b80d25d tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98" status: 200 len: 1316 microversion: 2.1 time: 0.599148 Oct 12 22:20:20.820373 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2759/4926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:20 2022] GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 => generated 1316 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:20.825638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eac2d9f1-db18-456d-96ad-9f2da9e3d3c0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:20.828398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eac2d9f1-db18-456d-96ad-9f2da9e3d3c0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 2e5d8dbf-3e5e-4605-9c47-079d075e7a7a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:20.838524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:20.839951 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-eac2d9f1-db18-456d-96ad-9f2da9e3d3c0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 2e5d8dbf-3e5e-4605-9c47-079d075e7a7a could not be found. Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eac2d9f1-db18-456d-96ad-9f2da9e3d3c0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/2e5d8dbf-3e5e-4605-9c47-079d075e7a7a/action HTTP/1.1 Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 65 Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: {"rebuild": {"imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c"}} Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 2e5d8dbf-3e5e-4605-9c47-079d075e7a7a could not be found. Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '2e5d8dbf-3e5e-4605-9c47-079d075e7a7a', 'body': {'rebuild': {'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c'}}} Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e5d8dbf-3e5e-4605-9c47-079d075e7a7a could not be found. Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 22:20:20.844664 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:20:20.850873 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:20:20.850873 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:20.850873 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:20.850873 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5d8dbf-3e5e-4605-9c47-079d075e7a7a could not be found. Oct 12 22:20:20.850873 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:20.850873 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:20.850873 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:20.850873 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:20.850873 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:20.850873 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:20.850873 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:20.850873 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:20.850873 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5d8dbf-3e5e-4605-9c47-079d075e7a7a could not be found. Oct 12 22:20:20.850873 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:20.850873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eac2d9f1-db18-456d-96ad-9f2da9e3d3c0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 2e5d8dbf-3e5e-4605-9c47-079d075e7a7a could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:20.850873 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eac2d9f1-db18-456d-96ad-9f2da9e3d3c0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/2e5d8dbf-3e5e-4605-9c47-079d075e7a7a/action" status: 404 len: 111 microversion: 2.1 time: 0.025333 Oct 12 22:20:20.850873 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2760/4927] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:20 2022] POST /compute/v2.1/servers/2e5d8dbf-3e5e-4605-9c47-079d075e7a7a/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:20:20.864006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-163ca87f-89c2-4fb0-9ea7-e1383ee7926d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:20.865941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-163ca87f-89c2-4fb0-9ea7-e1383ee7926d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:20.887875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-163ca87f-89c2-4fb0-9ea7-e1383ee7926d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:20.888831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-163ca87f-89c2-4fb0-9ea7-e1383ee7926d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:20.892110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-163ca87f-89c2-4fb0-9ea7-e1383ee7926d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:20.893233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-163ca87f-89c2-4fb0-9ea7-e1383ee7926d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:20.896901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-163ca87f-89c2-4fb0-9ea7-e1383ee7926d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:20.898516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-163ca87f-89c2-4fb0-9ea7-e1383ee7926d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:21.013791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e58a61f-5928-4623-b0dc-45ee0c7b3ac4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:21.029347 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7e58a61f-5928-4623-b0dc-45ee0c7b3ac4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1323 microversion: 2.1 time: 0.655256 Oct 12 22:20:21.032946 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2168/4928] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:20 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1323 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:21.050617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d43b830a-2ad0-4adf-93b8-81680b10e5a0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:21.054694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d43b830a-2ad0-4adf-93b8-81680b10e5a0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:21.069804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d43b830a-2ad0-4adf-93b8-81680b10e5a0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:21.071542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d43b830a-2ad0-4adf-93b8-81680b10e5a0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:21.072206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d43b830a-2ad0-4adf-93b8-81680b10e5a0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:21.073234 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d43b830a-2ad0-4adf-93b8-81680b10e5a0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:21.073902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d43b830a-2ad0-4adf-93b8-81680b10e5a0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:21.074581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d43b830a-2ad0-4adf-93b8-81680b10e5a0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:21.225526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-163ca87f-89c2-4fb0-9ea7-e1383ee7926d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:21.237678 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-163ca87f-89c2-4fb0-9ea7-e1383ee7926d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.387735 Oct 12 22:20:21.238484 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2761/4929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:20 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:21.608643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d43b830a-2ad0-4adf-93b8-81680b10e5a0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:21.618717 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d43b830a-2ad0-4adf-93b8-81680b10e5a0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.584413 Oct 12 22:20:21.620709 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2169/4930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:21 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:21.647584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-71095985-8b35-491a-ba38-f3ad31b08f75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:21.648721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-71095985-8b35-491a-ba38-f3ad31b08f75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:21.656809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71095985-8b35-491a-ba38-f3ad31b08f75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:21.657729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71095985-8b35-491a-ba38-f3ad31b08f75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:21.658500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71095985-8b35-491a-ba38-f3ad31b08f75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:21.659508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71095985-8b35-491a-ba38-f3ad31b08f75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:21.660193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71095985-8b35-491a-ba38-f3ad31b08f75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:21.660847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71095985-8b35-491a-ba38-f3ad31b08f75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:21.678370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:21.855664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0818220c-966a-45c2-88c0-b1a31bad86a7 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:21.856752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0818220c-966a-45c2-88c0-b1a31bad86a7 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:21.876828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0818220c-966a-45c2-88c0-b1a31bad86a7 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:21.877344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0818220c-966a-45c2-88c0-b1a31bad86a7 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:21.877808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0818220c-966a-45c2-88c0-b1a31bad86a7 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:21.878542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0818220c-966a-45c2-88c0-b1a31bad86a7 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:21.882843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0818220c-966a-45c2-88c0-b1a31bad86a7 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:21.883560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0818220c-966a-45c2-88c0-b1a31bad86a7 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:22.073252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-71095985-8b35-491a-ba38-f3ad31b08f75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:22.083850 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-71095985-8b35-491a-ba38-f3ad31b08f75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.440001 Oct 12 22:20:22.085501 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2762/4931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:21 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:22.091573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b21b9d06-35d6-4bca-a1f4-f02deb879584 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:22.092299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b21b9d06-35d6-4bca-a1f4-f02deb879584 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:22.099752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b21b9d06-35d6-4bca-a1f4-f02deb879584 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:22.100653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b21b9d06-35d6-4bca-a1f4-f02deb879584 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:22.105845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b21b9d06-35d6-4bca-a1f4-f02deb879584 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:22.106926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b21b9d06-35d6-4bca-a1f4-f02deb879584 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:22.107714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b21b9d06-35d6-4bca-a1f4-f02deb879584 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:22.108297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b21b9d06-35d6-4bca-a1f4-f02deb879584 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:22.332809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0818220c-966a-45c2-88c0-b1a31bad86a7 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd7262befc64279bac6f4aaf9c7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6c241409484307a7db7060346af159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:22.343638 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0818220c-966a-45c2-88c0-b1a31bad86a7 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98" status: 200 len: 1316 microversion: 2.1 time: 0.501171 Oct 12 22:20:22.344220 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2170/4932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:21 2022] GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 => generated 1316 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:22.364062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a51e0ecd-5a6e-4a86-a2ac-f5bb60b9d973 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:22.364890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a51e0ecd-5a6e-4a86-a2ac-f5bb60b9d973 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 39ebbd19-1ad1-4ee3-b123-27c2054da6e8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:22.371232 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-a51e0ecd-5a6e-4a86-a2ac-f5bb60b9d973 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 39ebbd19-1ad1-4ee3-b123-27c2054da6e8 could not be found. Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a51e0ecd-5a6e-4a86-a2ac-f5bb60b9d973 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/39ebbd19-1ad1-4ee3-b123-27c2054da6e8/action HTTP/1.1 Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 15 Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: {"restore": {}} Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 39ebbd19-1ad1-4ee3-b123-27c2054da6e8 could not be found. Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '39ebbd19-1ad1-4ee3-b123-27c2054da6e8', 'body': {'restore': {}}} Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39ebbd19-1ad1-4ee3-b123-27c2054da6e8 could not be found. Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39ebbd19-1ad1-4ee3-b123-27c2054da6e8 could not be found. Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:22.373538 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:22.377994 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:22.377994 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:22.377994 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39ebbd19-1ad1-4ee3-b123-27c2054da6e8 could not be found. Oct 12 22:20:22.377994 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:22.377994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a51e0ecd-5a6e-4a86-a2ac-f5bb60b9d973 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 39ebbd19-1ad1-4ee3-b123-27c2054da6e8 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:22.386238 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a51e0ecd-5a6e-4a86-a2ac-f5bb60b9d973 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/39ebbd19-1ad1-4ee3-b123-27c2054da6e8/action" status: 404 len: 111 microversion: 2.1 time: 0.039769 Oct 12 22:20:22.386868 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2171/4933] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:22 2022] POST /compute/v2.1/servers/39ebbd19-1ad1-4ee3-b123-27c2054da6e8/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:20:22.402134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b955a925-3736-4545-b25a-2d4cb27ba1c7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:22.404895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b955a925-3736-4545-b25a-2d4cb27ba1c7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:22.416440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b21b9d06-35d6-4bca-a1f4-f02deb879584 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:22.422488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b955a925-3736-4545-b25a-2d4cb27ba1c7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:22.425639 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b21b9d06-35d6-4bca-a1f4-f02deb879584 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1323 microversion: 2.1 time: 0.338958 Oct 12 22:20:22.426434 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2763/4934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:22 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1323 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:22.426562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b955a925-3736-4545-b25a-2d4cb27ba1c7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:22.427133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b955a925-3736-4545-b25a-2d4cb27ba1c7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:22.428000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b955a925-3736-4545-b25a-2d4cb27ba1c7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:22.433093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b955a925-3736-4545-b25a-2d4cb27ba1c7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:22.433663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b955a925-3736-4545-b25a-2d4cb27ba1c7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:22.452482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-61395bf0-34e5-4c30-a74e-99e6d34d376d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:22.453105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-61395bf0-34e5-4c30-a74e-99e6d34d376d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:22.472277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61395bf0-34e5-4c30-a74e-99e6d34d376d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:22.472780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61395bf0-34e5-4c30-a74e-99e6d34d376d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:22.473227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61395bf0-34e5-4c30-a74e-99e6d34d376d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:22.473948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61395bf0-34e5-4c30-a74e-99e6d34d376d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:22.474405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61395bf0-34e5-4c30-a74e-99e6d34d376d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:22.474840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61395bf0-34e5-4c30-a74e-99e6d34d376d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:22.814315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-61395bf0-34e5-4c30-a74e-99e6d34d376d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:22.832187 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-61395bf0-34e5-4c30-a74e-99e6d34d376d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.384907 Oct 12 22:20:22.833173 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2764/4935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:22 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:22.865489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8f877fe3-5614-4eda-af97-e0c3b1590eee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:22.866392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8f877fe3-5614-4eda-af97-e0c3b1590eee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:22.886884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f877fe3-5614-4eda-af97-e0c3b1590eee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:22.887016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f877fe3-5614-4eda-af97-e0c3b1590eee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:22.887192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b955a925-3736-4545-b25a-2d4cb27ba1c7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:22.889666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f877fe3-5614-4eda-af97-e0c3b1590eee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:22.890991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f877fe3-5614-4eda-af97-e0c3b1590eee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:22.890991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f877fe3-5614-4eda-af97-e0c3b1590eee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:22.893164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f877fe3-5614-4eda-af97-e0c3b1590eee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:22.912331 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b955a925-3736-4545-b25a-2d4cb27ba1c7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.523127 Oct 12 22:20:22.912914 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2172/4936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:22 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:23.130760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8f877fe3-5614-4eda-af97-e0c3b1590eee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:23.141366 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8f877fe3-5614-4eda-af97-e0c3b1590eee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.280712 Oct 12 22:20:23.142545 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2765/4937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:22 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:23.165019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1b38fae8-89f6-42d4-ac9f-c3324a11ad8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:23.166035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1b38fae8-89f6-42d4-ac9f-c3324a11ad8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:23.173603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b38fae8-89f6-42d4-ac9f-c3324a11ad8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:23.174710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b38fae8-89f6-42d4-ac9f-c3324a11ad8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:23.175334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b38fae8-89f6-42d4-ac9f-c3324a11ad8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:23.176220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b38fae8-89f6-42d4-ac9f-c3324a11ad8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:23.176848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b38fae8-89f6-42d4-ac9f-c3324a11ad8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:23.177433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b38fae8-89f6-42d4-ac9f-c3324a11ad8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:23.205246 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-1b38fae8-89f6-42d4-ac9f-c3324a11ad8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Cannot 'restore' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1b38fae8-89f6-42d4-ac9f-c3324a11ad8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action HTTP/1.1 Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 15 Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: {"restore": {}} Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: exception: Cannot 'restore' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '02be5cee-72e9-4cc6-94a2-c3517ec178bd', 'body': {'restore': {}}} Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd in vm_state active. Cannot restore while the instance is in this state. Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:23.207350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:23.212039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:23.212039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:23.212039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:23.212039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active Oct 12 22:20:23.212039 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:23.213201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1b38fae8-89f6-42d4-ac9f-c3324a11ad8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 409 to user: Cannot 'restore' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:23.214204 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1b38fae8-89f6-42d4-ac9f-c3324a11ad8c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action" status: 409 len: 145 microversion: 2.1 time: 0.053172 Oct 12 22:20:23.223444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e4eb5683-9e95-4557-928f-da83613e4590 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:23.224288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e4eb5683-9e95-4557-928f-da83613e4590 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:23.229086 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2173/4938] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:23 2022] POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action => generated 145 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:20:23.230784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4eb5683-9e95-4557-928f-da83613e4590 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:23.231292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4eb5683-9e95-4557-928f-da83613e4590 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:23.231731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4eb5683-9e95-4557-928f-da83613e4590 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:23.232422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4eb5683-9e95-4557-928f-da83613e4590 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:23.233051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4eb5683-9e95-4557-928f-da83613e4590 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:23.233630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e4eb5683-9e95-4557-928f-da83613e4590 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:23.378552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-793a318c-8328-4879-9369-837ad8d881f5 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:23.379660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-793a318c-8328-4879-9369-837ad8d881f5 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:23.387871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-793a318c-8328-4879-9369-837ad8d881f5 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:23.388862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-793a318c-8328-4879-9369-837ad8d881f5 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:23.389531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-793a318c-8328-4879-9369-837ad8d881f5 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:23.391548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-793a318c-8328-4879-9369-837ad8d881f5 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:23.392888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-793a318c-8328-4879-9369-837ad8d881f5 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:23.393549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-793a318c-8328-4879-9369-837ad8d881f5 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:23.545385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e4eb5683-9e95-4557-928f-da83613e4590 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:23.557595 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e4eb5683-9e95-4557-928f-da83613e4590 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.337949 Oct 12 22:20:23.562592 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2766/4939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:23 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:23.575676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a108a081-6d5e-437e-a1b9-be20c5f4b328 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:23.577661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a108a081-6d5e-437e-a1b9-be20c5f4b328 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:23.603913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a108a081-6d5e-437e-a1b9-be20c5f4b328 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:23.605795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a108a081-6d5e-437e-a1b9-be20c5f4b328 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:23.606489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a108a081-6d5e-437e-a1b9-be20c5f4b328 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:23.609386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a108a081-6d5e-437e-a1b9-be20c5f4b328 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:23.610340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a108a081-6d5e-437e-a1b9-be20c5f4b328 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:23.613386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a108a081-6d5e-437e-a1b9-be20c5f4b328 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:23.787846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-793a318c-8328-4879-9369-837ad8d881f5 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd7262befc64279bac6f4aaf9c7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6c241409484307a7db7060346af159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:23.808223 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-793a318c-8328-4879-9369-837ad8d881f5 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98" status: 200 len: 1504 microversion: 2.1 time: 0.442037 Oct 12 22:20:23.815931 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2174/4940] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:23 2022] GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 => generated 1504 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:23.831334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9abe3251-76c0-43cb-8dee-6acceea711b9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:23.832298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9abe3251-76c0-43cb-8dee-6acceea711b9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:23.843831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9abe3251-76c0-43cb-8dee-6acceea711b9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:23.850154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9abe3251-76c0-43cb-8dee-6acceea711b9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:23.851878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9abe3251-76c0-43cb-8dee-6acceea711b9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:23.853183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9abe3251-76c0-43cb-8dee-6acceea711b9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:23.853855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9abe3251-76c0-43cb-8dee-6acceea711b9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:23.855329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9abe3251-76c0-43cb-8dee-6acceea711b9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:23.879524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a108a081-6d5e-437e-a1b9-be20c5f4b328 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:23.893695 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a108a081-6d5e-437e-a1b9-be20c5f4b328 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1323 microversion: 2.1 time: 0.329591 Oct 12 22:20:23.903276 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2767/4941] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:23 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1323 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:23.907775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-29e086f9-5d41-4ef1-95b8-dd93f32abf73 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:23.908467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-29e086f9-5d41-4ef1-95b8-dd93f32abf73 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:23.925937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29e086f9-5d41-4ef1-95b8-dd93f32abf73 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:23.926433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29e086f9-5d41-4ef1-95b8-dd93f32abf73 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:23.927047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29e086f9-5d41-4ef1-95b8-dd93f32abf73 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:23.927799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29e086f9-5d41-4ef1-95b8-dd93f32abf73 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:23.928249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29e086f9-5d41-4ef1-95b8-dd93f32abf73 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:23.928887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29e086f9-5d41-4ef1-95b8-dd93f32abf73 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:24.067590 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-29e086f9-5d41-4ef1-95b8-dd93f32abf73 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "DELETE /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.169263 Oct 12 22:20:24.073755 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2768/4942] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Oct 12 22:20:23 2022] DELETE /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98/os-server-password => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:20:24.110289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7c23c6c8-89db-48cc-b0e4-951584bf34db tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:24.113377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7c23c6c8-89db-48cc-b0e4-951584bf34db tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:24.134525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c23c6c8-89db-48cc-b0e4-951584bf34db tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:24.135843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c23c6c8-89db-48cc-b0e4-951584bf34db tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:24.136580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c23c6c8-89db-48cc-b0e4-951584bf34db tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:24.137877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c23c6c8-89db-48cc-b0e4-951584bf34db tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:24.138594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c23c6c8-89db-48cc-b0e4-951584bf34db tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:24.140500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7c23c6c8-89db-48cc-b0e4-951584bf34db tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:24.432786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:24.493657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:24.534478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7c23c6c8-89db-48cc-b0e4-951584bf34db tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:24.553332 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7c23c6c8-89db-48cc-b0e4-951584bf34db tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.475905 Oct 12 22:20:24.553939 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2769/4943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:24 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:24.572557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3b65c0b8-6dd1-4429-9207-8f9485d8f7df tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:24.573319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3b65c0b8-6dd1-4429-9207-8f9485d8f7df tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:24.580684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b65c0b8-6dd1-4429-9207-8f9485d8f7df tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:24.581187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b65c0b8-6dd1-4429-9207-8f9485d8f7df tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:24.581639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b65c0b8-6dd1-4429-9207-8f9485d8f7df tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:24.582614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b65c0b8-6dd1-4429-9207-8f9485d8f7df tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:24.583084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b65c0b8-6dd1-4429-9207-8f9485d8f7df tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:24.583795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3b65c0b8-6dd1-4429-9207-8f9485d8f7df tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:24.629828 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3b65c0b8-6dd1-4429-9207-8f9485d8f7df tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.074761 Oct 12 22:20:24.630338 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2770/4944] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 12 22:20:24 2022] GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98/os-server-password => generated 16 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:20:24.775520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9abe3251-76c0-43cb-8dee-6acceea711b9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:24.787833 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9abe3251-76c0-43cb-8dee-6acceea711b9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.970470 Oct 12 22:20:24.797976 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2175/4945] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:23 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:24.812120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e2ca9e0c-79fd-4e98-864a-040f23a23e68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:24.812730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e2ca9e0c-79fd-4e98-864a-040f23a23e68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:24.827283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2ca9e0c-79fd-4e98-864a-040f23a23e68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:24.828903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2ca9e0c-79fd-4e98-864a-040f23a23e68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:24.830814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2ca9e0c-79fd-4e98-864a-040f23a23e68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:24.833541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2ca9e0c-79fd-4e98-864a-040f23a23e68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:24.835708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2ca9e0c-79fd-4e98-864a-040f23a23e68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:24.836351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2ca9e0c-79fd-4e98-864a-040f23a23e68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:24.896693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e2ca9e0c-79fd-4e98-864a-040f23a23e68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:20:24.956143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-4c78cb86-15b0-4325-8e4a-819b472760c6 req-7b2aa1cd-4956-48a3-8319-bb686ff3dc83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b6bc6c9-2437-4654-a89f-bf320500b7b1", "tag": "6ff18597-4249-41ef-84df-7032cece1756"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:24.981366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4c78cb86-15b0-4325-8e4a-819b472760c6 req-7b2aa1cd-4956-48a3-8319-bb686ff3dc83 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:24.983387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4c78cb86-15b0-4325-8e4a-819b472760c6 req-7b2aa1cd-4956-48a3-8319-bb686ff3dc83 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:24.987839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4c78cb86-15b0-4325-8e4a-819b472760c6 req-7b2aa1cd-4956-48a3-8319-bb686ff3dc83 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:25.018374 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-4c78cb86-15b0-4325-8e4a-819b472760c6 req-7b2aa1cd-4956-48a3-8319-bb686ff3dc83 service nova] Creating event network-changed:6ff18597-4249-41ef-84df-7032cece1756 for instance 7b6bc6c9-2437-4654-a89f-bf320500b7b1 on n-h1-861111-1 Oct 12 22:20:25.024035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=10 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:25.055301 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-4c78cb86-15b0-4325-8e4a-819b472760c6 req-7b2aa1cd-4956-48a3-8319-bb686ff3dc83 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.411645 Oct 12 22:20:25.057070 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2771/4946] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:20:25.062497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9cf5e475-d6ee-4434-ae20-a519a8cba680 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:25.073449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9cf5e475-d6ee-4434-ae20-a519a8cba680 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 2599cd74-22d8-47b6-bacb-53f148b563e3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:25.102930 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-9cf5e475-d6ee-4434-ae20-a519a8cba680 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 2599cd74-22d8-47b6-bacb-53f148b563e3 could not be found. Oct 12 22:20:25.138260 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e2ca9e0c-79fd-4e98-864a-040f23a23e68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "DELETE /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98" status: 204 len: 0 microversion: 2.1 time: 0.338599 Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9cf5e475-d6ee-4434-ae20-a519a8cba680 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/2599cd74-22d8-47b6-bacb-53f148b563e3/action HTTP/1.1 Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 14 Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: {"resume": {}} Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 2599cd74-22d8-47b6-bacb-53f148b563e3 could not be found. Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '2599cd74-22d8-47b6-bacb-53f148b563e3', 'body': {'resume': {}}} Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2599cd74-22d8-47b6-bacb-53f148b563e3 could not be found. Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2599cd74-22d8-47b6-bacb-53f148b563e3 could not be found. Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:25.138874 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:25.143859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:25.143859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:25.143859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2599cd74-22d8-47b6-bacb-53f148b563e3 could not be found. Oct 12 22:20:25.143859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:25.144920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9cf5e475-d6ee-4434-ae20-a519a8cba680 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 2599cd74-22d8-47b6-bacb-53f148b563e3 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:25.145930 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9cf5e475-d6ee-4434-ae20-a519a8cba680 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/2599cd74-22d8-47b6-bacb-53f148b563e3/action" status: 404 len: 111 microversion: 2.1 time: 0.087581 Oct 12 22:20:25.146706 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2176/4947] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:20:24 2022] DELETE /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:20:25.147445 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2772/4948] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:25 2022] POST /compute/v2.1/servers/2599cd74-22d8-47b6-bacb-53f148b563e3/action => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:20:25.158087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3f561bd5-b31f-4ae7-8e7d-6ebfaad4675f tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:25.162330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-204784b9-e71e-401e-b5fd-6453a13a94fa tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:25.163196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-204784b9-e71e-401e-b5fd-6453a13a94fa tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:25.164039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3f561bd5-b31f-4ae7-8e7d-6ebfaad4675f tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:25.182384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f561bd5-b31f-4ae7-8e7d-6ebfaad4675f tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:25.183290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f561bd5-b31f-4ae7-8e7d-6ebfaad4675f tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:25.183970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-204784b9-e71e-401e-b5fd-6453a13a94fa tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:25.184094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f561bd5-b31f-4ae7-8e7d-6ebfaad4675f tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:25.184482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-204784b9-e71e-401e-b5fd-6453a13a94fa tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:25.184928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-204784b9-e71e-401e-b5fd-6453a13a94fa tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:25.185645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-204784b9-e71e-401e-b5fd-6453a13a94fa tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:25.187482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f561bd5-b31f-4ae7-8e7d-6ebfaad4675f tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:25.188190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f561bd5-b31f-4ae7-8e7d-6ebfaad4675f tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:25.188919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f561bd5-b31f-4ae7-8e7d-6ebfaad4675f tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:25.189262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-204784b9-e71e-401e-b5fd-6453a13a94fa tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:25.189724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-204784b9-e71e-401e-b5fd-6453a13a94fa tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:25.525712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-204784b9-e71e-401e-b5fd-6453a13a94fa tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:25.542448 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-204784b9-e71e-401e-b5fd-6453a13a94fa tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1323 microversion: 2.1 time: 0.393553 Oct 12 22:20:25.543614 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2177/4949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:25 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1323 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:25.555077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dfe99a0b-5fbd-4832-983f-c5f28bfab62b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:25.555975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dfe99a0b-5fbd-4832-983f-c5f28bfab62b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:25.566907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe99a0b-5fbd-4832-983f-c5f28bfab62b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:25.567440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe99a0b-5fbd-4832-983f-c5f28bfab62b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:25.580417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe99a0b-5fbd-4832-983f-c5f28bfab62b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:25.581546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe99a0b-5fbd-4832-983f-c5f28bfab62b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:25.582359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe99a0b-5fbd-4832-983f-c5f28bfab62b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:25.583002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfe99a0b-5fbd-4832-983f-c5f28bfab62b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:25.659382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3f561bd5-b31f-4ae7-8e7d-6ebfaad4675f tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd7262befc64279bac6f4aaf9c7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6c241409484307a7db7060346af159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:25.671694 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3f561bd5-b31f-4ae7-8e7d-6ebfaad4675f tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98" status: 200 len: 1510 microversion: 2.1 time: 0.517358 Oct 12 22:20:25.682450 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2773/4950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:25 2022] GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 => generated 1510 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:25.700739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-19fb0e5e-2787-4a0a-b121-7155ae2901a9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:25.701389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-19fb0e5e-2787-4a0a-b121-7155ae2901a9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:25.709597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19fb0e5e-2787-4a0a-b121-7155ae2901a9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:25.710095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19fb0e5e-2787-4a0a-b121-7155ae2901a9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:25.710535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19fb0e5e-2787-4a0a-b121-7155ae2901a9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:25.711378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19fb0e5e-2787-4a0a-b121-7155ae2901a9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:25.711845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19fb0e5e-2787-4a0a-b121-7155ae2901a9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:25.712278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19fb0e5e-2787-4a0a-b121-7155ae2901a9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:25.909238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dfe99a0b-5fbd-4832-983f-c5f28bfab62b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:25.917960 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dfe99a0b-5fbd-4832-983f-c5f28bfab62b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.373094 Oct 12 22:20:25.922572 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2178/4951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:25 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:25.965114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-92702a48-7f8a-4565-841d-37864f7e27ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:25.966072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-92702a48-7f8a-4565-841d-37864f7e27ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:25.977514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92702a48-7f8a-4565-841d-37864f7e27ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:25.978285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92702a48-7f8a-4565-841d-37864f7e27ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:25.978908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92702a48-7f8a-4565-841d-37864f7e27ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:25.992215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92702a48-7f8a-4565-841d-37864f7e27ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:25.994224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92702a48-7f8a-4565-841d-37864f7e27ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:25.994969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92702a48-7f8a-4565-841d-37864f7e27ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:26.233196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-19fb0e5e-2787-4a0a-b121-7155ae2901a9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:26.243585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-92702a48-7f8a-4565-841d-37864f7e27ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:26.246664 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-19fb0e5e-2787-4a0a-b121-7155ae2901a9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.562843 Oct 12 22:20:26.249644 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2774/4952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:25 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:26.252327 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-92702a48-7f8a-4565-841d-37864f7e27ea tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.292392 Oct 12 22:20:26.252912 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2179/4953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:25 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:26.291828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d987803a-e9bd-4f9e-beaa-0e4197d9be57 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:26.293090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d987803a-e9bd-4f9e-beaa-0e4197d9be57 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:26.306537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d987803a-e9bd-4f9e-beaa-0e4197d9be57 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:26.310166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d987803a-e9bd-4f9e-beaa-0e4197d9be57 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:26.311314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d987803a-e9bd-4f9e-beaa-0e4197d9be57 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:26.315145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d987803a-e9bd-4f9e-beaa-0e4197d9be57 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:26.316687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d987803a-e9bd-4f9e-beaa-0e4197d9be57 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:26.317741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d987803a-e9bd-4f9e-beaa-0e4197d9be57 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:26.350586 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-d987803a-e9bd-4f9e-beaa-0e4197d9be57 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Cannot 'resume' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d987803a-e9bd-4f9e-beaa-0e4197d9be57 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action HTTP/1.1 Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 14 Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: {"resume": {}} Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: exception: Cannot 'resume' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '02be5cee-72e9-4cc6-94a2-c3517ec178bd', 'body': {'resume': {}}} Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd in vm_state active. Cannot resume while the instance is in this state. Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:26.352620 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:26.356319 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:26.356319 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:26.356319 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:26.356319 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:26.356319 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:26.356319 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active Oct 12 22:20:26.356319 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:26.358677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d987803a-e9bd-4f9e-beaa-0e4197d9be57 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 409 to user: Cannot 'resume' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:26.360309 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d987803a-e9bd-4f9e-beaa-0e4197d9be57 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action" status: 409 len: 144 microversion: 2.1 time: 0.074104 Oct 12 22:20:26.362026 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2775/4954] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:26 2022] POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action => generated 144 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:20:26.372574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-adc96c38-f504-4af0-95d7-5b80fbd3a482 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:26.374084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-adc96c38-f504-4af0-95d7-5b80fbd3a482 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:26.383056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adc96c38-f504-4af0-95d7-5b80fbd3a482 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:26.384000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adc96c38-f504-4af0-95d7-5b80fbd3a482 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:26.384659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adc96c38-f504-4af0-95d7-5b80fbd3a482 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:26.385573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adc96c38-f504-4af0-95d7-5b80fbd3a482 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:26.386445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adc96c38-f504-4af0-95d7-5b80fbd3a482 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:26.387131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adc96c38-f504-4af0-95d7-5b80fbd3a482 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:26.576778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b9bab92e-251b-49f6-9a20-1f702ac99d4d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:26.576976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b9bab92e-251b-49f6-9a20-1f702ac99d4d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:26.587358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9bab92e-251b-49f6-9a20-1f702ac99d4d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:26.588081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9bab92e-251b-49f6-9a20-1f702ac99d4d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:26.588527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9bab92e-251b-49f6-9a20-1f702ac99d4d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:26.589368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9bab92e-251b-49f6-9a20-1f702ac99d4d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:26.589988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9bab92e-251b-49f6-9a20-1f702ac99d4d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:26.590581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9bab92e-251b-49f6-9a20-1f702ac99d4d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:26.865564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-adc96c38-f504-4af0-95d7-5b80fbd3a482 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:26.868728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b9bab92e-251b-49f6-9a20-1f702ac99d4d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:26.879512 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-adc96c38-f504-4af0-95d7-5b80fbd3a482 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.513123 Oct 12 22:20:26.882471 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2180/4955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:26 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:26.898043 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b9bab92e-251b-49f6-9a20-1f702ac99d4d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1323 microversion: 2.1 time: 0.327680 Oct 12 22:20:26.904188 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2776/4956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:26 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1323 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:26.922044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d2f13031-c094-4d92-bae5-044167913fbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:26.922939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d2f13031-c094-4d92-bae5-044167913fbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:26.932019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2f13031-c094-4d92-bae5-044167913fbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:26.932878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2f13031-c094-4d92-bae5-044167913fbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:26.933640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2f13031-c094-4d92-bae5-044167913fbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:26.935092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2f13031-c094-4d92-bae5-044167913fbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:26.935738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2f13031-c094-4d92-bae5-044167913fbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:26.938427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2f13031-c094-4d92-bae5-044167913fbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:26.941415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4277190d-c5b0-4c42-a446-b7509e2a08f3 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:26.942446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4277190d-c5b0-4c42-a446-b7509e2a08f3 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:26.961604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4277190d-c5b0-4c42-a446-b7509e2a08f3 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:26.962102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4277190d-c5b0-4c42-a446-b7509e2a08f3 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:26.962534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4277190d-c5b0-4c42-a446-b7509e2a08f3 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:26.963253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4277190d-c5b0-4c42-a446-b7509e2a08f3 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:26.963732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4277190d-c5b0-4c42-a446-b7509e2a08f3 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:26.964972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4277190d-c5b0-4c42-a446-b7509e2a08f3 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:27.312243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4277190d-c5b0-4c42-a446-b7509e2a08f3 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd7262befc64279bac6f4aaf9c7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6c241409484307a7db7060346af159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:27.327925 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4277190d-c5b0-4c42-a446-b7509e2a08f3 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98" status: 200 len: 1510 microversion: 2.1 time: 0.443730 Oct 12 22:20:27.343288 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2181/4957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:26 2022] GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 => generated 1510 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:27.365160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d2f13031-c094-4d92-bae5-044167913fbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:27.366383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-86eadb14-5895-4f0f-8ddd-6cfdf85a8339 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:27.367541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-86eadb14-5895-4f0f-8ddd-6cfdf85a8339 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:27.373060 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d2f13031-c094-4d92-bae5-044167913fbf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.467539 Oct 12 22:20:27.388395 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2777/4958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:26 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:27.398272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86eadb14-5895-4f0f-8ddd-6cfdf85a8339 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:27.398272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86eadb14-5895-4f0f-8ddd-6cfdf85a8339 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:27.398272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86eadb14-5895-4f0f-8ddd-6cfdf85a8339 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:27.398272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86eadb14-5895-4f0f-8ddd-6cfdf85a8339 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:27.398272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86eadb14-5895-4f0f-8ddd-6cfdf85a8339 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:27.398272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86eadb14-5895-4f0f-8ddd-6cfdf85a8339 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:27.573904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a9be2c3a-ae59-4739-a759-a4877d5228ac tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a9be2c3a-ae59-4739-a759-a4877d5228ac tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 160 Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": "", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "57899def-7285-4d34-a6b9-8c4bdfce7a65"}]}} Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'server': {'name': '', 'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c', 'flavorRef': '452', 'networks': [{'uuid': '57899def-7285-4d34-a6b9-8c4bdfce7a65'}]}}} Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi '' Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:20:27.577980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:20:27.583191 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:20:27.583191 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 12 22:20:27.583191 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:27.583191 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:27.583191 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:27.583191 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:27.583191 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:27.583191 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:27.583191 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:20:27.583191 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:20:27.583191 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 12 22:20:27.583191 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:27.585846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a9be2c3a-ae59-4739-a759-a4877d5228ac tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:27.586924 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a9be2c3a-ae59-4739-a759-a4877d5228ac tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.017586 Oct 12 22:20:27.591802 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2778/4959] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:20:27 2022] POST /compute/v2.1/servers => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:20:27.597409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4209bdc0-33f7-45e9-900e-7a98b29b7735 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:27.598333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4209bdc0-33f7-45e9-900e-7a98b29b7735 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:27.606046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4209bdc0-33f7-45e9-900e-7a98b29b7735 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:27.606966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4209bdc0-33f7-45e9-900e-7a98b29b7735 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:27.607764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4209bdc0-33f7-45e9-900e-7a98b29b7735 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:27.608710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4209bdc0-33f7-45e9-900e-7a98b29b7735 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:27.609406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4209bdc0-33f7-45e9-900e-7a98b29b7735 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:27.610120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4209bdc0-33f7-45e9-900e-7a98b29b7735 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:28.066480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-86eadb14-5895-4f0f-8ddd-6cfdf85a8339 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:28.069032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4209bdc0-33f7-45e9-900e-7a98b29b7735 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:28.078548 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4209bdc0-33f7-45e9-900e-7a98b29b7735 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.485281 Oct 12 22:20:28.080916 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-86eadb14-5895-4f0f-8ddd-6cfdf85a8339 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.750142 Oct 12 22:20:28.081647 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2182/4961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:27 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:28.091551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-52dc2293-d6d2-4fd4-843f-99b38dad6aa9 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:28.091551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-52dc2293-d6d2-4fd4-843f-99b38dad6aa9 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:28.100991 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2779/4961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:27 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:28.109307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52dc2293-d6d2-4fd4-843f-99b38dad6aa9 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:28.109872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52dc2293-d6d2-4fd4-843f-99b38dad6aa9 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:28.110445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52dc2293-d6d2-4fd4-843f-99b38dad6aa9 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:28.111185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52dc2293-d6d2-4fd4-843f-99b38dad6aa9 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:28.113367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52dc2293-d6d2-4fd4-843f-99b38dad6aa9 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:28.114828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52dc2293-d6d2-4fd4-843f-99b38dad6aa9 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:28.115568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8e2ca385-ca00-4c66-9c48-bc3e62b522eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:28.116379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8e2ca385-ca00-4c66-9c48-bc3e62b522eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:28.135906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e2ca385-ca00-4c66-9c48-bc3e62b522eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:28.136512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e2ca385-ca00-4c66-9c48-bc3e62b522eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:28.137090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e2ca385-ca00-4c66-9c48-bc3e62b522eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:28.137898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e2ca385-ca00-4c66-9c48-bc3e62b522eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:28.142262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e2ca385-ca00-4c66-9c48-bc3e62b522eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:28.142842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e2ca385-ca00-4c66-9c48-bc3e62b522eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:28.155674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:28.534021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8e2ca385-ca00-4c66-9c48-bc3e62b522eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:28.556895 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8e2ca385-ca00-4c66-9c48-bc3e62b522eb tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.452211 Oct 12 22:20:28.558526 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2780/4962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:28 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:28.565909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-7d3cd6ab-9152-49b0-9684-f5d023c44c61 req-003a4053-c79e-4292-8762-fb72141d8988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efa646d0-6df2-47ae-829b-71ccb036fb98", "name": "network-vif-deleted", "tag": "224435d9-441b-4ffa-8613-89a9c0f35c47"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:28.584517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7d3cd6ab-9152-49b0-9684-f5d023c44c61 req-003a4053-c79e-4292-8762-fb72141d8988 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:28.585761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7d3cd6ab-9152-49b0-9684-f5d023c44c61 req-003a4053-c79e-4292-8762-fb72141d8988 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:28.586634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7d3cd6ab-9152-49b0-9684-f5d023c44c61 req-003a4053-c79e-4292-8762-fb72141d8988 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:28.593316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:28.606632 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-7d3cd6ab-9152-49b0-9684-f5d023c44c61 req-003a4053-c79e-4292-8762-fb72141d8988 service nova] Creating event network-vif-deleted:224435d9-441b-4ffa-8613-89a9c0f35c47 for instance efa646d0-6df2-47ae-829b-71ccb036fb98 on n-h1-861111-1 Oct 12 22:20:28.614827 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-7d3cd6ab-9152-49b0-9684-f5d023c44c61 req-003a4053-c79e-4292-8762-fb72141d8988 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053248 Oct 12 22:20:28.617534 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2781/4963] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:20:28.624605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-80f9be06-8d98-4f3c-a350-b9ad0ac6da68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:28.625646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-80f9be06-8d98-4f3c-a350-b9ad0ac6da68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:28.636382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80f9be06-8d98-4f3c-a350-b9ad0ac6da68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:28.637570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80f9be06-8d98-4f3c-a350-b9ad0ac6da68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:28.639891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80f9be06-8d98-4f3c-a350-b9ad0ac6da68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:28.641240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80f9be06-8d98-4f3c-a350-b9ad0ac6da68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:28.644881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80f9be06-8d98-4f3c-a350-b9ad0ac6da68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:28.645376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80f9be06-8d98-4f3c-a350-b9ad0ac6da68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:28.728669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80f9be06-8d98-4f3c-a350-b9ad0ac6da68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:28.729392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80f9be06-8d98-4f3c-a350-b9ad0ac6da68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:28.730297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80f9be06-8d98-4f3c-a350-b9ad0ac6da68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:28.730945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-80f9be06-8d98-4f3c-a350-b9ad0ac6da68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lazy-loading 'fault' on Instance uuid efa646d0-6df2-47ae-829b-71ccb036fb98 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:20:28.847751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-52dc2293-d6d2-4fd4-843f-99b38dad6aa9 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:28.863346 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-52dc2293-d6d2-4fd4-843f-99b38dad6aa9 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1323 microversion: 2.1 time: 0.780601 Oct 12 22:20:28.884958 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2183/4964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:28 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1323 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:28.913114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-05a37a20-d697-4fd5-a804-6692274a9b8e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:28.916559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-05a37a20-d697-4fd5-a804-6692274a9b8e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 6f60ebdc-f3e2-4eae-b6ca-d0daba801834] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:28.974154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-80f9be06-8d98-4f3c-a350-b9ad0ac6da68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd7262befc64279bac6f4aaf9c7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6c241409484307a7db7060346af159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:28.982373 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-05a37a20-d697-4fd5-a804-6692274a9b8e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 6f60ebdc-f3e2-4eae-b6ca-d0daba801834 could not be found. Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-05a37a20-d697-4fd5-a804-6692274a9b8e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/6f60ebdc-f3e2-4eae-b6ca-d0daba801834/action HTTP/1.1 Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 14 Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: {"shelve": {}} Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 6f60ebdc-f3e2-4eae-b6ca-d0daba801834 could not be found. Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '6f60ebdc-f3e2-4eae-b6ca-d0daba801834', 'body': {'shelve': {}}} Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f60ebdc-f3e2-4eae-b6ca-d0daba801834 could not be found. Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f60ebdc-f3e2-4eae-b6ca-d0daba801834 could not be found. Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:28.987290 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:28.991993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:28.991993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:28.991993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f60ebdc-f3e2-4eae-b6ca-d0daba801834 could not be found. Oct 12 22:20:28.991993 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:28.992241 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-80f9be06-8d98-4f3c-a350-b9ad0ac6da68 tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98" status: 200 len: 1306 microversion: 2.1 time: 0.369513 Oct 12 22:20:28.992241 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2782/4965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:28 2022] GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 => generated 1306 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:29.001758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-05a37a20-d697-4fd5-a804-6692274a9b8e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 6f60ebdc-f3e2-4eae-b6ca-d0daba801834 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:29.009542 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-05a37a20-d697-4fd5-a804-6692274a9b8e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/6f60ebdc-f3e2-4eae-b6ca-d0daba801834/action" status: 404 len: 111 microversion: 2.1 time: 0.109340 Oct 12 22:20:29.017672 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2184/4966] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:28 2022] POST /compute/v2.1/servers/6f60ebdc-f3e2-4eae-b6ca-d0daba801834/action => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:20:29.023501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8213dec1-c371-4136-8d83-61d005699392 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:29.024133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8213dec1-c371-4136-8d83-61d005699392 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:29.040377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8213dec1-c371-4136-8d83-61d005699392 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:29.042751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8213dec1-c371-4136-8d83-61d005699392 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:29.045612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8213dec1-c371-4136-8d83-61d005699392 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:29.046883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8213dec1-c371-4136-8d83-61d005699392 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:29.047634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8213dec1-c371-4136-8d83-61d005699392 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:29.049521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8213dec1-c371-4136-8d83-61d005699392 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:29.106295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-998dbfd2-5151-4078-ad45-02365dd8ef25 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:29.108413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-998dbfd2-5151-4078-ad45-02365dd8ef25 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:29.124415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998dbfd2-5151-4078-ad45-02365dd8ef25 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:29.125494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998dbfd2-5151-4078-ad45-02365dd8ef25 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:29.128522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998dbfd2-5151-4078-ad45-02365dd8ef25 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:29.130241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998dbfd2-5151-4078-ad45-02365dd8ef25 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:29.133771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998dbfd2-5151-4078-ad45-02365dd8ef25 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:29.134521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998dbfd2-5151-4078-ad45-02365dd8ef25 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:29.339350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8213dec1-c371-4136-8d83-61d005699392 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:29.351074 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8213dec1-c371-4136-8d83-61d005699392 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.333750 Oct 12 22:20:29.369221 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2783/4967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:29 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:29.384470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fda6937d-1861-4b5a-82ed-a35e66b6ca76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:29.385174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fda6937d-1861-4b5a-82ed-a35e66b6ca76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:29.394693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fda6937d-1861-4b5a-82ed-a35e66b6ca76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:29.395183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fda6937d-1861-4b5a-82ed-a35e66b6ca76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:29.395712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fda6937d-1861-4b5a-82ed-a35e66b6ca76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:29.396341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fda6937d-1861-4b5a-82ed-a35e66b6ca76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:29.396792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fda6937d-1861-4b5a-82ed-a35e66b6ca76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:29.400431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fda6937d-1861-4b5a-82ed-a35e66b6ca76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:29.649816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-998dbfd2-5151-4078-ad45-02365dd8ef25 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:29.658909 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-998dbfd2-5151-4078-ad45-02365dd8ef25 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.556800 Oct 12 22:20:29.659531 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2185/4968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:29 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:29.897195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-09d63212-80c5-4115-a04f-4c38327a3305 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:29.898071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-09d63212-80c5-4115-a04f-4c38327a3305 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:29.923493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09d63212-80c5-4115-a04f-4c38327a3305 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:29.924259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09d63212-80c5-4115-a04f-4c38327a3305 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:29.924788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09d63212-80c5-4115-a04f-4c38327a3305 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:29.933346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09d63212-80c5-4115-a04f-4c38327a3305 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:29.933963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09d63212-80c5-4115-a04f-4c38327a3305 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:29.934480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09d63212-80c5-4115-a04f-4c38327a3305 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:30.186960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-09d63212-80c5-4115-a04f-4c38327a3305 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:30.201253 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-09d63212-80c5-4115-a04f-4c38327a3305 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1323 microversion: 2.1 time: 0.307967 Oct 12 22:20:30.204135 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2186/4969] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:29 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1323 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:30.224361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-78bd10f5-c834-4978-ab55-544f88f722cd tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:30.224978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-78bd10f5-c834-4978-ab55-544f88f722cd tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] [instance: efa646d0-6df2-47ae-829b-71ccb036fb98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:30.240642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78bd10f5-c834-4978-ab55-544f88f722cd tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:30.241143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78bd10f5-c834-4978-ab55-544f88f722cd tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:30.241585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78bd10f5-c834-4978-ab55-544f88f722cd tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:30.242293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78bd10f5-c834-4978-ab55-544f88f722cd tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:30.242749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78bd10f5-c834-4978-ab55-544f88f722cd tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:30.243173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78bd10f5-c834-4978-ab55-544f88f722cd tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:30.259063 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-78bd10f5-c834-4978-ab55-544f88f722cd tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] HTTP exception thrown: Instance efa646d0-6df2-47ae-829b-71ccb036fb98 could not be found. Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-78bd10f5-c834-4978-ab55-544f88f722cd tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Request method failure captured: Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 HTTP/1.1 Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz2T4eSfSZylE4wbACQ8fjLmjoLF5E-Tsw-znFzVtREBJgX8lqkqdZU2jeMAQOP6CWlpSUVynJvA2-aZBzLA-PuuObVgWtSITDC9KjP2dA2x2Fs0m4A1ZrG944ptCi9F2_lxeptZGph_C5J8xBAj9HGVJBxifKhYr7K2EP8IWxBYB1g Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ee6c241409484307a7db7060346af159 Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerPasswordTestJSON-532258351 Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ee6c241409484307a7db7060346af159"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ee6c241409484307a7db7060346af159"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ee6c241409484307a7db7060346af159", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ee6c241409484307a7db7060346af159"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerPasswordTestJSON-532258351 Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ee6c241409484307a7db7060346af159 Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerPasswordTestJSON-532258351 Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerPasswordTestJSON-532258351-project Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 6bd7262befc64279bac6f4aaf9c7f20d Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerPasswordTestJSON-532258351-project Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance efa646d0-6df2-47ae-829b-71ccb036fb98 could not be found. Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'efa646d0-6df2-47ae-829b-71ccb036fb98'} Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efa646d0-6df2-47ae-829b-71ccb036fb98 could not be found. Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efa646d0-6df2-47ae-829b-71ccb036fb98 could not be found. Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:30.261230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:30.266312 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:30.266312 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:30.266312 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:30.266312 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:30.266312 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:30.266312 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efa646d0-6df2-47ae-829b-71ccb036fb98 could not be found. Oct 12 22:20:30.266312 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:30.266312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-78bd10f5-c834-4978-ab55-544f88f722cd tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] Returning 404 to user: Instance efa646d0-6df2-47ae-829b-71ccb036fb98 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:30.268961 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-78bd10f5-c834-4978-ab55-544f88f722cd tempest-ServerPasswordTestJSON-532258351 tempest-ServerPasswordTestJSON-532258351-project] 10.222.0.16 "GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98" status: 404 len: 111 microversion: 2.1 time: 0.048918 Oct 12 22:20:30.273840 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2187/4970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:30 2022] GET /compute/v2.1/servers/efa646d0-6df2-47ae-829b-71ccb036fb98 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:20:30.442624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fda6937d-1861-4b5a-82ed-a35e66b6ca76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:30.453809 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fda6937d-1861-4b5a-82ed-a35e66b6ca76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 1.077373 Oct 12 22:20:30.455788 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2784/4971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:29 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:30.479117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-19ff2554-2b7e-49f4-9b59-b75472e5790c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:30.479954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-19ff2554-2b7e-49f4-9b59-b75472e5790c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:30.487855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ff2554-2b7e-49f4-9b59-b75472e5790c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:30.490392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ff2554-2b7e-49f4-9b59-b75472e5790c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:30.491918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ff2554-2b7e-49f4-9b59-b75472e5790c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:30.497041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ff2554-2b7e-49f4-9b59-b75472e5790c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:30.497777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ff2554-2b7e-49f4-9b59-b75472e5790c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:30.498464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ff2554-2b7e-49f4-9b59-b75472e5790c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:30.546058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-19ff2554-2b7e-49f4-9b59-b75472e5790c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lazy-loading 'flavor' on Instance uuid 02be5cee-72e9-4cc6-94a2-c3517ec178bd {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:20:30.685085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0db321ee-c893-4bb9-bf48-85cc2a1644ec tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:30.685895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0db321ee-c893-4bb9-bf48-85cc2a1644ec tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:30.694596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0db321ee-c893-4bb9-bf48-85cc2a1644ec tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:30.697671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0db321ee-c893-4bb9-bf48-85cc2a1644ec tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:30.701633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0db321ee-c893-4bb9-bf48-85cc2a1644ec tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:30.702596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0db321ee-c893-4bb9-bf48-85cc2a1644ec tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:30.704548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0db321ee-c893-4bb9-bf48-85cc2a1644ec tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:30.709839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0db321ee-c893-4bb9-bf48-85cc2a1644ec tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:30.987694 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-19ff2554-2b7e-49f4-9b59-b75472e5790c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action" status: 202 len: 0 microversion: 2.1 time: 0.512029 Oct 12 22:20:30.995397 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2188/4972] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:30 2022] POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:20:31.026815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3f2e4800-8d29-44a8-948b-7e16ed67f950 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:31.027748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3f2e4800-8d29-44a8-948b-7e16ed67f950 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:31.041425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f2e4800-8d29-44a8-948b-7e16ed67f950 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:31.044854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f2e4800-8d29-44a8-948b-7e16ed67f950 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:31.045559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f2e4800-8d29-44a8-948b-7e16ed67f950 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:31.048950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f2e4800-8d29-44a8-948b-7e16ed67f950 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:31.051015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f2e4800-8d29-44a8-948b-7e16ed67f950 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:31.052854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f2e4800-8d29-44a8-948b-7e16ed67f950 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:31.161478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0db321ee-c893-4bb9-bf48-85cc2a1644ec tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:31.174431 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0db321ee-c893-4bb9-bf48-85cc2a1644ec tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.491618 Oct 12 22:20:31.175401 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2785/4973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:30 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:31.227621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-64b469c5-3b32-44ba-a1d6-13a0732e98e8 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:31.228257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-64b469c5-3b32-44ba-a1d6-13a0732e98e8 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:31.241316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64b469c5-3b32-44ba-a1d6-13a0732e98e8 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:31.241818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64b469c5-3b32-44ba-a1d6-13a0732e98e8 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:31.242265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64b469c5-3b32-44ba-a1d6-13a0732e98e8 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:31.242981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64b469c5-3b32-44ba-a1d6-13a0732e98e8 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:31.243465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64b469c5-3b32-44ba-a1d6-13a0732e98e8 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:31.254362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64b469c5-3b32-44ba-a1d6-13a0732e98e8 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:31.550150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-64b469c5-3b32-44ba-a1d6-13a0732e98e8 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:31.559989 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-64b469c5-3b32-44ba-a1d6-13a0732e98e8 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1323 microversion: 2.1 time: 0.337220 Oct 12 22:20:31.573010 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2786/4974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:31 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1323 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:31.901556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3f2e4800-8d29-44a8-948b-7e16ed67f950 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:31.906742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-4739a114-b6b5-4061-a750-2e19bf7167e4 req-7300f98a-709f-41f9-aa0c-d201ad7249c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b6bc6c9-2437-4654-a89f-bf320500b7b1", "name": "network-vif-plugged", "status": "completed", "tag": "6ff18597-4249-41ef-84df-7032cece1756"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:31.910372 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3f2e4800-8d29-44a8-948b-7e16ed67f950 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1510 microversion: 2.1 time: 0.912368 Oct 12 22:20:31.910960 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2189/4975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:30 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1510 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:31.920633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4739a114-b6b5-4061-a750-2e19bf7167e4 req-7300f98a-709f-41f9-aa0c-d201ad7249c5 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:31.921443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4739a114-b6b5-4061-a750-2e19bf7167e4 req-7300f98a-709f-41f9-aa0c-d201ad7249c5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:31.922454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4739a114-b6b5-4061-a750-2e19bf7167e4 req-7300f98a-709f-41f9-aa0c-d201ad7249c5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:31.942549 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-4739a114-b6b5-4061-a750-2e19bf7167e4 req-7300f98a-709f-41f9-aa0c-d201ad7249c5 service nova] Creating event network-vif-plugged:6ff18597-4249-41ef-84df-7032cece1756 for instance 7b6bc6c9-2437-4654-a89f-bf320500b7b1 on n-h1-861111-1 Oct 12 22:20:31.948043 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-4739a114-b6b5-4061-a750-2e19bf7167e4 req-7300f98a-709f-41f9-aa0c-d201ad7249c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045876 Oct 12 22:20:31.949901 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2787/4976] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:20:32.198321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-94c698a9-a386-40a0-aca3-30798375012c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:32.198929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-94c698a9-a386-40a0-aca3-30798375012c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:32.207572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94c698a9-a386-40a0-aca3-30798375012c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:32.207572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94c698a9-a386-40a0-aca3-30798375012c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:32.208067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94c698a9-a386-40a0-aca3-30798375012c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:32.209084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94c698a9-a386-40a0-aca3-30798375012c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:32.209620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94c698a9-a386-40a0-aca3-30798375012c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:32.210099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94c698a9-a386-40a0-aca3-30798375012c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:32.590535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-910577cd-c647-4d6d-878b-34b933f5fad4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:32.592362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-910577cd-c647-4d6d-878b-34b933f5fad4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:32.602696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-910577cd-c647-4d6d-878b-34b933f5fad4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:32.603121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-910577cd-c647-4d6d-878b-34b933f5fad4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:32.603584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-910577cd-c647-4d6d-878b-34b933f5fad4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:32.604675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-910577cd-c647-4d6d-878b-34b933f5fad4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:32.605254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-910577cd-c647-4d6d-878b-34b933f5fad4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:32.605717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-910577cd-c647-4d6d-878b-34b933f5fad4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:32.705278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-94c698a9-a386-40a0-aca3-30798375012c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:32.724531 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-94c698a9-a386-40a0-aca3-30798375012c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1522 microversion: 2.1 time: 0.530117 Oct 12 22:20:32.725132 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2190/4977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:32 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:32.881470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-910577cd-c647-4d6d-878b-34b933f5fad4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:32.905785 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-910577cd-c647-4d6d-878b-34b933f5fad4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1323 microversion: 2.1 time: 0.321187 Oct 12 22:20:32.924468 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2788/4978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:32 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1323 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:32.934895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dabef104-307f-4e66-b4d1-184c019fdd46 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:32.935554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dabef104-307f-4e66-b4d1-184c019fdd46 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:32.945402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dabef104-307f-4e66-b4d1-184c019fdd46 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:32.947157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dabef104-307f-4e66-b4d1-184c019fdd46 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:32.948998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dabef104-307f-4e66-b4d1-184c019fdd46 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:32.951278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dabef104-307f-4e66-b4d1-184c019fdd46 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:32.952631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dabef104-307f-4e66-b4d1-184c019fdd46 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:32.954703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dabef104-307f-4e66-b4d1-184c019fdd46 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:33.750138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9327d4ca-2fba-4c38-9e9f-50802883049a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:33.752072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9327d4ca-2fba-4c38-9e9f-50802883049a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:33.760645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9327d4ca-2fba-4c38-9e9f-50802883049a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:33.761293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9327d4ca-2fba-4c38-9e9f-50802883049a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:33.762438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9327d4ca-2fba-4c38-9e9f-50802883049a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:33.763177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9327d4ca-2fba-4c38-9e9f-50802883049a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:33.763699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9327d4ca-2fba-4c38-9e9f-50802883049a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:33.764160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9327d4ca-2fba-4c38-9e9f-50802883049a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:33.875284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dabef104-307f-4e66-b4d1-184c019fdd46 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:33.888085 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dabef104-307f-4e66-b4d1-184c019fdd46 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1510 microversion: 2.1 time: 0.956804 Oct 12 22:20:33.888895 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2191/4979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:32 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1510 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:33.940267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9327d4ca-2fba-4c38-9e9f-50802883049a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:33.945445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d137bd8-dc2e-4825-96b5-d7c777334358 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:33.947102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9d137bd8-dc2e-4825-96b5-d7c777334358 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:33.950537 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9327d4ca-2fba-4c38-9e9f-50802883049a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1502 microversion: 2.1 time: 0.204317 Oct 12 22:20:33.951688 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2789/4980] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:33 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1502 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:33.971230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d137bd8-dc2e-4825-96b5-d7c777334358 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:33.975028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d137bd8-dc2e-4825-96b5-d7c777334358 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:33.975792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d137bd8-dc2e-4825-96b5-d7c777334358 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:33.976601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f853be01-b935-453f-b2e6-815e4f50a340 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:33.977219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f853be01-b935-453f-b2e6-815e4f50a340 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:33.977961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d137bd8-dc2e-4825-96b5-d7c777334358 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:33.979527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d137bd8-dc2e-4825-96b5-d7c777334358 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:33.980502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d137bd8-dc2e-4825-96b5-d7c777334358 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:33.991686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f853be01-b935-453f-b2e6-815e4f50a340 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:33.992489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f853be01-b935-453f-b2e6-815e4f50a340 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:33.995316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f853be01-b935-453f-b2e6-815e4f50a340 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:33.996137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f853be01-b935-453f-b2e6-815e4f50a340 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:33.996681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f853be01-b935-453f-b2e6-815e4f50a340 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:33.997356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f853be01-b935-453f-b2e6-815e4f50a340 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:34.190462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f853be01-b935-453f-b2e6-815e4f50a340 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:34.202438 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f853be01-b935-453f-b2e6-815e4f50a340 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1517 microversion: 2.1 time: 0.226940 Oct 12 22:20:34.203378 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2790/4981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:33 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1517 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:34.226808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-61dcdaab-76f5-41eb-995b-d02f0581fa89 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:34.229817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-61dcdaab-76f5-41eb-995b-d02f0581fa89 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 30e413a5-2441-47e7-9882-58b1ffa4ce36] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:34.235531 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-61dcdaab-76f5-41eb-995b-d02f0581fa89 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] HTTP exception thrown: Instance 30e413a5-2441-47e7-9882-58b1ffa4ce36 could not be found. Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-61dcdaab-76f5-41eb-995b-d02f0581fa89 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Request method failure captured: Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/30e413a5-2441-47e7-9882-58b1ffa4ce36/action HTTP/1.1 Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 14 Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz1yYv3BEuyn16aX9rFnQkuXp35mHqXE7bVOWKfvxNZXNT7qw6co-FDMauTgJfMPQCxmiEKAu0kzyjnis87qTpfUYp96yN_F6sfmIZnSLJLUbYy9WREcLUGhzXNPjj1UORIJx3lHLMBoOzDKf1JzqCDKyG4PBpXcEQzC9GdyMUjXkpQ Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0a0c4d9f435a4c009bd0b5eb2618829b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: afec4a3808b84463900b744ecd9352b6 Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: {"rescue": {}} Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 30e413a5-2441-47e7-9882-58b1ffa4ce36 could not be found. Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '30e413a5-2441-47e7-9882-58b1ffa4ce36', 'body': {'rescue': {}}} Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e413a5-2441-47e7-9882-58b1ffa4ce36 could not be found. Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e413a5-2441-47e7-9882-58b1ffa4ce36 could not be found. Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:34.238154 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:34.242791 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:34.242791 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:34.242791 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:34.242791 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:34.242791 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e413a5-2441-47e7-9882-58b1ffa4ce36 could not be found. Oct 12 22:20:34.242791 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:34.243952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-61dcdaab-76f5-41eb-995b-d02f0581fa89 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Returning 404 to user: Instance 30e413a5-2441-47e7-9882-58b1ffa4ce36 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:34.245166 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-61dcdaab-76f5-41eb-995b-d02f0581fa89 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "POST /compute/v2.1/servers/30e413a5-2441-47e7-9882-58b1ffa4ce36/action" status: 404 len: 111 microversion: 2.1 time: 0.022286 Oct 12 22:20:34.252431 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2791/4982] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:34 2022] POST /compute/v2.1/servers/30e413a5-2441-47e7-9882-58b1ffa4ce36/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:20:34.257806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af63a35f-08e0-4dbc-b51b-d040381d1f07 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:34.258680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-af63a35f-08e0-4dbc-b51b-d040381d1f07 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:34.268151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af63a35f-08e0-4dbc-b51b-d040381d1f07 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:34.268863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af63a35f-08e0-4dbc-b51b-d040381d1f07 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:34.269476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af63a35f-08e0-4dbc-b51b-d040381d1f07 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:34.270568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af63a35f-08e0-4dbc-b51b-d040381d1f07 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:34.271193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af63a35f-08e0-4dbc-b51b-d040381d1f07 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:34.272260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af63a35f-08e0-4dbc-b51b-d040381d1f07 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:34.362999 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-af63a35f-08e0-4dbc-b51b-d040381d1f07 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "POST /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b/action" status: 202 len: 0 microversion: 2.1 time: 0.108252 Oct 12 22:20:34.367173 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2792/4983] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:34 2022] POST /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:20:34.373657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-55776982-204f-4082-953d-4d5e6b6eabcb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:34.376865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-55776982-204f-4082-953d-4d5e6b6eabcb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:34.384536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55776982-204f-4082-953d-4d5e6b6eabcb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:34.385306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55776982-204f-4082-953d-4d5e6b6eabcb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:34.385950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55776982-204f-4082-953d-4d5e6b6eabcb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:34.386838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55776982-204f-4082-953d-4d5e6b6eabcb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:34.387495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55776982-204f-4082-953d-4d5e6b6eabcb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:34.388168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55776982-204f-4082-953d-4d5e6b6eabcb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:34.576004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9d137bd8-dc2e-4825-96b5-d7c777334358 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:34.607691 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9d137bd8-dc2e-4825-96b5-d7c777334358 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1518 microversion: 2.1 time: 0.673174 Oct 12 22:20:34.612564 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2192/4984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:33 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1518 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:34.642556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4ea2e22f-1dd6-439a-9ccd-5a387dbd68f4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:34.645379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4ea2e22f-1dd6-439a-9ccd-5a387dbd68f4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:34.668252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ea2e22f-1dd6-439a-9ccd-5a387dbd68f4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:34.668773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ea2e22f-1dd6-439a-9ccd-5a387dbd68f4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:34.670786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ea2e22f-1dd6-439a-9ccd-5a387dbd68f4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:34.672335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ea2e22f-1dd6-439a-9ccd-5a387dbd68f4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:34.673022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ea2e22f-1dd6-439a-9ccd-5a387dbd68f4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:34.678994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ea2e22f-1dd6-439a-9ccd-5a387dbd68f4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:34.804922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-4ea2e22f-1dd6-439a-9ccd-5a387dbd68f4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lazy-loading 'flavor' on Instance uuid 7b6bc6c9-2437-4654-a89f-bf320500b7b1 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:20:34.937022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-55776982-204f-4082-953d-4d5e6b6eabcb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:34.947481 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-55776982-204f-4082-953d-4d5e6b6eabcb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1522 microversion: 2.1 time: 0.578770 Oct 12 22:20:34.968706 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2793/4985] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:34 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1522 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:34.990618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-332dc912-20e9-4577-8763-accde3a233cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:34.991740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-332dc912-20e9-4577-8763-accde3a233cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:35.022161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-332dc912-20e9-4577-8763-accde3a233cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:35.022671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-332dc912-20e9-4577-8763-accde3a233cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:35.023229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-332dc912-20e9-4577-8763-accde3a233cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:35.024332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-332dc912-20e9-4577-8763-accde3a233cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:35.027829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-332dc912-20e9-4577-8763-accde3a233cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:35.031168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-332dc912-20e9-4577-8763-accde3a233cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:35.060693 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4ea2e22f-1dd6-439a-9ccd-5a387dbd68f4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "POST /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1/action" status: 200 len: 32 microversion: 2.1 time: 0.420841 Oct 12 22:20:35.067654 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2193/4986] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:34 2022] POST /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1/action => generated 32 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:20:35.079500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1d4bfef5-76ac-46f9-bbe0-e08056214c0a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:35.090291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1d4bfef5-76ac-46f9-bbe0-e08056214c0a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:35.122221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d4bfef5-76ac-46f9-bbe0-e08056214c0a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:35.125169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d4bfef5-76ac-46f9-bbe0-e08056214c0a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:35.125687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d4bfef5-76ac-46f9-bbe0-e08056214c0a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:35.130980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d4bfef5-76ac-46f9-bbe0-e08056214c0a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:35.132943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d4bfef5-76ac-46f9-bbe0-e08056214c0a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:35.133403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d4bfef5-76ac-46f9-bbe0-e08056214c0a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:35.449307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-332dc912-20e9-4577-8763-accde3a233cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:35.459888 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-332dc912-20e9-4577-8763-accde3a233cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1510 microversion: 2.1 time: 0.489973 Oct 12 22:20:35.463452 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2794/4987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:34 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1510 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:35.870429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1d4bfef5-76ac-46f9-bbe0-e08056214c0a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:35.879027 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1d4bfef5-76ac-46f9-bbe0-e08056214c0a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.807759 Oct 12 22:20:35.880216 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2194/4988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:35 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:35.982824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-177af422-9729-45e1-80af-efa90a3f553e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:35.984235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-177af422-9729-45e1-80af-efa90a3f553e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:35.997451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-177af422-9729-45e1-80af-efa90a3f553e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:35.997959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-177af422-9729-45e1-80af-efa90a3f553e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:35.999999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-177af422-9729-45e1-80af-efa90a3f553e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:36.001504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-177af422-9729-45e1-80af-efa90a3f553e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:36.002584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-177af422-9729-45e1-80af-efa90a3f553e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:36.003442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-177af422-9729-45e1-80af-efa90a3f553e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:36.337758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-177af422-9729-45e1-80af-efa90a3f553e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:36.372086 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-177af422-9729-45e1-80af-efa90a3f553e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1502 microversion: 2.1 time: 0.382781 Oct 12 22:20:36.379404 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2795/4989] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:35 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1502 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:36.400821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-77ddc340-9f31-4beb-8739-b05828b2055c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:36.409321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-77ddc340-9f31-4beb-8739-b05828b2055c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:36.428161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ddc340-9f31-4beb-8739-b05828b2055c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:36.430996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ddc340-9f31-4beb-8739-b05828b2055c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:36.431646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ddc340-9f31-4beb-8739-b05828b2055c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:36.433176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ddc340-9f31-4beb-8739-b05828b2055c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:36.435393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ddc340-9f31-4beb-8739-b05828b2055c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:36.437263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77ddc340-9f31-4beb-8739-b05828b2055c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:36.492510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ba85e234-3c4c-4e23-9324-c6aa9ecb0a87 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:36.493410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ba85e234-3c4c-4e23-9324-c6aa9ecb0a87 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:36.500264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-77ddc340-9f31-4beb-8739-b05828b2055c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lazy-loading 'flavor' on Instance uuid 7013657e-c4d1-4af9-b593-b891d2d1c66b {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:20:36.506427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba85e234-3c4c-4e23-9324-c6aa9ecb0a87 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:36.507205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba85e234-3c4c-4e23-9324-c6aa9ecb0a87 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:36.508578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba85e234-3c4c-4e23-9324-c6aa9ecb0a87 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:36.510846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba85e234-3c4c-4e23-9324-c6aa9ecb0a87 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:36.511880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba85e234-3c4c-4e23-9324-c6aa9ecb0a87 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:36.513733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba85e234-3c4c-4e23-9324-c6aa9ecb0a87 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:36.551440 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-77ddc340-9f31-4beb-8739-b05828b2055c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] HTTP exception thrown: Cannot 'rescue' instance 7013657e-c4d1-4af9-b593-b891d2d1c66b while it is in vm_state paused Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-77ddc340-9f31-4beb-8739-b05828b2055c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Request method failure captured: Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b/action HTTP/1.1 Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 14 Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz1yYv3BEuyn16aX9rFnQkuXp35mHqXE7bVOWKfvxNZXNT7qw6co-FDMauTgJfMPQCxmiEKAu0kzyjnis87qTpfUYp96yN_F6sfmIZnSLJLUbYy9WREcLUGhzXNPjj1UORIJx3lHLMBoOzDKf1JzqCDKyG4PBpXcEQzC9GdyMUjXkpQ Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0a0c4d9f435a4c009bd0b5eb2618829b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: afec4a3808b84463900b744ecd9352b6 Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: {"rescue": {}} Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: exception: Cannot 'rescue' instance 7013657e-c4d1-4af9-b593-b891d2d1c66b while it is in vm_state paused Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '7013657e-c4d1-4af9-b593-b891d2d1c66b', 'body': {'rescue': {}}} Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7013657e-c4d1-4af9-b593-b891d2d1c66b in vm_state paused. Cannot rescue while the instance is in this state. Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 7013657e-c4d1-4af9-b593-b891d2d1c66b while it is in vm_state paused Oct 12 22:20:36.556778 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:36.561297 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:36.561297 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:36.561297 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:36.561297 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:36.561297 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:36.561297 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:36.561297 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:36.561297 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 7013657e-c4d1-4af9-b593-b891d2d1c66b while it is in vm_state paused Oct 12 22:20:36.561297 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:36.561297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-77ddc340-9f31-4beb-8739-b05828b2055c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Returning 409 to user: Cannot 'rescue' instance 7013657e-c4d1-4af9-b593-b891d2d1c66b while it is in vm_state paused {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:36.561297 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-77ddc340-9f31-4beb-8739-b05828b2055c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "POST /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b/action" status: 409 len: 144 microversion: 2.1 time: 0.163684 Oct 12 22:20:36.566380 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2195/4990] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:36 2022] POST /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b/action => generated 144 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:20:36.582895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b5009fba-0f84-4eaa-8745-e9e5361b7d8f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:36.583755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b5009fba-0f84-4eaa-8745-e9e5361b7d8f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:36.605332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5009fba-0f84-4eaa-8745-e9e5361b7d8f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:36.605835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5009fba-0f84-4eaa-8745-e9e5361b7d8f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:36.606277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5009fba-0f84-4eaa-8745-e9e5361b7d8f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:36.612254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5009fba-0f84-4eaa-8745-e9e5361b7d8f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:36.612818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5009fba-0f84-4eaa-8745-e9e5361b7d8f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:36.613273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5009fba-0f84-4eaa-8745-e9e5361b7d8f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:36.768055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:36.785209 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b5009fba-0f84-4eaa-8745-e9e5361b7d8f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "POST /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b/action" status: 202 len: 0 microversion: 2.1 time: 0.216257 Oct 12 22:20:36.787585 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2196/4991] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:36 2022] POST /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:20:36.797342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a2f58c41-8046-4259-b0b2-31af62ca3dce tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:36.805563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a2f58c41-8046-4259-b0b2-31af62ca3dce tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:36.831677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:36.838274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2f58c41-8046-4259-b0b2-31af62ca3dce tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:36.839820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2f58c41-8046-4259-b0b2-31af62ca3dce tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:36.844414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2f58c41-8046-4259-b0b2-31af62ca3dce tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:36.847359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2f58c41-8046-4259-b0b2-31af62ca3dce tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:36.848011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2f58c41-8046-4259-b0b2-31af62ca3dce tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:36.850405 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2f58c41-8046-4259-b0b2-31af62ca3dce tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:36.947384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ba85e234-3c4c-4e23-9324-c6aa9ecb0a87 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:36.979348 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ba85e234-3c4c-4e23-9324-c6aa9ecb0a87 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1510 microversion: 2.1 time: 0.490912 Oct 12 22:20:36.985894 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2796/4992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:36 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1510 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:37.002119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bf233c2f-7a7d-4740-a4ca-445f8edc63b7 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:37.018945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bf233c2f-7a7d-4740-a4ca-445f8edc63b7 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:37.050073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf233c2f-7a7d-4740-a4ca-445f8edc63b7 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:37.050879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf233c2f-7a7d-4740-a4ca-445f8edc63b7 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:37.051537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf233c2f-7a7d-4740-a4ca-445f8edc63b7 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:37.053821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf233c2f-7a7d-4740-a4ca-445f8edc63b7 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:37.055693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf233c2f-7a7d-4740-a4ca-445f8edc63b7 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:37.059936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf233c2f-7a7d-4740-a4ca-445f8edc63b7 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:37.802972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a2f58c41-8046-4259-b0b2-31af62ca3dce tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:37.820196 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a2f58c41-8046-4259-b0b2-31af62ca3dce tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1509 microversion: 2.1 time: 1.029679 Oct 12 22:20:37.820662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bf233c2f-7a7d-4740-a4ca-445f8edc63b7 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:37.821880 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2197/4993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:36 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1509 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:37.841978 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bf233c2f-7a7d-4740-a4ca-445f8edc63b7 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.849719 Oct 12 22:20:37.856949 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2797/4994] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:36 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:38.007181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-120b81d8-dbf2-48d5-b94e-407769bace8f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:38.007909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-120b81d8-dbf2-48d5-b94e-407769bace8f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:38.015774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-120b81d8-dbf2-48d5-b94e-407769bace8f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:38.016802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-120b81d8-dbf2-48d5-b94e-407769bace8f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:38.017240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-120b81d8-dbf2-48d5-b94e-407769bace8f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:38.023467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-120b81d8-dbf2-48d5-b94e-407769bace8f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:38.024309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-120b81d8-dbf2-48d5-b94e-407769bace8f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:38.024902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-120b81d8-dbf2-48d5-b94e-407769bace8f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:38.392990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-120b81d8-dbf2-48d5-b94e-407769bace8f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:38.403226 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-120b81d8-dbf2-48d5-b94e-407769bace8f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1510 microversion: 2.1 time: 0.399575 Oct 12 22:20:38.403993 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2198/4995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:38 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1510 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:38.853625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2f059ea1-9ac0-4657-b798-77e38775bb1d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:38.854867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2f059ea1-9ac0-4657-b798-77e38775bb1d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:38.868418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f059ea1-9ac0-4657-b798-77e38775bb1d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:38.869475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f059ea1-9ac0-4657-b798-77e38775bb1d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:38.870266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f059ea1-9ac0-4657-b798-77e38775bb1d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:38.871633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f059ea1-9ac0-4657-b798-77e38775bb1d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:38.872259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f059ea1-9ac0-4657-b798-77e38775bb1d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:38.872934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f059ea1-9ac0-4657-b798-77e38775bb1d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:38.876717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6cbf426a-790d-4645-9af4-29dc2be9ec4b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:38.877335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6cbf426a-790d-4645-9af4-29dc2be9ec4b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:38.908331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cbf426a-790d-4645-9af4-29dc2be9ec4b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:38.909824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cbf426a-790d-4645-9af4-29dc2be9ec4b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:38.913167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cbf426a-790d-4645-9af4-29dc2be9ec4b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:38.916728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cbf426a-790d-4645-9af4-29dc2be9ec4b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:38.923204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cbf426a-790d-4645-9af4-29dc2be9ec4b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:38.924563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cbf426a-790d-4645-9af4-29dc2be9ec4b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:39.242004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6cbf426a-790d-4645-9af4-29dc2be9ec4b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:39.257806 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6cbf426a-790d-4645-9af4-29dc2be9ec4b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.391529 Oct 12 22:20:39.258760 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2199/4996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:38 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:39.295231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2f059ea1-9ac0-4657-b798-77e38775bb1d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:39.298020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:39.313589 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2f059ea1-9ac0-4657-b798-77e38775bb1d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1517 microversion: 2.1 time: 0.471180 Oct 12 22:20:39.315715 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2798/4997] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:38 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1517 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:39.429512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4c4751e0-a184-48f2-8411-bcd6344f2f91 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:39.430594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4c4751e0-a184-48f2-8411-bcd6344f2f91 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:39.440573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c4751e0-a184-48f2-8411-bcd6344f2f91 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:39.442305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c4751e0-a184-48f2-8411-bcd6344f2f91 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:39.444899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c4751e0-a184-48f2-8411-bcd6344f2f91 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:39.446349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c4751e0-a184-48f2-8411-bcd6344f2f91 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:39.447062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c4751e0-a184-48f2-8411-bcd6344f2f91 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:39.449444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c4751e0-a184-48f2-8411-bcd6344f2f91 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:40.037235 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4c4751e0-a184-48f2-8411-bcd6344f2f91 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:40.047604 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4c4751e0-a184-48f2-8411-bcd6344f2f91 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1510 microversion: 2.1 time: 0.622456 Oct 12 22:20:40.055572 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2200/4998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:39 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1510 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:40.284688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-15c095f3-602e-4169-ad6f-cc212cb7ac6f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:40.285317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-15c095f3-602e-4169-ad6f-cc212cb7ac6f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:40.293893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15c095f3-602e-4169-ad6f-cc212cb7ac6f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:40.307948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15c095f3-602e-4169-ad6f-cc212cb7ac6f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:40.309810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15c095f3-602e-4169-ad6f-cc212cb7ac6f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:40.312941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15c095f3-602e-4169-ad6f-cc212cb7ac6f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:40.313762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15c095f3-602e-4169-ad6f-cc212cb7ac6f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:40.315167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15c095f3-602e-4169-ad6f-cc212cb7ac6f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:40.615369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-15c095f3-602e-4169-ad6f-cc212cb7ac6f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:40.624218 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-15c095f3-602e-4169-ad6f-cc212cb7ac6f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.344338 Oct 12 22:20:40.625119 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2799/4999] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:40 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:41.077007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-347fc660-69d1-4710-a31c-16fad3882655 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:41.078563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-347fc660-69d1-4710-a31c-16fad3882655 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:41.087551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-347fc660-69d1-4710-a31c-16fad3882655 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:41.088290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-347fc660-69d1-4710-a31c-16fad3882655 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:41.088876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-347fc660-69d1-4710-a31c-16fad3882655 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:41.089763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-347fc660-69d1-4710-a31c-16fad3882655 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:41.090365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-347fc660-69d1-4710-a31c-16fad3882655 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:41.090941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-347fc660-69d1-4710-a31c-16fad3882655 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:41.582345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-347fc660-69d1-4710-a31c-16fad3882655 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:41.593862 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-347fc660-69d1-4710-a31c-16fad3882655 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1510 microversion: 2.1 time: 0.524274 Oct 12 22:20:41.595024 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2201/5000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:41 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1510 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:41.650051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-839a0d7e-0b7b-4455-b711-4b8c4686fe25 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:41.651514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-839a0d7e-0b7b-4455-b711-4b8c4686fe25 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:41.664952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-839a0d7e-0b7b-4455-b711-4b8c4686fe25 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:41.665439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-839a0d7e-0b7b-4455-b711-4b8c4686fe25 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:41.669661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-839a0d7e-0b7b-4455-b711-4b8c4686fe25 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:41.670422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-839a0d7e-0b7b-4455-b711-4b8c4686fe25 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:41.670896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-839a0d7e-0b7b-4455-b711-4b8c4686fe25 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:41.671367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-839a0d7e-0b7b-4455-b711-4b8c4686fe25 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:42.010146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-839a0d7e-0b7b-4455-b711-4b8c4686fe25 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:42.027379 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-839a0d7e-0b7b-4455-b711-4b8c4686fe25 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.383100 Oct 12 22:20:42.045124 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2800/5001] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:41 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:42.139792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d94ad417-1e1a-4a0e-aaa0-bfa0ab97bbfb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:42.145217 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d94ad417-1e1a-4a0e-aaa0-bfa0ab97bbfb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:42.154437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d94ad417-1e1a-4a0e-aaa0-bfa0ab97bbfb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:42.155195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d94ad417-1e1a-4a0e-aaa0-bfa0ab97bbfb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:42.155817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d94ad417-1e1a-4a0e-aaa0-bfa0ab97bbfb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:42.156741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d94ad417-1e1a-4a0e-aaa0-bfa0ab97bbfb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:42.157342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d94ad417-1e1a-4a0e-aaa0-bfa0ab97bbfb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:42.157941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d94ad417-1e1a-4a0e-aaa0-bfa0ab97bbfb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:42.185042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-d94ad417-1e1a-4a0e-aaa0-bfa0ab97bbfb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lazy-loading 'flavor' on Instance uuid 7013657e-c4d1-4af9-b593-b891d2d1c66b {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:20:42.312127 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d94ad417-1e1a-4a0e-aaa0-bfa0ab97bbfb tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "POST /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b/action" status: 200 len: 32 microversion: 2.1 time: 0.176509 Oct 12 22:20:42.324046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e3db5a47-a96e-43b6-a64f-77eaf22f08f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:42.324959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e3db5a47-a96e-43b6-a64f-77eaf22f08f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:42.332260 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2202/5002] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:20:42 2022] POST /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:20:42.344836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3db5a47-a96e-43b6-a64f-77eaf22f08f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:42.348665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3db5a47-a96e-43b6-a64f-77eaf22f08f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:42.349527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3db5a47-a96e-43b6-a64f-77eaf22f08f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:42.350527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3db5a47-a96e-43b6-a64f-77eaf22f08f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:42.354070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3db5a47-a96e-43b6-a64f-77eaf22f08f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:42.356392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3db5a47-a96e-43b6-a64f-77eaf22f08f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:42.618214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d0a50250-e2ed-4aae-9e2a-ce252a3b5cd2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:42.619407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d0a50250-e2ed-4aae-9e2a-ce252a3b5cd2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:42.628108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0a50250-e2ed-4aae-9e2a-ce252a3b5cd2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:42.629040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0a50250-e2ed-4aae-9e2a-ce252a3b5cd2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:42.629949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0a50250-e2ed-4aae-9e2a-ce252a3b5cd2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:42.631136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0a50250-e2ed-4aae-9e2a-ce252a3b5cd2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:42.631864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0a50250-e2ed-4aae-9e2a-ce252a3b5cd2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:42.632493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0a50250-e2ed-4aae-9e2a-ce252a3b5cd2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:42.703042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e3db5a47-a96e-43b6-a64f-77eaf22f08f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:42.717820 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e3db5a47-a96e-43b6-a64f-77eaf22f08f7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1523 microversion: 2.1 time: 0.398459 Oct 12 22:20:42.720086 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2801/5003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:42 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1523 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:43.069558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c5abc5a6-ae64-42ea-a92f-fb0060b8f229 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:43.070518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c5abc5a6-ae64-42ea-a92f-fb0060b8f229 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:43.089946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5abc5a6-ae64-42ea-a92f-fb0060b8f229 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:43.091197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5abc5a6-ae64-42ea-a92f-fb0060b8f229 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:43.091685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5abc5a6-ae64-42ea-a92f-fb0060b8f229 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:43.092721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5abc5a6-ae64-42ea-a92f-fb0060b8f229 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:43.093612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5abc5a6-ae64-42ea-a92f-fb0060b8f229 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:43.094966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5abc5a6-ae64-42ea-a92f-fb0060b8f229 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:43.264835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d0a50250-e2ed-4aae-9e2a-ce252a3b5cd2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:43.283055 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d0a50250-e2ed-4aae-9e2a-ce252a3b5cd2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1510 microversion: 2.1 time: 0.668431 Oct 12 22:20:43.284330 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2203/5004] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:42 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1510 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:43.432410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c5abc5a6-ae64-42ea-a92f-fb0060b8f229 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:43.459097 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c5abc5a6-ae64-42ea-a92f-fb0060b8f229 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.390929 Oct 12 22:20:43.462147 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2802/5005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:43 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:43.743661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5beb6c25-123f-4742-918f-7b217aa2e153 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:43.745300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5beb6c25-123f-4742-918f-7b217aa2e153 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:43.772866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5beb6c25-123f-4742-918f-7b217aa2e153 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:43.775031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5beb6c25-123f-4742-918f-7b217aa2e153 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:43.775771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5beb6c25-123f-4742-918f-7b217aa2e153 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:43.777300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5beb6c25-123f-4742-918f-7b217aa2e153 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:43.779381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5beb6c25-123f-4742-918f-7b217aa2e153 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:43.782250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5beb6c25-123f-4742-918f-7b217aa2e153 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:44.197217 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5beb6c25-123f-4742-918f-7b217aa2e153 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:44.212746 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5beb6c25-123f-4742-918f-7b217aa2e153 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1523 microversion: 2.1 time: 0.474565 Oct 12 22:20:44.213456 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2204/5006] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:43 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1523 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:44.307992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0df73dea-5ea7-4025-bb02-1e9857475127 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:44.308860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0df73dea-5ea7-4025-bb02-1e9857475127 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:44.325807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0df73dea-5ea7-4025-bb02-1e9857475127 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:44.327405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0df73dea-5ea7-4025-bb02-1e9857475127 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:44.330569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0df73dea-5ea7-4025-bb02-1e9857475127 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:44.331952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0df73dea-5ea7-4025-bb02-1e9857475127 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:44.333854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0df73dea-5ea7-4025-bb02-1e9857475127 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:44.336593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0df73dea-5ea7-4025-bb02-1e9857475127 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:44.487336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fb5618b7-c983-4314-a4ed-4c64a6556708 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:44.490363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fb5618b7-c983-4314-a4ed-4c64a6556708 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:44.510716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5618b7-c983-4314-a4ed-4c64a6556708 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:44.511763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5618b7-c983-4314-a4ed-4c64a6556708 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:44.512814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5618b7-c983-4314-a4ed-4c64a6556708 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:44.515111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5618b7-c983-4314-a4ed-4c64a6556708 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:44.517554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5618b7-c983-4314-a4ed-4c64a6556708 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:44.518438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5618b7-c983-4314-a4ed-4c64a6556708 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:44.669782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0df73dea-5ea7-4025-bb02-1e9857475127 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:44.682434 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0df73dea-5ea7-4025-bb02-1e9857475127 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1510 microversion: 2.1 time: 0.380323 Oct 12 22:20:44.686157 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2803/5007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:44 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1510 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:44.806513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fb5618b7-c983-4314-a4ed-4c64a6556708 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:44.815307 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fb5618b7-c983-4314-a4ed-4c64a6556708 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.332987 Oct 12 22:20:44.819570 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2205/5008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:44 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:45.010719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-20518547-c760-4bc7-89ee-c2bd77e0b50b tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Action: 'create', calling method: .version_select at 0x7f5122ca6310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1273212549"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:45.240512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9661817a-f5dc-472e-a108-3dc54eacf113 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:45.241190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9661817a-f5dc-472e-a108-3dc54eacf113 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:45.256762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9661817a-f5dc-472e-a108-3dc54eacf113 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:45.257742 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9661817a-f5dc-472e-a108-3dc54eacf113 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:45.258590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9661817a-f5dc-472e-a108-3dc54eacf113 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:45.263260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9661817a-f5dc-472e-a108-3dc54eacf113 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:45.264057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9661817a-f5dc-472e-a108-3dc54eacf113 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:45.265260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9661817a-f5dc-472e-a108-3dc54eacf113 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:45.429906 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-20518547-c760-4bc7-89ee-c2bd77e0b50b tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.643390 Oct 12 22:20:45.430915 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2804/5009] 10.222.0.16 () {60 vars in 1155 bytes} [Wed Oct 12 22:20:44 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 645 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 12 22:20:45.603726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9661817a-f5dc-472e-a108-3dc54eacf113 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:45.616395 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9661817a-f5dc-472e-a108-3dc54eacf113 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1523 microversion: 2.1 time: 0.382396 Oct 12 22:20:45.617383 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2206/5010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:45 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1523 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:45.630208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cbfb4704-46e0-4e74-906e-727975b94338 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f51231c59d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:45.641100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7fea1fd3-8844-43b0-ac3b-cd6f78ef0598 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1465881922", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": "none"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:45.731072 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cbfb4704-46e0-4e74-906e-727975b94338 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170" status: 200 len: 345 microversion: 2.1 time: 0.112375 Oct 12 22:20:45.731756 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2207/5011] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:20:45 2022] GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170 => generated 345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:20:45.742267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-12fedf7e-e514-44b5-9500-c6380c14658b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:45.742885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-12fedf7e-e514-44b5-9500-c6380c14658b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:45.745712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7fea1fd3-8844-43b0-ac3b-cd6f78ef0598 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:20:45.746357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7fea1fd3-8844-43b0-ac3b-cd6f78ef0598 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:20:45.747014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7fea1fd3-8844-43b0-ac3b-cd6f78ef0598 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:20:45.747648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7fea1fd3-8844-43b0-ac3b-cd6f78ef0598 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:20:45.749596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7fea1fd3-8844-43b0-ac3b-cd6f78ef0598 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:20:45.753779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12fedf7e-e514-44b5-9500-c6380c14658b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:45.755615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12fedf7e-e514-44b5-9500-c6380c14658b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:45.756409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12fedf7e-e514-44b5-9500-c6380c14658b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:45.757285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12fedf7e-e514-44b5-9500-c6380c14658b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:45.758430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12fedf7e-e514-44b5-9500-c6380c14658b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:45.759511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12fedf7e-e514-44b5-9500-c6380c14658b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:45.784485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fea1fd3-8844-43b0-ac3b-cd6f78ef0598 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:45.784992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fea1fd3-8844-43b0-ac3b-cd6f78ef0598 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:45.785440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fea1fd3-8844-43b0-ac3b-cd6f78ef0598 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:45.786184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fea1fd3-8844-43b0-ac3b-cd6f78ef0598 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:45.786672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fea1fd3-8844-43b0-ac3b-cd6f78ef0598 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:45.787076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fea1fd3-8844-43b0-ac3b-cd6f78ef0598 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:45.816813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-7fea1fd3-8844-43b0-ac3b-cd6f78ef0598 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Getting quotas for project 8dba055973d54ca39763c585e6be68f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:20:45.822898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-7fea1fd3-8844-43b0-ac3b-cd6f78ef0598 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Getting quotas for user e0007eb556ef4942879c769adb0fbbf8 and project 8dba055973d54ca39763c585e6be68f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:20:45.839846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7fea1fd3-8844-43b0-ac3b-cd6f78ef0598 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:20:45.842439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7fea1fd3-8844-43b0-ac3b-cd6f78ef0598 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] [instance: ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:20:45.877519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:45.921432 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7fea1fd3-8844-43b0-ac3b-cd6f78ef0598 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.489420 Oct 12 22:20:45.925110 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2805/5012] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 22:20:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:20:45.948271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-465cef1d-ea84-4fe0-bc80-a9f187134c86 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:45.949170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-465cef1d-ea84-4fe0-bc80-a9f187134c86 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:45.962705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-465cef1d-ea84-4fe0-bc80-a9f187134c86 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:45.964911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-465cef1d-ea84-4fe0-bc80-a9f187134c86 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:45.965596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-465cef1d-ea84-4fe0-bc80-a9f187134c86 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:45.966484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-465cef1d-ea84-4fe0-bc80-a9f187134c86 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:45.971845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-465cef1d-ea84-4fe0-bc80-a9f187134c86 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:45.972483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-465cef1d-ea84-4fe0-bc80-a9f187134c86 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:46.157627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-12fedf7e-e514-44b5-9500-c6380c14658b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:46.167012 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-12fedf7e-e514-44b5-9500-c6380c14658b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1510 microversion: 2.1 time: 0.434227 Oct 12 22:20:46.193556 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2208/5013] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:45 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1510 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:46.198702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-81575f7a-0326-461d-b53e-1704d813730d tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:46.199359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-81575f7a-0326-461d-b53e-1704d813730d tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] [instance: ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:46.367001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-81575f7a-0326-461d-b53e-1704d813730d tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:46.381977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-81575f7a-0326-461d-b53e-1704d813730d tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:46.395133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-81575f7a-0326-461d-b53e-1704d813730d tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:46.398824 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-81575f7a-0326-461d-b53e-1704d813730d tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] 10.222.0.16 "GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1" status: 200 len: 1281 microversion: 2.47 time: 0.204076 Oct 12 22:20:46.401281 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2209/5014] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:46 2022] GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 => generated 1281 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:20:46.459510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-465cef1d-ea84-4fe0-bc80-a9f187134c86 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:46.467787 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-465cef1d-ea84-4fe0-bc80-a9f187134c86 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.533311 Oct 12 22:20:46.468382 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2806/5015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:45 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:46.642954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4b3c5b8b-29d4-4db0-b6cf-3da6d07c3249 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:46.643818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4b3c5b8b-29d4-4db0-b6cf-3da6d07c3249 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:46.653925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b3c5b8b-29d4-4db0-b6cf-3da6d07c3249 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:46.654423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b3c5b8b-29d4-4db0-b6cf-3da6d07c3249 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:46.654861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b3c5b8b-29d4-4db0-b6cf-3da6d07c3249 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:46.665351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b3c5b8b-29d4-4db0-b6cf-3da6d07c3249 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:46.666461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b3c5b8b-29d4-4db0-b6cf-3da6d07c3249 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:46.676061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b3c5b8b-29d4-4db0-b6cf-3da6d07c3249 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:46.747958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-26b787a4-0df3-4b99-8839-8efb0e8aad82 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f5122cf9430>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:46.861637 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-26b787a4-0df3-4b99-8839-8efb0e8aad82 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170" status: 200 len: 345 microversion: 2.1 time: 0.119450 Oct 12 22:20:46.862214 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2807/5016] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:20:46 2022] GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170 => generated 345 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:20:47.056797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4b3c5b8b-29d4-4db0-b6cf-3da6d07c3249 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:47.087413 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4b3c5b8b-29d4-4db0-b6cf-3da6d07c3249 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1523 microversion: 2.1 time: 0.432359 Oct 12 22:20:47.109107 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2210/5017] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:46 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1523 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:47.192320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0a74d952-f974-494b-a7c3-f57da97c0bf4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:47.192954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0a74d952-f974-494b-a7c3-f57da97c0bf4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:47.201183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a74d952-f974-494b-a7c3-f57da97c0bf4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:47.201730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a74d952-f974-494b-a7c3-f57da97c0bf4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:47.202770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a74d952-f974-494b-a7c3-f57da97c0bf4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:47.203541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a74d952-f974-494b-a7c3-f57da97c0bf4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:47.204046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a74d952-f974-494b-a7c3-f57da97c0bf4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:47.205805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a74d952-f974-494b-a7c3-f57da97c0bf4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:47.432069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4f06ff9d-98f8-438d-a552-0112c5adf422 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:47.432848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4f06ff9d-98f8-438d-a552-0112c5adf422 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] [instance: ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:47.440781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f06ff9d-98f8-438d-a552-0112c5adf422 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:47.441352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f06ff9d-98f8-438d-a552-0112c5adf422 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:47.441840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f06ff9d-98f8-438d-a552-0112c5adf422 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:47.442605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f06ff9d-98f8-438d-a552-0112c5adf422 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:47.443124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f06ff9d-98f8-438d-a552-0112c5adf422 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:47.443640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f06ff9d-98f8-438d-a552-0112c5adf422 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:47.461833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0a74d952-f974-494b-a7c3-f57da97c0bf4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:47.474991 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0a74d952-f974-494b-a7c3-f57da97c0bf4 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1510 microversion: 2.1 time: 0.288842 Oct 12 22:20:47.476330 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2808/5018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:47 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:47.493747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b982073c-facc-4b5f-afce-b31852a9ae6d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:47.494638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b982073c-facc-4b5f-afce-b31852a9ae6d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:47.502100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b982073c-facc-4b5f-afce-b31852a9ae6d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:47.502860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b982073c-facc-4b5f-afce-b31852a9ae6d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:47.503533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b982073c-facc-4b5f-afce-b31852a9ae6d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:47.504410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b982073c-facc-4b5f-afce-b31852a9ae6d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:47.505028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b982073c-facc-4b5f-afce-b31852a9ae6d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:47.505612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b982073c-facc-4b5f-afce-b31852a9ae6d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:47.539453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4f06ff9d-98f8-438d-a552-0112c5adf422 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:47.548001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4f06ff9d-98f8-438d-a552-0112c5adf422 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:47.549477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4f06ff9d-98f8-438d-a552-0112c5adf422 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:47.550832 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4f06ff9d-98f8-438d-a552-0112c5adf422 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] 10.222.0.16 "GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1" status: 200 len: 1333 microversion: 2.47 time: 0.123292 Oct 12 22:20:47.551415 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2211/5019] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:47 2022] GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 => generated 1333 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:20:47.718946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b982073c-facc-4b5f-afce-b31852a9ae6d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:47.727961 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b982073c-facc-4b5f-afce-b31852a9ae6d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.237842 Oct 12 22:20:47.728252 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2809/5020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:47 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:47.882355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-636baf6f-6a3e-40a3-9613-05955564dde7 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f51233e5940>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:48.026453 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-636baf6f-6a3e-40a3-9613-05955564dde7 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170" status: 200 len: 346 microversion: 2.1 time: 0.154496 Oct 12 22:20:48.027116 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2212/5021] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:20:47 2022] GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170 => generated 346 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:20:48.041566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48e40375-605e-4fb9-8671-5fa51dae5351 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Action: 'create', calling method: .version_select at 0x7f5122cf9ca0>, body: {"snapshot": {"volume_id": "de268212-8361-4aaf-9c31-12d2f6770170", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-688621914"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:48.113607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0ec72473-54da-419b-91be-d802e7d49380 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:48.115677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0ec72473-54da-419b-91be-d802e7d49380 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:48.131628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ec72473-54da-419b-91be-d802e7d49380 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:48.134170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ec72473-54da-419b-91be-d802e7d49380 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:48.134736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ec72473-54da-419b-91be-d802e7d49380 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:48.139010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ec72473-54da-419b-91be-d802e7d49380 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:48.139732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ec72473-54da-419b-91be-d802e7d49380 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:48.145465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ec72473-54da-419b-91be-d802e7d49380 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:48.382653 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-48e40375-605e-4fb9-8671-5fa51dae5351 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.345046 Oct 12 22:20:48.388982 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2810/5022] 10.222.0.16 () {60 vars in 1162 bytes} [Wed Oct 12 22:20:48 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:20:48.400972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9a0587a7-2eac-4f61-962f-da5f9da54a40 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f5122d27160>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:48.486456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0ec72473-54da-419b-91be-d802e7d49380 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:48.499675 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0ec72473-54da-419b-91be-d802e7d49380 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1523 microversion: 2.1 time: 0.391523 Oct 12 22:20:48.500780 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2213/5023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:48 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:48.504494 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9a0587a7-2eac-4f61-962f-da5f9da54a40 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6ea47c50-8b63-4160-98af-ea98466e6423" status: 200 len: 286 microversion: 2.1 time: 0.108103 Oct 12 22:20:48.505246 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2811/5024] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 12 22:20:48 2022] GET /compute/v2.1/os-snapshots/6ea47c50-8b63-4160-98af-ea98466e6423 => generated 286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:20:48.508234 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-27ac5d35-72e5-4ee1-a631-269e92204405 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:48.511606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-27ac5d35-72e5-4ee1-a631-269e92204405 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:48.521798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e8848292-0e74-451c-b407-3d1aca09b52e tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f5122c43040>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:48.524607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27ac5d35-72e5-4ee1-a631-269e92204405 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:48.525112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27ac5d35-72e5-4ee1-a631-269e92204405 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:48.525559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27ac5d35-72e5-4ee1-a631-269e92204405 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:48.529196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27ac5d35-72e5-4ee1-a631-269e92204405 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:48.529675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27ac5d35-72e5-4ee1-a631-269e92204405 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:48.532257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27ac5d35-72e5-4ee1-a631-269e92204405 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:48.560825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:48.612566 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e8848292-0e74-451c-b407-3d1aca09b52e tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.095452 Oct 12 22:20:48.613150 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2812/5025] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 12 22:20:48 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:20:48.624656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4bcf28df-be9b-46ea-8377-7d11a6b0fe24 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:48.626080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4bcf28df-be9b-46ea-8377-7d11a6b0fe24 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] [instance: ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:48.635896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bcf28df-be9b-46ea-8377-7d11a6b0fe24 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:48.636658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bcf28df-be9b-46ea-8377-7d11a6b0fe24 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:48.637342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bcf28df-be9b-46ea-8377-7d11a6b0fe24 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:48.638297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bcf28df-be9b-46ea-8377-7d11a6b0fe24 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:48.639051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bcf28df-be9b-46ea-8377-7d11a6b0fe24 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:48.640215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4bcf28df-be9b-46ea-8377-7d11a6b0fe24 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:48.726328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4bcf28df-be9b-46ea-8377-7d11a6b0fe24 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:48.736714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4bcf28df-be9b-46ea-8377-7d11a6b0fe24 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:48.739977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4bcf28df-be9b-46ea-8377-7d11a6b0fe24 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:48.742411 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4bcf28df-be9b-46ea-8377-7d11a6b0fe24 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] 10.222.0.16 "GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1" status: 200 len: 1339 microversion: 2.47 time: 0.121619 Oct 12 22:20:48.743578 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2813/5026] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:48 2022] GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 => generated 1339 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:20:48.763573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d7320ecd-ecc7-4568-86a7-d4a77eb9644c tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f5122c759d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:48.820024 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d7320ecd-ecc7-4568-86a7-d4a77eb9644c tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6ea47c50-8b63-4160-98af-ea98466e6423" status: 200 len: 286 microversion: 2.1 time: 0.075152 Oct 12 22:20:48.820831 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2814/5027] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 12 22:20:48 2022] GET /compute/v2.1/os-snapshots/6ea47c50-8b63-4160-98af-ea98466e6423 => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:20:48.831983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-72fa4771-8ef6-43d6-8eae-5e058ad2d3be tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:48.835971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-72fa4771-8ef6-43d6-8eae-5e058ad2d3be tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:48.855385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72fa4771-8ef6-43d6-8eae-5e058ad2d3be tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:48.857889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72fa4771-8ef6-43d6-8eae-5e058ad2d3be tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:48.858593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72fa4771-8ef6-43d6-8eae-5e058ad2d3be tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:48.865146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72fa4771-8ef6-43d6-8eae-5e058ad2d3be tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:48.866956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72fa4771-8ef6-43d6-8eae-5e058ad2d3be tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:48.867659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72fa4771-8ef6-43d6-8eae-5e058ad2d3be tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:49.260979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-72fa4771-8ef6-43d6-8eae-5e058ad2d3be tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:49.273565 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-72fa4771-8ef6-43d6-8eae-5e058ad2d3be tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.450226 Oct 12 22:20:49.274665 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2815/5028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:48 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:49.493527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-27ac5d35-72e5-4ee1-a631-269e92204405 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:49.504983 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-27ac5d35-72e5-4ee1-a631-269e92204405 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1531 microversion: 2.1 time: 1.003061 Oct 12 22:20:49.505589 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2214/5029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:48 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1531 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:49.521984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-da17dd1c-9ce4-4cf0-93da-5f726244d8b0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:49.522612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-da17dd1c-9ce4-4cf0-93da-5f726244d8b0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:49.534772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da17dd1c-9ce4-4cf0-93da-5f726244d8b0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:49.535312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da17dd1c-9ce4-4cf0-93da-5f726244d8b0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:49.535747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da17dd1c-9ce4-4cf0-93da-5f726244d8b0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:49.536466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da17dd1c-9ce4-4cf0-93da-5f726244d8b0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:49.536926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da17dd1c-9ce4-4cf0-93da-5f726244d8b0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:49.537367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da17dd1c-9ce4-4cf0-93da-5f726244d8b0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:49.776308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-91f38f56-d714-41e9-bd1e-894eaf1e24d8 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:49.776933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-91f38f56-d714-41e9-bd1e-894eaf1e24d8 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] [instance: ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:49.789211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91f38f56-d714-41e9-bd1e-894eaf1e24d8 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:49.789870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91f38f56-d714-41e9-bd1e-894eaf1e24d8 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:49.790144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91f38f56-d714-41e9-bd1e-894eaf1e24d8 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:49.790866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91f38f56-d714-41e9-bd1e-894eaf1e24d8 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:49.791366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91f38f56-d714-41e9-bd1e-894eaf1e24d8 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:49.791785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91f38f56-d714-41e9-bd1e-894eaf1e24d8 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:49.949017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-91f38f56-d714-41e9-bd1e-894eaf1e24d8 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:49.957827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-91f38f56-d714-41e9-bd1e-894eaf1e24d8 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:49.959974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-91f38f56-d714-41e9-bd1e-894eaf1e24d8 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:49.961504 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-91f38f56-d714-41e9-bd1e-894eaf1e24d8 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] 10.222.0.16 "GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1" status: 200 len: 1339 microversion: 2.47 time: 0.189172 Oct 12 22:20:49.962322 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2215/5030] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:49 2022] GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 => generated 1339 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:20:49.994732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-baf3db3d-f14b-436c-b764-d486c68faba4 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f51231d0f70>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:50.061973 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-baf3db3d-f14b-436c-b764-d486c68faba4 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6ea47c50-8b63-4160-98af-ea98466e6423" status: 200 len: 286 microversion: 2.1 time: 0.083580 Oct 12 22:20:50.064951 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2216/5031] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 12 22:20:49 2022] GET /compute/v2.1/os-snapshots/6ea47c50-8b63-4160-98af-ea98466e6423 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:20:50.183032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-da17dd1c-9ce4-4cf0-93da-5f726244d8b0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:50.199973 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-da17dd1c-9ce4-4cf0-93da-5f726244d8b0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1523 microversion: 2.1 time: 0.681743 Oct 12 22:20:50.218968 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2816/5032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:49 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1523 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:50.298284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e83d5094-e55a-46bf-ad62-2cabe5361151 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:50.299159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e83d5094-e55a-46bf-ad62-2cabe5361151 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:50.373140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e83d5094-e55a-46bf-ad62-2cabe5361151 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:50.377988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e83d5094-e55a-46bf-ad62-2cabe5361151 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:50.384950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e83d5094-e55a-46bf-ad62-2cabe5361151 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:50.387897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e83d5094-e55a-46bf-ad62-2cabe5361151 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:50.390707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e83d5094-e55a-46bf-ad62-2cabe5361151 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:50.401276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e83d5094-e55a-46bf-ad62-2cabe5361151 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:50.531007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-914b5080-23f1-4a66-a431-e32457979289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:50.533007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-914b5080-23f1-4a66-a431-e32457979289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:50.561707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-914b5080-23f1-4a66-a431-e32457979289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:50.565080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-914b5080-23f1-4a66-a431-e32457979289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:50.569644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-914b5080-23f1-4a66-a431-e32457979289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:50.571030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-914b5080-23f1-4a66-a431-e32457979289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:50.574137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-914b5080-23f1-4a66-a431-e32457979289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:50.576861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-914b5080-23f1-4a66-a431-e32457979289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:50.854007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e83d5094-e55a-46bf-ad62-2cabe5361151 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:50.868925 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e83d5094-e55a-46bf-ad62-2cabe5361151 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.575850 Oct 12 22:20:50.870214 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2217/5033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:50 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:50.875609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-3ab15465-49b8-40d5-a14b-b80fb532c310 req-b55bc40b-de1a-475e-8e38-f70619c2fc08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02be5cee-72e9-4cc6-94a2-c3517ec178bd", "name": "network-vif-plugged", "status": "completed", "tag": "ba67b2ed-d4b3-4942-b9cd-37eda012789a"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:50.898803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-914b5080-23f1-4a66-a431-e32457979289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:50.902446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3ab15465-49b8-40d5-a14b-b80fb532c310 req-b55bc40b-de1a-475e-8e38-f70619c2fc08 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:50.902834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3ab15465-49b8-40d5-a14b-b80fb532c310 req-b55bc40b-de1a-475e-8e38-f70619c2fc08 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:50.903299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3ab15465-49b8-40d5-a14b-b80fb532c310 req-b55bc40b-de1a-475e-8e38-f70619c2fc08 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:50.909374 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-914b5080-23f1-4a66-a431-e32457979289 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1531 microversion: 2.1 time: 0.383297 Oct 12 22:20:50.924322 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2817/5034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:50 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1531 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:50.936967 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-3ab15465-49b8-40d5-a14b-b80fb532c310 req-b55bc40b-de1a-475e-8e38-f70619c2fc08 service nova] Creating event network-vif-plugged:ba67b2ed-d4b3-4942-b9cd-37eda012789a for instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd on n-h2-861111-1 Oct 12 22:20:50.942797 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-3ab15465-49b8-40d5-a14b-b80fb532c310 req-b55bc40b-de1a-475e-8e38-f70619c2fc08 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071295 Oct 12 22:20:50.943675 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2218/5035] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:20:50.992337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-24d2d5bb-e719-41d1-bc90-c0b803b16237 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:50.992955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-24d2d5bb-e719-41d1-bc90-c0b803b16237 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] [instance: ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:50.999873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24d2d5bb-e719-41d1-bc90-c0b803b16237 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:51.000410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24d2d5bb-e719-41d1-bc90-c0b803b16237 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:51.000853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24d2d5bb-e719-41d1-bc90-c0b803b16237 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:51.001557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24d2d5bb-e719-41d1-bc90-c0b803b16237 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:51.002204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24d2d5bb-e719-41d1-bc90-c0b803b16237 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:51.002713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24d2d5bb-e719-41d1-bc90-c0b803b16237 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:51.077736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0f4b17bc-0c6b-46ba-beff-2b787c527294 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f51231d0ca0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:51.100199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-24d2d5bb-e719-41d1-bc90-c0b803b16237 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:51.114846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-24d2d5bb-e719-41d1-bc90-c0b803b16237 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:51.118755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-24d2d5bb-e719-41d1-bc90-c0b803b16237 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:51.120297 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-24d2d5bb-e719-41d1-bc90-c0b803b16237 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] 10.222.0.16 "GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1" status: 200 len: 1360 microversion: 2.47 time: 0.132475 Oct 12 22:20:51.121100 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2818/5036] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:50 2022] GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 => generated 1360 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:20:51.132402 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0f4b17bc-0c6b-46ba-beff-2b787c527294 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6ea47c50-8b63-4160-98af-ea98466e6423" status: 200 len: 287 microversion: 2.1 time: 0.058932 Oct 12 22:20:51.133434 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2219/5037] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 12 22:20:51 2022] GET /compute/v2.1/os-snapshots/6ea47c50-8b63-4160-98af-ea98466e6423 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:20:51.149005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-44c90620-2b1d-44b3-a57b-eb34587a77f8 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f5122c75280>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:51.149968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f932e36a-78c4-4c5a-864e-6032d3c4a28e tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2118485039"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:20:51.153877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f932e36a-78c4-4c5a-864e-6032d3c4a28e tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] [instance: ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:51.161625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f932e36a-78c4-4c5a-864e-6032d3c4a28e tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:51.162328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f932e36a-78c4-4c5a-864e-6032d3c4a28e tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:51.162959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f932e36a-78c4-4c5a-864e-6032d3c4a28e tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:51.163852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f932e36a-78c4-4c5a-864e-6032d3c4a28e tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:51.164112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f932e36a-78c4-4c5a-864e-6032d3c4a28e tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:51.164915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f932e36a-78c4-4c5a-864e-6032d3c4a28e tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:51.277384 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-44c90620-2b1d-44b3-a57b-eb34587a77f8 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/6ea47c50-8b63-4160-98af-ea98466e6423" status: 202 len: 0 microversion: 2.1 time: 0.136434 Oct 12 22:20:51.278014 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2819/5038] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Oct 12 22:20:51 2022] DELETE /compute/v2.1/os-snapshots/6ea47c50-8b63-4160-98af-ea98466e6423 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:20:51.289546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3fef714d-9aca-48f2-8c9a-624a3f25f70f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:51.290176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3fef714d-9aca-48f2-8c9a-624a3f25f70f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:51.298303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fef714d-9aca-48f2-8c9a-624a3f25f70f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:51.298805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fef714d-9aca-48f2-8c9a-624a3f25f70f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:51.302198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fef714d-9aca-48f2-8c9a-624a3f25f70f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:51.302986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fef714d-9aca-48f2-8c9a-624a3f25f70f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:51.303512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fef714d-9aca-48f2-8c9a-624a3f25f70f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:51.303952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fef714d-9aca-48f2-8c9a-624a3f25f70f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:51.446551 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f932e36a-78c4-4c5a-864e-6032d3c4a28e tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] 10.222.0.16 "POST /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1/action" status: 202 len: 52 microversion: 2.47 time: 0.300581 Oct 12 22:20:51.451309 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2220/5039] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 12 22:20:51 2022] POST /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1/action => generated 52 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 12 22:20:51.464420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-743fe46f-3bc1-4cf7-9c7b-14fcf796a30f tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f512354b4c0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:51.510333 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-743fe46f-3bc1-4cf7-9c7b-14fcf796a30f tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6ea47c50-8b63-4160-98af-ea98466e6423" status: 200 len: 286 microversion: 2.1 time: 0.056439 Oct 12 22:20:51.511094 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2221/5040] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 12 22:20:51 2022] GET /compute/v2.1/os-snapshots/6ea47c50-8b63-4160-98af-ea98466e6423 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:20:51.516058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-393d4564-907a-425a-b9d1-0e08e1263f25 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:51.516884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-393d4564-907a-425a-b9d1-0e08e1263f25 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] [instance: ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:51.530249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-393d4564-907a-425a-b9d1-0e08e1263f25 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:51.530249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-393d4564-907a-425a-b9d1-0e08e1263f25 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:51.530650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-393d4564-907a-425a-b9d1-0e08e1263f25 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:51.532965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-393d4564-907a-425a-b9d1-0e08e1263f25 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:51.533436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-393d4564-907a-425a-b9d1-0e08e1263f25 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:51.533888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-393d4564-907a-425a-b9d1-0e08e1263f25 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:51.599981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-393d4564-907a-425a-b9d1-0e08e1263f25 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] [instance: ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:20:51.626892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3fef714d-9aca-48f2-8c9a-624a3f25f70f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:51.638938 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3fef714d-9aca-48f2-8c9a-624a3f25f70f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1523 microversion: 2.1 time: 0.351035 Oct 12 22:20:51.639865 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2820/5041] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:51 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1523 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:51.714717 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-393d4564-907a-425a-b9d1-0e08e1263f25 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1" status: 204 len: 0 microversion: 2.47 time: 0.202002 Oct 12 22:20:51.718691 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2222/5042] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:20:51 2022] DELETE /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:20:51.733660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4dbd1e2f-d16d-43b1-a222-9106e6f35d22 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:51.734586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4dbd1e2f-d16d-43b1-a222-9106e6f35d22 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] [instance: ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:51.743166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4dbd1e2f-d16d-43b1-a222-9106e6f35d22 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:51.744327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4dbd1e2f-d16d-43b1-a222-9106e6f35d22 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:51.744598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4dbd1e2f-d16d-43b1-a222-9106e6f35d22 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:51.745592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4dbd1e2f-d16d-43b1-a222-9106e6f35d22 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:51.746158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4dbd1e2f-d16d-43b1-a222-9106e6f35d22 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:51.746814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4dbd1e2f-d16d-43b1-a222-9106e6f35d22 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:51.861971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4dbd1e2f-d16d-43b1-a222-9106e6f35d22 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:51.871589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4dbd1e2f-d16d-43b1-a222-9106e6f35d22 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:51.878565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4dbd1e2f-d16d-43b1-a222-9106e6f35d22 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:51.881760 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4dbd1e2f-d16d-43b1-a222-9106e6f35d22 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] 10.222.0.16 "GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1" status: 200 len: 1366 microversion: 2.47 time: 0.161037 Oct 12 22:20:51.885286 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2821/5043] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:51 2022] GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:20:51.905041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1e354851-25d9-49f2-a77b-e797ea4b809e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:51.905041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1e354851-25d9-49f2-a77b-e797ea4b809e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:51.915111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e354851-25d9-49f2-a77b-e797ea4b809e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:51.918292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e354851-25d9-49f2-a77b-e797ea4b809e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:51.919404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e354851-25d9-49f2-a77b-e797ea4b809e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:51.921708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e354851-25d9-49f2-a77b-e797ea4b809e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:51.924030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e354851-25d9-49f2-a77b-e797ea4b809e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:51.924513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e354851-25d9-49f2-a77b-e797ea4b809e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:51.934911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cbb8c2d9-c831-4a0c-b2fd-88cd8ac2ae30 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:51.935772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cbb8c2d9-c831-4a0c-b2fd-88cd8ac2ae30 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:51.947258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbb8c2d9-c831-4a0c-b2fd-88cd8ac2ae30 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:51.948011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbb8c2d9-c831-4a0c-b2fd-88cd8ac2ae30 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:51.949252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbb8c2d9-c831-4a0c-b2fd-88cd8ac2ae30 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:51.952021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbb8c2d9-c831-4a0c-b2fd-88cd8ac2ae30 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:51.952661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbb8c2d9-c831-4a0c-b2fd-88cd8ac2ae30 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:51.954642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbb8c2d9-c831-4a0c-b2fd-88cd8ac2ae30 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:52.285759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1e354851-25d9-49f2-a77b-e797ea4b809e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:52.294771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cbb8c2d9-c831-4a0c-b2fd-88cd8ac2ae30 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:52.301149 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1e354851-25d9-49f2-a77b-e797ea4b809e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.406829 Oct 12 22:20:52.301737 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2223/5044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:51 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:52.318858 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cbb8c2d9-c831-4a0c-b2fd-88cd8ac2ae30 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1531 microversion: 2.1 time: 0.388278 Oct 12 22:20:52.319986 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2822/5045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:51 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1531 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:52.523834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b0faf3ce-5d22-4b1d-b880-3e04f39bf1bd tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f5122c8d280>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:52.577083 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b0faf3ce-5d22-4b1d-b880-3e04f39bf1bd tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6ea47c50-8b63-4160-98af-ea98466e6423" status: 200 len: 286 microversion: 2.1 time: 0.057325 Oct 12 22:20:52.578751 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2823/5046] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 12 22:20:52 2022] GET /compute/v2.1/os-snapshots/6ea47c50-8b63-4160-98af-ea98466e6423 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:20:52.651090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3316917b-fd61-4d16-85af-9ad298c03bb4 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:52.652926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3316917b-fd61-4d16-85af-9ad298c03bb4 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:52.666043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-496b6d5f-f4d5-42c3-9f0d-124d9e693f00 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:52.667192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-496b6d5f-f4d5-42c3-9f0d-124d9e693f00 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:52.684233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-496b6d5f-f4d5-42c3-9f0d-124d9e693f00 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:52.688600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3316917b-fd61-4d16-85af-9ad298c03bb4 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:52.689337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3316917b-fd61-4d16-85af-9ad298c03bb4 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:52.690098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-496b6d5f-f4d5-42c3-9f0d-124d9e693f00 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:52.690795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3316917b-fd61-4d16-85af-9ad298c03bb4 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:52.691581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-496b6d5f-f4d5-42c3-9f0d-124d9e693f00 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:52.693133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-496b6d5f-f4d5-42c3-9f0d-124d9e693f00 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:52.693567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3316917b-fd61-4d16-85af-9ad298c03bb4 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:52.695675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3316917b-fd61-4d16-85af-9ad298c03bb4 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:52.696394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-496b6d5f-f4d5-42c3-9f0d-124d9e693f00 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:52.697070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3316917b-fd61-4d16-85af-9ad298c03bb4 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:52.697719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-496b6d5f-f4d5-42c3-9f0d-124d9e693f00 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:52.721644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:52.786557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3316917b-fd61-4d16-85af-9ad298c03bb4 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:20:53.006362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-496b6d5f-f4d5-42c3-9f0d-124d9e693f00 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:53.025564 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-496b6d5f-f4d5-42c3-9f0d-124d9e693f00 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1523 microversion: 2.1 time: 0.363481 Oct 12 22:20:53.026212 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3316917b-fd61-4d16-85af-9ad298c03bb4 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 204 len: 0 microversion: 2.42 time: 0.577435 Oct 12 22:20:53.042237 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2824/5047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:52 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:53.042237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-458539df-9cb2-4b49-aef3-95424dc7e9bd tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:53.043141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-458539df-9cb2-4b49-aef3-95424dc7e9bd tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] [instance: ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:53.046398 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2224/5048] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:20:52 2022] DELETE /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:20:53.048890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-458539df-9cb2-4b49-aef3-95424dc7e9bd tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:53.049475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-458539df-9cb2-4b49-aef3-95424dc7e9bd tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:53.049924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-458539df-9cb2-4b49-aef3-95424dc7e9bd tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:53.051136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-458539df-9cb2-4b49-aef3-95424dc7e9bd tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:53.052025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-458539df-9cb2-4b49-aef3-95424dc7e9bd tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:53.052702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-458539df-9cb2-4b49-aef3-95424dc7e9bd tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:53.075873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-19ad6f01-f218-4942-86b2-abeca20e5376 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:53.077065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-19ad6f01-f218-4942-86b2-abeca20e5376 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:53.096494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ad6f01-f218-4942-86b2-abeca20e5376 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:53.108363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ad6f01-f218-4942-86b2-abeca20e5376 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:53.108937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ad6f01-f218-4942-86b2-abeca20e5376 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:53.111348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ad6f01-f218-4942-86b2-abeca20e5376 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:53.112428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ad6f01-f218-4942-86b2-abeca20e5376 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:53.113658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ad6f01-f218-4942-86b2-abeca20e5376 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:53.158932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-458539df-9cb2-4b49-aef3-95424dc7e9bd tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:53.170425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-458539df-9cb2-4b49-aef3-95424dc7e9bd tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:53.173234 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-458539df-9cb2-4b49-aef3-95424dc7e9bd tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:53.175066 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-458539df-9cb2-4b49-aef3-95424dc7e9bd tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] 10.222.0.16 "GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1" status: 200 len: 1366 microversion: 2.47 time: 0.147840 Oct 12 22:20:53.177645 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2825/5049] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:53 2022] GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:20:53.329811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6a687a0d-30c2-4464-a3ae-9b3a6472dd3e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:53.330733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6a687a0d-30c2-4464-a3ae-9b3a6472dd3e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:53.357514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a687a0d-30c2-4464-a3ae-9b3a6472dd3e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:53.360263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a687a0d-30c2-4464-a3ae-9b3a6472dd3e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:53.362634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a687a0d-30c2-4464-a3ae-9b3a6472dd3e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:53.363766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a687a0d-30c2-4464-a3ae-9b3a6472dd3e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:53.364462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a687a0d-30c2-4464-a3ae-9b3a6472dd3e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:53.365130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a687a0d-30c2-4464-a3ae-9b3a6472dd3e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:53.443509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-19ad6f01-f218-4942-86b2-abeca20e5376 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:53.459042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-19ad6f01-f218-4942-86b2-abeca20e5376 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:53.464422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-19ad6f01-f218-4942-86b2-abeca20e5376 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:53.476810 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-19ad6f01-f218-4942-86b2-abeca20e5376 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 2963 microversion: 2.42 time: 0.423115 Oct 12 22:20:53.477427 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2225/5050] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:53 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 2963 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:20:53.505509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b3fe2a0e-1ff3-4d0c-a935-bd24bcecff75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:53.506426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b3fe2a0e-1ff3-4d0c-a935-bd24bcecff75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:53.513588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3fe2a0e-1ff3-4d0c-a935-bd24bcecff75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:53.514314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3fe2a0e-1ff3-4d0c-a935-bd24bcecff75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:53.514908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3fe2a0e-1ff3-4d0c-a935-bd24bcecff75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:53.515857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3fe2a0e-1ff3-4d0c-a935-bd24bcecff75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:53.516457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3fe2a0e-1ff3-4d0c-a935-bd24bcecff75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:53.517036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3fe2a0e-1ff3-4d0c-a935-bd24bcecff75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:53.525038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6a687a0d-30c2-4464-a3ae-9b3a6472dd3e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:53.535786 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6a687a0d-30c2-4464-a3ae-9b3a6472dd3e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.210432 Oct 12 22:20:53.536886 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2826/5051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:53 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:53.594584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5868af84-f3f7-4669-bbc6-932eb0962c3a tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f5122d38700>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:53.644173 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-5868af84-f3f7-4669-bbc6-932eb0962c3a tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] HTTP exception thrown: Snapshot 6ea47c50-8b63-4160-98af-ea98466e6423 could not be found. Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5868af84-f3f7-4669-bbc6-932eb0962c3a tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Request method failure captured: Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-snapshots/6ea47c50-8b63-4160-98af-ea98466e6423 HTTP/1.1 Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz284kXtJ6u-1kLkJrRyDOlEBja18OLNS5JUInI6c62cOpFpLd7iWubCm8wXpwuLlrIZOQO016rqceiVca0rQ5fyzPmMe1s2bOjsILWK_OY8HEDfCc_DHNgE4IQ9qfq76Fxxnj1AgCL-hGOFqqYADnKa-5dtjcO7Cj6kvTt2b732CyU Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 5adc55d301bd48048e977641551f3dea Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-981114427 Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5adc55d301bd48048e977641551f3dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5adc55d301bd48048e977641551f3dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5adc55d301bd48048e977641551f3dea", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5adc55d301bd48048e977641551f3dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-VolumesSnapshotsTestJSON-981114427 Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 5adc55d301bd48048e977641551f3dea Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-981114427 Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-VolumesSnapshotsTestJSON-981114427-project Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: d3604ca5d15e4c69b7f6ce3b85a8ab3a Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-VolumesSnapshotsTestJSON-981114427-project Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: exception: Snapshot 6ea47c50-8b63-4160-98af-ea98466e6423 could not be found. Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '6ea47c50-8b63-4160-98af-ea98466e6423'} Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6ea47c50-8b63-4160-98af-ea98466e6423 could not be found. (HTTP 404) (Request-ID: req-2addcdf9-a7a0-4257-bcfb-bc2a9d10ffd9) Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 22:20:53.654722 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6ea47c50-8b63-4160-98af-ea98466e6423 could not be found. Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6ea47c50-8b63-4160-98af-ea98466e6423 could not be found. Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6ea47c50-8b63-4160-98af-ea98466e6423 could not be found. Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5868af84-f3f7-4669-bbc6-932eb0962c3a tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Returning 404 to user: Snapshot 6ea47c50-8b63-4160-98af-ea98466e6423 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:53.660183 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5868af84-f3f7-4669-bbc6-932eb0962c3a tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6ea47c50-8b63-4160-98af-ea98466e6423" status: 404 len: 111 microversion: 2.1 time: 0.071388 Oct 12 22:20:53.663446 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2827/5052] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 12 22:20:53 2022] GET /compute/v2.1/os-snapshots/6ea47c50-8b63-4160-98af-ea98466e6423 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:20:53.673286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5667eb6e-ff36-468c-8d24-5f2613d54e92 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f5122c93790>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:53.795855 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5667eb6e-ff36-468c-8d24-5f2613d54e92 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170" status: 202 len: 0 microversion: 2.1 time: 0.132048 Oct 12 22:20:53.801031 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2828/5053] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 22:20:53 2022] DELETE /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:20:53.807466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eecd8f73-fd70-4294-92df-47e4fabfb262 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f5122d38670>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:53.862838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b3fe2a0e-1ff3-4d0c-a935-bd24bcecff75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:53.871367 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b3fe2a0e-1ff3-4d0c-a935-bd24bcecff75 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1531 microversion: 2.1 time: 0.378952 Oct 12 22:20:53.872121 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2226/5054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:53 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1531 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:53.893058 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eecd8f73-fd70-4294-92df-47e4fabfb262 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170" status: 200 len: 345 microversion: 2.1 time: 0.088095 Oct 12 22:20:53.903067 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2829/5055] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:20:53 2022] GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170 => generated 345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:20:54.054171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1a4481ce-e5cb-40ca-97bc-58e67924ee3d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:54.056162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1a4481ce-e5cb-40ca-97bc-58e67924ee3d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:54.074478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a4481ce-e5cb-40ca-97bc-58e67924ee3d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:54.075281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a4481ce-e5cb-40ca-97bc-58e67924ee3d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:54.079511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a4481ce-e5cb-40ca-97bc-58e67924ee3d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:54.080863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a4481ce-e5cb-40ca-97bc-58e67924ee3d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:54.081580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a4481ce-e5cb-40ca-97bc-58e67924ee3d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:54.083425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a4481ce-e5cb-40ca-97bc-58e67924ee3d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:54.204885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-99061bfd-999b-48eb-b34e-751c5c350248 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:54.206689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-99061bfd-999b-48eb-b34e-751c5c350248 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] [instance: ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:54.233808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99061bfd-999b-48eb-b34e-751c5c350248 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:54.238187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99061bfd-999b-48eb-b34e-751c5c350248 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:54.238811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99061bfd-999b-48eb-b34e-751c5c350248 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:54.240959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99061bfd-999b-48eb-b34e-751c5c350248 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:54.242369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99061bfd-999b-48eb-b34e-751c5c350248 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:54.242988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99061bfd-999b-48eb-b34e-751c5c350248 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:54.349531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99061bfd-999b-48eb-b34e-751c5c350248 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:54.350341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99061bfd-999b-48eb-b34e-751c5c350248 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:54.350951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99061bfd-999b-48eb-b34e-751c5c350248 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:54.351730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-99061bfd-999b-48eb-b34e-751c5c350248 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lazy-loading 'fault' on Instance uuid ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:20:54.403191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-99061bfd-999b-48eb-b34e-751c5c350248 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:54.410301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1a4481ce-e5cb-40ca-97bc-58e67924ee3d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:54.413662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-99061bfd-999b-48eb-b34e-751c5c350248 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:54.415776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-99061bfd-999b-48eb-b34e-751c5c350248 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0007eb556ef4942879c769adb0fbbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dba055973d54ca39763c585e6be68f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:54.417154 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-99061bfd-999b-48eb-b34e-751c5c350248 tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] 10.222.0.16 "GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1" status: 200 len: 1371 microversion: 2.47 time: 0.219483 Oct 12 22:20:54.418241 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2830/5056] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:54 2022] GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:20:54.439536 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1a4481ce-e5cb-40ca-97bc-58e67924ee3d tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1523 microversion: 2.1 time: 0.394319 Oct 12 22:20:54.455607 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2227/5057] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:54 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1523 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:54.509898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-480fde40-3c12-4bda-9f47-3956fc0e2215 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:54.510661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-480fde40-3c12-4bda-9f47-3956fc0e2215 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:54.517686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-480fde40-3c12-4bda-9f47-3956fc0e2215 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:54.518274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-480fde40-3c12-4bda-9f47-3956fc0e2215 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:54.518782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-480fde40-3c12-4bda-9f47-3956fc0e2215 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:54.519734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-480fde40-3c12-4bda-9f47-3956fc0e2215 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:54.520264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-480fde40-3c12-4bda-9f47-3956fc0e2215 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:54.521104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-480fde40-3c12-4bda-9f47-3956fc0e2215 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:54.560450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d0c14608-f349-431c-b57d-acf45c6183ea tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:54.561964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d0c14608-f349-431c-b57d-acf45c6183ea tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:54.573772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0c14608-f349-431c-b57d-acf45c6183ea tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:54.575835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0c14608-f349-431c-b57d-acf45c6183ea tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:54.581258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0c14608-f349-431c-b57d-acf45c6183ea tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:54.584193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0c14608-f349-431c-b57d-acf45c6183ea tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:54.584832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0c14608-f349-431c-b57d-acf45c6183ea tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:54.595980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0c14608-f349-431c-b57d-acf45c6183ea tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:54.793857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-480fde40-3c12-4bda-9f47-3956fc0e2215 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:54.807196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-480fde40-3c12-4bda-9f47-3956fc0e2215 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:54.809338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-480fde40-3c12-4bda-9f47-3956fc0e2215 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:54.810887 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-480fde40-3c12-4bda-9f47-3956fc0e2215 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 2963 microversion: 2.42 time: 0.305182 Oct 12 22:20:54.812884 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2831/5058] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:54 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 2963 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:20:54.901101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bd13eee9-1ec1-443a-bbd5-77b604e79067 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:54.904285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bd13eee9-1ec1-443a-bbd5-77b604e79067 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:54.915779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd13eee9-1ec1-443a-bbd5-77b604e79067 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:54.916676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd13eee9-1ec1-443a-bbd5-77b604e79067 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:54.917366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd13eee9-1ec1-443a-bbd5-77b604e79067 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:54.919409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd13eee9-1ec1-443a-bbd5-77b604e79067 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:54.920348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd13eee9-1ec1-443a-bbd5-77b604e79067 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:54.920997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd13eee9-1ec1-443a-bbd5-77b604e79067 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:55.004487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d0c14608-f349-431c-b57d-acf45c6183ea tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:55.014865 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d0c14608-f349-431c-b57d-acf45c6183ea tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.457335 Oct 12 22:20:55.018801 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2228/5059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:54 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:55.027728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-323ad500-706e-49f2-bccc-30ebfddd7e15 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f51232284c0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:55.117615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bd13eee9-1ec1-443a-bbd5-77b604e79067 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:55.130209 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bd13eee9-1ec1-443a-bbd5-77b604e79067 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1531 microversion: 2.1 time: 0.235205 Oct 12 22:20:55.131185 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2832/5060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:54 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1531 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:55.134999 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-323ad500-706e-49f2-bccc-30ebfddd7e15 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170" status: 200 len: 345 microversion: 2.1 time: 0.114900 Oct 12 22:20:55.143164 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2229/5061] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:20:55 2022] GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170 => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:20:55.444836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-05e62ace-7709-4f1c-90aa-ee20243eb75a tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:55.445460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-05e62ace-7709-4f1c-90aa-ee20243eb75a tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] [instance: ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:55.452525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05e62ace-7709-4f1c-90aa-ee20243eb75a tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:55.453080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05e62ace-7709-4f1c-90aa-ee20243eb75a tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:55.453830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05e62ace-7709-4f1c-90aa-ee20243eb75a tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:55.454653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05e62ace-7709-4f1c-90aa-ee20243eb75a tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:55.455113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05e62ace-7709-4f1c-90aa-ee20243eb75a tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:55.455733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05e62ace-7709-4f1c-90aa-ee20243eb75a tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:55.466129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-54aa99bf-e4a6-4459-8716-678806e87d65 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:55.467112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-54aa99bf-e4a6-4459-8716-678806e87d65 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:55.474002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54aa99bf-e4a6-4459-8716-678806e87d65 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:55.474864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54aa99bf-e4a6-4459-8716-678806e87d65 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:55.476249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54aa99bf-e4a6-4459-8716-678806e87d65 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:55.477834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54aa99bf-e4a6-4459-8716-678806e87d65 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:55.479328 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-05e62ace-7709-4f1c-90aa-ee20243eb75a tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] HTTP exception thrown: Instance ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 could not be found. Oct 12 22:20:55.480542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54aa99bf-e4a6-4459-8716-678806e87d65 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:55.480980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54aa99bf-e4a6-4459-8716-678806e87d65 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-05e62ace-7709-4f1c-90aa-ee20243eb75a tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Request method failure captured: Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 HTTP/1.1 Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz29GT-_rBzuaJIwzhOFKldC8rb-PS93X3-2V60O7XjX78-yeHvlM1_-_Zvv-tQyxopuuSalnXEtbSqrJmfaZsdlGbB38MHDmEnRfoE0l-2Yf0GwI2YXJEmOfJrsALL9zlSry97fceSsAL0lzGijlVBtxMjrESY4ga8w0yMvzufEXYY Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.47 Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8dba055973d54ca39763c585e6be68f4 Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersAaction247Test-1598479723 Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8dba055973d54ca39763c585e6be68f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8dba055973d54ca39763c585e6be68f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8dba055973d54ca39763c585e6be68f4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8dba055973d54ca39763c585e6be68f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersAaction247Test-1598479723 Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8dba055973d54ca39763c585e6be68f4 Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersAaction247Test-1598479723 Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersAaction247Test-1598479723-project Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: e0007eb556ef4942879c769adb0fbbf8 Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersAaction247Test-1598479723-project Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 could not be found. Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1'} Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 could not be found. Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 could not be found. Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:55.483506 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:55.488311 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:55.488311 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:55.488311 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:55.488311 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:55.488311 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:55.488311 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:55.488311 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 could not be found. Oct 12 22:20:55.488311 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:55.489106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-05e62ace-7709-4f1c-90aa-ee20243eb75a tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] Returning 404 to user: Instance ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:55.491815 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-05e62ace-7709-4f1c-90aa-ee20243eb75a tempest-ServersAaction247Test-1598479723 tempest-ServersAaction247Test-1598479723-project] 10.222.0.16 "GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1" status: 404 len: 111 microversion: 2.47 time: 0.050518 Oct 12 22:20:55.493620 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2833/5062] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:55 2022] GET /compute/v2.1/servers/ef6ff0cf-ac82-40f5-af8d-c3d8c2f5ebc1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:20:55.840311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d3a260f4-adb0-4a82-8e84-d1e0b693577d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:55.841068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d3a260f4-adb0-4a82-8e84-d1e0b693577d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:55.850340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:55.856073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:55.858477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3a260f4-adb0-4a82-8e84-d1e0b693577d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:55.859208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3a260f4-adb0-4a82-8e84-d1e0b693577d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:55.859823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3a260f4-adb0-4a82-8e84-d1e0b693577d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:55.863191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3a260f4-adb0-4a82-8e84-d1e0b693577d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:55.863895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3a260f4-adb0-4a82-8e84-d1e0b693577d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:55.864725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3a260f4-adb0-4a82-8e84-d1e0b693577d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:56.145883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d3a260f4-adb0-4a82-8e84-d1e0b693577d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:56.161425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d3a260f4-adb0-4a82-8e84-d1e0b693577d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:56.163289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d3a260f4-adb0-4a82-8e84-d1e0b693577d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:56.168654 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d3a260f4-adb0-4a82-8e84-d1e0b693577d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 2963 microversion: 2.42 time: 0.331061 Oct 12 22:20:56.171591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-54aa99bf-e4a6-4459-8716-678806e87d65 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:56.172285 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2834/5063] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:55 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 2963 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:20:56.179475 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-54aa99bf-e4a6-4459-8716-678806e87d65 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1523 microversion: 2.1 time: 0.721457 Oct 12 22:20:56.190984 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2230/5064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:55 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1523 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:56.191092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-882565be-9793-47c2-900f-fa341994f209 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:56.191092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-882565be-9793-47c2-900f-fa341994f209 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:56.200754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c1f6d3b1-b58d-48ef-9f9d-db3c7d1560ca tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f51231b0790>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:56.222568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-882565be-9793-47c2-900f-fa341994f209 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:56.225639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-882565be-9793-47c2-900f-fa341994f209 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:56.227417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-882565be-9793-47c2-900f-fa341994f209 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:56.228504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-882565be-9793-47c2-900f-fa341994f209 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:56.229127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-882565be-9793-47c2-900f-fa341994f209 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:56.229770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-882565be-9793-47c2-900f-fa341994f209 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:56.269421 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c1f6d3b1-b58d-48ef-9f9d-db3c7d1560ca tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170" status: 200 len: 345 microversion: 2.1 time: 0.085461 Oct 12 22:20:56.270308 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2231/5065] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:20:56 2022] GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170 => generated 345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:20:56.277100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ce1eeac2-d64a-4e49-a59d-50fe365c1538 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:56.277719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ce1eeac2-d64a-4e49-a59d-50fe365c1538 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:56.297514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce1eeac2-d64a-4e49-a59d-50fe365c1538 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:56.298278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce1eeac2-d64a-4e49-a59d-50fe365c1538 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:56.299953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce1eeac2-d64a-4e49-a59d-50fe365c1538 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:56.303904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce1eeac2-d64a-4e49-a59d-50fe365c1538 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:56.304719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce1eeac2-d64a-4e49-a59d-50fe365c1538 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:56.305341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce1eeac2-d64a-4e49-a59d-50fe365c1538 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:56.313332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:56.372617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:20:56.455806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-882565be-9793-47c2-900f-fa341994f209 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:56.467031 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-882565be-9793-47c2-900f-fa341994f209 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.293045 Oct 12 22:20:56.468315 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2835/5066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:56 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:56.635854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ce1eeac2-d64a-4e49-a59d-50fe365c1538 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:56.645426 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ce1eeac2-d64a-4e49-a59d-50fe365c1538 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1526 microversion: 2.1 time: 0.373855 Oct 12 22:20:56.646714 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2232/5067] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:56 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1526 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:57.205445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cfbd042b-78df-49c4-afb0-6306ca8a7b88 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:57.206068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cfbd042b-78df-49c4-afb0-6306ca8a7b88 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:57.207993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-068e97e9-8c60-4413-ba92-9612b72b5057 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:57.208987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-068e97e9-8c60-4413-ba92-9612b72b5057 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:57.215572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-068e97e9-8c60-4413-ba92-9612b72b5057 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:57.216197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-068e97e9-8c60-4413-ba92-9612b72b5057 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:57.216761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-068e97e9-8c60-4413-ba92-9612b72b5057 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:57.217688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-068e97e9-8c60-4413-ba92-9612b72b5057 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:57.218244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-068e97e9-8c60-4413-ba92-9612b72b5057 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:57.219711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-068e97e9-8c60-4413-ba92-9612b72b5057 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:57.224624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfbd042b-78df-49c4-afb0-6306ca8a7b88 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:57.225124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfbd042b-78df-49c4-afb0-6306ca8a7b88 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:57.225572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfbd042b-78df-49c4-afb0-6306ca8a7b88 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:57.226286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfbd042b-78df-49c4-afb0-6306ca8a7b88 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:57.226745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfbd042b-78df-49c4-afb0-6306ca8a7b88 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:57.227176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfbd042b-78df-49c4-afb0-6306ca8a7b88 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:57.455315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-068e97e9-8c60-4413-ba92-9612b72b5057 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:57.468339 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-068e97e9-8c60-4413-ba92-9612b72b5057 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1523 microversion: 2.1 time: 0.264499 Oct 12 22:20:57.470341 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2233/5068] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:57 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:57.475291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b6f849a1-34cb-44c0-aadb-eb0f4c3e33c6 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f51231d0c10>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:57.547021 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-b6f849a1-34cb-44c0-aadb-eb0f4c3e33c6 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] HTTP exception thrown: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b6f849a1-34cb-44c0-aadb-eb0f4c3e33c6 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Request method failure captured: Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170 HTTP/1.1 Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz284kXtJ6u-1kLkJrRyDOlEBja18OLNS5JUInI6c62cOpFpLd7iWubCm8wXpwuLlrIZOQO016rqceiVca0rQ5fyzPmMe1s2bOjsILWK_OY8HEDfCc_DHNgE4IQ9qfq76Fxxnj1AgCL-hGOFqqYADnKa-5dtjcO7Cj6kvTt2b732CyU Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 5adc55d301bd48048e977641551f3dea Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-981114427 Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5adc55d301bd48048e977641551f3dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5adc55d301bd48048e977641551f3dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5adc55d301bd48048e977641551f3dea", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5adc55d301bd48048e977641551f3dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-VolumesSnapshotsTestJSON-981114427 Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 5adc55d301bd48048e977641551f3dea Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-981114427 Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-VolumesSnapshotsTestJSON-981114427-project Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: d3604ca5d15e4c69b7f6ce3b85a8ab3a Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-VolumesSnapshotsTestJSON-981114427-project Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: exception: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'de268212-8361-4aaf-9c31-12d2f6770170'} Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. (HTTP 404) (Request-ID: req-c3788880-6226-4457-a508-4fa32f611ab5) Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 22:20:57.558329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b6f849a1-34cb-44c0-aadb-eb0f4c3e33c6 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Returning 404 to user: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b6f849a1-34cb-44c0-aadb-eb0f4c3e33c6 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170" status: 404 len: 109 microversion: 2.1 time: 0.088431 Oct 12 22:20:57.562749 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2234/5069] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:20:57 2022] GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:20:57.571148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1c2b4b03-4a46-4dce-82b3-edf407b06da3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:57.571973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1c2b4b03-4a46-4dce-82b3-edf407b06da3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:57.590415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c2b4b03-4a46-4dce-82b3-edf407b06da3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:57.590733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c2b4b03-4a46-4dce-82b3-edf407b06da3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:57.591316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c2b4b03-4a46-4dce-82b3-edf407b06da3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:57.591910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c2b4b03-4a46-4dce-82b3-edf407b06da3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:57.592359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c2b4b03-4a46-4dce-82b3-edf407b06da3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:57.592781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c2b4b03-4a46-4dce-82b3-edf407b06da3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:57.844494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1c2b4b03-4a46-4dce-82b3-edf407b06da3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:57.854716 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1c2b4b03-4a46-4dce-82b3-edf407b06da3 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.292284 Oct 12 22:20:57.855328 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2235/5070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:57 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:57.867476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-78f3aef1-4106-400f-96dc-c5072e30089a tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f5123228550>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:57.897234 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-78f3aef1-4106-400f-96dc-c5072e30089a tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] HTTP exception thrown: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-78f3aef1-4106-400f-96dc-c5072e30089a tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Request method failure captured: Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170 HTTP/1.1 Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz284kXtJ6u-1kLkJrRyDOlEBja18OLNS5JUInI6c62cOpFpLd7iWubCm8wXpwuLlrIZOQO016rqceiVca0rQ5fyzPmMe1s2bOjsILWK_OY8HEDfCc_DHNgE4IQ9qfq76Fxxnj1AgCL-hGOFqqYADnKa-5dtjcO7Cj6kvTt2b732CyU Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 5adc55d301bd48048e977641551f3dea Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-981114427 Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5adc55d301bd48048e977641551f3dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5adc55d301bd48048e977641551f3dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5adc55d301bd48048e977641551f3dea", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5adc55d301bd48048e977641551f3dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-VolumesSnapshotsTestJSON-981114427 Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 5adc55d301bd48048e977641551f3dea Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-981114427 Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-VolumesSnapshotsTestJSON-981114427-project Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: d3604ca5d15e4c69b7f6ce3b85a8ab3a Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-VolumesSnapshotsTestJSON-981114427-project Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: exception: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'de268212-8361-4aaf-9c31-12d2f6770170'} Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. (HTTP 404) (Request-ID: req-214dfef3-fa02-4ce6-a514-1fa26579e2d7) Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 22:20:57.899666 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-78f3aef1-4106-400f-96dc-c5072e30089a tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Returning 404 to user: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-78f3aef1-4106-400f-96dc-c5072e30089a tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170" status: 404 len: 109 microversion: 2.1 time: 0.044744 Oct 12 22:20:57.904613 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2236/5071] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 22:20:57 2022] DELETE /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:20:57.909470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d7abd49d-2620-495d-bd20-28b9c583a017 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:57.909470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d7abd49d-2620-495d-bd20-28b9c583a017 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:57.931383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7abd49d-2620-495d-bd20-28b9c583a017 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:57.931813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7abd49d-2620-495d-bd20-28b9c583a017 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:57.936001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7abd49d-2620-495d-bd20-28b9c583a017 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:57.937998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7abd49d-2620-495d-bd20-28b9c583a017 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:57.938475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7abd49d-2620-495d-bd20-28b9c583a017 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:57.938914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7abd49d-2620-495d-bd20-28b9c583a017 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:57.955155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cfbd042b-78df-49c4-afb0-6306ca8a7b88 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:57.971271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cfbd042b-78df-49c4-afb0-6306ca8a7b88 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:57.972754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cfbd042b-78df-49c4-afb0-6306ca8a7b88 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:57.974052 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cfbd042b-78df-49c4-afb0-6306ca8a7b88 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 2963 microversion: 2.42 time: 0.776339 Oct 12 22:20:57.982953 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2836/5072] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:57 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 2963 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:20:58.010120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-11f5ff14-ae28-4a35-8bcc-475643beb9b5 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Calling method '.version_select at 0x7f5122ca6310>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:58.069457 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-11f5ff14-ae28-4a35-8bcc-475643beb9b5 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] HTTP exception thrown: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-11f5ff14-ae28-4a35-8bcc-475643beb9b5 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Request method failure captured: Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170 HTTP/1.1 Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz284kXtJ6u-1kLkJrRyDOlEBja18OLNS5JUInI6c62cOpFpLd7iWubCm8wXpwuLlrIZOQO016rqceiVca0rQ5fyzPmMe1s2bOjsILWK_OY8HEDfCc_DHNgE4IQ9qfq76Fxxnj1AgCL-hGOFqqYADnKa-5dtjcO7Cj6kvTt2b732CyU Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 5adc55d301bd48048e977641551f3dea Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-981114427 Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5adc55d301bd48048e977641551f3dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5adc55d301bd48048e977641551f3dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5adc55d301bd48048e977641551f3dea", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5adc55d301bd48048e977641551f3dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-VolumesSnapshotsTestJSON-981114427 Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 5adc55d301bd48048e977641551f3dea Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-981114427 Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-VolumesSnapshotsTestJSON-981114427-project Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: d3604ca5d15e4c69b7f6ce3b85a8ab3a Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-VolumesSnapshotsTestJSON-981114427-project Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: exception: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'de268212-8361-4aaf-9c31-12d2f6770170'} Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. (HTTP 404) (Request-ID: req-8472fce5-37a0-4cab-a740-e759d9fb4a61) Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 22:20:58.072027 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. Oct 12 22:20:58.075997 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:20:58.079100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-11f5ff14-ae28-4a35-8bcc-475643beb9b5 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] Returning 404 to user: Volume de268212-8361-4aaf-9c31-12d2f6770170 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:20:58.079100 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-11f5ff14-ae28-4a35-8bcc-475643beb9b5 tempest-VolumesSnapshotsTestJSON-981114427 tempest-VolumesSnapshotsTestJSON-981114427-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170" status: 404 len: 109 microversion: 2.1 time: 0.092014 Oct 12 22:20:58.080061 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2837/5073] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:20:57 2022] GET /compute/v2.1/os-volumes/de268212-8361-4aaf-9c31-12d2f6770170 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:20:58.233368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d7abd49d-2620-495d-bd20-28b9c583a017 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:58.245839 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d7abd49d-2620-495d-bd20-28b9c583a017 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1526 microversion: 2.1 time: 0.342840 Oct 12 22:20:58.247343 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2237/5074] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:57 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1526 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:58.503802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9c390c87-73a0-4fc2-a477-5fee8328a391 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:58.504409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9c390c87-73a0-4fc2-a477-5fee8328a391 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:58.530838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c390c87-73a0-4fc2-a477-5fee8328a391 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:58.532120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c390c87-73a0-4fc2-a477-5fee8328a391 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:58.534205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c390c87-73a0-4fc2-a477-5fee8328a391 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:58.537061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c390c87-73a0-4fc2-a477-5fee8328a391 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:58.537716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c390c87-73a0-4fc2-a477-5fee8328a391 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:58.538315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c390c87-73a0-4fc2-a477-5fee8328a391 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:58.878276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b316b743-a60e-4701-bb26-322e2c1b4208 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:58.878891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b316b743-a60e-4701-bb26-322e2c1b4208 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:58.897856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b316b743-a60e-4701-bb26-322e2c1b4208 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:58.899602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b316b743-a60e-4701-bb26-322e2c1b4208 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:58.901168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b316b743-a60e-4701-bb26-322e2c1b4208 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:58.902012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b316b743-a60e-4701-bb26-322e2c1b4208 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:58.905518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b316b743-a60e-4701-bb26-322e2c1b4208 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:58.906701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b316b743-a60e-4701-bb26-322e2c1b4208 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:58.929257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9c390c87-73a0-4fc2-a477-5fee8328a391 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:58.938091 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9c390c87-73a0-4fc2-a477-5fee8328a391 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1523 microversion: 2.1 time: 0.442035 Oct 12 22:20:58.960691 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2838/5075] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:58 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1523 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:20:59.006552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b1aa61ce-4566-4003-8841-c109357dd681 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:59.007805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b1aa61ce-4566-4003-8841-c109357dd681 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:59.025222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1aa61ce-4566-4003-8841-c109357dd681 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:59.031267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1aa61ce-4566-4003-8841-c109357dd681 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:59.032962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1aa61ce-4566-4003-8841-c109357dd681 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:59.033951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1aa61ce-4566-4003-8841-c109357dd681 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:59.034631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1aa61ce-4566-4003-8841-c109357dd681 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:59.035301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1aa61ce-4566-4003-8841-c109357dd681 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:59.207830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b316b743-a60e-4701-bb26-322e2c1b4208 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:59.216515 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b316b743-a60e-4701-bb26-322e2c1b4208 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.342424 Oct 12 22:20:59.222128 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2238/5076] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:58 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:59.272114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fd179ae1-1ce5-4bf2-916f-6775dddf7d0a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:59.273483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fd179ae1-1ce5-4bf2-916f-6775dddf7d0a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:20:59.284421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd179ae1-1ce5-4bf2-916f-6775dddf7d0a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:59.285953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd179ae1-1ce5-4bf2-916f-6775dddf7d0a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:59.286565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd179ae1-1ce5-4bf2-916f-6775dddf7d0a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:59.287708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd179ae1-1ce5-4bf2-916f-6775dddf7d0a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:59.289477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd179ae1-1ce5-4bf2-916f-6775dddf7d0a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:59.290088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd179ae1-1ce5-4bf2-916f-6775dddf7d0a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:59.567338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b1aa61ce-4566-4003-8841-c109357dd681 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:59.584244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b1aa61ce-4566-4003-8841-c109357dd681 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:59.593206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b1aa61ce-4566-4003-8841-c109357dd681 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:59.599429 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b1aa61ce-4566-4003-8841-c109357dd681 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 2963 microversion: 2.42 time: 0.595488 Oct 12 22:20:59.600064 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2839/5077] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:20:59 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 2963 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:20:59.736243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fd179ae1-1ce5-4bf2-916f-6775dddf7d0a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:20:59.747782 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fd179ae1-1ce5-4bf2-916f-6775dddf7d0a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1526 microversion: 2.1 time: 0.476820 Oct 12 22:20:59.748422 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2239/5078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:59 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1526 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:20:59.975607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-85134e10-7ec0-4572-a6c5-fc681827d767 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:59.976531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-85134e10-7ec0-4572-a6c5-fc681827d767 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:00.006451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85134e10-7ec0-4572-a6c5-fc681827d767 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:00.007812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85134e10-7ec0-4572-a6c5-fc681827d767 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:00.009813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85134e10-7ec0-4572-a6c5-fc681827d767 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:00.010754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85134e10-7ec0-4572-a6c5-fc681827d767 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:00.011795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85134e10-7ec0-4572-a6c5-fc681827d767 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:00.014241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85134e10-7ec0-4572-a6c5-fc681827d767 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:00.245215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a28f5d7e-27df-4822-82aa-c8fc5d8e7317 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:00.245897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a28f5d7e-27df-4822-82aa-c8fc5d8e7317 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:00.269430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a28f5d7e-27df-4822-82aa-c8fc5d8e7317 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:00.269959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a28f5d7e-27df-4822-82aa-c8fc5d8e7317 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:00.270436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a28f5d7e-27df-4822-82aa-c8fc5d8e7317 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:00.271212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a28f5d7e-27df-4822-82aa-c8fc5d8e7317 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:00.279305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a28f5d7e-27df-4822-82aa-c8fc5d8e7317 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:00.280656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a28f5d7e-27df-4822-82aa-c8fc5d8e7317 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:00.367871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-85134e10-7ec0-4572-a6c5-fc681827d767 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:00.382960 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-85134e10-7ec0-4572-a6c5-fc681827d767 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1503 microversion: 2.1 time: 0.414748 Oct 12 22:21:00.384131 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2840/5079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:20:59 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1503 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:00.409175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6cda4c74-c6be-4a2c-9d34-c1d3fcb8d827 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43eecb7e-e193-41cb-bff1-61962251a0fd"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:00.412012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6cda4c74-c6be-4a2c-9d34-c1d3fcb8d827 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:00.432988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cda4c74-c6be-4a2c-9d34-c1d3fcb8d827 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:00.433772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cda4c74-c6be-4a2c-9d34-c1d3fcb8d827 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:00.434418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cda4c74-c6be-4a2c-9d34-c1d3fcb8d827 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:00.435502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cda4c74-c6be-4a2c-9d34-c1d3fcb8d827 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:00.436307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cda4c74-c6be-4a2c-9d34-c1d3fcb8d827 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:00.437500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cda4c74-c6be-4a2c-9d34-c1d3fcb8d827 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:00.476073 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-6cda4c74-c6be-4a2c-9d34-c1d3fcb8d827 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] HTTP exception thrown: Cannot 'attach_volume' instance 7013657e-c4d1-4af9-b593-b891d2d1c66b while it is in vm_state rescued Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6cda4c74-c6be-4a2c-9d34-c1d3fcb8d827 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Request method failure captured: Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b/os-volume_attachments HTTP/1.1 Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 74 Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz1yYv3BEuyn16aX9rFnQkuXp35mHqXE7bVOWKfvxNZXNT7qw6co-FDMauTgJfMPQCxmiEKAu0kzyjnis87qTpfUYp96yN_F6sfmIZnSLJLUbYy9WREcLUGhzXNPjj1UORIJx3lHLMBoOzDKf1JzqCDKyG4PBpXcEQzC9GdyMUjXkpQ Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0a0c4d9f435a4c009bd0b5eb2618829b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: afec4a3808b84463900b744ecd9352b6 Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: {"volumeAttachment": {"volumeId": "43eecb7e-e193-41cb-bff1-61962251a0fd"}} Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: exception: Cannot 'attach_volume' instance 7013657e-c4d1-4af9-b593-b891d2d1c66b while it is in vm_state rescued Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'server_id': '7013657e-c4d1-4af9-b593-b891d2d1c66b', 'body': {'volumeAttachment': {'volumeId': '43eecb7e-e193-41cb-bff1-61962251a0fd'}}} Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7013657e-c4d1-4af9-b593-b891d2d1c66b in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 12 22:21:00.478242 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 22:21:00.483144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:21:00.483144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:21:00.483144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7013657e-c4d1-4af9-b593-b891d2d1c66b while it is in vm_state rescued Oct 12 22:21:00.483144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:00.483144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:21:00.483144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:00.483144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:21:00.483144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:21:00.483144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:21:00.483144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:21:00.483144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:21:00.483144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7013657e-c4d1-4af9-b593-b891d2d1c66b while it is in vm_state rescued Oct 12 22:21:00.483144 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:00.483144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6cda4c74-c6be-4a2c-9d34-c1d3fcb8d827 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Returning 409 to user: Cannot 'attach_volume' instance 7013657e-c4d1-4af9-b593-b891d2d1c66b while it is in vm_state rescued {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:21:00.485917 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6cda4c74-c6be-4a2c-9d34-c1d3fcb8d827 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "POST /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.079503 Oct 12 22:21:00.489712 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2841/5080] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 22:21:00 2022] POST /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b/os-volume_attachments => generated 152 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 12 22:21:00.497668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e8e7dbf2-2c19-4667-bf20-f556bd5f70af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:00.498599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e8e7dbf2-2c19-4667-bf20-f556bd5f70af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:00.507871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8e7dbf2-2c19-4667-bf20-f556bd5f70af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:00.509055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8e7dbf2-2c19-4667-bf20-f556bd5f70af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:00.510936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8e7dbf2-2c19-4667-bf20-f556bd5f70af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:00.513908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8e7dbf2-2c19-4667-bf20-f556bd5f70af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:00.514811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8e7dbf2-2c19-4667-bf20-f556bd5f70af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:00.516657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8e7dbf2-2c19-4667-bf20-f556bd5f70af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:00.643180 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e8e7dbf2-2c19-4667-bf20-f556bd5f70af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "POST /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b/action" status: 202 len: 0 microversion: 2.1 time: 0.151006 Oct 12 22:21:00.643999 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2842/5081] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:21:00 2022] POST /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:21:00.652535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9652385e-98f5-4167-b9e3-b0d662755562 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:00.653735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9652385e-98f5-4167-b9e3-b0d662755562 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:00.665445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9652385e-98f5-4167-b9e3-b0d662755562 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:00.666260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9652385e-98f5-4167-b9e3-b0d662755562 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:00.667045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9652385e-98f5-4167-b9e3-b0d662755562 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:00.668319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9652385e-98f5-4167-b9e3-b0d662755562 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:00.669701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9652385e-98f5-4167-b9e3-b0d662755562 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:00.670906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9652385e-98f5-4167-b9e3-b0d662755562 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:01.099143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9652385e-98f5-4167-b9e3-b0d662755562 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:01.127505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9652385e-98f5-4167-b9e3-b0d662755562 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:01.127950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a28f5d7e-27df-4822-82aa-c8fc5d8e7317 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:01.133129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9652385e-98f5-4167-b9e3-b0d662755562 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:01.136948 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9652385e-98f5-4167-b9e3-b0d662755562 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 2942 microversion: 2.42 time: 0.491351 Oct 12 22:21:01.139198 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2843/5082] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:00 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 2942 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:01.141792 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a28f5d7e-27df-4822-82aa-c8fc5d8e7317 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.900416 Oct 12 22:21:01.160523 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2240/5083] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:00 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:21:01.181711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2c1a9da2-1402-40e3-ac20-f6d493a64475 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:01.184119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2c1a9da2-1402-40e3-ac20-f6d493a64475 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:01.185901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b3dd900a-b12c-4486-80ba-596d0fa33bbe tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:01.191515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b3dd900a-b12c-4486-80ba-596d0fa33bbe tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:01.198504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c1a9da2-1402-40e3-ac20-f6d493a64475 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:01.201405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c1a9da2-1402-40e3-ac20-f6d493a64475 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:01.203230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c1a9da2-1402-40e3-ac20-f6d493a64475 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:01.205281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c1a9da2-1402-40e3-ac20-f6d493a64475 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:01.206439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c1a9da2-1402-40e3-ac20-f6d493a64475 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:01.206904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c1a9da2-1402-40e3-ac20-f6d493a64475 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:01.211641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3dd900a-b12c-4486-80ba-596d0fa33bbe tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:01.214942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3dd900a-b12c-4486-80ba-596d0fa33bbe tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:01.217617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3dd900a-b12c-4486-80ba-596d0fa33bbe tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:01.219690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3dd900a-b12c-4486-80ba-596d0fa33bbe tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:01.221794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3dd900a-b12c-4486-80ba-596d0fa33bbe tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:01.224248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3dd900a-b12c-4486-80ba-596d0fa33bbe tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:01.250299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:01.806565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2c1a9da2-1402-40e3-ac20-f6d493a64475 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:01.816872 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2c1a9da2-1402-40e3-ac20-f6d493a64475 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1511 microversion: 2.1 time: 0.653768 Oct 12 22:21:01.820569 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2844/5084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:01 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1511 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:01.830395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-67c2c46d-8885-4ed7-b22f-71d86b640317 req-8f8407c3-7696-47fa-9c66-58018d08b5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "name": "network-vif-unplugged", "status": "completed", "tag": "f460a2f6-34cf-42a8-85f6-522777a2dd9f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:01.850933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-67c2c46d-8885-4ed7-b22f-71d86b640317 req-8f8407c3-7696-47fa-9c66-58018d08b5b7 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:01.852191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-67c2c46d-8885-4ed7-b22f-71d86b640317 req-8f8407c3-7696-47fa-9c66-58018d08b5b7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:01.852858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-67c2c46d-8885-4ed7-b22f-71d86b640317 req-8f8407c3-7696-47fa-9c66-58018d08b5b7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:01.870303 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-67c2c46d-8885-4ed7-b22f-71d86b640317 req-8f8407c3-7696-47fa-9c66-58018d08b5b7 service nova] Creating event network-vif-unplugged:f460a2f6-34cf-42a8-85f6-522777a2dd9f for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:21:01.879840 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-67c2c46d-8885-4ed7-b22f-71d86b640317 req-8f8407c3-7696-47fa-9c66-58018d08b5b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057400 Oct 12 22:21:01.881370 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2845/5085] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:02.179984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c12fb3ab-ba0a-4762-b582-a5d02a319e4a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:02.180932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c12fb3ab-ba0a-4762-b582-a5d02a319e4a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:02.197246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c12fb3ab-ba0a-4762-b582-a5d02a319e4a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:02.197810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c12fb3ab-ba0a-4762-b582-a5d02a319e4a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:02.198330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c12fb3ab-ba0a-4762-b582-a5d02a319e4a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:02.199145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c12fb3ab-ba0a-4762-b582-a5d02a319e4a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:02.199647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c12fb3ab-ba0a-4762-b582-a5d02a319e4a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:02.200223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c12fb3ab-ba0a-4762-b582-a5d02a319e4a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:02.485857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b3dd900a-b12c-4486-80ba-596d0fa33bbe tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:02.497541 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b3dd900a-b12c-4486-80ba-596d0fa33bbe tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1526 microversion: 2.1 time: 1.335204 Oct 12 22:21:02.500934 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2241/5086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:01 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1526 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:02.512849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bc826451-c4d3-443b-b0d1-f421444b4077 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:02.514785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bc826451-c4d3-443b-b0d1-f421444b4077 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:02.530913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c12fb3ab-ba0a-4762-b582-a5d02a319e4a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:02.532711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc826451-c4d3-443b-b0d1-f421444b4077 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:02.534690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc826451-c4d3-443b-b0d1-f421444b4077 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:02.536708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc826451-c4d3-443b-b0d1-f421444b4077 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:02.539457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc826451-c4d3-443b-b0d1-f421444b4077 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:02.541777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc826451-c4d3-443b-b0d1-f421444b4077 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:02.542514 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c12fb3ab-ba0a-4762-b582-a5d02a319e4a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 0.371048 Oct 12 22:21:02.543071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc826451-c4d3-443b-b0d1-f421444b4077 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:02.545102 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2846/5087] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:02 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:02.870009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-15e33125-ee29-486c-822c-89eb52b7d750 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:02.870933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-15e33125-ee29-486c-822c-89eb52b7d750 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:02.889855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15e33125-ee29-486c-822c-89eb52b7d750 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:02.891460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15e33125-ee29-486c-822c-89eb52b7d750 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:02.892099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15e33125-ee29-486c-822c-89eb52b7d750 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:02.893025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15e33125-ee29-486c-822c-89eb52b7d750 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:02.894179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15e33125-ee29-486c-822c-89eb52b7d750 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:02.894800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15e33125-ee29-486c-822c-89eb52b7d750 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:03.205653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-15e33125-ee29-486c-822c-89eb52b7d750 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:03.221852 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-15e33125-ee29-486c-822c-89eb52b7d750 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1511 microversion: 2.1 time: 0.373720 Oct 12 22:21:03.226263 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2847/5088] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:02 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1511 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:03.495198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bc826451-c4d3-443b-b0d1-f421444b4077 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:03.514735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bc826451-c4d3-443b-b0d1-f421444b4077 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:03.521920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bc826451-c4d3-443b-b0d1-f421444b4077 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:03.528741 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bc826451-c4d3-443b-b0d1-f421444b4077 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 2942 microversion: 2.42 time: 1.026581 Oct 12 22:21:03.529470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-75523b36-44d2-412c-b155-6733c449bc90 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:03.530095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-75523b36-44d2-412c-b155-6733c449bc90 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:03.541435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75523b36-44d2-412c-b155-6733c449bc90 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:03.543815 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2242/5089] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:02 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 2942 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:03.547022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75523b36-44d2-412c-b155-6733c449bc90 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:03.548144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75523b36-44d2-412c-b155-6733c449bc90 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:03.552432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75523b36-44d2-412c-b155-6733c449bc90 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:03.554608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75523b36-44d2-412c-b155-6733c449bc90 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:03.555672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-75523b36-44d2-412c-b155-6733c449bc90 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:03.569237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ec480747-b0d2-48c3-be78-d8011a35661a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:03.570108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ec480747-b0d2-48c3-be78-d8011a35661a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:03.581817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec480747-b0d2-48c3-be78-d8011a35661a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:03.583535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec480747-b0d2-48c3-be78-d8011a35661a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:03.584480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec480747-b0d2-48c3-be78-d8011a35661a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:03.586002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec480747-b0d2-48c3-be78-d8011a35661a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:03.587798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec480747-b0d2-48c3-be78-d8011a35661a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:03.594570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec480747-b0d2-48c3-be78-d8011a35661a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:04.927556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-75523b36-44d2-412c-b155-6733c449bc90 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:04.968379 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-75523b36-44d2-412c-b155-6733c449bc90 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1526 microversion: 2.1 time: 1.444165 Oct 12 22:21:04.977006 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2848/5090] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:03 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1526 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:21:04.995352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e53f9eaf-5910-4572-b4bc-9d8cad7bea7b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:04.996876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e53f9eaf-5910-4572-b4bc-9d8cad7bea7b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:05.038991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e53f9eaf-5910-4572-b4bc-9d8cad7bea7b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:05.048893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e53f9eaf-5910-4572-b4bc-9d8cad7bea7b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:05.049929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e53f9eaf-5910-4572-b4bc-9d8cad7bea7b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:05.053713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e53f9eaf-5910-4572-b4bc-9d8cad7bea7b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:05.057095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e53f9eaf-5910-4572-b4bc-9d8cad7bea7b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:05.062898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e53f9eaf-5910-4572-b4bc-9d8cad7bea7b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:05.411210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ec480747-b0d2-48c3-be78-d8011a35661a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:05.428070 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ec480747-b0d2-48c3-be78-d8011a35661a tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1524 microversion: 2.1 time: 1.857074 Oct 12 22:21:05.434145 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2243/5091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:03 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1524 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:05.451861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-5590964e-3446-4f2b-8ad3-bf4b54269fb7 req-7c290e4d-4b91-4239-abf3-5fefe61640f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "name": "network-vif-unplugged", "status": "completed", "tag": "a21af4ca-546d-4eb8-a73d-42ffccc0349b"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:05.477528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5590964e-3446-4f2b-8ad3-bf4b54269fb7 req-7c290e4d-4b91-4239-abf3-5fefe61640f5 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:05.478014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5590964e-3446-4f2b-8ad3-bf4b54269fb7 req-7c290e4d-4b91-4239-abf3-5fefe61640f5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:05.480827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5590964e-3446-4f2b-8ad3-bf4b54269fb7 req-7c290e4d-4b91-4239-abf3-5fefe61640f5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:05.508851 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-5590964e-3446-4f2b-8ad3-bf4b54269fb7 req-7c290e4d-4b91-4239-abf3-5fefe61640f5 service nova] Creating event network-vif-unplugged:a21af4ca-546d-4eb8-a73d-42ffccc0349b for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:21:05.526052 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-5590964e-3446-4f2b-8ad3-bf4b54269fb7 req-7c290e4d-4b91-4239-abf3-5fefe61640f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090144 Oct 12 22:21:05.527300 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2244/5092] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:05.536016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9488ae69-b076-411b-82ff-6600bbc4fbfb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:05.538180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9488ae69-b076-411b-82ff-6600bbc4fbfb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:05.554643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9488ae69-b076-411b-82ff-6600bbc4fbfb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:05.557226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9488ae69-b076-411b-82ff-6600bbc4fbfb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:05.560931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9488ae69-b076-411b-82ff-6600bbc4fbfb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:05.561866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9488ae69-b076-411b-82ff-6600bbc4fbfb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:05.562747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9488ae69-b076-411b-82ff-6600bbc4fbfb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:05.563662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9488ae69-b076-411b-82ff-6600bbc4fbfb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:06.057062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e53f9eaf-5910-4572-b4bc-9d8cad7bea7b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:06.074979 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e53f9eaf-5910-4572-b4bc-9d8cad7bea7b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1511 microversion: 2.1 time: 1.090251 Oct 12 22:21:06.096206 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2849/5093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:04 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1511 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:06.134779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-dc94b483-506f-484c-b36f-c99bd4aef492 req-e77635b1-5b16-452c-ba56-5cb7deecc095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "name": "network-vif-deleted", "tag": "410e58b4-a020-44fa-a570-283cadbd980e"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:06.181285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-dc94b483-506f-484c-b36f-c99bd4aef492 req-e77635b1-5b16-452c-ba56-5cb7deecc095 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:06.181786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-dc94b483-506f-484c-b36f-c99bd4aef492 req-e77635b1-5b16-452c-ba56-5cb7deecc095 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:06.182226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-dc94b483-506f-484c-b36f-c99bd4aef492 req-e77635b1-5b16-452c-ba56-5cb7deecc095 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:06.228527 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-dc94b483-506f-484c-b36f-c99bd4aef492 req-e77635b1-5b16-452c-ba56-5cb7deecc095 service nova] Creating event network-vif-deleted:410e58b4-a020-44fa-a570-283cadbd980e for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:21:06.265600 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-dc94b483-506f-484c-b36f-c99bd4aef492 req-e77635b1-5b16-452c-ba56-5cb7deecc095 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163994 Oct 12 22:21:06.266258 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2850/5094] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:06.278972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7f866156-2b4d-4655-882b-d65d33a249c2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:06.279774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7f866156-2b4d-4655-882b-d65d33a249c2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:06.316898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f866156-2b4d-4655-882b-d65d33a249c2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:06.318846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f866156-2b4d-4655-882b-d65d33a249c2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:06.320863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f866156-2b4d-4655-882b-d65d33a249c2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:06.321701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f866156-2b4d-4655-882b-d65d33a249c2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:06.322179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f866156-2b4d-4655-882b-d65d33a249c2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:06.322619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f866156-2b4d-4655-882b-d65d33a249c2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:06.792954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7f866156-2b4d-4655-882b-d65d33a249c2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:06.804661 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7f866156-2b4d-4655-882b-d65d33a249c2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1526 microversion: 2.1 time: 0.529971 Oct 12 22:21:06.806419 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2851/5095] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:06 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1526 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:06.821943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-99a39d70-302b-484e-a593-dc88bd8dd348 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:06.823645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-99a39d70-302b-484e-a593-dc88bd8dd348 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:06.844132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99a39d70-302b-484e-a593-dc88bd8dd348 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:06.845479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99a39d70-302b-484e-a593-dc88bd8dd348 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:06.849724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99a39d70-302b-484e-a593-dc88bd8dd348 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:06.851900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99a39d70-302b-484e-a593-dc88bd8dd348 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:06.853440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99a39d70-302b-484e-a593-dc88bd8dd348 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:06.853892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99a39d70-302b-484e-a593-dc88bd8dd348 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:07.204003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9488ae69-b076-411b-82ff-6600bbc4fbfb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:07.216327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9488ae69-b076-411b-82ff-6600bbc4fbfb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:07.219396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9488ae69-b076-411b-82ff-6600bbc4fbfb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:07.221478 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9488ae69-b076-411b-82ff-6600bbc4fbfb tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 2874 microversion: 2.42 time: 1.692910 Oct 12 22:21:07.222439 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2245/5096] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:05 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 2874 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:07.266627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-04ff6e77-e4f1-43c1-837e-e043f87259a0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:07.268468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-04ff6e77-e4f1-43c1-837e-e043f87259a0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:07.277035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:07.278821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04ff6e77-e4f1-43c1-837e-e043f87259a0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:07.279729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04ff6e77-e4f1-43c1-837e-e043f87259a0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:07.281656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04ff6e77-e4f1-43c1-837e-e043f87259a0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:07.283152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04ff6e77-e4f1-43c1-837e-e043f87259a0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:07.284756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04ff6e77-e4f1-43c1-837e-e043f87259a0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:07.285393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04ff6e77-e4f1-43c1-837e-e043f87259a0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:07.506017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-99a39d70-302b-484e-a593-dc88bd8dd348 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:07.547964 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-99a39d70-302b-484e-a593-dc88bd8dd348 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1504 microversion: 2.1 time: 0.735008 Oct 12 22:21:07.553944 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2852/5097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:06 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1504 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:07.589712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1775f667-f0d7-479c-99d0-bfd9465be330 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Action: 'create', calling method: .version_select at 0x7f5122c21c10>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1418945924", "description": "tempest-description-1597933971"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:08.648987 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1775f667-f0d7-479c-99d0-bfd9465be330 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 1.071596 Oct 12 22:21:08.649947 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2853/5098] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 12 22:21:07 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:08.655410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-95c94fd7-886c-4829-a194-33871962e13e req-cc550b53-4241-476b-9ad9-8040af1a1715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "name": "network-vif-unplugged", "status": "completed", "tag": "f6a6b535-1aed-4471-b5a4-a99246939f71"}, {"server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "name": "network-vif-unplugged", "status": "completed", "tag": "0fdc0365-5474-47b8-9674-e807e2942529"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:08.701512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-95c94fd7-886c-4829-a194-33871962e13e req-cc550b53-4241-476b-9ad9-8040af1a1715 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:08.702021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-95c94fd7-886c-4829-a194-33871962e13e req-cc550b53-4241-476b-9ad9-8040af1a1715 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:08.702532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-95c94fd7-886c-4829-a194-33871962e13e req-cc550b53-4241-476b-9ad9-8040af1a1715 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:08.752018 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-95c94fd7-886c-4829-a194-33871962e13e req-cc550b53-4241-476b-9ad9-8040af1a1715 service nova] Creating event network-vif-unplugged:f6a6b535-1aed-4471-b5a4-a99246939f71 for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:21:08.752512 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-95c94fd7-886c-4829-a194-33871962e13e req-cc550b53-4241-476b-9ad9-8040af1a1715 service nova] Creating event network-vif-unplugged:0fdc0365-5474-47b8-9674-e807e2942529 for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:21:08.770772 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-95c94fd7-886c-4829-a194-33871962e13e req-cc550b53-4241-476b-9ad9-8040af1a1715 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.119471 Oct 12 22:21:08.771758 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2854/5099] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:08.785417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d6392db4-0932-46d9-a714-47a4ae6c6458 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:08.788135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d6392db4-0932-46d9-a714-47a4ae6c6458 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:08.805326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6392db4-0932-46d9-a714-47a4ae6c6458 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:08.805833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6392db4-0932-46d9-a714-47a4ae6c6458 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:08.806278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6392db4-0932-46d9-a714-47a4ae6c6458 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:08.806997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6392db4-0932-46d9-a714-47a4ae6c6458 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:08.810899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6392db4-0932-46d9-a714-47a4ae6c6458 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:08.818382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6392db4-0932-46d9-a714-47a4ae6c6458 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:09.644572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d6392db4-0932-46d9-a714-47a4ae6c6458 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:09.662955 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d6392db4-0932-46d9-a714-47a4ae6c6458 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1526 microversion: 2.1 time: 0.889920 Oct 12 22:21:09.664243 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2855/5100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:08 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1526 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:09.680605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-23063510-c988-449b-a2c4-d1c22eec8fdc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:09.681311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-23063510-c988-449b-a2c4-d1c22eec8fdc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:09.697966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23063510-c988-449b-a2c4-d1c22eec8fdc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:09.702130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23063510-c988-449b-a2c4-d1c22eec8fdc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:09.702695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23063510-c988-449b-a2c4-d1c22eec8fdc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:09.703855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23063510-c988-449b-a2c4-d1c22eec8fdc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:09.704495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23063510-c988-449b-a2c4-d1c22eec8fdc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:09.706317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23063510-c988-449b-a2c4-d1c22eec8fdc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:10.404883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-04ff6e77-e4f1-43c1-837e-e043f87259a0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:10.413593 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-04ff6e77-e4f1-43c1-837e-e043f87259a0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1517 microversion: 2.1 time: 3.174650 Oct 12 22:21:10.427568 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2246/5101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:07 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1517 bytes in 3189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:10.435459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9feb0d48-7806-4c59-914d-d5fa9570f968 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1418945924"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:10.436910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9feb0d48-7806-4c59-914d-d5fa9570f968 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:10.453754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9feb0d48-7806-4c59-914d-d5fa9570f968 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:10.457915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9feb0d48-7806-4c59-914d-d5fa9570f968 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:10.458803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9feb0d48-7806-4c59-914d-d5fa9570f968 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:10.461691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9feb0d48-7806-4c59-914d-d5fa9570f968 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:10.466054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9feb0d48-7806-4c59-914d-d5fa9570f968 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:10.466707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9feb0d48-7806-4c59-914d-d5fa9570f968 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:10.579364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-23063510-c988-449b-a2c4-d1c22eec8fdc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:10.609318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-23063510-c988-449b-a2c4-d1c22eec8fdc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:10.623117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-23063510-c988-449b-a2c4-d1c22eec8fdc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:10.627645 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-23063510-c988-449b-a2c4-d1c22eec8fdc tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 2760 microversion: 2.42 time: 0.960955 Oct 12 22:21:10.637561 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2856/5102] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:09 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 2760 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:10.690285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-08bab358-c465-4bb7-bdcb-3f0c6c8309e7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:10.690909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-08bab358-c465-4bb7-bdcb-3f0c6c8309e7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:10.697872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08bab358-c465-4bb7-bdcb-3f0c6c8309e7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:10.707604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08bab358-c465-4bb7-bdcb-3f0c6c8309e7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:10.711982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08bab358-c465-4bb7-bdcb-3f0c6c8309e7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:10.715052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08bab358-c465-4bb7-bdcb-3f0c6c8309e7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:10.715568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08bab358-c465-4bb7-bdcb-3f0c6c8309e7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:10.716007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08bab358-c465-4bb7-bdcb-3f0c6c8309e7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:11.126612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-08bab358-c465-4bb7-bdcb-3f0c6c8309e7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:11.135707 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-08bab358-c465-4bb7-bdcb-3f0c6c8309e7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1526 microversion: 2.1 time: 0.449193 Oct 12 22:21:11.136316 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2857/5103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:10 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1526 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:11.161396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-6f553707-2655-4c99-a6b7-53eac2502e28 req-2ef7ccf2-4ba7-4720-ada0-e97c34e98423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "name": "network-vif-deleted", "tag": "f460a2f6-34cf-42a8-85f6-522777a2dd9f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:11.183771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6f553707-2655-4c99-a6b7-53eac2502e28 req-2ef7ccf2-4ba7-4720-ada0-e97c34e98423 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:11.187063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6f553707-2655-4c99-a6b7-53eac2502e28 req-2ef7ccf2-4ba7-4720-ada0-e97c34e98423 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:11.193099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6f553707-2655-4c99-a6b7-53eac2502e28 req-2ef7ccf2-4ba7-4720-ada0-e97c34e98423 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:11.224423 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6f553707-2655-4c99-a6b7-53eac2502e28 req-2ef7ccf2-4ba7-4720-ada0-e97c34e98423 service nova] Creating event network-vif-deleted:f460a2f6-34cf-42a8-85f6-522777a2dd9f for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:21:11.239479 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-6f553707-2655-4c99-a6b7-53eac2502e28 req-2ef7ccf2-4ba7-4720-ada0-e97c34e98423 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094033 Oct 12 22:21:11.241511 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2858/5104] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:11.623390 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.network.security_group_api [None req-9feb0d48-7806-4c59-914d-d5fa9570f968 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Adding security group f9458e64-d80e-4e7e-96d7-9e8165b73c47 to port 6ff18597-4249-41ef-84df-7032cece1756 Oct 12 22:21:11.670885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-497835a8-e888-44bd-a43a-a78fa135b47b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:11.672412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-497835a8-e888-44bd-a43a-a78fa135b47b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:11.709272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-497835a8-e888-44bd-a43a-a78fa135b47b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:11.711428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-497835a8-e888-44bd-a43a-a78fa135b47b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:11.713643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-497835a8-e888-44bd-a43a-a78fa135b47b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:11.722154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-497835a8-e888-44bd-a43a-a78fa135b47b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:11.724844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-497835a8-e888-44bd-a43a-a78fa135b47b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:11.726885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-497835a8-e888-44bd-a43a-a78fa135b47b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:12.284874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-497835a8-e888-44bd-a43a-a78fa135b47b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:12.298700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-497835a8-e888-44bd-a43a-a78fa135b47b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:12.301222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-497835a8-e888-44bd-a43a-a78fa135b47b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:12.302871 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-497835a8-e888-44bd-a43a-a78fa135b47b tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 2555 microversion: 2.42 time: 0.638124 Oct 12 22:21:12.354061 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2859/5105] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:11 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 2555 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:12.360415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bc3804a9-10d2-4cbb-ad6f-040a5235e588 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:12.361876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bc3804a9-10d2-4cbb-ad6f-040a5235e588 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:12.378214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc3804a9-10d2-4cbb-ad6f-040a5235e588 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:12.380314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc3804a9-10d2-4cbb-ad6f-040a5235e588 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:12.381065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc3804a9-10d2-4cbb-ad6f-040a5235e588 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:12.382256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc3804a9-10d2-4cbb-ad6f-040a5235e588 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:12.382931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc3804a9-10d2-4cbb-ad6f-040a5235e588 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:12.383603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc3804a9-10d2-4cbb-ad6f-040a5235e588 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:12.963619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bc3804a9-10d2-4cbb-ad6f-040a5235e588 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:12.975069 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bc3804a9-10d2-4cbb-ad6f-040a5235e588 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1526 microversion: 2.1 time: 0.619501 Oct 12 22:21:12.975886 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2860/5106] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:12 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1526 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:13.344257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-da4d090f-cacb-4553-9b45-13ec89e693d3 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:13.344880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-da4d090f-cacb-4553-9b45-13ec89e693d3 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:13.353318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da4d090f-cacb-4553-9b45-13ec89e693d3 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:13.362146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da4d090f-cacb-4553-9b45-13ec89e693d3 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:13.362614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da4d090f-cacb-4553-9b45-13ec89e693d3 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:13.363392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da4d090f-cacb-4553-9b45-13ec89e693d3 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:13.371130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da4d090f-cacb-4553-9b45-13ec89e693d3 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:13.375888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da4d090f-cacb-4553-9b45-13ec89e693d3 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:13.783303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-da4d090f-cacb-4553-9b45-13ec89e693d3 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:13.808967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-da4d090f-cacb-4553-9b45-13ec89e693d3 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:13.819894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-da4d090f-cacb-4553-9b45-13ec89e693d3 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:13.821261 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-da4d090f-cacb-4553-9b45-13ec89e693d3 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 2555 microversion: 2.42 time: 0.481237 Oct 12 22:21:13.822040 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2861/5107] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:13 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 2555 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:13.872127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7883a215-a4ce-491e-9489-6f0b116df50e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Action: 'create', calling method: .version_select at 0x7f5122c75c10>, body: {"keypair": {"name": "tempest-keypair-655754919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhUHa33DTk2Pi8SfhfVaD/7t3M/K+7We2w+R5QiapXNnJo4MmrBQBs2YLU2yefiPYch9kxP6+wx9LRR3CIUzLY7spGMyfLxQJMGbE85/PEpNU1jf1LhWmP9WX5uTTiwvQ=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:13.919718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-7883a215-a4ce-491e-9489-6f0b116df50e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Getting quotas for project 0a0c4d9f435a4c009bd0b5eb2618829b. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:21:13.930159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-7883a215-a4ce-491e-9489-6f0b116df50e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Getting quotas for user afec4a3808b84463900b744ecd9352b6 and project 0a0c4d9f435a4c009bd0b5eb2618829b. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:21:13.940251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:13.999945 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7883a215-a4ce-491e-9489-6f0b116df50e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.140164 Oct 12 22:21:14.001408 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2862/5108] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:21:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:14.011345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-25bb33dc-8a12-415e-8536-64ce897fb73f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:14.012284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-25bb33dc-8a12-415e-8536-64ce897fb73f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:14.022882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25bb33dc-8a12-415e-8536-64ce897fb73f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:14.023703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25bb33dc-8a12-415e-8536-64ce897fb73f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:14.031914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25bb33dc-8a12-415e-8536-64ce897fb73f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:14.033478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25bb33dc-8a12-415e-8536-64ce897fb73f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:14.033478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25bb33dc-8a12-415e-8536-64ce897fb73f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:14.035386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-25bb33dc-8a12-415e-8536-64ce897fb73f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:15.411476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-25bb33dc-8a12-415e-8536-64ce897fb73f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:15.429454 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-25bb33dc-8a12-415e-8536-64ce897fb73f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1526 microversion: 2.1 time: 1.426692 Oct 12 22:21:15.430563 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2863/5109] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:14 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1526 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:15.435703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-cd0fc754-1a55-4eeb-a59d-5cdfbf13b7c3 req-ac689a28-b102-4b03-b8b2-ffc1b3c13384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "name": "network-vif-deleted", "tag": "0fdc0365-5474-47b8-9674-e807e2942529"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:15.464079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cd0fc754-1a55-4eeb-a59d-5cdfbf13b7c3 req-ac689a28-b102-4b03-b8b2-ffc1b3c13384 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:15.464929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cd0fc754-1a55-4eeb-a59d-5cdfbf13b7c3 req-ac689a28-b102-4b03-b8b2-ffc1b3c13384 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:15.465740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cd0fc754-1a55-4eeb-a59d-5cdfbf13b7c3 req-ac689a28-b102-4b03-b8b2-ffc1b3c13384 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:15.481209 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-cd0fc754-1a55-4eeb-a59d-5cdfbf13b7c3 req-ac689a28-b102-4b03-b8b2-ffc1b3c13384 service nova] Creating event network-vif-deleted:0fdc0365-5474-47b8-9674-e807e2942529 for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:21:15.486871 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-cd0fc754-1a55-4eeb-a59d-5cdfbf13b7c3 req-ac689a28-b102-4b03-b8b2-ffc1b3c13384 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054871 Oct 12 22:21:15.487823 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2864/5110] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:15.493621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3a1fca14-a32b-4bc8-bd43-39025d1b4e03 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:15.494769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3a1fca14-a32b-4bc8-bd43-39025d1b4e03 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:15.520063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a1fca14-a32b-4bc8-bd43-39025d1b4e03 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:15.521927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a1fca14-a32b-4bc8-bd43-39025d1b4e03 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:15.523594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a1fca14-a32b-4bc8-bd43-39025d1b4e03 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:15.524479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a1fca14-a32b-4bc8-bd43-39025d1b4e03 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:15.525166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a1fca14-a32b-4bc8-bd43-39025d1b4e03 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:15.526392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a1fca14-a32b-4bc8-bd43-39025d1b4e03 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:15.753382 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9feb0d48-7806-4c59-914d-d5fa9570f968 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "POST /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1/action" status: 202 len: 0 microversion: 2.1 time: 5.322798 Oct 12 22:21:15.754502 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2247/5111] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:21:10 2022] POST /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1/action => generated 0 bytes in 5327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:21:15.778773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7fc1d145-80ba-4326-8120-2a64e0f91af6 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1418945924"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:15.781065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7fc1d145-80ba-4326-8120-2a64e0f91af6 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:15.794058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fc1d145-80ba-4326-8120-2a64e0f91af6 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:15.795063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fc1d145-80ba-4326-8120-2a64e0f91af6 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:15.795791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fc1d145-80ba-4326-8120-2a64e0f91af6 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:15.796824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fc1d145-80ba-4326-8120-2a64e0f91af6 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:15.797492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fc1d145-80ba-4326-8120-2a64e0f91af6 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:15.798132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fc1d145-80ba-4326-8120-2a64e0f91af6 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:16.062073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3a1fca14-a32b-4bc8-bd43-39025d1b4e03 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:16.080156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3a1fca14-a32b-4bc8-bd43-39025d1b4e03 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:16.088835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3a1fca14-a32b-4bc8-bd43-39025d1b4e03 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:16.092810 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3a1fca14-a32b-4bc8-bd43-39025d1b4e03 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 2394 microversion: 2.42 time: 0.600900 Oct 12 22:21:16.094859 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2865/5112] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:15 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 2394 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:16.456858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-68071f37-508c-4b9b-aa08-bd1d6e3ebd88 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:16.458511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-68071f37-508c-4b9b-aa08-bd1d6e3ebd88 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:16.474107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68071f37-508c-4b9b-aa08-bd1d6e3ebd88 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:16.475427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68071f37-508c-4b9b-aa08-bd1d6e3ebd88 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:16.476143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68071f37-508c-4b9b-aa08-bd1d6e3ebd88 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:16.479477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68071f37-508c-4b9b-aa08-bd1d6e3ebd88 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:16.480517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68071f37-508c-4b9b-aa08-bd1d6e3ebd88 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:16.481232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68071f37-508c-4b9b-aa08-bd1d6e3ebd88 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:16.513838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:16.610877 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.network.security_group_api [None req-7fc1d145-80ba-4326-8120-2a64e0f91af6 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Removing security group f9458e64-d80e-4e7e-96d7-9e8165b73c47 from port 6ff18597-4249-41ef-84df-7032cece1756 Oct 12 22:21:17.746645 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7fc1d145-80ba-4326-8120-2a64e0f91af6 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "POST /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1/action" status: 202 len: 0 microversion: 2.1 time: 1.983229 Oct 12 22:21:17.747272 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2248/5113] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:21:15 2022] POST /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1/action => generated 0 bytes in 1985 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:21:17.754253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8ebf5e96-eed4-4cd9-ad65-31f772c8dd48 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:17.761331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8ebf5e96-eed4-4cd9-ad65-31f772c8dd48 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:17.792994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ebf5e96-eed4-4cd9-ad65-31f772c8dd48 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:17.793493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ebf5e96-eed4-4cd9-ad65-31f772c8dd48 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:17.793930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ebf5e96-eed4-4cd9-ad65-31f772c8dd48 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:17.794640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ebf5e96-eed4-4cd9-ad65-31f772c8dd48 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:17.795088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ebf5e96-eed4-4cd9-ad65-31f772c8dd48 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:17.795550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ebf5e96-eed4-4cd9-ad65-31f772c8dd48 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:17.804676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-68071f37-508c-4b9b-aa08-bd1d6e3ebd88 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:17.819574 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-68071f37-508c-4b9b-aa08-bd1d6e3ebd88 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1526 microversion: 2.1 time: 1.365916 Oct 12 22:21:17.836624 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2866/5114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:16 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1526 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:17.843746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-55d4152f-976b-411c-a35d-91e619d7fab6 req-9fae1106-0ec2-478a-9691-29c99f1ed8af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b6bc6c9-2437-4654-a89f-bf320500b7b1", "tag": "6ff18597-4249-41ef-84df-7032cece1756"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:17.870553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-55d4152f-976b-411c-a35d-91e619d7fab6 req-9fae1106-0ec2-478a-9691-29c99f1ed8af service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:17.877034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-55d4152f-976b-411c-a35d-91e619d7fab6 req-9fae1106-0ec2-478a-9691-29c99f1ed8af service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:17.878135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-55d4152f-976b-411c-a35d-91e619d7fab6 req-9fae1106-0ec2-478a-9691-29c99f1ed8af service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:17.907988 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-55d4152f-976b-411c-a35d-91e619d7fab6 req-9fae1106-0ec2-478a-9691-29c99f1ed8af service nova] Creating event network-changed:6ff18597-4249-41ef-84df-7032cece1756 for instance 7b6bc6c9-2437-4654-a89f-bf320500b7b1 on n-h1-861111-1 Oct 12 22:21:17.934571 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-55d4152f-976b-411c-a35d-91e619d7fab6 req-9fae1106-0ec2-478a-9691-29c99f1ed8af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096241 Oct 12 22:21:17.935402 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2867/5115] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:17.951729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c23dd987-84e8-4048-bfa0-9e4ebaa7f98d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Action: 'create', calling method: .version_select at 0x7f5122d273a0>, body: {"pool": null} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:19.545874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8ebf5e96-eed4-4cd9-ad65-31f772c8dd48 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:19.563562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8ebf5e96-eed4-4cd9-ad65-31f772c8dd48 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:19.572007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8ebf5e96-eed4-4cd9-ad65-31f772c8dd48 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:19.591045 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8ebf5e96-eed4-4cd9-ad65-31f772c8dd48 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 2347 microversion: 2.42 time: 1.833677 Oct 12 22:21:19.602301 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2249/5116] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:17 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 2347 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:19.612805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b8234b77-722c-4b1c-b05c-e21132081084 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:19.623064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b8234b77-722c-4b1c-b05c-e21132081084 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:19.653984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b8234b77-722c-4b1c-b05c-e21132081084 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:19.659953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b8234b77-722c-4b1c-b05c-e21132081084 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:19.661211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b8234b77-722c-4b1c-b05c-e21132081084 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:19.665919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b8234b77-722c-4b1c-b05c-e21132081084 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:19.671695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b8234b77-722c-4b1c-b05c-e21132081084 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:19.675142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b8234b77-722c-4b1c-b05c-e21132081084 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:20.399945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b8234b77-722c-4b1c-b05c-e21132081084 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:20.412657 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b8234b77-722c-4b1c-b05c-e21132081084 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1526 microversion: 2.1 time: 0.809048 Oct 12 22:21:20.413789 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2250/5117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:19 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1526 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:20.431110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-0897c347-d64b-439a-b5a0-5bafea719457 req-f21f035a-15f4-4542-bc49-2266e27e2971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b6bc6c9-2437-4654-a89f-bf320500b7b1", "tag": "6ff18597-4249-41ef-84df-7032cece1756"}, {"server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "name": "network-vif-deleted", "tag": "a21af4ca-546d-4eb8-a73d-42ffccc0349b"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:20.469092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0897c347-d64b-439a-b5a0-5bafea719457 req-f21f035a-15f4-4542-bc49-2266e27e2971 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:20.469764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0897c347-d64b-439a-b5a0-5bafea719457 req-f21f035a-15f4-4542-bc49-2266e27e2971 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:20.470538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0897c347-d64b-439a-b5a0-5bafea719457 req-f21f035a-15f4-4542-bc49-2266e27e2971 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:20.502232 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-0897c347-d64b-439a-b5a0-5bafea719457 req-f21f035a-15f4-4542-bc49-2266e27e2971 service nova] Creating event network-changed:6ff18597-4249-41ef-84df-7032cece1756 for instance 7b6bc6c9-2437-4654-a89f-bf320500b7b1 on n-h1-861111-1 Oct 12 22:21:20.503314 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-0897c347-d64b-439a-b5a0-5bafea719457 req-f21f035a-15f4-4542-bc49-2266e27e2971 service nova] Creating event network-vif-deleted:a21af4ca-546d-4eb8-a73d-42ffccc0349b for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:21:20.516428 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-0897c347-d64b-439a-b5a0-5bafea719457 req-f21f035a-15f4-4542-bc49-2266e27e2971 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.099935 Oct 12 22:21:20.518323 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2251/5118] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:20.635552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d94d1a8b-127e-44f4-824c-0286b55023c7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:20.637130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d94d1a8b-127e-44f4-824c-0286b55023c7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:20.653109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d94d1a8b-127e-44f4-824c-0286b55023c7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:20.655402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d94d1a8b-127e-44f4-824c-0286b55023c7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:20.659278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d94d1a8b-127e-44f4-824c-0286b55023c7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:20.660276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d94d1a8b-127e-44f4-824c-0286b55023c7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:20.660910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d94d1a8b-127e-44f4-824c-0286b55023c7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:20.662646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d94d1a8b-127e-44f4-824c-0286b55023c7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:21.444387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d94d1a8b-127e-44f4-824c-0286b55023c7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:21.452198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:21.474761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d94d1a8b-127e-44f4-824c-0286b55023c7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:21.477960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d94d1a8b-127e-44f4-824c-0286b55023c7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:21.479253 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d94d1a8b-127e-44f4-824c-0286b55023c7 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 2055 microversion: 2.42 time: 0.849196 Oct 12 22:21:21.480394 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2252/5119] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:20 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 2055 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:21:21.496161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5e2ea595-1f6d-4577-ac36-9ba7a957c1c6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:21.496804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5e2ea595-1f6d-4577-ac36-9ba7a957c1c6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:21.514379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e2ea595-1f6d-4577-ac36-9ba7a957c1c6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:21.514879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e2ea595-1f6d-4577-ac36-9ba7a957c1c6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:21.520534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e2ea595-1f6d-4577-ac36-9ba7a957c1c6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:21.521448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e2ea595-1f6d-4577-ac36-9ba7a957c1c6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:21.521937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e2ea595-1f6d-4577-ac36-9ba7a957c1c6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:21.522383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e2ea595-1f6d-4577-ac36-9ba7a957c1c6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:22.168305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5e2ea595-1f6d-4577-ac36-9ba7a957c1c6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:22.183872 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5e2ea595-1f6d-4577-ac36-9ba7a957c1c6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1526 microversion: 2.1 time: 0.698582 Oct 12 22:21:22.185362 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2253/5120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:21 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1526 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:22.516559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-931edabd-b34d-46c3-ba65-ffceea1304c6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:22.518034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-931edabd-b34d-46c3-ba65-ffceea1304c6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:22.531006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931edabd-b34d-46c3-ba65-ffceea1304c6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:22.535969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931edabd-b34d-46c3-ba65-ffceea1304c6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:22.537355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931edabd-b34d-46c3-ba65-ffceea1304c6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:22.539969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931edabd-b34d-46c3-ba65-ffceea1304c6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:22.541938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931edabd-b34d-46c3-ba65-ffceea1304c6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:22.547718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931edabd-b34d-46c3-ba65-ffceea1304c6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:22.837293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-931edabd-b34d-46c3-ba65-ffceea1304c6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:22.856989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-931edabd-b34d-46c3-ba65-ffceea1304c6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:22.861209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-931edabd-b34d-46c3-ba65-ffceea1304c6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:22.869960 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-931edabd-b34d-46c3-ba65-ffceea1304c6 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1604 microversion: 2.42 time: 0.358943 Oct 12 22:21:22.871564 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2254/5121] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:22 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1604 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:21:22.882631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-a39b609b-f9e8-4adc-a578-0c6463c221e6 req-c9842561-e90c-48d2-b6e3-ef1580005beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33dea29-003c-413c-8b17-8b2ed9a89d00", "name": "network-vif-deleted", "tag": "f6a6b535-1aed-4471-b5a4-a99246939f71"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:22.912997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a39b609b-f9e8-4adc-a578-0c6463c221e6 req-c9842561-e90c-48d2-b6e3-ef1580005beb service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:22.914073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a39b609b-f9e8-4adc-a578-0c6463c221e6 req-c9842561-e90c-48d2-b6e3-ef1580005beb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:22.914765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a39b609b-f9e8-4adc-a578-0c6463c221e6 req-c9842561-e90c-48d2-b6e3-ef1580005beb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:22.939210 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-a39b609b-f9e8-4adc-a578-0c6463c221e6 req-c9842561-e90c-48d2-b6e3-ef1580005beb service nova] Creating event network-vif-deleted:f6a6b535-1aed-4471-b5a4-a99246939f71 for instance e33dea29-003c-413c-8b17-8b2ed9a89d00 on n-h2-861111-1 Oct 12 22:21:22.944846 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-a39b609b-f9e8-4adc-a578-0c6463c221e6 req-c9842561-e90c-48d2-b6e3-ef1580005beb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071824 Oct 12 22:21:22.945903 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2255/5122] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:23.209242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d271154a-3586-43a6-9b36-6cc30c2b4bbd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:23.216301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d271154a-3586-43a6-9b36-6cc30c2b4bbd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:23.231132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d271154a-3586-43a6-9b36-6cc30c2b4bbd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:23.232055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d271154a-3586-43a6-9b36-6cc30c2b4bbd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:23.232722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d271154a-3586-43a6-9b36-6cc30c2b4bbd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:23.234242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d271154a-3586-43a6-9b36-6cc30c2b4bbd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:23.234921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d271154a-3586-43a6-9b36-6cc30c2b4bbd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:23.238495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d271154a-3586-43a6-9b36-6cc30c2b4bbd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:23.954344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:24.527223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d271154a-3586-43a6-9b36-6cc30c2b4bbd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:24.567561 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d271154a-3586-43a6-9b36-6cc30c2b4bbd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1526 microversion: 2.1 time: 1.360824 Oct 12 22:21:24.568190 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2256/5123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:23 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1526 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:24.600322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-72006d3f-61a5-4b45-80cb-4ffe2ac55196 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:24.601895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-72006d3f-61a5-4b45-80cb-4ffe2ac55196 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:24.627969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72006d3f-61a5-4b45-80cb-4ffe2ac55196 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:24.629809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72006d3f-61a5-4b45-80cb-4ffe2ac55196 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:24.630283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72006d3f-61a5-4b45-80cb-4ffe2ac55196 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:24.631090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72006d3f-61a5-4b45-80cb-4ffe2ac55196 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:24.631591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72006d3f-61a5-4b45-80cb-4ffe2ac55196 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:24.632021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-72006d3f-61a5-4b45-80cb-4ffe2ac55196 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:24.913379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-72006d3f-61a5-4b45-80cb-4ffe2ac55196 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:24.929156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-72006d3f-61a5-4b45-80cb-4ffe2ac55196 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:24.934586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-72006d3f-61a5-4b45-80cb-4ffe2ac55196 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:24.937182 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-72006d3f-61a5-4b45-80cb-4ffe2ac55196 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1604 microversion: 2.42 time: 0.363947 Oct 12 22:21:24.938935 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2257/5124] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:24 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1604 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:24.949773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1269712065", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49f84747-5e93-4ad6-a379-e2b377cb642c"}], "security_groups": [{"name": "tempest-securitygroup--1449885003"}], "key_name": "tempest-keypair-655754919", "user_data": "}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:25.354092 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c23dd987-84e8-4048-bfa0-9e4ebaa7f98d tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.410382 Oct 12 22:21:25.354700 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2868/5125] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 12 22:21:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:25.392955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] validate_networks() for [('49f84747-5e93-4ad6-a379-e2b377cb642c', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:21:25.823674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-14546911-89d7-49b5-a6ee-40823b053cc2 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Action: 'create', calling method: .version_select at 0x7f5122bc14c0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1133496764", "policies": ["affinity"]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:25.876631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-14546911-89d7-49b5-a6ee-40823b053cc2 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:21:25.884881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-14546911-89d7-49b5-a6ee-40823b053cc2 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for user 3bf9c4a8ea974074b244abb1f026f1ff and project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:21:25.950282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-14546911-89d7-49b5-a6ee-40823b053cc2 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:21:25.969548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-14546911-89d7-49b5-a6ee-40823b053cc2 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for user 3bf9c4a8ea974074b244abb1f026f1ff and project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:21:25.988907 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-14546911-89d7-49b5-a6ee-40823b053cc2 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.632734 Oct 12 22:21:25.990479 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2869/5126] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Oct 12 22:21:25 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:25.996073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-60d32d07-635c-4c29-9f74-ea16f4bdcbd4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.189"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:26.012074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-60d32d07-635c-4c29-9f74-ea16f4bdcbd4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:26.021496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d32d07-635c-4c29-9f74-ea16f4bdcbd4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:26.022343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d32d07-635c-4c29-9f74-ea16f4bdcbd4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:26.023125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d32d07-635c-4c29-9f74-ea16f4bdcbd4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:26.024159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d32d07-635c-4c29-9f74-ea16f4bdcbd4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:26.024957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d32d07-635c-4c29-9f74-ea16f4bdcbd4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:26.025623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d32d07-635c-4c29-9f74-ea16f4bdcbd4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:26.063689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d32d07-635c-4c29-9f74-ea16f4bdcbd4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "refresh_cache-7b6bc6c9-2437-4654-a89f-bf320500b7b1" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:21:26.064828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d32d07-635c-4c29-9f74-ea16f4bdcbd4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquired lock "refresh_cache-7b6bc6c9-2437-4654-a89f-bf320500b7b1" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:21:28.410479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-60d32d07-635c-4c29-9f74-ea16f4bdcbd4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Building network info cache for instance {{(pid=120453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:21:28.659458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:21:28.660377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:21:28.661012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:21:28.661585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:21:28.662204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:21:28.690620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:28.698774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:28.699749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:28.707851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:28.709169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:28.709794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:28.753951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Getting quotas for project 0a0c4d9f435a4c009bd0b5eb2618829b. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:21:28.766092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Getting quotas for user afec4a3808b84463900b744ecd9352b6 and project 0a0c4d9f435a4c009bd0b5eb2618829b. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:21:28.784689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:21:28.787443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:21:28.881894 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0313314b-841d-4160-9c7a-27a93d2802a7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.938041 Oct 12 22:21:28.886251 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2258/5127] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:21:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 3947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:21:28.905240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-31f58935-845e-471c-b5d4-5079db7867dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:28.905886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-31f58935-845e-471c-b5d4-5079db7867dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:28.914796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31f58935-845e-471c-b5d4-5079db7867dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:28.915531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31f58935-845e-471c-b5d4-5079db7867dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:28.916317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31f58935-845e-471c-b5d4-5079db7867dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:28.917446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31f58935-845e-471c-b5d4-5079db7867dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:28.918180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31f58935-845e-471c-b5d4-5079db7867dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:28.918769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31f58935-845e-471c-b5d4-5079db7867dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:29.502625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-60d32d07-635c-4c29-9f74-ea16f4bdcbd4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Updating instance_info_cache with network_info: [{"id": "6ff18597-4249-41ef-84df-7032cece1756", "address": "fa:16:3e:35:56:14", "network": {"id": "95ebd2a8-3052-4905-a297-eef07be03e1f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1378033346-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7c3184d24b3941a8b7eb9b4196469db6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6ff18597-42", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:21:29.526167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d32d07-635c-4c29-9f74-ea16f4bdcbd4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Releasing lock "refresh_cache-7b6bc6c9-2437-4654-a89f-bf320500b7b1" {{(pid=120453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:21:29.528873 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-60d32d07-635c-4c29-9f74-ea16f4bdcbd4 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "POST /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1/action" status: 202 len: 0 microversion: 2.1 time: 3.536454 Oct 12 22:21:29.535081 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2870/5128] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:21:25 2022] POST /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1/action => generated 0 bytes in 3544 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:21:29.558285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-18bd08f0-4aed-4452-a19c-2a17df1e2373 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:29.562646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-18bd08f0-4aed-4452-a19c-2a17df1e2373 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:29.580428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-31f58935-845e-471c-b5d4-5079db7867dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:29.601148 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-31f58935-845e-471c-b5d4-5079db7867dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1508 microversion: 2.1 time: 0.703201 Oct 12 22:21:29.608335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18bd08f0-4aed-4452-a19c-2a17df1e2373 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:29.608848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18bd08f0-4aed-4452-a19c-2a17df1e2373 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:29.609305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18bd08f0-4aed-4452-a19c-2a17df1e2373 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:29.610034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18bd08f0-4aed-4452-a19c-2a17df1e2373 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:29.610313 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2259/5129] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:28 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1508 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:29.618810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18bd08f0-4aed-4452-a19c-2a17df1e2373 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:29.624460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18bd08f0-4aed-4452-a19c-2a17df1e2373 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:29.630279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-10776f52-04d5-4a37-8322-533ed7852b72 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Action: 'create', calling method: .version_select at 0x7f5123174430>, body: {"server_group": {"name": "tempest-server-group-1569190816", "policies": ["affinity"]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:29.735884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-10776f52-04d5-4a37-8322-533ed7852b72 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:21:29.748723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-10776f52-04d5-4a37-8322-533ed7852b72 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for user 3bf9c4a8ea974074b244abb1f026f1ff and project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:21:29.845285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-18bd08f0-4aed-4452-a19c-2a17df1e2373 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:29.872973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-18bd08f0-4aed-4452-a19c-2a17df1e2373 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:29.877324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-18bd08f0-4aed-4452-a19c-2a17df1e2373 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:29.880708 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-18bd08f0-4aed-4452-a19c-2a17df1e2373 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1604 microversion: 2.42 time: 0.342962 Oct 12 22:21:29.882971 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2871/5130] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:29 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1604 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:29.895381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-3f84e425-4bc4-404b-b470-7483678cfd3e req-fdd2a078-7115-4ce8-a43f-74885ea6e207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b6bc6c9-2437-4654-a89f-bf320500b7b1", "tag": "6ff18597-4249-41ef-84df-7032cece1756"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:29.918498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3f84e425-4bc4-404b-b470-7483678cfd3e req-fdd2a078-7115-4ce8-a43f-74885ea6e207 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:29.922645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3f84e425-4bc4-404b-b470-7483678cfd3e req-fdd2a078-7115-4ce8-a43f-74885ea6e207 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:29.923480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3f84e425-4bc4-404b-b470-7483678cfd3e req-fdd2a078-7115-4ce8-a43f-74885ea6e207 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:29.931682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-10776f52-04d5-4a37-8322-533ed7852b72 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:21:29.952833 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-3f84e425-4bc4-404b-b470-7483678cfd3e req-fdd2a078-7115-4ce8-a43f-74885ea6e207 service nova] Creating event network-changed:6ff18597-4249-41ef-84df-7032cece1756 for instance 7b6bc6c9-2437-4654-a89f-bf320500b7b1 on n-h1-861111-1 Oct 12 22:21:29.960570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-10776f52-04d5-4a37-8322-533ed7852b72 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for user 3bf9c4a8ea974074b244abb1f026f1ff and project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:21:29.971058 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-3f84e425-4bc4-404b-b470-7483678cfd3e req-fdd2a078-7115-4ce8-a43f-74885ea6e207 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081680 Oct 12 22:21:29.973963 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2872/5131] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:29.986314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0393cc4a-179d-4821-96c2-b0d9ac7e5248 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:29.987032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0393cc4a-179d-4821-96c2-b0d9ac7e5248 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:30.004035 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-10776f52-04d5-4a37-8322-533ed7852b72 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.391891 Oct 12 22:21:30.004744 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2260/5132] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 12 22:21:29 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:30.016177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0393cc4a-179d-4821-96c2-b0d9ac7e5248 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:30.016786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0393cc4a-179d-4821-96c2-b0d9ac7e5248 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:30.017237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0393cc4a-179d-4821-96c2-b0d9ac7e5248 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:30.017570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-dd2862ba-e676-4d19-abc1-1ac228c8f292 req-6efc50f1-cc6b-45e2-b12f-13c6d5ec4e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02be5cee-72e9-4cc6-94a2-c3517ec178bd", "name": "network-vif-unplugged", "status": "completed", "tag": "ba67b2ed-d4b3-4942-b9cd-37eda012789a"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:30.017971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0393cc4a-179d-4821-96c2-b0d9ac7e5248 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:30.018425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0393cc4a-179d-4821-96c2-b0d9ac7e5248 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:30.018852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0393cc4a-179d-4821-96c2-b0d9ac7e5248 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:30.029045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dd2862ba-e676-4d19-abc1-1ac228c8f292 req-6efc50f1-cc6b-45e2-b12f-13c6d5ec4e12 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:30.029918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dd2862ba-e676-4d19-abc1-1ac228c8f292 req-6efc50f1-cc6b-45e2-b12f-13c6d5ec4e12 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:30.030547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dd2862ba-e676-4d19-abc1-1ac228c8f292 req-6efc50f1-cc6b-45e2-b12f-13c6d5ec4e12 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:30.055892 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-dd2862ba-e676-4d19-abc1-1ac228c8f292 req-6efc50f1-cc6b-45e2-b12f-13c6d5ec4e12 service nova] Creating event network-vif-unplugged:ba67b2ed-d4b3-4942-b9cd-37eda012789a for instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd on n-h2-861111-1 Oct 12 22:21:30.069043 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-dd2862ba-e676-4d19-abc1-1ac228c8f292 req-6efc50f1-cc6b-45e2-b12f-13c6d5ec4e12 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054781 Oct 12 22:21:30.072908 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2261/5133] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:30.088804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8178ed7a-6594-49ee-9ee7-6d6b3696a57e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.189"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:30.184631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0393cc4a-179d-4821-96c2-b0d9ac7e5248 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:30.193373 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0393cc4a-179d-4821-96c2-b0d9ac7e5248 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1249 microversion: 2.1 time: 0.216120 Oct 12 22:21:30.194296 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2873/5134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:29 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1249 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:30.199556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8767f2b5-702c-4bc6-8ccc-edad31725da4 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Action: 'create', calling method: .version_select at 0x7f5122bc1e50>, body: {"server_group": {"name": "tempest-server-group-1569190816", "policies": ["affinity"]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:30.243305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-8767f2b5-702c-4bc6-8ccc-edad31725da4 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:21:30.254418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-8767f2b5-702c-4bc6-8ccc-edad31725da4 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for user 3bf9c4a8ea974074b244abb1f026f1ff and project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:21:30.373957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-8767f2b5-702c-4bc6-8ccc-edad31725da4 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:21:30.385266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-8767f2b5-702c-4bc6-8ccc-edad31725da4 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for user 3bf9c4a8ea974074b244abb1f026f1ff and project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:21:30.423979 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8767f2b5-702c-4bc6-8ccc-edad31725da4 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.227368 Oct 12 22:21:30.425628 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2874/5135] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 12 22:21:30 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:30.438866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c1a9be6a-f2ae-4018-8908-6ee92b937b66 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:30.928162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8178ed7a-6594-49ee-9ee7-6d6b3696a57e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:30.937408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8178ed7a-6594-49ee-9ee7-6d6b3696a57e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:30.939167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8178ed7a-6594-49ee-9ee7-6d6b3696a57e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:30.940204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8178ed7a-6594-49ee-9ee7-6d6b3696a57e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:30.942692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8178ed7a-6594-49ee-9ee7-6d6b3696a57e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:30.946690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8178ed7a-6594-49ee-9ee7-6d6b3696a57e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:30.947566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8178ed7a-6594-49ee-9ee7-6d6b3696a57e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:31.041674 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c1a9be6a-f2ae-4018-8908-6ee92b937b66 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/b8b67e16-421a-469a-8252-86b6b3a4832a" status: 204 len: 0 microversion: 2.1 time: 0.609317 Oct 12 22:21:31.042554 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2875/5136] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 12 22:21:30 2022] DELETE /compute/v2.1/os-server-groups/b8b67e16-421a-469a-8252-86b6b3a4832a => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:21:31.055300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-57f8ffa6-aba9-4095-8bb2-98550fa48dd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:31.056731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-57f8ffa6-aba9-4095-8bb2-98550fa48dd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:31.073137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57f8ffa6-aba9-4095-8bb2-98550fa48dd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:31.073677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57f8ffa6-aba9-4095-8bb2-98550fa48dd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:31.074136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57f8ffa6-aba9-4095-8bb2-98550fa48dd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:31.074875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57f8ffa6-aba9-4095-8bb2-98550fa48dd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:31.075370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57f8ffa6-aba9-4095-8bb2-98550fa48dd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:31.075822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57f8ffa6-aba9-4095-8bb2-98550fa48dd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:31.347090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-57f8ffa6-aba9-4095-8bb2-98550fa48dd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:31.366991 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-57f8ffa6-aba9-4095-8bb2-98550fa48dd1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1508 microversion: 2.1 time: 0.319176 Oct 12 22:21:31.393756 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2876/5137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:31 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:31.425121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-64244ff8-0348-4f04-a249-4763571dd94c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:31.427747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-64244ff8-0348-4f04-a249-4763571dd94c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:31.441852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64244ff8-0348-4f04-a249-4763571dd94c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:31.442652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64244ff8-0348-4f04-a249-4763571dd94c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:31.443852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64244ff8-0348-4f04-a249-4763571dd94c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:31.444810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64244ff8-0348-4f04-a249-4763571dd94c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:31.445440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64244ff8-0348-4f04-a249-4763571dd94c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:31.446113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-64244ff8-0348-4f04-a249-4763571dd94c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:31.558863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-64244ff8-0348-4f04-a249-4763571dd94c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:31.574696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-64244ff8-0348-4f04-a249-4763571dd94c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:31.577094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-64244ff8-0348-4f04-a249-4763571dd94c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:31.578767 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-64244ff8-0348-4f04-a249-4763571dd94c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1604 microversion: 2.42 time: 0.181194 Oct 12 22:21:31.579625 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2877/5138] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:31 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1604 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:31.585126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6049212d-ab40-4aac-b0fc-7226fc55ea9e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:31.629250 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6049212d-ab40-4aac-b0fc-7226fc55ea9e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.046943 Oct 12 22:21:31.631074 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2878/5139] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:21:31 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:31.646643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d3e52415-8766-42c8-8a1a-72c558984859 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:31.647304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d3e52415-8766-42c8-8a1a-72c558984859 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:31.674868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e52415-8766-42c8-8a1a-72c558984859 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:31.675567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e52415-8766-42c8-8a1a-72c558984859 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:31.676120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e52415-8766-42c8-8a1a-72c558984859 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:31.676988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e52415-8766-42c8-8a1a-72c558984859 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:31.677552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e52415-8766-42c8-8a1a-72c558984859 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:31.678091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3e52415-8766-42c8-8a1a-72c558984859 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:31.880913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d3e52415-8766-42c8-8a1a-72c558984859 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:31.905208 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d3e52415-8766-42c8-8a1a-72c558984859 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1315 microversion: 2.1 time: 0.270703 Oct 12 22:21:31.905846 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2879/5140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:31 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:31.929503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-824635b0-3509-42a3-9498-e99752575656 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:31.979216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=5 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:32.002776 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-824635b0-3509-42a3-9498-e99752575656 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/73e4054b-ddc1-4382-a1f7-af912257f811" status: 204 len: 0 microversion: 2.1 time: 0.094828 Oct 12 22:21:32.005779 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2880/5141] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 12 22:21:31 2022] DELETE /compute/v2.1/os-server-groups/73e4054b-ddc1-4382-a1f7-af912257f811 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:21:32.034757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f864df8d-6889-4e48-9458-c629cb87c3d2 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:32.057880 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f864df8d-6889-4e48-9458-c629cb87c3d2 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.037447 Oct 12 22:21:32.059614 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2881/5142] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:21:32 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:32.077954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3bcf43f0-939d-4d90-b8f0-98b58807e159 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Action: 'create', calling method: .version_select at 0x7f5122bc1ee0>, body: {"server_group": {"name": "tempest-server-group-645414663", "policies": ["affinity"]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:32.107500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-3bcf43f0-939d-4d90-b8f0-98b58807e159 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:21:32.114205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-3bcf43f0-939d-4d90-b8f0-98b58807e159 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for user 3bf9c4a8ea974074b244abb1f026f1ff and project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:21:32.190626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-3bcf43f0-939d-4d90-b8f0-98b58807e159 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:21:32.208804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-3bcf43f0-939d-4d90-b8f0-98b58807e159 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for user 3bf9c4a8ea974074b244abb1f026f1ff and project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:21:32.241611 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3bcf43f0-939d-4d90-b8f0-98b58807e159 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.169165 Oct 12 22:21:32.245062 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2882/5143] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 12 22:21:32 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:32.261825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bd3b892f-5a85-4105-a6db-71117803b090 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:32.319048 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bd3b892f-5a85-4105-a6db-71117803b090 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/a1a2ce9c-a4bf-406d-95ba-6b427186f838" status: 204 len: 0 microversion: 2.1 time: 0.067582 Oct 12 22:21:32.331568 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2883/5144] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 12 22:21:32 2022] DELETE /compute/v2.1/os-server-groups/a1a2ce9c-a4bf-406d-95ba-6b427186f838 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:21:32.340999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c1447e58-c143-4be8-b776-b57226236bd3 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:32.357100 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c1447e58-c143-4be8-b776-b57226236bd3 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.023720 Oct 12 22:21:32.365063 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2884/5145] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:21:32 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:32.372408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c6440836-6ae2-4767-9965-daa88fa28467 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Action: 'create', calling method: .version_select at 0x7f5122ccb4c0>, body: {"server_group": {"name": "tempest-server-group-637581351", "policies": ["anti-affinity"]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:32.402747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-c6440836-6ae2-4767-9965-daa88fa28467 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:21:32.411438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-c6440836-6ae2-4767-9965-daa88fa28467 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for user 3bf9c4a8ea974074b244abb1f026f1ff and project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:21:32.506273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-c6440836-6ae2-4767-9965-daa88fa28467 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:21:32.524117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-c6440836-6ae2-4767-9965-daa88fa28467 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for user 3bf9c4a8ea974074b244abb1f026f1ff and project c614ce154dd6424d8044223b671a6c73. Resources: {'server_groups'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:21:32.558088 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c6440836-6ae2-4767-9965-daa88fa28467 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.189731 Oct 12 22:21:32.560517 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2885/5146] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 12 22:21:32 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:32.569533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bf55756a-f351-4b98-8e0e-f47ecdb796ee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:32.570765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bf55756a-f351-4b98-8e0e-f47ecdb796ee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:32.582705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf55756a-f351-4b98-8e0e-f47ecdb796ee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:32.583835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf55756a-f351-4b98-8e0e-f47ecdb796ee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:32.584781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf55756a-f351-4b98-8e0e-f47ecdb796ee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:32.586805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf55756a-f351-4b98-8e0e-f47ecdb796ee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:32.587467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf55756a-f351-4b98-8e0e-f47ecdb796ee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:32.589794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf55756a-f351-4b98-8e0e-f47ecdb796ee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:32.874490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8178ed7a-6594-49ee-9ee7-6d6b3696a57e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "refresh_cache-7b6bc6c9-2437-4654-a89f-bf320500b7b1" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:21:32.875453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8178ed7a-6594-49ee-9ee7-6d6b3696a57e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquired lock "refresh_cache-7b6bc6c9-2437-4654-a89f-bf320500b7b1" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:21:33.322296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bf55756a-f351-4b98-8e0e-f47ecdb796ee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:33.330270 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bf55756a-f351-4b98-8e0e-f47ecdb796ee tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1511 microversion: 2.1 time: 0.767720 Oct 12 22:21:33.330857 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2886/5147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:32 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1511 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:33.356510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-66c3513d-30dd-4516-8291-a6b5f4a58235 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:33.414339 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-66c3513d-30dd-4516-8291-a6b5f4a58235 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/ead4a450-b00d-4238-b7c5-9ac2c6aed5af" status: 204 len: 0 microversion: 2.1 time: 0.061728 Oct 12 22:21:33.415159 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2887/5148] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 12 22:21:33 2022] DELETE /compute/v2.1/os-server-groups/ead4a450-b00d-4238-b7c5-9ac2c6aed5af => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:21:33.420563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ba72c48e-1d43-402a-b61f-126c39025218 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:33.421187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ba72c48e-1d43-402a-b61f-126c39025218 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:33.443583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba72c48e-1d43-402a-b61f-126c39025218 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:33.444086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba72c48e-1d43-402a-b61f-126c39025218 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:33.444530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba72c48e-1d43-402a-b61f-126c39025218 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:33.445245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba72c48e-1d43-402a-b61f-126c39025218 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:33.445703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba72c48e-1d43-402a-b61f-126c39025218 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:33.446150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba72c48e-1d43-402a-b61f-126c39025218 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:34.118311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ba72c48e-1d43-402a-b61f-126c39025218 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:34.140031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ba72c48e-1d43-402a-b61f-126c39025218 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:34.141499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ba72c48e-1d43-402a-b61f-126c39025218 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:34.144529 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ba72c48e-1d43-402a-b61f-126c39025218 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1604 microversion: 2.42 time: 0.728520 Oct 12 22:21:34.145279 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2888/5149] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:33 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1604 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:34.168351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6e93a081-c418-4add-b517-532e7fcf82d1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:34.168981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6e93a081-c418-4add-b517-532e7fcf82d1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:34.188050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e93a081-c418-4add-b517-532e7fcf82d1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:34.189979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e93a081-c418-4add-b517-532e7fcf82d1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:34.190308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e93a081-c418-4add-b517-532e7fcf82d1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:34.191515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e93a081-c418-4add-b517-532e7fcf82d1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:34.191515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e93a081-c418-4add-b517-532e7fcf82d1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:34.191959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e93a081-c418-4add-b517-532e7fcf82d1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:34.351000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-8178ed7a-6594-49ee-9ee7-6d6b3696a57e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Building network info cache for instance {{(pid=120452) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:21:34.610785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6e93a081-c418-4add-b517-532e7fcf82d1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:34.619920 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6e93a081-c418-4add-b517-532e7fcf82d1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1371 microversion: 2.1 time: 0.460616 Oct 12 22:21:34.632585 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2889/5150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:34 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1371 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:34.640580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f031a42a-4eaf-429e-94a0-a3c5d4b21303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:34.641219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f031a42a-4eaf-429e-94a0-a3c5d4b21303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:34.664491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f031a42a-4eaf-429e-94a0-a3c5d4b21303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:34.665357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f031a42a-4eaf-429e-94a0-a3c5d4b21303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:34.665997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f031a42a-4eaf-429e-94a0-a3c5d4b21303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:34.672336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f031a42a-4eaf-429e-94a0-a3c5d4b21303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:34.674681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f031a42a-4eaf-429e-94a0-a3c5d4b21303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:34.675392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f031a42a-4eaf-429e-94a0-a3c5d4b21303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:35.195163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f031a42a-4eaf-429e-94a0-a3c5d4b21303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:35.203686 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f031a42a-4eaf-429e-94a0-a3c5d4b21303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1451 microversion: 2.1 time: 0.569916 Oct 12 22:21:35.209035 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2890/5151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:34 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1451 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:35.213868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-12b61d71-4e01-4daf-b25d-20eed3d07d9a tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:35.242787 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-12b61d71-4e01-4daf-b25d-20eed3d07d9a tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.030910 Oct 12 22:21:35.244791 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2891/5152] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:21:35 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:35.269031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-69ed34e5-2b9e-4401-a8cf-bea5db9a6c3e req-1f8e21d1-a263-4b0a-b307-674a65a75798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b6bc6c9-2437-4654-a89f-bf320500b7b1", "tag": "6ff18597-4249-41ef-84df-7032cece1756"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:35.295919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-69ed34e5-2b9e-4401-a8cf-bea5db9a6c3e req-1f8e21d1-a263-4b0a-b307-674a65a75798 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:35.296535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-69ed34e5-2b9e-4401-a8cf-bea5db9a6c3e req-1f8e21d1-a263-4b0a-b307-674a65a75798 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:35.297042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-69ed34e5-2b9e-4401-a8cf-bea5db9a6c3e req-1f8e21d1-a263-4b0a-b307-674a65a75798 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:35.323956 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-69ed34e5-2b9e-4401-a8cf-bea5db9a6c3e req-1f8e21d1-a263-4b0a-b307-674a65a75798 service nova] Creating event network-changed:6ff18597-4249-41ef-84df-7032cece1756 for instance 7b6bc6c9-2437-4654-a89f-bf320500b7b1 on n-h1-861111-1 Oct 12 22:21:35.336863 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-69ed34e5-2b9e-4401-a8cf-bea5db9a6c3e req-1f8e21d1-a263-4b0a-b307-674a65a75798 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076988 Oct 12 22:21:35.339529 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2892/5153] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:35.355768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3c50d58e-1b3d-4ee3-995a-fc1ad7c5b12e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:35.356839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3c50d58e-1b3d-4ee3-995a-fc1ad7c5b12e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:35.376704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c50d58e-1b3d-4ee3-995a-fc1ad7c5b12e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:35.377520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c50d58e-1b3d-4ee3-995a-fc1ad7c5b12e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:35.378134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c50d58e-1b3d-4ee3-995a-fc1ad7c5b12e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:35.379136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c50d58e-1b3d-4ee3-995a-fc1ad7c5b12e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:35.379879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c50d58e-1b3d-4ee3-995a-fc1ad7c5b12e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:35.380477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c50d58e-1b3d-4ee3-995a-fc1ad7c5b12e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:35.576925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3c50d58e-1b3d-4ee3-995a-fc1ad7c5b12e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:35.587955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3c50d58e-1b3d-4ee3-995a-fc1ad7c5b12e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:35.612454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3c50d58e-1b3d-4ee3-995a-fc1ad7c5b12e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:35.617494 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3c50d58e-1b3d-4ee3-995a-fc1ad7c5b12e tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1604 microversion: 2.42 time: 0.276563 Oct 12 22:21:35.622604 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2893/5154] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:35 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1604 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:35.628674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2b529d18-ed8e-45a9-895f-9cc5fc7b0cfc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:35.630980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2b529d18-ed8e-45a9-895f-9cc5fc7b0cfc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:35.651554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b529d18-ed8e-45a9-895f-9cc5fc7b0cfc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:35.654997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b529d18-ed8e-45a9-895f-9cc5fc7b0cfc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:35.656798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b529d18-ed8e-45a9-895f-9cc5fc7b0cfc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:35.662349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b529d18-ed8e-45a9-895f-9cc5fc7b0cfc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:35.664311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b529d18-ed8e-45a9-895f-9cc5fc7b0cfc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:35.667361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b529d18-ed8e-45a9-895f-9cc5fc7b0cfc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:35.684991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-8178ed7a-6594-49ee-9ee7-6d6b3696a57e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Updating instance_info_cache with network_info: [{"id": "6ff18597-4249-41ef-84df-7032cece1756", "address": "fa:16:3e:35:56:14", "network": {"id": "95ebd2a8-3052-4905-a297-eef07be03e1f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1378033346-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7c3184d24b3941a8b7eb9b4196469db6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6ff18597-42", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120452) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:21:35.707414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8178ed7a-6594-49ee-9ee7-6d6b3696a57e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Releasing lock "refresh_cache-7b6bc6c9-2437-4654-a89f-bf320500b7b1" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:21:35.709227 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8178ed7a-6594-49ee-9ee7-6d6b3696a57e tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "POST /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1/action" status: 202 len: 0 microversion: 2.1 time: 5.634830 Oct 12 22:21:35.715315 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2262/5155] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:21:30 2022] POST /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1/action => generated 0 bytes in 5641 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:21:35.722441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1820412750", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "093c4650-6af2-4fcf-8d18-2a7d737da20d"}]}, "os:scheduler_hints": {"group": "23b221f5-6aa7-40c5-a74c-c91b3c6b5aaa"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:35.728494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-2b529d18-ed8e-45a9-895f-9cc5fc7b0cfc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lazy-loading 'flavor' on Instance uuid 02be5cee-72e9-4cc6-94a2-c3517ec178bd {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:21:35.761148 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-2b529d18-ed8e-45a9-895f-9cc5fc7b0cfc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Cannot 'shelve' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state shelved_offloaded Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2b529d18-ed8e-45a9-895f-9cc5fc7b0cfc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action HTTP/1.1 Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 14 Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: {"shelve": {}} Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: exception: Cannot 'shelve' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state shelved_offloaded Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '02be5cee-72e9-4cc6-94a2-c3517ec178bd', 'body': {'shelve': {}}} Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 22:21:35.765046 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:21:35.770538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:21:35.770538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state shelved_offloaded Oct 12 22:21:35.770538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:35.770538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:21:35.770538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:35.770538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:21:35.770538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:21:35.770538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:21:35.770538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:21:35.770538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:21:35.770538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state shelved_offloaded Oct 12 22:21:35.770538 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:35.770538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2b529d18-ed8e-45a9-895f-9cc5fc7b0cfc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 409 to user: Cannot 'shelve' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state shelved_offloaded {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:21:35.770538 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2b529d18-ed8e-45a9-895f-9cc5fc7b0cfc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action" status: 409 len: 155 microversion: 2.1 time: 0.143852 Oct 12 22:21:35.770538 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2894/5156] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:21:35 2022] POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action => generated 155 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:21:35.779752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7815cbad-9bb6-4de4-b37d-fc2479daaf97 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:35.783850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7815cbad-9bb6-4de4-b37d-fc2479daaf97 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:35.800474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7815cbad-9bb6-4de4-b37d-fc2479daaf97 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:35.802548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7815cbad-9bb6-4de4-b37d-fc2479daaf97 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:35.803962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7815cbad-9bb6-4de4-b37d-fc2479daaf97 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:35.809348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7815cbad-9bb6-4de4-b37d-fc2479daaf97 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:35.811008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7815cbad-9bb6-4de4-b37d-fc2479daaf97 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:35.812576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7815cbad-9bb6-4de4-b37d-fc2479daaf97 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:35.855128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] validate_networks() for [('093c4650-6af2-4fcf-8d18-2a7d737da20d', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:21:36.266568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7815cbad-9bb6-4de4-b37d-fc2479daaf97 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:36.276739 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7815cbad-9bb6-4de4-b37d-fc2479daaf97 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1371 microversion: 2.1 time: 0.505946 Oct 12 22:21:36.304337 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2895/5157] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:35 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1371 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:36.309710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d62ef5c5-acf7-45f0-8a7f-06f3a3f8aaf9 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '.version_select at 0x7f5122c43d30>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:37.844266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:21:37.844754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:21:37.845218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:21:37.846397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:21:37.847144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:21:37.851154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=5 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:37.894764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:37.897250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:37.898778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:37.901288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:37.902594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:37.903130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:37.972894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for project c614ce154dd6424d8044223b671a6c73. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:21:37.988934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for user 3bf9c4a8ea974074b244abb1f026f1ff and project c614ce154dd6424d8044223b671a6c73. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:21:38.007142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:21:38.009642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:21:38.176665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for project c614ce154dd6424d8044223b671a6c73. Resources: {'server_group_members'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:21:38.194870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for user 3bf9c4a8ea974074b244abb1f026f1ff and project c614ce154dd6424d8044223b671a6c73. Resources: {'server_group_members'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:21:38.289922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for project c614ce154dd6424d8044223b671a6c73. Resources: {'server_group_members'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:21:38.296945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Getting quotas for user 3bf9c4a8ea974074b244abb1f026f1ff and project c614ce154dd6424d8044223b671a6c73. Resources: {'server_group_members'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:21:38.334502 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3202942e-ee40-4994-bd07-1ea0be8acf7c tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.617732 Oct 12 22:21:38.341235 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2263/5158] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:21:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:21:38.349063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c7ea05b6-f3aa-4d32-99ae-898b1fb44300 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:38.349854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c7ea05b6-f3aa-4d32-99ae-898b1fb44300 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:38.359376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7ea05b6-f3aa-4d32-99ae-898b1fb44300 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:38.359914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7ea05b6-f3aa-4d32-99ae-898b1fb44300 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:38.360369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7ea05b6-f3aa-4d32-99ae-898b1fb44300 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:38.361093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7ea05b6-f3aa-4d32-99ae-898b1fb44300 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:38.361552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7ea05b6-f3aa-4d32-99ae-898b1fb44300 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:38.362138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7ea05b6-f3aa-4d32-99ae-898b1fb44300 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:38.422785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c7ea05b6-f3aa-4d32-99ae-898b1fb44300 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120452) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 22:21:38.595994 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c7ea05b6-f3aa-4d32-99ae-898b1fb44300 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action" status: 202 len: 0 microversion: 2.1 time: 0.258487 Oct 12 22:21:38.597701 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2264/5159] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:21:38 2022] POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:21:38.605471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-5dd3681e-0e90-4a75-98fe-30abe292a81f req-dae06124-e7f1-4760-8ba3-d9a5b87d8337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f2400d-a508-4bfc-b84f-bc80a4c28fec", "tag": "79f72797-4736-4c93-86f4-3bf45c9f94fd"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:38.620807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5dd3681e-0e90-4a75-98fe-30abe292a81f req-dae06124-e7f1-4760-8ba3-d9a5b87d8337 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:38.621858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5dd3681e-0e90-4a75-98fe-30abe292a81f req-dae06124-e7f1-4760-8ba3-d9a5b87d8337 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:38.622386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5dd3681e-0e90-4a75-98fe-30abe292a81f req-dae06124-e7f1-4760-8ba3-d9a5b87d8337 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:38.639004 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-5dd3681e-0e90-4a75-98fe-30abe292a81f req-dae06124-e7f1-4760-8ba3-d9a5b87d8337 service nova] Creating event network-changed:79f72797-4736-4c93-86f4-3bf45c9f94fd for instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec on n-h1-861111-1 Oct 12 22:21:38.658417 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-5dd3681e-0e90-4a75-98fe-30abe292a81f req-dae06124-e7f1-4760-8ba3-d9a5b87d8337 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048736 Oct 12 22:21:38.665498 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2265/5160] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:38.683056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7be9cb17-76b0-4616-9eb2-75526052604c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:38.684369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7be9cb17-76b0-4616-9eb2-75526052604c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:38.705145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7be9cb17-76b0-4616-9eb2-75526052604c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:38.706101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7be9cb17-76b0-4616-9eb2-75526052604c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:38.709118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7be9cb17-76b0-4616-9eb2-75526052604c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:38.713890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7be9cb17-76b0-4616-9eb2-75526052604c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:38.716250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7be9cb17-76b0-4616-9eb2-75526052604c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:38.716250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7be9cb17-76b0-4616-9eb2-75526052604c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:38.881612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7be9cb17-76b0-4616-9eb2-75526052604c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:38.892524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7be9cb17-76b0-4616-9eb2-75526052604c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:38.894117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7be9cb17-76b0-4616-9eb2-75526052604c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:38.895766 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7be9cb17-76b0-4616-9eb2-75526052604c tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1604 microversion: 2.42 time: 0.227832 Oct 12 22:21:38.896523 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2266/5161] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:38 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1604 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:38.901574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1e038e4a-7e8b-4b95-a9f5-b5441d71af43 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:38.902197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1e038e4a-7e8b-4b95-a9f5-b5441d71af43 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:38.921143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e038e4a-7e8b-4b95-a9f5-b5441d71af43 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:38.922255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e038e4a-7e8b-4b95-a9f5-b5441d71af43 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:38.924291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e038e4a-7e8b-4b95-a9f5-b5441d71af43 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:38.926575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e038e4a-7e8b-4b95-a9f5-b5441d71af43 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:38.927582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e038e4a-7e8b-4b95-a9f5-b5441d71af43 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:38.928027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e038e4a-7e8b-4b95-a9f5-b5441d71af43 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:39.493206 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d62ef5c5-acf7-45f0-8a7f-06f3a3f8aaf9 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/eefc1976-5969-4013-9c8c-35ad6791e3bc" status: 202 len: 0 microversion: 2.1 time: 3.187696 Oct 12 22:21:39.494625 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2896/5162] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:21:36 2022] DELETE /compute/v2.1/os-floating-ips/eefc1976-5969-4013-9c8c-35ad6791e3bc => generated 0 bytes in 3190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:21:39.500348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e22d6fab-cee6-46b3-886e-b9219e067cc6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:39.501272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e22d6fab-cee6-46b3-886e-b9219e067cc6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:39.523229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e22d6fab-cee6-46b3-886e-b9219e067cc6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:39.525019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e22d6fab-cee6-46b3-886e-b9219e067cc6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:39.528547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e22d6fab-cee6-46b3-886e-b9219e067cc6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:39.530661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e22d6fab-cee6-46b3-886e-b9219e067cc6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:39.534729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e22d6fab-cee6-46b3-886e-b9219e067cc6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:39.535425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e22d6fab-cee6-46b3-886e-b9219e067cc6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:39.547786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1e038e4a-7e8b-4b95-a9f5-b5441d71af43 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:39.557621 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1e038e4a-7e8b-4b95-a9f5-b5441d71af43 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1371 microversion: 2.1 time: 0.660031 Oct 12 22:21:39.567210 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2267/5163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:38 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1371 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:39.581312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9515c5b6-af8d-411f-a7d6-30ce72fac990 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:39.588376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9515c5b6-af8d-411f-a7d6-30ce72fac990 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:39.607729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9515c5b6-af8d-411f-a7d6-30ce72fac990 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:39.613469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9515c5b6-af8d-411f-a7d6-30ce72fac990 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:39.614946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9515c5b6-af8d-411f-a7d6-30ce72fac990 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:39.620507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9515c5b6-af8d-411f-a7d6-30ce72fac990 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:39.621224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9515c5b6-af8d-411f-a7d6-30ce72fac990 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:39.627171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9515c5b6-af8d-411f-a7d6-30ce72fac990 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:40.153899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e22d6fab-cee6-46b3-886e-b9219e067cc6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf9c4a8ea974074b244abb1f026f1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614ce154dd6424d8044223b671a6c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:40.166958 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e22d6fab-cee6-46b3-886e-b9219e067cc6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 200 len: 1217 microversion: 2.1 time: 0.670807 Oct 12 22:21:40.183935 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2897/5164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:39 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 1217 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:40.187843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9515c5b6-af8d-411f-a7d6-30ce72fac990 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:40.190618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-847820e1-8f67-493b-b725-74b668243743 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '.version_select at 0x7f5122c43160>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:40.208374 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9515c5b6-af8d-411f-a7d6-30ce72fac990 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1459 microversion: 2.1 time: 0.639342 Oct 12 22:21:40.213746 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2268/5165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:39 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1459 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:40.224140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-82156816-ceb3-4ec7-af1e-743ea2feca83 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:40.225169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-82156816-ceb3-4ec7-af1e-743ea2feca83 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:40.243723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82156816-ceb3-4ec7-af1e-743ea2feca83 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:40.244552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82156816-ceb3-4ec7-af1e-743ea2feca83 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:40.245232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82156816-ceb3-4ec7-af1e-743ea2feca83 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:40.246247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82156816-ceb3-4ec7-af1e-743ea2feca83 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:40.246902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82156816-ceb3-4ec7-af1e-743ea2feca83 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:40.247690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82156816-ceb3-4ec7-af1e-743ea2feca83 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:40.543187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-82156816-ceb3-4ec7-af1e-743ea2feca83 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:40.565052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-82156816-ceb3-4ec7-af1e-743ea2feca83 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:40.568817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-82156816-ceb3-4ec7-af1e-743ea2feca83 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:40.581439 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-82156816-ceb3-4ec7-af1e-743ea2feca83 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1604 microversion: 2.42 time: 0.361455 Oct 12 22:21:40.585058 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2269/5166] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:40 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1604 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:40.612282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-11f911ac-7c95-4b7f-96be-79988cc0838f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:40.613239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-11f911ac-7c95-4b7f-96be-79988cc0838f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:40.636887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11f911ac-7c95-4b7f-96be-79988cc0838f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:40.640135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11f911ac-7c95-4b7f-96be-79988cc0838f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:40.640758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11f911ac-7c95-4b7f-96be-79988cc0838f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:40.642374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11f911ac-7c95-4b7f-96be-79988cc0838f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:40.645574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11f911ac-7c95-4b7f-96be-79988cc0838f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:40.646351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11f911ac-7c95-4b7f-96be-79988cc0838f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:41.118806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-11f911ac-7c95-4b7f-96be-79988cc0838f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:41.130192 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-11f911ac-7c95-4b7f-96be-79988cc0838f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1371 microversion: 2.1 time: 0.543405 Oct 12 22:21:41.131204 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2270/5167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:40 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1371 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:41.202745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e1931667-ca61-4aa0-a2ec-44329f16abf6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:41.203483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e1931667-ca61-4aa0-a2ec-44329f16abf6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:41.218729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1931667-ca61-4aa0-a2ec-44329f16abf6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:41.219565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1931667-ca61-4aa0-a2ec-44329f16abf6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:41.221084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1931667-ca61-4aa0-a2ec-44329f16abf6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:41.221994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1931667-ca61-4aa0-a2ec-44329f16abf6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:41.223927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1931667-ca61-4aa0-a2ec-44329f16abf6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:41.225878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1931667-ca61-4aa0-a2ec-44329f16abf6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:41.274139 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-847820e1-8f67-493b-b725-74b668243743 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/f9458e64-d80e-4e7e-96d7-9e8165b73c47" status: 202 len: 0 microversion: 2.1 time: 1.088703 Oct 12 22:21:41.275401 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2898/5168] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 22:21:40 2022] DELETE /compute/v2.1/os-security-groups/f9458e64-d80e-4e7e-96d7-9e8165b73c47 => generated 0 bytes in 1091 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:21:41.281930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9a36326a-5000-494f-ad0c-f824e0bc5057 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:41.282899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9a36326a-5000-494f-ad0c-f824e0bc5057 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:41.298897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a36326a-5000-494f-ad0c-f824e0bc5057 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:41.304027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a36326a-5000-494f-ad0c-f824e0bc5057 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:41.304762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a36326a-5000-494f-ad0c-f824e0bc5057 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:41.305727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a36326a-5000-494f-ad0c-f824e0bc5057 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:41.306545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a36326a-5000-494f-ad0c-f824e0bc5057 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:41.309088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a36326a-5000-494f-ad0c-f824e0bc5057 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:41.345566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:41.409810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e1931667-ca61-4aa0-a2ec-44329f16abf6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf9c4a8ea974074b244abb1f026f1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614ce154dd6424d8044223b671a6c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:41.414773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:41.431691 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e1931667-ca61-4aa0-a2ec-44329f16abf6 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 200 len: 1271 microversion: 2.1 time: 0.244616 Oct 12 22:21:41.437871 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2271/5169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:41 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:21:41.460514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-271f9d39-3b1b-4194-a463-423193861d5b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:41.465232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-271f9d39-3b1b-4194-a463-423193861d5b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:41.490474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-271f9d39-3b1b-4194-a463-423193861d5b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:41.492891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-271f9d39-3b1b-4194-a463-423193861d5b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:41.493517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-271f9d39-3b1b-4194-a463-423193861d5b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:41.494652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-271f9d39-3b1b-4194-a463-423193861d5b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:41.495301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-271f9d39-3b1b-4194-a463-423193861d5b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:41.495980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-271f9d39-3b1b-4194-a463-423193861d5b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:41.550479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-271f9d39-3b1b-4194-a463-423193861d5b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:21:41.817410 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-271f9d39-3b1b-4194-a463-423193861d5b tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 204 len: 0 microversion: 2.1 time: 0.373414 Oct 12 22:21:41.818476 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2272/5170] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:21:41 2022] DELETE /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:21:41.831173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e8eb8e70-17d4-4a19-8f5d-957b5f059d94 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:41.831973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e8eb8e70-17d4-4a19-8f5d-957b5f059d94 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:41.846877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8eb8e70-17d4-4a19-8f5d-957b5f059d94 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:41.847659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8eb8e70-17d4-4a19-8f5d-957b5f059d94 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:41.848264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8eb8e70-17d4-4a19-8f5d-957b5f059d94 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:41.849158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8eb8e70-17d4-4a19-8f5d-957b5f059d94 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:41.849755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8eb8e70-17d4-4a19-8f5d-957b5f059d94 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:41.850336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8eb8e70-17d4-4a19-8f5d-957b5f059d94 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:41.996656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e8eb8e70-17d4-4a19-8f5d-957b5f059d94 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:42.011627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e8eb8e70-17d4-4a19-8f5d-957b5f059d94 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:42.013676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e8eb8e70-17d4-4a19-8f5d-957b5f059d94 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:42.016117 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e8eb8e70-17d4-4a19-8f5d-957b5f059d94 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1604 microversion: 2.42 time: 0.195389 Oct 12 22:21:42.016903 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2273/5171] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:41 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1604 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:42.033122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4c290a5c-b9d5-4193-bd14-0b94bb016e7f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:42.034150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4c290a5c-b9d5-4193-bd14-0b94bb016e7f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:42.050843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c290a5c-b9d5-4193-bd14-0b94bb016e7f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:42.051373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c290a5c-b9d5-4193-bd14-0b94bb016e7f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:42.056074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c290a5c-b9d5-4193-bd14-0b94bb016e7f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:42.057230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c290a5c-b9d5-4193-bd14-0b94bb016e7f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:42.057725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c290a5c-b9d5-4193-bd14-0b94bb016e7f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:42.058170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c290a5c-b9d5-4193-bd14-0b94bb016e7f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:42.432000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9a36326a-5000-494f-ad0c-f824e0bc5057 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:42.459794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4c290a5c-b9d5-4193-bd14-0b94bb016e7f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:42.461640 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9a36326a-5000-494f-ad0c-f824e0bc5057 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1459 microversion: 2.1 time: 1.184537 Oct 12 22:21:42.469384 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2899/5172] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:41 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1459 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:42.484681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e630d590-f113-4f73-bde7-53e293bec5f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:42.485751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e630d590-f113-4f73-bde7-53e293bec5f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:42.486456 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4c290a5c-b9d5-4193-bd14-0b94bb016e7f tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1510 microversion: 2.1 time: 0.467564 Oct 12 22:21:42.487046 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2274/5173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:42 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1510 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:42.499131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ba02e6db-9dd2-4e40-8bf1-6a40021b86ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:42.502638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ba02e6db-9dd2-4e40-8bf1-6a40021b86ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:42.516289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e630d590-f113-4f73-bde7-53e293bec5f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:42.517195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e630d590-f113-4f73-bde7-53e293bec5f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:42.518002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e630d590-f113-4f73-bde7-53e293bec5f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:42.519744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e630d590-f113-4f73-bde7-53e293bec5f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:42.520555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e630d590-f113-4f73-bde7-53e293bec5f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:42.521172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e630d590-f113-4f73-bde7-53e293bec5f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:42.524889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba02e6db-9dd2-4e40-8bf1-6a40021b86ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:42.525399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba02e6db-9dd2-4e40-8bf1-6a40021b86ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:42.525841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba02e6db-9dd2-4e40-8bf1-6a40021b86ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:42.526553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba02e6db-9dd2-4e40-8bf1-6a40021b86ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:42.527004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba02e6db-9dd2-4e40-8bf1-6a40021b86ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:42.527650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba02e6db-9dd2-4e40-8bf1-6a40021b86ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:42.551449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=32 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:42.942458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba02e6db-9dd2-4e40-8bf1-6a40021b86ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf9c4a8ea974074b244abb1f026f1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614ce154dd6424d8044223b671a6c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:42.953509 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ba02e6db-9dd2-4e40-8bf1-6a40021b86ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 200 len: 1313 microversion: 2.1 time: 0.460108 Oct 12 22:21:42.954867 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2275/5174] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:42 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 1313 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:42.967029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e630d590-f113-4f73-bde7-53e293bec5f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:42.979663 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e630d590-f113-4f73-bde7-53e293bec5f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1371 microversion: 2.1 time: 0.502181 Oct 12 22:21:42.996511 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2900/5175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:42 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1371 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:43.042112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-79641551-c460-4550-a014-7c7c608a3eee tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:43.042959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-79641551-c460-4550-a014-7c7c608a3eee tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:43.053113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79641551-c460-4550-a014-7c7c608a3eee tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:43.053309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79641551-c460-4550-a014-7c7c608a3eee tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:43.053753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79641551-c460-4550-a014-7c7c608a3eee tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:43.054474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79641551-c460-4550-a014-7c7c608a3eee tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:43.055038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79641551-c460-4550-a014-7c7c608a3eee tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:43.059133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79641551-c460-4550-a014-7c7c608a3eee tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:43.263513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-79641551-c460-4550-a014-7c7c608a3eee tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:43.275913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-79641551-c460-4550-a014-7c7c608a3eee tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:43.277619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-79641551-c460-4550-a014-7c7c608a3eee tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:43.278821 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-79641551-c460-4550-a014-7c7c608a3eee tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1604 microversion: 2.42 time: 0.240811 Oct 12 22:21:43.292209 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2276/5176] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:43 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1604 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:43.503857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5b41aae4-2ad2-41ef-9db0-94de2f1ba176 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:43.505544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5b41aae4-2ad2-41ef-9db0-94de2f1ba176 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:43.516174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:43.518649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c84e583b-264a-42af-8930-2431c2c171b5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:43.520852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c84e583b-264a-42af-8930-2431c2c171b5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:43.528833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c84e583b-264a-42af-8930-2431c2c171b5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:43.532418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b41aae4-2ad2-41ef-9db0-94de2f1ba176 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:43.533147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c84e583b-264a-42af-8930-2431c2c171b5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:43.534453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c84e583b-264a-42af-8930-2431c2c171b5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:43.535854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b41aae4-2ad2-41ef-9db0-94de2f1ba176 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:43.537444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b41aae4-2ad2-41ef-9db0-94de2f1ba176 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:43.537740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c84e583b-264a-42af-8930-2431c2c171b5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:43.538411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c84e583b-264a-42af-8930-2431c2c171b5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:43.540842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b41aae4-2ad2-41ef-9db0-94de2f1ba176 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:43.541889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b41aae4-2ad2-41ef-9db0-94de2f1ba176 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:43.542351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b41aae4-2ad2-41ef-9db0-94de2f1ba176 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:43.542967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c84e583b-264a-42af-8930-2431c2c171b5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:43.920824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c84e583b-264a-42af-8930-2431c2c171b5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:43.931808 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c84e583b-264a-42af-8930-2431c2c171b5 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1510 microversion: 2.1 time: 0.420533 Oct 12 22:21:43.932944 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2277/5177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:43 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1510 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:43.981310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb643fcd-f766-48bf-bcd3-822e6b31053e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:43.981999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eb643fcd-f766-48bf-bcd3-822e6b31053e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:43.992824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb643fcd-f766-48bf-bcd3-822e6b31053e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:43.994556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb643fcd-f766-48bf-bcd3-822e6b31053e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:44.000614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb643fcd-f766-48bf-bcd3-822e6b31053e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:44.001747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb643fcd-f766-48bf-bcd3-822e6b31053e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:44.002253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb643fcd-f766-48bf-bcd3-822e6b31053e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:44.002915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb643fcd-f766-48bf-bcd3-822e6b31053e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:44.063076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5b41aae4-2ad2-41ef-9db0-94de2f1ba176 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:44.079468 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5b41aae4-2ad2-41ef-9db0-94de2f1ba176 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1517 microversion: 2.1 time: 0.591480 Oct 12 22:21:44.083251 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2901/5178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:43 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1517 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:44.097259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9832e277-3af8-446b-b64b-e361c44f200e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:44.097905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9832e277-3af8-446b-b64b-e361c44f200e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:44.114458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9832e277-3af8-446b-b64b-e361c44f200e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:44.115023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9832e277-3af8-446b-b64b-e361c44f200e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:44.115513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9832e277-3af8-446b-b64b-e361c44f200e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:44.119065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9832e277-3af8-446b-b64b-e361c44f200e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:44.119592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9832e277-3af8-446b-b64b-e361c44f200e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:44.120042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9832e277-3af8-446b-b64b-e361c44f200e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:44.389924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eb643fcd-f766-48bf-bcd3-822e6b31053e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf9c4a8ea974074b244abb1f026f1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614ce154dd6424d8044223b671a6c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:44.400071 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb643fcd-f766-48bf-bcd3-822e6b31053e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 200 len: 1313 microversion: 2.1 time: 0.423931 Oct 12 22:21:44.408357 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2278/5179] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:43 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:44.427254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-33248fca-af98-46a3-861f-5a91816b93ef tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:44.428542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-33248fca-af98-46a3-861f-5a91816b93ef tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:44.439752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33248fca-af98-46a3-861f-5a91816b93ef tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:44.449015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33248fca-af98-46a3-861f-5a91816b93ef tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:44.449864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33248fca-af98-46a3-861f-5a91816b93ef tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:44.450920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33248fca-af98-46a3-861f-5a91816b93ef tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:44.451673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33248fca-af98-46a3-861f-5a91816b93ef tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:44.452339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33248fca-af98-46a3-861f-5a91816b93ef tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:44.616700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9832e277-3af8-446b-b64b-e361c44f200e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:44.627879 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9832e277-3af8-446b-b64b-e361c44f200e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1371 microversion: 2.1 time: 0.542678 Oct 12 22:21:44.644553 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2902/5180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:44 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1371 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:44.651398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-072372fe-777a-45b6-bb2a-dc6f3fd8b8ad req-db47dfc5-3387-4210-b033-e132c3274f23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed750853-d405-48c3-a083-6ffda832e5dc", "tag": "c3c32171-ff90-4513-ae26-85b7f6ebf0f8"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:44.702803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-072372fe-777a-45b6-bb2a-dc6f3fd8b8ad req-db47dfc5-3387-4210-b033-e132c3274f23 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:44.704100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-072372fe-777a-45b6-bb2a-dc6f3fd8b8ad req-db47dfc5-3387-4210-b033-e132c3274f23 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:44.704788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-072372fe-777a-45b6-bb2a-dc6f3fd8b8ad req-db47dfc5-3387-4210-b033-e132c3274f23 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:44.724222 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-072372fe-777a-45b6-bb2a-dc6f3fd8b8ad req-db47dfc5-3387-4210-b033-e132c3274f23 service nova] Creating event network-changed:c3c32171-ff90-4513-ae26-85b7f6ebf0f8 for instance ed750853-d405-48c3-a083-6ffda832e5dc on n-h2-861111-1 Oct 12 22:21:44.729659 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-072372fe-777a-45b6-bb2a-dc6f3fd8b8ad req-db47dfc5-3387-4210-b033-e132c3274f23 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083066 Oct 12 22:21:44.731381 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2903/5181] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:44.753445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-33248fca-af98-46a3-861f-5a91816b93ef tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:44.770747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-33248fca-af98-46a3-861f-5a91816b93ef tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:44.773271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-33248fca-af98-46a3-861f-5a91816b93ef tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:44.779120 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-33248fca-af98-46a3-861f-5a91816b93ef tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1604 microversion: 2.42 time: 0.369350 Oct 12 22:21:44.801504 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2279/5182] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:44 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1604 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:44.962770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-91f0ef48-70db-4fde-bf3e-99f5c7836407 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:44.963942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-91f0ef48-70db-4fde-bf3e-99f5c7836407 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:44.976572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91f0ef48-70db-4fde-bf3e-99f5c7836407 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:44.979339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91f0ef48-70db-4fde-bf3e-99f5c7836407 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:44.980039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91f0ef48-70db-4fde-bf3e-99f5c7836407 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:44.981333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91f0ef48-70db-4fde-bf3e-99f5c7836407 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:44.984805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91f0ef48-70db-4fde-bf3e-99f5c7836407 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:44.985444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91f0ef48-70db-4fde-bf3e-99f5c7836407 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:45.108896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-14fe6ac0-2588-4249-bb84-1fdecaf5545e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:45.109639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-14fe6ac0-2588-4249-bb84-1fdecaf5545e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:45.132596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14fe6ac0-2588-4249-bb84-1fdecaf5545e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:45.133122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14fe6ac0-2588-4249-bb84-1fdecaf5545e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:45.133574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14fe6ac0-2588-4249-bb84-1fdecaf5545e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:45.134309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14fe6ac0-2588-4249-bb84-1fdecaf5545e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:45.143641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14fe6ac0-2588-4249-bb84-1fdecaf5545e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:45.144195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14fe6ac0-2588-4249-bb84-1fdecaf5545e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:45.274389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-91f0ef48-70db-4fde-bf3e-99f5c7836407 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:45.286305 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-91f0ef48-70db-4fde-bf3e-99f5c7836407 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1510 microversion: 2.1 time: 0.328368 Oct 12 22:21:45.307106 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2904/5183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:44 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1510 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:45.434887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6d2f25c6-7e80-42a2-91c0-cbb7beb72623 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:45.436321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6d2f25c6-7e80-42a2-91c0-cbb7beb72623 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:45.461372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d2f25c6-7e80-42a2-91c0-cbb7beb72623 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:45.469784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d2f25c6-7e80-42a2-91c0-cbb7beb72623 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:45.472337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d2f25c6-7e80-42a2-91c0-cbb7beb72623 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:45.473347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d2f25c6-7e80-42a2-91c0-cbb7beb72623 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:45.477562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d2f25c6-7e80-42a2-91c0-cbb7beb72623 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:45.479358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d2f25c6-7e80-42a2-91c0-cbb7beb72623 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:45.819013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6d2f25c6-7e80-42a2-91c0-cbb7beb72623 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf9c4a8ea974074b244abb1f026f1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614ce154dd6424d8044223b671a6c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:45.832559 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6d2f25c6-7e80-42a2-91c0-cbb7beb72623 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 200 len: 1313 microversion: 2.1 time: 0.402964 Oct 12 22:21:45.838990 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2905/5184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:45 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:45.854106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-98b7ae39-0d98-4645-bcba-bf6d904fc716 req-4c6c2db8-43c1-40c3-8006-5359002d7cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f2400d-a508-4bfc-b84f-bc80a4c28fec", "name": "network-vif-plugged", "status": "completed", "tag": "79f72797-4736-4c93-86f4-3bf45c9f94fd"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:45.867657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-98b7ae39-0d98-4645-bcba-bf6d904fc716 req-4c6c2db8-43c1-40c3-8006-5359002d7cf1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:45.868854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-98b7ae39-0d98-4645-bcba-bf6d904fc716 req-4c6c2db8-43c1-40c3-8006-5359002d7cf1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:45.869518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-98b7ae39-0d98-4645-bcba-bf6d904fc716 req-4c6c2db8-43c1-40c3-8006-5359002d7cf1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:45.893363 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-98b7ae39-0d98-4645-bcba-bf6d904fc716 req-4c6c2db8-43c1-40c3-8006-5359002d7cf1 service nova] Creating event network-vif-plugged:79f72797-4736-4c93-86f4-3bf45c9f94fd for instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec on n-h1-861111-1 Oct 12 22:21:45.901890 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-98b7ae39-0d98-4645-bcba-bf6d904fc716 req-4c6c2db8-43c1-40c3-8006-5359002d7cf1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061369 Oct 12 22:21:45.903355 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2906/5185] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:45.914072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1f07927c-0ed5-4a0c-bbd5-e22b2299b350 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:45.915558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1f07927c-0ed5-4a0c-bbd5-e22b2299b350 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:45.924240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f07927c-0ed5-4a0c-bbd5-e22b2299b350 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:45.925552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f07927c-0ed5-4a0c-bbd5-e22b2299b350 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:45.926224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f07927c-0ed5-4a0c-bbd5-e22b2299b350 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:45.927314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f07927c-0ed5-4a0c-bbd5-e22b2299b350 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:45.928414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f07927c-0ed5-4a0c-bbd5-e22b2299b350 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:45.929380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f07927c-0ed5-4a0c-bbd5-e22b2299b350 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:46.218970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-14fe6ac0-2588-4249-bb84-1fdecaf5545e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:46.232909 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-14fe6ac0-2588-4249-bb84-1fdecaf5545e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1517 microversion: 2.1 time: 1.128337 Oct 12 22:21:46.233896 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2280/5186] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:45 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1517 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:46.245016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-1d7b75b8-7fa7-4a03-bcda-e1736c168bc7 req-72651c5b-48a4-4850-96b1-327a2d839cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b6bc6c9-2437-4654-a89f-bf320500b7b1", "name": "network-vif-deleted", "tag": "6ff18597-4249-41ef-84df-7032cece1756"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:46.271109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1f07927c-0ed5-4a0c-bbd5-e22b2299b350 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:46.273572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1d7b75b8-7fa7-4a03-bcda-e1736c168bc7 req-72651c5b-48a4-4850-96b1-327a2d839cb1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:46.274272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1d7b75b8-7fa7-4a03-bcda-e1736c168bc7 req-72651c5b-48a4-4850-96b1-327a2d839cb1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:46.274881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1d7b75b8-7fa7-4a03-bcda-e1736c168bc7 req-72651c5b-48a4-4850-96b1-327a2d839cb1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:46.283322 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1f07927c-0ed5-4a0c-bbd5-e22b2299b350 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1371 microversion: 2.1 time: 0.372559 Oct 12 22:21:46.284955 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2907/5187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:45 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1371 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:46.292984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dc1fa3b8-6387-4f03-90d6-f9f97b624337 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:46.293921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dc1fa3b8-6387-4f03-90d6-f9f97b624337 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:46.308384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc1fa3b8-6387-4f03-90d6-f9f97b624337 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:46.314233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc1fa3b8-6387-4f03-90d6-f9f97b624337 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:46.315269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc1fa3b8-6387-4f03-90d6-f9f97b624337 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:46.316326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc1fa3b8-6387-4f03-90d6-f9f97b624337 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:46.317022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc1fa3b8-6387-4f03-90d6-f9f97b624337 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:46.317342 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-1d7b75b8-7fa7-4a03-bcda-e1736c168bc7 req-72651c5b-48a4-4850-96b1-327a2d839cb1 service nova] Creating event network-vif-deleted:6ff18597-4249-41ef-84df-7032cece1756 for instance 7b6bc6c9-2437-4654-a89f-bf320500b7b1 on n-h1-861111-1 Oct 12 22:21:46.320575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc1fa3b8-6387-4f03-90d6-f9f97b624337 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:46.324082 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-1d7b75b8-7fa7-4a03-bcda-e1736c168bc7 req-72651c5b-48a4-4850-96b1-327a2d839cb1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088239 Oct 12 22:21:46.324893 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2281/5188] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:46.330997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b9f9d5d5-4d7f-4d68-b59e-87881e325e76 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:46.332514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b9f9d5d5-4d7f-4d68-b59e-87881e325e76 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:46.340846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9f9d5d5-4d7f-4d68-b59e-87881e325e76 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:46.341529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9f9d5d5-4d7f-4d68-b59e-87881e325e76 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:46.343126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9f9d5d5-4d7f-4d68-b59e-87881e325e76 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:46.344039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9f9d5d5-4d7f-4d68-b59e-87881e325e76 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:46.344659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9f9d5d5-4d7f-4d68-b59e-87881e325e76 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:46.345530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9f9d5d5-4d7f-4d68-b59e-87881e325e76 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:46.382772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9f9d5d5-4d7f-4d68-b59e-87881e325e76 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:46.383553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9f9d5d5-4d7f-4d68-b59e-87881e325e76 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:46.384141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9f9d5d5-4d7f-4d68-b59e-87881e325e76 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:46.384743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-b9f9d5d5-4d7f-4d68-b59e-87881e325e76 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lazy-loading 'fault' on Instance uuid 7b6bc6c9-2437-4654-a89f-bf320500b7b1 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:21:46.460386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dc1fa3b8-6387-4f03-90d6-f9f97b624337 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:46.478097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dc1fa3b8-6387-4f03-90d6-f9f97b624337 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:46.480048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dc1fa3b8-6387-4f03-90d6-f9f97b624337 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:46.481459 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dc1fa3b8-6387-4f03-90d6-f9f97b624337 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1604 microversion: 2.42 time: 0.195288 Oct 12 22:21:46.485310 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2908/5189] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:46 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1604 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:46.537061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b9f9d5d5-4d7f-4d68-b59e-87881e325e76 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d95a9556e14cecb4a80265aa2dc322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3184d24b3941a8b7eb9b4196469db6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:46.546804 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b9f9d5d5-4d7f-4d68-b59e-87881e325e76 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 200 len: 1313 microversion: 2.1 time: 0.220024 Oct 12 22:21:46.549696 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2282/5190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:46 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:46.863543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c68553c4-811e-4f85-a0c4-23704ea63d71 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:46.865646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c68553c4-811e-4f85-a0c4-23704ea63d71 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:46.884501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c68553c4-811e-4f85-a0c4-23704ea63d71 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:46.886480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c68553c4-811e-4f85-a0c4-23704ea63d71 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:46.887201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c68553c4-811e-4f85-a0c4-23704ea63d71 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:46.888402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c68553c4-811e-4f85-a0c4-23704ea63d71 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:46.891517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c68553c4-811e-4f85-a0c4-23704ea63d71 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:46.893168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c68553c4-811e-4f85-a0c4-23704ea63d71 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:47.136446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c68553c4-811e-4f85-a0c4-23704ea63d71 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf9c4a8ea974074b244abb1f026f1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614ce154dd6424d8044223b671a6c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:47.151268 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c68553c4-811e-4f85-a0c4-23704ea63d71 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 200 len: 1313 microversion: 2.1 time: 0.290580 Oct 12 22:21:47.152663 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2909/5191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:46 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:47.257772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-61faaae0-9abd-4db0-99c2-70a06f4ee098 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:47.258382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-61faaae0-9abd-4db0-99c2-70a06f4ee098 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:47.268380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61faaae0-9abd-4db0-99c2-70a06f4ee098 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:47.269199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61faaae0-9abd-4db0-99c2-70a06f4ee098 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:47.269898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61faaae0-9abd-4db0-99c2-70a06f4ee098 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:47.270805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61faaae0-9abd-4db0-99c2-70a06f4ee098 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:47.271588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61faaae0-9abd-4db0-99c2-70a06f4ee098 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:47.272140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61faaae0-9abd-4db0-99c2-70a06f4ee098 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:47.316437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-44897ebf-1c2f-49ec-91ce-2ef38345e9da tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:47.317268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-44897ebf-1c2f-49ec-91ce-2ef38345e9da tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:47.324943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44897ebf-1c2f-49ec-91ce-2ef38345e9da tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:47.332174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44897ebf-1c2f-49ec-91ce-2ef38345e9da tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:47.333057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44897ebf-1c2f-49ec-91ce-2ef38345e9da tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:47.333969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44897ebf-1c2f-49ec-91ce-2ef38345e9da tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:47.334727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44897ebf-1c2f-49ec-91ce-2ef38345e9da tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:47.335395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-44897ebf-1c2f-49ec-91ce-2ef38345e9da tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:47.557095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-44897ebf-1c2f-49ec-91ce-2ef38345e9da tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:47.565591 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-44897ebf-1c2f-49ec-91ce-2ef38345e9da tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1371 microversion: 2.1 time: 0.253034 Oct 12 22:21:47.566183 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2910/5192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:47 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:47.577949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f1393a1e-a732-4fe7-8cd6-16351c892946 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:47.578575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f1393a1e-a732-4fe7-8cd6-16351c892946 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:47.595044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1393a1e-a732-4fe7-8cd6-16351c892946 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:47.598349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1393a1e-a732-4fe7-8cd6-16351c892946 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:47.599387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1393a1e-a732-4fe7-8cd6-16351c892946 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:47.601249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1393a1e-a732-4fe7-8cd6-16351c892946 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:47.601919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1393a1e-a732-4fe7-8cd6-16351c892946 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:47.603015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1393a1e-a732-4fe7-8cd6-16351c892946 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:47.713153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f1393a1e-a732-4fe7-8cd6-16351c892946 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:47.726650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f1393a1e-a732-4fe7-8cd6-16351c892946 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:47.728905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f1393a1e-a732-4fe7-8cd6-16351c892946 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:47.730075 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f1393a1e-a732-4fe7-8cd6-16351c892946 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1604 microversion: 2.42 time: 0.162974 Oct 12 22:21:47.731577 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2911/5193] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:47 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1604 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:47.737231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eb024775-df3b-4bbe-af3a-402cfe8661d2 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:47.738054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eb024775-df3b-4bbe-af3a-402cfe8661d2 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] [instance: 7b6bc6c9-2437-4654-a89f-bf320500b7b1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:47.765704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb024775-df3b-4bbe-af3a-402cfe8661d2 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:47.766636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb024775-df3b-4bbe-af3a-402cfe8661d2 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:47.767523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb024775-df3b-4bbe-af3a-402cfe8661d2 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:47.768490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb024775-df3b-4bbe-af3a-402cfe8661d2 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:47.769271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb024775-df3b-4bbe-af3a-402cfe8661d2 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:47.769949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb024775-df3b-4bbe-af3a-402cfe8661d2 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:47.784450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-61faaae0-9abd-4db0-99c2-70a06f4ee098 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:47.796209 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-61faaae0-9abd-4db0-99c2-70a06f4ee098 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1517 microversion: 2.1 time: 0.542204 Oct 12 22:21:47.797828 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-eb024775-df3b-4bbe-af3a-402cfe8661d2 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] HTTP exception thrown: Instance 7b6bc6c9-2437-4654-a89f-bf320500b7b1 could not be found. Oct 12 22:21:47.798565 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2283/5194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:47 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1517 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eb024775-df3b-4bbe-af3a-402cfe8661d2 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Request method failure captured: Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 HTTP/1.1 Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz2bgXiyI1YqBSsxYh9jJVtSMa_Y3zFzIpN0aQRlXV-7eMgT_j4kxD053D5a9bobmDGu3qmcpm4DRz4k0Ch1sYutM49YCLx832ungMda_TblsisACxwOstiWObe2FHRNEodIjyieKdbr5zaH25c1Y_knhR41RFeRYGvR0M-Y_Novt_s Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7c3184d24b3941a8b7eb9b4196469db6 Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1549447967 Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c3184d24b3941a8b7eb9b4196469db6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c3184d24b3941a8b7eb9b4196469db6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7c3184d24b3941a8b7eb9b4196469db6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7c3184d24b3941a8b7eb9b4196469db6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1549447967 Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7c3184d24b3941a8b7eb9b4196469db6 Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1549447967 Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerRescueTestJSONUnderV235-1549447967-project Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 16d95a9556e14cecb4a80265aa2dc322 Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1549447967-project Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 7b6bc6c9-2437-4654-a89f-bf320500b7b1 could not be found. Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '7b6bc6c9-2437-4654-a89f-bf320500b7b1'} Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b6bc6c9-2437-4654-a89f-bf320500b7b1 could not be found. Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b6bc6c9-2437-4654-a89f-bf320500b7b1 could not be found. Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:47.800219 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:21:47.805251 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:47.805251 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:21:47.805251 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:21:47.805251 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:21:47.805251 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:21:47.805251 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:21:47.805251 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b6bc6c9-2437-4654-a89f-bf320500b7b1 could not be found. Oct 12 22:21:47.805251 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:47.806778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eb024775-df3b-4bbe-af3a-402cfe8661d2 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] Returning 404 to user: Instance 7b6bc6c9-2437-4654-a89f-bf320500b7b1 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:21:47.808233 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eb024775-df3b-4bbe-af3a-402cfe8661d2 tempest-ServerRescueTestJSONUnderV235-1549447967 tempest-ServerRescueTestJSONUnderV235-1549447967-project] 10.222.0.16 "GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1" status: 404 len: 111 microversion: 2.1 time: 0.074724 Oct 12 22:21:47.809698 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2912/5195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:47 2022] GET /compute/v2.1/servers/7b6bc6c9-2437-4654-a89f-bf320500b7b1 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:21:48.176917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2466b498-07fe-4da0-a82a-60d32531f405 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:48.177664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2466b498-07fe-4da0-a82a-60d32531f405 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:48.187501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:48.189136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2466b498-07fe-4da0-a82a-60d32531f405 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:48.189668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2466b498-07fe-4da0-a82a-60d32531f405 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:48.193805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2466b498-07fe-4da0-a82a-60d32531f405 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:48.194871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2466b498-07fe-4da0-a82a-60d32531f405 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:48.195533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2466b498-07fe-4da0-a82a-60d32531f405 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:48.196207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2466b498-07fe-4da0-a82a-60d32531f405 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:48.305033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=28 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:48.334203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-34372ac9-72a9-49bf-a7cf-cb9540807ea6 req-fb169ad8-376e-48f2-9bbc-4878569eec49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02be5cee-72e9-4cc6-94a2-c3517ec178bd", "tag": "ba67b2ed-d4b3-4942-b9cd-37eda012789a"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:48.347432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-34372ac9-72a9-49bf-a7cf-cb9540807ea6 req-fb169ad8-376e-48f2-9bbc-4878569eec49 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:48.347922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-34372ac9-72a9-49bf-a7cf-cb9540807ea6 req-fb169ad8-376e-48f2-9bbc-4878569eec49 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:48.348357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-34372ac9-72a9-49bf-a7cf-cb9540807ea6 req-fb169ad8-376e-48f2-9bbc-4878569eec49 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:48.395774 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-34372ac9-72a9-49bf-a7cf-cb9540807ea6 req-fb169ad8-376e-48f2-9bbc-4878569eec49 service nova] Creating event network-changed:ba67b2ed-d4b3-4942-b9cd-37eda012789a for instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd on n-h1-861111-1 Oct 12 22:21:48.400929 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-34372ac9-72a9-49bf-a7cf-cb9540807ea6 req-fb169ad8-376e-48f2-9bbc-4878569eec49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070881 Oct 12 22:21:48.405866 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2913/5196] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:21:48.593976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6b20bb41-eb2d-4a71-bc28-51045f697f8c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:48.595179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6b20bb41-eb2d-4a71-bc28-51045f697f8c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:48.606402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b20bb41-eb2d-4a71-bc28-51045f697f8c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:48.609380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b20bb41-eb2d-4a71-bc28-51045f697f8c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:48.610865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b20bb41-eb2d-4a71-bc28-51045f697f8c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:48.612512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b20bb41-eb2d-4a71-bc28-51045f697f8c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:48.615114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b20bb41-eb2d-4a71-bc28-51045f697f8c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:48.615804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b20bb41-eb2d-4a71-bc28-51045f697f8c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:48.796708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2466b498-07fe-4da0-a82a-60d32531f405 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf9c4a8ea974074b244abb1f026f1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614ce154dd6424d8044223b671a6c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:48.807892 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2466b498-07fe-4da0-a82a-60d32531f405 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 200 len: 1313 microversion: 2.1 time: 0.635187 Oct 12 22:21:48.809091 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2284/5197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:48 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 1313 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:48.836502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-de363a08-4de1-4387-85f7-66573310a8ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:48.837657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-de363a08-4de1-4387-85f7-66573310a8ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:48.853419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de363a08-4de1-4387-85f7-66573310a8ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:48.856319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de363a08-4de1-4387-85f7-66573310a8ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:48.858634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de363a08-4de1-4387-85f7-66573310a8ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:48.860675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de363a08-4de1-4387-85f7-66573310a8ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:48.862443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de363a08-4de1-4387-85f7-66573310a8ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:48.863130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de363a08-4de1-4387-85f7-66573310a8ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:49.095636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-de363a08-4de1-4387-85f7-66573310a8ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:49.099437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6b20bb41-eb2d-4a71-bc28-51045f697f8c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:49.111691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-de363a08-4de1-4387-85f7-66573310a8ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:49.115589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-de363a08-4de1-4387-85f7-66573310a8ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'def9100040524da08268b700ba75c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f247890f1bf4ff29af359f4d1cd405c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:49.118669 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-de363a08-4de1-4387-85f7-66573310a8ff tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 200 len: 1604 microversion: 2.42 time: 0.308380 Oct 12 22:21:49.120566 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2285/5198] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:48 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 1604 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:49.132014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8cf4e8f1-fab9-4e19-9bf6-f6e65bb1a85e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:49.132754 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6b20bb41-eb2d-4a71-bc28-51045f697f8c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1565 microversion: 2.1 time: 0.530050 Oct 12 22:21:49.133844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8cf4e8f1-fab9-4e19-9bf6-f6e65bb1a85e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:49.144121 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2914/5199] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:48 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1565 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:49.149295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cf4e8f1-fab9-4e19-9bf6-f6e65bb1a85e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:49.151069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cf4e8f1-fab9-4e19-9bf6-f6e65bb1a85e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:49.152104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cf4e8f1-fab9-4e19-9bf6-f6e65bb1a85e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:49.156983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cf4e8f1-fab9-4e19-9bf6-f6e65bb1a85e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:49.158823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cf4e8f1-fab9-4e19-9bf6-f6e65bb1a85e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:49.159426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8cf4e8f1-fab9-4e19-9bf6-f6e65bb1a85e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:49.171294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8255fc2d-c521-4acd-9ffe-903b1c9e88e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:49.172807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8255fc2d-c521-4acd-9ffe-903b1c9e88e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:49.197316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8255fc2d-c521-4acd-9ffe-903b1c9e88e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:49.197834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8255fc2d-c521-4acd-9ffe-903b1c9e88e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:49.198283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8255fc2d-c521-4acd-9ffe-903b1c9e88e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:49.212517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8255fc2d-c521-4acd-9ffe-903b1c9e88e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:49.213454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8255fc2d-c521-4acd-9ffe-903b1c9e88e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:49.215211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8255fc2d-c521-4acd-9ffe-903b1c9e88e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:49.506643 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8255fc2d-c521-4acd-9ffe-903b1c9e88e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.339785 Oct 12 22:21:49.507368 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2915/5200] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:21:49 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-interface => generated 284 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:49.843727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a077920d-a5d5-40f8-8e49-6ca14f8023f5 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:49.844334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a077920d-a5d5-40f8-8e49-6ca14f8023f5 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:49.857934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a077920d-a5d5-40f8-8e49-6ca14f8023f5 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:49.858439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a077920d-a5d5-40f8-8e49-6ca14f8023f5 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:49.865290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a077920d-a5d5-40f8-8e49-6ca14f8023f5 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:49.866377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a077920d-a5d5-40f8-8e49-6ca14f8023f5 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:49.867017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a077920d-a5d5-40f8-8e49-6ca14f8023f5 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:49.867657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a077920d-a5d5-40f8-8e49-6ca14f8023f5 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:50.136262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a077920d-a5d5-40f8-8e49-6ca14f8023f5 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf9c4a8ea974074b244abb1f026f1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614ce154dd6424d8044223b671a6c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:50.148092 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a077920d-a5d5-40f8-8e49-6ca14f8023f5 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 200 len: 1313 microversion: 2.1 time: 0.315741 Oct 12 22:21:50.164236 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2916/5201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:49 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:50.171865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2db79b21-ef21-4024-a9c2-19e7c7633d3d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:50.172497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2db79b21-ef21-4024-a9c2-19e7c7633d3d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:50.179017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2db79b21-ef21-4024-a9c2-19e7c7633d3d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:50.179621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2db79b21-ef21-4024-a9c2-19e7c7633d3d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:50.180065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2db79b21-ef21-4024-a9c2-19e7c7633d3d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:50.180948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2db79b21-ef21-4024-a9c2-19e7c7633d3d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:50.182271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2db79b21-ef21-4024-a9c2-19e7c7633d3d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:50.182805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2db79b21-ef21-4024-a9c2-19e7c7633d3d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:50.205924 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-2db79b21-ef21-4024-a9c2-19e7c7633d3d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] HTTP exception thrown: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2db79b21-ef21-4024-a9c2-19e7c7633d3d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Request method failure captured: Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 HTTP/1.1 Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRzxZVfo3hc8QhMlEEg2-VCSurVZBXEUvl4LPrg7Sa2FYukXFiEhToSxv4684dyXX08SQGGNk5MJLorDF-TXQ5Kyam-nui9ZVRsJyhiN_hPhqYyhke69f6oraz97fOxTZg_5hRxHQKVeu5YCBhjeOCWnrfDXKJabwJcksbabQ4psUe7U Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.42 Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 6f247890f1bf4ff29af359f4d1cd405c Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-461085014 Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f247890f1bf4ff29af359f4d1cd405c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f247890f1bf4ff29af359f4d1cd405c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6f247890f1bf4ff29af359f4d1cd405c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6f247890f1bf4ff29af359f4d1cd405c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TaggedBootDevicesTest_v242-461085014 Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 6f247890f1bf4ff29af359f4d1cd405c Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-461085014 Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TaggedBootDevicesTest_v242-461085014-project Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: def9100040524da08268b700ba75c68a Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TaggedBootDevicesTest_v242-461085014-project Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'e33dea29-003c-413c-8b17-8b2ed9a89d00'} Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:50.207712 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:21:50.213072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:50.213072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:21:50.213072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:21:50.213072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:21:50.213072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:21:50.213072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:21:50.213072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. Oct 12 22:21:50.213072 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:21:50.213072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2db79b21-ef21-4024-a9c2-19e7c7633d3d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Returning 404 to user: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:21:50.213072 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2db79b21-ef21-4024-a9c2-19e7c7633d3d tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 404 len: 111 microversion: 2.42 time: 0.043744 Oct 12 22:21:50.214419 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2917/5202] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:21:50 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:21:50.219855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2053a846-f3a8-432c-9fd1-7df5a2094ef9 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '.version_select at 0x7f5122d463a0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:50.250705 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2053a846-f3a8-432c-9fd1-7df5a2094ef9 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1798670009" status: 204 len: 0 microversion: 2.42 time: 0.035935 Oct 12 22:21:50.256152 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2918/5203] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 12 22:21:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1798670009 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:21:50.473606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8cf4e8f1-fab9-4e19-9bf6-f6e65bb1a85e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:50.481466 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8cf4e8f1-fab9-4e19-9bf6-f6e65bb1a85e tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1517 microversion: 2.1 time: 1.359554 Oct 12 22:21:50.499264 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2286/5204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:49 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1517 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:51.176754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-994f0a1a-2e12-4d08-a986-76ccb41bbf9b tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:51.181479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-994f0a1a-2e12-4d08-a986-76ccb41bbf9b tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:51.200308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-994f0a1a-2e12-4d08-a986-76ccb41bbf9b tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:51.207466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-994f0a1a-2e12-4d08-a986-76ccb41bbf9b tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:51.209870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-994f0a1a-2e12-4d08-a986-76ccb41bbf9b tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:51.211958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-994f0a1a-2e12-4d08-a986-76ccb41bbf9b tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:51.214151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-994f0a1a-2e12-4d08-a986-76ccb41bbf9b tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:51.215770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-994f0a1a-2e12-4d08-a986-76ccb41bbf9b tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:51.511146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3d1f6a43-bf72-409b-a5e6-b22268c621cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:51.511798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3d1f6a43-bf72-409b-a5e6-b22268c621cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:51.534592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:51.540566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d1f6a43-bf72-409b-a5e6-b22268c621cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:51.544379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d1f6a43-bf72-409b-a5e6-b22268c621cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:51.544931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d1f6a43-bf72-409b-a5e6-b22268c621cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:51.545687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d1f6a43-bf72-409b-a5e6-b22268c621cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:51.546148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d1f6a43-bf72-409b-a5e6-b22268c621cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:51.551613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d1f6a43-bf72-409b-a5e6-b22268c621cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:52.158121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:52.321623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-994f0a1a-2e12-4d08-a986-76ccb41bbf9b tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf9c4a8ea974074b244abb1f026f1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614ce154dd6424d8044223b671a6c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:52.336175 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-994f0a1a-2e12-4d08-a986-76ccb41bbf9b tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 200 len: 1313 microversion: 2.1 time: 1.158297 Oct 12 22:21:52.337351 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2919/5205] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:51 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 1313 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:52.892933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3d1f6a43-bf72-409b-a5e6-b22268c621cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:52.906715 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3d1f6a43-bf72-409b-a5e6-b22268c621cf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1517 microversion: 2.1 time: 1.399914 Oct 12 22:21:52.908754 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2287/5206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:51 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1517 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:21:53.311911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-b73733a3-537e-47db-8718-d055a66d81ab req-a683acb7-e0ce-44d9-a415-ef9377b3ea95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed750853-d405-48c3-a083-6ffda832e5dc", "name": "network-vif-plugged", "status": "completed", "tag": "c3c32171-ff90-4513-ae26-85b7f6ebf0f8"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:53.333277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b73733a3-537e-47db-8718-d055a66d81ab req-a683acb7-e0ce-44d9-a415-ef9377b3ea95 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:53.333957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b73733a3-537e-47db-8718-d055a66d81ab req-a683acb7-e0ce-44d9-a415-ef9377b3ea95 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:53.334439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b73733a3-537e-47db-8718-d055a66d81ab req-a683acb7-e0ce-44d9-a415-ef9377b3ea95 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:53.350292 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-b73733a3-537e-47db-8718-d055a66d81ab req-a683acb7-e0ce-44d9-a415-ef9377b3ea95 service nova] Creating event network-vif-plugged:c3c32171-ff90-4513-ae26-85b7f6ebf0f8 for instance ed750853-d405-48c3-a083-6ffda832e5dc on n-h2-861111-1 Oct 12 22:21:53.360208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-51b3e7e6-5976-412a-9d58-ff117b1c1e2a tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:53.360932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-51b3e7e6-5976-412a-9d58-ff117b1c1e2a tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:53.373364 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-b73733a3-537e-47db-8718-d055a66d81ab req-a683acb7-e0ce-44d9-a415-ef9377b3ea95 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065130 Oct 12 22:21:53.374285 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2920/5207] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:53.393134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51b3e7e6-5976-412a-9d58-ff117b1c1e2a tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:53.393657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51b3e7e6-5976-412a-9d58-ff117b1c1e2a tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:53.394104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51b3e7e6-5976-412a-9d58-ff117b1c1e2a tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:53.394836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51b3e7e6-5976-412a-9d58-ff117b1c1e2a tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:53.402276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51b3e7e6-5976-412a-9d58-ff117b1c1e2a tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:53.402884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51b3e7e6-5976-412a-9d58-ff117b1c1e2a tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:53.787727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-51b3e7e6-5976-412a-9d58-ff117b1c1e2a tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf9c4a8ea974074b244abb1f026f1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614ce154dd6424d8044223b671a6c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:53.825188 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-51b3e7e6-5976-412a-9d58-ff117b1c1e2a tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 200 len: 1313 microversion: 2.1 time: 0.465120 Oct 12 22:21:53.828364 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2288/5208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:53 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:53.937060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8716ea6d-730d-43b2-a102-41b68946b6f7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:53.938266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8716ea6d-730d-43b2-a102-41b68946b6f7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:53.952670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8716ea6d-730d-43b2-a102-41b68946b6f7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:53.953269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8716ea6d-730d-43b2-a102-41b68946b6f7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:53.953712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8716ea6d-730d-43b2-a102-41b68946b6f7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:53.961051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8716ea6d-730d-43b2-a102-41b68946b6f7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:53.961542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8716ea6d-730d-43b2-a102-41b68946b6f7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:53.962338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8716ea6d-730d-43b2-a102-41b68946b6f7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:53.974619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:54.858603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-97bb6888-2f5f-4c7a-b393-7e42c5399dde tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:54.861042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-97bb6888-2f5f-4c7a-b393-7e42c5399dde tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:54.876751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97bb6888-2f5f-4c7a-b393-7e42c5399dde tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:54.881094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97bb6888-2f5f-4c7a-b393-7e42c5399dde tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:54.881835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97bb6888-2f5f-4c7a-b393-7e42c5399dde tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:54.882798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97bb6888-2f5f-4c7a-b393-7e42c5399dde tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:54.884759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97bb6888-2f5f-4c7a-b393-7e42c5399dde tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:54.889810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97bb6888-2f5f-4c7a-b393-7e42c5399dde tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:55.018888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8716ea6d-730d-43b2-a102-41b68946b6f7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:55.034142 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8716ea6d-730d-43b2-a102-41b68946b6f7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1517 microversion: 2.1 time: 1.102608 Oct 12 22:21:55.036745 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2921/5209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:53 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1517 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:55.052931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-3619a786-3440-47a8-91b5-5eb8a4079df4 req-bdcfd7f7-6f03-400d-9900-2b2052f5d283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f2400d-a508-4bfc-b84f-bc80a4c28fec", "tag": "79f72797-4736-4c93-86f4-3bf45c9f94fd"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:55.097796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3619a786-3440-47a8-91b5-5eb8a4079df4 req-bdcfd7f7-6f03-400d-9900-2b2052f5d283 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:55.098763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3619a786-3440-47a8-91b5-5eb8a4079df4 req-bdcfd7f7-6f03-400d-9900-2b2052f5d283 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:55.099383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3619a786-3440-47a8-91b5-5eb8a4079df4 req-bdcfd7f7-6f03-400d-9900-2b2052f5d283 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:55.144753 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-3619a786-3440-47a8-91b5-5eb8a4079df4 req-bdcfd7f7-6f03-400d-9900-2b2052f5d283 service nova] Creating event network-changed:79f72797-4736-4c93-86f4-3bf45c9f94fd for instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec on n-h1-861111-1 Oct 12 22:21:55.161076 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-3619a786-3440-47a8-91b5-5eb8a4079df4 req-bdcfd7f7-6f03-400d-9900-2b2052f5d283 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123008 Oct 12 22:21:55.167271 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2922/5210] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:55.910176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-97bb6888-2f5f-4c7a-b393-7e42c5399dde tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf9c4a8ea974074b244abb1f026f1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614ce154dd6424d8044223b671a6c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:55.923985 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-97bb6888-2f5f-4c7a-b393-7e42c5399dde tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 200 len: 1313 microversion: 2.1 time: 1.072427 Oct 12 22:21:55.945790 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2289/5211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:54 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 1313 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:56.065213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-db1826a5-4256-4ed6-b61f-f6883d55e2e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:56.065213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-db1826a5-4256-4ed6-b61f-f6883d55e2e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:56.079226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-db1826a5-4256-4ed6-b61f-f6883d55e2e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:56.079991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-db1826a5-4256-4ed6-b61f-f6883d55e2e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:56.080704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-db1826a5-4256-4ed6-b61f-f6883d55e2e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:56.082075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-db1826a5-4256-4ed6-b61f-f6883d55e2e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:56.082707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-db1826a5-4256-4ed6-b61f-f6883d55e2e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:56.083903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-db1826a5-4256-4ed6-b61f-f6883d55e2e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:56.955143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3969b1d5-e6d6-42f3-b27d-72bd1afb80e0 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:56.955865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3969b1d5-e6d6-42f3-b27d-72bd1afb80e0 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:56.973555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3969b1d5-e6d6-42f3-b27d-72bd1afb80e0 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:56.974244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3969b1d5-e6d6-42f3-b27d-72bd1afb80e0 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:56.974872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3969b1d5-e6d6-42f3-b27d-72bd1afb80e0 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:56.975792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3969b1d5-e6d6-42f3-b27d-72bd1afb80e0 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:56.976454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3969b1d5-e6d6-42f3-b27d-72bd1afb80e0 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:56.977032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3969b1d5-e6d6-42f3-b27d-72bd1afb80e0 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:57.392680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3969b1d5-e6d6-42f3-b27d-72bd1afb80e0 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf9c4a8ea974074b244abb1f026f1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614ce154dd6424d8044223b671a6c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:57.407566 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3969b1d5-e6d6-42f3-b27d-72bd1afb80e0 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 200 len: 1499 microversion: 2.1 time: 0.457599 Oct 12 22:21:57.433258 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2290/5212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:56 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 1499 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:57.454004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dc78fb9a-04b6-4301-8964-e4df3d3c390e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:57.506583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.compute.server_groups [None req-dc78fb9a-04b6-4301-8964-e4df3d3c390e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Querying cell 2bc00301-6462-4874-9c83-c889d0ff6a49(cell1) for 1 instances {{(pid=120452) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 12 22:21:57.507875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc78fb9a-04b6-4301-8964-e4df3d3c390e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:57.519547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc78fb9a-04b6-4301-8964-e4df3d3c390e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:57.520512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc78fb9a-04b6-4301-8964-e4df3d3c390e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:57.552431 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dc78fb9a-04b6-4301-8964-e4df3d3c390e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/23b221f5-6aa7-40c5-a74c-c91b3c6b5aaa" status: 200 len: 222 microversion: 2.1 time: 0.117242 Oct 12 22:21:57.553236 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2291/5213] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:21:57 2022] GET /compute/v2.1/os-server-groups/23b221f5-6aa7-40c5-a74c-c91b3c6b5aaa => generated 222 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:57.566672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a055d2df-25a8-429b-a064-f5781b4123fd tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:57.568131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a055d2df-25a8-429b-a064-f5781b4123fd tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:57.583204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a055d2df-25a8-429b-a064-f5781b4123fd tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:57.598674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a055d2df-25a8-429b-a064-f5781b4123fd tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:57.599568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a055d2df-25a8-429b-a064-f5781b4123fd tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:57.600693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a055d2df-25a8-429b-a064-f5781b4123fd tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:57.601176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a055d2df-25a8-429b-a064-f5781b4123fd tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:57.601624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a055d2df-25a8-429b-a064-f5781b4123fd tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:57.666710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a055d2df-25a8-429b-a064-f5781b4123fd tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:21:57.769305 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a055d2df-25a8-429b-a064-f5781b4123fd tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 204 len: 0 microversion: 2.1 time: 0.206994 Oct 12 22:21:57.770706 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2292/5214] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:21:57 2022] DELETE /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:21:57.780916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-22ffda0b-a534-441b-83d1-9118330fa11e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:57.782181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-22ffda0b-a534-441b-83d1-9118330fa11e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:57.789560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22ffda0b-a534-441b-83d1-9118330fa11e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:57.790325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22ffda0b-a534-441b-83d1-9118330fa11e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:57.790936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22ffda0b-a534-441b-83d1-9118330fa11e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:57.791857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22ffda0b-a534-441b-83d1-9118330fa11e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:57.792729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22ffda0b-a534-441b-83d1-9118330fa11e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:57.793110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22ffda0b-a534-441b-83d1-9118330fa11e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:58.090588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-db1826a5-4256-4ed6-b61f-f6883d55e2e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:58.091842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-22ffda0b-a534-441b-83d1-9118330fa11e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf9c4a8ea974074b244abb1f026f1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614ce154dd6424d8044223b671a6c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:58.110408 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-22ffda0b-a534-441b-83d1-9118330fa11e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 200 len: 1505 microversion: 2.1 time: 0.332784 Oct 12 22:21:58.121766 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2293/5215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:57 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:58.122003 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-db1826a5-4256-4ed6-b61f-f6883d55e2e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1517 microversion: 2.1 time: 2.052279 Oct 12 22:21:58.122003 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2923/5216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:56 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1517 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:59.137264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2b652b8f-567f-4061-b52c-da922ab908b7 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:59.138185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2b652b8f-567f-4061-b52c-da922ab908b7 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:59.148530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1ffbe9d9-6beb-4795-850d-7c948a1c4956 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:59.149178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1ffbe9d9-6beb-4795-850d-7c948a1c4956 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:21:59.156396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b652b8f-567f-4061-b52c-da922ab908b7 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:59.157825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b652b8f-567f-4061-b52c-da922ab908b7 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:59.158424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b652b8f-567f-4061-b52c-da922ab908b7 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:59.159621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b652b8f-567f-4061-b52c-da922ab908b7 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:59.160537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b652b8f-567f-4061-b52c-da922ab908b7 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:59.162770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b652b8f-567f-4061-b52c-da922ab908b7 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:59.169522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ffbe9d9-6beb-4795-850d-7c948a1c4956 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:59.170033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ffbe9d9-6beb-4795-850d-7c948a1c4956 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:59.170488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ffbe9d9-6beb-4795-850d-7c948a1c4956 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:59.171217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ffbe9d9-6beb-4795-850d-7c948a1c4956 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:21:59.179648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ffbe9d9-6beb-4795-850d-7c948a1c4956 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:21:59.180170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ffbe9d9-6beb-4795-850d-7c948a1c4956 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:21:59.806293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2b652b8f-567f-4061-b52c-da922ab908b7 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf9c4a8ea974074b244abb1f026f1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614ce154dd6424d8044223b671a6c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:21:59.825940 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2b652b8f-567f-4061-b52c-da922ab908b7 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 200 len: 1505 microversion: 2.1 time: 0.691344 Oct 12 22:21:59.842893 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2294/5217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:59 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 1505 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:00.099434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1ffbe9d9-6beb-4795-850d-7c948a1c4956 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:00.110098 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1ffbe9d9-6beb-4795-850d-7c948a1c4956 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1517 microversion: 2.1 time: 0.972720 Oct 12 22:22:00.111766 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2924/5218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:21:59 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1517 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:00.850218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c15d3e3e-5239-452d-bd82-9480cc34f563 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:00.851732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c15d3e3e-5239-452d-bd82-9480cc34f563 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:00.865450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c15d3e3e-5239-452d-bd82-9480cc34f563 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:00.879064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c15d3e3e-5239-452d-bd82-9480cc34f563 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:00.879843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c15d3e3e-5239-452d-bd82-9480cc34f563 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:00.881050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c15d3e3e-5239-452d-bd82-9480cc34f563 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:00.881805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c15d3e3e-5239-452d-bd82-9480cc34f563 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:00.882539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c15d3e3e-5239-452d-bd82-9480cc34f563 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:01.139133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-27a43dd5-c3ca-4b50-bd00-93f9eb87020b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:01.140968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-27a43dd5-c3ca-4b50-bd00-93f9eb87020b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:01.165217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27a43dd5-c3ca-4b50-bd00-93f9eb87020b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:01.170928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27a43dd5-c3ca-4b50-bd00-93f9eb87020b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:01.171420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27a43dd5-c3ca-4b50-bd00-93f9eb87020b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:01.172244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27a43dd5-c3ca-4b50-bd00-93f9eb87020b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:01.172709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27a43dd5-c3ca-4b50-bd00-93f9eb87020b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:01.176949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27a43dd5-c3ca-4b50-bd00-93f9eb87020b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:01.312377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c15d3e3e-5239-452d-bd82-9480cc34f563 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf9c4a8ea974074b244abb1f026f1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614ce154dd6424d8044223b671a6c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:01.325855 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c15d3e3e-5239-452d-bd82-9480cc34f563 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 200 len: 1463 microversion: 2.1 time: 0.478289 Oct 12 22:22:01.326390 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2295/5219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:00 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 1463 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:01.462719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-c92780cf-726e-4078-9c00-9625429c56a3 req-72fa49f3-c29b-48fa-a887-1e5bf593016e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed750853-d405-48c3-a083-6ffda832e5dc", "name": "network-vif-deleted", "tag": "c3c32171-ff90-4513-ae26-85b7f6ebf0f8"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:01.506792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c92780cf-726e-4078-9c00-9625429c56a3 req-72fa49f3-c29b-48fa-a887-1e5bf593016e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:01.507491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c92780cf-726e-4078-9c00-9625429c56a3 req-72fa49f3-c29b-48fa-a887-1e5bf593016e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:01.517665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c92780cf-726e-4078-9c00-9625429c56a3 req-72fa49f3-c29b-48fa-a887-1e5bf593016e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:01.562679 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-c92780cf-726e-4078-9c00-9625429c56a3 req-72fa49f3-c29b-48fa-a887-1e5bf593016e service nova] Creating event network-vif-deleted:c3c32171-ff90-4513-ae26-85b7f6ebf0f8 for instance ed750853-d405-48c3-a083-6ffda832e5dc on n-h2-861111-1 Oct 12 22:22:01.577991 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-c92780cf-726e-4078-9c00-9625429c56a3 req-72fa49f3-c29b-48fa-a887-1e5bf593016e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124338 Oct 12 22:22:01.579266 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2296/5220] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:22:01.751512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-27a43dd5-c3ca-4b50-bd00-93f9eb87020b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:01.761264 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-27a43dd5-c3ca-4b50-bd00-93f9eb87020b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1517 microversion: 2.1 time: 0.626254 Oct 12 22:22:01.765095 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2925/5221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:01 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1517 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:02.365374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6ef095bb-8117-4a6f-8d21-e1315b8e6a66 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:02.382246 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6ef095bb-8117-4a6f-8d21-e1315b8e6a66 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:02.398416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ef095bb-8117-4a6f-8d21-e1315b8e6a66 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:02.402308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ef095bb-8117-4a6f-8d21-e1315b8e6a66 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:02.411654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ef095bb-8117-4a6f-8d21-e1315b8e6a66 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:02.412764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ef095bb-8117-4a6f-8d21-e1315b8e6a66 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:02.413394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ef095bb-8117-4a6f-8d21-e1315b8e6a66 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:02.413981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ef095bb-8117-4a6f-8d21-e1315b8e6a66 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:02.490915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ef095bb-8117-4a6f-8d21-e1315b8e6a66 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:02.491433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ef095bb-8117-4a6f-8d21-e1315b8e6a66 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:02.496006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ef095bb-8117-4a6f-8d21-e1315b8e6a66 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:02.496661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-6ef095bb-8117-4a6f-8d21-e1315b8e6a66 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lazy-loading 'fault' on Instance uuid ed750853-d405-48c3-a083-6ffda832e5dc {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:22:02.796572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a78c4340-e7fa-4158-9e75-c8e022477a8d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:02.798910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a78c4340-e7fa-4158-9e75-c8e022477a8d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:02.831618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a78c4340-e7fa-4158-9e75-c8e022477a8d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:02.833162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a78c4340-e7fa-4158-9e75-c8e022477a8d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:02.835218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a78c4340-e7fa-4158-9e75-c8e022477a8d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:02.837775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a78c4340-e7fa-4158-9e75-c8e022477a8d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:02.838962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a78c4340-e7fa-4158-9e75-c8e022477a8d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:02.841565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a78c4340-e7fa-4158-9e75-c8e022477a8d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:02.919937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6ef095bb-8117-4a6f-8d21-e1315b8e6a66 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf9c4a8ea974074b244abb1f026f1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614ce154dd6424d8044223b671a6c73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:02.929160 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6ef095bb-8117-4a6f-8d21-e1315b8e6a66 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 200 len: 1303 microversion: 2.1 time: 0.569889 Oct 12 22:22:02.930606 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2297/5222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:02 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 1303 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:03.373006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a78c4340-e7fa-4158-9e75-c8e022477a8d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:03.392231 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a78c4340-e7fa-4158-9e75-c8e022477a8d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1517 microversion: 2.1 time: 0.602809 Oct 12 22:22:03.407933 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2926/5223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:02 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1517 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:03.954564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-011ba68d-5725-44ed-b19e-661ba28b9fba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:03.955476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-011ba68d-5725-44ed-b19e-661ba28b9fba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:03.976881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-011ba68d-5725-44ed-b19e-661ba28b9fba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:03.981809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-011ba68d-5725-44ed-b19e-661ba28b9fba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:03.982399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-011ba68d-5725-44ed-b19e-661ba28b9fba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:03.983289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-011ba68d-5725-44ed-b19e-661ba28b9fba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:03.983867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-011ba68d-5725-44ed-b19e-661ba28b9fba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:03.984401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-011ba68d-5725-44ed-b19e-661ba28b9fba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:04.027282 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-011ba68d-5725-44ed-b19e-661ba28b9fba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] HTTP exception thrown: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-011ba68d-5725-44ed-b19e-661ba28b9fba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Request method failure captured: Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc HTTP/1.1 Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz3ks3gQk5M9Ddk1F4NM1EvkhWUleMheZEptZid8MjHn0M3-hX_YlVSsv3FEVRuokE6acko1puTk-RygTSWT8CB5ZVCC2_FY8MevWYxoAYwx3BV6TP1N_szHaMSPlfCUx36eCSbG7X_dXvdb4LYH6i1dHvJ9818OPaM2ljifjXAx6mo Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: c614ce154dd6424d8044223b671a6c73 Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c614ce154dd6424d8044223b671a6c73", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: c614ce154dd6424d8044223b671a6c73 Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerGroupTestJSON-34102452-project Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 3bf9c4a8ea974074b244abb1f026f1ff Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerGroupTestJSON-34102452-project Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'ed750853-d405-48c3-a083-6ffda832e5dc'} Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:04.043854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.049960 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.049960 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:04.049960 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:04.049960 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:04.049960 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:04.049960 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. Oct 12 22:22:04.049960 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.050908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-011ba68d-5725-44ed-b19e-661ba28b9fba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Returning 404 to user: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:04.056673 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-011ba68d-5725-44ed-b19e-661ba28b9fba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 404 len: 111 microversion: 2.1 time: 0.106941 Oct 12 22:22:04.060827 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2298/5224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:03 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:22:04.071040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9265f10d-c8d4-4fba-8719-2d7f29113dde tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:04.115334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.compute.server_groups [None req-9265f10d-c8d4-4fba-8719-2d7f29113dde tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Querying cell 2bc00301-6462-4874-9c83-c889d0ff6a49(cell1) for 1 instances {{(pid=120453) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 12 22:22:04.120537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9265f10d-c8d4-4fba-8719-2d7f29113dde tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:04.121174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9265f10d-c8d4-4fba-8719-2d7f29113dde tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:04.122375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9265f10d-c8d4-4fba-8719-2d7f29113dde tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:04.140912 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9265f10d-c8d4-4fba-8719-2d7f29113dde tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.073807 Oct 12 22:22:04.141921 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2927/5225] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:22:04 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:04.157245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-62a89de3-450a-4e10-9e04-06e49fa3fba1 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:04.174682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.compute.server_groups [None req-62a89de3-450a-4e10-9e04-06e49fa3fba1 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Querying cell 2bc00301-6462-4874-9c83-c889d0ff6a49(cell1) for 1 instances {{(pid=120452) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 12 22:22:04.175547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62a89de3-450a-4e10-9e04-06e49fa3fba1 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:04.195159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62a89de3-450a-4e10-9e04-06e49fa3fba1 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:04.195691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62a89de3-450a-4e10-9e04-06e49fa3fba1 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:04.249359 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-62a89de3-450a-4e10-9e04-06e49fa3fba1 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/23b221f5-6aa7-40c5-a74c-c91b3c6b5aaa" status: 200 len: 184 microversion: 2.1 time: 0.098457 Oct 12 22:22:04.249952 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2299/5226] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 12 22:22:04 2022] GET /compute/v2.1/os-server-groups/23b221f5-6aa7-40c5-a74c-c91b3c6b5aaa => generated 184 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:04.264227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0e4c2586-ec84-4766-88a8-c007471711ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:04.264903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0e4c2586-ec84-4766-88a8-c007471711ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:04.280884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e4c2586-ec84-4766-88a8-c007471711ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:04.281403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e4c2586-ec84-4766-88a8-c007471711ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:04.281851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e4c2586-ec84-4766-88a8-c007471711ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:04.285190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e4c2586-ec84-4766-88a8-c007471711ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:04.285820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e4c2586-ec84-4766-88a8-c007471711ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:04.287016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e4c2586-ec84-4766-88a8-c007471711ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:04.336099 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-0e4c2586-ec84-4766-88a8-c007471711ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] HTTP exception thrown: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0e4c2586-ec84-4766-88a8-c007471711ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Request method failure captured: Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc HTTP/1.1 Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz3ks3gQk5M9Ddk1F4NM1EvkhWUleMheZEptZid8MjHn0M3-hX_YlVSsv3FEVRuokE6acko1puTk-RygTSWT8CB5ZVCC2_FY8MevWYxoAYwx3BV6TP1N_szHaMSPlfCUx36eCSbG7X_dXvdb4LYH6i1dHvJ9818OPaM2ljifjXAx6mo Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: c614ce154dd6424d8044223b671a6c73 Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c614ce154dd6424d8044223b671a6c73", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: c614ce154dd6424d8044223b671a6c73 Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerGroupTestJSON-34102452-project Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 3bf9c4a8ea974074b244abb1f026f1ff Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerGroupTestJSON-34102452-project Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'ed750853-d405-48c3-a083-6ffda832e5dc'} Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:22:04.350928 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:04.354842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. Oct 12 22:22:04.354842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.354842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:04.354842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.354842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.354842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:04.354842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:04.354842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:04.354842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:04.354842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. Oct 12 22:22:04.354842 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.354842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0e4c2586-ec84-4766-88a8-c007471711ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Returning 404 to user: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:04.354842 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0e4c2586-ec84-4766-88a8-c007471711ba tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 404 len: 111 microversion: 2.1 time: 0.094903 Oct 12 22:22:04.361958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5854fe0d-63cb-4d92-8e11-4d956c3e36ed tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:04.362536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5854fe0d-63cb-4d92-8e11-4d956c3e36ed tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] [instance: ed750853-d405-48c3-a083-6ffda832e5dc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:04.365371 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2928/5227] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:22:04 2022] DELETE /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:22:04.368783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5854fe0d-63cb-4d92-8e11-4d956c3e36ed tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:04.378488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5854fe0d-63cb-4d92-8e11-4d956c3e36ed tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:04.379155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5854fe0d-63cb-4d92-8e11-4d956c3e36ed tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:04.380165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5854fe0d-63cb-4d92-8e11-4d956c3e36ed tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:04.380911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5854fe0d-63cb-4d92-8e11-4d956c3e36ed tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:04.381626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5854fe0d-63cb-4d92-8e11-4d956c3e36ed tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:04.422210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3d1404f3-d6fa-46a3-b1df-3f401773f3e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:04.423299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3d1404f3-d6fa-46a3-b1df-3f401773f3e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:04.443819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d1404f3-d6fa-46a3-b1df-3f401773f3e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:04.444687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d1404f3-d6fa-46a3-b1df-3f401773f3e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:04.450644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d1404f3-d6fa-46a3-b1df-3f401773f3e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:04.452085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d1404f3-d6fa-46a3-b1df-3f401773f3e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:04.468068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d1404f3-d6fa-46a3-b1df-3f401773f3e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:04.469044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d1404f3-d6fa-46a3-b1df-3f401773f3e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:04.472021 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-5854fe0d-63cb-4d92-8e11-4d956c3e36ed tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] HTTP exception thrown: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5854fe0d-63cb-4d92-8e11-4d956c3e36ed tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Request method failure captured: Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc HTTP/1.1 Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz3ks3gQk5M9Ddk1F4NM1EvkhWUleMheZEptZid8MjHn0M3-hX_YlVSsv3FEVRuokE6acko1puTk-RygTSWT8CB5ZVCC2_FY8MevWYxoAYwx3BV6TP1N_szHaMSPlfCUx36eCSbG7X_dXvdb4LYH6i1dHvJ9818OPaM2ljifjXAx6mo Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: c614ce154dd6424d8044223b671a6c73 Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c614ce154dd6424d8044223b671a6c73", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: c614ce154dd6424d8044223b671a6c73 Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerGroupTestJSON-34102452-project Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 3bf9c4a8ea974074b244abb1f026f1ff Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerGroupTestJSON-34102452-project Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'ed750853-d405-48c3-a083-6ffda832e5dc'} Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:04.479665 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.485593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.485593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:04.485593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:04.485593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:04.485593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:04.485593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. Oct 12 22:22:04.485593 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.498414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5854fe0d-63cb-4d92-8e11-4d956c3e36ed tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Returning 404 to user: Instance ed750853-d405-48c3-a083-6ffda832e5dc could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:04.499556 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5854fe0d-63cb-4d92-8e11-4d956c3e36ed tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc" status: 404 len: 111 microversion: 2.1 time: 0.141542 Oct 12 22:22:04.504446 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2300/5228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:04 2022] GET /compute/v2.1/servers/ed750853-d405-48c3-a083-6ffda832e5dc => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:22:04.520882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8ba0cba2-de20-4bee-bf35-c75a6f78b74d tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:04.580316 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-8ba0cba2-de20-4bee-bf35-c75a6f78b74d tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] HTTP exception thrown: Instance group ead4a450-b00d-4238-b7c5-9ac2c6aed5af could not be found. Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8ba0cba2-de20-4bee-bf35-c75a6f78b74d tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Request method failure captured: Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/os-server-groups/ead4a450-b00d-4238-b7c5-9ac2c6aed5af HTTP/1.1 Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz3ks3gQk5M9Ddk1F4NM1EvkhWUleMheZEptZid8MjHn0M3-hX_YlVSsv3FEVRuokE6acko1puTk-RygTSWT8CB5ZVCC2_FY8MevWYxoAYwx3BV6TP1N_szHaMSPlfCUx36eCSbG7X_dXvdb4LYH6i1dHvJ9818OPaM2ljifjXAx6mo Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: c614ce154dd6424d8044223b671a6c73 Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c614ce154dd6424d8044223b671a6c73", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: c614ce154dd6424d8044223b671a6c73 Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerGroupTestJSON-34102452-project Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 3bf9c4a8ea974074b244abb1f026f1ff Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerGroupTestJSON-34102452-project Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance group ead4a450-b00d-4238-b7c5-9ac2c6aed5af could not be found. Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'ead4a450-b00d-4238-b7c5-9ac2c6aed5af'} Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ead4a450-b00d-4238-b7c5-9ac2c6aed5af could not be found. Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ead4a450-b00d-4238-b7c5-9ac2c6aed5af could not be found. Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.600116 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.608380 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:04.608380 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:04.608380 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:04.608380 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:04.608380 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ead4a450-b00d-4238-b7c5-9ac2c6aed5af could not be found. Oct 12 22:22:04.608380 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.608380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8ba0cba2-de20-4bee-bf35-c75a6f78b74d tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Returning 404 to user: Instance group ead4a450-b00d-4238-b7c5-9ac2c6aed5af could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:04.608380 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8ba0cba2-de20-4bee-bf35-c75a6f78b74d tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/ead4a450-b00d-4238-b7c5-9ac2c6aed5af" status: 404 len: 117 microversion: 2.1 time: 0.092465 Oct 12 22:22:04.608380 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2301/5229] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 12 22:22:04 2022] DELETE /compute/v2.1/os-server-groups/ead4a450-b00d-4238-b7c5-9ac2c6aed5af => generated 117 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:22:04.636174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-73ad5ef1-9ee3-42c8-a6f2-b1833ea019c7 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:04.656325 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-73ad5ef1-9ee3-42c8-a6f2-b1833ea019c7 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] HTTP exception thrown: Instance group a1a2ce9c-a4bf-406d-95ba-6b427186f838 could not be found. Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-73ad5ef1-9ee3-42c8-a6f2-b1833ea019c7 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Request method failure captured: Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/os-server-groups/a1a2ce9c-a4bf-406d-95ba-6b427186f838 HTTP/1.1 Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz3ks3gQk5M9Ddk1F4NM1EvkhWUleMheZEptZid8MjHn0M3-hX_YlVSsv3FEVRuokE6acko1puTk-RygTSWT8CB5ZVCC2_FY8MevWYxoAYwx3BV6TP1N_szHaMSPlfCUx36eCSbG7X_dXvdb4LYH6i1dHvJ9818OPaM2ljifjXAx6mo Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: c614ce154dd6424d8044223b671a6c73 Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c614ce154dd6424d8044223b671a6c73", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: c614ce154dd6424d8044223b671a6c73 Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerGroupTestJSON-34102452-project Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 3bf9c4a8ea974074b244abb1f026f1ff Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerGroupTestJSON-34102452-project Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance group a1a2ce9c-a4bf-406d-95ba-6b427186f838 could not be found. Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'a1a2ce9c-a4bf-406d-95ba-6b427186f838'} Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a1a2ce9c-a4bf-406d-95ba-6b427186f838 could not be found. Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a1a2ce9c-a4bf-406d-95ba-6b427186f838 could not be found. Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.657903 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.663852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:04.663852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:04.663852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:04.663852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:04.663852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a1a2ce9c-a4bf-406d-95ba-6b427186f838 could not be found. Oct 12 22:22:04.663852 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.671568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-73ad5ef1-9ee3-42c8-a6f2-b1833ea019c7 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Returning 404 to user: Instance group a1a2ce9c-a4bf-406d-95ba-6b427186f838 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:04.672458 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-73ad5ef1-9ee3-42c8-a6f2-b1833ea019c7 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/a1a2ce9c-a4bf-406d-95ba-6b427186f838" status: 404 len: 117 microversion: 2.1 time: 0.052423 Oct 12 22:22:04.673021 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2302/5230] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 12 22:22:04 2022] DELETE /compute/v2.1/os-server-groups/a1a2ce9c-a4bf-406d-95ba-6b427186f838 => generated 117 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:22:04.688067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4ca7e208-8428-490e-9662-5c238d093942 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:04.789380 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-4ca7e208-8428-490e-9662-5c238d093942 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] HTTP exception thrown: Instance group 73e4054b-ddc1-4382-a1f7-af912257f811 could not be found. Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4ca7e208-8428-490e-9662-5c238d093942 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Request method failure captured: Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/os-server-groups/73e4054b-ddc1-4382-a1f7-af912257f811 HTTP/1.1 Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz3ks3gQk5M9Ddk1F4NM1EvkhWUleMheZEptZid8MjHn0M3-hX_YlVSsv3FEVRuokE6acko1puTk-RygTSWT8CB5ZVCC2_FY8MevWYxoAYwx3BV6TP1N_szHaMSPlfCUx36eCSbG7X_dXvdb4LYH6i1dHvJ9818OPaM2ljifjXAx6mo Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: c614ce154dd6424d8044223b671a6c73 Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c614ce154dd6424d8044223b671a6c73", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: c614ce154dd6424d8044223b671a6c73 Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerGroupTestJSON-34102452-project Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 3bf9c4a8ea974074b244abb1f026f1ff Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerGroupTestJSON-34102452-project Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance group 73e4054b-ddc1-4382-a1f7-af912257f811 could not be found. Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '73e4054b-ddc1-4382-a1f7-af912257f811'} Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 73e4054b-ddc1-4382-a1f7-af912257f811 could not be found. Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 73e4054b-ddc1-4382-a1f7-af912257f811 could not be found. Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.794379 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.801332 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:04.801332 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:04.801332 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:04.801332 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:04.801332 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 73e4054b-ddc1-4382-a1f7-af912257f811 could not be found. Oct 12 22:22:04.801332 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.804498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4ca7e208-8428-490e-9662-5c238d093942 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Returning 404 to user: Instance group 73e4054b-ddc1-4382-a1f7-af912257f811 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:04.806748 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4ca7e208-8428-490e-9662-5c238d093942 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/73e4054b-ddc1-4382-a1f7-af912257f811" status: 404 len: 117 microversion: 2.1 time: 0.129188 Oct 12 22:22:04.811809 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2303/5231] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 12 22:22:04 2022] DELETE /compute/v2.1/os-server-groups/73e4054b-ddc1-4382-a1f7-af912257f811 => generated 117 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:22:04.820659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a325ca08-2a16-43c3-9f65-98443494805e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:04.851951 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-a325ca08-2a16-43c3-9f65-98443494805e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] HTTP exception thrown: Instance group b8b67e16-421a-469a-8252-86b6b3a4832a could not be found. Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a325ca08-2a16-43c3-9f65-98443494805e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Request method failure captured: Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/os-server-groups/b8b67e16-421a-469a-8252-86b6b3a4832a HTTP/1.1 Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz3ks3gQk5M9Ddk1F4NM1EvkhWUleMheZEptZid8MjHn0M3-hX_YlVSsv3FEVRuokE6acko1puTk-RygTSWT8CB5ZVCC2_FY8MevWYxoAYwx3BV6TP1N_szHaMSPlfCUx36eCSbG7X_dXvdb4LYH6i1dHvJ9818OPaM2ljifjXAx6mo Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: c614ce154dd6424d8044223b671a6c73 Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c614ce154dd6424d8044223b671a6c73", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c614ce154dd6424d8044223b671a6c73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: c614ce154dd6424d8044223b671a6c73 Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerGroupTestJSON-34102452 Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerGroupTestJSON-34102452-project Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 3bf9c4a8ea974074b244abb1f026f1ff Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerGroupTestJSON-34102452-project Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance group b8b67e16-421a-469a-8252-86b6b3a4832a could not be found. Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'b8b67e16-421a-469a-8252-86b6b3a4832a'} Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b8b67e16-421a-469a-8252-86b6b3a4832a could not be found. Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b8b67e16-421a-469a-8252-86b6b3a4832a could not be found. Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.855064 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:04.860291 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:04.860291 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:04.860291 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:04.860291 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:04.860291 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b8b67e16-421a-469a-8252-86b6b3a4832a could not be found. Oct 12 22:22:04.860291 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:04.862737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a325ca08-2a16-43c3-9f65-98443494805e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Returning 404 to user: Instance group b8b67e16-421a-469a-8252-86b6b3a4832a could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:04.863962 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a325ca08-2a16-43c3-9f65-98443494805e tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/b8b67e16-421a-469a-8252-86b6b3a4832a" status: 404 len: 117 microversion: 2.1 time: 0.047327 Oct 12 22:22:04.864756 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2304/5232] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 12 22:22:04 2022] DELETE /compute/v2.1/os-server-groups/b8b67e16-421a-469a-8252-86b6b3a4832a => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:22:04.877002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2ddb52a8-b181-4ab6-98a9-4b128fc87667 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:04.954075 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2ddb52a8-b181-4ab6-98a9-4b128fc87667 tempest-ServerGroupTestJSON-34102452 tempest-ServerGroupTestJSON-34102452-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/23b221f5-6aa7-40c5-a74c-c91b3c6b5aaa" status: 204 len: 0 microversion: 2.1 time: 0.080481 Oct 12 22:22:04.955476 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2305/5233] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 12 22:22:04 2022] DELETE /compute/v2.1/os-server-groups/23b221f5-6aa7-40c5-a74c-c91b3c6b5aaa => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:22:05.292655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3d1404f3-d6fa-46a3-b1df-3f401773f3e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:05.304743 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3d1404f3-d6fa-46a3-b1df-3f401773f3e8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1517 microversion: 2.1 time: 0.887547 Oct 12 22:22:05.309860 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2929/5234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:04 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1517 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:06.316320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-95f744f5-a184-42a6-aedd-c3d0fa5b2489 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:06.316841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-95f744f5-a184-42a6-aedd-c3d0fa5b2489 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:06.326708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95f744f5-a184-42a6-aedd-c3d0fa5b2489 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:06.327195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95f744f5-a184-42a6-aedd-c3d0fa5b2489 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:06.327658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95f744f5-a184-42a6-aedd-c3d0fa5b2489 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:06.328365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95f744f5-a184-42a6-aedd-c3d0fa5b2489 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:06.328815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95f744f5-a184-42a6-aedd-c3d0fa5b2489 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:06.329237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95f744f5-a184-42a6-aedd-c3d0fa5b2489 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:06.339294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-166ae51e-dbdf-4fa5-abd5-2b889442fe1f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:06.340238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-166ae51e-dbdf-4fa5-abd5-2b889442fe1f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:06.352316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-166ae51e-dbdf-4fa5-abd5-2b889442fe1f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:06.352539 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-95f744f5-a184-42a6-aedd-c3d0fa5b2489 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] HTTP exception thrown: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. Oct 12 22:22:06.352811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-166ae51e-dbdf-4fa5-abd5-2b889442fe1f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:06.353459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-166ae51e-dbdf-4fa5-abd5-2b889442fe1f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-95f744f5-a184-42a6-aedd-c3d0fa5b2489 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Request method failure captured: Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 HTTP/1.1 Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzxZVfo3hc8QhMlEEg2-VCSurVZBXEUvl4LPrg7Sa2FYukXFiEhToSxv4684dyXX08SQGGNk5MJLorDF-TXQ5Kyam-nui9ZVRsJyhiN_hPhqYyhke69f6oraz97fOxTZg_5hRxHQKVeu5YCBhjeOCWnrfDXKJabwJcksbabQ4psUe7U Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-Openstack-Nova-Api-Version: 2.42 Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 6f247890f1bf4ff29af359f4d1cd405c Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-461085014 Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f247890f1bf4ff29af359f4d1cd405c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f247890f1bf4ff29af359f4d1cd405c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6f247890f1bf4ff29af359f4d1cd405c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6f247890f1bf4ff29af359f4d1cd405c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TaggedBootDevicesTest_v242-461085014 Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 6f247890f1bf4ff29af359f4d1cd405c Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-461085014 Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TaggedBootDevicesTest_v242-461085014-project Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: def9100040524da08268b700ba75c68a Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TaggedBootDevicesTest_v242-461085014-project Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'e33dea29-003c-413c-8b17-8b2ed9a89d00'} Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:22:06.354029 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:06.358604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. Oct 12 22:22:06.358604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:06.358604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:06.358604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:06.358604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:06.358604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:06.358604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:06.358604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:06.358604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:06.358604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. Oct 12 22:22:06.358604 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:06.358604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-95f744f5-a184-42a6-aedd-c3d0fa5b2489 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Returning 404 to user: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:06.361719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-166ae51e-dbdf-4fa5-abd5-2b889442fe1f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:06.362425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-166ae51e-dbdf-4fa5-abd5-2b889442fe1f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:06.363062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-166ae51e-dbdf-4fa5-abd5-2b889442fe1f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:06.367056 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-95f744f5-a184-42a6-aedd-c3d0fa5b2489 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 404 len: 111 microversion: 2.42 time: 0.044228 Oct 12 22:22:06.367619 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2306/5235] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:22:06 2022] DELETE /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:22:06.384866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f3eb6519-5f37-4a73-b1e6-367f2cae0959 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:06.385477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f3eb6519-5f37-4a73-b1e6-367f2cae0959 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] [instance: e33dea29-003c-413c-8b17-8b2ed9a89d00] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:06.394977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3eb6519-5f37-4a73-b1e6-367f2cae0959 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:06.395503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3eb6519-5f37-4a73-b1e6-367f2cae0959 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:06.395940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3eb6519-5f37-4a73-b1e6-367f2cae0959 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:06.396638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3eb6519-5f37-4a73-b1e6-367f2cae0959 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:06.397087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3eb6519-5f37-4a73-b1e6-367f2cae0959 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:06.397505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3eb6519-5f37-4a73-b1e6-367f2cae0959 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:06.445015 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-f3eb6519-5f37-4a73-b1e6-367f2cae0959 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] HTTP exception thrown: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f3eb6519-5f37-4a73-b1e6-367f2cae0959 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Request method failure captured: Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 HTTP/1.1 Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRzxZVfo3hc8QhMlEEg2-VCSurVZBXEUvl4LPrg7Sa2FYukXFiEhToSxv4684dyXX08SQGGNk5MJLorDF-TXQ5Kyam-nui9ZVRsJyhiN_hPhqYyhke69f6oraz97fOxTZg_5hRxHQKVeu5YCBhjeOCWnrfDXKJabwJcksbabQ4psUe7U Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-Openstack-Nova-Api-Version: 2.42 Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 6f247890f1bf4ff29af359f4d1cd405c Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-461085014 Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f247890f1bf4ff29af359f4d1cd405c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f247890f1bf4ff29af359f4d1cd405c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6f247890f1bf4ff29af359f4d1cd405c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6f247890f1bf4ff29af359f4d1cd405c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TaggedBootDevicesTest_v242-461085014 Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 6f247890f1bf4ff29af359f4d1cd405c Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-461085014 Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TaggedBootDevicesTest_v242-461085014-project Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: def9100040524da08268b700ba75c68a Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TaggedBootDevicesTest_v242-461085014-project Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'e33dea29-003c-413c-8b17-8b2ed9a89d00'} Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:06.448978 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:06.454299 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:06.454299 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:06.454299 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:06.454299 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:06.454299 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:06.454299 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:06.454299 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. Oct 12 22:22:06.454299 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:06.454299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f3eb6519-5f37-4a73-b1e6-367f2cae0959 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] Returning 404 to user: Instance e33dea29-003c-413c-8b17-8b2ed9a89d00 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:06.454299 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f3eb6519-5f37-4a73-b1e6-367f2cae0959 tempest-TaggedBootDevicesTest_v242-461085014 tempest-TaggedBootDevicesTest_v242-461085014-project] 10.222.0.16 "GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00" status: 404 len: 111 microversion: 2.42 time: 0.072490 Oct 12 22:22:06.455350 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2307/5236] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:22:06 2022] GET /compute/v2.1/servers/e33dea29-003c-413c-8b17-8b2ed9a89d00 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:22:06.710351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-166ae51e-dbdf-4fa5-abd5-2b889442fe1f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:06.724076 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-166ae51e-dbdf-4fa5-abd5-2b889442fe1f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1517 microversion: 2.1 time: 0.391792 Oct 12 22:22:06.729199 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2930/5237] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:06 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1517 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:07.758521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6a7ed21f-1e53-4f48-9415-42379074b99d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:07.759759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6a7ed21f-1e53-4f48-9415-42379074b99d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:07.773667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a7ed21f-1e53-4f48-9415-42379074b99d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:07.775535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a7ed21f-1e53-4f48-9415-42379074b99d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:07.776185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a7ed21f-1e53-4f48-9415-42379074b99d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:07.780752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a7ed21f-1e53-4f48-9415-42379074b99d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:07.781433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a7ed21f-1e53-4f48-9415-42379074b99d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:07.782546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a7ed21f-1e53-4f48-9415-42379074b99d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:08.431458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6a7ed21f-1e53-4f48-9415-42379074b99d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:08.441277 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6a7ed21f-1e53-4f48-9415-42379074b99d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1517 microversion: 2.1 time: 0.686518 Oct 12 22:22:08.442808 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2308/5238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:07 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1517 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:09.420756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-b81215e4-e2ed-4d13-8573-e1c6bc25139f req-a73b748b-32a2-43e7-92c4-0c1da50c547a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02be5cee-72e9-4cc6-94a2-c3517ec178bd", "name": "network-vif-plugged", "status": "completed", "tag": "ba67b2ed-d4b3-4942-b9cd-37eda012789a"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:09.455213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b81215e4-e2ed-4d13-8573-e1c6bc25139f req-a73b748b-32a2-43e7-92c4-0c1da50c547a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:09.455994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b81215e4-e2ed-4d13-8573-e1c6bc25139f req-a73b748b-32a2-43e7-92c4-0c1da50c547a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:09.456638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b81215e4-e2ed-4d13-8573-e1c6bc25139f req-a73b748b-32a2-43e7-92c4-0c1da50c547a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:09.470363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a73bdb8e-878b-4ac5-9652-579cae1cb173 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:09.471720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a73bdb8e-878b-4ac5-9652-579cae1cb173 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:09.484826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a73bdb8e-878b-4ac5-9652-579cae1cb173 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:09.487344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a73bdb8e-878b-4ac5-9652-579cae1cb173 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:09.487990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a73bdb8e-878b-4ac5-9652-579cae1cb173 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:09.489160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a73bdb8e-878b-4ac5-9652-579cae1cb173 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:09.492197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a73bdb8e-878b-4ac5-9652-579cae1cb173 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:09.492951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a73bdb8e-878b-4ac5-9652-579cae1cb173 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:09.495027 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-b81215e4-e2ed-4d13-8573-e1c6bc25139f req-a73b748b-32a2-43e7-92c4-0c1da50c547a service nova] Creating event network-vif-plugged:ba67b2ed-d4b3-4942-b9cd-37eda012789a for instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd on n-h1-861111-1 Oct 12 22:22:09.508036 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-b81215e4-e2ed-4d13-8573-e1c6bc25139f req-a73b748b-32a2-43e7-92c4-0c1da50c547a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093766 Oct 12 22:22:09.511826 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2931/5239] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:09.975079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a73bdb8e-878b-4ac5-9652-579cae1cb173 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:09.990894 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a73bdb8e-878b-4ac5-9652-579cae1cb173 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1517 microversion: 2.1 time: 0.526534 Oct 12 22:22:09.998864 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2309/5240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:09 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1517 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:11.024079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cfe6176e-5a5a-4330-b4d1-b2e0b7a82551 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:11.025285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cfe6176e-5a5a-4330-b4d1-b2e0b7a82551 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:11.044302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfe6176e-5a5a-4330-b4d1-b2e0b7a82551 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:11.049569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfe6176e-5a5a-4330-b4d1-b2e0b7a82551 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:11.051186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfe6176e-5a5a-4330-b4d1-b2e0b7a82551 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:11.054380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfe6176e-5a5a-4330-b4d1-b2e0b7a82551 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:11.055843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfe6176e-5a5a-4330-b4d1-b2e0b7a82551 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:11.056581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfe6176e-5a5a-4330-b4d1-b2e0b7a82551 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:12.651946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cfe6176e-5a5a-4330-b4d1-b2e0b7a82551 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:12.675966 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cfe6176e-5a5a-4330-b4d1-b2e0b7a82551 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1517 microversion: 2.1 time: 1.654590 Oct 12 22:22:12.676490 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2932/5241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:11 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1517 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:13.706943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dd344e19-850f-497d-86fe-75101b893bb1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:13.708575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dd344e19-850f-497d-86fe-75101b893bb1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:13.721995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd344e19-850f-497d-86fe-75101b893bb1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:13.729116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd344e19-850f-497d-86fe-75101b893bb1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:13.733199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd344e19-850f-497d-86fe-75101b893bb1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:13.734265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd344e19-850f-497d-86fe-75101b893bb1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:13.734982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd344e19-850f-497d-86fe-75101b893bb1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:13.741393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd344e19-850f-497d-86fe-75101b893bb1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:14.584131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dd344e19-850f-497d-86fe-75101b893bb1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:14.593890 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dd344e19-850f-497d-86fe-75101b893bb1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.891757 Oct 12 22:22:14.607263 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2310/5242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:13 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:14.626772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8337b856-7f7f-42b1-9f18-43c922b4da77 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:14.627850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8337b856-7f7f-42b1-9f18-43c922b4da77 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:14.642987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:22:14.644786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8337b856-7f7f-42b1-9f18-43c922b4da77 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:14.647811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8337b856-7f7f-42b1-9f18-43c922b4da77 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:14.648528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8337b856-7f7f-42b1-9f18-43c922b4da77 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:14.651061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8337b856-7f7f-42b1-9f18-43c922b4da77 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:14.651703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8337b856-7f7f-42b1-9f18-43c922b4da77 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:14.653142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8337b856-7f7f-42b1-9f18-43c922b4da77 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:15.536380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8337b856-7f7f-42b1-9f18-43c922b4da77 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:15.546469 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8337b856-7f7f-42b1-9f18-43c922b4da77 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.925587 Oct 12 22:22:15.565356 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2933/5243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:14 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:15.586159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e6704665-92e7-4315-82ce-61e6df89f58a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:15.588152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e6704665-92e7-4315-82ce-61e6df89f58a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:15.606507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6704665-92e7-4315-82ce-61e6df89f58a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:15.607506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6704665-92e7-4315-82ce-61e6df89f58a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:15.610176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6704665-92e7-4315-82ce-61e6df89f58a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:15.610176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6704665-92e7-4315-82ce-61e6df89f58a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:15.612397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6704665-92e7-4315-82ce-61e6df89f58a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:15.613158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6704665-92e7-4315-82ce-61e6df89f58a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:15.620422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:22:16.916572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e6704665-92e7-4315-82ce-61e6df89f58a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:16.940358 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e6704665-92e7-4315-82ce-61e6df89f58a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 1.359109 Oct 12 22:22:16.968719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c265a675-7574-4856-ab29-710af15cd3d1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:16.983462 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2311/5244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:15 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:16.989811 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-c265a675-7574-4856-ab29-710af15cd3d1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 1e40d39e-457d-496e-8f79-3cbd5e90bd99 has no mapping to a cell. Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c265a675-7574-4856-ab29-710af15cd3d1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/1e40d39e-457d-496e-8f79-3cbd5e90bd99/action HTTP/1.1 Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 15 Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: {"os-stop": {}} Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 1e40d39e-457d-496e-8f79-3cbd5e90bd99 has no mapping to a cell. Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1e40d39e-457d-496e-8f79-3cbd5e90bd99', 'body': {'os-stop': {}}} Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 1e40d39e-457d-496e-8f79-3cbd5e90bd99 has no mapping to a cell. Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:17.001229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e40d39e-457d-496e-8f79-3cbd5e90bd99 has no mapping to a cell. Oct 12 22:22:17.005511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:17.005511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:17.005511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:17.005511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:17.005511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:17.005511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:17.005511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:17.005511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:17.005511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e40d39e-457d-496e-8f79-3cbd5e90bd99 has no mapping to a cell. Oct 12 22:22:17.005511 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:17.007586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c265a675-7574-4856-ab29-710af15cd3d1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 1e40d39e-457d-496e-8f79-3cbd5e90bd99 has no mapping to a cell. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:17.009835 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c265a675-7574-4856-ab29-710af15cd3d1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/1e40d39e-457d-496e-8f79-3cbd5e90bd99/action" status: 404 len: 117 microversion: 2.1 time: 0.045778 Oct 12 22:22:17.019459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-723e4adb-3c81-4900-9ba9-c5c7689e193d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:17.020545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-723e4adb-3c81-4900-9ba9-c5c7689e193d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:17.024600 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2934/5245] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:22:16 2022] POST /compute/v2.1/servers/1e40d39e-457d-496e-8f79-3cbd5e90bd99/action => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:22:17.038753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-723e4adb-3c81-4900-9ba9-c5c7689e193d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:17.039398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-723e4adb-3c81-4900-9ba9-c5c7689e193d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:17.041333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-723e4adb-3c81-4900-9ba9-c5c7689e193d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:17.048655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-723e4adb-3c81-4900-9ba9-c5c7689e193d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:17.050954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-723e4adb-3c81-4900-9ba9-c5c7689e193d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:17.051542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-723e4adb-3c81-4900-9ba9-c5c7689e193d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:19.140055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-723e4adb-3c81-4900-9ba9-c5c7689e193d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:19.152402 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-723e4adb-3c81-4900-9ba9-c5c7689e193d tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 2.136569 Oct 12 22:22:19.170022 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2312/5246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:17 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 2155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:19.182635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c4920465-6efd-490c-a335-0f9f32634df6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:19.185523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c4920465-6efd-490c-a335-0f9f32634df6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:19.227625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4920465-6efd-490c-a335-0f9f32634df6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:19.228136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4920465-6efd-490c-a335-0f9f32634df6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:19.231842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4920465-6efd-490c-a335-0f9f32634df6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:19.232618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4920465-6efd-490c-a335-0f9f32634df6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:19.233100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4920465-6efd-490c-a335-0f9f32634df6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:19.239303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4920465-6efd-490c-a335-0f9f32634df6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:19.754687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c4920465-6efd-490c-a335-0f9f32634df6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:19.774687 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c4920465-6efd-490c-a335-0f9f32634df6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.595928 Oct 12 22:22:19.793030 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2935/5247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:19 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:19.807339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-da322e1e-e9f5-43cc-8de1-26c3dbdebca8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:19.810450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-da322e1e-e9f5-43cc-8de1-26c3dbdebca8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: ffeb8116-506e-48be-acc0-4258f8e55b7f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:19.839202 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-da322e1e-e9f5-43cc-8de1-26c3dbdebca8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance ffeb8116-506e-48be-acc0-4258f8e55b7f could not be found. Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-da322e1e-e9f5-43cc-8de1-26c3dbdebca8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/ffeb8116-506e-48be-acc0-4258f8e55b7f/action HTTP/1.1 Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 15 Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: {"suspend": {}} Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance ffeb8116-506e-48be-acc0-4258f8e55b7f could not be found. Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'ffeb8116-506e-48be-acc0-4258f8e55b7f', 'body': {'suspend': {}}} Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffeb8116-506e-48be-acc0-4258f8e55b7f could not be found. Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffeb8116-506e-48be-acc0-4258f8e55b7f could not be found. Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:19.843083 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:19.847795 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:19.847795 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:19.847795 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffeb8116-506e-48be-acc0-4258f8e55b7f could not be found. Oct 12 22:22:19.847795 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:19.862909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-da322e1e-e9f5-43cc-8de1-26c3dbdebca8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance ffeb8116-506e-48be-acc0-4258f8e55b7f could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:19.870893 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-da322e1e-e9f5-43cc-8de1-26c3dbdebca8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/ffeb8116-506e-48be-acc0-4258f8e55b7f/action" status: 404 len: 111 microversion: 2.1 time: 0.069829 Oct 12 22:22:19.883166 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2313/5248] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:22:19 2022] POST /compute/v2.1/servers/ffeb8116-506e-48be-acc0-4258f8e55b7f/action => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:22:19.892432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-05f7c54a-61b2-4c33-b7f9-b46da6578303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:19.893065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-05f7c54a-61b2-4c33-b7f9-b46da6578303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:19.906390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05f7c54a-61b2-4c33-b7f9-b46da6578303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:19.907227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05f7c54a-61b2-4c33-b7f9-b46da6578303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:19.907775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05f7c54a-61b2-4c33-b7f9-b46da6578303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:19.908686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05f7c54a-61b2-4c33-b7f9-b46da6578303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:19.909333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05f7c54a-61b2-4c33-b7f9-b46da6578303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:19.916099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05f7c54a-61b2-4c33-b7f9-b46da6578303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:20.377591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-05f7c54a-61b2-4c33-b7f9-b46da6578303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:20.387135 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-05f7c54a-61b2-4c33-b7f9-b46da6578303 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.499680 Oct 12 22:22:20.389364 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2936/5249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:19 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:20.423718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a6400ec5-b5a3-4fb5-a6d1-bc572fda3c7c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:20.423718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a6400ec5-b5a3-4fb5-a6d1-bc572fda3c7c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:20.443047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6400ec5-b5a3-4fb5-a6d1-bc572fda3c7c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:20.446012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6400ec5-b5a3-4fb5-a6d1-bc572fda3c7c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:20.447143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6400ec5-b5a3-4fb5-a6d1-bc572fda3c7c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:20.448898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6400ec5-b5a3-4fb5-a6d1-bc572fda3c7c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:20.450580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6400ec5-b5a3-4fb5-a6d1-bc572fda3c7c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:20.453605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6400ec5-b5a3-4fb5-a6d1-bc572fda3c7c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:21.332840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a6400ec5-b5a3-4fb5-a6d1-bc572fda3c7c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:21.350441 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a6400ec5-b5a3-4fb5-a6d1-bc572fda3c7c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.934310 Oct 12 22:22:21.352052 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2314/5250] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:20 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:21.383958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6a0e0a31-eb80-40c0-b816-cabe53c2f00f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:21.386401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6a0e0a31-eb80-40c0-b816-cabe53c2f00f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:21.415936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a0e0a31-eb80-40c0-b816-cabe53c2f00f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:21.421155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a0e0a31-eb80-40c0-b816-cabe53c2f00f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:21.423266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a0e0a31-eb80-40c0-b816-cabe53c2f00f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:21.424460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a0e0a31-eb80-40c0-b816-cabe53c2f00f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:21.426859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a0e0a31-eb80-40c0-b816-cabe53c2f00f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:21.427888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a0e0a31-eb80-40c0-b816-cabe53c2f00f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:21.499393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-6a0e0a31-eb80-40c0-b816-cabe53c2f00f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lazy-loading 'flavor' on Instance uuid 02be5cee-72e9-4cc6-94a2-c3517ec178bd {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:22:21.777963 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6a0e0a31-eb80-40c0-b816-cabe53c2f00f tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action" status: 202 len: 0 microversion: 2.1 time: 0.380589 Oct 12 22:22:21.782052 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2937/5251] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:22:21 2022] POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:22:21.790319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4496c8f6-fa38-4a03-9608-93ebb785fb4b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:21.790869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4496c8f6-fa38-4a03-9608-93ebb785fb4b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:21.806055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4496c8f6-fa38-4a03-9608-93ebb785fb4b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:21.806563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4496c8f6-fa38-4a03-9608-93ebb785fb4b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:21.807010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4496c8f6-fa38-4a03-9608-93ebb785fb4b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:21.812896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4496c8f6-fa38-4a03-9608-93ebb785fb4b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:21.819439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4496c8f6-fa38-4a03-9608-93ebb785fb4b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:21.820212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4496c8f6-fa38-4a03-9608-93ebb785fb4b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:23.323470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4496c8f6-fa38-4a03-9608-93ebb785fb4b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:23.333697 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4496c8f6-fa38-4a03-9608-93ebb785fb4b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1512 microversion: 2.1 time: 1.547416 Oct 12 22:22:23.341297 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2315/5252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:21 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1512 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:24.365253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4f9975fc-3f36-4a4b-a8aa-ca965f2fb5a9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:24.366592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4f9975fc-3f36-4a4b-a8aa-ca965f2fb5a9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:24.380132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f9975fc-3f36-4a4b-a8aa-ca965f2fb5a9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:24.387336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f9975fc-3f36-4a4b-a8aa-ca965f2fb5a9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:24.387801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f9975fc-3f36-4a4b-a8aa-ca965f2fb5a9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:24.388558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f9975fc-3f36-4a4b-a8aa-ca965f2fb5a9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:24.389024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f9975fc-3f36-4a4b-a8aa-ca965f2fb5a9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:24.396212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f9975fc-3f36-4a4b-a8aa-ca965f2fb5a9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:24.409590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:22:24.825594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4f9975fc-3f36-4a4b-a8aa-ca965f2fb5a9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:24.850163 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4f9975fc-3f36-4a4b-a8aa-ca965f2fb5a9 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1495 microversion: 2.1 time: 0.489235 Oct 12 22:22:24.850777 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2938/5253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:24 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1495 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:24.873688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-58426ba0-f702-4448-84f0-4a12751339fd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:24.874264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-58426ba0-f702-4448-84f0-4a12751339fd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:24.877959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:22:24.893138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58426ba0-f702-4448-84f0-4a12751339fd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:24.893662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58426ba0-f702-4448-84f0-4a12751339fd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:24.894121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58426ba0-f702-4448-84f0-4a12751339fd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:24.894853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58426ba0-f702-4448-84f0-4a12751339fd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:24.899559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58426ba0-f702-4448-84f0-4a12751339fd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:24.900584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58426ba0-f702-4448-84f0-4a12751339fd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:24.970151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-58426ba0-f702-4448-84f0-4a12751339fd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lazy-loading 'flavor' on Instance uuid 02be5cee-72e9-4cc6-94a2-c3517ec178bd {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:22:24.984667 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-58426ba0-f702-4448-84f0-4a12751339fd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Cannot 'suspend' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state suspended Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-58426ba0-f702-4448-84f0-4a12751339fd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action HTTP/1.1 Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 15 Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: {"suspend": {}} Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: exception: Cannot 'suspend' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state suspended Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '02be5cee-72e9-4cc6-94a2-c3517ec178bd', 'body': {'suspend': {}}} Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd in vm_state suspended. Cannot suspend while the instance is in this state. Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 12 22:22:24.986536 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 22:22:24.991141 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:22:24.991141 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:22:24.991141 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state suspended Oct 12 22:22:24.991141 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:24.991141 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:24.991141 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:24.991141 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:24.991141 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:24.991141 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:24.991141 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:24.991141 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:24.991141 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state suspended Oct 12 22:22:24.991141 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:24.993346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-58426ba0-f702-4448-84f0-4a12751339fd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 409 to user: Cannot 'suspend' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state suspended {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:24.994385 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-58426ba0-f702-4448-84f0-4a12751339fd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action" status: 409 len: 148 microversion: 2.1 time: 0.125383 Oct 12 22:22:24.995559 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2316/5254] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:22:24 2022] POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action => generated 148 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:22:25.005842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f76c9fc0-77e0-4b33-854f-9cf1e46b2bdf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:25.006654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f76c9fc0-77e0-4b33-854f-9cf1e46b2bdf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:25.013444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f76c9fc0-77e0-4b33-854f-9cf1e46b2bdf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:25.014148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f76c9fc0-77e0-4b33-854f-9cf1e46b2bdf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:25.014784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f76c9fc0-77e0-4b33-854f-9cf1e46b2bdf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:25.015812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f76c9fc0-77e0-4b33-854f-9cf1e46b2bdf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:25.016666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f76c9fc0-77e0-4b33-854f-9cf1e46b2bdf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:25.017412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f76c9fc0-77e0-4b33-854f-9cf1e46b2bdf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:25.206076 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f76c9fc0-77e0-4b33-854f-9cf1e46b2bdf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action" status: 202 len: 0 microversion: 2.1 time: 0.204454 Oct 12 22:22:25.211876 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2939/5255] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:22:24 2022] POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:22:25.217039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ad90d747-7574-42c8-87a9-fb2fbbc046d1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:25.217669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ad90d747-7574-42c8-87a9-fb2fbbc046d1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:25.233657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad90d747-7574-42c8-87a9-fb2fbbc046d1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:25.234170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad90d747-7574-42c8-87a9-fb2fbbc046d1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:25.235661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad90d747-7574-42c8-87a9-fb2fbbc046d1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:25.236885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad90d747-7574-42c8-87a9-fb2fbbc046d1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:25.239715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad90d747-7574-42c8-87a9-fb2fbbc046d1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:25.241277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad90d747-7574-42c8-87a9-fb2fbbc046d1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:26.240243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ad90d747-7574-42c8-87a9-fb2fbbc046d1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:26.258046 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ad90d747-7574-42c8-87a9-fb2fbbc046d1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1501 microversion: 2.1 time: 1.039256 Oct 12 22:22:26.258759 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2317/5256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:25 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1501 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:26.812869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2223dca7-b1bd-4314-95ed-319b397e8260 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e09ded0a-4d68-40dd-a52b-da0a239a475a"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:26.819791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2223dca7-b1bd-4314-95ed-319b397e8260 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:26.850794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2223dca7-b1bd-4314-95ed-319b397e8260 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:26.851371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2223dca7-b1bd-4314-95ed-319b397e8260 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:26.853751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2223dca7-b1bd-4314-95ed-319b397e8260 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:26.860239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2223dca7-b1bd-4314-95ed-319b397e8260 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:26.862185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2223dca7-b1bd-4314-95ed-319b397e8260 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:26.863069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2223dca7-b1bd-4314-95ed-319b397e8260 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:27.287787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aed12389-40fa-45ee-b80a-bec724379bf2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:27.290051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-aed12389-40fa-45ee-b80a-bec724379bf2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:27.307480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aed12389-40fa-45ee-b80a-bec724379bf2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:27.314478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aed12389-40fa-45ee-b80a-bec724379bf2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:27.317154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aed12389-40fa-45ee-b80a-bec724379bf2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:27.320517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aed12389-40fa-45ee-b80a-bec724379bf2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:27.321990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aed12389-40fa-45ee-b80a-bec724379bf2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:27.323109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aed12389-40fa-45ee-b80a-bec724379bf2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:27.397683 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2223dca7-b1bd-4314-95ed-319b397e8260 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "POST /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.590008 Oct 12 22:22:27.398342 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2940/5257] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 22:22:26 2022] POST /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments => generated 194 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:22:29.032682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-aed12389-40fa-45ee-b80a-bec724379bf2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:29.054751 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-aed12389-40fa-45ee-b80a-bec724379bf2 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1501 microversion: 2.1 time: 1.769647 Oct 12 22:22:29.057152 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2318/5258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:27 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1501 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:29.406494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-808704469", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "36f67723-f632-42aa-bcd9-cfd1c5f07f45"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:29.525072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] validate_networks() for [('36f67723-f632-42aa-bcd9-cfd1c5f07f45', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:22:30.086045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-757fc060-fd3e-4ffd-89a5-ae9f42e8440a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:30.086699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-757fc060-fd3e-4ffd-89a5-ae9f42e8440a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:30.103122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-757fc060-fd3e-4ffd-89a5-ae9f42e8440a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:30.103661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-757fc060-fd3e-4ffd-89a5-ae9f42e8440a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:30.104105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-757fc060-fd3e-4ffd-89a5-ae9f42e8440a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:30.112651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-757fc060-fd3e-4ffd-89a5-ae9f42e8440a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:30.113159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-757fc060-fd3e-4ffd-89a5-ae9f42e8440a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:30.113621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-757fc060-fd3e-4ffd-89a5-ae9f42e8440a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:31.024676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-757fc060-fd3e-4ffd-89a5-ae9f42e8440a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:31.044687 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-757fc060-fd3e-4ffd-89a5-ae9f42e8440a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.957269 Oct 12 22:22:31.046048 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2319/5259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:30 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:31.076758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-28548c78-4b33-42ad-a99f-6827975f9e76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:31.077708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-28548c78-4b33-42ad-a99f-6827975f9e76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:31.091198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28548c78-4b33-42ad-a99f-6827975f9e76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:31.092487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28548c78-4b33-42ad-a99f-6827975f9e76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:31.093159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28548c78-4b33-42ad-a99f-6827975f9e76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:31.094617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28548c78-4b33-42ad-a99f-6827975f9e76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:31.096830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28548c78-4b33-42ad-a99f-6827975f9e76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:31.097945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28548c78-4b33-42ad-a99f-6827975f9e76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:32.061309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-28548c78-4b33-42ad-a99f-6827975f9e76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:32.078209 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-28548c78-4b33-42ad-a99f-6827975f9e76 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 1.007412 Oct 12 22:22:32.079411 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2320/5260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:31 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:32.106639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-15025ec0-225a-4164-9135-615a11db2cc6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:32.108390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-15025ec0-225a-4164-9135-615a11db2cc6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 46f6073d-8eef-40d5-840e-a179767c6d5c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:32.117296 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-15025ec0-225a-4164-9135-615a11db2cc6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 46f6073d-8eef-40d5-840e-a179767c6d5c could not be found. Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-15025ec0-225a-4164-9135-615a11db2cc6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/46f6073d-8eef-40d5-840e-a179767c6d5c/action HTTP/1.1 Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 15 Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: {"unpause": {}} Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 46f6073d-8eef-40d5-840e-a179767c6d5c could not be found. Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '46f6073d-8eef-40d5-840e-a179767c6d5c', 'body': {'unpause': {}}} Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46f6073d-8eef-40d5-840e-a179767c6d5c could not be found. Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46f6073d-8eef-40d5-840e-a179767c6d5c could not be found. Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:32.126417 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:32.130752 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:32.130752 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:32.130752 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46f6073d-8eef-40d5-840e-a179767c6d5c could not be found. Oct 12 22:22:32.130752 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:32.133159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-15025ec0-225a-4164-9135-615a11db2cc6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 46f6073d-8eef-40d5-840e-a179767c6d5c could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:32.134391 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-15025ec0-225a-4164-9135-615a11db2cc6 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/46f6073d-8eef-40d5-840e-a179767c6d5c/action" status: 404 len: 111 microversion: 2.1 time: 0.032716 Oct 12 22:22:32.135775 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2321/5261] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:22:32 2022] POST /compute/v2.1/servers/46f6073d-8eef-40d5-840e-a179767c6d5c/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:22:32.148346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-58b740c4-83df-414b-acd2-5624508976dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:32.148974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:22:32.149432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:22:32.149989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:22:32.150181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-58b740c4-83df-414b-acd2-5624508976dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:32.150536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:22:32.151058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:22:32.160766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58b740c4-83df-414b-acd2-5624508976dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:32.161562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58b740c4-83df-414b-acd2-5624508976dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:32.162240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58b740c4-83df-414b-acd2-5624508976dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:32.164420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58b740c4-83df-414b-acd2-5624508976dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:32.165311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58b740c4-83df-414b-acd2-5624508976dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:32.165969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58b740c4-83df-414b-acd2-5624508976dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:32.168972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:32.175423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:32.179613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:32.180827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:32.181389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:32.182012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:32.240285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for project 8276c235e518406da376c8a4c19b27d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:22:32.262589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for user 789a612b19154564a853199a67ea8496 and project 8276c235e518406da376c8a4c19b27d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:22:32.295130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:22:32.300104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:22:32.430189 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a0a03c80-2ba6-434f-b648-802b814c76e6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.294588 Oct 12 22:22:32.433366 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2941/5262] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:22:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:22:32.442788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7808196f-5edf-418f-b9c1-4925b1f19bac tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:32.443508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7808196f-5edf-418f-b9c1-4925b1f19bac tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:32.578127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7808196f-5edf-418f-b9c1-4925b1f19bac tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:32.586246 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7808196f-5edf-418f-b9c1-4925b1f19bac tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1192 microversion: 2.1 time: 0.147946 Oct 12 22:22:32.589883 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2942/5263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:32 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1192 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:33.562251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-58b740c4-83df-414b-acd2-5624508976dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:33.600324 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-58b740c4-83df-414b-acd2-5624508976dd tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 1.442459 Oct 12 22:22:33.601875 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2322/5264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:32 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:33.613934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6b80b698-4a86-42c0-a0d4-e9a4a7332cd3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:33.614563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6b80b698-4a86-42c0-a0d4-e9a4a7332cd3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:33.632994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-063ef1cc-e0ea-40b0-8c3e-5f2629b36bf1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:33.633623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-063ef1cc-e0ea-40b0-8c3e-5f2629b36bf1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:33.645770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b80b698-4a86-42c0-a0d4-e9a4a7332cd3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:33.646284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b80b698-4a86-42c0-a0d4-e9a4a7332cd3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:33.646733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b80b698-4a86-42c0-a0d4-e9a4a7332cd3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:33.647488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b80b698-4a86-42c0-a0d4-e9a4a7332cd3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:33.647951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b80b698-4a86-42c0-a0d4-e9a4a7332cd3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:33.648391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b80b698-4a86-42c0-a0d4-e9a4a7332cd3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:33.656892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-063ef1cc-e0ea-40b0-8c3e-5f2629b36bf1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:33.676020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-063ef1cc-e0ea-40b0-8c3e-5f2629b36bf1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:33.676472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-063ef1cc-e0ea-40b0-8c3e-5f2629b36bf1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:33.677225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-063ef1cc-e0ea-40b0-8c3e-5f2629b36bf1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:33.677680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-063ef1cc-e0ea-40b0-8c3e-5f2629b36bf1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:33.678112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-063ef1cc-e0ea-40b0-8c3e-5f2629b36bf1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:34.050398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6b80b698-4a86-42c0-a0d4-e9a4a7332cd3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:34.066161 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6b80b698-4a86-42c0-a0d4-e9a4a7332cd3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1196 microversion: 2.1 time: 0.457396 Oct 12 22:22:34.071140 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2943/5265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:33 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1196 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:34.681218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-063ef1cc-e0ea-40b0-8c3e-5f2629b36bf1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:34.692548 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-063ef1cc-e0ea-40b0-8c3e-5f2629b36bf1 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 1.065557 Oct 12 22:22:34.711735 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2323/5266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:33 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:34.723029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-92b3578e-6a16-41ff-b804-5e2fb0d13597 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:34.723601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-92b3578e-6a16-41ff-b804-5e2fb0d13597 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:34.738424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92b3578e-6a16-41ff-b804-5e2fb0d13597 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:34.739183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92b3578e-6a16-41ff-b804-5e2fb0d13597 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:34.739803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92b3578e-6a16-41ff-b804-5e2fb0d13597 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:34.740713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92b3578e-6a16-41ff-b804-5e2fb0d13597 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:34.741333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92b3578e-6a16-41ff-b804-5e2fb0d13597 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:34.742836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92b3578e-6a16-41ff-b804-5e2fb0d13597 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:34.818171 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-92b3578e-6a16-41ff-b804-5e2fb0d13597 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Cannot 'unpause' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-92b3578e-6a16-41ff-b804-5e2fb0d13597 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action HTTP/1.1 Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 15 Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: {"unpause": {}} Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: exception: Cannot 'unpause' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '02be5cee-72e9-4cc6-94a2-c3517ec178bd', 'body': {'unpause': {}}} Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd in vm_state active. Cannot unpause while the instance is in this state. Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:34.820372 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:34.824410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:34.824410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:34.824410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:34.824410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active Oct 12 22:22:34.824410 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:34.826192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-92b3578e-6a16-41ff-b804-5e2fb0d13597 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 409 to user: Cannot 'unpause' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:34.827612 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-92b3578e-6a16-41ff-b804-5e2fb0d13597 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action" status: 409 len: 145 microversion: 2.1 time: 0.109006 Oct 12 22:22:34.841243 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2944/5267] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:22:34 2022] POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action => generated 145 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:22:34.846029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1fb91bf6-2465-4428-bf9b-c2d3d30727b7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:34.846657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1fb91bf6-2465-4428-bf9b-c2d3d30727b7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:34.859569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fb91bf6-2465-4428-bf9b-c2d3d30727b7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:34.860065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fb91bf6-2465-4428-bf9b-c2d3d30727b7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:34.860687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fb91bf6-2465-4428-bf9b-c2d3d30727b7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:34.861560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fb91bf6-2465-4428-bf9b-c2d3d30727b7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:34.866905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fb91bf6-2465-4428-bf9b-c2d3d30727b7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:34.867782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fb91bf6-2465-4428-bf9b-c2d3d30727b7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:35.099483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e12963d5-821f-4ccb-a7c0-bb70e1203cd9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:35.100353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e12963d5-821f-4ccb-a7c0-bb70e1203cd9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:35.112233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e12963d5-821f-4ccb-a7c0-bb70e1203cd9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:35.115125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e12963d5-821f-4ccb-a7c0-bb70e1203cd9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:35.115707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e12963d5-821f-4ccb-a7c0-bb70e1203cd9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:35.116566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e12963d5-821f-4ccb-a7c0-bb70e1203cd9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:35.119862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e12963d5-821f-4ccb-a7c0-bb70e1203cd9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:35.121956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e12963d5-821f-4ccb-a7c0-bb70e1203cd9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:35.365442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e12963d5-821f-4ccb-a7c0-bb70e1203cd9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:35.383156 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e12963d5-821f-4ccb-a7c0-bb70e1203cd9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1252 microversion: 2.1 time: 0.287469 Oct 12 22:22:35.391655 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2945/5268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:35 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1252 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:35.574688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1fb91bf6-2465-4428-bf9b-c2d3d30727b7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:35.585852 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1fb91bf6-2465-4428-bf9b-c2d3d30727b7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.743910 Oct 12 22:22:35.601634 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2324/5269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:34 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:35.620107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-069d2371-44ce-4a2d-87bc-8cbf6777377c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:35.622458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-069d2371-44ce-4a2d-87bc-8cbf6777377c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:35.641125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-069d2371-44ce-4a2d-87bc-8cbf6777377c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:35.642959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-069d2371-44ce-4a2d-87bc-8cbf6777377c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:35.645313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-069d2371-44ce-4a2d-87bc-8cbf6777377c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:35.646468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-069d2371-44ce-4a2d-87bc-8cbf6777377c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:35.651023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-069d2371-44ce-4a2d-87bc-8cbf6777377c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:35.652265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-069d2371-44ce-4a2d-87bc-8cbf6777377c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:36.413550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1ca3d694-d42b-43ab-9de2-44614931d624 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:36.414669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1ca3d694-d42b-43ab-9de2-44614931d624 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:36.433965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ca3d694-d42b-43ab-9de2-44614931d624 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:36.436108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ca3d694-d42b-43ab-9de2-44614931d624 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:36.437704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ca3d694-d42b-43ab-9de2-44614931d624 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:36.439953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ca3d694-d42b-43ab-9de2-44614931d624 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:36.442491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ca3d694-d42b-43ab-9de2-44614931d624 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:36.443092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ca3d694-d42b-43ab-9de2-44614931d624 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:36.572276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1ca3d694-d42b-43ab-9de2-44614931d624 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:36.582322 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1ca3d694-d42b-43ab-9de2-44614931d624 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1250 microversion: 2.1 time: 0.173568 Oct 12 22:22:36.585348 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2325/5270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:36 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1250 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:36.842910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-069d2371-44ce-4a2d-87bc-8cbf6777377c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:36.858437 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-069d2371-44ce-4a2d-87bc-8cbf6777377c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 1.245844 Oct 12 22:22:36.859024 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2946/5271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:35 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:36.889357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3ffb05cd-b20b-4344-9d57-8e6ca7b19f78 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:36.890327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3ffb05cd-b20b-4344-9d57-8e6ca7b19f78 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: aba9028e-708e-452c-ba41-5228bda4a173] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:36.901395 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-3ffb05cd-b20b-4344-9d57-8e6ca7b19f78 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance aba9028e-708e-452c-ba41-5228bda4a173 could not be found. Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3ffb05cd-b20b-4344-9d57-8e6ca7b19f78 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/aba9028e-708e-452c-ba41-5228bda4a173/action HTTP/1.1 Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 18 Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: {"unshelve": null} Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance aba9028e-708e-452c-ba41-5228bda4a173 could not be found. Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'aba9028e-708e-452c-ba41-5228bda4a173', 'body': {'unshelve': None}} Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aba9028e-708e-452c-ba41-5228bda4a173 could not be found. Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba9028e-708e-452c-ba41-5228bda4a173 could not be found. Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:36.904149 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:36.909175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:36.909175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:36.909175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:36.909175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:36.909175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:36.909175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:36.909175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba9028e-708e-452c-ba41-5228bda4a173 could not be found. Oct 12 22:22:36.909175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:36.912861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3ffb05cd-b20b-4344-9d57-8e6ca7b19f78 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance aba9028e-708e-452c-ba41-5228bda4a173 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:36.914528 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3ffb05cd-b20b-4344-9d57-8e6ca7b19f78 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/aba9028e-708e-452c-ba41-5228bda4a173/action" status: 404 len: 111 microversion: 2.1 time: 0.032705 Oct 12 22:22:36.916274 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2326/5272] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:22:36 2022] POST /compute/v2.1/servers/aba9028e-708e-452c-ba41-5228bda4a173/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:22:36.924861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-34c241ee-f104-4e43-86a5-e350838225d0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:36.925688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-34c241ee-f104-4e43-86a5-e350838225d0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:36.934347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34c241ee-f104-4e43-86a5-e350838225d0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:36.935080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34c241ee-f104-4e43-86a5-e350838225d0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:36.936147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34c241ee-f104-4e43-86a5-e350838225d0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:36.937184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34c241ee-f104-4e43-86a5-e350838225d0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:36.937836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34c241ee-f104-4e43-86a5-e350838225d0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:36.938600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34c241ee-f104-4e43-86a5-e350838225d0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:37.294922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-34c241ee-f104-4e43-86a5-e350838225d0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:37.325336 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-34c241ee-f104-4e43-86a5-e350838225d0 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.401116 Oct 12 22:22:37.330409 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2947/5273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:36 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:37.353951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb0a0437-2fa0-4666-9073-465d9ed0799c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:37.355077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eb0a0437-2fa0-4666-9073-465d9ed0799c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:37.363481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb0a0437-2fa0-4666-9073-465d9ed0799c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:37.363970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb0a0437-2fa0-4666-9073-465d9ed0799c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:37.364570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb0a0437-2fa0-4666-9073-465d9ed0799c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:37.365278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb0a0437-2fa0-4666-9073-465d9ed0799c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:37.365733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb0a0437-2fa0-4666-9073-465d9ed0799c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:37.366156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb0a0437-2fa0-4666-9073-465d9ed0799c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:37.609361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3a765ceb-f4c7-4ecc-8aa6-4d11c700dfa1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:37.610189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3a765ceb-f4c7-4ecc-8aa6-4d11c700dfa1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:37.634230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a765ceb-f4c7-4ecc-8aa6-4d11c700dfa1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:37.637515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a765ceb-f4c7-4ecc-8aa6-4d11c700dfa1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:37.638240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a765ceb-f4c7-4ecc-8aa6-4d11c700dfa1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:37.639905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a765ceb-f4c7-4ecc-8aa6-4d11c700dfa1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:37.642453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a765ceb-f4c7-4ecc-8aa6-4d11c700dfa1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:37.643185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a765ceb-f4c7-4ecc-8aa6-4d11c700dfa1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:38.158304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eb0a0437-2fa0-4666-9073-465d9ed0799c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:38.173670 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb0a0437-2fa0-4666-9073-465d9ed0799c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.826157 Oct 12 22:22:38.174264 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2327/5274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:37 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:38.200466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-726b84f6-02c9-4982-8e9c-b1ca042b15a8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:38.201434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-726b84f6-02c9-4982-8e9c-b1ca042b15a8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:38.209406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-726b84f6-02c9-4982-8e9c-b1ca042b15a8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:38.210263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-726b84f6-02c9-4982-8e9c-b1ca042b15a8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:38.210860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-726b84f6-02c9-4982-8e9c-b1ca042b15a8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:38.212057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-726b84f6-02c9-4982-8e9c-b1ca042b15a8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:38.212673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-726b84f6-02c9-4982-8e9c-b1ca042b15a8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:38.213982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-726b84f6-02c9-4982-8e9c-b1ca042b15a8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:38.247321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3a765ceb-f4c7-4ecc-8aa6-4d11c700dfa1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:38.253532 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-726b84f6-02c9-4982-8e9c-b1ca042b15a8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Cannot 'unshelve' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-726b84f6-02c9-4982-8e9c-b1ca042b15a8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action HTTP/1.1 Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 18 Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: {"unshelve": null} Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: exception: Cannot 'unshelve' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '02be5cee-72e9-4cc6-94a2-c3517ec178bd', 'body': {'unshelve': None}} Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd in vm_state active. Cannot unshelve while the instance is in this state. Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:22:38.256572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:22:38.262867 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active Oct 12 22:22:38.262867 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:38.262867 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:38.262867 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:38.262867 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:38.262867 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:38.262867 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:38.262867 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:38.262867 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:38.262867 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active Oct 12 22:22:38.262867 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:38.266444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-726b84f6-02c9-4982-8e9c-b1ca042b15a8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 409 to user: Cannot 'unshelve' instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd while it is in vm_state active {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:38.268534 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-726b84f6-02c9-4982-8e9c-b1ca042b15a8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action" status: 409 len: 146 microversion: 2.1 time: 0.075418 Oct 12 22:22:38.270935 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2328/5275] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:22:38 2022] POST /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd/action => generated 146 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:22:38.273295 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3a765ceb-f4c7-4ecc-8aa6-4d11c700dfa1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1292 microversion: 2.1 time: 0.668203 Oct 12 22:22:38.274770 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2948/5276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:37 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1292 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:38.281876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9ab74492-9b4d-419f-81af-2277d9f41472 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:38.282581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9ab74492-9b4d-419f-81af-2277d9f41472 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:38.289729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ab74492-9b4d-419f-81af-2277d9f41472 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:38.290436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ab74492-9b4d-419f-81af-2277d9f41472 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:38.291056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ab74492-9b4d-419f-81af-2277d9f41472 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:38.291961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ab74492-9b4d-419f-81af-2277d9f41472 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:38.292634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ab74492-9b4d-419f-81af-2277d9f41472 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:38.293590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ab74492-9b4d-419f-81af-2277d9f41472 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:39.320330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-701ccffd-c643-4841-b351-ce962e5c0671 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:39.322803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-701ccffd-c643-4841-b351-ce962e5c0671 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:39.344405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-701ccffd-c643-4841-b351-ce962e5c0671 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:39.347339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-701ccffd-c643-4841-b351-ce962e5c0671 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:39.350025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-701ccffd-c643-4841-b351-ce962e5c0671 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:39.351009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-701ccffd-c643-4841-b351-ce962e5c0671 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:39.354705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-701ccffd-c643-4841-b351-ce962e5c0671 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:39.356893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-701ccffd-c643-4841-b351-ce962e5c0671 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:39.359777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9ab74492-9b4d-419f-81af-2277d9f41472 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:39.371331 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9ab74492-9b4d-419f-81af-2277d9f41472 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 1.096215 Oct 12 22:22:39.376044 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2329/5277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:38 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:39.408046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c17c91ee-763b-4a3b-8424-385eb546cee7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:39.409596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c17c91ee-763b-4a3b-8424-385eb546cee7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:39.422011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c17c91ee-763b-4a3b-8424-385eb546cee7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:39.422787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c17c91ee-763b-4a3b-8424-385eb546cee7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:39.423474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c17c91ee-763b-4a3b-8424-385eb546cee7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:39.425281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c17c91ee-763b-4a3b-8424-385eb546cee7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:39.426455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c17c91ee-763b-4a3b-8424-385eb546cee7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:39.427674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c17c91ee-763b-4a3b-8424-385eb546cee7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:40.166496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c17c91ee-763b-4a3b-8424-385eb546cee7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:40.185776 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c17c91ee-763b-4a3b-8424-385eb546cee7 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.782392 Oct 12 22:22:40.193523 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2330/5278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:39 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:40.218873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-86250d2d-4110-415f-aee5-f5e403b54361 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1711786970_updated"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:40.222365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-86250d2d-4110-415f-aee5-f5e403b54361 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 79267e8f-6264-4097-95dd-1f8247a56b43] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:40.231366 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-86250d2d-4110-415f-aee5-f5e403b54361 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 79267e8f-6264-4097-95dd-1f8247a56b43 could not be found. Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-86250d2d-4110-415f-aee5-f5e403b54361 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: request: PUT /compute/v2.1/servers/79267e8f-6264-4097-95dd-1f8247a56b43 HTTP/1.1 Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 81 Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1711786970_updated"}} Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 79267e8f-6264-4097-95dd-1f8247a56b43 could not be found. Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '79267e8f-6264-4097-95dd-1f8247a56b43', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1711786970_updated'}}} Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79267e8f-6264-4097-95dd-1f8247a56b43 could not be found. Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 12 22:22:40.233496 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:22:40.239158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:22:40.239158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:22:40.239158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:40.239158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79267e8f-6264-4097-95dd-1f8247a56b43 could not be found. Oct 12 22:22:40.239158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:40.239158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:40.239158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:40.239158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:40.239158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:40.239158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:40.239158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:40.239158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:40.239158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79267e8f-6264-4097-95dd-1f8247a56b43 could not be found. Oct 12 22:22:40.239158 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:40.242266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-86250d2d-4110-415f-aee5-f5e403b54361 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 79267e8f-6264-4097-95dd-1f8247a56b43 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:40.243409 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-86250d2d-4110-415f-aee5-f5e403b54361 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "PUT /compute/v2.1/servers/79267e8f-6264-4097-95dd-1f8247a56b43" status: 404 len: 111 microversion: 2.1 time: 0.030715 Oct 12 22:22:40.247911 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2331/5279] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 12 22:22:40 2022] PUT /compute/v2.1/servers/79267e8f-6264-4097-95dd-1f8247a56b43 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:22:40.253788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b6f50844-5d61-484d-a6c9-bd8a08a1b743 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:40.254636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b6f50844-5d61-484d-a6c9-bd8a08a1b743 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:40.262999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6f50844-5d61-484d-a6c9-bd8a08a1b743 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:40.263996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6f50844-5d61-484d-a6c9-bd8a08a1b743 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:40.266311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6f50844-5d61-484d-a6c9-bd8a08a1b743 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:40.266311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6f50844-5d61-484d-a6c9-bd8a08a1b743 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:40.266923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6f50844-5d61-484d-a6c9-bd8a08a1b743 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:40.267560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6f50844-5d61-484d-a6c9-bd8a08a1b743 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:40.273309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:22:40.459449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-701ccffd-c643-4841-b351-ce962e5c0671 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:40.477631 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-701ccffd-c643-4841-b351-ce962e5c0671 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1292 microversion: 2.1 time: 1.180056 Oct 12 22:22:40.479918 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2949/5280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:39 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1292 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:41.001408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b6f50844-5d61-484d-a6c9-bd8a08a1b743 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:41.018724 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b6f50844-5d61-484d-a6c9-bd8a08a1b743 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.769299 Oct 12 22:22:41.020913 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2332/5281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:40 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:41.041817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3a3aaa6d-d69b-49a0-9d5e-942d52444121 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:41.042555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3a3aaa6d-d69b-49a0-9d5e-942d52444121 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:41.052319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a3aaa6d-d69b-49a0-9d5e-942d52444121 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:41.052831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a3aaa6d-d69b-49a0-9d5e-942d52444121 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:41.053281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a3aaa6d-d69b-49a0-9d5e-942d52444121 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:41.054045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a3aaa6d-d69b-49a0-9d5e-942d52444121 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:41.054674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a3aaa6d-d69b-49a0-9d5e-942d52444121 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:41.055160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a3aaa6d-d69b-49a0-9d5e-942d52444121 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:41.309278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3a3aaa6d-d69b-49a0-9d5e-942d52444121 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:41.337748 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3a3aaa6d-d69b-49a0-9d5e-942d52444121 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.293374 Oct 12 22:22:41.348444 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2950/5282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:41 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:41.365373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bed0f1df-35ec-4ceb-bfb8-a4e42228fb1c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bed0f1df-35ec-4ceb-bfb8-a4e42228fb1c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: request: PUT /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd HTTP/1.1 Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 280 Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '02be5cee-72e9-4cc6-94a2-c3517ec178bd', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:41.372617 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bed0f1df-35ec-4ceb-bfb8-a4e42228fb1c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:41.380412 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bed0f1df-35ec-4ceb-bfb8-a4e42228fb1c tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "PUT /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 400 len: 619 microversion: 2.1 time: 0.016532 Oct 12 22:22:41.389921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-94b7dda8-8676-4889-9dd9-d0425fda2ebc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:41.391183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-94b7dda8-8676-4889-9dd9-d0425fda2ebc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:41.393210 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2333/5283] 10.222.0.16 () {60 vars in 1257 bytes} [Wed Oct 12 22:22:41 2022] PUT /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:22:41.400363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94b7dda8-8676-4889-9dd9-d0425fda2ebc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:41.400891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94b7dda8-8676-4889-9dd9-d0425fda2ebc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:41.401695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94b7dda8-8676-4889-9dd9-d0425fda2ebc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:41.402993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94b7dda8-8676-4889-9dd9-d0425fda2ebc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:41.403597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94b7dda8-8676-4889-9dd9-d0425fda2ebc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:41.404647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94b7dda8-8676-4889-9dd9-d0425fda2ebc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:41.503399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b03ac811-aeaf-404d-8add-87f2a2a59f55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:41.504731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b03ac811-aeaf-404d-8add-87f2a2a59f55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:41.523560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b03ac811-aeaf-404d-8add-87f2a2a59f55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:41.527331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b03ac811-aeaf-404d-8add-87f2a2a59f55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:41.527758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b03ac811-aeaf-404d-8add-87f2a2a59f55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:41.530036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b03ac811-aeaf-404d-8add-87f2a2a59f55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:41.530515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b03ac811-aeaf-404d-8add-87f2a2a59f55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:41.532822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b03ac811-aeaf-404d-8add-87f2a2a59f55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:41.734419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-94b7dda8-8676-4889-9dd9-d0425fda2ebc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:41.772513 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-94b7dda8-8676-4889-9dd9-d0425fda2ebc tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.388765 Oct 12 22:22:41.780285 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2951/5284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:41 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:41.806621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aae4c89e-96f3-4c16-a55f-c943f932985a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:41.808598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aae4c89e-96f3-4c16-a55f-c943f932985a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:41.824639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aae4c89e-96f3-4c16-a55f-c943f932985a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:41.829039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aae4c89e-96f3-4c16-a55f-c943f932985a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:41.829588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aae4c89e-96f3-4c16-a55f-c943f932985a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:41.830678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aae4c89e-96f3-4c16-a55f-c943f932985a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:41.831155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aae4c89e-96f3-4c16-a55f-c943f932985a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:41.833071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aae4c89e-96f3-4c16-a55f-c943f932985a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:41.990390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b03ac811-aeaf-404d-8add-87f2a2a59f55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:42.001438 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b03ac811-aeaf-404d-8add-87f2a2a59f55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1292 microversion: 2.1 time: 0.502882 Oct 12 22:22:42.016065 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2334/5285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:41 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1292 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:42.114999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-dc2e396c-a8d7-44ea-8e62-360a611a13e7 req-48053bd3-4c24-4af7-9315-0c789d190229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e3d8758-5c13-4f1e-94fc-e12dec37ed65", "tag": "7ef380f8-6a73-4b80-81ea-0aee0edb8b01"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:42.133953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dc2e396c-a8d7-44ea-8e62-360a611a13e7 req-48053bd3-4c24-4af7-9315-0c789d190229 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:42.136692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dc2e396c-a8d7-44ea-8e62-360a611a13e7 req-48053bd3-4c24-4af7-9315-0c789d190229 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:42.162872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aae4c89e-96f3-4c16-a55f-c943f932985a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:42.166937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dc2e396c-a8d7-44ea-8e62-360a611a13e7 req-48053bd3-4c24-4af7-9315-0c789d190229 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:42.178386 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aae4c89e-96f3-4c16-a55f-c943f932985a tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.377033 Oct 12 22:22:42.183551 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2952/5286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:41 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:42.198036 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-dc2e396c-a8d7-44ea-8e62-360a611a13e7 req-48053bd3-4c24-4af7-9315-0c789d190229 service nova] Creating event network-changed:7ef380f8-6a73-4b80-81ea-0aee0edb8b01 for instance 7e3d8758-5c13-4f1e-94fc-e12dec37ed65 on n-h2-861111-1 Oct 12 22:22:42.209661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d14b4640-64ac-4a22-976d-3096941270e3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d14b4640-64ac-4a22-976d-3096941270e3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: request: PUT /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd HTTP/1.1 Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 24 Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": ""}} Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '02be5cee-72e9-4cc6-94a2-c3517ec178bd', 'body': {'server': {'name': ''}}} Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi '' Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:22:42.216301 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:22:42.221003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 12 22:22:42.221003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:42.221003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:42.221003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:42.221003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:42.221003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:42.221003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:42.221003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:22:42.221003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:22:42.221003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 12 22:22:42.221003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:42.223457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d14b4640-64ac-4a22-976d-3096941270e3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:42.223594 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-dc2e396c-a8d7-44ea-8e62-360a611a13e7 req-48053bd3-4c24-4af7-9315-0c789d190229 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116639 Oct 12 22:22:42.224164 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2335/5287] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:42.225018 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d14b4640-64ac-4a22-976d-3096941270e3 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "PUT /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 400 len: 108 microversion: 2.1 time: 0.021964 Oct 12 22:22:42.243939 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2953/5288] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 12 22:22:42 2022] PUT /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 108 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:22:42.244592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fe435698-fdbc-4ce7-83bc-84f017942df8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:42.245843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fe435698-fdbc-4ce7-83bc-84f017942df8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:42.252715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe435698-fdbc-4ce7-83bc-84f017942df8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:42.253207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe435698-fdbc-4ce7-83bc-84f017942df8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:42.254261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe435698-fdbc-4ce7-83bc-84f017942df8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:42.255174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe435698-fdbc-4ce7-83bc-84f017942df8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:42.255904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe435698-fdbc-4ce7-83bc-84f017942df8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:42.256532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe435698-fdbc-4ce7-83bc-84f017942df8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:43.029436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-73cc2c27-b640-4d37-a356-9d83d73c8488 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:43.031147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-73cc2c27-b640-4d37-a356-9d83d73c8488 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:43.054016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:22:43.059818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=8 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:22:43.063879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73cc2c27-b640-4d37-a356-9d83d73c8488 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:43.067104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73cc2c27-b640-4d37-a356-9d83d73c8488 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:43.068015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73cc2c27-b640-4d37-a356-9d83d73c8488 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:43.072003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73cc2c27-b640-4d37-a356-9d83d73c8488 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:43.073711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73cc2c27-b640-4d37-a356-9d83d73c8488 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:43.086369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73cc2c27-b640-4d37-a356-9d83d73c8488 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:43.151995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fe435698-fdbc-4ce7-83bc-84f017942df8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:43.151995 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fe435698-fdbc-4ce7-83bc-84f017942df8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1504 microversion: 2.1 time: 0.919847 Oct 12 22:22:43.152797 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2336/5289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:42 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1504 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:43.177679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4eee35a5-26df-402e-8a88-b181d2d28076 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:43.181406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4eee35a5-26df-402e-8a88-b181d2d28076 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:43.193552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4eee35a5-26df-402e-8a88-b181d2d28076 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:43.195578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4eee35a5-26df-402e-8a88-b181d2d28076 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:43.196150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4eee35a5-26df-402e-8a88-b181d2d28076 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:43.199660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4eee35a5-26df-402e-8a88-b181d2d28076 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:43.200283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4eee35a5-26df-402e-8a88-b181d2d28076 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:43.200830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4eee35a5-26df-402e-8a88-b181d2d28076 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:43.238229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-4eee35a5-26df-402e-8a88-b181d2d28076 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lazy-loading 'flavor' on Instance uuid d4f2400d-a508-4bfc-b84f-bc80a4c28fec {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:22:43.558793 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4eee35a5-26df-402e-8a88-b181d2d28076 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "POST /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/action" status: 200 len: 32 microversion: 2.1 time: 0.383470 Oct 12 22:22:43.564630 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2337/5290] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:22:43 2022] POST /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/action => generated 32 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:22:43.592053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1ded3d2b-a009-4a9f-a24b-f8b66987e48b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:43.593702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1ded3d2b-a009-4a9f-a24b-f8b66987e48b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:43.638698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ded3d2b-a009-4a9f-a24b-f8b66987e48b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:43.639331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ded3d2b-a009-4a9f-a24b-f8b66987e48b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:43.660270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ded3d2b-a009-4a9f-a24b-f8b66987e48b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:43.661318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ded3d2b-a009-4a9f-a24b-f8b66987e48b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:43.661939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ded3d2b-a009-4a9f-a24b-f8b66987e48b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:43.662856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ded3d2b-a009-4a9f-a24b-f8b66987e48b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:43.942337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-73cc2c27-b640-4d37-a356-9d83d73c8488 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:43.960223 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-73cc2c27-b640-4d37-a356-9d83d73c8488 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1292 microversion: 2.1 time: 0.938207 Oct 12 22:22:43.960817 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2954/5291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:43 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1292 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:44.318936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1ded3d2b-a009-4a9f-a24b-f8b66987e48b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:44.341263 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1ded3d2b-a009-4a9f-a24b-f8b66987e48b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1735 microversion: 2.1 time: 0.760600 Oct 12 22:22:44.343740 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2338/5292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:43 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1735 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:44.986024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4beb3217-02ff-471e-b605-5ea9a7638996 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:44.987491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4beb3217-02ff-471e-b605-5ea9a7638996 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:44.995809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:22:45.010346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4beb3217-02ff-471e-b605-5ea9a7638996 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:45.011938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4beb3217-02ff-471e-b605-5ea9a7638996 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:45.012390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4beb3217-02ff-471e-b605-5ea9a7638996 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:45.016180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4beb3217-02ff-471e-b605-5ea9a7638996 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:45.016506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4beb3217-02ff-471e-b605-5ea9a7638996 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:45.017135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4beb3217-02ff-471e-b605-5ea9a7638996 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:45.080908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:22:45.366326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fc9787a7-f3d7-411f-9c9a-0021fe0592a1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:45.367103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fc9787a7-f3d7-411f-9c9a-0021fe0592a1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:45.379413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fc9787a7-f3d7-411f-9c9a-0021fe0592a1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:45.382116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fc9787a7-f3d7-411f-9c9a-0021fe0592a1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:45.382795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fc9787a7-f3d7-411f-9c9a-0021fe0592a1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:45.384077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fc9787a7-f3d7-411f-9c9a-0021fe0592a1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:45.388825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fc9787a7-f3d7-411f-9c9a-0021fe0592a1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:45.390056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fc9787a7-f3d7-411f-9c9a-0021fe0592a1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:45.630808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4beb3217-02ff-471e-b605-5ea9a7638996 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:45.644407 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4beb3217-02ff-471e-b605-5ea9a7638996 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1292 microversion: 2.1 time: 0.664320 Oct 12 22:22:45.645345 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2955/5293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:44 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1292 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:46.369357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fc9787a7-f3d7-411f-9c9a-0021fe0592a1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:46.387510 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fc9787a7-f3d7-411f-9c9a-0021fe0592a1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1735 microversion: 2.1 time: 1.024920 Oct 12 22:22:46.412333 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2339/5294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:45 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1735 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:46.676608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b70e6a35-f5d6-44b5-b05e-fdf8c02e38da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:46.679617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b70e6a35-f5d6-44b5-b05e-fdf8c02e38da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:46.710002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b70e6a35-f5d6-44b5-b05e-fdf8c02e38da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:46.715616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b70e6a35-f5d6-44b5-b05e-fdf8c02e38da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:46.716247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b70e6a35-f5d6-44b5-b05e-fdf8c02e38da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:46.720784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b70e6a35-f5d6-44b5-b05e-fdf8c02e38da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:46.721994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b70e6a35-f5d6-44b5-b05e-fdf8c02e38da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:46.722691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b70e6a35-f5d6-44b5-b05e-fdf8c02e38da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:47.054737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b70e6a35-f5d6-44b5-b05e-fdf8c02e38da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:47.066952 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b70e6a35-f5d6-44b5-b05e-fdf8c02e38da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1292 microversion: 2.1 time: 0.401555 Oct 12 22:22:47.070079 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2956/5295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:46 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1292 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:47.440040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-96eeba43-0a11-458b-a93a-2129f5c32dfa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:47.440658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-96eeba43-0a11-458b-a93a-2129f5c32dfa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:47.456968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96eeba43-0a11-458b-a93a-2129f5c32dfa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:47.457944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96eeba43-0a11-458b-a93a-2129f5c32dfa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:47.462719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96eeba43-0a11-458b-a93a-2129f5c32dfa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:47.463624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96eeba43-0a11-458b-a93a-2129f5c32dfa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:47.464640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96eeba43-0a11-458b-a93a-2129f5c32dfa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:47.464974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96eeba43-0a11-458b-a93a-2129f5c32dfa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:48.092930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1f7b6323-df55-4142-81b8-3405607a0da6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:48.093783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1f7b6323-df55-4142-81b8-3405607a0da6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:48.112035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f7b6323-df55-4142-81b8-3405607a0da6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:48.112616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f7b6323-df55-4142-81b8-3405607a0da6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:48.113470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f7b6323-df55-4142-81b8-3405607a0da6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:48.114310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f7b6323-df55-4142-81b8-3405607a0da6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:48.114883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f7b6323-df55-4142-81b8-3405607a0da6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:48.116299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f7b6323-df55-4142-81b8-3405607a0da6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:48.351076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-96eeba43-0a11-458b-a93a-2129f5c32dfa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:48.368388 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-96eeba43-0a11-458b-a93a-2129f5c32dfa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1735 microversion: 2.1 time: 0.931277 Oct 12 22:22:48.369633 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2340/5296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:47 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1735 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:48.458869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1f7b6323-df55-4142-81b8-3405607a0da6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:48.472193 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1f7b6323-df55-4142-81b8-3405607a0da6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1292 microversion: 2.1 time: 0.383799 Oct 12 22:22:48.473910 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2957/5297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:48 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1292 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:49.395493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-76a43e70-eb44-4109-bcca-1268af18b8ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:49.396811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-76a43e70-eb44-4109-bcca-1268af18b8ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:49.410844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76a43e70-eb44-4109-bcca-1268af18b8ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:49.414628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76a43e70-eb44-4109-bcca-1268af18b8ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:49.415206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76a43e70-eb44-4109-bcca-1268af18b8ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:49.416079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76a43e70-eb44-4109-bcca-1268af18b8ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:49.418717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76a43e70-eb44-4109-bcca-1268af18b8ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:49.419315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76a43e70-eb44-4109-bcca-1268af18b8ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:49.501987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-be41c38d-5e5c-4d39-b70f-f69ccf5e79d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:49.502785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-be41c38d-5e5c-4d39-b70f-f69ccf5e79d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:49.531995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be41c38d-5e5c-4d39-b70f-f69ccf5e79d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:49.538733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be41c38d-5e5c-4d39-b70f-f69ccf5e79d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:49.541818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be41c38d-5e5c-4d39-b70f-f69ccf5e79d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:49.546644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be41c38d-5e5c-4d39-b70f-f69ccf5e79d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:49.548557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be41c38d-5e5c-4d39-b70f-f69ccf5e79d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:49.549253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be41c38d-5e5c-4d39-b70f-f69ccf5e79d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:49.873762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-be41c38d-5e5c-4d39-b70f-f69ccf5e79d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:49.887796 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-be41c38d-5e5c-4d39-b70f-f69ccf5e79d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1292 microversion: 2.1 time: 0.388244 Oct 12 22:22:49.889842 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2958/5298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:49 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1292 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:49.991523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-52be8aa2-df8a-4f54-970a-2f1d01351ac8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:49.992031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-52be8aa2-df8a-4f54-970a-2f1d01351ac8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:50.008354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52be8aa2-df8a-4f54-970a-2f1d01351ac8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:50.008902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52be8aa2-df8a-4f54-970a-2f1d01351ac8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:50.009358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52be8aa2-df8a-4f54-970a-2f1d01351ac8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:50.012364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52be8aa2-df8a-4f54-970a-2f1d01351ac8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:50.012854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52be8aa2-df8a-4f54-970a-2f1d01351ac8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:50.014961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52be8aa2-df8a-4f54-970a-2f1d01351ac8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:50.052608 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-52be8aa2-df8a-4f54-970a-2f1d01351ac8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-52be8aa2-df8a-4f54-970a-2f1d01351ac8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 HTTP/1.1 Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1cd026e6-7533-4efb-88f5-1573116d8f08'} Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:22:50.054221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:50.059932 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:22:50.059932 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:50.059932 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:50.059932 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:50.059932 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:50.059932 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:50.059932 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:50.059932 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:50.059932 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:50.059932 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:22:50.059932 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:50.059932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-52be8aa2-df8a-4f54-970a-2f1d01351ac8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:50.064875 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-52be8aa2-df8a-4f54-970a-2f1d01351ac8 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 404 len: 111 microversion: 2.1 time: 0.068423 Oct 12 22:22:50.066353 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2959/5299] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:22:49 2022] DELETE /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:22:50.076580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b321a271-d582-4de2-89c7-0c7c9eafce86 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:50.082860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b321a271-d582-4de2-89c7-0c7c9eafce86 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 1cd026e6-7533-4efb-88f5-1573116d8f08] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:50.092059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b321a271-d582-4de2-89c7-0c7c9eafce86 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:50.092810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b321a271-d582-4de2-89c7-0c7c9eafce86 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:50.093408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b321a271-d582-4de2-89c7-0c7c9eafce86 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:50.094313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b321a271-d582-4de2-89c7-0c7c9eafce86 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:50.094940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b321a271-d582-4de2-89c7-0c7c9eafce86 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:50.095569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b321a271-d582-4de2-89c7-0c7c9eafce86 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:50.114665 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-b321a271-d582-4de2-89c7-0c7c9eafce86 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b321a271-d582-4de2-89c7-0c7c9eafce86 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 HTTP/1.1 Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1cd026e6-7533-4efb-88f5-1573116d8f08'} Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:50.116766 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:50.122174 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:50.122174 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:50.122174 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:50.122174 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:50.122174 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:50.122174 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. Oct 12 22:22:50.122174 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:22:50.123918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b321a271-d582-4de2-89c7-0c7c9eafce86 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 1cd026e6-7533-4efb-88f5-1573116d8f08 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:50.125538 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b321a271-d582-4de2-89c7-0c7c9eafce86 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08" status: 404 len: 111 microversion: 2.1 time: 0.053225 Oct 12 22:22:50.126288 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2960/5300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:50 2022] GET /compute/v2.1/servers/1cd026e6-7533-4efb-88f5-1573116d8f08 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:22:50.135926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a1bb0304-20fb-4b7a-9d8d-a7bc8bb3a9bf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:50.136692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a1bb0304-20fb-4b7a-9d8d-a7bc8bb3a9bf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:50.143266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1bb0304-20fb-4b7a-9d8d-a7bc8bb3a9bf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:50.144162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1bb0304-20fb-4b7a-9d8d-a7bc8bb3a9bf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:50.144787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1bb0304-20fb-4b7a-9d8d-a7bc8bb3a9bf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:50.145841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1bb0304-20fb-4b7a-9d8d-a7bc8bb3a9bf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:50.146470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1bb0304-20fb-4b7a-9d8d-a7bc8bb3a9bf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:50.147730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1bb0304-20fb-4b7a-9d8d-a7bc8bb3a9bf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:50.204361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a1bb0304-20fb-4b7a-9d8d-a7bc8bb3a9bf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:22:50.497027 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a1bb0304-20fb-4b7a-9d8d-a7bc8bb3a9bf tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "DELETE /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 204 len: 0 microversion: 2.1 time: 0.366195 Oct 12 22:22:50.501292 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2961/5301] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:22:50 2022] DELETE /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:22:50.518030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6312ddc5-1d1b-46bb-a80f-46af3e5e7171 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:50.519640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6312ddc5-1d1b-46bb-a80f-46af3e5e7171 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:50.554867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6312ddc5-1d1b-46bb-a80f-46af3e5e7171 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:50.564478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6312ddc5-1d1b-46bb-a80f-46af3e5e7171 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:50.569742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6312ddc5-1d1b-46bb-a80f-46af3e5e7171 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:50.571468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6312ddc5-1d1b-46bb-a80f-46af3e5e7171 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:50.574919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6312ddc5-1d1b-46bb-a80f-46af3e5e7171 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:50.578234 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6312ddc5-1d1b-46bb-a80f-46af3e5e7171 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:51.003196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-76a43e70-eb44-4109-bcca-1268af18b8ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:51.020643 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-76a43e70-eb44-4109-bcca-1268af18b8ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1735 microversion: 2.1 time: 1.629170 Oct 12 22:22:51.023219 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2341/5302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:49 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1735 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:51.042757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e9a4ef15-4d13-4320-abc7-f92450156edd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:51.044804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e9a4ef15-4d13-4320-abc7-f92450156edd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:51.069985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9a4ef15-4d13-4320-abc7-f92450156edd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:51.070559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9a4ef15-4d13-4320-abc7-f92450156edd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:51.074015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9a4ef15-4d13-4320-abc7-f92450156edd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:51.076150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9a4ef15-4d13-4320-abc7-f92450156edd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:51.076783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9a4ef15-4d13-4320-abc7-f92450156edd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:51.077812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9a4ef15-4d13-4320-abc7-f92450156edd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:51.173217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6312ddc5-1d1b-46bb-a80f-46af3e5e7171 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:51.185694 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6312ddc5-1d1b-46bb-a80f-46af3e5e7171 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1510 microversion: 2.1 time: 0.679719 Oct 12 22:22:51.199973 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2962/5303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:50 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1510 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:51.709191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e9a4ef15-4d13-4320-abc7-f92450156edd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:51.735100 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e9a4ef15-4d13-4320-abc7-f92450156edd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1292 microversion: 2.1 time: 0.701417 Oct 12 22:22:51.743360 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2342/5304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:51 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1292 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:52.051626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7461380c-9b48-44e1-a0ba-337d1000e9ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:52.052422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7461380c-9b48-44e1-a0ba-337d1000e9ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:52.063957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7461380c-9b48-44e1-a0ba-337d1000e9ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:52.064454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7461380c-9b48-44e1-a0ba-337d1000e9ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:52.064890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7461380c-9b48-44e1-a0ba-337d1000e9ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:52.066158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7461380c-9b48-44e1-a0ba-337d1000e9ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:52.066158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7461380c-9b48-44e1-a0ba-337d1000e9ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:52.066591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7461380c-9b48-44e1-a0ba-337d1000e9ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:52.216928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-76ae1e4f-7798-46a8-a928-874816c5ce34 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:52.218256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-76ae1e4f-7798-46a8-a928-874816c5ce34 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:52.231812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76ae1e4f-7798-46a8-a928-874816c5ce34 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:52.232732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76ae1e4f-7798-46a8-a928-874816c5ce34 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:52.233398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76ae1e4f-7798-46a8-a928-874816c5ce34 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:52.234291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76ae1e4f-7798-46a8-a928-874816c5ce34 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:52.235030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76ae1e4f-7798-46a8-a928-874816c5ce34 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:52.235901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76ae1e4f-7798-46a8-a928-874816c5ce34 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:52.638052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-76ae1e4f-7798-46a8-a928-874816c5ce34 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:52.650789 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-76ae1e4f-7798-46a8-a928-874816c5ce34 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1510 microversion: 2.1 time: 0.435790 Oct 12 22:22:52.670116 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2343/5305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:52 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1510 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:52.685800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-9213c76e-f1b3-4c7d-a141-9fdc48a3aadb req-5638b0ba-4b47-44d6-81b9-2883631a66bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e3d8758-5c13-4f1e-94fc-e12dec37ed65", "name": "network-vif-plugged", "status": "completed", "tag": "7ef380f8-6a73-4b80-81ea-0aee0edb8b01"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:52.716028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9213c76e-f1b3-4c7d-a141-9fdc48a3aadb req-5638b0ba-4b47-44d6-81b9-2883631a66bc service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:52.716288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9213c76e-f1b3-4c7d-a141-9fdc48a3aadb req-5638b0ba-4b47-44d6-81b9-2883631a66bc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:52.716726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9213c76e-f1b3-4c7d-a141-9fdc48a3aadb req-5638b0ba-4b47-44d6-81b9-2883631a66bc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:52.747762 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-9213c76e-f1b3-4c7d-a141-9fdc48a3aadb req-5638b0ba-4b47-44d6-81b9-2883631a66bc service nova] Creating event network-vif-plugged:7ef380f8-6a73-4b80-81ea-0aee0edb8b01 for instance 7e3d8758-5c13-4f1e-94fc-e12dec37ed65 on n-h2-861111-1 Oct 12 22:22:52.782422 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-9213c76e-f1b3-4c7d-a141-9fdc48a3aadb req-5638b0ba-4b47-44d6-81b9-2883631a66bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110896 Oct 12 22:22:52.785842 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2344/5306] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:52.815134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-69a491b1-d782-444e-aca3-3a907daa6fec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:52.818481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-69a491b1-d782-444e-aca3-3a907daa6fec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:52.867115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69a491b1-d782-444e-aca3-3a907daa6fec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:52.867963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69a491b1-d782-444e-aca3-3a907daa6fec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:52.871632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69a491b1-d782-444e-aca3-3a907daa6fec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:52.873230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69a491b1-d782-444e-aca3-3a907daa6fec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:52.873886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69a491b1-d782-444e-aca3-3a907daa6fec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:52.875655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69a491b1-d782-444e-aca3-3a907daa6fec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:53.137025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7461380c-9b48-44e1-a0ba-337d1000e9ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:53.152622 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7461380c-9b48-44e1-a0ba-337d1000e9ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1735 microversion: 2.1 time: 1.104386 Oct 12 22:22:53.153251 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2963/5307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:52 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1735 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:53.490928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-69a491b1-d782-444e-aca3-3a907daa6fec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:53.509388 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-69a491b1-d782-444e-aca3-3a907daa6fec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1292 microversion: 2.1 time: 0.719137 Oct 12 22:22:53.511813 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2345/5308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:52 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1292 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:53.677460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5f1e5c02-16ce-4a2c-88b3-14afa3e15506 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:53.678077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5f1e5c02-16ce-4a2c-88b3-14afa3e15506 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:53.687188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f1e5c02-16ce-4a2c-88b3-14afa3e15506 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:53.687718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f1e5c02-16ce-4a2c-88b3-14afa3e15506 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:53.688154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f1e5c02-16ce-4a2c-88b3-14afa3e15506 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:53.698741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f1e5c02-16ce-4a2c-88b3-14afa3e15506 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:53.699228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f1e5c02-16ce-4a2c-88b3-14afa3e15506 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:53.699695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f1e5c02-16ce-4a2c-88b3-14afa3e15506 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:54.184567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1b9721bc-df22-4a9c-b40e-1371116e52ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:54.185769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1b9721bc-df22-4a9c-b40e-1371116e52ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:54.219459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b9721bc-df22-4a9c-b40e-1371116e52ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:54.220875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b9721bc-df22-4a9c-b40e-1371116e52ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:54.225380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b9721bc-df22-4a9c-b40e-1371116e52ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:54.228036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b9721bc-df22-4a9c-b40e-1371116e52ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:54.233847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b9721bc-df22-4a9c-b40e-1371116e52ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:54.235448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b9721bc-df22-4a9c-b40e-1371116e52ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:54.585482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1b9721bc-df22-4a9c-b40e-1371116e52ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:54.608560 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1b9721bc-df22-4a9c-b40e-1371116e52ea tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1735 microversion: 2.1 time: 0.434390 Oct 12 22:22:54.609954 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2346/5309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:54 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1735 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:54.621156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-2019388f-3b30-4654-8445-0ed659470587 req-1d8d73a7-2283-497b-a50f-0bac06e2c22a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02be5cee-72e9-4cc6-94a2-c3517ec178bd", "name": "network-vif-deleted", "tag": "ba67b2ed-d4b3-4942-b9cd-37eda012789a"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:54.645720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2019388f-3b30-4654-8445-0ed659470587 req-1d8d73a7-2283-497b-a50f-0bac06e2c22a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:54.647928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2019388f-3b30-4654-8445-0ed659470587 req-1d8d73a7-2283-497b-a50f-0bac06e2c22a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:54.648940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2019388f-3b30-4654-8445-0ed659470587 req-1d8d73a7-2283-497b-a50f-0bac06e2c22a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:54.675311 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-2019388f-3b30-4654-8445-0ed659470587 req-1d8d73a7-2283-497b-a50f-0bac06e2c22a service nova] Creating event network-vif-deleted:ba67b2ed-d4b3-4942-b9cd-37eda012789a for instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd on n-h1-861111-1 Oct 12 22:22:54.684344 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-2019388f-3b30-4654-8445-0ed659470587 req-1d8d73a7-2283-497b-a50f-0bac06e2c22a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072060 Oct 12 22:22:54.686777 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2347/5310] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:54.694569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-76b5ff1a-6685-4a27-bf11-348ed6c86a46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:54.696640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-76b5ff1a-6685-4a27-bf11-348ed6c86a46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:54.711173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76b5ff1a-6685-4a27-bf11-348ed6c86a46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:54.712948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76b5ff1a-6685-4a27-bf11-348ed6c86a46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:54.714029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76b5ff1a-6685-4a27-bf11-348ed6c86a46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:54.721624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76b5ff1a-6685-4a27-bf11-348ed6c86a46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:54.722863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76b5ff1a-6685-4a27-bf11-348ed6c86a46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:54.723754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76b5ff1a-6685-4a27-bf11-348ed6c86a46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:55.004124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5f1e5c02-16ce-4a2c-88b3-14afa3e15506 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db077881dc7b4893a480d71484c5cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1945a103d7df4bdc8519c3fd6e3f774c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:55.023752 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5f1e5c02-16ce-4a2c-88b3-14afa3e15506 tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 200 len: 1510 microversion: 2.1 time: 1.347461 Oct 12 22:22:55.026693 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2964/5311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:53 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 1510 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:55.438305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-76b5ff1a-6685-4a27-bf11-348ed6c86a46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:55.448676 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-76b5ff1a-6685-4a27-bf11-348ed6c86a46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1292 microversion: 2.1 time: 0.758280 Oct 12 22:22:55.465923 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2348/5312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:54 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1292 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:55.636722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-de089c6a-0996-4e0f-b075-f9c79bc23326 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:55.638985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-de089c6a-0996-4e0f-b075-f9c79bc23326 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:55.659013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de089c6a-0996-4e0f-b075-f9c79bc23326 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:55.660235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de089c6a-0996-4e0f-b075-f9c79bc23326 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:55.660765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de089c6a-0996-4e0f-b075-f9c79bc23326 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:55.661619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de089c6a-0996-4e0f-b075-f9c79bc23326 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:55.662202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de089c6a-0996-4e0f-b075-f9c79bc23326 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:55.663151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de089c6a-0996-4e0f-b075-f9c79bc23326 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:56.049759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e0d265a0-391a-4cb6-a391-6eb89d45c66b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:56.050408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e0d265a0-391a-4cb6-a391-6eb89d45c66b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] [instance: 02be5cee-72e9-4cc6-94a2-c3517ec178bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:56.052490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=64 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:22:56.063493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e0d265a0-391a-4cb6-a391-6eb89d45c66b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:56.064023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e0d265a0-391a-4cb6-a391-6eb89d45c66b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:56.064520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e0d265a0-391a-4cb6-a391-6eb89d45c66b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:56.065249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e0d265a0-391a-4cb6-a391-6eb89d45c66b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:56.065770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e0d265a0-391a-4cb6-a391-6eb89d45c66b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:56.066197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e0d265a0-391a-4cb6-a391-6eb89d45c66b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:56.084309 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-e0d265a0-391a-4cb6-a391-6eb89d45c66b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] HTTP exception thrown: Instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd could not be found. Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e0d265a0-391a-4cb6-a391-6eb89d45c66b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Request method failure captured: Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd HTTP/1.1 Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz07gAzFvxQpLhPykA0kIguGminpAUEuHg465CorRBgBpKwDRJBnGBqW2b5T36cIwDzm7MR6Ea2TywY0_xBBT2CtA_ezRNVXb8ar_JIjxRTIXay9vVTVIGyt04BQHojhLhaGQep80AQuHHZcYVYUSElLEUHN56cw3MuuluKXNvAHVyk Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1945a103d7df4bdc8519c3fd6e3f774c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1945a103d7df4bdc8519c3fd6e3f774c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1945a103d7df4bdc8519c3fd6e3f774c Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929060120 Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: db077881dc7b4893a480d71484c5cba9 Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1929060120-project Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd could not be found. Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '02be5cee-72e9-4cc6-94a2-c3517ec178bd'} Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd could not be found. Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd could not be found. Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:56.086696 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:56.092075 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:56.092075 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:56.092075 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:56.092075 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:56.092075 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:56.092075 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd could not be found. Oct 12 22:22:56.092075 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:22:56.094316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e0d265a0-391a-4cb6-a391-6eb89d45c66b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] Returning 404 to user: Instance 02be5cee-72e9-4cc6-94a2-c3517ec178bd could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:56.095554 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e0d265a0-391a-4cb6-a391-6eb89d45c66b tempest-ServersNegativeTestJSON-1929060120 tempest-ServersNegativeTestJSON-1929060120-project] 10.222.0.16 "GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd" status: 404 len: 111 microversion: 2.1 time: 0.050447 Oct 12 22:22:56.100621 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2349/5313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:56 2022] GET /compute/v2.1/servers/02be5cee-72e9-4cc6-94a2-c3517ec178bd => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:22:56.475975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-35ad779d-f5c2-4b7b-ade8-02a7eb009bc8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:56.476596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-35ad779d-f5c2-4b7b-ade8-02a7eb009bc8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:56.494157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35ad779d-f5c2-4b7b-ade8-02a7eb009bc8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:56.495638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35ad779d-f5c2-4b7b-ade8-02a7eb009bc8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:56.496242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35ad779d-f5c2-4b7b-ade8-02a7eb009bc8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:56.497158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35ad779d-f5c2-4b7b-ade8-02a7eb009bc8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:56.497764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35ad779d-f5c2-4b7b-ade8-02a7eb009bc8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:56.498350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35ad779d-f5c2-4b7b-ade8-02a7eb009bc8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:56.500057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-de089c6a-0996-4e0f-b075-f9c79bc23326 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:56.546384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:22:56.560056 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-de089c6a-0996-4e0f-b075-f9c79bc23326 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1735 microversion: 2.1 time: 0.928706 Oct 12 22:22:56.562585 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2965/5314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:55 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1735 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:57.083647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-35ad779d-f5c2-4b7b-ade8-02a7eb009bc8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:57.095852 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-35ad779d-f5c2-4b7b-ade8-02a7eb009bc8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1472 microversion: 2.1 time: 0.624141 Oct 12 22:22:57.097428 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2350/5315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:56 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1472 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:57.235136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-107726426", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:57.322350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] validate_networks() for [('36f67723-f632-42aa-bcd9-cfd1c5f07f45', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:22:57.589522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-61bc950d-dfb8-4014-ab09-6ea0268f5347 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:57.590774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-61bc950d-dfb8-4014-ab09-6ea0268f5347 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:57.607987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61bc950d-dfb8-4014-ab09-6ea0268f5347 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:57.609298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61bc950d-dfb8-4014-ab09-6ea0268f5347 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:57.610016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61bc950d-dfb8-4014-ab09-6ea0268f5347 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:57.612230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61bc950d-dfb8-4014-ab09-6ea0268f5347 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:57.614421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61bc950d-dfb8-4014-ab09-6ea0268f5347 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:57.615060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61bc950d-dfb8-4014-ab09-6ea0268f5347 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:58.121319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-61bc950d-dfb8-4014-ab09-6ea0268f5347 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:58.138362 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-61bc950d-dfb8-4014-ab09-6ea0268f5347 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1735 microversion: 2.1 time: 0.552408 Oct 12 22:22:58.139000 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2351/5316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:57 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1735 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:59.164764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-286c76c4-b236-49cf-b8f4-683f789619f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:59.166729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-286c76c4-b236-49cf-b8f4-683f789619f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:22:59.178522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-286c76c4-b236-49cf-b8f4-683f789619f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:59.179862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-286c76c4-b236-49cf-b8f4-683f789619f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:59.180693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-286c76c4-b236-49cf-b8f4-683f789619f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:59.183177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-286c76c4-b236-49cf-b8f4-683f789619f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:22:59.184136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-286c76c4-b236-49cf-b8f4-683f789619f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:22:59.187841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-286c76c4-b236-49cf-b8f4-683f789619f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:22:59.944840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-286c76c4-b236-49cf-b8f4-683f789619f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:22:59.988932 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-286c76c4-b236-49cf-b8f4-683f789619f5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1735 microversion: 2.1 time: 0.827473 Oct 12 22:23:00.013230 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2352/5317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:22:59 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1735 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:23:00.437637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:23:00.438197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:23:00.438645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:23:00.439065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:23:00.439772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:23:00.456498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:00.456985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:00.461754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:00.463918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:00.466410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:00.468737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:00.523782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for project 8276c235e518406da376c8a4c19b27d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:23:00.540752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for user 789a612b19154564a853199a67ea8496 and project 8276c235e518406da376c8a4c19b27d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:23:00.577007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:23:00.603407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 866af2f5-9e3f-411a-bcaf-a77aceb6260a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:23:00.696939 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6a451ea2-557a-490a-9170-fa5c1781c3aa tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.468316 Oct 12 22:23:00.700870 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2966/5318] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:22:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:23:00.714545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-35d722a9-3327-4d92-8b01-60aafd6cb3e3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:00.715076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-35d722a9-3327-4d92-8b01-60aafd6cb3e3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 866af2f5-9e3f-411a-bcaf-a77aceb6260a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:00.752487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-35d722a9-3327-4d92-8b01-60aafd6cb3e3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 866af2f5-9e3f-411a-bcaf-a77aceb6260a] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:23:01.026005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3cbc9183-130b-4416-b2ee-cd1806ffc29b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:01.026637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3cbc9183-130b-4416-b2ee-cd1806ffc29b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:01.034675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cbc9183-130b-4416-b2ee-cd1806ffc29b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:01.051060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cbc9183-130b-4416-b2ee-cd1806ffc29b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:01.055688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cbc9183-130b-4416-b2ee-cd1806ffc29b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:01.056475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cbc9183-130b-4416-b2ee-cd1806ffc29b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:01.057481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cbc9183-130b-4416-b2ee-cd1806ffc29b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:01.064919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3cbc9183-130b-4416-b2ee-cd1806ffc29b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:01.560244 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-35d722a9-3327-4d92-8b01-60aafd6cb3e3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/866af2f5-9e3f-411a-bcaf-a77aceb6260a" status: 204 len: 0 microversion: 2.1 time: 0.851544 Oct 12 22:23:01.561602 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2353/5319] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:23:00 2022] DELETE /compute/v2.1/servers/866af2f5-9e3f-411a-bcaf-a77aceb6260a => generated 0 bytes in 854 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:23:01.573832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6a0b8dc9-0987-4f21-8983-89d06b54ccc5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:01.575181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6a0b8dc9-0987-4f21-8983-89d06b54ccc5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 866af2f5-9e3f-411a-bcaf-a77aceb6260a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:01.645609 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-6a0b8dc9-0987-4f21-8983-89d06b54ccc5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6a0b8dc9-0987-4f21-8983-89d06b54ccc5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/866af2f5-9e3f-411a-bcaf-a77aceb6260a HTTP/1.1 Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '866af2f5-9e3f-411a-bcaf-a77aceb6260a'} Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:23:01.652359 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6a0b8dc9-0987-4f21-8983-89d06b54ccc5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:23:01.656714 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6a0b8dc9-0987-4f21-8983-89d06b54ccc5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/866af2f5-9e3f-411a-bcaf-a77aceb6260a" status: 404 len: 111 microversion: 2.1 time: 0.090347 Oct 12 22:23:01.659650 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2354/5320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:01 2022] GET /compute/v2.1/servers/866af2f5-9e3f-411a-bcaf-a77aceb6260a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:23:02.023279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1095324068", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "36f67723-f632-42aa-bcd9-cfd1c5f07f45"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:23:02.083299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3cbc9183-130b-4416-b2ee-cd1806ffc29b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:02.105012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] validate_networks() for [('36f67723-f632-42aa-bcd9-cfd1c5f07f45', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:23:02.110384 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3cbc9183-130b-4416-b2ee-cd1806ffc29b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1735 microversion: 2.1 time: 1.089710 Oct 12 22:23:02.110991 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2967/5321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:01 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1735 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:03.141997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-78f3cad7-c0b2-46a6-8d61-dd224a436409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:03.142710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-78f3cad7-c0b2-46a6-8d61-dd224a436409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:03.163999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78f3cad7-c0b2-46a6-8d61-dd224a436409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:03.165090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78f3cad7-c0b2-46a6-8d61-dd224a436409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:03.165752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78f3cad7-c0b2-46a6-8d61-dd224a436409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:03.168015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78f3cad7-c0b2-46a6-8d61-dd224a436409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:03.170425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78f3cad7-c0b2-46a6-8d61-dd224a436409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:03.172354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78f3cad7-c0b2-46a6-8d61-dd224a436409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:03.619575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:23:03.620714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:23:03.621441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:23:03.622100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:23:03.622679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:23:03.633856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:03.635487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:03.636097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:03.637016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:03.641506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:03.642187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:03.700946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for project 8276c235e518406da376c8a4c19b27d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:23:03.707119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for user 789a612b19154564a853199a67ea8496 and project 8276c235e518406da376c8a4c19b27d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:23:03.728475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:23:03.732450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:23:03.860853 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c1feaa79-5dfb-46ef-b8d2-274d9aef9d7c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.842172 Oct 12 22:23:03.862299 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2355/5322] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:23:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:23:03.878119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c0e7ae0f-f107-4d92-9c27-805657521cb7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:03.878850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-78f3cad7-c0b2-46a6-8d61-dd224a436409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:03.879594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c0e7ae0f-f107-4d92-9c27-805657521cb7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:03.890517 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-78f3cad7-c0b2-46a6-8d61-dd224a436409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1735 microversion: 2.1 time: 0.756162 Oct 12 22:23:03.896864 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2968/5323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:03 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1735 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:23:04.011324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c0e7ae0f-f107-4d92-9c27-805657521cb7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:04.020610 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c0e7ae0f-f107-4d92-9c27-805657521cb7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 200 len: 1221 microversion: 2.1 time: 0.150469 Oct 12 22:23:04.021493 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2356/5324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:03 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 1221 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:23:04.925263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5bf69082-6cc1-48ef-8f69-6fcf0cf91409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:04.925906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5bf69082-6cc1-48ef-8f69-6fcf0cf91409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:04.934742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bf69082-6cc1-48ef-8f69-6fcf0cf91409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:04.935566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bf69082-6cc1-48ef-8f69-6fcf0cf91409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:04.936193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bf69082-6cc1-48ef-8f69-6fcf0cf91409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:04.937100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bf69082-6cc1-48ef-8f69-6fcf0cf91409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:04.937739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bf69082-6cc1-48ef-8f69-6fcf0cf91409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:04.938350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bf69082-6cc1-48ef-8f69-6fcf0cf91409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:05.061978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-653e6e14-6e61-4b61-875c-bf8c539b1775 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:05.065500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-653e6e14-6e61-4b61-875c-bf8c539b1775 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:05.084430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-653e6e14-6e61-4b61-875c-bf8c539b1775 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:05.085591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-653e6e14-6e61-4b61-875c-bf8c539b1775 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:05.086352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-653e6e14-6e61-4b61-875c-bf8c539b1775 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:05.087754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-653e6e14-6e61-4b61-875c-bf8c539b1775 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:05.089090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-653e6e14-6e61-4b61-875c-bf8c539b1775 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:05.090130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-653e6e14-6e61-4b61-875c-bf8c539b1775 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:05.232981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-653e6e14-6e61-4b61-875c-bf8c539b1775 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:05.251528 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-653e6e14-6e61-4b61-875c-bf8c539b1775 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 200 len: 1273 microversion: 2.1 time: 0.206867 Oct 12 22:23:05.255145 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2357/5325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:05 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:23:05.265462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5bf69082-6cc1-48ef-8f69-6fcf0cf91409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:05.284104 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5bf69082-6cc1-48ef-8f69-6fcf0cf91409 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1735 microversion: 2.1 time: 0.362196 Oct 12 22:23:05.286592 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2969/5326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:04 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1735 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:23:06.283864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8a57c557-1e58-47b6-8bba-a110b7dcca50 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:06.285436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8a57c557-1e58-47b6-8bba-a110b7dcca50 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:06.311267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7e86443d-e13c-4000-a01f-fb987da6f8b2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:06.312228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7e86443d-e13c-4000-a01f-fb987da6f8b2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:06.325986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e86443d-e13c-4000-a01f-fb987da6f8b2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:06.326862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e86443d-e13c-4000-a01f-fb987da6f8b2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:06.327385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a57c557-1e58-47b6-8bba-a110b7dcca50 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:06.328101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a57c557-1e58-47b6-8bba-a110b7dcca50 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:06.328725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a57c557-1e58-47b6-8bba-a110b7dcca50 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:06.329617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a57c557-1e58-47b6-8bba-a110b7dcca50 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:06.329947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e86443d-e13c-4000-a01f-fb987da6f8b2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:06.331832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a57c557-1e58-47b6-8bba-a110b7dcca50 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:06.332732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a57c557-1e58-47b6-8bba-a110b7dcca50 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:06.334596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e86443d-e13c-4000-a01f-fb987da6f8b2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:06.335351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e86443d-e13c-4000-a01f-fb987da6f8b2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:06.336020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e86443d-e13c-4000-a01f-fb987da6f8b2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:06.949841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7e86443d-e13c-4000-a01f-fb987da6f8b2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:06.965619 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7e86443d-e13c-4000-a01f-fb987da6f8b2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1735 microversion: 2.1 time: 0.659451 Oct 12 22:23:06.967035 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2970/5327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:06 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1735 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:23:07.083805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8a57c557-1e58-47b6-8bba-a110b7dcca50 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:07.127370 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8a57c557-1e58-47b6-8bba-a110b7dcca50 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 200 len: 1279 microversion: 2.1 time: 0.849952 Oct 12 22:23:07.129111 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2358/5328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:06 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 1279 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:07.995333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1c89d2b9-fdd5-4290-97e4-18995ec738c2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:07.996515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1c89d2b9-fdd5-4290-97e4-18995ec738c2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:08.017102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c89d2b9-fdd5-4290-97e4-18995ec738c2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:08.018953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c89d2b9-fdd5-4290-97e4-18995ec738c2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:08.019769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c89d2b9-fdd5-4290-97e4-18995ec738c2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:08.022848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c89d2b9-fdd5-4290-97e4-18995ec738c2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:08.023619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c89d2b9-fdd5-4290-97e4-18995ec738c2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:08.024809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c89d2b9-fdd5-4290-97e4-18995ec738c2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:08.162396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8618a33c-500f-4513-a612-4626b7a7586d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:08.175004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8618a33c-500f-4513-a612-4626b7a7586d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:08.205051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8618a33c-500f-4513-a612-4626b7a7586d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:08.206830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8618a33c-500f-4513-a612-4626b7a7586d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:08.207806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8618a33c-500f-4513-a612-4626b7a7586d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:08.212774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8618a33c-500f-4513-a612-4626b7a7586d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:08.213878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8618a33c-500f-4513-a612-4626b7a7586d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:08.221465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8618a33c-500f-4513-a612-4626b7a7586d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:08.625712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8618a33c-500f-4513-a612-4626b7a7586d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:08.647280 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8618a33c-500f-4513-a612-4626b7a7586d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 200 len: 1279 microversion: 2.1 time: 0.492717 Oct 12 22:23:08.647896 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2359/5329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:08 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 1279 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:08.849756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1c89d2b9-fdd5-4290-97e4-18995ec738c2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:08.859054 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1c89d2b9-fdd5-4290-97e4-18995ec738c2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1735 microversion: 2.1 time: 0.868619 Oct 12 22:23:08.867846 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2971/5330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:07 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1735 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:09.673008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a5a724f3-78dd-46e3-a045-918541078ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:09.674411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a5a724f3-78dd-46e3-a045-918541078ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:09.685889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5a724f3-78dd-46e3-a045-918541078ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:09.691586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5a724f3-78dd-46e3-a045-918541078ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:09.692335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5a724f3-78dd-46e3-a045-918541078ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:09.693269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5a724f3-78dd-46e3-a045-918541078ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:09.693909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5a724f3-78dd-46e3-a045-918541078ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:09.694537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5a724f3-78dd-46e3-a045-918541078ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:09.894087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-576908d9-e82d-4fe2-a01a-beff7f83de72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:09.895384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-576908d9-e82d-4fe2-a01a-beff7f83de72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:09.908797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-576908d9-e82d-4fe2-a01a-beff7f83de72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:09.912152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-576908d9-e82d-4fe2-a01a-beff7f83de72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:09.912814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-576908d9-e82d-4fe2-a01a-beff7f83de72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:09.914727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-576908d9-e82d-4fe2-a01a-beff7f83de72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:09.922794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-576908d9-e82d-4fe2-a01a-beff7f83de72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:09.923659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-576908d9-e82d-4fe2-a01a-beff7f83de72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:09.951789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:10.492241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:10.561453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:10.950853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-576908d9-e82d-4fe2-a01a-beff7f83de72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:10.963620 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-576908d9-e82d-4fe2-a01a-beff7f83de72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1735 microversion: 2.1 time: 1.073506 Oct 12 22:23:10.979884 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2972/5331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:09 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1735 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:23:11.221444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a5a724f3-78dd-46e3-a045-918541078ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:11.302563 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a5a724f3-78dd-46e3-a045-918541078ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 200 len: 1321 microversion: 2.1 time: 1.629588 Oct 12 22:23:11.329069 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2360/5332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:09 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 1321 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:11.992832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-512caeb9-a6a8-4d0e-8430-bff7d20813b7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:11.994936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-512caeb9-a6a8-4d0e-8430-bff7d20813b7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:12.004744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-512caeb9-a6a8-4d0e-8430-bff7d20813b7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:12.005713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-512caeb9-a6a8-4d0e-8430-bff7d20813b7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:12.006792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-512caeb9-a6a8-4d0e-8430-bff7d20813b7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:12.007736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-512caeb9-a6a8-4d0e-8430-bff7d20813b7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:12.008460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-512caeb9-a6a8-4d0e-8430-bff7d20813b7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:12.009796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-512caeb9-a6a8-4d0e-8430-bff7d20813b7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:12.334953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-08f905a6-b716-460a-834b-aeda50fef2ea tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:12.338668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-08f905a6-b716-460a-834b-aeda50fef2ea tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:12.397688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08f905a6-b716-460a-834b-aeda50fef2ea tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:12.399541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08f905a6-b716-460a-834b-aeda50fef2ea tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:12.405963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08f905a6-b716-460a-834b-aeda50fef2ea tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:12.411358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08f905a6-b716-460a-834b-aeda50fef2ea tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:12.413267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08f905a6-b716-460a-834b-aeda50fef2ea tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:12.414135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08f905a6-b716-460a-834b-aeda50fef2ea tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:12.944853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-512caeb9-a6a8-4d0e-8430-bff7d20813b7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:12.960858 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-512caeb9-a6a8-4d0e-8430-bff7d20813b7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1735 microversion: 2.1 time: 0.973338 Oct 12 22:23:12.961473 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2973/5333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:11 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1735 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:13.102134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-4f463797-15f3-44f4-a860-4a16f546ae78 req-ee49967c-b45d-48da-8b0a-1dbedf1f96b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7d78e6-11af-404e-ad70-5c3d6e04bd90", "tag": "f5e25009-f1c3-4637-9322-7915f440da15"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:23:13.116153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4f463797-15f3-44f4-a860-4a16f546ae78 req-ee49967c-b45d-48da-8b0a-1dbedf1f96b9 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:13.116907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4f463797-15f3-44f4-a860-4a16f546ae78 req-ee49967c-b45d-48da-8b0a-1dbedf1f96b9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:13.118467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4f463797-15f3-44f4-a860-4a16f546ae78 req-ee49967c-b45d-48da-8b0a-1dbedf1f96b9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:13.134494 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-4f463797-15f3-44f4-a860-4a16f546ae78 req-ee49967c-b45d-48da-8b0a-1dbedf1f96b9 service nova] Creating event network-changed:f5e25009-f1c3-4637-9322-7915f440da15 for instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 on n-h1-861111-1 Oct 12 22:23:13.141200 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-4f463797-15f3-44f4-a860-4a16f546ae78 req-ee49967c-b45d-48da-8b0a-1dbedf1f96b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047093 Oct 12 22:23:13.142428 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2974/5334] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:23:13.473510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-08f905a6-b716-460a-834b-aeda50fef2ea tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:13.485086 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-08f905a6-b716-460a-834b-aeda50fef2ea tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 200 len: 1321 microversion: 2.1 time: 1.155992 Oct 12 22:23:13.486205 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2361/5335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:12 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 1321 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:13.989399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-29d24b2d-1888-4de8-a1f1-dbbbaef91c3b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:13.990423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-29d24b2d-1888-4de8-a1f1-dbbbaef91c3b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:13.998234 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d24b2d-1888-4de8-a1f1-dbbbaef91c3b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:13.998980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d24b2d-1888-4de8-a1f1-dbbbaef91c3b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:13.999854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d24b2d-1888-4de8-a1f1-dbbbaef91c3b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:14.000759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d24b2d-1888-4de8-a1f1-dbbbaef91c3b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:14.001382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d24b2d-1888-4de8-a1f1-dbbbaef91c3b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:14.001989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d24b2d-1888-4de8-a1f1-dbbbaef91c3b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:14.509212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e77b8f0b-18ef-4bfe-ae7e-1da860a2daf8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:14.509986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e77b8f0b-18ef-4bfe-ae7e-1da860a2daf8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:14.521921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:14.526052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=10 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:14.528546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e77b8f0b-18ef-4bfe-ae7e-1da860a2daf8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:14.532224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e77b8f0b-18ef-4bfe-ae7e-1da860a2daf8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:14.532576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e77b8f0b-18ef-4bfe-ae7e-1da860a2daf8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:14.533337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e77b8f0b-18ef-4bfe-ae7e-1da860a2daf8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:14.533814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e77b8f0b-18ef-4bfe-ae7e-1da860a2daf8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:14.534255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e77b8f0b-18ef-4bfe-ae7e-1da860a2daf8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:14.694488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-29d24b2d-1888-4de8-a1f1-dbbbaef91c3b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:14.731176 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-29d24b2d-1888-4de8-a1f1-dbbbaef91c3b tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1735 microversion: 2.1 time: 0.745916 Oct 12 22:23:14.732510 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2975/5336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:13 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1735 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:15.406063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e77b8f0b-18ef-4bfe-ae7e-1da860a2daf8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:15.416970 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e77b8f0b-18ef-4bfe-ae7e-1da860a2daf8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 200 len: 1321 microversion: 2.1 time: 0.911659 Oct 12 22:23:15.423420 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2362/5337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:14 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 1321 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:23:15.762310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0e526354-843d-4efb-ba4f-be457db66669 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:15.774032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0e526354-843d-4efb-ba4f-be457db66669 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:15.784073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:15.791671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e526354-843d-4efb-ba4f-be457db66669 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:15.794028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e526354-843d-4efb-ba4f-be457db66669 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:15.794661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e526354-843d-4efb-ba4f-be457db66669 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:15.797455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e526354-843d-4efb-ba4f-be457db66669 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:15.798171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e526354-843d-4efb-ba4f-be457db66669 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:15.798811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e526354-843d-4efb-ba4f-be457db66669 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:16.446377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0e526354-843d-4efb-ba4f-be457db66669 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:16.449727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e9158d23-6687-419b-8819-fb22e6dc8040 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:16.450361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e9158d23-6687-419b-8819-fb22e6dc8040 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:16.466743 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0e526354-843d-4efb-ba4f-be457db66669 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1715 microversion: 2.1 time: 0.716038 Oct 12 22:23:16.469449 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2976/5338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:15 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1715 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:16.482145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9158d23-6687-419b-8819-fb22e6dc8040 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:16.483018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9158d23-6687-419b-8819-fb22e6dc8040 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:16.485242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9158d23-6687-419b-8819-fb22e6dc8040 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:16.489833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9158d23-6687-419b-8819-fb22e6dc8040 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:16.490401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9158d23-6687-419b-8819-fb22e6dc8040 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:16.505611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9158d23-6687-419b-8819-fb22e6dc8040 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:16.774392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-13d87052-895b-42a8-ab70-32ef5f7708f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:16.775714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-13d87052-895b-42a8-ab70-32ef5f7708f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:16.792785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13d87052-895b-42a8-ab70-32ef5f7708f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:16.793660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13d87052-895b-42a8-ab70-32ef5f7708f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:16.794319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13d87052-895b-42a8-ab70-32ef5f7708f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:16.795551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13d87052-895b-42a8-ab70-32ef5f7708f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:16.796872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13d87052-895b-42a8-ab70-32ef5f7708f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:16.797435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-13d87052-895b-42a8-ab70-32ef5f7708f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:16.951140 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-13d87052-895b-42a8-ab70-32ef5f7708f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] HTTP exception thrown: Cannot 'detach_volume' instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec while it is in vm_state rescued Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-13d87052-895b-42a8-ab70-32ef5f7708f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Request method failure captured: Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments/e09ded0a-4d68-40dd-a52b-da0a239a475a HTTP/1.1 Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz1yYv3BEuyn16aX9rFnQkuXp35mHqXE7bVOWKfvxNZXNT7qw6co-FDMauTgJfMPQCxmiEKAu0kzyjnis87qTpfUYp96yN_F6sfmIZnSLJLUbYy9WREcLUGhzXNPjj1UORIJx3lHLMBoOzDKf1JzqCDKyG4PBpXcEQzC9GdyMUjXkpQ Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0a0c4d9f435a4c009bd0b5eb2618829b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: afec4a3808b84463900b744ecd9352b6 Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: exception: Cannot 'detach_volume' instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec while it is in vm_state rescued Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'server_id': 'd4f2400d-a508-4bfc-b84f-bc80a4c28fec', 'id': 'e09ded0a-4d68-40dd-a52b-da0a239a475a'} Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec while it is in vm_state rescued Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:23:16.954250 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:23:16.960519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:23:16.960519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:23:16.960519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:23:16.960519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:23:16.960519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec while it is in vm_state rescued Oct 12 22:23:16.960519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:23:16.962201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-13d87052-895b-42a8-ab70-32ef5f7708f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Returning 409 to user: Cannot 'detach_volume' instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec while it is in vm_state rescued {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:23:16.963510 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-13d87052-895b-42a8-ab70-32ef5f7708f6 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments/e09ded0a-4d68-40dd-a52b-da0a239a475a" status: 409 len: 152 microversion: 2.1 time: 0.194655 Oct 12 22:23:16.964566 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2977/5339] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 22:23:16 2022] DELETE /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments/e09ded0a-4d68-40dd-a52b-da0a239a475a => generated 152 bytes in 200 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:23:16.984357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c370469f-c624-4a82-8213-7fa828cbf08a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:23:16.986040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c370469f-c624-4a82-8213-7fa828cbf08a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:17.008228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c370469f-c624-4a82-8213-7fa828cbf08a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:17.010162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c370469f-c624-4a82-8213-7fa828cbf08a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:17.011986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c370469f-c624-4a82-8213-7fa828cbf08a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:17.013919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c370469f-c624-4a82-8213-7fa828cbf08a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:17.017484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c370469f-c624-4a82-8213-7fa828cbf08a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:17.018427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c370469f-c624-4a82-8213-7fa828cbf08a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:17.223932 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c370469f-c624-4a82-8213-7fa828cbf08a tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "POST /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/action" status: 202 len: 0 microversion: 2.1 time: 0.254609 Oct 12 22:23:17.225416 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2978/5340] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:23:16 2022] POST /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:23:17.240427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5e01ebfb-8be0-41c1-a237-fbcafead9ab8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:17.241778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5e01ebfb-8be0-41c1-a237-fbcafead9ab8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:17.266516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e01ebfb-8be0-41c1-a237-fbcafead9ab8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:17.267721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e01ebfb-8be0-41c1-a237-fbcafead9ab8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:17.269127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e01ebfb-8be0-41c1-a237-fbcafead9ab8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:17.271910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e01ebfb-8be0-41c1-a237-fbcafead9ab8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:17.274489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e01ebfb-8be0-41c1-a237-fbcafead9ab8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:17.276295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e01ebfb-8be0-41c1-a237-fbcafead9ab8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:18.057415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e9158d23-6687-419b-8819-fb22e6dc8040 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:18.106975 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e9158d23-6687-419b-8819-fb22e6dc8040 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 200 len: 1321 microversion: 2.1 time: 1.664760 Oct 12 22:23:18.110302 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2363/5341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:16 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 1321 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:18.449199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5e01ebfb-8be0-41c1-a237-fbcafead9ab8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:18.469591 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5e01ebfb-8be0-41c1-a237-fbcafead9ab8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1723 microversion: 2.1 time: 1.238695 Oct 12 22:23:18.482403 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2979/5342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:17 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1723 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:19.133221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d414b748-d51e-4d2f-80bb-446ae56085d3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:19.134021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d414b748-d51e-4d2f-80bb-446ae56085d3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:19.148737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d414b748-d51e-4d2f-80bb-446ae56085d3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:19.151615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d414b748-d51e-4d2f-80bb-446ae56085d3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:19.152061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d414b748-d51e-4d2f-80bb-446ae56085d3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:19.152930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d414b748-d51e-4d2f-80bb-446ae56085d3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:19.156375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d414b748-d51e-4d2f-80bb-446ae56085d3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:19.156931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d414b748-d51e-4d2f-80bb-446ae56085d3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:19.499274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8c284c5b-8c4a-4427-8633-abdc70830a77 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:19.500935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8c284c5b-8c4a-4427-8633-abdc70830a77 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:19.518890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c284c5b-8c4a-4427-8633-abdc70830a77 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:19.519701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c284c5b-8c4a-4427-8633-abdc70830a77 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:19.520368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c284c5b-8c4a-4427-8633-abdc70830a77 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:19.521278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c284c5b-8c4a-4427-8633-abdc70830a77 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:19.521916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c284c5b-8c4a-4427-8633-abdc70830a77 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:19.522524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8c284c5b-8c4a-4427-8633-abdc70830a77 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:19.859751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d414b748-d51e-4d2f-80bb-446ae56085d3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:19.883115 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d414b748-d51e-4d2f-80bb-446ae56085d3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 200 len: 1321 microversion: 2.1 time: 0.756905 Oct 12 22:23:19.884261 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2364/5343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:19 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 1321 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:20.329659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8c284c5b-8c4a-4427-8633-abdc70830a77 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:20.341286 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8c284c5b-8c4a-4427-8633-abdc70830a77 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1723 microversion: 2.1 time: 0.845976 Oct 12 22:23:20.356037 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2980/5344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:19 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1723 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:20.911778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a1588f8-2765-4516-9382-beba0fb4af9e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:20.912423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7a1588f8-2765-4516-9382-beba0fb4af9e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:20.926171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a1588f8-2765-4516-9382-beba0fb4af9e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:20.933692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a1588f8-2765-4516-9382-beba0fb4af9e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:20.934177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a1588f8-2765-4516-9382-beba0fb4af9e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:20.934958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a1588f8-2765-4516-9382-beba0fb4af9e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:20.935460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a1588f8-2765-4516-9382-beba0fb4af9e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:20.944527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a1588f8-2765-4516-9382-beba0fb4af9e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:21.377669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3de2b374-427e-4969-920d-34f6a70ca137 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:21.379869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3de2b374-427e-4969-920d-34f6a70ca137 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:21.403041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3de2b374-427e-4969-920d-34f6a70ca137 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:21.404089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3de2b374-427e-4969-920d-34f6a70ca137 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:21.406930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3de2b374-427e-4969-920d-34f6a70ca137 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:21.409794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3de2b374-427e-4969-920d-34f6a70ca137 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:21.410458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3de2b374-427e-4969-920d-34f6a70ca137 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:21.411098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3de2b374-427e-4969-920d-34f6a70ca137 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:21.586944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a1588f8-2765-4516-9382-beba0fb4af9e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:21.602697 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7a1588f8-2765-4516-9382-beba0fb4af9e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 200 len: 1321 microversion: 2.1 time: 0.695032 Oct 12 22:23:21.615509 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2365/5345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:20 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 1321 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:21.952050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3de2b374-427e-4969-920d-34f6a70ca137 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:21.965983 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3de2b374-427e-4969-920d-34f6a70ca137 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1723 microversion: 2.1 time: 0.601439 Oct 12 22:23:21.974553 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2981/5346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:21 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1723 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:22.482015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd4228ab-30d9-4c36-8fc1-948a7d53c276 tempest-ServerGroup264TestJSON-105295802 tempest-ServerGroup264TestJSON-105295802-project] Action: 'create', calling method: .version_select at 0x7f51236e71f0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:23:22.523980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-cd4228ab-30d9-4c36-8fc1-948a7d53c276 tempest-ServerGroup264TestJSON-105295802 tempest-ServerGroup264TestJSON-105295802-project] Getting quotas for project c0f751c33d534c6dad82dae8ebf9ca9b. Resources: {'server_groups'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:23:22.541279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-cd4228ab-30d9-4c36-8fc1-948a7d53c276 tempest-ServerGroup264TestJSON-105295802 tempest-ServerGroup264TestJSON-105295802-project] Getting quotas for user d536c1e071e344a7a8e64f2d0477ac00 and project c0f751c33d534c6dad82dae8ebf9ca9b. Resources: {'server_groups'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:23:22.629426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4c755a81-4a86-4086-90a7-7b4105121433 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:22.630054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4c755a81-4a86-4086-90a7-7b4105121433 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:22.640195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c755a81-4a86-4086-90a7-7b4105121433 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:22.640976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c755a81-4a86-4086-90a7-7b4105121433 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:22.641467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c755a81-4a86-4086-90a7-7b4105121433 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:22.672337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c755a81-4a86-4086-90a7-7b4105121433 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:22.673832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c755a81-4a86-4086-90a7-7b4105121433 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:22.674396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-cd4228ab-30d9-4c36-8fc1-948a7d53c276 tempest-ServerGroup264TestJSON-105295802 tempest-ServerGroup264TestJSON-105295802-project] Getting quotas for project c0f751c33d534c6dad82dae8ebf9ca9b. Resources: {'server_groups'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:23:22.674956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c755a81-4a86-4086-90a7-7b4105121433 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:22.693604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-cd4228ab-30d9-4c36-8fc1-948a7d53c276 tempest-ServerGroup264TestJSON-105295802 tempest-ServerGroup264TestJSON-105295802-project] Getting quotas for user d536c1e071e344a7a8e64f2d0477ac00 and project c0f751c33d534c6dad82dae8ebf9ca9b. Resources: {'server_groups'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:23:22.718090 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cd4228ab-30d9-4c36-8fc1-948a7d53c276 tempest-ServerGroup264TestJSON-105295802 tempest-ServerGroup264TestJSON-105295802-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.469869 Oct 12 22:23:22.718837 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2366/5347] 10.222.0.16 () {62 vars in 1214 bytes} [Wed Oct 12 22:23:22 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:23:22.739859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b6149947-0b3f-4f16-b60a-6e4f26a6361a tempest-ServerGroup264TestJSON-105295802 tempest-ServerGroup264TestJSON-105295802-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:22.802060 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b6149947-0b3f-4f16-b60a-6e4f26a6361a tempest-ServerGroup264TestJSON-105295802 tempest-ServerGroup264TestJSON-105295802-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.074963 Oct 12 22:23:22.804750 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2367/5348] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 12 22:23:22 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:23:22.820472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ce6f25ba-7525-402a-95cd-ad06e3079d5d tempest-ServerGroup264TestJSON-105295802 tempest-ServerGroup264TestJSON-105295802-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:22.851300 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ce6f25ba-7525-402a-95cd-ad06e3079d5d tempest-ServerGroup264TestJSON-105295802 tempest-ServerGroup264TestJSON-105295802-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/655392c1-0635-49a6-ba13-2871e25492a9" status: 200 len: 235 microversion: 2.64 time: 0.035150 Oct 12 22:23:22.853749 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2368/5349] 10.222.0.16 () {60 vars in 1304 bytes} [Wed Oct 12 22:23:22 2022] GET /compute/v2.1/os-server-groups/655392c1-0635-49a6-ba13-2871e25492a9 => generated 235 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 22:23:22.863929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d578f1ec-2a5b-432c-a119-0ef101754cc5 tempest-ServerGroup264TestJSON-105295802 tempest-ServerGroup264TestJSON-105295802-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:22.885810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:22.906097 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d578f1ec-2a5b-432c-a119-0ef101754cc5 tempest-ServerGroup264TestJSON-105295802 tempest-ServerGroup264TestJSON-105295802-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/655392c1-0635-49a6-ba13-2871e25492a9" status: 204 len: 0 microversion: 2.64 time: 0.045874 Oct 12 22:23:22.912935 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2369/5350] 10.222.0.16 () {60 vars in 1307 bytes} [Wed Oct 12 22:23:22 2022] DELETE /compute/v2.1/os-server-groups/655392c1-0635-49a6-ba13-2871e25492a9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 22:23:22.924793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-330cbda7-0b08-493e-84e8-b56c9079f2ca tempest-ServerGroup264TestJSON-105295802 tempest-ServerGroup264TestJSON-105295802-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:22.933600 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-330cbda7-0b08-493e-84e8-b56c9079f2ca tempest-ServerGroup264TestJSON-105295802 tempest-ServerGroup264TestJSON-105295802-project] HTTP exception thrown: Instance group 655392c1-0635-49a6-ba13-2871e25492a9 could not be found. Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-330cbda7-0b08-493e-84e8-b56c9079f2ca tempest-ServerGroup264TestJSON-105295802 tempest-ServerGroup264TestJSON-105295802-project] Request method failure captured: Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/os-server-groups/655392c1-0635-49a6-ba13-2871e25492a9 HTTP/1.1 Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz5avbNmsUViaAIzONRpqZRBbpC7XQNJWrgY2FIQBAUrnhHbXA0zqc0k6pwfhwCWJsEWqiG8hrc-FR28vXcJLbjhkXL6KVwFDi-EmKAUQjt2BvtPOmp6rGv6UD7HVDDhIluBGiZl008bqeemwuplt2pERsU_E2Qeiz-7FZsJa8g2sSM Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-Openstack-Nova-Api-Version: 2.64 Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: c0f751c33d534c6dad82dae8ebf9ca9b Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerGroup264TestJSON-105295802 Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c0f751c33d534c6dad82dae8ebf9ca9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c0f751c33d534c6dad82dae8ebf9ca9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c0f751c33d534c6dad82dae8ebf9ca9b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c0f751c33d534c6dad82dae8ebf9ca9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerGroup264TestJSON-105295802 Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: c0f751c33d534c6dad82dae8ebf9ca9b Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerGroup264TestJSON-105295802 Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerGroup264TestJSON-105295802-project Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: d536c1e071e344a7a8e64f2d0477ac00 Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerGroup264TestJSON-105295802-project Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance group 655392c1-0635-49a6-ba13-2871e25492a9 could not be found. Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '655392c1-0635-49a6-ba13-2871e25492a9'} Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 655392c1-0635-49a6-ba13-2871e25492a9 could not be found. Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 655392c1-0635-49a6-ba13-2871e25492a9 could not be found. Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:23:22.935580 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:23:22.940854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:23:22.940854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:23:22.940854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:23:22.940854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:23:22.940854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 655392c1-0635-49a6-ba13-2871e25492a9 could not be found. Oct 12 22:23:22.940854 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:23:22.943002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-330cbda7-0b08-493e-84e8-b56c9079f2ca tempest-ServerGroup264TestJSON-105295802 tempest-ServerGroup264TestJSON-105295802-project] Returning 404 to user: Instance group 655392c1-0635-49a6-ba13-2871e25492a9 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:23:22.949633 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-330cbda7-0b08-493e-84e8-b56c9079f2ca tempest-ServerGroup264TestJSON-105295802 tempest-ServerGroup264TestJSON-105295802-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/655392c1-0635-49a6-ba13-2871e25492a9" status: 404 len: 117 microversion: 2.64 time: 0.035094 Oct 12 22:23:22.954614 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2370/5351] 10.222.0.16 () {60 vars in 1307 bytes} [Wed Oct 12 22:23:22 2022] DELETE /compute/v2.1/os-server-groups/655392c1-0635-49a6-ba13-2871e25492a9 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:23:22.997898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f112eb0a-78af-45c4-b831-9212cc7e0664 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:22.999652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f112eb0a-78af-45c4-b831-9212cc7e0664 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:23.017764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f112eb0a-78af-45c4-b831-9212cc7e0664 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:23.018270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f112eb0a-78af-45c4-b831-9212cc7e0664 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:23.018715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f112eb0a-78af-45c4-b831-9212cc7e0664 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:23.019462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f112eb0a-78af-45c4-b831-9212cc7e0664 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:23.020111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f112eb0a-78af-45c4-b831-9212cc7e0664 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:23.020733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f112eb0a-78af-45c4-b831-9212cc7e0664 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:23.607493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4c755a81-4a86-4086-90a7-7b4105121433 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:23.619191 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4c755a81-4a86-4086-90a7-7b4105121433 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 200 len: 1321 microversion: 2.1 time: 0.993466 Oct 12 22:23:23.620637 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2982/5352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:22 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 1321 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:23:23.909998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f112eb0a-78af-45c4-b831-9212cc7e0664 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:23.938235 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f112eb0a-78af-45c4-b831-9212cc7e0664 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1723 microversion: 2.1 time: 0.944588 Oct 12 22:23:23.940080 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2371/5353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:22 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1723 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:23:24.631841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f3a91986-e1c0-4b23-9ec3-0d821a6fa777 req-dab2227b-0dea-48bc-a5a2-6852911cd739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7d78e6-11af-404e-ad70-5c3d6e04bd90", "name": "network-vif-plugged", "status": "completed", "tag": "f5e25009-f1c3-4637-9322-7915f440da15"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:23:24.642640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-370e942b-a5f9-4c64-9e59-82e9303673ae tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:24.643483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-370e942b-a5f9-4c64-9e59-82e9303673ae tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:24.707998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-370e942b-a5f9-4c64-9e59-82e9303673ae tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:24.708839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-370e942b-a5f9-4c64-9e59-82e9303673ae tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:24.709758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-370e942b-a5f9-4c64-9e59-82e9303673ae tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:24.710659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-370e942b-a5f9-4c64-9e59-82e9303673ae tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:24.711774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f3a91986-e1c0-4b23-9ec3-0d821a6fa777 req-dab2227b-0dea-48bc-a5a2-6852911cd739 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:24.713012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f3a91986-e1c0-4b23-9ec3-0d821a6fa777 req-dab2227b-0dea-48bc-a5a2-6852911cd739 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:24.713714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f3a91986-e1c0-4b23-9ec3-0d821a6fa777 req-dab2227b-0dea-48bc-a5a2-6852911cd739 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:24.713945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-370e942b-a5f9-4c64-9e59-82e9303673ae tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:24.714593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-370e942b-a5f9-4c64-9e59-82e9303673ae tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:24.752075 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f3a91986-e1c0-4b23-9ec3-0d821a6fa777 req-dab2227b-0dea-48bc-a5a2-6852911cd739 service nova] Creating event network-vif-plugged:f5e25009-f1c3-4637-9322-7915f440da15 for instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 on n-h1-861111-1 Oct 12 22:23:24.773838 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f3a91986-e1c0-4b23-9ec3-0d821a6fa777 req-dab2227b-0dea-48bc-a5a2-6852911cd739 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153747 Oct 12 22:23:24.789284 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2983/5354] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:23:24.966048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-068df440-ae86-4d74-891a-feea9b767ea8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:24.967064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-068df440-ae86-4d74-891a-feea9b767ea8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:24.974799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-068df440-ae86-4d74-891a-feea9b767ea8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:24.975673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-068df440-ae86-4d74-891a-feea9b767ea8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:24.977018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-068df440-ae86-4d74-891a-feea9b767ea8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:24.978692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-068df440-ae86-4d74-891a-feea9b767ea8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:24.979516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-068df440-ae86-4d74-891a-feea9b767ea8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:24.980442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-068df440-ae86-4d74-891a-feea9b767ea8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:25.497793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-068df440-ae86-4d74-891a-feea9b767ea8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:25.520177 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-068df440-ae86-4d74-891a-feea9b767ea8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1729 microversion: 2.1 time: 0.561666 Oct 12 22:23:25.522689 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2984/5355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:24 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1729 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:25.553473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4f3d81d3-d9f9-428e-871a-3d0731ac56e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:25.558210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4f3d81d3-d9f9-428e-871a-3d0731ac56e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:25.574679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f3d81d3-d9f9-428e-871a-3d0731ac56e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:25.577479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f3d81d3-d9f9-428e-871a-3d0731ac56e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:25.578198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f3d81d3-d9f9-428e-871a-3d0731ac56e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:25.582378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f3d81d3-d9f9-428e-871a-3d0731ac56e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:25.583320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f3d81d3-d9f9-428e-871a-3d0731ac56e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:25.584006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f3d81d3-d9f9-428e-871a-3d0731ac56e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:25.878400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-370e942b-a5f9-4c64-9e59-82e9303673ae tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:25.890231 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4f3d81d3-d9f9-428e-871a-3d0731ac56e7 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.349266 Oct 12 22:23:25.891870 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2985/5356] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:23:25 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-interface => generated 284 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:23:25.911525 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-370e942b-a5f9-4c64-9e59-82e9303673ae tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 200 len: 1321 microversion: 2.1 time: 1.252401 Oct 12 22:23:25.913399 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2372/5357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:24 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 1321 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:26.942629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-90b20864-bc84-419f-8a3f-c5d1d25544b8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:26.947180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-90b20864-bc84-419f-8a3f-c5d1d25544b8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:26.960061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90b20864-bc84-419f-8a3f-c5d1d25544b8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:26.960556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90b20864-bc84-419f-8a3f-c5d1d25544b8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:26.961297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90b20864-bc84-419f-8a3f-c5d1d25544b8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:26.962745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90b20864-bc84-419f-8a3f-c5d1d25544b8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:26.963580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90b20864-bc84-419f-8a3f-c5d1d25544b8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:26.964180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-90b20864-bc84-419f-8a3f-c5d1d25544b8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:28.097304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-90b20864-bc84-419f-8a3f-c5d1d25544b8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:28.113256 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-90b20864-bc84-419f-8a3f-c5d1d25544b8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 200 len: 1502 microversion: 2.1 time: 1.176725 Oct 12 22:23:28.119034 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2986/5358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:26 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 1502 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:28.141486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f0b3a3f6-9ed0-4249-90c4-33701cb2dee6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:28.142308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f0b3a3f6-9ed0-4249-90c4-33701cb2dee6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:28.149816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0b3a3f6-9ed0-4249-90c4-33701cb2dee6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:28.150307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0b3a3f6-9ed0-4249-90c4-33701cb2dee6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:28.150739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0b3a3f6-9ed0-4249-90c4-33701cb2dee6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:28.151483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0b3a3f6-9ed0-4249-90c4-33701cb2dee6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:28.152125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0b3a3f6-9ed0-4249-90c4-33701cb2dee6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:28.152660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0b3a3f6-9ed0-4249-90c4-33701cb2dee6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:28.161597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=83 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:29.214949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f0b3a3f6-9ed0-4249-90c4-33701cb2dee6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:29.233040 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f0b3a3f6-9ed0-4249-90c4-33701cb2dee6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 200 len: 1502 microversion: 2.1 time: 1.094550 Oct 12 22:23:29.233876 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2373/5359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:28 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 1502 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:23:29.256187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-38293d98-f99a-42e1-a135-c67b6bfe2db0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:29.257395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-38293d98-f99a-42e1-a135-c67b6bfe2db0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:29.265441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38293d98-f99a-42e1-a135-c67b6bfe2db0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:29.266333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38293d98-f99a-42e1-a135-c67b6bfe2db0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:29.266990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38293d98-f99a-42e1-a135-c67b6bfe2db0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:29.267958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38293d98-f99a-42e1-a135-c67b6bfe2db0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:29.268634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38293d98-f99a-42e1-a135-c67b6bfe2db0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:29.269280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38293d98-f99a-42e1-a135-c67b6bfe2db0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:29.318122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-38293d98-f99a-42e1-a135-c67b6bfe2db0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:23:29.492682 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-38293d98-f99a-42e1-a135-c67b6bfe2db0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 204 len: 0 microversion: 2.1 time: 0.239943 Oct 12 22:23:29.495478 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2987/5360] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:23:29 2022] DELETE /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:23:29.506889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e1cf7f8e-fd2c-4d86-81c2-673bb855e8be tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:29.508060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e1cf7f8e-fd2c-4d86-81c2-673bb855e8be tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:29.519462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1cf7f8e-fd2c-4d86-81c2-673bb855e8be tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:29.520431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1cf7f8e-fd2c-4d86-81c2-673bb855e8be tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:29.521496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1cf7f8e-fd2c-4d86-81c2-673bb855e8be tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:29.522917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1cf7f8e-fd2c-4d86-81c2-673bb855e8be tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:29.523820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1cf7f8e-fd2c-4d86-81c2-673bb855e8be tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:29.544032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1cf7f8e-fd2c-4d86-81c2-673bb855e8be tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:29.676359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-0f526e13-0767-4d24-b243-64c7a23d8c40 req-46733a5e-6697-4de4-a0ba-d4f14fcb46a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f2400d-a508-4bfc-b84f-bc80a4c28fec", "tag": "79f72797-4736-4c93-86f4-3bf45c9f94fd"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:23:29.705755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0f526e13-0767-4d24-b243-64c7a23d8c40 req-46733a5e-6697-4de4-a0ba-d4f14fcb46a2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:29.706525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0f526e13-0767-4d24-b243-64c7a23d8c40 req-46733a5e-6697-4de4-a0ba-d4f14fcb46a2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:29.709418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0f526e13-0767-4d24-b243-64c7a23d8c40 req-46733a5e-6697-4de4-a0ba-d4f14fcb46a2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:29.735729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:29.743945 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-0f526e13-0767-4d24-b243-64c7a23d8c40 req-46733a5e-6697-4de4-a0ba-d4f14fcb46a2 service nova] Creating event network-changed:79f72797-4736-4c93-86f4-3bf45c9f94fd for instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec on n-h1-861111-1 Oct 12 22:23:29.757795 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-0f526e13-0767-4d24-b243-64c7a23d8c40 req-46733a5e-6697-4de4-a0ba-d4f14fcb46a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087914 Oct 12 22:23:29.758812 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2988/5361] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:23:30.272946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e1cf7f8e-fd2c-4d86-81c2-673bb855e8be tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:30.292957 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e1cf7f8e-fd2c-4d86-81c2-673bb855e8be tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 200 len: 1508 microversion: 2.1 time: 0.787772 Oct 12 22:23:30.305207 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2374/5362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:29 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 1508 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:31.326445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-91439ada-a5c4-48f3-820c-f600fbe15f81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:31.327777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-91439ada-a5c4-48f3-820c-f600fbe15f81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:31.367093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91439ada-a5c4-48f3-820c-f600fbe15f81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:31.369002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91439ada-a5c4-48f3-820c-f600fbe15f81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:31.369714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91439ada-a5c4-48f3-820c-f600fbe15f81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:31.372335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91439ada-a5c4-48f3-820c-f600fbe15f81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:31.374983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91439ada-a5c4-48f3-820c-f600fbe15f81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:31.378235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91439ada-a5c4-48f3-820c-f600fbe15f81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:32.196909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-016731ba-a27e-4682-8476-a4cf3496fadd req-560266a8-46c1-471e-b50e-63674757c396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f2400d-a508-4bfc-b84f-bc80a4c28fec", "tag": "79f72797-4736-4c93-86f4-3bf45c9f94fd"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:23:32.207536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-016731ba-a27e-4682-8476-a4cf3496fadd req-560266a8-46c1-471e-b50e-63674757c396 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:32.208332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-016731ba-a27e-4682-8476-a4cf3496fadd req-560266a8-46c1-471e-b50e-63674757c396 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:32.209004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-016731ba-a27e-4682-8476-a4cf3496fadd req-560266a8-46c1-471e-b50e-63674757c396 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:32.221676 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-016731ba-a27e-4682-8476-a4cf3496fadd req-560266a8-46c1-471e-b50e-63674757c396 service nova] Creating event network-changed:79f72797-4736-4c93-86f4-3bf45c9f94fd for instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec on n-h1-861111-1 Oct 12 22:23:32.227964 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-016731ba-a27e-4682-8476-a4cf3496fadd req-560266a8-46c1-471e-b50e-63674757c396 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035548 Oct 12 22:23:32.229137 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2375/5363] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:23:32.313682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-91439ada-a5c4-48f3-820c-f600fbe15f81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:32.330438 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-91439ada-a5c4-48f3-820c-f600fbe15f81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 200 len: 1508 microversion: 2.1 time: 1.014525 Oct 12 22:23:32.348882 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2989/5364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:31 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 1508 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:33.359680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f68161b1-cc62-40c5-aaa0-54c8910909f9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:33.361287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f68161b1-cc62-40c5-aaa0-54c8910909f9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:33.363928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:33.378879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f68161b1-cc62-40c5-aaa0-54c8910909f9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:33.378879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f68161b1-cc62-40c5-aaa0-54c8910909f9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:33.379224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f68161b1-cc62-40c5-aaa0-54c8910909f9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:33.384703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f68161b1-cc62-40c5-aaa0-54c8910909f9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:33.386844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f68161b1-cc62-40c5-aaa0-54c8910909f9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:33.387764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f68161b1-cc62-40c5-aaa0-54c8910909f9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:33.480367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f68161b1-cc62-40c5-aaa0-54c8910909f9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:33.480367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f68161b1-cc62-40c5-aaa0-54c8910909f9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:33.482327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f68161b1-cc62-40c5-aaa0-54c8910909f9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:33.483183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-f68161b1-cc62-40c5-aaa0-54c8910909f9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lazy-loading 'fault' on Instance uuid 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:23:33.791019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f68161b1-cc62-40c5-aaa0-54c8910909f9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:33.811870 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f68161b1-cc62-40c5-aaa0-54c8910909f9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 200 len: 1311 microversion: 2.1 time: 0.456973 Oct 12 22:23:33.812474 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2376/5365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:33 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 1311 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:34.264651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-2338a115-7376-4fb3-a21d-2aff67afdd75 req-c4c7071b-f8ee-4a45-9b5a-afb7f9eee48b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7d78e6-11af-404e-ad70-5c3d6e04bd90", "name": "network-vif-deleted", "tag": "f5e25009-f1c3-4637-9322-7915f440da15"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:23:34.286217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2338a115-7376-4fb3-a21d-2aff67afdd75 req-c4c7071b-f8ee-4a45-9b5a-afb7f9eee48b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:34.290261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2338a115-7376-4fb3-a21d-2aff67afdd75 req-c4c7071b-f8ee-4a45-9b5a-afb7f9eee48b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:34.294280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2338a115-7376-4fb3-a21d-2aff67afdd75 req-c4c7071b-f8ee-4a45-9b5a-afb7f9eee48b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:34.337265 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-2338a115-7376-4fb3-a21d-2aff67afdd75 req-c4c7071b-f8ee-4a45-9b5a-afb7f9eee48b service nova] Creating event network-vif-deleted:f5e25009-f1c3-4637-9322-7915f440da15 for instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 on n-h1-861111-1 Oct 12 22:23:34.349001 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-2338a115-7376-4fb3-a21d-2aff67afdd75 req-c4c7071b-f8ee-4a45-9b5a-afb7f9eee48b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090421 Oct 12 22:23:34.349544 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2990/5366] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:23:34.838799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-659781bb-1c35-4bb6-8977-3de472f07264 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:34.841625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-659781bb-1c35-4bb6-8977-3de472f07264 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:34.851738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-659781bb-1c35-4bb6-8977-3de472f07264 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:34.856305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-659781bb-1c35-4bb6-8977-3de472f07264 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:34.858890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-659781bb-1c35-4bb6-8977-3de472f07264 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:34.862850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-659781bb-1c35-4bb6-8977-3de472f07264 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:34.864860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-659781bb-1c35-4bb6-8977-3de472f07264 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:34.867682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-659781bb-1c35-4bb6-8977-3de472f07264 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:34.902731 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-659781bb-1c35-4bb6-8977-3de472f07264 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-659781bb-1c35-4bb6-8977-3de472f07264 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 HTTP/1.1 Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '8c7d78e6-11af-404e-ad70-5c3d6e04bd90'} Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:23:34.921025 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:23:34.928443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:23:34.928443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:23:34.928443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:23:34.928443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:23:34.928443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. Oct 12 22:23:34.928443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:23:34.928443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-659781bb-1c35-4bb6-8977-3de472f07264 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:23:34.928443 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-659781bb-1c35-4bb6-8977-3de472f07264 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 404 len: 111 microversion: 2.1 time: 0.088217 Oct 12 22:23:34.928443 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2377/5367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:34 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:23:34.937037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b87ce40a-ea06-4dd0-b789-9ddd8f9c45c6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Action: 'create', calling method: .version_select at 0x7f512840bca0>, body: {"keypair": {"name": "tempest-key-1658842947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMsAx9Dk/5Uk5VMpYAU2mY8x7HwN9yRL5/2PZ4ZJUqReDNIqdpEO1f28lWlcmBRQ2qXLTbvMESQmmPEsKVmWs/YDrfjIdAbXFrjVHM0x+cJstN/p8MLMHH9uoQ47dQKBA=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:23:34.969609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-b87ce40a-ea06-4dd0-b789-9ddd8f9c45c6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for project 8276c235e518406da376c8a4c19b27d1. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:23:34.987671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-b87ce40a-ea06-4dd0-b789-9ddd8f9c45c6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for user 789a612b19154564a853199a67ea8496 and project 8276c235e518406da376c8a4c19b27d1. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:23:35.039132 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b87ce40a-ea06-4dd0-b789-9ddd8f9c45c6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.106335 Oct 12 22:23:35.045922 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2991/5368] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:23:34 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:23:35.051009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f5a34dc-559b-40d6-a04f-aa8ba14e7e3b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '.version_select at 0x7f51283a9c10>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:35.055347 n-d-861111-1 devstack@n-api.service[120452]: WARNING oslo_db.sqlalchemy.utils [None req-8f5a34dc-559b-40d6-a04f-aa8ba14e7e3b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 22:23:35.072070 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f5a34dc-559b-40d6-a04f-aa8ba14e7e3b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.024662 Oct 12 22:23:35.083502 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2378/5369] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:23:35 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:23:35.274685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1394862046", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "key_name": "tempest-key-1658842947", "networks": [{"uuid": "36f67723-f632-42aa-bcd9-cfd1c5f07f45"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:23:35.411919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] validate_networks() for [('36f67723-f632-42aa-bcd9-cfd1c5f07f45', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:23:36.777593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:23:36.778251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:23:36.778508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:23:36.779752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:23:36.779752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:23:36.804911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:36.806902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:36.810932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:36.812507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:36.816650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:36.817618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:36.911905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for project 8276c235e518406da376c8a4c19b27d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:23:36.950477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for user 789a612b19154564a853199a67ea8496 and project 8276c235e518406da376c8a4c19b27d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:23:37.000128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:23:37.002489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:23:37.085056 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3740d276-a490-40c6-84f1-605eb287d9b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.816972 Oct 12 22:23:37.091834 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2992/5370] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:23:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:23:37.096859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4e8e6c57-e57a-4818-9b09-75daa207eb93 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:37.097458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4e8e6c57-e57a-4818-9b09-75daa207eb93 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:37.760111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4e8e6c57-e57a-4818-9b09-75daa207eb93 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:37.769867 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4e8e6c57-e57a-4818-9b09-75daa207eb93 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 200 len: 1229 microversion: 2.1 time: 0.676144 Oct 12 22:23:37.785577 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2379/5371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:37 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 1229 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:23:38.796069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8279c214-ced6-449e-a9e3-2d4453b23356 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:38.796633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8279c214-ced6-449e-a9e3-2d4453b23356 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:38.809321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8279c214-ced6-449e-a9e3-2d4453b23356 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:38.809823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8279c214-ced6-449e-a9e3-2d4453b23356 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:38.810264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8279c214-ced6-449e-a9e3-2d4453b23356 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:38.810973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8279c214-ced6-449e-a9e3-2d4453b23356 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:38.811488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8279c214-ced6-449e-a9e3-2d4453b23356 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:38.811917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8279c214-ced6-449e-a9e3-2d4453b23356 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:38.993543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8279c214-ced6-449e-a9e3-2d4453b23356 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:39.001796 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8279c214-ced6-449e-a9e3-2d4453b23356 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 200 len: 1289 microversion: 2.1 time: 0.209703 Oct 12 22:23:39.002390 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2993/5372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:38 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 1289 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:40.026139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9209cb39-2129-468c-91c8-da8599676fd1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:40.027476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9209cb39-2129-468c-91c8-da8599676fd1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:40.035144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9209cb39-2129-468c-91c8-da8599676fd1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:40.036053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9209cb39-2129-468c-91c8-da8599676fd1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:40.036738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9209cb39-2129-468c-91c8-da8599676fd1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:40.037776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9209cb39-2129-468c-91c8-da8599676fd1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:40.038499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9209cb39-2129-468c-91c8-da8599676fd1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:40.039145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9209cb39-2129-468c-91c8-da8599676fd1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:40.178498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9209cb39-2129-468c-91c8-da8599676fd1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:40.198737 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9209cb39-2129-468c-91c8-da8599676fd1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 200 len: 1287 microversion: 2.1 time: 0.177078 Oct 12 22:23:40.212040 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2380/5373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:40 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 1287 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:41.228722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5d8a6604-7949-4861-a3cb-0fd5f4cc362c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:41.229436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5d8a6604-7949-4861-a3cb-0fd5f4cc362c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:41.239016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d8a6604-7949-4861-a3cb-0fd5f4cc362c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:41.239673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d8a6604-7949-4861-a3cb-0fd5f4cc362c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:41.240197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d8a6604-7949-4861-a3cb-0fd5f4cc362c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:41.240985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d8a6604-7949-4861-a3cb-0fd5f4cc362c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:41.241705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d8a6604-7949-4861-a3cb-0fd5f4cc362c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:41.242392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d8a6604-7949-4861-a3cb-0fd5f4cc362c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:41.420975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5d8a6604-7949-4861-a3cb-0fd5f4cc362c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:41.433280 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5d8a6604-7949-4861-a3cb-0fd5f4cc362c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 200 len: 1287 microversion: 2.1 time: 0.209456 Oct 12 22:23:41.455823 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2994/5374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:41 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 1287 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:42.462243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9c88230c-9872-4ba8-b2f3-8dcdc1dad774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:42.464137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9c88230c-9872-4ba8-b2f3-8dcdc1dad774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:42.497312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c88230c-9872-4ba8-b2f3-8dcdc1dad774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:42.499827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c88230c-9872-4ba8-b2f3-8dcdc1dad774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:42.501571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c88230c-9872-4ba8-b2f3-8dcdc1dad774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:42.505934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c88230c-9872-4ba8-b2f3-8dcdc1dad774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:42.510873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c88230c-9872-4ba8-b2f3-8dcdc1dad774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:42.512170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c88230c-9872-4ba8-b2f3-8dcdc1dad774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:43.118529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9c88230c-9872-4ba8-b2f3-8dcdc1dad774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:43.143877 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9c88230c-9872-4ba8-b2f3-8dcdc1dad774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 200 len: 1329 microversion: 2.1 time: 0.688231 Oct 12 22:23:43.156638 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2381/5375] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:42 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 1329 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:44.190477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e74544f7-334d-4b57-adbc-aa985b12133f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:44.201140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e74544f7-334d-4b57-adbc-aa985b12133f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:44.224093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e74544f7-334d-4b57-adbc-aa985b12133f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:44.224939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e74544f7-334d-4b57-adbc-aa985b12133f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:44.225587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e74544f7-334d-4b57-adbc-aa985b12133f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:44.227433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e74544f7-334d-4b57-adbc-aa985b12133f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:44.228157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e74544f7-334d-4b57-adbc-aa985b12133f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:44.228747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e74544f7-334d-4b57-adbc-aa985b12133f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:44.998698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5e98fab8-3aa2-47d3-b702-87f7fbd456de tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-2068057227", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": "none"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:23:45.127418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5e98fab8-3aa2-47d3-b702-87f7fbd456de tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:23:45.127844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5e98fab8-3aa2-47d3-b702-87f7fbd456de tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:23:45.128662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5e98fab8-3aa2-47d3-b702-87f7fbd456de tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:23:45.129196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5e98fab8-3aa2-47d3-b702-87f7fbd456de tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:23:45.129927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5e98fab8-3aa2-47d3-b702-87f7fbd456de tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:23:45.149639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e98fab8-3aa2-47d3-b702-87f7fbd456de tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:45.150454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e98fab8-3aa2-47d3-b702-87f7fbd456de tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:45.151084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e98fab8-3aa2-47d3-b702-87f7fbd456de tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:45.152666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e98fab8-3aa2-47d3-b702-87f7fbd456de tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:45.153528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e98fab8-3aa2-47d3-b702-87f7fbd456de tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:45.155149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e98fab8-3aa2-47d3-b702-87f7fbd456de tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:45.182553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-5e98fab8-3aa2-47d3-b702-87f7fbd456de tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Getting quotas for project 36ab1aa61e4243c6ad68f00a97dbdd56. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:23:45.193803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-5e98fab8-3aa2-47d3-b702-87f7fbd456de tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Getting quotas for user 230322186b9d4af18632ed85eb15459b and project 36ab1aa61e4243c6ad68f00a97dbdd56. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:23:45.236939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5e98fab8-3aa2-47d3-b702-87f7fbd456de tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:23:45.241640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5e98fab8-3aa2-47d3-b702-87f7fbd456de tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:23:45.297738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e74544f7-334d-4b57-adbc-aa985b12133f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:45.315843 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e74544f7-334d-4b57-adbc-aa985b12133f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 200 len: 1329 microversion: 2.1 time: 1.144231 Oct 12 22:23:45.345971 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2995/5376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:44 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 1329 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:45.380723 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5e98fab8-3aa2-47d3-b702-87f7fbd456de tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.736346 Oct 12 22:23:45.381474 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2382/5377] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 22:23:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:23:45.404604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1089c9e4-6b5c-43e5-a683-026f24845531 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:45.412055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1089c9e4-6b5c-43e5-a683-026f24845531 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:45.713984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1089c9e4-6b5c-43e5-a683-026f24845531 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:45.722457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1089c9e4-6b5c-43e5-a683-026f24845531 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:45.724089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1089c9e4-6b5c-43e5-a683-026f24845531 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:45.725155 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1089c9e4-6b5c-43e5-a683-026f24845531 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1278 microversion: 2.57 time: 0.324865 Oct 12 22:23:45.747774 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2996/5378] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:23:45 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1278 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:23:46.347076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4045fe31-be5c-459c-a451-72f8a67d9432 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:46.348498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4045fe31-be5c-459c-a451-72f8a67d9432 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:46.366903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4045fe31-be5c-459c-a451-72f8a67d9432 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:46.370099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4045fe31-be5c-459c-a451-72f8a67d9432 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:46.372972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4045fe31-be5c-459c-a451-72f8a67d9432 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:46.375368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4045fe31-be5c-459c-a451-72f8a67d9432 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:46.376926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4045fe31-be5c-459c-a451-72f8a67d9432 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:46.377625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4045fe31-be5c-459c-a451-72f8a67d9432 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:46.764478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e311351f-110e-4bc7-aef7-2874ba328a55 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:46.766144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e311351f-110e-4bc7-aef7-2874ba328a55 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:46.770768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:46.796331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e311351f-110e-4bc7-aef7-2874ba328a55 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:46.797405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e311351f-110e-4bc7-aef7-2874ba328a55 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:46.798163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e311351f-110e-4bc7-aef7-2874ba328a55 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:46.799674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e311351f-110e-4bc7-aef7-2874ba328a55 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:46.800370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e311351f-110e-4bc7-aef7-2874ba328a55 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:46.804880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e311351f-110e-4bc7-aef7-2874ba328a55 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:46.862339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:47.075317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4045fe31-be5c-459c-a451-72f8a67d9432 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:47.102535 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4045fe31-be5c-459c-a451-72f8a67d9432 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 200 len: 1329 microversion: 2.1 time: 0.759184 Oct 12 22:23:47.108229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e311351f-110e-4bc7-aef7-2874ba328a55 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:47.123896 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2383/5379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:46 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 1329 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:47.129735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e311351f-110e-4bc7-aef7-2874ba328a55 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:47.133246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e311351f-110e-4bc7-aef7-2874ba328a55 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:47.135599 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e311351f-110e-4bc7-aef7-2874ba328a55 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1274 microversion: 2.57 time: 0.377499 Oct 12 22:23:47.137671 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2997/5380] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:23:46 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1274 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:23:47.739710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-77a8133b-42dd-4f8c-b36e-d386fcad3e60 req-2adece35-628b-4561-b973-dabd3e924d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eedbdf1-5816-49c0-9d3e-fd35cce5cb61", "tag": "9c2bae92-c619-4bf0-bb87-9c3e9860e916"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:23:47.775433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-77a8133b-42dd-4f8c-b36e-d386fcad3e60 req-2adece35-628b-4561-b973-dabd3e924d62 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:47.776839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-77a8133b-42dd-4f8c-b36e-d386fcad3e60 req-2adece35-628b-4561-b973-dabd3e924d62 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:47.777490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-77a8133b-42dd-4f8c-b36e-d386fcad3e60 req-2adece35-628b-4561-b973-dabd3e924d62 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:47.806459 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-77a8133b-42dd-4f8c-b36e-d386fcad3e60 req-2adece35-628b-4561-b973-dabd3e924d62 service nova] Creating event network-changed:9c2bae92-c619-4bf0-bb87-9c3e9860e916 for instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 on n-h1-861111-1 Oct 12 22:23:47.813315 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-77a8133b-42dd-4f8c-b36e-d386fcad3e60 req-2adece35-628b-4561-b973-dabd3e924d62 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078365 Oct 12 22:23:47.818706 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2384/5381] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:23:48.139129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d886897f-bd3a-4665-a787-46ad31ead80c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:48.141256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d886897f-bd3a-4665-a787-46ad31ead80c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:48.157663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d886897f-bd3a-4665-a787-46ad31ead80c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:48.158454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d886897f-bd3a-4665-a787-46ad31ead80c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:48.163612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d886897f-bd3a-4665-a787-46ad31ead80c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:48.175668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-631b72b7-ee5f-4164-8a6f-dbf1fabc7905 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:48.176398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-631b72b7-ee5f-4164-8a6f-dbf1fabc7905 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:48.182080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d886897f-bd3a-4665-a787-46ad31ead80c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:48.183394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d886897f-bd3a-4665-a787-46ad31ead80c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:48.185131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d886897f-bd3a-4665-a787-46ad31ead80c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:48.195872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-631b72b7-ee5f-4164-8a6f-dbf1fabc7905 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:48.196569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-631b72b7-ee5f-4164-8a6f-dbf1fabc7905 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:48.197133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-631b72b7-ee5f-4164-8a6f-dbf1fabc7905 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:48.197887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-631b72b7-ee5f-4164-8a6f-dbf1fabc7905 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:48.198353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-631b72b7-ee5f-4164-8a6f-dbf1fabc7905 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:48.198797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-631b72b7-ee5f-4164-8a6f-dbf1fabc7905 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:48.470160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-631b72b7-ee5f-4164-8a6f-dbf1fabc7905 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:48.479913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-631b72b7-ee5f-4164-8a6f-dbf1fabc7905 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:48.490173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-631b72b7-ee5f-4164-8a6f-dbf1fabc7905 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:48.492585 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-631b72b7-ee5f-4164-8a6f-dbf1fabc7905 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1336 microversion: 2.57 time: 0.321522 Oct 12 22:23:48.495516 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2385/5382] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:23:48 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1336 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:23:48.765287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d886897f-bd3a-4665-a787-46ad31ead80c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:48.782823 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d886897f-bd3a-4665-a787-46ad31ead80c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 200 len: 1329 microversion: 2.1 time: 0.656825 Oct 12 22:23:48.783474 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2998/5383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:48 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 1329 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:49.529590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e9035f2f-cdb6-4e46-b079-d19c22be5d66 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:49.531004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e9035f2f-cdb6-4e46-b079-d19c22be5d66 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:49.555819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9035f2f-cdb6-4e46-b079-d19c22be5d66 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:49.557210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9035f2f-cdb6-4e46-b079-d19c22be5d66 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:49.557850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9035f2f-cdb6-4e46-b079-d19c22be5d66 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:49.559809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9035f2f-cdb6-4e46-b079-d19c22be5d66 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:49.560668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9035f2f-cdb6-4e46-b079-d19c22be5d66 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:49.561302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9035f2f-cdb6-4e46-b079-d19c22be5d66 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:49.770110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e9035f2f-cdb6-4e46-b079-d19c22be5d66 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:49.784368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e9035f2f-cdb6-4e46-b079-d19c22be5d66 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:49.793243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e9035f2f-cdb6-4e46-b079-d19c22be5d66 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:49.798851 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e9035f2f-cdb6-4e46-b079-d19c22be5d66 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1336 microversion: 2.57 time: 0.275479 Oct 12 22:23:49.802622 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2386/5384] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:23:49 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1336 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:23:49.807006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6403642e-bb29-4914-8dae-49de5a2ccb05 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:49.807623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6403642e-bb29-4914-8dae-49de5a2ccb05 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:49.818842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6403642e-bb29-4914-8dae-49de5a2ccb05 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:49.821311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6403642e-bb29-4914-8dae-49de5a2ccb05 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:49.821791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6403642e-bb29-4914-8dae-49de5a2ccb05 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:49.822536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6403642e-bb29-4914-8dae-49de5a2ccb05 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:49.823001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6403642e-bb29-4914-8dae-49de5a2ccb05 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:49.823466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6403642e-bb29-4914-8dae-49de5a2ccb05 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:50.829303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0dd1e229-8724-4af2-8b13-28445fd0f4be tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:50.829930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0dd1e229-8724-4af2-8b13-28445fd0f4be tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:50.842236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dd1e229-8724-4af2-8b13-28445fd0f4be tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:50.850159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dd1e229-8724-4af2-8b13-28445fd0f4be tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:50.850616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dd1e229-8724-4af2-8b13-28445fd0f4be tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:50.851442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dd1e229-8724-4af2-8b13-28445fd0f4be tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:50.851912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dd1e229-8724-4af2-8b13-28445fd0f4be tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:50.852340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0dd1e229-8724-4af2-8b13-28445fd0f4be tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:51.011462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0dd1e229-8724-4af2-8b13-28445fd0f4be tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:51.029003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0dd1e229-8724-4af2-8b13-28445fd0f4be tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:51.030454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0dd1e229-8724-4af2-8b13-28445fd0f4be tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:51.031648 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0dd1e229-8724-4af2-8b13-28445fd0f4be tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1336 microversion: 2.57 time: 0.206369 Oct 12 22:23:51.032537 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2387/5385] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:23:50 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1336 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:23:51.271000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6403642e-bb29-4914-8dae-49de5a2ccb05 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:51.296175 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6403642e-bb29-4914-8dae-49de5a2ccb05 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 200 len: 1329 microversion: 2.1 time: 1.493892 Oct 12 22:23:51.298320 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 2999/5386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:49 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 1329 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:52.059646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a0bc8401-5c87-4f5a-aa94-d682380aac20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:52.060383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a0bc8401-5c87-4f5a-aa94-d682380aac20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:52.093515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0bc8401-5c87-4f5a-aa94-d682380aac20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:52.096721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0bc8401-5c87-4f5a-aa94-d682380aac20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:52.098546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0bc8401-5c87-4f5a-aa94-d682380aac20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:52.101318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0bc8401-5c87-4f5a-aa94-d682380aac20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:52.102539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0bc8401-5c87-4f5a-aa94-d682380aac20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:52.104445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0bc8401-5c87-4f5a-aa94-d682380aac20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:52.254232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a0bc8401-5c87-4f5a-aa94-d682380aac20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:52.272381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a0bc8401-5c87-4f5a-aa94-d682380aac20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:52.274126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a0bc8401-5c87-4f5a-aa94-d682380aac20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:52.298151 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a0bc8401-5c87-4f5a-aa94-d682380aac20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1357 microversion: 2.57 time: 0.242739 Oct 12 22:23:52.312008 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2388/5387] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:23:52 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1357 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:23:52.327950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e38b934f-af6c-4c97-bee2-be70b1ee7878 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:52.332843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e38b934f-af6c-4c97-bee2-be70b1ee7878 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:52.338923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:23:52.348127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:52.357792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e38b934f-af6c-4c97-bee2-be70b1ee7878 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:52.366625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e38b934f-af6c-4c97-bee2-be70b1ee7878 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:52.370856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e38b934f-af6c-4c97-bee2-be70b1ee7878 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:52.376715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e38b934f-af6c-4c97-bee2-be70b1ee7878 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:52.380362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e38b934f-af6c-4c97-bee2-be70b1ee7878 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:52.389192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e38b934f-af6c-4c97-bee2-be70b1ee7878 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:52.394905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:52.408810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:52.409523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:52.412191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:52.412889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:52.414940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:52.625377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:23:52.629141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:23:52.630044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:23:52.630715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:23:52.631381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:23:52.780641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:52.793928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:52.794426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:52.794862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:52.799852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:52.800538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:52.801154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:52.865941 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-15fb2c48-e43b-4705-9bc5-3f2c3c6df894 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "POST /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c/action" status: 202 len: 1138 microversion: 2.57 time: 0.533508 Oct 12 22:23:52.868868 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2389/5388] 10.222.0.16 () {62 vars in 1320 bytes} [Wed Oct 12 22:23:52 2022] POST /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c/action => generated 1138 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 12 22:23:52.901028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5ac042f8-bea3-4456-b853-aa1f26274819 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:52.901997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5ac042f8-bea3-4456-b853-aa1f26274819 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:52.910019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ac042f8-bea3-4456-b853-aa1f26274819 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:52.911008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ac042f8-bea3-4456-b853-aa1f26274819 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:52.911797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ac042f8-bea3-4456-b853-aa1f26274819 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:52.913028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ac042f8-bea3-4456-b853-aa1f26274819 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:52.914974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ac042f8-bea3-4456-b853-aa1f26274819 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:52.915890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ac042f8-bea3-4456-b853-aa1f26274819 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:53.059994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5ac042f8-bea3-4456-b853-aa1f26274819 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:53.076208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5ac042f8-bea3-4456-b853-aa1f26274819 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:53.079518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5ac042f8-bea3-4456-b853-aa1f26274819 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:53.083844 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5ac042f8-bea3-4456-b853-aa1f26274819 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.187776 Oct 12 22:23:53.086380 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2390/5389] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:23:52 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:23:53.312166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e38b934f-af6c-4c97-bee2-be70b1ee7878 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:53.324654 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e38b934f-af6c-4c97-bee2-be70b1ee7878 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 200 len: 1329 microversion: 2.1 time: 1.001920 Oct 12 22:23:53.329564 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3000/5390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:52 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 1329 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:53.870319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-536224538", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "dba41ba3-f8c9-4f8d-87e7-6246eb947653"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:23:53.884001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:53.974302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] validate_networks() for [('dba41ba3-f8c9-4f8d-87e7-6246eb947653', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:23:54.116148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c15755bb-b2e4-4546-b627-dc4dace224b3 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:54.116629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c15755bb-b2e4-4546-b627-dc4dace224b3 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:54.125935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15755bb-b2e4-4546-b627-dc4dace224b3 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:54.126443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15755bb-b2e4-4546-b627-dc4dace224b3 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:54.126886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15755bb-b2e4-4546-b627-dc4dace224b3 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:54.127855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15755bb-b2e4-4546-b627-dc4dace224b3 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:54.128485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15755bb-b2e4-4546-b627-dc4dace224b3 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:54.129087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c15755bb-b2e4-4546-b627-dc4dace224b3 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:54.414791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c15755bb-b2e4-4546-b627-dc4dace224b3 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:54.428616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c15755bb-b2e4-4546-b627-dc4dace224b3 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:54.431031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c15755bb-b2e4-4546-b627-dc4dace224b3 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:54.436491 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c15755bb-b2e4-4546-b627-dc4dace224b3 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.324584 Oct 12 22:23:54.437203 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3001/5391] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:23:54 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:23:54.474238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a6ca2939-5d34-4578-a4ec-d787ab8e0dd6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:54.477794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a6ca2939-5d34-4578-a4ec-d787ab8e0dd6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:54.486863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6ca2939-5d34-4578-a4ec-d787ab8e0dd6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:54.491114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6ca2939-5d34-4578-a4ec-d787ab8e0dd6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:54.493885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6ca2939-5d34-4578-a4ec-d787ab8e0dd6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:54.494739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6ca2939-5d34-4578-a4ec-d787ab8e0dd6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:54.495317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6ca2939-5d34-4578-a4ec-d787ab8e0dd6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:54.499636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6ca2939-5d34-4578-a4ec-d787ab8e0dd6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:55.081429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:23:55.082191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:23:55.082942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:23:55.083634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:23:55.086415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:23:55.100559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:55.109088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:55.109799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:55.110804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:55.111494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:55.112129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:55.166086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Getting quotas for project e84273e7c2b44a24aa49dbedcd05f5fa. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:23:55.179047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Getting quotas for user 69a1b759d69b49b4a52be313a2b3b828 and project e84273e7c2b44a24aa49dbedcd05f5fa. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:23:55.209166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:23:55.215806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:23:55.293153 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1db7efbb-9c43-4f25-9a0f-f6fedf4342b7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.637881 Oct 12 22:23:55.294248 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2391/5392] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:23:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:23:55.305335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-756b65d4-ac62-4f5e-a851-035b60b77734 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:55.308247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-756b65d4-ac62-4f5e-a851-035b60b77734 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:55.634626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a6ca2939-5d34-4578-a4ec-d787ab8e0dd6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:55.712921 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a6ca2939-5d34-4578-a4ec-d787ab8e0dd6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 200 len: 1329 microversion: 2.1 time: 1.219868 Oct 12 22:23:55.717265 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3002/5393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:54 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 1329 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:55.748285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-11bf2d75-bcf5-408e-82a6-cb1584330578 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:55.753092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-11bf2d75-bcf5-408e-82a6-cb1584330578 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:55.763570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=12 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:55.775483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11bf2d75-bcf5-408e-82a6-cb1584330578 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:55.776423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11bf2d75-bcf5-408e-82a6-cb1584330578 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:55.777047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11bf2d75-bcf5-408e-82a6-cb1584330578 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:55.778046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11bf2d75-bcf5-408e-82a6-cb1584330578 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:55.779500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11bf2d75-bcf5-408e-82a6-cb1584330578 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:55.780197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11bf2d75-bcf5-408e-82a6-cb1584330578 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:56.203454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-756b65d4-ac62-4f5e-a851-035b60b77734 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:56.217195 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-756b65d4-ac62-4f5e-a851-035b60b77734 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1227 microversion: 2.1 time: 0.915758 Oct 12 22:23:56.217821 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2392/5394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:55 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1227 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:56.245635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-9399b6a0-be5c-4114-84bd-fcc8ef2bde06 req-8d276064-18b7-469f-bd50-2c07528d74a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eedbdf1-5816-49c0-9d3e-fd35cce5cb61", "name": "network-vif-plugged", "status": "completed", "tag": "9c2bae92-c619-4bf0-bb87-9c3e9860e916"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:23:56.278800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9399b6a0-be5c-4114-84bd-fcc8ef2bde06 req-8d276064-18b7-469f-bd50-2c07528d74a5 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:56.279321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9399b6a0-be5c-4114-84bd-fcc8ef2bde06 req-8d276064-18b7-469f-bd50-2c07528d74a5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:56.282222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9399b6a0-be5c-4114-84bd-fcc8ef2bde06 req-8d276064-18b7-469f-bd50-2c07528d74a5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:56.297741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-11bf2d75-bcf5-408e-82a6-cb1584330578 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:56.325057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-11bf2d75-bcf5-408e-82a6-cb1584330578 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:56.330809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-11bf2d75-bcf5-408e-82a6-cb1584330578 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:56.333924 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-9399b6a0-be5c-4114-84bd-fcc8ef2bde06 req-8d276064-18b7-469f-bd50-2c07528d74a5 service nova] Creating event network-vif-plugged:9c2bae92-c619-4bf0-bb87-9c3e9860e916 for instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 on n-h1-861111-1 Oct 12 22:23:56.335163 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-11bf2d75-bcf5-408e-82a6-cb1584330578 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.616620 Oct 12 22:23:56.352631 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3003/5395] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:23:55 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:23:56.368414 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-9399b6a0-be5c-4114-84bd-fcc8ef2bde06 req-8d276064-18b7-469f-bd50-2c07528d74a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132848 Oct 12 22:23:56.373295 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2393/5396] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:23:56.742250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c8b18a2f-b3df-4627-aaf9-6111ae51624a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:56.743604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c8b18a2f-b3df-4627-aaf9-6111ae51624a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:56.761113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8b18a2f-b3df-4627-aaf9-6111ae51624a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:56.763930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8b18a2f-b3df-4627-aaf9-6111ae51624a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:56.765664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8b18a2f-b3df-4627-aaf9-6111ae51624a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:56.766948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8b18a2f-b3df-4627-aaf9-6111ae51624a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:56.768763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8b18a2f-b3df-4627-aaf9-6111ae51624a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:56.770856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8b18a2f-b3df-4627-aaf9-6111ae51624a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:57.242955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bbcbd2b8-75dd-41a7-88e2-443b26827472 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:57.244532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bbcbd2b8-75dd-41a7-88e2-443b26827472 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:57.244685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c8b18a2f-b3df-4627-aaf9-6111ae51624a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:57.253918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbcbd2b8-75dd-41a7-88e2-443b26827472 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:57.254905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbcbd2b8-75dd-41a7-88e2-443b26827472 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:57.255750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbcbd2b8-75dd-41a7-88e2-443b26827472 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:57.256721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbcbd2b8-75dd-41a7-88e2-443b26827472 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:57.257664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbcbd2b8-75dd-41a7-88e2-443b26827472 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:57.258350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbcbd2b8-75dd-41a7-88e2-443b26827472 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:57.258867 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c8b18a2f-b3df-4627-aaf9-6111ae51624a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 200 len: 1329 microversion: 2.1 time: 0.523431 Oct 12 22:23:57.259515 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3004/5397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:56 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 1329 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:57.294875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:57.365767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-575f577c-9b66-4112-9861-986010e278d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:57.366939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-575f577c-9b66-4112-9861-986010e278d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:57.375473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-575f577c-9b66-4112-9861-986010e278d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:57.376249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-575f577c-9b66-4112-9861-986010e278d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:57.376890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-575f577c-9b66-4112-9861-986010e278d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:57.378280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-575f577c-9b66-4112-9861-986010e278d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:57.378948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-575f577c-9b66-4112-9861-986010e278d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:57.380111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-575f577c-9b66-4112-9861-986010e278d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:57.630244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-575f577c-9b66-4112-9861-986010e278d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:57.642267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-575f577c-9b66-4112-9861-986010e278d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:57.650527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-575f577c-9b66-4112-9861-986010e278d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:57.652751 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-575f577c-9b66-4112-9861-986010e278d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.293469 Oct 12 22:23:57.655056 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3005/5398] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:23:57 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:23:57.708558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bbcbd2b8-75dd-41a7-88e2-443b26827472 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:57.732031 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bbcbd2b8-75dd-41a7-88e2-443b26827472 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1279 microversion: 2.1 time: 0.494819 Oct 12 22:23:57.732775 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2394/5399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:57 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1279 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:58.285373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-48ea1414-14ce-4e44-af07-9e3d7acca774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:58.286564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-48ea1414-14ce-4e44-af07-9e3d7acca774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:58.301195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48ea1414-14ce-4e44-af07-9e3d7acca774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:58.303588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48ea1414-14ce-4e44-af07-9e3d7acca774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:58.306307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48ea1414-14ce-4e44-af07-9e3d7acca774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:58.307899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48ea1414-14ce-4e44-af07-9e3d7acca774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:58.309630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48ea1414-14ce-4e44-af07-9e3d7acca774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:58.311134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-48ea1414-14ce-4e44-af07-9e3d7acca774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:58.680421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bc50d716-9ac8-4316-9f67-bd009ff2dc11 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:58.681630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bc50d716-9ac8-4316-9f67-bd009ff2dc11 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:58.694727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc50d716-9ac8-4316-9f67-bd009ff2dc11 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:58.695461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc50d716-9ac8-4316-9f67-bd009ff2dc11 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:58.696091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc50d716-9ac8-4316-9f67-bd009ff2dc11 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:58.697142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc50d716-9ac8-4316-9f67-bd009ff2dc11 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:58.698427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc50d716-9ac8-4316-9f67-bd009ff2dc11 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:58.699639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc50d716-9ac8-4316-9f67-bd009ff2dc11 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:58.876496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-48ea1414-14ce-4e44-af07-9e3d7acca774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:58.885707 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-48ea1414-14ce-4e44-af07-9e3d7acca774 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 200 len: 1509 microversion: 2.1 time: 0.604595 Oct 12 22:23:58.891076 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3006/5400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:58 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 1509 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:58.913247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-031a5cad-c43d-4dc3-bcd2-021bcf6b5a14 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:58.914010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-031a5cad-c43d-4dc3-bcd2-021bcf6b5a14 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:58.920863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-031a5cad-c43d-4dc3-bcd2-021bcf6b5a14 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:58.921445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-031a5cad-c43d-4dc3-bcd2-021bcf6b5a14 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:58.921894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-031a5cad-c43d-4dc3-bcd2-021bcf6b5a14 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:58.922660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-031a5cad-c43d-4dc3-bcd2-021bcf6b5a14 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:58.923127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-031a5cad-c43d-4dc3-bcd2-021bcf6b5a14 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:58.923640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-031a5cad-c43d-4dc3-bcd2-021bcf6b5a14 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:58.966001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bc50d716-9ac8-4316-9f67-bd009ff2dc11 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:58.989559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bc50d716-9ac8-4316-9f67-bd009ff2dc11 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:58.993561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bc50d716-9ac8-4316-9f67-bd009ff2dc11 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:58.998256 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bc50d716-9ac8-4316-9f67-bd009ff2dc11 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.322196 Oct 12 22:23:58.999435 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2395/5401] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:23:58 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:23:59.004359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9197ed29-f05c-4224-991d-bd2c0ea2b0b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:59.005215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9197ed29-f05c-4224-991d-bd2c0ea2b0b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:59.013108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9197ed29-f05c-4224-991d-bd2c0ea2b0b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:59.014263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9197ed29-f05c-4224-991d-bd2c0ea2b0b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:59.014942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9197ed29-f05c-4224-991d-bd2c0ea2b0b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:59.015933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9197ed29-f05c-4224-991d-bd2c0ea2b0b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:59.016626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9197ed29-f05c-4224-991d-bd2c0ea2b0b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:59.017431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9197ed29-f05c-4224-991d-bd2c0ea2b0b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:59.083788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-031a5cad-c43d-4dc3-bcd2-021bcf6b5a14 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:59.109433 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-031a5cad-c43d-4dc3-bcd2-021bcf6b5a14 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1285 microversion: 2.1 time: 0.200772 Oct 12 22:23:59.110571 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3007/5402] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:58 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:59.116416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d2f6f7bc-01f3-451e-a02f-fad5667af4fa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:59.118117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d2f6f7bc-01f3-451e-a02f-fad5667af4fa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:59.126418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2f6f7bc-01f3-451e-a02f-fad5667af4fa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:59.127316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2f6f7bc-01f3-451e-a02f-fad5667af4fa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:59.128229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2f6f7bc-01f3-451e-a02f-fad5667af4fa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:59.131206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2f6f7bc-01f3-451e-a02f-fad5667af4fa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:59.132107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2f6f7bc-01f3-451e-a02f-fad5667af4fa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:59.132990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2f6f7bc-01f3-451e-a02f-fad5667af4fa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:59.301816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:59.305883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-d2f6f7bc-01f3-451e-a02f-fad5667af4fa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lazy-loading 'services' on Instance uuid d4f2400d-a508-4bfc-b84f-bc80a4c28fec {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:23:59.479183 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d2f6f7bc-01f3-451e-a02f-fad5667af4fa tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments/e09ded0a-4d68-40dd-a52b-da0a239a475a" status: 202 len: 0 microversion: 2.1 time: 0.367010 Oct 12 22:23:59.482897 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3008/5403] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 22:23:59 2022] DELETE /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments/e09ded0a-4d68-40dd-a52b-da0a239a475a => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:23:59.494481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c538d8d7-0be7-4487-af8c-91fd1f0fcfb2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:59.500023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c538d8d7-0be7-4487-af8c-91fd1f0fcfb2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:59.510757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c538d8d7-0be7-4487-af8c-91fd1f0fcfb2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:59.512420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c538d8d7-0be7-4487-af8c-91fd1f0fcfb2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:59.513821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c538d8d7-0be7-4487-af8c-91fd1f0fcfb2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:59.514416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c538d8d7-0be7-4487-af8c-91fd1f0fcfb2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:59.515124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c538d8d7-0be7-4487-af8c-91fd1f0fcfb2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:59.515845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c538d8d7-0be7-4487-af8c-91fd1f0fcfb2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:59.535623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9197ed29-f05c-4224-991d-bd2c0ea2b0b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:23:59.551979 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9197ed29-f05c-4224-991d-bd2c0ea2b0b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 200 len: 1509 microversion: 2.1 time: 0.551090 Oct 12 22:23:59.552632 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2396/5404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:58 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 1509 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:59.579409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3238fb7c-1f49-4a0a-9fe5-4f3e1c18b4a3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:59.580387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3238fb7c-1f49-4a0a-9fe5-4f3e1c18b4a3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:59.595223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3238fb7c-1f49-4a0a-9fe5-4f3e1c18b4a3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:59.602193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3238fb7c-1f49-4a0a-9fe5-4f3e1c18b4a3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:59.603033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3238fb7c-1f49-4a0a-9fe5-4f3e1c18b4a3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:59.604069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3238fb7c-1f49-4a0a-9fe5-4f3e1c18b4a3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:59.604757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3238fb7c-1f49-4a0a-9fe5-4f3e1c18b4a3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:59.605407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3238fb7c-1f49-4a0a-9fe5-4f3e1c18b4a3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:59.618768 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c538d8d7-0be7-4487-af8c-91fd1f0fcfb2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132011 Oct 12 22:23:59.620832 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3009/5405] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:23:59 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:23:59.682852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3238fb7c-1f49-4a0a-9fe5-4f3e1c18b4a3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:23:59.834856 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3238fb7c-1f49-4a0a-9fe5-4f3e1c18b4a3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 204 len: 0 microversion: 2.1 time: 0.259917 Oct 12 22:23:59.835884 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2397/5406] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:23:59 2022] DELETE /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:23:59.844885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-27b27434-cd5d-4e15-8448-435a9261e65b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:59.845842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-27b27434-cd5d-4e15-8448-435a9261e65b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:23:59.853701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27b27434-cd5d-4e15-8448-435a9261e65b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:59.854449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27b27434-cd5d-4e15-8448-435a9261e65b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:59.856268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27b27434-cd5d-4e15-8448-435a9261e65b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:23:59.857153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27b27434-cd5d-4e15-8448-435a9261e65b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:23:59.857813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27b27434-cd5d-4e15-8448-435a9261e65b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:23:59.858608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27b27434-cd5d-4e15-8448-435a9261e65b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:00.033461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-071abdca-dda0-4498-a1f2-3489750a459f tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:00.034587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-071abdca-dda0-4498-a1f2-3489750a459f tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:00.043056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-071abdca-dda0-4498-a1f2-3489750a459f tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:00.043822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-071abdca-dda0-4498-a1f2-3489750a459f tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:00.044600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-071abdca-dda0-4498-a1f2-3489750a459f tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:00.045573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-071abdca-dda0-4498-a1f2-3489750a459f tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:00.046255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-071abdca-dda0-4498-a1f2-3489750a459f tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:00.047608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-071abdca-dda0-4498-a1f2-3489750a459f tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:00.169321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-071abdca-dda0-4498-a1f2-3489750a459f tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:00.197217 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-071abdca-dda0-4498-a1f2-3489750a459f tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:00.203995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-071abdca-dda0-4498-a1f2-3489750a459f tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:00.205257 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-071abdca-dda0-4498-a1f2-3489750a459f tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.176493 Oct 12 22:24:00.213442 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2398/5407] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:00 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:24:00.219616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-509a9145-d727-42a9-b1c3-2d8425445e36 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:00.220252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-509a9145-d727-42a9-b1c3-2d8425445e36 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:00.235051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-509a9145-d727-42a9-b1c3-2d8425445e36 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:00.235693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-509a9145-d727-42a9-b1c3-2d8425445e36 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:00.236438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-509a9145-d727-42a9-b1c3-2d8425445e36 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:00.237753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-509a9145-d727-42a9-b1c3-2d8425445e36 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:00.239185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-509a9145-d727-42a9-b1c3-2d8425445e36 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:00.240617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-509a9145-d727-42a9-b1c3-2d8425445e36 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:00.370431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-509a9145-d727-42a9-b1c3-2d8425445e36 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:00.380361 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-509a9145-d727-42a9-b1c3-2d8425445e36 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1285 microversion: 2.1 time: 0.165306 Oct 12 22:24:00.381628 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2399/5408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:00 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:00.632462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d909a408-0401-4d6f-a44c-f78e258394e0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:00.635484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d909a408-0401-4d6f-a44c-f78e258394e0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:00.646435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d909a408-0401-4d6f-a44c-f78e258394e0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:00.647210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d909a408-0401-4d6f-a44c-f78e258394e0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:00.648007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d909a408-0401-4d6f-a44c-f78e258394e0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:00.648994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d909a408-0401-4d6f-a44c-f78e258394e0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:00.649589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d909a408-0401-4d6f-a44c-f78e258394e0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:00.651904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d909a408-0401-4d6f-a44c-f78e258394e0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:00.730447 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d909a408-0401-4d6f-a44c-f78e258394e0 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102361 Oct 12 22:24:00.736252 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2400/5409] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:24:00 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:01.041036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-27b27434-cd5d-4e15-8448-435a9261e65b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:01.058014 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-27b27434-cd5d-4e15-8448-435a9261e65b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 200 len: 1515 microversion: 2.1 time: 1.216850 Oct 12 22:24:01.058582 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3010/5410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:23:59 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 1515 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:24:01.234078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b0980a18-495d-4d86-845e-2d7d44cc6854 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:01.234693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b0980a18-495d-4d86-845e-2d7d44cc6854 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:01.247565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0980a18-495d-4d86-845e-2d7d44cc6854 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:01.249425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0980a18-495d-4d86-845e-2d7d44cc6854 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:01.250706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0980a18-495d-4d86-845e-2d7d44cc6854 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:01.251879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0980a18-495d-4d86-845e-2d7d44cc6854 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:01.252969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0980a18-495d-4d86-845e-2d7d44cc6854 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:01.254253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0980a18-495d-4d86-845e-2d7d44cc6854 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:01.407123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-23cd4c2c-25b3-4211-9588-f5ce6358868c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:01.409001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-23cd4c2c-25b3-4211-9588-f5ce6358868c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:01.430255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23cd4c2c-25b3-4211-9588-f5ce6358868c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:01.432216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23cd4c2c-25b3-4211-9588-f5ce6358868c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:01.433055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23cd4c2c-25b3-4211-9588-f5ce6358868c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:01.434517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23cd4c2c-25b3-4211-9588-f5ce6358868c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:01.436347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23cd4c2c-25b3-4211-9588-f5ce6358868c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:01.437345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23cd4c2c-25b3-4211-9588-f5ce6358868c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:01.583008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b0980a18-495d-4d86-845e-2d7d44cc6854 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:01.594353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b0980a18-495d-4d86-845e-2d7d44cc6854 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:01.598680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b0980a18-495d-4d86-845e-2d7d44cc6854 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:01.600526 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b0980a18-495d-4d86-845e-2d7d44cc6854 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.370452 Oct 12 22:24:01.603736 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2401/5411] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:01 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:24:01.671857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-23cd4c2c-25b3-4211-9588-f5ce6358868c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:01.685964 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-23cd4c2c-25b3-4211-9588-f5ce6358868c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1285 microversion: 2.1 time: 0.285876 Oct 12 22:24:01.686905 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3011/5412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:01 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1285 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:01.750384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-96dc003a-8889-482c-b477-043bb5f36c26 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:01.755901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-96dc003a-8889-482c-b477-043bb5f36c26 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:01.766415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96dc003a-8889-482c-b477-043bb5f36c26 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:01.767196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96dc003a-8889-482c-b477-043bb5f36c26 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:01.767843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96dc003a-8889-482c-b477-043bb5f36c26 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:01.768763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96dc003a-8889-482c-b477-043bb5f36c26 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:01.769570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96dc003a-8889-482c-b477-043bb5f36c26 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:01.770201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96dc003a-8889-482c-b477-043bb5f36c26 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:01.829908 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-96dc003a-8889-482c-b477-043bb5f36c26 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090839 Oct 12 22:24:01.831569 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2402/5413] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:24:01 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:02.082626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-92fe3fb2-5d41-4284-a8c3-067d6887e76b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:02.083260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-92fe3fb2-5d41-4284-a8c3-067d6887e76b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:02.093817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92fe3fb2-5d41-4284-a8c3-067d6887e76b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:02.100149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92fe3fb2-5d41-4284-a8c3-067d6887e76b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:02.100911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92fe3fb2-5d41-4284-a8c3-067d6887e76b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:02.102579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92fe3fb2-5d41-4284-a8c3-067d6887e76b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:02.103225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92fe3fb2-5d41-4284-a8c3-067d6887e76b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:02.103861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92fe3fb2-5d41-4284-a8c3-067d6887e76b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:02.632741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8a056b37-3c97-491d-96b2-0001835328d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:02.637814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8a056b37-3c97-491d-96b2-0001835328d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:02.653469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a056b37-3c97-491d-96b2-0001835328d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:02.655471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a056b37-3c97-491d-96b2-0001835328d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:02.656604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a056b37-3c97-491d-96b2-0001835328d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:02.660184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a056b37-3c97-491d-96b2-0001835328d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:02.660790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a056b37-3c97-491d-96b2-0001835328d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:02.661347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a056b37-3c97-491d-96b2-0001835328d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:03.047506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-92fe3fb2-5d41-4284-a8c3-067d6887e76b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:03.066243 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-92fe3fb2-5d41-4284-a8c3-067d6887e76b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 200 len: 1515 microversion: 2.1 time: 0.987731 Oct 12 22:24:03.067518 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3012/5414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:02 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 1515 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:03.075399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ec5409ec-3277-4e07-9315-0812e681296c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:03.076185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ec5409ec-3277-4e07-9315-0812e681296c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:03.092823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec5409ec-3277-4e07-9315-0812e681296c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:03.093499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec5409ec-3277-4e07-9315-0812e681296c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:03.093499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec5409ec-3277-4e07-9315-0812e681296c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:03.094368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec5409ec-3277-4e07-9315-0812e681296c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:03.094940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec5409ec-3277-4e07-9315-0812e681296c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:03.095541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec5409ec-3277-4e07-9315-0812e681296c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:03.190675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8a056b37-3c97-491d-96b2-0001835328d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:03.201031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8a056b37-3c97-491d-96b2-0001835328d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:03.205998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8a056b37-3c97-491d-96b2-0001835328d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:03.209546 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8a056b37-3c97-491d-96b2-0001835328d0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.580944 Oct 12 22:24:03.213018 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2403/5415] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:02 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:24:03.225749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-34e27843-1c36-45ab-a76e-944424833be3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:03.228372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-34e27843-1c36-45ab-a76e-944424833be3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:03.243093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34e27843-1c36-45ab-a76e-944424833be3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:03.247803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34e27843-1c36-45ab-a76e-944424833be3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:03.254418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34e27843-1c36-45ab-a76e-944424833be3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:03.255624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34e27843-1c36-45ab-a76e-944424833be3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:03.256409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34e27843-1c36-45ab-a76e-944424833be3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:03.257676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34e27843-1c36-45ab-a76e-944424833be3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:03.349797 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-34e27843-1c36-45ab-a76e-944424833be3 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132295 Oct 12 22:24:03.360430 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2404/5416] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:24:03 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:03.365608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-2da1dc09-9b08-4673-83eb-568533254c50 req-6f4c33fe-cee3-4687-ace6-fe90cab28027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eedbdf1-5816-49c0-9d3e-fd35cce5cb61", "name": "network-vif-deleted", "tag": "9c2bae92-c619-4bf0-bb87-9c3e9860e916"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:03.386255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2da1dc09-9b08-4673-83eb-568533254c50 req-6f4c33fe-cee3-4687-ace6-fe90cab28027 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:03.386868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2da1dc09-9b08-4673-83eb-568533254c50 req-6f4c33fe-cee3-4687-ace6-fe90cab28027 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:03.388052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2da1dc09-9b08-4673-83eb-568533254c50 req-6f4c33fe-cee3-4687-ace6-fe90cab28027 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:03.415878 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-2da1dc09-9b08-4673-83eb-568533254c50 req-6f4c33fe-cee3-4687-ace6-fe90cab28027 service nova] Creating event network-vif-deleted:9c2bae92-c619-4bf0-bb87-9c3e9860e916 for instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 on n-h1-861111-1 Oct 12 22:24:03.432021 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-2da1dc09-9b08-4673-83eb-568533254c50 req-6f4c33fe-cee3-4687-ace6-fe90cab28027 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069712 Oct 12 22:24:03.432856 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2405/5417] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:03.732685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ec5409ec-3277-4e07-9315-0812e681296c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:03.746652 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ec5409ec-3277-4e07-9315-0812e681296c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1327 microversion: 2.1 time: 0.676718 Oct 12 22:24:03.751160 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3013/5418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:03 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1327 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:04.093300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a24b5631-afd2-4de2-8463-de3e0402d601 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:04.094004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a24b5631-afd2-4de2-8463-de3e0402d601 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:04.107652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a24b5631-afd2-4de2-8463-de3e0402d601 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:04.112991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a24b5631-afd2-4de2-8463-de3e0402d601 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:04.113774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a24b5631-afd2-4de2-8463-de3e0402d601 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:04.114719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a24b5631-afd2-4de2-8463-de3e0402d601 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:04.120557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a24b5631-afd2-4de2-8463-de3e0402d601 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:04.121293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a24b5631-afd2-4de2-8463-de3e0402d601 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:04.203118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a24b5631-afd2-4de2-8463-de3e0402d601 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:04.204624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a24b5631-afd2-4de2-8463-de3e0402d601 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:04.205236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a24b5631-afd2-4de2-8463-de3e0402d601 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:04.205873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-a24b5631-afd2-4de2-8463-de3e0402d601 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lazy-loading 'fault' on Instance uuid 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:24:04.242686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4cd2ba55-4db9-4d75-bd17-c58037d6de4b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:04.243940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4cd2ba55-4db9-4d75-bd17-c58037d6de4b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:04.256536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cd2ba55-4db9-4d75-bd17-c58037d6de4b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:04.260019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cd2ba55-4db9-4d75-bd17-c58037d6de4b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:04.260747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cd2ba55-4db9-4d75-bd17-c58037d6de4b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:04.261555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cd2ba55-4db9-4d75-bd17-c58037d6de4b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:04.267865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cd2ba55-4db9-4d75-bd17-c58037d6de4b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:04.268564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cd2ba55-4db9-4d75-bd17-c58037d6de4b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:04.346561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a24b5631-afd2-4de2-8463-de3e0402d601 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:04.356389 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a24b5631-afd2-4de2-8463-de3e0402d601 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 200 len: 1319 microversion: 2.1 time: 0.267195 Oct 12 22:24:04.357565 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2406/5419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:04 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:04.380644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ce3cb81e-760d-44c1-b177-8599200ede98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:04.388860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ce3cb81e-760d-44c1-b177-8599200ede98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:04.395437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce3cb81e-760d-44c1-b177-8599200ede98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:04.396299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce3cb81e-760d-44c1-b177-8599200ede98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:04.396908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce3cb81e-760d-44c1-b177-8599200ede98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:04.398340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce3cb81e-760d-44c1-b177-8599200ede98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:04.398953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce3cb81e-760d-44c1-b177-8599200ede98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:04.399597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ce3cb81e-760d-44c1-b177-8599200ede98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:04.435121 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ce3cb81e-760d-44c1-b177-8599200ede98 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058616 Oct 12 22:24:04.440349 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2407/5420] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:24:04 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:24:04.470301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4cd2ba55-4db9-4d75-bd17-c58037d6de4b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:04.483441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4cd2ba55-4db9-4d75-bd17-c58037d6de4b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:04.485909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4cd2ba55-4db9-4d75-bd17-c58037d6de4b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:04.488004 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4cd2ba55-4db9-4d75-bd17-c58037d6de4b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.252051 Oct 12 22:24:04.500722 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3014/5421] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:04 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:24:04.769846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-496b1b4f-f492-4e62-a5a9-ee8674c8581e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:04.771302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-496b1b4f-f492-4e62-a5a9-ee8674c8581e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:04.795433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-496b1b4f-f492-4e62-a5a9-ee8674c8581e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:04.799440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-496b1b4f-f492-4e62-a5a9-ee8674c8581e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:04.800198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-496b1b4f-f492-4e62-a5a9-ee8674c8581e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:04.807854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-496b1b4f-f492-4e62-a5a9-ee8674c8581e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:04.808605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-496b1b4f-f492-4e62-a5a9-ee8674c8581e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:04.809215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-496b1b4f-f492-4e62-a5a9-ee8674c8581e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:05.063654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a7a26a30-c576-486e-81cf-aca0e6fc8264 req-cab04d85-4d90-4cf4-9e79-d7fa1dd0956f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "920cabd1-b4b0-4043-a02f-c81488ffea83", "tag": "58ca8f5d-ed1b-4a4c-a321-e78bcd740887"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:05.086017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a7a26a30-c576-486e-81cf-aca0e6fc8264 req-cab04d85-4d90-4cf4-9e79-d7fa1dd0956f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:05.086951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a7a26a30-c576-486e-81cf-aca0e6fc8264 req-cab04d85-4d90-4cf4-9e79-d7fa1dd0956f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:05.087691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a7a26a30-c576-486e-81cf-aca0e6fc8264 req-cab04d85-4d90-4cf4-9e79-d7fa1dd0956f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:05.101386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-496b1b4f-f492-4e62-a5a9-ee8674c8581e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:05.120823 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-496b1b4f-f492-4e62-a5a9-ee8674c8581e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1327 microversion: 2.1 time: 0.354767 Oct 12 22:24:05.125370 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2408/5422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:04 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1327 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:05.127735 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a7a26a30-c576-486e-81cf-aca0e6fc8264 req-cab04d85-4d90-4cf4-9e79-d7fa1dd0956f service nova] Creating event network-changed:58ca8f5d-ed1b-4a4c-a321-e78bcd740887 for instance 920cabd1-b4b0-4043-a02f-c81488ffea83 on n-h1-861111-1 Oct 12 22:24:05.145346 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a7a26a30-c576-486e-81cf-aca0e6fc8264 req-cab04d85-4d90-4cf4-9e79-d7fa1dd0956f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086085 Oct 12 22:24:05.146289 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3015/5423] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:05.382217 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1b6cdc18-b52e-46b0-8457-300a2675185b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:05.382830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1b6cdc18-b52e-46b0-8457-300a2675185b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:05.384996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:05.397507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b6cdc18-b52e-46b0-8457-300a2675185b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:05.398054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b6cdc18-b52e-46b0-8457-300a2675185b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:05.398495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b6cdc18-b52e-46b0-8457-300a2675185b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:05.399213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b6cdc18-b52e-46b0-8457-300a2675185b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:05.399690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b6cdc18-b52e-46b0-8457-300a2675185b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:05.400116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b6cdc18-b52e-46b0-8457-300a2675185b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:05.440069 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-1b6cdc18-b52e-46b0-8457-300a2675185b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. Oct 12 22:24:05.449323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-14bb3775-3d82-425f-aecc-c63d7be08ced tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1b6cdc18-b52e-46b0-8457-300a2675185b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 HTTP/1.1 Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '9eedbdf1-5816-49c0-9d3e-fd35cce5cb61'} Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:05.452215 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:05.457972 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:05.457972 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:05.457972 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:24:05.457972 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:24:05.457972 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. Oct 12 22:24:05.457972 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:05.457972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1b6cdc18-b52e-46b0-8457-300a2675185b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:24:05.457972 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1b6cdc18-b52e-46b0-8457-300a2675185b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 404 len: 111 microversion: 2.1 time: 0.075636 Oct 12 22:24:05.457972 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2409/5424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:05 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:24:05.459187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-14bb3775-3d82-425f-aecc-c63d7be08ced tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:05.466714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b22bc358-e39e-43a7-8997-508351642ab2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '.version_select at 0x7f512377f4c0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:05.482727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14bb3775-3d82-425f-aecc-c63d7be08ced tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:05.483216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14bb3775-3d82-425f-aecc-c63d7be08ced tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:05.483684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14bb3775-3d82-425f-aecc-c63d7be08ced tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:05.484417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14bb3775-3d82-425f-aecc-c63d7be08ced tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:05.484875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14bb3775-3d82-425f-aecc-c63d7be08ced tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:05.485306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14bb3775-3d82-425f-aecc-c63d7be08ced tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:05.532842 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b22bc358-e39e-43a7-8997-508351642ab2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-key-1658842947" status: 202 len: 0 microversion: 2.1 time: 0.067461 Oct 12 22:24:05.543501 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2410/5425] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 12 22:24:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1658842947 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:24:05.549199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-52c72f50-6496-4ae4-8463-ad790e3eeea5 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:05.550492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-52c72f50-6496-4ae4-8463-ad790e3eeea5 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:05.559675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52c72f50-6496-4ae4-8463-ad790e3eeea5 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:05.562807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52c72f50-6496-4ae4-8463-ad790e3eeea5 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:05.563779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52c72f50-6496-4ae4-8463-ad790e3eeea5 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:05.564997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52c72f50-6496-4ae4-8463-ad790e3eeea5 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:05.565953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52c72f50-6496-4ae4-8463-ad790e3eeea5 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:05.566670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52c72f50-6496-4ae4-8463-ad790e3eeea5 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:05.574620 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-14bb3775-3d82-425f-aecc-c63d7be08ced tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127819 Oct 12 22:24:05.579117 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3016/5426] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:24:05 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:24:05.602744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:05.709695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-789494500", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "36f67723-f632-42aa-bcd9-cfd1c5f07f45"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:05.789248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] validate_networks() for [('36f67723-f632-42aa-bcd9-cfd1c5f07f45', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:24:05.799272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-52c72f50-6496-4ae4-8463-ad790e3eeea5 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:05.820941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-52c72f50-6496-4ae4-8463-ad790e3eeea5 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:05.824069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-52c72f50-6496-4ae4-8463-ad790e3eeea5 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:05.829489 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-52c72f50-6496-4ae4-8463-ad790e3eeea5 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.284851 Oct 12 22:24:05.833829 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2411/5427] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:05 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:24:06.148600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5397efc0-a162-4467-99c8-216e8100dea0 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:06.149944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5397efc0-a162-4467-99c8-216e8100dea0 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:06.164916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5397efc0-a162-4467-99c8-216e8100dea0 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:06.165662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5397efc0-a162-4467-99c8-216e8100dea0 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:06.166313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5397efc0-a162-4467-99c8-216e8100dea0 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:06.167577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5397efc0-a162-4467-99c8-216e8100dea0 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:06.173752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5397efc0-a162-4467-99c8-216e8100dea0 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:06.174642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5397efc0-a162-4467-99c8-216e8100dea0 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:06.213055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=16 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:06.510673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5397efc0-a162-4467-99c8-216e8100dea0 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:06.521104 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5397efc0-a162-4467-99c8-216e8100dea0 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1327 microversion: 2.1 time: 0.377004 Oct 12 22:24:06.526551 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2412/5428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:06 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1327 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:24:06.587441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-38bae471-55cc-49d5-872e-746f424fbc6c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:06.589941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-38bae471-55cc-49d5-872e-746f424fbc6c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:06.604105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38bae471-55cc-49d5-872e-746f424fbc6c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:06.606912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38bae471-55cc-49d5-872e-746f424fbc6c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:06.607629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38bae471-55cc-49d5-872e-746f424fbc6c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:06.608585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38bae471-55cc-49d5-872e-746f424fbc6c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:06.611834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38bae471-55cc-49d5-872e-746f424fbc6c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:06.612529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38bae471-55cc-49d5-872e-746f424fbc6c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:06.678465 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-38bae471-55cc-49d5-872e-746f424fbc6c tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096259 Oct 12 22:24:06.679381 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2413/5429] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:24:06 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:24:06.861933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-604b559f-9fa8-4df5-b618-aa7d025e5b2c tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:06.862783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-604b559f-9fa8-4df5-b618-aa7d025e5b2c tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:06.877070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-604b559f-9fa8-4df5-b618-aa7d025e5b2c tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:06.877758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-604b559f-9fa8-4df5-b618-aa7d025e5b2c tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:06.878320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-604b559f-9fa8-4df5-b618-aa7d025e5b2c tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:06.879156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-604b559f-9fa8-4df5-b618-aa7d025e5b2c tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:06.879753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-604b559f-9fa8-4df5-b618-aa7d025e5b2c tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:06.880278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-604b559f-9fa8-4df5-b618-aa7d025e5b2c tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:07.016963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-604b559f-9fa8-4df5-b618-aa7d025e5b2c tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:07.034920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-604b559f-9fa8-4df5-b618-aa7d025e5b2c tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:07.038041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-604b559f-9fa8-4df5-b618-aa7d025e5b2c tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:07.040425 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-604b559f-9fa8-4df5-b618-aa7d025e5b2c tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.182373 Oct 12 22:24:07.059672 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2414/5430] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:06 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:24:07.551447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-04a711bd-e72c-4393-bf7e-755891fac4bf tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:07.552244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-04a711bd-e72c-4393-bf7e-755891fac4bf tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:07.568948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a711bd-e72c-4393-bf7e-755891fac4bf tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:07.571822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a711bd-e72c-4393-bf7e-755891fac4bf tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:07.572276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a711bd-e72c-4393-bf7e-755891fac4bf tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:07.573052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a711bd-e72c-4393-bf7e-755891fac4bf tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:07.573514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a711bd-e72c-4393-bf7e-755891fac4bf tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:07.576349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a711bd-e72c-4393-bf7e-755891fac4bf tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:07.929685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-04a711bd-e72c-4393-bf7e-755891fac4bf tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:07.947073 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-04a711bd-e72c-4393-bf7e-755891fac4bf tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1327 microversion: 2.1 time: 0.401564 Oct 12 22:24:07.949531 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2415/5431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:07 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1327 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:24:07.956362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-568db9dc-1af8-4453-8533-729a0c9893ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:07.960607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-568db9dc-1af8-4453-8533-729a0c9893ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:07.972759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-568db9dc-1af8-4453-8533-729a0c9893ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:07.974105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-568db9dc-1af8-4453-8533-729a0c9893ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:07.974850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-568db9dc-1af8-4453-8533-729a0c9893ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:07.977474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-568db9dc-1af8-4453-8533-729a0c9893ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:07.978130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-568db9dc-1af8-4453-8533-729a0c9893ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:07.979498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-568db9dc-1af8-4453-8533-729a0c9893ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:08.020531 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-568db9dc-1af8-4453-8533-729a0c9893ae tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069184 Oct 12 22:24:08.021257 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2416/5432] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:24:07 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:24:08.080178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b01cc105-7c39-4981-9e4e-4a1933f6d1ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:08.081099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b01cc105-7c39-4981-9e4e-4a1933f6d1ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:08.104601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b01cc105-7c39-4981-9e4e-4a1933f6d1ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:08.106739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b01cc105-7c39-4981-9e4e-4a1933f6d1ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:08.107460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b01cc105-7c39-4981-9e4e-4a1933f6d1ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:08.108679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b01cc105-7c39-4981-9e4e-4a1933f6d1ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:08.109745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b01cc105-7c39-4981-9e4e-4a1933f6d1ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:08.111757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b01cc105-7c39-4981-9e4e-4a1933f6d1ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:08.135134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:24:08.136590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:24:08.137339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:24:08.138077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:24:08.140126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:24:08.154331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:08.155259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:08.156038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:08.157236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:08.157958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:08.159371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:08.184712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for project 8276c235e518406da376c8a4c19b27d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:24:08.191547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for user 789a612b19154564a853199a67ea8496 and project 8276c235e518406da376c8a4c19b27d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:24:08.205537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:24:08.208267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:24:08.211521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b01cc105-7c39-4981-9e4e-4a1933f6d1ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:08.232387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b01cc105-7c39-4981-9e4e-4a1933f6d1ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:08.243432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b01cc105-7c39-4981-9e4e-4a1933f6d1ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:08.244827 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b01cc105-7c39-4981-9e4e-4a1933f6d1ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.170793 Oct 12 22:24:08.262442 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2417/5433] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:08 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:24:08.274326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5b300e25-d707-46ad-b525-37f88fd323f1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:08.276725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5b300e25-d707-46ad-b525-37f88fd323f1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:08.281696 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-91933e6e-0495-4a09-b6c7-e7e62822dffd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.576066 Oct 12 22:24:08.283383 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3017/5434] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:24:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:24:08.284559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b300e25-d707-46ad-b525-37f88fd323f1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:08.285173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b300e25-d707-46ad-b525-37f88fd323f1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:08.285710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b300e25-d707-46ad-b525-37f88fd323f1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:08.286512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b300e25-d707-46ad-b525-37f88fd323f1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:08.287066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b300e25-d707-46ad-b525-37f88fd323f1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:08.287710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5b300e25-d707-46ad-b525-37f88fd323f1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:08.293578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b5f77afa-f894-4aac-b488-2af391e0e256 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:08.297081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b5f77afa-f894-4aac-b488-2af391e0e256 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:08.327134 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-5b300e25-d707-46ad-b525-37f88fd323f1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] HTTP exception thrown: Cannot 'reboot' instance feda1f68-7489-4648-8f7a-ab12030e50b3 while it is in vm_state rescued Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5b300e25-d707-46ad-b525-37f88fd323f1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Request method failure captured: Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3/action HTTP/1.1 Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 28 Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz1yYv3BEuyn16aX9rFnQkuXp35mHqXE7bVOWKfvxNZXNT7qw6co-FDMauTgJfMPQCxmiEKAu0kzyjnis87qTpfUYp96yN_F6sfmIZnSLJLUbYy9WREcLUGhzXNPjj1UORIJx3lHLMBoOzDKf1JzqCDKyG4PBpXcEQzC9GdyMUjXkpQ Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0a0c4d9f435a4c009bd0b5eb2618829b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: afec4a3808b84463900b744ecd9352b6 Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: {"reboot": {"type": "HARD"}} Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: exception: Cannot 'reboot' instance feda1f68-7489-4648-8f7a-ab12030e50b3 while it is in vm_state rescued Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'feda1f68-7489-4648-8f7a-ab12030e50b3', 'body': {'reboot': {'type': 'HARD'}}} Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance feda1f68-7489-4648-8f7a-ab12030e50b3 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:24:08.329274 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:24:08.334060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance feda1f68-7489-4648-8f7a-ab12030e50b3 while it is in vm_state rescued Oct 12 22:24:08.334060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:08.334060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:08.334060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:08.334060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:08.334060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:08.334060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:08.334060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:24:08.334060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:24:08.334060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance feda1f68-7489-4648-8f7a-ab12030e50b3 while it is in vm_state rescued Oct 12 22:24:08.334060 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:08.337012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5b300e25-d707-46ad-b525-37f88fd323f1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Returning 409 to user: Cannot 'reboot' instance feda1f68-7489-4648-8f7a-ab12030e50b3 while it is in vm_state rescued {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:24:08.338163 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5b300e25-d707-46ad-b525-37f88fd323f1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "POST /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3/action" status: 409 len: 145 microversion: 2.1 time: 0.074375 Oct 12 22:24:08.339074 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2418/5435] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:24:08 2022] POST /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3/action => generated 145 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:24:08.357794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0454ba12-a33e-441d-8fc5-e4d13b646626 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:08.365471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0454ba12-a33e-441d-8fc5-e4d13b646626 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:08.380205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0454ba12-a33e-441d-8fc5-e4d13b646626 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:08.384835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0454ba12-a33e-441d-8fc5-e4d13b646626 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:08.385732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0454ba12-a33e-441d-8fc5-e4d13b646626 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:08.386732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0454ba12-a33e-441d-8fc5-e4d13b646626 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:08.387443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0454ba12-a33e-441d-8fc5-e4d13b646626 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:08.388151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0454ba12-a33e-441d-8fc5-e4d13b646626 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:08.439501 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-0454ba12-a33e-441d-8fc5-e4d13b646626 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] HTTP exception thrown: Cannot 'rebuild' instance feda1f68-7489-4648-8f7a-ab12030e50b3 while it is in vm_state rescued Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0454ba12-a33e-441d-8fc5-e4d13b646626 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Request method failure captured: Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3/action HTTP/1.1 Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 65 Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz1yYv3BEuyn16aX9rFnQkuXp35mHqXE7bVOWKfvxNZXNT7qw6co-FDMauTgJfMPQCxmiEKAu0kzyjnis87qTpfUYp96yN_F6sfmIZnSLJLUbYy9WREcLUGhzXNPjj1UORIJx3lHLMBoOzDKf1JzqCDKyG4PBpXcEQzC9GdyMUjXkpQ Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0a0c4d9f435a4c009bd0b5eb2618829b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: afec4a3808b84463900b744ecd9352b6 Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: {"rebuild": {"imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c"}} Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: exception: Cannot 'rebuild' instance feda1f68-7489-4648-8f7a-ab12030e50b3 while it is in vm_state rescued Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'feda1f68-7489-4648-8f7a-ab12030e50b3', 'body': {'rebuild': {'imageRef': 'd1e68057-c368-47a5-ab06-787819be7f9c'}}} Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance feda1f68-7489-4648-8f7a-ab12030e50b3 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:24:08.441411 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance feda1f68-7489-4648-8f7a-ab12030e50b3 while it is in vm_state rescued Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance feda1f68-7489-4648-8f7a-ab12030e50b3 while it is in vm_state rescued Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0454ba12-a33e-441d-8fc5-e4d13b646626 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Returning 409 to user: Cannot 'rebuild' instance feda1f68-7489-4648-8f7a-ab12030e50b3 while it is in vm_state rescued {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0454ba12-a33e-441d-8fc5-e4d13b646626 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "POST /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3/action" status: 409 len: 146 microversion: 2.1 time: 0.097543 Oct 12 22:24:08.446387 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2419/5436] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:24:08 2022] POST /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3/action => generated 146 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:24:08.453468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b5f77afa-f894-4aac-b488-2af391e0e256 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:08.468488 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b5f77afa-f894-4aac-b488-2af391e0e256 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1208 microversion: 2.1 time: 0.178650 Oct 12 22:24:08.471548 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3018/5437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:08 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1208 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:08.472834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-86ee7bd6-6ed1-469c-9ebb-19b2812d3014 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:08.473645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-86ee7bd6-6ed1-469c-9ebb-19b2812d3014 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:08.499989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86ee7bd6-6ed1-469c-9ebb-19b2812d3014 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:08.506531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86ee7bd6-6ed1-469c-9ebb-19b2812d3014 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:08.507625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86ee7bd6-6ed1-469c-9ebb-19b2812d3014 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:08.508765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86ee7bd6-6ed1-469c-9ebb-19b2812d3014 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:08.509230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86ee7bd6-6ed1-469c-9ebb-19b2812d3014 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:08.509869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86ee7bd6-6ed1-469c-9ebb-19b2812d3014 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:08.561056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-86ee7bd6-6ed1-469c-9ebb-19b2812d3014 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:24:08.756499 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-86ee7bd6-6ed1-469c-9ebb-19b2812d3014 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 204 len: 0 microversion: 2.1 time: 0.293525 Oct 12 22:24:08.758444 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2420/5438] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:24:08 2022] DELETE /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:24:08.767822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-440e6d12-02a4-4542-8efe-41bac3ca6dac tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:08.769667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-440e6d12-02a4-4542-8efe-41bac3ca6dac tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:08.793114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440e6d12-02a4-4542-8efe-41bac3ca6dac tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:08.795894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440e6d12-02a4-4542-8efe-41bac3ca6dac tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:08.799749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440e6d12-02a4-4542-8efe-41bac3ca6dac tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:08.801227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440e6d12-02a4-4542-8efe-41bac3ca6dac tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:08.801725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440e6d12-02a4-4542-8efe-41bac3ca6dac tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:08.806101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440e6d12-02a4-4542-8efe-41bac3ca6dac tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:08.986382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dc196c3f-1cbd-40fe-b5b9-a283dc5a9b86 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:08.987740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dc196c3f-1cbd-40fe-b5b9-a283dc5a9b86 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:09.004871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc196c3f-1cbd-40fe-b5b9-a283dc5a9b86 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:09.005513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc196c3f-1cbd-40fe-b5b9-a283dc5a9b86 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:09.007185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc196c3f-1cbd-40fe-b5b9-a283dc5a9b86 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:09.009214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc196c3f-1cbd-40fe-b5b9-a283dc5a9b86 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:09.012862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc196c3f-1cbd-40fe-b5b9-a283dc5a9b86 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:09.013749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc196c3f-1cbd-40fe-b5b9-a283dc5a9b86 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:09.159229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-440e6d12-02a4-4542-8efe-41bac3ca6dac tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:09.175579 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-440e6d12-02a4-4542-8efe-41bac3ca6dac tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1689 microversion: 2.1 time: 0.412096 Oct 12 22:24:09.201850 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3019/5439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:08 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1689 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:09.283153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2a6dd813-2d3d-4f40-98a4-3c1c4a61f608 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:09.284032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2a6dd813-2d3d-4f40-98a4-3c1c4a61f608 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:09.292464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a6dd813-2d3d-4f40-98a4-3c1c4a61f608 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:09.293109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a6dd813-2d3d-4f40-98a4-3c1c4a61f608 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:09.293851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a6dd813-2d3d-4f40-98a4-3c1c4a61f608 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:09.294938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a6dd813-2d3d-4f40-98a4-3c1c4a61f608 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:09.295669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a6dd813-2d3d-4f40-98a4-3c1c4a61f608 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:09.296335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a6dd813-2d3d-4f40-98a4-3c1c4a61f608 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:09.351527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dc196c3f-1cbd-40fe-b5b9-a283dc5a9b86 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:09.364680 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dc196c3f-1cbd-40fe-b5b9-a283dc5a9b86 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1327 microversion: 2.1 time: 0.392488 Oct 12 22:24:09.380571 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2421/5440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:08 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1327 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:09.500033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5e02299f-b88c-4919-9843-e8ff69d6a62f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:09.501071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5e02299f-b88c-4919-9843-e8ff69d6a62f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:09.527730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e02299f-b88c-4919-9843-e8ff69d6a62f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:09.528508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e02299f-b88c-4919-9843-e8ff69d6a62f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:09.529139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e02299f-b88c-4919-9843-e8ff69d6a62f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:09.530047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e02299f-b88c-4919-9843-e8ff69d6a62f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:09.530678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e02299f-b88c-4919-9843-e8ff69d6a62f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:09.531522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e02299f-b88c-4919-9843-e8ff69d6a62f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:09.836904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2a6dd813-2d3d-4f40-98a4-3c1c4a61f608 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:09.846751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2a6dd813-2d3d-4f40-98a4-3c1c4a61f608 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:09.848553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2a6dd813-2d3d-4f40-98a4-3c1c4a61f608 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:09.849898 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2a6dd813-2d3d-4f40-98a4-3c1c4a61f608 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.574486 Oct 12 22:24:09.851655 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3020/5441] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:09 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:24:09.991370 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5e02299f-b88c-4919-9843-e8ff69d6a62f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:10.000232 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5e02299f-b88c-4919-9843-e8ff69d6a62f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1212 microversion: 2.1 time: 0.505720 Oct 12 22:24:10.008683 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2422/5442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:09 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1212 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:10.226748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0b70d8ee-1c1b-4e47-b3e9-6689550e4723 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:10.227414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0b70d8ee-1c1b-4e47-b3e9-6689550e4723 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:10.235574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b70d8ee-1c1b-4e47-b3e9-6689550e4723 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:10.246286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b70d8ee-1c1b-4e47-b3e9-6689550e4723 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:10.246751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b70d8ee-1c1b-4e47-b3e9-6689550e4723 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:10.247550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b70d8ee-1c1b-4e47-b3e9-6689550e4723 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:10.248014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b70d8ee-1c1b-4e47-b3e9-6689550e4723 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:10.248447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0b70d8ee-1c1b-4e47-b3e9-6689550e4723 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:10.394838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-377108d2-4aff-4393-ad79-86e511f3cdf1 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:10.395968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-377108d2-4aff-4393-ad79-86e511f3cdf1 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:10.403606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-377108d2-4aff-4393-ad79-86e511f3cdf1 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:10.404416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-377108d2-4aff-4393-ad79-86e511f3cdf1 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:10.405076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-377108d2-4aff-4393-ad79-86e511f3cdf1 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:10.405993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-377108d2-4aff-4393-ad79-86e511f3cdf1 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:10.406661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-377108d2-4aff-4393-ad79-86e511f3cdf1 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:10.407336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-377108d2-4aff-4393-ad79-86e511f3cdf1 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:10.504064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0b70d8ee-1c1b-4e47-b3e9-6689550e4723 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:10.519525 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0b70d8ee-1c1b-4e47-b3e9-6689550e4723 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1689 microversion: 2.1 time: 0.294356 Oct 12 22:24:10.531344 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3021/5443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:10 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1689 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:10.827259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-377108d2-4aff-4393-ad79-86e511f3cdf1 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:10.845068 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-377108d2-4aff-4393-ad79-86e511f3cdf1 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1327 microversion: 2.1 time: 0.454581 Oct 12 22:24:10.846174 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2423/5444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:10 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1327 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:24:10.877332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5466dcc3-a25f-4328-a985-b3111117dcc6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:10.877948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5466dcc3-a25f-4328-a985-b3111117dcc6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:10.884321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5466dcc3-a25f-4328-a985-b3111117dcc6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:10.885250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5466dcc3-a25f-4328-a985-b3111117dcc6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:10.885875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5466dcc3-a25f-4328-a985-b3111117dcc6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:10.886942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5466dcc3-a25f-4328-a985-b3111117dcc6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:10.888571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5466dcc3-a25f-4328-a985-b3111117dcc6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:10.889185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5466dcc3-a25f-4328-a985-b3111117dcc6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:11.001407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5466dcc3-a25f-4328-a985-b3111117dcc6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:11.012145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5466dcc3-a25f-4328-a985-b3111117dcc6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:11.013984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5466dcc3-a25f-4328-a985-b3111117dcc6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:11.015434 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5466dcc3-a25f-4328-a985-b3111117dcc6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.142524 Oct 12 22:24:11.026694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1a52e7af-d204-4ea1-8fef-c1529bf56fb1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:11.028466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1a52e7af-d204-4ea1-8fef-c1529bf56fb1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:11.030467 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3022/5445] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:10 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:24:11.038647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a52e7af-d204-4ea1-8fef-c1529bf56fb1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:11.040226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a52e7af-d204-4ea1-8fef-c1529bf56fb1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:11.040870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a52e7af-d204-4ea1-8fef-c1529bf56fb1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:11.042158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a52e7af-d204-4ea1-8fef-c1529bf56fb1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:11.042790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a52e7af-d204-4ea1-8fef-c1529bf56fb1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:11.043466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a52e7af-d204-4ea1-8fef-c1529bf56fb1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:11.199292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1a52e7af-d204-4ea1-8fef-c1529bf56fb1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:11.208468 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1a52e7af-d204-4ea1-8fef-c1529bf56fb1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1212 microversion: 2.1 time: 0.186370 Oct 12 22:24:11.209514 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2424/5446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:11 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1212 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:11.547782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e7042f13-f147-4c67-8f9a-e887cb7f9c72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:11.549745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e7042f13-f147-4c67-8f9a-e887cb7f9c72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:11.562273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7042f13-f147-4c67-8f9a-e887cb7f9c72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:11.563565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7042f13-f147-4c67-8f9a-e887cb7f9c72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:11.564343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7042f13-f147-4c67-8f9a-e887cb7f9c72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:11.568619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7042f13-f147-4c67-8f9a-e887cb7f9c72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:11.570045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7042f13-f147-4c67-8f9a-e887cb7f9c72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:11.571323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e7042f13-f147-4c67-8f9a-e887cb7f9c72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:11.873764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5055321d-b1e1-4884-9948-1a102b6cedd7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:11.874425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5055321d-b1e1-4884-9948-1a102b6cedd7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:11.890850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e7042f13-f147-4c67-8f9a-e887cb7f9c72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:11.891389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:11.894138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5055321d-b1e1-4884-9948-1a102b6cedd7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:11.897905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5055321d-b1e1-4884-9948-1a102b6cedd7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:11.902447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5055321d-b1e1-4884-9948-1a102b6cedd7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:11.903358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5055321d-b1e1-4884-9948-1a102b6cedd7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:11.903926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5055321d-b1e1-4884-9948-1a102b6cedd7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:11.904643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5055321d-b1e1-4884-9948-1a102b6cedd7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:11.937527 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e7042f13-f147-4c67-8f9a-e887cb7f9c72 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1689 microversion: 2.1 time: 0.395755 Oct 12 22:24:11.942608 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3023/5447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:11 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1689 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:12.044254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e1412772-7083-421d-8485-34db9fb88e82 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:12.044878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e1412772-7083-421d-8485-34db9fb88e82 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:12.066225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1412772-7083-421d-8485-34db9fb88e82 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:12.066843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1412772-7083-421d-8485-34db9fb88e82 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:12.067318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1412772-7083-421d-8485-34db9fb88e82 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:12.068128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1412772-7083-421d-8485-34db9fb88e82 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:12.068493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1412772-7083-421d-8485-34db9fb88e82 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:12.077339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1412772-7083-421d-8485-34db9fb88e82 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:12.213361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e1412772-7083-421d-8485-34db9fb88e82 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:12.223391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e1412772-7083-421d-8485-34db9fb88e82 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:12.224866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e1412772-7083-421d-8485-34db9fb88e82 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:12.227230 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e1412772-7083-421d-8485-34db9fb88e82 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.188823 Oct 12 22:24:12.232203 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3024/5448] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:12 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:24:12.239250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6a5fb716-db61-44c2-a1a9-b54eee83177f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:12.239885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6a5fb716-db61-44c2-a1a9-b54eee83177f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:12.254775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a5fb716-db61-44c2-a1a9-b54eee83177f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:12.255315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a5fb716-db61-44c2-a1a9-b54eee83177f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:12.255768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a5fb716-db61-44c2-a1a9-b54eee83177f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:12.256517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a5fb716-db61-44c2-a1a9-b54eee83177f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:12.256980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a5fb716-db61-44c2-a1a9-b54eee83177f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:12.257414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a5fb716-db61-44c2-a1a9-b54eee83177f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:12.361204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6a5fb716-db61-44c2-a1a9-b54eee83177f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:12.385013 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6a5fb716-db61-44c2-a1a9-b54eee83177f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1212 microversion: 2.1 time: 0.151475 Oct 12 22:24:12.385571 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3025/5449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:12 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1212 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:12.390439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5055321d-b1e1-4884-9948-1a102b6cedd7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:12.403645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-2afb54eb-0945-412f-8390-e158d70f0288 req-d44415d6-edd6-4d39-ac37-4a75ba636ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "920cabd1-b4b0-4043-a02f-c81488ffea83", "name": "network-vif-plugged", "status": "completed", "tag": "58ca8f5d-ed1b-4a4c-a321-e78bcd740887"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:12.407057 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5055321d-b1e1-4884-9948-1a102b6cedd7 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1327 microversion: 2.1 time: 0.538207 Oct 12 22:24:12.407874 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2425/5450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:11 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1327 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:12.428189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2afb54eb-0945-412f-8390-e158d70f0288 req-d44415d6-edd6-4d39-ac37-4a75ba636ba9 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:12.429878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2afb54eb-0945-412f-8390-e158d70f0288 req-d44415d6-edd6-4d39-ac37-4a75ba636ba9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:12.430884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2afb54eb-0945-412f-8390-e158d70f0288 req-d44415d6-edd6-4d39-ac37-4a75ba636ba9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:12.448823 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-2afb54eb-0945-412f-8390-e158d70f0288 req-d44415d6-edd6-4d39-ac37-4a75ba636ba9 service nova] Creating event network-vif-plugged:58ca8f5d-ed1b-4a4c-a321-e78bcd740887 for instance 920cabd1-b4b0-4043-a02f-c81488ffea83 on n-h1-861111-1 Oct 12 22:24:12.454077 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-2afb54eb-0945-412f-8390-e158d70f0288 req-d44415d6-edd6-4d39-ac37-4a75ba636ba9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054155 Oct 12 22:24:12.454971 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3026/5451] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:12.967211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-97164223-5663-4309-9dae-33d90168b110 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:12.967917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-97164223-5663-4309-9dae-33d90168b110 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:12.982554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97164223-5663-4309-9dae-33d90168b110 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:12.985136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97164223-5663-4309-9dae-33d90168b110 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:12.985841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97164223-5663-4309-9dae-33d90168b110 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:12.995823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97164223-5663-4309-9dae-33d90168b110 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:12.997814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97164223-5663-4309-9dae-33d90168b110 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:12.998517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97164223-5663-4309-9dae-33d90168b110 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:13.264429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-037d53ac-14d2-44d1-9c34-2879c24ee540 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:13.265770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-037d53ac-14d2-44d1-9c34-2879c24ee540 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:13.275023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-037d53ac-14d2-44d1-9c34-2879c24ee540 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:13.275965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-037d53ac-14d2-44d1-9c34-2879c24ee540 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:13.276839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-037d53ac-14d2-44d1-9c34-2879c24ee540 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:13.278444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-037d53ac-14d2-44d1-9c34-2879c24ee540 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:13.281053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-037d53ac-14d2-44d1-9c34-2879c24ee540 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:13.282490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-037d53ac-14d2-44d1-9c34-2879c24ee540 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:13.414327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-037d53ac-14d2-44d1-9c34-2879c24ee540 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:13.416763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:13.447834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-037d53ac-14d2-44d1-9c34-2879c24ee540 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:13.455532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-037d53ac-14d2-44d1-9c34-2879c24ee540 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:13.459887 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-037d53ac-14d2-44d1-9c34-2879c24ee540 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.199411 Oct 12 22:24:13.463773 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3027/5452] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:13 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:24:13.473835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-008cb1d3-eaa8-4c4f-b5dd-d6af9336986e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:13.476669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-008cb1d3-eaa8-4c4f-b5dd-d6af9336986e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:13.494249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-008cb1d3-eaa8-4c4f-b5dd-d6af9336986e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:13.495185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-008cb1d3-eaa8-4c4f-b5dd-d6af9336986e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:13.495871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-008cb1d3-eaa8-4c4f-b5dd-d6af9336986e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:13.497390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-008cb1d3-eaa8-4c4f-b5dd-d6af9336986e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:13.499511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-008cb1d3-eaa8-4c4f-b5dd-d6af9336986e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:13.502865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-008cb1d3-eaa8-4c4f-b5dd-d6af9336986e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:13.627924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-008cb1d3-eaa8-4c4f-b5dd-d6af9336986e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:13.636996 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-008cb1d3-eaa8-4c4f-b5dd-d6af9336986e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1268 microversion: 2.1 time: 0.171812 Oct 12 22:24:13.648789 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3028/5453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:13 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:13.653876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f93f4ecd-80b2-421b-beeb-cd25b76fef7a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:13.654708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f93f4ecd-80b2-421b-beeb-cd25b76fef7a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:13.668714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f93f4ecd-80b2-421b-beeb-cd25b76fef7a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:13.669502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f93f4ecd-80b2-421b-beeb-cd25b76fef7a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:13.670139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f93f4ecd-80b2-421b-beeb-cd25b76fef7a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:13.671052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f93f4ecd-80b2-421b-beeb-cd25b76fef7a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:13.671722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f93f4ecd-80b2-421b-beeb-cd25b76fef7a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:13.672320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f93f4ecd-80b2-421b-beeb-cd25b76fef7a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:13.974554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f93f4ecd-80b2-421b-beeb-cd25b76fef7a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:13.989956 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f93f4ecd-80b2-421b-beeb-cd25b76fef7a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1327 microversion: 2.1 time: 0.339754 Oct 12 22:24:13.991601 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3029/5454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:13 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1327 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:14.296429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-97164223-5663-4309-9dae-33d90168b110 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:14.313049 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-97164223-5663-4309-9dae-33d90168b110 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1689 microversion: 2.1 time: 1.350408 Oct 12 22:24:14.317569 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2426/5455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:12 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1689 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:14.495040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f9fd8f28-06a0-4771-ad3c-1bc8dec4f0fc tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:14.495705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f9fd8f28-06a0-4771-ad3c-1bc8dec4f0fc tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:14.506099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9fd8f28-06a0-4771-ad3c-1bc8dec4f0fc tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:14.507644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9fd8f28-06a0-4771-ad3c-1bc8dec4f0fc tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:14.508303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9fd8f28-06a0-4771-ad3c-1bc8dec4f0fc tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:14.509017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9fd8f28-06a0-4771-ad3c-1bc8dec4f0fc tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:14.509939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9fd8f28-06a0-4771-ad3c-1bc8dec4f0fc tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:14.510369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f9fd8f28-06a0-4771-ad3c-1bc8dec4f0fc tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:14.629236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f9fd8f28-06a0-4771-ad3c-1bc8dec4f0fc tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:14.638382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f9fd8f28-06a0-4771-ad3c-1bc8dec4f0fc tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:14.640091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f9fd8f28-06a0-4771-ad3c-1bc8dec4f0fc tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:14.641653 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f9fd8f28-06a0-4771-ad3c-1bc8dec4f0fc tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.154314 Oct 12 22:24:14.655963 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3030/5456] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:14 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:24:14.673278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a5ce8f01-ef79-41e7-9145-3ba762481e53 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:14.675408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a5ce8f01-ef79-41e7-9145-3ba762481e53 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:14.688651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ce8f01-ef79-41e7-9145-3ba762481e53 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:14.689165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ce8f01-ef79-41e7-9145-3ba762481e53 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:14.689979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ce8f01-ef79-41e7-9145-3ba762481e53 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:14.690722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ce8f01-ef79-41e7-9145-3ba762481e53 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:14.691461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ce8f01-ef79-41e7-9145-3ba762481e53 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:14.691908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ce8f01-ef79-41e7-9145-3ba762481e53 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:14.700135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:14.905630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a5ce8f01-ef79-41e7-9145-3ba762481e53 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:14.919773 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a5ce8f01-ef79-41e7-9145-3ba762481e53 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1266 microversion: 2.1 time: 0.250074 Oct 12 22:24:14.921073 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2427/5457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:14 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:15.013460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-70aefc86-0c1e-4e59-a1db-b67807aefeb8 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:15.014529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-70aefc86-0c1e-4e59-a1db-b67807aefeb8 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:15.021112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70aefc86-0c1e-4e59-a1db-b67807aefeb8 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:15.021602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70aefc86-0c1e-4e59-a1db-b67807aefeb8 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:15.022070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70aefc86-0c1e-4e59-a1db-b67807aefeb8 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:15.022776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70aefc86-0c1e-4e59-a1db-b67807aefeb8 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:15.023268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70aefc86-0c1e-4e59-a1db-b67807aefeb8 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:15.023706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-70aefc86-0c1e-4e59-a1db-b67807aefeb8 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:15.296470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-70aefc86-0c1e-4e59-a1db-b67807aefeb8 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:15.310519 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-70aefc86-0c1e-4e59-a1db-b67807aefeb8 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1327 microversion: 2.1 time: 0.301234 Oct 12 22:24:15.311130 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3031/5458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:15 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1327 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:15.347883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8824e33d-ec3a-4b76-b668-e34f65d9bdbd tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:15.348604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8824e33d-ec3a-4b76-b668-e34f65d9bdbd tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:15.359356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8824e33d-ec3a-4b76-b668-e34f65d9bdbd tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:15.359939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8824e33d-ec3a-4b76-b668-e34f65d9bdbd tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:15.360323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8824e33d-ec3a-4b76-b668-e34f65d9bdbd tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:15.361021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8824e33d-ec3a-4b76-b668-e34f65d9bdbd tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:15.361467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8824e33d-ec3a-4b76-b668-e34f65d9bdbd tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:15.361894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8824e33d-ec3a-4b76-b668-e34f65d9bdbd tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:15.669537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-452bd5a7-4696-4bd4-b943-51d34891a413 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:15.670851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-452bd5a7-4696-4bd4-b943-51d34891a413 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:15.684863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-452bd5a7-4696-4bd4-b943-51d34891a413 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:15.687809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-452bd5a7-4696-4bd4-b943-51d34891a413 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:15.688500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-452bd5a7-4696-4bd4-b943-51d34891a413 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:15.689231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-452bd5a7-4696-4bd4-b943-51d34891a413 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:15.689687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-452bd5a7-4696-4bd4-b943-51d34891a413 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:15.690115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-452bd5a7-4696-4bd4-b943-51d34891a413 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:16.036469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8824e33d-ec3a-4b76-b668-e34f65d9bdbd tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:16.051173 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8824e33d-ec3a-4b76-b668-e34f65d9bdbd tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1689 microversion: 2.1 time: 0.712024 Oct 12 22:24:16.078983 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2428/5459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:15 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1689 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:16.085137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-885d041a-eaf1-4eb9-a8b7-a778bf566047 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:16.098775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-885d041a-eaf1-4eb9-a8b7-a778bf566047 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:16.118284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-885d041a-eaf1-4eb9-a8b7-a778bf566047 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:16.120561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-885d041a-eaf1-4eb9-a8b7-a778bf566047 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:16.121012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-885d041a-eaf1-4eb9-a8b7-a778bf566047 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:16.123380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-885d041a-eaf1-4eb9-a8b7-a778bf566047 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:16.126940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-885d041a-eaf1-4eb9-a8b7-a778bf566047 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:16.128055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-885d041a-eaf1-4eb9-a8b7-a778bf566047 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:16.224109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-452bd5a7-4696-4bd4-b943-51d34891a413 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:16.237372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-452bd5a7-4696-4bd4-b943-51d34891a413 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:16.240013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-452bd5a7-4696-4bd4-b943-51d34891a413 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:16.241553 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-452bd5a7-4696-4bd4-b943-51d34891a413 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.576921 Oct 12 22:24:16.242704 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3032/5460] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:15 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:24:16.337156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3a718d4c-0116-4fa9-ac0b-6c3da54fbd25 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:16.337865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3a718d4c-0116-4fa9-ac0b-6c3da54fbd25 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:16.354555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a718d4c-0116-4fa9-ac0b-6c3da54fbd25 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:16.355074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a718d4c-0116-4fa9-ac0b-6c3da54fbd25 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:16.355540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a718d4c-0116-4fa9-ac0b-6c3da54fbd25 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:16.358852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a718d4c-0116-4fa9-ac0b-6c3da54fbd25 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:16.359203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-885d041a-eaf1-4eb9-a8b7-a778bf566047 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:16.359711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a718d4c-0116-4fa9-ac0b-6c3da54fbd25 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:16.359813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a718d4c-0116-4fa9-ac0b-6c3da54fbd25 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:16.372756 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-885d041a-eaf1-4eb9-a8b7-a778bf566047 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1266 microversion: 2.1 time: 0.291986 Oct 12 22:24:16.373715 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2429/5461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:16 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:16.707689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3a718d4c-0116-4fa9-ac0b-6c3da54fbd25 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:16.722032 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3a718d4c-0116-4fa9-ac0b-6c3da54fbd25 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1528 microversion: 2.1 time: 0.390049 Oct 12 22:24:16.723203 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3033/5462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:16 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1528 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:16.750508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4b23cc6b-32f9-4774-b2db-2092c14a6ac5 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:16.751585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4b23cc6b-32f9-4774-b2db-2092c14a6ac5 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:16.779750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b23cc6b-32f9-4774-b2db-2092c14a6ac5 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:16.780445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b23cc6b-32f9-4774-b2db-2092c14a6ac5 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:16.781773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b23cc6b-32f9-4774-b2db-2092c14a6ac5 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:16.782949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b23cc6b-32f9-4774-b2db-2092c14a6ac5 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:16.783698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b23cc6b-32f9-4774-b2db-2092c14a6ac5 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:16.785707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b23cc6b-32f9-4774-b2db-2092c14a6ac5 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:17.082254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aba78674-5a36-4181-b271-b4ebec32e801 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:17.083899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aba78674-5a36-4181-b271-b4ebec32e801 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:17.086268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:17.093884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aba78674-5a36-4181-b271-b4ebec32e801 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:17.104216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aba78674-5a36-4181-b271-b4ebec32e801 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:17.105004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aba78674-5a36-4181-b271-b4ebec32e801 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:17.106098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aba78674-5a36-4181-b271-b4ebec32e801 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:17.107057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aba78674-5a36-4181-b271-b4ebec32e801 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:17.107755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aba78674-5a36-4181-b271-b4ebec32e801 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:17.218474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aba78674-5a36-4181-b271-b4ebec32e801 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:17.226869 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aba78674-5a36-4181-b271-b4ebec32e801 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1621 microversion: 2.1 time: 0.148775 Oct 12 22:24:17.232009 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3034/5463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:17 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1621 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:17.273451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3980a8ae-e29c-480a-907f-579f291e4116 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:17.274919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3980a8ae-e29c-480a-907f-579f291e4116 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:17.285780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3980a8ae-e29c-480a-907f-579f291e4116 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:17.292016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3980a8ae-e29c-480a-907f-579f291e4116 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:17.293018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3980a8ae-e29c-480a-907f-579f291e4116 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:17.293774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3980a8ae-e29c-480a-907f-579f291e4116 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:17.294233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3980a8ae-e29c-480a-907f-579f291e4116 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:17.294661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3980a8ae-e29c-480a-907f-579f291e4116 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:17.440671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3980a8ae-e29c-480a-907f-579f291e4116 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:17.449589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3980a8ae-e29c-480a-907f-579f291e4116 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:17.451051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3980a8ae-e29c-480a-907f-579f291e4116 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:17.452291 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3980a8ae-e29c-480a-907f-579f291e4116 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.187993 Oct 12 22:24:17.452859 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3035/5464] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:17 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:24:17.464918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cf4784b4-b341-4156-bd63-834012c2278a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:17.476163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cf4784b4-b341-4156-bd63-834012c2278a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:17.482990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf4784b4-b341-4156-bd63-834012c2278a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:17.488112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf4784b4-b341-4156-bd63-834012c2278a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:17.488566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf4784b4-b341-4156-bd63-834012c2278a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:17.489302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf4784b4-b341-4156-bd63-834012c2278a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:17.490564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf4784b4-b341-4156-bd63-834012c2278a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:17.491706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf4784b4-b341-4156-bd63-834012c2278a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:17.661512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4b23cc6b-32f9-4774-b2db-2092c14a6ac5 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:17.675823 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4b23cc6b-32f9-4774-b2db-2092c14a6ac5 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1528 microversion: 2.1 time: 0.928982 Oct 12 22:24:17.676432 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2430/5465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:16 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1528 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:17.994227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cf4784b4-b341-4156-bd63-834012c2278a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:18.002811 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cf4784b4-b341-4156-bd63-834012c2278a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1308 microversion: 2.1 time: 0.541602 Oct 12 22:24:18.011519 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3036/5466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:17 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1308 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:18.103109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c45dd59f-8e0c-4253-8d9a-9f093dc5c2f2 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:18.103670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c45dd59f-8e0c-4253-8d9a-9f093dc5c2f2 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:18.110767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c45dd59f-8e0c-4253-8d9a-9f093dc5c2f2 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:18.111493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c45dd59f-8e0c-4253-8d9a-9f093dc5c2f2 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:18.112353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c45dd59f-8e0c-4253-8d9a-9f093dc5c2f2 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:18.113409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c45dd59f-8e0c-4253-8d9a-9f093dc5c2f2 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:18.114236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c45dd59f-8e0c-4253-8d9a-9f093dc5c2f2 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:18.115002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c45dd59f-8e0c-4253-8d9a-9f093dc5c2f2 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:18.136655 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-c45dd59f-8e0c-4253-8d9a-9f093dc5c2f2 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] HTTP exception thrown: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c45dd59f-8e0c-4253-8d9a-9f093dc5c2f2 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Request method failure captured: Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 HTTP/1.1 Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz55ppN_dSeux9tTYXNlnXlk0Sxy0ffzlPMIaP6HV7gdLuwRvgFXJ7O5ruZGdhmKFAJfqLixJUVzo6BQC4TjZrADqGmve_-coWyJ8DAqTjcuQi9QkWjLhiLiaA1RWQ7tNQTEcqla0Hwpg-KVfAoNas8cHdXQcVUodATGFsSLVIFQr_Y Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 720abadb1e714a9fab52bf89af282a4c Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1841363656 Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/720abadb1e714a9fab52bf89af282a4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/720abadb1e714a9fab52bf89af282a4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_720abadb1e714a9fab52bf89af282a4c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/720abadb1e714a9fab52bf89af282a4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1841363656 Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 720abadb1e714a9fab52bf89af282a4c Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1841363656 Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1841363656-project Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: b7f073c6bbff44709fdf410024d13f5c Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1841363656-project Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '920cabd1-b4b0-4043-a02f-c81488ffea83'} Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:24:18.138982 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:24:18.145759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. Oct 12 22:24:18.145759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:18.145759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:18.145759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:18.145759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:18.145759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:18.145759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:18.145759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:24:18.145759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:24:18.145759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. Oct 12 22:24:18.145759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:18.149287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c45dd59f-8e0c-4253-8d9a-9f093dc5c2f2 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Returning 404 to user: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:24:18.150406 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c45dd59f-8e0c-4253-8d9a-9f093dc5c2f2 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] 10.222.0.16 "DELETE /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 404 len: 111 microversion: 2.1 time: 0.453973 Oct 12 22:24:18.151661 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2431/5467] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:24:17 2022] DELETE /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 111 bytes in 456 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:24:18.160924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-231e0e4e-8b2f-46f2-80b8-242931099902 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:18.161951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-231e0e4e-8b2f-46f2-80b8-242931099902 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:18.170773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-231e0e4e-8b2f-46f2-80b8-242931099902 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:18.173805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-231e0e4e-8b2f-46f2-80b8-242931099902 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:18.179129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-231e0e4e-8b2f-46f2-80b8-242931099902 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:18.180916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-231e0e4e-8b2f-46f2-80b8-242931099902 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:18.181628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-231e0e4e-8b2f-46f2-80b8-242931099902 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:18.182304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-231e0e4e-8b2f-46f2-80b8-242931099902 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:18.183003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:18.259147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-35f1e271-aad4-4e5a-8db1-d6e7411ecc96 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:18.260126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-35f1e271-aad4-4e5a-8db1-d6e7411ecc96 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:18.270356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35f1e271-aad4-4e5a-8db1-d6e7411ecc96 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:18.271277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35f1e271-aad4-4e5a-8db1-d6e7411ecc96 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:18.272505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35f1e271-aad4-4e5a-8db1-d6e7411ecc96 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:18.274009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35f1e271-aad4-4e5a-8db1-d6e7411ecc96 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:18.274696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35f1e271-aad4-4e5a-8db1-d6e7411ecc96 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:18.275581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35f1e271-aad4-4e5a-8db1-d6e7411ecc96 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:18.423363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-35f1e271-aad4-4e5a-8db1-d6e7411ecc96 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:18.448882 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-35f1e271-aad4-4e5a-8db1-d6e7411ecc96 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 200 len: 1621 microversion: 2.1 time: 0.189735 Oct 12 22:24:18.454458 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2432/5468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:18 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 1621 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:18.465032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=8 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:18.480667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-f654ffaf-940f-49ff-8dce-1d8ea224fa53 req-82263cf4-01a6-48a3-85af-91618c825990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f2400d-a508-4bfc-b84f-bc80a4c28fec", "name": "network-vif-deleted", "tag": "79f72797-4736-4c93-86f4-3bf45c9f94fd"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:18.512400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f654ffaf-940f-49ff-8dce-1d8ea224fa53 req-82263cf4-01a6-48a3-85af-91618c825990 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:18.515569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f654ffaf-940f-49ff-8dce-1d8ea224fa53 req-82263cf4-01a6-48a3-85af-91618c825990 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:18.516873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f654ffaf-940f-49ff-8dce-1d8ea224fa53 req-82263cf4-01a6-48a3-85af-91618c825990 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:18.556276 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-f654ffaf-940f-49ff-8dce-1d8ea224fa53 req-82263cf4-01a6-48a3-85af-91618c825990 service nova] Creating event network-vif-deleted:79f72797-4736-4c93-86f4-3bf45c9f94fd for instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec on n-h1-861111-1 Oct 12 22:24:18.574088 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-f654ffaf-940f-49ff-8dce-1d8ea224fa53 req-82263cf4-01a6-48a3-85af-91618c825990 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115163 Oct 12 22:24:18.575432 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2433/5469] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:18.583224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-145e8120-755e-420a-8825-16d87a9266a6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:18.585214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-145e8120-755e-420a-8825-16d87a9266a6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:18.610571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-145e8120-755e-420a-8825-16d87a9266a6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:18.611778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-145e8120-755e-420a-8825-16d87a9266a6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:18.612661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-145e8120-755e-420a-8825-16d87a9266a6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:18.614044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-145e8120-755e-420a-8825-16d87a9266a6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:18.615317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-145e8120-755e-420a-8825-16d87a9266a6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:18.616472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-145e8120-755e-420a-8825-16d87a9266a6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:18.839598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-145e8120-755e-420a-8825-16d87a9266a6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:18.849583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-145e8120-755e-420a-8825-16d87a9266a6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:18.852296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-145e8120-755e-420a-8825-16d87a9266a6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:18.854456 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-145e8120-755e-420a-8825-16d87a9266a6 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1366 microversion: 2.57 time: 0.277395 Oct 12 22:24:18.856156 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2434/5470] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:18 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:24:19.040503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-64e97c67-c400-4ac3-8d34-fc4c375f9625 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:19.042775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-64e97c67-c400-4ac3-8d34-fc4c375f9625 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:19.059406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64e97c67-c400-4ac3-8d34-fc4c375f9625 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:19.061663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64e97c67-c400-4ac3-8d34-fc4c375f9625 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:19.063023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64e97c67-c400-4ac3-8d34-fc4c375f9625 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:19.072189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64e97c67-c400-4ac3-8d34-fc4c375f9625 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:19.074477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64e97c67-c400-4ac3-8d34-fc4c375f9625 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:19.076413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64e97c67-c400-4ac3-8d34-fc4c375f9625 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:19.093732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-231e0e4e-8b2f-46f2-80b8-242931099902 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:19.176852 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-231e0e4e-8b2f-46f2-80b8-242931099902 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1528 microversion: 2.1 time: 1.009024 Oct 12 22:24:19.181026 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3037/5471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:18 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1528 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:19.212666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c9a7527b-8f39-44d9-8558-d4407e637ea1 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Action: 'update', calling method: >, body: {"server": {"name": "920cabd1-b4b0-4043-a02f-c81488ffea83_new"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:19.216819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c9a7527b-8f39-44d9-8558-d4407e637ea1 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:19.227080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9a7527b-8f39-44d9-8558-d4407e637ea1 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:19.228858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9a7527b-8f39-44d9-8558-d4407e637ea1 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:19.229632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9a7527b-8f39-44d9-8558-d4407e637ea1 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:19.231773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9a7527b-8f39-44d9-8558-d4407e637ea1 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:19.234405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9a7527b-8f39-44d9-8558-d4407e637ea1 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:19.239992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9a7527b-8f39-44d9-8558-d4407e637ea1 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:19.270945 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-c9a7527b-8f39-44d9-8558-d4407e637ea1 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] HTTP exception thrown: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c9a7527b-8f39-44d9-8558-d4407e637ea1 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Request method failure captured: Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: request: PUT /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 HTTP/1.1 Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 64 Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz55ppN_dSeux9tTYXNlnXlk0Sxy0ffzlPMIaP6HV7gdLuwRvgFXJ7O5ruZGdhmKFAJfqLixJUVzo6BQC4TjZrADqGmve_-coWyJ8DAqTjcuQi9QkWjLhiLiaA1RWQ7tNQTEcqla0Hwpg-KVfAoNas8cHdXQcVUodATGFsSLVIFQr_Y Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 720abadb1e714a9fab52bf89af282a4c Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1841363656 Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/720abadb1e714a9fab52bf89af282a4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/720abadb1e714a9fab52bf89af282a4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_720abadb1e714a9fab52bf89af282a4c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/720abadb1e714a9fab52bf89af282a4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1841363656 Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 720abadb1e714a9fab52bf89af282a4c Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1841363656 Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1841363656-project Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: b7f073c6bbff44709fdf410024d13f5c Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1841363656-project Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: {"server": {"name": "920cabd1-b4b0-4043-a02f-c81488ffea83_new"}} Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '920cabd1-b4b0-4043-a02f-c81488ffea83', 'body': {'server': {'name': '920cabd1-b4b0-4043-a02f-c81488ffea83_new'}}} Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:24:19.276172 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 22:24:19.281598 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 12 22:24:19.281598 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 12 22:24:19.281598 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:24:19.281598 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:24:19.281598 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:24:19.281598 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:24:19.281598 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. Oct 12 22:24:19.281598 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:19.281598 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:19.281598 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:19.281598 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:19.281598 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:19.281598 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:19.281598 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:24:19.281598 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:24:19.281598 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. Oct 12 22:24:19.281598 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:19.284083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c9a7527b-8f39-44d9-8558-d4407e637ea1 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] Returning 404 to user: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:24:19.285528 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c9a7527b-8f39-44d9-8558-d4407e637ea1 tempest-ServersNegativeTestMultiTenantJSON-1841363656 tempest-ServersNegativeTestMultiTenantJSON-1841363656-project] 10.222.0.16 "PUT /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 404 len: 111 microversion: 2.1 time: 0.084473 Oct 12 22:24:19.286655 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3038/5472] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 12 22:24:19 2022] PUT /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:24:19.297590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4b0da68a-0628-4d66-839a-491268ae4196 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:19.298735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4b0da68a-0628-4d66-839a-491268ae4196 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:19.305678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b0da68a-0628-4d66-839a-491268ae4196 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:19.306490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b0da68a-0628-4d66-839a-491268ae4196 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:19.307138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b0da68a-0628-4d66-839a-491268ae4196 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:19.308118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b0da68a-0628-4d66-839a-491268ae4196 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:19.308841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b0da68a-0628-4d66-839a-491268ae4196 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:19.309474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b0da68a-0628-4d66-839a-491268ae4196 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:19.363173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4b0da68a-0628-4d66-839a-491268ae4196 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:24:19.512219 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4b0da68a-0628-4d66-839a-491268ae4196 tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "DELETE /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 204 len: 0 microversion: 2.1 time: 0.217728 Oct 12 22:24:19.523565 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3039/5473] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:24:19 2022] DELETE /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:24:19.529856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-892f5df2-132d-4070-95f9-144a4cfc56ab tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:19.530842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-892f5df2-132d-4070-95f9-144a4cfc56ab tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: d4f2400d-a508-4bfc-b84f-bc80a4c28fec] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:19.552725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-892f5df2-132d-4070-95f9-144a4cfc56ab tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:19.553317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-892f5df2-132d-4070-95f9-144a4cfc56ab tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:19.553986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-892f5df2-132d-4070-95f9-144a4cfc56ab tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:19.555002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-892f5df2-132d-4070-95f9-144a4cfc56ab tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:19.557987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-892f5df2-132d-4070-95f9-144a4cfc56ab tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:19.559184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-892f5df2-132d-4070-95f9-144a4cfc56ab tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:19.590326 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-892f5df2-132d-4070-95f9-144a4cfc56ab tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] HTTP exception thrown: Instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec could not be found. Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-892f5df2-132d-4070-95f9-144a4cfc56ab tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Request method failure captured: Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec HTTP/1.1 Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz1yYv3BEuyn16aX9rFnQkuXp35mHqXE7bVOWKfvxNZXNT7qw6co-FDMauTgJfMPQCxmiEKAu0kzyjnis87qTpfUYp96yN_F6sfmIZnSLJLUbYy9WREcLUGhzXNPjj1UORIJx3lHLMBoOzDKf1JzqCDKyG4PBpXcEQzC9GdyMUjXkpQ Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0a0c4d9f435a4c009bd0b5eb2618829b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: afec4a3808b84463900b744ecd9352b6 Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec could not be found. Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'd4f2400d-a508-4bfc-b84f-bc80a4c28fec'} Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec could not be found. Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec could not be found. Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:19.592077 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:19.597374 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:19.597374 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:19.597374 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:19.597374 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:19.597374 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:24:19.597374 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:24:19.597374 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec could not be found. Oct 12 22:24:19.597374 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:19.597374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-892f5df2-132d-4070-95f9-144a4cfc56ab tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Returning 404 to user: Instance d4f2400d-a508-4bfc-b84f-bc80a4c28fec could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:24:19.597374 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-892f5df2-132d-4070-95f9-144a4cfc56ab tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec" status: 404 len: 111 microversion: 2.1 time: 0.071862 Oct 12 22:24:19.599411 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3040/5474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:19 2022] GET /compute/v2.1/servers/d4f2400d-a508-4bfc-b84f-bc80a4c28fec => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:24:19.608837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5b5b073f-19d4-44a9-9c12-cbdafa3cfb4a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:19.609468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5b5b073f-19d4-44a9-9c12-cbdafa3cfb4a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:19.627437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5b073f-19d4-44a9-9c12-cbdafa3cfb4a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:19.628002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5b073f-19d4-44a9-9c12-cbdafa3cfb4a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:19.628449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5b073f-19d4-44a9-9c12-cbdafa3cfb4a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:19.629184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5b073f-19d4-44a9-9c12-cbdafa3cfb4a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:19.630744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5b073f-19d4-44a9-9c12-cbdafa3cfb4a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:19.631912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5b073f-19d4-44a9-9c12-cbdafa3cfb4a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:19.873028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-64e97c67-c400-4ac3-8d34-fc4c375f9625 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:19.895072 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-64e97c67-c400-4ac3-8d34-fc4c375f9625 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1308 microversion: 2.1 time: 0.865395 Oct 12 22:24:19.899299 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2435/5475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:19 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1308 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:19.913776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0ea899ef-8343-4d0f-867d-2af9961f8cf9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '.version_select at 0x7f512c3bcdc0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:19.942879 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0ea899ef-8343-4d0f-867d-2af9961f8cf9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-655754919" status: 202 len: 0 microversion: 2.1 time: 0.041525 Oct 12 22:24:19.945028 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2436/5476] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 12 22:24:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-655754919 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:24:19.952865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7589e662-109c-4d7d-a5c7-4a836426f7fd tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:19.954122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7589e662-109c-4d7d-a5c7-4a836426f7fd tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:19.963557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7589e662-109c-4d7d-a5c7-4a836426f7fd tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:19.964411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7589e662-109c-4d7d-a5c7-4a836426f7fd tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:19.965608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7589e662-109c-4d7d-a5c7-4a836426f7fd tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:19.966642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7589e662-109c-4d7d-a5c7-4a836426f7fd tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:19.967447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7589e662-109c-4d7d-a5c7-4a836426f7fd tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:19.968878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7589e662-109c-4d7d-a5c7-4a836426f7fd tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:20.117699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5b5b073f-19d4-44a9-9c12-cbdafa3cfb4a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:20.129988 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5b5b073f-19d4-44a9-9c12-cbdafa3cfb4a tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1534 microversion: 2.1 time: 0.527484 Oct 12 22:24:20.132498 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3041/5477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:19 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1534 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:20.164873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7589e662-109c-4d7d-a5c7-4a836426f7fd tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:20.177492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7589e662-109c-4d7d-a5c7-4a836426f7fd tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:20.182297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7589e662-109c-4d7d-a5c7-4a836426f7fd tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:20.184446 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7589e662-109c-4d7d-a5c7-4a836426f7fd tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1372 microversion: 2.57 time: 0.237197 Oct 12 22:24:20.185477 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2437/5478] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:19 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1372 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:24:20.724172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-03417ee3-9b1f-4706-92c5-6415cca36c04 req-6ab87466-fd90-44c3-9420-44ed3df6bef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84af030c-67a9-47bb-826e-b414ea7857b5", "tag": "f510efd3-db76-43e0-a733-fec32383c0b9"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:20.742590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-03417ee3-9b1f-4706-92c5-6415cca36c04 req-6ab87466-fd90-44c3-9420-44ed3df6bef9 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:20.743312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-03417ee3-9b1f-4706-92c5-6415cca36c04 req-6ab87466-fd90-44c3-9420-44ed3df6bef9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:20.744116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-03417ee3-9b1f-4706-92c5-6415cca36c04 req-6ab87466-fd90-44c3-9420-44ed3df6bef9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:20.789282 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-03417ee3-9b1f-4706-92c5-6415cca36c04 req-6ab87466-fd90-44c3-9420-44ed3df6bef9 service nova] Creating event network-changed:f510efd3-db76-43e0-a733-fec32383c0b9 for instance 84af030c-67a9-47bb-826e-b414ea7857b5 on n-h1-861111-1 Oct 12 22:24:20.795622 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-03417ee3-9b1f-4706-92c5-6415cca36c04 req-6ab87466-fd90-44c3-9420-44ed3df6bef9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075846 Oct 12 22:24:20.796224 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3042/5479] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:20.920536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dc1a0913-c364-45f4-874a-dfb49887cf80 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:20.921692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dc1a0913-c364-45f4-874a-dfb49887cf80 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:20.932083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc1a0913-c364-45f4-874a-dfb49887cf80 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:20.932773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc1a0913-c364-45f4-874a-dfb49887cf80 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:20.933406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc1a0913-c364-45f4-874a-dfb49887cf80 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:20.934107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc1a0913-c364-45f4-874a-dfb49887cf80 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:20.934558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc1a0913-c364-45f4-874a-dfb49887cf80 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:20.934976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc1a0913-c364-45f4-874a-dfb49887cf80 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:21.157162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a4b32ed6-89f9-486d-bd4c-9ceed6ab707f tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:21.159255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a4b32ed6-89f9-486d-bd4c-9ceed6ab707f tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:21.174730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4b32ed6-89f9-486d-bd4c-9ceed6ab707f tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:21.175718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4b32ed6-89f9-486d-bd4c-9ceed6ab707f tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:21.176895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4b32ed6-89f9-486d-bd4c-9ceed6ab707f tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:21.178096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4b32ed6-89f9-486d-bd4c-9ceed6ab707f tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:21.178989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4b32ed6-89f9-486d-bd4c-9ceed6ab707f tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:21.179883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4b32ed6-89f9-486d-bd4c-9ceed6ab707f tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:21.657940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a4b32ed6-89f9-486d-bd4c-9ceed6ab707f tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:21.675647 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a4b32ed6-89f9-486d-bd4c-9ceed6ab707f tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1534 microversion: 2.1 time: 0.524790 Oct 12 22:24:21.684321 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3043/5480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:21 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1534 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:24:21.704948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5a3e942a-4aa5-4353-82ec-456295a727ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:21.706132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5a3e942a-4aa5-4353-82ec-456295a727ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:21.715925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a3e942a-4aa5-4353-82ec-456295a727ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:21.716865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a3e942a-4aa5-4353-82ec-456295a727ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:21.717604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a3e942a-4aa5-4353-82ec-456295a727ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:21.719609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a3e942a-4aa5-4353-82ec-456295a727ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:21.721399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a3e942a-4aa5-4353-82ec-456295a727ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:21.723621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a3e942a-4aa5-4353-82ec-456295a727ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:21.870608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5a3e942a-4aa5-4353-82ec-456295a727ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:21.872928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:21.883461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5a3e942a-4aa5-4353-82ec-456295a727ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:21.885059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5a3e942a-4aa5-4353-82ec-456295a727ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:21.886377 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5a3e942a-4aa5-4353-82ec-456295a727ea tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1372 microversion: 2.57 time: 0.200753 Oct 12 22:24:21.887391 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3044/5481] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:21 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:24:22.001724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dc1a0913-c364-45f4-874a-dfb49887cf80 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:22.038919 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dc1a0913-c364-45f4-874a-dfb49887cf80 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1308 microversion: 2.1 time: 1.122070 Oct 12 22:24:22.040278 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2438/5482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:20 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1308 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:22.710931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-33a4f8e2-9ddd-4e8e-a213-47c94cdf509e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:22.711881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-33a4f8e2-9ddd-4e8e-a213-47c94cdf509e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:22.729606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33a4f8e2-9ddd-4e8e-a213-47c94cdf509e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:22.730774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33a4f8e2-9ddd-4e8e-a213-47c94cdf509e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:22.731561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33a4f8e2-9ddd-4e8e-a213-47c94cdf509e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:22.732631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33a4f8e2-9ddd-4e8e-a213-47c94cdf509e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:22.733298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33a4f8e2-9ddd-4e8e-a213-47c94cdf509e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:22.734453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33a4f8e2-9ddd-4e8e-a213-47c94cdf509e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:22.932209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-414fb19c-089e-452f-8df3-d13081f66b6b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:22.933070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-414fb19c-089e-452f-8df3-d13081f66b6b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:22.951342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-414fb19c-089e-452f-8df3-d13081f66b6b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:22.954312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-414fb19c-089e-452f-8df3-d13081f66b6b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:22.954908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-414fb19c-089e-452f-8df3-d13081f66b6b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:22.958219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-414fb19c-089e-452f-8df3-d13081f66b6b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:22.958872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-414fb19c-089e-452f-8df3-d13081f66b6b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:22.960367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-414fb19c-089e-452f-8df3-d13081f66b6b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:23.096253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-33a4f8e2-9ddd-4e8e-a213-47c94cdf509e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:23.108683 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-33a4f8e2-9ddd-4e8e-a213-47c94cdf509e tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1534 microversion: 2.1 time: 0.406296 Oct 12 22:24:23.111563 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3045/5483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:22 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1534 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:23.125204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1b49f9d0-e0e9-4481-90f0-708f3e8bd418 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:23.127141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1b49f9d0-e0e9-4481-90f0-708f3e8bd418 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:23.152104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b49f9d0-e0e9-4481-90f0-708f3e8bd418 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:23.152966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b49f9d0-e0e9-4481-90f0-708f3e8bd418 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:23.155537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b49f9d0-e0e9-4481-90f0-708f3e8bd418 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:23.159420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b49f9d0-e0e9-4481-90f0-708f3e8bd418 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:23.160017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b49f9d0-e0e9-4481-90f0-708f3e8bd418 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:23.160565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1b49f9d0-e0e9-4481-90f0-708f3e8bd418 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:23.190236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-414fb19c-089e-452f-8df3-d13081f66b6b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:23.209817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-414fb19c-089e-452f-8df3-d13081f66b6b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:23.214283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-414fb19c-089e-452f-8df3-d13081f66b6b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:23.218428 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-414fb19c-089e-452f-8df3-d13081f66b6b tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1372 microversion: 2.57 time: 0.307540 Oct 12 22:24:23.220328 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2439/5484] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:22 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1372 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:24:23.577506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-40b37444-088d-40d5-a957-b1a332162675 req-272679dd-f718-49a7-96e5-a3335e1b3164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "920cabd1-b4b0-4043-a02f-c81488ffea83", "name": "network-vif-deleted", "tag": "58ca8f5d-ed1b-4a4c-a321-e78bcd740887"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:23.597071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-40b37444-088d-40d5-a957-b1a332162675 req-272679dd-f718-49a7-96e5-a3335e1b3164 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:23.597561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-40b37444-088d-40d5-a957-b1a332162675 req-272679dd-f718-49a7-96e5-a3335e1b3164 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:23.598002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-40b37444-088d-40d5-a957-b1a332162675 req-272679dd-f718-49a7-96e5-a3335e1b3164 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:23.644947 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-40b37444-088d-40d5-a957-b1a332162675 req-272679dd-f718-49a7-96e5-a3335e1b3164 service nova] Creating event network-vif-deleted:58ca8f5d-ed1b-4a4c-a321-e78bcd740887 for instance 920cabd1-b4b0-4043-a02f-c81488ffea83 on n-h1-861111-1 Oct 12 22:24:23.655755 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-40b37444-088d-40d5-a957-b1a332162675 req-272679dd-f718-49a7-96e5-a3335e1b3164 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081957 Oct 12 22:24:23.659469 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2440/5485] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:24:23.677877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1b49f9d0-e0e9-4481-90f0-708f3e8bd418 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:23.698018 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1b49f9d0-e0e9-4481-90f0-708f3e8bd418 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1308 microversion: 2.1 time: 0.583742 Oct 12 22:24:23.700418 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3046/5486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:23 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1308 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:24.137941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e4356396-6250-4192-8835-6994f1e3828c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:24.138923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e4356396-6250-4192-8835-6994f1e3828c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:24.152268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4356396-6250-4192-8835-6994f1e3828c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:24.152772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4356396-6250-4192-8835-6994f1e3828c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:24.153210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4356396-6250-4192-8835-6994f1e3828c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:24.153925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4356396-6250-4192-8835-6994f1e3828c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:24.157501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4356396-6250-4192-8835-6994f1e3828c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:24.159335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4356396-6250-4192-8835-6994f1e3828c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:24.247062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2d4e0f3d-ecd9-40fb-9eed-f9c852e1c066 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:24.248589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2d4e0f3d-ecd9-40fb-9eed-f9c852e1c066 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:24.260359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d4e0f3d-ecd9-40fb-9eed-f9c852e1c066 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:24.264255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d4e0f3d-ecd9-40fb-9eed-f9c852e1c066 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:24.265036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d4e0f3d-ecd9-40fb-9eed-f9c852e1c066 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:24.266561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d4e0f3d-ecd9-40fb-9eed-f9c852e1c066 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:24.267278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d4e0f3d-ecd9-40fb-9eed-f9c852e1c066 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:24.269596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d4e0f3d-ecd9-40fb-9eed-f9c852e1c066 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:24.280929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4356396-6250-4192-8835-6994f1e3828c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:24.282027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4356396-6250-4192-8835-6994f1e3828c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:24.284657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4356396-6250-4192-8835-6994f1e3828c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:24.285364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-e4356396-6250-4192-8835-6994f1e3828c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lazy-loading 'fault' on Instance uuid 920cabd1-b4b0-4043-a02f-c81488ffea83 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:24:24.394979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e4356396-6250-4192-8835-6994f1e3828c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1b759d69b49b4a52be313a2b3b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84273e7c2b44a24aa49dbedcd05f5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:24.417446 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e4356396-6250-4192-8835-6994f1e3828c tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 200 len: 1317 microversion: 2.1 time: 0.283667 Oct 12 22:24:24.418078 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2441/5487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:24 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:24.549083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2d4e0f3d-ecd9-40fb-9eed-f9c852e1c066 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:24.563620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2d4e0f3d-ecd9-40fb-9eed-f9c852e1c066 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:24.566638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2d4e0f3d-ecd9-40fb-9eed-f9c852e1c066 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:24.568243 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2d4e0f3d-ecd9-40fb-9eed-f9c852e1c066 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1357 microversion: 2.57 time: 0.326647 Oct 12 22:24:24.570132 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3047/5488] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:24 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1357 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:24:24.614553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d815b4d4-ed41-48b6-a4d7-0e0ccf9ac450 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:24.615143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d815b4d4-ed41-48b6-a4d7-0e0ccf9ac450 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:24.626119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d815b4d4-ed41-48b6-a4d7-0e0ccf9ac450 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:24.626667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d815b4d4-ed41-48b6-a4d7-0e0ccf9ac450 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:24.627104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d815b4d4-ed41-48b6-a4d7-0e0ccf9ac450 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:24.627861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d815b4d4-ed41-48b6-a4d7-0e0ccf9ac450 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:24.628327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d815b4d4-ed41-48b6-a4d7-0e0ccf9ac450 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:24.628746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d815b4d4-ed41-48b6-a4d7-0e0ccf9ac450 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:24.659162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d815b4d4-ed41-48b6-a4d7-0e0ccf9ac450 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:24:24.727466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e588aa94-0e22-424f-84b3-bef5981d9c03 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:24.728267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e588aa94-0e22-424f-84b3-bef5981d9c03 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:24.742613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e588aa94-0e22-424f-84b3-bef5981d9c03 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:24.746953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e588aa94-0e22-424f-84b3-bef5981d9c03 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:24.747773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e588aa94-0e22-424f-84b3-bef5981d9c03 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:24.752723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e588aa94-0e22-424f-84b3-bef5981d9c03 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:24.753634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e588aa94-0e22-424f-84b3-bef5981d9c03 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:24.754622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e588aa94-0e22-424f-84b3-bef5981d9c03 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:24.868399 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d815b4d4-ed41-48b6-a4d7-0e0ccf9ac450 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 204 len: 0 microversion: 2.57 time: 0.257720 Oct 12 22:24:24.876574 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2442/5489] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:24:24 2022] DELETE /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:24:24.891464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2f4ac6b0-2b54-498f-a727-c457204c901d tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:24.899757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f4ac6b0-2b54-498f-a727-c457204c901d tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:24.919627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f4ac6b0-2b54-498f-a727-c457204c901d tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:24.920747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f4ac6b0-2b54-498f-a727-c457204c901d tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:24.923438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f4ac6b0-2b54-498f-a727-c457204c901d tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:24.924975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f4ac6b0-2b54-498f-a727-c457204c901d tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:24.927654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f4ac6b0-2b54-498f-a727-c457204c901d tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:24.930093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f4ac6b0-2b54-498f-a727-c457204c901d tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:25.353502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f4ac6b0-2b54-498f-a727-c457204c901d tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:25.390812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f4ac6b0-2b54-498f-a727-c457204c901d tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:25.395554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f4ac6b0-2b54-498f-a727-c457204c901d tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:25.400499 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2f4ac6b0-2b54-498f-a727-c457204c901d tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1363 microversion: 2.57 time: 0.521508 Oct 12 22:24:25.404523 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2443/5490] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:24 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1363 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:24:25.444628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b5b71e68-050b-4ca2-8720-f41ab2982bbe tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:25.445706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b5b71e68-050b-4ca2-8720-f41ab2982bbe tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] [instance: 920cabd1-b4b0-4043-a02f-c81488ffea83] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:25.456376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5b71e68-050b-4ca2-8720-f41ab2982bbe tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:25.457939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5b71e68-050b-4ca2-8720-f41ab2982bbe tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:25.458822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5b71e68-050b-4ca2-8720-f41ab2982bbe tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:25.459832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5b71e68-050b-4ca2-8720-f41ab2982bbe tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:25.460941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5b71e68-050b-4ca2-8720-f41ab2982bbe tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:25.462756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5b71e68-050b-4ca2-8720-f41ab2982bbe tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:25.501510 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-b5b71e68-050b-4ca2-8720-f41ab2982bbe tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] HTTP exception thrown: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b5b71e68-050b-4ca2-8720-f41ab2982bbe tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Request method failure captured: Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 HTTP/1.1 Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz5uB-yElErzsdLZHSqXV5156uQoURAFuDrZEYUCYy0qAgQOLzFTFp0dceTQqjWMtLrjtN43SVzreJfPP6ie_39XNc_gNts7uN7qcyYPZ1nXke4KfSE_CPoq6ehaCxbokQTdql0ZaAUDrmM72yph9AzW8-ip_5LUzNzL10W93zCzhII Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: e84273e7c2b44a24aa49dbedcd05f5fa Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1151043946 Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e84273e7c2b44a24aa49dbedcd05f5fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e84273e7c2b44a24aa49dbedcd05f5fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e84273e7c2b44a24aa49dbedcd05f5fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e84273e7c2b44a24aa49dbedcd05f5fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1151043946 Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: e84273e7c2b44a24aa49dbedcd05f5fa Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1151043946 Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1151043946-project Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 69a1b759d69b49b4a52be313a2b3b828 Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1151043946-project Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '920cabd1-b4b0-4043-a02f-c81488ffea83'} Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. Oct 12 22:24:25.504865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:25.509756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:25.509756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:25.509756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:25.509756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:25.509756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:25.509756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:24:25.509756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:24:25.509756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. Oct 12 22:24:25.509756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:25.511832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b5b71e68-050b-4ca2-8720-f41ab2982bbe tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] Returning 404 to user: Instance 920cabd1-b4b0-4043-a02f-c81488ffea83 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:24:25.513799 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b5b71e68-050b-4ca2-8720-f41ab2982bbe tempest-ServersNegativeTestMultiTenantJSON-1151043946 tempest-ServersNegativeTestMultiTenantJSON-1151043946-project] 10.222.0.16 "GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83" status: 404 len: 111 microversion: 2.1 time: 0.074553 Oct 12 22:24:25.514953 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2444/5491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:25 2022] GET /compute/v2.1/servers/920cabd1-b4b0-4043-a02f-c81488ffea83 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:24:26.069867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e588aa94-0e22-424f-84b3-bef5981d9c03 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:26.084741 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e588aa94-0e22-424f-84b3-bef5981d9c03 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1308 microversion: 2.1 time: 1.363464 Oct 12 22:24:26.115982 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3048/5492] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:24 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1308 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:26.300302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-7eac0519-64ee-4410-9cb9-51f6cdcb783c req-535eaa78-f702-4af3-ab0b-10bfcdc5c76f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84af030c-67a9-47bb-826e-b414ea7857b5", "name": "network-vif-plugged", "status": "completed", "tag": "f510efd3-db76-43e0-a733-fec32383c0b9"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:26.328961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7eac0519-64ee-4410-9cb9-51f6cdcb783c req-535eaa78-f702-4af3-ab0b-10bfcdc5c76f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:26.329718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7eac0519-64ee-4410-9cb9-51f6cdcb783c req-535eaa78-f702-4af3-ab0b-10bfcdc5c76f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:26.330332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7eac0519-64ee-4410-9cb9-51f6cdcb783c req-535eaa78-f702-4af3-ab0b-10bfcdc5c76f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:26.353792 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-7eac0519-64ee-4410-9cb9-51f6cdcb783c req-535eaa78-f702-4af3-ab0b-10bfcdc5c76f service nova] Creating event network-vif-plugged:f510efd3-db76-43e0-a733-fec32383c0b9 for instance 84af030c-67a9-47bb-826e-b414ea7857b5 on n-h1-861111-1 Oct 12 22:24:26.369795 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-7eac0519-64ee-4410-9cb9-51f6cdcb783c req-535eaa78-f702-4af3-ab0b-10bfcdc5c76f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074244 Oct 12 22:24:26.370574 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2445/5493] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:26.435650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-326c5945-38fc-4d90-b803-5d48d1ec6f20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:26.436833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-326c5945-38fc-4d90-b803-5d48d1ec6f20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:26.449416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-326c5945-38fc-4d90-b803-5d48d1ec6f20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:26.450056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-326c5945-38fc-4d90-b803-5d48d1ec6f20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:26.450773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-326c5945-38fc-4d90-b803-5d48d1ec6f20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:26.453227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-326c5945-38fc-4d90-b803-5d48d1ec6f20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:26.455820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-326c5945-38fc-4d90-b803-5d48d1ec6f20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:26.457513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-326c5945-38fc-4d90-b803-5d48d1ec6f20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:26.777678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-326c5945-38fc-4d90-b803-5d48d1ec6f20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:26.813162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-326c5945-38fc-4d90-b803-5d48d1ec6f20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:26.825270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-326c5945-38fc-4d90-b803-5d48d1ec6f20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '230322186b9d4af18632ed85eb15459b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab1aa61e4243c6ad68f00a97dbdd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:26.827926 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-326c5945-38fc-4d90-b803-5d48d1ec6f20 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 200 len: 1363 microversion: 2.57 time: 0.397399 Oct 12 22:24:26.839876 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3049/5494] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:26 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 1363 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:24:27.117186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c87ffb3f-1e54-4e00-8363-103ed840f12e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:27.117947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c87ffb3f-1e54-4e00-8363-103ed840f12e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:27.129151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c87ffb3f-1e54-4e00-8363-103ed840f12e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:27.129562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c87ffb3f-1e54-4e00-8363-103ed840f12e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:27.130008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c87ffb3f-1e54-4e00-8363-103ed840f12e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:27.130709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c87ffb3f-1e54-4e00-8363-103ed840f12e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:27.131772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c87ffb3f-1e54-4e00-8363-103ed840f12e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:27.132126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c87ffb3f-1e54-4e00-8363-103ed840f12e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:27.154338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:27.624559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c87ffb3f-1e54-4e00-8363-103ed840f12e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:27.642452 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c87ffb3f-1e54-4e00-8363-103ed840f12e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1308 microversion: 2.1 time: 0.531390 Oct 12 22:24:27.643671 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2446/5495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:27 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1308 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:27.861598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8f3ba220-cc42-4792-9c79-056903360fb0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:27.863037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8f3ba220-cc42-4792-9c79-056903360fb0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] [instance: e91ac162-2efd-47b3-9ca3-02075049156c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:27.873649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f3ba220-cc42-4792-9c79-056903360fb0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:27.874383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f3ba220-cc42-4792-9c79-056903360fb0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:27.875087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f3ba220-cc42-4792-9c79-056903360fb0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:27.876189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f3ba220-cc42-4792-9c79-056903360fb0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:27.876876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f3ba220-cc42-4792-9c79-056903360fb0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:27.878276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f3ba220-cc42-4792-9c79-056903360fb0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:27.901780 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-8f3ba220-cc42-4792-9c79-056903360fb0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] HTTP exception thrown: Instance e91ac162-2efd-47b3-9ca3-02075049156c could not be found. Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8f3ba220-cc42-4792-9c79-056903360fb0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Request method failure captured: Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c HTTP/1.1 Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz5w3ix_PMDodjMy9d4mynGcEmKL9Ie0QRxXZf2NB7Z3WAQrH4f9iXMyb2UEYH3irRqFERpoTxtgr7WPhhfr8paUHw1ESFWfSOycP1cOfHHXqx5nFntoBvu7JypLhN5a1ldtfNLUC2D8P6AFBFy4gWD-9UbN4Nkz13CdDkxPP2MA5P0 Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.57 Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 36ab1aa61e4243c6ad68f00a97dbdd56 Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerShowV257Test-237984288 Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36ab1aa61e4243c6ad68f00a97dbdd56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36ab1aa61e4243c6ad68f00a97dbdd56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_36ab1aa61e4243c6ad68f00a97dbdd56", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/36ab1aa61e4243c6ad68f00a97dbdd56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerShowV257Test-237984288 Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 36ab1aa61e4243c6ad68f00a97dbdd56 Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerShowV257Test-237984288 Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerShowV257Test-237984288-project Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 230322186b9d4af18632ed85eb15459b Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerShowV257Test-237984288-project Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance e91ac162-2efd-47b3-9ca3-02075049156c could not be found. Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'e91ac162-2efd-47b3-9ca3-02075049156c'} Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e91ac162-2efd-47b3-9ca3-02075049156c could not be found. Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e91ac162-2efd-47b3-9ca3-02075049156c could not be found. Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:27.903888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:27.909193 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:27.909193 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:27.909193 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:27.909193 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:24:27.909193 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:24:27.909193 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e91ac162-2efd-47b3-9ca3-02075049156c could not be found. Oct 12 22:24:27.909193 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:27.909193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8f3ba220-cc42-4792-9c79-056903360fb0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] Returning 404 to user: Instance e91ac162-2efd-47b3-9ca3-02075049156c could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:24:27.912763 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8f3ba220-cc42-4792-9c79-056903360fb0 tempest-ServerShowV257Test-237984288 tempest-ServerShowV257Test-237984288-project] 10.222.0.16 "GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c" status: 404 len: 111 microversion: 2.57 time: 0.058510 Oct 12 22:24:27.918594 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3050/5496] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:24:27 2022] GET /compute/v2.1/servers/e91ac162-2efd-47b3-9ca3-02075049156c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:24:28.666998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-73086373-bdec-4bfe-89f8-d454557948a2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:28.669564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-73086373-bdec-4bfe-89f8-d454557948a2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:28.695953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73086373-bdec-4bfe-89f8-d454557948a2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:28.703050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73086373-bdec-4bfe-89f8-d454557948a2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:28.703920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73086373-bdec-4bfe-89f8-d454557948a2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:28.705019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73086373-bdec-4bfe-89f8-d454557948a2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:28.708147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73086373-bdec-4bfe-89f8-d454557948a2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:28.709369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73086373-bdec-4bfe-89f8-d454557948a2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:29.085438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-73086373-bdec-4bfe-89f8-d454557948a2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:29.108627 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-73086373-bdec-4bfe-89f8-d454557948a2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1488 microversion: 2.1 time: 0.441923 Oct 12 22:24:29.112629 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2447/5497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:28 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1488 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:29.583529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-789494500", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "36f67723-f632-42aa-bcd9-cfd1c5f07f45"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:29.720723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] validate_networks() for [('36f67723-f632-42aa-bcd9-cfd1c5f07f45', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:24:31.836455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:24:31.837059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:24:31.837587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:24:31.838154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:24:31.838622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:24:31.874481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:31.876308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:31.878723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:31.879887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:31.881854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:31.883500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:31.945232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for project 8276c235e518406da376c8a4c19b27d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:24:31.959917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for user 789a612b19154564a853199a67ea8496 and project 8276c235e518406da376c8a4c19b27d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:24:32.003654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:24:32.006443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:24:32.140453 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5cc6c544-0673-4bee-80f3-913900deaaff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.561800 Oct 12 22:24:32.141439 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3051/5498] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:24:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:24:32.153399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1c7ca49d-c8f7-4b36-aaf7-d7621915d968 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:32.154719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1c7ca49d-c8f7-4b36-aaf7-d7621915d968 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:33.361243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1c7ca49d-c8f7-4b36-aaf7-d7621915d968 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:33.373042 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1c7ca49d-c8f7-4b36-aaf7-d7621915d968 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1208 microversion: 2.1 time: 1.223578 Oct 12 22:24:33.374195 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2448/5499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:32 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1208 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:34.233800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a9af48e9-daa0-4211-8faa-207067351f1f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:34.236848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a9af48e9-daa0-4211-8faa-207067351f1f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:34.262881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9af48e9-daa0-4211-8faa-207067351f1f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:34.263438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9af48e9-daa0-4211-8faa-207067351f1f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:34.267695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9af48e9-daa0-4211-8faa-207067351f1f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:34.268498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9af48e9-daa0-4211-8faa-207067351f1f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:34.273280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9af48e9-daa0-4211-8faa-207067351f1f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:34.274169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9af48e9-daa0-4211-8faa-207067351f1f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:34.399966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cc9812b1-b250-4f9c-b722-cb0b92351042 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:34.400688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cc9812b1-b250-4f9c-b722-cb0b92351042 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:34.408098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a9af48e9-daa0-4211-8faa-207067351f1f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:24:34.432668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc9812b1-b250-4f9c-b722-cb0b92351042 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:34.432668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc9812b1-b250-4f9c-b722-cb0b92351042 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:34.432668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc9812b1-b250-4f9c-b722-cb0b92351042 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:34.437263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc9812b1-b250-4f9c-b722-cb0b92351042 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:34.437803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc9812b1-b250-4f9c-b722-cb0b92351042 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:34.438249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc9812b1-b250-4f9c-b722-cb0b92351042 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:34.698795 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a9af48e9-daa0-4211-8faa-207067351f1f tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "DELETE /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 204 len: 0 microversion: 2.1 time: 0.485676 Oct 12 22:24:34.699737 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3052/5500] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:24:34 2022] DELETE /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:24:34.717308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-68366d05-2436-4a71-977b-fe0b03457d5e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:34.721025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-68366d05-2436-4a71-977b-fe0b03457d5e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:34.741450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68366d05-2436-4a71-977b-fe0b03457d5e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:34.742635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68366d05-2436-4a71-977b-fe0b03457d5e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:34.743590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68366d05-2436-4a71-977b-fe0b03457d5e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:34.744688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68366d05-2436-4a71-977b-fe0b03457d5e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:34.745764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68366d05-2436-4a71-977b-fe0b03457d5e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:34.746651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68366d05-2436-4a71-977b-fe0b03457d5e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:34.847690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cc9812b1-b250-4f9c-b722-cb0b92351042 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:34.859730 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cc9812b1-b250-4f9c-b722-cb0b92351042 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1268 microversion: 2.1 time: 0.466317 Oct 12 22:24:34.865347 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2449/5501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:34 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1268 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:24:34.994421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-68366d05-2436-4a71-977b-fe0b03457d5e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:35.004367 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-68366d05-2436-4a71-977b-fe0b03457d5e tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1508 microversion: 2.1 time: 0.299387 Oct 12 22:24:35.018940 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3053/5502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:34 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:35.368029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-29239fdd-0c13-4430-ad68-b4cb07d6d4d7 tempest-ComputeTenantNetworksTest-892531984 tempest-ComputeTenantNetworksTest-892531984-project] Calling method '.version_select at 0x7f512c364ee0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:35.747374 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-29239fdd-0c13-4430-ad68-b4cb07d6d4d7 tempest-ComputeTenantNetworksTest-892531984 tempest-ComputeTenantNetworksTest-892531984-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.880449 Oct 12 22:24:35.747965 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2450/5503] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 12 22:24:34 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:35.764112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9ee50184-93b9-4315-832d-5a1b0bfd6b7c tempest-ComputeTenantNetworksTest-892531984 tempest-ComputeTenantNetworksTest-892531984-project] Calling method '.version_select at 0x7f51234531f0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:35.887917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e21b5f9c-302c-4471-88c3-2e2183543d64 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:35.888949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e21b5f9c-302c-4471-88c3-2e2183543d64 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:35.900809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e21b5f9c-302c-4471-88c3-2e2183543d64 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:35.901936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e21b5f9c-302c-4471-88c3-2e2183543d64 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:35.904684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e21b5f9c-302c-4471-88c3-2e2183543d64 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:35.905864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e21b5f9c-302c-4471-88c3-2e2183543d64 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:35.907410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e21b5f9c-302c-4471-88c3-2e2183543d64 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:35.908113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e21b5f9c-302c-4471-88c3-2e2183543d64 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:35.975961 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9ee50184-93b9-4315-832d-5a1b0bfd6b7c tempest-ComputeTenantNetworksTest-892531984 tempest-ComputeTenantNetworksTest-892531984-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks/07e99016-58af-4176-85b9-d5a65b9d6868" status: 200 len: 140 microversion: 2.1 time: 0.220253 Oct 12 22:24:35.976827 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3054/5504] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 12 22:24:35 2022] GET /compute/v2.1/os-tenant-networks/07e99016-58af-4176-85b9-d5a65b9d6868 => generated 140 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:24:36.029025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d00a3e6c-2698-475d-9d77-5a850d44da80 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:36.029801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d00a3e6c-2698-475d-9d77-5a850d44da80 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:36.037061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d00a3e6c-2698-475d-9d77-5a850d44da80 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:36.037833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d00a3e6c-2698-475d-9d77-5a850d44da80 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:36.038527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d00a3e6c-2698-475d-9d77-5a850d44da80 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:36.039508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d00a3e6c-2698-475d-9d77-5a850d44da80 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:36.040189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d00a3e6c-2698-475d-9d77-5a850d44da80 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:36.040834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d00a3e6c-2698-475d-9d77-5a850d44da80 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:36.140560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e21b5f9c-302c-4471-88c3-2e2183543d64 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:36.163493 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e21b5f9c-302c-4471-88c3-2e2183543d64 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1278 microversion: 2.1 time: 0.284179 Oct 12 22:24:36.164292 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2451/5505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:35 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1278 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:36.270627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d00a3e6c-2698-475d-9d77-5a850d44da80 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:36.280976 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d00a3e6c-2698-475d-9d77-5a850d44da80 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1508 microversion: 2.1 time: 0.255847 Oct 12 22:24:36.287669 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3055/5506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:36 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1508 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:24:37.188560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-64002a99-d24e-484e-9579-c0ed185d2ad9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:37.189135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-64002a99-d24e-484e-9579-c0ed185d2ad9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:37.205692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64002a99-d24e-484e-9579-c0ed185d2ad9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:37.207482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64002a99-d24e-484e-9579-c0ed185d2ad9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:37.208852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64002a99-d24e-484e-9579-c0ed185d2ad9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:37.211536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64002a99-d24e-484e-9579-c0ed185d2ad9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:37.212493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64002a99-d24e-484e-9579-c0ed185d2ad9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:37.213532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64002a99-d24e-484e-9579-c0ed185d2ad9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:37.306477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fd1f505d-db05-453d-8cb3-29052edbba45 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:37.307772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fd1f505d-db05-453d-8cb3-29052edbba45 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:37.317016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd1f505d-db05-453d-8cb3-29052edbba45 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:37.319076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd1f505d-db05-453d-8cb3-29052edbba45 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:37.319739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd1f505d-db05-453d-8cb3-29052edbba45 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:37.320972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd1f505d-db05-453d-8cb3-29052edbba45 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:37.321598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd1f505d-db05-453d-8cb3-29052edbba45 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:37.322280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd1f505d-db05-453d-8cb3-29052edbba45 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:37.413618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-64002a99-d24e-484e-9579-c0ed185d2ad9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:37.429215 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-64002a99-d24e-484e-9579-c0ed185d2ad9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1266 microversion: 2.1 time: 0.244697 Oct 12 22:24:37.445609 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2452/5507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:37 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:37.636554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fd1f505d-db05-453d-8cb3-29052edbba45 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:37.653525 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fd1f505d-db05-453d-8cb3-29052edbba45 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1508 microversion: 2.1 time: 0.351811 Oct 12 22:24:37.654432 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3056/5508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:37 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1508 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:24:38.466099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1047ae90-8729-45f6-bd92-8a9ea7ed4669 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:38.470322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1047ae90-8729-45f6-bd92-8a9ea7ed4669 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:38.485422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1047ae90-8729-45f6-bd92-8a9ea7ed4669 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:38.486147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1047ae90-8729-45f6-bd92-8a9ea7ed4669 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:38.487468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1047ae90-8729-45f6-bd92-8a9ea7ed4669 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:38.488568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1047ae90-8729-45f6-bd92-8a9ea7ed4669 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:38.489396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1047ae90-8729-45f6-bd92-8a9ea7ed4669 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:38.490815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1047ae90-8729-45f6-bd92-8a9ea7ed4669 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:38.680105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd78dc3d-4046-46db-b7ed-5d02931fa8d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:38.681867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dd78dc3d-4046-46db-b7ed-5d02931fa8d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:38.691575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd78dc3d-4046-46db-b7ed-5d02931fa8d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:38.692263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd78dc3d-4046-46db-b7ed-5d02931fa8d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:38.693511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd78dc3d-4046-46db-b7ed-5d02931fa8d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:38.694669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd78dc3d-4046-46db-b7ed-5d02931fa8d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:38.695708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd78dc3d-4046-46db-b7ed-5d02931fa8d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:38.696355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd78dc3d-4046-46db-b7ed-5d02931fa8d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:38.719190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1047ae90-8729-45f6-bd92-8a9ea7ed4669 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:38.736538 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1047ae90-8729-45f6-bd92-8a9ea7ed4669 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1266 microversion: 2.1 time: 0.270350 Oct 12 22:24:38.752560 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2453/5509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:38 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:39.261267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-8c7629db-e871-425f-bfb8-95c80823a308 req-b18acadd-4e74-404b-a3cd-5a83329cb962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feda1f68-7489-4648-8f7a-ab12030e50b3", "name": "network-vif-deleted", "tag": "3c29066c-14d0-4255-a92b-549d245ed144"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:39.293101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8c7629db-e871-425f-bfb8-95c80823a308 req-b18acadd-4e74-404b-a3cd-5a83329cb962 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:39.297243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8c7629db-e871-425f-bfb8-95c80823a308 req-b18acadd-4e74-404b-a3cd-5a83329cb962 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:39.297819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8c7629db-e871-425f-bfb8-95c80823a308 req-b18acadd-4e74-404b-a3cd-5a83329cb962 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:39.350368 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-8c7629db-e871-425f-bfb8-95c80823a308 req-b18acadd-4e74-404b-a3cd-5a83329cb962 service nova] Creating event network-vif-deleted:3c29066c-14d0-4255-a92b-549d245ed144 for instance feda1f68-7489-4648-8f7a-ab12030e50b3 on n-h2-861111-1 Oct 12 22:24:39.362515 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-8c7629db-e871-425f-bfb8-95c80823a308 req-b18acadd-4e74-404b-a3cd-5a83329cb962 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107452 Oct 12 22:24:39.364485 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2454/5510] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:39.572035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dd78dc3d-4046-46db-b7ed-5d02931fa8d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:39.600657 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dd78dc3d-4046-46db-b7ed-5d02931fa8d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 200 len: 1508 microversion: 2.1 time: 0.925117 Oct 12 22:24:39.601494 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3057/5511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:38 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 1508 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:39.766682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5009258d-69a0-4a5b-9a67-dac89c25e61d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:39.767326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5009258d-69a0-4a5b-9a67-dac89c25e61d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:39.782260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5009258d-69a0-4a5b-9a67-dac89c25e61d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:39.783000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5009258d-69a0-4a5b-9a67-dac89c25e61d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:39.783658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5009258d-69a0-4a5b-9a67-dac89c25e61d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:39.786347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5009258d-69a0-4a5b-9a67-dac89c25e61d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:39.789169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5009258d-69a0-4a5b-9a67-dac89c25e61d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:39.789979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5009258d-69a0-4a5b-9a67-dac89c25e61d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:40.098778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5009258d-69a0-4a5b-9a67-dac89c25e61d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:40.112785 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5009258d-69a0-4a5b-9a67-dac89c25e61d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1308 microversion: 2.1 time: 0.349106 Oct 12 22:24:40.129161 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2455/5512] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:39 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1308 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:40.314986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd78dc3d-4046-46db-b7ed-5d02931fa8d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:40.316355 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dd78dc3d-4046-46db-b7ed-5d02931fa8d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001731 Oct 12 22:24:40.318941 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3058/5513] 10.222.0.16 () {56 vars in 886 bytes} [Wed Oct 12 22:24:40 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 22:24:40.330172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5009258d-69a0-4a5b-9a67-dac89c25e61d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:40.332187 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5009258d-69a0-4a5b-9a67-dac89c25e61d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002371 Oct 12 22:24:40.341578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd78dc3d-4046-46db-b7ed-5d02931fa8d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:40.342918 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dd78dc3d-4046-46db-b7ed-5d02931fa8d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001845 Oct 12 22:24:40.343564 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3059/5514] 10.222.0.16 () {54 vars in 1041 bytes} [Wed Oct 12 22:24:40 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:40.353217 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2456/5515] 10.222.0.16 () {54 vars in 1035 bytes} [Wed Oct 12 22:24:40 2022] GET /compute/v2/ => generated 379 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 12 22:24:40.353895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd78dc3d-4046-46db-b7ed-5d02931fa8d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:40.355155 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dd78dc3d-4046-46db-b7ed-5d02931fa8d8 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002146 Oct 12 22:24:40.364891 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3060/5516] 10.222.0.16 () {56 vars in 886 bytes} [Wed Oct 12 22:24:40 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 22:24:40.626805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-26f5a820-6172-416a-bdbe-70e154e8e071 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:40.627885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-26f5a820-6172-416a-bdbe-70e154e8e071 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: feda1f68-7489-4648-8f7a-ab12030e50b3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:40.638981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26f5a820-6172-416a-bdbe-70e154e8e071 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:40.640440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26f5a820-6172-416a-bdbe-70e154e8e071 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:40.641409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26f5a820-6172-416a-bdbe-70e154e8e071 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:40.650500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26f5a820-6172-416a-bdbe-70e154e8e071 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:40.651022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26f5a820-6172-416a-bdbe-70e154e8e071 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:40.657834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26f5a820-6172-416a-bdbe-70e154e8e071 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:40.713833 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-26f5a820-6172-416a-bdbe-70e154e8e071 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] HTTP exception thrown: Instance feda1f68-7489-4648-8f7a-ab12030e50b3 could not be found. Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-26f5a820-6172-416a-bdbe-70e154e8e071 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Request method failure captured: Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 HTTP/1.1 Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz1yYv3BEuyn16aX9rFnQkuXp35mHqXE7bVOWKfvxNZXNT7qw6co-FDMauTgJfMPQCxmiEKAu0kzyjnis87qTpfUYp96yN_F6sfmIZnSLJLUbYy9WREcLUGhzXNPjj1UORIJx3lHLMBoOzDKf1JzqCDKyG4PBpXcEQzC9GdyMUjXkpQ Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0a0c4d9f435a4c009bd0b5eb2618829b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: afec4a3808b84463900b744ecd9352b6 Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance feda1f68-7489-4648-8f7a-ab12030e50b3 could not be found. Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'feda1f68-7489-4648-8f7a-ab12030e50b3'} Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feda1f68-7489-4648-8f7a-ab12030e50b3 could not be found. Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feda1f68-7489-4648-8f7a-ab12030e50b3 could not be found. Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:40.716183 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:40.721868 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:40.721868 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:40.721868 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:40.721868 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:40.721868 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:24:40.721868 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:24:40.721868 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feda1f68-7489-4648-8f7a-ab12030e50b3 could not be found. Oct 12 22:24:40.721868 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:40.726184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-26f5a820-6172-416a-bdbe-70e154e8e071 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Returning 404 to user: Instance feda1f68-7489-4648-8f7a-ab12030e50b3 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:24:40.728197 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-26f5a820-6172-416a-bdbe-70e154e8e071 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3" status: 404 len: 111 microversion: 2.1 time: 0.106122 Oct 12 22:24:40.733751 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2457/5517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:40 2022] GET /compute/v2.1/servers/feda1f68-7489-4648-8f7a-ab12030e50b3 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:24:40.754035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-419c6893-234f-4585-b5c5-7189a61b68d5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:40.754937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-419c6893-234f-4585-b5c5-7189a61b68d5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:40.765805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-419c6893-234f-4585-b5c5-7189a61b68d5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:40.768424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-419c6893-234f-4585-b5c5-7189a61b68d5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:40.774320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-419c6893-234f-4585-b5c5-7189a61b68d5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:40.776124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-419c6893-234f-4585-b5c5-7189a61b68d5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:40.778904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-419c6893-234f-4585-b5c5-7189a61b68d5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:40.780482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-419c6893-234f-4585-b5c5-7189a61b68d5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:40.843528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-419c6893-234f-4585-b5c5-7189a61b68d5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:24:41.059554 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-419c6893-234f-4585-b5c5-7189a61b68d5 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 204 len: 0 microversion: 2.1 time: 0.319007 Oct 12 22:24:41.070133 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3061/5518] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:24:40 2022] DELETE /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:24:41.079747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-50687ae2-1c29-4434-834f-572f4c98dae2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:41.081988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-50687ae2-1c29-4434-834f-572f4c98dae2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:41.099450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50687ae2-1c29-4434-834f-572f4c98dae2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:41.100042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50687ae2-1c29-4434-834f-572f4c98dae2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:41.100490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50687ae2-1c29-4434-834f-572f4c98dae2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:41.101214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50687ae2-1c29-4434-834f-572f4c98dae2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:41.101677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50687ae2-1c29-4434-834f-572f4c98dae2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:41.102113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50687ae2-1c29-4434-834f-572f4c98dae2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:41.144046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aca4702e-148c-4129-a63b-7e239f962e37 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:41.144046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aca4702e-148c-4129-a63b-7e239f962e37 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:41.154601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aca4702e-148c-4129-a63b-7e239f962e37 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:41.155131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aca4702e-148c-4129-a63b-7e239f962e37 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:41.171874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aca4702e-148c-4129-a63b-7e239f962e37 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:41.173252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aca4702e-148c-4129-a63b-7e239f962e37 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:41.173826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aca4702e-148c-4129-a63b-7e239f962e37 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:41.174597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aca4702e-148c-4129-a63b-7e239f962e37 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:41.696152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aca4702e-148c-4129-a63b-7e239f962e37 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:41.702351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-50687ae2-1c29-4434-834f-572f4c98dae2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:41.712657 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aca4702e-148c-4129-a63b-7e239f962e37 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1308 microversion: 2.1 time: 0.574330 Oct 12 22:24:41.713250 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3062/5519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:41 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1308 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:41.719777 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-50687ae2-1c29-4434-834f-572f4c98dae2 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1523 microversion: 2.1 time: 0.641267 Oct 12 22:24:41.720457 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2458/5520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:41 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1523 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:41.806603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-54b15cd1-2681-4c21-9f01-b21a39dcb17b req-a311f8b3-7ee2-4f71-bbe8-b9c86af6ba93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "665dc72f-f961-4a0b-b2cd-61828dc07c99", "tag": "49cdb1f0-2b3d-47f0-a80f-0038c1d0f408"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:41.818781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-54b15cd1-2681-4c21-9f01-b21a39dcb17b req-a311f8b3-7ee2-4f71-bbe8-b9c86af6ba93 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:41.819334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-54b15cd1-2681-4c21-9f01-b21a39dcb17b req-a311f8b3-7ee2-4f71-bbe8-b9c86af6ba93 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:41.819769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-54b15cd1-2681-4c21-9f01-b21a39dcb17b req-a311f8b3-7ee2-4f71-bbe8-b9c86af6ba93 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:41.867835 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-54b15cd1-2681-4c21-9f01-b21a39dcb17b req-a311f8b3-7ee2-4f71-bbe8-b9c86af6ba93 service nova] Creating event network-changed:49cdb1f0-2b3d-47f0-a80f-0038c1d0f408 for instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 on n-h2-861111-1 Oct 12 22:24:41.885136 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-54b15cd1-2681-4c21-9f01-b21a39dcb17b req-a311f8b3-7ee2-4f71-bbe8-b9c86af6ba93 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087370 Oct 12 22:24:41.886073 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2459/5521] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:42.746927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-57e218bc-f34a-4394-a930-c1d33117ab3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:42.757310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0e93671d-0624-4e26-9deb-7e45a8a83962 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:42.758879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-57e218bc-f34a-4394-a930-c1d33117ab3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:42.764483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:42.767027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0e93671d-0624-4e26-9deb-7e45a8a83962 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:42.776305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:42.778610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:42.787994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57e218bc-f34a-4394-a930-c1d33117ab3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:42.801571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57e218bc-f34a-4394-a930-c1d33117ab3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:42.804975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57e218bc-f34a-4394-a930-c1d33117ab3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:42.805719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57e218bc-f34a-4394-a930-c1d33117ab3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:42.806177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57e218bc-f34a-4394-a930-c1d33117ab3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:42.806604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-57e218bc-f34a-4394-a930-c1d33117ab3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:42.807288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e93671d-0624-4e26-9deb-7e45a8a83962 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:42.807813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e93671d-0624-4e26-9deb-7e45a8a83962 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:42.808247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e93671d-0624-4e26-9deb-7e45a8a83962 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:42.808962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e93671d-0624-4e26-9deb-7e45a8a83962 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:42.809406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e93671d-0624-4e26-9deb-7e45a8a83962 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:42.809827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e93671d-0624-4e26-9deb-7e45a8a83962 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:42.868521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:43.372044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:43.500937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-57e218bc-f34a-4394-a930-c1d33117ab3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:43.513925 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-57e218bc-f34a-4394-a930-c1d33117ab3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1308 microversion: 2.1 time: 0.775483 Oct 12 22:24:43.516845 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3063/5522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:42 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1308 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:43.715811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0e93671d-0624-4e26-9deb-7e45a8a83962 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:43.744892 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0e93671d-0624-4e26-9deb-7e45a8a83962 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1523 microversion: 2.1 time: 1.000334 Oct 12 22:24:43.747130 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2460/5523] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:42 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1523 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:44.154812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0403ed8d-6464-4483-a3c7-62b3e6f77662 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Action: 'create', calling method: .version_select at 0x7f5123511c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-904962236", "metadata": {"Type": "work"}}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0403ed8d-6464-4483-a3c7-62b3e6f77662 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Request method failure captured: Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 121 Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz6rnR6OUg8qAPQt1kPNZMLVUbp-86qPcfBwBaF33wCUQFUF5M1KA2O6RmEeSXheUong64zEcx1sgzmE0BfOWCQItxj-7OhrIN3OvVLW9ZflrOuuMlV--57u6vWBPcTFHeBwwmzFhQIgm48Pa8XgBDOlBcEL1YUaNQfDQ952DNE-Vvg Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 81e5f0c85ec84c8389f9b330a733f06a Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81e5f0c85ec84c8389f9b330a733f06a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 81e5f0c85ec84c8389f9b330a733f06a Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-VolumesNegativeTest-807718462-project Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 1a09f01ddd5d4ceba0522d5687887eb2 Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-VolumesNegativeTest-807718462-project Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-904962236", "metadata": {"Type": "work"}}} Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-904962236', 'metadata': {'Type': 'work'}}}} Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi '#$%' Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:24:44.160658 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:24:44.166244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 22:24:44.166244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.166244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:44.166244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.166244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.166244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:44.166244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:44.166244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:24:44.166244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:24:44.166244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 22:24:44.166244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.168796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0403ed8d-6464-4483-a3c7-62b3e6f77662 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:24:44.169741 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0403ed8d-6464-4483-a3c7-62b3e6f77662 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.316552 Oct 12 22:24:44.170420 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3064/5524] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 12 22:24:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 318 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:24:44.180742 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-79775f0f-bd3f-4997-b3d4-4af083981565 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Action: 'create', calling method: .version_select at 0x7f5128ca5280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1009517242", "metadata": {"Type": "work"}}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-79775f0f-bd3f-4997-b3d4-4af083981565 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Request method failure captured: Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 120 Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz6rnR6OUg8qAPQt1kPNZMLVUbp-86qPcfBwBaF33wCUQFUF5M1KA2O6RmEeSXheUong64zEcx1sgzmE0BfOWCQItxj-7OhrIN3OvVLW9ZflrOuuMlV--57u6vWBPcTFHeBwwmzFhQIgm48Pa8XgBDOlBcEL1YUaNQfDQ952DNE-Vvg Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 81e5f0c85ec84c8389f9b330a733f06a Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81e5f0c85ec84c8389f9b330a733f06a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 81e5f0c85ec84c8389f9b330a733f06a Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-VolumesNegativeTest-807718462-project Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 1a09f01ddd5d4ceba0522d5687887eb2 Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-VolumesNegativeTest-807718462-project Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1009517242", "metadata": {"Type": "work"}}} Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1009517242', 'metadata': {'Type': 'work'}}}} Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi '0' Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:24:44.185063 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:24:44.193668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 22:24:44.193668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.193668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:44.193668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.193668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.193668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:44.193668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:44.193668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:24:44.193668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:24:44.193668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 22:24:44.193668 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.193668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-79775f0f-bd3f-4997-b3d4-4af083981565 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:24:44.193668 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-79775f0f-bd3f-4997-b3d4-4af083981565 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010725 Oct 12 22:24:44.195831 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2461/5525] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 12 22:24:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:24:44.204047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f435fb0e-64d4-4422-bd83-985a74b55887 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Action: 'create', calling method: .version_select at 0x7f5128209550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1750822964", "metadata": {"Type": "work"}}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f435fb0e-64d4-4422-bd83-985a74b55887 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Request method failure captured: Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 119 Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz6rnR6OUg8qAPQt1kPNZMLVUbp-86qPcfBwBaF33wCUQFUF5M1KA2O6RmEeSXheUong64zEcx1sgzmE0BfOWCQItxj-7OhrIN3OvVLW9ZflrOuuMlV--57u6vWBPcTFHeBwwmzFhQIgm48Pa8XgBDOlBcEL1YUaNQfDQ952DNE-Vvg Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 81e5f0c85ec84c8389f9b330a733f06a Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81e5f0c85ec84c8389f9b330a733f06a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 81e5f0c85ec84c8389f9b330a733f06a Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-VolumesNegativeTest-807718462-project Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 1a09f01ddd5d4ceba0522d5687887eb2 Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-VolumesNegativeTest-807718462-project Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1750822964", "metadata": {"Type": "work"}}} Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1750822964', 'metadata': {'Type': 'work'}}}} Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi '' Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:24:44.211370 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:24:44.216622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 22:24:44.216622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.216622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:44.216622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.216622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.216622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:44.216622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:44.216622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:24:44.216622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:24:44.216622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 22:24:44.216622 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.216622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f435fb0e-64d4-4422-bd83-985a74b55887 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:24:44.219965 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f435fb0e-64d4-4422-bd83-985a74b55887 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020005 Oct 12 22:24:44.220100 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3065/5526] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 12 22:24:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:24:44.230029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8b4114ac-d3e9-45c8-933c-338907932b29 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Calling method '.version_select at 0x7f512862dee0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:44.269742 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-8b4114ac-d3e9-45c8-933c-338907932b29 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] HTTP exception thrown: Volume tempest-invalid-676726402 could not be found. Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8b4114ac-d3e9-45c8-933c-338907932b29 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Request method failure captured: Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-676726402 HTTP/1.1 Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz6rnR6OUg8qAPQt1kPNZMLVUbp-86qPcfBwBaF33wCUQFUF5M1KA2O6RmEeSXheUong64zEcx1sgzmE0BfOWCQItxj-7OhrIN3OvVLW9ZflrOuuMlV--57u6vWBPcTFHeBwwmzFhQIgm48Pa8XgBDOlBcEL1YUaNQfDQ952DNE-Vvg Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 81e5f0c85ec84c8389f9b330a733f06a Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81e5f0c85ec84c8389f9b330a733f06a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 81e5f0c85ec84c8389f9b330a733f06a Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-VolumesNegativeTest-807718462-project Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 1a09f01ddd5d4ceba0522d5687887eb2 Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-VolumesNegativeTest-807718462-project Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: exception: Volume tempest-invalid-676726402 could not be found. Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'tempest-invalid-676726402'} Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-676726402 could not be found. (HTTP 404) (Request-ID: req-77b40b63-ad3d-456f-9ab7-74a2df647635) Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:24:44.274446 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-676726402 could not be found. Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-676726402 could not be found. Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-676726402 could not be found. Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8b4114ac-d3e9-45c8-933c-338907932b29 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Returning 404 to user: Volume tempest-invalid-676726402 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8b4114ac-d3e9-45c8-933c-338907932b29 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-676726402" status: 404 len: 98 microversion: 2.1 time: 0.056627 Oct 12 22:24:44.287521 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2462/5527] 10.222.0.16 () {58 vars in 1215 bytes} [Wed Oct 12 22:24:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-676726402 => generated 98 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 12 22:24:44.313224 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f0a14088-fc23-4463-850f-079424b8d4a9 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011395 Oct 12 22:24:44.313224 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3066/5528] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 12 22:24:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 22:24:44.316434 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cd84fbe0-c20e-44ea-8e20-afa9955ff3e6 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004436 Oct 12 22:24:44.317226 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2463/5529] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 12 22:24:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 22:24:44.347300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4e615394-f0c7-4711-b33c-1c1137dcd2b0 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Calling method '.version_select at 0x7f5128553790>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:44.416097 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-4e615394-f0c7-4711-b33c-1c1137dcd2b0 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] HTTP exception thrown: Volume 0d24ba4b-1bd0-4f4d-8bec-5a63119ad9a9 could not be found. Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4e615394-f0c7-4711-b33c-1c1137dcd2b0 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Request method failure captured: Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/os-volumes/0d24ba4b-1bd0-4f4d-8bec-5a63119ad9a9 HTTP/1.1 Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz6rnR6OUg8qAPQt1kPNZMLVUbp-86qPcfBwBaF33wCUQFUF5M1KA2O6RmEeSXheUong64zEcx1sgzmE0BfOWCQItxj-7OhrIN3OvVLW9ZflrOuuMlV--57u6vWBPcTFHeBwwmzFhQIgm48Pa8XgBDOlBcEL1YUaNQfDQ952DNE-Vvg Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 81e5f0c85ec84c8389f9b330a733f06a Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81e5f0c85ec84c8389f9b330a733f06a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 81e5f0c85ec84c8389f9b330a733f06a Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-VolumesNegativeTest-807718462-project Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 1a09f01ddd5d4ceba0522d5687887eb2 Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-VolumesNegativeTest-807718462-project Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: exception: Volume 0d24ba4b-1bd0-4f4d-8bec-5a63119ad9a9 could not be found. Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '0d24ba4b-1bd0-4f4d-8bec-5a63119ad9a9'} Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d24ba4b-1bd0-4f4d-8bec-5a63119ad9a9 could not be found. (HTTP 404) (Request-ID: req-1617b9bc-e1ec-45b7-8130-19beb1884a73) Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 22:24:44.421494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d24ba4b-1bd0-4f4d-8bec-5a63119ad9a9 could not be found. Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d24ba4b-1bd0-4f4d-8bec-5a63119ad9a9 could not be found. Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d24ba4b-1bd0-4f4d-8bec-5a63119ad9a9 could not be found. Oct 12 22:24:44.426087 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.436918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4e615394-f0c7-4711-b33c-1c1137dcd2b0 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Returning 404 to user: Volume 0d24ba4b-1bd0-4f4d-8bec-5a63119ad9a9 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:24:44.438133 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4e615394-f0c7-4711-b33c-1c1137dcd2b0 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/0d24ba4b-1bd0-4f4d-8bec-5a63119ad9a9" status: 404 len: 109 microversion: 2.1 time: 0.112234 Oct 12 22:24:44.439745 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3067/5530] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 22:24:44 2022] DELETE /compute/v2.1/os-volumes/0d24ba4b-1bd0-4f4d-8bec-5a63119ad9a9 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:24:44.452245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49759342-09a6-443f-9ee9-65ed2c73c652 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Calling method '.version_select at 0x7f5128ca5280>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:44.485839 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-49759342-09a6-443f-9ee9-65ed2c73c652 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] HTTP exception thrown: Volume a962c699-6e09-455d-9ee3-2605d2955a2f could not be found. Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49759342-09a6-443f-9ee9-65ed2c73c652 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Request method failure captured: Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/os-volumes/a962c699-6e09-455d-9ee3-2605d2955a2f HTTP/1.1 Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz6rnR6OUg8qAPQt1kPNZMLVUbp-86qPcfBwBaF33wCUQFUF5M1KA2O6RmEeSXheUong64zEcx1sgzmE0BfOWCQItxj-7OhrIN3OvVLW9ZflrOuuMlV--57u6vWBPcTFHeBwwmzFhQIgm48Pa8XgBDOlBcEL1YUaNQfDQ952DNE-Vvg Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 81e5f0c85ec84c8389f9b330a733f06a Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81e5f0c85ec84c8389f9b330a733f06a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81e5f0c85ec84c8389f9b330a733f06a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 81e5f0c85ec84c8389f9b330a733f06a Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesNegativeTest-807718462 Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-VolumesNegativeTest-807718462-project Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 1a09f01ddd5d4ceba0522d5687887eb2 Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-VolumesNegativeTest-807718462-project Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: method: Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: exception: Volume a962c699-6e09-455d-9ee3-2605d2955a2f could not be found. Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'a962c699-6e09-455d-9ee3-2605d2955a2f'} Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a962c699-6e09-455d-9ee3-2605d2955a2f could not be found. (HTTP 404) (Request-ID: req-e5762e92-8bc7-48c1-b166-aab8c57cf44d) Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 22:24:44.488492 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a962c699-6e09-455d-9ee3-2605d2955a2f could not be found. Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a962c699-6e09-455d-9ee3-2605d2955a2f could not be found. Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a962c699-6e09-455d-9ee3-2605d2955a2f could not be found. Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49759342-09a6-443f-9ee9-65ed2c73c652 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] Returning 404 to user: Volume a962c699-6e09-455d-9ee3-2605d2955a2f could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:24:44.495329 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-49759342-09a6-443f-9ee9-65ed2c73c652 tempest-VolumesNegativeTest-807718462 tempest-VolumesNegativeTest-807718462-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a962c699-6e09-455d-9ee3-2605d2955a2f" status: 404 len: 109 microversion: 2.1 time: 0.044345 Oct 12 22:24:44.509384 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2464/5531] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:24:44 2022] GET /compute/v2.1/os-volumes/a962c699-6e09-455d-9ee3-2605d2955a2f => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:24:44.554581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7a92ff70-5d24-45ad-ab19-6e48c665ea01 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:44.555351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7a92ff70-5d24-45ad-ab19-6e48c665ea01 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:44.562767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a92ff70-5d24-45ad-ab19-6e48c665ea01 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:44.563626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a92ff70-5d24-45ad-ab19-6e48c665ea01 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:44.564189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a92ff70-5d24-45ad-ab19-6e48c665ea01 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:44.565033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a92ff70-5d24-45ad-ab19-6e48c665ea01 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:44.565628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a92ff70-5d24-45ad-ab19-6e48c665ea01 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:44.566195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a92ff70-5d24-45ad-ab19-6e48c665ea01 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:44.773989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-04e48074-2d83-4a9e-9e8d-ba2d07c90a60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:44.774675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-04e48074-2d83-4a9e-9e8d-ba2d07c90a60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:44.788063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04e48074-2d83-4a9e-9e8d-ba2d07c90a60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:44.788574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04e48074-2d83-4a9e-9e8d-ba2d07c90a60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:44.789020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04e48074-2d83-4a9e-9e8d-ba2d07c90a60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:44.789746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04e48074-2d83-4a9e-9e8d-ba2d07c90a60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:44.790204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04e48074-2d83-4a9e-9e8d-ba2d07c90a60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:44.790639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04e48074-2d83-4a9e-9e8d-ba2d07c90a60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:45.385263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7a92ff70-5d24-45ad-ab19-6e48c665ea01 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:45.396837 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7a92ff70-5d24-45ad-ab19-6e48c665ea01 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1308 microversion: 2.1 time: 0.857094 Oct 12 22:24:45.397606 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3068/5532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:44 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1308 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:46.420235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c1019ef1-c8c7-4b68-8e31-0d0f7e9ae0ec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:46.420893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c1019ef1-c8c7-4b68-8e31-0d0f7e9ae0ec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:46.434811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1019ef1-c8c7-4b68-8e31-0d0f7e9ae0ec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:46.435341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1019ef1-c8c7-4b68-8e31-0d0f7e9ae0ec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:46.435819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1019ef1-c8c7-4b68-8e31-0d0f7e9ae0ec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:46.436553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1019ef1-c8c7-4b68-8e31-0d0f7e9ae0ec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:46.436938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1019ef1-c8c7-4b68-8e31-0d0f7e9ae0ec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:46.437370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1019ef1-c8c7-4b68-8e31-0d0f7e9ae0ec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:46.527065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-04e48074-2d83-4a9e-9e8d-ba2d07c90a60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:46.544653 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-04e48074-2d83-4a9e-9e8d-ba2d07c90a60 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1523 microversion: 2.1 time: 1.775602 Oct 12 22:24:46.563035 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2465/5533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:44 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1523 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:46.876603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c1019ef1-c8c7-4b68-8e31-0d0f7e9ae0ec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:46.888151 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c1019ef1-c8c7-4b68-8e31-0d0f7e9ae0ec tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1308 microversion: 2.1 time: 0.471627 Oct 12 22:24:46.890745 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3069/5534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:46 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1308 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:47.575017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a8b40c51-fc37-4fc8-aaf9-307f0deef4af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:47.577086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a8b40c51-fc37-4fc8-aaf9-307f0deef4af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:47.607782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8b40c51-fc37-4fc8-aaf9-307f0deef4af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:47.610729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8b40c51-fc37-4fc8-aaf9-307f0deef4af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:47.611810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8b40c51-fc37-4fc8-aaf9-307f0deef4af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:47.616248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8b40c51-fc37-4fc8-aaf9-307f0deef4af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:47.618807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8b40c51-fc37-4fc8-aaf9-307f0deef4af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:47.619669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8b40c51-fc37-4fc8-aaf9-307f0deef4af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:47.684899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-97880100-95f8-48ca-b9df-1925927ee540 req-53e99ffb-28d8-44ba-93db-d23e70dbcc6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7013657e-c4d1-4af9-b593-b891d2d1c66b", "name": "network-vif-deleted", "tag": "aa91f8c1-414a-41aa-a5f3-ac7cbe6b2ab9"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:47.705778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:47.734998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-97880100-95f8-48ca-b9df-1925927ee540 req-53e99ffb-28d8-44ba-93db-d23e70dbcc6e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:47.735661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-97880100-95f8-48ca-b9df-1925927ee540 req-53e99ffb-28d8-44ba-93db-d23e70dbcc6e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:47.737023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-97880100-95f8-48ca-b9df-1925927ee540 req-53e99ffb-28d8-44ba-93db-d23e70dbcc6e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:47.782336 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-97880100-95f8-48ca-b9df-1925927ee540 req-53e99ffb-28d8-44ba-93db-d23e70dbcc6e service nova] Creating event network-vif-deleted:aa91f8c1-414a-41aa-a5f3-ac7cbe6b2ab9 for instance 7013657e-c4d1-4af9-b593-b891d2d1c66b on n-h2-861111-1 Oct 12 22:24:47.802988 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-97880100-95f8-48ca-b9df-1925927ee540 req-53e99ffb-28d8-44ba-93db-d23e70dbcc6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116499 Oct 12 22:24:47.808250 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3070/5535] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:47.871892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a8b40c51-fc37-4fc8-aaf9-307f0deef4af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:47.891640 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a8b40c51-fc37-4fc8-aaf9-307f0deef4af tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1481 microversion: 2.1 time: 0.324141 Oct 12 22:24:47.896685 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2466/5536] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:47 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1481 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:47.919902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f39f4cca-97e5-4779-81f1-2e9e9d8421b9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:47.920839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f39f4cca-97e5-4779-81f1-2e9e9d8421b9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:47.935003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f39f4cca-97e5-4779-81f1-2e9e9d8421b9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:47.935544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f39f4cca-97e5-4779-81f1-2e9e9d8421b9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:47.935997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f39f4cca-97e5-4779-81f1-2e9e9d8421b9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:47.939701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f39f4cca-97e5-4779-81f1-2e9e9d8421b9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:47.940253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f39f4cca-97e5-4779-81f1-2e9e9d8421b9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:47.940710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f39f4cca-97e5-4779-81f1-2e9e9d8421b9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:48.475945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f39f4cca-97e5-4779-81f1-2e9e9d8421b9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:48.493787 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f39f4cca-97e5-4779-81f1-2e9e9d8421b9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1308 microversion: 2.1 time: 0.585067 Oct 12 22:24:48.508983 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3071/5537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:47 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1308 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:48.925532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d080edc0-35b2-442c-a907-fea2087609f9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:48.926314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d080edc0-35b2-442c-a907-fea2087609f9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:48.941375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d080edc0-35b2-442c-a907-fea2087609f9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:48.942036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d080edc0-35b2-442c-a907-fea2087609f9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:48.942548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d080edc0-35b2-442c-a907-fea2087609f9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:48.943357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d080edc0-35b2-442c-a907-fea2087609f9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:48.943962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d080edc0-35b2-442c-a907-fea2087609f9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:48.946228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d080edc0-35b2-442c-a907-fea2087609f9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:49.115159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d080edc0-35b2-442c-a907-fea2087609f9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:49.135549 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d080edc0-35b2-442c-a907-fea2087609f9 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1481 microversion: 2.1 time: 0.214823 Oct 12 22:24:49.153125 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2467/5538] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:48 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1481 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:49.532520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-37369d71-277e-4453-a677-6114c10de818 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:49.546298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-37369d71-277e-4453-a677-6114c10de818 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:49.576316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37369d71-277e-4453-a677-6114c10de818 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:49.578737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37369d71-277e-4453-a677-6114c10de818 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:49.579205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37369d71-277e-4453-a677-6114c10de818 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:49.580241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37369d71-277e-4453-a677-6114c10de818 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:49.584168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37369d71-277e-4453-a677-6114c10de818 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:49.584849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37369d71-277e-4453-a677-6114c10de818 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:50.161568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-02af7dd3-7cab-4665-8beb-cc4a8c9a1551 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:50.162455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-02af7dd3-7cab-4665-8beb-cc4a8c9a1551 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:50.174000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02af7dd3-7cab-4665-8beb-cc4a8c9a1551 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:50.176231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02af7dd3-7cab-4665-8beb-cc4a8c9a1551 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:50.177758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02af7dd3-7cab-4665-8beb-cc4a8c9a1551 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:50.178570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02af7dd3-7cab-4665-8beb-cc4a8c9a1551 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:50.180582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02af7dd3-7cab-4665-8beb-cc4a8c9a1551 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:50.183089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02af7dd3-7cab-4665-8beb-cc4a8c9a1551 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:50.231773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-37369d71-277e-4453-a677-6114c10de818 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:50.241773 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-37369d71-277e-4453-a677-6114c10de818 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1308 microversion: 2.1 time: 0.720838 Oct 12 22:24:50.248648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02af7dd3-7cab-4665-8beb-cc4a8c9a1551 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:50.249402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02af7dd3-7cab-4665-8beb-cc4a8c9a1551 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:50.250177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02af7dd3-7cab-4665-8beb-cc4a8c9a1551 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:50.250632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-02af7dd3-7cab-4665-8beb-cc4a8c9a1551 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lazy-loading 'fault' on Instance uuid 7013657e-c4d1-4af9-b593-b891d2d1c66b {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:24:50.260127 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3072/5539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:49 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1308 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:50.341898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-02af7dd3-7cab-4665-8beb-cc4a8c9a1551 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afec4a3808b84463900b744ecd9352b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c4d9f435a4c009bd0b5eb2618829b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:50.368628 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-02af7dd3-7cab-4665-8beb-cc4a8c9a1551 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 200 len: 1312 microversion: 2.1 time: 0.211073 Oct 12 22:24:50.369868 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2468/5540] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:50 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 1312 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:51.267794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-12bb6bc8-a2d2-44d9-b814-d54365edd21a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:51.269323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-12bb6bc8-a2d2-44d9-b814-d54365edd21a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:51.281470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12bb6bc8-a2d2-44d9-b814-d54365edd21a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:51.287410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12bb6bc8-a2d2-44d9-b814-d54365edd21a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:51.288322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12bb6bc8-a2d2-44d9-b814-d54365edd21a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:51.290848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12bb6bc8-a2d2-44d9-b814-d54365edd21a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:51.292733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12bb6bc8-a2d2-44d9-b814-d54365edd21a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:51.294476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12bb6bc8-a2d2-44d9-b814-d54365edd21a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:51.394083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7513f3fb-73e7-4e6a-a23f-77edfed60de1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:51.394688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7513f3fb-73e7-4e6a-a23f-77edfed60de1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] [instance: 7013657e-c4d1-4af9-b593-b891d2d1c66b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:51.410649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7513f3fb-73e7-4e6a-a23f-77edfed60de1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:51.411203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7513f3fb-73e7-4e6a-a23f-77edfed60de1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:51.411700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7513f3fb-73e7-4e6a-a23f-77edfed60de1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:51.412416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7513f3fb-73e7-4e6a-a23f-77edfed60de1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:51.416660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7513f3fb-73e7-4e6a-a23f-77edfed60de1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:51.417151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7513f3fb-73e7-4e6a-a23f-77edfed60de1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:51.450128 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-7513f3fb-73e7-4e6a-a23f-77edfed60de1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] HTTP exception thrown: Instance 7013657e-c4d1-4af9-b593-b891d2d1c66b could not be found. Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7513f3fb-73e7-4e6a-a23f-77edfed60de1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Request method failure captured: Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b HTTP/1.1 Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz1yYv3BEuyn16aX9rFnQkuXp35mHqXE7bVOWKfvxNZXNT7qw6co-FDMauTgJfMPQCxmiEKAu0kzyjnis87qTpfUYp96yN_F6sfmIZnSLJLUbYy9WREcLUGhzXNPjj1UORIJx3lHLMBoOzDKf1JzqCDKyG4PBpXcEQzC9GdyMUjXkpQ Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0a0c4d9f435a4c009bd0b5eb2618829b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0a0c4d9f435a4c009bd0b5eb2618829b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 0a0c4d9f435a4c009bd0b5eb2618829b Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1975319326 Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: afec4a3808b84463900b744ecd9352b6 Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1975319326-project Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 7013657e-c4d1-4af9-b593-b891d2d1c66b could not be found. Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '7013657e-c4d1-4af9-b593-b891d2d1c66b'} Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7013657e-c4d1-4af9-b593-b891d2d1c66b could not be found. Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7013657e-c4d1-4af9-b593-b891d2d1c66b could not be found. Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:51.456447 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:51.461310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:51.461310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:51.461310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:51.461310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:51.461310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:24:51.461310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:24:51.461310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7013657e-c4d1-4af9-b593-b891d2d1c66b could not be found. Oct 12 22:24:51.461310 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:24:51.463716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7513f3fb-73e7-4e6a-a23f-77edfed60de1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] Returning 404 to user: Instance 7013657e-c4d1-4af9-b593-b891d2d1c66b could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:24:51.464826 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7513f3fb-73e7-4e6a-a23f-77edfed60de1 tempest-ServerRescueNegativeTestJSON-1975319326 tempest-ServerRescueNegativeTestJSON-1975319326-project] 10.222.0.16 "GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b" status: 404 len: 111 microversion: 2.1 time: 0.074708 Oct 12 22:24:51.474073 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2469/5541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:51 2022] GET /compute/v2.1/servers/7013657e-c4d1-4af9-b593-b891d2d1c66b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:24:51.684419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-12bb6bc8-a2d2-44d9-b814-d54365edd21a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:51.692578 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-12bb6bc8-a2d2-44d9-b814-d54365edd21a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1308 microversion: 2.1 time: 0.428902 Oct 12 22:24:51.703996 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3073/5542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:51 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1308 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:51.738524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aa0cb156-022b-45ef-bdf1-a6dfc16f7b00 tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] Action: 'create', calling method: .version_select at 0x7f5128ca5a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-709053315", "metadata": {"Type": "work"}}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:52.502606 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-aa0cb156-022b-45ef-bdf1-a6dfc16f7b00 tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.026999 Oct 12 22:24:52.508169 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2470/5543] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 12 22:24:51 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1033 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 12 22:24:52.520192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-34a63772-a37e-4a58-93a9-cbce20c860a3 tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] Calling method '.version_select at 0x7f51234b4d30>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:52.704491 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-34a63772-a37e-4a58-93a9-cbce20c860a3 tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431" status: 200 len: 352 microversion: 2.1 time: 0.188314 Oct 12 22:24:52.705081 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3074/5544] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:24:52 2022] GET /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431 => generated 352 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:24:52.731109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7b2dc9e7-6a35-4a04-aa6c-fa67f3edf644 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:52.732205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7b2dc9e7-6a35-4a04-aa6c-fa67f3edf644 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:52.742694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b2dc9e7-6a35-4a04-aa6c-fa67f3edf644 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:52.743661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b2dc9e7-6a35-4a04-aa6c-fa67f3edf644 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:52.744337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b2dc9e7-6a35-4a04-aa6c-fa67f3edf644 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:52.746020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b2dc9e7-6a35-4a04-aa6c-fa67f3edf644 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:52.746730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b2dc9e7-6a35-4a04-aa6c-fa67f3edf644 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:52.748120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b2dc9e7-6a35-4a04-aa6c-fa67f3edf644 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:53.018654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-611a2785-33ab-440e-b765-92c158dcf75a req-a11c157b-7124-4f95-b0a5-36e3a5fb5ffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "665dc72f-f961-4a0b-b2cd-61828dc07c99", "name": "network-vif-plugged", "status": "completed", "tag": "49cdb1f0-2b3d-47f0-a80f-0038c1d0f408"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:24:53.037912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-611a2785-33ab-440e-b765-92c158dcf75a req-a11c157b-7124-4f95-b0a5-36e3a5fb5ffa service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:53.038949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-611a2785-33ab-440e-b765-92c158dcf75a req-a11c157b-7124-4f95-b0a5-36e3a5fb5ffa service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:53.039736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-611a2785-33ab-440e-b765-92c158dcf75a req-a11c157b-7124-4f95-b0a5-36e3a5fb5ffa service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:53.110664 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-611a2785-33ab-440e-b765-92c158dcf75a req-a11c157b-7124-4f95-b0a5-36e3a5fb5ffa service nova] Creating event network-vif-plugged:49cdb1f0-2b3d-47f0-a80f-0038c1d0f408 for instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 on n-h2-861111-1 Oct 12 22:24:53.146587 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-611a2785-33ab-440e-b765-92c158dcf75a req-a11c157b-7124-4f95-b0a5-36e3a5fb5ffa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132259 Oct 12 22:24:53.147286 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3075/5545] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:24:53.721338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-68a50488-1d68-4d4c-9290-e541e3b4a51c tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] Calling method '.version_select at 0x7f5128553f70>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:53.855552 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-68a50488-1d68-4d4c-9290-e541e3b4a51c tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431" status: 200 len: 352 microversion: 2.1 time: 0.139194 Oct 12 22:24:53.856347 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3076/5546] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:24:53 2022] GET /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431 => generated 352 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:54.147478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7b2dc9e7-6a35-4a04-aa6c-fa67f3edf644 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:54.157785 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7b2dc9e7-6a35-4a04-aa6c-fa67f3edf644 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1308 microversion: 2.1 time: 1.432903 Oct 12 22:24:54.158372 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2471/5547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:52 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1308 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:54.872126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-17bc0daf-f52d-4214-afb1-d97bfb2efb3a tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] Calling method '.version_select at 0x7f512826c550>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:54.952895 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-17bc0daf-f52d-4214-afb1-d97bfb2efb3a tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431" status: 200 len: 353 microversion: 2.1 time: 0.085726 Oct 12 22:24:54.954844 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3077/5548] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:24:54 2022] GET /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:54.969559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-51e9a4db-4ef6-4c33-9b70-3ad24aba70bf tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] Calling method '.version_select at 0x7f51283400d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:55.027271 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-51e9a4db-4ef6-4c33-9b70-3ad24aba70bf tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431" status: 200 len: 353 microversion: 2.1 time: 0.063129 Oct 12 22:24:55.031031 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2472/5549] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:24:54 2022] GET /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:24:55.048107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f8394ae6-1013-4cce-8136-06a47e342abe tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] Calling method '.version_select at 0x7f51234293a0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:55.129595 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f8394ae6-1013-4cce-8136-06a47e342abe tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431" status: 202 len: 0 microversion: 2.1 time: 0.085073 Oct 12 22:24:55.132670 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3078/5550] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 22:24:55 2022] DELETE /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:24:55.142469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd5ec44b-4758-4de7-9c89-2ba90b7d8991 tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] Calling method '.version_select at 0x7f512395ce50>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:55.187579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bd23143a-f346-4ee2-9c88-7502eaedda81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:55.188473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bd23143a-f346-4ee2-9c88-7502eaedda81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:55.200215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd23143a-f346-4ee2-9c88-7502eaedda81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:55.200722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd23143a-f346-4ee2-9c88-7502eaedda81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:55.201183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd23143a-f346-4ee2-9c88-7502eaedda81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:55.201896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd23143a-f346-4ee2-9c88-7502eaedda81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:55.205518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd23143a-f346-4ee2-9c88-7502eaedda81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:55.205993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd23143a-f346-4ee2-9c88-7502eaedda81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:55.211560 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cd5ec44b-4758-4de7-9c89-2ba90b7d8991 tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431" status: 200 len: 352 microversion: 2.1 time: 0.076344 Oct 12 22:24:55.224529 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2473/5551] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:24:55 2022] GET /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431 => generated 352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:55.897486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bd23143a-f346-4ee2-9c88-7502eaedda81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:55.912078 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bd23143a-f346-4ee2-9c88-7502eaedda81 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1308 microversion: 2.1 time: 0.728789 Oct 12 22:24:55.912992 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3079/5552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:55 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1308 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:56.228462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-90dcf570-e2eb-4637-a760-2131b47a28f6 tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] Calling method '.version_select at 0x7f51287449d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:56.366988 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-90dcf570-e2eb-4637-a760-2131b47a28f6 tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431" status: 200 len: 352 microversion: 2.1 time: 0.144694 Oct 12 22:24:56.374364 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2474/5553] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:24:56 2022] GET /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431 => generated 352 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:24:56.937957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4871e71c-908e-4667-b845-ce653bace93f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:56.938595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4871e71c-908e-4667-b845-ce653bace93f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:56.964587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4871e71c-908e-4667-b845-ce653bace93f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:56.966709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4871e71c-908e-4667-b845-ce653bace93f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:56.975105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4871e71c-908e-4667-b845-ce653bace93f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:56.975920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4871e71c-908e-4667-b845-ce653bace93f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:56.976410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4871e71c-908e-4667-b845-ce653bace93f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:56.976855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4871e71c-908e-4667-b845-ce653bace93f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:57.383278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e21e6fb3-fb0e-448c-8da5-0d6db35a4e7f tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] Calling method '.version_select at 0x7f51238e8700>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:57.491411 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e21e6fb3-fb0e-448c-8da5-0d6db35a4e7f tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431" status: 200 len: 352 microversion: 2.1 time: 0.113757 Oct 12 22:24:57.498358 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2475/5554] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:24:57 2022] GET /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431 => generated 352 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:24:57.874109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4871e71c-908e-4667-b845-ce653bace93f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:57.890288 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4871e71c-908e-4667-b845-ce653bace93f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1488 microversion: 2.1 time: 0.956779 Oct 12 22:24:57.891981 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3080/5555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:56 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1488 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:57.914703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-08944126-5cd4-4291-a055-98fe52ff4049 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:57.915351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-08944126-5cd4-4291-a055-98fe52ff4049 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:57.930701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08944126-5cd4-4291-a055-98fe52ff4049 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:57.931209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08944126-5cd4-4291-a055-98fe52ff4049 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:57.931711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08944126-5cd4-4291-a055-98fe52ff4049 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:57.932441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08944126-5cd4-4291-a055-98fe52ff4049 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:57.932898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08944126-5cd4-4291-a055-98fe52ff4049 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:57.933332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08944126-5cd4-4291-a055-98fe52ff4049 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:57.936402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=94 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:24:58.507147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5198de1f-8801-445e-8940-fb74f793ef7e tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] Calling method '.version_select at 0x7f512840b790>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:58.626072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-08944126-5cd4-4291-a055-98fe52ff4049 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:58.639827 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-5198de1f-8801-445e-8940-fb74f793ef7e tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] HTTP exception thrown: Volume bea401c3-cd07-4b59-baf1-28f79a4ac431 could not be found. Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5198de1f-8801-445e-8940-fb74f793ef7e tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] Request method failure captured: Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431 HTTP/1.1 Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz6zR5lsQgdfedJdQpC34pTQM3UyLNhIAasQlipmaKJdXMiwQ7-wFuZH-Nn10IEJgVWxjpvAg7a8rFEFYIx2ZsMTUj5PONDwU1JVOfw4Xgx9Kk0Z5nchaIB9Ti8XhDdhg4Q1EztJqZSuVocZuKz1-ljqRz6GximhyPF4vMDNfxVVtEU Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 0be3356e21e5475f834e9fd9d08c402e Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-VolumesGetTestJSON-1631419443 Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0be3356e21e5475f834e9fd9d08c402e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0be3356e21e5475f834e9fd9d08c402e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0be3356e21e5475f834e9fd9d08c402e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0be3356e21e5475f834e9fd9d08c402e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-VolumesGetTestJSON-1631419443 Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 0be3356e21e5475f834e9fd9d08c402e Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-VolumesGetTestJSON-1631419443 Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-VolumesGetTestJSON-1631419443-project Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: c652b563555b429db71c0fbae1adc735 Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-VolumesGetTestJSON-1631419443-project Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: method: Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: exception: Volume bea401c3-cd07-4b59-baf1-28f79a4ac431 could not be found. Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'bea401c3-cd07-4b59-baf1-28f79a4ac431'} Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bea401c3-cd07-4b59-baf1-28f79a4ac431 could not be found. (HTTP 404) (Request-ID: req-e65fa695-6d9c-43cc-9bf9-c9143d74a0d5) Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 22:24:58.642061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bea401c3-cd07-4b59-baf1-28f79a4ac431 could not be found. Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bea401c3-cd07-4b59-baf1-28f79a4ac431 could not be found. Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bea401c3-cd07-4b59-baf1-28f79a4ac431 could not be found. Oct 12 22:24:58.648032 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:24:58.654906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5198de1f-8801-445e-8940-fb74f793ef7e tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] Returning 404 to user: Volume bea401c3-cd07-4b59-baf1-28f79a4ac431 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:24:58.654906 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5198de1f-8801-445e-8940-fb74f793ef7e tempest-VolumesGetTestJSON-1631419443 tempest-VolumesGetTestJSON-1631419443-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431" status: 404 len: 109 microversion: 2.1 time: 0.151380 Oct 12 22:24:58.659397 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3081/5556] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:24:58 2022] GET /compute/v2.1/os-volumes/bea401c3-cd07-4b59-baf1-28f79a4ac431 => generated 109 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:24:58.662094 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-08944126-5cd4-4291-a055-98fe52ff4049 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1488 microversion: 2.1 time: 0.750973 Oct 12 22:24:58.663228 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2476/5557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:57 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1488 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:58.688545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4ac97302-5259-4838-9b70-958a084040d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:58.690632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4ac97302-5259-4838-9b70-958a084040d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:58.709851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ac97302-5259-4838-9b70-958a084040d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:58.710355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ac97302-5259-4838-9b70-958a084040d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:58.722887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ac97302-5259-4838-9b70-958a084040d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:58.724235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ac97302-5259-4838-9b70-958a084040d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:58.731354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ac97302-5259-4838-9b70-958a084040d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:58.735071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ac97302-5259-4838-9b70-958a084040d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:59.328479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4ac97302-5259-4838-9b70-958a084040d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:24:59.355377 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4ac97302-5259-4838-9b70-958a084040d7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1488 microversion: 2.1 time: 0.670175 Oct 12 22:24:59.367268 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3082/5558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:58 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1488 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:24:59.394969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9310d133-deb5-4a18-b6e9-85a5783239da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:59.395590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9310d133-deb5-4a18-b6e9-85a5783239da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:59.403022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9310d133-deb5-4a18-b6e9-85a5783239da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:59.403498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9310d133-deb5-4a18-b6e9-85a5783239da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:59.403916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9310d133-deb5-4a18-b6e9-85a5783239da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:59.404633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9310d133-deb5-4a18-b6e9-85a5783239da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:59.405084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9310d133-deb5-4a18-b6e9-85a5783239da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:59.405515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9310d133-deb5-4a18-b6e9-85a5783239da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:59.490751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9310d133-deb5-4a18-b6e9-85a5783239da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:24:59.660049 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9310d133-deb5-4a18-b6e9-85a5783239da tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 204 len: 0 microversion: 2.1 time: 0.280751 Oct 12 22:24:59.661208 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2477/5559] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:24:59 2022] DELETE /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:24:59.669768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c2846ab9-ab21-4467-bcb3-a1acee51ac1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:24:59.670565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c2846ab9-ab21-4467-bcb3-a1acee51ac1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:24:59.686405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2846ab9-ab21-4467-bcb3-a1acee51ac1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:59.687673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2846ab9-ab21-4467-bcb3-a1acee51ac1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:59.700498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2846ab9-ab21-4467-bcb3-a1acee51ac1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:24:59.701796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2846ab9-ab21-4467-bcb3-a1acee51ac1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:24:59.702919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2846ab9-ab21-4467-bcb3-a1acee51ac1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:24:59.705518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c2846ab9-ab21-4467-bcb3-a1acee51ac1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:00.104314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c2846ab9-ab21-4467-bcb3-a1acee51ac1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:00.117637 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c2846ab9-ab21-4467-bcb3-a1acee51ac1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1494 microversion: 2.1 time: 0.449518 Oct 12 22:25:00.118278 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3083/5560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:24:59 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1494 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:01.149881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0cddcfef-ed7d-4165-b2d7-93a23823be93 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:01.150588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0cddcfef-ed7d-4165-b2d7-93a23823be93 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:01.168972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cddcfef-ed7d-4165-b2d7-93a23823be93 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:01.169723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cddcfef-ed7d-4165-b2d7-93a23823be93 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:01.170329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cddcfef-ed7d-4165-b2d7-93a23823be93 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:01.171881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cddcfef-ed7d-4165-b2d7-93a23823be93 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:01.172898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cddcfef-ed7d-4165-b2d7-93a23823be93 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:01.173907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cddcfef-ed7d-4165-b2d7-93a23823be93 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:02.119526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0cddcfef-ed7d-4165-b2d7-93a23823be93 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:02.136995 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0cddcfef-ed7d-4165-b2d7-93a23823be93 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1494 microversion: 2.1 time: 0.993424 Oct 12 22:25:02.139848 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2478/5561] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:01 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1494 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:03.130880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-2dd18b78-1c41-47bb-8990-c9067336ba0a req-97fa04b6-2662-4f18-9016-1f77c66fbffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "665dc72f-f961-4a0b-b2cd-61828dc07c99", "name": "network-vif-deleted", "tag": "49cdb1f0-2b3d-47f0-a80f-0038c1d0f408"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:25:03.166629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4f439081-08b3-4581-992b-61fb5f755f7a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:03.168029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4f439081-08b3-4581-992b-61fb5f755f7a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:03.183354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f439081-08b3-4581-992b-61fb5f755f7a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:03.186378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f439081-08b3-4581-992b-61fb5f755f7a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:03.187778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f439081-08b3-4581-992b-61fb5f755f7a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:03.191579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f439081-08b3-4581-992b-61fb5f755f7a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:03.192872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f439081-08b3-4581-992b-61fb5f755f7a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:03.193776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f439081-08b3-4581-992b-61fb5f755f7a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:03.219960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2dd18b78-1c41-47bb-8990-c9067336ba0a req-97fa04b6-2662-4f18-9016-1f77c66fbffa service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:03.221063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2dd18b78-1c41-47bb-8990-c9067336ba0a req-97fa04b6-2662-4f18-9016-1f77c66fbffa service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:03.221513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2dd18b78-1c41-47bb-8990-c9067336ba0a req-97fa04b6-2662-4f18-9016-1f77c66fbffa service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:03.272890 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-2dd18b78-1c41-47bb-8990-c9067336ba0a req-97fa04b6-2662-4f18-9016-1f77c66fbffa service nova] Creating event network-vif-deleted:49cdb1f0-2b3d-47f0-a80f-0038c1d0f408 for instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 on n-h2-861111-1 Oct 12 22:25:03.292508 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-2dd18b78-1c41-47bb-8990-c9067336ba0a req-97fa04b6-2662-4f18-9016-1f77c66fbffa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167919 Oct 12 22:25:03.296241 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3084/5562] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:25:03.324974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4f439081-08b3-4581-992b-61fb5f755f7a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:03.337471 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4f439081-08b3-4581-992b-61fb5f755f7a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 200 len: 1293 microversion: 2.1 time: 0.175024 Oct 12 22:25:03.338380 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2479/5563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:03 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 1293 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:04.362309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-61e41859-020f-4f6c-8b9b-384a334f9ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:04.363041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-61e41859-020f-4f6c-8b9b-384a334f9ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:04.377528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61e41859-020f-4f6c-8b9b-384a334f9ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:04.378238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61e41859-020f-4f6c-8b9b-384a334f9ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:04.378899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61e41859-020f-4f6c-8b9b-384a334f9ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:04.379979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61e41859-020f-4f6c-8b9b-384a334f9ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:04.383908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61e41859-020f-4f6c-8b9b-384a334f9ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:04.384610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61e41859-020f-4f6c-8b9b-384a334f9ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:04.414192 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-61e41859-020f-4f6c-8b9b-384a334f9ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-61e41859-020f-4f6c-8b9b-384a334f9ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 HTTP/1.1 Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '665dc72f-f961-4a0b-b2cd-61828dc07c99'} Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:25:04.421158 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:25:04.427919 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:25:04.427919 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:25:04.427919 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:25:04.427919 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:25:04.427919 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. Oct 12 22:25:04.427919 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:25:04.427919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-61e41859-020f-4f6c-8b9b-384a334f9ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:25:04.427919 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-61e41859-020f-4f6c-8b9b-384a334f9ac4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 404 len: 111 microversion: 2.1 time: 0.065704 Oct 12 22:25:04.427919 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3085/5564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:04 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:25:04.439845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-853aa11e-8943-40ce-8397-91f8cee9d612 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:04.442176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-853aa11e-8943-40ce-8397-91f8cee9d612 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:04.453297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-853aa11e-8943-40ce-8397-91f8cee9d612 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:04.458444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-853aa11e-8943-40ce-8397-91f8cee9d612 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:04.459102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-853aa11e-8943-40ce-8397-91f8cee9d612 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:04.460233 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-853aa11e-8943-40ce-8397-91f8cee9d612 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:04.460869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-853aa11e-8943-40ce-8397-91f8cee9d612 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:04.461919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-853aa11e-8943-40ce-8397-91f8cee9d612 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:04.525166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-853aa11e-8943-40ce-8397-91f8cee9d612 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:25:04.728633 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-853aa11e-8943-40ce-8397-91f8cee9d612 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 204 len: 0 microversion: 2.1 time: 0.295326 Oct 12 22:25:04.730240 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2480/5565] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:25:04 2022] DELETE /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:25:04.738378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-79b2f59a-4af3-4d80-83a1-29f03e808689 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:04.739032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-79b2f59a-4af3-4d80-83a1-29f03e808689 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:04.755200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b2f59a-4af3-4d80-83a1-29f03e808689 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:04.756094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b2f59a-4af3-4d80-83a1-29f03e808689 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:04.756933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b2f59a-4af3-4d80-83a1-29f03e808689 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:04.757924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b2f59a-4af3-4d80-83a1-29f03e808689 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:04.758611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b2f59a-4af3-4d80-83a1-29f03e808689 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:04.759279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b2f59a-4af3-4d80-83a1-29f03e808689 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:05.147617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-79b2f59a-4af3-4d80-83a1-29f03e808689 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:05.169648 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-79b2f59a-4af3-4d80-83a1-29f03e808689 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1494 microversion: 2.1 time: 0.434782 Oct 12 22:25:05.185558 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3086/5566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:04 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1494 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:06.207280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6be23a26-cec0-4771-b05d-c1ea3eaf49f4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:06.209552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6be23a26-cec0-4771-b05d-c1ea3eaf49f4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:06.240360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be23a26-cec0-4771-b05d-c1ea3eaf49f4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:06.244786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be23a26-cec0-4771-b05d-c1ea3eaf49f4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:06.248646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be23a26-cec0-4771-b05d-c1ea3eaf49f4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:06.252655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be23a26-cec0-4771-b05d-c1ea3eaf49f4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:06.260418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be23a26-cec0-4771-b05d-c1ea3eaf49f4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:06.261705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be23a26-cec0-4771-b05d-c1ea3eaf49f4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:06.963327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6be23a26-cec0-4771-b05d-c1ea3eaf49f4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:06.977724 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6be23a26-cec0-4771-b05d-c1ea3eaf49f4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1494 microversion: 2.1 time: 0.782967 Oct 12 22:25:06.980790 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2481/5567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:06 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1494 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:07.617347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a2100944-606b-4804-992b-20fb91e85d37 req-e3a638eb-f209-40bd-ac84-86fcfda9aa52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84af030c-67a9-47bb-826e-b414ea7857b5", "name": "network-vif-deleted", "tag": "f510efd3-db76-43e0-a733-fec32383c0b9"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:25:07.650775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a2100944-606b-4804-992b-20fb91e85d37 req-e3a638eb-f209-40bd-ac84-86fcfda9aa52 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:07.654851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a2100944-606b-4804-992b-20fb91e85d37 req-e3a638eb-f209-40bd-ac84-86fcfda9aa52 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:07.655840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a2100944-606b-4804-992b-20fb91e85d37 req-e3a638eb-f209-40bd-ac84-86fcfda9aa52 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:07.679171 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a2100944-606b-4804-992b-20fb91e85d37 req-e3a638eb-f209-40bd-ac84-86fcfda9aa52 service nova] Creating event network-vif-deleted:f510efd3-db76-43e0-a733-fec32383c0b9 for instance 84af030c-67a9-47bb-826e-b414ea7857b5 on n-h1-861111-1 Oct 12 22:25:07.700014 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a2100944-606b-4804-992b-20fb91e85d37 req-e3a638eb-f209-40bd-ac84-86fcfda9aa52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119074 Oct 12 22:25:07.701077 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3087/5568] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:25:08.005811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8868f4e0-12bc-4ff2-9963-d227ba214d8f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:08.006561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8868f4e0-12bc-4ff2-9963-d227ba214d8f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:08.027161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8868f4e0-12bc-4ff2-9963-d227ba214d8f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:08.032886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8868f4e0-12bc-4ff2-9963-d227ba214d8f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:08.033826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8868f4e0-12bc-4ff2-9963-d227ba214d8f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:08.046860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8868f4e0-12bc-4ff2-9963-d227ba214d8f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:08.059331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8868f4e0-12bc-4ff2-9963-d227ba214d8f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:08.060131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8868f4e0-12bc-4ff2-9963-d227ba214d8f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:08.181639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8868f4e0-12bc-4ff2-9963-d227ba214d8f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:08.185688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8868f4e0-12bc-4ff2-9963-d227ba214d8f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:08.186540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8868f4e0-12bc-4ff2-9963-d227ba214d8f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:08.191832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-8868f4e0-12bc-4ff2-9963-d227ba214d8f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lazy-loading 'fault' on Instance uuid 84af030c-67a9-47bb-826e-b414ea7857b5 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:25:08.272584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8868f4e0-12bc-4ff2-9963-d227ba214d8f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:08.283018 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8868f4e0-12bc-4ff2-9963-d227ba214d8f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 200 len: 1298 microversion: 2.1 time: 0.282039 Oct 12 22:25:08.287048 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2482/5569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:07 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 1298 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:09.313657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-38d4fb1d-4c95-4b1d-b75b-42347054c78a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:09.314303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-38d4fb1d-4c95-4b1d-b75b-42347054c78a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:09.335180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38d4fb1d-4c95-4b1d-b75b-42347054c78a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:09.343960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38d4fb1d-4c95-4b1d-b75b-42347054c78a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:09.344607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38d4fb1d-4c95-4b1d-b75b-42347054c78a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:09.345519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38d4fb1d-4c95-4b1d-b75b-42347054c78a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:09.348333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38d4fb1d-4c95-4b1d-b75b-42347054c78a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:09.359764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38d4fb1d-4c95-4b1d-b75b-42347054c78a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:09.396725 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-38d4fb1d-4c95-4b1d-b75b-42347054c78a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-38d4fb1d-4c95-4b1d-b75b-42347054c78a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 HTTP/1.1 Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '84af030c-67a9-47bb-826e-b414ea7857b5'} Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:25:09.398423 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:25:09.408132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:25:09.408132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:25:09.408132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:25:09.408132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:25:09.408132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. Oct 12 22:25:09.408132 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:25:09.408132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-38d4fb1d-4c95-4b1d-b75b-42347054c78a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:25:09.416266 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-38d4fb1d-4c95-4b1d-b75b-42347054c78a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 404 len: 111 microversion: 2.1 time: 0.107276 Oct 12 22:25:09.420020 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3088/5570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:09 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:25:09.774187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-874686848", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "36f67723-f632-42aa-bcd9-cfd1c5f07f45"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:25:09.880672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] validate_networks() for [('36f67723-f632-42aa-bcd9-cfd1c5f07f45', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:25:12.248294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:25:12.248917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:25:12.249411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:25:12.249973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:25:12.251112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:25:12.276211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:12.276897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:12.277344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:12.277914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:12.278401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:12.278880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:12.354096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for project 8276c235e518406da376c8a4c19b27d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:25:12.369828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for user 789a612b19154564a853199a67ea8496 and project 8276c235e518406da376c8a4c19b27d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:25:12.407821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:25:12.412814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:25:12.532953 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4030169a-7cfb-434a-a066-d7ed1cceedaf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.761770 Oct 12 22:25:12.536333 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2483/5571] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:25:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:25:12.547553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0ce1e1c6-a301-49ff-af58-db6f6aa045be tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:12.548304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0ce1e1c6-a301-49ff-af58-db6f6aa045be tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:12.888367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0ce1e1c6-a301-49ff-af58-db6f6aa045be tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:12.901163 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0ce1e1c6-a301-49ff-af58-db6f6aa045be tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1208 microversion: 2.1 time: 0.356595 Oct 12 22:25:12.902236 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3089/5572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:12 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1208 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:13.929862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3b153505-3706-44c9-94d1-2a7298123754 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:13.931897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3b153505-3706-44c9-94d1-2a7298123754 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:13.939641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:25:14.036012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3b153505-3706-44c9-94d1-2a7298123754 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:14.048541 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3b153505-3706-44c9-94d1-2a7298123754 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1208 microversion: 2.1 time: 0.127286 Oct 12 22:25:14.049436 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2484/5573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:13 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1208 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:25:15.075562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f488c894-b833-4ff5-b894-6f6b9b0be9f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:15.077258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f488c894-b833-4ff5-b894-6f6b9b0be9f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:15.091475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f488c894-b833-4ff5-b894-6f6b9b0be9f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:15.094087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f488c894-b833-4ff5-b894-6f6b9b0be9f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:15.094985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f488c894-b833-4ff5-b894-6f6b9b0be9f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:15.096319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f488c894-b833-4ff5-b894-6f6b9b0be9f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:15.098477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f488c894-b833-4ff5-b894-6f6b9b0be9f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:15.099173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f488c894-b833-4ff5-b894-6f6b9b0be9f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:15.151078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=76 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:25:15.711298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f488c894-b833-4ff5-b894-6f6b9b0be9f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:15.727998 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f488c894-b833-4ff5-b894-6f6b9b0be9f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1268 microversion: 2.1 time: 0.654340 Oct 12 22:25:15.728655 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3090/5574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:15 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1268 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:16.752723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dc5c0a94-e607-4cc6-9316-808ae18c1553 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:16.753345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dc5c0a94-e607-4cc6-9316-808ae18c1553 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:16.767924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc5c0a94-e607-4cc6-9316-808ae18c1553 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:16.768328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc5c0a94-e607-4cc6-9316-808ae18c1553 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:16.768776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc5c0a94-e607-4cc6-9316-808ae18c1553 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:16.780562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc5c0a94-e607-4cc6-9316-808ae18c1553 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:16.781070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc5c0a94-e607-4cc6-9316-808ae18c1553 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:16.781515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc5c0a94-e607-4cc6-9316-808ae18c1553 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:16.973820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dc5c0a94-e607-4cc6-9316-808ae18c1553 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:16.981877 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dc5c0a94-e607-4cc6-9316-808ae18c1553 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1266 microversion: 2.1 time: 0.233706 Oct 12 22:25:16.993254 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2485/5575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:16 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:18.018503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9a65d423-ed10-4153-baf9-4be55b212aa3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:18.022602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9a65d423-ed10-4153-baf9-4be55b212aa3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:18.035637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=34 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:25:18.045563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a65d423-ed10-4153-baf9-4be55b212aa3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:18.050170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a65d423-ed10-4153-baf9-4be55b212aa3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:18.054054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a65d423-ed10-4153-baf9-4be55b212aa3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:18.055104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a65d423-ed10-4153-baf9-4be55b212aa3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:18.055911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a65d423-ed10-4153-baf9-4be55b212aa3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:18.056579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a65d423-ed10-4153-baf9-4be55b212aa3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:18.354463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9a65d423-ed10-4153-baf9-4be55b212aa3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:18.375750 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9a65d423-ed10-4153-baf9-4be55b212aa3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1266 microversion: 2.1 time: 0.358995 Oct 12 22:25:18.376606 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3091/5576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:18 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1266 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:19.402078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6de2cef5-0f8f-438e-8246-57cd908d851a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:19.402867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6de2cef5-0f8f-438e-8246-57cd908d851a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:19.440606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de2cef5-0f8f-438e-8246-57cd908d851a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:19.441392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de2cef5-0f8f-438e-8246-57cd908d851a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:19.441934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de2cef5-0f8f-438e-8246-57cd908d851a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:19.448357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de2cef5-0f8f-438e-8246-57cd908d851a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:19.450301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de2cef5-0f8f-438e-8246-57cd908d851a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:19.452860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de2cef5-0f8f-438e-8246-57cd908d851a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:19.866911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6de2cef5-0f8f-438e-8246-57cd908d851a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:19.877566 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6de2cef5-0f8f-438e-8246-57cd908d851a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1308 microversion: 2.1 time: 0.479651 Oct 12 22:25:19.893328 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2486/5577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:19 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1308 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:20.908448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fcd97c37-944a-40ff-ac4d-834dab54675f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:20.910284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fcd97c37-944a-40ff-ac4d-834dab54675f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:20.933916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd97c37-944a-40ff-ac4d-834dab54675f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:20.934557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd97c37-944a-40ff-ac4d-834dab54675f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:20.937263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd97c37-944a-40ff-ac4d-834dab54675f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:20.938293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd97c37-944a-40ff-ac4d-834dab54675f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:20.944034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd97c37-944a-40ff-ac4d-834dab54675f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:20.945416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcd97c37-944a-40ff-ac4d-834dab54675f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:21.370042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fcd97c37-944a-40ff-ac4d-834dab54675f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:21.382255 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fcd97c37-944a-40ff-ac4d-834dab54675f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1308 microversion: 2.1 time: 0.481227 Oct 12 22:25:21.396983 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3092/5578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:20 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1308 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:22.410275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8ac77614-e183-4a5f-a296-77a6532ec994 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:22.411597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8ac77614-e183-4a5f-a296-77a6532ec994 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:22.415145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:25:22.433419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ac77614-e183-4a5f-a296-77a6532ec994 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:22.433933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ac77614-e183-4a5f-a296-77a6532ec994 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:22.434386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ac77614-e183-4a5f-a296-77a6532ec994 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:22.435108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ac77614-e183-4a5f-a296-77a6532ec994 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:22.438295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ac77614-e183-4a5f-a296-77a6532ec994 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:22.439627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ac77614-e183-4a5f-a296-77a6532ec994 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:23.506268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-8179f020-d495-4998-9875-bb401f800f0e req-04c70a58-7862-4f28-b527-5009622f1ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "942b1e4a-53ac-41ac-ab30-f92f68e11447", "tag": "321557b1-1871-4dfc-9cc3-95cb543ff6ef"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:25:23.537314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:25:23.543693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8179f020-d495-4998-9875-bb401f800f0e req-04c70a58-7862-4f28-b527-5009622f1ee1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:23.544559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8179f020-d495-4998-9875-bb401f800f0e req-04c70a58-7862-4f28-b527-5009622f1ee1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:23.545619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8179f020-d495-4998-9875-bb401f800f0e req-04c70a58-7862-4f28-b527-5009622f1ee1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:23.574230 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-8179f020-d495-4998-9875-bb401f800f0e req-04c70a58-7862-4f28-b527-5009622f1ee1 service nova] Creating event network-changed:321557b1-1871-4dfc-9cc3-95cb543ff6ef for instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 on n-h1-861111-1 Oct 12 22:25:23.583527 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-8179f020-d495-4998-9875-bb401f800f0e req-04c70a58-7862-4f28-b527-5009622f1ee1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083203 Oct 12 22:25:23.584897 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3093/5579] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:25:23.890631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8ac77614-e183-4a5f-a296-77a6532ec994 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:23.900147 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8ac77614-e183-4a5f-a296-77a6532ec994 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1308 microversion: 2.1 time: 1.495620 Oct 12 22:25:23.903369 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2487/5580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:22 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1308 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:24.932193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0ae54c78-0c60-4c0d-bfbc-b5ed86ed5f56 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:24.933093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0ae54c78-0c60-4c0d-bfbc-b5ed86ed5f56 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:24.962061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ae54c78-0c60-4c0d-bfbc-b5ed86ed5f56 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:24.973535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ae54c78-0c60-4c0d-bfbc-b5ed86ed5f56 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:24.974280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ae54c78-0c60-4c0d-bfbc-b5ed86ed5f56 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:24.978430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ae54c78-0c60-4c0d-bfbc-b5ed86ed5f56 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:24.979614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ae54c78-0c60-4c0d-bfbc-b5ed86ed5f56 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:24.982383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ae54c78-0c60-4c0d-bfbc-b5ed86ed5f56 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:25.182391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0ae54c78-0c60-4c0d-bfbc-b5ed86ed5f56 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:25.192044 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0ae54c78-0c60-4c0d-bfbc-b5ed86ed5f56 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1308 microversion: 2.1 time: 0.265932 Oct 12 22:25:25.192655 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3094/5581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:24 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1308 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:26.218367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d8df3e63-262b-481b-b0e4-ba03c24a1005 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:26.218979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d8df3e63-262b-481b-b0e4-ba03c24a1005 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:26.222707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:25:26.257696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8df3e63-262b-481b-b0e4-ba03c24a1005 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:26.258874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8df3e63-262b-481b-b0e4-ba03c24a1005 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:26.259510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8df3e63-262b-481b-b0e4-ba03c24a1005 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:26.261349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8df3e63-262b-481b-b0e4-ba03c24a1005 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:26.263837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8df3e63-262b-481b-b0e4-ba03c24a1005 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:26.264347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8df3e63-262b-481b-b0e4-ba03c24a1005 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:27.270654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d8df3e63-262b-481b-b0e4-ba03c24a1005 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:27.289056 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d8df3e63-262b-481b-b0e4-ba03c24a1005 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1308 microversion: 2.1 time: 1.075535 Oct 12 22:25:27.290372 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2488/5582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:26 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1308 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:28.313113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c0ee185c-5967-4dc7-ac90-54da0f4ff587 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:28.315486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c0ee185c-5967-4dc7-ac90-54da0f4ff587 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:28.332356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0ee185c-5967-4dc7-ac90-54da0f4ff587 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:28.333076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0ee185c-5967-4dc7-ac90-54da0f4ff587 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:28.333718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0ee185c-5967-4dc7-ac90-54da0f4ff587 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:28.336074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0ee185c-5967-4dc7-ac90-54da0f4ff587 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:28.336750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0ee185c-5967-4dc7-ac90-54da0f4ff587 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:28.338445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0ee185c-5967-4dc7-ac90-54da0f4ff587 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:28.706712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-637781119", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "6969ac61-797c-4d56-9b52-5a14ecbec7cc"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:25:28.886498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] validate_networks() for [('6969ac61-797c-4d56-9b52-5a14ecbec7cc', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:25:29.220847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c0ee185c-5967-4dc7-ac90-54da0f4ff587 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:29.241522 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c0ee185c-5967-4dc7-ac90-54da0f4ff587 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1308 microversion: 2.1 time: 0.928641 Oct 12 22:25:29.244462 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3095/5583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:28 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1308 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:30.269425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c3ea145d-14ea-4af2-840f-47347657c74d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:30.270062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c3ea145d-14ea-4af2-840f-47347657c74d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:30.280158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3ea145d-14ea-4af2-840f-47347657c74d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:30.281015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3ea145d-14ea-4af2-840f-47347657c74d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:30.289639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3ea145d-14ea-4af2-840f-47347657c74d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:30.291839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3ea145d-14ea-4af2-840f-47347657c74d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:30.295811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3ea145d-14ea-4af2-840f-47347657c74d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:30.296460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3ea145d-14ea-4af2-840f-47347657c74d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:30.918333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:25:30.918936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:25:30.919512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:25:30.919931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:25:30.920487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:25:30.952823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:30.955616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:30.959547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:30.962024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:30.962689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:30.964511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:31.001063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:25:31.037559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Getting quotas for project 680ec414f20440e2b21a9af8795764b4. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:25:31.054797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Getting quotas for user 4ebc899eeb0040b795ec64bd043e4769 and project 680ec414f20440e2b21a9af8795764b4. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:25:31.099142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:25:31.105992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:25:31.324021 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7b5e134e-3e22-4b50-a7b7-354636aed44b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.945231 Oct 12 22:25:31.330830 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2489/5584] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 22:25:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2952 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 12 22:25:31.349512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0f3f1325-30fc-4458-9407-c71e3594a9e4 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:31.353312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0f3f1325-30fc-4458-9407-c71e3594a9e4 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:31.363522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c3ea145d-14ea-4af2-840f-47347657c74d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:31.371609 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c3ea145d-14ea-4af2-840f-47347657c74d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1308 microversion: 2.1 time: 1.106023 Oct 12 22:25:31.372206 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3096/5585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:30 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1308 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:25:31.809696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0f3f1325-30fc-4458-9407-c71e3594a9e4 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:31.826194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0f3f1325-30fc-4458-9407-c71e3594a9e4 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:31.832999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0f3f1325-30fc-4458-9407-c71e3594a9e4 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:31.841676 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0f3f1325-30fc-4458-9407-c71e3594a9e4 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5" status: 200 len: 1261 microversion: 2.26 time: 0.505404 Oct 12 22:25:31.842489 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2490/5586] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:25:31 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 => generated 1261 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:25:32.401017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4c945854-a150-4b6a-85c8-0df724f354b7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:32.402257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4c945854-a150-4b6a-85c8-0df724f354b7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:32.413960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c945854-a150-4b6a-85c8-0df724f354b7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:32.419231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c945854-a150-4b6a-85c8-0df724f354b7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:32.419717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c945854-a150-4b6a-85c8-0df724f354b7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:32.420576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c945854-a150-4b6a-85c8-0df724f354b7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:32.421090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c945854-a150-4b6a-85c8-0df724f354b7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:32.421534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c945854-a150-4b6a-85c8-0df724f354b7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:32.873456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-70fe70a7-0e2e-44c8-9342-acd3305c1c03 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:32.875108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-70fe70a7-0e2e-44c8-9342-acd3305c1c03 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:32.906665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70fe70a7-0e2e-44c8-9342-acd3305c1c03 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:32.908269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70fe70a7-0e2e-44c8-9342-acd3305c1c03 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:32.913631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70fe70a7-0e2e-44c8-9342-acd3305c1c03 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:32.915571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70fe70a7-0e2e-44c8-9342-acd3305c1c03 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:32.917359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70fe70a7-0e2e-44c8-9342-acd3305c1c03 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:32.919948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70fe70a7-0e2e-44c8-9342-acd3305c1c03 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:33.175273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-70fe70a7-0e2e-44c8-9342-acd3305c1c03 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:33.193456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-70fe70a7-0e2e-44c8-9342-acd3305c1c03 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:33.195664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-70fe70a7-0e2e-44c8-9342-acd3305c1c03 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:33.221491 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-70fe70a7-0e2e-44c8-9342-acd3305c1c03 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5" status: 200 len: 1257 microversion: 2.26 time: 0.337329 Oct 12 22:25:33.228768 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2491/5587] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:25:32 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 => generated 1257 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:25:33.403518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4c945854-a150-4b6a-85c8-0df724f354b7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:33.415839 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4c945854-a150-4b6a-85c8-0df724f354b7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1308 microversion: 2.1 time: 1.018549 Oct 12 22:25:33.433053 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3097/5588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:32 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1308 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:34.272072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f1767f16-1572-46fc-92a2-285d604f8065 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:34.277436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f1767f16-1572-46fc-92a2-285d604f8065 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:34.304292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1767f16-1572-46fc-92a2-285d604f8065 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:34.305484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1767f16-1572-46fc-92a2-285d604f8065 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:34.306100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1767f16-1572-46fc-92a2-285d604f8065 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:34.308141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1767f16-1572-46fc-92a2-285d604f8065 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:34.312292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1767f16-1572-46fc-92a2-285d604f8065 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:34.315789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1767f16-1572-46fc-92a2-285d604f8065 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:34.451183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3155eff0-4647-4af4-a7c6-cb4da9e8dcc9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:34.451951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3155eff0-4647-4af4-a7c6-cb4da9e8dcc9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:34.466582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3155eff0-4647-4af4-a7c6-cb4da9e8dcc9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:34.467085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3155eff0-4647-4af4-a7c6-cb4da9e8dcc9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:34.467551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3155eff0-4647-4af4-a7c6-cb4da9e8dcc9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:34.468269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3155eff0-4647-4af4-a7c6-cb4da9e8dcc9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:34.468719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3155eff0-4647-4af4-a7c6-cb4da9e8dcc9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:34.469143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3155eff0-4647-4af4-a7c6-cb4da9e8dcc9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:34.605691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f1767f16-1572-46fc-92a2-285d604f8065 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:34.615917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f1767f16-1572-46fc-92a2-285d604f8065 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:34.644810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f1767f16-1572-46fc-92a2-285d604f8065 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:34.649140 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f1767f16-1572-46fc-92a2-285d604f8065 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5" status: 200 len: 1319 microversion: 2.26 time: 0.382487 Oct 12 22:25:34.658735 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2492/5589] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:25:34 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:25:35.117628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3155eff0-4647-4af4-a7c6-cb4da9e8dcc9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:35.139433 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3155eff0-4647-4af4-a7c6-cb4da9e8dcc9 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1308 microversion: 2.1 time: 0.691913 Oct 12 22:25:35.144539 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3098/5590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:34 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1308 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:35.688892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dfb8bd8a-4f87-4e64-a2e3-5e7d43cad582 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:35.690982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dfb8bd8a-4f87-4e64-a2e3-5e7d43cad582 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:35.711274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfb8bd8a-4f87-4e64-a2e3-5e7d43cad582 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:35.713121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfb8bd8a-4f87-4e64-a2e3-5e7d43cad582 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:35.713827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfb8bd8a-4f87-4e64-a2e3-5e7d43cad582 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:35.720094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfb8bd8a-4f87-4e64-a2e3-5e7d43cad582 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:35.720794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfb8bd8a-4f87-4e64-a2e3-5e7d43cad582 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:35.721253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfb8bd8a-4f87-4e64-a2e3-5e7d43cad582 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:35.971169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dfb8bd8a-4f87-4e64-a2e3-5e7d43cad582 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:35.993196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dfb8bd8a-4f87-4e64-a2e3-5e7d43cad582 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:35.997937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dfb8bd8a-4f87-4e64-a2e3-5e7d43cad582 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:36.000849 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dfb8bd8a-4f87-4e64-a2e3-5e7d43cad582 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5" status: 200 len: 1319 microversion: 2.26 time: 0.318467 Oct 12 22:25:36.031533 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2493/5591] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:25:35 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:25:36.173554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-63c6c51d-0e2d-4d54-9b0f-b367b1567a52 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:36.175662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-63c6c51d-0e2d-4d54-9b0f-b367b1567a52 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:36.193404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63c6c51d-0e2d-4d54-9b0f-b367b1567a52 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:36.194004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63c6c51d-0e2d-4d54-9b0f-b367b1567a52 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:36.195899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63c6c51d-0e2d-4d54-9b0f-b367b1567a52 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:36.197630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63c6c51d-0e2d-4d54-9b0f-b367b1567a52 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:36.199189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63c6c51d-0e2d-4d54-9b0f-b367b1567a52 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:36.200039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63c6c51d-0e2d-4d54-9b0f-b367b1567a52 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:36.937249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-63c6c51d-0e2d-4d54-9b0f-b367b1567a52 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:36.947076 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-63c6c51d-0e2d-4d54-9b0f-b367b1567a52 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1308 microversion: 2.1 time: 0.777773 Oct 12 22:25:36.951474 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3099/5592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:36 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1308 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:37.029039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9a5cc394-dfb0-42d8-ae78-82a4cebd9e9f tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:37.029773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9a5cc394-dfb0-42d8-ae78-82a4cebd9e9f tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:37.041746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a5cc394-dfb0-42d8-ae78-82a4cebd9e9f tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:37.046166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a5cc394-dfb0-42d8-ae78-82a4cebd9e9f tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:37.046929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a5cc394-dfb0-42d8-ae78-82a4cebd9e9f tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:37.047936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a5cc394-dfb0-42d8-ae78-82a4cebd9e9f tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:37.048759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a5cc394-dfb0-42d8-ae78-82a4cebd9e9f tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:37.049589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a5cc394-dfb0-42d8-ae78-82a4cebd9e9f tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:37.675222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9a5cc394-dfb0-42d8-ae78-82a4cebd9e9f tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:37.690692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9a5cc394-dfb0-42d8-ae78-82a4cebd9e9f tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:37.696251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9a5cc394-dfb0-42d8-ae78-82a4cebd9e9f tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:37.699174 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9a5cc394-dfb0-42d8-ae78-82a4cebd9e9f tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5" status: 200 len: 1361 microversion: 2.26 time: 0.672848 Oct 12 22:25:37.721750 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3100/5593] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:25:37 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 => generated 1361 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:25:37.773358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d533abd6-8af9-4f41-a742-42068ea4f929 req-fa6588d8-9088-4ebe-8b26-0a418e811838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942b1e4a-53ac-41ac-ab30-f92f68e11447", "name": "network-vif-plugged", "status": "completed", "tag": "321557b1-1871-4dfc-9cc3-95cb543ff6ef"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:25:37.802489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d533abd6-8af9-4f41-a742-42068ea4f929 req-fa6588d8-9088-4ebe-8b26-0a418e811838 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:37.816930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d533abd6-8af9-4f41-a742-42068ea4f929 req-fa6588d8-9088-4ebe-8b26-0a418e811838 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:37.820800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d533abd6-8af9-4f41-a742-42068ea4f929 req-fa6588d8-9088-4ebe-8b26-0a418e811838 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:37.858460 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d533abd6-8af9-4f41-a742-42068ea4f929 req-fa6588d8-9088-4ebe-8b26-0a418e811838 service nova] Creating event network-vif-plugged:321557b1-1871-4dfc-9cc3-95cb543ff6ef for instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 on n-h1-861111-1 Oct 12 22:25:37.881801 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d533abd6-8af9-4f41-a742-42068ea4f929 req-fa6588d8-9088-4ebe-8b26-0a418e811838 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.112696 Oct 12 22:25:37.889638 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2494/5594] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:25:37.982316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c7081497-246b-45ab-afb9-5ea5be4de401 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:37.983010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c7081497-246b-45ab-afb9-5ea5be4de401 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:37.995641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7081497-246b-45ab-afb9-5ea5be4de401 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:37.996182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7081497-246b-45ab-afb9-5ea5be4de401 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:37.996576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7081497-246b-45ab-afb9-5ea5be4de401 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:38.001171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7081497-246b-45ab-afb9-5ea5be4de401 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:38.005506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7081497-246b-45ab-afb9-5ea5be4de401 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:38.008613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7081497-246b-45ab-afb9-5ea5be4de401 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:38.847594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c7081497-246b-45ab-afb9-5ea5be4de401 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:38.859845 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c7081497-246b-45ab-afb9-5ea5be4de401 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1308 microversion: 2.1 time: 0.881385 Oct 12 22:25:38.874277 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3101/5595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:37 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1308 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:38.886383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-283d4fa6-5d1b-4ac4-8a94-96f57af612da tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:38.887338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-283d4fa6-5d1b-4ac4-8a94-96f57af612da tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:38.896913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-283d4fa6-5d1b-4ac4-8a94-96f57af612da tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:38.897615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-283d4fa6-5d1b-4ac4-8a94-96f57af612da tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:38.898325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-283d4fa6-5d1b-4ac4-8a94-96f57af612da tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:38.899280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-283d4fa6-5d1b-4ac4-8a94-96f57af612da tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:38.899964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-283d4fa6-5d1b-4ac4-8a94-96f57af612da tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:38.900639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-283d4fa6-5d1b-4ac4-8a94-96f57af612da tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:39.024285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-ee87105d-ab0d-4cf1-8fa4-94fb634d97cf req-6a201a2a-6bb4-4ffc-b05b-68f66b7c81bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c996267-ca3a-45d3-bc9f-90a6cbe95cc5", "tag": "44f7d6f8-2412-47ed-bffe-9d59214053ef"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:25:39.048872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ee87105d-ab0d-4cf1-8fa4-94fb634d97cf req-6a201a2a-6bb4-4ffc-b05b-68f66b7c81bf service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:39.052942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ee87105d-ab0d-4cf1-8fa4-94fb634d97cf req-6a201a2a-6bb4-4ffc-b05b-68f66b7c81bf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:39.054625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ee87105d-ab0d-4cf1-8fa4-94fb634d97cf req-6a201a2a-6bb4-4ffc-b05b-68f66b7c81bf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:39.084218 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-ee87105d-ab0d-4cf1-8fa4-94fb634d97cf req-6a201a2a-6bb4-4ffc-b05b-68f66b7c81bf service nova] Creating event network-changed:44f7d6f8-2412-47ed-bffe-9d59214053ef for instance 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 on n-h2-861111-1 Oct 12 22:25:39.101707 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-ee87105d-ab0d-4cf1-8fa4-94fb634d97cf req-6a201a2a-6bb4-4ffc-b05b-68f66b7c81bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.732836 Oct 12 22:25:39.105636 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2495/5596] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:25:39.330280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-283d4fa6-5d1b-4ac4-8a94-96f57af612da tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:39.352802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-283d4fa6-5d1b-4ac4-8a94-96f57af612da tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:39.354573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-283d4fa6-5d1b-4ac4-8a94-96f57af612da tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:39.361415 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-283d4fa6-5d1b-4ac4-8a94-96f57af612da tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5" status: 200 len: 1361 microversion: 2.26 time: 0.480188 Oct 12 22:25:39.362703 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3102/5597] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:25:38 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 => generated 1361 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:25:39.893724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-39396b26-c14e-4953-bd56-ffdafa02dbfd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:39.894600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-39396b26-c14e-4953-bd56-ffdafa02dbfd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:39.915859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39396b26-c14e-4953-bd56-ffdafa02dbfd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:39.919889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39396b26-c14e-4953-bd56-ffdafa02dbfd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:39.927055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39396b26-c14e-4953-bd56-ffdafa02dbfd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:39.928345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39396b26-c14e-4953-bd56-ffdafa02dbfd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:39.931931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39396b26-c14e-4953-bd56-ffdafa02dbfd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:39.932735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39396b26-c14e-4953-bd56-ffdafa02dbfd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:40.388050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-39396b26-c14e-4953-bd56-ffdafa02dbfd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:40.391005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-382ffd1c-aedd-4895-b861-59761c187da5 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:40.392734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-382ffd1c-aedd-4895-b861-59761c187da5 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:40.405730 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-39396b26-c14e-4953-bd56-ffdafa02dbfd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1489 microversion: 2.1 time: 0.519891 Oct 12 22:25:40.407070 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2496/5598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:39 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1489 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:40.413164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-382ffd1c-aedd-4895-b861-59761c187da5 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:40.416867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-382ffd1c-aedd-4895-b861-59761c187da5 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:40.417538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-382ffd1c-aedd-4895-b861-59761c187da5 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:40.418498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-382ffd1c-aedd-4895-b861-59761c187da5 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:40.421655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-382ffd1c-aedd-4895-b861-59761c187da5 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:40.423336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-382ffd1c-aedd-4895-b861-59761c187da5 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:40.441951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fba65ffe-221f-43ce-8a88-2825acc8ffc1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:25:40.456343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fba65ffe-221f-43ce-8a88-2825acc8ffc1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:40.481722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fba65ffe-221f-43ce-8a88-2825acc8ffc1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:40.484852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fba65ffe-221f-43ce-8a88-2825acc8ffc1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:40.485333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fba65ffe-221f-43ce-8a88-2825acc8ffc1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:40.486066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fba65ffe-221f-43ce-8a88-2825acc8ffc1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:40.486536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fba65ffe-221f-43ce-8a88-2825acc8ffc1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:40.495639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fba65ffe-221f-43ce-8a88-2825acc8ffc1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:40.651506 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fba65ffe-221f-43ce-8a88-2825acc8ffc1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "PUT /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1084 microversion: 2.1 time: 0.211632 Oct 12 22:25:40.663538 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2497/5599] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 12 22:25:40 2022] PUT /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1084 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:40.672766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4b9fbd0f-e504-4a48-ab3a-4e07acee07a8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:40.673685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4b9fbd0f-e504-4a48-ab3a-4e07acee07a8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:40.688452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b9fbd0f-e504-4a48-ab3a-4e07acee07a8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:40.689216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b9fbd0f-e504-4a48-ab3a-4e07acee07a8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:40.689733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b9fbd0f-e504-4a48-ab3a-4e07acee07a8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:40.691150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b9fbd0f-e504-4a48-ab3a-4e07acee07a8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:40.691833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b9fbd0f-e504-4a48-ab3a-4e07acee07a8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:40.692484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b9fbd0f-e504-4a48-ab3a-4e07acee07a8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:40.839914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-382ffd1c-aedd-4895-b861-59761c187da5 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:40.861671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-382ffd1c-aedd-4895-b861-59761c187da5 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:40.864141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-382ffd1c-aedd-4895-b861-59761c187da5 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:40.866419 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-382ffd1c-aedd-4895-b861-59761c187da5 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5" status: 200 len: 1361 microversion: 2.26 time: 0.480136 Oct 12 22:25:40.870246 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3103/5600] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:25:40 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 => generated 1361 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:25:41.001715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:25:41.417312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4b9fbd0f-e504-4a48-ab3a-4e07acee07a8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:41.430819 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4b9fbd0f-e504-4a48-ab3a-4e07acee07a8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1510 microversion: 2.1 time: 0.762112 Oct 12 22:25:41.450540 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2498/5601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:40 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1510 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:41.462812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-74c113ca-af67-4585-ab9f-97eeac01a658 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:41.463882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-74c113ca-af67-4585-ab9f-97eeac01a658 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:41.478251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c113ca-af67-4585-ab9f-97eeac01a658 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:41.478763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c113ca-af67-4585-ab9f-97eeac01a658 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:41.479207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c113ca-af67-4585-ab9f-97eeac01a658 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:41.487295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c113ca-af67-4585-ab9f-97eeac01a658 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:41.487798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c113ca-af67-4585-ab9f-97eeac01a658 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:41.488267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c113ca-af67-4585-ab9f-97eeac01a658 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:41.900539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bb98d188-c66d-4192-852d-00aa764cb546 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:41.901167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bb98d188-c66d-4192-852d-00aa764cb546 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:41.905607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:25:41.922149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb98d188-c66d-4192-852d-00aa764cb546 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:41.923448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb98d188-c66d-4192-852d-00aa764cb546 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:41.923907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb98d188-c66d-4192-852d-00aa764cb546 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:41.929737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb98d188-c66d-4192-852d-00aa764cb546 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:41.930298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb98d188-c66d-4192-852d-00aa764cb546 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:41.930751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb98d188-c66d-4192-852d-00aa764cb546 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:42.227767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-74c113ca-af67-4585-ab9f-97eeac01a658 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:42.239446 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-74c113ca-af67-4585-ab9f-97eeac01a658 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1510 microversion: 2.1 time: 0.781584 Oct 12 22:25:42.241920 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3104/5602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:41 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1510 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:42.273594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5ac93415-9da9-43ae-be9e-8dacbb285434 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:42.275543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5ac93415-9da9-43ae-be9e-8dacbb285434 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:42.291291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac93415-9da9-43ae-be9e-8dacbb285434 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:42.292782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac93415-9da9-43ae-be9e-8dacbb285434 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:42.293657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac93415-9da9-43ae-be9e-8dacbb285434 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:42.295021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac93415-9da9-43ae-be9e-8dacbb285434 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:42.296270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac93415-9da9-43ae-be9e-8dacbb285434 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:42.297433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac93415-9da9-43ae-be9e-8dacbb285434 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:42.352200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5ac93415-9da9-43ae-be9e-8dacbb285434 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:25:42.566615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:25:42.669539 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5ac93415-9da9-43ae-be9e-8dacbb285434 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 204 len: 0 microversion: 2.1 time: 0.406211 Oct 12 22:25:42.670598 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3105/5603] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:25:42 2022] DELETE /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:25:42.680359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bb98d188-c66d-4192-852d-00aa764cb546 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:42.681268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e715003a-080e-4730-a127-61f6b50e686a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:42.681996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e715003a-080e-4730-a127-61f6b50e686a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:42.693560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bb98d188-c66d-4192-852d-00aa764cb546 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:42.694874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e715003a-080e-4730-a127-61f6b50e686a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:42.695042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bb98d188-c66d-4192-852d-00aa764cb546 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:42.698518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e715003a-080e-4730-a127-61f6b50e686a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:42.699217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e715003a-080e-4730-a127-61f6b50e686a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:42.699917 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bb98d188-c66d-4192-852d-00aa764cb546 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5" status: 200 len: 1361 microversion: 2.26 time: 0.804683 Oct 12 22:25:42.703343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e715003a-080e-4730-a127-61f6b50e686a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:42.703722 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2499/5604] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:25:41 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 => generated 1361 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:25:42.704515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e715003a-080e-4730-a127-61f6b50e686a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:42.704979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e715003a-080e-4730-a127-61f6b50e686a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:43.147101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e715003a-080e-4730-a127-61f6b50e686a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:43.162894 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e715003a-080e-4730-a127-61f6b50e686a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1516 microversion: 2.1 time: 0.485545 Oct 12 22:25:43.180304 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3106/5605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:42 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1516 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:43.739129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c6a8ed41-4fbc-43e8-865a-87aabf563661 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:43.740375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c6a8ed41-4fbc-43e8-865a-87aabf563661 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:43.751133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6a8ed41-4fbc-43e8-865a-87aabf563661 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:43.751813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6a8ed41-4fbc-43e8-865a-87aabf563661 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:43.753351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6a8ed41-4fbc-43e8-865a-87aabf563661 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:43.761801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6a8ed41-4fbc-43e8-865a-87aabf563661 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:43.763723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6a8ed41-4fbc-43e8-865a-87aabf563661 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:43.765176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6a8ed41-4fbc-43e8-865a-87aabf563661 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:44.098212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c6a8ed41-4fbc-43e8-865a-87aabf563661 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:44.111970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c6a8ed41-4fbc-43e8-865a-87aabf563661 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:44.113558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c6a8ed41-4fbc-43e8-865a-87aabf563661 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:44.114762 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c6a8ed41-4fbc-43e8-865a-87aabf563661 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5" status: 200 len: 1361 microversion: 2.26 time: 0.384006 Oct 12 22:25:44.133680 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2500/5606] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:25:43 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 => generated 1361 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:25:44.189163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-08162c53-049d-4f57-970c-f7120cb64084 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:44.191387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-08162c53-049d-4f57-970c-f7120cb64084 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:44.209114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08162c53-049d-4f57-970c-f7120cb64084 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:44.210681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08162c53-049d-4f57-970c-f7120cb64084 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:44.213959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08162c53-049d-4f57-970c-f7120cb64084 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:44.214948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08162c53-049d-4f57-970c-f7120cb64084 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:44.215938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08162c53-049d-4f57-970c-f7120cb64084 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:44.217935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08162c53-049d-4f57-970c-f7120cb64084 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:44.338411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-c77f60fa-411c-4773-85bc-72c7942bd0ee req-7719999f-3661-4ea2-85c5-f3a90acfa7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c996267-ca3a-45d3-bc9f-90a6cbe95cc5", "name": "network-vif-plugged", "status": "completed", "tag": "44f7d6f8-2412-47ed-bffe-9d59214053ef"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:25:44.357103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:25:44.384903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c77f60fa-411c-4773-85bc-72c7942bd0ee req-7719999f-3661-4ea2-85c5-f3a90acfa7d0 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:44.385400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c77f60fa-411c-4773-85bc-72c7942bd0ee req-7719999f-3661-4ea2-85c5-f3a90acfa7d0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:44.385861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c77f60fa-411c-4773-85bc-72c7942bd0ee req-7719999f-3661-4ea2-85c5-f3a90acfa7d0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:44.428139 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-c77f60fa-411c-4773-85bc-72c7942bd0ee req-7719999f-3661-4ea2-85c5-f3a90acfa7d0 service nova] Creating event network-vif-plugged:44f7d6f8-2412-47ed-bffe-9d59214053ef for instance 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 on n-h2-861111-1 Oct 12 22:25:44.446152 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-c77f60fa-411c-4773-85bc-72c7942bd0ee req-7719999f-3661-4ea2-85c5-f3a90acfa7d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111604 Oct 12 22:25:44.447196 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2501/5607] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:25:44.937714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-08162c53-049d-4f57-970c-f7120cb64084 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:44.953605 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-08162c53-049d-4f57-970c-f7120cb64084 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1516 microversion: 2.1 time: 0.769295 Oct 12 22:25:44.954457 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3107/5608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:44 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1516 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:45.156537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-18f762c7-2884-4c8d-a02c-bca33a065be8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:45.157250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-18f762c7-2884-4c8d-a02c-bca33a065be8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:45.167571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f762c7-2884-4c8d-a02c-bca33a065be8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:45.168069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f762c7-2884-4c8d-a02c-bca33a065be8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:45.168523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f762c7-2884-4c8d-a02c-bca33a065be8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:45.169284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f762c7-2884-4c8d-a02c-bca33a065be8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:45.170030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f762c7-2884-4c8d-a02c-bca33a065be8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:45.170466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18f762c7-2884-4c8d-a02c-bca33a065be8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:45.530692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-18f762c7-2884-4c8d-a02c-bca33a065be8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:45.541595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-18f762c7-2884-4c8d-a02c-bca33a065be8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:45.547175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-18f762c7-2884-4c8d-a02c-bca33a065be8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:45.552036 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-18f762c7-2884-4c8d-a02c-bca33a065be8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5" status: 200 len: 1361 microversion: 2.26 time: 0.405386 Oct 12 22:25:45.554145 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2502/5609] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:25:45 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 => generated 1361 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:25:45.987312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-264dcc56-9203-477e-a41b-c96262a17d5c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:45.988458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-264dcc56-9203-477e-a41b-c96262a17d5c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:46.003575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-264dcc56-9203-477e-a41b-c96262a17d5c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:46.008156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-264dcc56-9203-477e-a41b-c96262a17d5c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:46.011410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-264dcc56-9203-477e-a41b-c96262a17d5c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:46.020730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-264dcc56-9203-477e-a41b-c96262a17d5c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:46.024026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-264dcc56-9203-477e-a41b-c96262a17d5c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:46.026065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-264dcc56-9203-477e-a41b-c96262a17d5c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:46.280673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-bb5b5eb5-a38b-4431-b08e-fcc39902f8b4 req-4faebb39-33c5-49b0-81af-e98febfeb370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942b1e4a-53ac-41ac-ab30-f92f68e11447", "name": "network-vif-deleted", "tag": "321557b1-1871-4dfc-9cc3-95cb543ff6ef"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:25:46.306538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-bb5b5eb5-a38b-4431-b08e-fcc39902f8b4 req-4faebb39-33c5-49b0-81af-e98febfeb370 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:46.314530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-bb5b5eb5-a38b-4431-b08e-fcc39902f8b4 req-4faebb39-33c5-49b0-81af-e98febfeb370 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:46.315904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-bb5b5eb5-a38b-4431-b08e-fcc39902f8b4 req-4faebb39-33c5-49b0-81af-e98febfeb370 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:46.386324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-264dcc56-9203-477e-a41b-c96262a17d5c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:46.393133 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-bb5b5eb5-a38b-4431-b08e-fcc39902f8b4 req-4faebb39-33c5-49b0-81af-e98febfeb370 service nova] Creating event network-vif-deleted:321557b1-1871-4dfc-9cc3-95cb543ff6ef for instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 on n-h1-861111-1 Oct 12 22:25:46.413059 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-bb5b5eb5-a38b-4431-b08e-fcc39902f8b4 req-4faebb39-33c5-49b0-81af-e98febfeb370 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136977 Oct 12 22:25:46.419575 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-264dcc56-9203-477e-a41b-c96262a17d5c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 200 len: 1474 microversion: 2.1 time: 0.435383 Oct 12 22:25:46.420043 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2503/5610] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 12 22:25:46.423831 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3108/5611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:45 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 1474 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:46.591482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-399cb3b1-f5ca-4c90-a6be-83ebada2f688 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:46.593610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-399cb3b1-f5ca-4c90-a6be-83ebada2f688 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:46.613718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-399cb3b1-f5ca-4c90-a6be-83ebada2f688 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:46.620194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-399cb3b1-f5ca-4c90-a6be-83ebada2f688 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:46.621590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-399cb3b1-f5ca-4c90-a6be-83ebada2f688 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:46.622353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-399cb3b1-f5ca-4c90-a6be-83ebada2f688 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:46.625406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-399cb3b1-f5ca-4c90-a6be-83ebada2f688 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:46.626330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-399cb3b1-f5ca-4c90-a6be-83ebada2f688 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:46.979805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-399cb3b1-f5ca-4c90-a6be-83ebada2f688 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:46.992239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-399cb3b1-f5ca-4c90-a6be-83ebada2f688 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:46.998470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-399cb3b1-f5ca-4c90-a6be-83ebada2f688 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:47.003910 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-399cb3b1-f5ca-4c90-a6be-83ebada2f688 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5" status: 200 len: 1546 microversion: 2.26 time: 0.423266 Oct 12 22:25:47.004727 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2504/5612] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:25:46 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 => generated 1546 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:25:47.036870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f5128536430>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:47.059753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.076609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.080245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.088054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:47.097524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.097972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.106179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.112193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.113450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.114071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.180144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.181553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.185209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.211156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.211828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.212385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.253775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lazy-loading 'flavor' on Instance uuid 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:25:47.279768 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f75c0989-0f79-468a-baa3-1dc297056a3d tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "PUT /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags/tempest-tag-1161270769" status: 201 len: 0 microversion: 2.26 time: 0.246647 Oct 12 22:25:47.282239 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3109/5613] 10.222.0.16 () {62 vars in 1380 bytes} [Wed Oct 12 22:25:47 2022] PUT /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags/tempest-tag-1161270769 => generated 0 bytes in 250 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 12 22:25:47.301681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dd17cd2b-2eb0-4d18-b47d-46cf27b2df9e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f512c3bce50>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:47.331970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd17cd2b-2eb0-4d18-b47d-46cf27b2df9e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.334699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd17cd2b-2eb0-4d18-b47d-46cf27b2df9e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.335199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd17cd2b-2eb0-4d18-b47d-46cf27b2df9e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.383871 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dd17cd2b-2eb0-4d18-b47d-46cf27b2df9e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags/tempest-tag-1161270769" status: 204 len: 0 microversion: 2.26 time: 0.095624 Oct 12 22:25:47.393703 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2505/5614] 10.222.0.16 () {60 vars in 1361 bytes} [Wed Oct 12 22:25:47 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags/tempest-tag-1161270769 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:25:47.404799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5bcd2ff3-c7e0-496e-80a3-832cc351d6cc tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f512826cf70>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:47.415357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bcd2ff3-c7e0-496e-80a3-832cc351d6cc tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.416059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bcd2ff3-c7e0-496e-80a3-832cc351d6cc tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.416993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bcd2ff3-c7e0-496e-80a3-832cc351d6cc tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.417641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5bcd2ff3-c7e0-496e-80a3-832cc351d6cc tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:47.426444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bcd2ff3-c7e0-496e-80a3-832cc351d6cc tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.427263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bcd2ff3-c7e0-496e-80a3-832cc351d6cc tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.427713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bcd2ff3-c7e0-496e-80a3-832cc351d6cc tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.428434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bcd2ff3-c7e0-496e-80a3-832cc351d6cc tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.428895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bcd2ff3-c7e0-496e-80a3-832cc351d6cc tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.429696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bcd2ff3-c7e0-496e-80a3-832cc351d6cc tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.450259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6f75a480-bb53-4730-86ab-4e9f4d889516 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:47.450833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6f75a480-bb53-4730-86ab-4e9f4d889516 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:47.466728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f75a480-bb53-4730-86ab-4e9f4d889516 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.467276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f75a480-bb53-4730-86ab-4e9f4d889516 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.469596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f75a480-bb53-4730-86ab-4e9f4d889516 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.473249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f75a480-bb53-4730-86ab-4e9f4d889516 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.473992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f75a480-bb53-4730-86ab-4e9f4d889516 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.474286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f75a480-bb53-4730-86ab-4e9f4d889516 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.494790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bcd2ff3-c7e0-496e-80a3-832cc351d6cc tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.495484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bcd2ff3-c7e0-496e-80a3-832cc351d6cc tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.495928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5bcd2ff3-c7e0-496e-80a3-832cc351d6cc tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.501397 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-6f75a480-bb53-4730-86ab-4e9f4d889516 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6f75a480-bb53-4730-86ab-4e9f4d889516 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 HTTP/1.1 Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '942b1e4a-53ac-41ac-ab30-f92f68e11447'} Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:25:47.504242 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:25:47.508011 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:25:47.508011 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:25:47.508011 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:25:47.508011 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:25:47.508011 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. Oct 12 22:25:47.508011 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:25:47.509898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6f75a480-bb53-4730-86ab-4e9f4d889516 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:25:47.511674 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6f75a480-bb53-4730-86ab-4e9f4d889516 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 404 len: 111 microversion: 2.1 time: 0.065157 Oct 12 22:25:47.512938 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2506/5615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:47 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:25:47.532634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-5bcd2ff3-c7e0-496e-80a3-832cc351d6cc tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lazy-loading 'flavor' on Instance uuid 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:25:47.549816 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5bcd2ff3-c7e0-496e-80a3-832cc351d6cc tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags" status: 204 len: 0 microversion: 2.26 time: 0.150968 Oct 12 22:25:47.551114 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3110/5616] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Oct 12 22:25:47 2022] DELETE /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:25:47.584696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-82fdb304-fbc4-4066-a90f-93ac9adb0b11 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f51285aedc0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:47.595785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82fdb304-fbc4-4066-a90f-93ac9adb0b11 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.597317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82fdb304-fbc4-4066-a90f-93ac9adb0b11 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.598210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82fdb304-fbc4-4066-a90f-93ac9adb0b11 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.615683 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-82fdb304-fbc4-4066-a90f-93ac9adb0b11 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags" status: 200 len: 12 microversion: 2.26 time: 0.051320 Oct 12 22:25:47.617301 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2507/5617] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 12 22:25:47 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags => generated 12 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:47.628078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f51233a0550>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:47.637710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.638330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.638950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.639635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:47.647367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.648209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.648882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.649734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.650374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.650979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.682386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.683528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.684375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.699684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.700441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.701243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.757880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1288536261", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "36f67723-f632-42aa-bcd9-cfd1c5f07f45"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:25:47.773915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lazy-loading 'flavor' on Instance uuid 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:25:47.816862 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9cdf25c1-6d8e-47c8-ba6a-d8c201a4bea0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "PUT /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags/tempest-tag-983889792" status: 201 len: 0 microversion: 2.26 time: 0.193447 Oct 12 22:25:47.821789 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3111/5618] 10.222.0.16 () {62 vars in 1377 bytes} [Wed Oct 12 22:25:47 2022] PUT /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags/tempest-tag-983889792 => generated 0 bytes in 199 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 12 22:25:47.839980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0010f51b-e67f-496a-9f33-c67fbd31397b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f51234b4280>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:47.852460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] validate_networks() for [('36f67723-f632-42aa-bcd9-cfd1c5f07f45', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:25:47.860620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0010f51b-e67f-496a-9f33-c67fbd31397b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.861135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0010f51b-e67f-496a-9f33-c67fbd31397b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.863412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0010f51b-e67f-496a-9f33-c67fbd31397b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.885830 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0010f51b-e67f-496a-9f33-c67fbd31397b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags" status: 200 len: 35 microversion: 2.26 time: 0.055630 Oct 12 22:25:47.886999 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3112/5619] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 12 22:25:47 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags => generated 35 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:47.898380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d8872dab-3bd3-47ee-b305-3a7b0b95d2b7 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f512826c1f0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:47.917121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8872dab-3bd3-47ee-b305-3a7b0b95d2b7 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.917781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8872dab-3bd3-47ee-b305-3a7b0b95d2b7 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.918227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8872dab-3bd3-47ee-b305-3a7b0b95d2b7 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.920636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d8872dab-3bd3-47ee-b305-3a7b0b95d2b7 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:47.932121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8872dab-3bd3-47ee-b305-3a7b0b95d2b7 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.932626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8872dab-3bd3-47ee-b305-3a7b0b95d2b7 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.933066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8872dab-3bd3-47ee-b305-3a7b0b95d2b7 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.933782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8872dab-3bd3-47ee-b305-3a7b0b95d2b7 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.935992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8872dab-3bd3-47ee-b305-3a7b0b95d2b7 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.936659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8872dab-3bd3-47ee-b305-3a7b0b95d2b7 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:47.988103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8872dab-3bd3-47ee-b305-3a7b0b95d2b7 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:47.988595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8872dab-3bd3-47ee-b305-3a7b0b95d2b7 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:47.989034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8872dab-3bd3-47ee-b305-3a7b0b95d2b7 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.067100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-d8872dab-3bd3-47ee-b305-3a7b0b95d2b7 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lazy-loading 'flavor' on Instance uuid 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:25:48.105109 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d8872dab-3bd3-47ee-b305-3a7b0b95d2b7 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags/tempest-tag-983889792" status: 204 len: 0 microversion: 2.26 time: 0.211807 Oct 12 22:25:48.109244 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3113/5620] 10.222.0.16 () {60 vars in 1361 bytes} [Wed Oct 12 22:25:47 2022] DELETE /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags/tempest-tag-983889792 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 22:25:48.123127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-86f595e3-58ff-4d3b-94a7-491c32f4693a tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f512826cb80>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:48.137877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:25:48.146685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86f595e3-58ff-4d3b-94a7-491c32f4693a tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.150312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86f595e3-58ff-4d3b-94a7-491c32f4693a tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.169923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-86f595e3-58ff-4d3b-94a7-491c32f4693a tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.216552 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-86f595e3-58ff-4d3b-94a7-491c32f4693a tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags" status: 200 len: 12 microversion: 2.26 time: 0.088514 Oct 12 22:25:48.217693 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3114/5621] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 12 22:25:48 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags => generated 12 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:25:48.233421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5426ffd5-29e8-494f-bf0f-b6558a58ddd6 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f51234290d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:48.265830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5426ffd5-29e8-494f-bf0f-b6558a58ddd6 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.267306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5426ffd5-29e8-494f-bf0f-b6558a58ddd6 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.270309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5426ffd5-29e8-494f-bf0f-b6558a58ddd6 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.273955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5426ffd5-29e8-494f-bf0f-b6558a58ddd6 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:48.292371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5426ffd5-29e8-494f-bf0f-b6558a58ddd6 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.293884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5426ffd5-29e8-494f-bf0f-b6558a58ddd6 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.296577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5426ffd5-29e8-494f-bf0f-b6558a58ddd6 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.298115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5426ffd5-29e8-494f-bf0f-b6558a58ddd6 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.300647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5426ffd5-29e8-494f-bf0f-b6558a58ddd6 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.303537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5426ffd5-29e8-494f-bf0f-b6558a58ddd6 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.392147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5426ffd5-29e8-494f-bf0f-b6558a58ddd6 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.393540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5426ffd5-29e8-494f-bf0f-b6558a58ddd6 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.397219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5426ffd5-29e8-494f-bf0f-b6558a58ddd6 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.424761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-5426ffd5-29e8-494f-bf0f-b6558a58ddd6 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lazy-loading 'flavor' on Instance uuid 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:25:48.479670 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5426ffd5-29e8-494f-bf0f-b6558a58ddd6 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags" status: 204 len: 0 microversion: 2.26 time: 0.254189 Oct 12 22:25:48.480702 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3115/5622] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Oct 12 22:25:48 2022] DELETE /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:25:48.495574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f5123123040>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:48.509631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.510516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.511182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.512083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:48.521818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.522557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.523103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.523936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.526064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.526736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.569992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.570510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.571412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.586725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.587352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.588074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.602492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:25:48.630364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lazy-loading 'flavor' on Instance uuid 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:25:48.655173 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-408f3207-1455-4858-bfc9-51f2e1791c70 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "PUT /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags/tempest-tag-188478509" status: 201 len: 0 microversion: 2.26 time: 0.168517 Oct 12 22:25:48.656545 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3116/5623] 10.222.0.16 () {62 vars in 1377 bytes} [Wed Oct 12 22:25:48 2022] PUT /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags/tempest-tag-188478509 => generated 0 bytes in 171 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 12 22:25:48.672784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f5123469d30>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:48.694071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.694577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.695555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.696256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:48.706985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.707522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.708201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.708925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.709395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.709979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.749820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.750482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.751080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.790458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.791104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.791740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.848597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lazy-loading 'flavor' on Instance uuid 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:25:48.892101 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3fa603d5-cbf2-4a4f-afd4-1dd1b97f52c8 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "PUT /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags/tempest-tag-1453399168" status: 201 len: 0 microversion: 2.26 time: 0.224112 Oct 12 22:25:48.893554 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3117/5624] 10.222.0.16 () {62 vars in 1380 bytes} [Wed Oct 12 22:25:48 2022] PUT /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags/tempest-tag-1453399168 => generated 0 bytes in 229 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 12 22:25:48.919303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ee0ce08b-06dd-4637-9a6f-11ebd002c452 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f5123123280>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:48.925240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:25:48.926300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:25:48.926922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:25:48.928148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:25:48.928853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:25:48.929724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee0ce08b-06dd-4637-9a6f-11ebd002c452 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.930380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee0ce08b-06dd-4637-9a6f-11ebd002c452 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.930909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee0ce08b-06dd-4637-9a6f-11ebd002c452 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.931513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ee0ce08b-06dd-4637-9a6f-11ebd002c452 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:48.940917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee0ce08b-06dd-4637-9a6f-11ebd002c452 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.941660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee0ce08b-06dd-4637-9a6f-11ebd002c452 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.942356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee0ce08b-06dd-4637-9a6f-11ebd002c452 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.943805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee0ce08b-06dd-4637-9a6f-11ebd002c452 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.944816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee0ce08b-06dd-4637-9a6f-11ebd002c452 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.945395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.945831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee0ce08b-06dd-4637-9a6f-11ebd002c452 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.949182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.949661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.950469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.950946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.951517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.980841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee0ce08b-06dd-4637-9a6f-11ebd002c452 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:48.981695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee0ce08b-06dd-4637-9a6f-11ebd002c452 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:48.982419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee0ce08b-06dd-4637-9a6f-11ebd002c452 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:48.997358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for project 8276c235e518406da376c8a4c19b27d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:25:49.001597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-ee0ce08b-06dd-4637-9a6f-11ebd002c452 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lazy-loading 'flavor' on Instance uuid 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:25:49.012960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Getting quotas for user 789a612b19154564a853199a67ea8496 and project 8276c235e518406da376c8a4c19b27d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:25:49.022796 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ee0ce08b-06dd-4637-9a6f-11ebd002c452 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags" status: 204 len: 0 microversion: 2.26 time: 0.120690 Oct 12 22:25:49.025783 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3118/5625] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Oct 12 22:25:48 2022] DELETE /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:25:49.038560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:25:49.039219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-96f924e8-b800-4b2f-82b1-57dcccdcb57f tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f5123429e50>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:49.046550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:25:49.061072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96f924e8-b800-4b2f-82b1-57dcccdcb57f tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.061583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96f924e8-b800-4b2f-82b1-57dcccdcb57f tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.063173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96f924e8-b800-4b2f-82b1-57dcccdcb57f tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.091921 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-96f924e8-b800-4b2f-82b1-57dcccdcb57f tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags" status: 200 len: 12 microversion: 2.26 time: 0.060991 Oct 12 22:25:49.094679 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3119/5626] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 12 22:25:49 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags => generated 12 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:49.107439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-93154fc1-84dd-4187-bb1b-7752405c0c1e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f51233e53a0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:49.122315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93154fc1-84dd-4187-bb1b-7752405c0c1e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.122936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93154fc1-84dd-4187-bb1b-7752405c0c1e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.123402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93154fc1-84dd-4187-bb1b-7752405c0c1e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.123967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-93154fc1-84dd-4187-bb1b-7752405c0c1e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:49.132316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93154fc1-84dd-4187-bb1b-7752405c0c1e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.132955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93154fc1-84dd-4187-bb1b-7752405c0c1e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.133430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93154fc1-84dd-4187-bb1b-7752405c0c1e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.134125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93154fc1-84dd-4187-bb1b-7752405c0c1e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.134589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93154fc1-84dd-4187-bb1b-7752405c0c1e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.135169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93154fc1-84dd-4187-bb1b-7752405c0c1e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.166929 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6552d78e-6d89-44a9-842c-bd9fb4ab4cf0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.413627 Oct 12 22:25:49.167625 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2508/5627] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:25:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:25:49.180295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c0b1bef6-92e4-4571-adce-c7a9f88aa1f3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:49.182266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93154fc1-84dd-4187-bb1b-7752405c0c1e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.182756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93154fc1-84dd-4187-bb1b-7752405c0c1e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.183196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93154fc1-84dd-4187-bb1b-7752405c0c1e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.184405 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c0b1bef6-92e4-4571-adce-c7a9f88aa1f3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:49.214890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-93154fc1-84dd-4187-bb1b-7752405c0c1e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lazy-loading 'flavor' on Instance uuid 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:25:49.240720 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-93154fc1-84dd-4187-bb1b-7752405c0c1e tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags" status: 204 len: 0 microversion: 2.26 time: 0.138163 Oct 12 22:25:49.245860 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3120/5628] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Oct 12 22:25:49 2022] DELETE /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 22:25:49.251769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f51233e5af0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:49.265456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.265957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.266404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.267462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:49.273358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.273931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.274419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.275174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.275715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.276415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.312084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.312084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.312084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.324830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c0b1bef6-92e4-4571-adce-c7a9f88aa1f3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:49.335997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.336563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.337024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.338604 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c0b1bef6-92e4-4571-adce-c7a9f88aa1f3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1209 microversion: 2.1 time: 0.162091 Oct 12 22:25:49.341056 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2509/5629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:49 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1209 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:49.390917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lazy-loading 'flavor' on Instance uuid 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:25:49.431864 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-22090153-c55b-4a09-bd7a-8e19cd725b6b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "PUT /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags/tempest-tag-855379322" status: 201 len: 0 microversion: 2.26 time: 0.184132 Oct 12 22:25:49.432711 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3121/5630] 10.222.0.16 () {62 vars in 1377 bytes} [Wed Oct 12 22:25:49 2022] PUT /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags/tempest-tag-855379322 => generated 0 bytes in 186 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 12 22:25:49.443442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f51286530d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:49.459185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.459710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.460153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.460648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:49.481241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.481935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.482390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.483129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.483708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.488718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.556792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.558896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.560255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.581972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.582463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.582898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.652601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lazy-loading 'flavor' on Instance uuid 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:25:49.664745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:25:49.720556 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6bb5c8d4-e623-4864-a048-ef75eb4b72ac tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "PUT /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags/tempest-tag-580372606" status: 201 len: 0 microversion: 2.26 time: 0.280905 Oct 12 22:25:49.726031 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2510/5631] 10.222.0.16 () {62 vars in 1377 bytes} [Wed Oct 12 22:25:49 2022] PUT /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags/tempest-tag-580372606 => generated 0 bytes in 288 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 12 22:25:49.736937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9ccc65b1-27d4-4f4f-9b6a-0de662dabfe0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Action: 'update_all', calling method: .version_select at 0x7f51234295e0>, body: {"tags": ["tempest-tag-1537339689", "tempest-tag-480720057"]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:25:49.765993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ccc65b1-27d4-4f4f-9b6a-0de662dabfe0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.769584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ccc65b1-27d4-4f4f-9b6a-0de662dabfe0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.770301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ccc65b1-27d4-4f4f-9b6a-0de662dabfe0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.771179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9ccc65b1-27d4-4f4f-9b6a-0de662dabfe0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:49.796519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ccc65b1-27d4-4f4f-9b6a-0de662dabfe0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.799664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ccc65b1-27d4-4f4f-9b6a-0de662dabfe0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.800467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ccc65b1-27d4-4f4f-9b6a-0de662dabfe0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.804110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ccc65b1-27d4-4f4f-9b6a-0de662dabfe0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.805594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ccc65b1-27d4-4f4f-9b6a-0de662dabfe0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.807791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ccc65b1-27d4-4f4f-9b6a-0de662dabfe0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.885097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ccc65b1-27d4-4f4f-9b6a-0de662dabfe0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:49.885705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ccc65b1-27d4-4f4f-9b6a-0de662dabfe0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:49.887530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ccc65b1-27d4-4f4f-9b6a-0de662dabfe0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:49.959524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-9ccc65b1-27d4-4f4f-9b6a-0de662dabfe0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lazy-loading 'flavor' on Instance uuid 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:25:49.991690 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9ccc65b1-27d4-4f4f-9b6a-0de662dabfe0 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "PUT /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags" status: 200 len: 61 microversion: 2.26 time: 0.257926 Oct 12 22:25:50.003196 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3122/5632] 10.222.0.16 () {62 vars in 1312 bytes} [Wed Oct 12 22:25:49 2022] PUT /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags => generated 61 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:50.008729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-68f13262-92f2-4093-8dde-4fcb71400ead tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f512c3bc940>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:50.020820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68f13262-92f2-4093-8dde-4fcb71400ead tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:50.024708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68f13262-92f2-4093-8dde-4fcb71400ead tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:50.025269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68f13262-92f2-4093-8dde-4fcb71400ead tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:50.045238 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-68f13262-92f2-4093-8dde-4fcb71400ead tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags" status: 200 len: 61 microversion: 2.26 time: 0.041494 Oct 12 22:25:50.046818 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2511/5633] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 12 22:25:50 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags => generated 61 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:50.059406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-78c69a97-4406-4253-a149-873543a1ec94 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '.version_select at 0x7f5123469af0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:50.069257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c69a97-4406-4253-a149-873543a1ec94 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:50.070213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c69a97-4406-4253-a149-873543a1ec94 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:50.070871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c69a97-4406-4253-a149-873543a1ec94 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:50.071756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-78c69a97-4406-4253-a149-873543a1ec94 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:50.078603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c69a97-4406-4253-a149-873543a1ec94 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:50.079325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c69a97-4406-4253-a149-873543a1ec94 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:50.080004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c69a97-4406-4253-a149-873543a1ec94 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:50.081353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c69a97-4406-4253-a149-873543a1ec94 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:50.082115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c69a97-4406-4253-a149-873543a1ec94 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:50.082761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c69a97-4406-4253-a149-873543a1ec94 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:50.116941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c69a97-4406-4253-a149-873543a1ec94 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:50.117550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c69a97-4406-4253-a149-873543a1ec94 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:50.118096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78c69a97-4406-4253-a149-873543a1ec94 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:50.156929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-78c69a97-4406-4253-a149-873543a1ec94 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lazy-loading 'flavor' on Instance uuid 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:25:50.192605 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-78c69a97-4406-4253-a149-873543a1ec94 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags" status: 204 len: 0 microversion: 2.26 time: 0.137586 Oct 12 22:25:50.195217 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3123/5634] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Oct 12 22:25:50 2022] DELETE /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5/tags => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:25:50.205188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-066adff2-2c2a-4050-b1f0-08d90ffe366b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:50.205854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-066adff2-2c2a-4050-b1f0-08d90ffe366b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:50.217466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066adff2-2c2a-4050-b1f0-08d90ffe366b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:50.220184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066adff2-2c2a-4050-b1f0-08d90ffe366b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:50.220647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066adff2-2c2a-4050-b1f0-08d90ffe366b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:50.221927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066adff2-2c2a-4050-b1f0-08d90ffe366b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:50.224939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066adff2-2c2a-4050-b1f0-08d90ffe366b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:50.225408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-066adff2-2c2a-4050-b1f0-08d90ffe366b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:50.275000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-066adff2-2c2a-4050-b1f0-08d90ffe366b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:25:50.367398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7b538a77-2a11-47c2-b083-0a0dc73b773c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:50.386710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7b538a77-2a11-47c2-b083-0a0dc73b773c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:50.423860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b538a77-2a11-47c2-b083-0a0dc73b773c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:50.427429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b538a77-2a11-47c2-b083-0a0dc73b773c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:50.428097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b538a77-2a11-47c2-b083-0a0dc73b773c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:50.429595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b538a77-2a11-47c2-b083-0a0dc73b773c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:50.432197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b538a77-2a11-47c2-b083-0a0dc73b773c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:50.433318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b538a77-2a11-47c2-b083-0a0dc73b773c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:50.511645 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-066adff2-2c2a-4050-b1f0-08d90ffe366b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5" status: 204 len: 0 microversion: 2.26 time: 0.309887 Oct 12 22:25:50.512513 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2512/5635] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:25:50 2022] DELETE /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:25:50.523518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49b7fac1-20e9-4928-9619-370ee0d01155 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:50.524472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-49b7fac1-20e9-4928-9619-370ee0d01155 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:50.538376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49b7fac1-20e9-4928-9619-370ee0d01155 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:50.541583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49b7fac1-20e9-4928-9619-370ee0d01155 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:50.542044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49b7fac1-20e9-4928-9619-370ee0d01155 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:50.542770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49b7fac1-20e9-4928-9619-370ee0d01155 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:50.543252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49b7fac1-20e9-4928-9619-370ee0d01155 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:50.543689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49b7fac1-20e9-4928-9619-370ee0d01155 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:50.595333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7b538a77-2a11-47c2-b083-0a0dc73b773c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:50.605423 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7b538a77-2a11-47c2-b083-0a0dc73b773c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1213 microversion: 2.1 time: 0.245111 Oct 12 22:25:50.607322 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3124/5636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:50 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1213 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:25:50.863069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-49b7fac1-20e9-4928-9619-370ee0d01155 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:50.873724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-49b7fac1-20e9-4928-9619-370ee0d01155 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:50.875563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-49b7fac1-20e9-4928-9619-370ee0d01155 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:50.876792 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-49b7fac1-20e9-4928-9619-370ee0d01155 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5" status: 200 len: 1552 microversion: 2.26 time: 0.359381 Oct 12 22:25:50.878403 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2513/5637] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:25:50 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 => generated 1552 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:25:51.630549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-980acf9b-a1fd-4685-8c44-f72659d503c4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:51.631821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-980acf9b-a1fd-4685-8c44-f72659d503c4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:51.649459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-980acf9b-a1fd-4685-8c44-f72659d503c4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:51.653468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-980acf9b-a1fd-4685-8c44-f72659d503c4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:51.654751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-980acf9b-a1fd-4685-8c44-f72659d503c4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:51.664196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-980acf9b-a1fd-4685-8c44-f72659d503c4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:51.665507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-980acf9b-a1fd-4685-8c44-f72659d503c4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:51.666420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-980acf9b-a1fd-4685-8c44-f72659d503c4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:51.888262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-980acf9b-a1fd-4685-8c44-f72659d503c4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:51.905099 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-980acf9b-a1fd-4685-8c44-f72659d503c4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1267 microversion: 2.1 time: 0.279488 Oct 12 22:25:51.905289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-770173be-6911-448f-9e56-3ba0a7025186 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:51.906934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-770173be-6911-448f-9e56-3ba0a7025186 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:51.919454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-770173be-6911-448f-9e56-3ba0a7025186 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:51.921423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-770173be-6911-448f-9e56-3ba0a7025186 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:51.925399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-770173be-6911-448f-9e56-3ba0a7025186 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:51.926611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-770173be-6911-448f-9e56-3ba0a7025186 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:51.927299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-770173be-6911-448f-9e56-3ba0a7025186 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:51.927954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-770173be-6911-448f-9e56-3ba0a7025186 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:51.939614 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3125/5638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:51 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1267 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:52.475688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-770173be-6911-448f-9e56-3ba0a7025186 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:52.493733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-770173be-6911-448f-9e56-3ba0a7025186 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:52.500174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-770173be-6911-448f-9e56-3ba0a7025186 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:52.503475 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-770173be-6911-448f-9e56-3ba0a7025186 tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5" status: 200 len: 1552 microversion: 2.26 time: 0.603134 Oct 12 22:25:52.524889 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2514/5639] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:25:51 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 => generated 1552 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:25:52.930744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9f6fecd7-0c58-49da-99ae-d1ebf63bb8c3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:52.931410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9f6fecd7-0c58-49da-99ae-d1ebf63bb8c3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:52.941873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f6fecd7-0c58-49da-99ae-d1ebf63bb8c3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:52.942414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f6fecd7-0c58-49da-99ae-d1ebf63bb8c3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:52.942812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f6fecd7-0c58-49da-99ae-d1ebf63bb8c3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:52.945298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f6fecd7-0c58-49da-99ae-d1ebf63bb8c3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:52.947064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f6fecd7-0c58-49da-99ae-d1ebf63bb8c3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:52.947879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f6fecd7-0c58-49da-99ae-d1ebf63bb8c3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:53.076163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9f6fecd7-0c58-49da-99ae-d1ebf63bb8c3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:53.081348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:RELEASE=3,nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:DELETE=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:25:53.090365 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9f6fecd7-0c58-49da-99ae-d1ebf63bb8c3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1267 microversion: 2.1 time: 0.163389 Oct 12 22:25:53.091194 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3126/5640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:52 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:53.541969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-13078136-882a-4a78-a63f-57348766c81b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:53.543085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-13078136-882a-4a78-a63f-57348766c81b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:53.563609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13078136-882a-4a78-a63f-57348766c81b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:53.564118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13078136-882a-4a78-a63f-57348766c81b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:53.564610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13078136-882a-4a78-a63f-57348766c81b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:53.565333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13078136-882a-4a78-a63f-57348766c81b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:53.565792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13078136-882a-4a78-a63f-57348766c81b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:53.566220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13078136-882a-4a78-a63f-57348766c81b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:54.116348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-82a728f5-d2a1-4b3f-8699-03ca21f173f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:54.117161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-82a728f5-d2a1-4b3f-8699-03ca21f173f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:54.136390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82a728f5-d2a1-4b3f-8699-03ca21f173f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:54.136869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82a728f5-d2a1-4b3f-8699-03ca21f173f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:54.140945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82a728f5-d2a1-4b3f-8699-03ca21f173f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:54.144304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82a728f5-d2a1-4b3f-8699-03ca21f173f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:54.145884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82a728f5-d2a1-4b3f-8699-03ca21f173f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:54.146340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82a728f5-d2a1-4b3f-8699-03ca21f173f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:54.152855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-13078136-882a-4a78-a63f-57348766c81b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:54.174828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-13078136-882a-4a78-a63f-57348766c81b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:54.184854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-13078136-882a-4a78-a63f-57348766c81b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ebc899eeb0040b795ec64bd043e4769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680ec414f20440e2b21a9af8795764b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:54.188684 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-13078136-882a-4a78-a63f-57348766c81b tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5" status: 200 len: 1552 microversion: 2.26 time: 0.657035 Oct 12 22:25:54.207264 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2515/5641] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:25:53 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 => generated 1552 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:25:54.212058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-847e51f6-a2d0-4dc6-b432-6bfb8a3beb31 req-3a253b4f-8fe3-4e90-8374-c368a21f91b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c996267-ca3a-45d3-bc9f-90a6cbe95cc5", "name": "network-vif-deleted", "tag": "44f7d6f8-2412-47ed-bffe-9d59214053ef"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:25:54.252586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-847e51f6-a2d0-4dc6-b432-6bfb8a3beb31 req-3a253b4f-8fe3-4e90-8374-c368a21f91b7 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:54.258139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-847e51f6-a2d0-4dc6-b432-6bfb8a3beb31 req-3a253b4f-8fe3-4e90-8374-c368a21f91b7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:54.262373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-847e51f6-a2d0-4dc6-b432-6bfb8a3beb31 req-3a253b4f-8fe3-4e90-8374-c368a21f91b7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:54.318760 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-847e51f6-a2d0-4dc6-b432-6bfb8a3beb31 req-3a253b4f-8fe3-4e90-8374-c368a21f91b7 service nova] Creating event network-vif-deleted:44f7d6f8-2412-47ed-bffe-9d59214053ef for instance 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 on n-h2-861111-1 Oct 12 22:25:54.338525 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-847e51f6-a2d0-4dc6-b432-6bfb8a3beb31 req-3a253b4f-8fe3-4e90-8374-c368a21f91b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142405 Oct 12 22:25:54.347941 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2516/5642] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:25:54.478119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-82a728f5-d2a1-4b3f-8699-03ca21f173f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:54.491442 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-82a728f5-d2a1-4b3f-8699-03ca21f173f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1309 microversion: 2.1 time: 0.378748 Oct 12 22:25:54.517227 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3127/5643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:54 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1309 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:55.224996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3d9004fa-c0b0-4d17-8081-15c7ff8998db tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:55.225691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3d9004fa-c0b0-4d17-8081-15c7ff8998db tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] [instance: 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:55.242194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d9004fa-c0b0-4d17-8081-15c7ff8998db tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:55.242827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d9004fa-c0b0-4d17-8081-15c7ff8998db tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:55.243354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d9004fa-c0b0-4d17-8081-15c7ff8998db tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:55.244133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d9004fa-c0b0-4d17-8081-15c7ff8998db tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:55.244648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d9004fa-c0b0-4d17-8081-15c7ff8998db tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:55.245208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d9004fa-c0b0-4d17-8081-15c7ff8998db tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:55.287685 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-3d9004fa-c0b0-4d17-8081-15c7ff8998db tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] HTTP exception thrown: Instance 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 could not be found. Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3d9004fa-c0b0-4d17-8081-15c7ff8998db tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Request method failure captured: Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 HTTP/1.1 Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz7Ybw1ioaVnIxxm5msuujTbhfV2IX1A1pB4DGTxYDBtZb7tMoY_fLsBSUGWDw4mxtXq-zOGLXN-DHHyjBxPhP1wduTqSEI20kwbby7Gc68-ChQ39650VipGxc-LysF2hqv7q_lXb0pysCCovOFBGcq3D-MeEWdXYqXSCSFLujgDN8g Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-Openstack-Nova-Api-Version: 2.26 Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 680ec414f20440e2b21a9af8795764b4 Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerTagsTestJSON-1404741220 Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/680ec414f20440e2b21a9af8795764b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/680ec414f20440e2b21a9af8795764b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_680ec414f20440e2b21a9af8795764b4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/680ec414f20440e2b21a9af8795764b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerTagsTestJSON-1404741220 Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 680ec414f20440e2b21a9af8795764b4 Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerTagsTestJSON-1404741220 Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerTagsTestJSON-1404741220-project Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 4ebc899eeb0040b795ec64bd043e4769 Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerTagsTestJSON-1404741220-project Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 could not be found. Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '1c996267-ca3a-45d3-bc9f-90a6cbe95cc5'} Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 could not be found. Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 could not be found. Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:25:55.304524 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:25:55.308397 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:25:55.308397 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:25:55.308397 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:25:55.308397 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:25:55.308397 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:25:55.308397 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 could not be found. Oct 12 22:25:55.308397 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:25:55.308397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3d9004fa-c0b0-4d17-8081-15c7ff8998db tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] Returning 404 to user: Instance 1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:25:55.308397 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3d9004fa-c0b0-4d17-8081-15c7ff8998db tempest-ServerTagsTestJSON-1404741220 tempest-ServerTagsTestJSON-1404741220-project] 10.222.0.16 "GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5" status: 404 len: 111 microversion: 2.26 time: 0.088277 Oct 12 22:25:55.319643 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2517/5644] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:25:55 2022] GET /compute/v2.1/servers/1c996267-ca3a-45d3-bc9f-90a6cbe95cc5 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:25:55.515609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bf47a278-e520-404f-a71d-0255fcde4b1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:55.516259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bf47a278-e520-404f-a71d-0255fcde4b1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:55.530132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf47a278-e520-404f-a71d-0255fcde4b1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:55.530724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf47a278-e520-404f-a71d-0255fcde4b1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:55.531175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf47a278-e520-404f-a71d-0255fcde4b1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:55.535500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf47a278-e520-404f-a71d-0255fcde4b1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:55.536059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf47a278-e520-404f-a71d-0255fcde4b1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:55.536755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf47a278-e520-404f-a71d-0255fcde4b1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:55.829917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bf47a278-e520-404f-a71d-0255fcde4b1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:55.862405 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bf47a278-e520-404f-a71d-0255fcde4b1a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1309 microversion: 2.1 time: 0.349162 Oct 12 22:25:55.863025 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3128/5645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:55 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1309 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:56.372557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-420cafd5-d0d2-41ec-8269-caf3e69b4673 req-e2169d17-de1d-4a64-9acc-e3d4a9a7b926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c620983a-6efc-458a-9bb3-fb1b6ef7283f", "tag": "6f09dab5-3aef-4840-b51a-fd178ecb1f4a"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:25:56.398785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-420cafd5-d0d2-41ec-8269-caf3e69b4673 req-e2169d17-de1d-4a64-9acc-e3d4a9a7b926 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:56.399392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-420cafd5-d0d2-41ec-8269-caf3e69b4673 req-e2169d17-de1d-4a64-9acc-e3d4a9a7b926 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:56.399839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-420cafd5-d0d2-41ec-8269-caf3e69b4673 req-e2169d17-de1d-4a64-9acc-e3d4a9a7b926 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:56.430585 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-420cafd5-d0d2-41ec-8269-caf3e69b4673 req-e2169d17-de1d-4a64-9acc-e3d4a9a7b926 service nova] Creating event network-changed:6f09dab5-3aef-4840-b51a-fd178ecb1f4a for instance c620983a-6efc-458a-9bb3-fb1b6ef7283f on n-h1-861111-1 Oct 12 22:25:56.450085 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-420cafd5-d0d2-41ec-8269-caf3e69b4673 req-e2169d17-de1d-4a64-9acc-e3d4a9a7b926 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081211 Oct 12 22:25:56.455600 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2518/5646] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:25:56.891048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ab1977ee-94d8-4639-99fd-fd3a586d2ca8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:56.893198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ab1977ee-94d8-4639-99fd-fd3a586d2ca8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:56.920665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab1977ee-94d8-4639-99fd-fd3a586d2ca8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:56.923448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab1977ee-94d8-4639-99fd-fd3a586d2ca8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:56.926965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab1977ee-94d8-4639-99fd-fd3a586d2ca8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:56.930371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab1977ee-94d8-4639-99fd-fd3a586d2ca8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:56.933897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab1977ee-94d8-4639-99fd-fd3a586d2ca8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:56.934743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab1977ee-94d8-4639-99fd-fd3a586d2ca8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:57.849708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ab1977ee-94d8-4639-99fd-fd3a586d2ca8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:57.859249 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ab1977ee-94d8-4639-99fd-fd3a586d2ca8 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1309 microversion: 2.1 time: 0.974336 Oct 12 22:25:57.862597 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3129/5647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:56 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1309 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:25:58.436607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1848801052", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:25:58.570174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] validate_networks() for None {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:25:58.887343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d9b1daa2-55e5-49ac-99ae-acb1b25ef786 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:58.888681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d9b1daa2-55e5-49ac-99ae-acb1b25ef786 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:25:58.912638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9b1daa2-55e5-49ac-99ae-acb1b25ef786 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:58.915000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9b1daa2-55e5-49ac-99ae-acb1b25ef786 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:58.919921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9b1daa2-55e5-49ac-99ae-acb1b25ef786 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:58.921753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9b1daa2-55e5-49ac-99ae-acb1b25ef786 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:58.925856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9b1daa2-55e5-49ac-99ae-acb1b25ef786 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:58.927725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9b1daa2-55e5-49ac-99ae-acb1b25ef786 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:58.975623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:25:59.330813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:25:59.455214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d9b1daa2-55e5-49ac-99ae-acb1b25ef786 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:25:59.473290 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d9b1daa2-55e5-49ac-99ae-acb1b25ef786 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1309 microversion: 2.1 time: 0.589255 Oct 12 22:25:59.498868 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3130/5648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:58 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1309 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:25:59.521629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:25:59.523424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:25:59.524123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:25:59.525348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:25:59.526262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:25:59.560993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:59.561741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:59.579601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:59.584265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:25:59.586080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:25:59.591658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:25:59.672944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Getting quotas for project a37f4c02a7a4439eba03499302477517. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:25:59.706182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Getting quotas for user 4117aa70605d41c0b5d42dbce801f3aa and project a37f4c02a7a4439eba03499302477517. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:25:59.758519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:25:59.769367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:25:59.880096 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bb74882f-df52-46e8-a1cd-3e1e767dd5c4 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.448055 Oct 12 22:25:59.887953 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2519/5649] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:25:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:25:59.894507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-55505417-d9e0-48d2-9621-7b1f21e864bb tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:25:59.899107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-55505417-d9e0-48d2-9621-7b1f21e864bb tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:00.454875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-55505417-d9e0-48d2-9621-7b1f21e864bb tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4117aa70605d41c0b5d42dbce801f3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37f4c02a7a4439eba03499302477517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:00.471007 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-55505417-d9e0-48d2-9621-7b1f21e864bb tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 200 len: 1214 microversion: 2.1 time: 0.580400 Oct 12 22:26:00.476182 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3131/5650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:25:59 2022] GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 1214 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:26:00.505816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1257d287-4bd3-4adf-8ceb-10892c26b5cf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:00.507349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1257d287-4bd3-4adf-8ceb-10892c26b5cf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:00.549419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1257d287-4bd3-4adf-8ceb-10892c26b5cf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:00.550153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1257d287-4bd3-4adf-8ceb-10892c26b5cf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:00.550449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1257d287-4bd3-4adf-8ceb-10892c26b5cf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:00.559885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1257d287-4bd3-4adf-8ceb-10892c26b5cf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:00.560668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1257d287-4bd3-4adf-8ceb-10892c26b5cf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:00.570157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1257d287-4bd3-4adf-8ceb-10892c26b5cf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:01.507887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8addc147-a801-4310-bd7d-7a8cb3d484ad tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:01.509090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8addc147-a801-4310-bd7d-7a8cb3d484ad tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:01.606813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1257d287-4bd3-4adf-8ceb-10892c26b5cf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:01.620311 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1257d287-4bd3-4adf-8ceb-10892c26b5cf tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1309 microversion: 2.1 time: 1.124611 Oct 12 22:26:01.621447 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2520/5651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:00 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1309 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:01.627069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8addc147-a801-4310-bd7d-7a8cb3d484ad tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4117aa70605d41c0b5d42dbce801f3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37f4c02a7a4439eba03499302477517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:01.634680 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8addc147-a801-4310-bd7d-7a8cb3d484ad tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 200 len: 1214 microversion: 2.1 time: 0.131151 Oct 12 22:26:01.653602 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3132/5652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:01 2022] GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:26:02.646919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2bd59782-28d7-4b0c-b45d-9bee93834fa7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:02.647645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2bd59782-28d7-4b0c-b45d-9bee93834fa7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:02.660968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f33b6871-fe69-4347-8093-6645e318ae2f tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:02.662330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f33b6871-fe69-4347-8093-6645e318ae2f tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:02.667551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2bd59782-28d7-4b0c-b45d-9bee93834fa7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:02.680775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2bd59782-28d7-4b0c-b45d-9bee93834fa7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:02.682417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2bd59782-28d7-4b0c-b45d-9bee93834fa7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:02.683127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f33b6871-fe69-4347-8093-6645e318ae2f tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:02.686709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f33b6871-fe69-4347-8093-6645e318ae2f tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:02.688343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2bd59782-28d7-4b0c-b45d-9bee93834fa7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:02.689027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f33b6871-fe69-4347-8093-6645e318ae2f tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:02.690662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2bd59782-28d7-4b0c-b45d-9bee93834fa7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:02.693116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f33b6871-fe69-4347-8093-6645e318ae2f tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:02.693834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2bd59782-28d7-4b0c-b45d-9bee93834fa7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:02.694534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f33b6871-fe69-4347-8093-6645e318ae2f tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:02.698030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f33b6871-fe69-4347-8093-6645e318ae2f tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:03.271778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f33b6871-fe69-4347-8093-6645e318ae2f tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4117aa70605d41c0b5d42dbce801f3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37f4c02a7a4439eba03499302477517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:03.282453 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f33b6871-fe69-4347-8093-6645e318ae2f tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 200 len: 1274 microversion: 2.1 time: 0.626119 Oct 12 22:26:03.286905 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3133/5653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:02 2022] GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 1274 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:26:03.651121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2bd59782-28d7-4b0c-b45d-9bee93834fa7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:03.723918 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2bd59782-28d7-4b0c-b45d-9bee93834fa7 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1309 microversion: 2.1 time: 1.034749 Oct 12 22:26:03.737052 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2521/5654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:02 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1309 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:04.320333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eafd2210-56ae-441c-add0-6558ebf0b2b9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:04.320870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eafd2210-56ae-441c-add0-6558ebf0b2b9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:04.332609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eafd2210-56ae-441c-add0-6558ebf0b2b9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:04.333111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eafd2210-56ae-441c-add0-6558ebf0b2b9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:04.333558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eafd2210-56ae-441c-add0-6558ebf0b2b9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:04.342815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eafd2210-56ae-441c-add0-6558ebf0b2b9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:04.346941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eafd2210-56ae-441c-add0-6558ebf0b2b9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:04.347999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eafd2210-56ae-441c-add0-6558ebf0b2b9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:04.695126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eafd2210-56ae-441c-add0-6558ebf0b2b9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4117aa70605d41c0b5d42dbce801f3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37f4c02a7a4439eba03499302477517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:04.706642 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eafd2210-56ae-441c-add0-6558ebf0b2b9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 200 len: 1272 microversion: 2.1 time: 0.390169 Oct 12 22:26:04.724961 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3134/5655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:04 2022] GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 1272 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:26:04.766992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-93f036a1-62f5-43b6-85cb-ff591f388ff3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:04.769675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-93f036a1-62f5-43b6-85cb-ff591f388ff3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:04.820322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93f036a1-62f5-43b6-85cb-ff591f388ff3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:04.824347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93f036a1-62f5-43b6-85cb-ff591f388ff3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:04.831904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93f036a1-62f5-43b6-85cb-ff591f388ff3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:04.832566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93f036a1-62f5-43b6-85cb-ff591f388ff3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:04.833076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93f036a1-62f5-43b6-85cb-ff591f388ff3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:04.833585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93f036a1-62f5-43b6-85cb-ff591f388ff3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:05.273701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-5a0d1ef5-5725-4390-98ca-b65b4659b02f req-fa508274-08bd-4228-8756-1c97b4a53636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c620983a-6efc-458a-9bb3-fb1b6ef7283f", "name": "network-vif-plugged", "status": "completed", "tag": "6f09dab5-3aef-4840-b51a-fd178ecb1f4a"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:26:05.287037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5a0d1ef5-5725-4390-98ca-b65b4659b02f req-fa508274-08bd-4228-8756-1c97b4a53636 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:05.288334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5a0d1ef5-5725-4390-98ca-b65b4659b02f req-fa508274-08bd-4228-8756-1c97b4a53636 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:05.288779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5a0d1ef5-5725-4390-98ca-b65b4659b02f req-fa508274-08bd-4228-8756-1c97b4a53636 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:05.313998 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-5a0d1ef5-5725-4390-98ca-b65b4659b02f req-fa508274-08bd-4228-8756-1c97b4a53636 service nova] Creating event network-vif-plugged:6f09dab5-3aef-4840-b51a-fd178ecb1f4a for instance c620983a-6efc-458a-9bb3-fb1b6ef7283f on n-h1-861111-1 Oct 12 22:26:05.325869 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-5a0d1ef5-5725-4390-98ca-b65b4659b02f req-fa508274-08bd-4228-8756-1c97b4a53636 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060255 Oct 12 22:26:05.330099 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3135/5656] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:26:05.624340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-93f036a1-62f5-43b6-85cb-ff591f388ff3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:05.635311 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-93f036a1-62f5-43b6-85cb-ff591f388ff3 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1309 microversion: 2.1 time: 0.876338 Oct 12 22:26:05.639915 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2522/5657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:04 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1309 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:05.755943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-258920f9-9f8a-4676-b6c8-ce560448575b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:05.757934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-258920f9-9f8a-4676-b6c8-ce560448575b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:05.794615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-258920f9-9f8a-4676-b6c8-ce560448575b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:05.796915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-258920f9-9f8a-4676-b6c8-ce560448575b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:05.797911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-258920f9-9f8a-4676-b6c8-ce560448575b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:05.802840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-258920f9-9f8a-4676-b6c8-ce560448575b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:05.804834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-258920f9-9f8a-4676-b6c8-ce560448575b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:05.805848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-258920f9-9f8a-4676-b6c8-ce560448575b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:06.213187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-258920f9-9f8a-4676-b6c8-ce560448575b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4117aa70605d41c0b5d42dbce801f3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37f4c02a7a4439eba03499302477517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:06.255086 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-258920f9-9f8a-4676-b6c8-ce560448575b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 200 len: 1272 microversion: 2.1 time: 0.506459 Oct 12 22:26:06.260718 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3136/5658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:05 2022] GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 1272 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:06.675443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e1f2ed6a-a43b-4a30-8545-98ecf229f2f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:06.676679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e1f2ed6a-a43b-4a30-8545-98ecf229f2f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:06.686093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f2ed6a-a43b-4a30-8545-98ecf229f2f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:06.686912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f2ed6a-a43b-4a30-8545-98ecf229f2f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:06.687612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f2ed6a-a43b-4a30-8545-98ecf229f2f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:06.688514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f2ed6a-a43b-4a30-8545-98ecf229f2f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:06.689237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f2ed6a-a43b-4a30-8545-98ecf229f2f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:06.689878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1f2ed6a-a43b-4a30-8545-98ecf229f2f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:07.294528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cf9b0306-9fd2-41c9-92ba-2fe67be62855 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:07.296106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cf9b0306-9fd2-41c9-92ba-2fe67be62855 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:07.304603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf9b0306-9fd2-41c9-92ba-2fe67be62855 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:07.305308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf9b0306-9fd2-41c9-92ba-2fe67be62855 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:07.306262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf9b0306-9fd2-41c9-92ba-2fe67be62855 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:07.307209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf9b0306-9fd2-41c9-92ba-2fe67be62855 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:07.307985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf9b0306-9fd2-41c9-92ba-2fe67be62855 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:07.308597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf9b0306-9fd2-41c9-92ba-2fe67be62855 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:07.381635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e1f2ed6a-a43b-4a30-8545-98ecf229f2f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:07.392468 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e1f2ed6a-a43b-4a30-8545-98ecf229f2f1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1309 microversion: 2.1 time: 0.722978 Oct 12 22:26:07.402297 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2523/5659] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:06 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1309 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:08.294809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cf9b0306-9fd2-41c9-92ba-2fe67be62855 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4117aa70605d41c0b5d42dbce801f3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37f4c02a7a4439eba03499302477517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:08.312019 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cf9b0306-9fd2-41c9-92ba-2fe67be62855 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 200 len: 1314 microversion: 2.1 time: 1.021495 Oct 12 22:26:08.332827 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3137/5660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:07 2022] GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 1314 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:26:08.424475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9472cf43-8c6a-4c59-9243-2f08717b717c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:08.425221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9472cf43-8c6a-4c59-9243-2f08717b717c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:08.441351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9472cf43-8c6a-4c59-9243-2f08717b717c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:08.442196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9472cf43-8c6a-4c59-9243-2f08717b717c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:08.442863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9472cf43-8c6a-4c59-9243-2f08717b717c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:08.444138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9472cf43-8c6a-4c59-9243-2f08717b717c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:08.444808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9472cf43-8c6a-4c59-9243-2f08717b717c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:08.445449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9472cf43-8c6a-4c59-9243-2f08717b717c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:08.736213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9472cf43-8c6a-4c59-9243-2f08717b717c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:08.745581 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9472cf43-8c6a-4c59-9243-2f08717b717c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1490 microversion: 2.1 time: 0.329960 Oct 12 22:26:08.751955 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2524/5661] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:08 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1490 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:08.777826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-674e9ab7-5a19-4063-89ff-80fae447b059 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-823490885"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:26:08.783110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-674e9ab7-5a19-4063-89ff-80fae447b059 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:08.791633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-674e9ab7-5a19-4063-89ff-80fae447b059 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:08.792701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-674e9ab7-5a19-4063-89ff-80fae447b059 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:08.793351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-674e9ab7-5a19-4063-89ff-80fae447b059 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:08.794794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-674e9ab7-5a19-4063-89ff-80fae447b059 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:08.795594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-674e9ab7-5a19-4063-89ff-80fae447b059 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:08.796183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-674e9ab7-5a19-4063-89ff-80fae447b059 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:08.904227 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-674e9ab7-5a19-4063-89ff-80fae447b059 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "PUT /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1074 microversion: 2.1 time: 0.136913 Oct 12 22:26:08.905645 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3138/5662] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 12 22:26:08 2022] PUT /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1074 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:08.924440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c9599b08-93ba-4cd0-891f-ab8e19d72299 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:08.925398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c9599b08-93ba-4cd0-891f-ab8e19d72299 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:08.931715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9599b08-93ba-4cd0-891f-ab8e19d72299 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:08.932465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9599b08-93ba-4cd0-891f-ab8e19d72299 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:08.933120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9599b08-93ba-4cd0-891f-ab8e19d72299 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:08.934059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9599b08-93ba-4cd0-891f-ab8e19d72299 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:08.934727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9599b08-93ba-4cd0-891f-ab8e19d72299 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:08.935426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9599b08-93ba-4cd0-891f-ab8e19d72299 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:09.347325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-36e5f320-333a-4ed6-a0a3-556d3fb30346 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:09.349775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-36e5f320-333a-4ed6-a0a3-556d3fb30346 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:09.373570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36e5f320-333a-4ed6-a0a3-556d3fb30346 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:09.374374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36e5f320-333a-4ed6-a0a3-556d3fb30346 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:09.376084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36e5f320-333a-4ed6-a0a3-556d3fb30346 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:09.380127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36e5f320-333a-4ed6-a0a3-556d3fb30346 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:09.380906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36e5f320-333a-4ed6-a0a3-556d3fb30346 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:09.381566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36e5f320-333a-4ed6-a0a3-556d3fb30346 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:09.613215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c9599b08-93ba-4cd0-891f-ab8e19d72299 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:09.625900 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c9599b08-93ba-4cd0-891f-ab8e19d72299 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1500 microversion: 2.1 time: 0.702602 Oct 12 22:26:09.627301 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2525/5663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:08 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1500 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:09.655029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4b36c379-c13c-4a08-91bb-bc69e329b8de tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:09.655807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4b36c379-c13c-4a08-91bb-bc69e329b8de tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:09.658057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:26:09.663882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b36c379-c13c-4a08-91bb-bc69e329b8de tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:09.665402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b36c379-c13c-4a08-91bb-bc69e329b8de tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:09.666033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b36c379-c13c-4a08-91bb-bc69e329b8de tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:09.666985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b36c379-c13c-4a08-91bb-bc69e329b8de tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:09.667679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b36c379-c13c-4a08-91bb-bc69e329b8de tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:09.668316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b36c379-c13c-4a08-91bb-bc69e329b8de tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:09.743161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:26:09.994358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-36e5f320-333a-4ed6-a0a3-556d3fb30346 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4117aa70605d41c0b5d42dbce801f3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37f4c02a7a4439eba03499302477517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:10.012241 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-36e5f320-333a-4ed6-a0a3-556d3fb30346 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 200 len: 1314 microversion: 2.1 time: 0.669417 Oct 12 22:26:10.017202 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3139/5664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:09 2022] GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:10.102035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4b36c379-c13c-4a08-91bb-bc69e329b8de tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:10.124431 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4b36c379-c13c-4a08-91bb-bc69e329b8de tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1500 microversion: 2.1 time: 0.469936 Oct 12 22:26:10.145531 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2526/5665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:09 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1500 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:26:10.155622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d417428c-e70e-4c80-b46d-969558a19f1c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:26:10.167270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d417428c-e70e-4c80-b46d-969558a19f1c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:10.168792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d417428c-e70e-4c80-b46d-969558a19f1c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:10.173816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d417428c-e70e-4c80-b46d-969558a19f1c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:10.207331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-0d7ef8f3-f822-4529-b57f-b128cd925804 req-1dcba3ce-c34a-4f83-b8f7-c443de967794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e1f52b4-4247-4612-afb8-ab097c2274ff", "tag": "1077c466-061f-4e71-ae24-ff379dda43f6"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:26:10.251835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0d7ef8f3-f822-4529-b57f-b128cd925804 req-1dcba3ce-c34a-4f83-b8f7-c443de967794 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:10.255491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0d7ef8f3-f822-4529-b57f-b128cd925804 req-1dcba3ce-c34a-4f83-b8f7-c443de967794 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:10.255813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d417428c-e70e-4c80-b46d-969558a19f1c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Going to try to stop instance {{(pid=120453) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 22:26:10.256879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0d7ef8f3-f822-4529-b57f-b128cd925804 req-1dcba3ce-c34a-4f83-b8f7-c443de967794 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:10.270394 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-0d7ef8f3-f822-4529-b57f-b128cd925804 req-1dcba3ce-c34a-4f83-b8f7-c443de967794 service nova] Creating event network-changed:1077c466-061f-4e71-ae24-ff379dda43f6 for instance 7e1f52b4-4247-4612-afb8-ab097c2274ff on n-h2-861111-1 Oct 12 22:26:10.281068 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-0d7ef8f3-f822-4529-b57f-b128cd925804 req-1dcba3ce-c34a-4f83-b8f7-c443de967794 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081008 Oct 12 22:26:10.288666 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2527/5666] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:26:10.419051 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d417428c-e70e-4c80-b46d-969558a19f1c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "POST /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f/action" status: 202 len: 0 microversion: 2.1 time: 0.267732 Oct 12 22:26:10.419051 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3140/5667] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:26:10 2022] POST /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:26:10.429119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1ee6798d-d946-436d-bcca-d80f09f955fe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:10.430240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1ee6798d-d946-436d-bcca-d80f09f955fe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:10.454810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee6798d-d946-436d-bcca-d80f09f955fe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:10.455432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee6798d-d946-436d-bcca-d80f09f955fe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:10.456139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee6798d-d946-436d-bcca-d80f09f955fe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:10.456894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee6798d-d946-436d-bcca-d80f09f955fe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:10.457353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee6798d-d946-436d-bcca-d80f09f955fe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:10.457807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee6798d-d946-436d-bcca-d80f09f955fe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:10.591006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d417428c-e70e-4c80-b46d-969558a19f1c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:10.592071 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d417428c-e70e-4c80-b46d-969558a19f1c tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001574 Oct 12 22:26:10.592407 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3141/5668] 10.222.0.16 () {56 vars in 886 bytes} [Wed Oct 12 22:26:10 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 22:26:10.844434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1ee6798d-d946-436d-bcca-d80f09f955fe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:10.857601 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1ee6798d-d946-436d-bcca-d80f09f955fe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1510 microversion: 2.1 time: 0.431081 Oct 12 22:26:10.859068 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2528/5669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:10 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1510 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:11.034943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-88f8df58-ed6e-40bb-97b7-b32749428355 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:11.036020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-88f8df58-ed6e-40bb-97b7-b32749428355 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:11.057504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88f8df58-ed6e-40bb-97b7-b32749428355 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:11.058241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88f8df58-ed6e-40bb-97b7-b32749428355 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:11.058827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88f8df58-ed6e-40bb-97b7-b32749428355 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:11.059789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88f8df58-ed6e-40bb-97b7-b32749428355 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:11.067165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88f8df58-ed6e-40bb-97b7-b32749428355 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:11.067883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-88f8df58-ed6e-40bb-97b7-b32749428355 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:11.473933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-88f8df58-ed6e-40bb-97b7-b32749428355 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4117aa70605d41c0b5d42dbce801f3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37f4c02a7a4439eba03499302477517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:11.499734 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-88f8df58-ed6e-40bb-97b7-b32749428355 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 200 len: 1314 microversion: 2.1 time: 0.467920 Oct 12 22:26:11.501121 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3142/5670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:11 2022] GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:26:11.883341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e7c5953e-a77c-4857-bf1f-03056f4b39a6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:11.884047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e7c5953e-a77c-4857-bf1f-03056f4b39a6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:11.895429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7c5953e-a77c-4857-bf1f-03056f4b39a6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:11.901609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7c5953e-a77c-4857-bf1f-03056f4b39a6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:11.902065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7c5953e-a77c-4857-bf1f-03056f4b39a6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:11.902809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7c5953e-a77c-4857-bf1f-03056f4b39a6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:11.903381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7c5953e-a77c-4857-bf1f-03056f4b39a6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:11.910614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7c5953e-a77c-4857-bf1f-03056f4b39a6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:12.111063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e7c5953e-a77c-4857-bf1f-03056f4b39a6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:12.118194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:26:12.122995 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e7c5953e-a77c-4857-bf1f-03056f4b39a6 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1510 microversion: 2.1 time: 0.243768 Oct 12 22:26:12.124780 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2529/5671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:11 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1510 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:12.526018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ee07f6ba-a7f0-458e-8d33-175fe5375e83 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:12.526653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ee07f6ba-a7f0-458e-8d33-175fe5375e83 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:12.538140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:26:12.540987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee07f6ba-a7f0-458e-8d33-175fe5375e83 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:12.541471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee07f6ba-a7f0-458e-8d33-175fe5375e83 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:12.543499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee07f6ba-a7f0-458e-8d33-175fe5375e83 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:12.544254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee07f6ba-a7f0-458e-8d33-175fe5375e83 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:12.544719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee07f6ba-a7f0-458e-8d33-175fe5375e83 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:12.545154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee07f6ba-a7f0-458e-8d33-175fe5375e83 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:13.152700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-304e9f8e-b176-428b-ab22-b3a3e90e23ed tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:13.153602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-304e9f8e-b176-428b-ab22-b3a3e90e23ed tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:13.182092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-304e9f8e-b176-428b-ab22-b3a3e90e23ed tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:13.182549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-304e9f8e-b176-428b-ab22-b3a3e90e23ed tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:13.184133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-304e9f8e-b176-428b-ab22-b3a3e90e23ed tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:13.185596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-304e9f8e-b176-428b-ab22-b3a3e90e23ed tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:13.188460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-304e9f8e-b176-428b-ab22-b3a3e90e23ed tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:13.188950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-304e9f8e-b176-428b-ab22-b3a3e90e23ed tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:13.244946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ee07f6ba-a7f0-458e-8d33-175fe5375e83 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4117aa70605d41c0b5d42dbce801f3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37f4c02a7a4439eba03499302477517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:13.259977 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ee07f6ba-a7f0-458e-8d33-175fe5375e83 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 200 len: 1314 microversion: 2.1 time: 0.735635 Oct 12 22:26:13.260588 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3143/5672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:12 2022] GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 1314 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:13.525002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-304e9f8e-b176-428b-ab22-b3a3e90e23ed tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:13.541140 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-304e9f8e-b176-428b-ab22-b3a3e90e23ed tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1510 microversion: 2.1 time: 0.396110 Oct 12 22:26:13.542085 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2530/5673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:13 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1510 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:14.285436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-32a79ed3-2974-40ca-84c9-98c70ff2d2e3 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:14.286066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-32a79ed3-2974-40ca-84c9-98c70ff2d2e3 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:14.308176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32a79ed3-2974-40ca-84c9-98c70ff2d2e3 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:14.308683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32a79ed3-2974-40ca-84c9-98c70ff2d2e3 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:14.309129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32a79ed3-2974-40ca-84c9-98c70ff2d2e3 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:14.309849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32a79ed3-2974-40ca-84c9-98c70ff2d2e3 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:14.310312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32a79ed3-2974-40ca-84c9-98c70ff2d2e3 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:14.310746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-32a79ed3-2974-40ca-84c9-98c70ff2d2e3 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:14.566936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2fdbfd05-e5df-41e6-a166-d2000ec4d823 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:14.567575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2fdbfd05-e5df-41e6-a166-d2000ec4d823 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:14.581699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:26:14.583393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fdbfd05-e5df-41e6-a166-d2000ec4d823 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:14.584028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fdbfd05-e5df-41e6-a166-d2000ec4d823 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:14.584608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fdbfd05-e5df-41e6-a166-d2000ec4d823 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:14.585459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fdbfd05-e5df-41e6-a166-d2000ec4d823 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:14.586081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fdbfd05-e5df-41e6-a166-d2000ec4d823 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:14.589633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fdbfd05-e5df-41e6-a166-d2000ec4d823 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:14.998981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2fdbfd05-e5df-41e6-a166-d2000ec4d823 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:15.031473 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2fdbfd05-e5df-41e6-a166-d2000ec4d823 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1510 microversion: 2.1 time: 0.468230 Oct 12 22:26:15.033836 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2531/5674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:14 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1510 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:26:15.146337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-32a79ed3-2974-40ca-84c9-98c70ff2d2e3 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4117aa70605d41c0b5d42dbce801f3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37f4c02a7a4439eba03499302477517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:15.181996 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-32a79ed3-2974-40ca-84c9-98c70ff2d2e3 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 200 len: 1314 microversion: 2.1 time: 0.897676 Oct 12 22:26:15.183154 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3144/5675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:14 2022] GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 1314 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:16.054977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2ce68617-a021-4e25-9082-0b0f8ed48058 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:16.056225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2ce68617-a021-4e25-9082-0b0f8ed48058 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:16.064960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ce68617-a021-4e25-9082-0b0f8ed48058 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:16.065461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ce68617-a021-4e25-9082-0b0f8ed48058 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:16.065897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ce68617-a021-4e25-9082-0b0f8ed48058 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:16.066600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ce68617-a021-4e25-9082-0b0f8ed48058 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:16.070567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ce68617-a021-4e25-9082-0b0f8ed48058 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:16.071607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ce68617-a021-4e25-9082-0b0f8ed48058 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:16.214089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7a965743-2b3e-4b00-ada7-8bc73517e285 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:16.215376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7a965743-2b3e-4b00-ada7-8bc73517e285 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:16.227146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a965743-2b3e-4b00-ada7-8bc73517e285 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:16.228318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a965743-2b3e-4b00-ada7-8bc73517e285 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:16.228969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a965743-2b3e-4b00-ada7-8bc73517e285 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:16.231255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a965743-2b3e-4b00-ada7-8bc73517e285 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:16.232833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a965743-2b3e-4b00-ada7-8bc73517e285 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:16.235293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a965743-2b3e-4b00-ada7-8bc73517e285 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:16.297277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:26:16.458402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2ce68617-a021-4e25-9082-0b0f8ed48058 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:16.470210 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2ce68617-a021-4e25-9082-0b0f8ed48058 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1510 microversion: 2.1 time: 0.418352 Oct 12 22:26:16.474318 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2532/5676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:16 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1510 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:16.584069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7a965743-2b3e-4b00-ada7-8bc73517e285 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4117aa70605d41c0b5d42dbce801f3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37f4c02a7a4439eba03499302477517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:16.594281 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7a965743-2b3e-4b00-ada7-8bc73517e285 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 200 len: 1314 microversion: 2.1 time: 0.385916 Oct 12 22:26:16.595171 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3145/5677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:16 2022] GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:16.667544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-15be9a43-1268-4df5-9e09-999108aadb1f req-3a643643-adbf-4fd4-9367-724ecced3a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e1f52b4-4247-4612-afb8-ab097c2274ff", "name": "network-vif-plugged", "status": "completed", "tag": "1077c466-061f-4e71-ae24-ff379dda43f6"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:26:16.685942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-15be9a43-1268-4df5-9e09-999108aadb1f req-3a643643-adbf-4fd4-9367-724ecced3a6b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:16.688076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-15be9a43-1268-4df5-9e09-999108aadb1f req-3a643643-adbf-4fd4-9367-724ecced3a6b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:16.690689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-15be9a43-1268-4df5-9e09-999108aadb1f req-3a643643-adbf-4fd4-9367-724ecced3a6b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:16.709447 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-15be9a43-1268-4df5-9e09-999108aadb1f req-3a643643-adbf-4fd4-9367-724ecced3a6b service nova] Creating event network-vif-plugged:1077c466-061f-4e71-ae24-ff379dda43f6 for instance 7e1f52b4-4247-4612-afb8-ab097c2274ff on n-h2-861111-1 Oct 12 22:26:16.717327 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-15be9a43-1268-4df5-9e09-999108aadb1f req-3a643643-adbf-4fd4-9367-724ecced3a6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053887 Oct 12 22:26:16.718265 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2533/5678] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:26:17.496483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-23fe535f-a119-4f23-9074-c284fc4f60fd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:17.497106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-23fe535f-a119-4f23-9074-c284fc4f60fd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:17.519192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23fe535f-a119-4f23-9074-c284fc4f60fd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:17.519736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23fe535f-a119-4f23-9074-c284fc4f60fd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:17.520186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23fe535f-a119-4f23-9074-c284fc4f60fd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:17.520900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23fe535f-a119-4f23-9074-c284fc4f60fd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:17.526023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23fe535f-a119-4f23-9074-c284fc4f60fd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:17.528702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23fe535f-a119-4f23-9074-c284fc4f60fd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:17.624617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9fe0d37c-b93b-4f3e-b998-2a27f01f160a tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:17.625237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9fe0d37c-b93b-4f3e-b998-2a27f01f160a tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:17.640418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fe0d37c-b93b-4f3e-b998-2a27f01f160a tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:17.640913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fe0d37c-b93b-4f3e-b998-2a27f01f160a tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:17.641397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fe0d37c-b93b-4f3e-b998-2a27f01f160a tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:17.642169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fe0d37c-b93b-4f3e-b998-2a27f01f160a tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:17.642666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fe0d37c-b93b-4f3e-b998-2a27f01f160a tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:17.643077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fe0d37c-b93b-4f3e-b998-2a27f01f160a tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:17.959537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9fe0d37c-b93b-4f3e-b998-2a27f01f160a tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4117aa70605d41c0b5d42dbce801f3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37f4c02a7a4439eba03499302477517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:17.966247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-23fe535f-a119-4f23-9074-c284fc4f60fd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:17.984655 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-23fe535f-a119-4f23-9074-c284fc4f60fd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1510 microversion: 2.1 time: 0.492210 Oct 12 22:26:17.985177 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9fe0d37c-b93b-4f3e-b998-2a27f01f160a tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 200 len: 1314 microversion: 2.1 time: 0.355865 Oct 12 22:26:17.987578 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3146/5680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:17 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1510 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:17.987782 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2534/5680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:17 2022] GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:19.010361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d4d31d64-9904-40f9-9f44-ecf7e3758cfe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:19.016006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bc2d547b-d971-48f1-963a-b93111fb51a2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:19.017759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bc2d547b-d971-48f1-963a-b93111fb51a2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:19.024793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d4d31d64-9904-40f9-9f44-ecf7e3758cfe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:19.028979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=84 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:26:19.031429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2d547b-d971-48f1-963a-b93111fb51a2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:19.034231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2d547b-d971-48f1-963a-b93111fb51a2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:19.035076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2d547b-d971-48f1-963a-b93111fb51a2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:19.039800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2d547b-d971-48f1-963a-b93111fb51a2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:19.040488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2d547b-d971-48f1-963a-b93111fb51a2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:19.041091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2d547b-d971-48f1-963a-b93111fb51a2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:19.041460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4d31d64-9904-40f9-9f44-ecf7e3758cfe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:19.047552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4d31d64-9904-40f9-9f44-ecf7e3758cfe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:19.048097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4d31d64-9904-40f9-9f44-ecf7e3758cfe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:19.048856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4d31d64-9904-40f9-9f44-ecf7e3758cfe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:19.049327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4d31d64-9904-40f9-9f44-ecf7e3758cfe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:19.051909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4d31d64-9904-40f9-9f44-ecf7e3758cfe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:19.504596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d4d31d64-9904-40f9-9f44-ecf7e3758cfe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:19.513059 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d4d31d64-9904-40f9-9f44-ecf7e3758cfe tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1510 microversion: 2.1 time: 0.507465 Oct 12 22:26:19.514553 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2535/5681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:19 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1510 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:19.698646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bc2d547b-d971-48f1-963a-b93111fb51a2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4117aa70605d41c0b5d42dbce801f3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37f4c02a7a4439eba03499302477517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:19.713697 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bc2d547b-d971-48f1-963a-b93111fb51a2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 200 len: 1464 microversion: 2.1 time: 0.699178 Oct 12 22:26:19.716766 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3147/5682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:19 2022] GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 1464 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:19.740777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bcae27de-89a3-4513-ab2e-0bd403d6ab1c tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1cb1e51-a124-451b-8544-8d3f5c2532b4", "device": "/dev/sdb"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:26:19.743292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bcae27de-89a3-4513-ab2e-0bd403d6ab1c tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:19.768963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcae27de-89a3-4513-ab2e-0bd403d6ab1c tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:19.771457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcae27de-89a3-4513-ab2e-0bd403d6ab1c tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:19.772076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcae27de-89a3-4513-ab2e-0bd403d6ab1c tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:19.775161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcae27de-89a3-4513-ab2e-0bd403d6ab1c tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:19.776520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcae27de-89a3-4513-ab2e-0bd403d6ab1c tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:19.777665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcae27de-89a3-4513-ab2e-0bd403d6ab1c tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:20.542831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-73076e67-52bf-4200-9cb0-07c64f56c81b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:20.543683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-73076e67-52bf-4200-9cb0-07c64f56c81b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:20.578222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73076e67-52bf-4200-9cb0-07c64f56c81b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:20.579192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73076e67-52bf-4200-9cb0-07c64f56c81b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:20.599536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73076e67-52bf-4200-9cb0-07c64f56c81b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:20.600453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73076e67-52bf-4200-9cb0-07c64f56c81b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:20.601126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73076e67-52bf-4200-9cb0-07c64f56c81b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:20.607908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73076e67-52bf-4200-9cb0-07c64f56c81b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:21.008724 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bcae27de-89a3-4513-ab2e-0bd403d6ab1c tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "POST /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.271795 Oct 12 22:26:21.009419 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2536/5683] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 22:26:19 2022] POST /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff/os-volume_attachments => generated 194 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:26:21.318762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-73076e67-52bf-4200-9cb0-07c64f56c81b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:21.343589 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-73076e67-52bf-4200-9cb0-07c64f56c81b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1510 microversion: 2.1 time: 0.804880 Oct 12 22:26:21.344649 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3148/5684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:20 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1510 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:26:22.369328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1911cd7-e139-40a0-9b31-6891e25b1d45 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:22.370733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a1911cd7-e139-40a0-9b31-6891e25b1d45 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:22.387938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1911cd7-e139-40a0-9b31-6891e25b1d45 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:22.388635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1911cd7-e139-40a0-9b31-6891e25b1d45 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:22.389926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1911cd7-e139-40a0-9b31-6891e25b1d45 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:22.392295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1911cd7-e139-40a0-9b31-6891e25b1d45 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:22.408755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1911cd7-e139-40a0-9b31-6891e25b1d45 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:22.409225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1911cd7-e139-40a0-9b31-6891e25b1d45 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:23.085330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a1911cd7-e139-40a0-9b31-6891e25b1d45 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:23.101860 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a1911cd7-e139-40a0-9b31-6891e25b1d45 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1510 microversion: 2.1 time: 0.726136 Oct 12 22:26:23.119650 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2537/5685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:22 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1510 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:24.133133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f54bd676-6761-4ea1-baad-d35759917cfb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:24.134309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f54bd676-6761-4ea1-baad-d35759917cfb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:24.155984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f54bd676-6761-4ea1-baad-d35759917cfb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:24.157429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f54bd676-6761-4ea1-baad-d35759917cfb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:24.158051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f54bd676-6761-4ea1-baad-d35759917cfb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:24.160163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f54bd676-6761-4ea1-baad-d35759917cfb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:24.160653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f54bd676-6761-4ea1-baad-d35759917cfb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:24.161229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f54bd676-6761-4ea1-baad-d35759917cfb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:24.538288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f54bd676-6761-4ea1-baad-d35759917cfb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:24.560486 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f54bd676-6761-4ea1-baad-d35759917cfb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1510 microversion: 2.1 time: 0.431026 Oct 12 22:26:24.562502 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3149/5686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:24 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1510 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:25.593300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dd33b711-1082-40c4-98d4-46e6d01e65df tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:25.594764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dd33b711-1082-40c4-98d4-46e6d01e65df tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:25.617832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd33b711-1082-40c4-98d4-46e6d01e65df tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:25.619087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd33b711-1082-40c4-98d4-46e6d01e65df tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:25.620379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd33b711-1082-40c4-98d4-46e6d01e65df tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:25.621364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd33b711-1082-40c4-98d4-46e6d01e65df tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:25.622006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd33b711-1082-40c4-98d4-46e6d01e65df tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:25.622620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd33b711-1082-40c4-98d4-46e6d01e65df tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:26.303045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dd33b711-1082-40c4-98d4-46e6d01e65df tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:26.313360 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dd33b711-1082-40c4-98d4-46e6d01e65df tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1510 microversion: 2.1 time: 0.723744 Oct 12 22:26:26.321289 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2538/5687] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:25 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1510 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:27.340778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c86a280b-6459-4318-b940-bd779ce3842a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:27.341529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c86a280b-6459-4318-b940-bd779ce3842a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:27.364674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86a280b-6459-4318-b940-bd779ce3842a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:27.368886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86a280b-6459-4318-b940-bd779ce3842a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:27.373342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86a280b-6459-4318-b940-bd779ce3842a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:27.374439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86a280b-6459-4318-b940-bd779ce3842a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:27.378774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86a280b-6459-4318-b940-bd779ce3842a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:27.382760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86a280b-6459-4318-b940-bd779ce3842a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:27.894102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b2d8e064-3bc1-4c41-85d5-158a6c0e8445 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Action: 'create', calling method: .version_select at 0x7f51234b21f0>, body: {"keypair": {"name": "tempest-keypair-1641358953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN94KNj/w2EDQhP8m0KodBHfK7UkKLoymTAE76fRpk6mrPLwseV22wkZGoLMq0cGBJqfJkTyYKYdhtCr6H8WHKmOY1pcgzm0GJU/FvvALKlpvH8kp4nOYt3COD8jTMa7Fg=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:26:27.961259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-b2d8e064-3bc1-4c41-85d5-158a6c0e8445 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Getting quotas for project 044e5feb7b4548bdb114d0aeaa6ea5cb. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:26:27.987717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-b2d8e064-3bc1-4c41-85d5-158a6c0e8445 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Getting quotas for user d79554521f9f432e87f6f3e0b0f11b85 and project 044e5feb7b4548bdb114d0aeaa6ea5cb. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:26:28.099590 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b2d8e064-3bc1-4c41-85d5-158a6c0e8445 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.497604 Oct 12 22:26:28.100614 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2539/5688] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 12 22:26:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 499 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 22:26:28.177458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c86a280b-6459-4318-b940-bd779ce3842a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:28.185943 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c86a280b-6459-4318-b940-bd779ce3842a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1510 microversion: 2.1 time: 0.850182 Oct 12 22:26:28.195824 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3150/5689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:27 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1510 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:29.222306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f9bbc877-b5cc-4ef4-8a63-64d52ce4e113 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:29.223597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f9bbc877-b5cc-4ef4-8a63-64d52ce4e113 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:29.235893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9bbc877-b5cc-4ef4-8a63-64d52ce4e113 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:29.237293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9bbc877-b5cc-4ef4-8a63-64d52ce4e113 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:29.238298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9bbc877-b5cc-4ef4-8a63-64d52ce4e113 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:29.240278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9bbc877-b5cc-4ef4-8a63-64d52ce4e113 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:29.241512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9bbc877-b5cc-4ef4-8a63-64d52ce4e113 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:29.242556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9bbc877-b5cc-4ef4-8a63-64d52ce4e113 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:29.818172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f9bbc877-b5cc-4ef4-8a63-64d52ce4e113 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:29.834311 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f9bbc877-b5cc-4ef4-8a63-64d52ce4e113 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1510 microversion: 2.1 time: 0.615997 Oct 12 22:26:29.835892 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2540/5690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:29 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1510 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:30.861846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9d67b150-e3e2-490a-bc0a-be05a5cf95b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:30.862574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9d67b150-e3e2-490a-bc0a-be05a5cf95b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:30.883492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d67b150-e3e2-490a-bc0a-be05a5cf95b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:30.892227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d67b150-e3e2-490a-bc0a-be05a5cf95b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:30.892769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d67b150-e3e2-490a-bc0a-be05a5cf95b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:30.897742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d67b150-e3e2-490a-bc0a-be05a5cf95b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:30.898805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d67b150-e3e2-490a-bc0a-be05a5cf95b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:30.901180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d67b150-e3e2-490a-bc0a-be05a5cf95b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:32.039808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9d67b150-e3e2-490a-bc0a-be05a5cf95b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:32.048324 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9d67b150-e3e2-490a-bc0a-be05a5cf95b1 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1510 microversion: 2.1 time: 1.190532 Oct 12 22:26:32.054123 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3151/5691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:30 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1510 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:32.125960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-562241487", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "494edc42-528c-4cb2-a764-ee4a7cddab3a"}], "security_groups": [{"name": "tempest-securitygroup--924994240"}], "key_name": "tempest-keypair-1641358953", "user_data": "}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:26:32.402842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] validate_networks() for [('494edc42-528c-4cb2-a764-ee4a7cddab3a', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:26:33.082396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d07e2296-35d7-4f8c-88e8-8e8785f904bd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:33.083016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d07e2296-35d7-4f8c-88e8-8e8785f904bd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:33.099550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d07e2296-35d7-4f8c-88e8-8e8785f904bd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:33.100019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d07e2296-35d7-4f8c-88e8-8e8785f904bd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:33.100377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d07e2296-35d7-4f8c-88e8-8e8785f904bd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:33.101095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d07e2296-35d7-4f8c-88e8-8e8785f904bd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:33.101552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d07e2296-35d7-4f8c-88e8-8e8785f904bd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:33.101978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d07e2296-35d7-4f8c-88e8-8e8785f904bd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:33.719677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d07e2296-35d7-4f8c-88e8-8e8785f904bd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:33.739928 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d07e2296-35d7-4f8c-88e8-8e8785f904bd tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1510 microversion: 2.1 time: 0.662060 Oct 12 22:26:33.740777 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3152/5692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:33 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1510 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:26:33.770344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:26:33.770871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:26:33.771261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:26:33.772540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:26:33.777612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:26:33.804177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:33.805633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:33.806146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:33.806926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:33.807459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:33.808652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:33.862094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Getting quotas for project 044e5feb7b4548bdb114d0aeaa6ea5cb. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:26:33.893612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Getting quotas for user d79554521f9f432e87f6f3e0b0f11b85 and project 044e5feb7b4548bdb114d0aeaa6ea5cb. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:26:33.947753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:26:33.955391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:26:34.106697 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c626bf5c-ec45-4cfc-be9d-19fc5edcb508 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.982613 Oct 12 22:26:34.116230 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2541/5693] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 22:26:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:26:34.118898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-84e4eb8e-9a9f-4391-bec8-1f7b14565767 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:34.119797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-84e4eb8e-9a9f-4391-bec8-1f7b14565767 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:34.329973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-84e4eb8e-9a9f-4391-bec8-1f7b14565767 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:34.341776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-84e4eb8e-9a9f-4391-bec8-1f7b14565767 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:34.354094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-84e4eb8e-9a9f-4391-bec8-1f7b14565767 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:34.355380 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-84e4eb8e-9a9f-4391-bec8-1f7b14565767 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1281 microversion: 2.20 time: 0.240367 Oct 12 22:26:34.361949 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3153/5694] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:26:34 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1281 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:26:34.766466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-12a71324-504b-4597-a5b8-dac25530e975 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:34.767086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-12a71324-504b-4597-a5b8-dac25530e975 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:34.789119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12a71324-504b-4597-a5b8-dac25530e975 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:34.790451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12a71324-504b-4597-a5b8-dac25530e975 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:34.791117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12a71324-504b-4597-a5b8-dac25530e975 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:34.791993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12a71324-504b-4597-a5b8-dac25530e975 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:34.794232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12a71324-504b-4597-a5b8-dac25530e975 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:34.794927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12a71324-504b-4597-a5b8-dac25530e975 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:35.135418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-12a71324-504b-4597-a5b8-dac25530e975 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:35.150287 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-12a71324-504b-4597-a5b8-dac25530e975 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1510 microversion: 2.1 time: 0.385762 Oct 12 22:26:35.151176 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2542/5695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:34 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1510 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:35.381130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aa2927f4-8805-4289-9820-1ffae5f8ce12 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:35.392250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aa2927f4-8805-4289-9820-1ffae5f8ce12 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:35.432887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa2927f4-8805-4289-9820-1ffae5f8ce12 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:35.433315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa2927f4-8805-4289-9820-1ffae5f8ce12 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:35.441578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa2927f4-8805-4289-9820-1ffae5f8ce12 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:35.446749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa2927f4-8805-4289-9820-1ffae5f8ce12 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:35.447757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa2927f4-8805-4289-9820-1ffae5f8ce12 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:35.448389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa2927f4-8805-4289-9820-1ffae5f8ce12 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:35.622144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aa2927f4-8805-4289-9820-1ffae5f8ce12 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:35.661578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aa2927f4-8805-4289-9820-1ffae5f8ce12 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:35.668058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aa2927f4-8805-4289-9820-1ffae5f8ce12 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:35.676798 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aa2927f4-8805-4289-9820-1ffae5f8ce12 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1285 microversion: 2.20 time: 0.299236 Oct 12 22:26:35.679205 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3154/5696] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:26:35 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1285 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:26:36.174374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c9cf16a6-1d53-49b1-a7ef-294371f4a149 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:36.174988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c9cf16a6-1d53-49b1-a7ef-294371f4a149 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:36.186892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9cf16a6-1d53-49b1-a7ef-294371f4a149 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:36.191064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9cf16a6-1d53-49b1-a7ef-294371f4a149 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:36.196996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9cf16a6-1d53-49b1-a7ef-294371f4a149 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:36.198046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9cf16a6-1d53-49b1-a7ef-294371f4a149 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:36.198535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9cf16a6-1d53-49b1-a7ef-294371f4a149 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:36.198984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9cf16a6-1d53-49b1-a7ef-294371f4a149 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:36.527044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c9cf16a6-1d53-49b1-a7ef-294371f4a149 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:36.537264 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c9cf16a6-1d53-49b1-a7ef-294371f4a149 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1487 microversion: 2.1 time: 0.367156 Oct 12 22:26:36.555500 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2543/5697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:36 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1487 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:36.563199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-551e4b02-37e2-48a5-a6b9-eee1c742f95a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-49159493"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:26:36.566531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-551e4b02-37e2-48a5-a6b9-eee1c742f95a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:36.587804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-551e4b02-37e2-48a5-a6b9-eee1c742f95a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:36.588303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-551e4b02-37e2-48a5-a6b9-eee1c742f95a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:36.592856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-551e4b02-37e2-48a5-a6b9-eee1c742f95a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:36.594207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-551e4b02-37e2-48a5-a6b9-eee1c742f95a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:36.594689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-551e4b02-37e2-48a5-a6b9-eee1c742f95a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:36.595128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-551e4b02-37e2-48a5-a6b9-eee1c742f95a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:36.708639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-983c92ff-c5f6-4b06-bdc2-ebcad86bf2d8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:36.709572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-983c92ff-c5f6-4b06-bdc2-ebcad86bf2d8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:36.724099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-983c92ff-c5f6-4b06-bdc2-ebcad86bf2d8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:36.744741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-983c92ff-c5f6-4b06-bdc2-ebcad86bf2d8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:36.746061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-983c92ff-c5f6-4b06-bdc2-ebcad86bf2d8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:36.749807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-983c92ff-c5f6-4b06-bdc2-ebcad86bf2d8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:36.750755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-983c92ff-c5f6-4b06-bdc2-ebcad86bf2d8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:36.752696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-983c92ff-c5f6-4b06-bdc2-ebcad86bf2d8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:36.805593 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-551e4b02-37e2-48a5-a6b9-eee1c742f95a tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "PUT /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1059 microversion: 2.1 time: 0.247182 Oct 12 22:26:36.818758 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3155/5698] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 12 22:26:36 2022] PUT /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1059 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:36.831103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1d22dff3-1220-4e87-9430-9687de839632 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:36.831755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1d22dff3-1220-4e87-9430-9687de839632 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:36.858296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d22dff3-1220-4e87-9430-9687de839632 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:36.858834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d22dff3-1220-4e87-9430-9687de839632 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:36.859870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d22dff3-1220-4e87-9430-9687de839632 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:36.860598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d22dff3-1220-4e87-9430-9687de839632 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:36.861050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d22dff3-1220-4e87-9430-9687de839632 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:36.888523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d22dff3-1220-4e87-9430-9687de839632 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:37.176878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1d22dff3-1220-4e87-9430-9687de839632 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:37.186715 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1d22dff3-1220-4e87-9430-9687de839632 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1486 microversion: 2.1 time: 0.362268 Oct 12 22:26:37.188380 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3156/5699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:36 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1486 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:26:37.211206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d906f9fc-3e59-4178-88e0-58ae23678d6b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:37.212300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d906f9fc-3e59-4178-88e0-58ae23678d6b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:37.225460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d906f9fc-3e59-4178-88e0-58ae23678d6b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:37.226262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d906f9fc-3e59-4178-88e0-58ae23678d6b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:37.226891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d906f9fc-3e59-4178-88e0-58ae23678d6b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:37.229910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d906f9fc-3e59-4178-88e0-58ae23678d6b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:37.230770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d906f9fc-3e59-4178-88e0-58ae23678d6b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:37.235307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d906f9fc-3e59-4178-88e0-58ae23678d6b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:37.277909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-983c92ff-c5f6-4b06-bdc2-ebcad86bf2d8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:37.291853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-983c92ff-c5f6-4b06-bdc2-ebcad86bf2d8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:37.299993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-983c92ff-c5f6-4b06-bdc2-ebcad86bf2d8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:37.307756 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-983c92ff-c5f6-4b06-bdc2-ebcad86bf2d8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1351 microversion: 2.20 time: 0.603268 Oct 12 22:26:37.310542 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2544/5700] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:26:36 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1351 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:26:37.570528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d906f9fc-3e59-4178-88e0-58ae23678d6b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:37.581682 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d906f9fc-3e59-4178-88e0-58ae23678d6b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1486 microversion: 2.1 time: 0.374905 Oct 12 22:26:37.583289 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3157/5701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:37 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1486 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:26:37.608207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-772703b3-0798-4e35-805b-8fe66b677ee0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:37.609123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-772703b3-0798-4e35-805b-8fe66b677ee0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:37.617136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-772703b3-0798-4e35-805b-8fe66b677ee0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:37.617984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-772703b3-0798-4e35-805b-8fe66b677ee0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:37.618626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-772703b3-0798-4e35-805b-8fe66b677ee0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:37.620085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-772703b3-0798-4e35-805b-8fe66b677ee0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:37.620755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-772703b3-0798-4e35-805b-8fe66b677ee0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:37.621442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-772703b3-0798-4e35-805b-8fe66b677ee0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:37.661551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-772703b3-0798-4e35-805b-8fe66b677ee0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:26:37.740610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:26:37.804965 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-772703b3-0798-4e35-805b-8fe66b677ee0 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 204 len: 0 microversion: 2.1 time: 0.200658 Oct 12 22:26:37.815793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fceedd50-e9f0-40f0-97f4-cc74a0526d7e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:37.816763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fceedd50-e9f0-40f0-97f4-cc74a0526d7e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:37.822648 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2545/5702] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:26:37 2022] DELETE /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:26:37.827158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fceedd50-e9f0-40f0-97f4-cc74a0526d7e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:37.830894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fceedd50-e9f0-40f0-97f4-cc74a0526d7e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:37.831509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fceedd50-e9f0-40f0-97f4-cc74a0526d7e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:37.832510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fceedd50-e9f0-40f0-97f4-cc74a0526d7e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:37.833229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fceedd50-e9f0-40f0-97f4-cc74a0526d7e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:37.833864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fceedd50-e9f0-40f0-97f4-cc74a0526d7e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:38.208424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fceedd50-e9f0-40f0-97f4-cc74a0526d7e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:38.220926 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fceedd50-e9f0-40f0-97f4-cc74a0526d7e tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1492 microversion: 2.1 time: 0.407790 Oct 12 22:26:38.220926 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3158/5703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:37 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1492 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:38.337870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bd947c1d-8418-4812-bf3d-641ba638e886 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:38.340671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bd947c1d-8418-4812-bf3d-641ba638e886 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:38.351387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd947c1d-8418-4812-bf3d-641ba638e886 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:38.352178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd947c1d-8418-4812-bf3d-641ba638e886 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:38.353034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd947c1d-8418-4812-bf3d-641ba638e886 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:38.355369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd947c1d-8418-4812-bf3d-641ba638e886 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:38.361671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd947c1d-8418-4812-bf3d-641ba638e886 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:38.364921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd947c1d-8418-4812-bf3d-641ba638e886 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:38.551173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd947c1d-8418-4812-bf3d-641ba638e886 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:38.573392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd947c1d-8418-4812-bf3d-641ba638e886 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:38.579763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd947c1d-8418-4812-bf3d-641ba638e886 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:38.583213 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bd947c1d-8418-4812-bf3d-641ba638e886 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1339 microversion: 2.20 time: 0.251724 Oct 12 22:26:38.592337 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2546/5704] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:26:38 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1339 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:26:39.247514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c52f630d-6210-4089-a6e0-6a01338e0c1d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:39.249002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c52f630d-6210-4089-a6e0-6a01338e0c1d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:39.267991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c52f630d-6210-4089-a6e0-6a01338e0c1d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:39.269558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c52f630d-6210-4089-a6e0-6a01338e0c1d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:39.271466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c52f630d-6210-4089-a6e0-6a01338e0c1d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:39.273309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c52f630d-6210-4089-a6e0-6a01338e0c1d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:39.274521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c52f630d-6210-4089-a6e0-6a01338e0c1d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:39.275873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c52f630d-6210-4089-a6e0-6a01338e0c1d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:39.620268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7486fdbe-6dc8-4018-b9cd-14a170d2f5cd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:39.621950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7486fdbe-6dc8-4018-b9cd-14a170d2f5cd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:39.643214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c52f630d-6210-4089-a6e0-6a01338e0c1d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:39.648566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7486fdbe-6dc8-4018-b9cd-14a170d2f5cd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:39.653170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7486fdbe-6dc8-4018-b9cd-14a170d2f5cd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:39.655475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7486fdbe-6dc8-4018-b9cd-14a170d2f5cd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:39.658108 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c52f630d-6210-4089-a6e0-6a01338e0c1d tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1492 microversion: 2.1 time: 0.413904 Oct 12 22:26:39.658697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7486fdbe-6dc8-4018-b9cd-14a170d2f5cd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:39.660523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7486fdbe-6dc8-4018-b9cd-14a170d2f5cd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:39.662112 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3159/5705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:39 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1492 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:39.662654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7486fdbe-6dc8-4018-b9cd-14a170d2f5cd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:40.607545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7486fdbe-6dc8-4018-b9cd-14a170d2f5cd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:40.644902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7486fdbe-6dc8-4018-b9cd-14a170d2f5cd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:40.652440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7486fdbe-6dc8-4018-b9cd-14a170d2f5cd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:40.685487 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7486fdbe-6dc8-4018-b9cd-14a170d2f5cd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1406 microversion: 2.20 time: 1.071170 Oct 12 22:26:40.686178 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2547/5706] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:26:39 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1406 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:26:40.689264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dc118cc9-7ef8-4b22-aa7f-54e35b193581 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:40.692780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dc118cc9-7ef8-4b22-aa7f-54e35b193581 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:40.703904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc118cc9-7ef8-4b22-aa7f-54e35b193581 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:40.704841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc118cc9-7ef8-4b22-aa7f-54e35b193581 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:40.705906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc118cc9-7ef8-4b22-aa7f-54e35b193581 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:40.706871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc118cc9-7ef8-4b22-aa7f-54e35b193581 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:40.714221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc118cc9-7ef8-4b22-aa7f-54e35b193581 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:40.715105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc118cc9-7ef8-4b22-aa7f-54e35b193581 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:40.985303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dc118cc9-7ef8-4b22-aa7f-54e35b193581 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:41.002346 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dc118cc9-7ef8-4b22-aa7f-54e35b193581 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1492 microversion: 2.1 time: 0.322549 Oct 12 22:26:41.004092 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3160/5707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:40 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1492 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:41.715800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5864efe1-eaad-424d-a60f-43b85af77e35 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:41.717570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5864efe1-eaad-424d-a60f-43b85af77e35 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:41.738257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5864efe1-eaad-424d-a60f-43b85af77e35 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:41.739946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5864efe1-eaad-424d-a60f-43b85af77e35 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:41.743075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5864efe1-eaad-424d-a60f-43b85af77e35 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:41.754729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5864efe1-eaad-424d-a60f-43b85af77e35 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:41.757986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5864efe1-eaad-424d-a60f-43b85af77e35 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:41.758957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5864efe1-eaad-424d-a60f-43b85af77e35 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:42.030733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c961945f-b869-4e50-96fc-bd87253f8281 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:42.031675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c961945f-b869-4e50-96fc-bd87253f8281 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:42.056548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c961945f-b869-4e50-96fc-bd87253f8281 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:42.058647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c961945f-b869-4e50-96fc-bd87253f8281 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:42.067831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c961945f-b869-4e50-96fc-bd87253f8281 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:42.070323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c961945f-b869-4e50-96fc-bd87253f8281 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:42.072179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c961945f-b869-4e50-96fc-bd87253f8281 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:42.079450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c961945f-b869-4e50-96fc-bd87253f8281 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:42.423106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c961945f-b869-4e50-96fc-bd87253f8281 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:42.434123 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c961945f-b869-4e50-96fc-bd87253f8281 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1492 microversion: 2.1 time: 0.408091 Oct 12 22:26:42.455497 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3161/5708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:42 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1492 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:42.958349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5864efe1-eaad-424d-a60f-43b85af77e35 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:42.979169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5864efe1-eaad-424d-a60f-43b85af77e35 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:42.992768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5864efe1-eaad-424d-a60f-43b85af77e35 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:42.997235 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5864efe1-eaad-424d-a60f-43b85af77e35 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1406 microversion: 2.20 time: 1.283889 Oct 12 22:26:42.998608 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2548/5709] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:26:41 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1406 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:26:43.459751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7b939dc7-f71f-4eed-bcf4-ccd3f12d20ef tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:43.461049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7b939dc7-f71f-4eed-bcf4-ccd3f12d20ef tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:43.495850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b939dc7-f71f-4eed-bcf4-ccd3f12d20ef tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:43.496634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b939dc7-f71f-4eed-bcf4-ccd3f12d20ef tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:43.497981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b939dc7-f71f-4eed-bcf4-ccd3f12d20ef tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:43.500017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b939dc7-f71f-4eed-bcf4-ccd3f12d20ef tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:43.502864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b939dc7-f71f-4eed-bcf4-ccd3f12d20ef tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:43.505017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b939dc7-f71f-4eed-bcf4-ccd3f12d20ef tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:43.523368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-ef5d3090-5b5e-4634-9fd6-c67453b1576a req-fe4792c5-2ef9-4b2b-b79f-ceded646c202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c620983a-6efc-458a-9bb3-fb1b6ef7283f", "name": "network-vif-deleted", "tag": "6f09dab5-3aef-4840-b51a-fd178ecb1f4a"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:26:43.545924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ef5d3090-5b5e-4634-9fd6-c67453b1576a req-fe4792c5-2ef9-4b2b-b79f-ceded646c202 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:43.546365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ef5d3090-5b5e-4634-9fd6-c67453b1576a req-fe4792c5-2ef9-4b2b-b79f-ceded646c202 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:43.546835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ef5d3090-5b5e-4634-9fd6-c67453b1576a req-fe4792c5-2ef9-4b2b-b79f-ceded646c202 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:43.620231 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-ef5d3090-5b5e-4634-9fd6-c67453b1576a req-fe4792c5-2ef9-4b2b-b79f-ceded646c202 service nova] Creating event network-vif-deleted:6f09dab5-3aef-4840-b51a-fd178ecb1f4a for instance c620983a-6efc-458a-9bb3-fb1b6ef7283f on n-h1-861111-1 Oct 12 22:26:43.630406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:26:43.642574 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-ef5d3090-5b5e-4634-9fd6-c67453b1576a req-fe4792c5-2ef9-4b2b-b79f-ceded646c202 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124621 Oct 12 22:26:43.646295 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2549/5710] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:26:44.032609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-39c2577d-d541-47a4-a328-58e3c84b93ac tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:44.034548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-39c2577d-d541-47a4-a328-58e3c84b93ac tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:44.038920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7b939dc7-f71f-4eed-bcf4-ccd3f12d20ef tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:44.052346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:26:44.056025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=10 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:26:44.057485 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7b939dc7-f71f-4eed-bcf4-ccd3f12d20ef tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 200 len: 1450 microversion: 2.1 time: 0.600545 Oct 12 22:26:44.063965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39c2577d-d541-47a4-a328-58e3c84b93ac tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:44.065793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39c2577d-d541-47a4-a328-58e3c84b93ac tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:44.070942 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3162/5711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:43 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 1450 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:44.094681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39c2577d-d541-47a4-a328-58e3c84b93ac tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:44.101351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39c2577d-d541-47a4-a328-58e3c84b93ac tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:44.104930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39c2577d-d541-47a4-a328-58e3c84b93ac tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:44.106633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39c2577d-d541-47a4-a328-58e3c84b93ac tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:45.101396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e5a69b2d-aa0e-484c-9cc3-06be5eb86df2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:45.101935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e5a69b2d-aa0e-484c-9cc3-06be5eb86df2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:45.133405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:26:45.142349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5a69b2d-aa0e-484c-9cc3-06be5eb86df2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:45.143823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5a69b2d-aa0e-484c-9cc3-06be5eb86df2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:45.167014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5a69b2d-aa0e-484c-9cc3-06be5eb86df2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:45.174976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5a69b2d-aa0e-484c-9cc3-06be5eb86df2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:45.177849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5a69b2d-aa0e-484c-9cc3-06be5eb86df2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:45.179868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e5a69b2d-aa0e-484c-9cc3-06be5eb86df2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:45.244559 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-e5a69b2d-aa0e-484c-9cc3-06be5eb86df2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e5a69b2d-aa0e-484c-9cc3-06be5eb86df2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f HTTP/1.1 Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'c620983a-6efc-458a-9bb3-fb1b6ef7283f'} Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.249149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.253398 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:45.253398 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:45.253398 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:26:45.253398 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:26:45.253398 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. Oct 12 22:26:45.253398 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.260356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e5a69b2d-aa0e-484c-9cc3-06be5eb86df2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:26:45.262319 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e5a69b2d-aa0e-484c-9cc3-06be5eb86df2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 404 len: 111 microversion: 2.1 time: 0.167966 Oct 12 22:26:45.266613 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3163/5712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:45 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:26:45.304874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-564df299-024e-49b4-a528-c81fdc67bb3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:45.308574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-564df299-024e-49b4-a528-c81fdc67bb3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:45.324136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564df299-024e-49b4-a528-c81fdc67bb3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:45.325325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564df299-024e-49b4-a528-c81fdc67bb3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:45.328532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564df299-024e-49b4-a528-c81fdc67bb3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:45.330217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564df299-024e-49b4-a528-c81fdc67bb3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:45.332527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564df299-024e-49b4-a528-c81fdc67bb3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:45.334153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564df299-024e-49b4-a528-c81fdc67bb3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:45.361964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-39c2577d-d541-47a4-a328-58e3c84b93ac tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:45.369729 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-564df299-024e-49b4-a528-c81fdc67bb3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-564df299-024e-49b4-a528-c81fdc67bb3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f HTTP/1.1 Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'c620983a-6efc-458a-9bb3-fb1b6ef7283f'} Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:26:45.377332 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. Oct 12 22:26:45.380725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.380725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:45.380725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.380725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.380725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:45.380725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:45.380725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:26:45.380725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:26:45.380725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. Oct 12 22:26:45.380725 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.381252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-39c2577d-d541-47a4-a328-58e3c84b93ac tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:45.382221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-39c2577d-d541-47a4-a328-58e3c84b93ac tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:45.383087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-564df299-024e-49b4-a528-c81fdc67bb3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:26:45.386653 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-564df299-024e-49b4-a528-c81fdc67bb3f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 404 len: 111 microversion: 2.1 time: 0.099774 Oct 12 22:26:45.387597 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3164/5713] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:26:45 2022] DELETE /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:26:45.392939 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-39c2577d-d541-47a4-a328-58e3c84b93ac tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1406 microversion: 2.20 time: 1.358196 Oct 12 22:26:45.396695 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2550/5714] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:26:44 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1406 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:26:45.417929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1be2d7b8-3543-4268-984b-36c01deccd46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:45.418750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1be2d7b8-3543-4268-984b-36c01deccd46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: c620983a-6efc-458a-9bb3-fb1b6ef7283f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:45.429886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1be2d7b8-3543-4268-984b-36c01deccd46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:45.432934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1be2d7b8-3543-4268-984b-36c01deccd46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:45.435845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1be2d7b8-3543-4268-984b-36c01deccd46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:45.436925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1be2d7b8-3543-4268-984b-36c01deccd46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:45.438029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1be2d7b8-3543-4268-984b-36c01deccd46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:45.440582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1be2d7b8-3543-4268-984b-36c01deccd46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:45.477383 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-1be2d7b8-3543-4268-984b-36c01deccd46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1be2d7b8-3543-4268-984b-36c01deccd46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f HTTP/1.1 Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'c620983a-6efc-458a-9bb3-fb1b6ef7283f'} Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.481779 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.486200 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:45.486200 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:45.486200 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:26:45.486200 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:26:45.486200 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. Oct 12 22:26:45.486200 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.490218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1be2d7b8-3543-4268-984b-36c01deccd46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance c620983a-6efc-458a-9bb3-fb1b6ef7283f could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:26:45.493648 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1be2d7b8-3543-4268-984b-36c01deccd46 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f" status: 404 len: 111 microversion: 2.1 time: 0.101783 Oct 12 22:26:45.495160 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3165/5715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:45 2022] GET /compute/v2.1/servers/c620983a-6efc-458a-9bb3-fb1b6ef7283f => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:26:45.503909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-127f2f40-f8d4-4bb3-8d24-15b542576d55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:45.504417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-127f2f40-f8d4-4bb3-8d24-15b542576d55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:45.507578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:26:45.527901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-127f2f40-f8d4-4bb3-8d24-15b542576d55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:45.529726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-127f2f40-f8d4-4bb3-8d24-15b542576d55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:45.530202 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-127f2f40-f8d4-4bb3-8d24-15b542576d55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:45.531959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-127f2f40-f8d4-4bb3-8d24-15b542576d55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:45.533700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-127f2f40-f8d4-4bb3-8d24-15b542576d55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:45.534327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-127f2f40-f8d4-4bb3-8d24-15b542576d55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:45.573026 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-127f2f40-f8d4-4bb3-8d24-15b542576d55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-127f2f40-f8d4-4bb3-8d24-15b542576d55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 HTTP/1.1 Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '942b1e4a-53ac-41ac-ab30-f92f68e11447'} Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:26:45.575278 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. Oct 12 22:26:45.584287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.584287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:45.584287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.584287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.584287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:45.584287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:45.584287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:26:45.584287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:26:45.584287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. Oct 12 22:26:45.584287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.587597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-127f2f40-f8d4-4bb3-8d24-15b542576d55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:26:45.589431 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-127f2f40-f8d4-4bb3-8d24-15b542576d55 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 404 len: 111 microversion: 2.1 time: 0.090209 Oct 12 22:26:45.594251 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2551/5716] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:26:45 2022] DELETE /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:26:45.600139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6f900f18-5fc7-43fe-887d-011e5a9d18cb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:45.600906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6f900f18-5fc7-43fe-887d-011e5a9d18cb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 942b1e4a-53ac-41ac-ab30-f92f68e11447] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:45.609108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f900f18-5fc7-43fe-887d-011e5a9d18cb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:45.617023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f900f18-5fc7-43fe-887d-011e5a9d18cb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:45.617991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f900f18-5fc7-43fe-887d-011e5a9d18cb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:45.619018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f900f18-5fc7-43fe-887d-011e5a9d18cb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:45.619271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f900f18-5fc7-43fe-887d-011e5a9d18cb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:45.623943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f900f18-5fc7-43fe-887d-011e5a9d18cb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:45.678641 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-6f900f18-5fc7-43fe-887d-011e5a9d18cb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6f900f18-5fc7-43fe-887d-011e5a9d18cb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 HTTP/1.1 Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '942b1e4a-53ac-41ac-ab30-f92f68e11447'} Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.680877 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.684950 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:45.684950 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:45.684950 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:26:45.684950 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:26:45.684950 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. Oct 12 22:26:45.684950 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.686056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6f900f18-5fc7-43fe-887d-011e5a9d18cb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 942b1e4a-53ac-41ac-ab30-f92f68e11447 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:26:45.687501 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6f900f18-5fc7-43fe-887d-011e5a9d18cb tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447" status: 404 len: 111 microversion: 2.1 time: 0.091438 Oct 12 22:26:45.692472 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3166/5717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:45 2022] GET /compute/v2.1/servers/942b1e4a-53ac-41ac-ab30-f92f68e11447 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:26:45.700989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-54d7c217-eed9-4126-989f-f8a97ed90002 req-d41fa95c-55ec-46a4-ac4a-fabdf711257c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ecbb62-d209-4784-9a32-1076041ce09a", "tag": "57ae856e-81cb-43bf-8768-e10cfb8d0da9"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:26:45.703283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ad0511fd-f353-46aa-9dbb-cdac6dde5aff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:45.706565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ad0511fd-f353-46aa-9dbb-cdac6dde5aff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:45.730420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-54d7c217-eed9-4126-989f-f8a97ed90002 req-d41fa95c-55ec-46a4-ac4a-fabdf711257c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:45.730914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-54d7c217-eed9-4126-989f-f8a97ed90002 req-d41fa95c-55ec-46a4-ac4a-fabdf711257c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:45.734316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-54d7c217-eed9-4126-989f-f8a97ed90002 req-d41fa95c-55ec-46a4-ac4a-fabdf711257c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:45.737267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad0511fd-f353-46aa-9dbb-cdac6dde5aff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:45.737786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad0511fd-f353-46aa-9dbb-cdac6dde5aff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:45.739707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad0511fd-f353-46aa-9dbb-cdac6dde5aff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:45.741407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad0511fd-f353-46aa-9dbb-cdac6dde5aff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:45.776554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad0511fd-f353-46aa-9dbb-cdac6dde5aff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:45.782804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad0511fd-f353-46aa-9dbb-cdac6dde5aff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:45.790023 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-54d7c217-eed9-4126-989f-f8a97ed90002 req-d41fa95c-55ec-46a4-ac4a-fabdf711257c service nova] Creating event network-changed:57ae856e-81cb-43bf-8768-e10cfb8d0da9 for instance 97ecbb62-d209-4784-9a32-1076041ce09a on n-h1-861111-1 Oct 12 22:26:45.824499 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-54d7c217-eed9-4126-989f-f8a97ed90002 req-d41fa95c-55ec-46a4-ac4a-fabdf711257c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123867 Oct 12 22:26:45.825929 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2552/5718] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 12 22:26:45.862944 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-ad0511fd-f353-46aa-9dbb-cdac6dde5aff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ad0511fd-f353-46aa-9dbb-cdac6dde5aff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 HTTP/1.1 Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '665dc72f-f961-4a0b-b2cd-61828dc07c99'} Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:26:45.872082 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. Oct 12 22:26:45.878728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.878728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:45.878728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.878728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:45.878728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:45.878728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:45.878728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:26:45.878728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:26:45.878728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. Oct 12 22:26:45.878728 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:45.884924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ad0511fd-f353-46aa-9dbb-cdac6dde5aff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:26:45.891283 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ad0511fd-f353-46aa-9dbb-cdac6dde5aff tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 404 len: 111 microversion: 2.1 time: 0.190674 Oct 12 22:26:45.895845 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3167/5719] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:26:45 2022] DELETE /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:26:45.909258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f64a8d5a-a2a7-4b9d-8b68-fc0ebf486a4b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:45.910120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f64a8d5a-a2a7-4b9d-8b68-fc0ebf486a4b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 665dc72f-f961-4a0b-b2cd-61828dc07c99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:45.929846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f64a8d5a-a2a7-4b9d-8b68-fc0ebf486a4b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:45.930350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f64a8d5a-a2a7-4b9d-8b68-fc0ebf486a4b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:45.930786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f64a8d5a-a2a7-4b9d-8b68-fc0ebf486a4b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:45.938335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f64a8d5a-a2a7-4b9d-8b68-fc0ebf486a4b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:45.938848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f64a8d5a-a2a7-4b9d-8b68-fc0ebf486a4b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:45.939295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f64a8d5a-a2a7-4b9d-8b68-fc0ebf486a4b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:46.018730 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-f64a8d5a-a2a7-4b9d-8b68-fc0ebf486a4b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f64a8d5a-a2a7-4b9d-8b68-fc0ebf486a4b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 HTTP/1.1 Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '665dc72f-f961-4a0b-b2cd-61828dc07c99'} Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.030031 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.034287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.034287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.034287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:26:46.034287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:26:46.034287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. Oct 12 22:26:46.034287 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.034287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f64a8d5a-a2a7-4b9d-8b68-fc0ebf486a4b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 665dc72f-f961-4a0b-b2cd-61828dc07c99 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:26:46.040232 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f64a8d5a-a2a7-4b9d-8b68-fc0ebf486a4b tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99" status: 404 len: 111 microversion: 2.1 time: 0.139502 Oct 12 22:26:46.040846 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2553/5720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:45 2022] GET /compute/v2.1/servers/665dc72f-f961-4a0b-b2cd-61828dc07c99 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:26:46.050800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5a89a139-94bd-4e79-bb33-e6afec6bc986 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:46.051487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5a89a139-94bd-4e79-bb33-e6afec6bc986 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:46.060449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a89a139-94bd-4e79-bb33-e6afec6bc986 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:46.063828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a89a139-94bd-4e79-bb33-e6afec6bc986 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:46.064421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a89a139-94bd-4e79-bb33-e6afec6bc986 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:46.066720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a89a139-94bd-4e79-bb33-e6afec6bc986 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:46.074955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a89a139-94bd-4e79-bb33-e6afec6bc986 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:46.075855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a89a139-94bd-4e79-bb33-e6afec6bc986 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:46.110349 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-5a89a139-94bd-4e79-bb33-e6afec6bc986 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5a89a139-94bd-4e79-bb33-e6afec6bc986 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 HTTP/1.1 Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '84af030c-67a9-47bb-826e-b414ea7857b5'} Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:26:46.113560 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. Oct 12 22:26:46.117635 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.117635 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.117635 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.117635 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.117635 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.117635 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.117635 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:26:46.117635 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:26:46.117635 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. Oct 12 22:26:46.117635 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.122387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5a89a139-94bd-4e79-bb33-e6afec6bc986 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:26:46.123399 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5a89a139-94bd-4e79-bb33-e6afec6bc986 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 404 len: 111 microversion: 2.1 time: 0.077697 Oct 12 22:26:46.128591 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3168/5721] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:26:46 2022] DELETE /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:26:46.135691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-157e29eb-a43f-433b-aa24-3e55c9bda649 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:46.136312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-157e29eb-a43f-433b-aa24-3e55c9bda649 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 84af030c-67a9-47bb-826e-b414ea7857b5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:46.159588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-157e29eb-a43f-433b-aa24-3e55c9bda649 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:46.166629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-157e29eb-a43f-433b-aa24-3e55c9bda649 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:46.168254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-157e29eb-a43f-433b-aa24-3e55c9bda649 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:46.173550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-157e29eb-a43f-433b-aa24-3e55c9bda649 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:46.174226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-157e29eb-a43f-433b-aa24-3e55c9bda649 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:46.175561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-157e29eb-a43f-433b-aa24-3e55c9bda649 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:46.237127 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-157e29eb-a43f-433b-aa24-3e55c9bda649 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-157e29eb-a43f-433b-aa24-3e55c9bda649 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 HTTP/1.1 Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '84af030c-67a9-47bb-826e-b414ea7857b5'} Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.243100 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.247220 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.247220 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.247220 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:26:46.247220 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:26:46.247220 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. Oct 12 22:26:46.247220 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.248680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-157e29eb-a43f-433b-aa24-3e55c9bda649 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 84af030c-67a9-47bb-826e-b414ea7857b5 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:26:46.252767 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-157e29eb-a43f-433b-aa24-3e55c9bda649 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5" status: 404 len: 111 microversion: 2.1 time: 0.118668 Oct 12 22:26:46.254300 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2554/5722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:46 2022] GET /compute/v2.1/servers/84af030c-67a9-47bb-826e-b414ea7857b5 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:26:46.264988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c1391fe9-b7d4-4c81-9981-e41ad5c8aad4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:46.265675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c1391fe9-b7d4-4c81-9981-e41ad5c8aad4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:46.312723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1391fe9-b7d4-4c81-9981-e41ad5c8aad4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:46.318199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1391fe9-b7d4-4c81-9981-e41ad5c8aad4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:46.320508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1391fe9-b7d4-4c81-9981-e41ad5c8aad4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:46.328937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1391fe9-b7d4-4c81-9981-e41ad5c8aad4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:46.331260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1391fe9-b7d4-4c81-9981-e41ad5c8aad4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:46.335008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1391fe9-b7d4-4c81-9981-e41ad5c8aad4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:46.397386 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-c1391fe9-b7d4-4c81-9981-e41ad5c8aad4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c1391fe9-b7d4-4c81-9981-e41ad5c8aad4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 HTTP/1.1 Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '9eedbdf1-5816-49c0-9d3e-fd35cce5cb61'} Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:26:46.407912 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. Oct 12 22:26:46.413128 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.413128 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.413128 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.413128 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.413128 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.413128 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.413128 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:26:46.413128 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:26:46.413128 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. Oct 12 22:26:46.413128 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.415427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c1391fe9-b7d4-4c81-9981-e41ad5c8aad4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:26:46.420871 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c1391fe9-b7d4-4c81-9981-e41ad5c8aad4 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 404 len: 111 microversion: 2.1 time: 0.158718 Oct 12 22:26:46.426859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d13d3b35-c62d-4199-9f61-40532433e663 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:46.427862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d13d3b35-c62d-4199-9f61-40532433e663 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:46.428646 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3169/5723] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:26:46 2022] DELETE /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:26:46.438674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d13d3b35-c62d-4199-9f61-40532433e663 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:46.441718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d13d3b35-c62d-4199-9f61-40532433e663 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:46.442291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d13d3b35-c62d-4199-9f61-40532433e663 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:46.443507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d13d3b35-c62d-4199-9f61-40532433e663 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:46.445591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d13d3b35-c62d-4199-9f61-40532433e663 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:46.446149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d13d3b35-c62d-4199-9f61-40532433e663 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:46.462494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-828c481c-b007-4acc-a289-c73441aa5dfc tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:46.463619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-828c481c-b007-4acc-a289-c73441aa5dfc tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:46.476599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-828c481c-b007-4acc-a289-c73441aa5dfc tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:46.477397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-828c481c-b007-4acc-a289-c73441aa5dfc tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:46.478092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-828c481c-b007-4acc-a289-c73441aa5dfc tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:46.479117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-828c481c-b007-4acc-a289-c73441aa5dfc tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:46.480332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-828c481c-b007-4acc-a289-c73441aa5dfc tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:46.480992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-828c481c-b007-4acc-a289-c73441aa5dfc tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:46.504266 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-828c481c-b007-4acc-a289-c73441aa5dfc tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-828c481c-b007-4acc-a289-c73441aa5dfc tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 HTTP/1.1 Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '9eedbdf1-5816-49c0-9d3e-fd35cce5cb61'} Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.506210 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.510705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.510705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.510705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:26:46.510705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:26:46.510705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. Oct 12 22:26:46.510705 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.512786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-828c481c-b007-4acc-a289-c73441aa5dfc tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:26:46.514584 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-828c481c-b007-4acc-a289-c73441aa5dfc tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61" status: 404 len: 111 microversion: 2.1 time: 0.081860 Oct 12 22:26:46.515442 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3170/5724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:46 2022] GET /compute/v2.1/servers/9eedbdf1-5816-49c0-9d3e-fd35cce5cb61 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:26:46.529417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-07288f7c-0237-4a89-a8d1-fbc9b11ea5d2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:46.530353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-07288f7c-0237-4a89-a8d1-fbc9b11ea5d2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:46.540119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07288f7c-0237-4a89-a8d1-fbc9b11ea5d2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:46.541081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07288f7c-0237-4a89-a8d1-fbc9b11ea5d2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:46.541822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07288f7c-0237-4a89-a8d1-fbc9b11ea5d2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:46.543153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07288f7c-0237-4a89-a8d1-fbc9b11ea5d2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:46.543968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07288f7c-0237-4a89-a8d1-fbc9b11ea5d2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:46.544624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07288f7c-0237-4a89-a8d1-fbc9b11ea5d2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:46.579097 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-07288f7c-0237-4a89-a8d1-fbc9b11ea5d2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-07288f7c-0237-4a89-a8d1-fbc9b11ea5d2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 HTTP/1.1 Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '8c7d78e6-11af-404e-ad70-5c3d6e04bd90'} Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:26:46.584866 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. Oct 12 22:26:46.588502 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.588502 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.588502 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.588502 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.588502 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.588502 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.588502 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:26:46.588502 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:26:46.588502 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. Oct 12 22:26:46.588502 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.590658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-07288f7c-0237-4a89-a8d1-fbc9b11ea5d2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:26:46.592609 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-07288f7c-0237-4a89-a8d1-fbc9b11ea5d2 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 404 len: 111 microversion: 2.1 time: 0.071733 Oct 12 22:26:46.595957 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3171/5725] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:26:46 2022] DELETE /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:26:46.611565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fcb3c411-d710-48d2-865f-cd2f8c065849 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:46.613245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fcb3c411-d710-48d2-865f-cd2f8c065849 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 8c7d78e6-11af-404e-ad70-5c3d6e04bd90] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:46.630831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcb3c411-d710-48d2-865f-cd2f8c065849 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:46.631418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcb3c411-d710-48d2-865f-cd2f8c065849 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:46.631954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcb3c411-d710-48d2-865f-cd2f8c065849 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:46.632751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcb3c411-d710-48d2-865f-cd2f8c065849 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:46.635030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcb3c411-d710-48d2-865f-cd2f8c065849 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:46.635575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fcb3c411-d710-48d2-865f-cd2f8c065849 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:46.665380 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-fcb3c411-d710-48d2-865f-cd2f8c065849 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fcb3c411-d710-48d2-865f-cd2f8c065849 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 HTTP/1.1 Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '8c7d78e6-11af-404e-ad70-5c3d6e04bd90'} Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.670891 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.677061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.677061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.677061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:26:46.677061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:26:46.677061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. Oct 12 22:26:46.677061 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.684313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fcb3c411-d710-48d2-865f-cd2f8c065849 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 8c7d78e6-11af-404e-ad70-5c3d6e04bd90 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:26:46.686144 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fcb3c411-d710-48d2-865f-cd2f8c065849 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90" status: 404 len: 111 microversion: 2.1 time: 0.081153 Oct 12 22:26:46.687062 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3172/5726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:46 2022] GET /compute/v2.1/servers/8c7d78e6-11af-404e-ad70-5c3d6e04bd90 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:26:46.700686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8e6f181f-bf25-441b-8d52-506ccf7ca025 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:46.711327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8e6f181f-bf25-441b-8d52-506ccf7ca025 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 866af2f5-9e3f-411a-bcaf-a77aceb6260a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:46.739667 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-8e6f181f-bf25-441b-8d52-506ccf7ca025 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8e6f181f-bf25-441b-8d52-506ccf7ca025 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/866af2f5-9e3f-411a-bcaf-a77aceb6260a HTTP/1.1 Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '866af2f5-9e3f-411a-bcaf-a77aceb6260a'} Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.741660 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.747169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.747169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.747169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.747169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:26:46.747169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:26:46.747169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. Oct 12 22:26:46.747169 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.747169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8e6f181f-bf25-441b-8d52-506ccf7ca025 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:26:46.747169 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8e6f181f-bf25-441b-8d52-506ccf7ca025 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/866af2f5-9e3f-411a-bcaf-a77aceb6260a" status: 404 len: 111 microversion: 2.1 time: 0.048363 Oct 12 22:26:46.751768 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3173/5727] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:26:46 2022] DELETE /compute/v2.1/servers/866af2f5-9e3f-411a-bcaf-a77aceb6260a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:26:46.780053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-745efbf1-c798-43a7-a287-4e8a5afd9dee tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:46.783139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-745efbf1-c798-43a7-a287-4e8a5afd9dee tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 866af2f5-9e3f-411a-bcaf-a77aceb6260a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:46.809578 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-745efbf1-c798-43a7-a287-4e8a5afd9dee tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-745efbf1-c798-43a7-a287-4e8a5afd9dee tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/866af2f5-9e3f-411a-bcaf-a77aceb6260a HTTP/1.1 Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '866af2f5-9e3f-411a-bcaf-a77aceb6260a'} Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:46.812380 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:46.816194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:26:46.816194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:26:46.816194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. Oct 12 22:26:46.816194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:46.816194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-745efbf1-c798-43a7-a287-4e8a5afd9dee tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 866af2f5-9e3f-411a-bcaf-a77aceb6260a could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:26:46.821143 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-745efbf1-c798-43a7-a287-4e8a5afd9dee tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/866af2f5-9e3f-411a-bcaf-a77aceb6260a" status: 404 len: 111 microversion: 2.1 time: 0.065662 Oct 12 22:26:46.821143 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3174/5728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:46 2022] GET /compute/v2.1/servers/866af2f5-9e3f-411a-bcaf-a77aceb6260a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:26:46.837454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7b1d1154-8637-45a9-98c8-67d8de4d4b75 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:46.838254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7b1d1154-8637-45a9-98c8-67d8de4d4b75 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:46.851755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b1d1154-8637-45a9-98c8-67d8de4d4b75 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:46.853991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b1d1154-8637-45a9-98c8-67d8de4d4b75 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:46.854738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b1d1154-8637-45a9-98c8-67d8de4d4b75 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:46.855826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b1d1154-8637-45a9-98c8-67d8de4d4b75 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:46.858060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b1d1154-8637-45a9-98c8-67d8de4d4b75 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:46.859211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7b1d1154-8637-45a9-98c8-67d8de4d4b75 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:46.930187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7b1d1154-8637-45a9-98c8-67d8de4d4b75 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:26:46.954896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d13d3b35-c62d-4199-9f61-40532433e663 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:46.970686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d13d3b35-c62d-4199-9f61-40532433e663 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:46.977257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d13d3b35-c62d-4199-9f61-40532433e663 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:46.981069 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d13d3b35-c62d-4199-9f61-40532433e663 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1406 microversion: 2.20 time: 0.560143 Oct 12 22:26:46.987068 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2555/5729] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:26:46 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1406 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:26:47.188770 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7b1d1154-8637-45a9-98c8-67d8de4d4b75 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 204 len: 0 microversion: 2.1 time: 0.363170 Oct 12 22:26:47.195463 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3175/5730] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:26:46 2022] DELETE /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:26:47.204658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5f539221-cef1-409b-bc41-00fc78c3a77f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:47.205095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5f539221-cef1-409b-bc41-00fc78c3a77f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:47.217281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f539221-cef1-409b-bc41-00fc78c3a77f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:47.222078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f539221-cef1-409b-bc41-00fc78c3a77f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:47.222815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f539221-cef1-409b-bc41-00fc78c3a77f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:47.223847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f539221-cef1-409b-bc41-00fc78c3a77f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:47.226241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f539221-cef1-409b-bc41-00fc78c3a77f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:47.227755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f539221-cef1-409b-bc41-00fc78c3a77f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:48.016012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2875b7ba-0a78-4c16-90b7-0fd99876ff06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:48.017078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2875b7ba-0a78-4c16-90b7-0fd99876ff06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:48.035840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2875b7ba-0a78-4c16-90b7-0fd99876ff06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:48.036344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2875b7ba-0a78-4c16-90b7-0fd99876ff06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:48.036881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2875b7ba-0a78-4c16-90b7-0fd99876ff06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:48.053168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2875b7ba-0a78-4c16-90b7-0fd99876ff06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:48.053682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2875b7ba-0a78-4c16-90b7-0fd99876ff06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:48.054135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2875b7ba-0a78-4c16-90b7-0fd99876ff06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:48.175259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5f539221-cef1-409b-bc41-00fc78c3a77f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:48.189259 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5f539221-cef1-409b-bc41-00fc78c3a77f tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1478 microversion: 2.1 time: 0.986526 Oct 12 22:26:48.190113 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2556/5731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:47 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1478 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:26:49.026603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2875b7ba-0a78-4c16-90b7-0fd99876ff06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:49.046952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2875b7ba-0a78-4c16-90b7-0fd99876ff06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:49.058421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2875b7ba-0a78-4c16-90b7-0fd99876ff06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:49.061253 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2875b7ba-0a78-4c16-90b7-0fd99876ff06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1406 microversion: 2.20 time: 1.050079 Oct 12 22:26:49.076251 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3176/5732] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:26:48 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1406 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:26:49.218884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9328012c-777d-493b-938d-29f6bee70207 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:49.219730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9328012c-777d-493b-938d-29f6bee70207 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:49.237616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9328012c-777d-493b-938d-29f6bee70207 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:49.238116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9328012c-777d-493b-938d-29f6bee70207 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:49.238557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9328012c-777d-493b-938d-29f6bee70207 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:49.245291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9328012c-777d-493b-938d-29f6bee70207 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:49.251093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9328012c-777d-493b-938d-29f6bee70207 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:49.251898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9328012c-777d-493b-938d-29f6bee70207 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:50.092554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-375a09a4-da2e-4a5f-9d6e-f56dbbab8a4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:50.093223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-375a09a4-da2e-4a5f-9d6e-f56dbbab8a4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:50.097210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:26:50.127280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-375a09a4-da2e-4a5f-9d6e-f56dbbab8a4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:50.127810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-375a09a4-da2e-4a5f-9d6e-f56dbbab8a4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:50.130451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-375a09a4-da2e-4a5f-9d6e-f56dbbab8a4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:50.132843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-375a09a4-da2e-4a5f-9d6e-f56dbbab8a4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:50.133479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-375a09a4-da2e-4a5f-9d6e-f56dbbab8a4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:50.133919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-375a09a4-da2e-4a5f-9d6e-f56dbbab8a4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:50.156958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9328012c-777d-493b-938d-29f6bee70207 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:50.168958 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9328012c-777d-493b-938d-29f6bee70207 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1478 microversion: 2.1 time: 0.955573 Oct 12 22:26:50.176576 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2557/5733] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:49 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1478 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:50.753696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-959f7fdd-9247-4be4-861f-5d9dc5aa53f4 req-5f1aeb1f-6dd1-4a92-aaf9-88eb64fff5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e3d8758-5c13-4f1e-94fc-e12dec37ed65", "name": "network-vif-deleted", "tag": "7ef380f8-6a73-4b80-81ea-0aee0edb8b01"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:26:50.817774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-959f7fdd-9247-4be4-861f-5d9dc5aa53f4 req-5f1aeb1f-6dd1-4a92-aaf9-88eb64fff5ca service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:50.825163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-959f7fdd-9247-4be4-861f-5d9dc5aa53f4 req-5f1aeb1f-6dd1-4a92-aaf9-88eb64fff5ca service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:50.827457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-959f7fdd-9247-4be4-861f-5d9dc5aa53f4 req-5f1aeb1f-6dd1-4a92-aaf9-88eb64fff5ca service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:50.872347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-375a09a4-da2e-4a5f-9d6e-f56dbbab8a4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:50.873491 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-959f7fdd-9247-4be4-861f-5d9dc5aa53f4 req-5f1aeb1f-6dd1-4a92-aaf9-88eb64fff5ca service nova] Creating event network-vif-deleted:7ef380f8-6a73-4b80-81ea-0aee0edb8b01 for instance 7e3d8758-5c13-4f1e-94fc-e12dec37ed65 on n-h2-861111-1 Oct 12 22:26:50.888053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-375a09a4-da2e-4a5f-9d6e-f56dbbab8a4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:50.915359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-375a09a4-da2e-4a5f-9d6e-f56dbbab8a4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:50.916891 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-375a09a4-da2e-4a5f-9d6e-f56dbbab8a4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1406 microversion: 2.20 time: 0.829301 Oct 12 22:26:50.917989 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3177/5734] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:26:50 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1406 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:26:50.920785 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-959f7fdd-9247-4be4-861f-5d9dc5aa53f4 req-5f1aeb1f-6dd1-4a92-aaf9-88eb64fff5ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171029 Oct 12 22:26:50.922075 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2558/5735] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:26:51.206735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4eb66215-3761-4643-977e-7995ee7530f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:51.208720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4eb66215-3761-4643-977e-7995ee7530f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:51.239981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4eb66215-3761-4643-977e-7995ee7530f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:51.246227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4eb66215-3761-4643-977e-7995ee7530f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:51.247635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4eb66215-3761-4643-977e-7995ee7530f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:51.251282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4eb66215-3761-4643-977e-7995ee7530f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:51.251783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4eb66215-3761-4643-977e-7995ee7530f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:51.252236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4eb66215-3761-4643-977e-7995ee7530f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:51.373570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4eb66215-3761-4643-977e-7995ee7530f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:51.374816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4eb66215-3761-4643-977e-7995ee7530f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:51.375304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4eb66215-3761-4643-977e-7995ee7530f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:51.375782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-4eb66215-3761-4643-977e-7995ee7530f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lazy-loading 'fault' on Instance uuid 7e3d8758-5c13-4f1e-94fc-e12dec37ed65 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:26:51.718580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4eb66215-3761-4643-977e-7995ee7530f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a612b19154564a853199a67ea8496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8276c235e518406da376c8a4c19b27d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:51.727998 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4eb66215-3761-4643-977e-7995ee7530f5 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 200 len: 1282 microversion: 2.1 time: 0.536082 Oct 12 22:26:51.737192 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3178/5736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:51 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 1282 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:26:51.946607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b291920-2569-4f6f-9656-f7e3c06b3b0d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:51.947301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6b291920-2569-4f6f-9656-f7e3c06b3b0d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:51.958244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b291920-2569-4f6f-9656-f7e3c06b3b0d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:51.961573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b291920-2569-4f6f-9656-f7e3c06b3b0d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:51.966166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b291920-2569-4f6f-9656-f7e3c06b3b0d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:51.968617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b291920-2569-4f6f-9656-f7e3c06b3b0d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:51.970515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b291920-2569-4f6f-9656-f7e3c06b3b0d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:51.974582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b291920-2569-4f6f-9656-f7e3c06b3b0d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:52.558164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6b291920-2569-4f6f-9656-f7e3c06b3b0d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:52.569495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6b291920-2569-4f6f-9656-f7e3c06b3b0d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:52.581821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6b291920-2569-4f6f-9656-f7e3c06b3b0d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:52.587306 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6b291920-2569-4f6f-9656-f7e3c06b3b0d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1406 microversion: 2.20 time: 0.645097 Oct 12 22:26:52.587894 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2559/5737] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:26:51 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1406 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:26:52.775832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7fbf5819-00ad-42fe-b731-26cb08fd0681 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:52.776462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7fbf5819-00ad-42fe-b731-26cb08fd0681 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] [instance: 7e3d8758-5c13-4f1e-94fc-e12dec37ed65] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:52.788542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fbf5819-00ad-42fe-b731-26cb08fd0681 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:52.789035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fbf5819-00ad-42fe-b731-26cb08fd0681 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:52.789470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fbf5819-00ad-42fe-b731-26cb08fd0681 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:52.825488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fbf5819-00ad-42fe-b731-26cb08fd0681 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:52.825488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fbf5819-00ad-42fe-b731-26cb08fd0681 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:52.825488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fbf5819-00ad-42fe-b731-26cb08fd0681 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:52.856094 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-7fbf5819-00ad-42fe-b731-26cb08fd0681 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] HTTP exception thrown: Instance 7e3d8758-5c13-4f1e-94fc-e12dec37ed65 could not be found. Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7fbf5819-00ad-42fe-b731-26cb08fd0681 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Request method failure captured: Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 HTTP/1.1 Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz4kHUrP0NR1weMrwNJFajjYeIIHokIcn1Smwldpi0IoxvTGddNQhUUGjWM2GBIrPrz5GLTO9Wq7PjURuyPK2PWodObf5bqIEIb0Z8tPk-SBrOdYHRy2v0yo_qP_zomvI0S_06qCS11qQZLwk2Wlyk9NRsawZsJg8JGcp5gWmkfx0Vo Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8276c235e518406da376c8a4c19b27d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8276c235e518406da376c8a4c19b27d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersTestJSON-106241240 Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 8276c235e518406da376c8a4c19b27d1 Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersTestJSON-106241240 Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersTestJSON-106241240-project Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 789a612b19154564a853199a67ea8496 Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersTestJSON-106241240-project Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 7e3d8758-5c13-4f1e-94fc-e12dec37ed65 could not be found. Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '7e3d8758-5c13-4f1e-94fc-e12dec37ed65'} Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e3d8758-5c13-4f1e-94fc-e12dec37ed65 could not be found. Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e3d8758-5c13-4f1e-94fc-e12dec37ed65 could not be found. Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:52.858075 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:26:52.862549 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:26:52.862549 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:26:52.862549 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:26:52.862549 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:26:52.862549 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e3d8758-5c13-4f1e-94fc-e12dec37ed65 could not be found. Oct 12 22:26:52.862549 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:26:52.862549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7fbf5819-00ad-42fe-b731-26cb08fd0681 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] Returning 404 to user: Instance 7e3d8758-5c13-4f1e-94fc-e12dec37ed65 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:26:52.862549 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7fbf5819-00ad-42fe-b731-26cb08fd0681 tempest-ServersTestJSON-106241240 tempest-ServersTestJSON-106241240-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65" status: 404 len: 111 microversion: 2.1 time: 0.087836 Oct 12 22:26:52.862549 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3179/5738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:26:52 2022] GET /compute/v2.1/servers/7e3d8758-5c13-4f1e-94fc-e12dec37ed65 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:26:52.882725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-f9e468bc-7f6f-49f4-9d23-264b755a017a req-8e87665a-e4be-4f1f-ac85-b020bc4fce85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ecbb62-d209-4784-9a32-1076041ce09a", "name": "network-vif-plugged", "status": "completed", "tag": "57ae856e-81cb-43bf-8768-e10cfb8d0da9"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:26:52.912321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f9e468bc-7f6f-49f4-9d23-264b755a017a req-8e87665a-e4be-4f1f-ac85-b020bc4fce85 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:52.914400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f9e468bc-7f6f-49f4-9d23-264b755a017a req-8e87665a-e4be-4f1f-ac85-b020bc4fce85 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:52.915006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f9e468bc-7f6f-49f4-9d23-264b755a017a req-8e87665a-e4be-4f1f-ac85-b020bc4fce85 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:53.006856 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-f9e468bc-7f6f-49f4-9d23-264b755a017a req-8e87665a-e4be-4f1f-ac85-b020bc4fce85 service nova] Creating event network-vif-plugged:57ae856e-81cb-43bf-8768-e10cfb8d0da9 for instance 97ecbb62-d209-4784-9a32-1076041ce09a on n-h1-861111-1 Oct 12 22:26:53.023040 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-f9e468bc-7f6f-49f4-9d23-264b755a017a req-8e87665a-e4be-4f1f-ac85-b020bc4fce85 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144030 Oct 12 22:26:53.037551 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2560/5739] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:26:53.614829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a72699c0-0160-4278-8398-0e97f0b07025 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:53.615981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a72699c0-0160-4278-8398-0e97f0b07025 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:53.629834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a72699c0-0160-4278-8398-0e97f0b07025 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:53.632773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a72699c0-0160-4278-8398-0e97f0b07025 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:53.633862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a72699c0-0160-4278-8398-0e97f0b07025 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:53.636073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a72699c0-0160-4278-8398-0e97f0b07025 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:53.636957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a72699c0-0160-4278-8398-0e97f0b07025 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:53.638949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a72699c0-0160-4278-8398-0e97f0b07025 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:53.964208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a72699c0-0160-4278-8398-0e97f0b07025 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:53.978675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a72699c0-0160-4278-8398-0e97f0b07025 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:53.981726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a72699c0-0160-4278-8398-0e97f0b07025 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:53.984260 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a72699c0-0160-4278-8398-0e97f0b07025 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1406 microversion: 2.20 time: 0.373834 Oct 12 22:26:53.986809 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3180/5740] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:26:53 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1406 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:26:55.021794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-47611c92-1599-4092-9889-91ee5b1db112 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:55.023051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-47611c92-1599-4092-9889-91ee5b1db112 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:55.059624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47611c92-1599-4092-9889-91ee5b1db112 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:55.065070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47611c92-1599-4092-9889-91ee5b1db112 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:55.068654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47611c92-1599-4092-9889-91ee5b1db112 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:55.069462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47611c92-1599-4092-9889-91ee5b1db112 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:55.072877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47611c92-1599-4092-9889-91ee5b1db112 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:55.073493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47611c92-1599-4092-9889-91ee5b1db112 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:55.881207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-47611c92-1599-4092-9889-91ee5b1db112 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:55.905991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-47611c92-1599-4092-9889-91ee5b1db112 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:55.910118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-47611c92-1599-4092-9889-91ee5b1db112 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:55.913461 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-47611c92-1599-4092-9889-91ee5b1db112 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1406 microversion: 2.20 time: 0.902759 Oct 12 22:26:55.931675 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2561/5741] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:26:55 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1406 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:26:56.946356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e249daa8-736c-4550-9312-cce0451e29da tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:56.947795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e249daa8-736c-4550-9312-cce0451e29da tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:56.966809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e249daa8-736c-4550-9312-cce0451e29da tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:56.968631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e249daa8-736c-4550-9312-cce0451e29da tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:56.972139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e249daa8-736c-4550-9312-cce0451e29da tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:56.973111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e249daa8-736c-4550-9312-cce0451e29da tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:56.974921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e249daa8-736c-4550-9312-cce0451e29da tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:56.975596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e249daa8-736c-4550-9312-cce0451e29da tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:58.062296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e249daa8-736c-4550-9312-cce0451e29da tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:58.071641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e249daa8-736c-4550-9312-cce0451e29da tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:58.074863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e249daa8-736c-4550-9312-cce0451e29da tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:26:58.087083 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e249daa8-736c-4550-9312-cce0451e29da tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1599 microversion: 2.20 time: 1.140524 Oct 12 22:26:58.092252 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3181/5742] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:26:56 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1599 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:26:58.142520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-00d6e2af-54c8-4637-ac6a-57a5d3afb5f2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:26:58.144601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-00d6e2af-54c8-4637-ac6a-57a5d3afb5f2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:26:58.163271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00d6e2af-54c8-4637-ac6a-57a5d3afb5f2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:58.167744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00d6e2af-54c8-4637-ac6a-57a5d3afb5f2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:58.169304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00d6e2af-54c8-4637-ac6a-57a5d3afb5f2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:58.173450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00d6e2af-54c8-4637-ac6a-57a5d3afb5f2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:26:58.174128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00d6e2af-54c8-4637-ac6a-57a5d3afb5f2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:26:58.174761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00d6e2af-54c8-4637-ac6a-57a5d3afb5f2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:26:58.387514 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-00d6e2af-54c8-4637-ac6a-57a5d3afb5f2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.252364 Oct 12 22:26:58.388620 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2562/5743] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 12 22:26:58 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-interface => generated 285 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:27:03.029255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-67d5ca1b-129e-453c-a542-a6169f221cc8 req-55fcfaea-2a6d-4553-b8f6-dd77ed6f6163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ecbb62-d209-4784-9a32-1076041ce09a", "tag": "57ae856e-81cb-43bf-8768-e10cfb8d0da9"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:27:03.081889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-67d5ca1b-129e-453c-a542-a6169f221cc8 req-55fcfaea-2a6d-4553-b8f6-dd77ed6f6163 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:03.084917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-67d5ca1b-129e-453c-a542-a6169f221cc8 req-55fcfaea-2a6d-4553-b8f6-dd77ed6f6163 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:03.087271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-67d5ca1b-129e-453c-a542-a6169f221cc8 req-55fcfaea-2a6d-4553-b8f6-dd77ed6f6163 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:03.159682 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-67d5ca1b-129e-453c-a542-a6169f221cc8 req-55fcfaea-2a6d-4553-b8f6-dd77ed6f6163 service nova] Creating event network-changed:57ae856e-81cb-43bf-8768-e10cfb8d0da9 for instance 97ecbb62-d209-4784-9a32-1076041ce09a on n-h1-861111-1 Oct 12 22:27:03.185472 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-67d5ca1b-129e-453c-a542-a6169f221cc8 req-55fcfaea-2a6d-4553-b8f6-dd77ed6f6163 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154954 Oct 12 22:27:03.191653 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3182/5744] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:27:08.276956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=23 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:27:08.277733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=72 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:27:08.681777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-81fff768-d60c-4e17-a230-2c9f412f6708 tempest-ExtensionsTest-255598725 tempest-ExtensionsTest-255598725-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:08.684180 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-81fff768-d60c-4e17-a230-2c9f412f6708 tempest-ExtensionsTest-255598725 tempest-ExtensionsTest-255598725-project] 10.222.0.16 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.415160 Oct 12 22:27:08.684738 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2563/5745] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 12 22:27:08 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:27:08.695922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-96de4bae-0a20-4c2e-b24b-5520a5014158 tempest-ExtensionsTest-255598725 tempest-ExtensionsTest-255598725-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:08.699154 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-96de4bae-0a20-4c2e-b24b-5520a5014158 tempest-ExtensionsTest-255598725 tempest-ExtensionsTest-255598725-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007957 Oct 12 22:27:08.703324 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3183/5746] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Oct 12 22:27:08 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:27:12.721010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-08b22f3d-3471-4bee-acc3-abcca5213b25 tempest-QuotasTestJSON-824771211 tempest-QuotasTestJSON-824771211-project] Calling method '.version_select at 0x7f5128ca5280>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:12.921477 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-08b22f3d-3471-4bee-acc3-abcca5213b25 tempest-QuotasTestJSON-824771211 tempest-QuotasTestJSON-824771211-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/700d0dd7887048349aec7b5c136b75e6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.552118 Oct 12 22:27:12.926714 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2564/5747] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 12 22:27:12 2022] GET /compute/v2.1/os-quota-sets/700d0dd7887048349aec7b5c136b75e6/defaults => generated 371 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:27:12.951711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-18ec998a-c161-40fb-a64c-f802eedbeef5 tempest-QuotasTestJSON-824771211 tempest-QuotasTestJSON-824771211-project] Calling method '.version_select at 0x7f5122e580d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:13.042537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=13 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:27:13.106229 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-18ec998a-c161-40fb-a64c-f802eedbeef5 tempest-QuotasTestJSON-824771211 tempest-QuotasTestJSON-824771211-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/700d0dd7887048349aec7b5c136b75e6" status: 200 len: 371 microversion: 2.1 time: 0.168465 Oct 12 22:27:13.107641 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3184/5748] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 12 22:27:12 2022] GET /compute/v2.1/os-quota-sets/700d0dd7887048349aec7b5c136b75e6 => generated 371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:27:13.123972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb0f2590-0f8b-40dd-95e2-be5f816e7ade tempest-QuotasTestJSON-824771211 tempest-QuotasTestJSON-824771211-project] Calling method '.version_select at 0x7f512864d790>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:13.241847 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb0f2590-0f8b-40dd-95e2-be5f816e7ade tempest-QuotasTestJSON-824771211 tempest-QuotasTestJSON-824771211-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/700d0dd7887048349aec7b5c136b75e6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.122152 Oct 12 22:27:13.242732 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2565/5749] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 12 22:27:13 2022] GET /compute/v2.1/os-quota-sets/700d0dd7887048349aec7b5c136b75e6/defaults => generated 371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:27:13.259332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7c158e86-37bf-4e4d-8c8b-6503bd6f0d79 tempest-QuotasTestJSON-824771211 tempest-QuotasTestJSON-824771211-project] Calling method '.version_select at 0x7f5122f504c0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:13.287093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:27:13.410838 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7c158e86-37bf-4e4d-8c8b-6503bd6f0d79 tempest-QuotasTestJSON-824771211 tempest-QuotasTestJSON-824771211-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/700d0dd7887048349aec7b5c136b75e6" status: 200 len: 371 microversion: 2.1 time: 0.155476 Oct 12 22:27:13.420359 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3185/5750] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 12 22:27:13 2022] GET /compute/v2.1/os-quota-sets/700d0dd7887048349aec7b5c136b75e6 => generated 371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:27:13.425473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e737f9d5-99c1-4ac0-a5a0-8ebbe7a0a114 tempest-QuotasTestJSON-824771211 tempest-QuotasTestJSON-824771211-project] Calling method '.version_select at 0x7f51235af820>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:13.582025 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e737f9d5-99c1-4ac0-a5a0-8ebbe7a0a114 tempest-QuotasTestJSON-824771211 tempest-QuotasTestJSON-824771211-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/700d0dd7887048349aec7b5c136b75e6?user_id=a37d1fcdae0c4f8186f87e8febed124b" status: 200 len: 371 microversion: 2.1 time: 0.161374 Oct 12 22:27:13.590437 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2566/5751] 10.222.0.16 () {58 vars in 1323 bytes} [Wed Oct 12 22:27:13 2022] GET /compute/v2.1/os-quota-sets/700d0dd7887048349aec7b5c136b75e6?user_id=a37d1fcdae0c4f8186f87e8febed124b => generated 371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:27:34.988204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b8e0ee0c-9e5e-4b2b-a879-a76a103d371a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:34.989457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b8e0ee0c-9e5e-4b2b-a879-a76a103d371a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:35.032034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:27:35.032940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=8 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:27:35.060125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8e0ee0c-9e5e-4b2b-a879-a76a103d371a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:35.061802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8e0ee0c-9e5e-4b2b-a879-a76a103d371a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:35.063639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8e0ee0c-9e5e-4b2b-a879-a76a103d371a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:35.064635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8e0ee0c-9e5e-4b2b-a879-a76a103d371a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:35.067308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8e0ee0c-9e5e-4b2b-a879-a76a103d371a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:35.067930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8e0ee0c-9e5e-4b2b-a879-a76a103d371a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:35.175826 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b8e0ee0c-9e5e-4b2b-a879-a76a103d371a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/ips" status: 200 len: 153 microversion: 2.20 time: 0.194122 Oct 12 22:27:35.178771 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3186/5752] 10.222.0.16 () {60 vars in 1289 bytes} [Wed Oct 12 22:27:34 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/ips => generated 153 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:27:35.427412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:27:35.429528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=10 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:27:35.699032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4f270e2d-38b3-4cfa-b340-6c99e4522659 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Action: 'create', calling method: .version_select at 0x7f5123763280>, body: {"keypair": {"name": "tempest-keypair-696507993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkZTyRPFSou/41oKCKEM55WIkIie9Ys/SFdteOfhnCWwuJqnKH3iyWf4lbmyiYAUqY81P7SkvBwUJ7XEDX8rVZRZMq3gG40EmdtECzdFKp/s8k43b1uCikl17tYlC0MlA=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:27:35.775474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-4f270e2d-38b3-4cfa-b340-6c99e4522659 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Getting quotas for project ecb54ad8150449aaba735b9fc149845d. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:27:35.799710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-4f270e2d-38b3-4cfa-b340-6c99e4522659 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Getting quotas for user c5fa1bcec6e24906bc2000ead6350336 and project ecb54ad8150449aaba735b9fc149845d. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:27:35.911931 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4f270e2d-38b3-4cfa-b340-6c99e4522659 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.490345 Oct 12 22:27:35.914279 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2567/5753] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:27:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:27:38.783519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3a0d916a-4ff5-47a8-a29e-8df13347de43 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:27:38.784641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3a0d916a-4ff5-47a8-a29e-8df13347de43 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:38.799535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a0d916a-4ff5-47a8-a29e-8df13347de43 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:38.802334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a0d916a-4ff5-47a8-a29e-8df13347de43 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:38.803554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a0d916a-4ff5-47a8-a29e-8df13347de43 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:38.806096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a0d916a-4ff5-47a8-a29e-8df13347de43 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:38.808921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a0d916a-4ff5-47a8-a29e-8df13347de43 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:38.810131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a0d916a-4ff5-47a8-a29e-8df13347de43 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:38.875295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-3a0d916a-4ff5-47a8-a29e-8df13347de43 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lazy-loading 'flavor' on Instance uuid 97ecbb62-d209-4784-9a32-1076041ce09a {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:27:39.295231 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3a0d916a-4ff5-47a8-a29e-8df13347de43 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "POST /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/action" status: 202 len: 0 microversion: 2.20 time: 0.519325 Oct 12 22:27:39.296123 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3187/5754] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 12 22:27:38 2022] POST /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:27:39.310139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-975a4f83-9d85-4f92-8ea7-b14049be52a0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:39.310612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-975a4f83-9d85-4f92-8ea7-b14049be52a0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:39.330451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-975a4f83-9d85-4f92-8ea7-b14049be52a0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:39.343636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-975a4f83-9d85-4f92-8ea7-b14049be52a0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:39.344269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-975a4f83-9d85-4f92-8ea7-b14049be52a0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:39.345142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-975a4f83-9d85-4f92-8ea7-b14049be52a0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:39.355905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-975a4f83-9d85-4f92-8ea7-b14049be52a0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:39.356692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-975a4f83-9d85-4f92-8ea7-b14049be52a0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:40.117706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-975a4f83-9d85-4f92-8ea7-b14049be52a0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:40.130826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-975a4f83-9d85-4f92-8ea7-b14049be52a0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:40.142201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-975a4f83-9d85-4f92-8ea7-b14049be52a0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:40.144945 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-975a4f83-9d85-4f92-8ea7-b14049be52a0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1724 microversion: 2.20 time: 0.844531 Oct 12 22:27:40.149758 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2568/5755] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:27:39 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1724 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:27:41.177475 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 22:27:41.177944 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 22:27:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a (ip 10.222.0.16) !!! Oct 12 22:27:41.184047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b02ce7d9-15e3-4839-ac17-c517b8e1ad37 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:41.190345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b02ce7d9-15e3-4839-ac17-c517b8e1ad37 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:41.216999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b02ce7d9-15e3-4839-ac17-c517b8e1ad37 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:41.217573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b02ce7d9-15e3-4839-ac17-c517b8e1ad37 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:41.218085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b02ce7d9-15e3-4839-ac17-c517b8e1ad37 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:41.222509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b02ce7d9-15e3-4839-ac17-c517b8e1ad37 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:41.227003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b02ce7d9-15e3-4839-ac17-c517b8e1ad37 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:41.227555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b02ce7d9-15e3-4839-ac17-c517b8e1ad37 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:41.775468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b02ce7d9-15e3-4839-ac17-c517b8e1ad37 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:41.799561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b02ce7d9-15e3-4839-ac17-c517b8e1ad37 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:41.801519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b02ce7d9-15e3-4839-ac17-c517b8e1ad37 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:41.802880 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b02ce7d9-15e3-4839-ac17-c517b8e1ad37 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1724 microversion: 2.20 time: 0.627236 Oct 12 22:27:41.808949 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3188/5756] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:27:41 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1724 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:27:42.609839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1323370381", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b630e3f8-f7dc-4831-b009-a6ce5ac4c2af"}], "security_groups": [{"name": "tempest-securitygroup--1134622789"}], "key_name": "tempest-keypair-696507993", "user_data": "}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:27:42.836667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-78874d23-5f98-4439-9b74-87b42ef59a3d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:42.838528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-78874d23-5f98-4439-9b74-87b42ef59a3d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:42.862215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78874d23-5f98-4439-9b74-87b42ef59a3d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:42.865213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78874d23-5f98-4439-9b74-87b42ef59a3d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:42.866919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78874d23-5f98-4439-9b74-87b42ef59a3d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:42.870654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78874d23-5f98-4439-9b74-87b42ef59a3d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:42.874331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78874d23-5f98-4439-9b74-87b42ef59a3d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:42.875439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78874d23-5f98-4439-9b74-87b42ef59a3d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:42.900960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] validate_networks() for [('b630e3f8-f7dc-4831-b009-a6ce5ac4c2af', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:27:43.951856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-78874d23-5f98-4439-9b74-87b42ef59a3d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:44.000143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-78874d23-5f98-4439-9b74-87b42ef59a3d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:44.001705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-78874d23-5f98-4439-9b74-87b42ef59a3d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:44.003462 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-78874d23-5f98-4439-9b74-87b42ef59a3d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1724 microversion: 2.20 time: 1.171474 Oct 12 22:27:44.009027 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3189/5757] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:27:42 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1724 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:27:44.481301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:27:44.481834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:27:44.482206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:27:44.482625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:27:44.483980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:27:44.506168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:44.506168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:44.506168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:44.506168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:44.506168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:44.506168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:44.527370 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Getting quotas for project ecb54ad8150449aaba735b9fc149845d. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:27:44.535014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Getting quotas for user c5fa1bcec6e24906bc2000ead6350336 and project ecb54ad8150449aaba735b9fc149845d. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:27:44.554339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:27:44.558478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:27:44.678963 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-add21515-6dca-4bc3-a651-f444ff8cefdf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.078726 Oct 12 22:27:44.702017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-25967865-d0f0-416f-81ee-1d4d20fd30e6 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:44.703415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-25967865-d0f0-416f-81ee-1d4d20fd30e6 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:44.708910 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2569/5758] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:27:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 2110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:27:44.866222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-25967865-d0f0-416f-81ee-1d4d20fd30e6 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:44.877033 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-25967865-d0f0-416f-81ee-1d4d20fd30e6 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1237 microversion: 2.1 time: 0.179732 Oct 12 22:27:44.892760 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3190/5759] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:27:44 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1237 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:27:45.033785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-06dc7a99-4188-46d7-847d-c692e6e12520 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:45.034846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-06dc7a99-4188-46d7-847d-c692e6e12520 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:45.057514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06dc7a99-4188-46d7-847d-c692e6e12520 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:45.060857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06dc7a99-4188-46d7-847d-c692e6e12520 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:45.062821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06dc7a99-4188-46d7-847d-c692e6e12520 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:45.066143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06dc7a99-4188-46d7-847d-c692e6e12520 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:45.073638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06dc7a99-4188-46d7-847d-c692e6e12520 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:45.075144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06dc7a99-4188-46d7-847d-c692e6e12520 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:45.912023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ff07fd12-9041-4cb0-a5f2-bb7c624ab65d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:45.913739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ff07fd12-9041-4cb0-a5f2-bb7c624ab65d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:46.030001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-06dc7a99-4188-46d7-847d-c692e6e12520 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:46.056160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-06dc7a99-4188-46d7-847d-c692e6e12520 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:46.060347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-06dc7a99-4188-46d7-847d-c692e6e12520 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:46.064991 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-06dc7a99-4188-46d7-847d-c692e6e12520 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1724 microversion: 2.20 time: 1.036195 Oct 12 22:27:46.068759 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2570/5760] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:27:45 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1724 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:27:46.142717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ff07fd12-9041-4cb0-a5f2-bb7c624ab65d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:46.162790 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ff07fd12-9041-4cb0-a5f2-bb7c624ab65d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1237 microversion: 2.1 time: 0.260705 Oct 12 22:27:46.180231 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3191/5761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:27:45 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1237 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:27:47.097234 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ba0173ee-e84f-4921-b22f-cad1d048a3f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:47.098889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ba0173ee-e84f-4921-b22f-cad1d048a3f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:47.119952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0173ee-e84f-4921-b22f-cad1d048a3f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:47.121045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0173ee-e84f-4921-b22f-cad1d048a3f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:47.121714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0173ee-e84f-4921-b22f-cad1d048a3f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:47.123458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0173ee-e84f-4921-b22f-cad1d048a3f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:47.126150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0173ee-e84f-4921-b22f-cad1d048a3f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:47.128088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0173ee-e84f-4921-b22f-cad1d048a3f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:47.188613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e1367e18-fdea-4db5-b4b1-988409a5bdc9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:47.190025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e1367e18-fdea-4db5-b4b1-988409a5bdc9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:47.212334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1367e18-fdea-4db5-b4b1-988409a5bdc9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:47.216808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1367e18-fdea-4db5-b4b1-988409a5bdc9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:47.219611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1367e18-fdea-4db5-b4b1-988409a5bdc9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:47.225212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1367e18-fdea-4db5-b4b1-988409a5bdc9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:47.235426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1367e18-fdea-4db5-b4b1-988409a5bdc9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:47.236252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1367e18-fdea-4db5-b4b1-988409a5bdc9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:47.417412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e1367e18-fdea-4db5-b4b1-988409a5bdc9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:47.433750 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e1367e18-fdea-4db5-b4b1-988409a5bdc9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1289 microversion: 2.1 time: 0.249066 Oct 12 22:27:47.439886 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3192/5762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:27:47 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1289 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:27:48.005149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba0173ee-e84f-4921-b22f-cad1d048a3f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:48.020053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba0173ee-e84f-4921-b22f-cad1d048a3f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:48.022448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba0173ee-e84f-4921-b22f-cad1d048a3f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:48.032329 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ba0173ee-e84f-4921-b22f-cad1d048a3f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1724 microversion: 2.20 time: 0.937113 Oct 12 22:27:48.033411 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2571/5763] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:27:47 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1724 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:27:48.466971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-59574e02-c5a6-4148-8548-29f2d17661d8 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:48.468447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-59574e02-c5a6-4148-8548-29f2d17661d8 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:48.492345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59574e02-c5a6-4148-8548-29f2d17661d8 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:48.495228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59574e02-c5a6-4148-8548-29f2d17661d8 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:48.495859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59574e02-c5a6-4148-8548-29f2d17661d8 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:48.502620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59574e02-c5a6-4148-8548-29f2d17661d8 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:48.503511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59574e02-c5a6-4148-8548-29f2d17661d8 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:48.504244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59574e02-c5a6-4148-8548-29f2d17661d8 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:48.802118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-59574e02-c5a6-4148-8548-29f2d17661d8 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:48.831720 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-59574e02-c5a6-4148-8548-29f2d17661d8 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1295 microversion: 2.1 time: 0.369812 Oct 12 22:27:48.832331 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3193/5764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:27:48 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1295 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:27:49.068578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d65aba7c-5d37-49a8-9869-3ffe90b87b99 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:49.069319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d65aba7c-5d37-49a8-9869-3ffe90b87b99 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:49.100595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d65aba7c-5d37-49a8-9869-3ffe90b87b99 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:49.109107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d65aba7c-5d37-49a8-9869-3ffe90b87b99 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:49.111984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d65aba7c-5d37-49a8-9869-3ffe90b87b99 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:49.113542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d65aba7c-5d37-49a8-9869-3ffe90b87b99 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:49.124376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d65aba7c-5d37-49a8-9869-3ffe90b87b99 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:49.125209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d65aba7c-5d37-49a8-9869-3ffe90b87b99 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:49.781253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d65aba7c-5d37-49a8-9869-3ffe90b87b99 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:49.789778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d65aba7c-5d37-49a8-9869-3ffe90b87b99 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:49.804293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d65aba7c-5d37-49a8-9869-3ffe90b87b99 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:49.805564 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d65aba7c-5d37-49a8-9869-3ffe90b87b99 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1724 microversion: 2.20 time: 0.744462 Oct 12 22:27:49.826901 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2572/5765] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:27:49 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1724 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:27:49.855086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9bcbc287-1da3-430b-a1cd-fe8ccd1ff63d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:49.856273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9bcbc287-1da3-430b-a1cd-fe8ccd1ff63d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:49.873625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9bcbc287-1da3-430b-a1cd-fe8ccd1ff63d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:49.874158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9bcbc287-1da3-430b-a1cd-fe8ccd1ff63d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:49.874546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9bcbc287-1da3-430b-a1cd-fe8ccd1ff63d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:49.875298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9bcbc287-1da3-430b-a1cd-fe8ccd1ff63d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:49.875762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9bcbc287-1da3-430b-a1cd-fe8ccd1ff63d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:49.876194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9bcbc287-1da3-430b-a1cd-fe8ccd1ff63d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:50.456008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9bcbc287-1da3-430b-a1cd-fe8ccd1ff63d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:50.471356 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9bcbc287-1da3-430b-a1cd-fe8ccd1ff63d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1363 microversion: 2.1 time: 0.618570 Oct 12 22:27:50.474238 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3194/5766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:27:49 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1363 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:27:50.834622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8c1f0abf-6526-4d16-bdaa-edfa34dcd80b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:50.836060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8c1f0abf-6526-4d16-bdaa-edfa34dcd80b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:50.850882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c1f0abf-6526-4d16-bdaa-edfa34dcd80b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:50.851864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c1f0abf-6526-4d16-bdaa-edfa34dcd80b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:50.854961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c1f0abf-6526-4d16-bdaa-edfa34dcd80b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:50.856462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c1f0abf-6526-4d16-bdaa-edfa34dcd80b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:50.857224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c1f0abf-6526-4d16-bdaa-edfa34dcd80b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:50.863051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c1f0abf-6526-4d16-bdaa-edfa34dcd80b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:51.502013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d3d38a36-eed7-47d6-9924-8322e04bafe2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:51.502824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d3d38a36-eed7-47d6-9924-8322e04bafe2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:51.528323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3d38a36-eed7-47d6-9924-8322e04bafe2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:51.528936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3d38a36-eed7-47d6-9924-8322e04bafe2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:51.529325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3d38a36-eed7-47d6-9924-8322e04bafe2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:51.533624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3d38a36-eed7-47d6-9924-8322e04bafe2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:51.534124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3d38a36-eed7-47d6-9924-8322e04bafe2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:51.534597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3d38a36-eed7-47d6-9924-8322e04bafe2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:51.643517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8c1f0abf-6526-4d16-bdaa-edfa34dcd80b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:51.692131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8c1f0abf-6526-4d16-bdaa-edfa34dcd80b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:51.695641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8c1f0abf-6526-4d16-bdaa-edfa34dcd80b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:51.697618 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8c1f0abf-6526-4d16-bdaa-edfa34dcd80b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1745 microversion: 2.20 time: 0.868138 Oct 12 22:27:51.701724 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2573/5767] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:27:50 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1745 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:27:52.063213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-cf6418b1-f3a6-4e6b-aada-0bd6b873cdc3 req-ecdcf62a-da22-4511-a699-76822bd65c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1958534e-ec1c-4ecc-bc9a-7720512092ed", "tag": "fb6f339c-beaf-425d-a33f-7e0afb090b69"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:27:52.083228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-cf6418b1-f3a6-4e6b-aada-0bd6b873cdc3 req-ecdcf62a-da22-4511-a699-76822bd65c72 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:52.083898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-cf6418b1-f3a6-4e6b-aada-0bd6b873cdc3 req-ecdcf62a-da22-4511-a699-76822bd65c72 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:52.084346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-cf6418b1-f3a6-4e6b-aada-0bd6b873cdc3 req-ecdcf62a-da22-4511-a699-76822bd65c72 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:52.110949 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-cf6418b1-f3a6-4e6b-aada-0bd6b873cdc3 req-ecdcf62a-da22-4511-a699-76822bd65c72 service nova] Creating event network-changed:fb6f339c-beaf-425d-a33f-7e0afb090b69 for instance 1958534e-ec1c-4ecc-bc9a-7720512092ed on n-h2-861111-1 Oct 12 22:27:52.119029 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-cf6418b1-f3a6-4e6b-aada-0bd6b873cdc3 req-ecdcf62a-da22-4511-a699-76822bd65c72 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072064 Oct 12 22:27:52.121075 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2574/5768] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:27:52.662215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d3d38a36-eed7-47d6-9924-8322e04bafe2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:52.691333 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d3d38a36-eed7-47d6-9924-8322e04bafe2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1363 microversion: 2.1 time: 1.196470 Oct 12 22:27:52.696733 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3195/5769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:27:51 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1363 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:27:52.736725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-18347040-1503-4867-be84-fbb317fecb27 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:52.737632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-18347040-1503-4867-be84-fbb317fecb27 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:52.749261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18347040-1503-4867-be84-fbb317fecb27 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:52.755589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18347040-1503-4867-be84-fbb317fecb27 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:52.758478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18347040-1503-4867-be84-fbb317fecb27 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:52.763968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18347040-1503-4867-be84-fbb317fecb27 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:52.764490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18347040-1503-4867-be84-fbb317fecb27 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:52.765373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18347040-1503-4867-be84-fbb317fecb27 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:53.450823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-18347040-1503-4867-be84-fbb317fecb27 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:53.473925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-18347040-1503-4867-be84-fbb317fecb27 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:53.481177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-18347040-1503-4867-be84-fbb317fecb27 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:53.495129 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-18347040-1503-4867-be84-fbb317fecb27 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 0.762752 Oct 12 22:27:53.511512 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2575/5770] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:27:52 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:27:53.726481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-da2b9c1f-269d-4196-99c7-7b6483ed78ba tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:53.727931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-da2b9c1f-269d-4196-99c7-7b6483ed78ba tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:53.749152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da2b9c1f-269d-4196-99c7-7b6483ed78ba tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:53.790120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da2b9c1f-269d-4196-99c7-7b6483ed78ba tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:53.792443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da2b9c1f-269d-4196-99c7-7b6483ed78ba tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:53.801194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da2b9c1f-269d-4196-99c7-7b6483ed78ba tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:53.801771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da2b9c1f-269d-4196-99c7-7b6483ed78ba tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:53.804773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da2b9c1f-269d-4196-99c7-7b6483ed78ba tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:54.220342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-da2b9c1f-269d-4196-99c7-7b6483ed78ba tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:54.236592 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-da2b9c1f-269d-4196-99c7-7b6483ed78ba tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1363 microversion: 2.1 time: 0.512196 Oct 12 22:27:54.237453 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3196/5771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:27:53 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1363 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:27:54.529441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-06cd7a1d-055c-4a62-a9dc-8d056475420d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:54.530208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-06cd7a1d-055c-4a62-a9dc-8d056475420d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:54.549150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:27:54.557171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06cd7a1d-055c-4a62-a9dc-8d056475420d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:54.560892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06cd7a1d-055c-4a62-a9dc-8d056475420d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:54.562047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06cd7a1d-055c-4a62-a9dc-8d056475420d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:54.564288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06cd7a1d-055c-4a62-a9dc-8d056475420d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:54.568172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06cd7a1d-055c-4a62-a9dc-8d056475420d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:54.568172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06cd7a1d-055c-4a62-a9dc-8d056475420d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:54.577979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=10 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:27:54.948645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-06cd7a1d-055c-4a62-a9dc-8d056475420d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:54.971477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-06cd7a1d-055c-4a62-a9dc-8d056475420d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:54.973128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-06cd7a1d-055c-4a62-a9dc-8d056475420d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:54.993715 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-06cd7a1d-055c-4a62-a9dc-8d056475420d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 0.469072 Oct 12 22:27:54.994310 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2576/5772] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:27:54 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:27:55.280134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e3b4ac54-be0d-477b-a0fa-8963b2464dcf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:55.284897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e3b4ac54-be0d-477b-a0fa-8963b2464dcf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:55.299884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3b4ac54-be0d-477b-a0fa-8963b2464dcf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:55.300678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3b4ac54-be0d-477b-a0fa-8963b2464dcf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:55.301275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3b4ac54-be0d-477b-a0fa-8963b2464dcf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:55.324989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3b4ac54-be0d-477b-a0fa-8963b2464dcf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:55.325349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3b4ac54-be0d-477b-a0fa-8963b2464dcf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:55.325872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3b4ac54-be0d-477b-a0fa-8963b2464dcf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:56.019148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ca702db6-b795-43bb-8e03-21642e833354 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:56.019854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ca702db6-b795-43bb-8e03-21642e833354 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:56.039485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca702db6-b795-43bb-8e03-21642e833354 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:56.040385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca702db6-b795-43bb-8e03-21642e833354 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:56.041744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca702db6-b795-43bb-8e03-21642e833354 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:56.045539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca702db6-b795-43bb-8e03-21642e833354 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:56.046541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca702db6-b795-43bb-8e03-21642e833354 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:56.048102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca702db6-b795-43bb-8e03-21642e833354 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:56.087687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e3b4ac54-be0d-477b-a0fa-8963b2464dcf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:56.100848 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e3b4ac54-be0d-477b-a0fa-8963b2464dcf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1363 microversion: 2.1 time: 0.834980 Oct 12 22:27:56.107563 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3197/5773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:27:55 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1363 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:27:57.132397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6f51d260-757e-49c0-bc5e-7434f2c5469d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:57.133076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6f51d260-757e-49c0-bc5e-7434f2c5469d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:57.134953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:27:57.136313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ca702db6-b795-43bb-8e03-21642e833354 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:57.162606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f51d260-757e-49c0-bc5e-7434f2c5469d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:57.162796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f51d260-757e-49c0-bc5e-7434f2c5469d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:57.163304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f51d260-757e-49c0-bc5e-7434f2c5469d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:57.164068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f51d260-757e-49c0-bc5e-7434f2c5469d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:57.164539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f51d260-757e-49c0-bc5e-7434f2c5469d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:57.164979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f51d260-757e-49c0-bc5e-7434f2c5469d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:57.186471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ca702db6-b795-43bb-8e03-21642e833354 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:57.188372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ca702db6-b795-43bb-8e03-21642e833354 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:57.189738 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ca702db6-b795-43bb-8e03-21642e833354 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 1.174372 Oct 12 22:27:57.190320 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2577/5774] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:27:56 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:27:57.655388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6f51d260-757e-49c0-bc5e-7434f2c5469d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:57.673309 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6f51d260-757e-49c0-bc5e-7434f2c5469d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1363 microversion: 2.1 time: 0.543684 Oct 12 22:27:57.696013 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3198/5775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:27:57 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1363 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:27:57.978607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-b64d14c7-ab7f-449b-8a0c-851ef9a3b362 req-cdaa2cce-8a98-46bc-9be9-67b831106e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ecbb62-d209-4784-9a32-1076041ce09a", "name": "network-vif-plugged", "status": "completed", "tag": "57ae856e-81cb-43bf-8768-e10cfb8d0da9"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:27:58.013205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b64d14c7-ab7f-449b-8a0c-851ef9a3b362 req-cdaa2cce-8a98-46bc-9be9-67b831106e26 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:58.013947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b64d14c7-ab7f-449b-8a0c-851ef9a3b362 req-cdaa2cce-8a98-46bc-9be9-67b831106e26 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:58.015563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b64d14c7-ab7f-449b-8a0c-851ef9a3b362 req-cdaa2cce-8a98-46bc-9be9-67b831106e26 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:58.078301 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-b64d14c7-ab7f-449b-8a0c-851ef9a3b362 req-cdaa2cce-8a98-46bc-9be9-67b831106e26 service nova] Creating event network-vif-plugged:57ae856e-81cb-43bf-8768-e10cfb8d0da9 for instance 97ecbb62-d209-4784-9a32-1076041ce09a on n-h1-861111-1 Oct 12 22:27:58.130829 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-b64d14c7-ab7f-449b-8a0c-851ef9a3b362 req-cdaa2cce-8a98-46bc-9be9-67b831106e26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158022 Oct 12 22:27:58.149246 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2578/5776] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:27:58.229395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a9ba9894-ee05-4737-bbbb-e06bf0447eba tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:58.242654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a9ba9894-ee05-4737-bbbb-e06bf0447eba tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:58.265525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9ba9894-ee05-4737-bbbb-e06bf0447eba tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:58.267726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9ba9894-ee05-4737-bbbb-e06bf0447eba tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:58.270559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9ba9894-ee05-4737-bbbb-e06bf0447eba tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:58.278299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9ba9894-ee05-4737-bbbb-e06bf0447eba tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:58.280238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9ba9894-ee05-4737-bbbb-e06bf0447eba tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:58.285380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9ba9894-ee05-4737-bbbb-e06bf0447eba tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:58.701766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-54e22dec-64cf-4c0a-a0e5-c371c0ac1044 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:58.702477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-54e22dec-64cf-4c0a-a0e5-c371c0ac1044 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:27:58.722575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54e22dec-64cf-4c0a-a0e5-c371c0ac1044 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:58.724582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54e22dec-64cf-4c0a-a0e5-c371c0ac1044 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:58.725035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54e22dec-64cf-4c0a-a0e5-c371c0ac1044 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:58.725770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54e22dec-64cf-4c0a-a0e5-c371c0ac1044 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:27:58.726253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54e22dec-64cf-4c0a-a0e5-c371c0ac1044 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:27:58.726651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54e22dec-64cf-4c0a-a0e5-c371c0ac1044 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:27:58.906421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a9ba9894-ee05-4737-bbbb-e06bf0447eba tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:58.916427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a9ba9894-ee05-4737-bbbb-e06bf0447eba tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:58.931577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a9ba9894-ee05-4737-bbbb-e06bf0447eba tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:58.949252 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a9ba9894-ee05-4737-bbbb-e06bf0447eba tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 0.732332 Oct 12 22:27:58.967068 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3199/5777] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:27:58 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:27:59.382452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-54e22dec-64cf-4c0a-a0e5-c371c0ac1044 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:27:59.399546 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-54e22dec-64cf-4c0a-a0e5-c371c0ac1044 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1363 microversion: 2.1 time: 0.699748 Oct 12 22:27:59.401770 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2579/5778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:27:58 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1363 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:27:59.986438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5fd39669-cd2e-4c04-996e-abd80608ca15 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:27:59.987231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5fd39669-cd2e-4c04-996e-abd80608ca15 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:00.007726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fd39669-cd2e-4c04-996e-abd80608ca15 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:00.011269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fd39669-cd2e-4c04-996e-abd80608ca15 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:00.013580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fd39669-cd2e-4c04-996e-abd80608ca15 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:00.015983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fd39669-cd2e-4c04-996e-abd80608ca15 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:00.017195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fd39669-cd2e-4c04-996e-abd80608ca15 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:00.017807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5fd39669-cd2e-4c04-996e-abd80608ca15 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:00.426687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4ebdc7a1-c646-4493-a72c-6579fec88b8c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:00.427328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4ebdc7a1-c646-4493-a72c-6579fec88b8c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:00.447263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ebdc7a1-c646-4493-a72c-6579fec88b8c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:00.447760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ebdc7a1-c646-4493-a72c-6579fec88b8c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:00.458539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ebdc7a1-c646-4493-a72c-6579fec88b8c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:00.459395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ebdc7a1-c646-4493-a72c-6579fec88b8c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:00.459882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ebdc7a1-c646-4493-a72c-6579fec88b8c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:00.460325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ebdc7a1-c646-4493-a72c-6579fec88b8c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:00.475704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5fd39669-cd2e-4c04-996e-abd80608ca15 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:00.491043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5fd39669-cd2e-4c04-996e-abd80608ca15 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:00.494012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5fd39669-cd2e-4c04-996e-abd80608ca15 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:00.497953 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5fd39669-cd2e-4c04-996e-abd80608ca15 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 0.518055 Oct 12 22:28:00.516843 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3200/5779] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:27:59 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:01.538378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5b9d5850-03e5-41f2-9687-900d60af2a30 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:01.539953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5b9d5850-03e5-41f2-9687-900d60af2a30 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:01.549126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b9d5850-03e5-41f2-9687-900d60af2a30 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:01.554690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b9d5850-03e5-41f2-9687-900d60af2a30 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:01.558594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b9d5850-03e5-41f2-9687-900d60af2a30 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:01.559572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b9d5850-03e5-41f2-9687-900d60af2a30 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:01.560327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b9d5850-03e5-41f2-9687-900d60af2a30 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:01.560948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b9d5850-03e5-41f2-9687-900d60af2a30 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:01.582638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4ebdc7a1-c646-4493-a72c-6579fec88b8c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:01.597455 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4ebdc7a1-c646-4493-a72c-6579fec88b8c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1363 microversion: 2.1 time: 1.174707 Oct 12 22:28:01.599057 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2580/5780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:28:00 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1363 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:28:02.199675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5b9d5850-03e5-41f2-9687-900d60af2a30 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:02.213676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5b9d5850-03e5-41f2-9687-900d60af2a30 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:02.248029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5b9d5850-03e5-41f2-9687-900d60af2a30 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:02.262541 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5b9d5850-03e5-41f2-9687-900d60af2a30 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 0.726902 Oct 12 22:28:02.268067 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3201/5781] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:01 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:28:02.625099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-79258e09-c59b-4d30-b78b-bada0c3b4c2e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:02.628590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-79258e09-c59b-4d30-b78b-bada0c3b4c2e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:02.657187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79258e09-c59b-4d30-b78b-bada0c3b4c2e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:02.658511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79258e09-c59b-4d30-b78b-bada0c3b4c2e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:02.661749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79258e09-c59b-4d30-b78b-bada0c3b4c2e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:02.670374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79258e09-c59b-4d30-b78b-bada0c3b4c2e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:02.670374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79258e09-c59b-4d30-b78b-bada0c3b4c2e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:02.670374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79258e09-c59b-4d30-b78b-bada0c3b4c2e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:03.287938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-79258e09-c59b-4d30-b78b-bada0c3b4c2e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:03.294798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9f55410b-35b6-44b1-8fc4-d0f423c34391 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:03.297365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9f55410b-35b6-44b1-8fc4-d0f423c34391 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:03.299757 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-79258e09-c59b-4d30-b78b-bada0c3b4c2e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1363 microversion: 2.1 time: 0.678472 Oct 12 22:28:03.300848 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2581/5782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:28:02 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1363 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:28:03.343215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f55410b-35b6-44b1-8fc4-d0f423c34391 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:03.348111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f55410b-35b6-44b1-8fc4-d0f423c34391 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:03.350283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f55410b-35b6-44b1-8fc4-d0f423c34391 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:03.354021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f55410b-35b6-44b1-8fc4-d0f423c34391 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:03.357081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f55410b-35b6-44b1-8fc4-d0f423c34391 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:03.358894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f55410b-35b6-44b1-8fc4-d0f423c34391 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:04.147544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9f55410b-35b6-44b1-8fc4-d0f423c34391 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:04.157703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:28:04.164864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9f55410b-35b6-44b1-8fc4-d0f423c34391 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:04.172467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9f55410b-35b6-44b1-8fc4-d0f423c34391 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:04.176566 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9f55410b-35b6-44b1-8fc4-d0f423c34391 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 0.887351 Oct 12 22:28:04.178631 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3202/5783] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:03 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:28:04.333641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-63eb3148-0942-4ee1-81c9-aaf38c0fee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:04.334379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-63eb3148-0942-4ee1-81c9-aaf38c0fee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:04.361126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63eb3148-0942-4ee1-81c9-aaf38c0fee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:04.361642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63eb3148-0942-4ee1-81c9-aaf38c0fee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:04.362193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63eb3148-0942-4ee1-81c9-aaf38c0fee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:04.363265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63eb3148-0942-4ee1-81c9-aaf38c0fee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:04.364169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63eb3148-0942-4ee1-81c9-aaf38c0fee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:04.364965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63eb3148-0942-4ee1-81c9-aaf38c0fee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:05.207592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-10c31ca4-6b22-41b5-a726-a2f737fb1d7f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:05.208216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-10c31ca4-6b22-41b5-a726-a2f737fb1d7f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:05.212524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=39 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:28:05.253708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10c31ca4-6b22-41b5-a726-a2f737fb1d7f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:05.256959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10c31ca4-6b22-41b5-a726-a2f737fb1d7f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:05.260033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10c31ca4-6b22-41b5-a726-a2f737fb1d7f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:05.260954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10c31ca4-6b22-41b5-a726-a2f737fb1d7f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:05.263215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10c31ca4-6b22-41b5-a726-a2f737fb1d7f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:05.263873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10c31ca4-6b22-41b5-a726-a2f737fb1d7f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:05.459687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-10c31ca4-6b22-41b5-a726-a2f737fb1d7f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:05.469609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-10c31ca4-6b22-41b5-a726-a2f737fb1d7f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:05.475355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-10c31ca4-6b22-41b5-a726-a2f737fb1d7f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:05.476600 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-10c31ca4-6b22-41b5-a726-a2f737fb1d7f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 0.274117 Oct 12 22:28:05.486480 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3203/5784] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:05 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:28:05.582586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-63eb3148-0942-4ee1-81c9-aaf38c0fee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:05.592864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=77 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:28:05.604675 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-63eb3148-0942-4ee1-81c9-aaf38c0fee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1363 microversion: 2.1 time: 1.274217 Oct 12 22:28:05.607681 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2582/5785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:28:04 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1363 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:28:05.789918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-34fcebe6-dbc7-4cf5-94e7-a10eb9f5dcf9 req-3131a92a-3ca4-410b-843c-b862a7795fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1958534e-ec1c-4ecc-bc9a-7720512092ed", "name": "network-vif-plugged", "status": "completed", "tag": "fb6f339c-beaf-425d-a33f-7e0afb090b69"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:28:05.845954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-34fcebe6-dbc7-4cf5-94e7-a10eb9f5dcf9 req-3131a92a-3ca4-410b-843c-b862a7795fb7 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:05.850431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-34fcebe6-dbc7-4cf5-94e7-a10eb9f5dcf9 req-3131a92a-3ca4-410b-843c-b862a7795fb7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:05.853424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-34fcebe6-dbc7-4cf5-94e7-a10eb9f5dcf9 req-3131a92a-3ca4-410b-843c-b862a7795fb7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:05.943088 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-34fcebe6-dbc7-4cf5-94e7-a10eb9f5dcf9 req-3131a92a-3ca4-410b-843c-b862a7795fb7 service nova] Creating event network-vif-plugged:fb6f339c-beaf-425d-a33f-7e0afb090b69 for instance 1958534e-ec1c-4ecc-bc9a-7720512092ed on n-h2-861111-1 Oct 12 22:28:05.989346 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-34fcebe6-dbc7-4cf5-94e7-a10eb9f5dcf9 req-3131a92a-3ca4-410b-843c-b862a7795fb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193841 Oct 12 22:28:05.990467 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3204/5786] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:28:06.522521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-589c090f-98f0-4403-a945-9f338e8a1abe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:06.523463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-589c090f-98f0-4403-a945-9f338e8a1abe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:06.527785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:28:06.548140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-589c090f-98f0-4403-a945-9f338e8a1abe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:06.548888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-589c090f-98f0-4403-a945-9f338e8a1abe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:06.552623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-589c090f-98f0-4403-a945-9f338e8a1abe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:06.554701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-589c090f-98f0-4403-a945-9f338e8a1abe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:06.561232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-589c090f-98f0-4403-a945-9f338e8a1abe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:06.561850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-589c090f-98f0-4403-a945-9f338e8a1abe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:06.637415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c1776e4f-ea91-493a-8476-ce21727c0b92 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:06.638450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c1776e4f-ea91-493a-8476-ce21727c0b92 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:06.656336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1776e4f-ea91-493a-8476-ce21727c0b92 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:06.660050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1776e4f-ea91-493a-8476-ce21727c0b92 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:06.660744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1776e4f-ea91-493a-8476-ce21727c0b92 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:06.664161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1776e4f-ea91-493a-8476-ce21727c0b92 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:06.667210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1776e4f-ea91-493a-8476-ce21727c0b92 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:06.669623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1776e4f-ea91-493a-8476-ce21727c0b92 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:07.235231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c1776e4f-ea91-493a-8476-ce21727c0b92 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:07.244247 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c1776e4f-ea91-493a-8476-ce21727c0b92 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1363 microversion: 2.1 time: 0.612562 Oct 12 22:28:07.255906 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3205/5787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:28:06 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1363 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:28:07.805331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-589c090f-98f0-4403-a945-9f338e8a1abe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:07.818446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-589c090f-98f0-4403-a945-9f338e8a1abe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:07.819986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-589c090f-98f0-4403-a945-9f338e8a1abe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:07.821269 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-589c090f-98f0-4403-a945-9f338e8a1abe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 1.304857 Oct 12 22:28:07.821856 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2583/5788] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:06 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:08.274857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-14e28907-3114-4b88-87a4-00bb71cdbdf9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:08.277071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-14e28907-3114-4b88-87a4-00bb71cdbdf9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:08.295653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14e28907-3114-4b88-87a4-00bb71cdbdf9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:08.296490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14e28907-3114-4b88-87a4-00bb71cdbdf9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:08.297186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14e28907-3114-4b88-87a4-00bb71cdbdf9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:08.305142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14e28907-3114-4b88-87a4-00bb71cdbdf9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:08.306070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14e28907-3114-4b88-87a4-00bb71cdbdf9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:08.306739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14e28907-3114-4b88-87a4-00bb71cdbdf9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:08.690480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-14e28907-3114-4b88-87a4-00bb71cdbdf9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:08.700426 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-14e28907-3114-4b88-87a4-00bb71cdbdf9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1548 microversion: 2.1 time: 0.430227 Oct 12 22:28:08.709189 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3206/5789] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:28:08 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1548 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:28:08.734133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-00802548-2ab7-4f20-93e9-77fab6cbe1e2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:08.734888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-00802548-2ab7-4f20-93e9-77fab6cbe1e2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:08.752250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00802548-2ab7-4f20-93e9-77fab6cbe1e2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:08.753006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00802548-2ab7-4f20-93e9-77fab6cbe1e2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:08.753676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00802548-2ab7-4f20-93e9-77fab6cbe1e2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:08.772099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00802548-2ab7-4f20-93e9-77fab6cbe1e2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:08.773021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00802548-2ab7-4f20-93e9-77fab6cbe1e2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:08.774039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00802548-2ab7-4f20-93e9-77fab6cbe1e2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:08.851642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c7beced5-9f60-4705-ac58-d88361fb10aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:08.852678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c7beced5-9f60-4705-ac58-d88361fb10aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:08.862893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7beced5-9f60-4705-ac58-d88361fb10aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:08.863855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7beced5-9f60-4705-ac58-d88361fb10aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:08.865065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7beced5-9f60-4705-ac58-d88361fb10aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:08.867502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7beced5-9f60-4705-ac58-d88361fb10aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:08.868198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7beced5-9f60-4705-ac58-d88361fb10aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:08.869424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7beced5-9f60-4705-ac58-d88361fb10aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:09.151762 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-00802548-2ab7-4f20-93e9-77fab6cbe1e2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.422729 Oct 12 22:28:09.153008 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2584/5790] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:28:08 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/os-interface => generated 284 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:28:09.873453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c7beced5-9f60-4705-ac58-d88361fb10aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:09.901712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c7beced5-9f60-4705-ac58-d88361fb10aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:09.921744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c7beced5-9f60-4705-ac58-d88361fb10aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:09.940816 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c7beced5-9f60-4705-ac58-d88361fb10aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 1.093075 Oct 12 22:28:09.944786 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3207/5791] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:08 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:28:10.981842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d1bb2a2-7dc9-4fbb-a8a2-2fc38e57eda5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:10.983337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9d1bb2a2-7dc9-4fbb-a8a2-2fc38e57eda5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:10.999096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d1bb2a2-7dc9-4fbb-a8a2-2fc38e57eda5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:11.000967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d1bb2a2-7dc9-4fbb-a8a2-2fc38e57eda5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:11.003143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d1bb2a2-7dc9-4fbb-a8a2-2fc38e57eda5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:11.004103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d1bb2a2-7dc9-4fbb-a8a2-2fc38e57eda5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:11.006697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d1bb2a2-7dc9-4fbb-a8a2-2fc38e57eda5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:11.007377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d1bb2a2-7dc9-4fbb-a8a2-2fc38e57eda5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:11.740975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9d1bb2a2-7dc9-4fbb-a8a2-2fc38e57eda5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:11.754611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9d1bb2a2-7dc9-4fbb-a8a2-2fc38e57eda5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:11.759140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9d1bb2a2-7dc9-4fbb-a8a2-2fc38e57eda5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:11.776315 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9d1bb2a2-7dc9-4fbb-a8a2-2fc38e57eda5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 0.801825 Oct 12 22:28:11.803441 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2585/5792] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:10 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:12.659392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-09c94a12-0dd3-4d22-aa14-363bbfa8be3b req-f5c3449a-0af8-4ff3-b4d2-ffe580c26b4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1958534e-ec1c-4ecc-bc9a-7720512092ed", "tag": "fb6f339c-beaf-425d-a33f-7e0afb090b69"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:28:12.685049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-09c94a12-0dd3-4d22-aa14-363bbfa8be3b req-f5c3449a-0af8-4ff3-b4d2-ffe580c26b4c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:12.690948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-09c94a12-0dd3-4d22-aa14-363bbfa8be3b req-f5c3449a-0af8-4ff3-b4d2-ffe580c26b4c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:12.691782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-09c94a12-0dd3-4d22-aa14-363bbfa8be3b req-f5c3449a-0af8-4ff3-b4d2-ffe580c26b4c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:12.721092 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-09c94a12-0dd3-4d22-aa14-363bbfa8be3b req-f5c3449a-0af8-4ff3-b4d2-ffe580c26b4c service nova] Creating event network-changed:fb6f339c-beaf-425d-a33f-7e0afb090b69 for instance 1958534e-ec1c-4ecc-bc9a-7720512092ed on n-h2-861111-1 Oct 12 22:28:12.732495 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-09c94a12-0dd3-4d22-aa14-363bbfa8be3b req-f5c3449a-0af8-4ff3-b4d2-ffe580c26b4c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.479986 Oct 12 22:28:12.736670 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3208/5793] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:28:12.823165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d9973325-aedf-4fed-b3ab-ee84d3b33cad tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:12.825576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d9973325-aedf-4fed-b3ab-ee84d3b33cad tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:12.840243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9973325-aedf-4fed-b3ab-ee84d3b33cad tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:12.841182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9973325-aedf-4fed-b3ab-ee84d3b33cad tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:12.842559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9973325-aedf-4fed-b3ab-ee84d3b33cad tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:12.844558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9973325-aedf-4fed-b3ab-ee84d3b33cad tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:12.846390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9973325-aedf-4fed-b3ab-ee84d3b33cad tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:12.848148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9973325-aedf-4fed-b3ab-ee84d3b33cad tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:14.078022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d9973325-aedf-4fed-b3ab-ee84d3b33cad tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:14.095268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d9973325-aedf-4fed-b3ab-ee84d3b33cad tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:14.101980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d9973325-aedf-4fed-b3ab-ee84d3b33cad tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:14.108774 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d9973325-aedf-4fed-b3ab-ee84d3b33cad tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 1.291512 Oct 12 22:28:14.113255 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2586/5794] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:12 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:15.139688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cd1a2782-3241-4f8b-bac8-14190528285f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:15.141233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cd1a2782-3241-4f8b-bac8-14190528285f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:15.161379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd1a2782-3241-4f8b-bac8-14190528285f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:15.162266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd1a2782-3241-4f8b-bac8-14190528285f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:15.162966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd1a2782-3241-4f8b-bac8-14190528285f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:15.163956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd1a2782-3241-4f8b-bac8-14190528285f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:15.168395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd1a2782-3241-4f8b-bac8-14190528285f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:15.171897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd1a2782-3241-4f8b-bac8-14190528285f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:15.524470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cd1a2782-3241-4f8b-bac8-14190528285f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:15.544957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cd1a2782-3241-4f8b-bac8-14190528285f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:15.559045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cd1a2782-3241-4f8b-bac8-14190528285f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:15.561841 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cd1a2782-3241-4f8b-bac8-14190528285f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 0.427412 Oct 12 22:28:15.566576 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3209/5795] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:15 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:16.596676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-693c4d0d-b275-486c-8275-90641bbf3fb4 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:16.598820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-693c4d0d-b275-486c-8275-90641bbf3fb4 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:16.619450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-693c4d0d-b275-486c-8275-90641bbf3fb4 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:16.621461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-693c4d0d-b275-486c-8275-90641bbf3fb4 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:16.623633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-693c4d0d-b275-486c-8275-90641bbf3fb4 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:16.624892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-693c4d0d-b275-486c-8275-90641bbf3fb4 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:16.626144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-693c4d0d-b275-486c-8275-90641bbf3fb4 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:16.634658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-693c4d0d-b275-486c-8275-90641bbf3fb4 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:17.183531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-55d09d80-eac7-486d-9158-cf72c6a2ae6a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308-project-admin] Calling method '.version_select at 0x7f5122d38160>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:17.185584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55d09d80-eac7-486d-9158-cf72c6a2ae6a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:17.187202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55d09d80-eac7-486d-9158-cf72c6a2ae6a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:17.187202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55d09d80-eac7-486d-9158-cf72c6a2ae6a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:17.231909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55d09d80-eac7-486d-9158-cf72c6a2ae6a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:17.234476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55d09d80-eac7-486d-9158-cf72c6a2ae6a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:17.234976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55d09d80-eac7-486d-9158-cf72c6a2ae6a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:17.264253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55d09d80-eac7-486d-9158-cf72c6a2ae6a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:17.266092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55d09d80-eac7-486d-9158-cf72c6a2ae6a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:17.269175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55d09d80-eac7-486d-9158-cf72c6a2ae6a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:17.284176 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-55d09d80-eac7-486d-9158-cf72c6a2ae6a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1386450308-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.563817 Oct 12 22:28:17.290322 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3210/5796] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:28:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:28:17.347502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-693c4d0d-b275-486c-8275-90641bbf3fb4 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:17.360514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-693c4d0d-b275-486c-8275-90641bbf3fb4 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:17.363223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-693c4d0d-b275-486c-8275-90641bbf3fb4 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:17.364859 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-693c4d0d-b275-486c-8275-90641bbf3fb4 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 0.775939 Oct 12 22:28:17.380833 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2587/5797] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:16 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:18.394127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3e8bbe00-f165-4d4a-8c64-097465876a83 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:18.397051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3e8bbe00-f165-4d4a-8c64-097465876a83 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:18.413764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e8bbe00-f165-4d4a-8c64-097465876a83 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:18.418504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e8bbe00-f165-4d4a-8c64-097465876a83 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:18.423357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e8bbe00-f165-4d4a-8c64-097465876a83 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:18.424649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e8bbe00-f165-4d4a-8c64-097465876a83 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:18.428588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e8bbe00-f165-4d4a-8c64-097465876a83 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:18.432016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e8bbe00-f165-4d4a-8c64-097465876a83 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:19.195113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3e8bbe00-f165-4d4a-8c64-097465876a83 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:19.221041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3e8bbe00-f165-4d4a-8c64-097465876a83 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:19.225221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3e8bbe00-f165-4d4a-8c64-097465876a83 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:19.229730 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3e8bbe00-f165-4d4a-8c64-097465876a83 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 0.840365 Oct 12 22:28:19.243874 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3211/5798] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:18 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:20.260961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ddcc6e00-05a8-457b-9f61-97b17914e846 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:20.261569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ddcc6e00-05a8-457b-9f61-97b17914e846 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:20.290614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddcc6e00-05a8-457b-9f61-97b17914e846 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:20.290614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddcc6e00-05a8-457b-9f61-97b17914e846 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:20.291017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddcc6e00-05a8-457b-9f61-97b17914e846 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:20.292787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddcc6e00-05a8-457b-9f61-97b17914e846 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:20.299920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddcc6e00-05a8-457b-9f61-97b17914e846 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:20.300794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddcc6e00-05a8-457b-9f61-97b17914e846 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:20.909060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ddcc6e00-05a8-457b-9f61-97b17914e846 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:20.944473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ddcc6e00-05a8-457b-9f61-97b17914e846 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:20.948735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ddcc6e00-05a8-457b-9f61-97b17914e846 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:20.952408 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ddcc6e00-05a8-457b-9f61-97b17914e846 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 0.696064 Oct 12 22:28:20.967276 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2588/5799] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:20 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:21.987571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a0b18c9a-7793-4292-8f89-aec3954c92ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:21.989076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a0b18c9a-7793-4292-8f89-aec3954c92ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:22.000606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0b18c9a-7793-4292-8f89-aec3954c92ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:22.003563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0b18c9a-7793-4292-8f89-aec3954c92ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:22.004197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0b18c9a-7793-4292-8f89-aec3954c92ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:22.011012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0b18c9a-7793-4292-8f89-aec3954c92ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:22.012392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0b18c9a-7793-4292-8f89-aec3954c92ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:22.013538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0b18c9a-7793-4292-8f89-aec3954c92ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:23.384524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a0b18c9a-7793-4292-8f89-aec3954c92ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:23.397625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a0b18c9a-7793-4292-8f89-aec3954c92ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:23.399685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a0b18c9a-7793-4292-8f89-aec3954c92ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:23.403861 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a0b18c9a-7793-4292-8f89-aec3954c92ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 1.420665 Oct 12 22:28:23.416512 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3212/5800] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:21 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:24.433410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2c59d0df-344f-4d08-8c26-b7b094b74d5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:24.434828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2c59d0df-344f-4d08-8c26-b7b094b74d5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:24.443619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c59d0df-344f-4d08-8c26-b7b094b74d5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:24.455117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c59d0df-344f-4d08-8c26-b7b094b74d5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:24.458457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c59d0df-344f-4d08-8c26-b7b094b74d5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:24.462917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c59d0df-344f-4d08-8c26-b7b094b74d5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:24.464853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c59d0df-344f-4d08-8c26-b7b094b74d5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:24.465448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c59d0df-344f-4d08-8c26-b7b094b74d5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:24.905960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2c59d0df-344f-4d08-8c26-b7b094b74d5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:24.920523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2c59d0df-344f-4d08-8c26-b7b094b74d5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:24.927437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2c59d0df-344f-4d08-8c26-b7b094b74d5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:24.929270 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2c59d0df-344f-4d08-8c26-b7b094b74d5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 0.499725 Oct 12 22:28:24.933533 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2589/5801] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:24 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:25.962205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87a82abd-b3d9-4bad-bf71-827c19dd0510 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:25.962851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-87a82abd-b3d9-4bad-bf71-827c19dd0510 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:25.983964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87a82abd-b3d9-4bad-bf71-827c19dd0510 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:25.984468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87a82abd-b3d9-4bad-bf71-827c19dd0510 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:25.984913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87a82abd-b3d9-4bad-bf71-827c19dd0510 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:25.985639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87a82abd-b3d9-4bad-bf71-827c19dd0510 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:25.986097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87a82abd-b3d9-4bad-bf71-827c19dd0510 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:25.995325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87a82abd-b3d9-4bad-bf71-827c19dd0510 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:26.450880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-87a82abd-b3d9-4bad-bf71-827c19dd0510 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:26.467885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-87a82abd-b3d9-4bad-bf71-827c19dd0510 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:26.470674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-87a82abd-b3d9-4bad-bf71-827c19dd0510 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:26.472148 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-87a82abd-b3d9-4bad-bf71-827c19dd0510 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1740 microversion: 2.20 time: 0.513976 Oct 12 22:28:26.473454 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3213/5802] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:25 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1740 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:27.499364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-27c400c5-5934-41aa-a748-df51187de3c8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:27.501915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-27c400c5-5934-41aa-a748-df51187de3c8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:27.515453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27c400c5-5934-41aa-a748-df51187de3c8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:27.517639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27c400c5-5934-41aa-a748-df51187de3c8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:27.518519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27c400c5-5934-41aa-a748-df51187de3c8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:27.520707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27c400c5-5934-41aa-a748-df51187de3c8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:27.523061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27c400c5-5934-41aa-a748-df51187de3c8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:27.526049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27c400c5-5934-41aa-a748-df51187de3c8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:27.936557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-27c400c5-5934-41aa-a748-df51187de3c8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:27.955126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-27c400c5-5934-41aa-a748-df51187de3c8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:27.956601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-27c400c5-5934-41aa-a748-df51187de3c8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:27.957770 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-27c400c5-5934-41aa-a748-df51187de3c8 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1722 microversion: 2.20 time: 0.463338 Oct 12 22:28:27.958330 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2590/5803] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:27 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1722 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:28.987178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8e940307-00f5-4c52-9042-fea47a5204eb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:28.988591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8e940307-00f5-4c52-9042-fea47a5204eb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:28.997320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e940307-00f5-4c52-9042-fea47a5204eb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:28.998439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e940307-00f5-4c52-9042-fea47a5204eb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:28.999100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e940307-00f5-4c52-9042-fea47a5204eb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:29.000351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e940307-00f5-4c52-9042-fea47a5204eb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:29.001025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e940307-00f5-4c52-9042-fea47a5204eb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:29.001662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e940307-00f5-4c52-9042-fea47a5204eb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:29.345382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8e940307-00f5-4c52-9042-fea47a5204eb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:29.356723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8e940307-00f5-4c52-9042-fea47a5204eb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:29.358802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8e940307-00f5-4c52-9042-fea47a5204eb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:29.375159 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8e940307-00f5-4c52-9042-fea47a5204eb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1722 microversion: 2.20 time: 0.392383 Oct 12 22:28:29.377106 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3214/5804] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:28 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1722 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:30.408526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-01b2b326-d265-4138-a6f8-5bfff68b89ab tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:30.409926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-01b2b326-d265-4138-a6f8-5bfff68b89ab tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:30.424164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-01b2b326-d265-4138-a6f8-5bfff68b89ab tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:30.425680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-01b2b326-d265-4138-a6f8-5bfff68b89ab tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:30.426946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-01b2b326-d265-4138-a6f8-5bfff68b89ab tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:30.428496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-01b2b326-d265-4138-a6f8-5bfff68b89ab tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:30.429249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-01b2b326-d265-4138-a6f8-5bfff68b89ab tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:30.430268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-01b2b326-d265-4138-a6f8-5bfff68b89ab tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:30.727784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-01b2b326-d265-4138-a6f8-5bfff68b89ab tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:30.746833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-01b2b326-d265-4138-a6f8-5bfff68b89ab tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:30.749282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-01b2b326-d265-4138-a6f8-5bfff68b89ab tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:30.753494 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-01b2b326-d265-4138-a6f8-5bfff68b89ab tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1722 microversion: 2.20 time: 0.353077 Oct 12 22:28:30.754083 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2591/5805] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:30 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1722 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:31.009234 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-8b1200e7-71e9-43ca-a6d1-45516e2a2340 req-05b08000-addf-45ba-bf27-d0f1b8f927d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ecbb62-d209-4784-9a32-1076041ce09a", "name": "network-vif-unplugged", "status": "completed", "tag": "57ae856e-81cb-43bf-8768-e10cfb8d0da9"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:28:31.046198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8b1200e7-71e9-43ca-a6d1-45516e2a2340 req-05b08000-addf-45ba-bf27-d0f1b8f927d8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:31.046981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8b1200e7-71e9-43ca-a6d1-45516e2a2340 req-05b08000-addf-45ba-bf27-d0f1b8f927d8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:31.047980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8b1200e7-71e9-43ca-a6d1-45516e2a2340 req-05b08000-addf-45ba-bf27-d0f1b8f927d8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:31.091194 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-8b1200e7-71e9-43ca-a6d1-45516e2a2340 req-05b08000-addf-45ba-bf27-d0f1b8f927d8 service nova] Creating event network-vif-unplugged:57ae856e-81cb-43bf-8768-e10cfb8d0da9 for instance 97ecbb62-d209-4784-9a32-1076041ce09a on n-h1-861111-1 Oct 12 22:28:31.099503 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-8b1200e7-71e9-43ca-a6d1-45516e2a2340 req-05b08000-addf-45ba-bf27-d0f1b8f927d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094224 Oct 12 22:28:31.100752 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3215/5806] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:28:31.782728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7e252987-9e47-42cc-b341-665384e0d05f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:31.783948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7e252987-9e47-42cc-b341-665384e0d05f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:31.795752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e252987-9e47-42cc-b341-665384e0d05f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:31.796505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e252987-9e47-42cc-b341-665384e0d05f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:31.797091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e252987-9e47-42cc-b341-665384e0d05f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:31.802733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e252987-9e47-42cc-b341-665384e0d05f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:31.803671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e252987-9e47-42cc-b341-665384e0d05f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:31.804267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e252987-9e47-42cc-b341-665384e0d05f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:32.995025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e252987-9e47-42cc-b341-665384e0d05f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:33.008416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e252987-9e47-42cc-b341-665384e0d05f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:33.017643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e252987-9e47-42cc-b341-665384e0d05f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:33.021701 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7e252987-9e47-42cc-b341-665384e0d05f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1725 microversion: 2.20 time: 1.242493 Oct 12 22:28:33.022544 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2592/5807] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:31 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1725 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:33.054090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-96a2a60d-93b7-4071-b8c8-ea5709bd0410 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "adad4cad-d3a9-41aa-bc50-c9f53168d0bb"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:28:33.069418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-96a2a60d-93b7-4071-b8c8-ea5709bd0410 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:33.093848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96a2a60d-93b7-4071-b8c8-ea5709bd0410 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:33.096559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96a2a60d-93b7-4071-b8c8-ea5709bd0410 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:33.097069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96a2a60d-93b7-4071-b8c8-ea5709bd0410 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:33.099499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96a2a60d-93b7-4071-b8c8-ea5709bd0410 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:33.101134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96a2a60d-93b7-4071-b8c8-ea5709bd0410 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:33.104877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96a2a60d-93b7-4071-b8c8-ea5709bd0410 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:33.745487 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-96a2a60d-93b7-4071-b8c8-ea5709bd0410 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "POST /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.698836 Oct 12 22:28:33.752530 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3216/5808] 10.222.0.16 () {62 vars in 1364 bytes} [Wed Oct 12 22:28:33 2022] POST /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments => generated 188 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:28:34.024453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4ecef822-a430-4f9a-9c2d-1bc381360f46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:28:34.025960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4ecef822-a430-4f9a-9c2d-1bc381360f46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:34.046738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ecef822-a430-4f9a-9c2d-1bc381360f46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:34.049439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ecef822-a430-4f9a-9c2d-1bc381360f46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:34.052898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ecef822-a430-4f9a-9c2d-1bc381360f46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:34.053868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ecef822-a430-4f9a-9c2d-1bc381360f46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:34.055619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ecef822-a430-4f9a-9c2d-1bc381360f46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:34.056390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ecef822-a430-4f9a-9c2d-1bc381360f46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:34.134151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4ecef822-a430-4f9a-9c2d-1bc381360f46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120452) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 22:28:34.274414 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4ecef822-a430-4f9a-9c2d-1bc381360f46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "POST /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/action" status: 202 len: 0 microversion: 2.20 time: 0.254797 Oct 12 22:28:34.276504 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2593/5809] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 12 22:28:34 2022] POST /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:28:34.283904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dbf80a0e-136c-4092-baef-1257417b8c90 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:34.284530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dbf80a0e-136c-4092-baef-1257417b8c90 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:34.298736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbf80a0e-136c-4092-baef-1257417b8c90 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:34.301812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbf80a0e-136c-4092-baef-1257417b8c90 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:34.302265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbf80a0e-136c-4092-baef-1257417b8c90 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:34.302988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbf80a0e-136c-4092-baef-1257417b8c90 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:34.303489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbf80a0e-136c-4092-baef-1257417b8c90 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:34.303919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dbf80a0e-136c-4092-baef-1257417b8c90 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:35.265104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dbf80a0e-136c-4092-baef-1257417b8c90 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:35.267467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:28:35.278155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dbf80a0e-136c-4092-baef-1257417b8c90 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:35.285668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dbf80a0e-136c-4092-baef-1257417b8c90 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:35.289310 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dbf80a0e-136c-4092-baef-1257417b8c90 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1751 microversion: 2.20 time: 1.007903 Oct 12 22:28:35.291918 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3217/5810] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:34 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1751 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:28:36.324028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ee818750-c98b-4db4-8526-489bb35acb8e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:36.333346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ee818750-c98b-4db4-8526-489bb35acb8e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:36.363092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee818750-c98b-4db4-8526-489bb35acb8e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:36.365482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee818750-c98b-4db4-8526-489bb35acb8e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:36.366020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee818750-c98b-4db4-8526-489bb35acb8e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:36.369244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee818750-c98b-4db4-8526-489bb35acb8e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:36.370467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee818750-c98b-4db4-8526-489bb35acb8e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:36.371134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee818750-c98b-4db4-8526-489bb35acb8e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:36.831587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ee818750-c98b-4db4-8526-489bb35acb8e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:36.834650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:28:36.847031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ee818750-c98b-4db4-8526-489bb35acb8e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:36.856201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ee818750-c98b-4db4-8526-489bb35acb8e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:36.868442 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ee818750-c98b-4db4-8526-489bb35acb8e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1751 microversion: 2.20 time: 0.549104 Oct 12 22:28:36.871918 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2594/5811] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:36 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1751 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:37.897243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-050ec4f9-442c-4933-b30c-7ca8284a56f7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:37.897865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-050ec4f9-442c-4933-b30c-7ca8284a56f7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:37.910271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=32 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:28:37.920188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-050ec4f9-442c-4933-b30c-7ca8284a56f7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:37.920703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-050ec4f9-442c-4933-b30c-7ca8284a56f7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:37.921150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-050ec4f9-442c-4933-b30c-7ca8284a56f7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:37.921878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-050ec4f9-442c-4933-b30c-7ca8284a56f7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:37.922333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-050ec4f9-442c-4933-b30c-7ca8284a56f7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:37.922942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-050ec4f9-442c-4933-b30c-7ca8284a56f7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:38.495119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-050ec4f9-442c-4933-b30c-7ca8284a56f7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:38.506278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-050ec4f9-442c-4933-b30c-7ca8284a56f7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:38.507774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-050ec4f9-442c-4933-b30c-7ca8284a56f7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:38.509002 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-050ec4f9-442c-4933-b30c-7ca8284a56f7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1753 microversion: 2.20 time: 0.616505 Oct 12 22:28:38.519716 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3218/5812] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:37 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1753 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:39.544611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-86e1509c-c72e-40ce-bc47-cf29dcb97d58 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:39.545295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-86e1509c-c72e-40ce-bc47-cf29dcb97d58 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:39.556011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:28:39.563438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86e1509c-c72e-40ce-bc47-cf29dcb97d58 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:39.564880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86e1509c-c72e-40ce-bc47-cf29dcb97d58 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:39.566396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86e1509c-c72e-40ce-bc47-cf29dcb97d58 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:39.567727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86e1509c-c72e-40ce-bc47-cf29dcb97d58 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:39.568580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86e1509c-c72e-40ce-bc47-cf29dcb97d58 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:39.569698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86e1509c-c72e-40ce-bc47-cf29dcb97d58 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:39.997127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-86e1509c-c72e-40ce-bc47-cf29dcb97d58 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:40.016704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-86e1509c-c72e-40ce-bc47-cf29dcb97d58 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:40.021936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-86e1509c-c72e-40ce-bc47-cf29dcb97d58 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:40.027465 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-86e1509c-c72e-40ce-bc47-cf29dcb97d58 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1753 microversion: 2.20 time: 0.490003 Oct 12 22:28:40.029861 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2595/5813] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:39 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1753 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:41.057943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1fa6e80b-8e86-448e-baeb-ce60fd10af33 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:41.059854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1fa6e80b-8e86-448e-baeb-ce60fd10af33 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:41.067119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fa6e80b-8e86-448e-baeb-ce60fd10af33 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:41.067693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fa6e80b-8e86-448e-baeb-ce60fd10af33 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:41.079356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fa6e80b-8e86-448e-baeb-ce60fd10af33 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:41.080806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fa6e80b-8e86-448e-baeb-ce60fd10af33 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:41.081475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fa6e80b-8e86-448e-baeb-ce60fd10af33 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:41.082080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1fa6e80b-8e86-448e-baeb-ce60fd10af33 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:41.409023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2d8662bf-95e4-441b-833d-90a8eaf98764 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:41.410174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2d8662bf-95e4-441b-833d-90a8eaf98764 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:41.417065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d8662bf-95e4-441b-833d-90a8eaf98764 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:41.418411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d8662bf-95e4-441b-833d-90a8eaf98764 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:41.419061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d8662bf-95e4-441b-833d-90a8eaf98764 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:41.420085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d8662bf-95e4-441b-833d-90a8eaf98764 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:41.420761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d8662bf-95e4-441b-833d-90a8eaf98764 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:41.421391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d8662bf-95e4-441b-833d-90a8eaf98764 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:41.609928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-2d8662bf-95e4-441b-833d-90a8eaf98764 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lazy-loading 'services' on Instance uuid 7e1f52b4-4247-4612-afb8-ab097c2274ff {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:28:41.709856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1fa6e80b-8e86-448e-baeb-ce60fd10af33 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:41.729984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1fa6e80b-8e86-448e-baeb-ce60fd10af33 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:41.737157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1fa6e80b-8e86-448e-baeb-ce60fd10af33 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:41.739085 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1fa6e80b-8e86-448e-baeb-ce60fd10af33 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1753 microversion: 2.20 time: 0.685578 Oct 12 22:28:41.740440 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3219/5814] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:41 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1753 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:41.808653 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2d8662bf-95e4-441b-833d-90a8eaf98764 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff/os-volume_attachments/e1cb1e51-a124-451b-8544-8d3f5c2532b4" status: 202 len: 0 microversion: 2.1 time: 0.403250 Oct 12 22:28:41.809415 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2596/5815] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 22:28:41 2022] DELETE /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff/os-volume_attachments/e1cb1e51-a124-451b-8544-8d3f5c2532b4 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:28:42.768985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1ba7e1f4-6c57-4714-acab-3234cc6ad1c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:42.770486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1ba7e1f4-6c57-4714-acab-3234cc6ad1c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:42.785288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ba7e1f4-6c57-4714-acab-3234cc6ad1c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:42.786278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ba7e1f4-6c57-4714-acab-3234cc6ad1c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:42.786940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ba7e1f4-6c57-4714-acab-3234cc6ad1c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:42.787939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ba7e1f4-6c57-4714-acab-3234cc6ad1c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:42.788605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ba7e1f4-6c57-4714-acab-3234cc6ad1c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:42.789238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ba7e1f4-6c57-4714-acab-3234cc6ad1c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:43.172837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1ba7e1f4-6c57-4714-acab-3234cc6ad1c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:43.187462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1ba7e1f4-6c57-4714-acab-3234cc6ad1c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:43.188938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1ba7e1f4-6c57-4714-acab-3234cc6ad1c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:43.190139 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1ba7e1f4-6c57-4714-acab-3234cc6ad1c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1753 microversion: 2.20 time: 0.425041 Oct 12 22:28:43.193501 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3220/5816] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:42 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1753 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:44.222905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e895aab2-5510-46ac-9844-fa6ffe8d8d8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:44.223601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e895aab2-5510-46ac-9844-fa6ffe8d8d8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:44.232173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e895aab2-5510-46ac-9844-fa6ffe8d8d8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:44.234092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e895aab2-5510-46ac-9844-fa6ffe8d8d8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:44.235406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e895aab2-5510-46ac-9844-fa6ffe8d8d8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:44.237035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e895aab2-5510-46ac-9844-fa6ffe8d8d8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:44.238522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e895aab2-5510-46ac-9844-fa6ffe8d8d8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:44.240843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e895aab2-5510-46ac-9844-fa6ffe8d8d8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:44.720012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e895aab2-5510-46ac-9844-fa6ffe8d8d8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:44.737461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e895aab2-5510-46ac-9844-fa6ffe8d8d8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:44.740301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e895aab2-5510-46ac-9844-fa6ffe8d8d8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:44.746993 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e895aab2-5510-46ac-9844-fa6ffe8d8d8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1753 microversion: 2.20 time: 0.529477 Oct 12 22:28:44.752026 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2597/5817] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:44 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1753 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:45.777304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8d6ab7ad-b7ff-4097-8b09-4b85448fc95d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:45.778044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8d6ab7ad-b7ff-4097-8b09-4b85448fc95d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:45.786064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d6ab7ad-b7ff-4097-8b09-4b85448fc95d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:45.786607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d6ab7ad-b7ff-4097-8b09-4b85448fc95d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:45.787049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d6ab7ad-b7ff-4097-8b09-4b85448fc95d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:45.787782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d6ab7ad-b7ff-4097-8b09-4b85448fc95d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:45.788243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d6ab7ad-b7ff-4097-8b09-4b85448fc95d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:45.788718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d6ab7ad-b7ff-4097-8b09-4b85448fc95d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:46.042554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8d6ab7ad-b7ff-4097-8b09-4b85448fc95d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:46.062145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8d6ab7ad-b7ff-4097-8b09-4b85448fc95d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:46.064891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8d6ab7ad-b7ff-4097-8b09-4b85448fc95d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:46.066113 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8d6ab7ad-b7ff-4097-8b09-4b85448fc95d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1753 microversion: 2.20 time: 0.294020 Oct 12 22:28:46.079928 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3221/5818] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:45 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1753 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:47.094668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-26ff0949-10ed-47db-913b-16e883eef085 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:47.095315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-26ff0949-10ed-47db-913b-16e883eef085 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:47.104971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26ff0949-10ed-47db-913b-16e883eef085 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:47.105373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26ff0949-10ed-47db-913b-16e883eef085 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:47.105810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26ff0949-10ed-47db-913b-16e883eef085 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:47.106500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26ff0949-10ed-47db-913b-16e883eef085 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:47.107579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26ff0949-10ed-47db-913b-16e883eef085 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:47.107579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26ff0949-10ed-47db-913b-16e883eef085 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:47.332759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-26ff0949-10ed-47db-913b-16e883eef085 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:47.349414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-26ff0949-10ed-47db-913b-16e883eef085 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:47.352885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-26ff0949-10ed-47db-913b-16e883eef085 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:47.356355 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-26ff0949-10ed-47db-913b-16e883eef085 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1753 microversion: 2.20 time: 0.266889 Oct 12 22:28:47.371967 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2598/5819] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:47 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1753 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:48.394141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4b04c4ff-1d29-472e-9586-ce22b81bdbc3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:48.399171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4b04c4ff-1d29-472e-9586-ce22b81bdbc3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:48.420580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b04c4ff-1d29-472e-9586-ce22b81bdbc3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:48.421081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b04c4ff-1d29-472e-9586-ce22b81bdbc3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:48.421506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b04c4ff-1d29-472e-9586-ce22b81bdbc3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:48.422217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b04c4ff-1d29-472e-9586-ce22b81bdbc3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:48.425238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b04c4ff-1d29-472e-9586-ce22b81bdbc3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:48.432732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b04c4ff-1d29-472e-9586-ce22b81bdbc3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:48.873905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b04c4ff-1d29-472e-9586-ce22b81bdbc3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:48.890155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b04c4ff-1d29-472e-9586-ce22b81bdbc3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:48.896227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b04c4ff-1d29-472e-9586-ce22b81bdbc3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:48.896227 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4b04c4ff-1d29-472e-9586-ce22b81bdbc3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1753 microversion: 2.20 time: 0.509184 Oct 12 22:28:48.905860 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3222/5820] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:48 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1753 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:49.378706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2349d18d-5d6b-4e28-b267-ba4a25a8bc03 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:49.384276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2349d18d-5d6b-4e28-b267-ba4a25a8bc03 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:49.404197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2349d18d-5d6b-4e28-b267-ba4a25a8bc03 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:49.404690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2349d18d-5d6b-4e28-b267-ba4a25a8bc03 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:49.405129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2349d18d-5d6b-4e28-b267-ba4a25a8bc03 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:49.411165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2349d18d-5d6b-4e28-b267-ba4a25a8bc03 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:49.411673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2349d18d-5d6b-4e28-b267-ba4a25a8bc03 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:49.412117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2349d18d-5d6b-4e28-b267-ba4a25a8bc03 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:49.475597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2349d18d-5d6b-4e28-b267-ba4a25a8bc03 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:28:49.674696 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2349d18d-5d6b-4e28-b267-ba4a25a8bc03 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 204 len: 0 microversion: 2.1 time: 0.300901 Oct 12 22:28:49.678465 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2599/5821] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:28:49 2022] DELETE /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:28:49.686449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fd3bc9d1-e8e4-4032-97b7-9bf9cb739b92 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:49.689193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fd3bc9d1-e8e4-4032-97b7-9bf9cb739b92 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:49.711037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3bc9d1-e8e4-4032-97b7-9bf9cb739b92 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:49.711824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3bc9d1-e8e4-4032-97b7-9bf9cb739b92 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:49.713243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3bc9d1-e8e4-4032-97b7-9bf9cb739b92 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:49.714336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3bc9d1-e8e4-4032-97b7-9bf9cb739b92 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:49.715124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3bc9d1-e8e4-4032-97b7-9bf9cb739b92 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:49.716033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd3bc9d1-e8e4-4032-97b7-9bf9cb739b92 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:49.938200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1cc7ea8c-b802-49aa-a8d4-b1bcaecdf684 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:49.939089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1cc7ea8c-b802-49aa-a8d4-b1bcaecdf684 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:49.950943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cc7ea8c-b802-49aa-a8d4-b1bcaecdf684 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:49.954945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cc7ea8c-b802-49aa-a8d4-b1bcaecdf684 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:49.955864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cc7ea8c-b802-49aa-a8d4-b1bcaecdf684 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:49.956931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cc7ea8c-b802-49aa-a8d4-b1bcaecdf684 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:49.958482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cc7ea8c-b802-49aa-a8d4-b1bcaecdf684 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:49.959763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cc7ea8c-b802-49aa-a8d4-b1bcaecdf684 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:50.110264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fd3bc9d1-e8e4-4032-97b7-9bf9cb739b92 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4117aa70605d41c0b5d42dbce801f3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37f4c02a7a4439eba03499302477517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:50.120098 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fd3bc9d1-e8e4-4032-97b7-9bf9cb739b92 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 200 len: 1470 microversion: 2.1 time: 0.439582 Oct 12 22:28:50.147313 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3223/5822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:28:49 2022] GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 1470 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:28:50.930853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1cc7ea8c-b802-49aa-a8d4-b1bcaecdf684 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:50.957175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1cc7ea8c-b802-49aa-a8d4-b1bcaecdf684 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:50.959096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1cc7ea8c-b802-49aa-a8d4-b1bcaecdf684 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:50.960551 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1cc7ea8c-b802-49aa-a8d4-b1bcaecdf684 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1753 microversion: 2.20 time: 1.027058 Oct 12 22:28:50.961282 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2600/5823] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:49 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1753 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:51.289119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8fede4ec-211d-4678-8426-9d0e788433a9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:51.295810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8fede4ec-211d-4678-8426-9d0e788433a9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:51.323341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fede4ec-211d-4678-8426-9d0e788433a9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:51.325947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fede4ec-211d-4678-8426-9d0e788433a9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:51.328115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fede4ec-211d-4678-8426-9d0e788433a9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:51.331622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fede4ec-211d-4678-8426-9d0e788433a9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:51.332427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fede4ec-211d-4678-8426-9d0e788433a9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:51.343522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fede4ec-211d-4678-8426-9d0e788433a9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:51.863863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8fede4ec-211d-4678-8426-9d0e788433a9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4117aa70605d41c0b5d42dbce801f3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37f4c02a7a4439eba03499302477517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:51.873488 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8fede4ec-211d-4678-8426-9d0e788433a9 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 200 len: 1470 microversion: 2.1 time: 0.590364 Oct 12 22:28:51.888657 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3224/5824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:28:51 2022] GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 1470 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:28:51.987084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-22c4d112-ea02-44d2-87d1-c2c60429d7b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:51.987809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-22c4d112-ea02-44d2-87d1-c2c60429d7b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:52.002277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22c4d112-ea02-44d2-87d1-c2c60429d7b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:52.002774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22c4d112-ea02-44d2-87d1-c2c60429d7b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:52.003230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22c4d112-ea02-44d2-87d1-c2c60429d7b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:52.003962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22c4d112-ea02-44d2-87d1-c2c60429d7b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:52.004412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22c4d112-ea02-44d2-87d1-c2c60429d7b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:52.004838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22c4d112-ea02-44d2-87d1-c2c60429d7b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:52.282051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-22c4d112-ea02-44d2-87d1-c2c60429d7b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:52.306655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-22c4d112-ea02-44d2-87d1-c2c60429d7b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:52.313319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-22c4d112-ea02-44d2-87d1-c2c60429d7b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:52.314977 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-22c4d112-ea02-44d2-87d1-c2c60429d7b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1753 microversion: 2.20 time: 0.333087 Oct 12 22:28:52.316500 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2601/5825] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:51 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1753 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:52.561251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f5778e89-8e52-48dd-8216-c1e081f2c8a4 req-cca19360-5bb5-4aeb-823b-a43a1f84ff0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e1f52b4-4247-4612-afb8-ab097c2274ff", "name": "network-vif-deleted", "tag": "1077c466-061f-4e71-ae24-ff379dda43f6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:28:52.576813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f5778e89-8e52-48dd-8216-c1e081f2c8a4 req-cca19360-5bb5-4aeb-823b-a43a1f84ff0a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:52.577433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f5778e89-8e52-48dd-8216-c1e081f2c8a4 req-cca19360-5bb5-4aeb-823b-a43a1f84ff0a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:52.579188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f5778e89-8e52-48dd-8216-c1e081f2c8a4 req-cca19360-5bb5-4aeb-823b-a43a1f84ff0a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:52.619192 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f5778e89-8e52-48dd-8216-c1e081f2c8a4 req-cca19360-5bb5-4aeb-823b-a43a1f84ff0a service nova] Creating event network-vif-deleted:1077c466-061f-4e71-ae24-ff379dda43f6 for instance 7e1f52b4-4247-4612-afb8-ab097c2274ff on n-h2-861111-1 Oct 12 22:28:52.626851 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f5778e89-8e52-48dd-8216-c1e081f2c8a4 req-cca19360-5bb5-4aeb-823b-a43a1f84ff0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068152 Oct 12 22:28:52.628760 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3225/5826] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:28:52.900996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-33da362b-7a00-4722-9647-d5dc1c3d827b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:52.902970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-33da362b-7a00-4722-9647-d5dc1c3d827b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:52.916566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33da362b-7a00-4722-9647-d5dc1c3d827b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:52.920208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33da362b-7a00-4722-9647-d5dc1c3d827b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:52.920952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33da362b-7a00-4722-9647-d5dc1c3d827b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:52.923413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33da362b-7a00-4722-9647-d5dc1c3d827b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:52.924665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33da362b-7a00-4722-9647-d5dc1c3d827b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:52.927563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33da362b-7a00-4722-9647-d5dc1c3d827b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:53.031400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33da362b-7a00-4722-9647-d5dc1c3d827b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:53.033137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33da362b-7a00-4722-9647-d5dc1c3d827b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:53.034042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33da362b-7a00-4722-9647-d5dc1c3d827b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:53.034900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-33da362b-7a00-4722-9647-d5dc1c3d827b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lazy-loading 'fault' on Instance uuid 7e1f52b4-4247-4612-afb8-ab097c2274ff {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:28:53.110166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-33da362b-7a00-4722-9647-d5dc1c3d827b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4117aa70605d41c0b5d42dbce801f3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37f4c02a7a4439eba03499302477517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:53.123788 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-33da362b-7a00-4722-9647-d5dc1c3d827b tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 200 len: 1304 microversion: 2.1 time: 0.228450 Oct 12 22:28:53.129804 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2602/5827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:28:52 2022] GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 1304 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:28:53.345517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c0858734-2e45-4d05-ac4e-a7087bfb0130 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:53.346429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c0858734-2e45-4d05-ac4e-a7087bfb0130 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:53.361215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0858734-2e45-4d05-ac4e-a7087bfb0130 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:53.361668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0858734-2e45-4d05-ac4e-a7087bfb0130 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:53.368178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0858734-2e45-4d05-ac4e-a7087bfb0130 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:53.370032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0858734-2e45-4d05-ac4e-a7087bfb0130 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:53.370650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0858734-2e45-4d05-ac4e-a7087bfb0130 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:53.371184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0858734-2e45-4d05-ac4e-a7087bfb0130 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:53.682943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c0858734-2e45-4d05-ac4e-a7087bfb0130 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:53.702183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c0858734-2e45-4d05-ac4e-a7087bfb0130 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:53.712297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c0858734-2e45-4d05-ac4e-a7087bfb0130 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:53.714782 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c0858734-2e45-4d05-ac4e-a7087bfb0130 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 0.375688 Oct 12 22:28:53.731265 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3226/5828] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:53 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:54.158358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-691e1b3e-5493-440a-943b-cbca3fd3a5e2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:54.159033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-691e1b3e-5493-440a-943b-cbca3fd3a5e2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] [instance: 7e1f52b4-4247-4612-afb8-ab097c2274ff] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:54.183599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-691e1b3e-5493-440a-943b-cbca3fd3a5e2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:54.184119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-691e1b3e-5493-440a-943b-cbca3fd3a5e2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:54.190870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-691e1b3e-5493-440a-943b-cbca3fd3a5e2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:54.192056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-691e1b3e-5493-440a-943b-cbca3fd3a5e2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:54.192755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-691e1b3e-5493-440a-943b-cbca3fd3a5e2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:54.193440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-691e1b3e-5493-440a-943b-cbca3fd3a5e2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:54.222154 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-691e1b3e-5493-440a-943b-cbca3fd3a5e2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] HTTP exception thrown: Instance 7e1f52b4-4247-4612-afb8-ab097c2274ff could not be found. Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-691e1b3e-5493-440a-943b-cbca3fd3a5e2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Request method failure captured: Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff HTTP/1.1 Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz7yDqtdrQ4Ia9zYWJ4JcwPM-eED1YgFsLRAlNVWxrsF35KV_Wy2PtHetjfUMIfU6LMdIBAHhtD53_MmY5WWehGkHF9vw32SkDQZcQdj7sVV5dmPw3gTTKRSJDxalqWgEVCHTbn18RuerbnGJQgHGnS4ZfpOR7-LmbZsKs2Fpg5RtBw Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: a37f4c02a7a4439eba03499302477517 Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesBackupsTest-2000070804 Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a37f4c02a7a4439eba03499302477517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a37f4c02a7a4439eba03499302477517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a37f4c02a7a4439eba03499302477517", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a37f4c02a7a4439eba03499302477517"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-VolumesBackupsTest-2000070804 Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: a37f4c02a7a4439eba03499302477517 Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesBackupsTest-2000070804 Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-VolumesBackupsTest-2000070804-project Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 4117aa70605d41c0b5d42dbce801f3aa Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-VolumesBackupsTest-2000070804-project Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 7e1f52b4-4247-4612-afb8-ab097c2274ff could not be found. Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '7e1f52b4-4247-4612-afb8-ab097c2274ff'} Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e1f52b4-4247-4612-afb8-ab097c2274ff could not be found. Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e1f52b4-4247-4612-afb8-ab097c2274ff could not be found. Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:28:54.224042 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:28:54.228965 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:28:54.228965 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:28:54.228965 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:28:54.228965 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:28:54.228965 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:28:54.228965 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e1f52b4-4247-4612-afb8-ab097c2274ff could not be found. Oct 12 22:28:54.228965 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:28:54.231814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-691e1b3e-5493-440a-943b-cbca3fd3a5e2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] Returning 404 to user: Instance 7e1f52b4-4247-4612-afb8-ab097c2274ff could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:28:54.233057 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-691e1b3e-5493-440a-943b-cbca3fd3a5e2 tempest-VolumesBackupsTest-2000070804 tempest-VolumesBackupsTest-2000070804-project] 10.222.0.16 "GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff" status: 404 len: 111 microversion: 2.1 time: 0.079373 Oct 12 22:28:54.237509 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2603/5829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:28:54 2022] GET /compute/v2.1/servers/7e1f52b4-4247-4612-afb8-ab097c2274ff => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:28:54.750361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b73ca44a-bc99-4f36-9916-ce1192a64594 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:54.751091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b73ca44a-bc99-4f36-9916-ce1192a64594 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:54.760432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b73ca44a-bc99-4f36-9916-ce1192a64594 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:54.771072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b73ca44a-bc99-4f36-9916-ce1192a64594 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:54.771763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b73ca44a-bc99-4f36-9916-ce1192a64594 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:54.780570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b73ca44a-bc99-4f36-9916-ce1192a64594 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:54.781704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b73ca44a-bc99-4f36-9916-ce1192a64594 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:54.787257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b73ca44a-bc99-4f36-9916-ce1192a64594 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:55.094933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b73ca44a-bc99-4f36-9916-ce1192a64594 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:55.122405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b73ca44a-bc99-4f36-9916-ce1192a64594 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:55.125439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b73ca44a-bc99-4f36-9916-ce1192a64594 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:55.128977 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b73ca44a-bc99-4f36-9916-ce1192a64594 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 0.385417 Oct 12 22:28:55.144296 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3227/5830] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:54 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:56.175875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bce694e5-eca6-49fc-b024-5b4401a3cb8c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:56.176266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bce694e5-eca6-49fc-b024-5b4401a3cb8c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:56.207581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bce694e5-eca6-49fc-b024-5b4401a3cb8c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:56.208526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bce694e5-eca6-49fc-b024-5b4401a3cb8c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:56.211127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bce694e5-eca6-49fc-b024-5b4401a3cb8c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:56.215305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bce694e5-eca6-49fc-b024-5b4401a3cb8c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:56.221462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bce694e5-eca6-49fc-b024-5b4401a3cb8c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:56.223590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bce694e5-eca6-49fc-b024-5b4401a3cb8c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:56.627111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bce694e5-eca6-49fc-b024-5b4401a3cb8c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:56.652201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bce694e5-eca6-49fc-b024-5b4401a3cb8c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:56.659876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bce694e5-eca6-49fc-b024-5b4401a3cb8c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:56.663492 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bce694e5-eca6-49fc-b024-5b4401a3cb8c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 0.498596 Oct 12 22:28:56.677472 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2604/5831] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:56 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:57.697968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8a8f4ed5-34a4-4894-95dd-b06d0a383997 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:57.699336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8a8f4ed5-34a4-4894-95dd-b06d0a383997 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:57.708291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a8f4ed5-34a4-4894-95dd-b06d0a383997 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:57.709233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a8f4ed5-34a4-4894-95dd-b06d0a383997 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:57.709862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a8f4ed5-34a4-4894-95dd-b06d0a383997 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:57.710761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a8f4ed5-34a4-4894-95dd-b06d0a383997 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:57.711577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a8f4ed5-34a4-4894-95dd-b06d0a383997 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:57.712747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a8f4ed5-34a4-4894-95dd-b06d0a383997 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:58.049832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8a8f4ed5-34a4-4894-95dd-b06d0a383997 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:58.072787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8a8f4ed5-34a4-4894-95dd-b06d0a383997 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:58.075742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8a8f4ed5-34a4-4894-95dd-b06d0a383997 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:58.081002 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8a8f4ed5-34a4-4894-95dd-b06d0a383997 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 0.387379 Oct 12 22:28:58.083368 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3228/5832] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:57 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:59.114022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ec68d272-3add-4660-9f8e-1b4a21860b13 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:59.114760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ec68d272-3add-4660-9f8e-1b4a21860b13 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:28:59.126637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec68d272-3add-4660-9f8e-1b4a21860b13 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:59.132245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec68d272-3add-4660-9f8e-1b4a21860b13 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:59.133766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec68d272-3add-4660-9f8e-1b4a21860b13 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:59.135882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec68d272-3add-4660-9f8e-1b4a21860b13 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:59.137874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec68d272-3add-4660-9f8e-1b4a21860b13 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:59.139209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec68d272-3add-4660-9f8e-1b4a21860b13 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:59.616388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ec68d272-3add-4660-9f8e-1b4a21860b13 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:59.636540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ec68d272-3add-4660-9f8e-1b4a21860b13 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:59.638185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ec68d272-3add-4660-9f8e-1b4a21860b13 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:28:59.639204 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ec68d272-3add-4660-9f8e-1b4a21860b13 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 0.529447 Oct 12 22:28:59.658039 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2605/5833] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:28:59 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:29:00.690184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-59e7cb7f-3128-4447-9f4e-1db01db020b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:00.690802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-59e7cb7f-3128-4447-9f4e-1db01db020b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:00.723379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e7cb7f-3128-4447-9f4e-1db01db020b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:00.724236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e7cb7f-3128-4447-9f4e-1db01db020b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:00.724707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e7cb7f-3128-4447-9f4e-1db01db020b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:00.732317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e7cb7f-3128-4447-9f4e-1db01db020b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:00.733032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e7cb7f-3128-4447-9f4e-1db01db020b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:00.736087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59e7cb7f-3128-4447-9f4e-1db01db020b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:01.171022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-59e7cb7f-3128-4447-9f4e-1db01db020b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:01.184424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-59e7cb7f-3128-4447-9f4e-1db01db020b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:01.189652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-59e7cb7f-3128-4447-9f4e-1db01db020b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:01.194267 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-59e7cb7f-3128-4447-9f4e-1db01db020b7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 0.504938 Oct 12 22:29:01.195377 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3229/5834] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:29:00 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:29:02.225148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4432a8bd-937b-433e-9350-9407b813d05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:02.226377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4432a8bd-937b-433e-9350-9407b813d05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:02.236416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4432a8bd-937b-433e-9350-9407b813d05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:02.240364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4432a8bd-937b-433e-9350-9407b813d05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:02.242178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4432a8bd-937b-433e-9350-9407b813d05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:02.246068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4432a8bd-937b-433e-9350-9407b813d05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:02.246839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4432a8bd-937b-433e-9350-9407b813d05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:02.247948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4432a8bd-937b-433e-9350-9407b813d05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:02.673462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4432a8bd-937b-433e-9350-9407b813d05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:02.695376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4432a8bd-937b-433e-9350-9407b813d05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:02.699589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4432a8bd-937b-433e-9350-9407b813d05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:02.702964 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4432a8bd-937b-433e-9350-9407b813d05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 0.482278 Oct 12 22:29:02.705056 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2606/5835] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:29:02 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:29:03.736353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fc8fe906-9754-4c37-bb41-3ec2478584a7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:03.737029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fc8fe906-9754-4c37-bb41-3ec2478584a7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:03.765112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc8fe906-9754-4c37-bb41-3ec2478584a7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:03.765622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc8fe906-9754-4c37-bb41-3ec2478584a7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:03.771064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc8fe906-9754-4c37-bb41-3ec2478584a7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:03.777383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc8fe906-9754-4c37-bb41-3ec2478584a7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:03.780364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc8fe906-9754-4c37-bb41-3ec2478584a7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:03.783806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc8fe906-9754-4c37-bb41-3ec2478584a7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:04.357973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fc8fe906-9754-4c37-bb41-3ec2478584a7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:04.386659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fc8fe906-9754-4c37-bb41-3ec2478584a7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:04.392248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fc8fe906-9754-4c37-bb41-3ec2478584a7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:04.407383 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fc8fe906-9754-4c37-bb41-3ec2478584a7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 0.665791 Oct 12 22:29:04.411381 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3230/5836] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:29:03 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:29:05.443216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-10eee3d1-9e88-4fde-89ae-a3aacb9269d0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:05.443216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-10eee3d1-9e88-4fde-89ae-a3aacb9269d0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:05.464463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10eee3d1-9e88-4fde-89ae-a3aacb9269d0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:05.466212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10eee3d1-9e88-4fde-89ae-a3aacb9269d0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:05.471807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10eee3d1-9e88-4fde-89ae-a3aacb9269d0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:05.475304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10eee3d1-9e88-4fde-89ae-a3aacb9269d0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:05.478353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10eee3d1-9e88-4fde-89ae-a3aacb9269d0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:05.489526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10eee3d1-9e88-4fde-89ae-a3aacb9269d0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:06.577302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-10eee3d1-9e88-4fde-89ae-a3aacb9269d0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:06.617707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-10eee3d1-9e88-4fde-89ae-a3aacb9269d0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:06.627043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-10eee3d1-9e88-4fde-89ae-a3aacb9269d0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:06.647114 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-10eee3d1-9e88-4fde-89ae-a3aacb9269d0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 1.217451 Oct 12 22:29:06.657222 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2607/5837] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:29:05 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:29:07.689411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-560534f5-3d18-4df9-83a1-3087a330fa19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:07.690254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-560534f5-3d18-4df9-83a1-3087a330fa19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:07.745512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-560534f5-3d18-4df9-83a1-3087a330fa19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:07.751930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-560534f5-3d18-4df9-83a1-3087a330fa19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:07.754249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-560534f5-3d18-4df9-83a1-3087a330fa19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:07.755272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-560534f5-3d18-4df9-83a1-3087a330fa19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:07.762494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-560534f5-3d18-4df9-83a1-3087a330fa19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:07.763319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-560534f5-3d18-4df9-83a1-3087a330fa19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:08.360976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-560534f5-3d18-4df9-83a1-3087a330fa19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:08.363814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=80 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:29:08.379221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-560534f5-3d18-4df9-83a1-3087a330fa19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:08.384752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-560534f5-3d18-4df9-83a1-3087a330fa19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:08.386898 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-560534f5-3d18-4df9-83a1-3087a330fa19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 0.708246 Oct 12 22:29:08.390813 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3231/5838] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:29:07 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:29:09.419121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-35a14e6b-5a63-4021-90ba-37f59521ed72 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:09.420714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-35a14e6b-5a63-4021-90ba-37f59521ed72 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:09.433465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35a14e6b-5a63-4021-90ba-37f59521ed72 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:09.434638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35a14e6b-5a63-4021-90ba-37f59521ed72 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:09.435700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35a14e6b-5a63-4021-90ba-37f59521ed72 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:09.436791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35a14e6b-5a63-4021-90ba-37f59521ed72 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:09.437485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35a14e6b-5a63-4021-90ba-37f59521ed72 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:09.438300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-35a14e6b-5a63-4021-90ba-37f59521ed72 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:11.047677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-35a14e6b-5a63-4021-90ba-37f59521ed72 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:11.050279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:29:11.074032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-35a14e6b-5a63-4021-90ba-37f59521ed72 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:11.076849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-35a14e6b-5a63-4021-90ba-37f59521ed72 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:11.080868 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-35a14e6b-5a63-4021-90ba-37f59521ed72 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 1.666266 Oct 12 22:29:11.096629 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2608/5839] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:29:09 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:29:12.107937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6a410c28-f21d-459e-9aa7-f8c7ac619840 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:12.109215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6a410c28-f21d-459e-9aa7-f8c7ac619840 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:12.122288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=28 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:29:12.151343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a410c28-f21d-459e-9aa7-f8c7ac619840 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:12.157578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a410c28-f21d-459e-9aa7-f8c7ac619840 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:12.161991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a410c28-f21d-459e-9aa7-f8c7ac619840 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:12.171652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a410c28-f21d-459e-9aa7-f8c7ac619840 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:12.172211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a410c28-f21d-459e-9aa7-f8c7ac619840 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:12.172667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a410c28-f21d-459e-9aa7-f8c7ac619840 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:12.673178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6a410c28-f21d-459e-9aa7-f8c7ac619840 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:12.689025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6a410c28-f21d-459e-9aa7-f8c7ac619840 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:12.693988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6a410c28-f21d-459e-9aa7-f8c7ac619840 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:12.696897 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6a410c28-f21d-459e-9aa7-f8c7ac619840 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 0.592012 Oct 12 22:29:12.699559 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3232/5840] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:29:12 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:29:13.726493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c3ffbf78-2690-45bd-938e-3d69dedd75a6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:13.727224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c3ffbf78-2690-45bd-938e-3d69dedd75a6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:13.729982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:29:13.740924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3ffbf78-2690-45bd-938e-3d69dedd75a6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:13.746259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3ffbf78-2690-45bd-938e-3d69dedd75a6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:13.746833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3ffbf78-2690-45bd-938e-3d69dedd75a6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:13.747625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3ffbf78-2690-45bd-938e-3d69dedd75a6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:13.748089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3ffbf78-2690-45bd-938e-3d69dedd75a6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:13.748689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3ffbf78-2690-45bd-938e-3d69dedd75a6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:14.279649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c3ffbf78-2690-45bd-938e-3d69dedd75a6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:14.296934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c3ffbf78-2690-45bd-938e-3d69dedd75a6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:14.298374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c3ffbf78-2690-45bd-938e-3d69dedd75a6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:14.299837 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c3ffbf78-2690-45bd-938e-3d69dedd75a6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 0.577864 Oct 12 22:29:14.300573 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2609/5841] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:29:13 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:29:14.990438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-47877d94-9afa-4f70-91fa-2da2b398b713 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:14.991071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-47877d94-9afa-4f70-91fa-2da2b398b713 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:15.001540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47877d94-9afa-4f70-91fa-2da2b398b713 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:15.004282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47877d94-9afa-4f70-91fa-2da2b398b713 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:15.004930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47877d94-9afa-4f70-91fa-2da2b398b713 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:15.013838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47877d94-9afa-4f70-91fa-2da2b398b713 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:15.014693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47877d94-9afa-4f70-91fa-2da2b398b713 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:15.015357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47877d94-9afa-4f70-91fa-2da2b398b713 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:15.063063 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-47877d94-9afa-4f70-91fa-2da2b398b713 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/ips" status: 200 len: 144 microversion: 2.1 time: 0.076514 Oct 12 22:29:15.075899 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3233/5842] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 22:29:14 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/ips => generated 144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:29:15.330644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-de9387a3-ffe7-40fb-9d81-100faf949b93 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:15.332023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-de9387a3-ffe7-40fb-9d81-100faf949b93 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:15.346188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de9387a3-ffe7-40fb-9d81-100faf949b93 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:15.347537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de9387a3-ffe7-40fb-9d81-100faf949b93 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:15.351941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de9387a3-ffe7-40fb-9d81-100faf949b93 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:15.353013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de9387a3-ffe7-40fb-9d81-100faf949b93 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:15.353725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de9387a3-ffe7-40fb-9d81-100faf949b93 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:15.354367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de9387a3-ffe7-40fb-9d81-100faf949b93 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:15.825989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-de9387a3-ffe7-40fb-9d81-100faf949b93 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:15.838172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-de9387a3-ffe7-40fb-9d81-100faf949b93 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:15.840236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-de9387a3-ffe7-40fb-9d81-100faf949b93 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:15.841801 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-de9387a3-ffe7-40fb-9d81-100faf949b93 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 0.515719 Oct 12 22:29:15.843330 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2610/5843] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:29:15 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:29:16.872412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dacdc3c5-d588-4945-9bdc-7d9505e857c6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:16.873365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dacdc3c5-d588-4945-9bdc-7d9505e857c6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:16.887643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dacdc3c5-d588-4945-9bdc-7d9505e857c6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:16.888178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dacdc3c5-d588-4945-9bdc-7d9505e857c6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:16.888617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dacdc3c5-d588-4945-9bdc-7d9505e857c6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:16.901674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dacdc3c5-d588-4945-9bdc-7d9505e857c6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:16.902203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dacdc3c5-d588-4945-9bdc-7d9505e857c6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:16.903298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dacdc3c5-d588-4945-9bdc-7d9505e857c6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:18.015812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dacdc3c5-d588-4945-9bdc-7d9505e857c6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:18.030544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dacdc3c5-d588-4945-9bdc-7d9505e857c6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:18.034443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dacdc3c5-d588-4945-9bdc-7d9505e857c6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:18.038842 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dacdc3c5-d588-4945-9bdc-7d9505e857c6 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 1.167284 Oct 12 22:29:18.039567 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3234/5844] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:29:16 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:29:18.862370 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d533c147-eb51-47e4-a5df-9eb7bfb4a91c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23d73b71-e4b9-4724-8cce-8a045f65e05e"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:29:18.866138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d533c147-eb51-47e4-a5df-9eb7bfb4a91c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:18.890125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d533c147-eb51-47e4-a5df-9eb7bfb4a91c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:18.895195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d533c147-eb51-47e4-a5df-9eb7bfb4a91c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:18.896018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d533c147-eb51-47e4-a5df-9eb7bfb4a91c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:18.897078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d533c147-eb51-47e4-a5df-9eb7bfb4a91c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:18.897683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d533c147-eb51-47e4-a5df-9eb7bfb4a91c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:18.899068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d533c147-eb51-47e4-a5df-9eb7bfb4a91c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:19.065920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1820f5fc-d29a-4c87-8c72-f3e285accdff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:19.066478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1820f5fc-d29a-4c87-8c72-f3e285accdff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:19.079742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1820f5fc-d29a-4c87-8c72-f3e285accdff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:19.091589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1820f5fc-d29a-4c87-8c72-f3e285accdff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:19.092257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1820f5fc-d29a-4c87-8c72-f3e285accdff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:19.094831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1820f5fc-d29a-4c87-8c72-f3e285accdff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:19.095360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1820f5fc-d29a-4c87-8c72-f3e285accdff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:19.095833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1820f5fc-d29a-4c87-8c72-f3e285accdff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:19.506194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1820f5fc-d29a-4c87-8c72-f3e285accdff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:19.517433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1820f5fc-d29a-4c87-8c72-f3e285accdff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:19.541502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1820f5fc-d29a-4c87-8c72-f3e285accdff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:19.543212 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d533c147-eb51-47e4-a5df-9eb7bfb4a91c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "POST /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.685200 Oct 12 22:29:19.545721 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2611/5845] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 22:29:18 2022] POST /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/os-volume_attachments => generated 194 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:29:19.563651 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1820f5fc-d29a-4c87-8c72-f3e285accdff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 0.481355 Oct 12 22:29:19.566514 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3235/5846] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:29:19 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:29:20.602580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-53760b19-92da-45f5-a41e-10aba7fc3598 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:20.603230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-53760b19-92da-45f5-a41e-10aba7fc3598 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:20.615547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53760b19-92da-45f5-a41e-10aba7fc3598 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:20.616034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53760b19-92da-45f5-a41e-10aba7fc3598 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:20.618839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53760b19-92da-45f5-a41e-10aba7fc3598 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:20.620414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53760b19-92da-45f5-a41e-10aba7fc3598 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:20.621846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53760b19-92da-45f5-a41e-10aba7fc3598 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:20.623073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53760b19-92da-45f5-a41e-10aba7fc3598 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:20.908366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-53760b19-92da-45f5-a41e-10aba7fc3598 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:20.941336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-53760b19-92da-45f5-a41e-10aba7fc3598 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:20.949187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-53760b19-92da-45f5-a41e-10aba7fc3598 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:20.951934 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-53760b19-92da-45f5-a41e-10aba7fc3598 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 0.355531 Oct 12 22:29:20.952988 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2612/5847] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:29:20 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:29:22.000039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-84dce6f8-d4ba-4f9f-b4b7-b10e5e6afe88 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:22.001526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-84dce6f8-d4ba-4f9f-b4b7-b10e5e6afe88 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:22.032263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84dce6f8-d4ba-4f9f-b4b7-b10e5e6afe88 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:22.040861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84dce6f8-d4ba-4f9f-b4b7-b10e5e6afe88 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:22.042099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84dce6f8-d4ba-4f9f-b4b7-b10e5e6afe88 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:22.043725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84dce6f8-d4ba-4f9f-b4b7-b10e5e6afe88 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:22.044873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84dce6f8-d4ba-4f9f-b4b7-b10e5e6afe88 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:22.046023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84dce6f8-d4ba-4f9f-b4b7-b10e5e6afe88 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:23.051008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-84dce6f8-d4ba-4f9f-b4b7-b10e5e6afe88 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:23.061933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-84dce6f8-d4ba-4f9f-b4b7-b10e5e6afe88 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:23.072899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-84dce6f8-d4ba-4f9f-b4b7-b10e5e6afe88 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:23.092477 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-84dce6f8-d4ba-4f9f-b4b7-b10e5e6afe88 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 1.087381 Oct 12 22:29:23.093154 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3236/5848] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:29:21 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:29:23.452096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-660695f8-19d4-4453-8c77-847c1f7db832 req-95a373ef-58e8-4f5c-9800-bd006a722bee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ecbb62-d209-4784-9a32-1076041ce09a", "name": "network-vif-plugged", "status": "completed", "tag": "57ae856e-81cb-43bf-8768-e10cfb8d0da9"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:29:23.479410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-660695f8-19d4-4453-8c77-847c1f7db832 req-95a373ef-58e8-4f5c-9800-bd006a722bee service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:23.489012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-660695f8-19d4-4453-8c77-847c1f7db832 req-95a373ef-58e8-4f5c-9800-bd006a722bee service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:23.489472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-660695f8-19d4-4453-8c77-847c1f7db832 req-95a373ef-58e8-4f5c-9800-bd006a722bee service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:23.538785 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-660695f8-19d4-4453-8c77-847c1f7db832 req-95a373ef-58e8-4f5c-9800-bd006a722bee service nova] Creating event network-vif-plugged:57ae856e-81cb-43bf-8768-e10cfb8d0da9 for instance 97ecbb62-d209-4784-9a32-1076041ce09a on n-h1-861111-1 Oct 12 22:29:23.570721 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-660695f8-19d4-4453-8c77-847c1f7db832 req-95a373ef-58e8-4f5c-9800-bd006a722bee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121448 Oct 12 22:29:23.573850 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2613/5849] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:29:24.122139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d7774bd7-7837-4ecb-b62d-ed44ffefdeb3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:24.122755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d7774bd7-7837-4ecb-b62d-ed44ffefdeb3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:24.139028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7774bd7-7837-4ecb-b62d-ed44ffefdeb3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:24.139830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7774bd7-7837-4ecb-b62d-ed44ffefdeb3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:24.141285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7774bd7-7837-4ecb-b62d-ed44ffefdeb3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:24.168250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7774bd7-7837-4ecb-b62d-ed44ffefdeb3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:24.177593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7774bd7-7837-4ecb-b62d-ed44ffefdeb3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:24.178400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d7774bd7-7837-4ecb-b62d-ed44ffefdeb3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:24.578881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d7774bd7-7837-4ecb-b62d-ed44ffefdeb3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:24.600540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d7774bd7-7837-4ecb-b62d-ed44ffefdeb3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:24.603254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d7774bd7-7837-4ecb-b62d-ed44ffefdeb3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:24.608752 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d7774bd7-7837-4ecb-b62d-ed44ffefdeb3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 0.490512 Oct 12 22:29:24.610356 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3237/5850] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:29:24 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:29:24.678254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-162367630", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "1ed964bc-f96c-4111-9373-35709419e1e0"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:29:25.013267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] validate_networks() for [('1ed964bc-f96c-4111-9373-35709419e1e0', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:29:25.639152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4043c339-a324-4355-a648-ccbd857094a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:25.639824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4043c339-a324-4355-a648-ccbd857094a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:25.652472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4043c339-a324-4355-a648-ccbd857094a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:25.653167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4043c339-a324-4355-a648-ccbd857094a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:25.653784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4043c339-a324-4355-a648-ccbd857094a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:25.668547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4043c339-a324-4355-a648-ccbd857094a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:25.671074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4043c339-a324-4355-a648-ccbd857094a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:25.671874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4043c339-a324-4355-a648-ccbd857094a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:25.936186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4043c339-a324-4355-a648-ccbd857094a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:25.945335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4043c339-a324-4355-a648-ccbd857094a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:25.946813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4043c339-a324-4355-a648-ccbd857094a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:25.948048 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4043c339-a324-4355-a648-ccbd857094a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 0.312893 Oct 12 22:29:25.952492 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3238/5851] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:29:25 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:29:26.560611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:29:26.561146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:29:26.561498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:29:26.562321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:29:26.562751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:29:26.600309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:26.607729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:26.608539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:26.610678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:26.611746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:26.614724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:26.666566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Getting quotas for project 791436eca03b48958e7a72280c50b252. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:29:26.694067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Getting quotas for user d227a0045d744874b36d2d13ea6eb1a4 and project 791436eca03b48958e7a72280c50b252. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:29:26.737268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:29:26.740985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:29:26.864322 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-57ace25a-a70a-4412-8561-60ef90d9ffc3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.513358 Oct 12 22:29:26.865254 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2614/5852] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:29:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:29:26.877304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-434afc91-718e-49a9-a8c9-6de17c123a76 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:26.877925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-434afc91-718e-49a9-a8c9-6de17c123a76 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:26.973869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-926198c2-7893-450b-abb6-3e3b34d367db tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:26.974580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-926198c2-7893-450b-abb6-3e3b34d367db tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:26.989721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-926198c2-7893-450b-abb6-3e3b34d367db tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:26.990222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-926198c2-7893-450b-abb6-3e3b34d367db tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:26.994546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-926198c2-7893-450b-abb6-3e3b34d367db tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:26.999185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-926198c2-7893-450b-abb6-3e3b34d367db tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:27.000332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-926198c2-7893-450b-abb6-3e3b34d367db tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:27.002899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-926198c2-7893-450b-abb6-3e3b34d367db tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:27.057231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-434afc91-718e-49a9-a8c9-6de17c123a76 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227a0045d744874b36d2d13ea6eb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791436eca03b48958e7a72280c50b252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:27.064723 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-434afc91-718e-49a9-a8c9-6de17c123a76 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] 10.222.0.16 "GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2" status: 200 len: 1213 microversion: 2.1 time: 0.191314 Oct 12 22:29:27.095267 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3239/5853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:26 2022] GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2 => generated 1213 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:28.083078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-926198c2-7893-450b-abb6-3e3b34d367db tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:28.091263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-386e4547-06fb-49e9-b405-88de31b14eeb tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:28.091959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-386e4547-06fb-49e9-b405-88de31b14eeb tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:28.102311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-926198c2-7893-450b-abb6-3e3b34d367db tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:28.106901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-926198c2-7893-450b-abb6-3e3b34d367db tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:28.110210 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-926198c2-7893-450b-abb6-3e3b34d367db tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1809 microversion: 2.20 time: 1.140092 Oct 12 22:29:28.123743 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2615/5854] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:29:26 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1809 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:29:28.175700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-386e4547-06fb-49e9-b405-88de31b14eeb tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:28.176213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-386e4547-06fb-49e9-b405-88de31b14eeb tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:28.176699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-386e4547-06fb-49e9-b405-88de31b14eeb tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:28.188055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-386e4547-06fb-49e9-b405-88de31b14eeb tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:28.188725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-386e4547-06fb-49e9-b405-88de31b14eeb tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:28.189192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-386e4547-06fb-49e9-b405-88de31b14eeb tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:28.639964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-386e4547-06fb-49e9-b405-88de31b14eeb tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227a0045d744874b36d2d13ea6eb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791436eca03b48958e7a72280c50b252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:28.651357 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-386e4547-06fb-49e9-b405-88de31b14eeb tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] 10.222.0.16 "GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2" status: 200 len: 1217 microversion: 2.1 time: 0.564142 Oct 12 22:29:28.672666 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3240/5855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:28 2022] GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2 => generated 1217 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:29.144769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-68263ddf-4d0d-44e0-b005-54cb4523eea3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:29.146362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-68263ddf-4d0d-44e0-b005-54cb4523eea3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:29.161811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68263ddf-4d0d-44e0-b005-54cb4523eea3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:29.165152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68263ddf-4d0d-44e0-b005-54cb4523eea3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:29.166778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68263ddf-4d0d-44e0-b005-54cb4523eea3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:29.172255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68263ddf-4d0d-44e0-b005-54cb4523eea3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:29.172981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68263ddf-4d0d-44e0-b005-54cb4523eea3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:29.173631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68263ddf-4d0d-44e0-b005-54cb4523eea3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:29.694466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bfc07296-ea14-44c5-ae97-805edeadcf2f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:29.695785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bfc07296-ea14-44c5-ae97-805edeadcf2f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:29.708698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfc07296-ea14-44c5-ae97-805edeadcf2f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:29.713802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfc07296-ea14-44c5-ae97-805edeadcf2f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:29.714640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfc07296-ea14-44c5-ae97-805edeadcf2f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:29.715659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfc07296-ea14-44c5-ae97-805edeadcf2f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:29.718645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfc07296-ea14-44c5-ae97-805edeadcf2f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:29.719383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfc07296-ea14-44c5-ae97-805edeadcf2f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:29.903742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bfc07296-ea14-44c5-ae97-805edeadcf2f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227a0045d744874b36d2d13ea6eb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791436eca03b48958e7a72280c50b252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:29.914677 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bfc07296-ea14-44c5-ae97-805edeadcf2f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] 10.222.0.16 "GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2" status: 200 len: 1271 microversion: 2.1 time: 0.222968 Oct 12 22:29:29.918055 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3241/5856] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:29 2022] GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2 => generated 1271 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:29:29.967220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-68263ddf-4d0d-44e0-b005-54cb4523eea3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:29.981257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-68263ddf-4d0d-44e0-b005-54cb4523eea3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:29.985716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-68263ddf-4d0d-44e0-b005-54cb4523eea3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:29.989936 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-68263ddf-4d0d-44e0-b005-54cb4523eea3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1796 microversion: 2.20 time: 0.850750 Oct 12 22:29:30.006124 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2616/5857] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:29:29 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1796 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:29:30.950509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c5c56059-3b16-4085-9b01-3be08d034d70 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:30.952762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c5c56059-3b16-4085-9b01-3be08d034d70 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:30.982829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5c56059-3b16-4085-9b01-3be08d034d70 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:30.983963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5c56059-3b16-4085-9b01-3be08d034d70 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:30.984814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5c56059-3b16-4085-9b01-3be08d034d70 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:30.986340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5c56059-3b16-4085-9b01-3be08d034d70 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:30.987159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5c56059-3b16-4085-9b01-3be08d034d70 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:30.987891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5c56059-3b16-4085-9b01-3be08d034d70 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:31.411585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c5c56059-3b16-4085-9b01-3be08d034d70 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227a0045d744874b36d2d13ea6eb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791436eca03b48958e7a72280c50b252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:31.428364 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c5c56059-3b16-4085-9b01-3be08d034d70 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] 10.222.0.16 "GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2" status: 200 len: 1271 microversion: 2.1 time: 0.485685 Oct 12 22:29:31.444500 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3242/5858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:30 2022] GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2 => generated 1271 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:32.458266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bd24d40d-dd50-4241-b75f-14f9077b7727 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:32.458885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bd24d40d-dd50-4241-b75f-14f9077b7727 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:32.466009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd24d40d-dd50-4241-b75f-14f9077b7727 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:32.466679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd24d40d-dd50-4241-b75f-14f9077b7727 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:32.467477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd24d40d-dd50-4241-b75f-14f9077b7727 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:32.468399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd24d40d-dd50-4241-b75f-14f9077b7727 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:32.468848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd24d40d-dd50-4241-b75f-14f9077b7727 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:32.469299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd24d40d-dd50-4241-b75f-14f9077b7727 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:32.808995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd24d40d-dd50-4241-b75f-14f9077b7727 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227a0045d744874b36d2d13ea6eb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791436eca03b48958e7a72280c50b252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:32.816685 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bd24d40d-dd50-4241-b75f-14f9077b7727 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] 10.222.0.16 "GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2" status: 200 len: 1313 microversion: 2.1 time: 0.362511 Oct 12 22:29:32.817323 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2617/5859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:32 2022] GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:33.259703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-60b88e26-c48a-49bf-af23-ce2101c405f7 req-e0d23fba-b495-4f8c-8a64-f1d4f8b621fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee06af9e-2c33-4c25-8995-89434dc370d2", "tag": "0c9a64d5-d994-4fb5-9a8f-0ea7f1348aa0"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:29:33.280097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-60b88e26-c48a-49bf-af23-ce2101c405f7 req-e0d23fba-b495-4f8c-8a64-f1d4f8b621fd service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:33.282644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-60b88e26-c48a-49bf-af23-ce2101c405f7 req-e0d23fba-b495-4f8c-8a64-f1d4f8b621fd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:33.283172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-60b88e26-c48a-49bf-af23-ce2101c405f7 req-e0d23fba-b495-4f8c-8a64-f1d4f8b621fd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:33.306501 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-60b88e26-c48a-49bf-af23-ce2101c405f7 req-e0d23fba-b495-4f8c-8a64-f1d4f8b621fd service nova] Creating event network-changed:0c9a64d5-d994-4fb5-9a8f-0ea7f1348aa0 for instance ee06af9e-2c33-4c25-8995-89434dc370d2 on n-h1-861111-1 Oct 12 22:29:33.318795 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-60b88e26-c48a-49bf-af23-ce2101c405f7 req-e0d23fba-b495-4f8c-8a64-f1d4f8b621fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062939 Oct 12 22:29:33.324505 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3243/5860] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:29:33.841003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0c150e95-70f8-4f40-a898-a2b158a75d63 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:33.841915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0c150e95-70f8-4f40-a898-a2b158a75d63 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:33.858529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c150e95-70f8-4f40-a898-a2b158a75d63 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:33.860175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c150e95-70f8-4f40-a898-a2b158a75d63 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:33.862420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c150e95-70f8-4f40-a898-a2b158a75d63 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:33.864526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c150e95-70f8-4f40-a898-a2b158a75d63 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:33.870876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c150e95-70f8-4f40-a898-a2b158a75d63 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:33.873987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c150e95-70f8-4f40-a898-a2b158a75d63 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:34.287674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0c150e95-70f8-4f40-a898-a2b158a75d63 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227a0045d744874b36d2d13ea6eb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791436eca03b48958e7a72280c50b252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:34.302190 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0c150e95-70f8-4f40-a898-a2b158a75d63 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] 10.222.0.16 "GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2" status: 200 len: 1313 microversion: 2.1 time: 0.465163 Oct 12 22:29:34.308896 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2618/5861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:33 2022] GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:35.339766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ade715ff-1c3b-462f-ab09-bc33218ad1b8 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:35.341637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ade715ff-1c3b-462f-ab09-bc33218ad1b8 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:35.356279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ade715ff-1c3b-462f-ab09-bc33218ad1b8 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:35.356846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ade715ff-1c3b-462f-ab09-bc33218ad1b8 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:35.358681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ade715ff-1c3b-462f-ab09-bc33218ad1b8 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:35.359475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ade715ff-1c3b-462f-ab09-bc33218ad1b8 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:35.360689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ade715ff-1c3b-462f-ab09-bc33218ad1b8 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:35.361958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ade715ff-1c3b-462f-ab09-bc33218ad1b8 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:35.974157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ade715ff-1c3b-462f-ab09-bc33218ad1b8 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227a0045d744874b36d2d13ea6eb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791436eca03b48958e7a72280c50b252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:35.994188 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ade715ff-1c3b-462f-ab09-bc33218ad1b8 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] 10.222.0.16 "GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2" status: 200 len: 1313 microversion: 2.1 time: 0.658697 Oct 12 22:29:36.006143 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3244/5862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:35 2022] GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2 => generated 1313 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:36.917495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bc0c8ec3-bdf2-4f8d-8714-accfa7c3067f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:29:36.923934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:29:36.925422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:29:36.936872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc0c8ec3-bdf2-4f8d-8714-accfa7c3067f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:36.945916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc0c8ec3-bdf2-4f8d-8714-accfa7c3067f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:36.946707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc0c8ec3-bdf2-4f8d-8714-accfa7c3067f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:36.980574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bc0c8ec3-bdf2-4f8d-8714-accfa7c3067f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Going to try to stop instance {{(pid=120452) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 22:29:37.021501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-226dd0b0-9e3b-46ee-a57d-03fff4588bcd tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:37.024100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-226dd0b0-9e3b-46ee-a57d-03fff4588bcd tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:37.033961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-226dd0b0-9e3b-46ee-a57d-03fff4588bcd tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:37.035144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-226dd0b0-9e3b-46ee-a57d-03fff4588bcd tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:37.035847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-226dd0b0-9e3b-46ee-a57d-03fff4588bcd tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:37.045280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-226dd0b0-9e3b-46ee-a57d-03fff4588bcd tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:37.059831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-226dd0b0-9e3b-46ee-a57d-03fff4588bcd tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:37.063062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-226dd0b0-9e3b-46ee-a57d-03fff4588bcd tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:37.065783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:29:37.081027 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bc0c8ec3-bdf2-4f8d-8714-accfa7c3067f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "POST /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/action" status: 202 len: 0 microversion: 2.1 time: 0.174969 Oct 12 22:29:37.082198 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2619/5863] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:29:36 2022] POST /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:29:37.097865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-14430c61-91c4-4916-bde0-a191131506be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:37.104690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-14430c61-91c4-4916-bde0-a191131506be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:37.118810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14430c61-91c4-4916-bde0-a191131506be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:37.119755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14430c61-91c4-4916-bde0-a191131506be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:37.121323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14430c61-91c4-4916-bde0-a191131506be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:37.127270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14430c61-91c4-4916-bde0-a191131506be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:37.128550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14430c61-91c4-4916-bde0-a191131506be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:37.131575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14430c61-91c4-4916-bde0-a191131506be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:37.652458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-226dd0b0-9e3b-46ee-a57d-03fff4588bcd tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227a0045d744874b36d2d13ea6eb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791436eca03b48958e7a72280c50b252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:37.661848 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-226dd0b0-9e3b-46ee-a57d-03fff4588bcd tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] 10.222.0.16 "GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2" status: 200 len: 1313 microversion: 2.1 time: 0.645714 Oct 12 22:29:37.662448 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3245/5864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:37 2022] GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2 => generated 1313 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:38.623661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-14430c61-91c4-4916-bde0-a191131506be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:38.660017 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-14430c61-91c4-4916-bde0-a191131506be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1722 microversion: 2.1 time: 1.572782 Oct 12 22:29:38.673305 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2620/5865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:37 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1722 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:38.693304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a071ea9f-d725-4279-beaf-e4a1c643def3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:38.694213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a071ea9f-d725-4279-beaf-e4a1c643def3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:38.709828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a071ea9f-d725-4279-beaf-e4a1c643def3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:38.710772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a071ea9f-d725-4279-beaf-e4a1c643def3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:38.711500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a071ea9f-d725-4279-beaf-e4a1c643def3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:38.712623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a071ea9f-d725-4279-beaf-e4a1c643def3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:38.713591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a071ea9f-d725-4279-beaf-e4a1c643def3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:38.714604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a071ea9f-d725-4279-beaf-e4a1c643def3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:39.280422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a071ea9f-d725-4279-beaf-e4a1c643def3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227a0045d744874b36d2d13ea6eb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791436eca03b48958e7a72280c50b252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:39.294541 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a071ea9f-d725-4279-beaf-e4a1c643def3 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] 10.222.0.16 "GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2" status: 200 len: 1313 microversion: 2.1 time: 0.607816 Oct 12 22:29:39.304384 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3246/5866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:38 2022] GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2 => generated 1313 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:39.699045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2c598395-1bd4-4855-839d-5c960c0540d4 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:39.702728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2c598395-1bd4-4855-839d-5c960c0540d4 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:39.713545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c598395-1bd4-4855-839d-5c960c0540d4 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:39.715199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c598395-1bd4-4855-839d-5c960c0540d4 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:39.716576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c598395-1bd4-4855-839d-5c960c0540d4 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:39.717574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c598395-1bd4-4855-839d-5c960c0540d4 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:39.720794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c598395-1bd4-4855-839d-5c960c0540d4 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:39.721508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c598395-1bd4-4855-839d-5c960c0540d4 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:39.823320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-4c2d5efb-d509-48a9-9e43-e16da708a0bc req-352b294f-c2c5-4e08-9c0d-581769101293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee06af9e-2c33-4c25-8995-89434dc370d2", "name": "network-vif-plugged", "status": "completed", "tag": "0c9a64d5-d994-4fb5-9a8f-0ea7f1348aa0"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:29:39.853920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4c2d5efb-d509-48a9-9e43-e16da708a0bc req-352b294f-c2c5-4e08-9c0d-581769101293 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:39.854725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4c2d5efb-d509-48a9-9e43-e16da708a0bc req-352b294f-c2c5-4e08-9c0d-581769101293 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:39.856106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4c2d5efb-d509-48a9-9e43-e16da708a0bc req-352b294f-c2c5-4e08-9c0d-581769101293 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:39.886225 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-4c2d5efb-d509-48a9-9e43-e16da708a0bc req-352b294f-c2c5-4e08-9c0d-581769101293 service nova] Creating event network-vif-plugged:0c9a64d5-d994-4fb5-9a8f-0ea7f1348aa0 for instance ee06af9e-2c33-4c25-8995-89434dc370d2 on n-h1-861111-1 Oct 12 22:29:39.902058 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-4c2d5efb-d509-48a9-9e43-e16da708a0bc req-352b294f-c2c5-4e08-9c0d-581769101293 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082650 Oct 12 22:29:39.903186 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3247/5867] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:29:40.071504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2c598395-1bd4-4855-839d-5c960c0540d4 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:40.084649 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2c598395-1bd4-4855-839d-5c960c0540d4 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1722 microversion: 2.1 time: 0.390046 Oct 12 22:29:40.086754 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2621/5868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:39 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1722 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:40.329761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9c724521-1a42-479c-877d-3a03ff40f11f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:40.330474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9c724521-1a42-479c-877d-3a03ff40f11f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:40.347549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c724521-1a42-479c-877d-3a03ff40f11f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:40.348050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c724521-1a42-479c-877d-3a03ff40f11f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:40.348493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c724521-1a42-479c-877d-3a03ff40f11f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:40.349209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c724521-1a42-479c-877d-3a03ff40f11f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:40.349673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c724521-1a42-479c-877d-3a03ff40f11f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:40.350102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9c724521-1a42-479c-877d-3a03ff40f11f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:40.959732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9c724521-1a42-479c-877d-3a03ff40f11f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227a0045d744874b36d2d13ea6eb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791436eca03b48958e7a72280c50b252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:40.977163 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9c724521-1a42-479c-877d-3a03ff40f11f tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] 10.222.0.16 "GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2" status: 200 len: 1313 microversion: 2.1 time: 0.651775 Oct 12 22:29:40.991720 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3248/5869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:40 2022] GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2 => generated 1313 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:41.113782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0a32c471-0262-45ed-82e1-97ea497a82be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:41.114463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0a32c471-0262-45ed-82e1-97ea497a82be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:41.125724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a32c471-0262-45ed-82e1-97ea497a82be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:41.127719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a32c471-0262-45ed-82e1-97ea497a82be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:41.128388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a32c471-0262-45ed-82e1-97ea497a82be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:41.130084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a32c471-0262-45ed-82e1-97ea497a82be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:41.131853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a32c471-0262-45ed-82e1-97ea497a82be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:41.132478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a32c471-0262-45ed-82e1-97ea497a82be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:41.586117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0a32c471-0262-45ed-82e1-97ea497a82be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:41.601221 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0a32c471-0262-45ed-82e1-97ea497a82be tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1722 microversion: 2.1 time: 0.490897 Oct 12 22:29:41.603956 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2622/5870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:41 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1722 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:42.005219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-825a3e33-a16b-4fab-a5c7-ab930d807bb5 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:42.007632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-825a3e33-a16b-4fab-a5c7-ab930d807bb5 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:42.020334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-825a3e33-a16b-4fab-a5c7-ab930d807bb5 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:42.024096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-825a3e33-a16b-4fab-a5c7-ab930d807bb5 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:42.025401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-825a3e33-a16b-4fab-a5c7-ab930d807bb5 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:42.028370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-825a3e33-a16b-4fab-a5c7-ab930d807bb5 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:42.029076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-825a3e33-a16b-4fab-a5c7-ab930d807bb5 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:42.029765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-825a3e33-a16b-4fab-a5c7-ab930d807bb5 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:42.514813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-825a3e33-a16b-4fab-a5c7-ab930d807bb5 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227a0045d744874b36d2d13ea6eb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791436eca03b48958e7a72280c50b252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:42.523247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=92 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:29:42.528398 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-825a3e33-a16b-4fab-a5c7-ab930d807bb5 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] 10.222.0.16 "GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2" status: 200 len: 1497 microversion: 2.1 time: 0.527555 Oct 12 22:29:42.530119 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3249/5871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:41 2022] GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2 => generated 1497 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:42.629465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-00edec37-f8b1-4562-995f-07762abed57c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:42.630094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-00edec37-f8b1-4562-995f-07762abed57c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:42.640764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00edec37-f8b1-4562-995f-07762abed57c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:42.641265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00edec37-f8b1-4562-995f-07762abed57c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:42.641714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00edec37-f8b1-4562-995f-07762abed57c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:42.642431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00edec37-f8b1-4562-995f-07762abed57c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:42.649021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00edec37-f8b1-4562-995f-07762abed57c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:42.657468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00edec37-f8b1-4562-995f-07762abed57c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:42.988326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-00edec37-f8b1-4562-995f-07762abed57c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:43.003047 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-00edec37-f8b1-4562-995f-07762abed57c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1722 microversion: 2.1 time: 0.377587 Oct 12 22:29:43.005101 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2623/5872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:42 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1722 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:44.026742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a59651cd-b63d-4af2-b32d-d92706fd28a7 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:44.038331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a59651cd-b63d-4af2-b32d-d92706fd28a7 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:44.070862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=42 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:29:44.080117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a59651cd-b63d-4af2-b32d-d92706fd28a7 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:44.080542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a59651cd-b63d-4af2-b32d-d92706fd28a7 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:44.080991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a59651cd-b63d-4af2-b32d-d92706fd28a7 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:44.081720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a59651cd-b63d-4af2-b32d-d92706fd28a7 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:44.082181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a59651cd-b63d-4af2-b32d-d92706fd28a7 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:44.082615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a59651cd-b63d-4af2-b32d-d92706fd28a7 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:44.677531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a59651cd-b63d-4af2-b32d-d92706fd28a7 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:44.698433 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a59651cd-b63d-4af2-b32d-d92706fd28a7 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1722 microversion: 2.1 time: 0.676107 Oct 12 22:29:44.713395 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3250/5873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:44 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1722 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:45.734832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-89155bc0-cf5c-4c61-b374-877354b7e62f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:45.738498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-89155bc0-cf5c-4c61-b374-877354b7e62f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:45.765146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:29:45.772005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89155bc0-cf5c-4c61-b374-877354b7e62f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:45.778937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89155bc0-cf5c-4c61-b374-877354b7e62f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:45.781333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89155bc0-cf5c-4c61-b374-877354b7e62f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:45.784020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89155bc0-cf5c-4c61-b374-877354b7e62f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:45.789507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89155bc0-cf5c-4c61-b374-877354b7e62f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:45.796770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89155bc0-cf5c-4c61-b374-877354b7e62f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:45.818332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:29:46.375611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-89155bc0-cf5c-4c61-b374-877354b7e62f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:46.399113 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-89155bc0-cf5c-4c61-b374-877354b7e62f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1722 microversion: 2.1 time: 0.677161 Oct 12 22:29:46.435563 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2624/5874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:45 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1722 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:47.434267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ddc66aab-ea81-40f9-8373-3ed0a725f64d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:47.435558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ddc66aab-ea81-40f9-8373-3ed0a725f64d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:47.458306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddc66aab-ea81-40f9-8373-3ed0a725f64d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:47.459231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddc66aab-ea81-40f9-8373-3ed0a725f64d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:47.460592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddc66aab-ea81-40f9-8373-3ed0a725f64d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:47.464616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddc66aab-ea81-40f9-8373-3ed0a725f64d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:47.465321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddc66aab-ea81-40f9-8373-3ed0a725f64d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:47.467559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddc66aab-ea81-40f9-8373-3ed0a725f64d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:47.516162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-18d6a344-dc13-4a2e-9ca1-7424e5847e57 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:47.516790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-18d6a344-dc13-4a2e-9ca1-7424e5847e57 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:47.535698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18d6a344-dc13-4a2e-9ca1-7424e5847e57 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:47.536320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18d6a344-dc13-4a2e-9ca1-7424e5847e57 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:47.540478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18d6a344-dc13-4a2e-9ca1-7424e5847e57 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:47.541591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18d6a344-dc13-4a2e-9ca1-7424e5847e57 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:47.545181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18d6a344-dc13-4a2e-9ca1-7424e5847e57 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:47.546095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18d6a344-dc13-4a2e-9ca1-7424e5847e57 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:47.612404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-18d6a344-dc13-4a2e-9ca1-7424e5847e57 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:29:47.777810 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-18d6a344-dc13-4a2e-9ca1-7424e5847e57 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2" status: 204 len: 0 microversion: 2.1 time: 0.267381 Oct 12 22:29:47.779434 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2625/5875] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:29:47 2022] DELETE /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:29:47.785457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9ccab287-ccca-417a-81e5-4bbbcd600968 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Action: 'create', calling method: .version_select at 0x7f51230ff790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-577487778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItuGTRr0crd2oT8hVR6XKzy2QgZYsub+PWKoBrK0Lr7dHye79lrHKc0CwDpBh7sCRoBJEUG9TozhH77DvecXSh3aLVokjmoDttjNuPKE6u/iqS5H2LkO58yHN1lyJovEw=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:29:47.824354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-9ccab287-ccca-417a-81e5-4bbbcd600968 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Getting quotas for project 08d857098e294c8da4f73d273912cdf3. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:29:47.841535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-9ccab287-ccca-417a-81e5-4bbbcd600968 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Getting quotas for user a672bb095f984fb7b23d1acd55902865 and project 08d857098e294c8da4f73d273912cdf3. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:29:47.917817 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9ccab287-ccca-417a-81e5-4bbbcd600968 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.137757 Oct 12 22:29:47.919000 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2626/5876] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:29:47 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:29:47.925115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e40094ca-d2cb-4655-bc22-a90a31dd4419 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:47.928855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e40094ca-d2cb-4655-bc22-a90a31dd4419 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:47.942092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e40094ca-d2cb-4655-bc22-a90a31dd4419 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:47.944380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e40094ca-d2cb-4655-bc22-a90a31dd4419 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:47.945023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e40094ca-d2cb-4655-bc22-a90a31dd4419 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:47.947591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e40094ca-d2cb-4655-bc22-a90a31dd4419 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:47.950148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e40094ca-d2cb-4655-bc22-a90a31dd4419 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:47.950771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e40094ca-d2cb-4655-bc22-a90a31dd4419 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:48.219357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e40094ca-d2cb-4655-bc22-a90a31dd4419 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227a0045d744874b36d2d13ea6eb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791436eca03b48958e7a72280c50b252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:48.228728 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e40094ca-d2cb-4655-bc22-a90a31dd4419 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] 10.222.0.16 "GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2" status: 200 len: 1503 microversion: 2.1 time: 0.308439 Oct 12 22:29:48.229320 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2627/5877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:47 2022] GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2 => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:48.250702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ddc66aab-ea81-40f9-8373-3ed0a725f64d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:48.261444 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ddc66aab-ea81-40f9-8373-3ed0a725f64d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1722 microversion: 2.1 time: 0.833233 Oct 12 22:29:48.277501 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3251/5878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:47 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1722 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:49.258231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9364e323-7a2f-4c43-8755-727c27f195a9 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:49.260158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9364e323-7a2f-4c43-8755-727c27f195a9 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:49.273631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9364e323-7a2f-4c43-8755-727c27f195a9 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:49.273631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9364e323-7a2f-4c43-8755-727c27f195a9 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:49.273951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9364e323-7a2f-4c43-8755-727c27f195a9 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:49.277723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9364e323-7a2f-4c43-8755-727c27f195a9 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:49.278212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9364e323-7a2f-4c43-8755-727c27f195a9 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:49.278646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9364e323-7a2f-4c43-8755-727c27f195a9 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:49.288679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4819a3fe-190c-4e66-8612-518e7617b866 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:49.289853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4819a3fe-190c-4e66-8612-518e7617b866 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:49.307941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4819a3fe-190c-4e66-8612-518e7617b866 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:49.310315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4819a3fe-190c-4e66-8612-518e7617b866 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:49.311786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4819a3fe-190c-4e66-8612-518e7617b866 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:49.317357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4819a3fe-190c-4e66-8612-518e7617b866 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:49.318110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4819a3fe-190c-4e66-8612-518e7617b866 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:49.318735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4819a3fe-190c-4e66-8612-518e7617b866 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:50.071867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4819a3fe-190c-4e66-8612-518e7617b866 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:50.142581 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4819a3fe-190c-4e66-8612-518e7617b866 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1722 microversion: 2.1 time: 0.854253 Oct 12 22:29:50.144543 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3252/5879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:49 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1722 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:29:50.372783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9364e323-7a2f-4c43-8755-727c27f195a9 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227a0045d744874b36d2d13ea6eb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791436eca03b48958e7a72280c50b252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:50.389667 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9364e323-7a2f-4c43-8755-727c27f195a9 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] 10.222.0.16 "GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2" status: 200 len: 1503 microversion: 2.1 time: 1.135753 Oct 12 22:29:50.390382 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2628/5880] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:49 2022] GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2 => generated 1503 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:51.174257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c1e87a96-db96-4f85-a7ee-9880dae5ef07 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:51.176391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c1e87a96-db96-4f85-a7ee-9880dae5ef07 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:51.191468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1e87a96-db96-4f85-a7ee-9880dae5ef07 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:51.191981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1e87a96-db96-4f85-a7ee-9880dae5ef07 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:51.192506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1e87a96-db96-4f85-a7ee-9880dae5ef07 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:51.197885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1e87a96-db96-4f85-a7ee-9880dae5ef07 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:51.199510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1e87a96-db96-4f85-a7ee-9880dae5ef07 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:51.199946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1e87a96-db96-4f85-a7ee-9880dae5ef07 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:51.417061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-12093e51-e4b6-48a6-a76d-bd3eec3224ae tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:51.417675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-12093e51-e4b6-48a6-a76d-bd3eec3224ae tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:51.433898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12093e51-e4b6-48a6-a76d-bd3eec3224ae tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:51.434646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12093e51-e4b6-48a6-a76d-bd3eec3224ae tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:51.435277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12093e51-e4b6-48a6-a76d-bd3eec3224ae tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:51.435998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12093e51-e4b6-48a6-a76d-bd3eec3224ae tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:51.436456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12093e51-e4b6-48a6-a76d-bd3eec3224ae tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:51.436963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-12093e51-e4b6-48a6-a76d-bd3eec3224ae tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:51.571132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c1e87a96-db96-4f85-a7ee-9880dae5ef07 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:51.579791 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c1e87a96-db96-4f85-a7ee-9880dae5ef07 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1722 microversion: 2.1 time: 0.415190 Oct 12 22:29:51.583738 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3253/5881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:51 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1722 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:51.694396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-12093e51-e4b6-48a6-a76d-bd3eec3224ae tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227a0045d744874b36d2d13ea6eb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791436eca03b48958e7a72280c50b252', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:51.732519 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-12093e51-e4b6-48a6-a76d-bd3eec3224ae tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] 10.222.0.16 "GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2" status: 200 len: 1461 microversion: 2.1 time: 0.308349 Oct 12 22:29:51.733284 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2629/5882] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:51 2022] GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2 => generated 1461 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:29:51.791192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-40867114-3cc2-445c-89b1-affe9d391cdf req-d995d6ea-f7ef-4df4-8f84-7dbca3e782e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee06af9e-2c33-4c25-8995-89434dc370d2", "name": "network-vif-deleted", "tag": "0c9a64d5-d994-4fb5-9a8f-0ea7f1348aa0"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:29:51.816359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-40867114-3cc2-445c-89b1-affe9d391cdf req-d995d6ea-f7ef-4df4-8f84-7dbca3e782e0 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:51.817043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-40867114-3cc2-445c-89b1-affe9d391cdf req-d995d6ea-f7ef-4df4-8f84-7dbca3e782e0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:51.817486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-40867114-3cc2-445c-89b1-affe9d391cdf req-d995d6ea-f7ef-4df4-8f84-7dbca3e782e0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:51.848801 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-40867114-3cc2-445c-89b1-affe9d391cdf req-d995d6ea-f7ef-4df4-8f84-7dbca3e782e0 service nova] Creating event network-vif-deleted:0c9a64d5-d994-4fb5-9a8f-0ea7f1348aa0 for instance ee06af9e-2c33-4c25-8995-89434dc370d2 on n-h1-861111-1 Oct 12 22:29:51.864412 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-40867114-3cc2-445c-89b1-affe9d391cdf req-d995d6ea-f7ef-4df4-8f84-7dbca3e782e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086191 Oct 12 22:29:51.865954 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3254/5883] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:29:52.436802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1769551483", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "13c5e62b-004d-4bf1-aa82-9d3788323476"}], "key_name": "tempest-TestNetworkBasicOps-577487778", "security_groups": [{"name": "tempest-secgroup-smoke-1615017967"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:29:52.611087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-850b3b04-558a-42ad-8682-d12e2ac4bec0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:52.611926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-850b3b04-558a-42ad-8682-d12e2ac4bec0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:52.630157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-850b3b04-558a-42ad-8682-d12e2ac4bec0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:52.637075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-850b3b04-558a-42ad-8682-d12e2ac4bec0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:52.637608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-850b3b04-558a-42ad-8682-d12e2ac4bec0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:52.638381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-850b3b04-558a-42ad-8682-d12e2ac4bec0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:52.638854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-850b3b04-558a-42ad-8682-d12e2ac4bec0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:52.639426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-850b3b04-558a-42ad-8682-d12e2ac4bec0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:52.859850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] validate_networks() for [('13c5e62b-004d-4bf1-aa82-9d3788323476', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:29:52.979958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-850b3b04-558a-42ad-8682-d12e2ac4bec0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:52.994899 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-850b3b04-558a-42ad-8682-d12e2ac4bec0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1699 microversion: 2.1 time: 0.393543 Oct 12 22:29:53.000510 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3255/5884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:52 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1699 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:29:53.005989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-50391025-8f17-46f9-bd58-effe26d66877 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:53.006636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-50391025-8f17-46f9-bd58-effe26d66877 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] [instance: ee06af9e-2c33-4c25-8995-89434dc370d2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:53.025776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50391025-8f17-46f9-bd58-effe26d66877 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:53.026286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50391025-8f17-46f9-bd58-effe26d66877 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:53.026723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50391025-8f17-46f9-bd58-effe26d66877 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:53.027470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50391025-8f17-46f9-bd58-effe26d66877 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:53.027932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50391025-8f17-46f9-bd58-effe26d66877 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:53.028525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50391025-8f17-46f9-bd58-effe26d66877 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:53.059945 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-50391025-8f17-46f9-bd58-effe26d66877 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] HTTP exception thrown: Instance ee06af9e-2c33-4c25-8995-89434dc370d2 could not be found. Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-50391025-8f17-46f9-bd58-effe26d66877 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Request method failure captured: Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2 HTTP/1.1 Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz-_EyRhtta00K1de-iCQgeKKm7sNkhpNF5NOPeYMXR2eg7vdsUhcqag2M2X5_XYyir0k9AhmfdPH3rUGrapojDFIutdzFG22V_MOYedtTjNiCT0rCMEZ8a9W-7nro9BrEZ40Ch-qPvwjFQXOKxTNPEEsMvEIPGqJsbR6_FMsXT91DI Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 791436eca03b48958e7a72280c50b252 Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-VolumesActionsTest-552289278 Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/791436eca03b48958e7a72280c50b252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/791436eca03b48958e7a72280c50b252"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_791436eca03b48958e7a72280c50b252", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/791436eca03b48958e7a72280c50b252"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-VolumesActionsTest-552289278 Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 791436eca03b48958e7a72280c50b252 Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-VolumesActionsTest-552289278 Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-VolumesActionsTest-552289278-project Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: d227a0045d744874b36d2d13ea6eb1a4 Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-VolumesActionsTest-552289278-project Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance ee06af9e-2c33-4c25-8995-89434dc370d2 could not be found. Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'ee06af9e-2c33-4c25-8995-89434dc370d2'} Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee06af9e-2c33-4c25-8995-89434dc370d2 could not be found. Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee06af9e-2c33-4c25-8995-89434dc370d2 could not be found. Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:29:53.071376 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:29:53.083814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:29:53.083814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:29:53.083814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:29:53.083814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:29:53.083814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:29:53.083814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee06af9e-2c33-4c25-8995-89434dc370d2 could not be found. Oct 12 22:29:53.083814 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:29:53.083814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-50391025-8f17-46f9-bd58-effe26d66877 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] Returning 404 to user: Instance ee06af9e-2c33-4c25-8995-89434dc370d2 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:29:53.083814 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-50391025-8f17-46f9-bd58-effe26d66877 tempest-VolumesActionsTest-552289278 tempest-VolumesActionsTest-552289278-project] 10.222.0.16 "GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2" status: 404 len: 111 microversion: 2.1 time: 0.071583 Oct 12 22:29:53.083814 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3256/5885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:53 2022] GET /compute/v2.1/servers/ee06af9e-2c33-4c25-8995-89434dc370d2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:29:53.091652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-20112631-3c0c-4742-b316-62a6f8885d36 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:29:53.112139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20112631-3c0c-4742-b316-62a6f8885d36 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:53.112791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20112631-3c0c-4742-b316-62a6f8885d36 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:53.113237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20112631-3c0c-4742-b316-62a6f8885d36 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:53.167776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-20112631-3c0c-4742-b316-62a6f8885d36 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Going to try to start instance {{(pid=120453) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 22:29:53.264506 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-20112631-3c0c-4742-b316-62a6f8885d36 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "POST /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/action" status: 202 len: 0 microversion: 2.1 time: 0.189604 Oct 12 22:29:53.268138 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3257/5886] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:29:53 2022] POST /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:29:53.293583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af2ad720-b66f-46e6-86be-4491791d9b03 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:53.295386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-af2ad720-b66f-46e6-86be-4491791d9b03 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:53.315191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af2ad720-b66f-46e6-86be-4491791d9b03 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:53.316144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af2ad720-b66f-46e6-86be-4491791d9b03 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:53.317014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af2ad720-b66f-46e6-86be-4491791d9b03 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:53.320249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af2ad720-b66f-46e6-86be-4491791d9b03 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:53.322020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af2ad720-b66f-46e6-86be-4491791d9b03 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:53.322774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af2ad720-b66f-46e6-86be-4491791d9b03 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:53.664260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-af2ad720-b66f-46e6-86be-4491791d9b03 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:53.679547 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-af2ad720-b66f-46e6-86be-4491791d9b03 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1708 microversion: 2.1 time: 0.401619 Oct 12 22:29:53.681698 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3258/5887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:53 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1708 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:54.592466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:29:54.593044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:29:54.593346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:29:54.600559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:29:54.601988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:29:54.623399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:54.624223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:54.624925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:54.625889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:54.626537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:54.627640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:54.670921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Getting quotas for project 08d857098e294c8da4f73d273912cdf3. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:29:54.676906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Getting quotas for user a672bb095f984fb7b23d1acd55902865 and project 08d857098e294c8da4f73d273912cdf3. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:29:54.707162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:29:54.709298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c9d182d8-cb08-447a-8283-03f8127127a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:54.709917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c9d182d8-cb08-447a-8283-03f8127127a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:54.710482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:29:54.719875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9d182d8-cb08-447a-8283-03f8127127a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:54.720364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9d182d8-cb08-447a-8283-03f8127127a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:54.720802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9d182d8-cb08-447a-8283-03f8127127a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:54.725631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9d182d8-cb08-447a-8283-03f8127127a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:54.726216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9d182d8-cb08-447a-8283-03f8127127a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:54.726669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c9d182d8-cb08-447a-8283-03f8127127a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:54.811066 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-65862a2d-1717-43a2-800c-d0d07ec23883 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.378840 Oct 12 22:29:54.816371 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2630/5888] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:29:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 2385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:29:54.839724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-159f31f1-e8b6-4900-8d00-5a1819d9c4f7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:54.840429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-159f31f1-e8b6-4900-8d00-5a1819d9c4f7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:55.095632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c9d182d8-cb08-447a-8283-03f8127127a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:55.108990 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c9d182d8-cb08-447a-8283-03f8127127a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1708 microversion: 2.1 time: 0.403834 Oct 12 22:29:55.110337 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3259/5889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:54 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1708 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:29:55.322152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-159f31f1-e8b6-4900-8d00-5a1819d9c4f7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:55.331727 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-159f31f1-e8b6-4900-8d00-5a1819d9c4f7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1248 microversion: 2.1 time: 0.500178 Oct 12 22:29:55.332255 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2631/5890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:54 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1248 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:29:56.137881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-61d401b9-4c98-4dfe-a2fe-39ae0e8d4f2b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:56.138442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-61d401b9-4c98-4dfe-a2fe-39ae0e8d4f2b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:56.152886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61d401b9-4c98-4dfe-a2fe-39ae0e8d4f2b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:56.153381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61d401b9-4c98-4dfe-a2fe-39ae0e8d4f2b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:56.153823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61d401b9-4c98-4dfe-a2fe-39ae0e8d4f2b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:56.154556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61d401b9-4c98-4dfe-a2fe-39ae0e8d4f2b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:56.154992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61d401b9-4c98-4dfe-a2fe-39ae0e8d4f2b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:56.168020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61d401b9-4c98-4dfe-a2fe-39ae0e8d4f2b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:56.360891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1666477-1883-4c14-8b85-73f8783fe613 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:56.361654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a1666477-1883-4c14-8b85-73f8783fe613 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:56.389632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1666477-1883-4c14-8b85-73f8783fe613 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:56.391652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1666477-1883-4c14-8b85-73f8783fe613 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:56.392409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1666477-1883-4c14-8b85-73f8783fe613 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:56.393356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1666477-1883-4c14-8b85-73f8783fe613 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:56.394092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1666477-1883-4c14-8b85-73f8783fe613 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:56.394571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1666477-1883-4c14-8b85-73f8783fe613 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:56.563076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-61d401b9-4c98-4dfe-a2fe-39ae0e8d4f2b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:56.578071 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-61d401b9-4c98-4dfe-a2fe-39ae0e8d4f2b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1712 microversion: 2.1 time: 0.444052 Oct 12 22:29:56.579604 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3260/5891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:56 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1712 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:56.690676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a1666477-1883-4c14-8b85-73f8783fe613 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:56.701426 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a1666477-1883-4c14-8b85-73f8783fe613 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1300 microversion: 2.1 time: 0.349998 Oct 12 22:29:56.711549 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2632/5892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:56 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1300 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:57.729492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ea0fbeb5-1078-43fa-8ea1-6b157a39026e tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:57.730107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ea0fbeb5-1078-43fa-8ea1-6b157a39026e tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:57.740811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea0fbeb5-1078-43fa-8ea1-6b157a39026e tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:57.748109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea0fbeb5-1078-43fa-8ea1-6b157a39026e tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:57.748829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea0fbeb5-1078-43fa-8ea1-6b157a39026e tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:57.752127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea0fbeb5-1078-43fa-8ea1-6b157a39026e tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:57.752763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea0fbeb5-1078-43fa-8ea1-6b157a39026e tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:57.753456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea0fbeb5-1078-43fa-8ea1-6b157a39026e tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:57.966192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ea0fbeb5-1078-43fa-8ea1-6b157a39026e tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:57.976906 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ea0fbeb5-1078-43fa-8ea1-6b157a39026e tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1306 microversion: 2.1 time: 0.251162 Oct 12 22:29:57.982196 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3261/5893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:57 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1306 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:29:59.023588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c31cb0b8-c23b-4399-886a-9cc3460fdbb4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:29:59.025357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c31cb0b8-c23b-4399-886a-9cc3460fdbb4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:29:59.053792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c31cb0b8-c23b-4399-886a-9cc3460fdbb4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:59.066163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c31cb0b8-c23b-4399-886a-9cc3460fdbb4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:59.066826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c31cb0b8-c23b-4399-886a-9cc3460fdbb4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:59.069744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c31cb0b8-c23b-4399-886a-9cc3460fdbb4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:59.071109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c31cb0b8-c23b-4399-886a-9cc3460fdbb4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:59.073482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c31cb0b8-c23b-4399-886a-9cc3460fdbb4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:59.932027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c31cb0b8-c23b-4399-886a-9cc3460fdbb4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:29:59.941138 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c31cb0b8-c23b-4399-886a-9cc3460fdbb4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1374 microversion: 2.1 time: 0.935019 Oct 12 22:29:59.947080 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2633/5894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:29:59 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1374 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:00.781136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b9613f23-e495-458f-bf56-1d0e823749fd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:00.782315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b9613f23-e495-458f-bf56-1d0e823749fd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:00.798390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9613f23-e495-458f-bf56-1d0e823749fd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:00.800432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9613f23-e495-458f-bf56-1d0e823749fd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:00.801173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9613f23-e495-458f-bf56-1d0e823749fd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:00.804859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9613f23-e495-458f-bf56-1d0e823749fd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:00.805622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9613f23-e495-458f-bf56-1d0e823749fd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:00.806284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9613f23-e495-458f-bf56-1d0e823749fd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:00.879732 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b9613f23-e495-458f-bf56-1d0e823749fd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments/adad4cad-d3a9-41aa-bc50-c9f53168d0bb" status: 200 len: 194 microversion: 2.20 time: 0.115332 Oct 12 22:30:00.891876 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3262/5895] 10.222.0.16 () {60 vars in 1454 bytes} [Wed Oct 12 22:30:00 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments/adad4cad-d3a9-41aa-bc50-c9f53168d0bb => generated 194 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:30:00.990050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-902ea553-1e3b-478f-a918-e5bb2993c91f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:00.991443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-902ea553-1e3b-478f-a918-e5bb2993c91f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:01.000590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b51971da-df93-4cc9-8617-c01189e0e4f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:01.000720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b51971da-df93-4cc9-8617-c01189e0e4f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:01.011764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b51971da-df93-4cc9-8617-c01189e0e4f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:01.013632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b51971da-df93-4cc9-8617-c01189e0e4f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:01.020740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-902ea553-1e3b-478f-a918-e5bb2993c91f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:01.022116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-902ea553-1e3b-478f-a918-e5bb2993c91f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:01.022955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b51971da-df93-4cc9-8617-c01189e0e4f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:01.024020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b51971da-df93-4cc9-8617-c01189e0e4f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:01.024513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b51971da-df93-4cc9-8617-c01189e0e4f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:01.025248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b51971da-df93-4cc9-8617-c01189e0e4f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:01.034138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-902ea553-1e3b-478f-a918-e5bb2993c91f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:01.035176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-902ea553-1e3b-478f-a918-e5bb2993c91f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:01.036200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-902ea553-1e3b-478f-a918-e5bb2993c91f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:01.036794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-902ea553-1e3b-478f-a918-e5bb2993c91f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:01.266880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-b51971da-df93-4cc9-8617-c01189e0e4f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lazy-loading 'services' on Instance uuid 97ecbb62-d209-4784-9a32-1076041ce09a {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:30:01.565893 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b51971da-df93-4cc9-8617-c01189e0e4f0 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "DELETE /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments/adad4cad-d3a9-41aa-bc50-c9f53168d0bb" status: 202 len: 0 microversion: 2.20 time: 0.570220 Oct 12 22:30:01.570397 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3263/5896] 10.222.0.16 () {60 vars in 1457 bytes} [Wed Oct 12 22:30:00 2022] DELETE /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments/adad4cad-d3a9-41aa-bc50-c9f53168d0bb => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:30:01.597201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7f4e2ee7-3ca1-4c5c-9925-74f7f190a05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:01.606019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7f4e2ee7-3ca1-4c5c-9925-74f7f190a05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:01.622022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f4e2ee7-3ca1-4c5c-9925-74f7f190a05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:01.622022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f4e2ee7-3ca1-4c5c-9925-74f7f190a05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:01.622022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f4e2ee7-3ca1-4c5c-9925-74f7f190a05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:01.632230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f4e2ee7-3ca1-4c5c-9925-74f7f190a05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:01.636390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f4e2ee7-3ca1-4c5c-9925-74f7f190a05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:01.637475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f4e2ee7-3ca1-4c5c-9925-74f7f190a05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:01.762249 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7f4e2ee7-3ca1-4c5c-9925-74f7f190a05c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.184152 Oct 12 22:30:01.776430 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3264/5897] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:30:01 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:30:01.951461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-902ea553-1e3b-478f-a918-e5bb2993c91f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:01.968829 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-902ea553-1e3b-478f-a918-e5bb2993c91f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1374 microversion: 2.1 time: 0.976307 Oct 12 22:30:01.971183 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2634/5898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:00 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1374 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:02.778989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-079568e3-34a4-40c3-99fe-333e71dc8d20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:02.782879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-079568e3-34a4-40c3-99fe-333e71dc8d20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:02.809009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-079568e3-34a4-40c3-99fe-333e71dc8d20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:02.809519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-079568e3-34a4-40c3-99fe-333e71dc8d20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:02.809965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-079568e3-34a4-40c3-99fe-333e71dc8d20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:02.816493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-079568e3-34a4-40c3-99fe-333e71dc8d20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:02.818897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-079568e3-34a4-40c3-99fe-333e71dc8d20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:02.821717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-079568e3-34a4-40c3-99fe-333e71dc8d20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:02.949358 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-079568e3-34a4-40c3-99fe-333e71dc8d20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.174359 Oct 12 22:30:02.957456 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3265/5899] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:30:02 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:30:02.992870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6dbff260-78b8-48b6-91a8-7cdfaab71586 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:02.993629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-f9781e23-92bc-48b1-91f6-ac944d8fe40e req-a0fd9c52-5c03-4f87-a216-de99e4e9c4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c973408a-2071-4e50-aa87-b08294479f15", "tag": "b8e5ca77-39e1-4915-9db4-a7c9dd58fa57"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:03.000398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6dbff260-78b8-48b6-91a8-7cdfaab71586 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:03.009211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dbff260-78b8-48b6-91a8-7cdfaab71586 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:03.015167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dbff260-78b8-48b6-91a8-7cdfaab71586 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:03.022010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dbff260-78b8-48b6-91a8-7cdfaab71586 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:03.027438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dbff260-78b8-48b6-91a8-7cdfaab71586 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:03.028882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dbff260-78b8-48b6-91a8-7cdfaab71586 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:03.032434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6dbff260-78b8-48b6-91a8-7cdfaab71586 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:03.041975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f9781e23-92bc-48b1-91f6-ac944d8fe40e req-a0fd9c52-5c03-4f87-a216-de99e4e9c4c8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:03.046386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f9781e23-92bc-48b1-91f6-ac944d8fe40e req-a0fd9c52-5c03-4f87-a216-de99e4e9c4c8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:03.047429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f9781e23-92bc-48b1-91f6-ac944d8fe40e req-a0fd9c52-5c03-4f87-a216-de99e4e9c4c8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:03.049672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:03.108994 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-f9781e23-92bc-48b1-91f6-ac944d8fe40e req-a0fd9c52-5c03-4f87-a216-de99e4e9c4c8 service nova] Creating event network-changed:b8e5ca77-39e1-4915-9db4-a7c9dd58fa57 for instance c973408a-2071-4e50-aa87-b08294479f15 on n-h2-861111-1 Oct 12 22:30:03.124080 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-f9781e23-92bc-48b1-91f6-ac944d8fe40e req-a0fd9c52-5c03-4f87-a216-de99e4e9c4c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141123 Oct 12 22:30:03.128536 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2635/5900] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:30:03.724251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6dbff260-78b8-48b6-91a8-7cdfaab71586 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:03.742013 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6dbff260-78b8-48b6-91a8-7cdfaab71586 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1374 microversion: 2.1 time: 0.753064 Oct 12 22:30:03.747607 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3266/5901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:02 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1374 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:30:03.972663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-efd7ab3d-18e0-4e15-bc8b-7739348fd40c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:03.982104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-efd7ab3d-18e0-4e15-bc8b-7739348fd40c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:04.004604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd7ab3d-18e0-4e15-bc8b-7739348fd40c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:04.007955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd7ab3d-18e0-4e15-bc8b-7739348fd40c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:04.009017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd7ab3d-18e0-4e15-bc8b-7739348fd40c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:04.012120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd7ab3d-18e0-4e15-bc8b-7739348fd40c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:04.012801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd7ab3d-18e0-4e15-bc8b-7739348fd40c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:04.014480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd7ab3d-18e0-4e15-bc8b-7739348fd40c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:04.091863 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-efd7ab3d-18e0-4e15-bc8b-7739348fd40c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.127378 Oct 12 22:30:04.096741 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2636/5902] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:30:03 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:30:04.776371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cd46f986-5d72-4885-93cf-b329a1bc58ef tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:04.777962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cd46f986-5d72-4885-93cf-b329a1bc58ef tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:04.788015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd46f986-5d72-4885-93cf-b329a1bc58ef tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:04.791096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd46f986-5d72-4885-93cf-b329a1bc58ef tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:04.793372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd46f986-5d72-4885-93cf-b329a1bc58ef tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:04.794300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd46f986-5d72-4885-93cf-b329a1bc58ef tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:04.794928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd46f986-5d72-4885-93cf-b329a1bc58ef tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:04.803736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd46f986-5d72-4885-93cf-b329a1bc58ef tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:05.105002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6baf963d-b8fc-4a5b-8b3c-36d4eea80db1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:05.108141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6baf963d-b8fc-4a5b-8b3c-36d4eea80db1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:05.110771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:05.122522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6baf963d-b8fc-4a5b-8b3c-36d4eea80db1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:05.126793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6baf963d-b8fc-4a5b-8b3c-36d4eea80db1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:05.131886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6baf963d-b8fc-4a5b-8b3c-36d4eea80db1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:05.133623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6baf963d-b8fc-4a5b-8b3c-36d4eea80db1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:05.134329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6baf963d-b8fc-4a5b-8b3c-36d4eea80db1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:05.135113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6baf963d-b8fc-4a5b-8b3c-36d4eea80db1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:05.210804 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6baf963d-b8fc-4a5b-8b3c-36d4eea80db1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.109835 Oct 12 22:30:05.217540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cd46f986-5d72-4885-93cf-b329a1bc58ef tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:05.226341 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2637/5903] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:30:05 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 22:30:05.228897 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cd46f986-5d72-4885-93cf-b329a1bc58ef tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1374 microversion: 2.1 time: 0.465379 Oct 12 22:30:05.229487 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3267/5904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:04 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1374 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:06.233935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b43fece2-4610-4308-bad0-baa679880709 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:06.236161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b43fece2-4610-4308-bad0-baa679880709 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:06.247304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=12 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:06.256541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-45589129-92a7-4a5b-ac84-5b390a61fd3d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:06.257185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-45589129-92a7-4a5b-ac84-5b390a61fd3d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:06.258454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b43fece2-4610-4308-bad0-baa679880709 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:06.259010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b43fece2-4610-4308-bad0-baa679880709 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:06.259507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b43fece2-4610-4308-bad0-baa679880709 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:06.260243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b43fece2-4610-4308-bad0-baa679880709 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:06.260726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b43fece2-4610-4308-bad0-baa679880709 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:06.261160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b43fece2-4610-4308-bad0-baa679880709 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:06.272008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45589129-92a7-4a5b-ac84-5b390a61fd3d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:06.273898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45589129-92a7-4a5b-ac84-5b390a61fd3d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:06.274607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45589129-92a7-4a5b-ac84-5b390a61fd3d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:06.277686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45589129-92a7-4a5b-ac84-5b390a61fd3d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:06.278830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45589129-92a7-4a5b-ac84-5b390a61fd3d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:06.281547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45589129-92a7-4a5b-ac84-5b390a61fd3d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:06.364583 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b43fece2-4610-4308-bad0-baa679880709 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.134562 Oct 12 22:30:06.365752 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2638/5905] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:30:06 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:30:07.381671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0868634b-0d19-4dea-af0d-0eb3de374429 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:07.384068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0868634b-0d19-4dea-af0d-0eb3de374429 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:07.402417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0868634b-0d19-4dea-af0d-0eb3de374429 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:07.402833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0868634b-0d19-4dea-af0d-0eb3de374429 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:07.403334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0868634b-0d19-4dea-af0d-0eb3de374429 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:07.404056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0868634b-0d19-4dea-af0d-0eb3de374429 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:07.404512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0868634b-0d19-4dea-af0d-0eb3de374429 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:07.404957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0868634b-0d19-4dea-af0d-0eb3de374429 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:07.483978 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0868634b-0d19-4dea-af0d-0eb3de374429 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108211 Oct 12 22:30:07.484609 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2639/5906] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:30:07 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:30:07.502099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-45589129-92a7-4a5b-ac84-5b390a61fd3d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:07.514141 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-45589129-92a7-4a5b-ac84-5b390a61fd3d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1374 microversion: 2.1 time: 1.263774 Oct 12 22:30:07.514737 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3268/5907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:06 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1374 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:08.502588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4f39fb48-5e6c-46e5-a8c3-028b09b6cb6c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:08.507106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4f39fb48-5e6c-46e5-a8c3-028b09b6cb6c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:08.530715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f39fb48-5e6c-46e5-a8c3-028b09b6cb6c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:08.531220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f39fb48-5e6c-46e5-a8c3-028b09b6cb6c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:08.531682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f39fb48-5e6c-46e5-a8c3-028b09b6cb6c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:08.541483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c3b6d394-946b-4c09-9994-2527533c0936 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:08.542666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c3b6d394-946b-4c09-9994-2527533c0936 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:08.550251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f39fb48-5e6c-46e5-a8c3-028b09b6cb6c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:08.552063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f39fb48-5e6c-46e5-a8c3-028b09b6cb6c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:08.553953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f39fb48-5e6c-46e5-a8c3-028b09b6cb6c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:08.569029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3b6d394-946b-4c09-9994-2527533c0936 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:08.571470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3b6d394-946b-4c09-9994-2527533c0936 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:08.575037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3b6d394-946b-4c09-9994-2527533c0936 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:08.576037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3b6d394-946b-4c09-9994-2527533c0936 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:08.577463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3b6d394-946b-4c09-9994-2527533c0936 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:08.587966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3b6d394-946b-4c09-9994-2527533c0936 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:08.675225 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4f39fb48-5e6c-46e5-a8c3-028b09b6cb6c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.180100 Oct 12 22:30:08.675835 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2640/5908] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:30:08 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:30:09.237731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c3b6d394-946b-4c09-9994-2527533c0936 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:09.246222 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c3b6d394-946b-4c09-9994-2527533c0936 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1374 microversion: 2.1 time: 0.709389 Oct 12 22:30:09.248126 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3269/5909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:08 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1374 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:30:09.688756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-38fe8335-0bd0-4aae-b20d-90b8c3b5453d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:09.693139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-38fe8335-0bd0-4aae-b20d-90b8c3b5453d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:09.716481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38fe8335-0bd0-4aae-b20d-90b8c3b5453d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:09.719349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38fe8335-0bd0-4aae-b20d-90b8c3b5453d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:09.722663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38fe8335-0bd0-4aae-b20d-90b8c3b5453d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:09.725225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38fe8335-0bd0-4aae-b20d-90b8c3b5453d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:09.727257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38fe8335-0bd0-4aae-b20d-90b8c3b5453d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:09.727737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38fe8335-0bd0-4aae-b20d-90b8c3b5453d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:09.878320 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-38fe8335-0bd0-4aae-b20d-90b8c3b5453d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.182814 Oct 12 22:30:09.879793 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2641/5910] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:30:09 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:30:10.274766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ea7e52b3-0ddf-45f3-ac7e-407b0e3c85de tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:10.275658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ea7e52b3-0ddf-45f3-ac7e-407b0e3c85de tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:10.294540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea7e52b3-0ddf-45f3-ac7e-407b0e3c85de tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:10.298258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea7e52b3-0ddf-45f3-ac7e-407b0e3c85de tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:10.298827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea7e52b3-0ddf-45f3-ac7e-407b0e3c85de tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:10.300205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea7e52b3-0ddf-45f3-ac7e-407b0e3c85de tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:10.303688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea7e52b3-0ddf-45f3-ac7e-407b0e3c85de tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:10.304336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea7e52b3-0ddf-45f3-ac7e-407b0e3c85de tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:10.591452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ea7e52b3-0ddf-45f3-ac7e-407b0e3c85de tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:10.605043 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ea7e52b3-0ddf-45f3-ac7e-407b0e3c85de tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1374 microversion: 2.1 time: 0.336034 Oct 12 22:30:10.606784 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3270/5911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:10 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1374 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:10.895286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-409a75f4-03bf-44b1-afd5-0ab7b84aee00 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:10.898768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-409a75f4-03bf-44b1-afd5-0ab7b84aee00 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:10.920363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-409a75f4-03bf-44b1-afd5-0ab7b84aee00 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:10.920895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-409a75f4-03bf-44b1-afd5-0ab7b84aee00 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:10.923423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-409a75f4-03bf-44b1-afd5-0ab7b84aee00 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:10.924517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-409a75f4-03bf-44b1-afd5-0ab7b84aee00 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:10.924995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-409a75f4-03bf-44b1-afd5-0ab7b84aee00 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:10.925896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-409a75f4-03bf-44b1-afd5-0ab7b84aee00 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:10.991338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:11.040937 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-409a75f4-03bf-44b1-afd5-0ab7b84aee00 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.152627 Oct 12 22:30:11.043077 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2642/5912] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:30:10 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a/os-volume_attachments => generated 25 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:11.159470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-de325b15-e532-4074-a035-a6e5c1703d26 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:11.160284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-de325b15-e532-4074-a035-a6e5c1703d26 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:11.170172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de325b15-e532-4074-a035-a6e5c1703d26 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:11.170669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de325b15-e532-4074-a035-a6e5c1703d26 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:11.171100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de325b15-e532-4074-a035-a6e5c1703d26 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:11.173664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de325b15-e532-4074-a035-a6e5c1703d26 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:11.175751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de325b15-e532-4074-a035-a6e5c1703d26 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:11.177250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de325b15-e532-4074-a035-a6e5c1703d26 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:11.227949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-de325b15-e532-4074-a035-a6e5c1703d26 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:30:11.244155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-81fbbe50-afea-4a4a-bd70-ee8a42447c41 req-747ff016-5c87-4123-a196-23842b0b2675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c973408a-2071-4e50-aa87-b08294479f15", "name": "network-vif-plugged", "status": "completed", "tag": "b8e5ca77-39e1-4915-9db4-a7c9dd58fa57"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:11.275816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-81fbbe50-afea-4a4a-bd70-ee8a42447c41 req-747ff016-5c87-4123-a196-23842b0b2675 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:11.278823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-81fbbe50-afea-4a4a-bd70-ee8a42447c41 req-747ff016-5c87-4123-a196-23842b0b2675 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:11.280634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-81fbbe50-afea-4a4a-bd70-ee8a42447c41 req-747ff016-5c87-4123-a196-23842b0b2675 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:11.307217 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-81fbbe50-afea-4a4a-bd70-ee8a42447c41 req-747ff016-5c87-4123-a196-23842b0b2675 service nova] Creating event network-vif-plugged:b8e5ca77-39e1-4915-9db4-a7c9dd58fa57 for instance c973408a-2071-4e50-aa87-b08294479f15 on n-h2-861111-1 Oct 12 22:30:11.336585 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-81fbbe50-afea-4a4a-bd70-ee8a42447c41 req-747ff016-5c87-4123-a196-23842b0b2675 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104084 Oct 12 22:30:11.340576 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2643/5913] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:30:11.430862 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-de325b15-e532-4074-a035-a6e5c1703d26 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "DELETE /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 204 len: 0 microversion: 2.20 time: 0.275598 Oct 12 22:30:11.432551 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3271/5914] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:30:11 2022] DELETE /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:30:11.442173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c72df9a8-81fb-4484-b67f-7dadcec0310b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:11.443453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c72df9a8-81fb-4484-b67f-7dadcec0310b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:11.464894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c72df9a8-81fb-4484-b67f-7dadcec0310b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:11.469334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c72df9a8-81fb-4484-b67f-7dadcec0310b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:11.469800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c72df9a8-81fb-4484-b67f-7dadcec0310b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:11.476223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c72df9a8-81fb-4484-b67f-7dadcec0310b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:11.476910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c72df9a8-81fb-4484-b67f-7dadcec0310b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:11.477356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c72df9a8-81fb-4484-b67f-7dadcec0310b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:11.634326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-daba69a6-24ec-4b02-9577-e5900a59e917 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:11.635726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-daba69a6-24ec-4b02-9577-e5900a59e917 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:11.645762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daba69a6-24ec-4b02-9577-e5900a59e917 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:11.647202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daba69a6-24ec-4b02-9577-e5900a59e917 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:11.647871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daba69a6-24ec-4b02-9577-e5900a59e917 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:11.648853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daba69a6-24ec-4b02-9577-e5900a59e917 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:11.649768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daba69a6-24ec-4b02-9577-e5900a59e917 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:11.650412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daba69a6-24ec-4b02-9577-e5900a59e917 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:11.894608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-daba69a6-24ec-4b02-9577-e5900a59e917 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:11.908413 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-daba69a6-24ec-4b02-9577-e5900a59e917 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1374 microversion: 2.1 time: 0.281929 Oct 12 22:30:11.909280 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3272/5915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:11 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1374 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:30:12.026482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c72df9a8-81fb-4484-b67f-7dadcec0310b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:12.058237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c72df9a8-81fb-4484-b67f-7dadcec0310b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:12.062482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c72df9a8-81fb-4484-b67f-7dadcec0310b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:12.068339 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c72df9a8-81fb-4484-b67f-7dadcec0310b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1724 microversion: 2.20 time: 0.630976 Oct 12 22:30:12.069093 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2644/5916] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:11 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1724 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:12.941342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2370495d-debe-4934-8031-7fbbda01b316 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:12.945103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2370495d-debe-4934-8031-7fbbda01b316 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:12.981365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2370495d-debe-4934-8031-7fbbda01b316 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:12.985057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2370495d-debe-4934-8031-7fbbda01b316 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:12.985614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2370495d-debe-4934-8031-7fbbda01b316 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:12.986389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2370495d-debe-4934-8031-7fbbda01b316 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:12.986865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2370495d-debe-4934-8031-7fbbda01b316 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:12.987328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2370495d-debe-4934-8031-7fbbda01b316 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:13.141311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ed2117f1-473e-4ca0-b27c-7bec41a0e581 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:13.157771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ed2117f1-473e-4ca0-b27c-7bec41a0e581 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:13.191549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed2117f1-473e-4ca0-b27c-7bec41a0e581 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:13.203025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed2117f1-473e-4ca0-b27c-7bec41a0e581 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:13.204037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed2117f1-473e-4ca0-b27c-7bec41a0e581 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:13.204984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed2117f1-473e-4ca0-b27c-7bec41a0e581 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:13.205641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed2117f1-473e-4ca0-b27c-7bec41a0e581 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:13.206283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed2117f1-473e-4ca0-b27c-7bec41a0e581 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:14.171603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2370495d-debe-4934-8031-7fbbda01b316 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:14.183491 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2370495d-debe-4934-8031-7fbbda01b316 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1374 microversion: 2.1 time: 1.254492 Oct 12 22:30:14.185478 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3273/5917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:12 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1374 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:15.073714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ed2117f1-473e-4ca0-b27c-7bec41a0e581 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:15.086494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ed2117f1-473e-4ca0-b27c-7bec41a0e581 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:15.092085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ed2117f1-473e-4ca0-b27c-7bec41a0e581 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:15.101806 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ed2117f1-473e-4ca0-b27c-7bec41a0e581 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1724 microversion: 2.20 time: 1.995062 Oct 12 22:30:15.102922 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2645/5918] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:13 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1724 bytes in 2007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:15.211309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e1e717d1-404f-4bce-8a12-6fcbaea069fc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:15.214017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e1e717d1-404f-4bce-8a12-6fcbaea069fc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:15.225495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:15.229155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1e717d1-404f-4bce-8a12-6fcbaea069fc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:15.230222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1e717d1-404f-4bce-8a12-6fcbaea069fc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:15.231065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1e717d1-404f-4bce-8a12-6fcbaea069fc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:15.232067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1e717d1-404f-4bce-8a12-6fcbaea069fc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:15.233045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1e717d1-404f-4bce-8a12-6fcbaea069fc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:15.233596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1e717d1-404f-4bce-8a12-6fcbaea069fc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:15.639438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e1e717d1-404f-4bce-8a12-6fcbaea069fc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:15.650735 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e1e717d1-404f-4bce-8a12-6fcbaea069fc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1547 microversion: 2.1 time: 0.444577 Oct 12 22:30:15.656385 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3274/5919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:15 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1547 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:15.679955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c67c5e82-581e-4681-bb02-60fff900dee7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:15.680709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c67c5e82-581e-4681-bb02-60fff900dee7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:15.689833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c67c5e82-581e-4681-bb02-60fff900dee7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:15.690333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c67c5e82-581e-4681-bb02-60fff900dee7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:15.690780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c67c5e82-581e-4681-bb02-60fff900dee7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:15.691520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c67c5e82-581e-4681-bb02-60fff900dee7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:15.692369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c67c5e82-581e-4681-bb02-60fff900dee7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:15.693806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c67c5e82-581e-4681-bb02-60fff900dee7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:16.091035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c67c5e82-581e-4681-bb02-60fff900dee7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:16.103471 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c67c5e82-581e-4681-bb02-60fff900dee7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1547 microversion: 2.1 time: 0.427914 Oct 12 22:30:16.121109 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2646/5920] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:15 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1547 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:16.134440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb2874d6-4ccc-41d0-8a0a-c7918c4027a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:16.135571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cb2874d6-4ccc-41d0-8a0a-c7918c4027a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:16.150908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb2874d6-4ccc-41d0-8a0a-c7918c4027a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:16.151546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb2874d6-4ccc-41d0-8a0a-c7918c4027a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:16.152205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb2874d6-4ccc-41d0-8a0a-c7918c4027a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:16.153112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb2874d6-4ccc-41d0-8a0a-c7918c4027a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:16.153582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb2874d6-4ccc-41d0-8a0a-c7918c4027a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:16.154017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb2874d6-4ccc-41d0-8a0a-c7918c4027a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:16.456242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cb2874d6-4ccc-41d0-8a0a-c7918c4027a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:16.469881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cb2874d6-4ccc-41d0-8a0a-c7918c4027a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:16.475277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cb2874d6-4ccc-41d0-8a0a-c7918c4027a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:16.476549 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cb2874d6-4ccc-41d0-8a0a-c7918c4027a3 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1724 microversion: 2.20 time: 0.347608 Oct 12 22:30:16.491972 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3275/5921] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:16 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1724 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:17.505963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ba446b0b-1143-4593-85b8-f24ba56476dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:17.506576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ba446b0b-1143-4593-85b8-f24ba56476dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:17.509746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:17.536732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba446b0b-1143-4593-85b8-f24ba56476dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:17.541192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba446b0b-1143-4593-85b8-f24ba56476dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:17.544650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba446b0b-1143-4593-85b8-f24ba56476dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:17.547867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba446b0b-1143-4593-85b8-f24ba56476dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:17.548426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba446b0b-1143-4593-85b8-f24ba56476dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:17.548940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba446b0b-1143-4593-85b8-f24ba56476dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:17.790359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba446b0b-1143-4593-85b8-f24ba56476dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:17.806443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba446b0b-1143-4593-85b8-f24ba56476dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:17.809310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba446b0b-1143-4593-85b8-f24ba56476dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:17.814201 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ba446b0b-1143-4593-85b8-f24ba56476dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1657 microversion: 2.20 time: 0.309436 Oct 12 22:30:17.831569 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2647/5922] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:17 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1657 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:18.620383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-bad3dc57-3973-4c52-9844-7b59525616a0 req-8a787a50-285b-4219-b697-8feea7a3987b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ecbb62-d209-4784-9a32-1076041ce09a", "name": "network-vif-deleted", "tag": "57ae856e-81cb-43bf-8768-e10cfb8d0da9"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:18.650048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-bad3dc57-3973-4c52-9844-7b59525616a0 req-8a787a50-285b-4219-b697-8feea7a3987b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:18.650531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-bad3dc57-3973-4c52-9844-7b59525616a0 req-8a787a50-285b-4219-b697-8feea7a3987b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:18.650960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-bad3dc57-3973-4c52-9844-7b59525616a0 req-8a787a50-285b-4219-b697-8feea7a3987b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:18.686912 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-bad3dc57-3973-4c52-9844-7b59525616a0 req-8a787a50-285b-4219-b697-8feea7a3987b service nova] Creating event network-vif-deleted:57ae856e-81cb-43bf-8768-e10cfb8d0da9 for instance 97ecbb62-d209-4784-9a32-1076041ce09a on n-h1-861111-1 Oct 12 22:30:18.694004 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-bad3dc57-3973-4c52-9844-7b59525616a0 req-8a787a50-285b-4219-b697-8feea7a3987b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078228 Oct 12 22:30:18.694613 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3276/5923] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:18.851364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9fbee383-90e5-4f7e-bf66-5f91774a8fe9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:18.852165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9fbee383-90e5-4f7e-bf66-5f91774a8fe9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:18.861911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fbee383-90e5-4f7e-bf66-5f91774a8fe9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:18.862506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fbee383-90e5-4f7e-bf66-5f91774a8fe9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:18.862819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fbee383-90e5-4f7e-bf66-5f91774a8fe9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:18.863545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fbee383-90e5-4f7e-bf66-5f91774a8fe9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:18.863997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fbee383-90e5-4f7e-bf66-5f91774a8fe9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:18.864956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fbee383-90e5-4f7e-bf66-5f91774a8fe9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:18.939967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fbee383-90e5-4f7e-bf66-5f91774a8fe9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:18.940473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fbee383-90e5-4f7e-bf66-5f91774a8fe9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:18.943832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fbee383-90e5-4f7e-bf66-5f91774a8fe9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:18.944329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-9fbee383-90e5-4f7e-bf66-5f91774a8fe9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lazy-loading 'fault' on Instance uuid 97ecbb62-d209-4784-9a32-1076041ce09a {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:30:19.103562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9fbee383-90e5-4f7e-bf66-5f91774a8fe9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:19.116349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9fbee383-90e5-4f7e-bf66-5f91774a8fe9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:19.120923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9fbee383-90e5-4f7e-bf66-5f91774a8fe9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:19.127065 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9fbee383-90e5-4f7e-bf66-5f91774a8fe9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 200 len: 1371 microversion: 2.20 time: 0.288579 Oct 12 22:30:19.142689 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2648/5924] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:18 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 1371 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:20.157144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f2bc3d86-6366-4749-8764-988171570b19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:20.157834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f2bc3d86-6366-4749-8764-988171570b19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:20.173290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2bc3d86-6366-4749-8764-988171570b19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:20.174222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2bc3d86-6366-4749-8764-988171570b19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:20.174662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2bc3d86-6366-4749-8764-988171570b19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:20.175908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2bc3d86-6366-4749-8764-988171570b19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:20.176521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2bc3d86-6366-4749-8764-988171570b19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:20.177644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2bc3d86-6366-4749-8764-988171570b19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:20.216561 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-f2bc3d86-6366-4749-8764-988171570b19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] HTTP exception thrown: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f2bc3d86-6366-4749-8764-988171570b19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Request method failure captured: Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a HTTP/1.1 Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz8ToxlzfCHBEMSzdQ8_A6J-U_BRf4lX8JTLHMNN7XwYCBcY72mthX2TxQtrUuWJp2jw9OLL0rkEOMj0GMsxB1BFYaDxqhy2QpvcJj2UrKBt_BKrMNjKzJc3L1BBkZlgu4AL42RTnKHp-D9SnRWaPrQ6y0eMruBdzp52tSpRl_phxf8 Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 044e5feb7b4548bdb114d0aeaa6ea5cb Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_044e5feb7b4548bdb114d0aeaa6ea5cb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 044e5feb7b4548bdb114d0aeaa6ea5cb Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeShelveTestJSON-684969485-project Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: d79554521f9f432e87f6f3e0b0f11b85 Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeShelveTestJSON-684969485-project Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '97ecbb62-d209-4784-9a32-1076041ce09a'} Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:30:20.228935 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:20.233313 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:30:20.233313 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:20.233313 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:20.233313 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:20.233313 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:30:20.233313 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:30:20.233313 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. Oct 12 22:30:20.233313 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:30:20.233313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f2bc3d86-6366-4749-8764-988171570b19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Returning 404 to user: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:20.233313 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f2bc3d86-6366-4749-8764-988171570b19 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 404 len: 111 microversion: 2.20 time: 0.079088 Oct 12 22:30:20.233313 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3277/5925] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:20 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:30:20.243091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e45a3fe9-e8c8-49ea-903e-343f474280ea tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '.version_select at 0x7f51230ffc10>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:20.303887 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e45a3fe9-e8c8-49ea-903e-343f474280ea tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641358953" status: 204 len: 0 microversion: 2.20 time: 0.067245 Oct 12 22:30:20.304814 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2649/5926] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 12 22:30:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641358953 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:30:21.614318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ed77eea6-0fd9-4723-a7e7-febfc45a4199 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Action: 'create', calling method: .version_select at 0x7f5122c6a310>, body: {"keypair": {"name": "tempest-keypair-1038961112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLpfBE3jUMqfBRRedQRRYb/1/n8RUBKXvudTHoXjhjymRT4DE5hSAy99QPlyVjDBBiwedeAAVxRFOnPjFCXu5OwQW/82JpBOH3WKfzk0eW/g5FzlKrEymGH7XKJV+BgXw=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:21.648144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-ed77eea6-0fd9-4723-a7e7-febfc45a4199 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Getting quotas for project 044e5feb7b4548bdb114d0aeaa6ea5cb. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:30:21.664282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-ed77eea6-0fd9-4723-a7e7-febfc45a4199 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Getting quotas for user d79554521f9f432e87f6f3e0b0f11b85 and project 044e5feb7b4548bdb114d0aeaa6ea5cb. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:30:21.698397 n-d-861111-1 devstack@n-api.service[120453]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ed77eea6-0fd9-4723-a7e7-febfc45a4199 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [55e88b13-f8be-4c2c-80f9-a8b0dda35e96] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 22:30:22.707069 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [None req-ed77eea6-0fd9-4723-a7e7-febfc45a4199 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [55e88b13-f8be-4c2c-80f9-a8b0dda35e96] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41324. Oct 12 22:30:22.761394 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ed77eea6-0fd9-4723-a7e7-febfc45a4199 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.138003 Oct 12 22:30:22.764262 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3278/5927] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 12 22:30:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1155 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 22:30:23.414289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-1dc35477-3e05-4423-a0ca-e6cf928460e5 req-96f48df4-a0cb-48fe-8aa8-d1be09cc022e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c973408a-2071-4e50-aa87-b08294479f15", "tag": "b8e5ca77-39e1-4915-9db4-a7c9dd58fa57"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:23.438478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1dc35477-3e05-4423-a0ca-e6cf928460e5 req-96f48df4-a0cb-48fe-8aa8-d1be09cc022e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:23.439065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1dc35477-3e05-4423-a0ca-e6cf928460e5 req-96f48df4-a0cb-48fe-8aa8-d1be09cc022e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:23.439531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1dc35477-3e05-4423-a0ca-e6cf928460e5 req-96f48df4-a0cb-48fe-8aa8-d1be09cc022e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:23.489773 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-1dc35477-3e05-4423-a0ca-e6cf928460e5 req-96f48df4-a0cb-48fe-8aa8-d1be09cc022e service nova] Creating event network-changed:b8e5ca77-39e1-4915-9db4-a7c9dd58fa57 for instance c973408a-2071-4e50-aa87-b08294479f15 on n-h2-861111-1 Oct 12 22:30:23.502509 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-1dc35477-3e05-4423-a0ca-e6cf928460e5 req-96f48df4-a0cb-48fe-8aa8-d1be09cc022e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091528 Oct 12 22:30:23.507415 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2650/5928] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:27.794441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1054590432", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "494edc42-528c-4cb2-a764-ee4a7cddab3a"}], "security_groups": [{"name": "tempest-securitygroup--2140364366"}], "key_name": "tempest-keypair-1038961112", "user_data": "}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:28.125456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] validate_networks() for [('494edc42-528c-4cb2-a764-ee4a7cddab3a', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:30:29.157787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:30:29.159090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:30:29.159750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:30:29.160336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:30:29.161316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:30:29.174174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:29.175187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:29.175816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:29.177253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:29.177855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:29.178440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:29.206707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Getting quotas for project 044e5feb7b4548bdb114d0aeaa6ea5cb. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:30:29.212611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Getting quotas for user d79554521f9f432e87f6f3e0b0f11b85 and project 044e5feb7b4548bdb114d0aeaa6ea5cb. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:30:29.232183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:30:29.237392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:30:29.334824 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0f6a01d2-5142-49b6-91cf-c8da97092780 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.545991 Oct 12 22:30:29.337413 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3279/5929] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 12 22:30:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:30:29.351417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-51780744-dac9-4920-8f11-62b7f20ae41d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:29.352759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-51780744-dac9-4920-8f11-62b7f20ae41d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:29.547880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-51780744-dac9-4920-8f11-62b7f20ae41d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:29.564738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-51780744-dac9-4920-8f11-62b7f20ae41d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:29.569613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-51780744-dac9-4920-8f11-62b7f20ae41d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:29.586413 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-51780744-dac9-4920-8f11-62b7f20ae41d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1282 microversion: 2.20 time: 0.239752 Oct 12 22:30:29.587208 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2651/5930] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:29 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1282 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:30.616737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4014da8a-22be-4919-b6f3-26cf4c1b55c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:30.617980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4014da8a-22be-4919-b6f3-26cf4c1b55c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:30.951983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4014da8a-22be-4919-b6f3-26cf4c1b55c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:31.009101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4014da8a-22be-4919-b6f3-26cf4c1b55c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:31.016801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4014da8a-22be-4919-b6f3-26cf4c1b55c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:31.018282 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4014da8a-22be-4919-b6f3-26cf4c1b55c7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1282 microversion: 2.20 time: 0.407269 Oct 12 22:30:31.019064 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3280/5931] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:30 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1282 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:32.048036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a4d1431e-a4ec-42c3-95ea-d6d7e7c0565d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:32.049990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a4d1431e-a4ec-42c3-95ea-d6d7e7c0565d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:32.082809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4d1431e-a4ec-42c3-95ea-d6d7e7c0565d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:32.090887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4d1431e-a4ec-42c3-95ea-d6d7e7c0565d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:32.091816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4d1431e-a4ec-42c3-95ea-d6d7e7c0565d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:32.093642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4d1431e-a4ec-42c3-95ea-d6d7e7c0565d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:32.094353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4d1431e-a4ec-42c3-95ea-d6d7e7c0565d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:32.101112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4d1431e-a4ec-42c3-95ea-d6d7e7c0565d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:32.617354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a4d1431e-a4ec-42c3-95ea-d6d7e7c0565d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:32.632269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a4d1431e-a4ec-42c3-95ea-d6d7e7c0565d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:32.650447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a4d1431e-a4ec-42c3-95ea-d6d7e7c0565d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:32.654495 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a4d1431e-a4ec-42c3-95ea-d6d7e7c0565d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1352 microversion: 2.20 time: 0.610851 Oct 12 22:30:32.669225 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2652/5932] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:32 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1352 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:33.698708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-55cad629-9882-4720-a4d9-08cf5030451f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:33.702281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-55cad629-9882-4720-a4d9-08cf5030451f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:33.736021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55cad629-9882-4720-a4d9-08cf5030451f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:33.736527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55cad629-9882-4720-a4d9-08cf5030451f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:33.736974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55cad629-9882-4720-a4d9-08cf5030451f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:33.737698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55cad629-9882-4720-a4d9-08cf5030451f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:33.738165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55cad629-9882-4720-a4d9-08cf5030451f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:33.739144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55cad629-9882-4720-a4d9-08cf5030451f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:33.827651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:34.498308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-55cad629-9882-4720-a4d9-08cf5030451f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:34.547101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-55cad629-9882-4720-a4d9-08cf5030451f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:34.559132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-55cad629-9882-4720-a4d9-08cf5030451f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:34.566425 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-55cad629-9882-4720-a4d9-08cf5030451f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1340 microversion: 2.20 time: 0.876277 Oct 12 22:30:34.571189 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3281/5933] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:33 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1340 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:35.599293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0fe8d3e7-3f0b-4c99-8d85-cfb7b726c9a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:35.600531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0fe8d3e7-3f0b-4c99-8d85-cfb7b726c9a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:35.609000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fe8d3e7-3f0b-4c99-8d85-cfb7b726c9a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:35.610075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fe8d3e7-3f0b-4c99-8d85-cfb7b726c9a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:35.610685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fe8d3e7-3f0b-4c99-8d85-cfb7b726c9a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:35.612958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fe8d3e7-3f0b-4c99-8d85-cfb7b726c9a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:35.616679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fe8d3e7-3f0b-4c99-8d85-cfb7b726c9a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:35.619476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fe8d3e7-3f0b-4c99-8d85-cfb7b726c9a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:36.022633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0fe8d3e7-3f0b-4c99-8d85-cfb7b726c9a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:36.031951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0fe8d3e7-3f0b-4c99-8d85-cfb7b726c9a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:36.051668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0fe8d3e7-3f0b-4c99-8d85-cfb7b726c9a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:36.056832 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0fe8d3e7-3f0b-4c99-8d85-cfb7b726c9a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1408 microversion: 2.20 time: 0.461807 Oct 12 22:30:36.078795 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2653/5934] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:35 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1408 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:36.367139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-3dbd2a55-7929-440c-b086-9d7ec30a30c8 req-8b0d83e9-6bac-4fc1-83c6-55c8b3ad80ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d", "tag": "ad849817-ecb6-4b77-a207-c06765b7f617"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:36.401132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3dbd2a55-7929-440c-b086-9d7ec30a30c8 req-8b0d83e9-6bac-4fc1-83c6-55c8b3ad80ee service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:36.402095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3dbd2a55-7929-440c-b086-9d7ec30a30c8 req-8b0d83e9-6bac-4fc1-83c6-55c8b3ad80ee service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:36.402554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3dbd2a55-7929-440c-b086-9d7ec30a30c8 req-8b0d83e9-6bac-4fc1-83c6-55c8b3ad80ee service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:36.458043 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-3dbd2a55-7929-440c-b086-9d7ec30a30c8 req-8b0d83e9-6bac-4fc1-83c6-55c8b3ad80ee service nova] Creating event network-changed:ad849817-ecb6-4b77-a207-c06765b7f617 for instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d on n-h1-861111-1 Oct 12 22:30:36.498712 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-3dbd2a55-7929-440c-b086-9d7ec30a30c8 req-8b0d83e9-6bac-4fc1-83c6-55c8b3ad80ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126954 Oct 12 22:30:36.499470 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3282/5935] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:37.086792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-569be5c1-ced5-4f5c-9c68-9aa3f14df827 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:37.087482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-569be5c1-ced5-4f5c-9c68-9aa3f14df827 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:37.102078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-569be5c1-ced5-4f5c-9c68-9aa3f14df827 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:37.102078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-569be5c1-ced5-4f5c-9c68-9aa3f14df827 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:37.102519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-569be5c1-ced5-4f5c-9c68-9aa3f14df827 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:37.109420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-569be5c1-ced5-4f5c-9c68-9aa3f14df827 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:37.111640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-569be5c1-ced5-4f5c-9c68-9aa3f14df827 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:37.113690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-569be5c1-ced5-4f5c-9c68-9aa3f14df827 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:38.291466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-569be5c1-ced5-4f5c-9c68-9aa3f14df827 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:38.311184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-569be5c1-ced5-4f5c-9c68-9aa3f14df827 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:38.314725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-569be5c1-ced5-4f5c-9c68-9aa3f14df827 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:38.318395 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-569be5c1-ced5-4f5c-9c68-9aa3f14df827 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1408 microversion: 2.20 time: 1.234742 Oct 12 22:30:38.319699 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2654/5936] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:37 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1408 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:39.346220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9be71571-2b9a-4d39-834d-18541d02828a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:39.346927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9be71571-2b9a-4d39-834d-18541d02828a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:39.356044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:39.373965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9be71571-2b9a-4d39-834d-18541d02828a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:39.376811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9be71571-2b9a-4d39-834d-18541d02828a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:39.378245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9be71571-2b9a-4d39-834d-18541d02828a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:39.380335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9be71571-2b9a-4d39-834d-18541d02828a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:39.382070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9be71571-2b9a-4d39-834d-18541d02828a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:39.387675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9be71571-2b9a-4d39-834d-18541d02828a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:39.991454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9be71571-2b9a-4d39-834d-18541d02828a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:40.003150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9be71571-2b9a-4d39-834d-18541d02828a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:40.007895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9be71571-2b9a-4d39-834d-18541d02828a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:40.012830 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9be71571-2b9a-4d39-834d-18541d02828a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1408 microversion: 2.20 time: 0.671502 Oct 12 22:30:40.013663 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3283/5937] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:39 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1408 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:41.044693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5cc07380-fe84-4a50-b0a5-4395aae51b5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:41.049008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5cc07380-fe84-4a50-b0a5-4395aae51b5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:41.083871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:41.086879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cc07380-fe84-4a50-b0a5-4395aae51b5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:41.089065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cc07380-fe84-4a50-b0a5-4395aae51b5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:41.090395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cc07380-fe84-4a50-b0a5-4395aae51b5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:41.095817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cc07380-fe84-4a50-b0a5-4395aae51b5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:41.097091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cc07380-fe84-4a50-b0a5-4395aae51b5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:41.105979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cc07380-fe84-4a50-b0a5-4395aae51b5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:41.749977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5cc07380-fe84-4a50-b0a5-4395aae51b5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:41.767984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=62 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:41.776317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5cc07380-fe84-4a50-b0a5-4395aae51b5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:41.778121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5cc07380-fe84-4a50-b0a5-4395aae51b5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:41.784368 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5cc07380-fe84-4a50-b0a5-4395aae51b5b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1408 microversion: 2.20 time: 0.743073 Oct 12 22:30:41.787803 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2655/5938] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:41 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1408 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:42.821749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ca057131-245b-4087-af8f-a7607a953f8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:42.822393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ca057131-245b-4087-af8f-a7607a953f8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:42.842965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=12 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:42.860865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca057131-245b-4087-af8f-a7607a953f8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:42.863034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca057131-245b-4087-af8f-a7607a953f8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:42.866773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca057131-245b-4087-af8f-a7607a953f8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:42.870007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca057131-245b-4087-af8f-a7607a953f8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:42.871609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca057131-245b-4087-af8f-a7607a953f8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:42.875389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca057131-245b-4087-af8f-a7607a953f8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:43.521723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ca057131-245b-4087-af8f-a7607a953f8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:43.537338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ca057131-245b-4087-af8f-a7607a953f8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:43.549428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ca057131-245b-4087-af8f-a7607a953f8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:43.553741 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ca057131-245b-4087-af8f-a7607a953f8b tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1408 microversion: 2.20 time: 0.743592 Oct 12 22:30:43.559083 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3284/5939] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:42 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1408 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:44.591947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3169b045-de91-4530-b5db-b90b2818e8a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:44.594277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3169b045-de91-4530-b5db-b90b2818e8a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:44.648684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3169b045-de91-4530-b5db-b90b2818e8a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:44.651262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3169b045-de91-4530-b5db-b90b2818e8a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:44.652732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3169b045-de91-4530-b5db-b90b2818e8a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:44.659190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3169b045-de91-4530-b5db-b90b2818e8a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:44.659928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3169b045-de91-4530-b5db-b90b2818e8a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:44.662524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3169b045-de91-4530-b5db-b90b2818e8a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:45.052794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3169b045-de91-4530-b5db-b90b2818e8a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:45.067855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3169b045-de91-4530-b5db-b90b2818e8a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:45.069971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3169b045-de91-4530-b5db-b90b2818e8a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:45.074273 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3169b045-de91-4530-b5db-b90b2818e8a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1408 microversion: 2.20 time: 0.487650 Oct 12 22:30:45.075404 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2656/5940] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:44 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1408 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:46.103676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-527c8892-8a37-4204-bf69-7db10dfeaa46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:46.104593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-527c8892-8a37-4204-bf69-7db10dfeaa46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:46.108396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:46.122831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-527c8892-8a37-4204-bf69-7db10dfeaa46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:46.126659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-527c8892-8a37-4204-bf69-7db10dfeaa46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:46.127400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-527c8892-8a37-4204-bf69-7db10dfeaa46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:46.131472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-527c8892-8a37-4204-bf69-7db10dfeaa46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:46.132181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-527c8892-8a37-4204-bf69-7db10dfeaa46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:46.132827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-527c8892-8a37-4204-bf69-7db10dfeaa46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:46.662789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-9444cbdf-2183-4247-8734-c285f6243241 req-7506896e-6c3d-46cc-bd25-837e84e2c736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d", "name": "network-vif-plugged", "status": "completed", "tag": "ad849817-ecb6-4b77-a207-c06765b7f617"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:46.685394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9444cbdf-2183-4247-8734-c285f6243241 req-7506896e-6c3d-46cc-bd25-837e84e2c736 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:46.685807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9444cbdf-2183-4247-8734-c285f6243241 req-7506896e-6c3d-46cc-bd25-837e84e2c736 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:46.686245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9444cbdf-2183-4247-8734-c285f6243241 req-7506896e-6c3d-46cc-bd25-837e84e2c736 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:46.724138 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-9444cbdf-2183-4247-8734-c285f6243241 req-7506896e-6c3d-46cc-bd25-837e84e2c736 service nova] Creating event network-vif-plugged:ad849817-ecb6-4b77-a207-c06765b7f617 for instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d on n-h1-861111-1 Oct 12 22:30:46.734690 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-9444cbdf-2183-4247-8734-c285f6243241 req-7506896e-6c3d-46cc-bd25-837e84e2c736 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.458611 Oct 12 22:30:46.741622 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2657/5941] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:46.989143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-527c8892-8a37-4204-bf69-7db10dfeaa46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:47.002439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-527c8892-8a37-4204-bf69-7db10dfeaa46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:47.006471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-527c8892-8a37-4204-bf69-7db10dfeaa46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:47.008263 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-527c8892-8a37-4204-bf69-7db10dfeaa46 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1408 microversion: 2.20 time: 0.909198 Oct 12 22:30:47.008837 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3285/5942] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:46 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1408 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:48.035807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ee42bc9c-7e8f-4c6e-9903-6e9e0f35de57 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:48.036512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ee42bc9c-7e8f-4c6e-9903-6e9e0f35de57 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:48.051480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:48.060148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee42bc9c-7e8f-4c6e-9903-6e9e0f35de57 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:48.060714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee42bc9c-7e8f-4c6e-9903-6e9e0f35de57 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:48.061182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee42bc9c-7e8f-4c6e-9903-6e9e0f35de57 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:48.065715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee42bc9c-7e8f-4c6e-9903-6e9e0f35de57 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:48.066268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee42bc9c-7e8f-4c6e-9903-6e9e0f35de57 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:48.066718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee42bc9c-7e8f-4c6e-9903-6e9e0f35de57 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:48.415197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ee42bc9c-7e8f-4c6e-9903-6e9e0f35de57 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:48.426744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ee42bc9c-7e8f-4c6e-9903-6e9e0f35de57 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:48.430512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ee42bc9c-7e8f-4c6e-9903-6e9e0f35de57 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:48.432647 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ee42bc9c-7e8f-4c6e-9903-6e9e0f35de57 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1408 microversion: 2.20 time: 0.402216 Oct 12 22:30:48.434481 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2658/5943] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:48 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1408 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:48.522019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bea090f6-9666-41ae-9aec-57e80182b3cd tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:48.525075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bea090f6-9666-41ae-9aec-57e80182b3cd tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:48.541553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bea090f6-9666-41ae-9aec-57e80182b3cd tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:48.545767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bea090f6-9666-41ae-9aec-57e80182b3cd tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:48.546599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bea090f6-9666-41ae-9aec-57e80182b3cd tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:48.548057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bea090f6-9666-41ae-9aec-57e80182b3cd tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:48.549302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bea090f6-9666-41ae-9aec-57e80182b3cd tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:48.553399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bea090f6-9666-41ae-9aec-57e80182b3cd tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:48.665435 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bea090f6-9666-41ae-9aec-57e80182b3cd tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "POST /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15/action" status: 200 len: 24568 microversion: 2.1 time: 0.147771 Oct 12 22:30:48.666434 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3286/5944] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:30:48 2022] POST /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15/action => generated 24568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:30:49.461548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a88676a6-039b-42e1-a2fe-233f5a743ef5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:49.462146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a88676a6-039b-42e1-a2fe-233f5a743ef5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:49.471322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a88676a6-039b-42e1-a2fe-233f5a743ef5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:49.473203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a88676a6-039b-42e1-a2fe-233f5a743ef5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:49.473644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a88676a6-039b-42e1-a2fe-233f5a743ef5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:49.474365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a88676a6-039b-42e1-a2fe-233f5a743ef5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:49.474811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a88676a6-039b-42e1-a2fe-233f5a743ef5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:49.480927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a88676a6-039b-42e1-a2fe-233f5a743ef5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:49.986024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a88676a6-039b-42e1-a2fe-233f5a743ef5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:49.997215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a88676a6-039b-42e1-a2fe-233f5a743ef5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:50.000399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a88676a6-039b-42e1-a2fe-233f5a743ef5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:50.002049 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a88676a6-039b-42e1-a2fe-233f5a743ef5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1600 microversion: 2.20 time: 0.544170 Oct 12 22:30:50.002943 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2659/5945] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:30:49 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1600 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:50.032105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b6d8480d-071f-48ab-a28d-9e9b26c9bbdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:50.032715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b6d8480d-071f-48ab-a28d-9e9b26c9bbdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:50.043800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6d8480d-071f-48ab-a28d-9e9b26c9bbdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:50.044292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6d8480d-071f-48ab-a28d-9e9b26c9bbdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:50.044728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6d8480d-071f-48ab-a28d-9e9b26c9bbdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:50.045431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6d8480d-071f-48ab-a28d-9e9b26c9bbdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:50.045882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6d8480d-071f-48ab-a28d-9e9b26c9bbdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:50.046324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b6d8480d-071f-48ab-a28d-9e9b26c9bbdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:50.180247 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b6d8480d-071f-48ab-a28d-9e9b26c9bbdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.154133 Oct 12 22:30:50.181479 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3287/5946] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 12 22:30:50 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:30:52.141746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b93a6edd-bcce-4fc7-9f19-dee7df8d66f3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:52.142287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b93a6edd-bcce-4fc7-9f19-dee7df8d66f3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:52.158054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b93a6edd-bcce-4fc7-9f19-dee7df8d66f3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:52.161737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b93a6edd-bcce-4fc7-9f19-dee7df8d66f3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:52.162227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b93a6edd-bcce-4fc7-9f19-dee7df8d66f3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:52.162966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b93a6edd-bcce-4fc7-9f19-dee7df8d66f3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:52.166959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b93a6edd-bcce-4fc7-9f19-dee7df8d66f3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:52.167501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b93a6edd-bcce-4fc7-9f19-dee7df8d66f3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:52.428785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-b93a6edd-bcce-4fc7-9f19-dee7df8d66f3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lazy-loading 'services' on Instance uuid 1958534e-ec1c-4ecc-bc9a-7720512092ed {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:30:52.614284 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b93a6edd-bcce-4fc7-9f19-dee7df8d66f3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/os-volume_attachments/23d73b71-e4b9-4724-8cce-8a045f65e05e" status: 202 len: 0 microversion: 2.1 time: 0.476618 Oct 12 22:30:52.616565 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2660/5947] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 22:30:52 2022] DELETE /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/os-volume_attachments/23d73b71-e4b9-4724-8cce-8a045f65e05e => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:30:54.605729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d4284fa1-0cfa-4bd3-9d58-d92ca96483eb req-fb6f6bb5-4a20-4dba-8dc6-bad44f7b75c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d", "tag": "ad849817-ecb6-4b77-a207-c06765b7f617"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:54.640893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d4284fa1-0cfa-4bd3-9d58-d92ca96483eb req-fb6f6bb5-4a20-4dba-8dc6-bad44f7b75c7 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:54.649702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d4284fa1-0cfa-4bd3-9d58-d92ca96483eb req-fb6f6bb5-4a20-4dba-8dc6-bad44f7b75c7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:54.650445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d4284fa1-0cfa-4bd3-9d58-d92ca96483eb req-fb6f6bb5-4a20-4dba-8dc6-bad44f7b75c7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:54.685830 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d4284fa1-0cfa-4bd3-9d58-d92ca96483eb req-fb6f6bb5-4a20-4dba-8dc6-bad44f7b75c7 service nova] Creating event network-changed:ad849817-ecb6-4b77-a207-c06765b7f617 for instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d on n-h1-861111-1 Oct 12 22:30:54.697965 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d4284fa1-0cfa-4bd3-9d58-d92ca96483eb req-fb6f6bb5-4a20-4dba-8dc6-bad44f7b75c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096373 Oct 12 22:30:54.698587 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3288/5948] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:04.215810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-41b10479-392d-4c03-9e19-3fe3f735182f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:04.279957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=5 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:04.282996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:04.289420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41b10479-392d-4c03-9e19-3fe3f735182f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:04.297811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41b10479-392d-4c03-9e19-3fe3f735182f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:04.298588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41b10479-392d-4c03-9e19-3fe3f735182f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:04.350502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-41b10479-392d-4c03-9e19-3fe3f735182f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Going to try to stop instance {{(pid=120452) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 22:31:04.442085 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-41b10479-392d-4c03-9e19-3fe3f735182f tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "POST /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/action" status: 202 len: 0 microversion: 2.1 time: 0.230768 Oct 12 22:31:04.443638 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2661/5949] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:31:04 2022] POST /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:31:04.453637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8a6dddbc-d1d5-43c5-9bbe-d0adedeae327 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:04.454397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8a6dddbc-d1d5-43c5-9bbe-d0adedeae327 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:04.475636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a6dddbc-d1d5-43c5-9bbe-d0adedeae327 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:04.476141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a6dddbc-d1d5-43c5-9bbe-d0adedeae327 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:04.476589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a6dddbc-d1d5-43c5-9bbe-d0adedeae327 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:04.481181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a6dddbc-d1d5-43c5-9bbe-d0adedeae327 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:04.484431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a6dddbc-d1d5-43c5-9bbe-d0adedeae327 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:04.485144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a6dddbc-d1d5-43c5-9bbe-d0adedeae327 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:04.490231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=36 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:04.798294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8a6dddbc-d1d5-43c5-9bbe-d0adedeae327 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:04.810123 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8a6dddbc-d1d5-43c5-9bbe-d0adedeae327 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1676 microversion: 2.1 time: 0.362237 Oct 12 22:31:04.814615 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3289/5950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:04 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1676 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:05.837626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-66ba4f5e-5f14-47ae-abba-49fcfdcbd759 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:05.838360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-66ba4f5e-5f14-47ae-abba-49fcfdcbd759 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:05.851018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66ba4f5e-5f14-47ae-abba-49fcfdcbd759 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:05.853691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66ba4f5e-5f14-47ae-abba-49fcfdcbd759 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:05.854216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66ba4f5e-5f14-47ae-abba-49fcfdcbd759 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:05.854973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66ba4f5e-5f14-47ae-abba-49fcfdcbd759 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:05.855473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66ba4f5e-5f14-47ae-abba-49fcfdcbd759 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:05.855917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66ba4f5e-5f14-47ae-abba-49fcfdcbd759 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:06.350164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-66ba4f5e-5f14-47ae-abba-49fcfdcbd759 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:06.393988 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-66ba4f5e-5f14-47ae-abba-49fcfdcbd759 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1676 microversion: 2.1 time: 0.557168 Oct 12 22:31:06.394929 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2662/5951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:05 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1676 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:07.418953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-486b908e-449e-44ca-83b7-da73e9fa9021 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:07.419881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-486b908e-449e-44ca-83b7-da73e9fa9021 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:07.442546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-486b908e-449e-44ca-83b7-da73e9fa9021 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:07.443366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-486b908e-449e-44ca-83b7-da73e9fa9021 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:07.447179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-486b908e-449e-44ca-83b7-da73e9fa9021 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:07.448843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-486b908e-449e-44ca-83b7-da73e9fa9021 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:07.453707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-486b908e-449e-44ca-83b7-da73e9fa9021 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:07.456607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-486b908e-449e-44ca-83b7-da73e9fa9021 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:07.892553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-486b908e-449e-44ca-83b7-da73e9fa9021 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:07.902499 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-486b908e-449e-44ca-83b7-da73e9fa9021 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1676 microversion: 2.1 time: 0.488163 Oct 12 22:31:07.916842 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3290/5952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:07 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1676 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:08.931103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-73fb2a6a-8bd4-4902-b314-02e71f43ee9a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:08.933046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-73fb2a6a-8bd4-4902-b314-02e71f43ee9a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:08.944006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73fb2a6a-8bd4-4902-b314-02e71f43ee9a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:08.945342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73fb2a6a-8bd4-4902-b314-02e71f43ee9a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:08.946137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73fb2a6a-8bd4-4902-b314-02e71f43ee9a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:08.948090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73fb2a6a-8bd4-4902-b314-02e71f43ee9a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:08.948736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73fb2a6a-8bd4-4902-b314-02e71f43ee9a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:08.949319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73fb2a6a-8bd4-4902-b314-02e71f43ee9a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:09.339201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-73fb2a6a-8bd4-4902-b314-02e71f43ee9a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:09.348922 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-73fb2a6a-8bd4-4902-b314-02e71f43ee9a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1676 microversion: 2.1 time: 0.424495 Oct 12 22:31:09.349589 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2663/5953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:08 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1676 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:10.374643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8cf6e3a9-0967-4712-b3de-d6532176a060 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:10.375408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8cf6e3a9-0967-4712-b3de-d6532176a060 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:10.387201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8cf6e3a9-0967-4712-b3de-d6532176a060 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:10.388468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8cf6e3a9-0967-4712-b3de-d6532176a060 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:10.390097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8cf6e3a9-0967-4712-b3de-d6532176a060 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:10.390841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8cf6e3a9-0967-4712-b3de-d6532176a060 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:10.391309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8cf6e3a9-0967-4712-b3de-d6532176a060 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:10.393870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8cf6e3a9-0967-4712-b3de-d6532176a060 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:10.872311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8cf6e3a9-0967-4712-b3de-d6532176a060 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:10.904682 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8cf6e3a9-0967-4712-b3de-d6532176a060 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1676 microversion: 2.1 time: 0.534663 Oct 12 22:31:10.905473 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3291/5954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:10 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1676 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:11.935410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b6f2f39d-bf4d-4150-89c1-f358e32c54a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:11.936276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b6f2f39d-bf4d-4150-89c1-f358e32c54a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:11.950545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6f2f39d-bf4d-4150-89c1-f358e32c54a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:11.953524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6f2f39d-bf4d-4150-89c1-f358e32c54a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:11.955482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6f2f39d-bf4d-4150-89c1-f358e32c54a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:11.957574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6f2f39d-bf4d-4150-89c1-f358e32c54a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:11.962366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6f2f39d-bf4d-4150-89c1-f358e32c54a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:11.962860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6f2f39d-bf4d-4150-89c1-f358e32c54a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:12.517631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b6f2f39d-bf4d-4150-89c1-f358e32c54a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:12.535160 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b6f2f39d-bf4d-4150-89c1-f358e32c54a9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1676 microversion: 2.1 time: 0.604876 Oct 12 22:31:12.537790 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2664/5955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:11 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1676 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:13.569058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0d5e9fa0-80ee-4085-b948-2e101714bdd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:13.570379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0d5e9fa0-80ee-4085-b948-2e101714bdd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:13.588691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d5e9fa0-80ee-4085-b948-2e101714bdd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:13.591006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d5e9fa0-80ee-4085-b948-2e101714bdd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:13.591899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d5e9fa0-80ee-4085-b948-2e101714bdd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:13.594958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d5e9fa0-80ee-4085-b948-2e101714bdd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:13.595880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d5e9fa0-80ee-4085-b948-2e101714bdd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:13.597515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d5e9fa0-80ee-4085-b948-2e101714bdd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:13.909927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0d5e9fa0-80ee-4085-b948-2e101714bdd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:13.923559 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0d5e9fa0-80ee-4085-b948-2e101714bdd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1676 microversion: 2.1 time: 0.358512 Oct 12 22:31:13.925676 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3292/5956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:13 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1676 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:14.956585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-46252dbe-9261-4713-b359-2225822d5c77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:14.957318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-46252dbe-9261-4713-b359-2225822d5c77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:14.968788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46252dbe-9261-4713-b359-2225822d5c77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:14.973631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46252dbe-9261-4713-b359-2225822d5c77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:14.974281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46252dbe-9261-4713-b359-2225822d5c77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:14.975202 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46252dbe-9261-4713-b359-2225822d5c77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:14.975839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46252dbe-9261-4713-b359-2225822d5c77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:14.977773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46252dbe-9261-4713-b359-2225822d5c77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:15.304168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-46252dbe-9261-4713-b359-2225822d5c77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:15.321433 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-46252dbe-9261-4713-b359-2225822d5c77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1653 microversion: 2.1 time: 0.365100 Oct 12 22:31:15.335267 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2665/5957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:14 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1653 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:15.355133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-36c32417-9f88-4ebf-9f2d-a1e0ffdce20c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:15.369132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36c32417-9f88-4ebf-9f2d-a1e0ffdce20c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:15.369653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36c32417-9f88-4ebf-9f2d-a1e0ffdce20c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:15.370105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36c32417-9f88-4ebf-9f2d-a1e0ffdce20c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:15.423788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-36c32417-9f88-4ebf-9f2d-a1e0ffdce20c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Going to try to start instance {{(pid=120453) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 22:31:15.513406 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-36c32417-9f88-4ebf-9f2d-a1e0ffdce20c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "POST /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/action" status: 202 len: 0 microversion: 2.1 time: 0.165467 Oct 12 22:31:15.517544 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3293/5958] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:31:15 2022] POST /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:31:15.529550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-76ce0c37-0fdc-4c03-af91-7f187277fc3c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:15.530092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-76ce0c37-0fdc-4c03-af91-7f187277fc3c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:15.549986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76ce0c37-0fdc-4c03-af91-7f187277fc3c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:15.550485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76ce0c37-0fdc-4c03-af91-7f187277fc3c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:15.550926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76ce0c37-0fdc-4c03-af91-7f187277fc3c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:15.560125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76ce0c37-0fdc-4c03-af91-7f187277fc3c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:15.560755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76ce0c37-0fdc-4c03-af91-7f187277fc3c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:15.561215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-76ce0c37-0fdc-4c03-af91-7f187277fc3c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:16.140261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-76ce0c37-0fdc-4c03-af91-7f187277fc3c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:16.159091 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-76ce0c37-0fdc-4c03-af91-7f187277fc3c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1662 microversion: 2.1 time: 0.633983 Oct 12 22:31:16.160376 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2666/5959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:15 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1662 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:17.186164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3f4bbee8-7d9d-49b0-9c1a-35f2d73c9ae2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:17.186882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3f4bbee8-7d9d-49b0-9c1a-35f2d73c9ae2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:17.198261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=18 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:17.204993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f4bbee8-7d9d-49b0-9c1a-35f2d73c9ae2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:17.205542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f4bbee8-7d9d-49b0-9c1a-35f2d73c9ae2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:17.212431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f4bbee8-7d9d-49b0-9c1a-35f2d73c9ae2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:17.223061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f4bbee8-7d9d-49b0-9c1a-35f2d73c9ae2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:17.223061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f4bbee8-7d9d-49b0-9c1a-35f2d73c9ae2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:17.223061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f4bbee8-7d9d-49b0-9c1a-35f2d73c9ae2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:17.925496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3f4bbee8-7d9d-49b0-9c1a-35f2d73c9ae2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:17.956461 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3f4bbee8-7d9d-49b0-9c1a-35f2d73c9ae2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1662 microversion: 2.1 time: 0.774437 Oct 12 22:31:17.962183 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3294/5960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:17 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1662 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:18.989339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7597aabd-b401-4b33-b0ee-0c97a4c21941 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:18.989964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7597aabd-b401-4b33-b0ee-0c97a4c21941 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:19.003790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7597aabd-b401-4b33-b0ee-0c97a4c21941 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:19.016797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7597aabd-b401-4b33-b0ee-0c97a4c21941 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:19.017517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7597aabd-b401-4b33-b0ee-0c97a4c21941 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:19.022291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7597aabd-b401-4b33-b0ee-0c97a4c21941 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:19.023008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7597aabd-b401-4b33-b0ee-0c97a4c21941 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:19.023711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7597aabd-b401-4b33-b0ee-0c97a4c21941 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:19.718101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7597aabd-b401-4b33-b0ee-0c97a4c21941 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:19.727962 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7597aabd-b401-4b33-b0ee-0c97a4c21941 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1666 microversion: 2.1 time: 0.746167 Oct 12 22:31:19.758172 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2667/5961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:18 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1666 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:25.053620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ef547da7-fc57-4af3-a59e-7657aed85ebe tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Action: 'create', calling method: .version_select at 0x7f5122c51310>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1011984007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQx1z/5cTtN1RMFFHDkBawm4F0jXI3yhBYOdtj0EYTLsQFenG1cFdYAxpAHUmsBNfNV50yG3WcbGQclHIOWSVnLTXwgUqgodToYUYNgCSxcEzv6Zbw/XdRIKv8nPbYUVQ=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:25.113340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-ef547da7-fc57-4af3-a59e-7657aed85ebe tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Getting quotas for project 08d857098e294c8da4f73d273912cdf3. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:31:25.142033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-ef547da7-fc57-4af3-a59e-7657aed85ebe tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Getting quotas for user a672bb095f984fb7b23d1acd55902865 and project 08d857098e294c8da4f73d273912cdf3. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:31:25.207524 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ef547da7-fc57-4af3-a59e-7657aed85ebe tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.158625 Oct 12 22:31:25.214676 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3295/5962] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:31:25 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:26.026937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-65c5909f-bdd6-4dc2-bb81-4d69c9b7f1e2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:26.027609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-65c5909f-bdd6-4dc2-bb81-4d69c9b7f1e2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:26.040357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65c5909f-bdd6-4dc2-bb81-4d69c9b7f1e2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:26.040858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65c5909f-bdd6-4dc2-bb81-4d69c9b7f1e2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:26.041302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65c5909f-bdd6-4dc2-bb81-4d69c9b7f1e2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:26.042012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65c5909f-bdd6-4dc2-bb81-4d69c9b7f1e2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:26.049086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65c5909f-bdd6-4dc2-bb81-4d69c9b7f1e2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:26.049086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65c5909f-bdd6-4dc2-bb81-4d69c9b7f1e2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:26.103986 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-65c5909f-bdd6-4dc2-bb81-4d69c9b7f1e2 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d/ips" status: 200 len: 152 microversion: 2.20 time: 0.082050 Oct 12 22:31:26.105197 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2668/5963] 10.222.0.16 () {60 vars in 1289 bytes} [Wed Oct 12 22:31:26 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d/ips => generated 152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:31:29.380854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:29.385843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1161141790", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "015dc8a1-6fb4-4e28-aab5-9ce4d654805e"}], "key_name": "tempest-TestNetworkBasicOps-1011984007", "security_groups": [{"name": "tempest-secgroup-smoke-65799827"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:29.605573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] validate_networks() for [('015dc8a1-6fb4-4e28-aab5-9ce4d654805e', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:31:30.122418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9a941273-f77d-449d-affc-698414cd4f69 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:30.131927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9a941273-f77d-449d-affc-698414cd4f69 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:30.145565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a941273-f77d-449d-affc-698414cd4f69 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:30.146911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a941273-f77d-449d-affc-698414cd4f69 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:30.147998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a941273-f77d-449d-affc-698414cd4f69 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:30.150523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a941273-f77d-449d-affc-698414cd4f69 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:30.151418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a941273-f77d-449d-affc-698414cd4f69 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:30.152152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a941273-f77d-449d-affc-698414cd4f69 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:30.191292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-9a941273-f77d-449d-affc-698414cd4f69 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lazy-loading 'flavor' on Instance uuid ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:31:30.428235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:31:30.429326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:31:30.430018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:31:30.430673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:31:30.431456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:31:30.447997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:30.450447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:30.451146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:30.454249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:30.455022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:30.455723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:30.502918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Getting quotas for project 08d857098e294c8da4f73d273912cdf3. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:31:30.515372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Getting quotas for user a672bb095f984fb7b23d1acd55902865 and project 08d857098e294c8da4f73d273912cdf3. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:31:30.545732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:31:30.553635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:31:30.656781 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9a941273-f77d-449d-affc-698414cd4f69 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "POST /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d/action" status: 202 len: 0 microversion: 2.20 time: 0.545946 Oct 12 22:31:30.658502 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2669/5964] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 12 22:31:30 2022] POST /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:31:30.668067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1e921160-f5eb-4360-962d-3ba3e4ab175c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:30.675706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1e921160-f5eb-4360-962d-3ba3e4ab175c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:30.695721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e921160-f5eb-4360-962d-3ba3e4ab175c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:30.696719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e921160-f5eb-4360-962d-3ba3e4ab175c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:30.697366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e921160-f5eb-4360-962d-3ba3e4ab175c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:30.698294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e921160-f5eb-4360-962d-3ba3e4ab175c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:30.698897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e921160-f5eb-4360-962d-3ba3e4ab175c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:30.699516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e921160-f5eb-4360-962d-3ba3e4ab175c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:30.734162 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9ab37050-f219-496b-93e2-998b96e14ee4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.354809 Oct 12 22:31:30.740406 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3296/5965] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:31:29 2022] POST /compute/v2.1/servers => generated 404 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:31:30.756042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-658b28d9-c821-4201-9fdf-1b02d224cd33 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:30.756953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-658b28d9-c821-4201-9fdf-1b02d224cd33 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:30.896609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-658b28d9-c821-4201-9fdf-1b02d224cd33 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:30.903562 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-658b28d9-c821-4201-9fdf-1b02d224cd33 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 200 len: 1249 microversion: 2.1 time: 0.159562 Oct 12 22:31:30.904154 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3297/5966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:30 2022] GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 1249 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:31.342049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1e921160-f5eb-4360-962d-3ba3e4ab175c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:31.357366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1e921160-f5eb-4360-962d-3ba3e4ab175c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:31.399304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1e921160-f5eb-4360-962d-3ba3e4ab175c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:31.404993 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1e921160-f5eb-4360-962d-3ba3e4ab175c tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1725 microversion: 2.20 time: 0.737562 Oct 12 22:31:31.409921 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2670/5967] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:30 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1725 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:31.926580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-72b8ef52-f31d-4810-be67-f1bd7e74b0a7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:31.928502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-72b8ef52-f31d-4810-be67-f1bd7e74b0a7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:31.950783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72b8ef52-f31d-4810-be67-f1bd7e74b0a7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:31.951873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72b8ef52-f31d-4810-be67-f1bd7e74b0a7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:31.952508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72b8ef52-f31d-4810-be67-f1bd7e74b0a7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:31.958323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72b8ef52-f31d-4810-be67-f1bd7e74b0a7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:31.960714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72b8ef52-f31d-4810-be67-f1bd7e74b0a7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:31.967120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-72b8ef52-f31d-4810-be67-f1bd7e74b0a7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:32.123897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-72b8ef52-f31d-4810-be67-f1bd7e74b0a7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:32.133355 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-72b8ef52-f31d-4810-be67-f1bd7e74b0a7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 200 len: 1253 microversion: 2.1 time: 0.211202 Oct 12 22:31:32.150293 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3298/5968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:31 2022] GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 1253 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:32.433740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bd2a720b-d928-4b0a-9317-63520f4017ed tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:32.434349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bd2a720b-d928-4b0a-9317-63520f4017ed tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:32.448831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd2a720b-d928-4b0a-9317-63520f4017ed tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:32.454927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd2a720b-d928-4b0a-9317-63520f4017ed tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:32.455610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd2a720b-d928-4b0a-9317-63520f4017ed tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:32.456673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd2a720b-d928-4b0a-9317-63520f4017ed tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:32.457293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd2a720b-d928-4b0a-9317-63520f4017ed tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:32.460650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd2a720b-d928-4b0a-9317-63520f4017ed tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:33.159201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fc04bcdb-fa14-4cea-8329-554f63c83e6b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:33.159895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fc04bcdb-fa14-4cea-8329-554f63c83e6b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:33.170106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc04bcdb-fa14-4cea-8329-554f63c83e6b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:33.184345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc04bcdb-fa14-4cea-8329-554f63c83e6b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:33.185009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc04bcdb-fa14-4cea-8329-554f63c83e6b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:33.188677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc04bcdb-fa14-4cea-8329-554f63c83e6b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:33.189698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc04bcdb-fa14-4cea-8329-554f63c83e6b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:33.190144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc04bcdb-fa14-4cea-8329-554f63c83e6b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:33.254139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd2a720b-d928-4b0a-9317-63520f4017ed tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:33.268843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd2a720b-d928-4b0a-9317-63520f4017ed tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:33.270372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd2a720b-d928-4b0a-9317-63520f4017ed tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:33.271619 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bd2a720b-d928-4b0a-9317-63520f4017ed tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1725 microversion: 2.20 time: 0.841795 Oct 12 22:31:33.289096 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2671/5969] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:32 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1725 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:33.340611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fc04bcdb-fa14-4cea-8329-554f63c83e6b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:33.351456 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fc04bcdb-fa14-4cea-8329-554f63c83e6b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 200 len: 1309 microversion: 2.1 time: 0.196690 Oct 12 22:31:33.352050 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3299/5970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:33 2022] GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 1309 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:34.316150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-593153d2-233c-4baa-ae16-8714f1ad4468 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:34.317471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-593153d2-233c-4baa-ae16-8714f1ad4468 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:34.321804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=23 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:34.334392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-593153d2-233c-4baa-ae16-8714f1ad4468 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:34.335042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-593153d2-233c-4baa-ae16-8714f1ad4468 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:34.335707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-593153d2-233c-4baa-ae16-8714f1ad4468 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:34.336588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-593153d2-233c-4baa-ae16-8714f1ad4468 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:34.337190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-593153d2-233c-4baa-ae16-8714f1ad4468 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:34.337785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-593153d2-233c-4baa-ae16-8714f1ad4468 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:34.379627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2932214b-42dd-47ea-9e72-5f40afa8cb87 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:34.380392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2932214b-42dd-47ea-9e72-5f40afa8cb87 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:34.396267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2932214b-42dd-47ea-9e72-5f40afa8cb87 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:34.396267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2932214b-42dd-47ea-9e72-5f40afa8cb87 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:34.396721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2932214b-42dd-47ea-9e72-5f40afa8cb87 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:34.407341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2932214b-42dd-47ea-9e72-5f40afa8cb87 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:34.409747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:34.410237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2932214b-42dd-47ea-9e72-5f40afa8cb87 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:34.410857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2932214b-42dd-47ea-9e72-5f40afa8cb87 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:34.741041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2932214b-42dd-47ea-9e72-5f40afa8cb87 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:34.750015 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2932214b-42dd-47ea-9e72-5f40afa8cb87 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 200 len: 1307 microversion: 2.1 time: 0.375516 Oct 12 22:31:34.756085 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3300/5971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:34 2022] GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 1307 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:34.866965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-593153d2-233c-4baa-ae16-8714f1ad4468 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:34.876263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-593153d2-233c-4baa-ae16-8714f1ad4468 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:34.877739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-593153d2-233c-4baa-ae16-8714f1ad4468 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:34.878930 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-593153d2-233c-4baa-ae16-8714f1ad4468 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1725 microversion: 2.20 time: 0.567111 Oct 12 22:31:34.885807 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2672/5972] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:34 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1725 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:35.778134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6630f021-845e-4146-850f-c1794082749a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:35.778756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6630f021-845e-4146-850f-c1794082749a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:35.795098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6630f021-845e-4146-850f-c1794082749a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:35.795658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6630f021-845e-4146-850f-c1794082749a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:35.796107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6630f021-845e-4146-850f-c1794082749a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:35.796822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6630f021-845e-4146-850f-c1794082749a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:35.797283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6630f021-845e-4146-850f-c1794082749a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:35.797734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6630f021-845e-4146-850f-c1794082749a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:35.909861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-10a45358-02dd-4493-8875-951183715eca tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:35.911142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-10a45358-02dd-4493-8875-951183715eca tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:35.933700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10a45358-02dd-4493-8875-951183715eca tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:35.934212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10a45358-02dd-4493-8875-951183715eca tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:35.934646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10a45358-02dd-4493-8875-951183715eca tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:35.943673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10a45358-02dd-4493-8875-951183715eca tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:35.944077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10a45358-02dd-4493-8875-951183715eca tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:35.944536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10a45358-02dd-4493-8875-951183715eca tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:36.249484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6630f021-845e-4146-850f-c1794082749a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:36.269925 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6630f021-845e-4146-850f-c1794082749a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 200 len: 1373 microversion: 2.1 time: 0.495594 Oct 12 22:31:36.275060 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3301/5973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:35 2022] GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 1373 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:37.303153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1a86334c-2042-4a97-900e-83874a302562 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:37.314813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1a86334c-2042-4a97-900e-83874a302562 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:37.321774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-10a45358-02dd-4493-8875-951183715eca tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:37.334480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a86334c-2042-4a97-900e-83874a302562 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:37.335062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a86334c-2042-4a97-900e-83874a302562 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:37.335550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a86334c-2042-4a97-900e-83874a302562 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:37.336292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a86334c-2042-4a97-900e-83874a302562 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:37.336760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a86334c-2042-4a97-900e-83874a302562 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:37.337206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a86334c-2042-4a97-900e-83874a302562 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:37.338875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-10a45358-02dd-4493-8875-951183715eca tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:37.348153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-10a45358-02dd-4493-8875-951183715eca tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:37.355215 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-10a45358-02dd-4493-8875-951183715eca tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1725 microversion: 2.20 time: 1.443650 Oct 12 22:31:37.356449 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2673/5974] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:35 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1725 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:31:37.717475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a86334c-2042-4a97-900e-83874a302562 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:37.729575 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1a86334c-2042-4a97-900e-83874a302562 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 200 len: 1373 microversion: 2.1 time: 0.435393 Oct 12 22:31:37.739496 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3302/5975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:37 2022] GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 1373 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:31:38.080729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-3abd30c4-bf61-4339-a3f5-a72018e6a5cd req-99a2b8bf-76c5-48c8-ba57-1e7a25c5bfac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7", "tag": "08cb1665-4138-4239-8f71-66221aea4b2f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:38.107752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3abd30c4-bf61-4339-a3f5-a72018e6a5cd req-99a2b8bf-76c5-48c8-ba57-1e7a25c5bfac service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:38.108251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3abd30c4-bf61-4339-a3f5-a72018e6a5cd req-99a2b8bf-76c5-48c8-ba57-1e7a25c5bfac service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:38.120231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3abd30c4-bf61-4339-a3f5-a72018e6a5cd req-99a2b8bf-76c5-48c8-ba57-1e7a25c5bfac service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:38.145936 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-3abd30c4-bf61-4339-a3f5-a72018e6a5cd req-99a2b8bf-76c5-48c8-ba57-1e7a25c5bfac service nova] Creating event network-changed:08cb1665-4138-4239-8f71-66221aea4b2f for instance e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 on n-h2-861111-1 Oct 12 22:31:38.153079 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-3abd30c4-bf61-4339-a3f5-a72018e6a5cd req-99a2b8bf-76c5-48c8-ba57-1e7a25c5bfac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.488298 Oct 12 22:31:38.161914 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2674/5976] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:38.390062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-861d54bc-f9f1-4e1b-b8c2-cf6a1473d4d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:38.390817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-861d54bc-f9f1-4e1b-b8c2-cf6a1473d4d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:38.427517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-861d54bc-f9f1-4e1b-b8c2-cf6a1473d4d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:38.429497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-861d54bc-f9f1-4e1b-b8c2-cf6a1473d4d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:38.431249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-861d54bc-f9f1-4e1b-b8c2-cf6a1473d4d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:38.432046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-861d54bc-f9f1-4e1b-b8c2-cf6a1473d4d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:38.432519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-861d54bc-f9f1-4e1b-b8c2-cf6a1473d4d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:38.432959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-861d54bc-f9f1-4e1b-b8c2-cf6a1473d4d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:38.779879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1e1a9f73-e2ce-4f21-924e-49c0609bec53 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:38.780597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1e1a9f73-e2ce-4f21-924e-49c0609bec53 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:38.811429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e1a9f73-e2ce-4f21-924e-49c0609bec53 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:38.811958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e1a9f73-e2ce-4f21-924e-49c0609bec53 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:38.812407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e1a9f73-e2ce-4f21-924e-49c0609bec53 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:38.816847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e1a9f73-e2ce-4f21-924e-49c0609bec53 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:38.817229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e1a9f73-e2ce-4f21-924e-49c0609bec53 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:38.817534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e1a9f73-e2ce-4f21-924e-49c0609bec53 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:38.849897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-861d54bc-f9f1-4e1b-b8c2-cf6a1473d4d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:38.863683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-861d54bc-f9f1-4e1b-b8c2-cf6a1473d4d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:38.875853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-861d54bc-f9f1-4e1b-b8c2-cf6a1473d4d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:38.878066 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-861d54bc-f9f1-4e1b-b8c2-cf6a1473d4d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1725 microversion: 2.20 time: 0.494748 Oct 12 22:31:38.878860 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3303/5977] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:38 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1725 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:39.341766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1e1a9f73-e2ce-4f21-924e-49c0609bec53 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:39.351171 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1e1a9f73-e2ce-4f21-924e-49c0609bec53 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 200 len: 1373 microversion: 2.1 time: 0.596634 Oct 12 22:31:39.352570 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2675/5978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:38 2022] GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 1373 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:39.907333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-10991a11-99a8-4ffb-a5c0-1a805731525a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:39.908842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-10991a11-99a8-4ffb-a5c0-1a805731525a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:39.917163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10991a11-99a8-4ffb-a5c0-1a805731525a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:39.917678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10991a11-99a8-4ffb-a5c0-1a805731525a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:39.918070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10991a11-99a8-4ffb-a5c0-1a805731525a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:39.918822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10991a11-99a8-4ffb-a5c0-1a805731525a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:39.919290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10991a11-99a8-4ffb-a5c0-1a805731525a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:39.919905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10991a11-99a8-4ffb-a5c0-1a805731525a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:40.177279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-10991a11-99a8-4ffb-a5c0-1a805731525a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:40.203219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-10991a11-99a8-4ffb-a5c0-1a805731525a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:40.206344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-10991a11-99a8-4ffb-a5c0-1a805731525a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:40.208719 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-10991a11-99a8-4ffb-a5c0-1a805731525a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1725 microversion: 2.20 time: 0.306885 Oct 12 22:31:40.223484 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3304/5979] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:39 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1725 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:40.376177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-615db517-0090-49c7-a58a-1ca4228aea38 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:40.377400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-615db517-0090-49c7-a58a-1ca4228aea38 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:40.389121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-615db517-0090-49c7-a58a-1ca4228aea38 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:40.389619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-615db517-0090-49c7-a58a-1ca4228aea38 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:40.390055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-615db517-0090-49c7-a58a-1ca4228aea38 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:40.390760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-615db517-0090-49c7-a58a-1ca4228aea38 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:40.391212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-615db517-0090-49c7-a58a-1ca4228aea38 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:40.392191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-615db517-0090-49c7-a58a-1ca4228aea38 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:41.106943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-615db517-0090-49c7-a58a-1ca4228aea38 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:41.125119 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-615db517-0090-49c7-a58a-1ca4228aea38 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 200 len: 1373 microversion: 2.1 time: 0.752070 Oct 12 22:31:41.129292 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2676/5980] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:40 2022] GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 1373 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:41.234788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-007e9051-f400-46d4-9b22-adfe0261190e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:41.235505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-007e9051-f400-46d4-9b22-adfe0261190e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:41.237599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:41.238285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=12 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:41.252020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-007e9051-f400-46d4-9b22-adfe0261190e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:41.252736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-007e9051-f400-46d4-9b22-adfe0261190e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:41.253008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-007e9051-f400-46d4-9b22-adfe0261190e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:41.257217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-007e9051-f400-46d4-9b22-adfe0261190e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:41.257726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-007e9051-f400-46d4-9b22-adfe0261190e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:41.258172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-007e9051-f400-46d4-9b22-adfe0261190e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:41.510912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-007e9051-f400-46d4-9b22-adfe0261190e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:41.523129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-007e9051-f400-46d4-9b22-adfe0261190e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:41.523129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-007e9051-f400-46d4-9b22-adfe0261190e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:41.524392 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-007e9051-f400-46d4-9b22-adfe0261190e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1746 microversion: 2.20 time: 0.294241 Oct 12 22:31:41.525281 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3305/5981] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:41 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1746 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:42.152906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-db4fb404-caec-48bb-a04c-989ee7d20e19 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:42.154363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-db4fb404-caec-48bb-a04c-989ee7d20e19 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:42.163454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db4fb404-caec-48bb-a04c-989ee7d20e19 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:42.164127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db4fb404-caec-48bb-a04c-989ee7d20e19 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:42.164567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db4fb404-caec-48bb-a04c-989ee7d20e19 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:42.165408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db4fb404-caec-48bb-a04c-989ee7d20e19 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:42.165860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db4fb404-caec-48bb-a04c-989ee7d20e19 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:42.166333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db4fb404-caec-48bb-a04c-989ee7d20e19 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:42.376878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-db4fb404-caec-48bb-a04c-989ee7d20e19 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:42.405689 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-db4fb404-caec-48bb-a04c-989ee7d20e19 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 200 len: 1373 microversion: 2.1 time: 0.254691 Oct 12 22:31:42.406804 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2677/5982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:42 2022] GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 1373 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:42.554107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-85d1bde0-8731-442d-a6a3-473d1a8b1c4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:42.554550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-85d1bde0-8731-442d-a6a3-473d1a8b1c4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:42.563156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85d1bde0-8731-442d-a6a3-473d1a8b1c4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:42.564288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85d1bde0-8731-442d-a6a3-473d1a8b1c4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:42.564671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85d1bde0-8731-442d-a6a3-473d1a8b1c4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:42.565377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85d1bde0-8731-442d-a6a3-473d1a8b1c4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:42.579991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85d1bde0-8731-442d-a6a3-473d1a8b1c4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:42.580831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85d1bde0-8731-442d-a6a3-473d1a8b1c4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:42.995300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-85d1bde0-8731-442d-a6a3-473d1a8b1c4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:43.004263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-85d1bde0-8731-442d-a6a3-473d1a8b1c4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:43.005726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-85d1bde0-8731-442d-a6a3-473d1a8b1c4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:43.006925 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-85d1bde0-8731-442d-a6a3-473d1a8b1c4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1746 microversion: 2.20 time: 0.457038 Oct 12 22:31:43.018888 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3306/5983] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:42 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1746 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:43.431128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-38b16a02-3293-49c2-a116-89871bddb750 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:43.431908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-38b16a02-3293-49c2-a116-89871bddb750 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:43.446800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38b16a02-3293-49c2-a116-89871bddb750 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:43.448047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38b16a02-3293-49c2-a116-89871bddb750 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:43.448649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38b16a02-3293-49c2-a116-89871bddb750 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:43.452099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38b16a02-3293-49c2-a116-89871bddb750 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:43.456256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38b16a02-3293-49c2-a116-89871bddb750 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:43.458193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38b16a02-3293-49c2-a116-89871bddb750 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:43.526808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-49d66b1c-f0a3-4db1-83c3-48973df9310d req-0bb047b7-6d08-4767-8391-1da31e9ff387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7", "name": "network-vif-plugged", "status": "completed", "tag": "08cb1665-4138-4239-8f71-66221aea4b2f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:43.552536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-49d66b1c-f0a3-4db1-83c3-48973df9310d req-0bb047b7-6d08-4767-8391-1da31e9ff387 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:43.553256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-49d66b1c-f0a3-4db1-83c3-48973df9310d req-0bb047b7-6d08-4767-8391-1da31e9ff387 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:43.553885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-49d66b1c-f0a3-4db1-83c3-48973df9310d req-0bb047b7-6d08-4767-8391-1da31e9ff387 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:43.604071 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-49d66b1c-f0a3-4db1-83c3-48973df9310d req-0bb047b7-6d08-4767-8391-1da31e9ff387 service nova] Creating event network-vif-plugged:08cb1665-4138-4239-8f71-66221aea4b2f for instance e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 on n-h2-861111-1 Oct 12 22:31:43.616856 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-49d66b1c-f0a3-4db1-83c3-48973df9310d req-0bb047b7-6d08-4767-8391-1da31e9ff387 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095562 Oct 12 22:31:43.620976 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3307/5984] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:31:43.945797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-38b16a02-3293-49c2-a116-89871bddb750 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:43.958812 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-38b16a02-3293-49c2-a116-89871bddb750 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 200 len: 1373 microversion: 2.1 time: 0.531482 Oct 12 22:31:43.967267 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2678/5985] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:43 2022] GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 1373 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:44.063062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e06193e6-3e5c-43eb-a97e-587d9550574e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:44.065496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e06193e6-3e5c-43eb-a97e-587d9550574e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:44.087025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e06193e6-3e5c-43eb-a97e-587d9550574e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:44.088177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e06193e6-3e5c-43eb-a97e-587d9550574e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:44.088878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e06193e6-3e5c-43eb-a97e-587d9550574e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:44.089843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e06193e6-3e5c-43eb-a97e-587d9550574e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:44.090525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e06193e6-3e5c-43eb-a97e-587d9550574e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:44.091179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e06193e6-3e5c-43eb-a97e-587d9550574e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:44.482561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e06193e6-3e5c-43eb-a97e-587d9550574e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:44.498166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e06193e6-3e5c-43eb-a97e-587d9550574e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:44.507765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e06193e6-3e5c-43eb-a97e-587d9550574e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:44.509033 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e06193e6-3e5c-43eb-a97e-587d9550574e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1741 microversion: 2.20 time: 0.463866 Oct 12 22:31:44.523262 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3308/5986] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:44 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1741 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:44.986250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b93341d3-b385-4482-9f22-d814050a376f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:44.987066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b93341d3-b385-4482-9f22-d814050a376f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:45.000013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b93341d3-b385-4482-9f22-d814050a376f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:45.000506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b93341d3-b385-4482-9f22-d814050a376f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:45.019673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b93341d3-b385-4482-9f22-d814050a376f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:45.020820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b93341d3-b385-4482-9f22-d814050a376f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:45.021471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b93341d3-b385-4482-9f22-d814050a376f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:45.022067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b93341d3-b385-4482-9f22-d814050a376f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:45.324941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b93341d3-b385-4482-9f22-d814050a376f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:45.334807 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b93341d3-b385-4482-9f22-d814050a376f tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 200 len: 1373 microversion: 2.1 time: 0.353469 Oct 12 22:31:45.336894 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2679/5987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:44 2022] GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 1373 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:45.534811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6ef90854-02f5-4822-a17f-518180d8baa7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:45.536969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6ef90854-02f5-4822-a17f-518180d8baa7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:45.551779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ef90854-02f5-4822-a17f-518180d8baa7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:45.552560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ef90854-02f5-4822-a17f-518180d8baa7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:45.553301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ef90854-02f5-4822-a17f-518180d8baa7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:45.554303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ef90854-02f5-4822-a17f-518180d8baa7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:45.555014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ef90854-02f5-4822-a17f-518180d8baa7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:45.555770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ef90854-02f5-4822-a17f-518180d8baa7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:45.713705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6ef90854-02f5-4822-a17f-518180d8baa7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:45.722631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6ef90854-02f5-4822-a17f-518180d8baa7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:45.724126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6ef90854-02f5-4822-a17f-518180d8baa7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:45.730657 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6ef90854-02f5-4822-a17f-518180d8baa7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1741 microversion: 2.20 time: 0.195342 Oct 12 22:31:45.731444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-feb9d011-b39c-4c36-80c8-75d08c37a738 req-ab81b890-8667-4d55-8d74-8c24ec2d649f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d", "name": "network-vif-plugged", "status": "completed", "tag": "ad849817-ecb6-4b77-a207-c06765b7f617"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:45.744091 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3309/5988] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:45 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1741 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:45.761687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-feb9d011-b39c-4c36-80c8-75d08c37a738 req-ab81b890-8667-4d55-8d74-8c24ec2d649f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:45.762575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-feb9d011-b39c-4c36-80c8-75d08c37a738 req-ab81b890-8667-4d55-8d74-8c24ec2d649f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:45.763733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-feb9d011-b39c-4c36-80c8-75d08c37a738 req-ab81b890-8667-4d55-8d74-8c24ec2d649f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:45.784624 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-feb9d011-b39c-4c36-80c8-75d08c37a738 req-ab81b890-8667-4d55-8d74-8c24ec2d649f service nova] Creating event network-vif-plugged:ad849817-ecb6-4b77-a207-c06765b7f617 for instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d on n-h1-861111-1 Oct 12 22:31:45.792288 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-feb9d011-b39c-4c36-80c8-75d08c37a738 req-ab81b890-8667-4d55-8d74-8c24ec2d649f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065364 Oct 12 22:31:45.798799 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2680/5989] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 12 22:31:46.366986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2c18d84e-625f-4530-a5dc-82c73ed483fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:46.367962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2c18d84e-625f-4530-a5dc-82c73ed483fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:46.385394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c18d84e-625f-4530-a5dc-82c73ed483fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:46.387114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c18d84e-625f-4530-a5dc-82c73ed483fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:46.388030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c18d84e-625f-4530-a5dc-82c73ed483fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:46.390184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c18d84e-625f-4530-a5dc-82c73ed483fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:46.393864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c18d84e-625f-4530-a5dc-82c73ed483fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:46.395943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c18d84e-625f-4530-a5dc-82c73ed483fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:46.772654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f61bcaf8-e7fc-4042-ad2c-bfdb665c6c3f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:46.773392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f61bcaf8-e7fc-4042-ad2c-bfdb665c6c3f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:46.789809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f61bcaf8-e7fc-4042-ad2c-bfdb665c6c3f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:46.790337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f61bcaf8-e7fc-4042-ad2c-bfdb665c6c3f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:46.790831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f61bcaf8-e7fc-4042-ad2c-bfdb665c6c3f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:46.791642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f61bcaf8-e7fc-4042-ad2c-bfdb665c6c3f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:46.792090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f61bcaf8-e7fc-4042-ad2c-bfdb665c6c3f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:46.792562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f61bcaf8-e7fc-4042-ad2c-bfdb665c6c3f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:47.033026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f61bcaf8-e7fc-4042-ad2c-bfdb665c6c3f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:47.068806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f61bcaf8-e7fc-4042-ad2c-bfdb665c6c3f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:47.081969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f61bcaf8-e7fc-4042-ad2c-bfdb665c6c3f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:47.084605 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f61bcaf8-e7fc-4042-ad2c-bfdb665c6c3f tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1741 microversion: 2.20 time: 0.317907 Oct 12 22:31:47.092938 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2681/5990] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:46 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1741 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:31:47.208538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2c18d84e-625f-4530-a5dc-82c73ed483fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:47.223958 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2c18d84e-625f-4530-a5dc-82c73ed483fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 200 len: 1546 microversion: 2.1 time: 0.856831 Oct 12 22:31:47.226153 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3310/5991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:46 2022] GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 1546 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:47.257036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e3fd3b0b-2443-464f-a578-5bb38e3a53b5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:47.257772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e3fd3b0b-2443-464f-a578-5bb38e3a53b5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:47.268951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3fd3b0b-2443-464f-a578-5bb38e3a53b5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:47.271810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3fd3b0b-2443-464f-a578-5bb38e3a53b5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:47.276082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3fd3b0b-2443-464f-a578-5bb38e3a53b5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:47.277133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3fd3b0b-2443-464f-a578-5bb38e3a53b5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:47.278032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3fd3b0b-2443-464f-a578-5bb38e3a53b5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:47.279722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3fd3b0b-2443-464f-a578-5bb38e3a53b5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:47.722077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e3fd3b0b-2443-464f-a578-5bb38e3a53b5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:47.737092 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e3fd3b0b-2443-464f-a578-5bb38e3a53b5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 200 len: 1546 microversion: 2.1 time: 0.484822 Oct 12 22:31:47.742452 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2682/5992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:47 2022] GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 1546 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:48.120568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2a2dcdde-f8f5-46f7-ba3b-9eb7c63bd11e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:48.121614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2a2dcdde-f8f5-46f7-ba3b-9eb7c63bd11e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:48.138114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:48.147463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a2dcdde-f8f5-46f7-ba3b-9eb7c63bd11e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:48.149750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a2dcdde-f8f5-46f7-ba3b-9eb7c63bd11e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:48.153219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a2dcdde-f8f5-46f7-ba3b-9eb7c63bd11e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:48.155362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a2dcdde-f8f5-46f7-ba3b-9eb7c63bd11e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:48.157626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a2dcdde-f8f5-46f7-ba3b-9eb7c63bd11e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:48.159623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a2dcdde-f8f5-46f7-ba3b-9eb7c63bd11e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:48.473912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2a2dcdde-f8f5-46f7-ba3b-9eb7c63bd11e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:48.489117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2a2dcdde-f8f5-46f7-ba3b-9eb7c63bd11e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:48.492020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2a2dcdde-f8f5-46f7-ba3b-9eb7c63bd11e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:48.499792 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2a2dcdde-f8f5-46f7-ba3b-9eb7c63bd11e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1741 microversion: 2.20 time: 0.381124 Oct 12 22:31:48.501231 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3311/5993] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:48 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1741 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:49.537675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-331acad4-68b3-4621-b59e-6057a2c79faf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:49.543549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-331acad4-68b3-4621-b59e-6057a2c79faf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:49.558529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-331acad4-68b3-4621-b59e-6057a2c79faf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:49.559407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-331acad4-68b3-4621-b59e-6057a2c79faf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:49.560026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-331acad4-68b3-4621-b59e-6057a2c79faf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:49.563682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-331acad4-68b3-4621-b59e-6057a2c79faf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:49.564387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-331acad4-68b3-4621-b59e-6057a2c79faf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:49.565016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-331acad4-68b3-4621-b59e-6057a2c79faf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:49.885875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-331acad4-68b3-4621-b59e-6057a2c79faf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:49.908340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-331acad4-68b3-4621-b59e-6057a2c79faf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:49.910912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-331acad4-68b3-4621-b59e-6057a2c79faf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:49.917020 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-331acad4-68b3-4621-b59e-6057a2c79faf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1741 microversion: 2.20 time: 0.388426 Oct 12 22:31:49.923642 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2683/5994] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:49 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1741 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:50.963939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-74e305cf-85ee-405b-81a1-62260953c6d7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:50.977803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-74e305cf-85ee-405b-81a1-62260953c6d7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:51.018868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74e305cf-85ee-405b-81a1-62260953c6d7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:51.022293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74e305cf-85ee-405b-81a1-62260953c6d7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:51.023266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74e305cf-85ee-405b-81a1-62260953c6d7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:51.025569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74e305cf-85ee-405b-81a1-62260953c6d7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:51.030269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74e305cf-85ee-405b-81a1-62260953c6d7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:51.032412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74e305cf-85ee-405b-81a1-62260953c6d7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:51.518720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-74e305cf-85ee-405b-81a1-62260953c6d7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:51.544027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-74e305cf-85ee-405b-81a1-62260953c6d7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:51.552617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-74e305cf-85ee-405b-81a1-62260953c6d7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:51.554266 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-74e305cf-85ee-405b-81a1-62260953c6d7 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1741 microversion: 2.20 time: 0.594969 Oct 12 22:31:51.576683 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3312/5995] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:50 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1741 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:52.604270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1cc636be-9287-4448-88aa-87de7f1a22d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:52.609209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1cc636be-9287-4448-88aa-87de7f1a22d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:52.646785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cc636be-9287-4448-88aa-87de7f1a22d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:52.651055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cc636be-9287-4448-88aa-87de7f1a22d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:52.657435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cc636be-9287-4448-88aa-87de7f1a22d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:52.659053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cc636be-9287-4448-88aa-87de7f1a22d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:52.664659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cc636be-9287-4448-88aa-87de7f1a22d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:52.669111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1cc636be-9287-4448-88aa-87de7f1a22d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:54.567507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1cc636be-9287-4448-88aa-87de7f1a22d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:54.577592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1cc636be-9287-4448-88aa-87de7f1a22d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:54.580452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1cc636be-9287-4448-88aa-87de7f1a22d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:54.582022 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1cc636be-9287-4448-88aa-87de7f1a22d5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1741 microversion: 2.20 time: 1.995802 Oct 12 22:31:54.582979 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2684/5996] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:52 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1741 bytes in 1997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:55.614161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4513716e-ea49-43e7-9850-fade1406f0ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:55.615138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4513716e-ea49-43e7-9850-fade1406f0ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:55.639118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4513716e-ea49-43e7-9850-fade1406f0ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:55.641502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4513716e-ea49-43e7-9850-fade1406f0ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:55.643449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4513716e-ea49-43e7-9850-fade1406f0ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:55.645427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4513716e-ea49-43e7-9850-fade1406f0ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:55.645910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4513716e-ea49-43e7-9850-fade1406f0ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:55.646345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4513716e-ea49-43e7-9850-fade1406f0ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:55.972254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4513716e-ea49-43e7-9850-fade1406f0ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:55.982681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4513716e-ea49-43e7-9850-fade1406f0ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:55.984208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4513716e-ea49-43e7-9850-fade1406f0ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:55.985450 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4513716e-ea49-43e7-9850-fade1406f0ef tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1741 microversion: 2.20 time: 0.375958 Oct 12 22:31:55.986025 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3313/5997] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:55 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1741 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:57.013131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f525a0d3-6558-46e1-a7c1-218603456dfd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:57.014365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f525a0d3-6558-46e1-a7c1-218603456dfd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:57.024507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f525a0d3-6558-46e1-a7c1-218603456dfd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:57.027397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f525a0d3-6558-46e1-a7c1-218603456dfd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:57.029655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f525a0d3-6558-46e1-a7c1-218603456dfd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:57.030617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f525a0d3-6558-46e1-a7c1-218603456dfd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:57.031879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f525a0d3-6558-46e1-a7c1-218603456dfd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:57.035622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f525a0d3-6558-46e1-a7c1-218603456dfd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:57.403268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f525a0d3-6558-46e1-a7c1-218603456dfd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:57.415555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f525a0d3-6558-46e1-a7c1-218603456dfd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:57.416998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f525a0d3-6558-46e1-a7c1-218603456dfd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:57.418174 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f525a0d3-6558-46e1-a7c1-218603456dfd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1741 microversion: 2.20 time: 0.408975 Oct 12 22:31:57.440241 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2685/5998] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:57 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1741 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:58.448507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4e3c9492-a976-41c4-8ef1-bd3693f09645 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:58.449073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4e3c9492-a976-41c4-8ef1-bd3693f09645 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:58.475731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e3c9492-a976-41c4-8ef1-bd3693f09645 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:58.476612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e3c9492-a976-41c4-8ef1-bd3693f09645 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:58.487184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e3c9492-a976-41c4-8ef1-bd3693f09645 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:58.489414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e3c9492-a976-41c4-8ef1-bd3693f09645 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:58.491328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e3c9492-a976-41c4-8ef1-bd3693f09645 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:58.492013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e3c9492-a976-41c4-8ef1-bd3693f09645 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:58.807940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4e3c9492-a976-41c4-8ef1-bd3693f09645 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:58.819451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:58.830429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4e3c9492-a976-41c4-8ef1-bd3693f09645 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:58.832348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4e3c9492-a976-41c4-8ef1-bd3693f09645 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:58.833773 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4e3c9492-a976-41c4-8ef1-bd3693f09645 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1741 microversion: 2.20 time: 0.389979 Oct 12 22:31:58.834870 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3314/5999] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:58 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1741 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:59.866927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2e3aa8ae-2b14-4abb-8bb0-ed80d03aac06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:59.868417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2e3aa8ae-2b14-4abb-8bb0-ed80d03aac06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:59.877611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e3aa8ae-2b14-4abb-8bb0-ed80d03aac06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:59.878576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e3aa8ae-2b14-4abb-8bb0-ed80d03aac06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:59.879525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e3aa8ae-2b14-4abb-8bb0-ed80d03aac06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:59.880770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e3aa8ae-2b14-4abb-8bb0-ed80d03aac06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:59.881445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e3aa8ae-2b14-4abb-8bb0-ed80d03aac06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:59.882091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e3aa8ae-2b14-4abb-8bb0-ed80d03aac06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:00.225435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2e3aa8ae-2b14-4abb-8bb0-ed80d03aac06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:00.247201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2e3aa8ae-2b14-4abb-8bb0-ed80d03aac06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:00.252569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2e3aa8ae-2b14-4abb-8bb0-ed80d03aac06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:00.258707 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2e3aa8ae-2b14-4abb-8bb0-ed80d03aac06 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1741 microversion: 2.20 time: 0.402522 Oct 12 22:32:00.261611 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2686/6000] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:59 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1741 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:01.289400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dfb9db1b-2434-41cc-9364-9f4b5df2c294 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:01.290025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dfb9db1b-2434-41cc-9364-9f4b5df2c294 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:01.299471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfb9db1b-2434-41cc-9364-9f4b5df2c294 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:01.300429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfb9db1b-2434-41cc-9364-9f4b5df2c294 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:01.301340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfb9db1b-2434-41cc-9364-9f4b5df2c294 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:01.302433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfb9db1b-2434-41cc-9364-9f4b5df2c294 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:01.303120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfb9db1b-2434-41cc-9364-9f4b5df2c294 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:01.303875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfb9db1b-2434-41cc-9364-9f4b5df2c294 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:01.645056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dfb9db1b-2434-41cc-9364-9f4b5df2c294 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:01.665059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dfb9db1b-2434-41cc-9364-9f4b5df2c294 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:01.669980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dfb9db1b-2434-41cc-9364-9f4b5df2c294 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:01.671219 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dfb9db1b-2434-41cc-9364-9f4b5df2c294 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1741 microversion: 2.20 time: 0.388324 Oct 12 22:32:01.671843 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3315/6001] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:01 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1741 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:02.701210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-94c81ff8-1781-4ccf-9b87-016e00a1da9a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:02.703677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-94c81ff8-1781-4ccf-9b87-016e00a1da9a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:02.717108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94c81ff8-1781-4ccf-9b87-016e00a1da9a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:02.720819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94c81ff8-1781-4ccf-9b87-016e00a1da9a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:02.722884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94c81ff8-1781-4ccf-9b87-016e00a1da9a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:02.724079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94c81ff8-1781-4ccf-9b87-016e00a1da9a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:02.726799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94c81ff8-1781-4ccf-9b87-016e00a1da9a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:02.727956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94c81ff8-1781-4ccf-9b87-016e00a1da9a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:03.027970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-94c81ff8-1781-4ccf-9b87-016e00a1da9a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:03.039661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-94c81ff8-1781-4ccf-9b87-016e00a1da9a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:03.042096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-94c81ff8-1781-4ccf-9b87-016e00a1da9a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:03.043528 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-94c81ff8-1781-4ccf-9b87-016e00a1da9a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1741 microversion: 2.20 time: 0.346279 Oct 12 22:32:03.044246 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2687/6002] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:02 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1741 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:04.069056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-79b10f2d-e3f4-43a6-9eb1-17c53e07bcdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:04.069674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-79b10f2d-e3f4-43a6-9eb1-17c53e07bcdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:04.086005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b10f2d-e3f4-43a6-9eb1-17c53e07bcdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:04.089758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b10f2d-e3f4-43a6-9eb1-17c53e07bcdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:04.090573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b10f2d-e3f4-43a6-9eb1-17c53e07bcdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:04.091505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b10f2d-e3f4-43a6-9eb1-17c53e07bcdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:04.097245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b10f2d-e3f4-43a6-9eb1-17c53e07bcdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:04.097939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-79b10f2d-e3f4-43a6-9eb1-17c53e07bcdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:04.346852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-79b10f2d-e3f4-43a6-9eb1-17c53e07bcdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:04.355783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-79b10f2d-e3f4-43a6-9eb1-17c53e07bcdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:04.366299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-79b10f2d-e3f4-43a6-9eb1-17c53e07bcdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:04.367738 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-79b10f2d-e3f4-43a6-9eb1-17c53e07bcdc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1741 microversion: 2.20 time: 0.302693 Oct 12 22:32:04.383945 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3316/6003] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:04 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1741 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:05.395182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0a460635-3360-48f0-8956-6f3691204e52 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:05.403543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0a460635-3360-48f0-8956-6f3691204e52 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:05.406998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=32 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:05.425708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a460635-3360-48f0-8956-6f3691204e52 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:05.426182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a460635-3360-48f0-8956-6f3691204e52 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:05.426621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a460635-3360-48f0-8956-6f3691204e52 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:05.427357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a460635-3360-48f0-8956-6f3691204e52 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:05.427815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a460635-3360-48f0-8956-6f3691204e52 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:05.428243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a460635-3360-48f0-8956-6f3691204e52 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:05.445508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=88 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:05.724699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0a460635-3360-48f0-8956-6f3691204e52 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:05.736643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0a460635-3360-48f0-8956-6f3691204e52 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:05.738876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0a460635-3360-48f0-8956-6f3691204e52 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:05.740436 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0a460635-3360-48f0-8956-6f3691204e52 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1741 microversion: 2.20 time: 0.350042 Oct 12 22:32:05.741566 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2688/6004] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:05 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1741 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:06.769594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dec2596d-6c71-4211-ab08-4223b4fbccee tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:06.770210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dec2596d-6c71-4211-ab08-4223b4fbccee tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:06.791505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dec2596d-6c71-4211-ab08-4223b4fbccee tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:06.795708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dec2596d-6c71-4211-ab08-4223b4fbccee tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:06.796362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dec2596d-6c71-4211-ab08-4223b4fbccee tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:06.797817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dec2596d-6c71-4211-ab08-4223b4fbccee tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:06.800532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dec2596d-6c71-4211-ab08-4223b4fbccee tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:06.802843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dec2596d-6c71-4211-ab08-4223b4fbccee tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:07.256124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dec2596d-6c71-4211-ab08-4223b4fbccee tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:07.268622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dec2596d-6c71-4211-ab08-4223b4fbccee tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:07.270573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dec2596d-6c71-4211-ab08-4223b4fbccee tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:07.272439 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dec2596d-6c71-4211-ab08-4223b4fbccee tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1741 microversion: 2.20 time: 0.507004 Oct 12 22:32:07.273566 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3317/6005] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:06 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1741 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:08.303519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c6d4751c-8002-4220-993c-62f7c3149852 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:08.304273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c6d4751c-8002-4220-993c-62f7c3149852 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:08.352061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6d4751c-8002-4220-993c-62f7c3149852 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:08.352569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6d4751c-8002-4220-993c-62f7c3149852 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:08.359648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6d4751c-8002-4220-993c-62f7c3149852 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:08.360403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6d4751c-8002-4220-993c-62f7c3149852 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:08.360872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6d4751c-8002-4220-993c-62f7c3149852 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:08.361295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6d4751c-8002-4220-993c-62f7c3149852 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:08.864612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c6d4751c-8002-4220-993c-62f7c3149852 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:08.875357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c6d4751c-8002-4220-993c-62f7c3149852 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:08.877439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c6d4751c-8002-4220-993c-62f7c3149852 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:08.878978 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c6d4751c-8002-4220-993c-62f7c3149852 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1723 microversion: 2.20 time: 0.580593 Oct 12 22:32:08.880100 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2689/6006] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:08 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1723 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:09.904592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ef52a61f-a95d-4070-ad7a-ebd823fd7b64 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:09.905194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ef52a61f-a95d-4070-ad7a-ebd823fd7b64 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:09.919763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef52a61f-a95d-4070-ad7a-ebd823fd7b64 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:09.920263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef52a61f-a95d-4070-ad7a-ebd823fd7b64 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:09.920704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef52a61f-a95d-4070-ad7a-ebd823fd7b64 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:09.921938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef52a61f-a95d-4070-ad7a-ebd823fd7b64 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:09.922398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef52a61f-a95d-4070-ad7a-ebd823fd7b64 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:09.922827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef52a61f-a95d-4070-ad7a-ebd823fd7b64 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:10.188777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ef52a61f-a95d-4070-ad7a-ebd823fd7b64 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:10.199556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ef52a61f-a95d-4070-ad7a-ebd823fd7b64 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:10.201672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ef52a61f-a95d-4070-ad7a-ebd823fd7b64 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:10.204332 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ef52a61f-a95d-4070-ad7a-ebd823fd7b64 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1723 microversion: 2.20 time: 0.303564 Oct 12 22:32:10.223778 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3318/6007] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:09 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:10.459121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-dfcf6af3-b428-4132-a85a-784b33f7cdb5 req-6c4be553-ab1b-4f1c-9f47-4d4c0e21cc56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d", "name": "network-vif-unplugged", "status": "completed", "tag": "ad849817-ecb6-4b77-a207-c06765b7f617"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:10.512131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dfcf6af3-b428-4132-a85a-784b33f7cdb5 req-6c4be553-ab1b-4f1c-9f47-4d4c0e21cc56 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:10.515640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dfcf6af3-b428-4132-a85a-784b33f7cdb5 req-6c4be553-ab1b-4f1c-9f47-4d4c0e21cc56 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:10.517230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dfcf6af3-b428-4132-a85a-784b33f7cdb5 req-6c4be553-ab1b-4f1c-9f47-4d4c0e21cc56 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:10.539955 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-dfcf6af3-b428-4132-a85a-784b33f7cdb5 req-6c4be553-ab1b-4f1c-9f47-4d4c0e21cc56 service nova] Creating event network-vif-unplugged:ad849817-ecb6-4b77-a207-c06765b7f617 for instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d on n-h1-861111-1 Oct 12 22:32:10.548761 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-dfcf6af3-b428-4132-a85a-784b33f7cdb5 req-6c4be553-ab1b-4f1c-9f47-4d4c0e21cc56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094421 Oct 12 22:32:10.550522 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2690/6008] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:11.231952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c76b6c86-b66b-4527-9662-7a4609a91ee5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:11.232580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c76b6c86-b66b-4527-9662-7a4609a91ee5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:11.241905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c76b6c86-b66b-4527-9662-7a4609a91ee5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:11.242395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c76b6c86-b66b-4527-9662-7a4609a91ee5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:11.245009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c76b6c86-b66b-4527-9662-7a4609a91ee5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:11.245748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c76b6c86-b66b-4527-9662-7a4609a91ee5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:11.246389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c76b6c86-b66b-4527-9662-7a4609a91ee5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:11.247019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c76b6c86-b66b-4527-9662-7a4609a91ee5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:11.433641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c76b6c86-b66b-4527-9662-7a4609a91ee5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:11.452131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c76b6c86-b66b-4527-9662-7a4609a91ee5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:11.456553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c76b6c86-b66b-4527-9662-7a4609a91ee5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:11.457976 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c76b6c86-b66b-4527-9662-7a4609a91ee5 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1666 microversion: 2.20 time: 0.230266 Oct 12 22:32:11.474604 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3319/6009] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:11 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1666 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:11.491229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5e7cc365-7d20-4aa1-ad33-4fdc7c741fdf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ac5f405-51ac-473a-b794-f99868db21ce"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:11.493664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5e7cc365-7d20-4aa1-ad33-4fdc7c741fdf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:11.503667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e7cc365-7d20-4aa1-ad33-4fdc7c741fdf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:11.504157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e7cc365-7d20-4aa1-ad33-4fdc7c741fdf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:11.504592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e7cc365-7d20-4aa1-ad33-4fdc7c741fdf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:11.505362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e7cc365-7d20-4aa1-ad33-4fdc7c741fdf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:11.506166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e7cc365-7d20-4aa1-ad33-4fdc7c741fdf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:11.506507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e7cc365-7d20-4aa1-ad33-4fdc7c741fdf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:12.125459 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5e7cc365-7d20-4aa1-ad33-4fdc7c741fdf tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "POST /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.638678 Oct 12 22:32:12.132841 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2691/6010] 10.222.0.16 () {62 vars in 1364 bytes} [Wed Oct 12 22:32:11 2022] POST /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d/os-volume_attachments => generated 188 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:32:12.402297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2f33f443-64a5-490b-a5bd-501c56ace047 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:12.413939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2f33f443-64a5-490b-a5bd-501c56ace047 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:12.443989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f33f443-64a5-490b-a5bd-501c56ace047 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:12.444552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f33f443-64a5-490b-a5bd-501c56ace047 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:12.445025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f33f443-64a5-490b-a5bd-501c56ace047 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:12.445689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f33f443-64a5-490b-a5bd-501c56ace047 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:12.446399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f33f443-64a5-490b-a5bd-501c56ace047 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:12.446945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f33f443-64a5-490b-a5bd-501c56ace047 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:12.846175 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2f33f443-64a5-490b-a5bd-501c56ace047 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d/os-volume_attachments/6ac5f405-51ac-473a-b794-f99868db21ce" status: 202 len: 0 microversion: 2.20 time: 0.467528 Oct 12 22:32:12.862316 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3320/6011] 10.222.0.16 () {60 vars in 1457 bytes} [Wed Oct 12 22:32:12 2022] DELETE /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d/os-volume_attachments/6ac5f405-51ac-473a-b794-f99868db21ce => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:32:12.938847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1946c500-f305-4ebe-8c37-6c859bb7819e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:12.939644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1946c500-f305-4ebe-8c37-6c859bb7819e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:12.948511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1946c500-f305-4ebe-8c37-6c859bb7819e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:12.948948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1946c500-f305-4ebe-8c37-6c859bb7819e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:12.950527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1946c500-f305-4ebe-8c37-6c859bb7819e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:12.951960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1946c500-f305-4ebe-8c37-6c859bb7819e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:12.952895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1946c500-f305-4ebe-8c37-6c859bb7819e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:12.954000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1946c500-f305-4ebe-8c37-6c859bb7819e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:13.197886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1946c500-f305-4ebe-8c37-6c859bb7819e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120452) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 22:32:13.311132 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1946c500-f305-4ebe-8c37-6c859bb7819e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "POST /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d/action" status: 202 len: 0 microversion: 2.20 time: 0.379543 Oct 12 22:32:13.312475 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2692/6012] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 12 22:32:12 2022] POST /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:32:13.322493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-543b8628-a537-4517-aa6e-9c15d15493dd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:13.323436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-543b8628-a537-4517-aa6e-9c15d15493dd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:13.334138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-543b8628-a537-4517-aa6e-9c15d15493dd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:13.334795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-543b8628-a537-4517-aa6e-9c15d15493dd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:13.335548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-543b8628-a537-4517-aa6e-9c15d15493dd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:13.336502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-543b8628-a537-4517-aa6e-9c15d15493dd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:13.337136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-543b8628-a537-4517-aa6e-9c15d15493dd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:13.337749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-543b8628-a537-4517-aa6e-9c15d15493dd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:13.541849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-543b8628-a537-4517-aa6e-9c15d15493dd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:13.560326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-543b8628-a537-4517-aa6e-9c15d15493dd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:13.564436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-543b8628-a537-4517-aa6e-9c15d15493dd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:13.568076 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-543b8628-a537-4517-aa6e-9c15d15493dd tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1674 microversion: 2.20 time: 0.251723 Oct 12 22:32:13.583821 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3321/6013] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:13 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1674 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:32:14.595348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e015d373-489c-419f-b32f-5289994f4463 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:14.596975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e015d373-489c-419f-b32f-5289994f4463 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:14.607887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e015d373-489c-419f-b32f-5289994f4463 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:14.608690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e015d373-489c-419f-b32f-5289994f4463 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:14.614969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e015d373-489c-419f-b32f-5289994f4463 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:14.616221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e015d373-489c-419f-b32f-5289994f4463 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:14.616905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e015d373-489c-419f-b32f-5289994f4463 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:14.625841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e015d373-489c-419f-b32f-5289994f4463 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:14.931060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e015d373-489c-419f-b32f-5289994f4463 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:14.941085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e015d373-489c-419f-b32f-5289994f4463 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:14.944214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e015d373-489c-419f-b32f-5289994f4463 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:14.950498 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e015d373-489c-419f-b32f-5289994f4463 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1674 microversion: 2.20 time: 0.358095 Oct 12 22:32:14.953612 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2693/6014] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:14 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1674 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:15.060110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8066a8a1-0956-4b45-94b6-49c97eee4ba5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:15.063930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8066a8a1-0956-4b45-94b6-49c97eee4ba5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:15.085611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8066a8a1-0956-4b45-94b6-49c97eee4ba5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:15.087781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8066a8a1-0956-4b45-94b6-49c97eee4ba5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:15.089896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8066a8a1-0956-4b45-94b6-49c97eee4ba5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:15.090642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8066a8a1-0956-4b45-94b6-49c97eee4ba5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:15.091110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8066a8a1-0956-4b45-94b6-49c97eee4ba5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:15.091580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8066a8a1-0956-4b45-94b6-49c97eee4ba5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:15.131377 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8066a8a1-0956-4b45-94b6-49c97eee4ba5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075221 Oct 12 22:32:15.138151 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3322/6015] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:32:15 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:32:15.272305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2412045c-0f55-40fe-817a-80301b47374b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:15.272818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2412045c-0f55-40fe-817a-80301b47374b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:15.282715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2412045c-0f55-40fe-817a-80301b47374b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:15.286014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2412045c-0f55-40fe-817a-80301b47374b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:15.287083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2412045c-0f55-40fe-817a-80301b47374b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:15.290798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2412045c-0f55-40fe-817a-80301b47374b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:15.291501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2412045c-0f55-40fe-817a-80301b47374b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:15.292193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2412045c-0f55-40fe-817a-80301b47374b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:15.389671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2412045c-0f55-40fe-817a-80301b47374b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:32:15.548096 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2412045c-0f55-40fe-817a-80301b47374b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 204 len: 0 microversion: 2.1 time: 0.281347 Oct 12 22:32:15.549012 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2694/6016] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:32:15 2022] DELETE /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:32:15.557277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-df887b11-4f63-4044-bfb6-bffe3f31a114 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:15.557903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-df887b11-4f63-4044-bfb6-bffe3f31a114 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:15.568577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df887b11-4f63-4044-bfb6-bffe3f31a114 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:15.569326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df887b11-4f63-4044-bfb6-bffe3f31a114 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:15.569915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df887b11-4f63-4044-bfb6-bffe3f31a114 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:15.575782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df887b11-4f63-4044-bfb6-bffe3f31a114 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:15.576676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df887b11-4f63-4044-bfb6-bffe3f31a114 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:15.579382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df887b11-4f63-4044-bfb6-bffe3f31a114 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:15.852882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-df887b11-4f63-4044-bfb6-bffe3f31a114 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:15.864955 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-df887b11-4f63-4044-bfb6-bffe3f31a114 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1672 microversion: 2.1 time: 0.311582 Oct 12 22:32:15.865900 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3323/6017] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:15 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1672 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:15.993657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f6c1c608-2203-4eb0-b50f-3fcc0f7a2939 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:15.995776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f6c1c608-2203-4eb0-b50f-3fcc0f7a2939 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:16.004060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6c1c608-2203-4eb0-b50f-3fcc0f7a2939 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:16.012353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6c1c608-2203-4eb0-b50f-3fcc0f7a2939 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:16.013064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6c1c608-2203-4eb0-b50f-3fcc0f7a2939 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:16.014125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6c1c608-2203-4eb0-b50f-3fcc0f7a2939 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:16.014788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6c1c608-2203-4eb0-b50f-3fcc0f7a2939 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:16.016054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6c1c608-2203-4eb0-b50f-3fcc0f7a2939 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:16.256292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f6c1c608-2203-4eb0-b50f-3fcc0f7a2939 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:16.276849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f6c1c608-2203-4eb0-b50f-3fcc0f7a2939 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:16.282273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f6c1c608-2203-4eb0-b50f-3fcc0f7a2939 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:16.283521 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f6c1c608-2203-4eb0-b50f-3fcc0f7a2939 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1732 microversion: 2.20 time: 0.294130 Oct 12 22:32:16.289950 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2695/6018] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:15 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1732 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:16.904748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5417bc3f-75d5-46b5-af67-b3bdadbf38b0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:16.906470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5417bc3f-75d5-46b5-af67-b3bdadbf38b0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:16.922045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5417bc3f-75d5-46b5-af67-b3bdadbf38b0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:16.925011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5417bc3f-75d5-46b5-af67-b3bdadbf38b0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:16.925704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5417bc3f-75d5-46b5-af67-b3bdadbf38b0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:16.926659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5417bc3f-75d5-46b5-af67-b3bdadbf38b0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:16.930180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5417bc3f-75d5-46b5-af67-b3bdadbf38b0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:16.930890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5417bc3f-75d5-46b5-af67-b3bdadbf38b0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:17.326719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-499df796-6ecd-4e6d-8a1a-b7b75e38bc4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:17.327977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-499df796-6ecd-4e6d-8a1a-b7b75e38bc4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:17.337978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-499df796-6ecd-4e6d-8a1a-b7b75e38bc4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:17.340285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-499df796-6ecd-4e6d-8a1a-b7b75e38bc4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:17.340917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-499df796-6ecd-4e6d-8a1a-b7b75e38bc4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:17.341877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-499df796-6ecd-4e6d-8a1a-b7b75e38bc4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:17.342509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-499df796-6ecd-4e6d-8a1a-b7b75e38bc4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:17.343555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-499df796-6ecd-4e6d-8a1a-b7b75e38bc4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:17.345937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5417bc3f-75d5-46b5-af67-b3bdadbf38b0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:17.362455 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5417bc3f-75d5-46b5-af67-b3bdadbf38b0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1672 microversion: 2.1 time: 0.471520 Oct 12 22:32:17.378388 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3324/6019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:16 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1672 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:17.626896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-499df796-6ecd-4e6d-8a1a-b7b75e38bc4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:17.642767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-499df796-6ecd-4e6d-8a1a-b7b75e38bc4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:17.649584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-499df796-6ecd-4e6d-8a1a-b7b75e38bc4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:17.654182 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-499df796-6ecd-4e6d-8a1a-b7b75e38bc4a tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1732 microversion: 2.20 time: 0.330126 Oct 12 22:32:17.659732 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2696/6020] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:17 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1732 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:18.389455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0f49307d-03b7-4985-bc2d-aa080569beaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:18.395806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0f49307d-03b7-4985-bc2d-aa080569beaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:18.398160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=28 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:18.419185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f49307d-03b7-4985-bc2d-aa080569beaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:18.420666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f49307d-03b7-4985-bc2d-aa080569beaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:18.423786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f49307d-03b7-4985-bc2d-aa080569beaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:18.428744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f49307d-03b7-4985-bc2d-aa080569beaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:18.429525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f49307d-03b7-4985-bc2d-aa080569beaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:18.431832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0f49307d-03b7-4985-bc2d-aa080569beaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:18.683039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f3517d59-98f9-4ab2-b475-fffcd7673629 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:18.684018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f3517d59-98f9-4ab2-b475-fffcd7673629 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:18.715066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3517d59-98f9-4ab2-b475-fffcd7673629 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:18.727139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3517d59-98f9-4ab2-b475-fffcd7673629 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:18.728663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3517d59-98f9-4ab2-b475-fffcd7673629 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:18.732200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3517d59-98f9-4ab2-b475-fffcd7673629 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:18.735859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3517d59-98f9-4ab2-b475-fffcd7673629 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:18.736388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3517d59-98f9-4ab2-b475-fffcd7673629 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:18.950864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0f49307d-03b7-4985-bc2d-aa080569beaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:18.959222 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0f49307d-03b7-4985-bc2d-aa080569beaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1672 microversion: 2.1 time: 0.574502 Oct 12 22:32:18.981665 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3325/6021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:18 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1672 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:19.662823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f3517d59-98f9-4ab2-b475-fffcd7673629 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:19.680917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f3517d59-98f9-4ab2-b475-fffcd7673629 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:19.689150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f3517d59-98f9-4ab2-b475-fffcd7673629 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:19.692524 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f3517d59-98f9-4ab2-b475-fffcd7673629 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1732 microversion: 2.20 time: 1.013561 Oct 12 22:32:19.717811 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2697/6022] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:18 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1732 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:19.993183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e809272-2434-429e-ac7b-b1658f97b43b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:19.994498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9e809272-2434-429e-ac7b-b1658f97b43b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:20.006984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e809272-2434-429e-ac7b-b1658f97b43b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:20.009846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e809272-2434-429e-ac7b-b1658f97b43b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:20.010642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e809272-2434-429e-ac7b-b1658f97b43b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:20.012447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e809272-2434-429e-ac7b-b1658f97b43b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:20.014415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e809272-2434-429e-ac7b-b1658f97b43b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:20.016249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e809272-2434-429e-ac7b-b1658f97b43b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:20.178959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9e809272-2434-429e-ac7b-b1658f97b43b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:20.187834 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9e809272-2434-429e-ac7b-b1658f97b43b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1604 microversion: 2.1 time: 0.205613 Oct 12 22:32:20.209901 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3326/6023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:19 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1604 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:20.539967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-7d47da8e-240f-4b01-8827-d7567bb97eb7 req-d2a2a5b2-dfa3-424a-8c17-daad12fa6749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1958534e-ec1c-4ecc-bc9a-7720512092ed", "name": "network-vif-deleted", "tag": "fb6f339c-beaf-425d-a33f-7e0afb090b69"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:20.560463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7d47da8e-240f-4b01-8827-d7567bb97eb7 req-d2a2a5b2-dfa3-424a-8c17-daad12fa6749 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:20.562729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7d47da8e-240f-4b01-8827-d7567bb97eb7 req-d2a2a5b2-dfa3-424a-8c17-daad12fa6749 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:20.564250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7d47da8e-240f-4b01-8827-d7567bb97eb7 req-d2a2a5b2-dfa3-424a-8c17-daad12fa6749 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:20.597874 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-7d47da8e-240f-4b01-8827-d7567bb97eb7 req-d2a2a5b2-dfa3-424a-8c17-daad12fa6749 service nova] Creating event network-vif-deleted:fb6f339c-beaf-425d-a33f-7e0afb090b69 for instance 1958534e-ec1c-4ecc-bc9a-7720512092ed on n-h2-861111-1 Oct 12 22:32:20.627902 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-7d47da8e-240f-4b01-8827-d7567bb97eb7 req-d2a2a5b2-dfa3-424a-8c17-daad12fa6749 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076043 Oct 12 22:32:20.652568 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2698/6024] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:20.724673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-096365ed-f113-4be6-b29f-a549f1496a16 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:20.725452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-096365ed-f113-4be6-b29f-a549f1496a16 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:20.738856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-096365ed-f113-4be6-b29f-a549f1496a16 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:20.747260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-096365ed-f113-4be6-b29f-a549f1496a16 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:20.754563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-096365ed-f113-4be6-b29f-a549f1496a16 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:20.758377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-096365ed-f113-4be6-b29f-a549f1496a16 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:20.758997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-096365ed-f113-4be6-b29f-a549f1496a16 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:20.760399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-096365ed-f113-4be6-b29f-a549f1496a16 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:21.138862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-096365ed-f113-4be6-b29f-a549f1496a16 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:21.157470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-096365ed-f113-4be6-b29f-a549f1496a16 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:21.167320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-096365ed-f113-4be6-b29f-a549f1496a16 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:21.172518 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-096365ed-f113-4be6-b29f-a549f1496a16 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1732 microversion: 2.20 time: 0.451599 Oct 12 22:32:21.192426 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3327/6025] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:20 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1732 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:21.218425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b585976d-3836-470f-8b87-f31dc62c8b77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:21.222969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b585976d-3836-470f-8b87-f31dc62c8b77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:21.228485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b585976d-3836-470f-8b87-f31dc62c8b77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:21.228933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b585976d-3836-470f-8b87-f31dc62c8b77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:21.230603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b585976d-3836-470f-8b87-f31dc62c8b77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:21.234221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b585976d-3836-470f-8b87-f31dc62c8b77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:21.235787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b585976d-3836-470f-8b87-f31dc62c8b77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:21.237154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b585976d-3836-470f-8b87-f31dc62c8b77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:21.429709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b585976d-3836-470f-8b87-f31dc62c8b77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:21.430206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b585976d-3836-470f-8b87-f31dc62c8b77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:21.430645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b585976d-3836-470f-8b87-f31dc62c8b77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:21.431464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-b585976d-3836-470f-8b87-f31dc62c8b77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lazy-loading 'fault' on Instance uuid 1958534e-ec1c-4ecc-bc9a-7720512092ed {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:21.656915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b585976d-3836-470f-8b87-f31dc62c8b77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:21.665153 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b585976d-3836-470f-8b87-f31dc62c8b77 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 200 len: 1327 microversion: 2.1 time: 0.451582 Oct 12 22:32:21.671106 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2699/6026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:21 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 1327 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:22.221550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2dae4a4c-914c-41dd-9c29-957d2f33d610 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:22.224093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2dae4a4c-914c-41dd-9c29-957d2f33d610 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:22.251218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dae4a4c-914c-41dd-9c29-957d2f33d610 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:22.252869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dae4a4c-914c-41dd-9c29-957d2f33d610 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:22.253611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dae4a4c-914c-41dd-9c29-957d2f33d610 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:22.254957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dae4a4c-914c-41dd-9c29-957d2f33d610 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:22.255660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dae4a4c-914c-41dd-9c29-957d2f33d610 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:22.256361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dae4a4c-914c-41dd-9c29-957d2f33d610 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:22.696281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3b1871cd-7be9-4083-a071-2975be4eee7e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:22.696891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3b1871cd-7be9-4083-a071-2975be4eee7e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:22.706544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b1871cd-7be9-4083-a071-2975be4eee7e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:22.709532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b1871cd-7be9-4083-a071-2975be4eee7e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:22.710433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b1871cd-7be9-4083-a071-2975be4eee7e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:22.712837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b1871cd-7be9-4083-a071-2975be4eee7e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:22.714938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b1871cd-7be9-4083-a071-2975be4eee7e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:22.715675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b1871cd-7be9-4083-a071-2975be4eee7e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:22.754394 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-3b1871cd-7be9-4083-a071-2975be4eee7e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] HTTP exception thrown: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3b1871cd-7be9-4083-a071-2975be4eee7e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Request method failure captured: Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed HTTP/1.1 Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz9XdK23GQk5mbVmf46xTGAPFoYA8cbrngeSV-lktYZqlruSM3O8e6-yNtUozE6uemwI1m1WFBFELhC1xKYwWqcaNOYsbfNwY6JSWnoc44HmgPQxHVroHGLrPwjNMCpffi4vrQzminQGRI4keq8jqoUYjj33FoQrzgO_P3fnKD4z0Cg Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ecb54ad8150449aaba735b9fc149845d Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecb54ad8150449aaba735b9fc149845d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ecb54ad8150449aaba735b9fc149845d Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-AttachVolumeTestJSON-353621643-project Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: c5fa1bcec6e24906bc2000ead6350336 Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeTestJSON-353621643-project Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '1958534e-ec1c-4ecc-bc9a-7720512092ed'} Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:22.756572 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:32:22.764850 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:22.764850 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:22.764850 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:22.764850 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:32:22.764850 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:32:22.764850 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. Oct 12 22:32:22.764850 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:32:22.764850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3b1871cd-7be9-4083-a071-2975be4eee7e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Returning 404 to user: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:22.764850 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3b1871cd-7be9-4083-a071-2975be4eee7e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 404 len: 111 microversion: 2.1 time: 0.068914 Oct 12 22:32:22.766548 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2700/6027] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:22 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:32:22.778924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cc883d99-44e2-48bf-8318-1e5bcac9f440 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '.version_select at 0x7f51230e64c0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:22.829242 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cc883d99-44e2-48bf-8318-1e5bcac9f440 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-696507993" status: 202 len: 0 microversion: 2.1 time: 0.061518 Oct 12 22:32:22.837330 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2701/6028] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 12 22:32:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-696507993 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:32:23.131257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2dae4a4c-914c-41dd-9c29-957d2f33d610 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:23.148388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2dae4a4c-914c-41dd-9c29-957d2f33d610 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:23.153096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2dae4a4c-914c-41dd-9c29-957d2f33d610 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:23.160638 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2dae4a4c-914c-41dd-9c29-957d2f33d610 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1732 microversion: 2.20 time: 0.944636 Oct 12 22:32:23.161825 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3328/6029] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:22 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1732 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:24.205532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-61d65288-6523-4be7-934e-c37c886b11fa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:24.206192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-61d65288-6523-4be7-934e-c37c886b11fa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:24.232567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61d65288-6523-4be7-934e-c37c886b11fa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:24.233069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61d65288-6523-4be7-934e-c37c886b11fa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:24.234139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61d65288-6523-4be7-934e-c37c886b11fa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:24.236660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61d65288-6523-4be7-934e-c37c886b11fa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:24.237589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61d65288-6523-4be7-934e-c37c886b11fa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:24.242581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61d65288-6523-4be7-934e-c37c886b11fa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:24.284538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:25.145413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-61d65288-6523-4be7-934e-c37c886b11fa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:25.162624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-61d65288-6523-4be7-934e-c37c886b11fa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:25.169130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-61d65288-6523-4be7-934e-c37c886b11fa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:25.183710 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-61d65288-6523-4be7-934e-c37c886b11fa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1732 microversion: 2.20 time: 0.992182 Oct 12 22:32:25.214414 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2702/6030] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:24 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1732 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:26.217106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f02e570d-1d3d-40b7-944d-ff4897bc3d77 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:26.218630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f02e570d-1d3d-40b7-944d-ff4897bc3d77 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:26.231474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f02e570d-1d3d-40b7-944d-ff4897bc3d77 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:26.232266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f02e570d-1d3d-40b7-944d-ff4897bc3d77 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:26.233778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f02e570d-1d3d-40b7-944d-ff4897bc3d77 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:26.235019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f02e570d-1d3d-40b7-944d-ff4897bc3d77 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:26.237773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f02e570d-1d3d-40b7-944d-ff4897bc3d77 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:26.238446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f02e570d-1d3d-40b7-944d-ff4897bc3d77 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:26.292023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:26.952717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f02e570d-1d3d-40b7-944d-ff4897bc3d77 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:26.961605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f02e570d-1d3d-40b7-944d-ff4897bc3d77 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:26.981284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f02e570d-1d3d-40b7-944d-ff4897bc3d77 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:26.992768 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f02e570d-1d3d-40b7-944d-ff4897bc3d77 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1732 microversion: 2.20 time: 0.779475 Oct 12 22:32:27.018447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-76cf7383-c9a3-48ff-af86-db7f3ea67570 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Action: 'create', calling method: .version_select at 0x7f51230b4040>, body: {"keypair": {"name": "tempest-keypair-1948970676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHx1MSixEjRWXFB1Aw0T9K1HBK4bfUO1OjnRagPgR3PO2ffYzD/cR5+3FMPcJbxNGm9w7ek5wePfFZmN6k35WhnCHrKjrnUg7QYoclMDifXiG+Vyp/8rh0ZDQz8m7//QxQ=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:27.019750 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3329/6031] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:26 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1732 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:27.070236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-76cf7383-c9a3-48ff-af86-db7f3ea67570 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Getting quotas for project ecb54ad8150449aaba735b9fc149845d. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:32:27.118389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-76cf7383-c9a3-48ff-af86-db7f3ea67570 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Getting quotas for user c5fa1bcec6e24906bc2000ead6350336 and project ecb54ad8150449aaba735b9fc149845d. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:32:27.286244 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-76cf7383-c9a3-48ff-af86-db7f3ea67570 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.279093 Oct 12 22:32:27.299691 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2703/6032] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:32:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:27.903804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2d9dc550-f568-4e0f-bab5-a6ebb3cf7f01 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:27.904982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2d9dc550-f568-4e0f-bab5-a6ebb3cf7f01 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:27.914343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d9dc550-f568-4e0f-bab5-a6ebb3cf7f01 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:27.918662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d9dc550-f568-4e0f-bab5-a6ebb3cf7f01 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:27.919123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d9dc550-f568-4e0f-bab5-a6ebb3cf7f01 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:27.933734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d9dc550-f568-4e0f-bab5-a6ebb3cf7f01 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:27.934744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d9dc550-f568-4e0f-bab5-a6ebb3cf7f01 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:27.938006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d9dc550-f568-4e0f-bab5-a6ebb3cf7f01 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:28.037194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7e7421de-2be5-421d-b74e-76ac676912fe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:28.037818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7e7421de-2be5-421d-b74e-76ac676912fe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:28.041379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2d9dc550-f568-4e0f-bab5-a6ebb3cf7f01 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:32:28.052003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e7421de-2be5-421d-b74e-76ac676912fe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:28.056667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e7421de-2be5-421d-b74e-76ac676912fe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:28.060247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e7421de-2be5-421d-b74e-76ac676912fe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:28.061272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e7421de-2be5-421d-b74e-76ac676912fe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:28.061918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e7421de-2be5-421d-b74e-76ac676912fe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:28.063789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e7421de-2be5-421d-b74e-76ac676912fe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:28.299330 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2d9dc550-f568-4e0f-bab5-a6ebb3cf7f01 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 204 len: 0 microversion: 2.1 time: 0.399861 Oct 12 22:32:28.307403 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3330/6033] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:32:27 2022] DELETE /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:32:28.333007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-66926b4e-7782-4ddf-881a-d43e417c4115 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:28.333798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-66926b4e-7782-4ddf-881a-d43e417c4115 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:28.362412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66926b4e-7782-4ddf-881a-d43e417c4115 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:28.363111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66926b4e-7782-4ddf-881a-d43e417c4115 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:28.363622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66926b4e-7782-4ddf-881a-d43e417c4115 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:28.364574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66926b4e-7782-4ddf-881a-d43e417c4115 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:28.365076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66926b4e-7782-4ddf-881a-d43e417c4115 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:28.365577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66926b4e-7782-4ddf-881a-d43e417c4115 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:28.801772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e7421de-2be5-421d-b74e-76ac676912fe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:28.844184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e7421de-2be5-421d-b74e-76ac676912fe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:28.852382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e7421de-2be5-421d-b74e-76ac676912fe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:28.862079 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7e7421de-2be5-421d-b74e-76ac676912fe tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1732 microversion: 2.20 time: 0.831862 Oct 12 22:32:28.867255 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2704/6034] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:28 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1732 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:29.692593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-66926b4e-7782-4ddf-881a-d43e417c4115 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:29.701850 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-66926b4e-7782-4ddf-881a-d43e417c4115 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 200 len: 1552 microversion: 2.1 time: 1.389818 Oct 12 22:32:29.707935 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3331/6035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:28 2022] GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 1552 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:29.899558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-11394a9d-3244-4f34-ad3d-356433e242f9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:29.900106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-11394a9d-3244-4f34-ad3d-356433e242f9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:29.927322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11394a9d-3244-4f34-ad3d-356433e242f9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:29.927877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11394a9d-3244-4f34-ad3d-356433e242f9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:29.928336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11394a9d-3244-4f34-ad3d-356433e242f9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:29.929092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11394a9d-3244-4f34-ad3d-356433e242f9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:29.929554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11394a9d-3244-4f34-ad3d-356433e242f9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:29.945828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11394a9d-3244-4f34-ad3d-356433e242f9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:30.736698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ca5aab36-60a5-45f6-9e06-de2de0fca134 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:30.739533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ca5aab36-60a5-45f6-9e06-de2de0fca134 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:30.787518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca5aab36-60a5-45f6-9e06-de2de0fca134 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:30.790368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca5aab36-60a5-45f6-9e06-de2de0fca134 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:30.792053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca5aab36-60a5-45f6-9e06-de2de0fca134 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:30.807968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca5aab36-60a5-45f6-9e06-de2de0fca134 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:30.813014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca5aab36-60a5-45f6-9e06-de2de0fca134 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:30.814387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca5aab36-60a5-45f6-9e06-de2de0fca134 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.521911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-11394a9d-3244-4f34-ad3d-356433e242f9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:31.534215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-11394a9d-3244-4f34-ad3d-356433e242f9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:31.543031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-11394a9d-3244-4f34-ad3d-356433e242f9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:31.544512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ca5aab36-60a5-45f6-9e06-de2de0fca134 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:31.545225 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-11394a9d-3244-4f34-ad3d-356433e242f9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1732 microversion: 2.20 time: 1.653903 Oct 12 22:32:31.549681 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2705/6036] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:29 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1732 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:31.564663 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ca5aab36-60a5-45f6-9e06-de2de0fca134 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 200 len: 1552 microversion: 2.1 time: 0.832057 Oct 12 22:32:31.577743 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3332/6037] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:30 2022] GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 1552 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:32.599830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1b4b672e-1606-43e9-8010-59c54b4bb178 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:32.601598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-59c1b4c0-7e4f-46c3-87a2-83889d387be7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:32.602248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1b4b672e-1606-43e9-8010-59c54b4bb178 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:32.604671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-59c1b4c0-7e4f-46c3-87a2-83889d387be7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:32.630997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b4b672e-1606-43e9-8010-59c54b4bb178 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:32.632903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b4b672e-1606-43e9-8010-59c54b4bb178 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:32.633348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b4b672e-1606-43e9-8010-59c54b4bb178 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:32.634081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b4b672e-1606-43e9-8010-59c54b4bb178 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:32.634743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59c1b4c0-7e4f-46c3-87a2-83889d387be7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:32.635583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59c1b4c0-7e4f-46c3-87a2-83889d387be7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:32.636031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59c1b4c0-7e4f-46c3-87a2-83889d387be7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:32.636760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59c1b4c0-7e4f-46c3-87a2-83889d387be7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:32.637216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59c1b4c0-7e4f-46c3-87a2-83889d387be7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:32.639141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b4b672e-1606-43e9-8010-59c54b4bb178 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:32.640464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b4b672e-1606-43e9-8010-59c54b4bb178 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:32.643530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-59c1b4c0-7e4f-46c3-87a2-83889d387be7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:33.202144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1b4b672e-1606-43e9-8010-59c54b4bb178 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:33.220440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1b4b672e-1606-43e9-8010-59c54b4bb178 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:33.222265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1b4b672e-1606-43e9-8010-59c54b4bb178 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:33.223532 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1b4b672e-1606-43e9-8010-59c54b4bb178 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1732 microversion: 2.20 time: 0.634092 Oct 12 22:32:33.228079 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2706/6038] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:32 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1732 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:33.448774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-59c1b4c0-7e4f-46c3-87a2-83889d387be7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:33.464214 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-59c1b4c0-7e4f-46c3-87a2-83889d387be7 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 200 len: 1552 microversion: 2.1 time: 0.863001 Oct 12 22:32:33.464902 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3333/6039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:32 2022] GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 1552 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:33.523607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d3a8ddae-8278-4a39-8999-f0e86f7bba9a req-31a8b3ca-0a0d-410b-98ea-60c8c9987597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7", "name": "network-vif-deleted", "tag": "08cb1665-4138-4239-8f71-66221aea4b2f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:33.537334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d3a8ddae-8278-4a39-8999-f0e86f7bba9a req-31a8b3ca-0a0d-410b-98ea-60c8c9987597 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:33.537807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d3a8ddae-8278-4a39-8999-f0e86f7bba9a req-31a8b3ca-0a0d-410b-98ea-60c8c9987597 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:33.538336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d3a8ddae-8278-4a39-8999-f0e86f7bba9a req-31a8b3ca-0a0d-410b-98ea-60c8c9987597 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:33.585033 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d3a8ddae-8278-4a39-8999-f0e86f7bba9a req-31a8b3ca-0a0d-410b-98ea-60c8c9987597 service nova] Creating event network-vif-deleted:08cb1665-4138-4239-8f71-66221aea4b2f for instance e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 on n-h2-861111-1 Oct 12 22:32:33.615480 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d3a8ddae-8278-4a39-8999-f0e86f7bba9a req-31a8b3ca-0a0d-410b-98ea-60c8c9987597 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093082 Oct 12 22:32:33.618002 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2707/6040] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:33.638644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2056604060", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b630e3f8-f7dc-4831-b009-a6ce5ac4c2af"}], "security_groups": [{"name": "tempest-securitygroup--1540271691"}], "key_name": "tempest-keypair-1948970676", "user_data": "}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:34.044354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] validate_networks() for [('b630e3f8-f7dc-4831-b009-a6ce5ac4c2af', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:32:34.253258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bcae34fd-76f2-4b4c-855f-afbf7e98923d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:34.254342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bcae34fd-76f2-4b4c-855f-afbf7e98923d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:34.269846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcae34fd-76f2-4b4c-855f-afbf7e98923d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:34.271889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcae34fd-76f2-4b4c-855f-afbf7e98923d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:34.273115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcae34fd-76f2-4b4c-855f-afbf7e98923d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:34.277422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcae34fd-76f2-4b4c-855f-afbf7e98923d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:34.280413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcae34fd-76f2-4b4c-855f-afbf7e98923d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:34.286668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bcae34fd-76f2-4b4c-855f-afbf7e98923d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:34.738643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bcae34fd-76f2-4b4c-855f-afbf7e98923d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:34.748654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bcae34fd-76f2-4b4c-855f-afbf7e98923d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:34.753146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bcae34fd-76f2-4b4c-855f-afbf7e98923d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:34.761440 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bcae34fd-76f2-4b4c-855f-afbf7e98923d tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1732 microversion: 2.20 time: 0.513412 Oct 12 22:32:34.781054 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2708/6041] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:34 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1732 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:32:34.787127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3d61dc27-4876-49dd-9c46-3c5bd92dcf45 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:34.796735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3d61dc27-4876-49dd-9c46-3c5bd92dcf45 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:34.803816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d61dc27-4876-49dd-9c46-3c5bd92dcf45 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:34.804637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d61dc27-4876-49dd-9c46-3c5bd92dcf45 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:34.805919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d61dc27-4876-49dd-9c46-3c5bd92dcf45 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:34.812338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d61dc27-4876-49dd-9c46-3c5bd92dcf45 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:34.813097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d61dc27-4876-49dd-9c46-3c5bd92dcf45 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:34.813733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d61dc27-4876-49dd-9c46-3c5bd92dcf45 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:34.847564 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-3d61dc27-4876-49dd-9c46-3c5bd92dcf45 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] HTTP exception thrown: Instance e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 could not be found. Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3d61dc27-4876-49dd-9c46-3c5bd92dcf45 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Request method failure captured: Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 HTTP/1.1 Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz_NU6UQmSO7i7Bx75T1nJfatDuXoxDn89C0uP55LpKjWt8Tz54gd8kp0OWHBQKu17OneBMndQGOqsDqbMDUSzVrZTmVJWW9kZTcpD_NYyHyCbaGCH6an9e0wybdo6_Q-Euo0O4RnLcx3cwTPUrwDW8M_xqZJHFSXQdiEmMJ5C3u5I0 Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 08d857098e294c8da4f73d273912cdf3 Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestNetworkBasicOps-1431188583 Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/08d857098e294c8da4f73d273912cdf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/08d857098e294c8da4f73d273912cdf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_08d857098e294c8da4f73d273912cdf3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/08d857098e294c8da4f73d273912cdf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestNetworkBasicOps-1431188583 Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 08d857098e294c8da4f73d273912cdf3 Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestNetworkBasicOps-1431188583 Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestNetworkBasicOps-1431188583-project Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: a672bb095f984fb7b23d1acd55902865 Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestNetworkBasicOps-1431188583-project Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 could not be found. Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7'} Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 could not be found. Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 could not be found. Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:34.860443 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:32:34.865762 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:34.865762 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:34.865762 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:34.865762 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:32:34.865762 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:32:34.865762 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 could not be found. Oct 12 22:32:34.865762 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:32:34.866960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3d61dc27-4876-49dd-9c46-3c5bd92dcf45 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Returning 404 to user: Instance e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:34.868029 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3d61dc27-4876-49dd-9c46-3c5bd92dcf45 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7" status: 404 len: 111 microversion: 2.1 time: 0.085742 Oct 12 22:32:34.868762 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2709/6042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:34 2022] GET /compute/v2.1/servers/e1cbde21-49d2-45fc-9e7a-53a19bfd6ea7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:32:35.388819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-46221eb3-eaa6-496c-a253-f8905a275caf tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '.version_select at 0x7f5128a973a0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:35.425418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:35.463032 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-46221eb3-eaa6-496c-a253-f8905a275caf tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1011984007" status: 202 len: 0 microversion: 2.1 time: 0.078242 Oct 12 22:32:35.471489 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2710/6043] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 12 22:32:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1011984007 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:32:35.518357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:32:35.519669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:32:35.520439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:32:35.521405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:32:35.534572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:32:35.597684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:35.602627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:35.606151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:35.610883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:35.615069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:35.624491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:35.749290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Getting quotas for project ecb54ad8150449aaba735b9fc149845d. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:32:35.768940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Getting quotas for user c5fa1bcec6e24906bc2000ead6350336 and project ecb54ad8150449aaba735b9fc149845d. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:32:35.798376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9b5427cb-982e-4988-abea-1ee333d25c79 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:35.799404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:32:35.799711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9b5427cb-982e-4988-abea-1ee333d25c79 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:35.802377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:32:35.823662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b5427cb-982e-4988-abea-1ee333d25c79 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:35.826273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b5427cb-982e-4988-abea-1ee333d25c79 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:35.827638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b5427cb-982e-4988-abea-1ee333d25c79 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:35.829475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b5427cb-982e-4988-abea-1ee333d25c79 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:35.830381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b5427cb-982e-4988-abea-1ee333d25c79 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:35.831211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b5427cb-982e-4988-abea-1ee333d25c79 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:35.954955 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2de5e5e4-1494-47fc-974f-e989a546234d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.334513 Oct 12 22:32:35.959334 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3334/6044] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 2340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:32:36.412674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1a4e386d-bdd2-45bc-9cf4-02a67fd927b2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:36.413462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1a4e386d-bdd2-45bc-9cf4-02a67fd927b2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:36.640424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a4e386d-bdd2-45bc-9cf4-02a67fd927b2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:36.670975 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1a4e386d-bdd2-45bc-9cf4-02a67fd927b2 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1238 microversion: 2.1 time: 0.704037 Oct 12 22:32:36.681136 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3335/6045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:35 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1238 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:37.101887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9b5427cb-982e-4988-abea-1ee333d25c79 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:37.111152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9b5427cb-982e-4988-abea-1ee333d25c79 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:37.121201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9b5427cb-982e-4988-abea-1ee333d25c79 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:37.128898 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9b5427cb-982e-4988-abea-1ee333d25c79 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1732 microversion: 2.20 time: 1.337742 Oct 12 22:32:37.130941 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2711/6046] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:35 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1732 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:37.708341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f313b369-da50-401f-b563-6c7591ab55cc tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:37.708979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f313b369-da50-401f-b563-6c7591ab55cc tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:37.730779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f313b369-da50-401f-b563-6c7591ab55cc tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:37.731478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f313b369-da50-401f-b563-6c7591ab55cc tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:37.731948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f313b369-da50-401f-b563-6c7591ab55cc tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:37.732755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f313b369-da50-401f-b563-6c7591ab55cc tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:37.733236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f313b369-da50-401f-b563-6c7591ab55cc tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:37.738520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f313b369-da50-401f-b563-6c7591ab55cc tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:38.052281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f313b369-da50-401f-b563-6c7591ab55cc tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:38.062823 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f313b369-da50-401f-b563-6c7591ab55cc tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1234 microversion: 2.1 time: 0.358353 Oct 12 22:32:38.080862 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3336/6047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:37 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1234 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:38.158817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fe48dfeb-a4ad-4a1d-ade0-08e5732fd666 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:38.159463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fe48dfeb-a4ad-4a1d-ade0-08e5732fd666 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:38.175062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:38.183696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe48dfeb-a4ad-4a1d-ade0-08e5732fd666 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:38.192512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe48dfeb-a4ad-4a1d-ade0-08e5732fd666 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:38.194156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe48dfeb-a4ad-4a1d-ade0-08e5732fd666 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:38.195408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe48dfeb-a4ad-4a1d-ade0-08e5732fd666 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:38.197289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe48dfeb-a4ad-4a1d-ade0-08e5732fd666 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:38.197936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe48dfeb-a4ad-4a1d-ade0-08e5732fd666 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:38.593178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fe48dfeb-a4ad-4a1d-ade0-08e5732fd666 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:38.608579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fe48dfeb-a4ad-4a1d-ade0-08e5732fd666 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:38.610249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fe48dfeb-a4ad-4a1d-ade0-08e5732fd666 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:38.613231 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fe48dfeb-a4ad-4a1d-ade0-08e5732fd666 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1732 microversion: 2.20 time: 0.459257 Oct 12 22:32:38.632558 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2712/6048] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:38 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1732 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:39.092656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e999af5f-0d65-41b1-a392-e57a6af3126b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:39.094090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e999af5f-0d65-41b1-a392-e57a6af3126b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:39.111472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e999af5f-0d65-41b1-a392-e57a6af3126b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:39.112971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e999af5f-0d65-41b1-a392-e57a6af3126b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:39.116306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e999af5f-0d65-41b1-a392-e57a6af3126b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:39.119264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e999af5f-0d65-41b1-a392-e57a6af3126b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:39.119961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e999af5f-0d65-41b1-a392-e57a6af3126b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:39.122137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e999af5f-0d65-41b1-a392-e57a6af3126b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:39.366378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e999af5f-0d65-41b1-a392-e57a6af3126b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:39.375729 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e999af5f-0d65-41b1-a392-e57a6af3126b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1290 microversion: 2.1 time: 0.289161 Oct 12 22:32:39.383919 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3337/6049] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:39 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1290 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:39.647603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7ad50243-d3f5-44b8-a78b-789065deaedb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:39.648918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7ad50243-d3f5-44b8-a78b-789065deaedb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:39.665556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ad50243-d3f5-44b8-a78b-789065deaedb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:39.667588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ad50243-d3f5-44b8-a78b-789065deaedb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:39.668041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ad50243-d3f5-44b8-a78b-789065deaedb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:39.671528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ad50243-d3f5-44b8-a78b-789065deaedb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:39.672005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ad50243-d3f5-44b8-a78b-789065deaedb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:39.672441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ad50243-d3f5-44b8-a78b-789065deaedb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:40.406513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aeea8113-4fbe-4f3e-846c-14bcff475ef9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:40.407120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aeea8113-4fbe-4f3e-846c-14bcff475ef9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:40.417091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aeea8113-4fbe-4f3e-846c-14bcff475ef9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:40.417888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aeea8113-4fbe-4f3e-846c-14bcff475ef9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:40.421481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aeea8113-4fbe-4f3e-846c-14bcff475ef9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:40.422489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aeea8113-4fbe-4f3e-846c-14bcff475ef9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:40.425466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aeea8113-4fbe-4f3e-846c-14bcff475ef9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:40.426118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aeea8113-4fbe-4f3e-846c-14bcff475ef9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:40.541269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aeea8113-4fbe-4f3e-846c-14bcff475ef9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:40.552102 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aeea8113-4fbe-4f3e-846c-14bcff475ef9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1296 microversion: 2.1 time: 0.149555 Oct 12 22:32:40.567934 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3338/6050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:40 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1296 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:41.236100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7ad50243-d3f5-44b8-a78b-789065deaedb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:41.247966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7ad50243-d3f5-44b8-a78b-789065deaedb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:41.254930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7ad50243-d3f5-44b8-a78b-789065deaedb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:41.270186 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7ad50243-d3f5-44b8-a78b-789065deaedb tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1732 microversion: 2.20 time: 1.617593 Oct 12 22:32:41.270891 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2713/6051] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:39 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1732 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:41.581515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5abae7e3-fe95-446b-940c-477207dd9dfe tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:41.582174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5abae7e3-fe95-446b-940c-477207dd9dfe tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:41.593974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5abae7e3-fe95-446b-940c-477207dd9dfe tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:41.594524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5abae7e3-fe95-446b-940c-477207dd9dfe tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:41.600198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5abae7e3-fe95-446b-940c-477207dd9dfe tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:41.601710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5abae7e3-fe95-446b-940c-477207dd9dfe tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:41.602553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5abae7e3-fe95-446b-940c-477207dd9dfe tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:41.603617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5abae7e3-fe95-446b-940c-477207dd9dfe tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:41.718816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5abae7e3-fe95-446b-940c-477207dd9dfe tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:41.733791 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5abae7e3-fe95-446b-940c-477207dd9dfe tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1296 microversion: 2.1 time: 0.159188 Oct 12 22:32:41.734715 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3339/6052] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:41 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1296 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:42.304284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d792df19-48b8-4619-bc0e-a839e3757332 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:42.304915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d792df19-48b8-4619-bc0e-a839e3757332 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:42.320564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d792df19-48b8-4619-bc0e-a839e3757332 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:42.325727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d792df19-48b8-4619-bc0e-a839e3757332 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:42.326899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d792df19-48b8-4619-bc0e-a839e3757332 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:42.332180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d792df19-48b8-4619-bc0e-a839e3757332 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:42.332674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d792df19-48b8-4619-bc0e-a839e3757332 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:42.336203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d792df19-48b8-4619-bc0e-a839e3757332 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:42.757679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2335c111-5b5a-498f-a888-8b029a46b668 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:42.758465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2335c111-5b5a-498f-a888-8b029a46b668 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:42.771332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2335c111-5b5a-498f-a888-8b029a46b668 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:42.775497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2335c111-5b5a-498f-a888-8b029a46b668 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:42.776355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2335c111-5b5a-498f-a888-8b029a46b668 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:42.779614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2335c111-5b5a-498f-a888-8b029a46b668 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:42.783891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2335c111-5b5a-498f-a888-8b029a46b668 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:42.784707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2335c111-5b5a-498f-a888-8b029a46b668 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:43.069385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2335c111-5b5a-498f-a888-8b029a46b668 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:43.078678 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2335c111-5b5a-498f-a888-8b029a46b668 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1296 microversion: 2.1 time: 0.324965 Oct 12 22:32:43.079301 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3340/6053] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:42 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1296 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:43.088342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-65d37680-274f-4f53-8e97-d84939f02d7f req-c766466d-9452-422c-9c53-fe38b6f6a99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d", "name": "network-vif-plugged", "status": "completed", "tag": "ad849817-ecb6-4b77-a207-c06765b7f617"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:43.135923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-65d37680-274f-4f53-8e97-d84939f02d7f req-c766466d-9452-422c-9c53-fe38b6f6a99b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:43.136739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-65d37680-274f-4f53-8e97-d84939f02d7f req-c766466d-9452-422c-9c53-fe38b6f6a99b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:43.137348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-65d37680-274f-4f53-8e97-d84939f02d7f req-c766466d-9452-422c-9c53-fe38b6f6a99b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:43.181814 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-65d37680-274f-4f53-8e97-d84939f02d7f req-c766466d-9452-422c-9c53-fe38b6f6a99b service nova] Creating event network-vif-plugged:ad849817-ecb6-4b77-a207-c06765b7f617 for instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d on n-h1-861111-1 Oct 12 22:32:43.211870 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-65d37680-274f-4f53-8e97-d84939f02d7f req-c766466d-9452-422c-9c53-fe38b6f6a99b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126546 Oct 12 22:32:43.224030 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3341/6054] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:43.786669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d792df19-48b8-4619-bc0e-a839e3757332 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:43.798294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d792df19-48b8-4619-bc0e-a839e3757332 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:43.804785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d792df19-48b8-4619-bc0e-a839e3757332 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:43.807361 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d792df19-48b8-4619-bc0e-a839e3757332 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1732 microversion: 2.20 time: 1.507259 Oct 12 22:32:43.812492 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2714/6055] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:42 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1732 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:44.107942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c92a55cd-d682-4bde-88b5-b05bf395ede3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:44.109097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c92a55cd-d682-4bde-88b5-b05bf395ede3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:44.134773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c92a55cd-d682-4bde-88b5-b05bf395ede3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.138138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c92a55cd-d682-4bde-88b5-b05bf395ede3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.143346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c92a55cd-d682-4bde-88b5-b05bf395ede3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.144669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c92a55cd-d682-4bde-88b5-b05bf395ede3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.147517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c92a55cd-d682-4bde-88b5-b05bf395ede3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.148337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c92a55cd-d682-4bde-88b5-b05bf395ede3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.242077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c92a55cd-d682-4bde-88b5-b05bf395ede3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:44.258887 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c92a55cd-d682-4bde-88b5-b05bf395ede3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1296 microversion: 2.1 time: 0.156597 Oct 12 22:32:44.276438 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3342/6056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:44 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1296 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:44.434450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c5337bf4-7812-4d34-aa5d-4283b598f4b4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:44.441255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-781d0675-c4a7-4923-a898-a03c7eb257ea req-0626e337-32fc-4518-bdaf-bd40b8b5cfd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c973408a-2071-4e50-aa87-b08294479f15", "tag": "b8e5ca77-39e1-4915-9db4-a7c9dd58fa57"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:44.442115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c5337bf4-7812-4d34-aa5d-4283b598f4b4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:44.467828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5337bf4-7812-4d34-aa5d-4283b598f4b4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.469519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-781d0675-c4a7-4923-a898-a03c7eb257ea req-0626e337-32fc-4518-bdaf-bd40b8b5cfd4 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.470112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-781d0675-c4a7-4923-a898-a03c7eb257ea req-0626e337-32fc-4518-bdaf-bd40b8b5cfd4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.471389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5337bf4-7812-4d34-aa5d-4283b598f4b4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.472009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5337bf4-7812-4d34-aa5d-4283b598f4b4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.472581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-781d0675-c4a7-4923-a898-a03c7eb257ea req-0626e337-32fc-4518-bdaf-bd40b8b5cfd4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.473453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5337bf4-7812-4d34-aa5d-4283b598f4b4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.481294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5337bf4-7812-4d34-aa5d-4283b598f4b4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.481915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5337bf4-7812-4d34-aa5d-4283b598f4b4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.516221 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-781d0675-c4a7-4923-a898-a03c7eb257ea req-0626e337-32fc-4518-bdaf-bd40b8b5cfd4 service nova] Creating event network-changed:b8e5ca77-39e1-4915-9db4-a7c9dd58fa57 for instance c973408a-2071-4e50-aa87-b08294479f15 on n-h2-861111-1 Oct 12 22:32:44.538112 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-781d0675-c4a7-4923-a898-a03c7eb257ea req-0626e337-32fc-4518-bdaf-bd40b8b5cfd4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099283 Oct 12 22:32:44.543164 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3343/6057] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:44.560987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c5337bf4-7812-4d34-aa5d-4283b598f4b4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:32:44.710687 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c5337bf4-7812-4d34-aa5d-4283b598f4b4 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 204 len: 0 microversion: 2.1 time: 0.280670 Oct 12 22:32:44.716430 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2715/6058] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:32:44 2022] DELETE /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:32:44.724808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5c0a9e63-1b5b-4ec2-87b6-e8786107395d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:44.725957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5c0a9e63-1b5b-4ec2-87b6-e8786107395d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:44.740160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c0a9e63-1b5b-4ec2-87b6-e8786107395d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.740920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c0a9e63-1b5b-4ec2-87b6-e8786107395d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.741731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c0a9e63-1b5b-4ec2-87b6-e8786107395d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.742685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c0a9e63-1b5b-4ec2-87b6-e8786107395d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.743414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c0a9e63-1b5b-4ec2-87b6-e8786107395d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.744122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c0a9e63-1b5b-4ec2-87b6-e8786107395d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.835625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3b2f554f-72f1-4a24-95a7-a880453b6504 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:44.836463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3b2f554f-72f1-4a24-95a7-a880453b6504 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:44.848100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b2f554f-72f1-4a24-95a7-a880453b6504 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.848507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b2f554f-72f1-4a24-95a7-a880453b6504 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.848948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b2f554f-72f1-4a24-95a7-a880453b6504 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.849665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b2f554f-72f1-4a24-95a7-a880453b6504 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.860407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b2f554f-72f1-4a24-95a7-a880453b6504 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.861165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b2f554f-72f1-4a24-95a7-a880453b6504 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.990529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5c0a9e63-1b5b-4ec2-87b6-e8786107395d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:45.017709 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5c0a9e63-1b5b-4ec2-87b6-e8786107395d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1671 microversion: 2.1 time: 0.295186 Oct 12 22:32:45.029310 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3344/6059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:44 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1671 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:45.282791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9996201c-2fda-410e-9406-36dc0e074829 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:45.284785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9996201c-2fda-410e-9406-36dc0e074829 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:45.295648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9996201c-2fda-410e-9406-36dc0e074829 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:45.296151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9996201c-2fda-410e-9406-36dc0e074829 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:45.296596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9996201c-2fda-410e-9406-36dc0e074829 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:45.297317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9996201c-2fda-410e-9406-36dc0e074829 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:45.297789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9996201c-2fda-410e-9406-36dc0e074829 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:45.298224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9996201c-2fda-410e-9406-36dc0e074829 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:45.549585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9996201c-2fda-410e-9406-36dc0e074829 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:45.559180 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9996201c-2fda-410e-9406-36dc0e074829 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1364 microversion: 2.1 time: 0.280961 Oct 12 22:32:45.560843 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3345/6060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:45 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1364 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:46.046027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6fe05811-40b5-4646-a728-5e014ee69671 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:46.046685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6fe05811-40b5-4646-a728-5e014ee69671 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:46.064543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:46.066312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fe05811-40b5-4646-a728-5e014ee69671 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:46.068801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fe05811-40b5-4646-a728-5e014ee69671 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:46.070554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fe05811-40b5-4646-a728-5e014ee69671 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:46.072796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fe05811-40b5-4646-a728-5e014ee69671 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:46.075855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fe05811-40b5-4646-a728-5e014ee69671 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:46.078509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fe05811-40b5-4646-a728-5e014ee69671 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:46.634659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6fe05811-40b5-4646-a728-5e014ee69671 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:46.647163 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6fe05811-40b5-4646-a728-5e014ee69671 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1671 microversion: 2.1 time: 0.603849 Oct 12 22:32:46.647882 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3346/6061] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:46 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1671 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:46.673380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-720bc7e2-505e-4963-89bd-f50922993c24 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:46.680452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-720bc7e2-505e-4963-89bd-f50922993c24 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:46.684672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=8 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:46.703511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-720bc7e2-505e-4963-89bd-f50922993c24 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:46.709293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-720bc7e2-505e-4963-89bd-f50922993c24 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:46.709828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-720bc7e2-505e-4963-89bd-f50922993c24 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:46.714385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-720bc7e2-505e-4963-89bd-f50922993c24 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:46.714945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-720bc7e2-505e-4963-89bd-f50922993c24 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:46.716702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-720bc7e2-505e-4963-89bd-f50922993c24 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:46.732975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:47.073724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-720bc7e2-505e-4963-89bd-f50922993c24 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:47.083542 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-720bc7e2-505e-4963-89bd-f50922993c24 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1364 microversion: 2.1 time: 0.425862 Oct 12 22:32:47.104035 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3347/6062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:46 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1364 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:47.219772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3b2f554f-72f1-4a24-95a7-a880453b6504 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:47.229530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3b2f554f-72f1-4a24-95a7-a880453b6504 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:47.257318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3b2f554f-72f1-4a24-95a7-a880453b6504 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:47.260434 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3b2f554f-72f1-4a24-95a7-a880453b6504 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1732 microversion: 2.20 time: 2.429933 Oct 12 22:32:47.276860 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2716/6063] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:44 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1732 bytes in 2447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:32:47.678052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2820d87d-31bc-4345-9418-fe75c998e8aa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:47.681406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2820d87d-31bc-4345-9418-fe75c998e8aa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:47.695307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2820d87d-31bc-4345-9418-fe75c998e8aa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:47.695823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2820d87d-31bc-4345-9418-fe75c998e8aa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:47.696271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2820d87d-31bc-4345-9418-fe75c998e8aa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:47.696992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2820d87d-31bc-4345-9418-fe75c998e8aa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:47.697454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2820d87d-31bc-4345-9418-fe75c998e8aa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:47.697892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2820d87d-31bc-4345-9418-fe75c998e8aa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:48.120319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1e9eba8b-93ef-44ab-a7d7-41d2ff405aec tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:48.123551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1e9eba8b-93ef-44ab-a7d7-41d2ff405aec tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:48.143989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e9eba8b-93ef-44ab-a7d7-41d2ff405aec tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:48.144578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e9eba8b-93ef-44ab-a7d7-41d2ff405aec tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:48.147633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e9eba8b-93ef-44ab-a7d7-41d2ff405aec tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:48.150055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e9eba8b-93ef-44ab-a7d7-41d2ff405aec tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:48.155104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e9eba8b-93ef-44ab-a7d7-41d2ff405aec tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:48.156647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2820d87d-31bc-4345-9418-fe75c998e8aa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:48.156802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e9eba8b-93ef-44ab-a7d7-41d2ff405aec tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:48.193874 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2820d87d-31bc-4345-9418-fe75c998e8aa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1671 microversion: 2.1 time: 0.520077 Oct 12 22:32:48.200876 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3348/6064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:47 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1671 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:48.301307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-437171dc-0370-4b93-8e1f-a4920da932ff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:48.303298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-437171dc-0370-4b93-8e1f-a4920da932ff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:48.335871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-437171dc-0370-4b93-8e1f-a4920da932ff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:48.337557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-437171dc-0370-4b93-8e1f-a4920da932ff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:48.338553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-437171dc-0370-4b93-8e1f-a4920da932ff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:48.342457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-437171dc-0370-4b93-8e1f-a4920da932ff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:48.343035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-437171dc-0370-4b93-8e1f-a4920da932ff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:48.346573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-437171dc-0370-4b93-8e1f-a4920da932ff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:48.891355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1e9eba8b-93ef-44ab-a7d7-41d2ff405aec tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:48.917537 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1e9eba8b-93ef-44ab-a7d7-41d2ff405aec tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1364 microversion: 2.1 time: 0.796626 Oct 12 22:32:48.918869 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2717/6065] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:48 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1364 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:48.974096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-437171dc-0370-4b93-8e1f-a4920da932ff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:49.020011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-437171dc-0370-4b93-8e1f-a4920da932ff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:49.027511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-437171dc-0370-4b93-8e1f-a4920da932ff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:49.036476 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-437171dc-0370-4b93-8e1f-a4920da932ff tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1719 microversion: 2.20 time: 0.747614 Oct 12 22:32:49.039890 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3349/6066] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:48 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1719 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:49.240203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4f31c997-c05f-4391-9039-be9d64b6e9cc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:49.241202 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4f31c997-c05f-4391-9039-be9d64b6e9cc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:49.287544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f31c997-c05f-4391-9039-be9d64b6e9cc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:49.292417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f31c997-c05f-4391-9039-be9d64b6e9cc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:49.297266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f31c997-c05f-4391-9039-be9d64b6e9cc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:49.300108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f31c997-c05f-4391-9039-be9d64b6e9cc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:49.304750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f31c997-c05f-4391-9039-be9d64b6e9cc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:49.305307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f31c997-c05f-4391-9039-be9d64b6e9cc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:49.613949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4f31c997-c05f-4391-9039-be9d64b6e9cc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:49.625385 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4f31c997-c05f-4391-9039-be9d64b6e9cc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 200 len: 1603 microversion: 2.1 time: 0.391087 Oct 12 22:32:49.626381 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2718/6067] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:49 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 1603 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:49.667312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-c6fc1554-af58-42a8-b7e1-fdfee0d40f94 req-90e0d213-0c39-439a-ae59-b08eb06fda56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c973408a-2071-4e50-aa87-b08294479f15", "name": "network-vif-deleted", "tag": "b8e5ca77-39e1-4915-9db4-a7c9dd58fa57"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:49.689678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:49.700802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c6fc1554-af58-42a8-b7e1-fdfee0d40f94 req-90e0d213-0c39-439a-ae59-b08eb06fda56 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:49.704813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c6fc1554-af58-42a8-b7e1-fdfee0d40f94 req-90e0d213-0c39-439a-ae59-b08eb06fda56 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:49.705369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c6fc1554-af58-42a8-b7e1-fdfee0d40f94 req-90e0d213-0c39-439a-ae59-b08eb06fda56 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:49.746256 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-c6fc1554-af58-42a8-b7e1-fdfee0d40f94 req-90e0d213-0c39-439a-ae59-b08eb06fda56 service nova] Creating event network-vif-deleted:b8e5ca77-39e1-4915-9db4-a7c9dd58fa57 for instance c973408a-2071-4e50-aa87-b08294479f15 on n-h2-861111-1 Oct 12 22:32:49.764705 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-c6fc1554-af58-42a8-b7e1-fdfee0d40f94 req-90e0d213-0c39-439a-ae59-b08eb06fda56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095579 Oct 12 22:32:49.765688 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3350/6068] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:49.948455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b7ff6541-9248-4a73-9785-cd442a1ce1a3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:49.948921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b7ff6541-9248-4a73-9785-cd442a1ce1a3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:49.975174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7ff6541-9248-4a73-9785-cd442a1ce1a3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:49.980502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7ff6541-9248-4a73-9785-cd442a1ce1a3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:49.980994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7ff6541-9248-4a73-9785-cd442a1ce1a3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:49.981776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7ff6541-9248-4a73-9785-cd442a1ce1a3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:49.982818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7ff6541-9248-4a73-9785-cd442a1ce1a3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:49.983303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7ff6541-9248-4a73-9785-cd442a1ce1a3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:50.407724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b7ff6541-9248-4a73-9785-cd442a1ce1a3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:50.431671 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b7ff6541-9248-4a73-9785-cd442a1ce1a3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1364 microversion: 2.1 time: 0.487733 Oct 12 22:32:50.432268 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2719/6069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:49 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1364 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:50.650621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-52bcf0c7-2433-420d-911e-4fa11e4b7311 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:50.652012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-52bcf0c7-2433-420d-911e-4fa11e4b7311 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: c973408a-2071-4e50-aa87-b08294479f15] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:50.668543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52bcf0c7-2433-420d-911e-4fa11e4b7311 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:50.669044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52bcf0c7-2433-420d-911e-4fa11e4b7311 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:50.670065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52bcf0c7-2433-420d-911e-4fa11e4b7311 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:50.671051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52bcf0c7-2433-420d-911e-4fa11e4b7311 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:50.671533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52bcf0c7-2433-420d-911e-4fa11e4b7311 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:50.671966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52bcf0c7-2433-420d-911e-4fa11e4b7311 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:50.710467 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-52bcf0c7-2433-420d-911e-4fa11e4b7311 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] HTTP exception thrown: Instance c973408a-2071-4e50-aa87-b08294479f15 could not be found. Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-52bcf0c7-2433-420d-911e-4fa11e4b7311 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Request method failure captured: Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 HTTP/1.1 Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz_NU6UQmSO7i7Bx75T1nJfatDuXoxDn89C0uP55LpKjWt8Tz54gd8kp0OWHBQKu17OneBMndQGOqsDqbMDUSzVrZTmVJWW9kZTcpD_NYyHyCbaGCH6an9e0wybdo6_Q-Euo0O4RnLcx3cwTPUrwDW8M_xqZJHFSXQdiEmMJ5C3u5I0 Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 08d857098e294c8da4f73d273912cdf3 Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestNetworkBasicOps-1431188583 Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/08d857098e294c8da4f73d273912cdf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/08d857098e294c8da4f73d273912cdf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_08d857098e294c8da4f73d273912cdf3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/08d857098e294c8da4f73d273912cdf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestNetworkBasicOps-1431188583 Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 08d857098e294c8da4f73d273912cdf3 Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestNetworkBasicOps-1431188583 Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestNetworkBasicOps-1431188583-project Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: a672bb095f984fb7b23d1acd55902865 Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestNetworkBasicOps-1431188583-project Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance c973408a-2071-4e50-aa87-b08294479f15 could not be found. Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'c973408a-2071-4e50-aa87-b08294479f15'} Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c973408a-2071-4e50-aa87-b08294479f15 could not be found. Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c973408a-2071-4e50-aa87-b08294479f15 could not be found. Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:50.712229 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:32:50.721395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:50.721395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:50.721395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:50.721395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:32:50.721395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:32:50.721395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c973408a-2071-4e50-aa87-b08294479f15 could not be found. Oct 12 22:32:50.721395 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:32:50.721395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-52bcf0c7-2433-420d-911e-4fa11e4b7311 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Returning 404 to user: Instance c973408a-2071-4e50-aa87-b08294479f15 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:50.721395 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-52bcf0c7-2433-420d-911e-4fa11e4b7311 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15" status: 404 len: 111 microversion: 2.1 time: 0.067427 Oct 12 22:32:50.721395 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3351/6070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:50 2022] GET /compute/v2.1/servers/c973408a-2071-4e50-aa87-b08294479f15 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:32:51.456677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cec8c2b3-63f0-44fe-8810-2a02049ddac3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:51.457388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cec8c2b3-63f0-44fe-8810-2a02049ddac3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:51.470293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cec8c2b3-63f0-44fe-8810-2a02049ddac3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:51.470797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cec8c2b3-63f0-44fe-8810-2a02049ddac3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:51.471286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cec8c2b3-63f0-44fe-8810-2a02049ddac3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:51.475103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cec8c2b3-63f0-44fe-8810-2a02049ddac3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:51.477020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cec8c2b3-63f0-44fe-8810-2a02049ddac3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:51.477475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cec8c2b3-63f0-44fe-8810-2a02049ddac3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:51.513978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:51.613708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-872bfb7c-9e17-448c-ad7b-9cdf2b420cc9 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '.version_select at 0x7f5122c6a280>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:51.677416 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-872bfb7c-9e17-448c-ad7b-9cdf2b420cc9 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-577487778" status: 202 len: 0 microversion: 2.1 time: 0.073736 Oct 12 22:32:51.678121 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3352/6071] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Oct 12 22:32:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-577487778 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:32:51.829374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-0165200c-9fd7-4ab0-97a2-fa23cd1f3828 req-4def7a1e-d8b9-4189-8a06-cb6d0a3fedd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce3ef25-cbc5-48bd-ad42-725ab00c92bd", "tag": "6a1e70d1-21d9-45f4-a40e-28c701dcadfa"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:51.856899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0165200c-9fd7-4ab0-97a2-fa23cd1f3828 req-4def7a1e-d8b9-4189-8a06-cb6d0a3fedd1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:51.859829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0165200c-9fd7-4ab0-97a2-fa23cd1f3828 req-4def7a1e-d8b9-4189-8a06-cb6d0a3fedd1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:51.861736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0165200c-9fd7-4ab0-97a2-fa23cd1f3828 req-4def7a1e-d8b9-4189-8a06-cb6d0a3fedd1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:51.916975 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-0165200c-9fd7-4ab0-97a2-fa23cd1f3828 req-4def7a1e-d8b9-4189-8a06-cb6d0a3fedd1 service nova] Creating event network-changed:6a1e70d1-21d9-45f4-a40e-28c701dcadfa for instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd on n-h1-861111-1 Oct 12 22:32:51.940887 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-0165200c-9fd7-4ab0-97a2-fa23cd1f3828 req-4def7a1e-d8b9-4189-8a06-cb6d0a3fedd1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114256 Oct 12 22:32:51.944101 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3353/6072] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:32:51.954665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cec8c2b3-63f0-44fe-8810-2a02049ddac3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:51.968592 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cec8c2b3-63f0-44fe-8810-2a02049ddac3 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1364 microversion: 2.1 time: 0.515378 Oct 12 22:32:51.971280 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2720/6073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:51 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1364 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:52.999058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-53591aae-9804-4a4d-bef5-9a569f6787d9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:52.999058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-53591aae-9804-4a4d-bef5-9a569f6787d9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:53.005542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53591aae-9804-4a4d-bef5-9a569f6787d9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:53.006250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53591aae-9804-4a4d-bef5-9a569f6787d9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:53.006846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53591aae-9804-4a4d-bef5-9a569f6787d9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:53.008201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53591aae-9804-4a4d-bef5-9a569f6787d9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:53.026469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53591aae-9804-4a4d-bef5-9a569f6787d9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:53.027232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53591aae-9804-4a4d-bef5-9a569f6787d9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:53.427132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-53591aae-9804-4a4d-bef5-9a569f6787d9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:53.438016 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-53591aae-9804-4a4d-bef5-9a569f6787d9 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1364 microversion: 2.1 time: 0.445374 Oct 12 22:32:53.439952 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3354/6074] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:52 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1364 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:54.465233 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-52134278-e64b-4f25-b87f-a6711bdfc5a0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:54.467096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-52134278-e64b-4f25-b87f-a6711bdfc5a0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:54.481564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52134278-e64b-4f25-b87f-a6711bdfc5a0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:54.483802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52134278-e64b-4f25-b87f-a6711bdfc5a0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:54.484517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52134278-e64b-4f25-b87f-a6711bdfc5a0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:54.486812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52134278-e64b-4f25-b87f-a6711bdfc5a0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:54.488727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52134278-e64b-4f25-b87f-a6711bdfc5a0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:54.489541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52134278-e64b-4f25-b87f-a6711bdfc5a0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:54.759594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-52134278-e64b-4f25-b87f-a6711bdfc5a0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:54.775775 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-52134278-e64b-4f25-b87f-a6711bdfc5a0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1364 microversion: 2.1 time: 0.315753 Oct 12 22:32:54.776412 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2721/6075] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:54 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1364 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:55.798186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-441f1e54-bbc7-4ef5-8966-e5155e40bc56 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:55.798835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-441f1e54-bbc7-4ef5-8966-e5155e40bc56 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:55.809746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-441f1e54-bbc7-4ef5-8966-e5155e40bc56 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:55.810825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-441f1e54-bbc7-4ef5-8966-e5155e40bc56 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:55.811441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-441f1e54-bbc7-4ef5-8966-e5155e40bc56 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:55.813099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-441f1e54-bbc7-4ef5-8966-e5155e40bc56 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:55.813640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-441f1e54-bbc7-4ef5-8966-e5155e40bc56 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:55.814151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-441f1e54-bbc7-4ef5-8966-e5155e40bc56 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:56.057798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-441f1e54-bbc7-4ef5-8966-e5155e40bc56 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:56.072711 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-441f1e54-bbc7-4ef5-8966-e5155e40bc56 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1364 microversion: 2.1 time: 0.278448 Oct 12 22:32:56.087804 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3355/6076] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:55 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1364 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:56.873682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-60bbe302-bc73-4341-8854-cbeb360d2917 req-74eb1cb8-07b5-4228-a6b7-f10cbb29d80f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce3ef25-cbc5-48bd-ad42-725ab00c92bd", "name": "network-vif-plugged", "status": "completed", "tag": "6a1e70d1-21d9-45f4-a40e-28c701dcadfa"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:56.903114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-60bbe302-bc73-4341-8854-cbeb360d2917 req-74eb1cb8-07b5-4228-a6b7-f10cbb29d80f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:56.903695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-60bbe302-bc73-4341-8854-cbeb360d2917 req-74eb1cb8-07b5-4228-a6b7-f10cbb29d80f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:56.913903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-60bbe302-bc73-4341-8854-cbeb360d2917 req-74eb1cb8-07b5-4228-a6b7-f10cbb29d80f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:56.938503 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-60bbe302-bc73-4341-8854-cbeb360d2917 req-74eb1cb8-07b5-4228-a6b7-f10cbb29d80f service nova] Creating event network-vif-plugged:6a1e70d1-21d9-45f4-a40e-28c701dcadfa for instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd on n-h1-861111-1 Oct 12 22:32:56.945127 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-60bbe302-bc73-4341-8854-cbeb360d2917 req-74eb1cb8-07b5-4228-a6b7-f10cbb29d80f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076034 Oct 12 22:32:56.946284 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2722/6077] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:32:57.099130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-26f4ea4b-3552-4f29-a553-3b267a6f214a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:57.099981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-26f4ea4b-3552-4f29-a553-3b267a6f214a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:57.121800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26f4ea4b-3552-4f29-a553-3b267a6f214a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:57.126648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26f4ea4b-3552-4f29-a553-3b267a6f214a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:57.127213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26f4ea4b-3552-4f29-a553-3b267a6f214a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:57.128025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26f4ea4b-3552-4f29-a553-3b267a6f214a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:57.128506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26f4ea4b-3552-4f29-a553-3b267a6f214a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:57.129150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26f4ea4b-3552-4f29-a553-3b267a6f214a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:57.767988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-26f4ea4b-3552-4f29-a553-3b267a6f214a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:57.777259 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-26f4ea4b-3552-4f29-a553-3b267a6f214a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1364 microversion: 2.1 time: 0.682987 Oct 12 22:32:57.805507 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3356/6078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:57 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1364 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:58.803078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a70da52d-c70a-4b42-8776-3e499bc06257 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:58.804520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a70da52d-c70a-4b42-8776-3e499bc06257 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:58.813500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a70da52d-c70a-4b42-8776-3e499bc06257 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:58.814698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a70da52d-c70a-4b42-8776-3e499bc06257 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:58.815562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a70da52d-c70a-4b42-8776-3e499bc06257 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:58.816554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a70da52d-c70a-4b42-8776-3e499bc06257 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:58.817259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a70da52d-c70a-4b42-8776-3e499bc06257 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:58.817915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a70da52d-c70a-4b42-8776-3e499bc06257 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:59.065533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a70da52d-c70a-4b42-8776-3e499bc06257 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:59.074038 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a70da52d-c70a-4b42-8776-3e499bc06257 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1549 microversion: 2.1 time: 0.275679 Oct 12 22:32:59.079426 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2723/6079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:58 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1549 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:59.119804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ece2713b-2559-404e-be5f-860e02a8d140 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:59.120337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ece2713b-2559-404e-be5f-860e02a8d140 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:59.129220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ece2713b-2559-404e-be5f-860e02a8d140 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:59.129597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ece2713b-2559-404e-be5f-860e02a8d140 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:59.130049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ece2713b-2559-404e-be5f-860e02a8d140 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:59.130741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ece2713b-2559-404e-be5f-860e02a8d140 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:59.131692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ece2713b-2559-404e-be5f-860e02a8d140 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:59.132947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ece2713b-2559-404e-be5f-860e02a8d140 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:59.280909 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ece2713b-2559-404e-be5f-860e02a8d140 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.165314 Oct 12 22:32:59.281484 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3357/6080] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:32:59 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:00.771595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-476f985c-6317-4811-8fc9-d27d08502f84 req-d902f31f-bc0e-40d7-aac8-94b58208215c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce3ef25-cbc5-48bd-ad42-725ab00c92bd", "tag": "6a1e70d1-21d9-45f4-a40e-28c701dcadfa"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:00.785571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-476f985c-6317-4811-8fc9-d27d08502f84 req-d902f31f-bc0e-40d7-aac8-94b58208215c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:00.786170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-476f985c-6317-4811-8fc9-d27d08502f84 req-d902f31f-bc0e-40d7-aac8-94b58208215c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:00.786607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-476f985c-6317-4811-8fc9-d27d08502f84 req-d902f31f-bc0e-40d7-aac8-94b58208215c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:00.836214 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-476f985c-6317-4811-8fc9-d27d08502f84 req-d902f31f-bc0e-40d7-aac8-94b58208215c service nova] Creating event network-changed:6a1e70d1-21d9-45f4-a40e-28c701dcadfa for instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd on n-h1-861111-1 Oct 12 22:33:00.849937 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-476f985c-6317-4811-8fc9-d27d08502f84 req-d902f31f-bc0e-40d7-aac8-94b58208215c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083115 Oct 12 22:33:00.855830 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2724/6081] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:33:08.998636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-66ddaf4b-68d7-4688-90df-b67547246707 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Action: 'create', calling method: .version_select at 0x7f5122b8af70>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1079467325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEikZzDmT/vNPRI/K8hVNxeAq0okMJ/3THNtBR9lIq2pTPy5Uxg8psZ9Z+QGd2h1BryU5YRHR0Qf+JrOGabw1zNZdrEMUuMLyVctx1uV9gUaxTo7k4s6rr3Lcqmzoxem3A=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:09.020036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-66ddaf4b-68d7-4688-90df-b67547246707 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Getting quotas for project 08d857098e294c8da4f73d273912cdf3. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:33:09.027403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-66ddaf4b-68d7-4688-90df-b67547246707 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Getting quotas for user a672bb095f984fb7b23d1acd55902865 and project 08d857098e294c8da4f73d273912cdf3. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:33:09.063942 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-66ddaf4b-68d7-4688-90df-b67547246707 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.070210 Oct 12 22:33:09.064973 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3358/6082] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:33:08 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:11.179177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:11.179963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=19 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:11.186082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1650031804", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "3080e939-82f1-44b6-9a29-871a9b8420f7"}], "key_name": "tempest-TestNetworkBasicOps-1079467325", "security_groups": [{"name": "tempest-secgroup-smoke-1359431063"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:11.397012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] validate_networks() for [('3080e939-82f1-44b6-9a29-871a9b8420f7', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:33:12.063825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:33:12.064779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:33:12.065274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:33:12.065687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:33:12.066103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:33:12.076248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:12.076733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:12.077553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:12.078294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:12.078751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:12.079468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:12.101927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Getting quotas for project 08d857098e294c8da4f73d273912cdf3. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:33:12.109103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Getting quotas for user a672bb095f984fb7b23d1acd55902865 and project 08d857098e294c8da4f73d273912cdf3. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:33:12.130037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:33:12.132661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:33:12.223029 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4c00428b-38b1-4d1f-9b2b-6f2145668d8b tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.045383 Oct 12 22:33:12.226139 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2725/6083] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:33:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:33:12.235607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=45 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:12.242680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4baed52f-22ec-4620-9bf6-c62fe4006c67 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:12.243368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4baed52f-22ec-4620-9bf6-c62fe4006c67 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:12.353033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4baed52f-22ec-4620-9bf6-c62fe4006c67 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:12.368997 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4baed52f-22ec-4620-9bf6-c62fe4006c67 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36" status: 200 len: 1249 microversion: 2.1 time: 0.134125 Oct 12 22:33:12.373045 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3359/6084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:12 2022] GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 => generated 1249 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:13.400625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-57db0515-c15b-4e27-a82c-ecae18034eed tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:13.401373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-57db0515-c15b-4e27-a82c-ecae18034eed tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:13.410347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57db0515-c15b-4e27-a82c-ecae18034eed tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.410809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57db0515-c15b-4e27-a82c-ecae18034eed tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.411271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57db0515-c15b-4e27-a82c-ecae18034eed tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.411984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57db0515-c15b-4e27-a82c-ecae18034eed tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.412801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57db0515-c15b-4e27-a82c-ecae18034eed tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.413231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57db0515-c15b-4e27-a82c-ecae18034eed tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.484502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-57db0515-c15b-4e27-a82c-ecae18034eed tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:13.506603 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-57db0515-c15b-4e27-a82c-ecae18034eed tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36" status: 200 len: 1301 microversion: 2.1 time: 0.112240 Oct 12 22:33:13.507321 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2726/6085] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:13 2022] GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 => generated 1301 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:14.530056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a503e698-43b4-4ed9-8c10-37a8bc2429fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:14.530683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a503e698-43b4-4ed9-8c10-37a8bc2429fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:14.541087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a503e698-43b4-4ed9-8c10-37a8bc2429fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:14.541584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a503e698-43b4-4ed9-8c10-37a8bc2429fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:14.542749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a503e698-43b4-4ed9-8c10-37a8bc2429fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:14.544521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a503e698-43b4-4ed9-8c10-37a8bc2429fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:14.545176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a503e698-43b4-4ed9-8c10-37a8bc2429fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:14.545782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a503e698-43b4-4ed9-8c10-37a8bc2429fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:14.889006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a503e698-43b4-4ed9-8c10-37a8bc2429fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:14.900158 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a503e698-43b4-4ed9-8c10-37a8bc2429fa tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36" status: 200 len: 1375 microversion: 2.1 time: 0.373871 Oct 12 22:33:14.902403 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3360/6086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:14 2022] GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 => generated 1375 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:15.689783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-70950e17-1a43-4fc1-ae0b-4e6520358cad req-da3eb168-ee5b-48e8-af72-5ad4a85b81ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6796590a-7d3a-4b4b-8707-fa1aacc8aa36", "tag": "9a8e89c0-535a-4e74-b829-fff4a082c91a"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:15.715698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-70950e17-1a43-4fc1-ae0b-4e6520358cad req-da3eb168-ee5b-48e8-af72-5ad4a85b81ad service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:15.716782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-70950e17-1a43-4fc1-ae0b-4e6520358cad req-da3eb168-ee5b-48e8-af72-5ad4a85b81ad service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:15.717436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-70950e17-1a43-4fc1-ae0b-4e6520358cad req-da3eb168-ee5b-48e8-af72-5ad4a85b81ad service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:15.731452 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-70950e17-1a43-4fc1-ae0b-4e6520358cad req-da3eb168-ee5b-48e8-af72-5ad4a85b81ad service nova] Creating event network-changed:9a8e89c0-535a-4e74-b829-fff4a082c91a for instance 6796590a-7d3a-4b4b-8707-fa1aacc8aa36 on n-h2-861111-1 Oct 12 22:33:15.737770 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-70950e17-1a43-4fc1-ae0b-4e6520358cad req-da3eb168-ee5b-48e8-af72-5ad4a85b81ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053270 Oct 12 22:33:15.738763 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2727/6087] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:15.924025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-da0be73a-d8c8-4cfc-b3a7-f98700a58dfc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:15.925432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-da0be73a-d8c8-4cfc-b3a7-f98700a58dfc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:15.935360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da0be73a-d8c8-4cfc-b3a7-f98700a58dfc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:15.935864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da0be73a-d8c8-4cfc-b3a7-f98700a58dfc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:15.936393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da0be73a-d8c8-4cfc-b3a7-f98700a58dfc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:15.937317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da0be73a-d8c8-4cfc-b3a7-f98700a58dfc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:15.937777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da0be73a-d8c8-4cfc-b3a7-f98700a58dfc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:15.938511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da0be73a-d8c8-4cfc-b3a7-f98700a58dfc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:16.107623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-da0be73a-d8c8-4cfc-b3a7-f98700a58dfc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:16.116894 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-da0be73a-d8c8-4cfc-b3a7-f98700a58dfc tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36" status: 200 len: 1375 microversion: 2.1 time: 0.196803 Oct 12 22:33:16.128393 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3361/6088] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:15 2022] GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 => generated 1375 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:17.158768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bd52b273-b2c9-4255-9f55-ef2944eb5add tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:17.159666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bd52b273-b2c9-4255-9f55-ef2944eb5add tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:17.173084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd52b273-b2c9-4255-9f55-ef2944eb5add tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:17.173644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd52b273-b2c9-4255-9f55-ef2944eb5add tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:17.174651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd52b273-b2c9-4255-9f55-ef2944eb5add tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:17.177148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd52b273-b2c9-4255-9f55-ef2944eb5add tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:17.177694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd52b273-b2c9-4255-9f55-ef2944eb5add tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:17.179384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd52b273-b2c9-4255-9f55-ef2944eb5add tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:17.396002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd52b273-b2c9-4255-9f55-ef2944eb5add tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:17.404353 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bd52b273-b2c9-4255-9f55-ef2944eb5add tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36" status: 200 len: 1375 microversion: 2.1 time: 0.252640 Oct 12 22:33:17.404927 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2728/6089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:17 2022] GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 => generated 1375 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:18.432789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9f368aa2-cfa0-40e9-bbc5-51b8990b0f9a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:18.433499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9f368aa2-cfa0-40e9-bbc5-51b8990b0f9a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:18.460221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f368aa2-cfa0-40e9-bbc5-51b8990b0f9a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:18.461316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f368aa2-cfa0-40e9-bbc5-51b8990b0f9a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:18.461906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f368aa2-cfa0-40e9-bbc5-51b8990b0f9a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:18.462765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f368aa2-cfa0-40e9-bbc5-51b8990b0f9a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:18.463143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f368aa2-cfa0-40e9-bbc5-51b8990b0f9a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:18.463689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f368aa2-cfa0-40e9-bbc5-51b8990b0f9a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:18.758194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9f368aa2-cfa0-40e9-bbc5-51b8990b0f9a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:18.770346 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9f368aa2-cfa0-40e9-bbc5-51b8990b0f9a tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36" status: 200 len: 1375 microversion: 2.1 time: 0.342053 Oct 12 22:33:18.779157 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3362/6090] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:18 2022] GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 => generated 1375 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:19.392802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83c378c8-6dd1-49c2-b7c7-f961ed46048e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:19.395754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-83c378c8-6dd1-49c2-b7c7-f961ed46048e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:19.403140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83c378c8-6dd1-49c2-b7c7-f961ed46048e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:19.404262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83c378c8-6dd1-49c2-b7c7-f961ed46048e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:19.404789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83c378c8-6dd1-49c2-b7c7-f961ed46048e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:19.405601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83c378c8-6dd1-49c2-b7c7-f961ed46048e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:19.406187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83c378c8-6dd1-49c2-b7c7-f961ed46048e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:19.406722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83c378c8-6dd1-49c2-b7c7-f961ed46048e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:19.458538 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-83c378c8-6dd1-49c2-b7c7-f961ed46048e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.071118 Oct 12 22:33:19.475510 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2729/6091] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 12 22:33:19 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:19.535119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c3c1b6f1-f413-4585-bfdf-8b311b84b462 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:19.536303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c3c1b6f1-f413-4585-bfdf-8b311b84b462 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:19.544529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3c1b6f1-f413-4585-bfdf-8b311b84b462 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:19.545358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3c1b6f1-f413-4585-bfdf-8b311b84b462 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:19.546023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3c1b6f1-f413-4585-bfdf-8b311b84b462 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:19.546957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3c1b6f1-f413-4585-bfdf-8b311b84b462 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:19.547711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3c1b6f1-f413-4585-bfdf-8b311b84b462 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:19.548696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3c1b6f1-f413-4585-bfdf-8b311b84b462 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:19.586747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c3c1b6f1-f413-4585-bfdf-8b311b84b462 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:33:19.703451 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c3c1b6f1-f413-4585-bfdf-8b311b84b462 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 204 len: 0 microversion: 2.20 time: 0.170079 Oct 12 22:33:19.704393 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3363/6092] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:33:19 2022] DELETE /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:33:19.718710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-45cb9858-a693-4c13-a878-53f33dbcff10 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:19.720505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-45cb9858-a693-4c13-a878-53f33dbcff10 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:19.731177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45cb9858-a693-4c13-a878-53f33dbcff10 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:19.731711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45cb9858-a693-4c13-a878-53f33dbcff10 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:19.732161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45cb9858-a693-4c13-a878-53f33dbcff10 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:19.733366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45cb9858-a693-4c13-a878-53f33dbcff10 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:19.734718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45cb9858-a693-4c13-a878-53f33dbcff10 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:19.735198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45cb9858-a693-4c13-a878-53f33dbcff10 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:19.795316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6fbdc479-4c10-4c6f-8b6d-8b015689c9c5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:19.796443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6fbdc479-4c10-4c6f-8b6d-8b015689c9c5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:19.805990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fbdc479-4c10-4c6f-8b6d-8b015689c9c5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:19.806800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fbdc479-4c10-4c6f-8b6d-8b015689c9c5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:19.807694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fbdc479-4c10-4c6f-8b6d-8b015689c9c5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:19.809206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fbdc479-4c10-4c6f-8b6d-8b015689c9c5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:19.811001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fbdc479-4c10-4c6f-8b6d-8b015689c9c5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:19.815573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6fbdc479-4c10-4c6f-8b6d-8b015689c9c5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:19.989485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-45cb9858-a693-4c13-a878-53f33dbcff10 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:20.000180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-45cb9858-a693-4c13-a878-53f33dbcff10 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:20.002390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-45cb9858-a693-4c13-a878-53f33dbcff10 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:20.004248 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-45cb9858-a693-4c13-a878-53f33dbcff10 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1725 microversion: 2.20 time: 0.294968 Oct 12 22:33:20.006327 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2730/6093] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:19 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1725 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:20.026041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6fbdc479-4c10-4c6f-8b6d-8b015689c9c5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:20.044051 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6fbdc479-4c10-4c6f-8b6d-8b015689c9c5 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36" status: 200 len: 1375 microversion: 2.1 time: 0.252883 Oct 12 22:33:20.044864 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3364/6094] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:19 2022] GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 => generated 1375 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:21.036866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-57601bc6-5e0c-4afb-a8dc-ec90e69c6269 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:21.038192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-57601bc6-5e0c-4afb-a8dc-ec90e69c6269 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:21.056729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57601bc6-5e0c-4afb-a8dc-ec90e69c6269 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:21.057231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57601bc6-5e0c-4afb-a8dc-ec90e69c6269 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:21.057669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57601bc6-5e0c-4afb-a8dc-ec90e69c6269 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:21.059165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57601bc6-5e0c-4afb-a8dc-ec90e69c6269 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:21.059657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57601bc6-5e0c-4afb-a8dc-ec90e69c6269 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:21.060083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57601bc6-5e0c-4afb-a8dc-ec90e69c6269 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:21.079978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cf9d1582-8a7d-4043-9291-0a2cea035287 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:21.080595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cf9d1582-8a7d-4043-9291-0a2cea035287 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:21.085500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:21.100520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf9d1582-8a7d-4043-9291-0a2cea035287 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:21.101260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf9d1582-8a7d-4043-9291-0a2cea035287 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:21.102069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf9d1582-8a7d-4043-9291-0a2cea035287 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:21.102971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf9d1582-8a7d-4043-9291-0a2cea035287 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:21.103693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf9d1582-8a7d-4043-9291-0a2cea035287 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:21.104299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf9d1582-8a7d-4043-9291-0a2cea035287 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:21.322758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cf9d1582-8a7d-4043-9291-0a2cea035287 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:21.336692 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cf9d1582-8a7d-4043-9291-0a2cea035287 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36" status: 200 len: 1375 microversion: 2.1 time: 0.263363 Oct 12 22:33:21.349761 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3365/6095] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:21 2022] GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 => generated 1375 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:21.417760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-57601bc6-5e0c-4afb-a8dc-ec90e69c6269 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:21.427322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-57601bc6-5e0c-4afb-a8dc-ec90e69c6269 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:21.432194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-57601bc6-5e0c-4afb-a8dc-ec90e69c6269 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:21.436546 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-57601bc6-5e0c-4afb-a8dc-ec90e69c6269 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1725 microversion: 2.20 time: 0.405026 Oct 12 22:33:21.437680 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2731/6096] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:21 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1725 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:22.005873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-0e829023-e155-4896-9f9b-536ecbd33793 req-74edb0da-ada4-411d-b178-45b3019c2d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6796590a-7d3a-4b4b-8707-fa1aacc8aa36", "name": "network-vif-plugged", "status": "completed", "tag": "9a8e89c0-535a-4e74-b829-fff4a082c91a"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:22.035280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0e829023-e155-4896-9f9b-536ecbd33793 req-74edb0da-ada4-411d-b178-45b3019c2d20 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:22.037939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0e829023-e155-4896-9f9b-536ecbd33793 req-74edb0da-ada4-411d-b178-45b3019c2d20 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:22.038407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0e829023-e155-4896-9f9b-536ecbd33793 req-74edb0da-ada4-411d-b178-45b3019c2d20 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:22.100287 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-0e829023-e155-4896-9f9b-536ecbd33793 req-74edb0da-ada4-411d-b178-45b3019c2d20 service nova] Creating event network-vif-plugged:9a8e89c0-535a-4e74-b829-fff4a082c91a for instance 6796590a-7d3a-4b4b-8707-fa1aacc8aa36 on n-h2-861111-1 Oct 12 22:33:22.119860 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-0e829023-e155-4896-9f9b-536ecbd33793 req-74edb0da-ada4-411d-b178-45b3019c2d20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119449 Oct 12 22:33:22.125059 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3366/6097] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:22.363160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-446c581f-8146-4da7-ace3-45696c90ec30 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:22.363806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-446c581f-8146-4da7-ace3-45696c90ec30 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:22.368871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:22.369539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:22.406774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-446c581f-8146-4da7-ace3-45696c90ec30 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:22.407412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-446c581f-8146-4da7-ace3-45696c90ec30 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:22.407876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-446c581f-8146-4da7-ace3-45696c90ec30 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:22.408623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-446c581f-8146-4da7-ace3-45696c90ec30 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:22.409083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-446c581f-8146-4da7-ace3-45696c90ec30 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:22.417196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-446c581f-8146-4da7-ace3-45696c90ec30 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:22.460481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:22.475299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4b6e03b3-9a2f-483d-8ee0-495628c5d7e9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:22.476252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4b6e03b3-9a2f-483d-8ee0-495628c5d7e9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:22.500736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b6e03b3-9a2f-483d-8ee0-495628c5d7e9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:22.501473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b6e03b3-9a2f-483d-8ee0-495628c5d7e9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:22.502000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b6e03b3-9a2f-483d-8ee0-495628c5d7e9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:22.503010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b6e03b3-9a2f-483d-8ee0-495628c5d7e9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:22.503614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b6e03b3-9a2f-483d-8ee0-495628c5d7e9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:22.504156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b6e03b3-9a2f-483d-8ee0-495628c5d7e9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:22.640790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b6e03b3-9a2f-483d-8ee0-495628c5d7e9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:22.654832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b6e03b3-9a2f-483d-8ee0-495628c5d7e9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:22.656415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b6e03b3-9a2f-483d-8ee0-495628c5d7e9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79554521f9f432e87f6f3e0b0f11b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e5feb7b4548bdb114d0aeaa6ea5cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:22.667763 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4b6e03b3-9a2f-483d-8ee0-495628c5d7e9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 200 len: 1657 microversion: 2.20 time: 0.208418 Oct 12 22:33:22.685890 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3367/6098] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:22 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 1657 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:22.883109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-1c6075e1-2d21-4d40-80ef-18d4fa2df87f req-d1dd9f2c-0d0d-4690-9b7b-0d14bee47b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d", "name": "network-vif-deleted", "tag": "ad849817-ecb6-4b77-a207-c06765b7f617"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:22.897492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1c6075e1-2d21-4d40-80ef-18d4fa2df87f req-d1dd9f2c-0d0d-4690-9b7b-0d14bee47b80 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:22.898816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1c6075e1-2d21-4d40-80ef-18d4fa2df87f req-d1dd9f2c-0d0d-4690-9b7b-0d14bee47b80 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:22.899770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1c6075e1-2d21-4d40-80ef-18d4fa2df87f req-d1dd9f2c-0d0d-4690-9b7b-0d14bee47b80 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:22.904438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-446c581f-8146-4da7-ace3-45696c90ec30 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:22.913540 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-1c6075e1-2d21-4d40-80ef-18d4fa2df87f req-d1dd9f2c-0d0d-4690-9b7b-0d14bee47b80 service nova] Creating event network-vif-deleted:ad849817-ecb6-4b77-a207-c06765b7f617 for instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d on n-h1-861111-1 Oct 12 22:33:22.919873 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-1c6075e1-2d21-4d40-80ef-18d4fa2df87f req-d1dd9f2c-0d0d-4690-9b7b-0d14bee47b80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040571 Oct 12 22:33:22.921114 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3368/6099] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:33:22.926418 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-446c581f-8146-4da7-ace3-45696c90ec30 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36" status: 200 len: 1375 microversion: 2.1 time: 0.566829 Oct 12 22:33:22.927009 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2732/6100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:22 2022] GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 => generated 1375 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:23.702913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8f3259c5-a46e-4c9c-86d1-6bbb689aa58e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:23.704537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8f3259c5-a46e-4c9c-86d1-6bbb689aa58e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:23.728706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f3259c5-a46e-4c9c-86d1-6bbb689aa58e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:23.729702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f3259c5-a46e-4c9c-86d1-6bbb689aa58e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:23.730619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f3259c5-a46e-4c9c-86d1-6bbb689aa58e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:23.731648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f3259c5-a46e-4c9c-86d1-6bbb689aa58e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:23.732932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f3259c5-a46e-4c9c-86d1-6bbb689aa58e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:23.733626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f3259c5-a46e-4c9c-86d1-6bbb689aa58e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:23.772445 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-8f3259c5-a46e-4c9c-86d1-6bbb689aa58e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] HTTP exception thrown: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8f3259c5-a46e-4c9c-86d1-6bbb689aa58e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Request method failure captured: Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d HTTP/1.1 Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz8ToxlzfCHBEMSzdQ8_A6J-U_BRf4lX8JTLHMNN7XwYCBcY72mthX2TxQtrUuWJp2jw9OLL0rkEOMj0GMsxB1BFYaDxqhy2QpvcJj2UrKBt_BKrMNjKzJc3L1BBkZlgu4AL42RTnKHp-D9SnRWaPrQ6y0eMruBdzp52tSpRl_phxf8 Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 044e5feb7b4548bdb114d0aeaa6ea5cb Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_044e5feb7b4548bdb114d0aeaa6ea5cb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 044e5feb7b4548bdb114d0aeaa6ea5cb Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeShelveTestJSON-684969485-project Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: d79554521f9f432e87f6f3e0b0f11b85 Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeShelveTestJSON-684969485-project Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d'} Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.774369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:23.779628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.779628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.779628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:23.779628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:23.779628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:23.779628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:23.779628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. Oct 12 22:33:23.779628 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.779628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8f3259c5-a46e-4c9c-86d1-6bbb689aa58e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Returning 404 to user: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:23.779628 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8f3259c5-a46e-4c9c-86d1-6bbb689aa58e tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 404 len: 111 microversion: 2.20 time: 0.082398 Oct 12 22:33:23.779628 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3369/6101] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:23 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:33:23.787755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ef6907b3-93d5-4c4b-9967-d0a04f4115f9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '.version_select at 0x7f51230e6c10>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:23.820714 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ef6907b3-93d5-4c4b-9967-d0a04f4115f9 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1038961112" status: 204 len: 0 microversion: 2.20 time: 0.037838 Oct 12 22:33:23.821589 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2733/6102] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 12 22:33:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1038961112 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:33:23.950175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3c1502d3-4de8-40a6-b29f-032eeac3a165 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:23.951095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3c1502d3-4de8-40a6-b29f-032eeac3a165 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:23.967351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c1502d3-4de8-40a6-b29f-032eeac3a165 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:23.968151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c1502d3-4de8-40a6-b29f-032eeac3a165 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:23.968772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c1502d3-4de8-40a6-b29f-032eeac3a165 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:23.974889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c1502d3-4de8-40a6-b29f-032eeac3a165 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:23.975669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c1502d3-4de8-40a6-b29f-032eeac3a165 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:23.976109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c1502d3-4de8-40a6-b29f-032eeac3a165 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:24.264062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3c1502d3-4de8-40a6-b29f-032eeac3a165 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:24.274949 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3c1502d3-4de8-40a6-b29f-032eeac3a165 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36" status: 200 len: 1375 microversion: 2.1 time: 0.328530 Oct 12 22:33:24.293415 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3370/6103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:23 2022] GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 => generated 1375 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:25.302292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5fa1d305-f77c-466b-8478-143626082483 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:25.304538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5fa1d305-f77c-466b-8478-143626082483 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:25.354470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fa1d305-f77c-466b-8478-143626082483 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:25.357330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fa1d305-f77c-466b-8478-143626082483 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:25.357945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fa1d305-f77c-466b-8478-143626082483 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:25.358727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fa1d305-f77c-466b-8478-143626082483 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:25.359647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fa1d305-f77c-466b-8478-143626082483 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:25.360096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fa1d305-f77c-466b-8478-143626082483 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:25.709718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5fa1d305-f77c-466b-8478-143626082483 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:25.723303 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5fa1d305-f77c-466b-8478-143626082483 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36" status: 200 len: 1548 microversion: 2.1 time: 0.427802 Oct 12 22:33:25.724052 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2734/6104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:25 2022] GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 => generated 1548 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:25.747954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-07071884-5788-45e7-81cf-87a69a3e0b14 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:25.752270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-07071884-5788-45e7-81cf-87a69a3e0b14 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:25.761374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07071884-5788-45e7-81cf-87a69a3e0b14 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:25.762274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07071884-5788-45e7-81cf-87a69a3e0b14 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:25.762969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07071884-5788-45e7-81cf-87a69a3e0b14 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:25.764189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07071884-5788-45e7-81cf-87a69a3e0b14 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:25.764886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07071884-5788-45e7-81cf-87a69a3e0b14 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:25.765540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07071884-5788-45e7-81cf-87a69a3e0b14 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:25.963001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-07071884-5788-45e7-81cf-87a69a3e0b14 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:25.972290 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-07071884-5788-45e7-81cf-87a69a3e0b14 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36" status: 200 len: 1548 microversion: 2.1 time: 0.228410 Oct 12 22:33:25.995665 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3371/6105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:25 2022] GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 => generated 1548 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:28.221882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-df27afd1-fa54-4396-97fe-2bbe293dbc86 req-58b134ea-31ae-4958-ba72-2eea825bc074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6796590a-7d3a-4b4b-8707-fa1aacc8aa36", "tag": "9a8e89c0-535a-4e74-b829-fff4a082c91a"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:28.234899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ac30cb2a-6967-4d1b-bf2a-d5b3410fc0a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:28.236082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ac30cb2a-6967-4d1b-bf2a-d5b3410fc0a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:28.256709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac30cb2a-6967-4d1b-bf2a-d5b3410fc0a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:28.259829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac30cb2a-6967-4d1b-bf2a-d5b3410fc0a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:28.260522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac30cb2a-6967-4d1b-bf2a-d5b3410fc0a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:28.262396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-df27afd1-fa54-4396-97fe-2bbe293dbc86 req-58b134ea-31ae-4958-ba72-2eea825bc074 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:28.263391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac30cb2a-6967-4d1b-bf2a-d5b3410fc0a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:28.264047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac30cb2a-6967-4d1b-bf2a-d5b3410fc0a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:28.264686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ac30cb2a-6967-4d1b-bf2a-d5b3410fc0a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:28.265379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-df27afd1-fa54-4396-97fe-2bbe293dbc86 req-58b134ea-31ae-4958-ba72-2eea825bc074 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:28.267456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-df27afd1-fa54-4396-97fe-2bbe293dbc86 req-58b134ea-31ae-4958-ba72-2eea825bc074 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:28.297164 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-ac30cb2a-6967-4d1b-bf2a-d5b3410fc0a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] HTTP exception thrown: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. Oct 12 22:33:28.298608 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-df27afd1-fa54-4396-97fe-2bbe293dbc86 req-58b134ea-31ae-4958-ba72-2eea825bc074 service nova] Creating event network-changed:9a8e89c0-535a-4e74-b829-fff4a082c91a for instance 6796590a-7d3a-4b4b-8707-fa1aacc8aa36 on n-h2-861111-1 Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ac30cb2a-6967-4d1b-bf2a-d5b3410fc0a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Request method failure captured: Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d HTTP/1.1 Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz8ToxlzfCHBEMSzdQ8_A6J-U_BRf4lX8JTLHMNN7XwYCBcY72mthX2TxQtrUuWJp2jw9OLL0rkEOMj0GMsxB1BFYaDxqhy2QpvcJj2UrKBt_BKrMNjKzJc3L1BBkZlgu4AL42RTnKHp-D9SnRWaPrQ6y0eMruBdzp52tSpRl_phxf8 Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 044e5feb7b4548bdb114d0aeaa6ea5cb Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_044e5feb7b4548bdb114d0aeaa6ea5cb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 044e5feb7b4548bdb114d0aeaa6ea5cb Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeShelveTestJSON-684969485-project Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: d79554521f9f432e87f6f3e0b0f11b85 Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeShelveTestJSON-684969485-project Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d'} Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:33:28.300485 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:33:28.306799 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. Oct 12 22:33:28.306799 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:28.306799 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:28.306799 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:28.306799 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:28.306799 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:28.306799 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:28.306799 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:28.306799 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:28.306799 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. Oct 12 22:33:28.306799 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:28.310571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ac30cb2a-6967-4d1b-bf2a-d5b3410fc0a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Returning 404 to user: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:28.314135 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ac30cb2a-6967-4d1b-bf2a-d5b3410fc0a1 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 404 len: 111 microversion: 2.20 time: 0.083656 Oct 12 22:33:28.315777 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3372/6106] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:33:28 2022] DELETE /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:33:28.321129 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-df27afd1-fa54-4396-97fe-2bbe293dbc86 req-58b134ea-31ae-4958-ba72-2eea825bc074 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099683 Oct 12 22:33:28.323110 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2735/6107] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:28.337992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a9896493-8608-4e36-ac4b-14cd1e309a20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:28.338866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a9896493-8608-4e36-ac4b-14cd1e309a20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:28.356597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9896493-8608-4e36-ac4b-14cd1e309a20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:28.357404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9896493-8608-4e36-ac4b-14cd1e309a20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:28.358655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9896493-8608-4e36-ac4b-14cd1e309a20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:28.359669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9896493-8608-4e36-ac4b-14cd1e309a20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:28.364314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9896493-8608-4e36-ac4b-14cd1e309a20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:28.364994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9896493-8608-4e36-ac4b-14cd1e309a20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:28.396679 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-a9896493-8608-4e36-ac4b-14cd1e309a20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] HTTP exception thrown: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a9896493-8608-4e36-ac4b-14cd1e309a20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Request method failure captured: Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d HTTP/1.1 Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz8ToxlzfCHBEMSzdQ8_A6J-U_BRf4lX8JTLHMNN7XwYCBcY72mthX2TxQtrUuWJp2jw9OLL0rkEOMj0GMsxB1BFYaDxqhy2QpvcJj2UrKBt_BKrMNjKzJc3L1BBkZlgu4AL42RTnKHp-D9SnRWaPrQ6y0eMruBdzp52tSpRl_phxf8 Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 044e5feb7b4548bdb114d0aeaa6ea5cb Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_044e5feb7b4548bdb114d0aeaa6ea5cb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 044e5feb7b4548bdb114d0aeaa6ea5cb Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeShelveTestJSON-684969485-project Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: d79554521f9f432e87f6f3e0b0f11b85 Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeShelveTestJSON-684969485-project Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d'} Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:28.398590 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:28.404018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:28.404018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:28.404018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:28.404018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:28.404018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:28.404018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:28.404018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. Oct 12 22:33:28.404018 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:28.406368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a9896493-8608-4e36-ac4b-14cd1e309a20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Returning 404 to user: Instance ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:28.407362 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a9896493-8608-4e36-ac4b-14cd1e309a20 tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d" status: 404 len: 111 microversion: 2.20 time: 0.087935 Oct 12 22:33:28.407859 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3373/6108] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:28 2022] GET /compute/v2.1/servers/ef8ae06f-a8fe-4e6d-a7ec-1b3b0836bc6d => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:33:32.860926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c74d6afa-2a67-48d9-991e-0c174243a0dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:32.861649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c74d6afa-2a67-48d9-991e-0c174243a0dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:32.868134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c74d6afa-2a67-48d9-991e-0c174243a0dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:32.868629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c74d6afa-2a67-48d9-991e-0c174243a0dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:32.869131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c74d6afa-2a67-48d9-991e-0c174243a0dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:32.869894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c74d6afa-2a67-48d9-991e-0c174243a0dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:32.870435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c74d6afa-2a67-48d9-991e-0c174243a0dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:32.870984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c74d6afa-2a67-48d9-991e-0c174243a0dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:32.884864 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-c74d6afa-2a67-48d9-991e-0c174243a0dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] HTTP exception thrown: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c74d6afa-2a67-48d9-991e-0c174243a0dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Request method failure captured: Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a HTTP/1.1 Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz8ToxlzfCHBEMSzdQ8_A6J-U_BRf4lX8JTLHMNN7XwYCBcY72mthX2TxQtrUuWJp2jw9OLL0rkEOMj0GMsxB1BFYaDxqhy2QpvcJj2UrKBt_BKrMNjKzJc3L1BBkZlgu4AL42RTnKHp-D9SnRWaPrQ6y0eMruBdzp52tSpRl_phxf8 Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 044e5feb7b4548bdb114d0aeaa6ea5cb Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_044e5feb7b4548bdb114d0aeaa6ea5cb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 044e5feb7b4548bdb114d0aeaa6ea5cb Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-AttachVolumeShelveTestJSON-684969485-project Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: d79554521f9f432e87f6f3e0b0f11b85 Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeShelveTestJSON-684969485-project Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '97ecbb62-d209-4784-9a32-1076041ce09a'} Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:33:32.887266 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:33:32.892301 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. Oct 12 22:33:32.892301 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:33:32.892301 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:32.892301 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:33:32.892301 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:32.892301 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:32.892301 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:32.892301 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:32.892301 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:32.892301 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. Oct 12 22:33:32.892301 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:33:32.892301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c74d6afa-2a67-48d9-991e-0c174243a0dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Returning 404 to user: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:32.892301 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c74d6afa-2a67-48d9-991e-0c174243a0dc tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "DELETE /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 404 len: 111 microversion: 2.20 time: 0.033435 Oct 12 22:33:32.892301 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2736/6109] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 12 22:33:32 2022] DELETE /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:33:32.897295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a4705678-bf25-4582-b33f-134ce85201aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:32.897915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a4705678-bf25-4582-b33f-134ce85201aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] [instance: 97ecbb62-d209-4784-9a32-1076041ce09a] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:32.906373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4705678-bf25-4582-b33f-134ce85201aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:32.906863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4705678-bf25-4582-b33f-134ce85201aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:32.907324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4705678-bf25-4582-b33f-134ce85201aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:32.908029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4705678-bf25-4582-b33f-134ce85201aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:32.908484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4705678-bf25-4582-b33f-134ce85201aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:32.908912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4705678-bf25-4582-b33f-134ce85201aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:32.924395 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-a4705678-bf25-4582-b33f-134ce85201aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] HTTP exception thrown: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a4705678-bf25-4582-b33f-134ce85201aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Request method failure captured: Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a HTTP/1.1 Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz8ToxlzfCHBEMSzdQ8_A6J-U_BRf4lX8JTLHMNN7XwYCBcY72mthX2TxQtrUuWJp2jw9OLL0rkEOMj0GMsxB1BFYaDxqhy2QpvcJj2UrKBt_BKrMNjKzJc3L1BBkZlgu4AL42RTnKHp-D9SnRWaPrQ6y0eMruBdzp52tSpRl_phxf8 Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 044e5feb7b4548bdb114d0aeaa6ea5cb Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_044e5feb7b4548bdb114d0aeaa6ea5cb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/044e5feb7b4548bdb114d0aeaa6ea5cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 044e5feb7b4548bdb114d0aeaa6ea5cb Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-684969485 Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeShelveTestJSON-684969485-project Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: d79554521f9f432e87f6f3e0b0f11b85 Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeShelveTestJSON-684969485-project Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '97ecbb62-d209-4784-9a32-1076041ce09a'} Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:32.926000 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:32.935823 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:32.935823 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:32.935823 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:32.935823 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:32.935823 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:32.935823 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:32.935823 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. Oct 12 22:33:32.935823 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:33:32.935823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a4705678-bf25-4582-b33f-134ce85201aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] Returning 404 to user: Instance 97ecbb62-d209-4784-9a32-1076041ce09a could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:32.935823 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a4705678-bf25-4582-b33f-134ce85201aa tempest-AttachVolumeShelveTestJSON-684969485 tempest-AttachVolumeShelveTestJSON-684969485-project] 10.222.0.16 "GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a" status: 404 len: 111 microversion: 2.20 time: 0.034066 Oct 12 22:33:32.935823 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3374/6110] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:32 2022] GET /compute/v2.1/servers/97ecbb62-d209-4784-9a32-1076041ce09a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:33:35.693749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d3f16c80-ca42-4513-9dce-8dfbd89d9521 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:35.694373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d3f16c80-ca42-4513-9dce-8dfbd89d9521 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:35.709278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d3f16c80-ca42-4513-9dce-8dfbd89d9521 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:35.709781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d3f16c80-ca42-4513-9dce-8dfbd89d9521 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:35.718758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d3f16c80-ca42-4513-9dce-8dfbd89d9521 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:35.723905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d3f16c80-ca42-4513-9dce-8dfbd89d9521 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:35.727286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d3f16c80-ca42-4513-9dce-8dfbd89d9521 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:35.729424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d3f16c80-ca42-4513-9dce-8dfbd89d9521 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:35.794369 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d3f16c80-ca42-4513-9dce-8dfbd89d9521 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/ips" status: 200 len: 145 microversion: 2.1 time: 0.105009 Oct 12 22:33:35.795328 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2737/6111] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 12 22:33:35 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/ips => generated 145 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:38.524493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c8e922f5-0ea5-4d58-b448-cd4eedf8b6f0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef7deb48-abb8-43c2-8f4e-3f03a24c7e5a"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:38.528346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c8e922f5-0ea5-4d58-b448-cd4eedf8b6f0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:38.536643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8e922f5-0ea5-4d58-b448-cd4eedf8b6f0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:38.537333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8e922f5-0ea5-4d58-b448-cd4eedf8b6f0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:38.538015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8e922f5-0ea5-4d58-b448-cd4eedf8b6f0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:38.539263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8e922f5-0ea5-4d58-b448-cd4eedf8b6f0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:38.539887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8e922f5-0ea5-4d58-b448-cd4eedf8b6f0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:38.540522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8e922f5-0ea5-4d58-b448-cd4eedf8b6f0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:38.922156 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c8e922f5-0ea5-4d58-b448-cd4eedf8b6f0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "POST /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.401772 Oct 12 22:33:38.923136 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3375/6112] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 22:33:38 2022] POST /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:41.049799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-efe0d741-b82f-4599-9b04-726f99ad88e7 tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] Calling method '.version_select at 0x7f51230dfd30>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:41.124584 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-efe0d741-b82f-4599-9b04-726f99ad88e7 tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0db724fe-3db2-4ff0-ba49-d95c2b3cdda7" status: 200 len: 351 microversion: 2.1 time: 0.088143 Oct 12 22:33:41.125203 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2738/6113] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:33:41 2022] GET /compute/v2.1/os-volumes/0db724fe-3db2-4ff0-ba49-d95c2b3cdda7 => generated 351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:43.741720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-752964be-0761-4489-8338-daf1562b522d tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] Calling method '.version_select at 0x7f5122c071f0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:43.816221 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-752964be-0761-4489-8338-daf1562b522d tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/737b8ea2-1d86-483c-8cc0-7fef0fa0a9e1" status: 200 len: 350 microversion: 2.1 time: 0.079314 Oct 12 22:33:43.818632 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3376/6114] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:33:43 2022] GET /compute/v2.1/os-volumes/737b8ea2-1d86-483c-8cc0-7fef0fa0a9e1 => generated 350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:45.400923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4498a317-14c1-465e-9ba7-fe4dee92e39d tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] Calling method '.version_select at 0x7f512307bd30>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:45.449969 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4498a317-14c1-465e-9ba7-fe4dee92e39d tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6fda4926-c58a-4716-a2aa-a4d85dd1632c" status: 200 len: 351 microversion: 2.1 time: 0.054253 Oct 12 22:33:45.450545 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2739/6115] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 12 22:33:45 2022] GET /compute/v2.1/os-volumes/6fda4926-c58a-4716-a2aa-a4d85dd1632c => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:45.465636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb6c83f1-68d7-4a18-943f-338b6ec9b2e2 tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] Calling method '.version_select at 0x7f5122c0d820>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:45.559599 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cb6c83f1-68d7-4a18-943f-338b6ec9b2e2 tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.099286 Oct 12 22:33:45.560265 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3377/6116] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Oct 12 22:33:45 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:45.576383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e16e755e-2b1e-4b53-b113-939e1c8854d7 tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] Calling method '.version_select at 0x7f512313da60>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:45.668848 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e16e755e-2b1e-4b53-b113-939e1c8854d7 tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.097177 Oct 12 22:33:45.669403 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2740/6117] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 12 22:33:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:45.684030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-44dc241c-b395-4b11-b7fa-896de34f93ee tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] Calling method '.version_select at 0x7f5122b81280>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:45.771804 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-44dc241c-b395-4b11-b7fa-896de34f93ee tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092185 Oct 12 22:33:45.772382 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3378/6118] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Oct 12 22:33:45 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:45.783184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:45.787485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5f835762-0b53-4f1d-9728-bac8da8fec62 tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] Calling method '.version_select at 0x7f5123101dc0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:45.798672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=54 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:45.889518 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5f835762-0b53-4f1d-9728-bac8da8fec62 tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.107033 Oct 12 22:33:45.890108 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2741/6119] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 12 22:33:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:33:45.905235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2e44acfb-c399-4332-acee-c31aaad5da66 tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] Calling method '.version_select at 0x7f5122c50c10>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:46.163644 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2e44acfb-c399-4332-acee-c31aaad5da66 tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.262715 Oct 12 22:33:46.164289 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3379/6120] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 12 22:33:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:46.179467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-03bb0459-fc10-477e-82bf-1ed07f38ad26 tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] Calling method '.version_select at 0x7f512392da60>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:46.271224 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-03bb0459-fc10-477e-82bf-1ed07f38ad26 tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.095748 Oct 12 22:33:46.271830 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2742/6121] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 12 22:33:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:46.285479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-171f243f-abb7-4b51-b0d6-b5442da3599e tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] Calling method '.version_select at 0x7f5122c070d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:46.554191 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-171f243f-abb7-4b51-b0d6-b5442da3599e tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.272435 Oct 12 22:33:46.554785 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3380/6122] 10.222.0.16 () {58 vars in 1188 bytes} [Wed Oct 12 22:33:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:46.571572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6fe1a538-a4af-4d78-92b1-140c3f6c493a tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] Calling method '.version_select at 0x7f51230e6c10>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:46.663220 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6fe1a538-a4af-4d78-92b1-140c3f6c493a tempest-VolumesTestJSON-597800296 tempest-VolumesTestJSON-597800296-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.097309 Oct 12 22:33:46.663827 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2743/6123] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 12 22:33:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:51.056479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=21 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:51.057868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:51.062944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4cf40676-d242-48e2-a7a6-7455557cbf15 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:51.066245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4cf40676-d242-48e2-a7a6-7455557cbf15 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:51.073238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cf40676-d242-48e2-a7a6-7455557cbf15 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:51.073934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cf40676-d242-48e2-a7a6-7455557cbf15 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:51.074537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cf40676-d242-48e2-a7a6-7455557cbf15 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:51.075422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cf40676-d242-48e2-a7a6-7455557cbf15 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:51.076016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cf40676-d242-48e2-a7a6-7455557cbf15 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:51.076831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cf40676-d242-48e2-a7a6-7455557cbf15 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:51.118984 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4cf40676-d242-48e2-a7a6-7455557cbf15 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063691 Oct 12 22:33:51.126376 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3381/6124] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:33:51 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:51.132176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aae8e23d-0ed0-40d2-8757-4b19deae6d6d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:51.132804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-aae8e23d-0ed0-40d2-8757-4b19deae6d6d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:51.140749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aae8e23d-0ed0-40d2-8757-4b19deae6d6d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:51.141810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aae8e23d-0ed0-40d2-8757-4b19deae6d6d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:51.142365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aae8e23d-0ed0-40d2-8757-4b19deae6d6d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:51.143275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aae8e23d-0ed0-40d2-8757-4b19deae6d6d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:51.143868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aae8e23d-0ed0-40d2-8757-4b19deae6d6d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:51.144419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aae8e23d-0ed0-40d2-8757-4b19deae6d6d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:51.176484 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-aae8e23d-0ed0-40d2-8757-4b19deae6d6d tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments/ef7deb48-abb8-43c2-8f4e-3f03a24c7e5a" status: 200 len: 194 microversion: 2.1 time: 0.049119 Oct 12 22:33:51.177601 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2744/6125] 10.222.0.16 () {58 vars in 1413 bytes} [Wed Oct 12 22:33:51 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments/ef7deb48-abb8-43c2-8f4e-3f03a24c7e5a => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:53.659829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-691abd7b-5cb8-42f8-ac5c-7bec0716221a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6092090c-5575-4c9e-b14e-fda185ee1f7c"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:53.662420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-691abd7b-5cb8-42f8-ac5c-7bec0716221a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:53.670137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-691abd7b-5cb8-42f8-ac5c-7bec0716221a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:53.670696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-691abd7b-5cb8-42f8-ac5c-7bec0716221a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:53.671203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-691abd7b-5cb8-42f8-ac5c-7bec0716221a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:53.672101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-691abd7b-5cb8-42f8-ac5c-7bec0716221a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:53.672620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-691abd7b-5cb8-42f8-ac5c-7bec0716221a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:53.673112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-691abd7b-5cb8-42f8-ac5c-7bec0716221a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:53.958818 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-691abd7b-5cb8-42f8-ac5c-7bec0716221a tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "POST /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302637 Oct 12 22:33:53.960334 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3382/6126] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 22:33:53 2022] POST /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:58.709666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d39a2baf-c3fb-4e25-b0bf-a5aa6663d770 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:58.715628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d39a2baf-c3fb-4e25-b0bf-a5aa6663d770 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:58.724364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d39a2baf-c3fb-4e25-b0bf-a5aa6663d770 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:58.724905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d39a2baf-c3fb-4e25-b0bf-a5aa6663d770 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:58.725387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d39a2baf-c3fb-4e25-b0bf-a5aa6663d770 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:58.726109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d39a2baf-c3fb-4e25-b0bf-a5aa6663d770 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:58.726741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d39a2baf-c3fb-4e25-b0bf-a5aa6663d770 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:58.727194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d39a2baf-c3fb-4e25-b0bf-a5aa6663d770 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:58.790145 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d39a2baf-c3fb-4e25-b0bf-a5aa6663d770 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "POST /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36/action" status: 200 len: 24572 microversion: 2.1 time: 0.088276 Oct 12 22:33:58.797293 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2745/6127] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:33:58 2022] POST /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36/action => generated 24572 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:34:10.419272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:10.421224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:10.427259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d47dc866-0135-4984-a238-203216a0514b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:10.429906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d47dc866-0135-4984-a238-203216a0514b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:10.439667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d47dc866-0135-4984-a238-203216a0514b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:10.440088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d47dc866-0135-4984-a238-203216a0514b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:10.440795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d47dc866-0135-4984-a238-203216a0514b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:10.441840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d47dc866-0135-4984-a238-203216a0514b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:10.442331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d47dc866-0135-4984-a238-203216a0514b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:10.442772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d47dc866-0135-4984-a238-203216a0514b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:10.480262 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d47dc866-0135-4984-a238-203216a0514b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062725 Oct 12 22:34:10.480869 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3383/6128] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:34:10 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments => generated 371 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:10.646293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-19c1ba02-08e5-4e3b-9cf7-d13ebeb4b5ca tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:10.646867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-19c1ba02-08e5-4e3b-9cf7-d13ebeb4b5ca tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:10.654314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:10.655599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=10 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:10.657628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19c1ba02-08e5-4e3b-9cf7-d13ebeb4b5ca tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:10.658265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19c1ba02-08e5-4e3b-9cf7-d13ebeb4b5ca tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:10.658859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19c1ba02-08e5-4e3b-9cf7-d13ebeb4b5ca tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:10.659836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19c1ba02-08e5-4e3b-9cf7-d13ebeb4b5ca tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:10.660438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19c1ba02-08e5-4e3b-9cf7-d13ebeb4b5ca tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:10.661187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19c1ba02-08e5-4e3b-9cf7-d13ebeb4b5ca tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:10.703543 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-19c1ba02-08e5-4e3b-9cf7-d13ebeb4b5ca tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments/ef7deb48-abb8-43c2-8f4e-3f03a24c7e5a" status: 200 len: 194 microversion: 2.1 time: 0.061455 Oct 12 22:34:10.704367 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2746/6129] 10.222.0.16 () {58 vars in 1413 bytes} [Wed Oct 12 22:34:10 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments/ef7deb48-abb8-43c2-8f4e-3f03a24c7e5a => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:10.715713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1f294bec-c6f0-4640-a8f3-6f1db11743fb tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:10.716338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1f294bec-c6f0-4640-a8f3-6f1db11743fb tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:10.726089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f294bec-c6f0-4640-a8f3-6f1db11743fb tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:10.727709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f294bec-c6f0-4640-a8f3-6f1db11743fb tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:10.728990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f294bec-c6f0-4640-a8f3-6f1db11743fb tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:10.729906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f294bec-c6f0-4640-a8f3-6f1db11743fb tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:10.730533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f294bec-c6f0-4640-a8f3-6f1db11743fb tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:10.731316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f294bec-c6f0-4640-a8f3-6f1db11743fb tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:10.848225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-1f294bec-c6f0-4640-a8f3-6f1db11743fb tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lazy-loading 'services' on Instance uuid 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:34:10.959908 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1f294bec-c6f0-4640-a8f3-6f1db11743fb tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments/ef7deb48-abb8-43c2-8f4e-3f03a24c7e5a" status: 202 len: 0 microversion: 2.1 time: 0.248351 Oct 12 22:34:10.960887 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3384/6130] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 22:34:10 2022] DELETE /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments/ef7deb48-abb8-43c2-8f4e-3f03a24c7e5a => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:34:17.490099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a5183388-78ae-4820-8366-8f1e5f03ed82 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:17.490627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a5183388-78ae-4820-8366-8f1e5f03ed82 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:17.497697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5183388-78ae-4820-8366-8f1e5f03ed82 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.498192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5183388-78ae-4820-8366-8f1e5f03ed82 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.500333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5183388-78ae-4820-8366-8f1e5f03ed82 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.501115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5183388-78ae-4820-8366-8f1e5f03ed82 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.501573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5183388-78ae-4820-8366-8f1e5f03ed82 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.502007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5183388-78ae-4820-8366-8f1e5f03ed82 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.549963 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a5183388-78ae-4820-8366-8f1e5f03ed82 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments/6092090c-5575-4c9e-b14e-fda185ee1f7c" status: 200 len: 194 microversion: 2.1 time: 0.064469 Oct 12 22:34:17.551318 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2747/6131] 10.222.0.16 () {58 vars in 1413 bytes} [Wed Oct 12 22:34:17 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments/6092090c-5575-4c9e-b14e-fda185ee1f7c => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:17.564680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a6cd781d-1a7d-44e7-9a2f-78f489933d09 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:17.565920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a6cd781d-1a7d-44e7-9a2f-78f489933d09 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:17.575920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6cd781d-1a7d-44e7-9a2f-78f489933d09 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.576921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6cd781d-1a7d-44e7-9a2f-78f489933d09 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.577536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6cd781d-1a7d-44e7-9a2f-78f489933d09 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.578716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6cd781d-1a7d-44e7-9a2f-78f489933d09 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.579393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6cd781d-1a7d-44e7-9a2f-78f489933d09 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.580825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6cd781d-1a7d-44e7-9a2f-78f489933d09 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.832090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-a6cd781d-1a7d-44e7-9a2f-78f489933d09 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lazy-loading 'services' on Instance uuid 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:34:17.916647 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a6cd781d-1a7d-44e7-9a2f-78f489933d09 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments/6092090c-5575-4c9e-b14e-fda185ee1f7c" status: 202 len: 0 microversion: 2.1 time: 0.357452 Oct 12 22:34:17.923301 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3385/6132] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 22:34:17 2022] DELETE /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments/6092090c-5575-4c9e-b14e-fda185ee1f7c => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:34:25.506136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-19ced79d-aa72-4ca5-8bcb-7e916247774b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:25.508430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-19ced79d-aa72-4ca5-8bcb-7e916247774b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:25.516896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ced79d-aa72-4ca5-8bcb-7e916247774b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.517378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ced79d-aa72-4ca5-8bcb-7e916247774b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.517823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ced79d-aa72-4ca5-8bcb-7e916247774b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.518518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ced79d-aa72-4ca5-8bcb-7e916247774b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.518972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ced79d-aa72-4ca5-8bcb-7e916247774b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.519449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19ced79d-aa72-4ca5-8bcb-7e916247774b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.550776 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-19ced79d-aa72-4ca5-8bcb-7e916247774b tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048644 Oct 12 22:34:25.551358 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2748/6133] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:34:25 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:34:25.675914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cebdfcca-e64e-4305-a1cb-e967f827e662 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:25.678659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cebdfcca-e64e-4305-a1cb-e967f827e662 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:25.685786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cebdfcca-e64e-4305-a1cb-e967f827e662 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.686783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cebdfcca-e64e-4305-a1cb-e967f827e662 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.686783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cebdfcca-e64e-4305-a1cb-e967f827e662 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.693294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cebdfcca-e64e-4305-a1cb-e967f827e662 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.693778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cebdfcca-e64e-4305-a1cb-e967f827e662 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.694222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cebdfcca-e64e-4305-a1cb-e967f827e662 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.725189 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cebdfcca-e64e-4305-a1cb-e967f827e662 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056139 Oct 12 22:34:25.731277 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3386/6134] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 22:34:25 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:34:25.790269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-84d24ff7-7bfe-4a0c-ac76-d49d4597e66c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:25.790763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-84d24ff7-7bfe-4a0c-ac76-d49d4597e66c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:25.797084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84d24ff7-7bfe-4a0c-ac76-d49d4597e66c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.797562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84d24ff7-7bfe-4a0c-ac76-d49d4597e66c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.797990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84d24ff7-7bfe-4a0c-ac76-d49d4597e66c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.798670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84d24ff7-7bfe-4a0c-ac76-d49d4597e66c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.799119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84d24ff7-7bfe-4a0c-ac76-d49d4597e66c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.799567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84d24ff7-7bfe-4a0c-ac76-d49d4597e66c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.828132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-84d24ff7-7bfe-4a0c-ac76-d49d4597e66c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:34:25.903399 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-84d24ff7-7bfe-4a0c-ac76-d49d4597e66c tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 204 len: 0 microversion: 2.1 time: 0.116643 Oct 12 22:34:25.904328 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2749/6135] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:34:25 2022] DELETE /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:34:25.912652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f5bf1f43-ee44-4409-9d64-4fc9c3fc658e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:25.913371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f5bf1f43-ee44-4409-9d64-4fc9c3fc658e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:25.919724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5bf1f43-ee44-4409-9d64-4fc9c3fc658e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.920293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5bf1f43-ee44-4409-9d64-4fc9c3fc658e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.920805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5bf1f43-ee44-4409-9d64-4fc9c3fc658e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.921709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5bf1f43-ee44-4409-9d64-4fc9c3fc658e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.922242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5bf1f43-ee44-4409-9d64-4fc9c3fc658e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.922744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5bf1f43-ee44-4409-9d64-4fc9c3fc658e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:26.054315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f5bf1f43-ee44-4409-9d64-4fc9c3fc658e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:26.063136 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f5bf1f43-ee44-4409-9d64-4fc9c3fc658e tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1674 microversion: 2.1 time: 0.154760 Oct 12 22:34:26.063761 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3387/6136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:25 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:27.086874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-61095c47-063e-42f3-8ee3-b898ae359eaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:27.087595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-61095c47-063e-42f3-8ee3-b898ae359eaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:27.094322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61095c47-063e-42f3-8ee3-b898ae359eaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:27.094805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61095c47-063e-42f3-8ee3-b898ae359eaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:27.095260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61095c47-063e-42f3-8ee3-b898ae359eaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:27.095955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61095c47-063e-42f3-8ee3-b898ae359eaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:27.096450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61095c47-063e-42f3-8ee3-b898ae359eaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:27.096879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61095c47-063e-42f3-8ee3-b898ae359eaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:27.336240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-61095c47-063e-42f3-8ee3-b898ae359eaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:27.344550 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-61095c47-063e-42f3-8ee3-b898ae359eaf tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1674 microversion: 2.1 time: 0.261997 Oct 12 22:34:27.345121 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2750/6137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:27 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1674 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:28.368964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7154ac46-6c2b-4e6e-a5dc-60fe11d53ee0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:28.369587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7154ac46-6c2b-4e6e-a5dc-60fe11d53ee0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:28.376436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7154ac46-6c2b-4e6e-a5dc-60fe11d53ee0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:28.376871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7154ac46-6c2b-4e6e-a5dc-60fe11d53ee0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:28.377312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7154ac46-6c2b-4e6e-a5dc-60fe11d53ee0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:28.378013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7154ac46-6c2b-4e6e-a5dc-60fe11d53ee0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:28.378645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7154ac46-6c2b-4e6e-a5dc-60fe11d53ee0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:28.379227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7154ac46-6c2b-4e6e-a5dc-60fe11d53ee0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:28.522780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7154ac46-6c2b-4e6e-a5dc-60fe11d53ee0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:28.532536 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7154ac46-6c2b-4e6e-a5dc-60fe11d53ee0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1674 microversion: 2.1 time: 0.167373 Oct 12 22:34:28.534493 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3388/6138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:28 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:29.288810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c97d4f73-8b56-43ee-bc98-f2495be825bf tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:29.297963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c97d4f73-8b56-43ee-bc98-f2495be825bf tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:29.313617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c97d4f73-8b56-43ee-bc98-f2495be825bf tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:29.318180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c97d4f73-8b56-43ee-bc98-f2495be825bf tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:29.318614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c97d4f73-8b56-43ee-bc98-f2495be825bf tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:29.319757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c97d4f73-8b56-43ee-bc98-f2495be825bf tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:29.320407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c97d4f73-8b56-43ee-bc98-f2495be825bf tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:29.320838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c97d4f73-8b56-43ee-bc98-f2495be825bf tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:29.334561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a14b778f-f2ba-4011-a975-9d938eb96b88 req-12841ad7-5b40-4a0f-aee5-f92953462442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce3ef25-cbc5-48bd-ad42-725ab00c92bd", "name": "network-vif-deleted", "tag": "6a1e70d1-21d9-45f4-a40e-28c701dcadfa"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:29.346923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a14b778f-f2ba-4011-a975-9d938eb96b88 req-12841ad7-5b40-4a0f-aee5-f92953462442 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:29.347657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a14b778f-f2ba-4011-a975-9d938eb96b88 req-12841ad7-5b40-4a0f-aee5-f92953462442 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:29.348361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a14b778f-f2ba-4011-a975-9d938eb96b88 req-12841ad7-5b40-4a0f-aee5-f92953462442 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:29.361429 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a14b778f-f2ba-4011-a975-9d938eb96b88 req-12841ad7-5b40-4a0f-aee5-f92953462442 service nova] Creating event network-vif-deleted:6a1e70d1-21d9-45f4-a40e-28c701dcadfa for instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd on n-h1-861111-1 Oct 12 22:34:29.367083 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a14b778f-f2ba-4011-a975-9d938eb96b88 req-12841ad7-5b40-4a0f-aee5-f92953462442 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036342 Oct 12 22:34:29.368900 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3389/6139] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:34:29.422727 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c97d4f73-8b56-43ee-bc98-f2495be825bf tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "POST /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36/action" status: 200 len: 32642 microversion: 2.1 time: 0.137733 Oct 12 22:34:29.424876 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2751/6140] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:34:29 2022] POST /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36/action => generated 32642 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:34:29.557189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b0277c15-22e2-4c7d-9d58-449775016ea1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:29.557903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b0277c15-22e2-4c7d-9d58-449775016ea1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:29.571111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0277c15-22e2-4c7d-9d58-449775016ea1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:29.573688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0277c15-22e2-4c7d-9d58-449775016ea1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:29.574477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0277c15-22e2-4c7d-9d58-449775016ea1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:29.575578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0277c15-22e2-4c7d-9d58-449775016ea1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:29.576473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0277c15-22e2-4c7d-9d58-449775016ea1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:29.577228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0277c15-22e2-4c7d-9d58-449775016ea1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:29.644683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0277c15-22e2-4c7d-9d58-449775016ea1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:29.645187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0277c15-22e2-4c7d-9d58-449775016ea1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:29.647622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0277c15-22e2-4c7d-9d58-449775016ea1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:29.648297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-b0277c15-22e2-4c7d-9d58-449775016ea1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lazy-loading 'fault' on Instance uuid 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:34:29.721720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b0277c15-22e2-4c7d-9d58-449775016ea1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5fa1bcec6e24906bc2000ead6350336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb54ad8150449aaba735b9fc149845d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:29.733258 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b0277c15-22e2-4c7d-9d58-449775016ea1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 200 len: 1328 microversion: 2.1 time: 0.181203 Oct 12 22:34:29.735565 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3390/6141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:29 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 1328 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:30.751611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5c9dcfef-a1cd-4cd1-bddb-e7a19259f2d1 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:30.752909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5c9dcfef-a1cd-4cd1-bddb-e7a19259f2d1 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:30.765866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c9dcfef-a1cd-4cd1-bddb-e7a19259f2d1 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.768331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c9dcfef-a1cd-4cd1-bddb-e7a19259f2d1 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.769511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c9dcfef-a1cd-4cd1-bddb-e7a19259f2d1 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.770474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c9dcfef-a1cd-4cd1-bddb-e7a19259f2d1 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.773149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c9dcfef-a1cd-4cd1-bddb-e7a19259f2d1 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.774764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c9dcfef-a1cd-4cd1-bddb-e7a19259f2d1 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.807801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5c9dcfef-a1cd-4cd1-bddb-e7a19259f2d1 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:34:30.884304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-7248861c-1ff0-4123-b5ab-d94f4279363c req-80d0afc5-c8fb-4ae4-8cd6-ef949f57f68e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6796590a-7d3a-4b4b-8707-fa1aacc8aa36", "tag": "9a8e89c0-535a-4e74-b829-fff4a082c91a"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:30.909581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7248861c-1ff0-4123-b5ab-d94f4279363c req-80d0afc5-c8fb-4ae4-8cd6-ef949f57f68e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.910078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7248861c-1ff0-4123-b5ab-d94f4279363c req-80d0afc5-c8fb-4ae4-8cd6-ef949f57f68e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.910521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7248861c-1ff0-4123-b5ab-d94f4279363c req-80d0afc5-c8fb-4ae4-8cd6-ef949f57f68e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.923634 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-7248861c-1ff0-4123-b5ab-d94f4279363c req-80d0afc5-c8fb-4ae4-8cd6-ef949f57f68e service nova] Creating event network-changed:9a8e89c0-535a-4e74-b829-fff4a082c91a for instance 6796590a-7d3a-4b4b-8707-fa1aacc8aa36 on n-h2-861111-1 Oct 12 22:34:30.934781 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-7248861c-1ff0-4123-b5ab-d94f4279363c req-80d0afc5-c8fb-4ae4-8cd6-ef949f57f68e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185911 Oct 12 22:34:30.935738 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3391/6142] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:30.945000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cac9a70d-6eaf-41b7-adf1-406f311f6fe1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:30.946478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cac9a70d-6eaf-41b7-adf1-406f311f6fe1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:30.953362 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5c9dcfef-a1cd-4cd1-bddb-e7a19259f2d1 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36" status: 204 len: 0 microversion: 2.1 time: 0.207986 Oct 12 22:34:30.954575 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2752/6143] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:34:30 2022] DELETE /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:34:30.958549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cac9a70d-6eaf-41b7-adf1-406f311f6fe1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.959048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cac9a70d-6eaf-41b7-adf1-406f311f6fe1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.961195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cac9a70d-6eaf-41b7-adf1-406f311f6fe1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.962044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cac9a70d-6eaf-41b7-adf1-406f311f6fe1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.962518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cac9a70d-6eaf-41b7-adf1-406f311f6fe1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.962960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cac9a70d-6eaf-41b7-adf1-406f311f6fe1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.964354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9ba2304f-88b5-4415-a40e-e1a7b138b749 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:30.965181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9ba2304f-88b5-4415-a40e-e1a7b138b749 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:30.976699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ba2304f-88b5-4415-a40e-e1a7b138b749 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.978216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ba2304f-88b5-4415-a40e-e1a7b138b749 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.978758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ba2304f-88b5-4415-a40e-e1a7b138b749 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.985255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ba2304f-88b5-4415-a40e-e1a7b138b749 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.986214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ba2304f-88b5-4415-a40e-e1a7b138b749 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.986848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ba2304f-88b5-4415-a40e-e1a7b138b749 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.996906 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-cac9a70d-6eaf-41b7-adf1-406f311f6fe1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] HTTP exception thrown: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cac9a70d-6eaf-41b7-adf1-406f311f6fe1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Request method failure captured: Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd HTTP/1.1 Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz9XdK23GQk5mbVmf46xTGAPFoYA8cbrngeSV-lktYZqlruSM3O8e6-yNtUozE6uemwI1m1WFBFELhC1xKYwWqcaNOYsbfNwY6JSWnoc44HmgPQxHVroHGLrPwjNMCpffi4vrQzminQGRI4keq8jqoUYjj33FoQrzgO_P3fnKD4z0Cg Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: ecb54ad8150449aaba735b9fc149845d Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecb54ad8150449aaba735b9fc149845d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: ecb54ad8150449aaba735b9fc149845d Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeTestJSON-353621643-project Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: c5fa1bcec6e24906bc2000ead6350336 Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeTestJSON-353621643-project Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '0ce3ef25-cbc5-48bd-ad42-725ab00c92bd'} Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:30.999100 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:34:31.002494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:31.002494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:31.002494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:31.002494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:34:31.002494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:34:31.002494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. Oct 12 22:34:31.002494 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:34:31.002494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cac9a70d-6eaf-41b7-adf1-406f311f6fe1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Returning 404 to user: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:31.004380 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cac9a70d-6eaf-41b7-adf1-406f311f6fe1 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 404 len: 111 microversion: 2.1 time: 0.066218 Oct 12 22:34:31.012913 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3392/6144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:30 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:34:31.019338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4899eb85-ff25-4306-b5ca-0404f9f613ce tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '.version_select at 0x7f5122b928b0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:31.061550 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4899eb85-ff25-4306-b5ca-0404f9f613ce tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1948970676" status: 202 len: 0 microversion: 2.1 time: 0.047171 Oct 12 22:34:31.065412 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3393/6145] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 12 22:34:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1948970676 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:34:31.252759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9ba2304f-88b5-4415-a40e-e1a7b138b749 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:31.261509 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9ba2304f-88b5-4415-a40e-e1a7b138b749 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36" status: 200 len: 1673 microversion: 2.1 time: 0.302657 Oct 12 22:34:31.276769 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2753/6146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:30 2022] GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 => generated 1673 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:32.287437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4c46152a-cb71-4844-b9bc-c2045307640d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:32.288155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4c46152a-cb71-4844-b9bc-c2045307640d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:32.308906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c46152a-cb71-4844-b9bc-c2045307640d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:32.310685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c46152a-cb71-4844-b9bc-c2045307640d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:32.311637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c46152a-cb71-4844-b9bc-c2045307640d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:32.315630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c46152a-cb71-4844-b9bc-c2045307640d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:32.316293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c46152a-cb71-4844-b9bc-c2045307640d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:32.316852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c46152a-cb71-4844-b9bc-c2045307640d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:32.558759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4c46152a-cb71-4844-b9bc-c2045307640d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:32.569214 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4c46152a-cb71-4844-b9bc-c2045307640d tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36" status: 200 len: 1673 microversion: 2.1 time: 0.285800 Oct 12 22:34:32.569827 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3394/6147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:32 2022] GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 => generated 1673 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:33.580194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-a1ef7c0b-ff0e-4891-baea-cea4663fd286 req-f7206c10-c944-4c03-ac36-07119dd42a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6796590a-7d3a-4b4b-8707-fa1aacc8aa36", "name": "network-vif-deleted", "tag": "9a8e89c0-535a-4e74-b829-fff4a082c91a"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:33.594949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0e841cd8-cf06-4e7d-af4d-4ad6daf5b21c tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:33.596574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0e841cd8-cf06-4e7d-af4d-4ad6daf5b21c tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:33.610305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e841cd8-cf06-4e7d-af4d-4ad6daf5b21c tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:33.614772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a1ef7c0b-ff0e-4891-baea-cea4663fd286 req-f7206c10-c944-4c03-ac36-07119dd42a90 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:33.615219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e841cd8-cf06-4e7d-af4d-4ad6daf5b21c tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:33.616275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e841cd8-cf06-4e7d-af4d-4ad6daf5b21c tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:33.616927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a1ef7c0b-ff0e-4891-baea-cea4663fd286 req-f7206c10-c944-4c03-ac36-07119dd42a90 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:33.618564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e841cd8-cf06-4e7d-af4d-4ad6daf5b21c tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:33.619216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a1ef7c0b-ff0e-4891-baea-cea4663fd286 req-f7206c10-c944-4c03-ac36-07119dd42a90 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:33.635365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e841cd8-cf06-4e7d-af4d-4ad6daf5b21c tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:33.636055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0e841cd8-cf06-4e7d-af4d-4ad6daf5b21c tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:33.655673 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-a1ef7c0b-ff0e-4891-baea-cea4663fd286 req-f7206c10-c944-4c03-ac36-07119dd42a90 service nova] Creating event network-vif-deleted:9a8e89c0-535a-4e74-b829-fff4a082c91a for instance 6796590a-7d3a-4b4b-8707-fa1aacc8aa36 on n-h2-861111-1 Oct 12 22:34:33.663547 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-a1ef7c0b-ff0e-4891-baea-cea4663fd286 req-f7206c10-c944-4c03-ac36-07119dd42a90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085773 Oct 12 22:34:33.666595 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2754/6148] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:33.749016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0e841cd8-cf06-4e7d-af4d-4ad6daf5b21c tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a672bb095f984fb7b23d1acd55902865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d857098e294c8da4f73d273912cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:33.782480 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0e841cd8-cf06-4e7d-af4d-4ad6daf5b21c tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36" status: 200 len: 1334 microversion: 2.1 time: 0.191462 Oct 12 22:34:33.797744 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3395/6149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:33 2022] GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 => generated 1334 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:34.806522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-00a27a61-8dfe-469a-896b-783510e5f791 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:34.807231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-00a27a61-8dfe-469a-896b-783510e5f791 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] [instance: 6796590a-7d3a-4b4b-8707-fa1aacc8aa36] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:34.819225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00a27a61-8dfe-469a-896b-783510e5f791 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:34.819856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00a27a61-8dfe-469a-896b-783510e5f791 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:34.820368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00a27a61-8dfe-469a-896b-783510e5f791 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:34.821432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00a27a61-8dfe-469a-896b-783510e5f791 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:34.822467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00a27a61-8dfe-469a-896b-783510e5f791 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:34.823170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00a27a61-8dfe-469a-896b-783510e5f791 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:34.846078 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-00a27a61-8dfe-469a-896b-783510e5f791 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] HTTP exception thrown: Instance 6796590a-7d3a-4b4b-8707-fa1aacc8aa36 could not be found. Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-00a27a61-8dfe-469a-896b-783510e5f791 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Request method failure captured: Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 HTTP/1.1 Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz_NU6UQmSO7i7Bx75T1nJfatDuXoxDn89C0uP55LpKjWt8Tz54gd8kp0OWHBQKu17OneBMndQGOqsDqbMDUSzVrZTmVJWW9kZTcpD_NYyHyCbaGCH6an9e0wybdo6_Q-Euo0O4RnLcx3cwTPUrwDW8M_xqZJHFSXQdiEmMJ5C3u5I0 Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 08d857098e294c8da4f73d273912cdf3 Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestNetworkBasicOps-1431188583 Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/08d857098e294c8da4f73d273912cdf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/08d857098e294c8da4f73d273912cdf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_08d857098e294c8da4f73d273912cdf3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/08d857098e294c8da4f73d273912cdf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestNetworkBasicOps-1431188583 Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 08d857098e294c8da4f73d273912cdf3 Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestNetworkBasicOps-1431188583 Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestNetworkBasicOps-1431188583-project Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: a672bb095f984fb7b23d1acd55902865 Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestNetworkBasicOps-1431188583-project Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 6796590a-7d3a-4b4b-8707-fa1aacc8aa36 could not be found. Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '6796590a-7d3a-4b4b-8707-fa1aacc8aa36'} Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6796590a-7d3a-4b4b-8707-fa1aacc8aa36 could not be found. Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6796590a-7d3a-4b4b-8707-fa1aacc8aa36 could not be found. Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:34.848043 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:34:34.853451 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:34.853451 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:34.853451 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:34.853451 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:34:34.853451 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:34:34.853451 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6796590a-7d3a-4b4b-8707-fa1aacc8aa36 could not be found. Oct 12 22:34:34.853451 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:34:34.856989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-00a27a61-8dfe-469a-896b-783510e5f791 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Returning 404 to user: Instance 6796590a-7d3a-4b4b-8707-fa1aacc8aa36 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:34.858045 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-00a27a61-8dfe-469a-896b-783510e5f791 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36" status: 404 len: 111 microversion: 2.1 time: 0.056585 Oct 12 22:34:34.859202 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2755/6150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:34 2022] GET /compute/v2.1/servers/6796590a-7d3a-4b4b-8707-fa1aacc8aa36 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:34:35.130498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-03777eee-4b24-425d-80f6-71f8968ecc20 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] Calling method '.version_select at 0x7f5122b8a4c0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:35.176774 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-03777eee-4b24-425d-80f6-71f8968ecc20 tempest-TestNetworkBasicOps-1431188583 tempest-TestNetworkBasicOps-1431188583-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1079467325" status: 202 len: 0 microversion: 2.1 time: 0.054042 Oct 12 22:34:35.178270 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3396/6151] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 12 22:34:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1079467325 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:34:42.485364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9f108e6a-eb05-43c8-885c-5fca042c3cd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:42.485967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9f108e6a-eb05-43c8-885c-5fca042c3cd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:42.489423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:42.500677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f108e6a-eb05-43c8-885c-5fca042c3cd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:42.511420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f108e6a-eb05-43c8-885c-5fca042c3cd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:42.512017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f108e6a-eb05-43c8-885c-5fca042c3cd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:42.512892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f108e6a-eb05-43c8-885c-5fca042c3cd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:42.513493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f108e6a-eb05-43c8-885c-5fca042c3cd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:42.514083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f108e6a-eb05-43c8-885c-5fca042c3cd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:42.517869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:42.556599 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-9f108e6a-eb05-43c8-885c-5fca042c3cd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] HTTP exception thrown: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9f108e6a-eb05-43c8-885c-5fca042c3cd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Request method failure captured: Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd HTTP/1.1 Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz9XdK23GQk5mbVmf46xTGAPFoYA8cbrngeSV-lktYZqlruSM3O8e6-yNtUozE6uemwI1m1WFBFELhC1xKYwWqcaNOYsbfNwY6JSWnoc44HmgPQxHVroHGLrPwjNMCpffi4vrQzminQGRI4keq8jqoUYjj33FoQrzgO_P3fnKD4z0Cg Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ecb54ad8150449aaba735b9fc149845d Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecb54ad8150449aaba735b9fc149845d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ecb54ad8150449aaba735b9fc149845d Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-AttachVolumeTestJSON-353621643-project Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: c5fa1bcec6e24906bc2000ead6350336 Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeTestJSON-353621643-project Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '0ce3ef25-cbc5-48bd-ad42-725ab00c92bd'} Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:34:42.559350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:34:42.563805 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. Oct 12 22:34:42.563805 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:34:42.563805 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:42.563805 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:34:42.563805 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:42.563805 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:42.563805 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:42.563805 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:34:42.563805 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:34:42.563805 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. Oct 12 22:34:42.563805 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:34:42.563805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9f108e6a-eb05-43c8-885c-5fca042c3cd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Returning 404 to user: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:42.563805 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9f108e6a-eb05-43c8-885c-5fca042c3cd0 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 404 len: 111 microversion: 2.1 time: 0.080605 Oct 12 22:34:42.576439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6045e15d-6855-45f6-838f-ec608a11bbe5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:42.580689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6045e15d-6855-45f6-838f-ec608a11bbe5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:42.588874 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2756/6152] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:34:42 2022] DELETE /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:34:42.594125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:42.596386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6045e15d-6855-45f6-838f-ec608a11bbe5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:42.597043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6045e15d-6855-45f6-838f-ec608a11bbe5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:42.597761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6045e15d-6855-45f6-838f-ec608a11bbe5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:42.598624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6045e15d-6855-45f6-838f-ec608a11bbe5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:42.599386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6045e15d-6855-45f6-838f-ec608a11bbe5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:42.600028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6045e15d-6855-45f6-838f-ec608a11bbe5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:42.624932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:42.626365 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-6045e15d-6855-45f6-838f-ec608a11bbe5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] HTTP exception thrown: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6045e15d-6855-45f6-838f-ec608a11bbe5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Request method failure captured: Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd HTTP/1.1 Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz9XdK23GQk5mbVmf46xTGAPFoYA8cbrngeSV-lktYZqlruSM3O8e6-yNtUozE6uemwI1m1WFBFELhC1xKYwWqcaNOYsbfNwY6JSWnoc44HmgPQxHVroHGLrPwjNMCpffi4vrQzminQGRI4keq8jqoUYjj33FoQrzgO_P3fnKD4z0Cg Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: ecb54ad8150449aaba735b9fc149845d Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecb54ad8150449aaba735b9fc149845d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: ecb54ad8150449aaba735b9fc149845d Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeTestJSON-353621643-project Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: c5fa1bcec6e24906bc2000ead6350336 Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeTestJSON-353621643-project Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '0ce3ef25-cbc5-48bd-ad42-725ab00c92bd'} Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:42.628152 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:34:42.631472 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:42.631472 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:42.631472 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:42.631472 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:34:42.631472 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:34:42.631472 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. Oct 12 22:34:42.631472 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:34:42.633383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6045e15d-6855-45f6-838f-ec608a11bbe5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Returning 404 to user: Instance 0ce3ef25-cbc5-48bd-ad42-725ab00c92bd could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:42.634450 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6045e15d-6855-45f6-838f-ec608a11bbe5 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd" status: 404 len: 111 microversion: 2.1 time: 0.067677 Oct 12 22:34:42.649766 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3397/6153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:42 2022] GET /compute/v2.1/servers/0ce3ef25-cbc5-48bd-ad42-725ab00c92bd => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:34:48.032181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb9e370e-cd60-4b68-b93c-fdc00e4da82c tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Action: 'create', calling method: .version_select at 0x7f51230b0790>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-662679922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmLU+8HRQeQbz1TOXJJPZm4Jel8Mti3PeBKyvopwOsr8OExLepN57umO1HdxkIyO+uwLMJ3YTdtzhT4VSWYYR3B/SOyQa7esEeg4vC2b2Tm0drezT6nYVMqpNIX0cyxnw=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:48.057824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-eb9e370e-cd60-4b68-b93c-fdc00e4da82c tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Getting quotas for project 9f46e26b725045708751d688a0422950. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:34:48.064361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-eb9e370e-cd60-4b68-b93c-fdc00e4da82c tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Getting quotas for user 1195be2699414d198bc95d20d4be9c2e and project 9f46e26b725045708751d688a0422950. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:34:48.122230 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb9e370e-cd60-4b68-b93c-fdc00e4da82c tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.588460 Oct 12 22:34:48.123204 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2757/6154] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:34:47 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:48.399633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-62e0c434-9fd5-4764-ad0d-e14a0adbaabd tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:48.400272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-62e0c434-9fd5-4764-ad0d-e14a0adbaabd tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:48.414594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e0c434-9fd5-4764-ad0d-e14a0adbaabd tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:48.416745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e0c434-9fd5-4764-ad0d-e14a0adbaabd tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:48.417329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e0c434-9fd5-4764-ad0d-e14a0adbaabd tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:48.418622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e0c434-9fd5-4764-ad0d-e14a0adbaabd tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:48.419287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e0c434-9fd5-4764-ad0d-e14a0adbaabd tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:48.420110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e0c434-9fd5-4764-ad0d-e14a0adbaabd tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:48.471421 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-62e0c434-9fd5-4764-ad0d-e14a0adbaabd tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] HTTP exception thrown: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-62e0c434-9fd5-4764-ad0d-e14a0adbaabd tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Request method failure captured: Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed HTTP/1.1 Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjRz9XdK23GQk5mbVmf46xTGAPFoYA8cbrngeSV-lktYZqlruSM3O8e6-yNtUozE6uemwI1m1WFBFELhC1xKYwWqcaNOYsbfNwY6JSWnoc44HmgPQxHVroHGLrPwjNMCpffi4vrQzminQGRI4keq8jqoUYjj33FoQrzgO_P3fnKD4z0Cg Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: ecb54ad8150449aaba735b9fc149845d Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecb54ad8150449aaba735b9fc149845d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: ecb54ad8150449aaba735b9fc149845d Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-AttachVolumeTestJSON-353621643-project Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: c5fa1bcec6e24906bc2000ead6350336 Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-AttachVolumeTestJSON-353621643-project Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1958534e-ec1c-4ecc-bc9a-7720512092ed'} Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:34:48.474727 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:34:48.478808 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. Oct 12 22:34:48.478808 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:34:48.478808 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:48.478808 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:34:48.478808 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:48.478808 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:48.478808 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:48.478808 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:34:48.478808 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:34:48.478808 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. Oct 12 22:34:48.478808 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:34:48.488330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-62e0c434-9fd5-4764-ad0d-e14a0adbaabd tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Returning 404 to user: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:48.489866 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-62e0c434-9fd5-4764-ad0d-e14a0adbaabd tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 404 len: 111 microversion: 2.1 time: 0.095314 Oct 12 22:34:48.490977 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3398/6155] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:34:48 2022] DELETE /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:34:48.499462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d91ace0-3c47-4f6d-bacd-6116573cee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:48.500073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9d91ace0-3c47-4f6d-bacd-6116573cee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] [instance: 1958534e-ec1c-4ecc-bc9a-7720512092ed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:48.507479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d91ace0-3c47-4f6d-bacd-6116573cee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:48.507973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d91ace0-3c47-4f6d-bacd-6116573cee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:48.508407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d91ace0-3c47-4f6d-bacd-6116573cee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:48.509107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d91ace0-3c47-4f6d-bacd-6116573cee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:48.509556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d91ace0-3c47-4f6d-bacd-6116573cee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:48.509978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d91ace0-3c47-4f6d-bacd-6116573cee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:48.545564 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-9d91ace0-3c47-4f6d-bacd-6116573cee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] HTTP exception thrown: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d91ace0-3c47-4f6d-bacd-6116573cee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Request method failure captured: Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed HTTP/1.1 Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjRz9XdK23GQk5mbVmf46xTGAPFoYA8cbrngeSV-lktYZqlruSM3O8e6-yNtUozE6uemwI1m1WFBFELhC1xKYwWqcaNOYsbfNwY6JSWnoc44HmgPQxHVroHGLrPwjNMCpffi4vrQzminQGRI4keq8jqoUYjj33FoQrzgO_P3fnKD4z0Cg Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ecb54ad8150449aaba735b9fc149845d Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecb54ad8150449aaba735b9fc149845d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecb54ad8150449aaba735b9fc149845d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ecb54ad8150449aaba735b9fc149845d Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeTestJSON-353621643 Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-AttachVolumeTestJSON-353621643-project Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: c5fa1bcec6e24906bc2000ead6350336 Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeTestJSON-353621643-project Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '1958534e-ec1c-4ecc-bc9a-7720512092ed'} Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:48.547191 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:34:48.551404 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:48.551404 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:48.551404 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:48.551404 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:34:48.551404 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:34:48.551404 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. Oct 12 22:34:48.551404 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:34:48.551404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d91ace0-3c47-4f6d-bacd-6116573cee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] Returning 404 to user: Instance 1958534e-ec1c-4ecc-bc9a-7720512092ed could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:48.551404 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9d91ace0-3c47-4f6d-bacd-6116573cee86 tempest-AttachVolumeTestJSON-353621643 tempest-AttachVolumeTestJSON-353621643-project] 10.222.0.16 "GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed" status: 404 len: 111 microversion: 2.1 time: 0.053666 Oct 12 22:34:48.552290 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2758/6156] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:48 2022] GET /compute/v2.1/servers/1958534e-ec1c-4ecc-bc9a-7720512092ed => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:35:03.075435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-296401407-access_point-1926614224", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "eafde008-47b0-4bbd-9b52-42124527d4c8"}], "key_name": "tempest-TestSecurityGroupsBasicOps-662679922", "security_groups": [{"name": "tempest-secgroup_access--917172499"}, {"name": "tempest-secgroup_general--1988400282"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:03.099282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:03.910101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] validate_networks() for [('eafde008-47b0-4bbd-9b52-42124527d4c8', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:35:05.073338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:35:05.074409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:35:05.075037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:35:05.076006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:35:05.076572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:35:05.097648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:05.098410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:05.099000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:05.105147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:05.105974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:05.107005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:05.155650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Getting quotas for project 9f46e26b725045708751d688a0422950. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:35:05.163610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Getting quotas for user 1195be2699414d198bc95d20d4be9c2e and project 9f46e26b725045708751d688a0422950. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:35:05.181699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:35:05.184176 n-d-861111-1 devstack@n-api.service[120453]: WARNING nova.utils [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-296401407-access_point-1926614224 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-296401407-acc Oct 12 22:35:05.185366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:35:05.353672 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3471f99c-2d36-4676-9238-fdef3529b8c4 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.282504 Oct 12 22:35:05.355778 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3399/6157] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:35:03 2022] POST /compute/v2.1/servers => generated 457 bytes in 2285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:35:05.368257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d89a0ca8-d3a7-4647-b2da-ff963a3f747b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:05.368892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d89a0ca8-d3a7-4647-b2da-ff963a3f747b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:05.375479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:05.377925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:05.378837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:05.745806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d89a0ca8-d3a7-4647-b2da-ff963a3f747b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:05.753263 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d89a0ca8-d3a7-4647-b2da-ff963a3f747b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 200 len: 1293 microversion: 2.1 time: 0.390016 Oct 12 22:35:05.753855 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2759/6158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:05 2022] GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 1293 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:06.785644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2928501f-43f9-4ef1-ad55-2a017e1d87b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:06.786922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2928501f-43f9-4ef1-ad55-2a017e1d87b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:06.803930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2928501f-43f9-4ef1-ad55-2a017e1d87b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:06.805813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2928501f-43f9-4ef1-ad55-2a017e1d87b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:06.807705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2928501f-43f9-4ef1-ad55-2a017e1d87b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:06.811083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2928501f-43f9-4ef1-ad55-2a017e1d87b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:06.812754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2928501f-43f9-4ef1-ad55-2a017e1d87b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:06.813390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2928501f-43f9-4ef1-ad55-2a017e1d87b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:06.980189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2928501f-43f9-4ef1-ad55-2a017e1d87b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:06.989091 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2928501f-43f9-4ef1-ad55-2a017e1d87b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 200 len: 1289 microversion: 2.1 time: 0.212766 Oct 12 22:35:06.995732 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3400/6159] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:06 2022] GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 1289 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:08.025319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-da96b9c6-055b-495b-9761-165efe17b34a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:08.026140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-da96b9c6-055b-495b-9761-165efe17b34a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:08.039265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da96b9c6-055b-495b-9761-165efe17b34a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:08.042403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da96b9c6-055b-495b-9761-165efe17b34a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:08.044370 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da96b9c6-055b-495b-9761-165efe17b34a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:08.046002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da96b9c6-055b-495b-9761-165efe17b34a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:08.048023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da96b9c6-055b-495b-9761-165efe17b34a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:08.051333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da96b9c6-055b-495b-9761-165efe17b34a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:08.173985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-da96b9c6-055b-495b-9761-165efe17b34a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:08.183879 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-da96b9c6-055b-495b-9761-165efe17b34a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 200 len: 1351 microversion: 2.1 time: 0.164278 Oct 12 22:35:08.196732 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2760/6160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:08 2022] GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 1351 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:09.221518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-53f8571c-77b7-461e-8f8b-bf9f0a4221cd tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:09.222844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-53f8571c-77b7-461e-8f8b-bf9f0a4221cd tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:09.230702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53f8571c-77b7-461e-8f8b-bf9f0a4221cd tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:09.232092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53f8571c-77b7-461e-8f8b-bf9f0a4221cd tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:09.232746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53f8571c-77b7-461e-8f8b-bf9f0a4221cd tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:09.233697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53f8571c-77b7-461e-8f8b-bf9f0a4221cd tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:09.234637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53f8571c-77b7-461e-8f8b-bf9f0a4221cd tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:09.235496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53f8571c-77b7-461e-8f8b-bf9f0a4221cd tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:09.617250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-53f8571c-77b7-461e-8f8b-bf9f0a4221cd tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:09.630300 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-53f8571c-77b7-461e-8f8b-bf9f0a4221cd tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 200 len: 1470 microversion: 2.1 time: 0.421919 Oct 12 22:35:09.633325 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3401/6161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:09 2022] GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 1470 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:10.325172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-68ee9f9c-21be-43c3-93d4-da9dfb495cb5 req-bbccb608-b444-472e-bea4-5dd1758fd7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e50519f9-97da-478d-902c-e33b86c44a38", "tag": "2b55e3c8-6c7e-4c2a-9c71-e2640252beed"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:10.346449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-68ee9f9c-21be-43c3-93d4-da9dfb495cb5 req-bbccb608-b444-472e-bea4-5dd1758fd7c3 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:10.350728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-68ee9f9c-21be-43c3-93d4-da9dfb495cb5 req-bbccb608-b444-472e-bea4-5dd1758fd7c3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:10.353258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-68ee9f9c-21be-43c3-93d4-da9dfb495cb5 req-bbccb608-b444-472e-bea4-5dd1758fd7c3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:10.375711 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-68ee9f9c-21be-43c3-93d4-da9dfb495cb5 req-bbccb608-b444-472e-bea4-5dd1758fd7c3 service nova] Creating event network-changed:2b55e3c8-6c7e-4c2a-9c71-e2640252beed for instance e50519f9-97da-478d-902c-e33b86c44a38 on n-h2-861111-1 Oct 12 22:35:10.410423 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-68ee9f9c-21be-43c3-93d4-da9dfb495cb5 req-bbccb608-b444-472e-bea4-5dd1758fd7c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087523 Oct 12 22:35:10.411271 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2761/6162] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:10.658972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dea0bc9a-4882-4be9-ac15-36b63b49d626 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:10.660258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dea0bc9a-4882-4be9-ac15-36b63b49d626 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:10.674104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dea0bc9a-4882-4be9-ac15-36b63b49d626 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:10.674590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dea0bc9a-4882-4be9-ac15-36b63b49d626 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:10.675161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dea0bc9a-4882-4be9-ac15-36b63b49d626 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:10.675899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dea0bc9a-4882-4be9-ac15-36b63b49d626 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:10.676349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dea0bc9a-4882-4be9-ac15-36b63b49d626 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:10.676770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dea0bc9a-4882-4be9-ac15-36b63b49d626 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:11.512411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dea0bc9a-4882-4be9-ac15-36b63b49d626 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:11.523640 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dea0bc9a-4882-4be9-ac15-36b63b49d626 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 200 len: 1470 microversion: 2.1 time: 0.870834 Oct 12 22:35:11.524229 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3402/6163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:10 2022] GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 1470 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:12.548155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2e65101b-eebd-46ce-ae32-ecc91e9480bc tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:12.548683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2e65101b-eebd-46ce-ae32-ecc91e9480bc tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:12.563704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e65101b-eebd-46ce-ae32-ecc91e9480bc tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:12.566421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e65101b-eebd-46ce-ae32-ecc91e9480bc tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:12.567052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e65101b-eebd-46ce-ae32-ecc91e9480bc tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:12.568247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e65101b-eebd-46ce-ae32-ecc91e9480bc tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:12.570759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e65101b-eebd-46ce-ae32-ecc91e9480bc tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:12.571402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e65101b-eebd-46ce-ae32-ecc91e9480bc tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:13.310630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2e65101b-eebd-46ce-ae32-ecc91e9480bc tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:13.326521 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2e65101b-eebd-46ce-ae32-ecc91e9480bc tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 200 len: 1470 microversion: 2.1 time: 0.779774 Oct 12 22:35:13.328969 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2762/6164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:12 2022] GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 1470 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:14.355436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a2c77b93-b330-4674-adf1-7208f9339006 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:14.356058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a2c77b93-b330-4674-adf1-7208f9339006 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:14.369695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2c77b93-b330-4674-adf1-7208f9339006 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:14.373793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2c77b93-b330-4674-adf1-7208f9339006 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:14.374522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2c77b93-b330-4674-adf1-7208f9339006 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:14.375985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2c77b93-b330-4674-adf1-7208f9339006 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:14.376929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2c77b93-b330-4674-adf1-7208f9339006 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:14.379668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2c77b93-b330-4674-adf1-7208f9339006 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:14.809538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a2c77b93-b330-4674-adf1-7208f9339006 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:14.819541 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a2c77b93-b330-4674-adf1-7208f9339006 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 200 len: 1470 microversion: 2.1 time: 0.468764 Oct 12 22:35:14.822973 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3403/6165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:14 2022] GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 1470 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:15.847914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fff58a29-b929-4e75-baff-c29accdd0330 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:15.848988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fff58a29-b929-4e75-baff-c29accdd0330 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:15.854000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:15.857717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fff58a29-b929-4e75-baff-c29accdd0330 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:15.858512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fff58a29-b929-4e75-baff-c29accdd0330 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:15.859090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fff58a29-b929-4e75-baff-c29accdd0330 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:15.860195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fff58a29-b929-4e75-baff-c29accdd0330 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:15.860858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fff58a29-b929-4e75-baff-c29accdd0330 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:15.861712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fff58a29-b929-4e75-baff-c29accdd0330 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:16.116360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fff58a29-b929-4e75-baff-c29accdd0330 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:16.126575 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fff58a29-b929-4e75-baff-c29accdd0330 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 200 len: 1470 microversion: 2.1 time: 0.282965 Oct 12 22:35:16.142917 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2763/6166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:15 2022] GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 1470 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:16.494931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-93f1f713-d570-4640-9a98-f16512772fcc req-dac9bd90-b08c-427c-a88a-2f8d478a0af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e50519f9-97da-478d-902c-e33b86c44a38", "name": "network-vif-plugged", "status": "completed", "tag": "2b55e3c8-6c7e-4c2a-9c71-e2640252beed"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:16.500208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:16.504038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:16.524267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-93f1f713-d570-4640-9a98-f16512772fcc req-dac9bd90-b08c-427c-a88a-2f8d478a0af9 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:16.525997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-93f1f713-d570-4640-9a98-f16512772fcc req-dac9bd90-b08c-427c-a88a-2f8d478a0af9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:16.528362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-93f1f713-d570-4640-9a98-f16512772fcc req-dac9bd90-b08c-427c-a88a-2f8d478a0af9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:16.555853 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-93f1f713-d570-4640-9a98-f16512772fcc req-dac9bd90-b08c-427c-a88a-2f8d478a0af9 service nova] Creating event network-vif-plugged:2b55e3c8-6c7e-4c2a-9c71-e2640252beed for instance e50519f9-97da-478d-902c-e33b86c44a38 on n-h2-861111-1 Oct 12 22:35:16.584147 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-93f1f713-d570-4640-9a98-f16512772fcc req-dac9bd90-b08c-427c-a88a-2f8d478a0af9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093118 Oct 12 22:35:16.589480 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3404/6167] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:35:17.151455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fac806ad-7856-469d-bab8-56300691e1b3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:17.152637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fac806ad-7856-469d-bab8-56300691e1b3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:17.170247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fac806ad-7856-469d-bab8-56300691e1b3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:17.170743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fac806ad-7856-469d-bab8-56300691e1b3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:17.171172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fac806ad-7856-469d-bab8-56300691e1b3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:17.174184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fac806ad-7856-469d-bab8-56300691e1b3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:17.176576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fac806ad-7856-469d-bab8-56300691e1b3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:17.177208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fac806ad-7856-469d-bab8-56300691e1b3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:17.511803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fac806ad-7856-469d-bab8-56300691e1b3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:17.535168 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fac806ad-7856-469d-bab8-56300691e1b3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 200 len: 1470 microversion: 2.1 time: 0.388226 Oct 12 22:35:17.542233 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2764/6168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:17 2022] GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 1470 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:18.559952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3aa0d57b-0966-4550-842a-9abcd20ccc7b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:18.560683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3aa0d57b-0966-4550-842a-9abcd20ccc7b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:18.569701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3aa0d57b-0966-4550-842a-9abcd20ccc7b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.570192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3aa0d57b-0966-4550-842a-9abcd20ccc7b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.570627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3aa0d57b-0966-4550-842a-9abcd20ccc7b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.571356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3aa0d57b-0966-4550-842a-9abcd20ccc7b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.571810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3aa0d57b-0966-4550-842a-9abcd20ccc7b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.572237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3aa0d57b-0966-4550-842a-9abcd20ccc7b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.995173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3aa0d57b-0966-4550-842a-9abcd20ccc7b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:19.003621 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3aa0d57b-0966-4550-842a-9abcd20ccc7b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 200 len: 1642 microversion: 2.1 time: 0.448601 Oct 12 22:35:19.004215 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3405/6169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:18 2022] GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 1642 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:19.027374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-36c98658-023c-4b60-b351-7821f99ae236 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:19.027885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-36c98658-023c-4b60-b351-7821f99ae236 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:19.035926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36c98658-023c-4b60-b351-7821f99ae236 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.036672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36c98658-023c-4b60-b351-7821f99ae236 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.037356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36c98658-023c-4b60-b351-7821f99ae236 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.038800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36c98658-023c-4b60-b351-7821f99ae236 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.039703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36c98658-023c-4b60-b351-7821f99ae236 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.040238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36c98658-023c-4b60-b351-7821f99ae236 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.465978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-36c98658-023c-4b60-b351-7821f99ae236 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:19.479931 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-36c98658-023c-4b60-b351-7821f99ae236 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 200 len: 1642 microversion: 2.1 time: 0.455817 Oct 12 22:35:19.480915 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2765/6170] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:19 2022] GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 1642 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:19.511537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-24a7ace8-3f43-44cb-8c3f-7f9ad23793ce tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:19.512639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-24a7ace8-3f43-44cb-8c3f-7f9ad23793ce tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:19.535907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24a7ace8-3f43-44cb-8c3f-7f9ad23793ce tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.540170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24a7ace8-3f43-44cb-8c3f-7f9ad23793ce tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.542346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24a7ace8-3f43-44cb-8c3f-7f9ad23793ce tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.543218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24a7ace8-3f43-44cb-8c3f-7f9ad23793ce tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.543805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24a7ace8-3f43-44cb-8c3f-7f9ad23793ce tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.547963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24a7ace8-3f43-44cb-8c3f-7f9ad23793ce tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:20.141780 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-24a7ace8-3f43-44cb-8c3f-7f9ad23793ce tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 200 len: 1793 microversion: 2.1 time: 0.636253 Oct 12 22:35:20.143700 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3406/6171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:19 2022] GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 1793 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:23.073991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-b1d0cd4e-d40c-4f86-85e8-a8babb6a65c2 req-fc7ab90f-849a-46a1-9967-c8054faa6b46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e50519f9-97da-478d-902c-e33b86c44a38", "tag": "2b55e3c8-6c7e-4c2a-9c71-e2640252beed"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:23.101762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b1d0cd4e-d40c-4f86-85e8-a8babb6a65c2 req-fc7ab90f-849a-46a1-9967-c8054faa6b46 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:23.103009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b1d0cd4e-d40c-4f86-85e8-a8babb6a65c2 req-fc7ab90f-849a-46a1-9967-c8054faa6b46 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:23.103009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b1d0cd4e-d40c-4f86-85e8-a8babb6a65c2 req-fc7ab90f-849a-46a1-9967-c8054faa6b46 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:23.138804 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-b1d0cd4e-d40c-4f86-85e8-a8babb6a65c2 req-fc7ab90f-849a-46a1-9967-c8054faa6b46 service nova] Creating event network-changed:2b55e3c8-6c7e-4c2a-9c71-e2640252beed for instance e50519f9-97da-478d-902c-e33b86c44a38 on n-h2-861111-1 Oct 12 22:35:23.151408 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-b1d0cd4e-d40c-4f86-85e8-a8babb6a65c2 req-fc7ab90f-849a-46a1-9967-c8054faa6b46 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081002 Oct 12 22:35:23.155476 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2766/6172] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:29.392733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:29.397563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=43 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:29.406872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1119505718", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:29.528230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] validate_networks() for None {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:36:30.153136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:36:30.154634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:36:30.155684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:36:30.156716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:36:30.157339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:36:30.174296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:30.176232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:30.176873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:30.177798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:30.179857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:30.180681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:30.208637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Getting quotas for project 77521afa195941a18caadc3f5b9ca5b3. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:36:30.224567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Getting quotas for user 40920d7353f54c7baf214a6db7c577a1 and project 77521afa195941a18caadc3f5b9ca5b3. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:36:30.256539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:36:30.258894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:36:30.323211 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b1778388-5189-47f3-afe1-5b3baa1e078b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.933647 Oct 12 22:36:30.324316 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3407/6173] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:36:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:36:30.335410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=18 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:30.336875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=34 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:30.339124 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 22:36:30.339663 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 22:36:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 (ip 10.222.0.16) !!! Oct 12 22:36:30.360646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-afdba8bf-3c1d-4676-9353-4ae5fd6cccdf tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:30.363992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-afdba8bf-3c1d-4676-9353-4ae5fd6cccdf tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:30.564363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-afdba8bf-3c1d-4676-9353-4ae5fd6cccdf tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40920d7353f54c7baf214a6db7c577a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77521afa195941a18caadc3f5b9ca5b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:30.576813 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-afdba8bf-3c1d-4676-9353-4ae5fd6cccdf tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 200 len: 1215 microversion: 2.1 time: 0.244088 Oct 12 22:36:30.577744 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2767/6174] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:30 2022] GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 1215 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:31.603870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d1b26b0b-d67e-4609-b34b-d5af2bce8d85 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:31.605469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d1b26b0b-d67e-4609-b34b-d5af2bce8d85 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:31.614969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1b26b0b-d67e-4609-b34b-d5af2bce8d85 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:31.615843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1b26b0b-d67e-4609-b34b-d5af2bce8d85 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:31.616962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1b26b0b-d67e-4609-b34b-d5af2bce8d85 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:31.618160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1b26b0b-d67e-4609-b34b-d5af2bce8d85 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:31.618782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1b26b0b-d67e-4609-b34b-d5af2bce8d85 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:31.620246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1b26b0b-d67e-4609-b34b-d5af2bce8d85 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:31.781079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d1b26b0b-d67e-4609-b34b-d5af2bce8d85 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40920d7353f54c7baf214a6db7c577a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77521afa195941a18caadc3f5b9ca5b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:31.797942 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d1b26b0b-d67e-4609-b34b-d5af2bce8d85 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 200 len: 1219 microversion: 2.1 time: 0.198531 Oct 12 22:36:31.799263 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3408/6175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:31 2022] GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 1219 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:32.823415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6cec4a53-0853-4d74-9e20-246f68a2eb93 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:32.825899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6cec4a53-0853-4d74-9e20-246f68a2eb93 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:32.851034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cec4a53-0853-4d74-9e20-246f68a2eb93 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:32.852002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cec4a53-0853-4d74-9e20-246f68a2eb93 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:32.853360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cec4a53-0853-4d74-9e20-246f68a2eb93 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:32.854666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cec4a53-0853-4d74-9e20-246f68a2eb93 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:32.855458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cec4a53-0853-4d74-9e20-246f68a2eb93 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:32.855994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cec4a53-0853-4d74-9e20-246f68a2eb93 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:33.068603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6cec4a53-0853-4d74-9e20-246f68a2eb93 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40920d7353f54c7baf214a6db7c577a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77521afa195941a18caadc3f5b9ca5b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:33.078658 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6cec4a53-0853-4d74-9e20-246f68a2eb93 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 200 len: 1273 microversion: 2.1 time: 0.260734 Oct 12 22:36:33.090326 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2768/6176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:32 2022] GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:34.121086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b58e4320-5753-44cd-b3bd-b5a22bc4de9c tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:34.121958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b58e4320-5753-44cd-b3bd-b5a22bc4de9c tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:34.140807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b58e4320-5753-44cd-b3bd-b5a22bc4de9c tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:34.142369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b58e4320-5753-44cd-b3bd-b5a22bc4de9c tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:34.142838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b58e4320-5753-44cd-b3bd-b5a22bc4de9c tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:34.146342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b58e4320-5753-44cd-b3bd-b5a22bc4de9c tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:34.148342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b58e4320-5753-44cd-b3bd-b5a22bc4de9c tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:34.148599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b58e4320-5753-44cd-b3bd-b5a22bc4de9c tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:34.456061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b58e4320-5753-44cd-b3bd-b5a22bc4de9c tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40920d7353f54c7baf214a6db7c577a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77521afa195941a18caadc3f5b9ca5b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:34.471732 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b58e4320-5753-44cd-b3bd-b5a22bc4de9c tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 200 len: 1273 microversion: 2.1 time: 0.351962 Oct 12 22:36:34.491369 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3409/6177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:34 2022] GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 1273 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:35.497808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fcebbc1d-133f-415e-b416-795a1744227e tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:35.498429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fcebbc1d-133f-415e-b416-795a1744227e tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:35.520362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcebbc1d-133f-415e-b416-795a1744227e tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:35.520855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcebbc1d-133f-415e-b416-795a1744227e tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:35.521289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcebbc1d-133f-415e-b416-795a1744227e tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:35.522005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcebbc1d-133f-415e-b416-795a1744227e tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:35.522457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcebbc1d-133f-415e-b416-795a1744227e tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:35.522880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fcebbc1d-133f-415e-b416-795a1744227e tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:36.190302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fcebbc1d-133f-415e-b416-795a1744227e tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40920d7353f54c7baf214a6db7c577a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77521afa195941a18caadc3f5b9ca5b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:36.201951 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fcebbc1d-133f-415e-b416-795a1744227e tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 200 len: 1315 microversion: 2.1 time: 0.707790 Oct 12 22:36:36.202560 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2769/6178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:35 2022] GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 1315 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:37.227452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0dcb27b2-d5b6-4586-b9e8-74be4412de4f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:37.228073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0dcb27b2-d5b6-4586-b9e8-74be4412de4f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:37.239030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0dcb27b2-d5b6-4586-b9e8-74be4412de4f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:37.239872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0dcb27b2-d5b6-4586-b9e8-74be4412de4f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:37.241116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0dcb27b2-d5b6-4586-b9e8-74be4412de4f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:37.242323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0dcb27b2-d5b6-4586-b9e8-74be4412de4f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:37.242937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0dcb27b2-d5b6-4586-b9e8-74be4412de4f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:37.243869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0dcb27b2-d5b6-4586-b9e8-74be4412de4f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:38.233052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0dcb27b2-d5b6-4586-b9e8-74be4412de4f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40920d7353f54c7baf214a6db7c577a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77521afa195941a18caadc3f5b9ca5b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:38.258606 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0dcb27b2-d5b6-4586-b9e8-74be4412de4f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 200 len: 1315 microversion: 2.1 time: 1.035153 Oct 12 22:36:38.261644 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3410/6179] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:37 2022] GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 1315 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:38.545962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-9398b439-98d7-4294-95c4-80414a628a87 req-703bd582-3d4a-4201-93cb-4cff45e9e118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd81d242-ce58-42ef-8e91-e2b8d2f16c49", "tag": "a3405a62-554d-4d08-8798-3a93c9b6911f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:38.564343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1313186918", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "30a9a67a-58dd-466e-be1e-53c3389320fd"}], "key_name": "tempest-TestSecurityGroupsBasicOps-662679922", "security_groups": []}, "os:scheduler_hints": {"different_host": ["e50519f9-97da-478d-902c-e33b86c44a38"]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:38.588072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9398b439-98d7-4294-95c4-80414a628a87 req-703bd582-3d4a-4201-93cb-4cff45e9e118 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:38.588558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9398b439-98d7-4294-95c4-80414a628a87 req-703bd582-3d4a-4201-93cb-4cff45e9e118 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:38.589027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9398b439-98d7-4294-95c4-80414a628a87 req-703bd582-3d4a-4201-93cb-4cff45e9e118 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:38.646877 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-9398b439-98d7-4294-95c4-80414a628a87 req-703bd582-3d4a-4201-93cb-4cff45e9e118 service nova] Creating event network-changed:a3405a62-554d-4d08-8798-3a93c9b6911f for instance bd81d242-ce58-42ef-8e91-e2b8d2f16c49 on n-h1-861111-1 Oct 12 22:36:38.662608 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-9398b439-98d7-4294-95c4-80414a628a87 req-703bd582-3d4a-4201-93cb-4cff45e9e118 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.554441 Oct 12 22:36:38.663223 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2770/6180] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:38.690473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] validate_networks() for [('30a9a67a-58dd-466e-be1e-53c3389320fd', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:36:39.291368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1c8437c5-5f33-43ed-a204-42225f94ed3f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:39.292077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1c8437c5-5f33-43ed-a204-42225f94ed3f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:39.304556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c8437c5-5f33-43ed-a204-42225f94ed3f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:39.305369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c8437c5-5f33-43ed-a204-42225f94ed3f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:39.306387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c8437c5-5f33-43ed-a204-42225f94ed3f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:39.308268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c8437c5-5f33-43ed-a204-42225f94ed3f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:39.309746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c8437c5-5f33-43ed-a204-42225f94ed3f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:39.313250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c8437c5-5f33-43ed-a204-42225f94ed3f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:39.839579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:36:39.840543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:36:39.841175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:36:39.841770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:36:39.842322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:36:39.862348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:39.866586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:39.867250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:39.868226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:39.868867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:39.876344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:39.918234 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Getting quotas for project 9f46e26b725045708751d688a0422950. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:36:39.928047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Getting quotas for user 1195be2699414d198bc95d20d4be9c2e and project 9f46e26b725045708751d688a0422950. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:36:39.958499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:36:39.961030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:36:40.018396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1c8437c5-5f33-43ed-a204-42225f94ed3f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40920d7353f54c7baf214a6db7c577a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77521afa195941a18caadc3f5b9ca5b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:40.029405 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1c8437c5-5f33-43ed-a204-42225f94ed3f tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 200 len: 1315 microversion: 2.1 time: 0.743600 Oct 12 22:36:40.034397 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2771/6181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:39 2022] GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 1315 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:36:40.081935 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7ae38115-c7fd-490b-aca4-7ddad6c7b48b tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.521627 Oct 12 22:36:40.085039 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3411/6182] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:36:38 2022] POST /compute/v2.1/servers => generated 361 bytes in 1524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:36:40.094236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-96b4260f-9c54-4399-ab94-c0e66db6117e tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:40.094837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-96b4260f-9c54-4399-ab94-c0e66db6117e tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:40.215071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-96b4260f-9c54-4399-ab94-c0e66db6117e tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:40.234315 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-96b4260f-9c54-4399-ab94-c0e66db6117e tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1241 microversion: 2.1 time: 0.143426 Oct 12 22:36:40.235544 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2772/6183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:40 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1241 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:41.064372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-73381bb9-ffee-40cd-8db1-a9f052384a42 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:41.067311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-73381bb9-ffee-40cd-8db1-a9f052384a42 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:41.087292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73381bb9-ffee-40cd-8db1-a9f052384a42 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:41.088152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73381bb9-ffee-40cd-8db1-a9f052384a42 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:41.090479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73381bb9-ffee-40cd-8db1-a9f052384a42 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:41.091231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73381bb9-ffee-40cd-8db1-a9f052384a42 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:41.091738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73381bb9-ffee-40cd-8db1-a9f052384a42 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:41.092169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-73381bb9-ffee-40cd-8db1-a9f052384a42 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:41.261673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1c3fca07-9a9a-459e-8a8f-d2aa9b6c1bd3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:41.262495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1c3fca07-9a9a-459e-8a8f-d2aa9b6c1bd3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:41.280314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c3fca07-9a9a-459e-8a8f-d2aa9b6c1bd3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:41.281257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c3fca07-9a9a-459e-8a8f-d2aa9b6c1bd3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:41.281989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c3fca07-9a9a-459e-8a8f-d2aa9b6c1bd3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:41.282991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c3fca07-9a9a-459e-8a8f-d2aa9b6c1bd3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:41.286568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c3fca07-9a9a-459e-8a8f-d2aa9b6c1bd3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:41.287660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c3fca07-9a9a-459e-8a8f-d2aa9b6c1bd3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:41.668064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-73381bb9-ffee-40cd-8db1-a9f052384a42 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40920d7353f54c7baf214a6db7c577a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77521afa195941a18caadc3f5b9ca5b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:41.681550 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-73381bb9-ffee-40cd-8db1-a9f052384a42 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 200 len: 1315 microversion: 2.1 time: 0.627949 Oct 12 22:36:41.682183 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3412/6184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:41 2022] GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 1315 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:42.143332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1c3fca07-9a9a-459e-8a8f-d2aa9b6c1bd3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:42.157370 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1c3fca07-9a9a-459e-8a8f-d2aa9b6c1bd3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1237 microversion: 2.1 time: 0.895288 Oct 12 22:36:42.170863 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2773/6185] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:41 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1237 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:36:42.714888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-daec3192-c2f4-4bf5-926b-1280755b49f8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:42.716131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-daec3192-c2f4-4bf5-926b-1280755b49f8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:42.731157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daec3192-c2f4-4bf5-926b-1280755b49f8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:42.731689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daec3192-c2f4-4bf5-926b-1280755b49f8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:42.732132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daec3192-c2f4-4bf5-926b-1280755b49f8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:42.732850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daec3192-c2f4-4bf5-926b-1280755b49f8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:42.733311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daec3192-c2f4-4bf5-926b-1280755b49f8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:42.734503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-daec3192-c2f4-4bf5-926b-1280755b49f8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:43.105503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-daec3192-c2f4-4bf5-926b-1280755b49f8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40920d7353f54c7baf214a6db7c577a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77521afa195941a18caadc3f5b9ca5b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:43.119033 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-daec3192-c2f4-4bf5-926b-1280755b49f8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 200 len: 1315 microversion: 2.1 time: 0.409173 Oct 12 22:36:43.120279 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3413/6186] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:42 2022] GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:43.181666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d81a96a-80c3-430a-82bf-3e5e1c05ccc8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:43.182189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9d81a96a-80c3-430a-82bf-3e5e1c05ccc8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:43.189079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d81a96a-80c3-430a-82bf-3e5e1c05ccc8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:43.190049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d81a96a-80c3-430a-82bf-3e5e1c05ccc8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:43.190650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d81a96a-80c3-430a-82bf-3e5e1c05ccc8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:43.191568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d81a96a-80c3-430a-82bf-3e5e1c05ccc8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:43.192167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d81a96a-80c3-430a-82bf-3e5e1c05ccc8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:43.192741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d81a96a-80c3-430a-82bf-3e5e1c05ccc8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:43.312512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9d81a96a-80c3-430a-82bf-3e5e1c05ccc8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:43.322853 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9d81a96a-80c3-430a-82bf-3e5e1c05ccc8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1299 microversion: 2.1 time: 0.145491 Oct 12 22:36:43.324933 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2774/6187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:43 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1299 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:44.148347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2939fad5-dbc1-4d3d-a03c-add3d54251ea tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:44.149054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2939fad5-dbc1-4d3d-a03c-add3d54251ea tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:44.161530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2939fad5-dbc1-4d3d-a03c-add3d54251ea tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:44.163883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2939fad5-dbc1-4d3d-a03c-add3d54251ea tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:44.166445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2939fad5-dbc1-4d3d-a03c-add3d54251ea tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:44.168692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2939fad5-dbc1-4d3d-a03c-add3d54251ea tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:44.169943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2939fad5-dbc1-4d3d-a03c-add3d54251ea tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:44.172291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2939fad5-dbc1-4d3d-a03c-add3d54251ea tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:44.351826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fd0fb132-8f54-4427-b3d6-43d9a4cae5e2 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:44.352450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fd0fb132-8f54-4427-b3d6-43d9a4cae5e2 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:44.367469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd0fb132-8f54-4427-b3d6-43d9a4cae5e2 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:44.368504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd0fb132-8f54-4427-b3d6-43d9a4cae5e2 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:44.369125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd0fb132-8f54-4427-b3d6-43d9a4cae5e2 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:44.370112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd0fb132-8f54-4427-b3d6-43d9a4cae5e2 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:44.372717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd0fb132-8f54-4427-b3d6-43d9a4cae5e2 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:44.373334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fd0fb132-8f54-4427-b3d6-43d9a4cae5e2 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:44.646744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fd0fb132-8f54-4427-b3d6-43d9a4cae5e2 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:44.674997 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fd0fb132-8f54-4427-b3d6-43d9a4cae5e2 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1299 microversion: 2.1 time: 0.325914 Oct 12 22:36:44.676324 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2775/6188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:44 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1299 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:44.985930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2939fad5-dbc1-4d3d-a03c-add3d54251ea tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40920d7353f54c7baf214a6db7c577a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77521afa195941a18caadc3f5b9ca5b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:44.995511 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2939fad5-dbc1-4d3d-a03c-add3d54251ea tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 200 len: 1315 microversion: 2.1 time: 0.851618 Oct 12 22:36:44.997338 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3414/6189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:44 2022] GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 1315 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:45.700165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6581d7b9-3518-4846-8c48-90d63b94221f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:45.700952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6581d7b9-3518-4846-8c48-90d63b94221f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:45.719116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6581d7b9-3518-4846-8c48-90d63b94221f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:45.721667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6581d7b9-3518-4846-8c48-90d63b94221f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:45.722156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6581d7b9-3518-4846-8c48-90d63b94221f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:45.722913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6581d7b9-3518-4846-8c48-90d63b94221f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:45.724358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6581d7b9-3518-4846-8c48-90d63b94221f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:45.724988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6581d7b9-3518-4846-8c48-90d63b94221f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:46.023755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6581d7b9-3518-4846-8c48-90d63b94221f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:46.032241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-65ca0f77-1f59-4c64-a340-c03f1345920d tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:46.034079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-65ca0f77-1f59-4c64-a340-c03f1345920d tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:46.042544 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6581d7b9-3518-4846-8c48-90d63b94221f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1299 microversion: 2.1 time: 0.348079 Oct 12 22:36:46.047969 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2776/6190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:45 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1299 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:46.058127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65ca0f77-1f59-4c64-a340-c03f1345920d tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:46.061369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65ca0f77-1f59-4c64-a340-c03f1345920d tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:46.062492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65ca0f77-1f59-4c64-a340-c03f1345920d tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:46.064038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65ca0f77-1f59-4c64-a340-c03f1345920d tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:46.066276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65ca0f77-1f59-4c64-a340-c03f1345920d tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:46.066890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65ca0f77-1f59-4c64-a340-c03f1345920d tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:46.224989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-b54cc356-3a55-46f7-a1d8-d4cad0cd4c53 req-7eb8713f-6a90-4f49-835d-21f2ebb82faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd81d242-ce58-42ef-8e91-e2b8d2f16c49", "name": "network-vif-plugged", "status": "completed", "tag": "a3405a62-554d-4d08-8798-3a93c9b6911f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:46.248269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b54cc356-3a55-46f7-a1d8-d4cad0cd4c53 req-7eb8713f-6a90-4f49-835d-21f2ebb82faf service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:46.248815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b54cc356-3a55-46f7-a1d8-d4cad0cd4c53 req-7eb8713f-6a90-4f49-835d-21f2ebb82faf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:46.249264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b54cc356-3a55-46f7-a1d8-d4cad0cd4c53 req-7eb8713f-6a90-4f49-835d-21f2ebb82faf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:46.288369 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-b54cc356-3a55-46f7-a1d8-d4cad0cd4c53 req-7eb8713f-6a90-4f49-835d-21f2ebb82faf service nova] Creating event network-vif-plugged:a3405a62-554d-4d08-8798-3a93c9b6911f for instance bd81d242-ce58-42ef-8e91-e2b8d2f16c49 on n-h1-861111-1 Oct 12 22:36:46.294030 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-b54cc356-3a55-46f7-a1d8-d4cad0cd4c53 req-7eb8713f-6a90-4f49-835d-21f2ebb82faf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163756 Oct 12 22:36:46.295354 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2777/6191] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:36:46.317765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-65ca0f77-1f59-4c64-a340-c03f1345920d tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40920d7353f54c7baf214a6db7c577a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77521afa195941a18caadc3f5b9ca5b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:46.333658 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-65ca0f77-1f59-4c64-a340-c03f1345920d tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 200 len: 1315 microversion: 2.1 time: 0.316754 Oct 12 22:36:46.341413 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3415/6192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:46 2022] GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:46.789497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-e73974e9-df26-4b4a-be3e-e9119971b4c5 req-fc17628d-154b-4589-853e-869619e310f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85e249b0-2fd5-45bd-aaba-284c989d536b", "tag": "bcacf00f-9416-4864-b592-eeb0dcf67268"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:46.810730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e73974e9-df26-4b4a-be3e-e9119971b4c5 req-fc17628d-154b-4589-853e-869619e310f0 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:46.813244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e73974e9-df26-4b4a-be3e-e9119971b4c5 req-fc17628d-154b-4589-853e-869619e310f0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:46.815126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e73974e9-df26-4b4a-be3e-e9119971b4c5 req-fc17628d-154b-4589-853e-869619e310f0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:46.838133 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-e73974e9-df26-4b4a-be3e-e9119971b4c5 req-fc17628d-154b-4589-853e-869619e310f0 service nova] Creating event network-changed:bcacf00f-9416-4864-b592-eeb0dcf67268 for instance 85e249b0-2fd5-45bd-aaba-284c989d536b on n-h1-861111-1 Oct 12 22:36:46.857100 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-e73974e9-df26-4b4a-be3e-e9119971b4c5 req-fc17628d-154b-4589-853e-869619e310f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066166 Oct 12 22:36:46.857917 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2778/6193] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:47.075041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-337b31c2-dc79-44a7-b8c2-8e56a784b047 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:47.076226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-337b31c2-dc79-44a7-b8c2-8e56a784b047 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:47.090441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-337b31c2-dc79-44a7-b8c2-8e56a784b047 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:47.091177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-337b31c2-dc79-44a7-b8c2-8e56a784b047 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:47.093965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-337b31c2-dc79-44a7-b8c2-8e56a784b047 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:47.094872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-337b31c2-dc79-44a7-b8c2-8e56a784b047 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:47.098754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-337b31c2-dc79-44a7-b8c2-8e56a784b047 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:47.099994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-337b31c2-dc79-44a7-b8c2-8e56a784b047 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:47.312152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-337b31c2-dc79-44a7-b8c2-8e56a784b047 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:47.328933 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-337b31c2-dc79-44a7-b8c2-8e56a784b047 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1299 microversion: 2.1 time: 0.252193 Oct 12 22:36:47.329993 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3416/6194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:47 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1299 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:47.362957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-27e79c70-d95f-4fd4-a8b4-2749469d02a8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:47.364778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-27e79c70-d95f-4fd4-a8b4-2749469d02a8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:47.379837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27e79c70-d95f-4fd4-a8b4-2749469d02a8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:47.383031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27e79c70-d95f-4fd4-a8b4-2749469d02a8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:47.384265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27e79c70-d95f-4fd4-a8b4-2749469d02a8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:47.386038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27e79c70-d95f-4fd4-a8b4-2749469d02a8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:47.391670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27e79c70-d95f-4fd4-a8b4-2749469d02a8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:47.392441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27e79c70-d95f-4fd4-a8b4-2749469d02a8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:48.317185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-27e79c70-d95f-4fd4-a8b4-2749469d02a8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40920d7353f54c7baf214a6db7c577a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77521afa195941a18caadc3f5b9ca5b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:48.325563 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-27e79c70-d95f-4fd4-a8b4-2749469d02a8 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 200 len: 1315 microversion: 2.1 time: 0.970897 Oct 12 22:36:48.336924 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2779/6195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:47 2022] GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 1315 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:48.357073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-91545efc-d84f-45d5-a25a-04d108e1e598 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:48.358691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-91545efc-d84f-45d5-a25a-04d108e1e598 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:48.371926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91545efc-d84f-45d5-a25a-04d108e1e598 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:48.372938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91545efc-d84f-45d5-a25a-04d108e1e598 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:48.373623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91545efc-d84f-45d5-a25a-04d108e1e598 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:48.374545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91545efc-d84f-45d5-a25a-04d108e1e598 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:48.375221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91545efc-d84f-45d5-a25a-04d108e1e598 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:48.375884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91545efc-d84f-45d5-a25a-04d108e1e598 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:48.538633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-91545efc-d84f-45d5-a25a-04d108e1e598 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:48.555975 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-91545efc-d84f-45d5-a25a-04d108e1e598 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1299 microversion: 2.1 time: 0.203202 Oct 12 22:36:48.569510 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3417/6196] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:48 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1299 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:49.355792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-adaa6a59-6e5f-439b-8ce5-954004978e63 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:49.358222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-adaa6a59-6e5f-439b-8ce5-954004978e63 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:49.372324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adaa6a59-6e5f-439b-8ce5-954004978e63 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:49.373245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adaa6a59-6e5f-439b-8ce5-954004978e63 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:49.374273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adaa6a59-6e5f-439b-8ce5-954004978e63 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:49.375919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adaa6a59-6e5f-439b-8ce5-954004978e63 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:49.377409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adaa6a59-6e5f-439b-8ce5-954004978e63 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:49.378006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adaa6a59-6e5f-439b-8ce5-954004978e63 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:49.584077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4872f599-6028-4888-93ea-32729f9c83a8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:49.585292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4872f599-6028-4888-93ea-32729f9c83a8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:49.594318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4872f599-6028-4888-93ea-32729f9c83a8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:49.594818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4872f599-6028-4888-93ea-32729f9c83a8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:49.595271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4872f599-6028-4888-93ea-32729f9c83a8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:49.596023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4872f599-6028-4888-93ea-32729f9c83a8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:49.596486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4872f599-6028-4888-93ea-32729f9c83a8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:49.596914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4872f599-6028-4888-93ea-32729f9c83a8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:49.829804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4872f599-6028-4888-93ea-32729f9c83a8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:49.841109 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4872f599-6028-4888-93ea-32729f9c83a8 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1299 microversion: 2.1 time: 0.261790 Oct 12 22:36:49.842962 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3418/6197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:49 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1299 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:49.843976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-adaa6a59-6e5f-439b-8ce5-954004978e63 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40920d7353f54c7baf214a6db7c577a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77521afa195941a18caadc3f5b9ca5b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:49.862944 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-adaa6a59-6e5f-439b-8ce5-954004978e63 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 200 len: 1465 microversion: 2.1 time: 0.511759 Oct 12 22:36:49.863928 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2780/6198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:49 2022] GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 1465 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:49.916654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-05db79c3-b755-4fab-b473-4fa687e06006 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:49.917162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-05db79c3-b755-4fab-b473-4fa687e06006 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:49.922461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:49.936763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05db79c3-b755-4fab-b473-4fa687e06006 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:49.937447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05db79c3-b755-4fab-b473-4fa687e06006 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:49.938075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05db79c3-b755-4fab-b473-4fa687e06006 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:49.938954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05db79c3-b755-4fab-b473-4fa687e06006 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:49.940169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05db79c3-b755-4fab-b473-4fa687e06006 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:49.940757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05db79c3-b755-4fab-b473-4fa687e06006 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:49.968923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=12 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:49.987771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-05db79c3-b755-4fab-b473-4fa687e06006 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:36:50.090379 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-05db79c3-b755-4fab-b473-4fa687e06006 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 204 len: 0 microversion: 2.1 time: 0.177168 Oct 12 22:36:50.094554 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3419/6199] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:36:49 2022] DELETE /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:36:50.100616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-47bfbfa6-245b-4feb-8bff-cce1d3d27584 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:50.101962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-47bfbfa6-245b-4feb-8bff-cce1d3d27584 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:50.109734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47bfbfa6-245b-4feb-8bff-cce1d3d27584 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:50.118523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47bfbfa6-245b-4feb-8bff-cce1d3d27584 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:50.120418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47bfbfa6-245b-4feb-8bff-cce1d3d27584 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:50.123225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47bfbfa6-245b-4feb-8bff-cce1d3d27584 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:50.129976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47bfbfa6-245b-4feb-8bff-cce1d3d27584 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:50.130839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47bfbfa6-245b-4feb-8bff-cce1d3d27584 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:50.232802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:50.401529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-47bfbfa6-245b-4feb-8bff-cce1d3d27584 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40920d7353f54c7baf214a6db7c577a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77521afa195941a18caadc3f5b9ca5b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:50.412298 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-47bfbfa6-245b-4feb-8bff-cce1d3d27584 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 200 len: 1471 microversion: 2.1 time: 0.315024 Oct 12 22:36:50.415210 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2781/6200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:50 2022] GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 1471 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:50.870741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-259dc38d-eab1-4bc9-b2e6-d1c117d717de tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:50.871917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-259dc38d-eab1-4bc9-b2e6-d1c117d717de tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:50.881668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-259dc38d-eab1-4bc9-b2e6-d1c117d717de tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:50.882465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-259dc38d-eab1-4bc9-b2e6-d1c117d717de tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:50.882993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-259dc38d-eab1-4bc9-b2e6-d1c117d717de tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:50.883784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-259dc38d-eab1-4bc9-b2e6-d1c117d717de tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:50.884427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-259dc38d-eab1-4bc9-b2e6-d1c117d717de tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:50.885062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-259dc38d-eab1-4bc9-b2e6-d1c117d717de tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:50.983103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-259dc38d-eab1-4bc9-b2e6-d1c117d717de tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:50.995949 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-259dc38d-eab1-4bc9-b2e6-d1c117d717de tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1299 microversion: 2.1 time: 0.133526 Oct 12 22:36:50.997073 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3420/6201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:50 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:51.442857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-433bb58e-d35c-4e9b-a5da-1f0a9de4d52b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:51.443592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-433bb58e-d35c-4e9b-a5da-1f0a9de4d52b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:51.455787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-433bb58e-d35c-4e9b-a5da-1f0a9de4d52b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:51.456287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-433bb58e-d35c-4e9b-a5da-1f0a9de4d52b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:51.457937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-433bb58e-d35c-4e9b-a5da-1f0a9de4d52b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:51.458663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-433bb58e-d35c-4e9b-a5da-1f0a9de4d52b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:51.459120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-433bb58e-d35c-4e9b-a5da-1f0a9de4d52b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:51.459727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-433bb58e-d35c-4e9b-a5da-1f0a9de4d52b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:51.635348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-433bb58e-d35c-4e9b-a5da-1f0a9de4d52b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40920d7353f54c7baf214a6db7c577a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77521afa195941a18caadc3f5b9ca5b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:51.646745 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-433bb58e-d35c-4e9b-a5da-1f0a9de4d52b tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 200 len: 1471 microversion: 2.1 time: 0.208553 Oct 12 22:36:51.650020 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2782/6202] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:51 2022] GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 1471 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:52.032722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f3a95614-199f-4c29-aeb0-3bcb5a5e35f7 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:52.033383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f3a95614-199f-4c29-aeb0-3bcb5a5e35f7 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:52.045690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3a95614-199f-4c29-aeb0-3bcb5a5e35f7 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:52.046562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3a95614-199f-4c29-aeb0-3bcb5a5e35f7 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:52.046869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3a95614-199f-4c29-aeb0-3bcb5a5e35f7 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:52.047843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3a95614-199f-4c29-aeb0-3bcb5a5e35f7 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:52.048299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3a95614-199f-4c29-aeb0-3bcb5a5e35f7 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:52.049414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3a95614-199f-4c29-aeb0-3bcb5a5e35f7 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:52.313325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f3a95614-199f-4c29-aeb0-3bcb5a5e35f7 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:52.324212 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f3a95614-199f-4c29-aeb0-3bcb5a5e35f7 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1299 microversion: 2.1 time: 0.296249 Oct 12 22:36:52.328108 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3421/6203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:52 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1299 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:52.677942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6e0e0272-c7de-454a-970d-0995a422aec3 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:52.679382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6e0e0272-c7de-454a-970d-0995a422aec3 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:52.688698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e0e0272-c7de-454a-970d-0995a422aec3 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:52.689667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e0e0272-c7de-454a-970d-0995a422aec3 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:52.690330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e0e0272-c7de-454a-970d-0995a422aec3 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:52.691295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e0e0272-c7de-454a-970d-0995a422aec3 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:52.691956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e0e0272-c7de-454a-970d-0995a422aec3 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:52.692587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e0e0272-c7de-454a-970d-0995a422aec3 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:52.727018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-e53f1ba1-66c6-42bc-9fab-114458fabbf7 req-a9d7494d-c2d6-4433-b91c-cfd3b3c3632b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd81d242-ce58-42ef-8e91-e2b8d2f16c49", "name": "network-vif-deleted", "tag": "a3405a62-554d-4d08-8798-3a93c9b6911f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:52.739654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e53f1ba1-66c6-42bc-9fab-114458fabbf7 req-a9d7494d-c2d6-4433-b91c-cfd3b3c3632b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:52.740305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e53f1ba1-66c6-42bc-9fab-114458fabbf7 req-a9d7494d-c2d6-4433-b91c-cfd3b3c3632b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:52.750551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e53f1ba1-66c6-42bc-9fab-114458fabbf7 req-a9d7494d-c2d6-4433-b91c-cfd3b3c3632b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:52.795167 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-e53f1ba1-66c6-42bc-9fab-114458fabbf7 req-a9d7494d-c2d6-4433-b91c-cfd3b3c3632b service nova] Creating event network-vif-deleted:a3405a62-554d-4d08-8798-3a93c9b6911f for instance bd81d242-ce58-42ef-8e91-e2b8d2f16c49 on n-h1-861111-1 Oct 12 22:36:52.801369 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-e53f1ba1-66c6-42bc-9fab-114458fabbf7 req-a9d7494d-c2d6-4433-b91c-cfd3b3c3632b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078490 Oct 12 22:36:52.808764 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3422/6204] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:36:52.833859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6e0e0272-c7de-454a-970d-0995a422aec3 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40920d7353f54c7baf214a6db7c577a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77521afa195941a18caadc3f5b9ca5b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:52.850232 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6e0e0272-c7de-454a-970d-0995a422aec3 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 200 len: 1429 microversion: 2.1 time: 0.175261 Oct 12 22:36:52.850857 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2783/6205] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:52 2022] GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 1429 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:53.363161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-abef8822-9e8e-4453-ba84-995bfabd48b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:53.365895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-abef8822-9e8e-4453-ba84-995bfabd48b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:53.387025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abef8822-9e8e-4453-ba84-995bfabd48b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:53.387867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abef8822-9e8e-4453-ba84-995bfabd48b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:53.388666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abef8822-9e8e-4453-ba84-995bfabd48b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:53.389991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abef8822-9e8e-4453-ba84-995bfabd48b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:53.391391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abef8822-9e8e-4453-ba84-995bfabd48b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:53.391869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abef8822-9e8e-4453-ba84-995bfabd48b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:53.497428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-abef8822-9e8e-4453-ba84-995bfabd48b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:53.502209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:53.519547 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-abef8822-9e8e-4453-ba84-995bfabd48b1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1299 microversion: 2.1 time: 0.167520 Oct 12 22:36:53.522510 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3423/6206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:53 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1299 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:53.877192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5496b319-bc47-4ca7-abfa-8460b060d9d6 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:53.883808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5496b319-bc47-4ca7-abfa-8460b060d9d6 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] [instance: bd81d242-ce58-42ef-8e91-e2b8d2f16c49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:53.901762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5496b319-bc47-4ca7-abfa-8460b060d9d6 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:53.902681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5496b319-bc47-4ca7-abfa-8460b060d9d6 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:53.906537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5496b319-bc47-4ca7-abfa-8460b060d9d6 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:53.909124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5496b319-bc47-4ca7-abfa-8460b060d9d6 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:53.909886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5496b319-bc47-4ca7-abfa-8460b060d9d6 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:53.910493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5496b319-bc47-4ca7-abfa-8460b060d9d6 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:53.931390 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-5496b319-bc47-4ca7-abfa-8460b060d9d6 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] HTTP exception thrown: Instance bd81d242-ce58-42ef-8e91-e2b8d2f16c49 could not be found. Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5496b319-bc47-4ca7-abfa-8460b060d9d6 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Request method failure captured: Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 HTTP/1.1 Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0FqnyvDwG0mdsPVUGH4GSHoMcPM5uxFTt4Z0NYddgoEXaZai52zmZkJq0xawxLFnpsuTeTHxyU32Vb71kKeThOxzg7hJxM0jpyYHrxZK12lx6wk4n2TgL63M_hW3Xq_zO43HQILY0IwAnd4b9t3tCld_buHEMbDt-ZDnVFoW6SlVak Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 77521afa195941a18caadc3f5b9ca5b3 Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesNegativeTest-1601514006 Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77521afa195941a18caadc3f5b9ca5b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77521afa195941a18caadc3f5b9ca5b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_77521afa195941a18caadc3f5b9ca5b3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/77521afa195941a18caadc3f5b9ca5b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-VolumesNegativeTest-1601514006 Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 77521afa195941a18caadc3f5b9ca5b3 Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesNegativeTest-1601514006 Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-VolumesNegativeTest-1601514006-project Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 40920d7353f54c7baf214a6db7c577a1 Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-VolumesNegativeTest-1601514006-project Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance bd81d242-ce58-42ef-8e91-e2b8d2f16c49 could not be found. Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'bd81d242-ce58-42ef-8e91-e2b8d2f16c49'} Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd81d242-ce58-42ef-8e91-e2b8d2f16c49 could not be found. Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd81d242-ce58-42ef-8e91-e2b8d2f16c49 could not be found. Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:53.934112 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:36:53.938750 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:53.938750 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:53.938750 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:53.938750 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:36:53.938750 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:36:53.938750 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd81d242-ce58-42ef-8e91-e2b8d2f16c49 could not be found. Oct 12 22:36:53.938750 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:36:53.941670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5496b319-bc47-4ca7-abfa-8460b060d9d6 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] Returning 404 to user: Instance bd81d242-ce58-42ef-8e91-e2b8d2f16c49 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:36:53.943494 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5496b319-bc47-4ca7-abfa-8460b060d9d6 tempest-VolumesNegativeTest-1601514006 tempest-VolumesNegativeTest-1601514006-project] 10.222.0.16 "GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49" status: 404 len: 111 microversion: 2.1 time: 0.071592 Oct 12 22:36:53.944681 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2784/6207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:53 2022] GET /compute/v2.1/servers/bd81d242-ce58-42ef-8e91-e2b8d2f16c49 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:36:54.549706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a9baad2b-3381-4fd0-91bf-e451394eac69 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:54.552428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a9baad2b-3381-4fd0-91bf-e451394eac69 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:54.583510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9baad2b-3381-4fd0-91bf-e451394eac69 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:54.584096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9baad2b-3381-4fd0-91bf-e451394eac69 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:54.584655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9baad2b-3381-4fd0-91bf-e451394eac69 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:54.585393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9baad2b-3381-4fd0-91bf-e451394eac69 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:54.586407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9baad2b-3381-4fd0-91bf-e451394eac69 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:54.588463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9baad2b-3381-4fd0-91bf-e451394eac69 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:54.823103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a9baad2b-3381-4fd0-91bf-e451394eac69 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:54.841336 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a9baad2b-3381-4fd0-91bf-e451394eac69 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1299 microversion: 2.1 time: 0.298435 Oct 12 22:36:54.842778 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3424/6208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:54 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1299 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:55.869424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6ec8ee0c-260a-45c0-9d66-299dc24d0a5f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:55.870590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6ec8ee0c-260a-45c0-9d66-299dc24d0a5f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:55.881774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ec8ee0c-260a-45c0-9d66-299dc24d0a5f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:55.884831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ec8ee0c-260a-45c0-9d66-299dc24d0a5f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:55.885295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ec8ee0c-260a-45c0-9d66-299dc24d0a5f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:55.886030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ec8ee0c-260a-45c0-9d66-299dc24d0a5f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:55.886492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ec8ee0c-260a-45c0-9d66-299dc24d0a5f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:55.886917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ec8ee0c-260a-45c0-9d66-299dc24d0a5f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:56.124173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-c17a774a-b01e-4927-abef-e87c56e6f600 req-5fc60dfc-a652-42ea-9f61-98f4fb448060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85e249b0-2fd5-45bd-aaba-284c989d536b", "name": "network-vif-plugged", "status": "completed", "tag": "bcacf00f-9416-4864-b592-eeb0dcf67268"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:56.148099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c17a774a-b01e-4927-abef-e87c56e6f600 req-5fc60dfc-a652-42ea-9f61-98f4fb448060 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:56.148495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c17a774a-b01e-4927-abef-e87c56e6f600 req-5fc60dfc-a652-42ea-9f61-98f4fb448060 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:56.149077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c17a774a-b01e-4927-abef-e87c56e6f600 req-5fc60dfc-a652-42ea-9f61-98f4fb448060 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:56.175231 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-c17a774a-b01e-4927-abef-e87c56e6f600 req-5fc60dfc-a652-42ea-9f61-98f4fb448060 service nova] Creating event network-vif-plugged:bcacf00f-9416-4864-b592-eeb0dcf67268 for instance 85e249b0-2fd5-45bd-aaba-284c989d536b on n-h1-861111-1 Oct 12 22:36:56.181494 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-c17a774a-b01e-4927-abef-e87c56e6f600 req-5fc60dfc-a652-42ea-9f61-98f4fb448060 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061173 Oct 12 22:36:56.183701 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3425/6209] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:56.317489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6ec8ee0c-260a-45c0-9d66-299dc24d0a5f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:56.341993 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6ec8ee0c-260a-45c0-9d66-299dc24d0a5f tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1299 microversion: 2.1 time: 0.477308 Oct 12 22:36:56.356254 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2785/6210] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:55 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1299 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:57.389291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ca0bf3c0-6791-4781-b504-9407db6a9641 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:57.394775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ca0bf3c0-6791-4781-b504-9407db6a9641 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:57.416369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca0bf3c0-6791-4781-b504-9407db6a9641 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:57.417066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca0bf3c0-6791-4781-b504-9407db6a9641 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:57.417655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca0bf3c0-6791-4781-b504-9407db6a9641 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:57.418708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca0bf3c0-6791-4781-b504-9407db6a9641 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:57.419335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca0bf3c0-6791-4781-b504-9407db6a9641 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:57.420789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca0bf3c0-6791-4781-b504-9407db6a9641 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:57.789537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ca0bf3c0-6791-4781-b504-9407db6a9641 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:57.810290 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ca0bf3c0-6791-4781-b504-9407db6a9641 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1299 microversion: 2.1 time: 0.436870 Oct 12 22:36:57.844506 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3426/6211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:57 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1299 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:58.842481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6534f61e-92fa-4f66-bf8c-b8c951bfb3b0 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:58.842980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6534f61e-92fa-4f66-bf8c-b8c951bfb3b0 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:58.879909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6534f61e-92fa-4f66-bf8c-b8c951bfb3b0 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:58.880797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6534f61e-92fa-4f66-bf8c-b8c951bfb3b0 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:58.886286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6534f61e-92fa-4f66-bf8c-b8c951bfb3b0 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:58.887497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6534f61e-92fa-4f66-bf8c-b8c951bfb3b0 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:58.888118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6534f61e-92fa-4f66-bf8c-b8c951bfb3b0 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:58.889711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6534f61e-92fa-4f66-bf8c-b8c951bfb3b0 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:59.196588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6534f61e-92fa-4f66-bf8c-b8c951bfb3b0 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:59.216717 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6534f61e-92fa-4f66-bf8c-b8c951bfb3b0 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1471 microversion: 2.1 time: 0.380201 Oct 12 22:36:59.218758 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2786/6212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:58 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1471 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:59.251833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c484bb84-a22e-49d6-8f1a-c7d636db0453 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:59.253468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c484bb84-a22e-49d6-8f1a-c7d636db0453 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:59.272189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c484bb84-a22e-49d6-8f1a-c7d636db0453 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:59.284275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c484bb84-a22e-49d6-8f1a-c7d636db0453 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:59.284954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c484bb84-a22e-49d6-8f1a-c7d636db0453 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:59.287727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c484bb84-a22e-49d6-8f1a-c7d636db0453 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:59.288352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c484bb84-a22e-49d6-8f1a-c7d636db0453 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:59.290200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c484bb84-a22e-49d6-8f1a-c7d636db0453 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:59.619205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c484bb84-a22e-49d6-8f1a-c7d636db0453 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:59.629553 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c484bb84-a22e-49d6-8f1a-c7d636db0453 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1471 microversion: 2.1 time: 0.385717 Oct 12 22:36:59.635017 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3427/6213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:59 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1471 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:59.653235 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-10b97128-cdb7-4932-a826-c5dfc8f00a51 tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:59.653856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-10b97128-cdb7-4932-a826-c5dfc8f00a51 tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:59.671399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10b97128-cdb7-4932-a826-c5dfc8f00a51 tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:59.678347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10b97128-cdb7-4932-a826-c5dfc8f00a51 tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:59.678825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10b97128-cdb7-4932-a826-c5dfc8f00a51 tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:59.692447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10b97128-cdb7-4932-a826-c5dfc8f00a51 tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:59.693037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10b97128-cdb7-4932-a826-c5dfc8f00a51 tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:59.693484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10b97128-cdb7-4932-a826-c5dfc8f00a51 tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:59.931703 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-10b97128-cdb7-4932-a826-c5dfc8f00a51 tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1622 microversion: 2.1 time: 0.281741 Oct 12 22:36:59.947473 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2787/6214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:59 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1622 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:59.958540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7a9176a0-f953-494d-8c61-4a61cf9c642e tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:59.959189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7a9176a0-f953-494d-8c61-4a61cf9c642e tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:59.962662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:59.971807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a9176a0-f953-494d-8c61-4a61cf9c642e tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:59.972249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a9176a0-f953-494d-8c61-4a61cf9c642e tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:59.972712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a9176a0-f953-494d-8c61-4a61cf9c642e tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:59.978978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a9176a0-f953-494d-8c61-4a61cf9c642e tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:59.979570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a9176a0-f953-494d-8c61-4a61cf9c642e tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:59.980027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a9176a0-f953-494d-8c61-4a61cf9c642e tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:00.875758 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7a9176a0-f953-494d-8c61-4a61cf9c642e tempest-TestSecurityGroupsBasicOps-442093561 tempest-TestSecurityGroupsBasicOps-442093561-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 200 len: 1912 microversion: 2.1 time: 0.922132 Oct 12 22:37:00.879586 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3428/6215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:59 2022] GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 1912 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:01.016650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6c562c0a-4fcc-41a3-9bba-d56798b23aa1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:01.017200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6c562c0a-4fcc-41a3-9bba-d56798b23aa1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:01.021339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=47 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:01.030634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c562c0a-4fcc-41a3-9bba-d56798b23aa1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:01.031138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c562c0a-4fcc-41a3-9bba-d56798b23aa1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:01.034337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c562c0a-4fcc-41a3-9bba-d56798b23aa1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:01.035202 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c562c0a-4fcc-41a3-9bba-d56798b23aa1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:01.035719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c562c0a-4fcc-41a3-9bba-d56798b23aa1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:01.036184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c562c0a-4fcc-41a3-9bba-d56798b23aa1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:01.051195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=99 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:01.098910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6c562c0a-4fcc-41a3-9bba-d56798b23aa1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:37:01.308796 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6c562c0a-4fcc-41a3-9bba-d56798b23aa1 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "DELETE /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 204 len: 0 microversion: 2.1 time: 0.295852 Oct 12 22:37:01.313449 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2788/6216] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:37:01 2022] DELETE /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:37:01.321744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cc3a95e2-b7dd-4efb-b504-c9f335beb1c3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:01.322548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cc3a95e2-b7dd-4efb-b504-c9f335beb1c3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:01.335583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc3a95e2-b7dd-4efb-b504-c9f335beb1c3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:01.336031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc3a95e2-b7dd-4efb-b504-c9f335beb1c3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:01.336473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc3a95e2-b7dd-4efb-b504-c9f335beb1c3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:01.350911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc3a95e2-b7dd-4efb-b504-c9f335beb1c3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:01.351979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc3a95e2-b7dd-4efb-b504-c9f335beb1c3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:01.353426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc3a95e2-b7dd-4efb-b504-c9f335beb1c3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:01.529259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cc3a95e2-b7dd-4efb-b504-c9f335beb1c3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:01.542445 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cc3a95e2-b7dd-4efb-b504-c9f335beb1c3 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1477 microversion: 2.1 time: 0.224677 Oct 12 22:37:01.546871 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3429/6217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:01 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1477 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:02.575624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1e2089ab-b1f3-4246-bb3d-2c03bea0d109 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:02.576505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1e2089ab-b1f3-4246-bb3d-2c03bea0d109 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:02.598108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e2089ab-b1f3-4246-bb3d-2c03bea0d109 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:02.598861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e2089ab-b1f3-4246-bb3d-2c03bea0d109 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:02.599441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e2089ab-b1f3-4246-bb3d-2c03bea0d109 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:02.600436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e2089ab-b1f3-4246-bb3d-2c03bea0d109 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:02.600991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e2089ab-b1f3-4246-bb3d-2c03bea0d109 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:02.601524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e2089ab-b1f3-4246-bb3d-2c03bea0d109 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:02.852529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1e2089ab-b1f3-4246-bb3d-2c03bea0d109 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:02.863754 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1e2089ab-b1f3-4246-bb3d-2c03bea0d109 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1477 microversion: 2.1 time: 0.297181 Oct 12 22:37:02.880774 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2789/6218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:02 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1477 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:03.889624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-97e3743b-88c7-439b-b116-66d96153d884 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:03.890654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-97e3743b-88c7-439b-b116-66d96153d884 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:03.910456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97e3743b-88c7-439b-b116-66d96153d884 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:03.911067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97e3743b-88c7-439b-b116-66d96153d884 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:03.911937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97e3743b-88c7-439b-b116-66d96153d884 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:03.913235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97e3743b-88c7-439b-b116-66d96153d884 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:03.913762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97e3743b-88c7-439b-b116-66d96153d884 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:03.914199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97e3743b-88c7-439b-b116-66d96153d884 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:04.010953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-97e3743b-88c7-439b-b116-66d96153d884 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:04.020963 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-97e3743b-88c7-439b-b116-66d96153d884 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1477 microversion: 2.1 time: 0.136106 Oct 12 22:37:04.021566 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3430/6219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:03 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1477 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:04.307971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-652141e7-6367-4736-a947-2ae277df15ce req-7650a8be-5776-4f2d-b0c3-96e6f2d26bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85e249b0-2fd5-45bd-aaba-284c989d536b", "name": "network-vif-deleted", "tag": "bcacf00f-9416-4864-b592-eeb0dcf67268"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:04.339408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-652141e7-6367-4736-a947-2ae277df15ce req-7650a8be-5776-4f2d-b0c3-96e6f2d26bca service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:04.355518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-652141e7-6367-4736-a947-2ae277df15ce req-7650a8be-5776-4f2d-b0c3-96e6f2d26bca service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:04.363645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-652141e7-6367-4736-a947-2ae277df15ce req-7650a8be-5776-4f2d-b0c3-96e6f2d26bca service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:04.413390 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-652141e7-6367-4736-a947-2ae277df15ce req-7650a8be-5776-4f2d-b0c3-96e6f2d26bca service nova] Creating event network-vif-deleted:bcacf00f-9416-4864-b592-eeb0dcf67268 for instance 85e249b0-2fd5-45bd-aaba-284c989d536b on n-h1-861111-1 Oct 12 22:37:04.431668 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-652141e7-6367-4736-a947-2ae277df15ce req-7650a8be-5776-4f2d-b0c3-96e6f2d26bca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128491 Oct 12 22:37:04.435894 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2790/6220] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:05.047480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-58af7757-5a78-4c9b-8a59-60bafea29b2a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:05.048409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-58af7757-5a78-4c9b-8a59-60bafea29b2a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:05.072326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58af7757-5a78-4c9b-8a59-60bafea29b2a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:05.074691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58af7757-5a78-4c9b-8a59-60bafea29b2a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:05.077979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58af7757-5a78-4c9b-8a59-60bafea29b2a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:05.082394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58af7757-5a78-4c9b-8a59-60bafea29b2a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:05.083131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58af7757-5a78-4c9b-8a59-60bafea29b2a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:05.083830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58af7757-5a78-4c9b-8a59-60bafea29b2a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:05.202180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58af7757-5a78-4c9b-8a59-60bafea29b2a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:05.202675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58af7757-5a78-4c9b-8a59-60bafea29b2a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:05.203112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-58af7757-5a78-4c9b-8a59-60bafea29b2a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:05.210731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-58af7757-5a78-4c9b-8a59-60bafea29b2a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lazy-loading 'fault' on Instance uuid 85e249b0-2fd5-45bd-aaba-284c989d536b {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:37:05.344108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-58af7757-5a78-4c9b-8a59-60bafea29b2a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:05.354112 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-58af7757-5a78-4c9b-8a59-60bafea29b2a tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 200 len: 1331 microversion: 2.1 time: 0.311248 Oct 12 22:37:05.360984 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3431/6221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:05 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 1331 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:06.399481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-253d11ab-d7a1-47b3-ba8a-d3677883b705 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:06.400594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-253d11ab-d7a1-47b3-ba8a-d3677883b705 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: 85e249b0-2fd5-45bd-aaba-284c989d536b] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:06.414812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-253d11ab-d7a1-47b3-ba8a-d3677883b705 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:06.415334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-253d11ab-d7a1-47b3-ba8a-d3677883b705 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:06.415775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-253d11ab-d7a1-47b3-ba8a-d3677883b705 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:06.416487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-253d11ab-d7a1-47b3-ba8a-d3677883b705 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:06.416942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-253d11ab-d7a1-47b3-ba8a-d3677883b705 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:06.423510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-253d11ab-d7a1-47b3-ba8a-d3677883b705 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:06.463848 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-253d11ab-d7a1-47b3-ba8a-d3677883b705 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] HTTP exception thrown: Instance 85e249b0-2fd5-45bd-aaba-284c989d536b could not be found. Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-253d11ab-d7a1-47b3-ba8a-d3677883b705 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Request method failure captured: Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b HTTP/1.1 Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0EFEBODiLeXumH_9M_YTSv4vlLHFXyMOXWvjwXMYoh8cDybT_mA9f4WRLaiEYkSbjuh48gsetbdLdxOO0DyohEzhX5g_vUwfsW1UxGkMjb0h8QYv95ZwXGQ8sGnwM5Nu2CEbEHzJYltVPFFQkEHcEepF2S4jqHkOgfBox7bsNV0GAQ Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 9f46e26b725045708751d688a0422950 Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-296401407 Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f46e26b725045708751d688a0422950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f46e26b725045708751d688a0422950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9f46e26b725045708751d688a0422950", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9f46e26b725045708751d688a0422950"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestSecurityGroupsBasicOps-296401407 Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 9f46e26b725045708751d688a0422950 Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-296401407 Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestSecurityGroupsBasicOps-296401407-project Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 1195be2699414d198bc95d20d4be9c2e Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestSecurityGroupsBasicOps-296401407-project Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 85e249b0-2fd5-45bd-aaba-284c989d536b could not be found. Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '85e249b0-2fd5-45bd-aaba-284c989d536b'} Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85e249b0-2fd5-45bd-aaba-284c989d536b could not be found. Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85e249b0-2fd5-45bd-aaba-284c989d536b could not be found. Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:06.468747 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:37:06.474124 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:06.474124 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:06.474124 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:06.474124 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:06.474124 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:06.474124 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85e249b0-2fd5-45bd-aaba-284c989d536b could not be found. Oct 12 22:37:06.474124 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:37:06.474124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-253d11ab-d7a1-47b3-ba8a-d3677883b705 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Returning 404 to user: Instance 85e249b0-2fd5-45bd-aaba-284c989d536b could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:06.474124 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-253d11ab-d7a1-47b3-ba8a-d3677883b705 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b" status: 404 len: 111 microversion: 2.1 time: 0.077034 Oct 12 22:37:06.478755 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2791/6222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:06 2022] GET /compute/v2.1/servers/85e249b0-2fd5-45bd-aaba-284c989d536b => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:37:09.286652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4bc25bd7-9a4a-407c-807c-0523cb60913f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'create', calling method: .version_select at 0x7f5122b6a4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1715989287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBsbhte8L9xRJu+tCpAOFVqWEUnlX2ZsdE/Lyt4s3764QLd5bzTPlMuCa3yYftRCFQMk1d4nmbFwuApYJC+5p/LtR+sNyz7JxgEO9QO+C9gv4SfVptDeogvvoTiCVvlZQ=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:09.315023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-4bc25bd7-9a4a-407c-807c-0523cb60913f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Getting quotas for project aa5cc899bfb3403c9aa9d192833cafa9. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:37:09.323778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-4bc25bd7-9a4a-407c-807c-0523cb60913f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Getting quotas for user 2acd162da21348b6acb725bfe572bc00 and project aa5cc899bfb3403c9aa9d192833cafa9. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:37:09.366888 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4bc25bd7-9a4a-407c-807c-0523cb60913f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.427929 Oct 12 22:37:09.376474 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3432/6223] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:37:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:19.547775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:19.549589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:19.554234 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e9b3d187-a3a1-41d9-bceb-609ea2b75a52 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:19.555077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e9b3d187-a3a1-41d9-bceb-609ea2b75a52 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:19.558059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-0b44f4c0-9b1e-4da7-94c2-d42e262224ae req-be571746-4f8b-4e62-b2fd-61f9008d15ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e50519f9-97da-478d-902c-e33b86c44a38", "tag": "2b55e3c8-6c7e-4c2a-9c71-e2640252beed"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:19.566951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9b3d187-a3a1-41d9-bceb-609ea2b75a52 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:19.568665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9b3d187-a3a1-41d9-bceb-609ea2b75a52 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:19.570514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9b3d187-a3a1-41d9-bceb-609ea2b75a52 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:19.571424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9b3d187-a3a1-41d9-bceb-609ea2b75a52 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:19.572614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9b3d187-a3a1-41d9-bceb-609ea2b75a52 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:19.573807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9b3d187-a3a1-41d9-bceb-609ea2b75a52 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:19.586951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=46 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:19.590016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:19.592018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:19.600043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0b44f4c0-9b1e-4da7-94c2-d42e262224ae req-be571746-4f8b-4e62-b2fd-61f9008d15ea service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:19.601265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0b44f4c0-9b1e-4da7-94c2-d42e262224ae req-be571746-4f8b-4e62-b2fd-61f9008d15ea service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:19.604203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0b44f4c0-9b1e-4da7-94c2-d42e262224ae req-be571746-4f8b-4e62-b2fd-61f9008d15ea service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:19.643821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e9b3d187-a3a1-41d9-bceb-609ea2b75a52 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:37:19.646027 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-0b44f4c0-9b1e-4da7-94c2-d42e262224ae req-be571746-4f8b-4e62-b2fd-61f9008d15ea service nova] Creating event network-changed:2b55e3c8-6c7e-4c2a-9c71-e2640252beed for instance e50519f9-97da-478d-902c-e33b86c44a38 on n-h2-861111-1 Oct 12 22:37:19.653505 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-0b44f4c0-9b1e-4da7-94c2-d42e262224ae req-be571746-4f8b-4e62-b2fd-61f9008d15ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099518 Oct 12 22:37:19.655104 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3433/6224] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:19.811004 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e9b3d187-a3a1-41d9-bceb-609ea2b75a52 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 204 len: 0 microversion: 2.1 time: 0.264153 Oct 12 22:37:19.820744 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2792/6225] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:37:19 2022] DELETE /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:37:19.823721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-36151a84-b987-4c58-b873-caa3f26f905d tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:19.824696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-36151a84-b987-4c58-b873-caa3f26f905d tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:19.836818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36151a84-b987-4c58-b873-caa3f26f905d tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:19.837328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36151a84-b987-4c58-b873-caa3f26f905d tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:19.837773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36151a84-b987-4c58-b873-caa3f26f905d tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:19.838685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36151a84-b987-4c58-b873-caa3f26f905d tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:19.839150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36151a84-b987-4c58-b873-caa3f26f905d tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:19.850862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36151a84-b987-4c58-b873-caa3f26f905d tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:20.311666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-36151a84-b987-4c58-b873-caa3f26f905d tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:20.321323 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-36151a84-b987-4c58-b873-caa3f26f905d tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 200 len: 1767 microversion: 2.1 time: 0.501903 Oct 12 22:37:20.327795 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3434/6226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:19 2022] GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 1767 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:21.355312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-970d7291-21bf-4140-8251-2c0026f839ae tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:21.356704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-970d7291-21bf-4140-8251-2c0026f839ae tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:21.370626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-970d7291-21bf-4140-8251-2c0026f839ae tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:21.377602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-970d7291-21bf-4140-8251-2c0026f839ae tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:21.378545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-970d7291-21bf-4140-8251-2c0026f839ae tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:21.380724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-970d7291-21bf-4140-8251-2c0026f839ae tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:21.383852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-970d7291-21bf-4140-8251-2c0026f839ae tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:21.384463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-970d7291-21bf-4140-8251-2c0026f839ae tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:22.066602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-970d7291-21bf-4140-8251-2c0026f839ae tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:22.076395 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-970d7291-21bf-4140-8251-2c0026f839ae tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 200 len: 1767 microversion: 2.1 time: 0.725943 Oct 12 22:37:22.092666 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2793/6227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:21 2022] GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 1767 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:22.549073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-8a01f0ec-1421-472d-97db-c81be3aea846 req-55d77dc8-9d12-405a-b909-9c7ff7e1753d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e50519f9-97da-478d-902c-e33b86c44a38", "name": "network-vif-deleted", "tag": "2b55e3c8-6c7e-4c2a-9c71-e2640252beed"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:22.569519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8a01f0ec-1421-472d-97db-c81be3aea846 req-55d77dc8-9d12-405a-b909-9c7ff7e1753d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:22.570076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8a01f0ec-1421-472d-97db-c81be3aea846 req-55d77dc8-9d12-405a-b909-9c7ff7e1753d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:22.570506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8a01f0ec-1421-472d-97db-c81be3aea846 req-55d77dc8-9d12-405a-b909-9c7ff7e1753d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:22.589736 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-8a01f0ec-1421-472d-97db-c81be3aea846 req-55d77dc8-9d12-405a-b909-9c7ff7e1753d service nova] Creating event network-vif-deleted:2b55e3c8-6c7e-4c2a-9c71-e2640252beed for instance e50519f9-97da-478d-902c-e33b86c44a38 on n-h2-861111-1 Oct 12 22:37:22.605904 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-8a01f0ec-1421-472d-97db-c81be3aea846 req-55d77dc8-9d12-405a-b909-9c7ff7e1753d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060378 Oct 12 22:37:22.606540 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3435/6228] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:23.104592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-829360c9-9c12-4f1c-a174-74a038093d61 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:23.105199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-829360c9-9c12-4f1c-a174-74a038093d61 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:23.117154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-829360c9-9c12-4f1c-a174-74a038093d61 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:23.121670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-829360c9-9c12-4f1c-a174-74a038093d61 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:23.122432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-829360c9-9c12-4f1c-a174-74a038093d61 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:23.123361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-829360c9-9c12-4f1c-a174-74a038093d61 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:23.124096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-829360c9-9c12-4f1c-a174-74a038093d61 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:23.124679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-829360c9-9c12-4f1c-a174-74a038093d61 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:23.196139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-829360c9-9c12-4f1c-a174-74a038093d61 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:23.200326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-829360c9-9c12-4f1c-a174-74a038093d61 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:23.201469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-829360c9-9c12-4f1c-a174-74a038093d61 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:23.202653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-829360c9-9c12-4f1c-a174-74a038093d61 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lazy-loading 'fault' on Instance uuid e50519f9-97da-478d-902c-e33b86c44a38 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:37:23.353737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-829360c9-9c12-4f1c-a174-74a038093d61 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1195be2699414d198bc95d20d4be9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f46e26b725045708751d688a0422950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:23.366184 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-829360c9-9c12-4f1c-a174-74a038093d61 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 200 len: 1383 microversion: 2.1 time: 0.265410 Oct 12 22:37:23.379723 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2794/6229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:23 2022] GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 1383 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:24.398050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9d521435-884d-45ef-afda-863b19fa6bee tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:24.399732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9d521435-884d-45ef-afda-863b19fa6bee tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] [instance: e50519f9-97da-478d-902c-e33b86c44a38] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:24.414233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d521435-884d-45ef-afda-863b19fa6bee tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:24.429974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d521435-884d-45ef-afda-863b19fa6bee tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:24.430458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d521435-884d-45ef-afda-863b19fa6bee tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:24.432472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d521435-884d-45ef-afda-863b19fa6bee tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:24.438541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d521435-884d-45ef-afda-863b19fa6bee tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:24.439195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d521435-884d-45ef-afda-863b19fa6bee tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:24.479594 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-9d521435-884d-45ef-afda-863b19fa6bee tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] HTTP exception thrown: Instance e50519f9-97da-478d-902c-e33b86c44a38 could not be found. Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9d521435-884d-45ef-afda-863b19fa6bee tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Request method failure captured: Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 HTTP/1.1 Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0EFEBODiLeXumH_9M_YTSv4vlLHFXyMOXWvjwXMYoh8cDybT_mA9f4WRLaiEYkSbjuh48gsetbdLdxOO0DyohEzhX5g_vUwfsW1UxGkMjb0h8QYv95ZwXGQ8sGnwM5Nu2CEbEHzJYltVPFFQkEHcEepF2S4jqHkOgfBox7bsNV0GAQ Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 9f46e26b725045708751d688a0422950 Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-296401407 Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f46e26b725045708751d688a0422950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f46e26b725045708751d688a0422950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9f46e26b725045708751d688a0422950", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9f46e26b725045708751d688a0422950"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestSecurityGroupsBasicOps-296401407 Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 9f46e26b725045708751d688a0422950 Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-296401407 Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestSecurityGroupsBasicOps-296401407-project Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 1195be2699414d198bc95d20d4be9c2e Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestSecurityGroupsBasicOps-296401407-project Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance e50519f9-97da-478d-902c-e33b86c44a38 could not be found. Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'e50519f9-97da-478d-902c-e33b86c44a38'} Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e50519f9-97da-478d-902c-e33b86c44a38 could not be found. Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e50519f9-97da-478d-902c-e33b86c44a38 could not be found. Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:24.483168 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:37:24.487334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:24.487334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:24.487334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:24.487334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:24.487334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:24.487334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e50519f9-97da-478d-902c-e33b86c44a38 could not be found. Oct 12 22:37:24.487334 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:37:24.490750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9d521435-884d-45ef-afda-863b19fa6bee tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Returning 404 to user: Instance e50519f9-97da-478d-902c-e33b86c44a38 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:24.493865 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9d521435-884d-45ef-afda-863b19fa6bee tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38" status: 404 len: 111 microversion: 2.1 time: 0.101876 Oct 12 22:37:24.503185 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3436/6230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:24 2022] GET /compute/v2.1/servers/e50519f9-97da-478d-902c-e33b86c44a38 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:37:27.208062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1748338941", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "21a5ed39-6e83-46eb-b07b-44f74dc5f870"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1715989287", "security_groups": [{"name": "tempest-secgroup-smoke-1753512184"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:27.587821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] validate_networks() for [('21a5ed39-6e83-46eb-b07b-44f74dc5f870', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:37:29.723564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:37:29.725717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:37:29.726472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:37:29.727832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:37:29.728937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:37:29.767448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:29.768055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:29.768604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:29.769453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:29.770503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:29.771349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:29.811097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Getting quotas for project aa5cc899bfb3403c9aa9d192833cafa9. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:37:29.827633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Getting quotas for user 2acd162da21348b6acb725bfe572bc00 and project aa5cc899bfb3403c9aa9d192833cafa9. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:37:29.856366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:37:29.860766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:37:29.978880 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0da4e9b6-6739-4855-be40-35ad06a8dcd4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.774549 Oct 12 22:37:29.987415 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2795/6231] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:37:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 2779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:37:29.992899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-be15858a-d1a2-4acc-b4b7-6e3d13c5be56 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:29.994041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-be15858a-d1a2-4acc-b4b7-6e3d13c5be56 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:30.161865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-be15858a-d1a2-4acc-b4b7-6e3d13c5be56 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:30.170598 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-be15858a-d1a2-4acc-b4b7-6e3d13c5be56 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1267 microversion: 2.1 time: 0.181727 Oct 12 22:37:30.171177 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3437/6232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:29 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:31.196541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6ec62c31-2d51-4f65-aa3b-9c52a8931228 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:31.197829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6ec62c31-2d51-4f65-aa3b-9c52a8931228 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:31.214937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ec62c31-2d51-4f65-aa3b-9c52a8931228 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:31.217326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ec62c31-2d51-4f65-aa3b-9c52a8931228 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:31.218258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ec62c31-2d51-4f65-aa3b-9c52a8931228 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:31.222861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ec62c31-2d51-4f65-aa3b-9c52a8931228 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:31.224780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ec62c31-2d51-4f65-aa3b-9c52a8931228 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:31.225419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ec62c31-2d51-4f65-aa3b-9c52a8931228 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:31.529482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6ec62c31-2d51-4f65-aa3b-9c52a8931228 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:31.538124 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6ec62c31-2d51-4f65-aa3b-9c52a8931228 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1319 microversion: 2.1 time: 0.347990 Oct 12 22:37:31.561658 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2796/6233] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:31 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1319 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:32.286663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-be36f738-ac07-4160-be33-db1cab1cf77d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:32.297309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be36f738-ac07-4160-be33-db1cab1cf77d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:32.297801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be36f738-ac07-4160-be33-db1cab1cf77d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:32.298295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be36f738-ac07-4160-be33-db1cab1cf77d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:32.299032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be36f738-ac07-4160-be33-db1cab1cf77d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:32.299514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be36f738-ac07-4160-be33-db1cab1cf77d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:32.300049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be36f738-ac07-4160-be33-db1cab1cf77d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:32.400249 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-be36f738-ac07-4160-be33-db1cab1cf77d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.407480 Oct 12 22:37:32.403415 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3438/6234] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 12 22:37:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:32.563709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b3c53c61-901f-4e77-a8f0-f61fdfeb70dc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:32.564380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b3c53c61-901f-4e77-a8f0-f61fdfeb70dc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:32.582110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3c53c61-901f-4e77-a8f0-f61fdfeb70dc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:32.583698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3c53c61-901f-4e77-a8f0-f61fdfeb70dc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:32.584152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3c53c61-901f-4e77-a8f0-f61fdfeb70dc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:32.591810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3c53c61-901f-4e77-a8f0-f61fdfeb70dc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:32.592863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3c53c61-901f-4e77-a8f0-f61fdfeb70dc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:32.593715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3c53c61-901f-4e77-a8f0-f61fdfeb70dc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:32.698444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-826277779", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "availability_zone": "nova:n-h1-861111-1", "networks": [{"uuid": "6287bf18-b230-48bf-8bfa-8cf5338b6575"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:32.831746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] validate_networks() for [('6287bf18-b230-48bf-8bfa-8cf5338b6575', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:37:32.855088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b3c53c61-901f-4e77-a8f0-f61fdfeb70dc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:32.868894 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b3c53c61-901f-4e77-a8f0-f61fdfeb70dc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1325 microversion: 2.1 time: 0.308550 Oct 12 22:37:32.869781 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2797/6235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:32 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1325 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:33.896458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2e5a22f9-553e-4dad-8efe-53f17c28404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:33.897085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2e5a22f9-553e-4dad-8efe-53f17c28404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:33.914471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e5a22f9-553e-4dad-8efe-53f17c28404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:33.917829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e5a22f9-553e-4dad-8efe-53f17c28404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:33.918600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e5a22f9-553e-4dad-8efe-53f17c28404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:33.919608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e5a22f9-553e-4dad-8efe-53f17c28404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:33.920267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e5a22f9-553e-4dad-8efe-53f17c28404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:33.923929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e5a22f9-553e-4dad-8efe-53f17c28404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:34.119019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2e5a22f9-553e-4dad-8efe-53f17c28404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:34.134619 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2e5a22f9-553e-4dad-8efe-53f17c28404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1325 microversion: 2.1 time: 0.241942 Oct 12 22:37:34.139367 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2798/6236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:33 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1325 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:34.585744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:37:34.586238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:37:34.586628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:37:34.587042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:37:34.587487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:37:34.605401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:34.605923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:34.606370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:34.607403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:34.607869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:34.608355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:34.665356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Getting quotas for project 94ab8d96844048498c739ef7369b6c3d. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:37:34.693414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Getting quotas for user 66752b232187493da723657a671a04d2 and project 94ab8d96844048498c739ef7369b6c3d. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:37:34.743328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:37:34.753925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:37:34.892704 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e1f33cdd-f013-40f0-be9b-7bc350f00593 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.197551 Oct 12 22:37:34.897407 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3439/6237] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:37:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:37:34.906583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ca234329-da1f-4de9-b06e-f8094a74c848 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:34.907469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ca234329-da1f-4de9-b06e-f8094a74c848 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:35.050924 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ca234329-da1f-4de9-b06e-f8094a74c848 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1328 microversion: 2.1 time: 0.148216 Oct 12 22:37:35.054601 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2799/6238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:34 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1328 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:35.166627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cfec0575-dcf1-4733-be1c-e67b2f36fe7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:35.167286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cfec0575-dcf1-4733-be1c-e67b2f36fe7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:35.198177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfec0575-dcf1-4733-be1c-e67b2f36fe7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:35.198889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfec0575-dcf1-4733-be1c-e67b2f36fe7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:35.199810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfec0575-dcf1-4733-be1c-e67b2f36fe7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:35.201036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfec0575-dcf1-4733-be1c-e67b2f36fe7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:35.203356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfec0575-dcf1-4733-be1c-e67b2f36fe7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:35.204041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cfec0575-dcf1-4733-be1c-e67b2f36fe7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:35.561510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cfec0575-dcf1-4733-be1c-e67b2f36fe7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:35.569692 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cfec0575-dcf1-4733-be1c-e67b2f36fe7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1393 microversion: 2.1 time: 0.407238 Oct 12 22:37:35.573813 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3440/6239] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:35 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1393 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:36.080839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-47ab35aa-d7b0-4b1b-a9e0-96400ccccd67 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:36.081670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-47ab35aa-d7b0-4b1b-a9e0-96400ccccd67 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:36.100661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ab35aa-d7b0-4b1b-a9e0-96400ccccd67 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:36.101257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ab35aa-d7b0-4b1b-a9e0-96400ccccd67 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:36.101710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ab35aa-d7b0-4b1b-a9e0-96400ccccd67 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:36.102674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ab35aa-d7b0-4b1b-a9e0-96400ccccd67 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:36.103338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ab35aa-d7b0-4b1b-a9e0-96400ccccd67 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:36.106133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47ab35aa-d7b0-4b1b-a9e0-96400ccccd67 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:36.384554 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-47ab35aa-d7b0-4b1b-a9e0-96400ccccd67 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1337 microversion: 2.1 time: 0.308700 Oct 12 22:37:36.392274 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2800/6240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:36 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1337 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:36.594175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-03e6eabb-b002-4001-b8e0-b670435884ae tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:36.594981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-03e6eabb-b002-4001-b8e0-b670435884ae tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:36.608190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03e6eabb-b002-4001-b8e0-b670435884ae tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:36.609556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03e6eabb-b002-4001-b8e0-b670435884ae tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:36.614834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03e6eabb-b002-4001-b8e0-b670435884ae tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:36.615938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03e6eabb-b002-4001-b8e0-b670435884ae tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:36.616599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03e6eabb-b002-4001-b8e0-b670435884ae tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:36.617231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03e6eabb-b002-4001-b8e0-b670435884ae tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:37.230758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-03e6eabb-b002-4001-b8e0-b670435884ae tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:37.246851 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-03e6eabb-b002-4001-b8e0-b670435884ae tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1393 microversion: 2.1 time: 0.655837 Oct 12 22:37:37.249108 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3441/6241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:36 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1393 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:37.413306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ca5d8b19-c271-4a64-afa7-23e017c26b1b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:37.414635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ca5d8b19-c271-4a64-afa7-23e017c26b1b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:37.428693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca5d8b19-c271-4a64-afa7-23e017c26b1b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:37.432288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca5d8b19-c271-4a64-afa7-23e017c26b1b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:37.433600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca5d8b19-c271-4a64-afa7-23e017c26b1b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:37.434615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca5d8b19-c271-4a64-afa7-23e017c26b1b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:37.441006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca5d8b19-c271-4a64-afa7-23e017c26b1b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:37.442342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca5d8b19-c271-4a64-afa7-23e017c26b1b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:37.718897 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ca5d8b19-c271-4a64-afa7-23e017c26b1b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1421 microversion: 2.1 time: 0.309702 Oct 12 22:37:37.735263 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2801/6242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:37 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1421 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:38.272280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f0620f68-baad-4c88-8d80-f312f9d2f2e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:38.272886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f0620f68-baad-4c88-8d80-f312f9d2f2e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:38.284017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0620f68-baad-4c88-8d80-f312f9d2f2e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:38.289378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0620f68-baad-4c88-8d80-f312f9d2f2e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:38.289884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0620f68-baad-4c88-8d80-f312f9d2f2e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:38.290649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0620f68-baad-4c88-8d80-f312f9d2f2e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:38.291123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0620f68-baad-4c88-8d80-f312f9d2f2e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:38.291853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f0620f68-baad-4c88-8d80-f312f9d2f2e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:38.443916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-b4ab29e1-c247-4415-8f04-6643cd6c99da req-5c56d555-9901-4eab-8a5e-1f8ead6fe46f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "404dff76-7390-487a-91d2-23a68bf291bc", "tag": "239cb6af-7528-4161-ac97-242cd413fbc5"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:38.466255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b4ab29e1-c247-4415-8f04-6643cd6c99da req-5c56d555-9901-4eab-8a5e-1f8ead6fe46f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:38.466852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b4ab29e1-c247-4415-8f04-6643cd6c99da req-5c56d555-9901-4eab-8a5e-1f8ead6fe46f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:38.467329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b4ab29e1-c247-4415-8f04-6643cd6c99da req-5c56d555-9901-4eab-8a5e-1f8ead6fe46f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:38.493764 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-b4ab29e1-c247-4415-8f04-6643cd6c99da req-5c56d555-9901-4eab-8a5e-1f8ead6fe46f service nova] Creating event network-changed:239cb6af-7528-4161-ac97-242cd413fbc5 for instance 404dff76-7390-487a-91d2-23a68bf291bc on n-h2-861111-1 Oct 12 22:37:38.504927 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-b4ab29e1-c247-4415-8f04-6643cd6c99da req-5c56d555-9901-4eab-8a5e-1f8ead6fe46f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064809 Oct 12 22:37:38.505693 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2802/6243] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:37:38.739452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f0620f68-baad-4c88-8d80-f312f9d2f2e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:38.750870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-015920de-8ac7-4b17-a1f1-84134a8e8f5f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:38.751633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-015920de-8ac7-4b17-a1f1-84134a8e8f5f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:38.766889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-015920de-8ac7-4b17-a1f1-84134a8e8f5f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:38.770054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-015920de-8ac7-4b17-a1f1-84134a8e8f5f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:38.772300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-015920de-8ac7-4b17-a1f1-84134a8e8f5f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:38.774679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-015920de-8ac7-4b17-a1f1-84134a8e8f5f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:38.776139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-015920de-8ac7-4b17-a1f1-84134a8e8f5f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:38.777563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-015920de-8ac7-4b17-a1f1-84134a8e8f5f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:38.810740 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f0620f68-baad-4c88-8d80-f312f9d2f2e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1393 microversion: 2.1 time: 0.541124 Oct 12 22:37:38.816484 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3442/6244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:38 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1393 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:39.207124 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-015920de-8ac7-4b17-a1f1-84134a8e8f5f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1463 microversion: 2.1 time: 0.462568 Oct 12 22:37:39.210363 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2803/6245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:38 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1463 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:37:39.595432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1afb762c-681a-48b9-81d3-0b3f100794b9 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] Calling method '.version_select at 0x7f5122b7db80>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:39.642127 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1afb762c-681a-48b9-81d3-0b3f100794b9 tempest-TestSecurityGroupsBasicOps-296401407 tempest-TestSecurityGroupsBasicOps-296401407-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-662679922" status: 202 len: 0 microversion: 2.1 time: 0.051212 Oct 12 22:37:39.644212 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3443/6246] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:37:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-662679922 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:37:39.837301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9b9cfa75-c3f5-4f6d-a01b-9a856551adb8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:39.838644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9b9cfa75-c3f5-4f6d-a01b-9a856551adb8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:39.846739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:39.854766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b9cfa75-c3f5-4f6d-a01b-9a856551adb8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:39.856468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b9cfa75-c3f5-4f6d-a01b-9a856551adb8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:39.856944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b9cfa75-c3f5-4f6d-a01b-9a856551adb8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:39.857965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b9cfa75-c3f5-4f6d-a01b-9a856551adb8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:39.858651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b9cfa75-c3f5-4f6d-a01b-9a856551adb8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:39.859272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b9cfa75-c3f5-4f6d-a01b-9a856551adb8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:40.211516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9b9cfa75-c3f5-4f6d-a01b-9a856551adb8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:40.223854 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9b9cfa75-c3f5-4f6d-a01b-9a856551adb8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1393 microversion: 2.1 time: 0.391916 Oct 12 22:37:40.224985 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2804/6247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:39 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1393 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:40.239514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6e8523f5-1e24-40c0-aa86-327ff4fb69e9 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:40.240146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6e8523f5-1e24-40c0-aa86-327ff4fb69e9 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:40.248879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e8523f5-1e24-40c0-aa86-327ff4fb69e9 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:40.249963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e8523f5-1e24-40c0-aa86-327ff4fb69e9 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:40.256754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e8523f5-1e24-40c0-aa86-327ff4fb69e9 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:40.257641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e8523f5-1e24-40c0-aa86-327ff4fb69e9 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:40.258138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e8523f5-1e24-40c0-aa86-327ff4fb69e9 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:40.258591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6e8523f5-1e24-40c0-aa86-327ff4fb69e9 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:40.687378 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6e8523f5-1e24-40c0-aa86-327ff4fb69e9 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1463 microversion: 2.1 time: 0.452435 Oct 12 22:37:40.688027 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3444/6248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:40 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1463 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:41.251521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ac3e5f2c-1710-4bbb-8890-3fc1ba2c4f18 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:41.253634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ac3e5f2c-1710-4bbb-8890-3fc1ba2c4f18 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:41.274075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3e5f2c-1710-4bbb-8890-3fc1ba2c4f18 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:41.279178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3e5f2c-1710-4bbb-8890-3fc1ba2c4f18 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:41.281717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3e5f2c-1710-4bbb-8890-3fc1ba2c4f18 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:41.283984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3e5f2c-1710-4bbb-8890-3fc1ba2c4f18 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:41.286499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3e5f2c-1710-4bbb-8890-3fc1ba2c4f18 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:41.289257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac3e5f2c-1710-4bbb-8890-3fc1ba2c4f18 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:41.711405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-bf8365fe-6233-48a7-b648-8b56e8033e2c req-cf10c69f-aeba-4703-ae60-c6a3c92df3bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250f6eba-a9cb-431d-bdb9-d52b86cc618e", "tag": "8f79c82c-41c5-46df-8b02-80b2e0b91828"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:41.724231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-bf8365fe-6233-48a7-b648-8b56e8033e2c req-cf10c69f-aeba-4703-ae60-c6a3c92df3bb service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:41.725332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-bf8365fe-6233-48a7-b648-8b56e8033e2c req-cf10c69f-aeba-4703-ae60-c6a3c92df3bb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:41.725630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-bf8365fe-6233-48a7-b648-8b56e8033e2c req-cf10c69f-aeba-4703-ae60-c6a3c92df3bb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:41.740335 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-bf8365fe-6233-48a7-b648-8b56e8033e2c req-cf10c69f-aeba-4703-ae60-c6a3c92df3bb service nova] Creating event network-changed:8f79c82c-41c5-46df-8b02-80b2e0b91828 for instance 250f6eba-a9cb-431d-bdb9-d52b86cc618e on n-h1-861111-1 Oct 12 22:37:41.748648 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-bf8365fe-6233-48a7-b648-8b56e8033e2c req-cf10c69f-aeba-4703-ae60-c6a3c92df3bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041768 Oct 12 22:37:41.749711 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3445/6249] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:41.755759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b044e37b-a95d-4a47-a8c6-1e927cbede44 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:41.756801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b044e37b-a95d-4a47-a8c6-1e927cbede44 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:41.763627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b044e37b-a95d-4a47-a8c6-1e927cbede44 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:41.764421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b044e37b-a95d-4a47-a8c6-1e927cbede44 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:41.765634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b044e37b-a95d-4a47-a8c6-1e927cbede44 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:41.767200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b044e37b-a95d-4a47-a8c6-1e927cbede44 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:41.768238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b044e37b-a95d-4a47-a8c6-1e927cbede44 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:41.768880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b044e37b-a95d-4a47-a8c6-1e927cbede44 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.272050 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b044e37b-a95d-4a47-a8c6-1e927cbede44 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1463 microversion: 2.1 time: 0.520652 Oct 12 22:37:42.287705 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3446/6250] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:41 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1463 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:42.520370 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ac3e5f2c-1710-4bbb-8890-3fc1ba2c4f18 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:42.537551 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ac3e5f2c-1710-4bbb-8890-3fc1ba2c4f18 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1393 microversion: 2.1 time: 1.290457 Oct 12 22:37:42.539699 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2805/6251] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:41 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1393 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:43.306987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e84963a2-1451-4662-951d-f2a7d97ff3d5 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:43.308460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e84963a2-1451-4662-951d-f2a7d97ff3d5 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:43.319542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e84963a2-1451-4662-951d-f2a7d97ff3d5 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.327450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e84963a2-1451-4662-951d-f2a7d97ff3d5 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.328082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e84963a2-1451-4662-951d-f2a7d97ff3d5 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:43.329217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e84963a2-1451-4662-951d-f2a7d97ff3d5 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.329687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e84963a2-1451-4662-951d-f2a7d97ff3d5 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.330125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e84963a2-1451-4662-951d-f2a7d97ff3d5 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:43.562878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f6f061e-0f10-4070-aa76-54a12d0137fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:43.563531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8f6f061e-0f10-4070-aa76-54a12d0137fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:43.583694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f6f061e-0f10-4070-aa76-54a12d0137fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.584484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f6f061e-0f10-4070-aa76-54a12d0137fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.586817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f6f061e-0f10-4070-aa76-54a12d0137fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:43.587745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f6f061e-0f10-4070-aa76-54a12d0137fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.589539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f6f061e-0f10-4070-aa76-54a12d0137fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.590017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f6f061e-0f10-4070-aa76-54a12d0137fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:44.125645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f6f061e-0f10-4070-aa76-54a12d0137fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:44.146540 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f6f061e-0f10-4070-aa76-54a12d0137fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1393 microversion: 2.1 time: 0.587375 Oct 12 22:37:44.147931 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2806/6252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:43 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1393 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:44.209903 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e84963a2-1451-4662-951d-f2a7d97ff3d5 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1463 microversion: 2.1 time: 0.911360 Oct 12 22:37:44.232404 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3447/6253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:43 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1463 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:45.175690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-afb6fbf0-4a12-439e-98c5-206312500c0a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:45.176379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-afb6fbf0-4a12-439e-98c5-206312500c0a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:45.181315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:45.196511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afb6fbf0-4a12-439e-98c5-206312500c0a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:45.198412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afb6fbf0-4a12-439e-98c5-206312500c0a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:45.199860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afb6fbf0-4a12-439e-98c5-206312500c0a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:45.200793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afb6fbf0-4a12-439e-98c5-206312500c0a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:45.203040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afb6fbf0-4a12-439e-98c5-206312500c0a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:45.205394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afb6fbf0-4a12-439e-98c5-206312500c0a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:45.234370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cd62dd17-c184-4e9f-b4a5-75b815267b4e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:45.235200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cd62dd17-c184-4e9f-b4a5-75b815267b4e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:45.245189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:45.247188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=8 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:45.249974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd62dd17-c184-4e9f-b4a5-75b815267b4e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:45.253061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd62dd17-c184-4e9f-b4a5-75b815267b4e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:45.256402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd62dd17-c184-4e9f-b4a5-75b815267b4e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:45.259540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd62dd17-c184-4e9f-b4a5-75b815267b4e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:45.260263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd62dd17-c184-4e9f-b4a5-75b815267b4e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:45.262772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd62dd17-c184-4e9f-b4a5-75b815267b4e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:45.761984 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cd62dd17-c184-4e9f-b4a5-75b815267b4e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1463 microversion: 2.1 time: 0.526740 Oct 12 22:37:45.772180 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3448/6254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:45 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1463 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:46.616523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-afb6fbf0-4a12-439e-98c5-206312500c0a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:46.625968 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-afb6fbf0-4a12-439e-98c5-206312500c0a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1393 microversion: 2.1 time: 1.459540 Oct 12 22:37:46.626753 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2807/6255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:45 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1393 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:46.792436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-78ff7798-7c10-475a-afdf-63d4c487479d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:46.794218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-78ff7798-7c10-475a-afdf-63d4c487479d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:46.813838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78ff7798-7c10-475a-afdf-63d4c487479d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:46.814567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78ff7798-7c10-475a-afdf-63d4c487479d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:46.815061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78ff7798-7c10-475a-afdf-63d4c487479d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:46.816207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78ff7798-7c10-475a-afdf-63d4c487479d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:46.819802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78ff7798-7c10-475a-afdf-63d4c487479d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:46.821040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78ff7798-7c10-475a-afdf-63d4c487479d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:47.650462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ef203682-196c-46f2-81a9-4bf3fa96329d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:47.671933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ef203682-196c-46f2-81a9-4bf3fa96329d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:47.695667 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-78ff7798-7c10-475a-afdf-63d4c487479d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1463 microversion: 2.1 time: 0.910678 Oct 12 22:37:47.700692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef203682-196c-46f2-81a9-4bf3fa96329d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:47.702577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef203682-196c-46f2-81a9-4bf3fa96329d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:47.703753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef203682-196c-46f2-81a9-4bf3fa96329d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:47.705397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef203682-196c-46f2-81a9-4bf3fa96329d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:47.713757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef203682-196c-46f2-81a9-4bf3fa96329d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:47.714146 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3449/6256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:46 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1463 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:47.714975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef203682-196c-46f2-81a9-4bf3fa96329d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:47.976903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-9cfdedf3-82f3-4a12-aaeb-f73e4012da3c req-943a3de0-b271-4f1a-9592-284ef423290c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404dff76-7390-487a-91d2-23a68bf291bc", "name": "network-vif-plugged", "status": "completed", "tag": "239cb6af-7528-4161-ac97-242cd413fbc5"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:48.001453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9cfdedf3-82f3-4a12-aaeb-f73e4012da3c req-943a3de0-b271-4f1a-9592-284ef423290c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:48.003083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9cfdedf3-82f3-4a12-aaeb-f73e4012da3c req-943a3de0-b271-4f1a-9592-284ef423290c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:48.003547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9cfdedf3-82f3-4a12-aaeb-f73e4012da3c req-943a3de0-b271-4f1a-9592-284ef423290c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:48.038499 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-9cfdedf3-82f3-4a12-aaeb-f73e4012da3c req-943a3de0-b271-4f1a-9592-284ef423290c service nova] Creating event network-vif-plugged:239cb6af-7528-4161-ac97-242cd413fbc5 for instance 404dff76-7390-487a-91d2-23a68bf291bc on n-h2-861111-1 Oct 12 22:37:48.054933 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-9cfdedf3-82f3-4a12-aaeb-f73e4012da3c req-943a3de0-b271-4f1a-9592-284ef423290c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081141 Oct 12 22:37:48.056213 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3450/6257] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:37:48.407926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ef203682-196c-46f2-81a9-4bf3fa96329d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:48.417664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:48.425278 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ef203682-196c-46f2-81a9-4bf3fa96329d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1393 microversion: 2.1 time: 0.777832 Oct 12 22:37:48.426344 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2808/6258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:47 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1393 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:48.742124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-507909f9-42f6-451a-b8f3-da0a80613b7c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:48.746535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-507909f9-42f6-451a-b8f3-da0a80613b7c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:48.784261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-507909f9-42f6-451a-b8f3-da0a80613b7c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:48.785957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-507909f9-42f6-451a-b8f3-da0a80613b7c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:48.787186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-507909f9-42f6-451a-b8f3-da0a80613b7c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:48.788179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-507909f9-42f6-451a-b8f3-da0a80613b7c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:48.788824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-507909f9-42f6-451a-b8f3-da0a80613b7c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:48.789471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-507909f9-42f6-451a-b8f3-da0a80613b7c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:49.015387 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-507909f9-42f6-451a-b8f3-da0a80613b7c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1463 microversion: 2.1 time: 0.290405 Oct 12 22:37:49.017273 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3451/6259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:48 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1463 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:49.453738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-957ef8d9-8cca-4fd0-90fc-9dd505bf07ba tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:49.454354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-957ef8d9-8cca-4fd0-90fc-9dd505bf07ba tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:49.469501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-957ef8d9-8cca-4fd0-90fc-9dd505bf07ba tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:49.469995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-957ef8d9-8cca-4fd0-90fc-9dd505bf07ba tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:49.470434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-957ef8d9-8cca-4fd0-90fc-9dd505bf07ba tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:49.471150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-957ef8d9-8cca-4fd0-90fc-9dd505bf07ba tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:49.471627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-957ef8d9-8cca-4fd0-90fc-9dd505bf07ba tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:49.472338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-957ef8d9-8cca-4fd0-90fc-9dd505bf07ba tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:49.905978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-957ef8d9-8cca-4fd0-90fc-9dd505bf07ba tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:49.918252 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-957ef8d9-8cca-4fd0-90fc-9dd505bf07ba tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1393 microversion: 2.1 time: 0.469124 Oct 12 22:37:49.918995 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2809/6260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:49 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1393 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:50.041135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0a729525-87f3-4232-bc85-31529450b36d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:50.042377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0a729525-87f3-4232-bc85-31529450b36d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:50.074689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:50.080677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a729525-87f3-4232-bc85-31529450b36d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:50.084793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a729525-87f3-4232-bc85-31529450b36d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:50.086089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a729525-87f3-4232-bc85-31529450b36d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:50.087868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a729525-87f3-4232-bc85-31529450b36d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:50.088649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a729525-87f3-4232-bc85-31529450b36d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:50.089414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a729525-87f3-4232-bc85-31529450b36d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:50.101505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=75 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:50.725729 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0a729525-87f3-4232-bc85-31529450b36d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1463 microversion: 2.1 time: 0.689566 Oct 12 22:37:50.727561 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3452/6261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:50 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1463 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:50.944670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d0188dce-0ac4-4e8b-a2e4-9b47a6841e48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:50.945288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d0188dce-0ac4-4e8b-a2e4-9b47a6841e48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:50.951771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:50.953651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0188dce-0ac4-4e8b-a2e4-9b47a6841e48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:50.954354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0188dce-0ac4-4e8b-a2e4-9b47a6841e48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:50.954956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0188dce-0ac4-4e8b-a2e4-9b47a6841e48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:50.955857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0188dce-0ac4-4e8b-a2e4-9b47a6841e48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:50.956584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0188dce-0ac4-4e8b-a2e4-9b47a6841e48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:50.957370 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0188dce-0ac4-4e8b-a2e4-9b47a6841e48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:51.494843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d0188dce-0ac4-4e8b-a2e4-9b47a6841e48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:51.504184 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d0188dce-0ac4-4e8b-a2e4-9b47a6841e48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1565 microversion: 2.1 time: 0.563676 Oct 12 22:37:51.511342 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2810/6262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:50 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1565 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:51.535094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0025cfca-34d9-43d1-bbf0-db442b30f6fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:51.535747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0025cfca-34d9-43d1-bbf0-db442b30f6fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:51.549792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0025cfca-34d9-43d1-bbf0-db442b30f6fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:51.551432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0025cfca-34d9-43d1-bbf0-db442b30f6fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:51.551904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0025cfca-34d9-43d1-bbf0-db442b30f6fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:51.552660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0025cfca-34d9-43d1-bbf0-db442b30f6fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:51.555284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0025cfca-34d9-43d1-bbf0-db442b30f6fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:51.555933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0025cfca-34d9-43d1-bbf0-db442b30f6fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:51.754423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b8ef991-0d01-4e68-92c5-34c08ed8c375 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:51.755295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6b8ef991-0d01-4e68-92c5-34c08ed8c375 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:51.768149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b8ef991-0d01-4e68-92c5-34c08ed8c375 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:51.769807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b8ef991-0d01-4e68-92c5-34c08ed8c375 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:51.786491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b8ef991-0d01-4e68-92c5-34c08ed8c375 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:51.788747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b8ef991-0d01-4e68-92c5-34c08ed8c375 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:51.790882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b8ef991-0d01-4e68-92c5-34c08ed8c375 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:51.791713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b8ef991-0d01-4e68-92c5-34c08ed8c375 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:51.844236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0025cfca-34d9-43d1-bbf0-db442b30f6fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:51.856157 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0025cfca-34d9-43d1-bbf0-db442b30f6fe tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1565 microversion: 2.1 time: 0.324970 Oct 12 22:37:51.885936 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3453/6263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:51 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1565 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:52.368803 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6b8ef991-0d01-4e68-92c5-34c08ed8c375 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1463 microversion: 2.1 time: 0.621477 Oct 12 22:37:52.371031 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2811/6264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:51 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1463 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:52.610006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-00effda5-7451-40c4-ad40-3e2d3dfb0f4c req-b8738092-b302-4478-9f43-5ae2ed20f4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250f6eba-a9cb-431d-bdb9-d52b86cc618e", "name": "network-vif-plugged", "status": "completed", "tag": "8f79c82c-41c5-46df-8b02-80b2e0b91828"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:52.630322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-00effda5-7451-40c4-ad40-3e2d3dfb0f4c req-b8738092-b302-4478-9f43-5ae2ed20f4b8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:52.631494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-00effda5-7451-40c4-ad40-3e2d3dfb0f4c req-b8738092-b302-4478-9f43-5ae2ed20f4b8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:52.632345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-00effda5-7451-40c4-ad40-3e2d3dfb0f4c req-b8738092-b302-4478-9f43-5ae2ed20f4b8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:52.648134 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-00effda5-7451-40c4-ad40-3e2d3dfb0f4c req-b8738092-b302-4478-9f43-5ae2ed20f4b8 service nova] Creating event network-vif-plugged:8f79c82c-41c5-46df-8b02-80b2e0b91828 for instance 250f6eba-a9cb-431d-bdb9-d52b86cc618e on n-h1-861111-1 Oct 12 22:37:52.654641 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-00effda5-7451-40c4-ad40-3e2d3dfb0f4c req-b8738092-b302-4478-9f43-5ae2ed20f4b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047947 Oct 12 22:37:52.656885 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3454/6265] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:53.395657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c5e6e062-fcc6-45de-8504-0f7590824f12 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:53.397277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c5e6e062-fcc6-45de-8504-0f7590824f12 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:53.434703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5e6e062-fcc6-45de-8504-0f7590824f12 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:53.435205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5e6e062-fcc6-45de-8504-0f7590824f12 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:53.435683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5e6e062-fcc6-45de-8504-0f7590824f12 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:53.436998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5e6e062-fcc6-45de-8504-0f7590824f12 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:53.437483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5e6e062-fcc6-45de-8504-0f7590824f12 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:53.437943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5e6e062-fcc6-45de-8504-0f7590824f12 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:54.027003 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c5e6e062-fcc6-45de-8504-0f7590824f12 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1463 microversion: 2.1 time: 0.636234 Oct 12 22:37:54.032129 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2812/6266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:53 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1463 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:55.059453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-34f1b1a2-4f1e-4e00-bdab-448c327ca6cc tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:55.060971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-34f1b1a2-4f1e-4e00-bdab-448c327ca6cc tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:55.075123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34f1b1a2-4f1e-4e00-bdab-448c327ca6cc tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:55.076012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34f1b1a2-4f1e-4e00-bdab-448c327ca6cc tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:55.078948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34f1b1a2-4f1e-4e00-bdab-448c327ca6cc tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:55.089566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34f1b1a2-4f1e-4e00-bdab-448c327ca6cc tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:55.090415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34f1b1a2-4f1e-4e00-bdab-448c327ca6cc tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:55.091117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-34f1b1a2-4f1e-4e00-bdab-448c327ca6cc tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:55.408704 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-34f1b1a2-4f1e-4e00-bdab-448c327ca6cc tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1648 microversion: 2.1 time: 0.354319 Oct 12 22:37:55.411008 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3455/6267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:55 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1648 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:55.432160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-66ce62ca-80bc-46db-be97-4c24121f08f3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:55.432793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-66ce62ca-80bc-46db-be97-4c24121f08f3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:55.442265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66ce62ca-80bc-46db-be97-4c24121f08f3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:55.442765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66ce62ca-80bc-46db-be97-4c24121f08f3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:55.443201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66ce62ca-80bc-46db-be97-4c24121f08f3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:55.443962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66ce62ca-80bc-46db-be97-4c24121f08f3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:55.444423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66ce62ca-80bc-46db-be97-4c24121f08f3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:55.444852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66ce62ca-80bc-46db-be97-4c24121f08f3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:56.249010 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-66ce62ca-80bc-46db-be97-4c24121f08f3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1648 microversion: 2.1 time: 0.820780 Oct 12 22:37:56.255832 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2813/6268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:55 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1648 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:56.272008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2d94efeb-712e-41c4-bac7-eb5af8f41874 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:56.273183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2d94efeb-712e-41c4-bac7-eb5af8f41874 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:56.284474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d94efeb-712e-41c4-bac7-eb5af8f41874 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:56.285607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d94efeb-712e-41c4-bac7-eb5af8f41874 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:56.286269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d94efeb-712e-41c4-bac7-eb5af8f41874 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:56.287190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d94efeb-712e-41c4-bac7-eb5af8f41874 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:56.287675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d94efeb-712e-41c4-bac7-eb5af8f41874 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:56.288290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d94efeb-712e-41c4-bac7-eb5af8f41874 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:57.010036 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2d94efeb-712e-41c4-bac7-eb5af8f41874 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1648 microversion: 2.1 time: 0.742363 Oct 12 22:37:57.017508 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3456/6269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:56 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1648 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:57.162305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-995924402", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "availability_zone": "nova:n-h2-861111-1", "networks": [{"uuid": "6287bf18-b230-48bf-8bfa-8cf5338b6575"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:57.292460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] validate_networks() for [('6287bf18-b230-48bf-8bfa-8cf5338b6575', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:37:58.570972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4fd4e9e0-5f38-47c6-9943-2bb79e1f2107 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:58.571837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4fd4e9e0-5f38-47c6-9943-2bb79e1f2107 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:58.590245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4fd4e9e0-5f38-47c6-9943-2bb79e1f2107 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:58.590970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4fd4e9e0-5f38-47c6-9943-2bb79e1f2107 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:58.593593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4fd4e9e0-5f38-47c6-9943-2bb79e1f2107 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:58.594680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4fd4e9e0-5f38-47c6-9943-2bb79e1f2107 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:58.596292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4fd4e9e0-5f38-47c6-9943-2bb79e1f2107 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:58.597050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4fd4e9e0-5f38-47c6-9943-2bb79e1f2107 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:58.943049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4fd4e9e0-5f38-47c6-9943-2bb79e1f2107 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:58.973137 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4fd4e9e0-5f38-47c6-9943-2bb79e1f2107 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1565 microversion: 2.1 time: 0.405857 Oct 12 22:37:58.973861 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3457/6270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:58 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1565 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:37:58.996373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-37376a71-b990-4dab-9eea-e2cc6d042388 req-255136c0-cb11-4d9b-bb94-9fb8db1e61b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "404dff76-7390-487a-91d2-23a68bf291bc", "tag": "239cb6af-7528-4161-ac97-242cd413fbc5"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:59.029499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-37376a71-b990-4dab-9eea-e2cc6d042388 req-255136c0-cb11-4d9b-bb94-9fb8db1e61b6 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:59.032694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-37376a71-b990-4dab-9eea-e2cc6d042388 req-255136c0-cb11-4d9b-bb94-9fb8db1e61b6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:59.033597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-37376a71-b990-4dab-9eea-e2cc6d042388 req-255136c0-cb11-4d9b-bb94-9fb8db1e61b6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:59.075093 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-37376a71-b990-4dab-9eea-e2cc6d042388 req-255136c0-cb11-4d9b-bb94-9fb8db1e61b6 service nova] Creating event network-changed:239cb6af-7528-4161-ac97-242cd413fbc5 for instance 404dff76-7390-487a-91d2-23a68bf291bc on n-h2-861111-1 Oct 12 22:37:59.092048 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-37376a71-b990-4dab-9eea-e2cc6d042388 req-255136c0-cb11-4d9b-bb94-9fb8db1e61b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112441 Oct 12 22:37:59.093692 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3458/6271] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:59.112438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:37:59.113497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:37:59.114141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:37:59.114714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:37:59.115332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:37:59.127530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:59.128307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:59.128906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:59.129804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:59.130653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:59.131476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:59.160944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Getting quotas for project 94ab8d96844048498c739ef7369b6c3d. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:37:59.168295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Getting quotas for user 66752b232187493da723657a671a04d2 and project 94ab8d96844048498c739ef7369b6c3d. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:37:59.186598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:37:59.190592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:37:59.280926 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-629442db-e6e2-4fd2-849e-d4754e82ca92 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.122539 Oct 12 22:37:59.282470 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2814/6272] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:37:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:37:59.294789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7d00a071-03f3-4ba2-a8b3-7ad3e839e7ea tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:59.296079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7d00a071-03f3-4ba2-a8b3-7ad3e839e7ea tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:59.456862 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7d00a071-03f3-4ba2-a8b3-7ad3e839e7ea tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 200 len: 1328 microversion: 2.1 time: 0.167386 Oct 12 22:37:59.463616 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3459/6273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:59 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 1328 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:00.485470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2db9cf6f-22b2-48da-89a3-5da00a46f0a3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:00.486918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2db9cf6f-22b2-48da-89a3-5da00a46f0a3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:00.498757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2db9cf6f-22b2-48da-89a3-5da00a46f0a3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:00.504227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2db9cf6f-22b2-48da-89a3-5da00a46f0a3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:00.507335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2db9cf6f-22b2-48da-89a3-5da00a46f0a3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:00.508284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2db9cf6f-22b2-48da-89a3-5da00a46f0a3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:00.508909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2db9cf6f-22b2-48da-89a3-5da00a46f0a3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:00.511935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2db9cf6f-22b2-48da-89a3-5da00a46f0a3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:00.984300 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2db9cf6f-22b2-48da-89a3-5da00a46f0a3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 200 len: 1345 microversion: 2.1 time: 0.487003 Oct 12 22:38:00.985581 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2815/6274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:00 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 1345 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:02.016979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-06ffe289-8cea-4b90-bcf6-5827530b52e4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:02.018359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-06ffe289-8cea-4b90-bcf6-5827530b52e4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:02.034926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06ffe289-8cea-4b90-bcf6-5827530b52e4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:02.038624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06ffe289-8cea-4b90-bcf6-5827530b52e4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:02.042342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06ffe289-8cea-4b90-bcf6-5827530b52e4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:02.043332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06ffe289-8cea-4b90-bcf6-5827530b52e4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:02.043987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06ffe289-8cea-4b90-bcf6-5827530b52e4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:02.044575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-06ffe289-8cea-4b90-bcf6-5827530b52e4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:02.282751 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-06ffe289-8cea-4b90-bcf6-5827530b52e4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 200 len: 1421 microversion: 2.1 time: 0.271173 Oct 12 22:38:02.283437 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3460/6275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:02 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 1421 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:03.308626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-717a5878-27ae-44c0-b6d2-7520019bfcd3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:03.309245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-717a5878-27ae-44c0-b6d2-7520019bfcd3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:03.318060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-717a5878-27ae-44c0-b6d2-7520019bfcd3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:03.322220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-717a5878-27ae-44c0-b6d2-7520019bfcd3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:03.322678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-717a5878-27ae-44c0-b6d2-7520019bfcd3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:03.323466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-717a5878-27ae-44c0-b6d2-7520019bfcd3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:03.324190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-717a5878-27ae-44c0-b6d2-7520019bfcd3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:03.324605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-717a5878-27ae-44c0-b6d2-7520019bfcd3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:03.540128 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-717a5878-27ae-44c0-b6d2-7520019bfcd3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 200 len: 1421 microversion: 2.1 time: 0.236107 Oct 12 22:38:03.540721 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2816/6276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:03 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 1421 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:04.566304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-123e8370-685a-4cb3-b25e-7b76a21a502d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:04.567420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-123e8370-685a-4cb3-b25e-7b76a21a502d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:04.581078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-123e8370-685a-4cb3-b25e-7b76a21a502d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:04.582492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-123e8370-685a-4cb3-b25e-7b76a21a502d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:04.583186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-123e8370-685a-4cb3-b25e-7b76a21a502d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:04.584697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-123e8370-685a-4cb3-b25e-7b76a21a502d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:04.585556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-123e8370-685a-4cb3-b25e-7b76a21a502d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:04.586338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-123e8370-685a-4cb3-b25e-7b76a21a502d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:04.902549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1bcb0fa3-b356-4f0a-bec7-94ffa63044b9 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Action: 'create', calling method: .version_select at 0x7f5122c23d30>, body: {"keypair": {"name": "tempest-TestServerBasicOps-636203393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONKx16HWUX+RFMuXdRh5uumEKKcAUOnri1kODk+f1WhehxG8i5eM+sH2irwjlZMpyA6Vul/cmMJIMxLPIex9Un1Nhox4uUeEOPYRaMU0dRVih59bN4KWTi2NI6dKy4Rcg=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:04.936857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-1bcb0fa3-b356-4f0a-bec7-94ffa63044b9 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Getting quotas for project a5331169dc284a98be1b4c9801f9d24f. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:38:04.950598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-1bcb0fa3-b356-4f0a-bec7-94ffa63044b9 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Getting quotas for user 5affeb55a85f49409606c84e4de040a7 and project a5331169dc284a98be1b4c9801f9d24f. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:38:04.995274 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-123e8370-685a-4cb3-b25e-7b76a21a502d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 200 len: 1463 microversion: 2.1 time: 0.436177 Oct 12 22:38:04.996245 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2817/6277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:04 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 1463 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:05.022480 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1bcb0fa3-b356-4f0a-bec7-94ffa63044b9 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.754418 Oct 12 22:38:05.023297 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3461/6278] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:38:04 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:05.695750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-3b975996-7cd9-4341-bc63-985ea8fb9117 req-d9137505-7307-41fa-ac3b-c06bc78161f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b854dc8-8ec0-43a1-8adf-1f380637015d", "tag": "e157e0fe-47df-4901-9faa-c004586fcec6"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:05.723965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3b975996-7cd9-4341-bc63-985ea8fb9117 req-d9137505-7307-41fa-ac3b-c06bc78161f0 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:05.724973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3b975996-7cd9-4341-bc63-985ea8fb9117 req-d9137505-7307-41fa-ac3b-c06bc78161f0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:05.725982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3b975996-7cd9-4341-bc63-985ea8fb9117 req-d9137505-7307-41fa-ac3b-c06bc78161f0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:05.749654 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-3b975996-7cd9-4341-bc63-985ea8fb9117 req-d9137505-7307-41fa-ac3b-c06bc78161f0 service nova] Creating event network-changed:e157e0fe-47df-4901-9faa-c004586fcec6 for instance 7b854dc8-8ec0-43a1-8adf-1f380637015d on n-h2-861111-1 Oct 12 22:38:05.776574 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-3b975996-7cd9-4341-bc63-985ea8fb9117 req-d9137505-7307-41fa-ac3b-c06bc78161f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091148 Oct 12 22:38:05.777746 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2818/6279] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:06.023641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-03e9fafd-1440-43d2-b1fd-81a57a28db8b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:06.024522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-03e9fafd-1440-43d2-b1fd-81a57a28db8b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:06.036899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03e9fafd-1440-43d2-b1fd-81a57a28db8b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:06.037554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03e9fafd-1440-43d2-b1fd-81a57a28db8b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:06.039808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03e9fafd-1440-43d2-b1fd-81a57a28db8b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:06.040692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03e9fafd-1440-43d2-b1fd-81a57a28db8b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:06.041907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03e9fafd-1440-43d2-b1fd-81a57a28db8b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:06.044262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-03e9fafd-1440-43d2-b1fd-81a57a28db8b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:06.315178 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-03e9fafd-1440-43d2-b1fd-81a57a28db8b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 200 len: 1463 microversion: 2.1 time: 0.300324 Oct 12 22:38:06.324406 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3462/6280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:06 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 1463 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:06.831499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-30342524", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-636203393", "security_groups": [{"name": "tempest-secgroup-smoke-655221346"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "ed7a5385-c5cb-45f0-b791-8d80c970f3e5"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:06.977339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] validate_networks() for [('ed7a5385-c5cb-45f0-b791-8d80c970f3e5', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:38:07.342856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f35a6aa2-77a1-421d-a02a-815402656f58 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:07.343518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f35a6aa2-77a1-421d-a02a-815402656f58 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:07.352762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f35a6aa2-77a1-421d-a02a-815402656f58 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:07.353968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f35a6aa2-77a1-421d-a02a-815402656f58 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:07.354612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f35a6aa2-77a1-421d-a02a-815402656f58 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:07.356175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f35a6aa2-77a1-421d-a02a-815402656f58 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:07.357436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f35a6aa2-77a1-421d-a02a-815402656f58 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:07.358081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f35a6aa2-77a1-421d-a02a-815402656f58 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:07.584766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Getting quotas for project a5331169dc284a98be1b4c9801f9d24f. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:38:07.589051 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f35a6aa2-77a1-421d-a02a-815402656f58 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 200 len: 1463 microversion: 2.1 time: 0.250876 Oct 12 22:38:07.589646 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3463/6281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:07 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 1463 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:07.599539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Getting quotas for user 5affeb55a85f49409606c84e4de040a7 and project a5331169dc284a98be1b4c9801f9d24f. Resources: dict_keys(['metadata_items']) {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:38:07.615146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:38:07.615778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:38:07.616063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:38:07.616468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:38:07.616878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:38:07.629832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:07.630490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:07.631295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:07.632331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:07.632870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:07.633476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:07.653849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Getting quotas for project a5331169dc284a98be1b4c9801f9d24f. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:38:07.660002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Getting quotas for user 5affeb55a85f49409606c84e4de040a7 and project a5331169dc284a98be1b4c9801f9d24f. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:38:07.674036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:38:07.677173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:38:07.727614 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7f2c5a60-8880-4f8a-b49d-d08d4619e32d tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.900914 Oct 12 22:38:07.734851 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2819/6282] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:38:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:38:07.743656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-34df2b50-1faf-4b1a-9fac-2e344b76be7c tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:07.744279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-34df2b50-1faf-4b1a-9fac-2e344b76be7c tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:07.811775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-34df2b50-1faf-4b1a-9fac-2e344b76be7c tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5affeb55a85f49409606c84e4de040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5331169dc284a98be1b4c9801f9d24f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:07.824457 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-34df2b50-1faf-4b1a-9fac-2e344b76be7c tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 200 len: 1300 microversion: 2.1 time: 0.087933 Oct 12 22:38:07.840925 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3464/6283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:07 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 1300 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:08.621491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-de61446f-6bb1-436f-b2ae-87f6f150e464 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:08.625354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-de61446f-6bb1-436f-b2ae-87f6f150e464 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:08.666392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de61446f-6bb1-436f-b2ae-87f6f150e464 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:08.667199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de61446f-6bb1-436f-b2ae-87f6f150e464 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:08.668132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de61446f-6bb1-436f-b2ae-87f6f150e464 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:08.670585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de61446f-6bb1-436f-b2ae-87f6f150e464 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:08.671669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de61446f-6bb1-436f-b2ae-87f6f150e464 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:08.672326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de61446f-6bb1-436f-b2ae-87f6f150e464 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:08.848843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f63a0940-9df3-4685-8172-968b07e196bd tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:08.850162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f63a0940-9df3-4685-8172-968b07e196bd tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:08.859390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f63a0940-9df3-4685-8172-968b07e196bd tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:08.860124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f63a0940-9df3-4685-8172-968b07e196bd tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:08.860644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f63a0940-9df3-4685-8172-968b07e196bd tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:08.861443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f63a0940-9df3-4685-8172-968b07e196bd tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:08.861983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f63a0940-9df3-4685-8172-968b07e196bd tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:08.862490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f63a0940-9df3-4685-8172-968b07e196bd tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:08.979591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f63a0940-9df3-4685-8172-968b07e196bd tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5affeb55a85f49409606c84e4de040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5331169dc284a98be1b4c9801f9d24f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:08.989693 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f63a0940-9df3-4685-8172-968b07e196bd tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 200 len: 1352 microversion: 2.1 time: 0.145299 Oct 12 22:38:08.990457 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3465/6284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:08 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 1352 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:09.081891 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-de61446f-6bb1-436f-b2ae-87f6f150e464 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 200 len: 1463 microversion: 2.1 time: 0.469268 Oct 12 22:38:09.083166 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2820/6285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:08 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 1463 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:10.015193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6a8adb06-c465-4ed6-95e2-e95265416b02 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:10.017070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6a8adb06-c465-4ed6-95e2-e95265416b02 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:10.027207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a8adb06-c465-4ed6-95e2-e95265416b02 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:10.028006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a8adb06-c465-4ed6-95e2-e95265416b02 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:10.028460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a8adb06-c465-4ed6-95e2-e95265416b02 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:10.029231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a8adb06-c465-4ed6-95e2-e95265416b02 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:10.029697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a8adb06-c465-4ed6-95e2-e95265416b02 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:10.030578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a8adb06-c465-4ed6-95e2-e95265416b02 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:10.133480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cc8022eb-43b0-4a28-a62b-f986cb7f4b77 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:10.134736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cc8022eb-43b0-4a28-a62b-f986cb7f4b77 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:10.154293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc8022eb-43b0-4a28-a62b-f986cb7f4b77 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:10.157034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc8022eb-43b0-4a28-a62b-f986cb7f4b77 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:10.157827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc8022eb-43b0-4a28-a62b-f986cb7f4b77 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:10.160133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc8022eb-43b0-4a28-a62b-f986cb7f4b77 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:10.161138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc8022eb-43b0-4a28-a62b-f986cb7f4b77 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:10.164015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc8022eb-43b0-4a28-a62b-f986cb7f4b77 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:10.212317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6a8adb06-c465-4ed6-95e2-e95265416b02 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5affeb55a85f49409606c84e4de040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5331169dc284a98be1b4c9801f9d24f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:10.220174 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6a8adb06-c465-4ed6-95e2-e95265416b02 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 200 len: 1358 microversion: 2.1 time: 0.210337 Oct 12 22:38:10.221094 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3466/6286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:10 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:10.359277 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 22:38:10.359745 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 22:38:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d (ip 10.222.0.16) !!! Oct 12 22:38:10.540545 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cc8022eb-43b0-4a28-a62b-f986cb7f4b77 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 200 len: 1463 microversion: 2.1 time: 0.429934 Oct 12 22:38:10.550435 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2821/6287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:10 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 1463 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:11.105015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-818b2914-f970-4399-8fea-8af44db8c71c req-0e1c8b3e-0992-4ded-ace8-10c8a8310e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b854dc8-8ec0-43a1-8adf-1f380637015d", "name": "network-vif-plugged", "status": "completed", "tag": "e157e0fe-47df-4901-9faa-c004586fcec6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:11.119218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-818b2914-f970-4399-8fea-8af44db8c71c req-0e1c8b3e-0992-4ded-ace8-10c8a8310e86 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:11.119729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-818b2914-f970-4399-8fea-8af44db8c71c req-0e1c8b3e-0992-4ded-ace8-10c8a8310e86 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:11.120169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-818b2914-f970-4399-8fea-8af44db8c71c req-0e1c8b3e-0992-4ded-ace8-10c8a8310e86 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:11.154909 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-818b2914-f970-4399-8fea-8af44db8c71c req-0e1c8b3e-0992-4ded-ace8-10c8a8310e86 service nova] Creating event network-vif-plugged:e157e0fe-47df-4901-9faa-c004586fcec6 for instance 7b854dc8-8ec0-43a1-8adf-1f380637015d on n-h2-861111-1 Oct 12 22:38:11.168298 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-818b2914-f970-4399-8fea-8af44db8c71c req-0e1c8b3e-0992-4ded-ace8-10c8a8310e86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068677 Oct 12 22:38:11.210773 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3467/6288] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:11.251328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c8e115bd-f79e-4028-b65b-60a883bb9a80 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:11.251945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c8e115bd-f79e-4028-b65b-60a883bb9a80 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:11.261196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8e115bd-f79e-4028-b65b-60a883bb9a80 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:11.261965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8e115bd-f79e-4028-b65b-60a883bb9a80 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:11.262381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8e115bd-f79e-4028-b65b-60a883bb9a80 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:11.264610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8e115bd-f79e-4028-b65b-60a883bb9a80 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:11.265317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8e115bd-f79e-4028-b65b-60a883bb9a80 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:11.265970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8e115bd-f79e-4028-b65b-60a883bb9a80 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:11.568596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-53e5a721-4288-42ed-b878-586d9978f80d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:11.569665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-53e5a721-4288-42ed-b878-586d9978f80d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:11.577270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53e5a721-4288-42ed-b878-586d9978f80d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:11.577967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53e5a721-4288-42ed-b878-586d9978f80d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:11.578524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53e5a721-4288-42ed-b878-586d9978f80d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:11.579365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53e5a721-4288-42ed-b878-586d9978f80d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:11.579945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53e5a721-4288-42ed-b878-586d9978f80d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:11.584452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53e5a721-4288-42ed-b878-586d9978f80d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:11.639969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c8e115bd-f79e-4028-b65b-60a883bb9a80 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5affeb55a85f49409606c84e4de040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5331169dc284a98be1b4c9801f9d24f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:11.664876 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c8e115bd-f79e-4028-b65b-60a883bb9a80 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 200 len: 1425 microversion: 2.1 time: 0.418931 Oct 12 22:38:11.680539 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2822/6289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:11 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 1425 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:11.714697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-43f3eecd-930d-493c-8ce9-f77d4bd5f1ba req-9dc539e4-780a-4aa1-9aab-72583fb9fd49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa", "tag": "a445749d-e1fb-4cf4-a4e9-29d2afd930ce"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:11.728315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-43f3eecd-930d-493c-8ce9-f77d4bd5f1ba req-9dc539e4-780a-4aa1-9aab-72583fb9fd49 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:11.728797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-43f3eecd-930d-493c-8ce9-f77d4bd5f1ba req-9dc539e4-780a-4aa1-9aab-72583fb9fd49 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:11.730004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-43f3eecd-930d-493c-8ce9-f77d4bd5f1ba req-9dc539e4-780a-4aa1-9aab-72583fb9fd49 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:11.744386 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-43f3eecd-930d-493c-8ce9-f77d4bd5f1ba req-9dc539e4-780a-4aa1-9aab-72583fb9fd49 service nova] Creating event network-changed:a445749d-e1fb-4cf4-a4e9-29d2afd930ce for instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa on n-h1-861111-1 Oct 12 22:38:11.750415 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-43f3eecd-930d-493c-8ce9-f77d4bd5f1ba req-9dc539e4-780a-4aa1-9aab-72583fb9fd49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040331 Oct 12 22:38:11.751612 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2823/6290] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:11.798077 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-53e5a721-4288-42ed-b878-586d9978f80d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 200 len: 1463 microversion: 2.1 time: 0.235376 Oct 12 22:38:11.798750 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3468/6291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:11 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 1463 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:12.693434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-00501c24-5595-4033-b5f1-573e7b9a86cb tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:12.694151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-00501c24-5595-4033-b5f1-573e7b9a86cb tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:12.700649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00501c24-5595-4033-b5f1-573e7b9a86cb tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:12.701790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00501c24-5595-4033-b5f1-573e7b9a86cb tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:12.702548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00501c24-5595-4033-b5f1-573e7b9a86cb tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:12.703273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00501c24-5595-4033-b5f1-573e7b9a86cb tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:12.703734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00501c24-5595-4033-b5f1-573e7b9a86cb tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:12.704167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00501c24-5595-4033-b5f1-573e7b9a86cb tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:12.823610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fd9ef05d-4149-4841-a89b-3d91d64d7ee6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:12.824741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fd9ef05d-4149-4841-a89b-3d91d64d7ee6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:12.833063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd9ef05d-4149-4841-a89b-3d91d64d7ee6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:12.833846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd9ef05d-4149-4841-a89b-3d91d64d7ee6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:12.834477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd9ef05d-4149-4841-a89b-3d91d64d7ee6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:12.835453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd9ef05d-4149-4841-a89b-3d91d64d7ee6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:12.836118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd9ef05d-4149-4841-a89b-3d91d64d7ee6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:12.836515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd9ef05d-4149-4841-a89b-3d91d64d7ee6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:12.846243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-00501c24-5595-4033-b5f1-573e7b9a86cb tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5affeb55a85f49409606c84e4de040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5331169dc284a98be1b4c9801f9d24f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:12.857317 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-00501c24-5595-4033-b5f1-573e7b9a86cb tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 200 len: 1425 microversion: 2.1 time: 0.168610 Oct 12 22:38:12.859180 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2824/6292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:12 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 1425 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:12.979427 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fd9ef05d-4149-4841-a89b-3d91d64d7ee6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 200 len: 1463 microversion: 2.1 time: 0.160899 Oct 12 22:38:12.980670 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3469/6293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:12 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 1463 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:13.881715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3185aa1c-05be-4355-896c-562861c22327 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:13.882330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3185aa1c-05be-4355-896c-562861c22327 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:13.888888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3185aa1c-05be-4355-896c-562861c22327 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:13.889687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3185aa1c-05be-4355-896c-562861c22327 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:13.890281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3185aa1c-05be-4355-896c-562861c22327 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:13.891118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3185aa1c-05be-4355-896c-562861c22327 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:13.891861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3185aa1c-05be-4355-896c-562861c22327 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:13.892435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3185aa1c-05be-4355-896c-562861c22327 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:14.004778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c3b8b5df-fef8-4b4b-bfff-37d45418b2cb tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:14.006047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c3b8b5df-fef8-4b4b-bfff-37d45418b2cb tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:14.013701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3b8b5df-fef8-4b4b-bfff-37d45418b2cb tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:14.014454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3b8b5df-fef8-4b4b-bfff-37d45418b2cb tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:14.015986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3b8b5df-fef8-4b4b-bfff-37d45418b2cb tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:14.016918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3b8b5df-fef8-4b4b-bfff-37d45418b2cb tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:14.017554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3b8b5df-fef8-4b4b-bfff-37d45418b2cb tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:14.018155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c3b8b5df-fef8-4b4b-bfff-37d45418b2cb tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:14.225122 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c3b8b5df-fef8-4b4b-bfff-37d45418b2cb tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 200 len: 1647 microversion: 2.1 time: 0.224086 Oct 12 22:38:14.226942 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3470/6294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:13 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 1647 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:14.249046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-721a7ae8-f29d-4ce4-8d52-d79a6a92d67d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:14.250240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-721a7ae8-f29d-4ce4-8d52-d79a6a92d67d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:14.257265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-721a7ae8-f29d-4ce4-8d52-d79a6a92d67d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:14.258089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-721a7ae8-f29d-4ce4-8d52-d79a6a92d67d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:14.258690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-721a7ae8-f29d-4ce4-8d52-d79a6a92d67d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:14.259751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-721a7ae8-f29d-4ce4-8d52-d79a6a92d67d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:14.260638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-721a7ae8-f29d-4ce4-8d52-d79a6a92d67d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:14.261241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-721a7ae8-f29d-4ce4-8d52-d79a6a92d67d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:14.379158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3185aa1c-05be-4355-896c-562861c22327 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5affeb55a85f49409606c84e4de040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5331169dc284a98be1b4c9801f9d24f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:14.386993 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3185aa1c-05be-4355-896c-562861c22327 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 200 len: 1425 microversion: 2.1 time: 0.509461 Oct 12 22:38:14.403901 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2825/6295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:13 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 1425 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:14.422218 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-721a7ae8-f29d-4ce4-8d52-d79a6a92d67d tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 200 len: 1647 microversion: 2.1 time: 0.176996 Oct 12 22:38:14.422939 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3471/6296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:14 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 1647 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:14.444294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ead3522c-65f5-4623-aecb-5de4439cb7f2 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:14.444908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ead3522c-65f5-4623-aecb-5de4439cb7f2 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:14.451213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ead3522c-65f5-4623-aecb-5de4439cb7f2 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:14.451722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ead3522c-65f5-4623-aecb-5de4439cb7f2 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:14.452151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ead3522c-65f5-4623-aecb-5de4439cb7f2 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:14.452843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ead3522c-65f5-4623-aecb-5de4439cb7f2 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:14.453289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ead3522c-65f5-4623-aecb-5de4439cb7f2 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:14.453707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ead3522c-65f5-4623-aecb-5de4439cb7f2 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:14.616121 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ead3522c-65f5-4623-aecb-5de4439cb7f2 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 200 len: 1647 microversion: 2.1 time: 0.175421 Oct 12 22:38:14.616701 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2826/6297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:14 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 1647 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:14.639045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-56c7e5db-fa40-4ffc-b196-b92f1e3b943b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:14.639629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-56c7e5db-fa40-4ffc-b196-b92f1e3b943b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:14.646213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56c7e5db-fa40-4ffc-b196-b92f1e3b943b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:14.646709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56c7e5db-fa40-4ffc-b196-b92f1e3b943b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:14.647148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56c7e5db-fa40-4ffc-b196-b92f1e3b943b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:14.647918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56c7e5db-fa40-4ffc-b196-b92f1e3b943b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:14.648377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56c7e5db-fa40-4ffc-b196-b92f1e3b943b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:14.648807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56c7e5db-fa40-4ffc-b196-b92f1e3b943b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:14.678062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-56c7e5db-fa40-4ffc-b196-b92f1e3b943b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:38:14.717386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:14.766297 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-56c7e5db-fa40-4ffc-b196-b92f1e3b943b tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 204 len: 0 microversion: 2.1 time: 0.131295 Oct 12 22:38:14.766994 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3472/6298] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:38:14 2022] DELETE /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:38:14.776047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-40cf0755-4192-4a45-a21d-bbac411d7d98 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:14.776743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-40cf0755-4192-4a45-a21d-bbac411d7d98 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:14.789372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40cf0755-4192-4a45-a21d-bbac411d7d98 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:14.789907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40cf0755-4192-4a45-a21d-bbac411d7d98 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:14.790346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40cf0755-4192-4a45-a21d-bbac411d7d98 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:14.791052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40cf0755-4192-4a45-a21d-bbac411d7d98 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:14.791549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40cf0755-4192-4a45-a21d-bbac411d7d98 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:14.792007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40cf0755-4192-4a45-a21d-bbac411d7d98 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:14.939122 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-40cf0755-4192-4a45-a21d-bbac411d7d98 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 200 len: 1653 microversion: 2.1 time: 0.167584 Oct 12 22:38:14.946144 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2827/6299] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:14 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 1653 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:15.412122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8ffe685f-93a9-4174-8120-37b50b49fc6c tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:15.413314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8ffe685f-93a9-4174-8120-37b50b49fc6c tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:15.422361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ffe685f-93a9-4174-8120-37b50b49fc6c tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:15.423061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ffe685f-93a9-4174-8120-37b50b49fc6c tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:15.423317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ffe685f-93a9-4174-8120-37b50b49fc6c tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:15.425019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ffe685f-93a9-4174-8120-37b50b49fc6c tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:15.425892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ffe685f-93a9-4174-8120-37b50b49fc6c tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:15.426477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ffe685f-93a9-4174-8120-37b50b49fc6c tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:15.635549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8ffe685f-93a9-4174-8120-37b50b49fc6c tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5affeb55a85f49409606c84e4de040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5331169dc284a98be1b4c9801f9d24f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:15.643809 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8ffe685f-93a9-4174-8120-37b50b49fc6c tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 200 len: 1425 microversion: 2.1 time: 0.237165 Oct 12 22:38:15.645003 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3473/6300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:15 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 1425 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:15.962290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2945b317-89f3-4282-87e6-e6b8888099b8 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:15.963677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2945b317-89f3-4282-87e6-e6b8888099b8 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:15.972495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2945b317-89f3-4282-87e6-e6b8888099b8 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:15.975888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2945b317-89f3-4282-87e6-e6b8888099b8 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:15.976505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2945b317-89f3-4282-87e6-e6b8888099b8 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:15.978396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2945b317-89f3-4282-87e6-e6b8888099b8 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:15.981402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2945b317-89f3-4282-87e6-e6b8888099b8 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:15.982548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2945b317-89f3-4282-87e6-e6b8888099b8 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:15.987756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:16.192012 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2945b317-89f3-4282-87e6-e6b8888099b8 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 200 len: 1653 microversion: 2.1 time: 0.233742 Oct 12 22:38:16.192654 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2828/6301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:15 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 1653 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:16.668166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5b5a2b72-c24d-4091-a6a3-5c802d831da1 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:16.668733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5b5a2b72-c24d-4091-a6a3-5c802d831da1 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:16.700407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5a2b72-c24d-4091-a6a3-5c802d831da1 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:16.704014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5a2b72-c24d-4091-a6a3-5c802d831da1 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:16.705369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5a2b72-c24d-4091-a6a3-5c802d831da1 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:16.708488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5a2b72-c24d-4091-a6a3-5c802d831da1 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:16.711024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5a2b72-c24d-4091-a6a3-5c802d831da1 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:16.714828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5a2b72-c24d-4091-a6a3-5c802d831da1 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:16.906635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-cba658e0-6530-4fe3-9a4f-282e42ec2396 req-97c3ea0b-6e1e-4d3e-bebb-5832a68bb373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b854dc8-8ec0-43a1-8adf-1f380637015d", "name": "network-vif-deleted", "tag": "e157e0fe-47df-4901-9faa-c004586fcec6"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:16.941947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-cba658e0-6530-4fe3-9a4f-282e42ec2396 req-97c3ea0b-6e1e-4d3e-bebb-5832a68bb373 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:16.944246 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-cba658e0-6530-4fe3-9a4f-282e42ec2396 req-97c3ea0b-6e1e-4d3e-bebb-5832a68bb373 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:16.944936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-cba658e0-6530-4fe3-9a4f-282e42ec2396 req-97c3ea0b-6e1e-4d3e-bebb-5832a68bb373 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:16.972437 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-cba658e0-6530-4fe3-9a4f-282e42ec2396 req-97c3ea0b-6e1e-4d3e-bebb-5832a68bb373 service nova] Creating event network-vif-deleted:e157e0fe-47df-4901-9faa-c004586fcec6 for instance 7b854dc8-8ec0-43a1-8adf-1f380637015d on n-h2-861111-1 Oct 12 22:38:16.981105 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-cba658e0-6530-4fe3-9a4f-282e42ec2396 req-97c3ea0b-6e1e-4d3e-bebb-5832a68bb373 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095321 Oct 12 22:38:16.981769 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2829/6302] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:38:17.056396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5b5a2b72-c24d-4091-a6a3-5c802d831da1 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5affeb55a85f49409606c84e4de040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5331169dc284a98be1b4c9801f9d24f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:17.069216 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5b5a2b72-c24d-4091-a6a3-5c802d831da1 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 200 len: 1425 microversion: 2.1 time: 0.405445 Oct 12 22:38:17.082615 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3474/6303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:16 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 1425 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:17.222375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-869d63bd-c1d9-4bff-bd76-ef132661ecd4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:17.223388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-869d63bd-c1d9-4bff-bd76-ef132661ecd4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:17.235101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-869d63bd-c1d9-4bff-bd76-ef132661ecd4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:17.235865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-869d63bd-c1d9-4bff-bd76-ef132661ecd4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:17.236536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-869d63bd-c1d9-4bff-bd76-ef132661ecd4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:17.237440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-869d63bd-c1d9-4bff-bd76-ef132661ecd4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:17.244047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-869d63bd-c1d9-4bff-bd76-ef132661ecd4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:17.244797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-869d63bd-c1d9-4bff-bd76-ef132661ecd4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:17.311531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-869d63bd-c1d9-4bff-bd76-ef132661ecd4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:17.313585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-869d63bd-c1d9-4bff-bd76-ef132661ecd4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:17.314069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-869d63bd-c1d9-4bff-bd76-ef132661ecd4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:17.314535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-869d63bd-c1d9-4bff-bd76-ef132661ecd4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lazy-loading 'fault' on Instance uuid 7b854dc8-8ec0-43a1-8adf-1f380637015d {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:38:17.413005 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-869d63bd-c1d9-4bff-bd76-ef132661ecd4 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 200 len: 1453 microversion: 2.1 time: 0.194821 Oct 12 22:38:17.424609 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2830/6304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:17 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 1453 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:18.067831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-35deb8a5-8fcb-4b0d-b92a-2a9960b35918 req-ab985404-c35f-4d60-af1c-3e144c74e26e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa", "name": "network-vif-plugged", "status": "completed", "tag": "a445749d-e1fb-4cf4-a4e9-29d2afd930ce"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:18.086009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=8 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:18.094505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-35deb8a5-8fcb-4b0d-b92a-2a9960b35918 req-ab985404-c35f-4d60-af1c-3e144c74e26e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:18.095329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-35deb8a5-8fcb-4b0d-b92a-2a9960b35918 req-ab985404-c35f-4d60-af1c-3e144c74e26e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:18.095957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-35deb8a5-8fcb-4b0d-b92a-2a9960b35918 req-ab985404-c35f-4d60-af1c-3e144c74e26e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:18.112598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83186a06-36e2-418b-bc4d-5841d9829195 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:18.113231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-83186a06-36e2-418b-bc4d-5841d9829195 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:18.114368 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-35deb8a5-8fcb-4b0d-b92a-2a9960b35918 req-ab985404-c35f-4d60-af1c-3e144c74e26e service nova] Creating event network-vif-plugged:a445749d-e1fb-4cf4-a4e9-29d2afd930ce for instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa on n-h1-861111-1 Oct 12 22:38:18.120429 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-35deb8a5-8fcb-4b0d-b92a-2a9960b35918 req-ab985404-c35f-4d60-af1c-3e144c74e26e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063866 Oct 12 22:38:18.121654 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3475/6305] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:18.125225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:18.128567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=16 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:18.167052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83186a06-36e2-418b-bc4d-5841d9829195 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:18.171106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83186a06-36e2-418b-bc4d-5841d9829195 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:18.172032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83186a06-36e2-418b-bc4d-5841d9829195 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:18.172875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83186a06-36e2-418b-bc4d-5841d9829195 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:18.174385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83186a06-36e2-418b-bc4d-5841d9829195 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:18.174846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83186a06-36e2-418b-bc4d-5841d9829195 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:18.384495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-83186a06-36e2-418b-bc4d-5841d9829195 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5affeb55a85f49409606c84e4de040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5331169dc284a98be1b4c9801f9d24f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:18.394223 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-83186a06-36e2-418b-bc4d-5841d9829195 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 200 len: 1425 microversion: 2.1 time: 0.288004 Oct 12 22:38:18.394987 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2831/6306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:18 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 1425 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:18.438483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4d6b95ad-b116-4f55-9cfb-ac4f598adeb3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:18.439213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4d6b95ad-b116-4f55-9cfb-ac4f598adeb3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 7b854dc8-8ec0-43a1-8adf-1f380637015d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:18.445772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d6b95ad-b116-4f55-9cfb-ac4f598adeb3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:18.446333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d6b95ad-b116-4f55-9cfb-ac4f598adeb3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:18.446862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d6b95ad-b116-4f55-9cfb-ac4f598adeb3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:18.447672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d6b95ad-b116-4f55-9cfb-ac4f598adeb3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:18.448340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d6b95ad-b116-4f55-9cfb-ac4f598adeb3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:18.449098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d6b95ad-b116-4f55-9cfb-ac4f598adeb3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:18.464356 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-4d6b95ad-b116-4f55-9cfb-ac4f598adeb3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] HTTP exception thrown: Instance 7b854dc8-8ec0-43a1-8adf-1f380637015d could not be found. Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4d6b95ad-b116-4f55-9cfb-ac4f598adeb3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Request method failure captured: Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d HTTP/1.1 Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0GrIwxkoYbXCRHCOLPMFEvhSBYcQCKi00PO0qFNEiUVYuiAmRWxEAoUjUlz--U3GIAzRCv65q5Q2NrMvqXWw-kfX7gecIZ8Uj5IFP9Z184tlmf_CXijM9hfGaNIPmftGuQv1TVTaUfrt_-yUKrhCJvyFGH6WUYEiP2_tpGnlfb1CQY Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 94ab8d96844048498c739ef7369b6c3d Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestServerMultinode-1972651083 Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94ab8d96844048498c739ef7369b6c3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94ab8d96844048498c739ef7369b6c3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94ab8d96844048498c739ef7369b6c3d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94ab8d96844048498c739ef7369b6c3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestServerMultinode-1972651083 Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 94ab8d96844048498c739ef7369b6c3d Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestServerMultinode-1972651083 Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestServerMultinode-1972651083-project-admin Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 66752b232187493da723657a671a04d2 Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestServerMultinode-1972651083-project-admin Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 7b854dc8-8ec0-43a1-8adf-1f380637015d could not be found. Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '7b854dc8-8ec0-43a1-8adf-1f380637015d'} Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b854dc8-8ec0-43a1-8adf-1f380637015d could not be found. Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b854dc8-8ec0-43a1-8adf-1f380637015d could not be found. Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:38:18.466892 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:38:18.471765 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:18.471765 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:38:18.471765 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:38:18.471765 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:38:18.471765 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:38:18.471765 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b854dc8-8ec0-43a1-8adf-1f380637015d could not be found. Oct 12 22:38:18.471765 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:38:18.471765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4d6b95ad-b116-4f55-9cfb-ac4f598adeb3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Returning 404 to user: Instance 7b854dc8-8ec0-43a1-8adf-1f380637015d could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:38:18.471765 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4d6b95ad-b116-4f55-9cfb-ac4f598adeb3 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d" status: 404 len: 111 microversion: 2.1 time: 0.035539 Oct 12 22:38:18.474920 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3476/6307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:18 2022] GET /compute/v2.1/servers/7b854dc8-8ec0-43a1-8adf-1f380637015d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:38:18.480456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9c0146e3-ae33-46b8-b661-148e521c7f2c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:18.481123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9c0146e3-ae33-46b8-b661-148e521c7f2c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:18.487741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c0146e3-ae33-46b8-b661-148e521c7f2c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:18.488420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c0146e3-ae33-46b8-b661-148e521c7f2c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:18.489017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c0146e3-ae33-46b8-b661-148e521c7f2c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:18.490030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c0146e3-ae33-46b8-b661-148e521c7f2c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:18.490647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c0146e3-ae33-46b8-b661-148e521c7f2c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:18.491231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c0146e3-ae33-46b8-b661-148e521c7f2c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:18.518366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9c0146e3-ae33-46b8-b661-148e521c7f2c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:38:18.600942 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9c0146e3-ae33-46b8-b661-148e521c7f2c tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 204 len: 0 microversion: 2.1 time: 0.124364 Oct 12 22:38:18.602432 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2832/6308] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:38:18 2022] DELETE /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:38:18.612114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-974039b8-5ae4-4755-b1ad-23abb6b510c6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:18.612986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-974039b8-5ae4-4755-b1ad-23abb6b510c6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:18.620929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-974039b8-5ae4-4755-b1ad-23abb6b510c6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:18.621425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-974039b8-5ae4-4755-b1ad-23abb6b510c6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:18.622180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-974039b8-5ae4-4755-b1ad-23abb6b510c6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:18.623774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-974039b8-5ae4-4755-b1ad-23abb6b510c6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:18.624440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-974039b8-5ae4-4755-b1ad-23abb6b510c6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:18.625061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-974039b8-5ae4-4755-b1ad-23abb6b510c6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:18.800824 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-974039b8-5ae4-4755-b1ad-23abb6b510c6 tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1654 microversion: 2.1 time: 0.194188 Oct 12 22:38:18.802246 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3477/6309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:18 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1654 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:19.418524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83ffa0d0-1670-4dd9-a00e-6cca110c1c38 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:19.419232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-83ffa0d0-1670-4dd9-a00e-6cca110c1c38 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:19.426737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83ffa0d0-1670-4dd9-a00e-6cca110c1c38 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:19.426737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83ffa0d0-1670-4dd9-a00e-6cca110c1c38 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:19.427155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83ffa0d0-1670-4dd9-a00e-6cca110c1c38 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:19.427879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83ffa0d0-1670-4dd9-a00e-6cca110c1c38 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:19.428328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83ffa0d0-1670-4dd9-a00e-6cca110c1c38 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:19.428750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83ffa0d0-1670-4dd9-a00e-6cca110c1c38 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:19.581113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-83ffa0d0-1670-4dd9-a00e-6cca110c1c38 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5affeb55a85f49409606c84e4de040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5331169dc284a98be1b4c9801f9d24f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:19.595878 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-83ffa0d0-1670-4dd9-a00e-6cca110c1c38 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 200 len: 1425 microversion: 2.1 time: 0.181405 Oct 12 22:38:19.596638 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2833/6310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:19 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 1425 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:19.829972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-975ba0f7-8d04-4706-8ae8-25f124b9b59f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:19.830628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-975ba0f7-8d04-4706-8ae8-25f124b9b59f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:19.837537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-975ba0f7-8d04-4706-8ae8-25f124b9b59f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:19.838027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-975ba0f7-8d04-4706-8ae8-25f124b9b59f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:19.838469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-975ba0f7-8d04-4706-8ae8-25f124b9b59f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:19.839167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-975ba0f7-8d04-4706-8ae8-25f124b9b59f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:19.839649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-975ba0f7-8d04-4706-8ae8-25f124b9b59f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:19.840081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-975ba0f7-8d04-4706-8ae8-25f124b9b59f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:20.002727 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-975ba0f7-8d04-4706-8ae8-25f124b9b59f tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1654 microversion: 2.1 time: 0.176094 Oct 12 22:38:20.007727 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3478/6311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:19 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1654 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:20.620244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ee9c7745-1fce-4234-8119-db06e8064de0 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:20.621029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ee9c7745-1fce-4234-8119-db06e8064de0 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:20.628465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee9c7745-1fce-4234-8119-db06e8064de0 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:20.629817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee9c7745-1fce-4234-8119-db06e8064de0 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:20.634014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee9c7745-1fce-4234-8119-db06e8064de0 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:20.638185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee9c7745-1fce-4234-8119-db06e8064de0 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:20.638824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee9c7745-1fce-4234-8119-db06e8064de0 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:20.639476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee9c7745-1fce-4234-8119-db06e8064de0 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:20.876418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ee9c7745-1fce-4234-8119-db06e8064de0 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5affeb55a85f49409606c84e4de040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5331169dc284a98be1b4c9801f9d24f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:20.886062 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ee9c7745-1fce-4234-8119-db06e8064de0 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 200 len: 1606 microversion: 2.1 time: 0.269678 Oct 12 22:38:20.887162 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2834/6312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:20 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 1606 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:20.911116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cc6a06f5-2eca-4ca1-b04e-3bd3ca113882 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:20.912465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cc6a06f5-2eca-4ca1-b04e-3bd3ca113882 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:20.924061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:20.926014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc6a06f5-2eca-4ca1-b04e-3bd3ca113882 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:20.926745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc6a06f5-2eca-4ca1-b04e-3bd3ca113882 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:20.927431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc6a06f5-2eca-4ca1-b04e-3bd3ca113882 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:20.928350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc6a06f5-2eca-4ca1-b04e-3bd3ca113882 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:20.928968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc6a06f5-2eca-4ca1-b04e-3bd3ca113882 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:20.929570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc6a06f5-2eca-4ca1-b04e-3bd3ca113882 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:21.045361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c768623e-6d77-42f3-bc82-1a016814499e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:21.046173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c768623e-6d77-42f3-bc82-1a016814499e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:21.049550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:21.059328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c768623e-6d77-42f3-bc82-1a016814499e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:21.060990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c768623e-6d77-42f3-bc82-1a016814499e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:21.067782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c768623e-6d77-42f3-bc82-1a016814499e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:21.068563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c768623e-6d77-42f3-bc82-1a016814499e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:21.069037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c768623e-6d77-42f3-bc82-1a016814499e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:21.069474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c768623e-6d77-42f3-bc82-1a016814499e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:21.277752 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c768623e-6d77-42f3-bc82-1a016814499e tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 200 len: 1612 microversion: 2.1 time: 0.237243 Oct 12 22:38:21.280529 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2835/6313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:21 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 1612 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:21.286181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-0861f7bc-743d-4f5d-b15b-3b482de9a9ed req-25a37687-b8c6-4534-8636-7779c5bb955e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250f6eba-a9cb-431d-bdb9-d52b86cc618e", "name": "network-vif-deleted", "tag": "8f79c82c-41c5-46df-8b02-80b2e0b91828"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:21.298525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0861f7bc-743d-4f5d-b15b-3b482de9a9ed req-25a37687-b8c6-4534-8636-7779c5bb955e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:21.299286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0861f7bc-743d-4f5d-b15b-3b482de9a9ed req-25a37687-b8c6-4534-8636-7779c5bb955e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:21.299955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0861f7bc-743d-4f5d-b15b-3b482de9a9ed req-25a37687-b8c6-4534-8636-7779c5bb955e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:21.330600 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-0861f7bc-743d-4f5d-b15b-3b482de9a9ed req-25a37687-b8c6-4534-8636-7779c5bb955e service nova] Creating event network-vif-deleted:8f79c82c-41c5-46df-8b02-80b2e0b91828 for instance 250f6eba-a9cb-431d-bdb9-d52b86cc618e on n-h1-861111-1 Oct 12 22:38:21.351271 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-0861f7bc-743d-4f5d-b15b-3b482de9a9ed req-25a37687-b8c6-4534-8636-7779c5bb955e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068844 Oct 12 22:38:21.357373 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2836/6314] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:21.516356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cc6a06f5-2eca-4ca1-b04e-3bd3ca113882 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5affeb55a85f49409606c84e4de040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5331169dc284a98be1b4c9801f9d24f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:21.526318 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cc6a06f5-2eca-4ca1-b04e-3bd3ca113882 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 200 len: 1606 microversion: 2.1 time: 0.619684 Oct 12 22:38:21.527649 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3479/6315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:20 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 1606 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:21.570464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd95f6fb-0c44-4eb4-b5e3-e760d7347007 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:21.573343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cd95f6fb-0c44-4eb4-b5e3-e760d7347007 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:21.597076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd95f6fb-0c44-4eb4-b5e3-e760d7347007 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:21.597908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd95f6fb-0c44-4eb4-b5e3-e760d7347007 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:21.599731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd95f6fb-0c44-4eb4-b5e3-e760d7347007 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:21.601549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd95f6fb-0c44-4eb4-b5e3-e760d7347007 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:21.603286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd95f6fb-0c44-4eb4-b5e3-e760d7347007 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:21.603954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd95f6fb-0c44-4eb4-b5e3-e760d7347007 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:21.758101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cd95f6fb-0c44-4eb4-b5e3-e760d7347007 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5affeb55a85f49409606c84e4de040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5331169dc284a98be1b4c9801f9d24f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:21.767602 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cd95f6fb-0c44-4eb4-b5e3-e760d7347007 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 200 len: 1606 microversion: 2.1 time: 0.219373 Oct 12 22:38:21.768717 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2837/6316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:21 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 1606 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:22.319192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4c798bda-71dd-4974-ac79-1a9e21917d7a tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:22.320654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4c798bda-71dd-4974-ac79-1a9e21917d7a tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] [instance: 250f6eba-a9cb-431d-bdb9-d52b86cc618e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:22.347877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c798bda-71dd-4974-ac79-1a9e21917d7a tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:22.347877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c798bda-71dd-4974-ac79-1a9e21917d7a tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:22.347877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c798bda-71dd-4974-ac79-1a9e21917d7a tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:22.347877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c798bda-71dd-4974-ac79-1a9e21917d7a tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:22.347877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c798bda-71dd-4974-ac79-1a9e21917d7a tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:22.347877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c798bda-71dd-4974-ac79-1a9e21917d7a tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:22.363632 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-4c798bda-71dd-4974-ac79-1a9e21917d7a tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] HTTP exception thrown: Instance 250f6eba-a9cb-431d-bdb9-d52b86cc618e could not be found. Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4c798bda-71dd-4974-ac79-1a9e21917d7a tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Request method failure captured: Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e HTTP/1.1 Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0GrIwxkoYbXCRHCOLPMFEvhSBYcQCKi00PO0qFNEiUVYuiAmRWxEAoUjUlz--U3GIAzRCv65q5Q2NrMvqXWw-kfX7gecIZ8Uj5IFP9Z184tlmf_CXijM9hfGaNIPmftGuQv1TVTaUfrt_-yUKrhCJvyFGH6WUYEiP2_tpGnlfb1CQY Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 94ab8d96844048498c739ef7369b6c3d Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestServerMultinode-1972651083 Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94ab8d96844048498c739ef7369b6c3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94ab8d96844048498c739ef7369b6c3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94ab8d96844048498c739ef7369b6c3d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94ab8d96844048498c739ef7369b6c3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestServerMultinode-1972651083 Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 94ab8d96844048498c739ef7369b6c3d Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestServerMultinode-1972651083 Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestServerMultinode-1972651083-project-admin Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 66752b232187493da723657a671a04d2 Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestServerMultinode-1972651083-project-admin Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 250f6eba-a9cb-431d-bdb9-d52b86cc618e could not be found. Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '250f6eba-a9cb-431d-bdb9-d52b86cc618e'} Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 250f6eba-a9cb-431d-bdb9-d52b86cc618e could not be found. Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 250f6eba-a9cb-431d-bdb9-d52b86cc618e could not be found. Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:38:22.365221 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:38:22.369797 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:22.369797 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:38:22.369797 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:38:22.369797 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:38:22.369797 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:38:22.369797 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 250f6eba-a9cb-431d-bdb9-d52b86cc618e could not be found. Oct 12 22:38:22.369797 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:38:22.369797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4c798bda-71dd-4974-ac79-1a9e21917d7a tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] Returning 404 to user: Instance 250f6eba-a9cb-431d-bdb9-d52b86cc618e could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:38:22.369797 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4c798bda-71dd-4974-ac79-1a9e21917d7a tempest-TestServerMultinode-1972651083 tempest-TestServerMultinode-1972651083-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e" status: 404 len: 111 microversion: 2.1 time: 0.051430 Oct 12 22:38:22.369797 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3480/6317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:22 2022] GET /compute/v2.1/servers/250f6eba-a9cb-431d-bdb9-d52b86cc618e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:38:24.475929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bd90e89e-e674-4b6c-9419-6dfab64a0cf8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:24.479985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bd90e89e-e674-4b6c-9419-6dfab64a0cf8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:24.488723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd90e89e-e674-4b6c-9419-6dfab64a0cf8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:24.489860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd90e89e-e674-4b6c-9419-6dfab64a0cf8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:24.490678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd90e89e-e674-4b6c-9419-6dfab64a0cf8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:24.491797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd90e89e-e674-4b6c-9419-6dfab64a0cf8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:24.492492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd90e89e-e674-4b6c-9419-6dfab64a0cf8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:24.493142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd90e89e-e674-4b6c-9419-6dfab64a0cf8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:24.564648 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bd90e89e-e674-4b6c-9419-6dfab64a0cf8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc/action" status: 200 len: 24568 microversion: 2.1 time: 0.098755 Oct 12 22:38:24.571285 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2838/6318] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:38:24 2022] POST /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc/action => generated 24568 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:38:25.352603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-987423ab-76e4-4134-be6e-67c9d557f7b3 req-8b4d1b30-64f4-4880-9b91-ef5ecbc57f0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa", "tag": "a445749d-e1fb-4cf4-a4e9-29d2afd930ce"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:25.375600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-987423ab-76e4-4134-be6e-67c9d557f7b3 req-8b4d1b30-64f4-4880-9b91-ef5ecbc57f0e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:25.376356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-987423ab-76e4-4134-be6e-67c9d557f7b3 req-8b4d1b30-64f4-4880-9b91-ef5ecbc57f0e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:25.376967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-987423ab-76e4-4134-be6e-67c9d557f7b3 req-8b4d1b30-64f4-4880-9b91-ef5ecbc57f0e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:25.401834 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-987423ab-76e4-4134-be6e-67c9d557f7b3 req-8b4d1b30-64f4-4880-9b91-ef5ecbc57f0e service nova] Creating event network-changed:a445749d-e1fb-4cf4-a4e9-29d2afd930ce for instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa on n-h1-861111-1 Oct 12 22:38:25.417413 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-987423ab-76e4-4134-be6e-67c9d557f7b3 req-8b4d1b30-64f4-4880-9b91-ef5ecbc57f0e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068415 Oct 12 22:38:25.418782 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3481/6319] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:54.961002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b50a11b9-4973-4743-875d-022c0bc28507 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:54.961631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b50a11b9-4973-4743-875d-022c0bc28507 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:54.964883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=7 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:54.965578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:54.981682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b50a11b9-4973-4743-875d-022c0bc28507 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:54.982304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b50a11b9-4973-4743-875d-022c0bc28507 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:54.982748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b50a11b9-4973-4743-875d-022c0bc28507 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:54.983663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b50a11b9-4973-4743-875d-022c0bc28507 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:54.984298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b50a11b9-4973-4743-875d-022c0bc28507 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:54.984737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b50a11b9-4973-4743-875d-022c0bc28507 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:55.271572 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b50a11b9-4973-4743-875d-022c0bc28507 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1833 microversion: 2.1 time: 0.314746 Oct 12 22:38:55.276310 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2839/6320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:54 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1833 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:55.295665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d74ed9e5-adbf-4ea0-983d-08379230a6dd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:55.296280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d74ed9e5-adbf-4ea0-983d-08379230a6dd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:55.299756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=5 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:55.300403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:55.306434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d74ed9e5-adbf-4ea0-983d-08379230a6dd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:55.307129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d74ed9e5-adbf-4ea0-983d-08379230a6dd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:55.307617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d74ed9e5-adbf-4ea0-983d-08379230a6dd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:55.308831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d74ed9e5-adbf-4ea0-983d-08379230a6dd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:55.309457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d74ed9e5-adbf-4ea0-983d-08379230a6dd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:55.309886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d74ed9e5-adbf-4ea0-983d-08379230a6dd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:55.446780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d74ed9e5-adbf-4ea0-983d-08379230a6dd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:55.455788 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d74ed9e5-adbf-4ea0-983d-08379230a6dd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1682 microversion: 2.1 time: 0.164298 Oct 12 22:38:55.456376 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3482/6321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:55 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:55.560333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-29fa9071-6811-4ad5-ab7a-eb303c30aed5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:55.562750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-29fa9071-6811-4ad5-ab7a-eb303c30aed5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:55.572549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29fa9071-6811-4ad5-ab7a-eb303c30aed5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:55.573405 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29fa9071-6811-4ad5-ab7a-eb303c30aed5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:55.574513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29fa9071-6811-4ad5-ab7a-eb303c30aed5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:55.575338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29fa9071-6811-4ad5-ab7a-eb303c30aed5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:55.575895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29fa9071-6811-4ad5-ab7a-eb303c30aed5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:55.576452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29fa9071-6811-4ad5-ab7a-eb303c30aed5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:55.636827 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-29fa9071-6811-4ad5-ab7a-eb303c30aed5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc/action" status: 200 len: 32641 microversion: 2.1 time: 0.080210 Oct 12 22:38:55.637789 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2840/6322] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:38:55 2022] POST /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc/action => generated 32641 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:38:55.809695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6d35dfb8-a28c-42cd-8f01-66414fb0b0cb tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:55.810283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6d35dfb8-a28c-42cd-8f01-66414fb0b0cb tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:55.816569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d35dfb8-a28c-42cd-8f01-66414fb0b0cb tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:55.817066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d35dfb8-a28c-42cd-8f01-66414fb0b0cb tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:55.817512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d35dfb8-a28c-42cd-8f01-66414fb0b0cb tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:55.818220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d35dfb8-a28c-42cd-8f01-66414fb0b0cb tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:55.818679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d35dfb8-a28c-42cd-8f01-66414fb0b0cb tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:55.819434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d35dfb8-a28c-42cd-8f01-66414fb0b0cb tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:55.862756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6d35dfb8-a28c-42cd-8f01-66414fb0b0cb tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '892bbd4935094d73b436f48f56f5be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0b30ba37d944c9b5893f582e181064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:55.863674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6d35dfb8-a28c-42cd-8f01-66414fb0b0cb tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] flavor_id is None. Assuming migration. {{(pid=120453) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 12 22:38:55.864397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6d35dfb8-a28c-42cd-8f01-66414fb0b0cb tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120453) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:38:56.142861 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6d35dfb8-a28c-42cd-8f01-66414fb0b0cb tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc/action" status: 202 len: 0 microversion: 2.1 time: 0.337404 Oct 12 22:38:56.144420 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3483/6323] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:38:55 2022] POST /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:38:56.152692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f5ba9e3d-0184-4bab-85de-3fb233de1dfc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:56.153487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f5ba9e3d-0184-4bab-85de-3fb233de1dfc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:56.161712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5ba9e3d-0184-4bab-85de-3fb233de1dfc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:56.162456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5ba9e3d-0184-4bab-85de-3fb233de1dfc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:56.163126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5ba9e3d-0184-4bab-85de-3fb233de1dfc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:56.164084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5ba9e3d-0184-4bab-85de-3fb233de1dfc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:56.164746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5ba9e3d-0184-4bab-85de-3fb233de1dfc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:56.165713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5ba9e3d-0184-4bab-85de-3fb233de1dfc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:56.390972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f5ba9e3d-0184-4bab-85de-3fb233de1dfc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:56.399649 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f5ba9e3d-0184-4bab-85de-3fb233de1dfc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1691 microversion: 2.1 time: 0.251140 Oct 12 22:38:56.400804 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2841/6324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:56 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1691 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:57.425555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3e0bd70c-f20b-419b-8ece-d90c22dca5ff tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:57.426264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3e0bd70c-f20b-419b-8ece-d90c22dca5ff tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:57.432816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e0bd70c-f20b-419b-8ece-d90c22dca5ff tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:57.433346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e0bd70c-f20b-419b-8ece-d90c22dca5ff tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:57.433793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e0bd70c-f20b-419b-8ece-d90c22dca5ff tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:57.434505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e0bd70c-f20b-419b-8ece-d90c22dca5ff tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:57.434962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e0bd70c-f20b-419b-8ece-d90c22dca5ff tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:57.435500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e0bd70c-f20b-419b-8ece-d90c22dca5ff tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:57.624173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3e0bd70c-f20b-419b-8ece-d90c22dca5ff tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:57.639629 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3e0bd70c-f20b-419b-8ece-d90c22dca5ff tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1691 microversion: 2.1 time: 0.219077 Oct 12 22:38:57.641086 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3484/6325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:57 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1691 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:58.664324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8342f3f5-2505-4493-b544-101268dd9afa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:58.666102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8342f3f5-2505-4493-b544-101268dd9afa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:58.676646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8342f3f5-2505-4493-b544-101268dd9afa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:58.677466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8342f3f5-2505-4493-b544-101268dd9afa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:58.678156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8342f3f5-2505-4493-b544-101268dd9afa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:58.679124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8342f3f5-2505-4493-b544-101268dd9afa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:58.679900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8342f3f5-2505-4493-b544-101268dd9afa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:58.680691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8342f3f5-2505-4493-b544-101268dd9afa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:58.891197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8342f3f5-2505-4493-b544-101268dd9afa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:58.903121 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8342f3f5-2505-4493-b544-101268dd9afa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1696 microversion: 2.1 time: 0.243297 Oct 12 22:38:58.904281 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2842/6326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:58 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1696 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:59.930435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d6ef6682-3f92-42f7-944c-57eac4962912 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:59.931054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d6ef6682-3f92-42f7-944c-57eac4962912 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:59.948046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6ef6682-3f92-42f7-944c-57eac4962912 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:59.948835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6ef6682-3f92-42f7-944c-57eac4962912 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:59.949446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6ef6682-3f92-42f7-944c-57eac4962912 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:59.950160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6ef6682-3f92-42f7-944c-57eac4962912 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:59.950617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6ef6682-3f92-42f7-944c-57eac4962912 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:59.951042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6ef6682-3f92-42f7-944c-57eac4962912 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:00.108782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d6ef6682-3f92-42f7-944c-57eac4962912 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:00.118364 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d6ef6682-3f92-42f7-944c-57eac4962912 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1696 microversion: 2.1 time: 0.192248 Oct 12 22:39:00.121102 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3485/6327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:59 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1696 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:00.238739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1711e494-99d0-4165-8984-37d2e95980b6 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:00.239391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1711e494-99d0-4165-8984-37d2e95980b6 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:00.249633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1711e494-99d0-4165-8984-37d2e95980b6 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:00.250285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1711e494-99d0-4165-8984-37d2e95980b6 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:00.250975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1711e494-99d0-4165-8984-37d2e95980b6 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:00.252223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1711e494-99d0-4165-8984-37d2e95980b6 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:00.252899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1711e494-99d0-4165-8984-37d2e95980b6 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:00.253575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1711e494-99d0-4165-8984-37d2e95980b6 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:00.285796 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1711e494-99d0-4165-8984-37d2e95980b6 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.051834 Oct 12 22:39:00.286718 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2843/6328] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 12 22:39:00 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa/os-server-password => generated 116 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:01.145136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cbc2a120-7356-4619-ab3d-f93fac9c23bb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:01.146015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cbc2a120-7356-4619-ab3d-f93fac9c23bb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:01.154529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbc2a120-7356-4619-ab3d-f93fac9c23bb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:01.155099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbc2a120-7356-4619-ab3d-f93fac9c23bb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:01.155790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbc2a120-7356-4619-ab3d-f93fac9c23bb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:01.156679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbc2a120-7356-4619-ab3d-f93fac9c23bb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:01.157203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbc2a120-7356-4619-ab3d-f93fac9c23bb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:01.157859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cbc2a120-7356-4619-ab3d-f93fac9c23bb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:01.302380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cbc2a120-7356-4619-ab3d-f93fac9c23bb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:01.311591 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cbc2a120-7356-4619-ab3d-f93fac9c23bb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1696 microversion: 2.1 time: 0.170550 Oct 12 22:39:01.312049 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3486/6329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:01 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:02.345291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c2b404d9-c578-45e8-8fa8-ce98ce99aae8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:02.346682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c2b404d9-c578-45e8-8fa8-ce98ce99aae8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:02.355302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2b404d9-c578-45e8-8fa8-ce98ce99aae8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:02.356086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2b404d9-c578-45e8-8fa8-ce98ce99aae8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:02.356913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2b404d9-c578-45e8-8fa8-ce98ce99aae8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:02.357618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2b404d9-c578-45e8-8fa8-ce98ce99aae8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:02.358325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2b404d9-c578-45e8-8fa8-ce98ce99aae8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:02.358750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2b404d9-c578-45e8-8fa8-ce98ce99aae8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:02.569152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c2b404d9-c578-45e8-8fa8-ce98ce99aae8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:02.577824 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c2b404d9-c578-45e8-8fa8-ce98ce99aae8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1696 microversion: 2.1 time: 0.245458 Oct 12 22:39:02.578597 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2844/6330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:02 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1696 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:03.602655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c7c23804-322a-45d9-93be-f21b5eebb49f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:03.603198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c7c23804-322a-45d9-93be-f21b5eebb49f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:03.610523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7c23804-322a-45d9-93be-f21b5eebb49f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:03.611026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7c23804-322a-45d9-93be-f21b5eebb49f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:03.611517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7c23804-322a-45d9-93be-f21b5eebb49f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:03.624245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7c23804-322a-45d9-93be-f21b5eebb49f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:03.624826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7c23804-322a-45d9-93be-f21b5eebb49f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:03.625516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c7c23804-322a-45d9-93be-f21b5eebb49f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:03.894911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c7c23804-322a-45d9-93be-f21b5eebb49f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:03.922785 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c7c23804-322a-45d9-93be-f21b5eebb49f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1696 microversion: 2.1 time: 0.323672 Oct 12 22:39:03.924324 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3487/6331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:03 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1696 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:04.947395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2d9df7ea-b68a-4dd5-9a3d-5aaa17d354c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:04.949610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2d9df7ea-b68a-4dd5-9a3d-5aaa17d354c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:04.958684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d9df7ea-b68a-4dd5-9a3d-5aaa17d354c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:04.959579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d9df7ea-b68a-4dd5-9a3d-5aaa17d354c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:04.960352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d9df7ea-b68a-4dd5-9a3d-5aaa17d354c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:04.962969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d9df7ea-b68a-4dd5-9a3d-5aaa17d354c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:04.964333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d9df7ea-b68a-4dd5-9a3d-5aaa17d354c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:04.965057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d9df7ea-b68a-4dd5-9a3d-5aaa17d354c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:05.187627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2d9df7ea-b68a-4dd5-9a3d-5aaa17d354c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:05.210495 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2d9df7ea-b68a-4dd5-9a3d-5aaa17d354c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1696 microversion: 2.1 time: 0.268107 Oct 12 22:39:05.216415 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2845/6332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:04 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1696 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:06.245961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e6dc5693-075a-469a-902e-81825d8b1015 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:06.247550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e6dc5693-075a-469a-902e-81825d8b1015 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:06.255693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6dc5693-075a-469a-902e-81825d8b1015 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:06.256432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6dc5693-075a-469a-902e-81825d8b1015 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:06.257078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6dc5693-075a-469a-902e-81825d8b1015 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:06.258301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6dc5693-075a-469a-902e-81825d8b1015 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:06.259303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6dc5693-075a-469a-902e-81825d8b1015 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:06.260366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6dc5693-075a-469a-902e-81825d8b1015 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:06.479495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e6dc5693-075a-469a-902e-81825d8b1015 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:06.490218 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e6dc5693-075a-469a-902e-81825d8b1015 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1696 microversion: 2.1 time: 0.250479 Oct 12 22:39:06.491168 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3488/6333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:06 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1696 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:07.516662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-31533a04-7307-488b-87cd-25d7aa2e432b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:07.518138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-31533a04-7307-488b-87cd-25d7aa2e432b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:07.530434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31533a04-7307-488b-87cd-25d7aa2e432b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:07.531397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31533a04-7307-488b-87cd-25d7aa2e432b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:07.532030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31533a04-7307-488b-87cd-25d7aa2e432b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:07.533351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31533a04-7307-488b-87cd-25d7aa2e432b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:07.533976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31533a04-7307-488b-87cd-25d7aa2e432b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:07.534578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31533a04-7307-488b-87cd-25d7aa2e432b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:07.752361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-31533a04-7307-488b-87cd-25d7aa2e432b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:07.802218 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-31533a04-7307-488b-87cd-25d7aa2e432b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1696 microversion: 2.1 time: 0.291433 Oct 12 22:39:07.828573 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2846/6334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:07 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1696 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:08.833574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2b9c6624-47b9-41f9-985a-13db7167fba0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:08.834209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2b9c6624-47b9-41f9-985a-13db7167fba0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:08.842028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b9c6624-47b9-41f9-985a-13db7167fba0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:08.842530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b9c6624-47b9-41f9-985a-13db7167fba0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:08.843170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b9c6624-47b9-41f9-985a-13db7167fba0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:08.844080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b9c6624-47b9-41f9-985a-13db7167fba0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:08.844708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b9c6624-47b9-41f9-985a-13db7167fba0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:08.845144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b9c6624-47b9-41f9-985a-13db7167fba0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:09.169837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2b9c6624-47b9-41f9-985a-13db7167fba0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:09.187537 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2b9c6624-47b9-41f9-985a-13db7167fba0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1696 microversion: 2.1 time: 0.359719 Oct 12 22:39:09.188255 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3489/6335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:08 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1696 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:10.217294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-93360a42-a310-413e-aa79-f8befb411332 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:10.218151 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-93360a42-a310-413e-aa79-f8befb411332 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:10.236214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93360a42-a310-413e-aa79-f8befb411332 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:10.236821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93360a42-a310-413e-aa79-f8befb411332 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:10.237386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93360a42-a310-413e-aa79-f8befb411332 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:10.238390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93360a42-a310-413e-aa79-f8befb411332 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:10.239066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93360a42-a310-413e-aa79-f8befb411332 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:10.240289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93360a42-a310-413e-aa79-f8befb411332 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:10.547650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-93360a42-a310-413e-aa79-f8befb411332 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:10.565683 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-93360a42-a310-413e-aa79-f8befb411332 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1696 microversion: 2.1 time: 0.352913 Oct 12 22:39:10.583531 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2847/6336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:10 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1696 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:11.592368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7dc15187-0dfb-408b-af54-88b9c72f0a95 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:11.593003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7dc15187-0dfb-408b-af54-88b9c72f0a95 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:11.614660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dc15187-0dfb-408b-af54-88b9c72f0a95 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:11.615160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dc15187-0dfb-408b-af54-88b9c72f0a95 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:11.624471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dc15187-0dfb-408b-af54-88b9c72f0a95 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:11.625455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dc15187-0dfb-408b-af54-88b9c72f0a95 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:11.625933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dc15187-0dfb-408b-af54-88b9c72f0a95 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:11.626546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dc15187-0dfb-408b-af54-88b9c72f0a95 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:11.669653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-0a6053d0-5c27-4f42-b9c0-a582ae11c1ae req-df22ec9b-2690-49a6-a310-f4d5dcc97f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404dff76-7390-487a-91d2-23a68bf291bc", "name": "network-vif-unplugged", "status": "completed", "tag": "239cb6af-7528-4161-ac97-242cd413fbc5"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:11.700114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0a6053d0-5c27-4f42-b9c0-a582ae11c1ae req-df22ec9b-2690-49a6-a310-f4d5dcc97f06 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:11.700883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0a6053d0-5c27-4f42-b9c0-a582ae11c1ae req-df22ec9b-2690-49a6-a310-f4d5dcc97f06 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:11.701481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0a6053d0-5c27-4f42-b9c0-a582ae11c1ae req-df22ec9b-2690-49a6-a310-f4d5dcc97f06 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:11.716512 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-0a6053d0-5c27-4f42-b9c0-a582ae11c1ae req-df22ec9b-2690-49a6-a310-f4d5dcc97f06 service nova] Creating event network-vif-unplugged:239cb6af-7528-4161-ac97-242cd413fbc5 for instance 404dff76-7390-487a-91d2-23a68bf291bc on n-h1-861111-1 Oct 12 22:39:11.723170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-0a6053d0-5c27-4f42-b9c0-a582ae11c1ae req-df22ec9b-2690-49a6-a310-f4d5dcc97f06 service nova] Instance 404dff76-7390-487a-91d2-23a68bf291bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:39:11.736862 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-0a6053d0-5c27-4f42-b9c0-a582ae11c1ae req-df22ec9b-2690-49a6-a310-f4d5dcc97f06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073244 Oct 12 22:39:11.738080 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2848/6337] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:11.840423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7dc15187-0dfb-408b-af54-88b9c72f0a95 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:11.851706 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7dc15187-0dfb-408b-af54-88b9c72f0a95 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1695 microversion: 2.1 time: 0.263256 Oct 12 22:39:11.864673 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3490/6338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:11 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1695 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:11.966824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-948304bb-c88f-48a7-8b04-100491ed9e5e tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-2009689854", "availability_zone": "foo_zone"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:11.971224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.aggregate [None req-948304bb-c88f-48a7-8b04-100491ed9e5e tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Generated uuid f0f8fa9f-f893-4b4a-99eb-84d15d8f4967 for aggregate {{(pid=120452) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:39:12.004373 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-948304bb-c88f-48a7-8b04-100491ed9e5e tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.186070 Oct 12 22:39:12.005391 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2849/6339] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 12 22:39:11 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:39:12.018759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7fdcc892-5b20-419d-8258-945639603e73 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:12.055647 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7fdcc892-5b20-419d-8258-945639603e73 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.041809 Oct 12 22:39:12.056820 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3491/6340] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 12 22:39:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:12.070813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e8f7aee7-4d54-48c0-9d4b-a32a97454b3f tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:12.077495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8f7aee7-4d54-48c0-9d4b-a32a97454b3f tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:12.079441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8f7aee7-4d54-48c0-9d4b-a32a97454b3f tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:12.080068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8f7aee7-4d54-48c0-9d4b-a32a97454b3f tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:12.081054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8f7aee7-4d54-48c0-9d4b-a32a97454b3f tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:12.081512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8f7aee7-4d54-48c0-9d4b-a32a97454b3f tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:12.082007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8f7aee7-4d54-48c0-9d4b-a32a97454b3f tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:12.120410 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e8f7aee7-4d54-48c0-9d4b-a32a97454b3f tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.055587 Oct 12 22:39:12.128118 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2850/6341] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 12 22:39:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:12.134122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-affb006f-10a6-4488-aa0e-fefc139211c7 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:12.144325 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-affb006f-10a6-4488-aa0e-fefc139211c7 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.014070 Oct 12 22:39:12.145292 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3492/6342] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 12 22:39:12 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:12.159652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-18ecab20-136a-4afb-bc31-03d6bd34b126 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861111-1"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:12.172369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18ecab20-136a-4afb-bc31-03d6bd34b126 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:12.172875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18ecab20-136a-4afb-bc31-03d6bd34b126 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:12.173581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18ecab20-136a-4afb-bc31-03d6bd34b126 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:12.601994 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-18ecab20-136a-4afb-bc31-03d6bd34b126 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.447355 Oct 12 22:39:12.602936 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2851/6343] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 12 22:39:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:12.614956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f8c30d4a-3c80-4a3a-976e-7b40287fb886 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:12.627920 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f8c30d4a-3c80-4a3a-976e-7b40287fb886 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.016158 Oct 12 22:39:12.629806 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3493/6344] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:39:12 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:12.645318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-57eff843-8cf8-43c1-a5e9-aeb9ccbe9cc9 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1514892749", "availability_zone": "foo_zone"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:12.834660 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-57eff843-8cf8-43c1-a5e9-aeb9ccbe9cc9 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.195303 Oct 12 22:39:12.837150 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2852/6345] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 12 22:39:12 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:12.846686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1867b477-1bab-4987-84c0-96e49efd9985 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:12.878074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e894caf1-3996-4931-a2ce-70cd9109e0f2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:12.879073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e894caf1-3996-4931-a2ce-70cd9109e0f2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:12.888483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e894caf1-3996-4931-a2ce-70cd9109e0f2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:12.893140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e894caf1-3996-4931-a2ce-70cd9109e0f2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:12.893842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e894caf1-3996-4931-a2ce-70cd9109e0f2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:12.894769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e894caf1-3996-4931-a2ce-70cd9109e0f2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:12.895085 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1867b477-1bab-4987-84c0-96e49efd9985 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.052182 Oct 12 22:39:12.895433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e894caf1-3996-4931-a2ce-70cd9109e0f2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:12.895875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e894caf1-3996-4931-a2ce-70cd9109e0f2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:12.905259 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3494/6346] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 12 22:39:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:12.911691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5b30b507-b097-4e2c-bdac-c2b4dae40a57 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:12.934132 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5b30b507-b097-4e2c-bdac-c2b4dae40a57 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.027046 Oct 12 22:39:12.934942 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3495/6347] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 12 22:39:12 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:12.949391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b612b231-3da6-4bc9-a275-782450f8fae9 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861111-1"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:12.968021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b612b231-3da6-4bc9-a275-782450f8fae9 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:12.968774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b612b231-3da6-4bc9-a275-782450f8fae9 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:12.969966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b612b231-3da6-4bc9-a275-782450f8fae9 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:13.120323 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b612b231-3da6-4bc9-a275-782450f8fae9 tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.175068 Oct 12 22:39:13.121318 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3496/6348] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 12 22:39:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:13.133382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-db8696cb-357b-447d-9c77-2441110ec40e tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:13.169031 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-db8696cb-357b-447d-9c77-2441110ec40e tempest-TestAggregatesBasicOps-1866576985 tempest-TestAggregatesBasicOps-1866576985-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.039566 Oct 12 22:39:13.170131 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3497/6349] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 12 22:39:13 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:39:13.238474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e894caf1-3996-4931-a2ce-70cd9109e0f2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:13.253110 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e894caf1-3996-4931-a2ce-70cd9109e0f2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1699 microversion: 2.1 time: 0.378995 Oct 12 22:39:13.253708 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2853/6350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:12 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1699 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:39:13.794021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d904a6ed-59a0-4579-a23f-e759712bb26b req-b45e13a1-6407-4e2c-803b-ba376adae857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "404dff76-7390-487a-91d2-23a68bf291bc", "tag": "239cb6af-7528-4161-ac97-242cd413fbc5"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:13.803974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d904a6ed-59a0-4579-a23f-e759712bb26b req-b45e13a1-6407-4e2c-803b-ba376adae857 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:13.804623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d904a6ed-59a0-4579-a23f-e759712bb26b req-b45e13a1-6407-4e2c-803b-ba376adae857 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:13.805176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d904a6ed-59a0-4579-a23f-e759712bb26b req-b45e13a1-6407-4e2c-803b-ba376adae857 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:13.822524 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d904a6ed-59a0-4579-a23f-e759712bb26b req-b45e13a1-6407-4e2c-803b-ba376adae857 service nova] Creating event network-changed:239cb6af-7528-4161-ac97-242cd413fbc5 for instance 404dff76-7390-487a-91d2-23a68bf291bc on n-h1-861111-1 Oct 12 22:39:13.830407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-d904a6ed-59a0-4579-a23f-e759712bb26b req-b45e13a1-6407-4e2c-803b-ba376adae857 service nova] Instance 404dff76-7390-487a-91d2-23a68bf291bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:39:13.850045 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d904a6ed-59a0-4579-a23f-e759712bb26b req-b45e13a1-6407-4e2c-803b-ba376adae857 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060465 Oct 12 22:39:13.852018 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3498/6351] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:14.281704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-31daa51a-1efa-4ab2-86bf-ee31483d2560 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:14.283268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-31daa51a-1efa-4ab2-86bf-ee31483d2560 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:14.294964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31daa51a-1efa-4ab2-86bf-ee31483d2560 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:14.302086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31daa51a-1efa-4ab2-86bf-ee31483d2560 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:14.304973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31daa51a-1efa-4ab2-86bf-ee31483d2560 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:14.306288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31daa51a-1efa-4ab2-86bf-ee31483d2560 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:14.309023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31daa51a-1efa-4ab2-86bf-ee31483d2560 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:14.309782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31daa51a-1efa-4ab2-86bf-ee31483d2560 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:14.701214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-31daa51a-1efa-4ab2-86bf-ee31483d2560 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:14.711764 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-31daa51a-1efa-4ab2-86bf-ee31483d2560 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1693 microversion: 2.1 time: 0.435894 Oct 12 22:39:14.715792 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2854/6352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:14 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1693 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:15.751722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1a9ade92-e79e-4861-89fc-27fe51014da0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:15.753118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1a9ade92-e79e-4861-89fc-27fe51014da0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:15.784699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a9ade92-e79e-4861-89fc-27fe51014da0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:15.787094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a9ade92-e79e-4861-89fc-27fe51014da0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:15.788152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a9ade92-e79e-4861-89fc-27fe51014da0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:15.789475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a9ade92-e79e-4861-89fc-27fe51014da0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:15.792880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a9ade92-e79e-4861-89fc-27fe51014da0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:15.793634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a9ade92-e79e-4861-89fc-27fe51014da0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:16.186072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a9ade92-e79e-4861-89fc-27fe51014da0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:16.196940 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1a9ade92-e79e-4861-89fc-27fe51014da0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1693 microversion: 2.1 time: 0.463337 Oct 12 22:39:16.199082 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3499/6353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:15 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1693 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:17.224250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-75955a68-6f6b-4ad0-932b-72377371624d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:17.224899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-75955a68-6f6b-4ad0-932b-72377371624d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:17.235597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75955a68-6f6b-4ad0-932b-72377371624d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:17.236095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75955a68-6f6b-4ad0-932b-72377371624d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:17.236537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75955a68-6f6b-4ad0-932b-72377371624d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:17.243497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75955a68-6f6b-4ad0-932b-72377371624d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:17.247804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75955a68-6f6b-4ad0-932b-72377371624d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:17.248632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75955a68-6f6b-4ad0-932b-72377371624d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:17.512608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-75955a68-6f6b-4ad0-932b-72377371624d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:17.522903 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-75955a68-6f6b-4ad0-932b-72377371624d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1690 microversion: 2.1 time: 0.303324 Oct 12 22:39:17.524150 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2855/6354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:17 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1690 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:17.547661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1d3231ac-a575-4cfa-91a7-89eade343b69 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:17.548887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1d3231ac-a575-4cfa-91a7-89eade343b69 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:17.563730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d3231ac-a575-4cfa-91a7-89eade343b69 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:17.564784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d3231ac-a575-4cfa-91a7-89eade343b69 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:17.565460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d3231ac-a575-4cfa-91a7-89eade343b69 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:17.566524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d3231ac-a575-4cfa-91a7-89eade343b69 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:17.567396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d3231ac-a575-4cfa-91a7-89eade343b69 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:17.568087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d3231ac-a575-4cfa-91a7-89eade343b69 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:17.708914 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1d3231ac-a575-4cfa-91a7-89eade343b69 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc/action" status: 204 len: 0 microversion: 2.1 time: 0.165423 Oct 12 22:39:17.713124 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3500/6355] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:39:17 2022] POST /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc/action => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:39:17.723080 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b7913d76-16db-4e27-b82f-ec891a206e39 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:17.723791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b7913d76-16db-4e27-b82f-ec891a206e39 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:17.746760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7913d76-16db-4e27-b82f-ec891a206e39 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:17.747899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7913d76-16db-4e27-b82f-ec891a206e39 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:17.750656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7913d76-16db-4e27-b82f-ec891a206e39 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:17.753145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7913d76-16db-4e27-b82f-ec891a206e39 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:17.753874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7913d76-16db-4e27-b82f-ec891a206e39 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:17.756309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7913d76-16db-4e27-b82f-ec891a206e39 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:18.271228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b7913d76-16db-4e27-b82f-ec891a206e39 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:18.285048 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b7913d76-16db-4e27-b82f-ec891a206e39 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1690 microversion: 2.1 time: 0.567402 Oct 12 22:39:18.299497 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2856/6356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:17 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1690 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:18.784718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-1acd8882-8674-4092-a29a-24f98f83d1e8 req-b4ccfe4d-602f-41a1-91ff-84f5d4f424fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404dff76-7390-487a-91d2-23a68bf291bc", "name": "network-vif-plugged", "status": "completed", "tag": "239cb6af-7528-4161-ac97-242cd413fbc5"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:18.812867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1acd8882-8674-4092-a29a-24f98f83d1e8 req-b4ccfe4d-602f-41a1-91ff-84f5d4f424fe service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:18.813512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1acd8882-8674-4092-a29a-24f98f83d1e8 req-b4ccfe4d-602f-41a1-91ff-84f5d4f424fe service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:18.813942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1acd8882-8674-4092-a29a-24f98f83d1e8 req-b4ccfe4d-602f-41a1-91ff-84f5d4f424fe service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:18.849942 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-1acd8882-8674-4092-a29a-24f98f83d1e8 req-b4ccfe4d-602f-41a1-91ff-84f5d4f424fe service nova] Creating event network-vif-plugged:239cb6af-7528-4161-ac97-242cd413fbc5 for instance 404dff76-7390-487a-91d2-23a68bf291bc on n-h1-861111-1 Oct 12 22:39:18.867697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-1acd8882-8674-4092-a29a-24f98f83d1e8 req-b4ccfe4d-602f-41a1-91ff-84f5d4f424fe service nova] Instance 404dff76-7390-487a-91d2-23a68bf291bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:39:18.910437 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-1acd8882-8674-4092-a29a-24f98f83d1e8 req-b4ccfe4d-602f-41a1-91ff-84f5d4f424fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133262 Oct 12 22:39:18.914139 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3501/6357] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:19.310475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d899c797-4f3a-4adb-91fe-803ff2796ff1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:19.312069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d899c797-4f3a-4adb-91fe-803ff2796ff1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:19.337022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d899c797-4f3a-4adb-91fe-803ff2796ff1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:19.337531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d899c797-4f3a-4adb-91fe-803ff2796ff1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:19.338019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d899c797-4f3a-4adb-91fe-803ff2796ff1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:19.338741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d899c797-4f3a-4adb-91fe-803ff2796ff1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:19.339414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d899c797-4f3a-4adb-91fe-803ff2796ff1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:19.340125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d899c797-4f3a-4adb-91fe-803ff2796ff1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:19.544913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d899c797-4f3a-4adb-91fe-803ff2796ff1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:19.555469 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d899c797-4f3a-4adb-91fe-803ff2796ff1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1690 microversion: 2.1 time: 0.250386 Oct 12 22:39:19.557477 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2857/6358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:19 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1690 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:20.583536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b8a72f86-d0e9-4627-9f9d-fbc31771de48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:20.585091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b8a72f86-d0e9-4627-9f9d-fbc31771de48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:20.598047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8a72f86-d0e9-4627-9f9d-fbc31771de48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:20.599579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8a72f86-d0e9-4627-9f9d-fbc31771de48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:20.601781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8a72f86-d0e9-4627-9f9d-fbc31771de48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:20.602716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8a72f86-d0e9-4627-9f9d-fbc31771de48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:20.604266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8a72f86-d0e9-4627-9f9d-fbc31771de48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:20.607371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8a72f86-d0e9-4627-9f9d-fbc31771de48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:21.093238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b8a72f86-d0e9-4627-9f9d-fbc31771de48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:21.096595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:21.117284 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b8a72f86-d0e9-4627-9f9d-fbc31771de48 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1682 microversion: 2.1 time: 0.539374 Oct 12 22:39:21.118732 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3502/6359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:20 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1682 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:37.539050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1636183429", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9a851be7-2367-4e34-b611-3af6e36abe4c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6d173dd3-914e-48d4-bcc2-81061c8da03d"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:37.552409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:37.553911 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:37.555020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=90 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:37.792115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] validate_networks() for [('6d173dd3-914e-48d4-bcc2-81061c8da03d', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:39:38.197164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:39:38.198048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:39:38.198665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:39:38.199089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:39:38.199841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:39:38.210275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:38.210701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:38.211681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:38.215745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:38.216218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:38.216658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:38.236331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:39:38.244350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for user 7d141d93d7a74a57b5b6475294c9af5e and project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:39:38.311721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:39:38.314468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9a851be7-2367-4e34-b611-3af6e36abe4c',volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:39:38.455019 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2fac47ad-27dc-4765-a848-9677f93d0381 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.919716 Oct 12 22:39:38.463390 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2858/6360] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:39:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:39:38.469306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-17b33351-da4a-4cae-9c8e-fb3b7b1751d3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:38.469935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-17b33351-da4a-4cae-9c8e-fb3b7b1751d3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:38.476222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:38.556799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-17b33351-da4a-4cae-9c8e-fb3b7b1751d3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:38.570821 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-17b33351-da4a-4cae-9c8e-fb3b7b1751d3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1057 microversion: 2.1 time: 0.105345 Oct 12 22:39:38.573665 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3503/6361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:38 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1057 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:39.594465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-37620901-f15d-45cf-b95a-950fdba042be tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:39.595078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-37620901-f15d-45cf-b95a-950fdba042be tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:39.611502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37620901-f15d-45cf-b95a-950fdba042be tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:39.612743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37620901-f15d-45cf-b95a-950fdba042be tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:39.619907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37620901-f15d-45cf-b95a-950fdba042be tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:39.620983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37620901-f15d-45cf-b95a-950fdba042be tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:39.621776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37620901-f15d-45cf-b95a-950fdba042be tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:39.622411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37620901-f15d-45cf-b95a-950fdba042be tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:39.838941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-37620901-f15d-45cf-b95a-950fdba042be tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:39.850484 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-37620901-f15d-45cf-b95a-950fdba042be tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1163 microversion: 2.1 time: 0.260102 Oct 12 22:39:39.863124 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2859/6362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:39 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1163 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:40.896260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6927a9f1-ff36-4d00-867c-60aa76aa1311 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:40.897628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6927a9f1-ff36-4d00-867c-60aa76aa1311 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:40.908988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6927a9f1-ff36-4d00-867c-60aa76aa1311 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:40.916509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6927a9f1-ff36-4d00-867c-60aa76aa1311 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:40.917321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6927a9f1-ff36-4d00-867c-60aa76aa1311 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:40.918313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6927a9f1-ff36-4d00-867c-60aa76aa1311 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:40.919009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6927a9f1-ff36-4d00-867c-60aa76aa1311 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:40.919693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6927a9f1-ff36-4d00-867c-60aa76aa1311 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:41.007597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6927a9f1-ff36-4d00-867c-60aa76aa1311 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:41.018334 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6927a9f1-ff36-4d00-867c-60aa76aa1311 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1173 microversion: 2.1 time: 0.136370 Oct 12 22:39:41.019535 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3504/6363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:40 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1173 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:41.321879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a0b8bd8a-dc32-43f6-8101-21e7b3a1404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:41.324996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a0b8bd8a-dc32-43f6-8101-21e7b3a1404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:41.332829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0b8bd8a-dc32-43f6-8101-21e7b3a1404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:41.334387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0b8bd8a-dc32-43f6-8101-21e7b3a1404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:41.335170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0b8bd8a-dc32-43f6-8101-21e7b3a1404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:41.336208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0b8bd8a-dc32-43f6-8101-21e7b3a1404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:41.336818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0b8bd8a-dc32-43f6-8101-21e7b3a1404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:41.337947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0b8bd8a-dc32-43f6-8101-21e7b3a1404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:41.411656 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a0b8bd8a-dc32-43f6-8101-21e7b3a1404a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc/action" status: 200 len: 24579 microversion: 2.1 time: 0.093951 Oct 12 22:39:41.413237 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2860/6364] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:39:41 2022] POST /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc/action => generated 24579 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:39:42.042341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-91e519e4-cf15-4193-8cc5-5bc103636c60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:42.043711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-91e519e4-cf15-4193-8cc5-5bc103636c60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:42.051806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91e519e4-cf15-4193-8cc5-5bc103636c60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:42.052650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91e519e4-cf15-4193-8cc5-5bc103636c60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:42.053311 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91e519e4-cf15-4193-8cc5-5bc103636c60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:42.054286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91e519e4-cf15-4193-8cc5-5bc103636c60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:42.054964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91e519e4-cf15-4193-8cc5-5bc103636c60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:42.056178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91e519e4-cf15-4193-8cc5-5bc103636c60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:42.228360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-91e519e4-cf15-4193-8cc5-5bc103636c60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:42.243658 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-91e519e4-cf15-4193-8cc5-5bc103636c60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1215 microversion: 2.1 time: 0.205348 Oct 12 22:39:42.244605 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3505/6365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:42 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1215 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:42.275192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-4c9c44a6-8030-4cf3-80c3-fdef146eee17 req-775e65fb-58c9-4e7e-a1d4-e65ab8d89a32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32ae84a6-74a0-450d-9900-57ff189c8458", "tag": "4f2af4cc-e28f-41ce-ac21-6eb37a0c322c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:42.289848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4c9c44a6-8030-4cf3-80c3-fdef146eee17 req-775e65fb-58c9-4e7e-a1d4-e65ab8d89a32 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:42.291298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4c9c44a6-8030-4cf3-80c3-fdef146eee17 req-775e65fb-58c9-4e7e-a1d4-e65ab8d89a32 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:42.300788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4c9c44a6-8030-4cf3-80c3-fdef146eee17 req-775e65fb-58c9-4e7e-a1d4-e65ab8d89a32 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:42.318638 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-4c9c44a6-8030-4cf3-80c3-fdef146eee17 req-775e65fb-58c9-4e7e-a1d4-e65ab8d89a32 service nova] Creating event network-changed:4f2af4cc-e28f-41ce-ac21-6eb37a0c322c for instance 32ae84a6-74a0-450d-9900-57ff189c8458 on n-h2-861111-1 Oct 12 22:39:42.339290 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-4c9c44a6-8030-4cf3-80c3-fdef146eee17 req-775e65fb-58c9-4e7e-a1d4-e65ab8d89a32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068742 Oct 12 22:39:42.341035 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2861/6366] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:39:43.275805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-318a6d04-0454-4050-9b39-80c7735b6832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:43.276620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-318a6d04-0454-4050-9b39-80c7735b6832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:43.291745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-318a6d04-0454-4050-9b39-80c7735b6832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:43.292421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-318a6d04-0454-4050-9b39-80c7735b6832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:43.293068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-318a6d04-0454-4050-9b39-80c7735b6832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:43.297093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-318a6d04-0454-4050-9b39-80c7735b6832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:43.297683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-318a6d04-0454-4050-9b39-80c7735b6832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:43.298235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-318a6d04-0454-4050-9b39-80c7735b6832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:43.468962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-318a6d04-0454-4050-9b39-80c7735b6832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:43.477064 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-318a6d04-0454-4050-9b39-80c7735b6832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1215 microversion: 2.1 time: 0.206184 Oct 12 22:39:43.495280 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3506/6367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:43 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1215 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:44.504769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-78e794a1-c0c1-4ccd-a078-3f0d35ec9ffd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:44.505765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-78e794a1-c0c1-4ccd-a078-3f0d35ec9ffd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:44.513280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78e794a1-c0c1-4ccd-a078-3f0d35ec9ffd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:44.513602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78e794a1-c0c1-4ccd-a078-3f0d35ec9ffd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:44.514109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78e794a1-c0c1-4ccd-a078-3f0d35ec9ffd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:44.514883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78e794a1-c0c1-4ccd-a078-3f0d35ec9ffd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:44.515567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78e794a1-c0c1-4ccd-a078-3f0d35ec9ffd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:44.516253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78e794a1-c0c1-4ccd-a078-3f0d35ec9ffd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:44.673599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-78e794a1-c0c1-4ccd-a078-3f0d35ec9ffd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:44.694674 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-78e794a1-c0c1-4ccd-a078-3f0d35ec9ffd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1215 microversion: 2.1 time: 0.196194 Oct 12 22:39:44.695644 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2862/6368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:44 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1215 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:45.718956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f6e1e8c0-fd52-4ebc-affd-cbfc50e06b52 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:45.719611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f6e1e8c0-fd52-4ebc-affd-cbfc50e06b52 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:45.726996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6e1e8c0-fd52-4ebc-affd-cbfc50e06b52 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:45.728144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6e1e8c0-fd52-4ebc-affd-cbfc50e06b52 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:45.728597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6e1e8c0-fd52-4ebc-affd-cbfc50e06b52 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:45.729307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6e1e8c0-fd52-4ebc-affd-cbfc50e06b52 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:45.729776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6e1e8c0-fd52-4ebc-affd-cbfc50e06b52 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:45.730209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6e1e8c0-fd52-4ebc-affd-cbfc50e06b52 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:45.863064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f6e1e8c0-fd52-4ebc-affd-cbfc50e06b52 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:45.870749 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f6e1e8c0-fd52-4ebc-affd-cbfc50e06b52 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1203 microversion: 2.1 time: 0.155705 Oct 12 22:39:45.871424 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3507/6369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:45 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:46.894045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aa3cef3a-6833-498e-8789-82cea2e2334a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:46.894666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-aa3cef3a-6833-498e-8789-82cea2e2334a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:46.901698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa3cef3a-6833-498e-8789-82cea2e2334a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:46.902212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa3cef3a-6833-498e-8789-82cea2e2334a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:46.902652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa3cef3a-6833-498e-8789-82cea2e2334a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:46.903393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa3cef3a-6833-498e-8789-82cea2e2334a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:46.903850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa3cef3a-6833-498e-8789-82cea2e2334a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:46.904277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa3cef3a-6833-498e-8789-82cea2e2334a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:47.042369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-aa3cef3a-6833-498e-8789-82cea2e2334a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:47.051254 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-aa3cef3a-6833-498e-8789-82cea2e2334a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1203 microversion: 2.1 time: 0.161050 Oct 12 22:39:47.051857 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2863/6370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:46 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:39:47.624781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-68b89fe0-264f-4184-8226-9898de3c3c71 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:47.625397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-68b89fe0-264f-4184-8226-9898de3c3c71 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:47.632182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68b89fe0-264f-4184-8226-9898de3c3c71 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:47.632645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68b89fe0-264f-4184-8226-9898de3c3c71 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:47.633117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68b89fe0-264f-4184-8226-9898de3c3c71 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:47.634502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68b89fe0-264f-4184-8226-9898de3c3c71 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:47.634973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68b89fe0-264f-4184-8226-9898de3c3c71 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:47.635409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68b89fe0-264f-4184-8226-9898de3c3c71 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:47.768891 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-68b89fe0-264f-4184-8226-9898de3c3c71 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1833 microversion: 2.1 time: 0.147750 Oct 12 22:39:47.769475 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3508/6371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:47 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1833 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:48.079889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f377336b-0724-460f-96bd-cbc814044c9b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:48.080601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f377336b-0724-460f-96bd-cbc814044c9b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:48.089765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f377336b-0724-460f-96bd-cbc814044c9b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:48.090941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f377336b-0724-460f-96bd-cbc814044c9b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:48.091712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f377336b-0724-460f-96bd-cbc814044c9b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:48.092516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f377336b-0724-460f-96bd-cbc814044c9b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:48.093079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f377336b-0724-460f-96bd-cbc814044c9b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:48.093413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f377336b-0724-460f-96bd-cbc814044c9b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:48.226640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:48.252221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f377336b-0724-460f-96bd-cbc814044c9b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:48.256182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:48.263716 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f377336b-0724-460f-96bd-cbc814044c9b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1203 microversion: 2.1 time: 0.192831 Oct 12 22:39:48.264769 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2864/6372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:48 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1203 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:48.677600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bb46affe-c053-46b7-908a-7c4bf53059f0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:48.678989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bb46affe-c053-46b7-908a-7c4bf53059f0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:48.683386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:48.690512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb46affe-c053-46b7-908a-7c4bf53059f0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:48.691350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb46affe-c053-46b7-908a-7c4bf53059f0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:48.692023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb46affe-c053-46b7-908a-7c4bf53059f0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:48.693154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb46affe-c053-46b7-908a-7c4bf53059f0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:48.693816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb46affe-c053-46b7-908a-7c4bf53059f0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:48.694479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb46affe-c053-46b7-908a-7c4bf53059f0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:48.727645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bb46affe-c053-46b7-908a-7c4bf53059f0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:39:48.824111 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bb46affe-c053-46b7-908a-7c4bf53059f0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "DELETE /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 204 len: 0 microversion: 2.1 time: 0.150510 Oct 12 22:39:48.825246 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3509/6373] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:39:48 2022] DELETE /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:39:48.836261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5a62fe51-8770-4c94-b8c4-6872033b0992 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:48.837861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5a62fe51-8770-4c94-b8c4-6872033b0992 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:48.844778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a62fe51-8770-4c94-b8c4-6872033b0992 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:48.845553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a62fe51-8770-4c94-b8c4-6872033b0992 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:48.846252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a62fe51-8770-4c94-b8c4-6872033b0992 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:48.847691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a62fe51-8770-4c94-b8c4-6872033b0992 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:48.848686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a62fe51-8770-4c94-b8c4-6872033b0992 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:48.849344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a62fe51-8770-4c94-b8c4-6872033b0992 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:48.871722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-e23008d7-84b4-4c52-9459-7c2f4d380772 req-cbfa452e-1d54-4561-a4c0-c8b0480d521e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "404dff76-7390-487a-91d2-23a68bf291bc", "tag": "239cb6af-7528-4161-ac97-242cd413fbc5"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:48.883163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e23008d7-84b4-4c52-9459-7c2f4d380772 req-cbfa452e-1d54-4561-a4c0-c8b0480d521e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:48.884087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e23008d7-84b4-4c52-9459-7c2f4d380772 req-cbfa452e-1d54-4561-a4c0-c8b0480d521e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:48.885046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e23008d7-84b4-4c52-9459-7c2f4d380772 req-cbfa452e-1d54-4561-a4c0-c8b0480d521e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:48.900051 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-e23008d7-84b4-4c52-9459-7c2f4d380772 req-cbfa452e-1d54-4561-a4c0-c8b0480d521e service nova] Creating event network-changed:239cb6af-7528-4161-ac97-242cd413fbc5 for instance 404dff76-7390-487a-91d2-23a68bf291bc on n-h1-861111-1 Oct 12 22:39:48.907146 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-e23008d7-84b4-4c52-9459-7c2f4d380772 req-cbfa452e-1d54-4561-a4c0-c8b0480d521e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231604 Oct 12 22:39:48.911304 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2865/6374] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:39:49.040513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5a62fe51-8770-4c94-b8c4-6872033b0992 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:49.050072 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5a62fe51-8770-4c94-b8c4-6872033b0992 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1688 microversion: 2.1 time: 0.219402 Oct 12 22:39:49.050932 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3510/6375] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:48 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1688 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:49.288095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1334f6bd-ba6a-4023-9f2b-1416bc06e0cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:49.288808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1334f6bd-ba6a-4023-9f2b-1416bc06e0cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:49.296058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1334f6bd-ba6a-4023-9f2b-1416bc06e0cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:49.296559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1334f6bd-ba6a-4023-9f2b-1416bc06e0cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:49.297004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1334f6bd-ba6a-4023-9f2b-1416bc06e0cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:49.297722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1334f6bd-ba6a-4023-9f2b-1416bc06e0cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:49.298183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1334f6bd-ba6a-4023-9f2b-1416bc06e0cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:49.298614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1334f6bd-ba6a-4023-9f2b-1416bc06e0cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:49.466521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1334f6bd-ba6a-4023-9f2b-1416bc06e0cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:49.475149 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1334f6bd-ba6a-4023-9f2b-1416bc06e0cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1203 microversion: 2.1 time: 0.191839 Oct 12 22:39:49.475807 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2866/6376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:49 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1203 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:50.077819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7dba73b6-d593-416f-b82c-716136785fd8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:50.079345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7dba73b6-d593-416f-b82c-716136785fd8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:50.089119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dba73b6-d593-416f-b82c-716136785fd8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:50.089895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dba73b6-d593-416f-b82c-716136785fd8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:50.090686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dba73b6-d593-416f-b82c-716136785fd8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:50.091880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dba73b6-d593-416f-b82c-716136785fd8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:50.092429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dba73b6-d593-416f-b82c-716136785fd8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:50.092946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7dba73b6-d593-416f-b82c-716136785fd8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:50.244515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7dba73b6-d593-416f-b82c-716136785fd8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:50.252990 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7dba73b6-d593-416f-b82c-716136785fd8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1688 microversion: 2.1 time: 0.183069 Oct 12 22:39:50.253581 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3511/6377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:50 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:50.501835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f2e23ba6-89ac-4b74-a445-21914a69b124 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:50.503310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f2e23ba6-89ac-4b74-a445-21914a69b124 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:50.515005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e23ba6-89ac-4b74-a445-21914a69b124 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:50.515999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e23ba6-89ac-4b74-a445-21914a69b124 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:50.517028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e23ba6-89ac-4b74-a445-21914a69b124 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:50.518065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e23ba6-89ac-4b74-a445-21914a69b124 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:50.518686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e23ba6-89ac-4b74-a445-21914a69b124 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:50.519817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e23ba6-89ac-4b74-a445-21914a69b124 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:50.865294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f2e23ba6-89ac-4b74-a445-21914a69b124 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:50.873616 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f2e23ba6-89ac-4b74-a445-21914a69b124 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1203 microversion: 2.1 time: 0.378058 Oct 12 22:39:50.883503 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2867/6378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:50 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1203 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:51.097337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-5ba24cb3-0ce0-4750-a36e-0b8ea086eb06 req-351c9911-ec96-4ca4-9ce1-cf115e03c60d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404dff76-7390-487a-91d2-23a68bf291bc", "name": "network-vif-deleted", "tag": "239cb6af-7528-4161-ac97-242cd413fbc5"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:51.108885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5ba24cb3-0ce0-4750-a36e-0b8ea086eb06 req-351c9911-ec96-4ca4-9ce1-cf115e03c60d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:51.109483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5ba24cb3-0ce0-4750-a36e-0b8ea086eb06 req-351c9911-ec96-4ca4-9ce1-cf115e03c60d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:51.109988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5ba24cb3-0ce0-4750-a36e-0b8ea086eb06 req-351c9911-ec96-4ca4-9ce1-cf115e03c60d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:51.122815 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-5ba24cb3-0ce0-4750-a36e-0b8ea086eb06 req-351c9911-ec96-4ca4-9ce1-cf115e03c60d service nova] Creating event network-vif-deleted:239cb6af-7528-4161-ac97-242cd413fbc5 for instance 404dff76-7390-487a-91d2-23a68bf291bc on n-h1-861111-1 Oct 12 22:39:51.129741 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-5ba24cb3-0ce0-4750-a36e-0b8ea086eb06 req-351c9911-ec96-4ca4-9ce1-cf115e03c60d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036365 Oct 12 22:39:51.132553 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3512/6379] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:51.277484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3e2e250e-ab9e-4616-ad16-b3a7b559a2ac tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:51.278567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3e2e250e-ab9e-4616-ad16-b3a7b559a2ac tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:51.285041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e2e250e-ab9e-4616-ad16-b3a7b559a2ac tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:51.285739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e2e250e-ab9e-4616-ad16-b3a7b559a2ac tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:51.286267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e2e250e-ab9e-4616-ad16-b3a7b559a2ac tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:51.287013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e2e250e-ab9e-4616-ad16-b3a7b559a2ac tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:51.287753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e2e250e-ab9e-4616-ad16-b3a7b559a2ac tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:51.288362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e2e250e-ab9e-4616-ad16-b3a7b559a2ac tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:51.324040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e2e250e-ab9e-4616-ad16-b3a7b559a2ac tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:51.324711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e2e250e-ab9e-4616-ad16-b3a7b559a2ac tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:51.325305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e2e250e-ab9e-4616-ad16-b3a7b559a2ac tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:51.325905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-3e2e250e-ab9e-4616-ad16-b3a7b559a2ac tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lazy-loading 'fault' on Instance uuid 404dff76-7390-487a-91d2-23a68bf291bc {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:39:51.376746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3e2e250e-ab9e-4616-ad16-b3a7b559a2ac tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:51.396368 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3e2e250e-ab9e-4616-ad16-b3a7b559a2ac tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 200 len: 1357 microversion: 2.1 time: 0.123602 Oct 12 22:39:51.396951 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2868/6380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:51 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 1357 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:51.896404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6810daa6-9ed7-4c7f-93d9-2daa866c5106 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:51.898182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6810daa6-9ed7-4c7f-93d9-2daa866c5106 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:51.904933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6810daa6-9ed7-4c7f-93d9-2daa866c5106 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:51.905420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6810daa6-9ed7-4c7f-93d9-2daa866c5106 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:51.905858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6810daa6-9ed7-4c7f-93d9-2daa866c5106 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:51.906550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6810daa6-9ed7-4c7f-93d9-2daa866c5106 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:51.907000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6810daa6-9ed7-4c7f-93d9-2daa866c5106 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:51.907450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6810daa6-9ed7-4c7f-93d9-2daa866c5106 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:52.040744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6810daa6-9ed7-4c7f-93d9-2daa866c5106 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:52.048637 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6810daa6-9ed7-4c7f-93d9-2daa866c5106 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1203 microversion: 2.1 time: 0.156424 Oct 12 22:39:52.049258 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3513/6381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:51 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:52.420236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d65a92a-78b9-4cd9-bfcc-9c729c5a42c7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:52.420925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9d65a92a-78b9-4cd9-bfcc-9c729c5a42c7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: 404dff76-7390-487a-91d2-23a68bf291bc] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:52.427901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d65a92a-78b9-4cd9-bfcc-9c729c5a42c7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:52.428394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d65a92a-78b9-4cd9-bfcc-9c729c5a42c7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:52.428841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d65a92a-78b9-4cd9-bfcc-9c729c5a42c7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:52.429550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d65a92a-78b9-4cd9-bfcc-9c729c5a42c7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:52.430014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d65a92a-78b9-4cd9-bfcc-9c729c5a42c7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:52.430448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9d65a92a-78b9-4cd9-bfcc-9c729c5a42c7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:52.444712 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-9d65a92a-78b9-4cd9-bfcc-9c729c5a42c7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] HTTP exception thrown: Instance 404dff76-7390-487a-91d2-23a68bf291bc could not be found. Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d65a92a-78b9-4cd9-bfcc-9c729c5a42c7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Request method failure captured: Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc HTTP/1.1 Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0GT7kMjoeYhQ1Th4q7G_rjSfBz-SOd6Bk2_ScJ5gdprLwVptEtdNViG1pBtatnIyIuIXK-pDsF5xb7TwO3bZt7IWwrbvVcGcwuSVCzGTfwLlYAWKRg5O0DaNHlhbZQtTS0lSPT92gMQCb3wkKvhYt9T6IUbiTCIN3iqt07wMQT2obc Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: aa5cc899bfb3403c9aa9d192833cafa9 Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1768289362 Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aa5cc899bfb3403c9aa9d192833cafa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aa5cc899bfb3403c9aa9d192833cafa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aa5cc899bfb3403c9aa9d192833cafa9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aa5cc899bfb3403c9aa9d192833cafa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1768289362 Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: aa5cc899bfb3403c9aa9d192833cafa9 Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1768289362 Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestNetworkAdvancedServerOps-1768289362-project Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 2acd162da21348b6acb725bfe572bc00 Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1768289362-project Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 404dff76-7390-487a-91d2-23a68bf291bc could not be found. Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '404dff76-7390-487a-91d2-23a68bf291bc'} Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 404dff76-7390-487a-91d2-23a68bf291bc could not be found. Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 404dff76-7390-487a-91d2-23a68bf291bc could not be found. Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:39:52.446669 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:52.454421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:39:52.454421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:52.454421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:52.454421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:52.454421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:39:52.454421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:39:52.454421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 404dff76-7390-487a-91d2-23a68bf291bc could not be found. Oct 12 22:39:52.454421 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:39:52.454421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d65a92a-78b9-4cd9-bfcc-9c729c5a42c7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Returning 404 to user: Instance 404dff76-7390-487a-91d2-23a68bf291bc could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:39:52.454421 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9d65a92a-78b9-4cd9-bfcc-9c729c5a42c7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc" status: 404 len: 111 microversion: 2.1 time: 0.032220 Oct 12 22:39:52.459891 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2869/6382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:52 2022] GET /compute/v2.1/servers/404dff76-7390-487a-91d2-23a68bf291bc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:39:53.074380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b8d3fb9d-9a9a-4d38-81ec-1ebc39f9ca0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:53.075020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b8d3fb9d-9a9a-4d38-81ec-1ebc39f9ca0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:53.081893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8d3fb9d-9a9a-4d38-81ec-1ebc39f9ca0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:53.082398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8d3fb9d-9a9a-4d38-81ec-1ebc39f9ca0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:53.082848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8d3fb9d-9a9a-4d38-81ec-1ebc39f9ca0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:53.083589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8d3fb9d-9a9a-4d38-81ec-1ebc39f9ca0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:53.084270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8d3fb9d-9a9a-4d38-81ec-1ebc39f9ca0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:53.084875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8d3fb9d-9a9a-4d38-81ec-1ebc39f9ca0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:53.341450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b8d3fb9d-9a9a-4d38-81ec-1ebc39f9ca0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:53.349300 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b8d3fb9d-9a9a-4d38-81ec-1ebc39f9ca0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1203 microversion: 2.1 time: 0.279723 Oct 12 22:39:53.350176 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3514/6383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:53 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1203 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:54.372270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a82e4c03-eb50-4f2e-884f-134a73d8a509 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:54.372889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a82e4c03-eb50-4f2e-884f-134a73d8a509 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:54.391141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a82e4c03-eb50-4f2e-884f-134a73d8a509 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:54.391762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a82e4c03-eb50-4f2e-884f-134a73d8a509 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:54.392359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a82e4c03-eb50-4f2e-884f-134a73d8a509 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:54.393118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a82e4c03-eb50-4f2e-884f-134a73d8a509 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:54.393582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a82e4c03-eb50-4f2e-884f-134a73d8a509 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:54.394017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a82e4c03-eb50-4f2e-884f-134a73d8a509 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:54.610723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a82e4c03-eb50-4f2e-884f-134a73d8a509 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:54.623056 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a82e4c03-eb50-4f2e-884f-134a73d8a509 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1203 microversion: 2.1 time: 0.254144 Oct 12 22:39:54.624425 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2870/6384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:54 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1203 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:55.649783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ab098eca-072e-4e31-a8da-dba32ebd5aa0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:55.651072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ab098eca-072e-4e31-a8da-dba32ebd5aa0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:55.665206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab098eca-072e-4e31-a8da-dba32ebd5aa0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:55.666534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab098eca-072e-4e31-a8da-dba32ebd5aa0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:55.666998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab098eca-072e-4e31-a8da-dba32ebd5aa0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:55.667767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab098eca-072e-4e31-a8da-dba32ebd5aa0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:55.671130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab098eca-072e-4e31-a8da-dba32ebd5aa0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:55.671758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab098eca-072e-4e31-a8da-dba32ebd5aa0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:55.882089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ab098eca-072e-4e31-a8da-dba32ebd5aa0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:55.893793 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ab098eca-072e-4e31-a8da-dba32ebd5aa0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1203 microversion: 2.1 time: 0.251441 Oct 12 22:39:55.911989 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3515/6385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:55 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1203 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:56.420652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b4851688-b00a-4905-a5f9-4da00d491f8b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '.version_select at 0x7f51233d3dc0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:56.447066 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b4851688-b00a-4905-a5f9-4da00d491f8b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1715989287" status: 202 len: 0 microversion: 2.1 time: 0.030398 Oct 12 22:39:56.448377 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2871/6386] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Oct 12 22:39:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1715989287 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:39:56.477680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b442c50b-57ec-4317-b535-026b72f2f147 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'create', calling method: .version_select at 0x7f5122f50940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-314377209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCwmyn5JsKtyMEYpikA9+brNaSuaDhzPf3S0BoLtF6qXXxVrzvtlG4uf+RfL705ifjeYbEzRkHyg2b4PRmVAh6EkDOLBACIlN2UQ+DQ/I4oCacXvCw9C2aeLGiKGra7og=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:56.493871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-b442c50b-57ec-4317-b535-026b72f2f147 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Getting quotas for project aa5cc899bfb3403c9aa9d192833cafa9. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:39:56.499134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-b442c50b-57ec-4317-b535-026b72f2f147 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Getting quotas for user 2acd162da21348b6acb725bfe572bc00 and project aa5cc899bfb3403c9aa9d192833cafa9. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:39:56.523714 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b442c50b-57ec-4317-b535-026b72f2f147 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050434 Oct 12 22:39:56.524506 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3516/6387] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:39:56 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:56.917914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-21989387-d524-4dc9-97f7-d8cdaaed8dc0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:56.919208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-21989387-d524-4dc9-97f7-d8cdaaed8dc0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:56.928306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21989387-d524-4dc9-97f7-d8cdaaed8dc0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:56.929178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21989387-d524-4dc9-97f7-d8cdaaed8dc0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:56.940218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21989387-d524-4dc9-97f7-d8cdaaed8dc0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:56.941128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21989387-d524-4dc9-97f7-d8cdaaed8dc0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:56.942069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21989387-d524-4dc9-97f7-d8cdaaed8dc0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:56.942515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21989387-d524-4dc9-97f7-d8cdaaed8dc0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:57.126822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-21989387-d524-4dc9-97f7-d8cdaaed8dc0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:57.135975 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-21989387-d524-4dc9-97f7-d8cdaaed8dc0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1203 microversion: 2.1 time: 0.221842 Oct 12 22:39:57.136618 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2872/6388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:56 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1203 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:57.526240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d3a5e199-613d-4aa5-a097-7de19f605b39 req-8e2af174-3ff3-499e-b154-57d630351b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ae84a6-74a0-450d-9900-57ff189c8458", "name": "network-vif-plugged", "status": "completed", "tag": "4f2af4cc-e28f-41ce-ac21-6eb37a0c322c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:57.543769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d3a5e199-613d-4aa5-a097-7de19f605b39 req-8e2af174-3ff3-499e-b154-57d630351b46 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:57.544625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d3a5e199-613d-4aa5-a097-7de19f605b39 req-8e2af174-3ff3-499e-b154-57d630351b46 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:57.545378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d3a5e199-613d-4aa5-a097-7de19f605b39 req-8e2af174-3ff3-499e-b154-57d630351b46 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:57.562151 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d3a5e199-613d-4aa5-a097-7de19f605b39 req-8e2af174-3ff3-499e-b154-57d630351b46 service nova] Creating event network-vif-plugged:4f2af4cc-e28f-41ce-ac21-6eb37a0c322c for instance 32ae84a6-74a0-450d-9900-57ff189c8458 on n-h2-861111-1 Oct 12 22:39:57.567790 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d3a5e199-613d-4aa5-a097-7de19f605b39 req-8e2af174-3ff3-499e-b154-57d630351b46 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046902 Oct 12 22:39:57.569090 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3517/6389] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:58.159550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e0f57023-6b98-4f37-a2dc-8df4b9cc7f03 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:58.161032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e0f57023-6b98-4f37-a2dc-8df4b9cc7f03 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:58.171221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e0f57023-6b98-4f37-a2dc-8df4b9cc7f03 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:58.172636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e0f57023-6b98-4f37-a2dc-8df4b9cc7f03 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:58.173464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e0f57023-6b98-4f37-a2dc-8df4b9cc7f03 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:58.174487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e0f57023-6b98-4f37-a2dc-8df4b9cc7f03 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:58.175373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e0f57023-6b98-4f37-a2dc-8df4b9cc7f03 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:58.176096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e0f57023-6b98-4f37-a2dc-8df4b9cc7f03 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:58.484309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e0f57023-6b98-4f37-a2dc-8df4b9cc7f03 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:58.495724 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e0f57023-6b98-4f37-a2dc-8df4b9cc7f03 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1203 microversion: 2.1 time: 0.341379 Oct 12 22:39:58.496377 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2873/6390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:58 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1203 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:59.521371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-731fa532-55ba-46e9-96a6-dc2818d4784b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:59.522093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-731fa532-55ba-46e9-96a6-dc2818d4784b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:59.529910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-731fa532-55ba-46e9-96a6-dc2818d4784b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:59.530440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-731fa532-55ba-46e9-96a6-dc2818d4784b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:59.531086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-731fa532-55ba-46e9-96a6-dc2818d4784b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:59.532082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-731fa532-55ba-46e9-96a6-dc2818d4784b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:59.532759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-731fa532-55ba-46e9-96a6-dc2818d4784b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:59.533272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-731fa532-55ba-46e9-96a6-dc2818d4784b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:59.675804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-731fa532-55ba-46e9-96a6-dc2818d4784b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:59.684358 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-731fa532-55ba-46e9-96a6-dc2818d4784b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1389 microversion: 2.1 time: 0.170044 Oct 12 22:39:59.685078 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3518/6391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:59 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1389 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:59.707620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2801bc48-64d8-4e9c-8543-6c621305c946 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:59.708234 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2801bc48-64d8-4e9c-8543-6c621305c946 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:59.716379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2801bc48-64d8-4e9c-8543-6c621305c946 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:59.717112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2801bc48-64d8-4e9c-8543-6c621305c946 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:59.717550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2801bc48-64d8-4e9c-8543-6c621305c946 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:59.718244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2801bc48-64d8-4e9c-8543-6c621305c946 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:59.718692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2801bc48-64d8-4e9c-8543-6c621305c946 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:59.719114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2801bc48-64d8-4e9c-8543-6c621305c946 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:59.904381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2801bc48-64d8-4e9c-8543-6c621305c946 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:59.919085 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2801bc48-64d8-4e9c-8543-6c621305c946 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1389 microversion: 2.1 time: 0.215319 Oct 12 22:39:59.932125 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2874/6392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:59 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1389 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:59.943691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aa15e3d3-0466-4542-9122-565cb911a841 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:59.944552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aa15e3d3-0466-4542-9122-565cb911a841 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:59.951687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa15e3d3-0466-4542-9122-565cb911a841 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:59.954675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa15e3d3-0466-4542-9122-565cb911a841 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:59.955500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa15e3d3-0466-4542-9122-565cb911a841 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:59.957835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa15e3d3-0466-4542-9122-565cb911a841 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:59.958515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa15e3d3-0466-4542-9122-565cb911a841 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:59.959109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aa15e3d3-0466-4542-9122-565cb911a841 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:00.238056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aa15e3d3-0466-4542-9122-565cb911a841 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:00.248857 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aa15e3d3-0466-4542-9122-565cb911a841 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1389 microversion: 2.1 time: 0.311274 Oct 12 22:40:00.250098 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3519/6393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:59 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1389 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:00.273214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a53f80f3-49d3-49ad-a1a2-5f78ef899be8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:00.273214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a53f80f3-49d3-49ad-a1a2-5f78ef899be8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:00.284163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a53f80f3-49d3-49ad-a1a2-5f78ef899be8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:00.284763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a53f80f3-49d3-49ad-a1a2-5f78ef899be8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:00.285167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a53f80f3-49d3-49ad-a1a2-5f78ef899be8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:00.286574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a53f80f3-49d3-49ad-a1a2-5f78ef899be8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:00.287051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a53f80f3-49d3-49ad-a1a2-5f78ef899be8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:00.287515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a53f80f3-49d3-49ad-a1a2-5f78ef899be8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:00.297190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1749649785", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "7743ef8f-6671-46c7-9c0a-c227553bbd6a"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:00.324250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a53f80f3-49d3-49ad-a1a2-5f78ef899be8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:40:00.364632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] validate_networks() for [('7743ef8f-6671-46c7-9c0a-c227553bbd6a', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:40:00.432397 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a53f80f3-49d3-49ad-a1a2-5f78ef899be8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "DELETE /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 204 len: 0 microversion: 2.1 time: 0.164500 Oct 12 22:40:00.433015 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2875/6394] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:40:00 2022] DELETE /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:40:00.443413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-433f58e9-5b7e-4e8c-9944-c45b76efd14d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:00.444119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-433f58e9-5b7e-4e8c-9944-c45b76efd14d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:00.451345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-433f58e9-5b7e-4e8c-9944-c45b76efd14d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:00.451884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-433f58e9-5b7e-4e8c-9944-c45b76efd14d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:00.452498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-433f58e9-5b7e-4e8c-9944-c45b76efd14d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:00.453381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-433f58e9-5b7e-4e8c-9944-c45b76efd14d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:00.453994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-433f58e9-5b7e-4e8c-9944-c45b76efd14d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:00.454585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-433f58e9-5b7e-4e8c-9944-c45b76efd14d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:00.477260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:00.606209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-433f58e9-5b7e-4e8c-9944-c45b76efd14d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:00.620313 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-433f58e9-5b7e-4e8c-9944-c45b76efd14d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1395 microversion: 2.1 time: 0.182475 Oct 12 22:40:00.632810 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2876/6395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:00 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1395 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:01.069724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:40:01.070263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:40:01.071507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:40:01.071936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:40:01.073122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:40:01.095978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:01.096513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:01.097246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:01.098449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:01.099494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:01.100368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:01.125517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Getting quotas for project 63bdbf1427b34fea8b69194fe2c77606. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:40:01.131713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Getting quotas for user f5cd75eef94a44d3b62ab3db358cb06c and project 63bdbf1427b34fea8b69194fe2c77606. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:40:01.146753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:40:01.150365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: c3f65544-da93-4a0e-91ec-d52e5b1a27b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:40:01.231756 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e90a273b-2969-4677-9fcd-1b0f81769b9e tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938265 Oct 12 22:40:01.234878 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3520/6396] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:40:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:40:01.244986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c2a82e53-490b-4889-940f-fb4291e193b5 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:01.246907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c2a82e53-490b-4889-940f-fb4291e193b5 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: c3f65544-da93-4a0e-91ec-d52e5b1a27b4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:01.316388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c2a82e53-490b-4889-940f-fb4291e193b5 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:01.325319 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c2a82e53-490b-4889-940f-fb4291e193b5 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4" status: 200 len: 1214 microversion: 2.1 time: 0.084122 Oct 12 22:40:01.326419 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2877/6397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:01 2022] GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:01.645102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f3bd1f32-b358-4aa5-863f-bea2b489d6a4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:01.645716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f3bd1f32-b358-4aa5-863f-bea2b489d6a4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:01.653699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3bd1f32-b358-4aa5-863f-bea2b489d6a4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:01.654652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3bd1f32-b358-4aa5-863f-bea2b489d6a4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:01.655732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3bd1f32-b358-4aa5-863f-bea2b489d6a4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:01.656815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3bd1f32-b358-4aa5-863f-bea2b489d6a4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:01.657441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3bd1f32-b358-4aa5-863f-bea2b489d6a4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:01.658057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3bd1f32-b358-4aa5-863f-bea2b489d6a4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:02.104264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f3bd1f32-b358-4aa5-863f-bea2b489d6a4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:02.112873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:02.116295 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f3bd1f32-b358-4aa5-863f-bea2b489d6a4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1395 microversion: 2.1 time: 0.476107 Oct 12 22:40:02.118532 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3521/6398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:01 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1395 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:02.357929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b6ed1574-d8cb-4439-bb97-d092cb54f2f7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:02.359619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b6ed1574-d8cb-4439-bb97-d092cb54f2f7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: c3f65544-da93-4a0e-91ec-d52e5b1a27b4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:02.371601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6ed1574-d8cb-4439-bb97-d092cb54f2f7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:02.372326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6ed1574-d8cb-4439-bb97-d092cb54f2f7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:02.378051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6ed1574-d8cb-4439-bb97-d092cb54f2f7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:02.379300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6ed1574-d8cb-4439-bb97-d092cb54f2f7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:02.379955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6ed1574-d8cb-4439-bb97-d092cb54f2f7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:02.380794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6ed1574-d8cb-4439-bb97-d092cb54f2f7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:02.645348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b6ed1574-d8cb-4439-bb97-d092cb54f2f7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:02.665537 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b6ed1574-d8cb-4439-bb97-d092cb54f2f7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4" status: 200 len: 1266 microversion: 2.1 time: 0.320638 Oct 12 22:40:02.666871 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2878/6399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:02 2022] GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4 => generated 1266 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:02.748930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a9f3e5a5-3421-4504-ba15-fe009ee464dc req-4d02f027-f74d-4d0c-99af-b619948b24b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ae84a6-74a0-450d-9900-57ff189c8458", "name": "network-vif-deleted", "tag": "4f2af4cc-e28f-41ce-ac21-6eb37a0c322c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:02.782635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a9f3e5a5-3421-4504-ba15-fe009ee464dc req-4d02f027-f74d-4d0c-99af-b619948b24b5 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:02.783848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a9f3e5a5-3421-4504-ba15-fe009ee464dc req-4d02f027-f74d-4d0c-99af-b619948b24b5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:02.784902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a9f3e5a5-3421-4504-ba15-fe009ee464dc req-4d02f027-f74d-4d0c-99af-b619948b24b5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:02.815922 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a9f3e5a5-3421-4504-ba15-fe009ee464dc req-4d02f027-f74d-4d0c-99af-b619948b24b5 service nova] Creating event network-vif-deleted:4f2af4cc-e28f-41ce-ac21-6eb37a0c322c for instance 32ae84a6-74a0-450d-9900-57ff189c8458 on n-h2-861111-1 Oct 12 22:40:02.823900 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a9f3e5a5-3421-4504-ba15-fe009ee464dc req-4d02f027-f74d-4d0c-99af-b619948b24b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079710 Oct 12 22:40:02.825137 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3522/6400] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:03.144037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c5c57bb3-cc03-43e9-84bb-94c2d0ae972a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:03.145345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c5c57bb3-cc03-43e9-84bb-94c2d0ae972a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:03.156580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5c57bb3-cc03-43e9-84bb-94c2d0ae972a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:03.157455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5c57bb3-cc03-43e9-84bb-94c2d0ae972a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:03.158792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5c57bb3-cc03-43e9-84bb-94c2d0ae972a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:03.159882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5c57bb3-cc03-43e9-84bb-94c2d0ae972a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:03.160536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5c57bb3-cc03-43e9-84bb-94c2d0ae972a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:03.168659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5c57bb3-cc03-43e9-84bb-94c2d0ae972a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:03.255658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c5c57bb3-cc03-43e9-84bb-94c2d0ae972a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:03.270521 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c5c57bb3-cc03-43e9-84bb-94c2d0ae972a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1188 microversion: 2.1 time: 0.133245 Oct 12 22:40:03.273062 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2879/6401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:03 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1188 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:03.691319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3032117a-4b29-4acd-9fbb-2aca02b57505 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:03.692613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3032117a-4b29-4acd-9fbb-2aca02b57505 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: c3f65544-da93-4a0e-91ec-d52e5b1a27b4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:03.705038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3032117a-4b29-4acd-9fbb-2aca02b57505 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:03.706690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3032117a-4b29-4acd-9fbb-2aca02b57505 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:03.707154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3032117a-4b29-4acd-9fbb-2aca02b57505 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:03.711030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3032117a-4b29-4acd-9fbb-2aca02b57505 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:03.711906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3032117a-4b29-4acd-9fbb-2aca02b57505 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:03.712578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3032117a-4b29-4acd-9fbb-2aca02b57505 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:03.879611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3032117a-4b29-4acd-9fbb-2aca02b57505 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:03.890131 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3032117a-4b29-4acd-9fbb-2aca02b57505 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4" status: 200 len: 1272 microversion: 2.1 time: 0.203756 Oct 12 22:40:03.893852 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3523/6402] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:03 2022] GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4 => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:04.296288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-86919f73-4fe7-476a-9ee6-3891642136c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:04.296892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-86919f73-4fe7-476a-9ee6-3891642136c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:04.309097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86919f73-4fe7-476a-9ee6-3891642136c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:04.309593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86919f73-4fe7-476a-9ee6-3891642136c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:04.310037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86919f73-4fe7-476a-9ee6-3891642136c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:04.313074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86919f73-4fe7-476a-9ee6-3891642136c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:04.313552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86919f73-4fe7-476a-9ee6-3891642136c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:04.315327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86919f73-4fe7-476a-9ee6-3891642136c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:04.520535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-186464261", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "a72a224a-9f59-4caf-9d59-ce4e058de0e9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-314377209", "security_groups": [{"name": "tempest-secgroup-smoke-1589336265"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:04.614695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-86919f73-4fe7-476a-9ee6-3891642136c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:04.628934 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-86919f73-4fe7-476a-9ee6-3891642136c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1188 microversion: 2.1 time: 0.337417 Oct 12 22:40:04.635357 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2880/6403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:04 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1188 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:04.784780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] validate_networks() for [('a72a224a-9f59-4caf-9d59-ce4e058de0e9', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:40:04.914523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ae1c8640-9c87-4081-a743-6c08c6aaf66a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:04.915144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ae1c8640-9c87-4081-a743-6c08c6aaf66a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: c3f65544-da93-4a0e-91ec-d52e5b1a27b4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:04.925759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae1c8640-9c87-4081-a743-6c08c6aaf66a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:04.929302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae1c8640-9c87-4081-a743-6c08c6aaf66a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:04.930090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae1c8640-9c87-4081-a743-6c08c6aaf66a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:04.931094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae1c8640-9c87-4081-a743-6c08c6aaf66a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:04.931938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae1c8640-9c87-4081-a743-6c08c6aaf66a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:04.934260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae1c8640-9c87-4081-a743-6c08c6aaf66a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:05.254099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ae1c8640-9c87-4081-a743-6c08c6aaf66a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:05.267659 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ae1c8640-9c87-4081-a743-6c08c6aaf66a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4" status: 200 len: 1314 microversion: 2.1 time: 0.355180 Oct 12 22:40:05.268304 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2881/6404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:04 2022] GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:05.384587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-ee4f13be-c567-4ced-b18d-59664527a0f2 req-b41ba570-33a9-484a-a29f-7dfb7974bb13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3f65544-da93-4a0e-91ec-d52e5b1a27b4", "tag": "b4dd00dd-8556-492d-a06c-56bdf018cf42"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:05.422792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ee4f13be-c567-4ced-b18d-59664527a0f2 req-b41ba570-33a9-484a-a29f-7dfb7974bb13 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:05.426374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ee4f13be-c567-4ced-b18d-59664527a0f2 req-b41ba570-33a9-484a-a29f-7dfb7974bb13 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:05.428252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ee4f13be-c567-4ced-b18d-59664527a0f2 req-b41ba570-33a9-484a-a29f-7dfb7974bb13 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:05.476686 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-ee4f13be-c567-4ced-b18d-59664527a0f2 req-b41ba570-33a9-484a-a29f-7dfb7974bb13 service nova] Creating event network-changed:b4dd00dd-8556-492d-a06c-56bdf018cf42 for instance c3f65544-da93-4a0e-91ec-d52e5b1a27b4 on n-h1-861111-1 Oct 12 22:40:05.486387 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-ee4f13be-c567-4ced-b18d-59664527a0f2 req-b41ba570-33a9-484a-a29f-7dfb7974bb13 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106638 Oct 12 22:40:05.487627 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2882/6405] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:40:05.642413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:40:05.643026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:40:05.643558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:40:05.643980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:40:05.644513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:40:05.655406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:05.655982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:05.656521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:05.657330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:05.658025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:05.658672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:05.663036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5a428192-e020-4eee-a714-22faf75648c4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:05.664163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5a428192-e020-4eee-a714-22faf75648c4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:05.677633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a428192-e020-4eee-a714-22faf75648c4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:05.679744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a428192-e020-4eee-a714-22faf75648c4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:05.679985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Getting quotas for project aa5cc899bfb3403c9aa9d192833cafa9. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:40:05.680418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a428192-e020-4eee-a714-22faf75648c4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:05.683075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a428192-e020-4eee-a714-22faf75648c4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:05.683754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a428192-e020-4eee-a714-22faf75648c4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:05.685283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a428192-e020-4eee-a714-22faf75648c4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:05.688197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Getting quotas for user 2acd162da21348b6acb725bfe572bc00 and project aa5cc899bfb3403c9aa9d192833cafa9. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:40:05.708036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:40:05.710913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:40:05.771798 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ed7ab29f-cfea-4162-8c3b-79e0248968ee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.256952 Oct 12 22:40:05.772961 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3524/6406] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:40:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:40:05.784830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-433be964-39d0-4a4b-90e8-87b439026b05 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:05.786166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-433be964-39d0-4a4b-90e8-87b439026b05 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:05.833454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5a428192-e020-4eee-a714-22faf75648c4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:05.856809 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5a428192-e020-4eee-a714-22faf75648c4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1188 microversion: 2.1 time: 0.198347 Oct 12 22:40:05.857423 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2883/6407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:05 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1188 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:05.864796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-433be964-39d0-4a4b-90e8-87b439026b05 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:05.886191 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-433be964-39d0-4a4b-90e8-87b439026b05 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1265 microversion: 2.1 time: 0.104876 Oct 12 22:40:05.899705 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3525/6408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:05 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1265 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:06.292070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-454b48d9-71b1-4567-9c90-7c594a3b4f0c tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:06.292938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-454b48d9-71b1-4567-9c90-7c594a3b4f0c tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: c3f65544-da93-4a0e-91ec-d52e5b1a27b4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:06.299955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-454b48d9-71b1-4567-9c90-7c594a3b4f0c tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:06.300777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-454b48d9-71b1-4567-9c90-7c594a3b4f0c tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:06.301439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-454b48d9-71b1-4567-9c90-7c594a3b4f0c tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:06.302586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-454b48d9-71b1-4567-9c90-7c594a3b4f0c tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:06.303285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-454b48d9-71b1-4567-9c90-7c594a3b4f0c tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:06.304012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-454b48d9-71b1-4567-9c90-7c594a3b4f0c tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:06.480868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-454b48d9-71b1-4567-9c90-7c594a3b4f0c tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:06.492480 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-454b48d9-71b1-4567-9c90-7c594a3b4f0c tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4" status: 200 len: 1314 microversion: 2.1 time: 0.204623 Oct 12 22:40:06.513552 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2884/6409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:06 2022] GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:06.885788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-92f3e2af-ec0c-475a-947f-53b30e3e5127 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:06.886429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-92f3e2af-ec0c-475a-947f-53b30e3e5127 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:06.894266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92f3e2af-ec0c-475a-947f-53b30e3e5127 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:06.895087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92f3e2af-ec0c-475a-947f-53b30e3e5127 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:06.895680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92f3e2af-ec0c-475a-947f-53b30e3e5127 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:06.896469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92f3e2af-ec0c-475a-947f-53b30e3e5127 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:06.897080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92f3e2af-ec0c-475a-947f-53b30e3e5127 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:06.897641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92f3e2af-ec0c-475a-947f-53b30e3e5127 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:06.914757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a232cada-70b6-4298-b4a8-272a7d2ace4b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:06.916741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a232cada-70b6-4298-b4a8-272a7d2ace4b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:06.924569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a232cada-70b6-4298-b4a8-272a7d2ace4b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:06.925558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a232cada-70b6-4298-b4a8-272a7d2ace4b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:06.926278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a232cada-70b6-4298-b4a8-272a7d2ace4b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:06.928122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a232cada-70b6-4298-b4a8-272a7d2ace4b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:06.928597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a232cada-70b6-4298-b4a8-272a7d2ace4b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:06.929034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a232cada-70b6-4298-b4a8-272a7d2ace4b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:06.998792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-92f3e2af-ec0c-475a-947f-53b30e3e5127 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:07.009043 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-92f3e2af-ec0c-475a-947f-53b30e3e5127 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1188 microversion: 2.1 time: 0.127423 Oct 12 22:40:07.026245 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3526/6410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:06 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1188 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:07.026635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a232cada-70b6-4298-b4a8-272a7d2ace4b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:07.033984 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a232cada-70b6-4298-b4a8-272a7d2ace4b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1317 microversion: 2.1 time: 0.123712 Oct 12 22:40:07.034568 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2885/6411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:06 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1317 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:07.522003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5a367e7b-ef51-405d-a9f5-6accc8172d1a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:07.522590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5a367e7b-ef51-405d-a9f5-6accc8172d1a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: c3f65544-da93-4a0e-91ec-d52e5b1a27b4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:07.531438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:07.536825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a367e7b-ef51-405d-a9f5-6accc8172d1a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:07.537331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a367e7b-ef51-405d-a9f5-6accc8172d1a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:07.539441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a367e7b-ef51-405d-a9f5-6accc8172d1a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:07.543832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a367e7b-ef51-405d-a9f5-6accc8172d1a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:07.544341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a367e7b-ef51-405d-a9f5-6accc8172d1a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:07.544790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5a367e7b-ef51-405d-a9f5-6accc8172d1a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:07.828666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5a367e7b-ef51-405d-a9f5-6accc8172d1a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:07.842998 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5a367e7b-ef51-405d-a9f5-6accc8172d1a tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4" status: 200 len: 1314 microversion: 2.1 time: 0.326135 Oct 12 22:40:07.850882 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3527/6412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:07 2022] GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:08.035140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4e7b518a-6f69-4288-9524-0470b252e6a6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:08.036399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4e7b518a-6f69-4288-9524-0470b252e6a6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:08.042936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:08.045012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e7b518a-6f69-4288-9524-0470b252e6a6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:08.046081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e7b518a-6f69-4288-9524-0470b252e6a6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:08.046690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e7b518a-6f69-4288-9524-0470b252e6a6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:08.047663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e7b518a-6f69-4288-9524-0470b252e6a6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:08.048287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e7b518a-6f69-4288-9524-0470b252e6a6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:08.048869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e7b518a-6f69-4288-9524-0470b252e6a6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:08.058984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-84d83f28-3746-417e-aba0-3b4f1231a716 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:08.060422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-84d83f28-3746-417e-aba0-3b4f1231a716 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:08.071962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84d83f28-3746-417e-aba0-3b4f1231a716 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:08.078982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84d83f28-3746-417e-aba0-3b4f1231a716 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:08.079709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84d83f28-3746-417e-aba0-3b4f1231a716 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:08.080767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84d83f28-3746-417e-aba0-3b4f1231a716 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:08.081384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84d83f28-3746-417e-aba0-3b4f1231a716 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:08.082005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84d83f28-3746-417e-aba0-3b4f1231a716 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:08.184438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4e7b518a-6f69-4288-9524-0470b252e6a6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:08.188931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-84d83f28-3746-417e-aba0-3b4f1231a716 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:08.212817 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4e7b518a-6f69-4288-9524-0470b252e6a6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 200 len: 1188 microversion: 2.1 time: 0.179551 Oct 12 22:40:08.213640 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2886/6413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:08 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 1188 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:08.213934 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-84d83f28-3746-417e-aba0-3b4f1231a716 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1323 microversion: 2.1 time: 0.158154 Oct 12 22:40:08.214967 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3528/6414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:08 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1323 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:08.867852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7e5d7b24-b368-46fd-8c45-866e910241ff tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:08.868604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7e5d7b24-b368-46fd-8c45-866e910241ff tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: c3f65544-da93-4a0e-91ec-d52e5b1a27b4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:08.874685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e5d7b24-b368-46fd-8c45-866e910241ff tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:08.875434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e5d7b24-b368-46fd-8c45-866e910241ff tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:08.876038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e5d7b24-b368-46fd-8c45-866e910241ff tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:08.877406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e5d7b24-b368-46fd-8c45-866e910241ff tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:08.877862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e5d7b24-b368-46fd-8c45-866e910241ff tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:08.878453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e5d7b24-b368-46fd-8c45-866e910241ff tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:09.127259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e5d7b24-b368-46fd-8c45-866e910241ff tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:09.135846 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7e5d7b24-b368-46fd-8c45-866e910241ff tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4" status: 200 len: 1314 microversion: 2.1 time: 0.272352 Oct 12 22:40:09.136548 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2887/6415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:08 2022] GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:09.236184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b5dc3be1-80e3-41d4-bbba-9c35a35eaf3c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:09.236808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b5dc3be1-80e3-41d4-bbba-9c35a35eaf3c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32ae84a6-74a0-450d-9900-57ff189c8458] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:09.245351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5dc3be1-80e3-41d4-bbba-9c35a35eaf3c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:09.245745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a819966e-14e4-4b42-b1a6-782a1e93858d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:09.246029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5dc3be1-80e3-41d4-bbba-9c35a35eaf3c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:09.246478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5dc3be1-80e3-41d4-bbba-9c35a35eaf3c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:09.246606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a819966e-14e4-4b42-b1a6-782a1e93858d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:09.247184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5dc3be1-80e3-41d4-bbba-9c35a35eaf3c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:09.247705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5dc3be1-80e3-41d4-bbba-9c35a35eaf3c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:09.248131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5dc3be1-80e3-41d4-bbba-9c35a35eaf3c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:09.252423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a819966e-14e4-4b42-b1a6-782a1e93858d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:09.253096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a819966e-14e4-4b42-b1a6-782a1e93858d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:09.253546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a819966e-14e4-4b42-b1a6-782a1e93858d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:09.254245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a819966e-14e4-4b42-b1a6-782a1e93858d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:09.254871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a819966e-14e4-4b42-b1a6-782a1e93858d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:09.255326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a819966e-14e4-4b42-b1a6-782a1e93858d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:09.264507 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-b5dc3be1-80e3-41d4-bbba-9c35a35eaf3c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] HTTP exception thrown: Instance 32ae84a6-74a0-450d-9900-57ff189c8458 could not be found. Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b5dc3be1-80e3-41d4-bbba-9c35a35eaf3c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Request method failure captured: Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 HTTP/1.1 Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0IharzkU0EI5od_tYFYiimWbIhiU_Z2qWiELggh5UckxeqrnYnnrwzymqi7TUfpjzQhGi9AT7nHEyzZohAJui-4vZv6nTEy801Fmq2zP90o12d8oz0UHjyBxm9MxKWeYUrTwr-9KmypVoqQEOknLfZ_qBqmv_P1kjCeo-X5DoGtv6Y Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef79a1f4c33c46f1a7536c37f910e2b0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7d141d93d7a74a57b5b6475294c9af5e Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 32ae84a6-74a0-450d-9900-57ff189c8458 could not be found. Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '32ae84a6-74a0-450d-9900-57ff189c8458'} Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32ae84a6-74a0-450d-9900-57ff189c8458 could not be found. Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32ae84a6-74a0-450d-9900-57ff189c8458 could not be found. Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:40:09.265414 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:40:09.270914 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:40:09.270914 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:40:09.270914 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:40:09.270914 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:40:09.270914 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:40:09.270914 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32ae84a6-74a0-450d-9900-57ff189c8458 could not be found. Oct 12 22:40:09.270914 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:40:09.270914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b5dc3be1-80e3-41d4-bbba-9c35a35eaf3c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Returning 404 to user: Instance 32ae84a6-74a0-450d-9900-57ff189c8458 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:40:09.270914 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b5dc3be1-80e3-41d4-bbba-9c35a35eaf3c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458" status: 404 len: 111 microversion: 2.1 time: 0.034680 Oct 12 22:40:09.270914 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3529/6416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:09 2022] GET /compute/v2.1/servers/32ae84a6-74a0-450d-9900-57ff189c8458 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:40:09.451487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-b79142a0-4825-4652-8456-8102724bc330 req-2d4e12f0-be59-4e17-be41-f2517e36408a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f", "tag": "f09a9c76-1253-4c10-afae-3e74c87a8ea4"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:09.453484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a819966e-14e4-4b42-b1a6-782a1e93858d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:09.463326 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a819966e-14e4-4b42-b1a6-782a1e93858d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1391 microversion: 2.1 time: 0.221757 Oct 12 22:40:09.464217 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2888/6417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:09 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1391 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:09.482022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b79142a0-4825-4652-8456-8102724bc330 req-2d4e12f0-be59-4e17-be41-f2517e36408a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:09.482520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b79142a0-4825-4652-8456-8102724bc330 req-2d4e12f0-be59-4e17-be41-f2517e36408a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:09.483015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b79142a0-4825-4652-8456-8102724bc330 req-2d4e12f0-be59-4e17-be41-f2517e36408a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:09.496500 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-b79142a0-4825-4652-8456-8102724bc330 req-2d4e12f0-be59-4e17-be41-f2517e36408a service nova] Creating event network-changed:f09a9c76-1253-4c10-afae-3e74c87a8ea4 for instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f on n-h2-861111-1 Oct 12 22:40:09.501877 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-b79142a0-4825-4652-8456-8102724bc330 req-2d4e12f0-be59-4e17-be41-f2517e36408a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054477 Oct 12 22:40:09.502499 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3530/6418] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:40:10.169980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2af388f2-e707-4071-a8fb-c53ff6c4286f tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:10.171265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2af388f2-e707-4071-a8fb-c53ff6c4286f tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: c3f65544-da93-4a0e-91ec-d52e5b1a27b4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:10.180230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2af388f2-e707-4071-a8fb-c53ff6c4286f tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:10.181026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2af388f2-e707-4071-a8fb-c53ff6c4286f tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:10.182218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2af388f2-e707-4071-a8fb-c53ff6c4286f tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:10.183149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2af388f2-e707-4071-a8fb-c53ff6c4286f tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:10.183795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2af388f2-e707-4071-a8fb-c53ff6c4286f tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:10.184500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2af388f2-e707-4071-a8fb-c53ff6c4286f tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:10.329052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2af388f2-e707-4071-a8fb-c53ff6c4286f tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:10.337523 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2af388f2-e707-4071-a8fb-c53ff6c4286f tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4" status: 200 len: 1314 microversion: 2.1 time: 0.171753 Oct 12 22:40:10.338176 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2889/6419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:10 2022] GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:10.491046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-49f59daa-5776-420f-97a4-e9b567892f6a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:10.491836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-49f59daa-5776-420f-97a4-e9b567892f6a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:10.498353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49f59daa-5776-420f-97a4-e9b567892f6a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:10.499046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49f59daa-5776-420f-97a4-e9b567892f6a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:10.499521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49f59daa-5776-420f-97a4-e9b567892f6a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:10.500233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49f59daa-5776-420f-97a4-e9b567892f6a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:10.500870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49f59daa-5776-420f-97a4-e9b567892f6a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:10.501310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-49f59daa-5776-420f-97a4-e9b567892f6a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:10.582686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d9878af3-9c5f-4a01-9e97-8cc83eab13ca req-3b7cb220-2db0-4d45-ab84-1383b64d6f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3f65544-da93-4a0e-91ec-d52e5b1a27b4", "name": "network-vif-plugged", "status": "completed", "tag": "b4dd00dd-8556-492d-a06c-56bdf018cf42"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:10.598980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d9878af3-9c5f-4a01-9e97-8cc83eab13ca req-3b7cb220-2db0-4d45-ab84-1383b64d6f1e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:10.600300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d9878af3-9c5f-4a01-9e97-8cc83eab13ca req-3b7cb220-2db0-4d45-ab84-1383b64d6f1e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:10.600937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d9878af3-9c5f-4a01-9e97-8cc83eab13ca req-3b7cb220-2db0-4d45-ab84-1383b64d6f1e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:10.618634 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d9878af3-9c5f-4a01-9e97-8cc83eab13ca req-3b7cb220-2db0-4d45-ab84-1383b64d6f1e service nova] Creating event network-vif-plugged:b4dd00dd-8556-492d-a06c-56bdf018cf42 for instance c3f65544-da93-4a0e-91ec-d52e5b1a27b4 on n-h1-861111-1 Oct 12 22:40:10.626533 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d9878af3-9c5f-4a01-9e97-8cc83eab13ca req-3b7cb220-2db0-4d45-ab84-1383b64d6f1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050920 Oct 12 22:40:10.627705 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2890/6420] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:10.649612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-49f59daa-5776-420f-97a4-e9b567892f6a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:10.659464 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-49f59daa-5776-420f-97a4-e9b567892f6a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1391 microversion: 2.1 time: 0.175235 Oct 12 22:40:10.662014 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3531/6421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:10 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:11.359327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:11.363697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d71acb8f-f1f9-401c-ae63-875b8e141827 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:11.364402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d71acb8f-f1f9-401c-ae63-875b8e141827 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: c3f65544-da93-4a0e-91ec-d52e5b1a27b4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:11.371111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d71acb8f-f1f9-401c-ae63-875b8e141827 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:11.371622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d71acb8f-f1f9-401c-ae63-875b8e141827 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:11.372062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d71acb8f-f1f9-401c-ae63-875b8e141827 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:11.372776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d71acb8f-f1f9-401c-ae63-875b8e141827 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:11.373224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d71acb8f-f1f9-401c-ae63-875b8e141827 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:11.373646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d71acb8f-f1f9-401c-ae63-875b8e141827 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:11.512302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d71acb8f-f1f9-401c-ae63-875b8e141827 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:11.520102 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d71acb8f-f1f9-401c-ae63-875b8e141827 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4" status: 200 len: 1314 microversion: 2.1 time: 0.162567 Oct 12 22:40:11.520672 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2891/6422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:11 2022] GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:11.683487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6bcc4baa-f951-40de-97b4-cb3c30d84660 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:11.684109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6bcc4baa-f951-40de-97b4-cb3c30d84660 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:11.691042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6bcc4baa-f951-40de-97b4-cb3c30d84660 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:11.691592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6bcc4baa-f951-40de-97b4-cb3c30d84660 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:11.692041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6bcc4baa-f951-40de-97b4-cb3c30d84660 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:11.692746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6bcc4baa-f951-40de-97b4-cb3c30d84660 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:11.693209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6bcc4baa-f951-40de-97b4-cb3c30d84660 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:11.693644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6bcc4baa-f951-40de-97b4-cb3c30d84660 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:11.843631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6bcc4baa-f951-40de-97b4-cb3c30d84660 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:11.862577 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6bcc4baa-f951-40de-97b4-cb3c30d84660 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1391 microversion: 2.1 time: 0.181603 Oct 12 22:40:11.863781 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3532/6423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:11 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1391 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:12.545667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-46358ca8-ad71-4357-afe9-f27c00bdfd19 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:12.546893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-46358ca8-ad71-4357-afe9-f27c00bdfd19 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: c3f65544-da93-4a0e-91ec-d52e5b1a27b4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:12.561755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46358ca8-ad71-4357-afe9-f27c00bdfd19 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:12.568416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46358ca8-ad71-4357-afe9-f27c00bdfd19 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:12.569108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46358ca8-ad71-4357-afe9-f27c00bdfd19 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:12.569926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46358ca8-ad71-4357-afe9-f27c00bdfd19 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:12.570385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46358ca8-ad71-4357-afe9-f27c00bdfd19 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:12.570870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46358ca8-ad71-4357-afe9-f27c00bdfd19 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:12.782628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-46358ca8-ad71-4357-afe9-f27c00bdfd19 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:12.791756 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-46358ca8-ad71-4357-afe9-f27c00bdfd19 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4" status: 200 len: 1498 microversion: 2.1 time: 0.253506 Oct 12 22:40:12.803641 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2892/6424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:12 2022] GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4 => generated 1498 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:12.891901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dd651bb2-d15f-446d-b76e-ee5e03d700a2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:12.893041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dd651bb2-d15f-446d-b76e-ee5e03d700a2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:12.904795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd651bb2-d15f-446d-b76e-ee5e03d700a2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:12.905506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd651bb2-d15f-446d-b76e-ee5e03d700a2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:12.906011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd651bb2-d15f-446d-b76e-ee5e03d700a2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:12.908445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd651bb2-d15f-446d-b76e-ee5e03d700a2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:12.909008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd651bb2-d15f-446d-b76e-ee5e03d700a2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:12.909574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dd651bb2-d15f-446d-b76e-ee5e03d700a2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:13.104081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dd651bb2-d15f-446d-b76e-ee5e03d700a2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:13.113884 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dd651bb2-d15f-446d-b76e-ee5e03d700a2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1391 microversion: 2.1 time: 0.230055 Oct 12 22:40:13.115105 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3533/6425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:12 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1391 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:13.302933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-04a869f0-9ca0-4cb5-9057-24e6f7b33356 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:13.303865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-04a869f0-9ca0-4cb5-9057-24e6f7b33356 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: c3f65544-da93-4a0e-91ec-d52e5b1a27b4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:13.310992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a869f0-9ca0-4cb5-9057-24e6f7b33356 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:13.311594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a869f0-9ca0-4cb5-9057-24e6f7b33356 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:13.312268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a869f0-9ca0-4cb5-9057-24e6f7b33356 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:13.313162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a869f0-9ca0-4cb5-9057-24e6f7b33356 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:13.313697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a869f0-9ca0-4cb5-9057-24e6f7b33356 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:13.314369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a869f0-9ca0-4cb5-9057-24e6f7b33356 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:13.341940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-04a869f0-9ca0-4cb5-9057-24e6f7b33356 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: c3f65544-da93-4a0e-91ec-d52e5b1a27b4] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:40:13.399268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:13.428597 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-04a869f0-9ca0-4cb5-9057-24e6f7b33356 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4" status: 204 len: 0 microversion: 2.1 time: 0.130521 Oct 12 22:40:13.429400 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2893/6426] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:40:13 2022] DELETE /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:40:13.437609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9711f52f-953a-44d3-ba2e-36a6accba7f8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:13.438227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9711f52f-953a-44d3-ba2e-36a6accba7f8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: c3f65544-da93-4a0e-91ec-d52e5b1a27b4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:13.444345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9711f52f-953a-44d3-ba2e-36a6accba7f8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:13.444856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9711f52f-953a-44d3-ba2e-36a6accba7f8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:13.445625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9711f52f-953a-44d3-ba2e-36a6accba7f8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:13.446374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9711f52f-953a-44d3-ba2e-36a6accba7f8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:13.446839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9711f52f-953a-44d3-ba2e-36a6accba7f8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:13.447528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9711f52f-953a-44d3-ba2e-36a6accba7f8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:13.585951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9711f52f-953a-44d3-ba2e-36a6accba7f8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:13.593882 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9711f52f-953a-44d3-ba2e-36a6accba7f8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4" status: 200 len: 1504 microversion: 2.1 time: 0.160075 Oct 12 22:40:13.594457 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3534/6427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:13 2022] GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:14.138121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3281c879-8cd7-4f8b-9152-f81404d78b68 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:14.138758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3281c879-8cd7-4f8b-9152-f81404d78b68 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:14.145274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3281c879-8cd7-4f8b-9152-f81404d78b68 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:14.145764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3281c879-8cd7-4f8b-9152-f81404d78b68 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:14.146232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3281c879-8cd7-4f8b-9152-f81404d78b68 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:14.146923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3281c879-8cd7-4f8b-9152-f81404d78b68 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:14.147416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3281c879-8cd7-4f8b-9152-f81404d78b68 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:14.147868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3281c879-8cd7-4f8b-9152-f81404d78b68 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:14.280750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3281c879-8cd7-4f8b-9152-f81404d78b68 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:14.288428 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3281c879-8cd7-4f8b-9152-f81404d78b68 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1391 microversion: 2.1 time: 0.154730 Oct 12 22:40:14.289007 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2894/6428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:14 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:14.434956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-433700779", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f5cc8d24-d891-42cd-9461-69f1cf950cef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6d173dd3-914e-48d4-bcc2-81061c8da03d"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:14.495798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] validate_networks() for [('6d173dd3-914e-48d4-bcc2-81061c8da03d', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:40:14.617628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dee9da0b-93d8-463e-9909-c178091fb745 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:14.618263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dee9da0b-93d8-463e-9909-c178091fb745 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: c3f65544-da93-4a0e-91ec-d52e5b1a27b4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:14.625098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dee9da0b-93d8-463e-9909-c178091fb745 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:14.625596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dee9da0b-93d8-463e-9909-c178091fb745 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:14.626043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dee9da0b-93d8-463e-9909-c178091fb745 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:14.626898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dee9da0b-93d8-463e-9909-c178091fb745 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:14.627522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dee9da0b-93d8-463e-9909-c178091fb745 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:14.627958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dee9da0b-93d8-463e-9909-c178091fb745 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:14.765208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dee9da0b-93d8-463e-9909-c178091fb745 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:14.774556 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dee9da0b-93d8-463e-9909-c178091fb745 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4" status: 200 len: 1504 microversion: 2.1 time: 0.161182 Oct 12 22:40:14.775159 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2895/6429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:14 2022] GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:14.872279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:40:14.872713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:40:14.873233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:40:14.873653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:40:14.874073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:40:14.883937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:14.884457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:14.885520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:14.886272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:14.886735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:14.887171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:14.904253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:40:14.909597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for user 7d141d93d7a74a57b5b6475294c9af5e and project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:40:14.966200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:40:14.968263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f5cc8d24-d891-42cd-9461-69f1cf950cef',volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:40:15.097575 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2f396458-194e-4346-b0fd-49a3fedea76f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666552 Oct 12 22:40:15.104336 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3535/6430] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:40:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:40:15.109861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c28d2a33-022e-463e-b2df-04c47f1a9c16 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:15.110622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c28d2a33-022e-463e-b2df-04c47f1a9c16 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:15.206660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c28d2a33-022e-463e-b2df-04c47f1a9c16 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:15.214640 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c28d2a33-022e-463e-b2df-04c47f1a9c16 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1056 microversion: 2.1 time: 0.108696 Oct 12 22:40:15.215611 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2896/6431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:15 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1056 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:15.313456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1e224866-bcb5-40f8-b3af-fbacf909a22d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:15.316212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1e224866-bcb5-40f8-b3af-fbacf909a22d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:15.329410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-dc526ba2-e178-4dce-bbd0-0ef2d40d3044 req-b00c0e8f-7c5b-4ec0-9852-368b91394ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3f65544-da93-4a0e-91ec-d52e5b1a27b4", "name": "network-vif-deleted", "tag": "b4dd00dd-8556-492d-a06c-56bdf018cf42"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:15.332113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e224866-bcb5-40f8-b3af-fbacf909a22d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:15.332630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e224866-bcb5-40f8-b3af-fbacf909a22d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:15.333092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e224866-bcb5-40f8-b3af-fbacf909a22d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:15.333830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e224866-bcb5-40f8-b3af-fbacf909a22d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:15.338348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e224866-bcb5-40f8-b3af-fbacf909a22d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:15.339141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e224866-bcb5-40f8-b3af-fbacf909a22d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:15.366597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dc526ba2-e178-4dce-bbd0-0ef2d40d3044 req-b00c0e8f-7c5b-4ec0-9852-368b91394ac7 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:15.368129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dc526ba2-e178-4dce-bbd0-0ef2d40d3044 req-b00c0e8f-7c5b-4ec0-9852-368b91394ac7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:15.371594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dc526ba2-e178-4dce-bbd0-0ef2d40d3044 req-b00c0e8f-7c5b-4ec0-9852-368b91394ac7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:15.385822 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-dc526ba2-e178-4dce-bbd0-0ef2d40d3044 req-b00c0e8f-7c5b-4ec0-9852-368b91394ac7 service nova] Creating event network-vif-deleted:b4dd00dd-8556-492d-a06c-56bdf018cf42 for instance c3f65544-da93-4a0e-91ec-d52e5b1a27b4 on n-h1-861111-1 Oct 12 22:40:15.391271 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-dc526ba2-e178-4dce-bbd0-0ef2d40d3044 req-b00c0e8f-7c5b-4ec0-9852-368b91394ac7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065563 Oct 12 22:40:15.392205 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2897/6432] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:15.579973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1e224866-bcb5-40f8-b3af-fbacf909a22d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:15.591515 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1e224866-bcb5-40f8-b3af-fbacf909a22d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1391 microversion: 2.1 time: 0.283548 Oct 12 22:40:15.592101 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3536/6433] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:15 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1391 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:15.798704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7220d61a-1e50-45e1-a955-2be43a8b2717 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:15.799604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7220d61a-1e50-45e1-a955-2be43a8b2717 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: c3f65544-da93-4a0e-91ec-d52e5b1a27b4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:15.805678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7220d61a-1e50-45e1-a955-2be43a8b2717 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:15.806213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7220d61a-1e50-45e1-a955-2be43a8b2717 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:15.806655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7220d61a-1e50-45e1-a955-2be43a8b2717 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:15.807371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7220d61a-1e50-45e1-a955-2be43a8b2717 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:15.807826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7220d61a-1e50-45e1-a955-2be43a8b2717 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:15.808249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7220d61a-1e50-45e1-a955-2be43a8b2717 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:15.844330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7220d61a-1e50-45e1-a955-2be43a8b2717 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:15.844814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7220d61a-1e50-45e1-a955-2be43a8b2717 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:15.845247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7220d61a-1e50-45e1-a955-2be43a8b2717 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:15.845703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-7220d61a-1e50-45e1-a955-2be43a8b2717 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lazy-loading 'fault' on Instance uuid c3f65544-da93-4a0e-91ec-d52e5b1a27b4 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:40:15.893312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7220d61a-1e50-45e1-a955-2be43a8b2717 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:15.903320 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7220d61a-1e50-45e1-a955-2be43a8b2717 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4" status: 200 len: 1304 microversion: 2.1 time: 0.109415 Oct 12 22:40:15.907782 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2898/6434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:15 2022] GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:16.237440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5b5a147d-51b1-4b22-87b5-db7b7d61ac92 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:16.238031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5b5a147d-51b1-4b22-87b5-db7b7d61ac92 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:16.244239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5a147d-51b1-4b22-87b5-db7b7d61ac92 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:16.244729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5a147d-51b1-4b22-87b5-db7b7d61ac92 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:16.245181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5a147d-51b1-4b22-87b5-db7b7d61ac92 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:16.245879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5a147d-51b1-4b22-87b5-db7b7d61ac92 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:16.246338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5a147d-51b1-4b22-87b5-db7b7d61ac92 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:16.246772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b5a147d-51b1-4b22-87b5-db7b7d61ac92 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:16.309650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5b5a147d-51b1-4b22-87b5-db7b7d61ac92 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:16.317534 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5b5a147d-51b1-4b22-87b5-db7b7d61ac92 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1162 microversion: 2.1 time: 0.084317 Oct 12 22:40:16.318113 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3537/6435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:16 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1162 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:16.617411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1ab5f180-3c6a-4418-b8ce-c520df7c2f01 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:16.618185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1ab5f180-3c6a-4418-b8ce-c520df7c2f01 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:16.625617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ab5f180-3c6a-4418-b8ce-c520df7c2f01 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:16.626426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ab5f180-3c6a-4418-b8ce-c520df7c2f01 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:16.626972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ab5f180-3c6a-4418-b8ce-c520df7c2f01 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:16.627907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ab5f180-3c6a-4418-b8ce-c520df7c2f01 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:16.628538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ab5f180-3c6a-4418-b8ce-c520df7c2f01 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:16.629139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ab5f180-3c6a-4418-b8ce-c520df7c2f01 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:16.842636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1ab5f180-3c6a-4418-b8ce-c520df7c2f01 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:16.850718 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1ab5f180-3c6a-4418-b8ce-c520df7c2f01 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1391 microversion: 2.1 time: 0.237922 Oct 12 22:40:16.851975 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2899/6436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:16 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1391 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:16.926166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cd31b349-f832-4129-a8c3-91ea0fb48d02 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:16.926787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cd31b349-f832-4129-a8c3-91ea0fb48d02 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: c3f65544-da93-4a0e-91ec-d52e5b1a27b4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:16.934344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd31b349-f832-4129-a8c3-91ea0fb48d02 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:16.935054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd31b349-f832-4129-a8c3-91ea0fb48d02 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:16.935690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd31b349-f832-4129-a8c3-91ea0fb48d02 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:16.936567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd31b349-f832-4129-a8c3-91ea0fb48d02 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:16.937229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd31b349-f832-4129-a8c3-91ea0fb48d02 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:16.937875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd31b349-f832-4129-a8c3-91ea0fb48d02 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:16.952830 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-cd31b349-f832-4129-a8c3-91ea0fb48d02 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] HTTP exception thrown: Instance c3f65544-da93-4a0e-91ec-d52e5b1a27b4 could not be found. Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cd31b349-f832-4129-a8c3-91ea0fb48d02 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Request method failure captured: Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4 HTTP/1.1 Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0I-F19rtwfDDTl6s_g5oz5dskRqqXDpCwZmas6O0pBn78njl9uNg2t_07j0N512C0HvMLa2LojlXV79XAd6pZqadR2YtoXp6fbumLnP2j5D_UkHeO2MfCSY-5nL7nt0HEDP7Q8RhflPyHDmbgYiEsXqz3pkTwplbMmglhFH1atRgao Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 63bdbf1427b34fea8b69194fe2c77606 Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-VolumesActionsTest-817658301 Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63bdbf1427b34fea8b69194fe2c77606"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63bdbf1427b34fea8b69194fe2c77606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_63bdbf1427b34fea8b69194fe2c77606", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/63bdbf1427b34fea8b69194fe2c77606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-VolumesActionsTest-817658301 Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 63bdbf1427b34fea8b69194fe2c77606 Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-VolumesActionsTest-817658301 Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-VolumesActionsTest-817658301-project Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: f5cd75eef94a44d3b62ab3db358cb06c Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-VolumesActionsTest-817658301-project Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance c3f65544-da93-4a0e-91ec-d52e5b1a27b4 could not be found. Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'c3f65544-da93-4a0e-91ec-d52e5b1a27b4'} Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3f65544-da93-4a0e-91ec-d52e5b1a27b4 could not be found. Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3f65544-da93-4a0e-91ec-d52e5b1a27b4 could not be found. Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:40:16.954551 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:40:16.971531 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:40:16.971531 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:40:16.971531 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:40:16.971531 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:40:16.971531 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:40:16.971531 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3f65544-da93-4a0e-91ec-d52e5b1a27b4 could not be found. Oct 12 22:40:16.971531 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:40:16.971531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cd31b349-f832-4129-a8c3-91ea0fb48d02 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Returning 404 to user: Instance c3f65544-da93-4a0e-91ec-d52e5b1a27b4 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:40:16.971531 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cd31b349-f832-4129-a8c3-91ea0fb48d02 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4" status: 404 len: 111 microversion: 2.1 time: 0.033823 Oct 12 22:40:16.971531 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3538/6437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:16 2022] GET /compute/v2.1/servers/c3f65544-da93-4a0e-91ec-d52e5b1a27b4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:40:17.024055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1165069733", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "7743ef8f-6671-46c7-9c0a-c227553bbd6a"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:17.096252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] validate_networks() for [('7743ef8f-6671-46c7-9c0a-c227553bbd6a', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:40:17.342551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ed5491ec-195d-4834-bde4-acc1a53793bf tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:17.343490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ed5491ec-195d-4834-bde4-acc1a53793bf tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:17.354053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed5491ec-195d-4834-bde4-acc1a53793bf tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:17.355065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed5491ec-195d-4834-bde4-acc1a53793bf tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:17.355869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed5491ec-195d-4834-bde4-acc1a53793bf tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:17.356878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed5491ec-195d-4834-bde4-acc1a53793bf tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:17.357730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed5491ec-195d-4834-bde4-acc1a53793bf tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:17.358395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed5491ec-195d-4834-bde4-acc1a53793bf tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:17.628217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ed5491ec-195d-4834-bde4-acc1a53793bf tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:17.637626 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ed5491ec-195d-4834-bde4-acc1a53793bf tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1214 microversion: 2.1 time: 0.299391 Oct 12 22:40:17.639149 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3539/6438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:17 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1214 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:17.735415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-6517c0e9-2917-483d-b713-82037f6f4c3c req-22fc83ca-e392-4188-a510-dd4cb23caa2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f", "name": "network-vif-plugged", "status": "completed", "tag": "f09a9c76-1253-4c10-afae-3e74c87a8ea4"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:17.750610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6517c0e9-2917-483d-b713-82037f6f4c3c req-22fc83ca-e392-4188-a510-dd4cb23caa2c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:17.751924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6517c0e9-2917-483d-b713-82037f6f4c3c req-22fc83ca-e392-4188-a510-dd4cb23caa2c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:17.752851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6517c0e9-2917-483d-b713-82037f6f4c3c req-22fc83ca-e392-4188-a510-dd4cb23caa2c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:17.797699 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6517c0e9-2917-483d-b713-82037f6f4c3c req-22fc83ca-e392-4188-a510-dd4cb23caa2c service nova] Creating event network-vif-plugged:f09a9c76-1253-4c10-afae-3e74c87a8ea4 for instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f on n-h2-861111-1 Oct 12 22:40:17.812741 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-6517c0e9-2917-483d-b713-82037f6f4c3c req-22fc83ca-e392-4188-a510-dd4cb23caa2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081185 Oct 12 22:40:17.814807 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3540/6439] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:17.854067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:40:17.854743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:40:17.854976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:40:17.855423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:40:17.855843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:40:17.868893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:17.869534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:17.869995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:17.870734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:17.871415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:17.872015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:17.876050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cac07be9-574d-4db5-be83-e835d23dcef3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:17.876759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cac07be9-574d-4db5-be83-e835d23dcef3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:17.896411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cac07be9-574d-4db5-be83-e835d23dcef3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:17.897184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cac07be9-574d-4db5-be83-e835d23dcef3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:17.898375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cac07be9-574d-4db5-be83-e835d23dcef3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:17.899497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cac07be9-574d-4db5-be83-e835d23dcef3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:17.899854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Getting quotas for project 63bdbf1427b34fea8b69194fe2c77606. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:40:17.902486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cac07be9-574d-4db5-be83-e835d23dcef3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:17.903137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cac07be9-574d-4db5-be83-e835d23dcef3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:17.907260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Getting quotas for user f5cd75eef94a44d3b62ab3db358cb06c and project 63bdbf1427b34fea8b69194fe2c77606. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:40:17.926044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:40:17.929490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: 2508c04b-0bc3-4d90-9e07-1f2d631c77d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:40:18.034963 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-78fb44cc-c478-4642-bcbb-e9da01858ea3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.016334 Oct 12 22:40:18.038134 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2900/6440] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:40:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:40:18.051788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-01b2ded8-662f-4313-8d6c-d3cb2739384c tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:18.071907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-01b2ded8-662f-4313-8d6c-d3cb2739384c tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: 2508c04b-0bc3-4d90-9e07-1f2d631c77d1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:18.187154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cac07be9-574d-4db5-be83-e835d23dcef3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:18.198971 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cac07be9-574d-4db5-be83-e835d23dcef3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1391 microversion: 2.1 time: 0.327401 Oct 12 22:40:18.201775 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3541/6441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:17 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1391 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:18.239202 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-01b2ded8-662f-4313-8d6c-d3cb2739384c tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:18.248504 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-01b2ded8-662f-4313-8d6c-d3cb2739384c tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1" status: 200 len: 1214 microversion: 2.1 time: 0.203243 Oct 12 22:40:18.249100 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2901/6442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:18 2022] GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1 => generated 1214 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:18.614858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-05eaf619-24ca-43e3-b090-ed6d110a5621 req-f5dd927f-85c1-48de-862f-fc03a24bde31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756515be-f978-463e-beba-f9dbbf55edbb", "tag": "54d957b3-e62a-44c3-a5aa-4f2aaffd7f70"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:18.624841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-05eaf619-24ca-43e3-b090-ed6d110a5621 req-f5dd927f-85c1-48de-862f-fc03a24bde31 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:18.625650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-05eaf619-24ca-43e3-b090-ed6d110a5621 req-f5dd927f-85c1-48de-862f-fc03a24bde31 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:18.626341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-05eaf619-24ca-43e3-b090-ed6d110a5621 req-f5dd927f-85c1-48de-862f-fc03a24bde31 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:18.644423 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-05eaf619-24ca-43e3-b090-ed6d110a5621 req-f5dd927f-85c1-48de-862f-fc03a24bde31 service nova] Creating event network-changed:54d957b3-e62a-44c3-a5aa-4f2aaffd7f70 for instance 756515be-f978-463e-beba-f9dbbf55edbb on n-h2-861111-1 Oct 12 22:40:18.651568 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-05eaf619-24ca-43e3-b090-ed6d110a5621 req-f5dd927f-85c1-48de-862f-fc03a24bde31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040856 Oct 12 22:40:18.653590 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3542/6443] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:18.661052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8512984a-1c14-4c54-b730-02a12c49b1b4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:18.661682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8512984a-1c14-4c54-b730-02a12c49b1b4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:18.668434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8512984a-1c14-4c54-b730-02a12c49b1b4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:18.668928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8512984a-1c14-4c54-b730-02a12c49b1b4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:18.669374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8512984a-1c14-4c54-b730-02a12c49b1b4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:18.670075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8512984a-1c14-4c54-b730-02a12c49b1b4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:18.670534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8512984a-1c14-4c54-b730-02a12c49b1b4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:18.670964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8512984a-1c14-4c54-b730-02a12c49b1b4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:18.818524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8512984a-1c14-4c54-b730-02a12c49b1b4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:18.828817 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8512984a-1c14-4c54-b730-02a12c49b1b4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1214 microversion: 2.1 time: 0.171681 Oct 12 22:40:18.829488 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2902/6444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:18 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:19.226339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-faca9083-1fd5-4ed3-8901-584f347c8116 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:19.227078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-faca9083-1fd5-4ed3-8901-584f347c8116 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:19.233621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faca9083-1fd5-4ed3-8901-584f347c8116 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:19.234112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faca9083-1fd5-4ed3-8901-584f347c8116 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:19.234558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faca9083-1fd5-4ed3-8901-584f347c8116 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:19.235275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faca9083-1fd5-4ed3-8901-584f347c8116 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:19.235739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faca9083-1fd5-4ed3-8901-584f347c8116 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:19.236168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-faca9083-1fd5-4ed3-8901-584f347c8116 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:19.271675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9eea1f24-73b5-4535-bc69-50d0c7707707 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:19.273652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9eea1f24-73b5-4535-bc69-50d0c7707707 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: 2508c04b-0bc3-4d90-9e07-1f2d631c77d1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:19.279941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9eea1f24-73b5-4535-bc69-50d0c7707707 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:19.280642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9eea1f24-73b5-4535-bc69-50d0c7707707 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:19.281089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9eea1f24-73b5-4535-bc69-50d0c7707707 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:19.281807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9eea1f24-73b5-4535-bc69-50d0c7707707 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:19.282270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9eea1f24-73b5-4535-bc69-50d0c7707707 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:19.282725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9eea1f24-73b5-4535-bc69-50d0c7707707 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:19.388465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-faca9083-1fd5-4ed3-8901-584f347c8116 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:19.398302 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-faca9083-1fd5-4ed3-8901-584f347c8116 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1391 microversion: 2.1 time: 0.176986 Oct 12 22:40:19.399850 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3543/6445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:19 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:19.429645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9eea1f24-73b5-4535-bc69-50d0c7707707 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:19.439540 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9eea1f24-73b5-4535-bc69-50d0c7707707 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1" status: 200 len: 1266 microversion: 2.1 time: 0.172124 Oct 12 22:40:19.451935 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2903/6446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:19 2022] GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:19.852093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-04e68731-9a74-44d8-8345-ab0be5d41c1a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:19.852954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-04e68731-9a74-44d8-8345-ab0be5d41c1a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:19.859337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04e68731-9a74-44d8-8345-ab0be5d41c1a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:19.859830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04e68731-9a74-44d8-8345-ab0be5d41c1a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:19.860271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04e68731-9a74-44d8-8345-ab0be5d41c1a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:19.860976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04e68731-9a74-44d8-8345-ab0be5d41c1a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:19.861433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04e68731-9a74-44d8-8345-ab0be5d41c1a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:19.861866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-04e68731-9a74-44d8-8345-ab0be5d41c1a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:20.005869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-04e68731-9a74-44d8-8345-ab0be5d41c1a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:20.008368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=100 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:20.015277 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-04e68731-9a74-44d8-8345-ab0be5d41c1a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1214 microversion: 2.1 time: 0.167612 Oct 12 22:40:20.016228 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3544/6447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:19 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:20.430226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-153da9de-0fd4-4320-8ab8-dfc300af05f9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:20.431574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-153da9de-0fd4-4320-8ab8-dfc300af05f9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:20.439503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-153da9de-0fd4-4320-8ab8-dfc300af05f9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:20.440263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-153da9de-0fd4-4320-8ab8-dfc300af05f9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:20.440818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-153da9de-0fd4-4320-8ab8-dfc300af05f9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:20.441618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-153da9de-0fd4-4320-8ab8-dfc300af05f9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:20.442318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-153da9de-0fd4-4320-8ab8-dfc300af05f9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:20.442931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-153da9de-0fd4-4320-8ab8-dfc300af05f9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:20.469604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4f294b24-defb-47ba-a415-9961071fc576 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:20.471161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4f294b24-defb-47ba-a415-9961071fc576 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: 2508c04b-0bc3-4d90-9e07-1f2d631c77d1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:20.481660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f294b24-defb-47ba-a415-9961071fc576 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:20.482643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f294b24-defb-47ba-a415-9961071fc576 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:20.483277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f294b24-defb-47ba-a415-9961071fc576 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:20.484421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f294b24-defb-47ba-a415-9961071fc576 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:20.484973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f294b24-defb-47ba-a415-9961071fc576 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:20.485481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f294b24-defb-47ba-a415-9961071fc576 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:20.555915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4f294b24-defb-47ba-a415-9961071fc576 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:20.563789 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4f294b24-defb-47ba-a415-9961071fc576 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1" status: 200 len: 1272 microversion: 2.1 time: 0.100114 Oct 12 22:40:20.564472 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3545/6448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:20 2022] GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1 => generated 1272 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:20.664161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-153da9de-0fd4-4320-8ab8-dfc300af05f9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:20.672369 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-153da9de-0fd4-4320-8ab8-dfc300af05f9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1564 microversion: 2.1 time: 0.248077 Oct 12 22:40:20.686569 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2904/6449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:20 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1564 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:20.696072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2eb95e34-42cb-44a4-b1a3-0bee39389319 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:20.696714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2eb95e34-42cb-44a4-b1a3-0bee39389319 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:20.703309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2eb95e34-42cb-44a4-b1a3-0bee39389319 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:20.703814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2eb95e34-42cb-44a4-b1a3-0bee39389319 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:20.704266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2eb95e34-42cb-44a4-b1a3-0bee39389319 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:20.704985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2eb95e34-42cb-44a4-b1a3-0bee39389319 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:20.705447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2eb95e34-42cb-44a4-b1a3-0bee39389319 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:20.705884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2eb95e34-42cb-44a4-b1a3-0bee39389319 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:20.871655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2eb95e34-42cb-44a4-b1a3-0bee39389319 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:20.880063 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2eb95e34-42cb-44a4-b1a3-0bee39389319 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1564 microversion: 2.1 time: 0.187939 Oct 12 22:40:20.881080 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3546/6450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:20 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1564 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:21.039286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-658db1b6-1234-4a8c-a685-37fd5e343e40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:21.040172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-658db1b6-1234-4a8c-a685-37fd5e343e40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:21.046432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-658db1b6-1234-4a8c-a685-37fd5e343e40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:21.047131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-658db1b6-1234-4a8c-a685-37fd5e343e40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:21.047758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-658db1b6-1234-4a8c-a685-37fd5e343e40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:21.049021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-658db1b6-1234-4a8c-a685-37fd5e343e40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:21.049645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-658db1b6-1234-4a8c-a685-37fd5e343e40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:21.050253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-658db1b6-1234-4a8c-a685-37fd5e343e40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:21.276939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-658db1b6-1234-4a8c-a685-37fd5e343e40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:21.297891 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-658db1b6-1234-4a8c-a685-37fd5e343e40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1214 microversion: 2.1 time: 0.262729 Oct 12 22:40:21.300977 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2905/6451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:21 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1214 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:21.589290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-74c1e1ee-75f3-4f23-b865-047e7c55f779 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:21.590802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-74c1e1ee-75f3-4f23-b865-047e7c55f779 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: 2508c04b-0bc3-4d90-9e07-1f2d631c77d1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:21.600193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c1e1ee-75f3-4f23-b865-047e7c55f779 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:21.601005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c1e1ee-75f3-4f23-b865-047e7c55f779 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:21.601931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c1e1ee-75f3-4f23-b865-047e7c55f779 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:21.602694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c1e1ee-75f3-4f23-b865-047e7c55f779 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:21.604768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c1e1ee-75f3-4f23-b865-047e7c55f779 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:21.605143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74c1e1ee-75f3-4f23-b865-047e7c55f779 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:21.658100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-407ef29b-c645-4fbb-b0c9-c8870f0159ea req-e1e46482-c5d3-4d04-951c-02a8e328850a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2508c04b-0bc3-4d90-9e07-1f2d631c77d1", "tag": "9bd369f3-baee-4295-a7d2-c8850106c721"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:21.674803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-407ef29b-c645-4fbb-b0c9-c8870f0159ea req-e1e46482-c5d3-4d04-951c-02a8e328850a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:21.675643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-407ef29b-c645-4fbb-b0c9-c8870f0159ea req-e1e46482-c5d3-4d04-951c-02a8e328850a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:21.676271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-407ef29b-c645-4fbb-b0c9-c8870f0159ea req-e1e46482-c5d3-4d04-951c-02a8e328850a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:21.691476 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-407ef29b-c645-4fbb-b0c9-c8870f0159ea req-e1e46482-c5d3-4d04-951c-02a8e328850a service nova] Creating event network-changed:9bd369f3-baee-4295-a7d2-c8850106c721 for instance 2508c04b-0bc3-4d90-9e07-1f2d631c77d1 on n-h1-861111-1 Oct 12 22:40:21.699812 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-407ef29b-c645-4fbb-b0c9-c8870f0159ea req-e1e46482-c5d3-4d04-951c-02a8e328850a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049210 Oct 12 22:40:21.701017 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2906/6452] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:22.228933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-74c1e1ee-75f3-4f23-b865-047e7c55f779 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:22.236682 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-74c1e1ee-75f3-4f23-b865-047e7c55f779 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1" status: 200 len: 1314 microversion: 2.1 time: 0.653450 Oct 12 22:40:22.237266 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3547/6453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:21 2022] GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1 => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:22.324064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d31c025-27bc-4ebb-8063-288859a96e0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:22.324780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5d31c025-27bc-4ebb-8063-288859a96e0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:22.330870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d31c025-27bc-4ebb-8063-288859a96e0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:22.331383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d31c025-27bc-4ebb-8063-288859a96e0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:22.331826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d31c025-27bc-4ebb-8063-288859a96e0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:22.332517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d31c025-27bc-4ebb-8063-288859a96e0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:22.332971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d31c025-27bc-4ebb-8063-288859a96e0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:22.333400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d31c025-27bc-4ebb-8063-288859a96e0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:22.470909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5d31c025-27bc-4ebb-8063-288859a96e0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:22.479797 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5d31c025-27bc-4ebb-8063-288859a96e0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1202 microversion: 2.1 time: 0.160754 Oct 12 22:40:22.480337 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2907/6454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:22 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:23.030932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f3c4dfac-b58d-4867-b159-82e2b205cf32 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:23.031579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f3c4dfac-b58d-4867-b159-82e2b205cf32 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:23.039447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3c4dfac-b58d-4867-b159-82e2b205cf32 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:23.039984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3c4dfac-b58d-4867-b159-82e2b205cf32 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:23.040433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3c4dfac-b58d-4867-b159-82e2b205cf32 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:23.041166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-fc7bbc79-f261-4abd-ab9b-029608b859ba req-4c0ffeda-1887-48e3-86c8-d58d5766b1cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f", "tag": "f09a9c76-1253-4c10-afae-3e74c87a8ea4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:23.041625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3c4dfac-b58d-4867-b159-82e2b205cf32 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:23.041719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3c4dfac-b58d-4867-b159-82e2b205cf32 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:23.042137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3c4dfac-b58d-4867-b159-82e2b205cf32 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:23.050940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fc7bbc79-f261-4abd-ab9b-029608b859ba req-4c0ffeda-1887-48e3-86c8-d58d5766b1cf service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:23.051692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fc7bbc79-f261-4abd-ab9b-029608b859ba req-4c0ffeda-1887-48e3-86c8-d58d5766b1cf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:23.052130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fc7bbc79-f261-4abd-ab9b-029608b859ba req-4c0ffeda-1887-48e3-86c8-d58d5766b1cf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:23.064221 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-fc7bbc79-f261-4abd-ab9b-029608b859ba req-4c0ffeda-1887-48e3-86c8-d58d5766b1cf service nova] Creating event network-changed:f09a9c76-1253-4c10-afae-3e74c87a8ea4 for instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f on n-h2-861111-1 Oct 12 22:40:23.069990 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-fc7bbc79-f261-4abd-ab9b-029608b859ba req-4c0ffeda-1887-48e3-86c8-d58d5766b1cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032918 Oct 12 22:40:23.070828 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2908/6455] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:23.193144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f3c4dfac-b58d-4867-b159-82e2b205cf32 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:23.203830 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f3c4dfac-b58d-4867-b159-82e2b205cf32 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1564 microversion: 2.1 time: 0.176795 Oct 12 22:40:23.204661 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3548/6456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:23 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:23.260686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9916b39f-71ff-4586-a5f7-ac2f3372f421 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:23.261552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9916b39f-71ff-4586-a5f7-ac2f3372f421 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: 2508c04b-0bc3-4d90-9e07-1f2d631c77d1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:23.270347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9916b39f-71ff-4586-a5f7-ac2f3372f421 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:23.271920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9916b39f-71ff-4586-a5f7-ac2f3372f421 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:23.272813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9916b39f-71ff-4586-a5f7-ac2f3372f421 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:23.274072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9916b39f-71ff-4586-a5f7-ac2f3372f421 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:23.274766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9916b39f-71ff-4586-a5f7-ac2f3372f421 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:23.275561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9916b39f-71ff-4586-a5f7-ac2f3372f421 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:23.502871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2e2ab119-fc30-423c-9be4-ac45b44339d2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:23.503809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2e2ab119-fc30-423c-9be4-ac45b44339d2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:23.510066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e2ab119-fc30-423c-9be4-ac45b44339d2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:23.510691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e2ab119-fc30-423c-9be4-ac45b44339d2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:23.511251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e2ab119-fc30-423c-9be4-ac45b44339d2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:23.512082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e2ab119-fc30-423c-9be4-ac45b44339d2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:23.512648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e2ab119-fc30-423c-9be4-ac45b44339d2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:23.513206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e2ab119-fc30-423c-9be4-ac45b44339d2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:23.606021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9916b39f-71ff-4586-a5f7-ac2f3372f421 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:23.622821 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9916b39f-71ff-4586-a5f7-ac2f3372f421 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1" status: 200 len: 1314 microversion: 2.1 time: 0.364442 Oct 12 22:40:23.636042 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2909/6457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:23 2022] GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1 => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:23.686887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2e2ab119-fc30-423c-9be4-ac45b44339d2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:23.696632 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2e2ab119-fc30-423c-9be4-ac45b44339d2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1202 microversion: 2.1 time: 0.198099 Oct 12 22:40:23.702169 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3549/6458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:23 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1202 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:24.646306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-da3e49fa-59f7-4da7-8619-edd9e4d8d7a8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:24.647033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-da3e49fa-59f7-4da7-8619-edd9e4d8d7a8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: 2508c04b-0bc3-4d90-9e07-1f2d631c77d1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:24.654450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da3e49fa-59f7-4da7-8619-edd9e4d8d7a8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:24.655010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da3e49fa-59f7-4da7-8619-edd9e4d8d7a8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:24.655486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da3e49fa-59f7-4da7-8619-edd9e4d8d7a8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:24.656183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da3e49fa-59f7-4da7-8619-edd9e4d8d7a8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:24.656639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da3e49fa-59f7-4da7-8619-edd9e4d8d7a8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:24.657066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-da3e49fa-59f7-4da7-8619-edd9e4d8d7a8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:24.720260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-52d88172-7206-4463-9c01-55bca9470572 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:24.720864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-52d88172-7206-4463-9c01-55bca9470572 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:24.728066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52d88172-7206-4463-9c01-55bca9470572 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:24.728550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52d88172-7206-4463-9c01-55bca9470572 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:24.728983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52d88172-7206-4463-9c01-55bca9470572 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:24.729675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52d88172-7206-4463-9c01-55bca9470572 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:24.730128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52d88172-7206-4463-9c01-55bca9470572 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:24.730553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52d88172-7206-4463-9c01-55bca9470572 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:24.791589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-da3e49fa-59f7-4da7-8619-edd9e4d8d7a8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:24.799667 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-da3e49fa-59f7-4da7-8619-edd9e4d8d7a8 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1" status: 200 len: 1314 microversion: 2.1 time: 0.157322 Oct 12 22:40:24.800239 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2910/6459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:24 2022] GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:24.864956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-52d88172-7206-4463-9c01-55bca9470572 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:24.872764 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-52d88172-7206-4463-9c01-55bca9470572 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1202 microversion: 2.1 time: 0.156503 Oct 12 22:40:24.873348 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3550/6460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:24 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:25.821914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1a65247-bd65-4a26-9780-321eb0ea3206 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:25.822749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a1a65247-bd65-4a26-9780-321eb0ea3206 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: 2508c04b-0bc3-4d90-9e07-1f2d631c77d1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:25.829497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1a65247-bd65-4a26-9780-321eb0ea3206 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:25.829976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1a65247-bd65-4a26-9780-321eb0ea3206 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:25.830409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1a65247-bd65-4a26-9780-321eb0ea3206 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:25.831101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1a65247-bd65-4a26-9780-321eb0ea3206 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:25.831572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1a65247-bd65-4a26-9780-321eb0ea3206 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:25.831997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1a65247-bd65-4a26-9780-321eb0ea3206 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:25.897024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a0e0e387-5be8-4f31-a15d-8da635a3ce38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:25.897639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a0e0e387-5be8-4f31-a15d-8da635a3ce38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:25.899574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:25.900239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=24 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:25.907168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0e0e387-5be8-4f31-a15d-8da635a3ce38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:25.907675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0e0e387-5be8-4f31-a15d-8da635a3ce38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:25.908114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0e0e387-5be8-4f31-a15d-8da635a3ce38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:25.908811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0e0e387-5be8-4f31-a15d-8da635a3ce38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:25.909263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0e0e387-5be8-4f31-a15d-8da635a3ce38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:25.909688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0e0e387-5be8-4f31-a15d-8da635a3ce38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:25.965213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a1a65247-bd65-4a26-9780-321eb0ea3206 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:25.972877 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a1a65247-bd65-4a26-9780-321eb0ea3206 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1" status: 200 len: 1314 microversion: 2.1 time: 0.154866 Oct 12 22:40:25.973470 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2911/6461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:25 2022] GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:26.038518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a0e0e387-5be8-4f31-a15d-8da635a3ce38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:26.046425 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a0e0e387-5be8-4f31-a15d-8da635a3ce38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1202 microversion: 2.1 time: 0.153442 Oct 12 22:40:26.047016 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3551/6462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:25 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:26.610900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-631c73ba-8bd5-43b3-a1e4-7a2dc2d6a7df req-72161008-4f9e-4ec7-a3b7-326698c7b8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2508c04b-0bc3-4d90-9e07-1f2d631c77d1", "name": "network-vif-plugged", "status": "completed", "tag": "9bd369f3-baee-4295-a7d2-c8850106c721"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:26.620354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-631c73ba-8bd5-43b3-a1e4-7a2dc2d6a7df req-72161008-4f9e-4ec7-a3b7-326698c7b8c7 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:26.620830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-631c73ba-8bd5-43b3-a1e4-7a2dc2d6a7df req-72161008-4f9e-4ec7-a3b7-326698c7b8c7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:26.621258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-631c73ba-8bd5-43b3-a1e4-7a2dc2d6a7df req-72161008-4f9e-4ec7-a3b7-326698c7b8c7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:26.632976 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-631c73ba-8bd5-43b3-a1e4-7a2dc2d6a7df req-72161008-4f9e-4ec7-a3b7-326698c7b8c7 service nova] Creating event network-vif-plugged:9bd369f3-baee-4295-a7d2-c8850106c721 for instance 2508c04b-0bc3-4d90-9e07-1f2d631c77d1 on n-h1-861111-1 Oct 12 22:40:26.637645 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-631c73ba-8bd5-43b3-a1e4-7a2dc2d6a7df req-72161008-4f9e-4ec7-a3b7-326698c7b8c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030462 Oct 12 22:40:26.638241 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2912/6463] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:26.996743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b91317fe-138d-4bb8-875f-49da14fc1ea9 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:26.997439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b91317fe-138d-4bb8-875f-49da14fc1ea9 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: 2508c04b-0bc3-4d90-9e07-1f2d631c77d1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:27.004305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b91317fe-138d-4bb8-875f-49da14fc1ea9 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:27.004820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b91317fe-138d-4bb8-875f-49da14fc1ea9 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:27.005262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b91317fe-138d-4bb8-875f-49da14fc1ea9 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:27.005968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b91317fe-138d-4bb8-875f-49da14fc1ea9 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:27.006454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b91317fe-138d-4bb8-875f-49da14fc1ea9 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:27.007565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b91317fe-138d-4bb8-875f-49da14fc1ea9 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:27.071795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8421d22c-2662-4f86-99c1-fd85daaa0242 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:27.072905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8421d22c-2662-4f86-99c1-fd85daaa0242 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:27.080117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8421d22c-2662-4f86-99c1-fd85daaa0242 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:27.080604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8421d22c-2662-4f86-99c1-fd85daaa0242 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:27.081047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8421d22c-2662-4f86-99c1-fd85daaa0242 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:27.081746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8421d22c-2662-4f86-99c1-fd85daaa0242 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:27.082199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8421d22c-2662-4f86-99c1-fd85daaa0242 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:27.082623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8421d22c-2662-4f86-99c1-fd85daaa0242 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:27.147764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b91317fe-138d-4bb8-875f-49da14fc1ea9 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:27.156060 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b91317fe-138d-4bb8-875f-49da14fc1ea9 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1" status: 200 len: 1314 microversion: 2.1 time: 0.163457 Oct 12 22:40:27.156669 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3552/6464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:26 2022] GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:27.222560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8421d22c-2662-4f86-99c1-fd85daaa0242 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:27.230913 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8421d22c-2662-4f86-99c1-fd85daaa0242 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1202 microversion: 2.1 time: 0.165766 Oct 12 22:40:27.231512 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2913/6465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:27 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:28.179130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02deca53-3089-4092-8f3f-0b7f777c9596 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:28.179781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-02deca53-3089-4092-8f3f-0b7f777c9596 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: 2508c04b-0bc3-4d90-9e07-1f2d631c77d1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:28.186719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02deca53-3089-4092-8f3f-0b7f777c9596 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:28.188692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02deca53-3089-4092-8f3f-0b7f777c9596 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:28.188692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02deca53-3089-4092-8f3f-0b7f777c9596 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:28.188692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02deca53-3089-4092-8f3f-0b7f777c9596 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:28.190017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02deca53-3089-4092-8f3f-0b7f777c9596 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:28.190447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02deca53-3089-4092-8f3f-0b7f777c9596 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:28.254239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-331f0d8a-2728-46d5-b515-ef62eccf9425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:28.254838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-331f0d8a-2728-46d5-b515-ef62eccf9425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:28.257364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:28.258907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=10 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:28.264258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-331f0d8a-2728-46d5-b515-ef62eccf9425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:28.264746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-331f0d8a-2728-46d5-b515-ef62eccf9425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:28.265186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-331f0d8a-2728-46d5-b515-ef62eccf9425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:28.265891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-331f0d8a-2728-46d5-b515-ef62eccf9425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:28.266345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-331f0d8a-2728-46d5-b515-ef62eccf9425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:28.266772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-331f0d8a-2728-46d5-b515-ef62eccf9425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:28.327922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-02deca53-3089-4092-8f3f-0b7f777c9596 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:28.335862 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-02deca53-3089-4092-8f3f-0b7f777c9596 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1" status: 200 len: 1497 microversion: 2.1 time: 0.160657 Oct 12 22:40:28.336441 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3553/6466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:28 2022] GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1 => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:28.405289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-331f0d8a-2728-46d5-b515-ef62eccf9425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:28.413408 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-331f0d8a-2728-46d5-b515-ef62eccf9425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1202 microversion: 2.1 time: 0.163242 Oct 12 22:40:28.413989 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2914/6467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:28 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:28.747037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-51749489-2ba3-431e-8bcd-ea0a733841da tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:28.747566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-51749489-2ba3-431e-8bcd-ea0a733841da tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: 2508c04b-0bc3-4d90-9e07-1f2d631c77d1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:28.753444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51749489-2ba3-431e-8bcd-ea0a733841da tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:28.753923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51749489-2ba3-431e-8bcd-ea0a733841da tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:28.754361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51749489-2ba3-431e-8bcd-ea0a733841da tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:28.755074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51749489-2ba3-431e-8bcd-ea0a733841da tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:28.755554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51749489-2ba3-431e-8bcd-ea0a733841da tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:28.755980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51749489-2ba3-431e-8bcd-ea0a733841da tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:28.782267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-51749489-2ba3-431e-8bcd-ea0a733841da tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: 2508c04b-0bc3-4d90-9e07-1f2d631c77d1] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:40:28.857114 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-51749489-2ba3-431e-8bcd-ea0a733841da tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1" status: 204 len: 0 microversion: 2.1 time: 0.113484 Oct 12 22:40:28.857869 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3554/6468] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:40:28 2022] DELETE /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:40:28.866774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c27349bc-bc28-4bc0-90d0-b280962849e7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:28.867434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c27349bc-bc28-4bc0-90d0-b280962849e7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: 2508c04b-0bc3-4d90-9e07-1f2d631c77d1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:28.873369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c27349bc-bc28-4bc0-90d0-b280962849e7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:28.873851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c27349bc-bc28-4bc0-90d0-b280962849e7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:28.874288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c27349bc-bc28-4bc0-90d0-b280962849e7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:28.874973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c27349bc-bc28-4bc0-90d0-b280962849e7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:28.875457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c27349bc-bc28-4bc0-90d0-b280962849e7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:28.875882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c27349bc-bc28-4bc0-90d0-b280962849e7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:28.893447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:29.004490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c27349bc-bc28-4bc0-90d0-b280962849e7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:29.012239 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c27349bc-bc28-4bc0-90d0-b280962849e7 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1" status: 200 len: 1503 microversion: 2.1 time: 0.150026 Oct 12 22:40:29.012811 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2915/6469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:28 2022] GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:29.437272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e154d3f2-ea32-484b-8b6f-352bf26faacc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:29.437983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e154d3f2-ea32-484b-8b6f-352bf26faacc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:29.445295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e154d3f2-ea32-484b-8b6f-352bf26faacc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:29.445778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e154d3f2-ea32-484b-8b6f-352bf26faacc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:29.446211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e154d3f2-ea32-484b-8b6f-352bf26faacc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:29.446899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e154d3f2-ea32-484b-8b6f-352bf26faacc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:29.447638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e154d3f2-ea32-484b-8b6f-352bf26faacc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:29.448070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e154d3f2-ea32-484b-8b6f-352bf26faacc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:29.575225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e154d3f2-ea32-484b-8b6f-352bf26faacc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:29.583176 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e154d3f2-ea32-484b-8b6f-352bf26faacc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1202 microversion: 2.1 time: 0.150234 Oct 12 22:40:29.583803 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3555/6470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:29 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:30.035534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-32b9c108-52f3-4c6f-90ac-63b0d58e67d3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:30.036087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-32b9c108-52f3-4c6f-90ac-63b0d58e67d3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: 2508c04b-0bc3-4d90-9e07-1f2d631c77d1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:30.042916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32b9c108-52f3-4c6f-90ac-63b0d58e67d3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:30.043560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32b9c108-52f3-4c6f-90ac-63b0d58e67d3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:30.044059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32b9c108-52f3-4c6f-90ac-63b0d58e67d3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:30.044759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32b9c108-52f3-4c6f-90ac-63b0d58e67d3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:30.045219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32b9c108-52f3-4c6f-90ac-63b0d58e67d3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:30.045643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32b9c108-52f3-4c6f-90ac-63b0d58e67d3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:30.180857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-32b9c108-52f3-4c6f-90ac-63b0d58e67d3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:30.188618 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-32b9c108-52f3-4c6f-90ac-63b0d58e67d3 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1" status: 200 len: 1503 microversion: 2.1 time: 0.157167 Oct 12 22:40:30.189205 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2916/6471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:30 2022] GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:30.607063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-733437ab-2206-49d2-b5ca-430c49af68d5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:30.607661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-733437ab-2206-49d2-b5ca-430c49af68d5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:30.614521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-733437ab-2206-49d2-b5ca-430c49af68d5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:30.615016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-733437ab-2206-49d2-b5ca-430c49af68d5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:30.615494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-733437ab-2206-49d2-b5ca-430c49af68d5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:30.616206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-733437ab-2206-49d2-b5ca-430c49af68d5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:30.616664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-733437ab-2206-49d2-b5ca-430c49af68d5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:30.617097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-733437ab-2206-49d2-b5ca-430c49af68d5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:30.710994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-aea391b8-e94b-4b48-8b39-3fce273ab861 req-4a0a683f-c234-4df8-a91c-1c3e2caf2ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2508c04b-0bc3-4d90-9e07-1f2d631c77d1", "name": "network-vif-deleted", "tag": "9bd369f3-baee-4295-a7d2-c8850106c721"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:30.721003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-aea391b8-e94b-4b48-8b39-3fce273ab861 req-4a0a683f-c234-4df8-a91c-1c3e2caf2ef4 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:30.721826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-aea391b8-e94b-4b48-8b39-3fce273ab861 req-4a0a683f-c234-4df8-a91c-1c3e2caf2ef4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:30.722264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-aea391b8-e94b-4b48-8b39-3fce273ab861 req-4a0a683f-c234-4df8-a91c-1c3e2caf2ef4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:30.735150 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-aea391b8-e94b-4b48-8b39-3fce273ab861 req-4a0a683f-c234-4df8-a91c-1c3e2caf2ef4 service nova] Creating event network-vif-deleted:9bd369f3-baee-4295-a7d2-c8850106c721 for instance 2508c04b-0bc3-4d90-9e07-1f2d631c77d1 on n-h1-861111-1 Oct 12 22:40:30.740695 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-aea391b8-e94b-4b48-8b39-3fce273ab861 req-4a0a683f-c234-4df8-a91c-1c3e2caf2ef4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033815 Oct 12 22:40:30.741996 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2917/6472] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:30.767909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-733437ab-2206-49d2-b5ca-430c49af68d5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:30.776695 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-733437ab-2206-49d2-b5ca-430c49af68d5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1202 microversion: 2.1 time: 0.173759 Oct 12 22:40:30.777388 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3556/6473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:30 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1202 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:31.213693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-88aedae4-af80-48bf-a62d-1a88cd172831 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:31.214307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-88aedae4-af80-48bf-a62d-1a88cd172831 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: 2508c04b-0bc3-4d90-9e07-1f2d631c77d1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:31.220455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88aedae4-af80-48bf-a62d-1a88cd172831 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:31.220904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88aedae4-af80-48bf-a62d-1a88cd172831 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:31.221331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88aedae4-af80-48bf-a62d-1a88cd172831 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:31.222010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88aedae4-af80-48bf-a62d-1a88cd172831 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:31.222456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88aedae4-af80-48bf-a62d-1a88cd172831 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:31.222878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88aedae4-af80-48bf-a62d-1a88cd172831 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:31.254650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88aedae4-af80-48bf-a62d-1a88cd172831 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:31.255130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88aedae4-af80-48bf-a62d-1a88cd172831 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:31.255586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88aedae4-af80-48bf-a62d-1a88cd172831 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:31.256028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-88aedae4-af80-48bf-a62d-1a88cd172831 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lazy-loading 'fault' on Instance uuid 2508c04b-0bc3-4d90-9e07-1f2d631c77d1 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:40:31.302689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-88aedae4-af80-48bf-a62d-1a88cd172831 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5cd75eef94a44d3b62ab3db358cb06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bdbf1427b34fea8b69194fe2c77606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:31.310944 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-88aedae4-af80-48bf-a62d-1a88cd172831 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1" status: 200 len: 1304 microversion: 2.1 time: 0.103043 Oct 12 22:40:31.311584 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2918/6474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:31 2022] GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:31.800961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c4a8a8b9-be6b-4e4f-8560-b898d21e55bd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:31.801747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c4a8a8b9-be6b-4e4f-8560-b898d21e55bd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:31.810259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4a8a8b9-be6b-4e4f-8560-b898d21e55bd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:31.810879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4a8a8b9-be6b-4e4f-8560-b898d21e55bd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:31.811457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4a8a8b9-be6b-4e4f-8560-b898d21e55bd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:31.812481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4a8a8b9-be6b-4e4f-8560-b898d21e55bd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:31.812948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4a8a8b9-be6b-4e4f-8560-b898d21e55bd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:31.813385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4a8a8b9-be6b-4e4f-8560-b898d21e55bd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:31.949131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c4a8a8b9-be6b-4e4f-8560-b898d21e55bd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:31.957052 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c4a8a8b9-be6b-4e4f-8560-b898d21e55bd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1202 microversion: 2.1 time: 0.160610 Oct 12 22:40:31.957649 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3557/6475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:31 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:32.335282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-37e4bfbc-255d-407e-8eb5-e018f24caa32 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:32.335852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-37e4bfbc-255d-407e-8eb5-e018f24caa32 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] [instance: 2508c04b-0bc3-4d90-9e07-1f2d631c77d1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:32.342573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37e4bfbc-255d-407e-8eb5-e018f24caa32 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:32.343061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37e4bfbc-255d-407e-8eb5-e018f24caa32 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:32.343542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37e4bfbc-255d-407e-8eb5-e018f24caa32 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:32.344239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37e4bfbc-255d-407e-8eb5-e018f24caa32 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:32.344702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37e4bfbc-255d-407e-8eb5-e018f24caa32 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:32.345133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-37e4bfbc-255d-407e-8eb5-e018f24caa32 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:32.358980 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-37e4bfbc-255d-407e-8eb5-e018f24caa32 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] HTTP exception thrown: Instance 2508c04b-0bc3-4d90-9e07-1f2d631c77d1 could not be found. Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-37e4bfbc-255d-407e-8eb5-e018f24caa32 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Request method failure captured: Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1 HTTP/1.1 Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0I-F19rtwfDDTl6s_g5oz5dskRqqXDpCwZmas6O0pBn78njl9uNg2t_07j0N512C0HvMLa2LojlXV79XAd6pZqadR2YtoXp6fbumLnP2j5D_UkHeO2MfCSY-5nL7nt0HEDP7Q8RhflPyHDmbgYiEsXqz3pkTwplbMmglhFH1atRgao Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 63bdbf1427b34fea8b69194fe2c77606 Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesActionsTest-817658301 Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63bdbf1427b34fea8b69194fe2c77606"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63bdbf1427b34fea8b69194fe2c77606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_63bdbf1427b34fea8b69194fe2c77606", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/63bdbf1427b34fea8b69194fe2c77606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-VolumesActionsTest-817658301 Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 63bdbf1427b34fea8b69194fe2c77606 Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesActionsTest-817658301 Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-VolumesActionsTest-817658301-project Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: f5cd75eef94a44d3b62ab3db358cb06c Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-VolumesActionsTest-817658301-project Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 2508c04b-0bc3-4d90-9e07-1f2d631c77d1 could not be found. Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '2508c04b-0bc3-4d90-9e07-1f2d631c77d1'} Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2508c04b-0bc3-4d90-9e07-1f2d631c77d1 could not be found. Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2508c04b-0bc3-4d90-9e07-1f2d631c77d1 could not be found. Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:40:32.360672 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:40:32.365837 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:40:32.365837 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:40:32.365837 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:40:32.365837 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:40:32.365837 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:40:32.365837 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2508c04b-0bc3-4d90-9e07-1f2d631c77d1 could not be found. Oct 12 22:40:32.365837 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:40:32.365837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-37e4bfbc-255d-407e-8eb5-e018f24caa32 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] Returning 404 to user: Instance 2508c04b-0bc3-4d90-9e07-1f2d631c77d1 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:40:32.365837 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-37e4bfbc-255d-407e-8eb5-e018f24caa32 tempest-VolumesActionsTest-817658301 tempest-VolumesActionsTest-817658301-project] 10.222.0.16 "GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1" status: 404 len: 111 microversion: 2.1 time: 0.031385 Oct 12 22:40:32.365837 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2919/6476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:32 2022] GET /compute/v2.1/servers/2508c04b-0bc3-4d90-9e07-1f2d631c77d1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:40:32.979647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-787e1782-33e1-4285-9e0a-ed600369ec77 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:32.980413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-787e1782-33e1-4285-9e0a-ed600369ec77 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:32.987195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-787e1782-33e1-4285-9e0a-ed600369ec77 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:32.987707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-787e1782-33e1-4285-9e0a-ed600369ec77 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:32.988148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-787e1782-33e1-4285-9e0a-ed600369ec77 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:32.988844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-787e1782-33e1-4285-9e0a-ed600369ec77 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:32.989763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-787e1782-33e1-4285-9e0a-ed600369ec77 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:32.990194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-787e1782-33e1-4285-9e0a-ed600369ec77 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:33.132753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-787e1782-33e1-4285-9e0a-ed600369ec77 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:33.141071 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-787e1782-33e1-4285-9e0a-ed600369ec77 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1202 microversion: 2.1 time: 0.165165 Oct 12 22:40:33.141575 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3558/6477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:32 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1202 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:33.666427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-48aae216-96d7-4a4c-b8b7-3343822465e8 req-d5779bc7-4d5a-4136-81fa-4fdeb13724b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756515be-f978-463e-beba-f9dbbf55edbb", "name": "network-vif-plugged", "status": "completed", "tag": "54d957b3-e62a-44c3-a5aa-4f2aaffd7f70"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:33.679803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-48aae216-96d7-4a4c-b8b7-3343822465e8 req-d5779bc7-4d5a-4136-81fa-4fdeb13724b2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:33.680960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-48aae216-96d7-4a4c-b8b7-3343822465e8 req-d5779bc7-4d5a-4136-81fa-4fdeb13724b2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:33.682071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-48aae216-96d7-4a4c-b8b7-3343822465e8 req-d5779bc7-4d5a-4136-81fa-4fdeb13724b2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:33.697816 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-48aae216-96d7-4a4c-b8b7-3343822465e8 req-d5779bc7-4d5a-4136-81fa-4fdeb13724b2 service nova] Creating event network-vif-plugged:54d957b3-e62a-44c3-a5aa-4f2aaffd7f70 for instance 756515be-f978-463e-beba-f9dbbf55edbb on n-h2-861111-1 Oct 12 22:40:33.704875 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-48aae216-96d7-4a4c-b8b7-3343822465e8 req-d5779bc7-4d5a-4136-81fa-4fdeb13724b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048189 Oct 12 22:40:33.706006 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2920/6478] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:40:34.163781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8d91b7e8-474d-49e9-b5ce-f993625650bb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:34.165707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8d91b7e8-474d-49e9-b5ce-f993625650bb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:34.174293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d91b7e8-474d-49e9-b5ce-f993625650bb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:34.175280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d91b7e8-474d-49e9-b5ce-f993625650bb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:34.175685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d91b7e8-474d-49e9-b5ce-f993625650bb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:34.176828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d91b7e8-474d-49e9-b5ce-f993625650bb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:34.177658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d91b7e8-474d-49e9-b5ce-f993625650bb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:34.178116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d91b7e8-474d-49e9-b5ce-f993625650bb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:34.333168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8d91b7e8-474d-49e9-b5ce-f993625650bb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:34.335550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:34.343036 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8d91b7e8-474d-49e9-b5ce-f993625650bb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1202 microversion: 2.1 time: 0.184090 Oct 12 22:40:34.344194 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3559/6479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:34 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1202 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:35.367758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a9e4c3f6-5364-44ef-bec6-abe4c2976c83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:35.369178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a9e4c3f6-5364-44ef-bec6-abe4c2976c83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:35.375916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9e4c3f6-5364-44ef-bec6-abe4c2976c83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:35.376645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9e4c3f6-5364-44ef-bec6-abe4c2976c83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:35.377264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9e4c3f6-5364-44ef-bec6-abe4c2976c83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:35.378149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9e4c3f6-5364-44ef-bec6-abe4c2976c83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:35.378842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9e4c3f6-5364-44ef-bec6-abe4c2976c83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:35.380013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a9e4c3f6-5364-44ef-bec6-abe4c2976c83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:35.526658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a9e4c3f6-5364-44ef-bec6-abe4c2976c83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:35.539102 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a9e4c3f6-5364-44ef-bec6-abe4c2976c83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1389 microversion: 2.1 time: 0.176909 Oct 12 22:40:35.540241 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2921/6480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:35 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1389 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:35.565828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8285ebd0-5928-4576-8692-8da4579b2f3a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:35.566978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8285ebd0-5928-4576-8692-8da4579b2f3a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:35.577786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8285ebd0-5928-4576-8692-8da4579b2f3a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:35.578291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8285ebd0-5928-4576-8692-8da4579b2f3a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:35.578739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8285ebd0-5928-4576-8692-8da4579b2f3a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:35.579486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8285ebd0-5928-4576-8692-8da4579b2f3a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:35.580150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8285ebd0-5928-4576-8692-8da4579b2f3a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:35.580756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8285ebd0-5928-4576-8692-8da4579b2f3a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:35.752121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8285ebd0-5928-4576-8692-8da4579b2f3a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:35.772442 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8285ebd0-5928-4576-8692-8da4579b2f3a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1389 microversion: 2.1 time: 0.210366 Oct 12 22:40:35.773235 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3560/6481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:35 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1389 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:35.794791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c9ba1e6a-8456-43b6-a7d0-15208d415f58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:35.795647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c9ba1e6a-8456-43b6-a7d0-15208d415f58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:35.798012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:35.806554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9ba1e6a-8456-43b6-a7d0-15208d415f58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:35.807347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9ba1e6a-8456-43b6-a7d0-15208d415f58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:35.808027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9ba1e6a-8456-43b6-a7d0-15208d415f58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:35.808858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9ba1e6a-8456-43b6-a7d0-15208d415f58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:35.809395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9ba1e6a-8456-43b6-a7d0-15208d415f58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:35.809902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9ba1e6a-8456-43b6-a7d0-15208d415f58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:35.967757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c9ba1e6a-8456-43b6-a7d0-15208d415f58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:35.978846 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c9ba1e6a-8456-43b6-a7d0-15208d415f58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1389 microversion: 2.1 time: 0.187753 Oct 12 22:40:35.979767 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2922/6482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:35 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1389 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:36.002364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0970cd0b-d3f8-4a75-9b95-9173577daa4e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:36.002794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0970cd0b-d3f8-4a75-9b95-9173577daa4e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:36.010564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0970cd0b-d3f8-4a75-9b95-9173577daa4e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:36.011058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0970cd0b-d3f8-4a75-9b95-9173577daa4e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:36.011725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0970cd0b-d3f8-4a75-9b95-9173577daa4e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:36.012629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0970cd0b-d3f8-4a75-9b95-9173577daa4e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:36.013092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0970cd0b-d3f8-4a75-9b95-9173577daa4e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:36.013705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0970cd0b-d3f8-4a75-9b95-9173577daa4e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:36.044114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0970cd0b-d3f8-4a75-9b95-9173577daa4e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:40:36.151979 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0970cd0b-d3f8-4a75-9b95-9173577daa4e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "DELETE /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 204 len: 0 microversion: 2.1 time: 0.153074 Oct 12 22:40:36.155610 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3561/6483] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:40:35 2022] DELETE /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:40:36.163104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-be768426-0fca-4a98-8530-3c50daeb293f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:36.163815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-be768426-0fca-4a98-8530-3c50daeb293f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:36.189575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be768426-0fca-4a98-8530-3c50daeb293f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:36.191549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be768426-0fca-4a98-8530-3c50daeb293f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:36.192213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be768426-0fca-4a98-8530-3c50daeb293f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:36.192972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be768426-0fca-4a98-8530-3c50daeb293f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:36.198922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be768426-0fca-4a98-8530-3c50daeb293f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:36.199459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be768426-0fca-4a98-8530-3c50daeb293f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:36.374977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-be768426-0fca-4a98-8530-3c50daeb293f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:36.386118 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-be768426-0fca-4a98-8530-3c50daeb293f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1395 microversion: 2.1 time: 0.227922 Oct 12 22:40:36.388070 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2923/6484] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:36 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1395 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:37.411827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2dd9cd01-fd95-42d2-abb7-1dd73feead5a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:37.413132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2dd9cd01-fd95-42d2-abb7-1dd73feead5a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:37.424020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dd9cd01-fd95-42d2-abb7-1dd73feead5a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:37.424521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dd9cd01-fd95-42d2-abb7-1dd73feead5a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:37.424965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dd9cd01-fd95-42d2-abb7-1dd73feead5a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:37.425685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dd9cd01-fd95-42d2-abb7-1dd73feead5a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:37.426146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dd9cd01-fd95-42d2-abb7-1dd73feead5a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:37.426582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2dd9cd01-fd95-42d2-abb7-1dd73feead5a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:37.592507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2dd9cd01-fd95-42d2-abb7-1dd73feead5a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:37.601381 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2dd9cd01-fd95-42d2-abb7-1dd73feead5a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1395 microversion: 2.1 time: 0.194595 Oct 12 22:40:37.604163 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3562/6485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:37 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1395 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:38.370145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-591f51b4-65c4-4c46-87cc-94d5f9d9939d req-fe65971f-8866-42d8-a44a-82eec9e07466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756515be-f978-463e-beba-f9dbbf55edbb", "name": "network-vif-deleted", "tag": "54d957b3-e62a-44c3-a5aa-4f2aaffd7f70"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:38.407501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-591f51b4-65c4-4c46-87cc-94d5f9d9939d req-fe65971f-8866-42d8-a44a-82eec9e07466 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:38.415187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-591f51b4-65c4-4c46-87cc-94d5f9d9939d req-fe65971f-8866-42d8-a44a-82eec9e07466 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:38.416098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-591f51b4-65c4-4c46-87cc-94d5f9d9939d req-fe65971f-8866-42d8-a44a-82eec9e07466 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:38.438723 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-591f51b4-65c4-4c46-87cc-94d5f9d9939d req-fe65971f-8866-42d8-a44a-82eec9e07466 service nova] Creating event network-vif-deleted:54d957b3-e62a-44c3-a5aa-4f2aaffd7f70 for instance 756515be-f978-463e-beba-f9dbbf55edbb on n-h2-861111-1 Oct 12 22:40:38.444326 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-591f51b4-65c4-4c46-87cc-94d5f9d9939d req-fe65971f-8866-42d8-a44a-82eec9e07466 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079269 Oct 12 22:40:38.445197 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2924/6486] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:38.626392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bfe586d2-82ba-4d81-9a60-be9f2ad808c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:38.626964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bfe586d2-82ba-4d81-9a60-be9f2ad808c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:38.635054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:38.640535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfe586d2-82ba-4d81-9a60-be9f2ad808c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:38.641041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfe586d2-82ba-4d81-9a60-be9f2ad808c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:38.641594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfe586d2-82ba-4d81-9a60-be9f2ad808c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:38.642197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfe586d2-82ba-4d81-9a60-be9f2ad808c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:38.642658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfe586d2-82ba-4d81-9a60-be9f2ad808c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:38.643092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfe586d2-82ba-4d81-9a60-be9f2ad808c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:38.723137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bfe586d2-82ba-4d81-9a60-be9f2ad808c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:38.732908 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bfe586d2-82ba-4d81-9a60-be9f2ad808c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1187 microversion: 2.1 time: 0.110698 Oct 12 22:40:38.733929 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3563/6487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:38 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1187 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:39.763554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-64abf948-9998-4253-b831-57983e588d5b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:39.765238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-64abf948-9998-4253-b831-57983e588d5b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:39.779828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64abf948-9998-4253-b831-57983e588d5b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:39.780320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64abf948-9998-4253-b831-57983e588d5b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:39.780757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64abf948-9998-4253-b831-57983e588d5b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:39.781473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64abf948-9998-4253-b831-57983e588d5b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:39.781923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64abf948-9998-4253-b831-57983e588d5b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:39.782404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64abf948-9998-4253-b831-57983e588d5b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:39.861294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-64abf948-9998-4253-b831-57983e588d5b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:39.861294 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-64abf948-9998-4253-b831-57983e588d5b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1187 microversion: 2.1 time: 0.107493 Oct 12 22:40:39.861294 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2925/6488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:39 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1187 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:40.895201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e71ffaa8-8bad-46e7-8139-ca5bb7f5453f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:40.896912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e71ffaa8-8bad-46e7-8139-ca5bb7f5453f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:40.914219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e71ffaa8-8bad-46e7-8139-ca5bb7f5453f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:40.915515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e71ffaa8-8bad-46e7-8139-ca5bb7f5453f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:40.916614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e71ffaa8-8bad-46e7-8139-ca5bb7f5453f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:40.918573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e71ffaa8-8bad-46e7-8139-ca5bb7f5453f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:40.921052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e71ffaa8-8bad-46e7-8139-ca5bb7f5453f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:40.923677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e71ffaa8-8bad-46e7-8139-ca5bb7f5453f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:41.040248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e71ffaa8-8bad-46e7-8139-ca5bb7f5453f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:41.065806 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e71ffaa8-8bad-46e7-8139-ca5bb7f5453f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1187 microversion: 2.1 time: 0.174505 Oct 12 22:40:41.066714 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3564/6489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:40 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1187 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:42.090835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-96c198dc-787f-4ebb-b7d6-80817973dd6b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:42.093063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-96c198dc-787f-4ebb-b7d6-80817973dd6b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:42.110154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96c198dc-787f-4ebb-b7d6-80817973dd6b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:42.113266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96c198dc-787f-4ebb-b7d6-80817973dd6b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:42.114030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96c198dc-787f-4ebb-b7d6-80817973dd6b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:42.123581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96c198dc-787f-4ebb-b7d6-80817973dd6b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:42.124074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96c198dc-787f-4ebb-b7d6-80817973dd6b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:42.124518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96c198dc-787f-4ebb-b7d6-80817973dd6b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:42.212040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-96c198dc-787f-4ebb-b7d6-80817973dd6b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:42.220565 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-96c198dc-787f-4ebb-b7d6-80817973dd6b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1187 microversion: 2.1 time: 0.134366 Oct 12 22:40:42.223614 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2926/6490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:42 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1187 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:43.249599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-69600f00-df91-4ea8-898d-04f951aed774 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:43.251682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-69600f00-df91-4ea8-898d-04f951aed774 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:43.261647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69600f00-df91-4ea8-898d-04f951aed774 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:43.262405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69600f00-df91-4ea8-898d-04f951aed774 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:43.262898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69600f00-df91-4ea8-898d-04f951aed774 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:43.263859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69600f00-df91-4ea8-898d-04f951aed774 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:43.264333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69600f00-df91-4ea8-898d-04f951aed774 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:43.264803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69600f00-df91-4ea8-898d-04f951aed774 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:43.306287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69600f00-df91-4ea8-898d-04f951aed774 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:43.306777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69600f00-df91-4ea8-898d-04f951aed774 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:43.307546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-69600f00-df91-4ea8-898d-04f951aed774 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:43.308332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-69600f00-df91-4ea8-898d-04f951aed774 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lazy-loading 'fault' on Instance uuid 756515be-f978-463e-beba-f9dbbf55edbb {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:40:43.370304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-69600f00-df91-4ea8-898d-04f951aed774 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:43.384572 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-69600f00-df91-4ea8-898d-04f951aed774 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 200 len: 1192 microversion: 2.1 time: 0.140600 Oct 12 22:40:43.397767 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3565/6491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:43 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 1192 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:44.410121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3a3a977e-6863-4601-8334-bb8534fb9eb2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:44.410721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3a3a977e-6863-4601-8334-bb8534fb9eb2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 756515be-f978-463e-beba-f9dbbf55edbb] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:44.422413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a3a977e-6863-4601-8334-bb8534fb9eb2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:44.423253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a3a977e-6863-4601-8334-bb8534fb9eb2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:44.423926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a3a977e-6863-4601-8334-bb8534fb9eb2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:44.424688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a3a977e-6863-4601-8334-bb8534fb9eb2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:44.425224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a3a977e-6863-4601-8334-bb8534fb9eb2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:44.425729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a3a977e-6863-4601-8334-bb8534fb9eb2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:44.441582 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-3a3a977e-6863-4601-8334-bb8534fb9eb2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] HTTP exception thrown: Instance 756515be-f978-463e-beba-f9dbbf55edbb could not be found. Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3a3a977e-6863-4601-8334-bb8534fb9eb2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Request method failure captured: Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb HTTP/1.1 Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0IharzkU0EI5od_tYFYiimWbIhiU_Z2qWiELggh5UckxeqrnYnnrwzymqi7TUfpjzQhGi9AT7nHEyzZohAJui-4vZv6nTEy801Fmq2zP90o12d8oz0UHjyBxm9MxKWeYUrTwr-9KmypVoqQEOknLfZ_qBqmv_P1kjCeo-X5DoGtv6Y Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef79a1f4c33c46f1a7536c37f910e2b0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7d141d93d7a74a57b5b6475294c9af5e Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 756515be-f978-463e-beba-f9dbbf55edbb could not be found. Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '756515be-f978-463e-beba-f9dbbf55edbb'} Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 756515be-f978-463e-beba-f9dbbf55edbb could not be found. Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 756515be-f978-463e-beba-f9dbbf55edbb could not be found. Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:40:44.446226 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:40:44.454038 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:40:44.454038 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:40:44.454038 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:40:44.454038 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:40:44.454038 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:40:44.454038 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 756515be-f978-463e-beba-f9dbbf55edbb could not be found. Oct 12 22:40:44.454038 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:40:44.456034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3a3a977e-6863-4601-8334-bb8534fb9eb2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Returning 404 to user: Instance 756515be-f978-463e-beba-f9dbbf55edbb could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:40:44.457499 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3a3a977e-6863-4601-8334-bb8534fb9eb2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb" status: 404 len: 111 microversion: 2.1 time: 0.051533 Oct 12 22:40:44.458596 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2927/6492] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:44 2022] GET /compute/v2.1/servers/756515be-f978-463e-beba-f9dbbf55edbb => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:40:54.510862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f5da99cd-9a4c-4a57-a0a0-c7e194d5b96f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:54.515487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f5da99cd-9a4c-4a57-a0a0-c7e194d5b96f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:54.527527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=7 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:54.529283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:54.531743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5da99cd-9a4c-4a57-a0a0-c7e194d5b96f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:54.533475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5da99cd-9a4c-4a57-a0a0-c7e194d5b96f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:54.534431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5da99cd-9a4c-4a57-a0a0-c7e194d5b96f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:54.535417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5da99cd-9a4c-4a57-a0a0-c7e194d5b96f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:54.536060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5da99cd-9a4c-4a57-a0a0-c7e194d5b96f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:54.537205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f5da99cd-9a4c-4a57-a0a0-c7e194d5b96f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:54.603802 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f5da99cd-9a4c-4a57-a0a0-c7e194d5b96f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f/action" status: 200 len: 24569 microversion: 2.1 time: 0.097770 Oct 12 22:40:54.605318 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3566/6493] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:40:54 2022] POST /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f/action => generated 24569 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:41:08.078435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2113660702", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "00a4e78b-4901-408c-bba3-ead1081aa32b", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6d173dd3-914e-48d4-bcc2-81061c8da03d"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:08.089719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=11 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:08.090367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=56 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:08.170219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] validate_networks() for [('6d173dd3-914e-48d4-bcc2-81061c8da03d', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:41:08.554619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:41:08.555047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:41:08.555578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:41:08.555992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:41:08.556770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:41:08.565931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:08.566507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:08.566950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:08.567756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:08.568227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:08.568662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:08.585812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:41:08.591086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for user 7d141d93d7a74a57b5b6475294c9af5e and project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:41:08.604355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:41:08.606400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='00a4e78b-4901-408c-bba3-ead1081aa32b',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:41:08.680658 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1ee7b6f9-54c7-4803-b4a1-c5069e4dfa0a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606360 Oct 12 22:41:08.681356 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2928/6494] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:41:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:41:08.693293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-647c4d5c-b39a-497d-a8db-3dffdfa6de17 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:08.694100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-647c4d5c-b39a-497d-a8db-3dffdfa6de17 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:08.700247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:08.701136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:08.773318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-647c4d5c-b39a-497d-a8db-3dffdfa6de17 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:08.781649 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-647c4d5c-b39a-497d-a8db-3dffdfa6de17 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1057 microversion: 2.1 time: 0.092565 Oct 12 22:41:08.782436 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3567/6495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:08 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1057 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:09.805942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f7cc7d89-b724-41fd-a89f-3d0124b8aa13 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:09.806723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f7cc7d89-b724-41fd-a89f-3d0124b8aa13 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:09.814809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7cc7d89-b724-41fd-a89f-3d0124b8aa13 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:09.815578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7cc7d89-b724-41fd-a89f-3d0124b8aa13 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:09.816292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7cc7d89-b724-41fd-a89f-3d0124b8aa13 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:09.817823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7cc7d89-b724-41fd-a89f-3d0124b8aa13 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:09.818383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7cc7d89-b724-41fd-a89f-3d0124b8aa13 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:09.818908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f7cc7d89-b724-41fd-a89f-3d0124b8aa13 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:10.179557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f7cc7d89-b724-41fd-a89f-3d0124b8aa13 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:10.201672 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f7cc7d89-b724-41fd-a89f-3d0124b8aa13 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1127 microversion: 2.1 time: 0.397974 Oct 12 22:41:10.202403 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2929/6496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:09 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1127 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:11.227040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-97d726fa-34c0-42ca-926a-755f05f521f3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:11.228555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-97d726fa-34c0-42ca-926a-755f05f521f3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:11.237201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97d726fa-34c0-42ca-926a-755f05f521f3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:11.237961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97d726fa-34c0-42ca-926a-755f05f521f3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:11.238756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97d726fa-34c0-42ca-926a-755f05f521f3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:11.239777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97d726fa-34c0-42ca-926a-755f05f521f3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:11.240445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97d726fa-34c0-42ca-926a-755f05f521f3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:11.241449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97d726fa-34c0-42ca-926a-755f05f521f3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:11.397741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-97d726fa-34c0-42ca-926a-755f05f521f3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:11.407494 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-97d726fa-34c0-42ca-926a-755f05f521f3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1169 microversion: 2.1 time: 0.185165 Oct 12 22:41:11.424101 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3568/6497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:11 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1169 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:11.594495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-39388f2c-8984-4264-ad71-375499e0608f req-b060757d-435c-4e19-8b47-f57b32a3d24f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32578200-0a10-4b2f-8d76-a9d87447f1b7", "tag": "4c1d7c04-1313-44be-9b11-74469e6412f1"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:11.617826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-39388f2c-8984-4264-ad71-375499e0608f req-b060757d-435c-4e19-8b47-f57b32a3d24f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:11.619252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-39388f2c-8984-4264-ad71-375499e0608f req-b060757d-435c-4e19-8b47-f57b32a3d24f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:11.620433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-39388f2c-8984-4264-ad71-375499e0608f req-b060757d-435c-4e19-8b47-f57b32a3d24f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:11.638539 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-39388f2c-8984-4264-ad71-375499e0608f req-b060757d-435c-4e19-8b47-f57b32a3d24f service nova] Creating event network-changed:4c1d7c04-1313-44be-9b11-74469e6412f1 for instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 on n-h2-861111-1 Oct 12 22:41:11.646707 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-39388f2c-8984-4264-ad71-375499e0608f req-b060757d-435c-4e19-8b47-f57b32a3d24f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055885 Oct 12 22:41:11.654373 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2930/6498] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:12.431917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-52646244-c207-4875-93a5-a6e94b847539 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:12.433299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-52646244-c207-4875-93a5-a6e94b847539 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:12.445206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52646244-c207-4875-93a5-a6e94b847539 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:12.447853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52646244-c207-4875-93a5-a6e94b847539 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:12.449937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52646244-c207-4875-93a5-a6e94b847539 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:12.452644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52646244-c207-4875-93a5-a6e94b847539 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:12.453412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52646244-c207-4875-93a5-a6e94b847539 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:12.454123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52646244-c207-4875-93a5-a6e94b847539 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:12.599226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-52646244-c207-4875-93a5-a6e94b847539 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:12.611990 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-52646244-c207-4875-93a5-a6e94b847539 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1169 microversion: 2.1 time: 0.185773 Oct 12 22:41:12.613223 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3569/6499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:12 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1169 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:13.635608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f1772335-ed9f-4855-b1b3-1f87a2cd5b80 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:13.639679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f1772335-ed9f-4855-b1b3-1f87a2cd5b80 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:13.655301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1772335-ed9f-4855-b1b3-1f87a2cd5b80 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:13.656648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1772335-ed9f-4855-b1b3-1f87a2cd5b80 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:13.659142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1772335-ed9f-4855-b1b3-1f87a2cd5b80 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:13.660387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1772335-ed9f-4855-b1b3-1f87a2cd5b80 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:13.661635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1772335-ed9f-4855-b1b3-1f87a2cd5b80 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:13.663306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1772335-ed9f-4855-b1b3-1f87a2cd5b80 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:13.869119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f1772335-ed9f-4855-b1b3-1f87a2cd5b80 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:13.881642 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f1772335-ed9f-4855-b1b3-1f87a2cd5b80 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1169 microversion: 2.1 time: 0.251235 Oct 12 22:41:13.882319 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2931/6500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:13 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1169 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:14.916564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bc803067-c8c3-448d-ab5b-281ab4e77c3d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:14.918250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bc803067-c8c3-448d-ab5b-281ab4e77c3d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:14.926407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc803067-c8c3-448d-ab5b-281ab4e77c3d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:14.927303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc803067-c8c3-448d-ab5b-281ab4e77c3d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:14.928202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc803067-c8c3-448d-ab5b-281ab4e77c3d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:14.928924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc803067-c8c3-448d-ab5b-281ab4e77c3d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:14.929376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc803067-c8c3-448d-ab5b-281ab4e77c3d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:14.929996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc803067-c8c3-448d-ab5b-281ab4e77c3d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:15.122617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bc803067-c8c3-448d-ab5b-281ab4e77c3d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:15.132060 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bc803067-c8c3-448d-ab5b-281ab4e77c3d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1169 microversion: 2.1 time: 0.220282 Oct 12 22:41:15.132664 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3570/6501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:14 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1169 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:16.156964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-492d43e2-26c4-47d0-b785-4cccc55e862c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:16.157666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-492d43e2-26c4-47d0-b785-4cccc55e862c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:16.169008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-492d43e2-26c4-47d0-b785-4cccc55e862c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:16.172202 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-492d43e2-26c4-47d0-b785-4cccc55e862c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:16.172401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-492d43e2-26c4-47d0-b785-4cccc55e862c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:16.172952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-492d43e2-26c4-47d0-b785-4cccc55e862c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:16.173409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-492d43e2-26c4-47d0-b785-4cccc55e862c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:16.174437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-492d43e2-26c4-47d0-b785-4cccc55e862c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:16.375083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-492d43e2-26c4-47d0-b785-4cccc55e862c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:16.384626 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-492d43e2-26c4-47d0-b785-4cccc55e862c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1169 microversion: 2.1 time: 0.232343 Oct 12 22:41:16.385539 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2932/6502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:16 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1169 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:17.442663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e0a48466-c810-4a86-8c2a-180ae0f2a972 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:17.444179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e0a48466-c810-4a86-8c2a-180ae0f2a972 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:17.482148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0a48466-c810-4a86-8c2a-180ae0f2a972 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:17.482662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0a48466-c810-4a86-8c2a-180ae0f2a972 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:17.483110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0a48466-c810-4a86-8c2a-180ae0f2a972 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:17.487776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0a48466-c810-4a86-8c2a-180ae0f2a972 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:17.488288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0a48466-c810-4a86-8c2a-180ae0f2a972 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:17.489257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0a48466-c810-4a86-8c2a-180ae0f2a972 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:17.761184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e0a48466-c810-4a86-8c2a-180ae0f2a972 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:17.769177 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e0a48466-c810-4a86-8c2a-180ae0f2a972 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1169 microversion: 2.1 time: 0.360880 Oct 12 22:41:17.783267 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3571/6503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:17 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1169 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:18.794445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-feaa2dcd-99cc-4616-b2e9-07b46572c71d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:18.796455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-feaa2dcd-99cc-4616-b2e9-07b46572c71d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:18.800048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:18.802289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:18.811456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-feaa2dcd-99cc-4616-b2e9-07b46572c71d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:18.812061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-feaa2dcd-99cc-4616-b2e9-07b46572c71d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:18.812502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-feaa2dcd-99cc-4616-b2e9-07b46572c71d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:18.813256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-feaa2dcd-99cc-4616-b2e9-07b46572c71d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:18.813719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-feaa2dcd-99cc-4616-b2e9-07b46572c71d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:18.814150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-feaa2dcd-99cc-4616-b2e9-07b46572c71d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:18.972108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-feaa2dcd-99cc-4616-b2e9-07b46572c71d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:18.981803 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-feaa2dcd-99cc-4616-b2e9-07b46572c71d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1169 microversion: 2.1 time: 0.191413 Oct 12 22:41:18.982436 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2933/6504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:18 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1169 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:20.005964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7cc822df-2a29-4b92-ac25-c7dfc2fa55cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:20.006707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7cc822df-2a29-4b92-ac25-c7dfc2fa55cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:20.009712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:20.015632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cc822df-2a29-4b92-ac25-c7dfc2fa55cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:20.016266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cc822df-2a29-4b92-ac25-c7dfc2fa55cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:20.016715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cc822df-2a29-4b92-ac25-c7dfc2fa55cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:20.017446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cc822df-2a29-4b92-ac25-c7dfc2fa55cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:20.018111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cc822df-2a29-4b92-ac25-c7dfc2fa55cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:20.018547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7cc822df-2a29-4b92-ac25-c7dfc2fa55cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:20.161238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7cc822df-2a29-4b92-ac25-c7dfc2fa55cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:20.170027 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7cc822df-2a29-4b92-ac25-c7dfc2fa55cb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1169 microversion: 2.1 time: 0.168478 Oct 12 22:41:20.170626 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3572/6505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:20 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1169 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:21.194703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8e1e824e-bfb6-4e08-b69a-5d3b386b95c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:21.196204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8e1e824e-bfb6-4e08-b69a-5d3b386b95c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:21.204409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e1e824e-bfb6-4e08-b69a-5d3b386b95c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:21.205149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e1e824e-bfb6-4e08-b69a-5d3b386b95c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:21.205855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e1e824e-bfb6-4e08-b69a-5d3b386b95c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:21.206807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e1e824e-bfb6-4e08-b69a-5d3b386b95c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:21.208001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e1e824e-bfb6-4e08-b69a-5d3b386b95c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:21.208674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e1e824e-bfb6-4e08-b69a-5d3b386b95c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:21.350690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8e1e824e-bfb6-4e08-b69a-5d3b386b95c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:21.360720 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8e1e824e-bfb6-4e08-b69a-5d3b386b95c1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1169 microversion: 2.1 time: 0.170842 Oct 12 22:41:21.361462 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2934/6506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:21 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1169 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:22.383766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f3fb2513-ec66-45f0-9764-2d652b7f2185 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:22.384433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f3fb2513-ec66-45f0-9764-2d652b7f2185 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:22.391028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3fb2513-ec66-45f0-9764-2d652b7f2185 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:22.391536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3fb2513-ec66-45f0-9764-2d652b7f2185 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:22.391973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3fb2513-ec66-45f0-9764-2d652b7f2185 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:22.392669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3fb2513-ec66-45f0-9764-2d652b7f2185 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:22.393128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3fb2513-ec66-45f0-9764-2d652b7f2185 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:22.393554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3fb2513-ec66-45f0-9764-2d652b7f2185 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:22.541630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f3fb2513-ec66-45f0-9764-2d652b7f2185 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:22.549352 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f3fb2513-ec66-45f0-9764-2d652b7f2185 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1169 microversion: 2.1 time: 0.170133 Oct 12 22:41:22.550200 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3573/6507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:22 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1169 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:23.577111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ff70dbf2-7b4a-46b3-9049-7f55239f461d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:23.577918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ff70dbf2-7b4a-46b3-9049-7f55239f461d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:23.585701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff70dbf2-7b4a-46b3-9049-7f55239f461d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:23.586228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff70dbf2-7b4a-46b3-9049-7f55239f461d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:23.586908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff70dbf2-7b4a-46b3-9049-7f55239f461d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:23.587684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff70dbf2-7b4a-46b3-9049-7f55239f461d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:23.588146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff70dbf2-7b4a-46b3-9049-7f55239f461d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:23.588623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff70dbf2-7b4a-46b3-9049-7f55239f461d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:23.730209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ff70dbf2-7b4a-46b3-9049-7f55239f461d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:23.738858 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ff70dbf2-7b4a-46b3-9049-7f55239f461d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1169 microversion: 2.1 time: 0.164951 Oct 12 22:41:23.739455 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2935/6508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:23 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1169 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:24.761675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-171a0a1d-7ac3-404a-a56a-ec9017237d15 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:24.762288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-171a0a1d-7ac3-404a-a56a-ec9017237d15 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:24.771701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-171a0a1d-7ac3-404a-a56a-ec9017237d15 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:24.772230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-171a0a1d-7ac3-404a-a56a-ec9017237d15 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:24.773655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-171a0a1d-7ac3-404a-a56a-ec9017237d15 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:24.774362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-171a0a1d-7ac3-404a-a56a-ec9017237d15 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:24.774819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-171a0a1d-7ac3-404a-a56a-ec9017237d15 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:24.775269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-171a0a1d-7ac3-404a-a56a-ec9017237d15 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:24.911114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-171a0a1d-7ac3-404a-a56a-ec9017237d15 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:24.919762 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-171a0a1d-7ac3-404a-a56a-ec9017237d15 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1203 microversion: 2.1 time: 0.161922 Oct 12 22:41:24.920568 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3574/6509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:24 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:25.942095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0017e8b3-f721-4acb-83f8-bb6c422199ee tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:25.942686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0017e8b3-f721-4acb-83f8-bb6c422199ee tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:25.950124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0017e8b3-f721-4acb-83f8-bb6c422199ee tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:25.950696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0017e8b3-f721-4acb-83f8-bb6c422199ee tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:25.951220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0017e8b3-f721-4acb-83f8-bb6c422199ee tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:25.952036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0017e8b3-f721-4acb-83f8-bb6c422199ee tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:25.952563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0017e8b3-f721-4acb-83f8-bb6c422199ee tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:25.953058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0017e8b3-f721-4acb-83f8-bb6c422199ee tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:26.084210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0017e8b3-f721-4acb-83f8-bb6c422199ee tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:26.092146 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0017e8b3-f721-4acb-83f8-bb6c422199ee tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1203 microversion: 2.1 time: 0.153780 Oct 12 22:41:26.092742 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2936/6510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:25 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:27.116876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-071cc2e4-112f-4d37-b497-a9c05a845a60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:27.117504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-071cc2e4-112f-4d37-b497-a9c05a845a60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:27.125086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-071cc2e4-112f-4d37-b497-a9c05a845a60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:27.125581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-071cc2e4-112f-4d37-b497-a9c05a845a60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:27.126045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-071cc2e4-112f-4d37-b497-a9c05a845a60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:27.126744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-071cc2e4-112f-4d37-b497-a9c05a845a60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:27.127205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-071cc2e4-112f-4d37-b497-a9c05a845a60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:27.127680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-071cc2e4-112f-4d37-b497-a9c05a845a60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:27.259627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-071cc2e4-112f-4d37-b497-a9c05a845a60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:27.267498 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-071cc2e4-112f-4d37-b497-a9c05a845a60 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1203 microversion: 2.1 time: 0.154984 Oct 12 22:41:27.268005 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3575/6511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:27 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:28.291259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2cbb4743-4bdf-4c1a-b8ac-0359fd0edf01 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:28.291872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2cbb4743-4bdf-4c1a-b8ac-0359fd0edf01 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:28.298681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cbb4743-4bdf-4c1a-b8ac-0359fd0edf01 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:28.299172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cbb4743-4bdf-4c1a-b8ac-0359fd0edf01 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:28.299638 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cbb4743-4bdf-4c1a-b8ac-0359fd0edf01 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:28.300333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cbb4743-4bdf-4c1a-b8ac-0359fd0edf01 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:28.300788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cbb4743-4bdf-4c1a-b8ac-0359fd0edf01 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:28.301214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2cbb4743-4bdf-4c1a-b8ac-0359fd0edf01 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:28.436714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2cbb4743-4bdf-4c1a-b8ac-0359fd0edf01 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:28.444782 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2cbb4743-4bdf-4c1a-b8ac-0359fd0edf01 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1203 microversion: 2.1 time: 0.157623 Oct 12 22:41:28.445355 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2937/6512] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:28 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:29.467771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bced2af7-380c-47a4-a33e-d43626e77305 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:29.468469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bced2af7-380c-47a4-a33e-d43626e77305 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:29.476894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bced2af7-380c-47a4-a33e-d43626e77305 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:29.477382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bced2af7-380c-47a4-a33e-d43626e77305 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:29.477822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bced2af7-380c-47a4-a33e-d43626e77305 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:29.478523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bced2af7-380c-47a4-a33e-d43626e77305 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:29.478976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bced2af7-380c-47a4-a33e-d43626e77305 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:29.479431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bced2af7-380c-47a4-a33e-d43626e77305 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:29.618024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bced2af7-380c-47a4-a33e-d43626e77305 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:29.625689 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bced2af7-380c-47a4-a33e-d43626e77305 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1203 microversion: 2.1 time: 0.161915 Oct 12 22:41:29.626265 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3576/6513] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:29 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:30.648910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e07bf86e-7bc4-4b20-bcb9-6440ea2dc5e4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:30.649764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e07bf86e-7bc4-4b20-bcb9-6440ea2dc5e4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:30.657333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e07bf86e-7bc4-4b20-bcb9-6440ea2dc5e4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:30.657822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e07bf86e-7bc4-4b20-bcb9-6440ea2dc5e4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:30.658508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e07bf86e-7bc4-4b20-bcb9-6440ea2dc5e4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:30.659213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e07bf86e-7bc4-4b20-bcb9-6440ea2dc5e4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:30.659734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e07bf86e-7bc4-4b20-bcb9-6440ea2dc5e4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:30.660164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e07bf86e-7bc4-4b20-bcb9-6440ea2dc5e4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:30.799828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e07bf86e-7bc4-4b20-bcb9-6440ea2dc5e4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:30.808721 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e07bf86e-7bc4-4b20-bcb9-6440ea2dc5e4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1203 microversion: 2.1 time: 0.163774 Oct 12 22:41:30.810529 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2938/6514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:30 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:31.833510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-24ff1ce6-1ced-478d-86ec-169854e31832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:31.834124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-24ff1ce6-1ced-478d-86ec-169854e31832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:31.841729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24ff1ce6-1ced-478d-86ec-169854e31832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:31.842204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24ff1ce6-1ced-478d-86ec-169854e31832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:31.842640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24ff1ce6-1ced-478d-86ec-169854e31832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:31.843353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24ff1ce6-1ced-478d-86ec-169854e31832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:31.843803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24ff1ce6-1ced-478d-86ec-169854e31832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:31.844228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24ff1ce6-1ced-478d-86ec-169854e31832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:31.976087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-24ff1ce6-1ced-478d-86ec-169854e31832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:31.984152 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-24ff1ce6-1ced-478d-86ec-169854e31832 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1203 microversion: 2.1 time: 0.155228 Oct 12 22:41:31.984726 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3577/6515] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:31 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:33.006933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d8b10020-f348-4899-a96c-19ce39b4df4c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:33.007438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d8b10020-f348-4899-a96c-19ce39b4df4c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:33.014061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8b10020-f348-4899-a96c-19ce39b4df4c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:33.014542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8b10020-f348-4899-a96c-19ce39b4df4c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:33.014976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8b10020-f348-4899-a96c-19ce39b4df4c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:33.015828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8b10020-f348-4899-a96c-19ce39b4df4c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:33.016342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8b10020-f348-4899-a96c-19ce39b4df4c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:33.016854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d8b10020-f348-4899-a96c-19ce39b4df4c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:33.150960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d8b10020-f348-4899-a96c-19ce39b4df4c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:33.159332 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d8b10020-f348-4899-a96c-19ce39b4df4c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1203 microversion: 2.1 time: 0.156311 Oct 12 22:41:33.160903 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2939/6516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:33 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:33.653866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d5df623f-0ee1-4942-92cb-d39e9d5fe061 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:33.655189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d5df623f-0ee1-4942-92cb-d39e9d5fe061 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:33.663269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5df623f-0ee1-4942-92cb-d39e9d5fe061 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:33.664096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5df623f-0ee1-4942-92cb-d39e9d5fe061 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:33.664758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5df623f-0ee1-4942-92cb-d39e9d5fe061 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:33.665682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5df623f-0ee1-4942-92cb-d39e9d5fe061 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:33.666324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5df623f-0ee1-4942-92cb-d39e9d5fe061 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:33.666964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5df623f-0ee1-4942-92cb-d39e9d5fe061 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:33.830253 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d5df623f-0ee1-4942-92cb-d39e9d5fe061 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1833 microversion: 2.1 time: 0.180025 Oct 12 22:41:33.830853 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3578/6517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:33 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1833 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:33.852524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f3ffb4b3-1e95-44fa-a042-194337732dfd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:33.853132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f3ffb4b3-1e95-44fa-a042-194337732dfd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:33.859127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3ffb4b3-1e95-44fa-a042-194337732dfd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:33.859648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3ffb4b3-1e95-44fa-a042-194337732dfd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:33.860087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3ffb4b3-1e95-44fa-a042-194337732dfd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:33.860783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3ffb4b3-1e95-44fa-a042-194337732dfd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:33.861231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3ffb4b3-1e95-44fa-a042-194337732dfd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:33.861840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3ffb4b3-1e95-44fa-a042-194337732dfd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:34.015613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f3ffb4b3-1e95-44fa-a042-194337732dfd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:34.023877 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f3ffb4b3-1e95-44fa-a042-194337732dfd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1682 microversion: 2.1 time: 0.175135 Oct 12 22:41:34.024640 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2940/6518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:33 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:34.126333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f1386e43-2ac4-4507-8d2b-002cd5619278 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:34.129923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f1386e43-2ac4-4507-8d2b-002cd5619278 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:34.136193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1386e43-2ac4-4507-8d2b-002cd5619278 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:34.136693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1386e43-2ac4-4507-8d2b-002cd5619278 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:34.137140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1386e43-2ac4-4507-8d2b-002cd5619278 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:34.137860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1386e43-2ac4-4507-8d2b-002cd5619278 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:34.138323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1386e43-2ac4-4507-8d2b-002cd5619278 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:34.138754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f1386e43-2ac4-4507-8d2b-002cd5619278 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:34.182775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3518e406-084d-4e92-ab68-3f1f0269f03d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:34.183637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3518e406-084d-4e92-ab68-3f1f0269f03d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:34.189666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3518e406-084d-4e92-ab68-3f1f0269f03d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:34.190157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3518e406-084d-4e92-ab68-3f1f0269f03d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:34.190591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3518e406-084d-4e92-ab68-3f1f0269f03d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:34.191333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3518e406-084d-4e92-ab68-3f1f0269f03d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:34.191782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3518e406-084d-4e92-ab68-3f1f0269f03d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:34.192203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3518e406-084d-4e92-ab68-3f1f0269f03d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:34.197980 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f1386e43-2ac4-4507-8d2b-002cd5619278 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f/action" status: 200 len: 32642 microversion: 2.1 time: 0.075339 Oct 12 22:41:34.199102 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3579/6519] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:41:34 2022] POST /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f/action => generated 32642 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:41:34.327352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3518e406-084d-4e92-ab68-3f1f0269f03d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:34.338122 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3518e406-084d-4e92-ab68-3f1f0269f03d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1203 microversion: 2.1 time: 0.159252 Oct 12 22:41:34.338707 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2941/6520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:34 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:34.362988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-255e4014-91da-4043-9621-df3094fd8657 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:34.363700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-255e4014-91da-4043-9621-df3094fd8657 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:34.371206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-255e4014-91da-4043-9621-df3094fd8657 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:34.371735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-255e4014-91da-4043-9621-df3094fd8657 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:34.372172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-255e4014-91da-4043-9621-df3094fd8657 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:34.372872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-255e4014-91da-4043-9621-df3094fd8657 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:34.373323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-255e4014-91da-4043-9621-df3094fd8657 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:34.373757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-255e4014-91da-4043-9621-df3094fd8657 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:34.404205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-255e4014-91da-4043-9621-df3094fd8657 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '892bbd4935094d73b436f48f56f5be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0b30ba37d944c9b5893f582e181064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:34.404782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-255e4014-91da-4043-9621-df3094fd8657 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] flavor_id is None. Assuming migration. {{(pid=120453) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 12 22:41:34.405223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-255e4014-91da-4043-9621-df3094fd8657 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120453) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:41:34.517362 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-255e4014-91da-4043-9621-df3094fd8657 tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f/action" status: 202 len: 0 microversion: 2.1 time: 0.159071 Oct 12 22:41:34.521833 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3580/6521] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:41:34 2022] POST /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:41:34.526948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-011f4cae-7c6a-4a38-99fa-f79624788711 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:34.527612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-011f4cae-7c6a-4a38-99fa-f79624788711 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:34.534106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-011f4cae-7c6a-4a38-99fa-f79624788711 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:34.535803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-011f4cae-7c6a-4a38-99fa-f79624788711 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:34.536449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-011f4cae-7c6a-4a38-99fa-f79624788711 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:34.537160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-011f4cae-7c6a-4a38-99fa-f79624788711 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:34.537796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-011f4cae-7c6a-4a38-99fa-f79624788711 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:34.538224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-011f4cae-7c6a-4a38-99fa-f79624788711 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:34.695271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-011f4cae-7c6a-4a38-99fa-f79624788711 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:34.704999 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-011f4cae-7c6a-4a38-99fa-f79624788711 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1691 microversion: 2.1 time: 0.181872 Oct 12 22:41:34.705696 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2942/6522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:34 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:35.362200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5e908936-fa01-4777-b4b9-22a5f8f9b58d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:35.363698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5e908936-fa01-4777-b4b9-22a5f8f9b58d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:35.371744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e908936-fa01-4777-b4b9-22a5f8f9b58d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:35.372240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e908936-fa01-4777-b4b9-22a5f8f9b58d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:35.372926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e908936-fa01-4777-b4b9-22a5f8f9b58d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:35.373811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e908936-fa01-4777-b4b9-22a5f8f9b58d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:35.374387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e908936-fa01-4777-b4b9-22a5f8f9b58d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:35.374831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5e908936-fa01-4777-b4b9-22a5f8f9b58d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:35.568685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5e908936-fa01-4777-b4b9-22a5f8f9b58d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:35.577222 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5e908936-fa01-4777-b4b9-22a5f8f9b58d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1203 microversion: 2.1 time: 0.219845 Oct 12 22:41:35.577847 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3581/6523] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:35 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1203 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:35.736528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1d61b182-86f3-4eaa-ab07-edb019f0e54b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:35.737143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1d61b182-86f3-4eaa-ab07-edb019f0e54b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:35.755290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d61b182-86f3-4eaa-ab07-edb019f0e54b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:35.756751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d61b182-86f3-4eaa-ab07-edb019f0e54b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:35.761430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d61b182-86f3-4eaa-ab07-edb019f0e54b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:35.762488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d61b182-86f3-4eaa-ab07-edb019f0e54b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:35.763163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d61b182-86f3-4eaa-ab07-edb019f0e54b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:35.764315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d61b182-86f3-4eaa-ab07-edb019f0e54b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:35.925791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-93449e81-3015-4938-9dd1-42395d4e0a3d req-76ff0fd3-8b43-46ee-a266-b541a16bf857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32578200-0a10-4b2f-8d76-a9d87447f1b7", "name": "network-vif-plugged", "status": "completed", "tag": "4c1d7c04-1313-44be-9b11-74469e6412f1"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:35.937667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-93449e81-3015-4938-9dd1-42395d4e0a3d req-76ff0fd3-8b43-46ee-a266-b541a16bf857 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:35.938669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-93449e81-3015-4938-9dd1-42395d4e0a3d req-76ff0fd3-8b43-46ee-a266-b541a16bf857 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:35.939321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-93449e81-3015-4938-9dd1-42395d4e0a3d req-76ff0fd3-8b43-46ee-a266-b541a16bf857 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:35.953669 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-93449e81-3015-4938-9dd1-42395d4e0a3d req-76ff0fd3-8b43-46ee-a266-b541a16bf857 service nova] Creating event network-vif-plugged:4c1d7c04-1313-44be-9b11-74469e6412f1 for instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 on n-h2-861111-1 Oct 12 22:41:35.958767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1d61b182-86f3-4eaa-ab07-edb019f0e54b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:35.959159 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-93449e81-3015-4938-9dd1-42395d4e0a3d req-76ff0fd3-8b43-46ee-a266-b541a16bf857 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038411 Oct 12 22:41:35.959950 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3582/6524] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:41:35.966963 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1d61b182-86f3-4eaa-ab07-edb019f0e54b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1691 microversion: 2.1 time: 0.234767 Oct 12 22:41:35.968377 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2943/6525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:35 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1691 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:36.600690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02d1dd71-91e8-4762-9763-f8cbfd1940ed tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:36.601402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-02d1dd71-91e8-4762-9763-f8cbfd1940ed tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:36.608877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02d1dd71-91e8-4762-9763-f8cbfd1940ed tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:36.609381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02d1dd71-91e8-4762-9763-f8cbfd1940ed tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:36.609821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02d1dd71-91e8-4762-9763-f8cbfd1940ed tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:36.610570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02d1dd71-91e8-4762-9763-f8cbfd1940ed tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:36.611027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02d1dd71-91e8-4762-9763-f8cbfd1940ed tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:36.611513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02d1dd71-91e8-4762-9763-f8cbfd1940ed tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:36.744917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-02d1dd71-91e8-4762-9763-f8cbfd1940ed tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:36.748491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:36.754487 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-02d1dd71-91e8-4762-9763-f8cbfd1940ed tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1203 microversion: 2.1 time: 0.158196 Oct 12 22:41:36.755718 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3583/6526] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:36 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:36.990680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-53dee76b-4c9a-47de-a933-a354362a9d50 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:36.991312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-53dee76b-4c9a-47de-a933-a354362a9d50 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:36.998280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53dee76b-4c9a-47de-a933-a354362a9d50 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:36.998760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53dee76b-4c9a-47de-a933-a354362a9d50 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:36.999208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53dee76b-4c9a-47de-a933-a354362a9d50 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.000084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53dee76b-4c9a-47de-a933-a354362a9d50 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.000426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53dee76b-4c9a-47de-a933-a354362a9d50 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.000844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53dee76b-4c9a-47de-a933-a354362a9d50 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.193490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-53dee76b-4c9a-47de-a933-a354362a9d50 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:37.202350 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-53dee76b-4c9a-47de-a933-a354362a9d50 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1691 microversion: 2.1 time: 0.216161 Oct 12 22:41:37.202920 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2944/6527] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:36 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1691 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:37.776840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ad9b8d7c-c54c-497e-97ea-0a524fb46ec5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:37.777490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ad9b8d7c-c54c-497e-97ea-0a524fb46ec5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:37.785573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad9b8d7c-c54c-497e-97ea-0a524fb46ec5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.786060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad9b8d7c-c54c-497e-97ea-0a524fb46ec5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.786504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad9b8d7c-c54c-497e-97ea-0a524fb46ec5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.787202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad9b8d7c-c54c-497e-97ea-0a524fb46ec5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.787685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad9b8d7c-c54c-497e-97ea-0a524fb46ec5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.788116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad9b8d7c-c54c-497e-97ea-0a524fb46ec5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.923570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ad9b8d7c-c54c-497e-97ea-0a524fb46ec5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:37.932151 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ad9b8d7c-c54c-497e-97ea-0a524fb46ec5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1390 microversion: 2.1 time: 0.159927 Oct 12 22:41:37.932747 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3584/6528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:37 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:37.954836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6f38f25b-2368-409b-bd69-76347ea4be5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:37.955484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6f38f25b-2368-409b-bd69-76347ea4be5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:37.961574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f38f25b-2368-409b-bd69-76347ea4be5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.962061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f38f25b-2368-409b-bd69-76347ea4be5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.962501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f38f25b-2368-409b-bd69-76347ea4be5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.963191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f38f25b-2368-409b-bd69-76347ea4be5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.963793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f38f25b-2368-409b-bd69-76347ea4be5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.964224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f38f25b-2368-409b-bd69-76347ea4be5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.098050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6f38f25b-2368-409b-bd69-76347ea4be5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:38.101568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:38.107779 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6f38f25b-2368-409b-bd69-76347ea4be5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1390 microversion: 2.1 time: 0.156689 Oct 12 22:41:38.108361 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2945/6529] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:37 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:38.130336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6a14833d-e31d-42c1-a92f-81be68f5dc22 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:38.130957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6a14833d-e31d-42c1-a92f-81be68f5dc22 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:38.137085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a14833d-e31d-42c1-a92f-81be68f5dc22 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.137571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a14833d-e31d-42c1-a92f-81be68f5dc22 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.137998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a14833d-e31d-42c1-a92f-81be68f5dc22 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.138688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a14833d-e31d-42c1-a92f-81be68f5dc22 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.139134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a14833d-e31d-42c1-a92f-81be68f5dc22 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.139587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a14833d-e31d-42c1-a92f-81be68f5dc22 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.226332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ffe616f5-ac49-48d3-9817-5674e3f04937 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:38.226944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ffe616f5-ac49-48d3-9817-5674e3f04937 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:38.228993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:38.235296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffe616f5-ac49-48d3-9817-5674e3f04937 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.235999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffe616f5-ac49-48d3-9817-5674e3f04937 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.236438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffe616f5-ac49-48d3-9817-5674e3f04937 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.237230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffe616f5-ac49-48d3-9817-5674e3f04937 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.238212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffe616f5-ac49-48d3-9817-5674e3f04937 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.238642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffe616f5-ac49-48d3-9817-5674e3f04937 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.283970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6a14833d-e31d-42c1-a92f-81be68f5dc22 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:38.291907 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6a14833d-e31d-42c1-a92f-81be68f5dc22 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1390 microversion: 2.1 time: 0.165385 Oct 12 22:41:38.299268 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3585/6530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:38 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:38.380020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ffe616f5-ac49-48d3-9817-5674e3f04937 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:38.383488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-33ba5da3-5db8-49a0-a640-ba0eba28d6aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:38.384831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-33ba5da3-5db8-49a0-a640-ba0eba28d6aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:38.389617 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ffe616f5-ac49-48d3-9817-5674e3f04937 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1696 microversion: 2.1 time: 0.167556 Oct 12 22:41:38.390388 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2946/6531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:38 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:38.392006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33ba5da3-5db8-49a0-a640-ba0eba28d6aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.392505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33ba5da3-5db8-49a0-a640-ba0eba28d6aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.392949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33ba5da3-5db8-49a0-a640-ba0eba28d6aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.394187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33ba5da3-5db8-49a0-a640-ba0eba28d6aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.394756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33ba5da3-5db8-49a0-a640-ba0eba28d6aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.395199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33ba5da3-5db8-49a0-a640-ba0eba28d6aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.421787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-33ba5da3-5db8-49a0-a640-ba0eba28d6aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:41:38.499727 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-33ba5da3-5db8-49a0-a640-ba0eba28d6aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "DELETE /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 204 len: 0 microversion: 2.1 time: 0.122836 Oct 12 22:41:38.500422 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3586/6532] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:41:38 2022] DELETE /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:41:38.509620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2b81bd32-4c11-4d7f-b22a-d0888b0573b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:38.510245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2b81bd32-4c11-4d7f-b22a-d0888b0573b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:38.516381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b81bd32-4c11-4d7f-b22a-d0888b0573b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.516868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b81bd32-4c11-4d7f-b22a-d0888b0573b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.517305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b81bd32-4c11-4d7f-b22a-d0888b0573b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.518026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b81bd32-4c11-4d7f-b22a-d0888b0573b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.518480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b81bd32-4c11-4d7f-b22a-d0888b0573b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.519585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b81bd32-4c11-4d7f-b22a-d0888b0573b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.651109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2b81bd32-4c11-4d7f-b22a-d0888b0573b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:38.659222 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2b81bd32-4c11-4d7f-b22a-d0888b0573b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1396 microversion: 2.1 time: 0.153583 Oct 12 22:41:38.659834 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2947/6533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:38 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1396 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:39.414288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7ec0a0bd-61a1-4643-8b0c-22321098b98f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:39.414998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7ec0a0bd-61a1-4643-8b0c-22321098b98f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:39.417808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:39.423019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ec0a0bd-61a1-4643-8b0c-22321098b98f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:39.423533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ec0a0bd-61a1-4643-8b0c-22321098b98f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:39.423974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ec0a0bd-61a1-4643-8b0c-22321098b98f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:39.424793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ec0a0bd-61a1-4643-8b0c-22321098b98f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:39.425822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ec0a0bd-61a1-4643-8b0c-22321098b98f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:39.426258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ec0a0bd-61a1-4643-8b0c-22321098b98f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:39.571691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7ec0a0bd-61a1-4643-8b0c-22321098b98f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:39.579918 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7ec0a0bd-61a1-4643-8b0c-22321098b98f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1696 microversion: 2.1 time: 0.170464 Oct 12 22:41:39.580635 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3587/6534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:39 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:39.682342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-70029a93-771b-419f-b992-8fc1afa131f6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:39.682939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-70029a93-771b-419f-b992-8fc1afa131f6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:39.689798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70029a93-771b-419f-b992-8fc1afa131f6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:39.690318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70029a93-771b-419f-b992-8fc1afa131f6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:39.690766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70029a93-771b-419f-b992-8fc1afa131f6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:39.691494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70029a93-771b-419f-b992-8fc1afa131f6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:39.691955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70029a93-771b-419f-b992-8fc1afa131f6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:39.692387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70029a93-771b-419f-b992-8fc1afa131f6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:39.834404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-70029a93-771b-419f-b992-8fc1afa131f6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:39.842311 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-70029a93-771b-419f-b992-8fc1afa131f6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1396 microversion: 2.1 time: 0.163990 Oct 12 22:41:39.842885 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2948/6535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:39 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1396 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:40.605448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f24add9d-064a-4cfd-9a95-5ddca033bd2b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:40.606124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f24add9d-064a-4cfd-9a95-5ddca033bd2b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:40.613849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f24add9d-064a-4cfd-9a95-5ddca033bd2b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:40.614359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f24add9d-064a-4cfd-9a95-5ddca033bd2b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:40.614800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f24add9d-064a-4cfd-9a95-5ddca033bd2b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:40.615541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f24add9d-064a-4cfd-9a95-5ddca033bd2b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:40.615994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f24add9d-064a-4cfd-9a95-5ddca033bd2b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:40.616704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f24add9d-064a-4cfd-9a95-5ddca033bd2b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:40.725836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-0903edca-167b-4664-a3c0-8c04edb5c4c3 req-6b54f1d7-d5d4-4487-9b4d-23fbb8085968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32578200-0a10-4b2f-8d76-a9d87447f1b7", "name": "network-vif-deleted", "tag": "4c1d7c04-1313-44be-9b11-74469e6412f1"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:40.742106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0903edca-167b-4664-a3c0-8c04edb5c4c3 req-6b54f1d7-d5d4-4487-9b4d-23fbb8085968 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:40.742702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0903edca-167b-4664-a3c0-8c04edb5c4c3 req-6b54f1d7-d5d4-4487-9b4d-23fbb8085968 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:40.743261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0903edca-167b-4664-a3c0-8c04edb5c4c3 req-6b54f1d7-d5d4-4487-9b4d-23fbb8085968 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:40.768543 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-0903edca-167b-4664-a3c0-8c04edb5c4c3 req-6b54f1d7-d5d4-4487-9b4d-23fbb8085968 service nova] Creating event network-vif-deleted:4c1d7c04-1313-44be-9b11-74469e6412f1 for instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 on n-h2-861111-1 Oct 12 22:41:40.775112 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-0903edca-167b-4664-a3c0-8c04edb5c4c3 req-6b54f1d7-d5d4-4487-9b4d-23fbb8085968 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201347 Oct 12 22:41:40.776699 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3588/6536] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:40.820219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f24add9d-064a-4cfd-9a95-5ddca033bd2b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:40.828751 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f24add9d-064a-4cfd-9a95-5ddca033bd2b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1696 microversion: 2.1 time: 0.228519 Oct 12 22:41:40.829516 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2949/6537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:40 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1696 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:40.867007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6f2c8855-57b2-4412-9aac-0f87b403137b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:40.867860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6f2c8855-57b2-4412-9aac-0f87b403137b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:40.875512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f2c8855-57b2-4412-9aac-0f87b403137b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:40.876366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f2c8855-57b2-4412-9aac-0f87b403137b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:40.877049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f2c8855-57b2-4412-9aac-0f87b403137b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:40.877980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f2c8855-57b2-4412-9aac-0f87b403137b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:40.878450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f2c8855-57b2-4412-9aac-0f87b403137b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:40.879115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f2c8855-57b2-4412-9aac-0f87b403137b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:40.948383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6f2c8855-57b2-4412-9aac-0f87b403137b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:40.957202 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6f2c8855-57b2-4412-9aac-0f87b403137b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1188 microversion: 2.1 time: 0.095073 Oct 12 22:41:40.957897 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3589/6538] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:40 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1188 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:41.852489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e69f6f3d-39b2-4f1f-bc19-613e4f433211 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:41.853109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e69f6f3d-39b2-4f1f-bc19-613e4f433211 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:41.859852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e69f6f3d-39b2-4f1f-bc19-613e4f433211 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:41.860238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e69f6f3d-39b2-4f1f-bc19-613e4f433211 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:41.860685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e69f6f3d-39b2-4f1f-bc19-613e4f433211 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:41.861397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e69f6f3d-39b2-4f1f-bc19-613e4f433211 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:41.861858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e69f6f3d-39b2-4f1f-bc19-613e4f433211 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:41.862786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e69f6f3d-39b2-4f1f-bc19-613e4f433211 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:41.981785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c8394e17-bf54-4322-a6cf-6e08cb011a5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:41.983527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c8394e17-bf54-4322-a6cf-6e08cb011a5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:41.990889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8394e17-bf54-4322-a6cf-6e08cb011a5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:41.991618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8394e17-bf54-4322-a6cf-6e08cb011a5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:41.992214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8394e17-bf54-4322-a6cf-6e08cb011a5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:41.993554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8394e17-bf54-4322-a6cf-6e08cb011a5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:41.994005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8394e17-bf54-4322-a6cf-6e08cb011a5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:41.994596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8394e17-bf54-4322-a6cf-6e08cb011a5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:42.013661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e69f6f3d-39b2-4f1f-bc19-613e4f433211 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:42.025030 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e69f6f3d-39b2-4f1f-bc19-613e4f433211 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1696 microversion: 2.1 time: 0.176400 Oct 12 22:41:42.025905 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2950/6539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:41 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:42.074900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c8394e17-bf54-4322-a6cf-6e08cb011a5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:42.084941 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c8394e17-bf54-4322-a6cf-6e08cb011a5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1188 microversion: 2.1 time: 0.108347 Oct 12 22:41:42.086444 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3590/6540] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:41 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1188 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:43.052216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-51b723bf-4e9f-4aef-bd6f-d2b7964c70f6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:43.053477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-51b723bf-4e9f-4aef-bd6f-d2b7964c70f6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:43.065596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51b723bf-4e9f-4aef-bd6f-d2b7964c70f6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.066408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51b723bf-4e9f-4aef-bd6f-d2b7964c70f6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.067028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51b723bf-4e9f-4aef-bd6f-d2b7964c70f6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:43.068129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51b723bf-4e9f-4aef-bd6f-d2b7964c70f6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.068750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51b723bf-4e9f-4aef-bd6f-d2b7964c70f6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.069393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51b723bf-4e9f-4aef-bd6f-d2b7964c70f6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:43.111857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-781355c4-64ba-4793-9290-deb08279a498 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:43.112999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-781355c4-64ba-4793-9290-deb08279a498 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:43.119922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-781355c4-64ba-4793-9290-deb08279a498 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.120693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-781355c4-64ba-4793-9290-deb08279a498 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.121320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-781355c4-64ba-4793-9290-deb08279a498 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:43.122201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-781355c4-64ba-4793-9290-deb08279a498 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.123464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-781355c4-64ba-4793-9290-deb08279a498 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.124068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-781355c4-64ba-4793-9290-deb08279a498 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:43.202362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-781355c4-64ba-4793-9290-deb08279a498 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:43.213044 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-781355c4-64ba-4793-9290-deb08279a498 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1188 microversion: 2.1 time: 0.108953 Oct 12 22:41:43.215821 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3591/6541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:43 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1188 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:43.247379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-51b723bf-4e9f-4aef-bd6f-d2b7964c70f6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:43.255925 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-51b723bf-4e9f-4aef-bd6f-d2b7964c70f6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1696 microversion: 2.1 time: 0.209666 Oct 12 22:41:43.256520 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2951/6542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:43 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1696 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:44.238034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b65fef9c-3025-47c3-b8c3-083a62e5201b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:44.238657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b65fef9c-3025-47c3-b8c3-083a62e5201b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:44.245557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b65fef9c-3025-47c3-b8c3-083a62e5201b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:44.246041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b65fef9c-3025-47c3-b8c3-083a62e5201b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:44.246479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b65fef9c-3025-47c3-b8c3-083a62e5201b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:44.247168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b65fef9c-3025-47c3-b8c3-083a62e5201b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:44.247648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b65fef9c-3025-47c3-b8c3-083a62e5201b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:44.248074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b65fef9c-3025-47c3-b8c3-083a62e5201b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:44.283898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f21aa60-3355-4d4d-8819-07b118d5405b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:44.285850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8f21aa60-3355-4d4d-8819-07b118d5405b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:44.299939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f21aa60-3355-4d4d-8819-07b118d5405b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:44.305679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f21aa60-3355-4d4d-8819-07b118d5405b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:44.306376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f21aa60-3355-4d4d-8819-07b118d5405b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:44.307211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f21aa60-3355-4d4d-8819-07b118d5405b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:44.307898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f21aa60-3355-4d4d-8819-07b118d5405b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:44.308418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f21aa60-3355-4d4d-8819-07b118d5405b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:44.325992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b65fef9c-3025-47c3-b8c3-083a62e5201b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:44.335374 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b65fef9c-3025-47c3-b8c3-083a62e5201b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1188 microversion: 2.1 time: 0.101259 Oct 12 22:41:44.336396 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3592/6543] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:44 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1188 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:44.458687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f21aa60-3355-4d4d-8819-07b118d5405b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:44.466836 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f21aa60-3355-4d4d-8819-07b118d5405b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1696 microversion: 2.1 time: 0.187429 Oct 12 22:41:44.468171 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2952/6544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:44 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:45.358013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d4186961-4c86-4338-99ed-b6409de09c25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:45.358703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d4186961-4c86-4338-99ed-b6409de09c25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:45.365743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4186961-4c86-4338-99ed-b6409de09c25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:45.366233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4186961-4c86-4338-99ed-b6409de09c25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:45.366673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4186961-4c86-4338-99ed-b6409de09c25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:45.367790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4186961-4c86-4338-99ed-b6409de09c25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:45.368266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4186961-4c86-4338-99ed-b6409de09c25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:45.368878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4186961-4c86-4338-99ed-b6409de09c25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:45.407305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4186961-4c86-4338-99ed-b6409de09c25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:45.407945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4186961-4c86-4338-99ed-b6409de09c25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:45.408561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4186961-4c86-4338-99ed-b6409de09c25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:45.409557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-d4186961-4c86-4338-99ed-b6409de09c25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lazy-loading 'fault' on Instance uuid 32578200-0a10-4b2f-8d76-a9d87447f1b7 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:41:45.455542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d4186961-4c86-4338-99ed-b6409de09c25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:45.464653 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d4186961-4c86-4338-99ed-b6409de09c25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 200 len: 1193 microversion: 2.1 time: 0.110511 Oct 12 22:41:45.465636 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3593/6545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:45 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 1193 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:45.491866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-63e95222-28e2-4b21-b6d5-368ea3472c62 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:45.493271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-63e95222-28e2-4b21-b6d5-368ea3472c62 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:45.502444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63e95222-28e2-4b21-b6d5-368ea3472c62 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:45.504249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63e95222-28e2-4b21-b6d5-368ea3472c62 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:45.504841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63e95222-28e2-4b21-b6d5-368ea3472c62 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:45.505885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63e95222-28e2-4b21-b6d5-368ea3472c62 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:45.506564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63e95222-28e2-4b21-b6d5-368ea3472c62 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:45.507305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63e95222-28e2-4b21-b6d5-368ea3472c62 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:45.661449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-63e95222-28e2-4b21-b6d5-368ea3472c62 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:45.669738 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-63e95222-28e2-4b21-b6d5-368ea3472c62 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1696 microversion: 2.1 time: 0.183568 Oct 12 22:41:45.670551 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2953/6546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:45 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:46.489468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b5f76ed3-5e6f-4034-8ac3-89da02e63914 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:46.490765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b5f76ed3-5e6f-4034-8ac3-89da02e63914 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:46.498117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5f76ed3-5e6f-4034-8ac3-89da02e63914 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:46.498605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5f76ed3-5e6f-4034-8ac3-89da02e63914 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:46.499076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5f76ed3-5e6f-4034-8ac3-89da02e63914 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:46.499821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5f76ed3-5e6f-4034-8ac3-89da02e63914 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:46.500266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5f76ed3-5e6f-4034-8ac3-89da02e63914 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:46.500779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b5f76ed3-5e6f-4034-8ac3-89da02e63914 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:46.515089 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-b5f76ed3-5e6f-4034-8ac3-89da02e63914 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] HTTP exception thrown: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b5f76ed3-5e6f-4034-8ac3-89da02e63914 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Request method failure captured: Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 HTTP/1.1 Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0IharzkU0EI5od_tYFYiimWbIhiU_Z2qWiELggh5UckxeqrnYnnrwzymqi7TUfpjzQhGi9AT7nHEyzZohAJui-4vZv6nTEy801Fmq2zP90o12d8oz0UHjyBxm9MxKWeYUrTwr-9KmypVoqQEOknLfZ_qBqmv_P1kjCeo-X5DoGtv6Y Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef79a1f4c33c46f1a7536c37f910e2b0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7d141d93d7a74a57b5b6475294c9af5e Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '32578200-0a10-4b2f-8d76-a9d87447f1b7'} Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:46.516821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:41:46.522037 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:46.522037 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:46.522037 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:46.522037 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:46.522037 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:46.522037 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. Oct 12 22:41:46.522037 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:41:46.522037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b5f76ed3-5e6f-4034-8ac3-89da02e63914 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Returning 404 to user: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:46.522037 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b5f76ed3-5e6f-4034-8ac3-89da02e63914 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 404 len: 111 microversion: 2.1 time: 0.033198 Oct 12 22:41:46.522037 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3594/6547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:46 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:41:46.693912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f1a080ee-0f14-41c0-a146-12f5ae95515f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:46.694527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f1a080ee-0f14-41c0-a146-12f5ae95515f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:46.702077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1a080ee-0f14-41c0-a146-12f5ae95515f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:46.702561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1a080ee-0f14-41c0-a146-12f5ae95515f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:46.702998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1a080ee-0f14-41c0-a146-12f5ae95515f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:46.704009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1a080ee-0f14-41c0-a146-12f5ae95515f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:46.704415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1a080ee-0f14-41c0-a146-12f5ae95515f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:46.704841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1a080ee-0f14-41c0-a146-12f5ae95515f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:46.841478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f1a080ee-0f14-41c0-a146-12f5ae95515f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:46.849718 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f1a080ee-0f14-41c0-a146-12f5ae95515f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1696 microversion: 2.1 time: 0.159825 Oct 12 22:41:46.850312 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2954/6548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:46 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:47.874360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-564640a7-d5f0-4bbd-812b-3c4f548843cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:47.875054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-564640a7-d5f0-4bbd-812b-3c4f548843cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:47.882964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564640a7-d5f0-4bbd-812b-3c4f548843cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:47.883485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564640a7-d5f0-4bbd-812b-3c4f548843cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:47.883930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564640a7-d5f0-4bbd-812b-3c4f548843cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:47.884728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564640a7-d5f0-4bbd-812b-3c4f548843cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:47.885192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564640a7-d5f0-4bbd-812b-3c4f548843cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:47.885624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564640a7-d5f0-4bbd-812b-3c4f548843cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:48.033967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-564640a7-d5f0-4bbd-812b-3c4f548843cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:48.041948 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-564640a7-d5f0-4bbd-812b-3c4f548843cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1696 microversion: 2.1 time: 0.171602 Oct 12 22:41:48.042616 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3595/6549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:47 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:49.067028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1b8c2940-552c-4bdd-bf0c-aee675c4c76e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:49.068233 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1b8c2940-552c-4bdd-bf0c-aee675c4c76e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:49.075696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b8c2940-552c-4bdd-bf0c-aee675c4c76e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:49.076182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b8c2940-552c-4bdd-bf0c-aee675c4c76e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:49.076618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b8c2940-552c-4bdd-bf0c-aee675c4c76e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:49.077518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b8c2940-552c-4bdd-bf0c-aee675c4c76e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:49.077979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b8c2940-552c-4bdd-bf0c-aee675c4c76e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:49.078410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b8c2940-552c-4bdd-bf0c-aee675c4c76e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:49.228249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1b8c2940-552c-4bdd-bf0c-aee675c4c76e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:49.236278 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1b8c2940-552c-4bdd-bf0c-aee675c4c76e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1696 microversion: 2.1 time: 0.174223 Oct 12 22:41:49.239313 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2955/6550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:49 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:49.739007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb99b0aa-e4c6-43d1-b61e-475b381584c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:49.739546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cb99b0aa-e4c6-43d1-b61e-475b381584c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:49.746848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb99b0aa-e4c6-43d1-b61e-475b381584c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:49.747284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb99b0aa-e4c6-43d1-b61e-475b381584c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:49.747863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb99b0aa-e4c6-43d1-b61e-475b381584c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:49.748581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb99b0aa-e4c6-43d1-b61e-475b381584c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:49.749038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb99b0aa-e4c6-43d1-b61e-475b381584c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:49.749468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb99b0aa-e4c6-43d1-b61e-475b381584c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:49.768925 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-cb99b0aa-e4c6-43d1-b61e-475b381584c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] HTTP exception thrown: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb99b0aa-e4c6-43d1-b61e-475b381584c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Request method failure captured: Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 HTTP/1.1 Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0IharzkU0EI5od_tYFYiimWbIhiU_Z2qWiELggh5UckxeqrnYnnrwzymqi7TUfpjzQhGi9AT7nHEyzZohAJui-4vZv6nTEy801Fmq2zP90o12d8oz0UHjyBxm9MxKWeYUrTwr-9KmypVoqQEOknLfZ_qBqmv_P1kjCeo-X5DoGtv6Y Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef79a1f4c33c46f1a7536c37f910e2b0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7d141d93d7a74a57b5b6475294c9af5e Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '32578200-0a10-4b2f-8d76-a9d87447f1b7'} Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:41:49.770519 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:41:49.775565 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. Oct 12 22:41:49.775565 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:41:49.775565 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:49.775565 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:41:49.775565 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:49.775565 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:49.775565 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:49.775565 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:49.775565 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:49.775565 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. Oct 12 22:41:49.775565 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:41:49.775565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb99b0aa-e4c6-43d1-b61e-475b381584c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Returning 404 to user: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:49.775565 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cb99b0aa-e4c6-43d1-b61e-475b381584c6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "DELETE /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 404 len: 111 microversion: 2.1 time: 0.038095 Oct 12 22:41:49.781070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5ec5c728-af86-4749-bf6d-8e6064db2cf0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:49.781689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5ec5c728-af86-4749-bf6d-8e6064db2cf0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 32578200-0a10-4b2f-8d76-a9d87447f1b7] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:49.786994 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3596/6551] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:41:49 2022] DELETE /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:41:49.788602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ec5c728-af86-4749-bf6d-8e6064db2cf0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:49.789090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ec5c728-af86-4749-bf6d-8e6064db2cf0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:49.789677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ec5c728-af86-4749-bf6d-8e6064db2cf0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:49.790378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ec5c728-af86-4749-bf6d-8e6064db2cf0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:49.790830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ec5c728-af86-4749-bf6d-8e6064db2cf0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:49.791312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ec5c728-af86-4749-bf6d-8e6064db2cf0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:49.812120 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-5ec5c728-af86-4749-bf6d-8e6064db2cf0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] HTTP exception thrown: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5ec5c728-af86-4749-bf6d-8e6064db2cf0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Request method failure captured: Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 HTTP/1.1 Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0IharzkU0EI5od_tYFYiimWbIhiU_Z2qWiELggh5UckxeqrnYnnrwzymqi7TUfpjzQhGi9AT7nHEyzZohAJui-4vZv6nTEy801Fmq2zP90o12d8oz0UHjyBxm9MxKWeYUrTwr-9KmypVoqQEOknLfZ_qBqmv_P1kjCeo-X5DoGtv6Y Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef79a1f4c33c46f1a7536c37f910e2b0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7d141d93d7a74a57b5b6475294c9af5e Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '32578200-0a10-4b2f-8d76-a9d87447f1b7'} Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:49.816285 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:41:49.821670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:49.821670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:49.821670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:49.821670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:49.821670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:49.821670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. Oct 12 22:41:49.821670 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:41:49.823495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5ec5c728-af86-4749-bf6d-8e6064db2cf0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Returning 404 to user: Instance 32578200-0a10-4b2f-8d76-a9d87447f1b7 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:49.824986 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5ec5c728-af86-4749-bf6d-8e6064db2cf0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7" status: 404 len: 111 microversion: 2.1 time: 0.047494 Oct 12 22:41:49.825981 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2956/6552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:49 2022] GET /compute/v2.1/servers/32578200-0a10-4b2f-8d76-a9d87447f1b7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:41:50.260275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2e29b7fb-1e19-43b3-8b2e-3f344e2408db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:50.261246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2e29b7fb-1e19-43b3-8b2e-3f344e2408db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:50.270631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e29b7fb-1e19-43b3-8b2e-3f344e2408db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:50.271820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e29b7fb-1e19-43b3-8b2e-3f344e2408db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:50.272618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e29b7fb-1e19-43b3-8b2e-3f344e2408db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:50.273680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e29b7fb-1e19-43b3-8b2e-3f344e2408db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:50.274856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e29b7fb-1e19-43b3-8b2e-3f344e2408db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:50.275491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2e29b7fb-1e19-43b3-8b2e-3f344e2408db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:50.425863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-0cc5db86-68a4-468a-bced-ce01c7042234 req-f8a5c872-3b55-483a-8125-edb02d0e2df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f", "name": "network-vif-unplugged", "status": "completed", "tag": "f09a9c76-1253-4c10-afae-3e74c87a8ea4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:50.451261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0cc5db86-68a4-468a-bced-ce01c7042234 req-f8a5c872-3b55-483a-8125-edb02d0e2df1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:50.451673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0cc5db86-68a4-468a-bced-ce01c7042234 req-f8a5c872-3b55-483a-8125-edb02d0e2df1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:50.452112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0cc5db86-68a4-468a-bced-ce01c7042234 req-f8a5c872-3b55-483a-8125-edb02d0e2df1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:50.500738 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-0cc5db86-68a4-468a-bced-ce01c7042234 req-f8a5c872-3b55-483a-8125-edb02d0e2df1 service nova] Creating event network-vif-unplugged:f09a9c76-1253-4c10-afae-3e74c87a8ea4 for instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f on n-h1-861111-1 Oct 12 22:41:50.538409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-0cc5db86-68a4-468a-bced-ce01c7042234 req-f8a5c872-3b55-483a-8125-edb02d0e2df1 service nova] Instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:41:50.575098 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-0cc5db86-68a4-468a-bced-ce01c7042234 req-f8a5c872-3b55-483a-8125-edb02d0e2df1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153222 Oct 12 22:41:50.589618 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2957/6553] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:41:50.603885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2e29b7fb-1e19-43b3-8b2e-3f344e2408db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:50.619257 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2e29b7fb-1e19-43b3-8b2e-3f344e2408db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1695 microversion: 2.1 time: 0.362882 Oct 12 22:41:50.621972 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3597/6554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:50 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1695 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:51.655205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1c6f3b5a-21f6-4ffc-891f-f068fa5e99af tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:51.655955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1c6f3b5a-21f6-4ffc-891f-f068fa5e99af tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:51.664060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c6f3b5a-21f6-4ffc-891f-f068fa5e99af tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:51.664558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c6f3b5a-21f6-4ffc-891f-f068fa5e99af tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:51.665225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c6f3b5a-21f6-4ffc-891f-f068fa5e99af tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:51.666109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c6f3b5a-21f6-4ffc-891f-f068fa5e99af tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:51.667417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c6f3b5a-21f6-4ffc-891f-f068fa5e99af tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:51.668028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c6f3b5a-21f6-4ffc-891f-f068fa5e99af tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:51.969783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1c6f3b5a-21f6-4ffc-891f-f068fa5e99af tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:51.980821 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1c6f3b5a-21f6-4ffc-891f-f068fa5e99af tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1695 microversion: 2.1 time: 0.334821 Oct 12 22:41:51.981948 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2958/6555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:51 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1695 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:52.626147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f7eede5b-8693-4514-8b62-0296924ee3fb req-527a0b25-d05c-498b-be8f-1538d338636d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f", "tag": "f09a9c76-1253-4c10-afae-3e74c87a8ea4"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:52.640108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f7eede5b-8693-4514-8b62-0296924ee3fb req-527a0b25-d05c-498b-be8f-1538d338636d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:52.640590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f7eede5b-8693-4514-8b62-0296924ee3fb req-527a0b25-d05c-498b-be8f-1538d338636d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:52.641024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f7eede5b-8693-4514-8b62-0296924ee3fb req-527a0b25-d05c-498b-be8f-1538d338636d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:52.654024 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f7eede5b-8693-4514-8b62-0296924ee3fb req-527a0b25-d05c-498b-be8f-1538d338636d service nova] Creating event network-changed:f09a9c76-1253-4c10-afae-3e74c87a8ea4 for instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f on n-h1-861111-1 Oct 12 22:41:52.660452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-f7eede5b-8693-4514-8b62-0296924ee3fb req-527a0b25-d05c-498b-be8f-1538d338636d service nova] Instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:41:52.671381 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f7eede5b-8693-4514-8b62-0296924ee3fb req-527a0b25-d05c-498b-be8f-1538d338636d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049074 Oct 12 22:41:52.671993 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3598/6556] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:41:53.012880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b117cb2f-bd80-4a78-9d3e-0861dbd8740d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:53.013590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b117cb2f-bd80-4a78-9d3e-0861dbd8740d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:53.021650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b117cb2f-bd80-4a78-9d3e-0861dbd8740d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:53.022160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b117cb2f-bd80-4a78-9d3e-0861dbd8740d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:53.022549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b117cb2f-bd80-4a78-9d3e-0861dbd8740d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:53.023317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b117cb2f-bd80-4a78-9d3e-0861dbd8740d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:53.023733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b117cb2f-bd80-4a78-9d3e-0861dbd8740d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:53.024158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b117cb2f-bd80-4a78-9d3e-0861dbd8740d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:53.351500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b117cb2f-bd80-4a78-9d3e-0861dbd8740d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:53.372673 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b117cb2f-bd80-4a78-9d3e-0861dbd8740d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1693 microversion: 2.1 time: 0.364087 Oct 12 22:41:53.373709 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2959/6557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:53 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1693 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:54.399780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e32fdf06-a541-4444-9da9-3267914868e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:54.400432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e32fdf06-a541-4444-9da9-3267914868e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:54.406879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e32fdf06-a541-4444-9da9-3267914868e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:54.407412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e32fdf06-a541-4444-9da9-3267914868e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:54.407864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e32fdf06-a541-4444-9da9-3267914868e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:54.408586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e32fdf06-a541-4444-9da9-3267914868e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:54.409049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e32fdf06-a541-4444-9da9-3267914868e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:54.409484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e32fdf06-a541-4444-9da9-3267914868e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:54.551970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e32fdf06-a541-4444-9da9-3267914868e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:54.559946 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e32fdf06-a541-4444-9da9-3267914868e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1690 microversion: 2.1 time: 0.165435 Oct 12 22:41:54.560529 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3599/6558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:54 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:54.583980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ae26f198-35e9-487c-b223-6fcea9a8cbf7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:54.584359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ae26f198-35e9-487c-b223-6fcea9a8cbf7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:54.591952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae26f198-35e9-487c-b223-6fcea9a8cbf7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:54.593390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae26f198-35e9-487c-b223-6fcea9a8cbf7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:54.593910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae26f198-35e9-487c-b223-6fcea9a8cbf7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:54.594693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae26f198-35e9-487c-b223-6fcea9a8cbf7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:54.595219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae26f198-35e9-487c-b223-6fcea9a8cbf7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:54.595906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae26f198-35e9-487c-b223-6fcea9a8cbf7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:54.657261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1663907565", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "7f25dd6f-a021-4d21-9e99-73e8f56b6e5b"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:54.722037 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ae26f198-35e9-487c-b223-6fcea9a8cbf7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f/action" status: 202 len: 0 microversion: 2.1 time: 0.142447 Oct 12 22:41:54.723301 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2960/6559] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:41:54 2022] POST /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:41:54.731165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-98c73f4d-cfe4-409b-a5f2-b8655542a9c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:54.731894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] validate_networks() for [('7f25dd6f-a021-4d21-9e99-73e8f56b6e5b', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:41:54.732346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-98c73f4d-cfe4-409b-a5f2-b8655542a9c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:54.740699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98c73f4d-cfe4-409b-a5f2-b8655542a9c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:54.741417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98c73f4d-cfe4-409b-a5f2-b8655542a9c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:54.742024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98c73f4d-cfe4-409b-a5f2-b8655542a9c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:54.742889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98c73f4d-cfe4-409b-a5f2-b8655542a9c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:54.743750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98c73f4d-cfe4-409b-a5f2-b8655542a9c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:54.744655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98c73f4d-cfe4-409b-a5f2-b8655542a9c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:54.976754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-98c73f4d-cfe4-409b-a5f2-b8655542a9c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:54.981831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:54.993929 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-98c73f4d-cfe4-409b-a5f2-b8655542a9c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1689 microversion: 2.1 time: 0.266792 Oct 12 22:41:54.995390 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2961/6560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:54 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1689 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:55.197363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:41:55.197793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:41:55.198274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:41:55.198702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:41:55.199105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:41:55.209640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:55.212441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:55.212891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:55.213770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:55.214455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:55.214887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:55.234674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Getting quotas for project 1cc51c59f6b348f7a707a864ce232516. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:41:55.240352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Getting quotas for user b8be40d3bedf44e5855cb97f7832bd65 and project 1cc51c59f6b348f7a707a864ce232516. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:41:55.254863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:41:55.257562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:41:55.317231 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-de56b3d6-931a-42e6-ac91-56d6c665c0e2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663821 Oct 12 22:41:55.318193 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3600/6561] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:41:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:41:55.329533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-518ec465-7e2c-491d-8d11-9b7fecda96fd tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:55.330183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-518ec465-7e2c-491d-8d11-9b7fecda96fd tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:55.419438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-518ec465-7e2c-491d-8d11-9b7fecda96fd tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:55.428373 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-518ec465-7e2c-491d-8d11-9b7fecda96fd tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810" status: 200 len: 1219 microversion: 2.1 time: 0.103016 Oct 12 22:41:55.429588 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2962/6562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:55 2022] GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:56.019814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-805fc240-49d5-4a03-a56b-9d994f3e8061 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:56.020546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-805fc240-49d5-4a03-a56b-9d994f3e8061 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:56.028686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-805fc240-49d5-4a03-a56b-9d994f3e8061 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:56.029547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-805fc240-49d5-4a03-a56b-9d994f3e8061 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:56.030101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-805fc240-49d5-4a03-a56b-9d994f3e8061 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:56.030920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-805fc240-49d5-4a03-a56b-9d994f3e8061 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:56.031514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-805fc240-49d5-4a03-a56b-9d994f3e8061 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:56.032200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-805fc240-49d5-4a03-a56b-9d994f3e8061 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:56.052760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:56.195495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-805fc240-49d5-4a03-a56b-9d994f3e8061 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:56.207263 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-805fc240-49d5-4a03-a56b-9d994f3e8061 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1689 microversion: 2.1 time: 0.193206 Oct 12 22:41:56.207849 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3601/6563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:56 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1689 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:56.453521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c45714d1-bfa2-4907-aceb-9eb1442f2d1b tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:56.454074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c45714d1-bfa2-4907-aceb-9eb1442f2d1b tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:56.464073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c45714d1-bfa2-4907-aceb-9eb1442f2d1b tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:56.464574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c45714d1-bfa2-4907-aceb-9eb1442f2d1b tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:56.465020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c45714d1-bfa2-4907-aceb-9eb1442f2d1b tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:56.465716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c45714d1-bfa2-4907-aceb-9eb1442f2d1b tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:56.466163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c45714d1-bfa2-4907-aceb-9eb1442f2d1b tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:56.466708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c45714d1-bfa2-4907-aceb-9eb1442f2d1b tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:56.542977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c45714d1-bfa2-4907-aceb-9eb1442f2d1b tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:56.553668 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c45714d1-bfa2-4907-aceb-9eb1442f2d1b tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810" status: 200 len: 1271 microversion: 2.1 time: 0.104100 Oct 12 22:41:56.554592 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2963/6564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:56 2022] GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 => generated 1271 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:57.232310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-835a3efd-b038-43a2-ab3a-257d9cf78913 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:57.232937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-835a3efd-b038-43a2-ab3a-257d9cf78913 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:57.241862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-835a3efd-b038-43a2-ab3a-257d9cf78913 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:57.242622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-835a3efd-b038-43a2-ab3a-257d9cf78913 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:57.243534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-835a3efd-b038-43a2-ab3a-257d9cf78913 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:57.244422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-835a3efd-b038-43a2-ab3a-257d9cf78913 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:57.245038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-835a3efd-b038-43a2-ab3a-257d9cf78913 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:57.245634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-835a3efd-b038-43a2-ab3a-257d9cf78913 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:57.408039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-835a3efd-b038-43a2-ab3a-257d9cf78913 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:57.420559 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-835a3efd-b038-43a2-ab3a-257d9cf78913 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1689 microversion: 2.1 time: 0.192362 Oct 12 22:41:57.435415 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3602/6565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:57 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1689 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:57.578984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0901a0a5-4800-4c24-ad24-c88b5891e0cb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:57.579593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0901a0a5-4800-4c24-ad24-c88b5891e0cb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:57.595016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0901a0a5-4800-4c24-ad24-c88b5891e0cb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:57.596389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0901a0a5-4800-4c24-ad24-c88b5891e0cb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:57.597021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0901a0a5-4800-4c24-ad24-c88b5891e0cb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:57.598014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0901a0a5-4800-4c24-ad24-c88b5891e0cb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:57.599478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0901a0a5-4800-4c24-ad24-c88b5891e0cb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:57.600925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0901a0a5-4800-4c24-ad24-c88b5891e0cb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:57.892014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0901a0a5-4800-4c24-ad24-c88b5891e0cb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:57.903975 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0901a0a5-4800-4c24-ad24-c88b5891e0cb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810" status: 200 len: 1319 microversion: 2.1 time: 0.329178 Oct 12 22:41:57.905081 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2964/6566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:57 2022] GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:58.447475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d359e1b3-cb22-480f-a2d1-c6f983274d61 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:58.448779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d359e1b3-cb22-480f-a2d1-c6f983274d61 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:58.456332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d359e1b3-cb22-480f-a2d1-c6f983274d61 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:58.456827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d359e1b3-cb22-480f-a2d1-c6f983274d61 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:58.457287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d359e1b3-cb22-480f-a2d1-c6f983274d61 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:58.457989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d359e1b3-cb22-480f-a2d1-c6f983274d61 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:58.458448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d359e1b3-cb22-480f-a2d1-c6f983274d61 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:58.458886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d359e1b3-cb22-480f-a2d1-c6f983274d61 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:58.892187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d359e1b3-cb22-480f-a2d1-c6f983274d61 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:58.906513 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d359e1b3-cb22-480f-a2d1-c6f983274d61 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1689 microversion: 2.1 time: 0.463651 Oct 12 22:41:58.919932 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3603/6567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:58 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1689 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:58.928422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7c606d5e-5816-4f5f-9e52-e4419ed13ec4 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:58.929149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7c606d5e-5816-4f5f-9e52-e4419ed13ec4 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:58.936432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c606d5e-5816-4f5f-9e52-e4419ed13ec4 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:58.936925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c606d5e-5816-4f5f-9e52-e4419ed13ec4 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:58.937362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c606d5e-5816-4f5f-9e52-e4419ed13ec4 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:58.938069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c606d5e-5816-4f5f-9e52-e4419ed13ec4 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:58.938510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c606d5e-5816-4f5f-9e52-e4419ed13ec4 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:58.938938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c606d5e-5816-4f5f-9e52-e4419ed13ec4 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:59.150208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d688ff3f-2524-4334-8233-5fd1641ffcfc req-378e8b87-5f3b-4626-a7dd-3dabbb04d92c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ecd20d-7eba-44cb-9f7f-441177312810", "tag": "b4cf6480-d196-4dc9-a58a-a7ccb9c9ee39"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:59.160538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d688ff3f-2524-4334-8233-5fd1641ffcfc req-378e8b87-5f3b-4626-a7dd-3dabbb04d92c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:59.161029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d688ff3f-2524-4334-8233-5fd1641ffcfc req-378e8b87-5f3b-4626-a7dd-3dabbb04d92c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:59.161856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d688ff3f-2524-4334-8233-5fd1641ffcfc req-378e8b87-5f3b-4626-a7dd-3dabbb04d92c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:59.179357 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d688ff3f-2524-4334-8233-5fd1641ffcfc req-378e8b87-5f3b-4626-a7dd-3dabbb04d92c service nova] Creating event network-changed:b4cf6480-d196-4dc9-a58a-a7ccb9c9ee39 for instance 16ecd20d-7eba-44cb-9f7f-441177312810 on n-h2-861111-1 Oct 12 22:41:59.184611 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d688ff3f-2524-4334-8233-5fd1641ffcfc req-378e8b87-5f3b-4626-a7dd-3dabbb04d92c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038116 Oct 12 22:41:59.185442 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3604/6568] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:41:59.407258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7c606d5e-5816-4f5f-9e52-e4419ed13ec4 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:59.415776 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7c606d5e-5816-4f5f-9e52-e4419ed13ec4 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810" status: 200 len: 1319 microversion: 2.1 time: 0.491484 Oct 12 22:41:59.416586 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2965/6569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:58 2022] GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 => generated 1319 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:59.932400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d89ef5a1-3366-48c2-93f9-8834fcd48427 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:59.933116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d89ef5a1-3366-48c2-93f9-8834fcd48427 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:59.940259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d89ef5a1-3366-48c2-93f9-8834fcd48427 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:59.940754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d89ef5a1-3366-48c2-93f9-8834fcd48427 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:59.941201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d89ef5a1-3366-48c2-93f9-8834fcd48427 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:59.941906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d89ef5a1-3366-48c2-93f9-8834fcd48427 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:59.942366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d89ef5a1-3366-48c2-93f9-8834fcd48427 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:59.942795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d89ef5a1-3366-48c2-93f9-8834fcd48427 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:00.083949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d89ef5a1-3366-48c2-93f9-8834fcd48427 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:00.092531 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d89ef5a1-3366-48c2-93f9-8834fcd48427 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1689 microversion: 2.1 time: 0.165296 Oct 12 22:42:00.093635 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3605/6570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:59 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:00.440055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-916ce9d5-0fbb-47bc-b139-0ad88b3d2830 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:00.440670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-916ce9d5-0fbb-47bc-b139-0ad88b3d2830 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:00.448014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-916ce9d5-0fbb-47bc-b139-0ad88b3d2830 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:00.448494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-916ce9d5-0fbb-47bc-b139-0ad88b3d2830 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:00.448923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-916ce9d5-0fbb-47bc-b139-0ad88b3d2830 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:00.449615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-916ce9d5-0fbb-47bc-b139-0ad88b3d2830 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:00.450068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-916ce9d5-0fbb-47bc-b139-0ad88b3d2830 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:00.450493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-916ce9d5-0fbb-47bc-b139-0ad88b3d2830 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:00.592482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-916ce9d5-0fbb-47bc-b139-0ad88b3d2830 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:00.600278 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-916ce9d5-0fbb-47bc-b139-0ad88b3d2830 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810" status: 200 len: 1319 microversion: 2.1 time: 0.164716 Oct 12 22:42:00.600848 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2966/6571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:00 2022] GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:01.118501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9a6f1089-4a78-4bd8-985b-512a25dda6c3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:01.119120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9a6f1089-4a78-4bd8-985b-512a25dda6c3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:01.126783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a6f1089-4a78-4bd8-985b-512a25dda6c3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:01.127827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a6f1089-4a78-4bd8-985b-512a25dda6c3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:01.128262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a6f1089-4a78-4bd8-985b-512a25dda6c3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:01.128975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a6f1089-4a78-4bd8-985b-512a25dda6c3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:01.129440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a6f1089-4a78-4bd8-985b-512a25dda6c3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:01.129861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9a6f1089-4a78-4bd8-985b-512a25dda6c3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:01.222627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-fe98b218-072a-4037-b94d-a65b8ff228cf req-b80614e3-a7e7-446d-b2ef-58fb0a954d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f", "tag": "f09a9c76-1253-4c10-afae-3e74c87a8ea4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:01.232406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fe98b218-072a-4037-b94d-a65b8ff228cf req-b80614e3-a7e7-446d-b2ef-58fb0a954d6c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:01.233118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fe98b218-072a-4037-b94d-a65b8ff228cf req-b80614e3-a7e7-446d-b2ef-58fb0a954d6c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:01.233556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fe98b218-072a-4037-b94d-a65b8ff228cf req-b80614e3-a7e7-446d-b2ef-58fb0a954d6c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:01.246667 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-fe98b218-072a-4037-b94d-a65b8ff228cf req-b80614e3-a7e7-446d-b2ef-58fb0a954d6c service nova] Creating event network-changed:f09a9c76-1253-4c10-afae-3e74c87a8ea4 for instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f on n-h2-861111-1 Oct 12 22:42:01.253237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-fe98b218-072a-4037-b94d-a65b8ff228cf req-b80614e3-a7e7-446d-b2ef-58fb0a954d6c service nova] Instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:42:01.265124 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-fe98b218-072a-4037-b94d-a65b8ff228cf req-b80614e3-a7e7-446d-b2ef-58fb0a954d6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047117 Oct 12 22:42:01.265733 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2967/6572] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:42:01.286950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9a6f1089-4a78-4bd8-985b-512a25dda6c3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:01.298062 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9a6f1089-4a78-4bd8-985b-512a25dda6c3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1689 microversion: 2.1 time: 0.183467 Oct 12 22:42:01.311285 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3606/6573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:01 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:01.625141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-78dea584-9154-497c-b89e-916c270aca01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:01.625847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-78dea584-9154-497c-b89e-916c270aca01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:01.632870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78dea584-9154-497c-b89e-916c270aca01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:01.633368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78dea584-9154-497c-b89e-916c270aca01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:01.633807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78dea584-9154-497c-b89e-916c270aca01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:01.634582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78dea584-9154-497c-b89e-916c270aca01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:01.635273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78dea584-9154-497c-b89e-916c270aca01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:01.635715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78dea584-9154-497c-b89e-916c270aca01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:01.822990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-78dea584-9154-497c-b89e-916c270aca01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:01.834167 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-78dea584-9154-497c-b89e-916c270aca01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810" status: 200 len: 1319 microversion: 2.1 time: 0.214337 Oct 12 22:42:01.834948 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2968/6574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:01 2022] GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:02.324144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-43234bf8-e705-458e-ad95-ec667dc7f564 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:02.324929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-43234bf8-e705-458e-ad95-ec667dc7f564 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:02.332241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43234bf8-e705-458e-ad95-ec667dc7f564 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:02.332816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43234bf8-e705-458e-ad95-ec667dc7f564 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:02.333337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43234bf8-e705-458e-ad95-ec667dc7f564 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:02.334111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43234bf8-e705-458e-ad95-ec667dc7f564 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:02.334629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43234bf8-e705-458e-ad95-ec667dc7f564 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:02.335442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43234bf8-e705-458e-ad95-ec667dc7f564 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:02.497902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-43234bf8-e705-458e-ad95-ec667dc7f564 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:02.506332 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-43234bf8-e705-458e-ad95-ec667dc7f564 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1689 microversion: 2.1 time: 0.186417 Oct 12 22:42:02.507223 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3607/6575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:02 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:02.857833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8a98a163-e8ba-40ec-9729-bdd16754af20 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:02.858452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8a98a163-e8ba-40ec-9729-bdd16754af20 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:02.865530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a98a163-e8ba-40ec-9729-bdd16754af20 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:02.866021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a98a163-e8ba-40ec-9729-bdd16754af20 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:02.866514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a98a163-e8ba-40ec-9729-bdd16754af20 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:02.867361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a98a163-e8ba-40ec-9729-bdd16754af20 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:02.867819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a98a163-e8ba-40ec-9729-bdd16754af20 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:02.868248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a98a163-e8ba-40ec-9729-bdd16754af20 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:03.005222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8a98a163-e8ba-40ec-9729-bdd16754af20 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:03.013484 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8a98a163-e8ba-40ec-9729-bdd16754af20 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810" status: 200 len: 1319 microversion: 2.1 time: 0.159693 Oct 12 22:42:03.014196 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2969/6576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:02 2022] GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:03.533883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f8d6a032-257d-4934-860c-b1935e69b633 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:03.534570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f8d6a032-257d-4934-860c-b1935e69b633 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:03.541728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8d6a032-257d-4934-860c-b1935e69b633 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:03.542336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8d6a032-257d-4934-860c-b1935e69b633 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:03.543011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8d6a032-257d-4934-860c-b1935e69b633 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:03.543873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8d6a032-257d-4934-860c-b1935e69b633 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:03.544341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8d6a032-257d-4934-860c-b1935e69b633 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:03.544783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8d6a032-257d-4934-860c-b1935e69b633 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:03.684119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f8d6a032-257d-4934-860c-b1935e69b633 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:03.694716 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f8d6a032-257d-4934-860c-b1935e69b633 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1689 microversion: 2.1 time: 0.164953 Oct 12 22:42:03.695327 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3608/6577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:03 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:04.036597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8e06eb7a-e4a2-4fdb-8fb7-ece4553e83a5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:04.037880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8e06eb7a-e4a2-4fdb-8fb7-ece4553e83a5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:04.044765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e06eb7a-e4a2-4fdb-8fb7-ece4553e83a5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:04.045262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e06eb7a-e4a2-4fdb-8fb7-ece4553e83a5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:04.045945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e06eb7a-e4a2-4fdb-8fb7-ece4553e83a5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:04.046732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e06eb7a-e4a2-4fdb-8fb7-ece4553e83a5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:04.047398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e06eb7a-e4a2-4fdb-8fb7-ece4553e83a5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:04.047855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8e06eb7a-e4a2-4fdb-8fb7-ece4553e83a5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:04.186696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8e06eb7a-e4a2-4fdb-8fb7-ece4553e83a5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:04.195194 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8e06eb7a-e4a2-4fdb-8fb7-ece4553e83a5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810" status: 200 len: 1319 microversion: 2.1 time: 0.162595 Oct 12 22:42:04.211007 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2970/6578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:04 2022] GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:04.718844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fd0a77cc-5771-4866-8f14-8491d7e6b8f8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:04.719613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fd0a77cc-5771-4866-8f14-8491d7e6b8f8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:04.726356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd0a77cc-5771-4866-8f14-8491d7e6b8f8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:04.726917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd0a77cc-5771-4866-8f14-8491d7e6b8f8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:04.727463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd0a77cc-5771-4866-8f14-8491d7e6b8f8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:04.728225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd0a77cc-5771-4866-8f14-8491d7e6b8f8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:04.728758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd0a77cc-5771-4866-8f14-8491d7e6b8f8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:04.729198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd0a77cc-5771-4866-8f14-8491d7e6b8f8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:04.871420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fd0a77cc-5771-4866-8f14-8491d7e6b8f8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:04.879896 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fd0a77cc-5771-4866-8f14-8491d7e6b8f8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1689 microversion: 2.1 time: 0.165150 Oct 12 22:42:04.895333 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3609/6579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:04 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:05.218469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6184d24c-2a55-4cef-bf09-2e2f25632774 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:05.219061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6184d24c-2a55-4cef-bf09-2e2f25632774 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:05.225945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6184d24c-2a55-4cef-bf09-2e2f25632774 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:05.226433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6184d24c-2a55-4cef-bf09-2e2f25632774 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:05.226866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6184d24c-2a55-4cef-bf09-2e2f25632774 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:05.227608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6184d24c-2a55-4cef-bf09-2e2f25632774 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:05.228056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6184d24c-2a55-4cef-bf09-2e2f25632774 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:05.228486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6184d24c-2a55-4cef-bf09-2e2f25632774 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:05.428510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:05.458039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6184d24c-2a55-4cef-bf09-2e2f25632774 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:05.468797 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6184d24c-2a55-4cef-bf09-2e2f25632774 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810" status: 200 len: 1319 microversion: 2.1 time: 0.254221 Oct 12 22:42:05.469649 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2971/6580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:05 2022] GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:05.905109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5b2dc456-4377-4c87-89c1-e6a549ad9dc4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:05.906051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5b2dc456-4377-4c87-89c1-e6a549ad9dc4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:05.907983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:05.908735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:05.919560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b2dc456-4377-4c87-89c1-e6a549ad9dc4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:05.920110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b2dc456-4377-4c87-89c1-e6a549ad9dc4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:05.920870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b2dc456-4377-4c87-89c1-e6a549ad9dc4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:05.921779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b2dc456-4377-4c87-89c1-e6a549ad9dc4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:05.922442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b2dc456-4377-4c87-89c1-e6a549ad9dc4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:05.923100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5b2dc456-4377-4c87-89c1-e6a549ad9dc4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:06.100340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5b2dc456-4377-4c87-89c1-e6a549ad9dc4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:06.111840 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5b2dc456-4377-4c87-89c1-e6a549ad9dc4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1682 microversion: 2.1 time: 0.210210 Oct 12 22:42:06.128499 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3610/6581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:05 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1682 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:06.437240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-4be14b7c-9b67-45a9-97f8-50b83b5463a5 req-63834b7b-3caa-40fa-954f-d5aefa2d6689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ecd20d-7eba-44cb-9f7f-441177312810", "name": "network-vif-plugged", "status": "completed", "tag": "b4cf6480-d196-4dc9-a58a-a7ccb9c9ee39"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:06.449124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4be14b7c-9b67-45a9-97f8-50b83b5463a5 req-63834b7b-3caa-40fa-954f-d5aefa2d6689 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:06.449615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4be14b7c-9b67-45a9-97f8-50b83b5463a5 req-63834b7b-3caa-40fa-954f-d5aefa2d6689 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:06.450300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4be14b7c-9b67-45a9-97f8-50b83b5463a5 req-63834b7b-3caa-40fa-954f-d5aefa2d6689 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:06.464542 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-4be14b7c-9b67-45a9-97f8-50b83b5463a5 req-63834b7b-3caa-40fa-954f-d5aefa2d6689 service nova] Creating event network-vif-plugged:b4cf6480-d196-4dc9-a58a-a7ccb9c9ee39 for instance 16ecd20d-7eba-44cb-9f7f-441177312810 on n-h2-861111-1 Oct 12 22:42:06.470156 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-4be14b7c-9b67-45a9-97f8-50b83b5463a5 req-63834b7b-3caa-40fa-954f-d5aefa2d6689 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120588 Oct 12 22:42:06.471790 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2972/6582] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:06.492632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe742230-4dea-41f7-9bf2-68bd25650b55 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:06.494492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fe742230-4dea-41f7-9bf2-68bd25650b55 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:06.501359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe742230-4dea-41f7-9bf2-68bd25650b55 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:06.502051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe742230-4dea-41f7-9bf2-68bd25650b55 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:06.502754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe742230-4dea-41f7-9bf2-68bd25650b55 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:06.503744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe742230-4dea-41f7-9bf2-68bd25650b55 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:06.504647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe742230-4dea-41f7-9bf2-68bd25650b55 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:06.505193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe742230-4dea-41f7-9bf2-68bd25650b55 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:06.650360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fe742230-4dea-41f7-9bf2-68bd25650b55 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:06.658931 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fe742230-4dea-41f7-9bf2-68bd25650b55 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810" status: 200 len: 1319 microversion: 2.1 time: 0.170233 Oct 12 22:42:06.659612 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3611/6583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:06 2022] GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:07.683966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f2b16be-d28f-49f2-afce-0f2322f3b66e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:07.684700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8f2b16be-d28f-49f2-afce-0f2322f3b66e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:07.691895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f2b16be-d28f-49f2-afce-0f2322f3b66e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:07.692715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f2b16be-d28f-49f2-afce-0f2322f3b66e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:07.693418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f2b16be-d28f-49f2-afce-0f2322f3b66e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:07.694300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f2b16be-d28f-49f2-afce-0f2322f3b66e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:07.694770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f2b16be-d28f-49f2-afce-0f2322f3b66e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:07.695462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f2b16be-d28f-49f2-afce-0f2322f3b66e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:07.838904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f2b16be-d28f-49f2-afce-0f2322f3b66e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:07.851642 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f2b16be-d28f-49f2-afce-0f2322f3b66e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810" status: 200 len: 1319 microversion: 2.1 time: 0.174285 Oct 12 22:42:07.852228 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2973/6584] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:07 2022] GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:08.487272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f024cef7-8570-419f-a268-4e771df410f6 req-26cf3d44-0673-4097-9738-501245e4f12f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f", "name": "network-vif-plugged", "status": "completed", "tag": "f09a9c76-1253-4c10-afae-3e74c87a8ea4"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:08.497742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f024cef7-8570-419f-a268-4e771df410f6 req-26cf3d44-0673-4097-9738-501245e4f12f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:08.498223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f024cef7-8570-419f-a268-4e771df410f6 req-26cf3d44-0673-4097-9738-501245e4f12f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:08.498658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f024cef7-8570-419f-a268-4e771df410f6 req-26cf3d44-0673-4097-9738-501245e4f12f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:08.509870 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f024cef7-8570-419f-a268-4e771df410f6 req-26cf3d44-0673-4097-9738-501245e4f12f service nova] Creating event network-vif-plugged:f09a9c76-1253-4c10-afae-3e74c87a8ea4 for instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f on n-h2-861111-1 Oct 12 22:42:08.514848 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f024cef7-8570-419f-a268-4e771df410f6 req-26cf3d44-0673-4097-9738-501245e4f12f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031945 Oct 12 22:42:08.515663 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3612/6585] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:08.875387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d4d0b20b-4846-487f-91f0-bf569640b9ed tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:08.876106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d4d0b20b-4846-487f-91f0-bf569640b9ed tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:08.878910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=62 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:08.884205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4d0b20b-4846-487f-91f0-bf569640b9ed tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:08.884685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4d0b20b-4846-487f-91f0-bf569640b9ed tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:08.885120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4d0b20b-4846-487f-91f0-bf569640b9ed tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:08.885814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4d0b20b-4846-487f-91f0-bf569640b9ed tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:08.886261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4d0b20b-4846-487f-91f0-bf569640b9ed tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:08.886692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4d0b20b-4846-487f-91f0-bf569640b9ed tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:09.024657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d4d0b20b-4846-487f-91f0-bf569640b9ed tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:09.032927 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d4d0b20b-4846-487f-91f0-bf569640b9ed tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810" status: 200 len: 1508 microversion: 2.1 time: 0.161342 Oct 12 22:42:09.034096 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2974/6586] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:08 2022] GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:11.873338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1320610903", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "70508b23-3c89-40af-aa6b-b49e0fd846f2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6d173dd3-914e-48d4-bcc2-81061c8da03d"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:11.883501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:11.940850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] validate_networks() for [('6d173dd3-914e-48d4-bcc2-81061c8da03d', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:42:12.331837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:42:12.332294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:42:12.332771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:42:12.333456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:42:12.333876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:42:12.344115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:12.344603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:12.345039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:12.345793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:12.346248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:12.346673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:12.364299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:42:12.370888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for user 7d141d93d7a74a57b5b6475294c9af5e and project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:42:12.431885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:42:12.434281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='70508b23-3c89-40af-aa6b-b49e0fd846f2',volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:42:12.592706 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-66c7860f-3403-420b-90e4-22f1bd1fbcaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.724390 Oct 12 22:42:12.593762 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3613/6587] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:42:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:42:12.607112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-76ea3917-1c8b-4bdf-9e6b-57e055e4f2f0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:12.608798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-76ea3917-1c8b-4bdf-9e6b-57e055e4f2f0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:12.692413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-76ea3917-1c8b-4bdf-9e6b-57e055e4f2f0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:12.700374 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-76ea3917-1c8b-4bdf-9e6b-57e055e4f2f0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1071 microversion: 2.1 time: 0.098094 Oct 12 22:42:12.701312 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2975/6588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:12 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1071 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:13.725757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1bca2f6c-64d2-4a86-8197-0404e22d6c26 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:13.726389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1bca2f6c-64d2-4a86-8197-0404e22d6c26 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:13.734936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bca2f6c-64d2-4a86-8197-0404e22d6c26 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:13.735726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bca2f6c-64d2-4a86-8197-0404e22d6c26 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:13.737845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bca2f6c-64d2-4a86-8197-0404e22d6c26 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:13.738976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bca2f6c-64d2-4a86-8197-0404e22d6c26 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:13.739736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bca2f6c-64d2-4a86-8197-0404e22d6c26 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:13.740298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bca2f6c-64d2-4a86-8197-0404e22d6c26 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:13.822599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1bca2f6c-64d2-4a86-8197-0404e22d6c26 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:13.832205 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1bca2f6c-64d2-4a86-8197-0404e22d6c26 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1177 microversion: 2.1 time: 0.111912 Oct 12 22:42:13.833139 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3614/6589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:13 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1177 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:14.855765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-10a5f669-cda7-47d7-8035-296ce5eb717b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:14.856955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-10a5f669-cda7-47d7-8035-296ce5eb717b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:14.865394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10a5f669-cda7-47d7-8035-296ce5eb717b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:14.866163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10a5f669-cda7-47d7-8035-296ce5eb717b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:14.866609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10a5f669-cda7-47d7-8035-296ce5eb717b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:14.867345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10a5f669-cda7-47d7-8035-296ce5eb717b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:14.867803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10a5f669-cda7-47d7-8035-296ce5eb717b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:14.871767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10a5f669-cda7-47d7-8035-296ce5eb717b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:15.200141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-10a5f669-cda7-47d7-8035-296ce5eb717b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:15.211844 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-10a5f669-cda7-47d7-8035-296ce5eb717b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1229 microversion: 2.1 time: 0.357551 Oct 12 22:42:15.212468 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2976/6590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:14 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1229 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:15.691904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-c2d2f04e-3497-4deb-a93e-b4e3276c9b0b req-90c99a55-132c-4614-997e-d978d477afd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff1c156-3133-4c24-81e5-770b0a6faaa4", "tag": "376adc19-ae45-49d6-8914-7087df7dcf21"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:15.713674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c2d2f04e-3497-4deb-a93e-b4e3276c9b0b req-90c99a55-132c-4614-997e-d978d477afd9 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:15.714451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c2d2f04e-3497-4deb-a93e-b4e3276c9b0b req-90c99a55-132c-4614-997e-d978d477afd9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:15.715865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c2d2f04e-3497-4deb-a93e-b4e3276c9b0b req-90c99a55-132c-4614-997e-d978d477afd9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:15.731391 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-c2d2f04e-3497-4deb-a93e-b4e3276c9b0b req-90c99a55-132c-4614-997e-d978d477afd9 service nova] Creating event network-changed:376adc19-ae45-49d6-8914-7087df7dcf21 for instance cff1c156-3133-4c24-81e5-770b0a6faaa4 on n-h1-861111-1 Oct 12 22:42:15.737297 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-c2d2f04e-3497-4deb-a93e-b4e3276c9b0b req-90c99a55-132c-4614-997e-d978d477afd9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050198 Oct 12 22:42:15.738345 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3615/6591] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:16.235774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-24d36742-151c-433a-9216-e4048d96304e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:16.237185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-24d36742-151c-433a-9216-e4048d96304e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:16.253315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24d36742-151c-433a-9216-e4048d96304e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:16.254078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24d36742-151c-433a-9216-e4048d96304e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:16.254707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24d36742-151c-433a-9216-e4048d96304e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:16.256298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24d36742-151c-433a-9216-e4048d96304e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:16.257540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24d36742-151c-433a-9216-e4048d96304e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:16.258170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24d36742-151c-433a-9216-e4048d96304e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:16.475562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-24d36742-151c-433a-9216-e4048d96304e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:16.484556 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-24d36742-151c-433a-9216-e4048d96304e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1229 microversion: 2.1 time: 0.252482 Oct 12 22:42:16.486188 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2977/6592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:16 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1229 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:17.509935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dda4387b-7370-414b-93b2-0ddad927107c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:17.512105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dda4387b-7370-414b-93b2-0ddad927107c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:17.523211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dda4387b-7370-414b-93b2-0ddad927107c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:17.524569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dda4387b-7370-414b-93b2-0ddad927107c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:17.525408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dda4387b-7370-414b-93b2-0ddad927107c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:17.526577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dda4387b-7370-414b-93b2-0ddad927107c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:17.527320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dda4387b-7370-414b-93b2-0ddad927107c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:17.528186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dda4387b-7370-414b-93b2-0ddad927107c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:17.706759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dda4387b-7370-414b-93b2-0ddad927107c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:17.717470 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dda4387b-7370-414b-93b2-0ddad927107c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1229 microversion: 2.1 time: 0.212298 Oct 12 22:42:17.718494 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3616/6593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:17 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1229 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:18.741111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8d86de6a-6720-48f5-b10e-8cc719e05feb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:18.742195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8d86de6a-6720-48f5-b10e-8cc719e05feb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:18.750643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d86de6a-6720-48f5-b10e-8cc719e05feb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:18.751225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d86de6a-6720-48f5-b10e-8cc719e05feb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:18.752118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d86de6a-6720-48f5-b10e-8cc719e05feb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:18.753248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d86de6a-6720-48f5-b10e-8cc719e05feb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:18.753946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d86de6a-6720-48f5-b10e-8cc719e05feb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:18.754666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d86de6a-6720-48f5-b10e-8cc719e05feb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:18.903665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8d86de6a-6720-48f5-b10e-8cc719e05feb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:18.915805 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8d86de6a-6720-48f5-b10e-8cc719e05feb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1229 microversion: 2.1 time: 0.178555 Oct 12 22:42:18.916493 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2978/6594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:18 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1229 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:19.938595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8721693b-0864-4003-8953-f3cd59b34630 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:19.939184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8721693b-0864-4003-8953-f3cd59b34630 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:19.946191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8721693b-0864-4003-8953-f3cd59b34630 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:19.946674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8721693b-0864-4003-8953-f3cd59b34630 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:19.947109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8721693b-0864-4003-8953-f3cd59b34630 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:19.947821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8721693b-0864-4003-8953-f3cd59b34630 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:19.948271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8721693b-0864-4003-8953-f3cd59b34630 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:19.948695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8721693b-0864-4003-8953-f3cd59b34630 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:20.089368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8721693b-0864-4003-8953-f3cd59b34630 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:20.098869 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8721693b-0864-4003-8953-f3cd59b34630 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1217 microversion: 2.1 time: 0.164236 Oct 12 22:42:20.111822 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3617/6595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:19 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:21.122930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-68af6e1c-5b40-4bad-88eb-d90c0e13aa96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:21.123624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-68af6e1c-5b40-4bad-88eb-d90c0e13aa96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:21.131176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68af6e1c-5b40-4bad-88eb-d90c0e13aa96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:21.131699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68af6e1c-5b40-4bad-88eb-d90c0e13aa96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:21.132142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68af6e1c-5b40-4bad-88eb-d90c0e13aa96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:21.132843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68af6e1c-5b40-4bad-88eb-d90c0e13aa96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:21.133349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68af6e1c-5b40-4bad-88eb-d90c0e13aa96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:21.133783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68af6e1c-5b40-4bad-88eb-d90c0e13aa96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:21.268906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-68af6e1c-5b40-4bad-88eb-d90c0e13aa96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:21.277207 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-68af6e1c-5b40-4bad-88eb-d90c0e13aa96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1217 microversion: 2.1 time: 0.158373 Oct 12 22:42:21.277884 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2979/6596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:21 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:22.300144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f6dc22d8-3848-42b9-9b60-a5fff2f8c7e5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:22.300873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f6dc22d8-3848-42b9-9b60-a5fff2f8c7e5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:22.307832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6dc22d8-3848-42b9-9b60-a5fff2f8c7e5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:22.308400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6dc22d8-3848-42b9-9b60-a5fff2f8c7e5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:22.308912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6dc22d8-3848-42b9-9b60-a5fff2f8c7e5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:22.309692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6dc22d8-3848-42b9-9b60-a5fff2f8c7e5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:22.310239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6dc22d8-3848-42b9-9b60-a5fff2f8c7e5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:22.310739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6dc22d8-3848-42b9-9b60-a5fff2f8c7e5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:22.354672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:22.377861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:22.447809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f6dc22d8-3848-42b9-9b60-a5fff2f8c7e5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:22.455793 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f6dc22d8-3848-42b9-9b60-a5fff2f8c7e5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1217 microversion: 2.1 time: 0.160105 Oct 12 22:42:22.456392 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3618/6597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:22 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:23.478945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-91703a6a-3396-4397-a7b7-6d326fe2e198 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:23.479599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-91703a6a-3396-4397-a7b7-6d326fe2e198 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:23.482663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:23.488184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91703a6a-3396-4397-a7b7-6d326fe2e198 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:23.488668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91703a6a-3396-4397-a7b7-6d326fe2e198 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:23.489100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91703a6a-3396-4397-a7b7-6d326fe2e198 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:23.489797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91703a6a-3396-4397-a7b7-6d326fe2e198 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:23.490249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91703a6a-3396-4397-a7b7-6d326fe2e198 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:23.490670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91703a6a-3396-4397-a7b7-6d326fe2e198 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:23.621140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-91703a6a-3396-4397-a7b7-6d326fe2e198 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:23.629399 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-91703a6a-3396-4397-a7b7-6d326fe2e198 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1217 microversion: 2.1 time: 0.154361 Oct 12 22:42:23.629968 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2980/6598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:23 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:24.655029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-20e12e9c-6e45-4f73-a648-8922ab360da2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:24.656420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-20e12e9c-6e45-4f73-a648-8922ab360da2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:24.668715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20e12e9c-6e45-4f73-a648-8922ab360da2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:24.669545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20e12e9c-6e45-4f73-a648-8922ab360da2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:24.670078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20e12e9c-6e45-4f73-a648-8922ab360da2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:24.671114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20e12e9c-6e45-4f73-a648-8922ab360da2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:24.671938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20e12e9c-6e45-4f73-a648-8922ab360da2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:24.673206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20e12e9c-6e45-4f73-a648-8922ab360da2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:24.838931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-20e12e9c-6e45-4f73-a648-8922ab360da2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:24.852917 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-20e12e9c-6e45-4f73-a648-8922ab360da2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1217 microversion: 2.1 time: 0.203638 Oct 12 22:42:24.853679 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3619/6599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:24 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1217 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:25.875829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a474ca60-4620-4be9-a29a-a7be36d41341 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:25.876373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a474ca60-4620-4be9-a29a-a7be36d41341 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:25.883223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a474ca60-4620-4be9-a29a-a7be36d41341 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:25.883721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a474ca60-4620-4be9-a29a-a7be36d41341 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:25.884153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a474ca60-4620-4be9-a29a-a7be36d41341 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:25.884836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a474ca60-4620-4be9-a29a-a7be36d41341 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:25.885283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a474ca60-4620-4be9-a29a-a7be36d41341 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:25.885706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a474ca60-4620-4be9-a29a-a7be36d41341 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:25.888224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:26.015935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a474ca60-4620-4be9-a29a-a7be36d41341 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:26.024122 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a474ca60-4620-4be9-a29a-a7be36d41341 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1217 microversion: 2.1 time: 0.152296 Oct 12 22:42:26.024684 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2981/6600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:25 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:26.493295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-53b819db-ba11-4725-9e4f-7cb195f482a8 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5c98d0f-dd23-48c4-a1e3-9096f1b97555", "device": "/dev/sdb"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:26.495766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-53b819db-ba11-4725-9e4f-7cb195f482a8 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:26.503207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53b819db-ba11-4725-9e4f-7cb195f482a8 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:26.503736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53b819db-ba11-4725-9e4f-7cb195f482a8 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:26.504194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53b819db-ba11-4725-9e4f-7cb195f482a8 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:26.504889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53b819db-ba11-4725-9e4f-7cb195f482a8 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:26.505371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53b819db-ba11-4725-9e4f-7cb195f482a8 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:26.505800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53b819db-ba11-4725-9e4f-7cb195f482a8 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:26.508358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=95 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:26.760130 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-53b819db-ba11-4725-9e4f-7cb195f482a8 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "POST /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270290 Oct 12 22:42:26.765981 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3620/6601] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 22:42:26 2022] POST /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:42:27.047562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9c86f57f-8c68-403f-9f4f-2a1df032bcec tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:27.048209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9c86f57f-8c68-403f-9f4f-2a1df032bcec tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:27.055707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c86f57f-8c68-403f-9f4f-2a1df032bcec tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:27.056198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c86f57f-8c68-403f-9f4f-2a1df032bcec tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:27.056644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c86f57f-8c68-403f-9f4f-2a1df032bcec tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:27.057345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c86f57f-8c68-403f-9f4f-2a1df032bcec tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:27.057802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c86f57f-8c68-403f-9f4f-2a1df032bcec tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:27.058233 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c86f57f-8c68-403f-9f4f-2a1df032bcec tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:27.190054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9c86f57f-8c68-403f-9f4f-2a1df032bcec tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:27.197986 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9c86f57f-8c68-403f-9f4f-2a1df032bcec tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1217 microversion: 2.1 time: 0.154523 Oct 12 22:42:27.198550 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2982/6602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:27 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:28.222238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2245936e-105b-4b40-a294-692367e5db08 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:28.222878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2245936e-105b-4b40-a294-692367e5db08 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:28.230315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2245936e-105b-4b40-a294-692367e5db08 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:28.230812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2245936e-105b-4b40-a294-692367e5db08 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:28.231274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2245936e-105b-4b40-a294-692367e5db08 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:28.231990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2245936e-105b-4b40-a294-692367e5db08 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:28.232451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2245936e-105b-4b40-a294-692367e5db08 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:28.232882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2245936e-105b-4b40-a294-692367e5db08 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:28.367907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2245936e-105b-4b40-a294-692367e5db08 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:28.375656 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2245936e-105b-4b40-a294-692367e5db08 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1217 microversion: 2.1 time: 0.158880 Oct 12 22:42:28.376326 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3621/6603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:28 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:29.398395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-95d89442-f053-4ef4-8ea5-7dc29670e22c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:29.398940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-95d89442-f053-4ef4-8ea5-7dc29670e22c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:29.405912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95d89442-f053-4ef4-8ea5-7dc29670e22c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:29.406391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95d89442-f053-4ef4-8ea5-7dc29670e22c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:29.406827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95d89442-f053-4ef4-8ea5-7dc29670e22c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:29.407542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95d89442-f053-4ef4-8ea5-7dc29670e22c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:29.408486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95d89442-f053-4ef4-8ea5-7dc29670e22c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:29.408908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95d89442-f053-4ef4-8ea5-7dc29670e22c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:29.548060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-95d89442-f053-4ef4-8ea5-7dc29670e22c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:29.556654 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-95d89442-f053-4ef4-8ea5-7dc29670e22c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1217 microversion: 2.1 time: 0.162230 Oct 12 22:42:29.557236 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2983/6604] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:29 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:30.580016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d5bbacf7-e9b9-48c1-bafb-064668b59745 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:30.580656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d5bbacf7-e9b9-48c1-bafb-064668b59745 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:30.587862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5bbacf7-e9b9-48c1-bafb-064668b59745 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:30.588360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5bbacf7-e9b9-48c1-bafb-064668b59745 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:30.588805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5bbacf7-e9b9-48c1-bafb-064668b59745 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:30.589522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5bbacf7-e9b9-48c1-bafb-064668b59745 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:30.589982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5bbacf7-e9b9-48c1-bafb-064668b59745 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:30.590411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5bbacf7-e9b9-48c1-bafb-064668b59745 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:30.729349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d5bbacf7-e9b9-48c1-bafb-064668b59745 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:30.738081 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d5bbacf7-e9b9-48c1-bafb-064668b59745 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1217 microversion: 2.1 time: 0.162144 Oct 12 22:42:30.738655 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3622/6605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:30 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:30.912186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-ad505715-8092-4783-8097-6ff3e5eb852a req-9c42aa6a-b128-494f-aa8f-824273ac1f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff1c156-3133-4c24-81e5-770b0a6faaa4", "name": "network-vif-plugged", "status": "completed", "tag": "376adc19-ae45-49d6-8914-7087df7dcf21"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:30.923388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ad505715-8092-4783-8097-6ff3e5eb852a req-9c42aa6a-b128-494f-aa8f-824273ac1f84 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:30.924523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ad505715-8092-4783-8097-6ff3e5eb852a req-9c42aa6a-b128-494f-aa8f-824273ac1f84 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:30.925056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ad505715-8092-4783-8097-6ff3e5eb852a req-9c42aa6a-b128-494f-aa8f-824273ac1f84 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:30.937316 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-ad505715-8092-4783-8097-6ff3e5eb852a req-9c42aa6a-b128-494f-aa8f-824273ac1f84 service nova] Creating event network-vif-plugged:376adc19-ae45-49d6-8914-7087df7dcf21 for instance cff1c156-3133-4c24-81e5-770b0a6faaa4 on n-h1-861111-1 Oct 12 22:42:30.942661 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-ad505715-8092-4783-8097-6ff3e5eb852a req-9c42aa6a-b128-494f-aa8f-824273ac1f84 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035077 Oct 12 22:42:30.943999 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2984/6606] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:42:31.761066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-45c2b890-3802-435f-b289-74fbf933da7a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:31.761759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-45c2b890-3802-435f-b289-74fbf933da7a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:31.769361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45c2b890-3802-435f-b289-74fbf933da7a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:31.769881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45c2b890-3802-435f-b289-74fbf933da7a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:31.770327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45c2b890-3802-435f-b289-74fbf933da7a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:31.771035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45c2b890-3802-435f-b289-74fbf933da7a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:31.771523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45c2b890-3802-435f-b289-74fbf933da7a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:31.771986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45c2b890-3802-435f-b289-74fbf933da7a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:31.902944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-45c2b890-3802-435f-b289-74fbf933da7a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:31.910874 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-45c2b890-3802-435f-b289-74fbf933da7a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1217 microversion: 2.1 time: 0.153739 Oct 12 22:42:31.911493 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3623/6607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:31 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:32.933929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5452a9f3-8b3a-4f62-b469-4308f8b72540 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:32.934628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5452a9f3-8b3a-4f62-b469-4308f8b72540 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:32.942333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5452a9f3-8b3a-4f62-b469-4308f8b72540 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:32.942804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5452a9f3-8b3a-4f62-b469-4308f8b72540 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:32.943268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5452a9f3-8b3a-4f62-b469-4308f8b72540 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:32.943936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5452a9f3-8b3a-4f62-b469-4308f8b72540 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:32.944385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5452a9f3-8b3a-4f62-b469-4308f8b72540 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:32.944806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5452a9f3-8b3a-4f62-b469-4308f8b72540 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:33.075608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5452a9f3-8b3a-4f62-b469-4308f8b72540 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:33.083446 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5452a9f3-8b3a-4f62-b469-4308f8b72540 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1403 microversion: 2.1 time: 0.153756 Oct 12 22:42:33.084020 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2985/6608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:32 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1403 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:33.105157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2118c297-9cde-4e2d-a342-03671cb71ba3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:33.105774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2118c297-9cde-4e2d-a342-03671cb71ba3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:33.113346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2118c297-9cde-4e2d-a342-03671cb71ba3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:33.113893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2118c297-9cde-4e2d-a342-03671cb71ba3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:33.114426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2118c297-9cde-4e2d-a342-03671cb71ba3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:33.115350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2118c297-9cde-4e2d-a342-03671cb71ba3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:33.115952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2118c297-9cde-4e2d-a342-03671cb71ba3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:33.116399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2118c297-9cde-4e2d-a342-03671cb71ba3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:33.250595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2118c297-9cde-4e2d-a342-03671cb71ba3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:33.258360 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2118c297-9cde-4e2d-a342-03671cb71ba3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1403 microversion: 2.1 time: 0.157138 Oct 12 22:42:33.258941 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3624/6609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:33 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1403 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:33.280935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-48fea51f-8602-47be-88f8-439c04c51d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-179081846"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:33.283764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-48fea51f-8602-47be-88f8-439c04c51d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:33.289628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48fea51f-8602-47be-88f8-439c04c51d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:33.290103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48fea51f-8602-47be-88f8-439c04c51d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:33.290532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48fea51f-8602-47be-88f8-439c04c51d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:33.291213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48fea51f-8602-47be-88f8-439c04c51d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:33.291682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48fea51f-8602-47be-88f8-439c04c51d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:33.292592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48fea51f-8602-47be-88f8-439c04c51d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:33.385790 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.compute.api [None req-48fea51f-8602-47be-88f8-439c04c51d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Attempting to quiesce instance before volume snapshot. Oct 12 22:42:33.428790 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.compute.api [None req-48fea51f-8602-47be-88f8-439c04c51d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 12 22:42:33.498363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-48fea51f-8602-47be-88f8-439c04c51d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Creating snapshot from volume 70508b23-3c89-40af-aa6b-b49e0fd846f2. {{(pid=120452) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 12 22:42:34.230711 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-48fea51f-8602-47be-88f8-439c04c51d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "POST /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4/action" status: 202 len: 0 microversion: 2.1 time: 0.953676 Oct 12 22:42:34.236964 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2986/6610] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:42:33 2022] POST /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4/action => generated 0 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:42:35.388107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-466068649", "imageRef": "e557a3bb-8bcb-4742-996f-f2a467f3ef01", "flavorRef": "452", "networks": [{"uuid": "6d173dd3-914e-48d4-bcc2-81061c8da03d"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:35.444023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] validate_networks() for [('6d173dd3-914e-48d4-bcc2-81061c8da03d', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:42:35.822342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:42:35.822772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:42:35.823274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:42:35.823694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:42:35.824137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:42:35.833008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:35.833492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:35.833933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:35.834662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:35.835126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:35.835583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:35.852107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:42:35.857295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for user 7d141d93d7a74a57b5b6475294c9af5e and project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:42:35.870061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:42:35.872635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='99394251-5007-4016-b989-61801c5ed6e9',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:42:35.947474 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4d6457a2-05b8-4f46-9eea-0dbc59f16d18 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563311 Oct 12 22:42:35.948132 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3625/6611] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:42:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:42:35.960899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3ffc65c8-0224-4d66-a859-f3015cfa0c20 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:35.961623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3ffc65c8-0224-4d66-a859-f3015cfa0c20 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:36.015791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3ffc65c8-0224-4d66-a859-f3015cfa0c20 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:36.022689 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3ffc65c8-0224-4d66-a859-f3015cfa0c20 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1229 microversion: 2.1 time: 0.066957 Oct 12 22:42:36.023539 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2987/6612] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:35 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1229 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:37.046581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-df659692-3842-4b7e-baca-811889f6c99b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:37.047146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-df659692-3842-4b7e-baca-811889f6c99b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:37.054228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df659692-3842-4b7e-baca-811889f6c99b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:37.054722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df659692-3842-4b7e-baca-811889f6c99b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:37.055206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df659692-3842-4b7e-baca-811889f6c99b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:37.055935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df659692-3842-4b7e-baca-811889f6c99b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:37.056401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df659692-3842-4b7e-baca-811889f6c99b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:37.056839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df659692-3842-4b7e-baca-811889f6c99b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:37.132108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-df659692-3842-4b7e-baca-811889f6c99b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:37.143123 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-df659692-3842-4b7e-baca-811889f6c99b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1281 microversion: 2.1 time: 0.100708 Oct 12 22:42:37.144049 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3626/6613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:37 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1281 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:38.168348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f33d4682-4ff4-49d4-bffc-1cb7fc0cd6e9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:38.169616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f33d4682-4ff4-49d4-bffc-1cb7fc0cd6e9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:38.181260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f33d4682-4ff4-49d4-bffc-1cb7fc0cd6e9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:38.181784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f33d4682-4ff4-49d4-bffc-1cb7fc0cd6e9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:38.182265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f33d4682-4ff4-49d4-bffc-1cb7fc0cd6e9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:38.182977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f33d4682-4ff4-49d4-bffc-1cb7fc0cd6e9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:38.195944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f33d4682-4ff4-49d4-bffc-1cb7fc0cd6e9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:38.196551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f33d4682-4ff4-49d4-bffc-1cb7fc0cd6e9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:38.451622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f33d4682-4ff4-49d4-bffc-1cb7fc0cd6e9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:38.465109 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f33d4682-4ff4-49d4-bffc-1cb7fc0cd6e9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1341 microversion: 2.1 time: 0.300355 Oct 12 22:42:38.465717 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2988/6614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:38 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1341 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:39.201321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-477d7ed6-1e95-46fb-915d-632213285749 req-e44f9796-2468-4f2c-9fd7-e20ffdbdff90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6c2ea15-06b2-434a-a9df-210053f8871d", "tag": "9b5e5b93-180b-493d-b567-6d500f1e4e17"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:39.245676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-477d7ed6-1e95-46fb-915d-632213285749 req-e44f9796-2468-4f2c-9fd7-e20ffdbdff90 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:39.247577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-477d7ed6-1e95-46fb-915d-632213285749 req-e44f9796-2468-4f2c-9fd7-e20ffdbdff90 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:39.249110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-477d7ed6-1e95-46fb-915d-632213285749 req-e44f9796-2468-4f2c-9fd7-e20ffdbdff90 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:39.281652 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-477d7ed6-1e95-46fb-915d-632213285749 req-e44f9796-2468-4f2c-9fd7-e20ffdbdff90 service nova] Creating event network-changed:9b5e5b93-180b-493d-b567-6d500f1e4e17 for instance b6c2ea15-06b2-434a-a9df-210053f8871d on n-h2-861111-1 Oct 12 22:42:39.295342 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-477d7ed6-1e95-46fb-915d-632213285749 req-e44f9796-2468-4f2c-9fd7-e20ffdbdff90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101372 Oct 12 22:42:39.296044 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3627/6615] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:39.496762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-db09bce6-3666-46eb-8770-c3013116b613 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:39.497322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-db09bce6-3666-46eb-8770-c3013116b613 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:39.500128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=34 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:39.510219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db09bce6-3666-46eb-8770-c3013116b613 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:39.510725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db09bce6-3666-46eb-8770-c3013116b613 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:39.511184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db09bce6-3666-46eb-8770-c3013116b613 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:39.511938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db09bce6-3666-46eb-8770-c3013116b613 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:39.512411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db09bce6-3666-46eb-8770-c3013116b613 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:39.512858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db09bce6-3666-46eb-8770-c3013116b613 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:39.724910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-db09bce6-3666-46eb-8770-c3013116b613 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:39.736051 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-db09bce6-3666-46eb-8770-c3013116b613 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1341 microversion: 2.1 time: 0.242562 Oct 12 22:42:39.736774 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2989/6616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:39 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1341 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:40.473990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d496eeda-5944-4e9f-b3b1-68d0d7ff60a6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:40.476397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d496eeda-5944-4e9f-b3b1-68d0d7ff60a6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:40.483271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d496eeda-5944-4e9f-b3b1-68d0d7ff60a6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:40.485907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d496eeda-5944-4e9f-b3b1-68d0d7ff60a6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:40.486359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d496eeda-5944-4e9f-b3b1-68d0d7ff60a6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:40.487086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d496eeda-5944-4e9f-b3b1-68d0d7ff60a6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:40.487574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d496eeda-5944-4e9f-b3b1-68d0d7ff60a6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:40.488010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d496eeda-5944-4e9f-b3b1-68d0d7ff60a6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:40.548241 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d496eeda-5944-4e9f-b3b1-68d0d7ff60a6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f/action" status: 200 len: 62925 microversion: 2.1 time: 0.193237 Oct 12 22:42:40.548830 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3628/6617] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:42:40 2022] POST /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f/action => generated 62925 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:42:40.772890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-be4e2844-bb02-49c6-8c8c-a9e22f4efc25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:40.773523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-be4e2844-bb02-49c6-8c8c-a9e22f4efc25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:40.780259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be4e2844-bb02-49c6-8c8c-a9e22f4efc25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:40.780992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be4e2844-bb02-49c6-8c8c-a9e22f4efc25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:40.781440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be4e2844-bb02-49c6-8c8c-a9e22f4efc25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:40.782155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be4e2844-bb02-49c6-8c8c-a9e22f4efc25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:40.782646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be4e2844-bb02-49c6-8c8c-a9e22f4efc25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:40.783082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be4e2844-bb02-49c6-8c8c-a9e22f4efc25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:40.941869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-be4e2844-bb02-49c6-8c8c-a9e22f4efc25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:40.950144 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-be4e2844-bb02-49c6-8c8c-a9e22f4efc25 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1341 microversion: 2.1 time: 0.195695 Oct 12 22:42:40.958391 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2990/6618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:40 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1341 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:41.974423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b93c654b-ace1-4210-be10-ba4513f35cd8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:41.975143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b93c654b-ace1-4210-be10-ba4513f35cd8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:41.978032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:41.984606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b93c654b-ace1-4210-be10-ba4513f35cd8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:41.985099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b93c654b-ace1-4210-be10-ba4513f35cd8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:41.985558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b93c654b-ace1-4210-be10-ba4513f35cd8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:41.986260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b93c654b-ace1-4210-be10-ba4513f35cd8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:41.986714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b93c654b-ace1-4210-be10-ba4513f35cd8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:41.987155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b93c654b-ace1-4210-be10-ba4513f35cd8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:42.209365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b93c654b-ace1-4210-be10-ba4513f35cd8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:42.219269 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b93c654b-ace1-4210-be10-ba4513f35cd8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1341 microversion: 2.1 time: 0.249463 Oct 12 22:42:42.220285 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3629/6619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:41 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1341 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:43.265400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-91bdcb6c-62c0-4064-a83a-335bcc3712aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:43.267257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-91bdcb6c-62c0-4064-a83a-335bcc3712aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:43.273880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91bdcb6c-62c0-4064-a83a-335bcc3712aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:43.274390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91bdcb6c-62c0-4064-a83a-335bcc3712aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:43.274845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91bdcb6c-62c0-4064-a83a-335bcc3712aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:43.275606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91bdcb6c-62c0-4064-a83a-335bcc3712aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:43.276300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91bdcb6c-62c0-4064-a83a-335bcc3712aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:43.277020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91bdcb6c-62c0-4064-a83a-335bcc3712aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:43.487547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-91bdcb6c-62c0-4064-a83a-335bcc3712aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:43.496066 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-91bdcb6c-62c0-4064-a83a-335bcc3712aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1341 microversion: 2.1 time: 0.234942 Oct 12 22:42:43.496645 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2991/6620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:43 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1341 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:44.521423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d0bbab4c-932a-4e58-a8d8-5eea4beec00e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:44.522061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d0bbab4c-932a-4e58-a8d8-5eea4beec00e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:44.529095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0bbab4c-932a-4e58-a8d8-5eea4beec00e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:44.529639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0bbab4c-932a-4e58-a8d8-5eea4beec00e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:44.530007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0bbab4c-932a-4e58-a8d8-5eea4beec00e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:44.530719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0bbab4c-932a-4e58-a8d8-5eea4beec00e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:44.531167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0bbab4c-932a-4e58-a8d8-5eea4beec00e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:44.531856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d0bbab4c-932a-4e58-a8d8-5eea4beec00e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:44.711927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d0bbab4c-932a-4e58-a8d8-5eea4beec00e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:44.719892 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d0bbab4c-932a-4e58-a8d8-5eea4beec00e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1341 microversion: 2.1 time: 0.202878 Oct 12 22:42:44.736184 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3630/6621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:44 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1341 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:45.747610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d69cea29-84ca-4cf8-ae25-a949e872f25e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:45.749106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d69cea29-84ca-4cf8-ae25-a949e872f25e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:45.776847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69cea29-84ca-4cf8-ae25-a949e872f25e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:45.777361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69cea29-84ca-4cf8-ae25-a949e872f25e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:45.778099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69cea29-84ca-4cf8-ae25-a949e872f25e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:45.778980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69cea29-84ca-4cf8-ae25-a949e872f25e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:45.779659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69cea29-84ca-4cf8-ae25-a949e872f25e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:45.780480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69cea29-84ca-4cf8-ae25-a949e872f25e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:45.982883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d69cea29-84ca-4cf8-ae25-a949e872f25e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:45.995045 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d69cea29-84ca-4cf8-ae25-a949e872f25e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1341 microversion: 2.1 time: 0.251459 Oct 12 22:42:45.995779 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2992/6622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:45 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1341 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:47.020350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-977ec605-10da-4856-a5df-4a6e9c5363f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:47.020983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-977ec605-10da-4856-a5df-4a6e9c5363f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:47.023818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:47.024633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:47.030711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-977ec605-10da-4856-a5df-4a6e9c5363f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:47.031265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-977ec605-10da-4856-a5df-4a6e9c5363f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:47.031702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-977ec605-10da-4856-a5df-4a6e9c5363f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:47.033043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-977ec605-10da-4856-a5df-4a6e9c5363f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:47.033506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-977ec605-10da-4856-a5df-4a6e9c5363f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:47.033942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-977ec605-10da-4856-a5df-4a6e9c5363f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:47.166578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-977ec605-10da-4856-a5df-4a6e9c5363f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:47.174911 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-977ec605-10da-4856-a5df-4a6e9c5363f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1341 microversion: 2.1 time: 0.159016 Oct 12 22:42:47.175529 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3631/6623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:47 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1341 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:48.197284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-533c74bb-76f7-4c98-a349-1f6a0cfa7767 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:48.198038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-533c74bb-76f7-4c98-a349-1f6a0cfa7767 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:48.200005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:48.207324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-533c74bb-76f7-4c98-a349-1f6a0cfa7767 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:48.207905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-533c74bb-76f7-4c98-a349-1f6a0cfa7767 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:48.208454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-533c74bb-76f7-4c98-a349-1f6a0cfa7767 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:48.209239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-533c74bb-76f7-4c98-a349-1f6a0cfa7767 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:48.209781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-533c74bb-76f7-4c98-a349-1f6a0cfa7767 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:48.210297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-533c74bb-76f7-4c98-a349-1f6a0cfa7767 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:48.347929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-533c74bb-76f7-4c98-a349-1f6a0cfa7767 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:48.356018 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-533c74bb-76f7-4c98-a349-1f6a0cfa7767 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1341 microversion: 2.1 time: 0.162926 Oct 12 22:42:48.356585 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2993/6624] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:48 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:49.380735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4894c200-05c0-4ba2-a010-a93da831bee7 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:49.382333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4894c200-05c0-4ba2-a010-a93da831bee7 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:49.389420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4894c200-05c0-4ba2-a010-a93da831bee7 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:49.389906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4894c200-05c0-4ba2-a010-a93da831bee7 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:49.390355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4894c200-05c0-4ba2-a010-a93da831bee7 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:49.391071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4894c200-05c0-4ba2-a010-a93da831bee7 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:49.391641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4894c200-05c0-4ba2-a010-a93da831bee7 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:49.392081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4894c200-05c0-4ba2-a010-a93da831bee7 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:49.533384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4894c200-05c0-4ba2-a010-a93da831bee7 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:49.541725 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4894c200-05c0-4ba2-a010-a93da831bee7 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1341 microversion: 2.1 time: 0.166504 Oct 12 22:42:49.558156 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3632/6625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:49 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:50.567299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d18f1010-f5d9-40b8-a22b-d5e0354a4a6e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:50.567935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d18f1010-f5d9-40b8-a22b-d5e0354a4a6e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:50.576338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d18f1010-f5d9-40b8-a22b-d5e0354a4a6e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:50.576976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d18f1010-f5d9-40b8-a22b-d5e0354a4a6e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:50.577658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d18f1010-f5d9-40b8-a22b-d5e0354a4a6e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:50.578373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d18f1010-f5d9-40b8-a22b-d5e0354a4a6e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:50.578873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d18f1010-f5d9-40b8-a22b-d5e0354a4a6e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:50.580050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d18f1010-f5d9-40b8-a22b-d5e0354a4a6e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:50.720781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d18f1010-f5d9-40b8-a22b-d5e0354a4a6e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:50.728723 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d18f1010-f5d9-40b8-a22b-d5e0354a4a6e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1341 microversion: 2.1 time: 0.166789 Oct 12 22:42:50.729309 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2994/6626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:50 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:50.899823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4881a040-986a-49cc-8304-32278d235ac5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:50.900458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4881a040-986a-49cc-8304-32278d235ac5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:50.907568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4881a040-986a-49cc-8304-32278d235ac5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:50.908336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4881a040-986a-49cc-8304-32278d235ac5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:50.908487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4881a040-986a-49cc-8304-32278d235ac5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:50.909222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4881a040-986a-49cc-8304-32278d235ac5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:50.909690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4881a040-986a-49cc-8304-32278d235ac5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:50.910117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4881a040-986a-49cc-8304-32278d235ac5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:51.000584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-4881a040-986a-49cc-8304-32278d235ac5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lazy-loading 'services' on Instance uuid 16ecd20d-7eba-44cb-9f7f-441177312810 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:42:51.071636 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4881a040-986a-49cc-8304-32278d235ac5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "DELETE /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810/os-volume_attachments/c5c98d0f-dd23-48c4-a1e3-9096f1b97555" status: 202 len: 0 microversion: 2.1 time: 0.175789 Oct 12 22:42:51.072283 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3633/6627] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 22:42:50 2022] DELETE /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810/os-volume_attachments/c5c98d0f-dd23-48c4-a1e3-9096f1b97555 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:42:51.753088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-470593c6-2921-4309-81f7-8b02181203aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:51.754867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-470593c6-2921-4309-81f7-8b02181203aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:51.766410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-470593c6-2921-4309-81f7-8b02181203aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:51.767435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-470593c6-2921-4309-81f7-8b02181203aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:51.768079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-470593c6-2921-4309-81f7-8b02181203aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:51.768979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-470593c6-2921-4309-81f7-8b02181203aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:51.769621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-470593c6-2921-4309-81f7-8b02181203aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:51.770231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-470593c6-2921-4309-81f7-8b02181203aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:51.930175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-470593c6-2921-4309-81f7-8b02181203aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:51.941551 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-470593c6-2921-4309-81f7-8b02181203aa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1341 microversion: 2.1 time: 0.191882 Oct 12 22:42:51.942201 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2995/6628] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:51 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1341 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:52.966695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e9d2aa0e-b54f-4094-9619-5d2f97851ea0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:52.967553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e9d2aa0e-b54f-4094-9619-5d2f97851ea0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:52.974656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9d2aa0e-b54f-4094-9619-5d2f97851ea0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:52.975148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9d2aa0e-b54f-4094-9619-5d2f97851ea0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:52.975743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9d2aa0e-b54f-4094-9619-5d2f97851ea0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:52.976440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9d2aa0e-b54f-4094-9619-5d2f97851ea0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:52.976902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9d2aa0e-b54f-4094-9619-5d2f97851ea0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:52.977333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9d2aa0e-b54f-4094-9619-5d2f97851ea0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:53.113402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e9d2aa0e-b54f-4094-9619-5d2f97851ea0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:53.122069 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e9d2aa0e-b54f-4094-9619-5d2f97851ea0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1375 microversion: 2.1 time: 0.160506 Oct 12 22:42:53.122657 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3634/6629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:52 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:54.147885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-54650c3f-84e8-4303-b08b-34d6575570b1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:54.148446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-54650c3f-84e8-4303-b08b-34d6575570b1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:54.155368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54650c3f-84e8-4303-b08b-34d6575570b1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:54.155861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54650c3f-84e8-4303-b08b-34d6575570b1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:54.156308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54650c3f-84e8-4303-b08b-34d6575570b1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:54.157532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54650c3f-84e8-4303-b08b-34d6575570b1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:54.157996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54650c3f-84e8-4303-b08b-34d6575570b1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:54.158431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54650c3f-84e8-4303-b08b-34d6575570b1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:54.293484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-54650c3f-84e8-4303-b08b-34d6575570b1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:54.303184 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-54650c3f-84e8-4303-b08b-34d6575570b1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1375 microversion: 2.1 time: 0.159355 Oct 12 22:42:54.303788 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2996/6630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:54 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:55.327711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-633ef7be-0315-4dfa-ae06-4211bb9287d1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:55.328343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-633ef7be-0315-4dfa-ae06-4211bb9287d1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:55.335991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-633ef7be-0315-4dfa-ae06-4211bb9287d1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:55.336478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-633ef7be-0315-4dfa-ae06-4211bb9287d1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:55.336923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-633ef7be-0315-4dfa-ae06-4211bb9287d1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:55.337625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-633ef7be-0315-4dfa-ae06-4211bb9287d1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:55.338172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-633ef7be-0315-4dfa-ae06-4211bb9287d1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:55.338567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-633ef7be-0315-4dfa-ae06-4211bb9287d1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:55.475991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-633ef7be-0315-4dfa-ae06-4211bb9287d1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:55.483899 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-633ef7be-0315-4dfa-ae06-4211bb9287d1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1375 microversion: 2.1 time: 0.161088 Oct 12 22:42:55.484706 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3635/6631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:55 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:56.508513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ad050a52-461e-408d-b7f3-0ff61b1b7d96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:56.509169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ad050a52-461e-408d-b7f3-0ff61b1b7d96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:56.517079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad050a52-461e-408d-b7f3-0ff61b1b7d96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:56.517575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad050a52-461e-408d-b7f3-0ff61b1b7d96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:56.518013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad050a52-461e-408d-b7f3-0ff61b1b7d96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:56.518723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad050a52-461e-408d-b7f3-0ff61b1b7d96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:56.519194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad050a52-461e-408d-b7f3-0ff61b1b7d96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:56.519660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad050a52-461e-408d-b7f3-0ff61b1b7d96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:56.523780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:56.663816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ad050a52-461e-408d-b7f3-0ff61b1b7d96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:56.671658 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ad050a52-461e-408d-b7f3-0ff61b1b7d96 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1375 microversion: 2.1 time: 0.168133 Oct 12 22:42:56.672236 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2997/6632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:56 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:56.747526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-347561db-7b43-46a5-a105-0bb9ec81250d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:56.748042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-347561db-7b43-46a5-a105-0bb9ec81250d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:56.755513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-347561db-7b43-46a5-a105-0bb9ec81250d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:56.756006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-347561db-7b43-46a5-a105-0bb9ec81250d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:56.756452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-347561db-7b43-46a5-a105-0bb9ec81250d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:56.757161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-347561db-7b43-46a5-a105-0bb9ec81250d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:56.757621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-347561db-7b43-46a5-a105-0bb9ec81250d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:56.758059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-347561db-7b43-46a5-a105-0bb9ec81250d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:56.760973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:56.788505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-347561db-7b43-46a5-a105-0bb9ec81250d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:42:56.863614 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-347561db-7b43-46a5-a105-0bb9ec81250d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "DELETE /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810" status: 204 len: 0 microversion: 2.1 time: 0.119639 Oct 12 22:42:56.864422 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3636/6633] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:42:56 2022] DELETE /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:42:56.873407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-66f4b08e-4a6e-4101-96a5-c3f4c5d868f9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:56.874205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-66f4b08e-4a6e-4101-96a5-c3f4c5d868f9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:56.882549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66f4b08e-4a6e-4101-96a5-c3f4c5d868f9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:56.883104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66f4b08e-4a6e-4101-96a5-c3f4c5d868f9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:56.883641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66f4b08e-4a6e-4101-96a5-c3f4c5d868f9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:56.884410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66f4b08e-4a6e-4101-96a5-c3f4c5d868f9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:56.884929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66f4b08e-4a6e-4101-96a5-c3f4c5d868f9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:56.885377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66f4b08e-4a6e-4101-96a5-c3f4c5d868f9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:57.021852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-66f4b08e-4a6e-4101-96a5-c3f4c5d868f9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:57.030779 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-66f4b08e-4a6e-4101-96a5-c3f4c5d868f9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810" status: 200 len: 1514 microversion: 2.1 time: 0.162147 Oct 12 22:42:57.031381 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2998/6634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:56 2022] GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:57.695526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-000dcf0a-2337-40c4-9d60-426d96dcd8f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:57.696496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-000dcf0a-2337-40c4-9d60-426d96dcd8f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:57.702813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-000dcf0a-2337-40c4-9d60-426d96dcd8f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:57.703333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-000dcf0a-2337-40c4-9d60-426d96dcd8f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:57.703802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-000dcf0a-2337-40c4-9d60-426d96dcd8f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:57.704524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-000dcf0a-2337-40c4-9d60-426d96dcd8f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:57.704982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-000dcf0a-2337-40c4-9d60-426d96dcd8f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:57.705428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-000dcf0a-2337-40c4-9d60-426d96dcd8f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:57.848665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-000dcf0a-2337-40c4-9d60-426d96dcd8f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:57.857444 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-000dcf0a-2337-40c4-9d60-426d96dcd8f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1375 microversion: 2.1 time: 0.166470 Oct 12 22:42:57.858027 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3637/6635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:57 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:58.056293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-16a84b55-aa09-47ba-af60-59137ddaceb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:58.057062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-16a84b55-aa09-47ba-af60-59137ddaceb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:58.065435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16a84b55-aa09-47ba-af60-59137ddaceb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:58.066096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16a84b55-aa09-47ba-af60-59137ddaceb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:58.066601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16a84b55-aa09-47ba-af60-59137ddaceb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:58.067504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16a84b55-aa09-47ba-af60-59137ddaceb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:58.067968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16a84b55-aa09-47ba-af60-59137ddaceb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:58.068405 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16a84b55-aa09-47ba-af60-59137ddaceb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:58.208422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-16a84b55-aa09-47ba-af60-59137ddaceb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:58.216264 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-16a84b55-aa09-47ba-af60-59137ddaceb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810" status: 200 len: 1514 microversion: 2.1 time: 0.164929 Oct 12 22:42:58.217157 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2999/6636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:58 2022] GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:58.887347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a9f49443-16d9-443f-a258-8146a7ab33b2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:58.888206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a9f49443-16d9-443f-a258-8146a7ab33b2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:58.897143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9f49443-16d9-443f-a258-8146a7ab33b2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:58.897639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9f49443-16d9-443f-a258-8146a7ab33b2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:58.898077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9f49443-16d9-443f-a258-8146a7ab33b2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:58.898844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9f49443-16d9-443f-a258-8146a7ab33b2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:58.899329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9f49443-16d9-443f-a258-8146a7ab33b2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:58.899759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9f49443-16d9-443f-a258-8146a7ab33b2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:59.045203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a9f49443-16d9-443f-a258-8146a7ab33b2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:59.053625 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a9f49443-16d9-443f-a258-8146a7ab33b2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1375 microversion: 2.1 time: 0.171901 Oct 12 22:42:59.054212 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3638/6637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:58 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1375 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:59.243999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bd8908c7-b064-4862-a67c-58db6dd5f420 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:59.245267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bd8908c7-b064-4862-a67c-58db6dd5f420 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:59.257450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd8908c7-b064-4862-a67c-58db6dd5f420 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:59.257969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd8908c7-b064-4862-a67c-58db6dd5f420 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:59.258408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd8908c7-b064-4862-a67c-58db6dd5f420 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:59.259135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd8908c7-b064-4862-a67c-58db6dd5f420 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:59.259635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd8908c7-b064-4862-a67c-58db6dd5f420 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:59.260076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd8908c7-b064-4862-a67c-58db6dd5f420 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:59.369669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd8908c7-b064-4862-a67c-58db6dd5f420 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:59.378899 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bd8908c7-b064-4862-a67c-58db6dd5f420 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810" status: 200 len: 1472 microversion: 2.1 time: 0.140381 Oct 12 22:42:59.379638 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3000/6638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:59 2022] GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 => generated 1472 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:59.382477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-8ebd2e39-cc24-46fa-b7f1-e60597a5dcd4 req-f8e5b869-f719-4cd9-9244-79335c0a01b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ecd20d-7eba-44cb-9f7f-441177312810", "name": "network-vif-deleted", "tag": "b4cf6480-d196-4dc9-a58a-a7ccb9c9ee39"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:59.393759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8ebd2e39-cc24-46fa-b7f1-e60597a5dcd4 req-f8e5b869-f719-4cd9-9244-79335c0a01b3 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:59.394293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8ebd2e39-cc24-46fa-b7f1-e60597a5dcd4 req-f8e5b869-f719-4cd9-9244-79335c0a01b3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:59.394741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8ebd2e39-cc24-46fa-b7f1-e60597a5dcd4 req-f8e5b869-f719-4cd9-9244-79335c0a01b3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:59.406578 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-8ebd2e39-cc24-46fa-b7f1-e60597a5dcd4 req-f8e5b869-f719-4cd9-9244-79335c0a01b3 service nova] Creating event network-vif-deleted:b4cf6480-d196-4dc9-a58a-a7ccb9c9ee39 for instance 16ecd20d-7eba-44cb-9f7f-441177312810 on n-h2-861111-1 Oct 12 22:42:59.412285 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-8ebd2e39-cc24-46fa-b7f1-e60597a5dcd4 req-f8e5b869-f719-4cd9-9244-79335c0a01b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033823 Oct 12 22:42:59.412906 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3639/6639] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:43:00.078146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-74192d92-0b6b-4847-ab19-0cdcb858b710 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:00.079645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-74192d92-0b6b-4847-ab19-0cdcb858b710 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:00.087349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74192d92-0b6b-4847-ab19-0cdcb858b710 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:00.087970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74192d92-0b6b-4847-ab19-0cdcb858b710 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:00.088766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74192d92-0b6b-4847-ab19-0cdcb858b710 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:00.090180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74192d92-0b6b-4847-ab19-0cdcb858b710 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:00.091018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74192d92-0b6b-4847-ab19-0cdcb858b710 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:00.091492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74192d92-0b6b-4847-ab19-0cdcb858b710 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:00.228618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-74192d92-0b6b-4847-ab19-0cdcb858b710 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:00.236921 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-74192d92-0b6b-4847-ab19-0cdcb858b710 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1375 microversion: 2.1 time: 0.163073 Oct 12 22:43:00.237497 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3001/6640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:00 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:00.405156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2414f056-7fb7-4b58-9d1a-b748d94d74de tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:00.405854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2414f056-7fb7-4b58-9d1a-b748d94d74de tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 16ecd20d-7eba-44cb-9f7f-441177312810] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:00.412623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2414f056-7fb7-4b58-9d1a-b748d94d74de tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:00.413100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2414f056-7fb7-4b58-9d1a-b748d94d74de tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:00.413533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2414f056-7fb7-4b58-9d1a-b748d94d74de tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:00.414215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2414f056-7fb7-4b58-9d1a-b748d94d74de tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:00.414664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2414f056-7fb7-4b58-9d1a-b748d94d74de tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:00.415089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2414f056-7fb7-4b58-9d1a-b748d94d74de tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:00.428876 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-2414f056-7fb7-4b58-9d1a-b748d94d74de tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] HTTP exception thrown: Instance 16ecd20d-7eba-44cb-9f7f-441177312810 could not be found. Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2414f056-7fb7-4b58-9d1a-b748d94d74de tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Request method failure captured: Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 HTTP/1.1 Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0J4QhmtW5_v1N6yo-394UHGfA4AHVoTKVi7e74UOzkQHm3mUSjhJaQgrYlpqP62wWPTdLj-H1lJ6wZfW4i2UtJKOJy_p3RfZq3ckZK_6PucWEaGFyGMDD02MxavaGVFIC3sLzkIGx06VPmscBJ4OsmU_23x-6pSnfFbPbwDtn_U9Ok Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1cc51c59f6b348f7a707a864ce232516 Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1077196455 Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1cc51c59f6b348f7a707a864ce232516"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1cc51c59f6b348f7a707a864ce232516"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1cc51c59f6b348f7a707a864ce232516", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1cc51c59f6b348f7a707a864ce232516"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-VolumesSnapshotTestJSON-1077196455 Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1cc51c59f6b348f7a707a864ce232516 Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1077196455 Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-VolumesSnapshotTestJSON-1077196455-project Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: b8be40d3bedf44e5855cb97f7832bd65 Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-VolumesSnapshotTestJSON-1077196455-project Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 16ecd20d-7eba-44cb-9f7f-441177312810 could not be found. Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '16ecd20d-7eba-44cb-9f7f-441177312810'} Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ecd20d-7eba-44cb-9f7f-441177312810 could not be found. Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ecd20d-7eba-44cb-9f7f-441177312810 could not be found. Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:00.430456 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:00.435840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:00.435840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:00.435840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:00.435840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:43:00.435840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:43:00.435840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ecd20d-7eba-44cb-9f7f-441177312810 could not be found. Oct 12 22:43:00.435840 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:00.435840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2414f056-7fb7-4b58-9d1a-b748d94d74de tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Returning 404 to user: Instance 16ecd20d-7eba-44cb-9f7f-441177312810 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:43:00.435840 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2414f056-7fb7-4b58-9d1a-b748d94d74de tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810" status: 404 len: 111 microversion: 2.1 time: 0.031875 Oct 12 22:43:00.435840 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3640/6641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:00 2022] GET /compute/v2.1/servers/16ecd20d-7eba-44cb-9f7f-441177312810 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:43:01.259903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7d4e8add-9d6d-4077-8500-904ba0953371 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:01.260538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7d4e8add-9d6d-4077-8500-904ba0953371 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:01.267476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d4e8add-9d6d-4077-8500-904ba0953371 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:01.268009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d4e8add-9d6d-4077-8500-904ba0953371 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:01.268473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d4e8add-9d6d-4077-8500-904ba0953371 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:01.269192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d4e8add-9d6d-4077-8500-904ba0953371 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:01.269663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d4e8add-9d6d-4077-8500-904ba0953371 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:01.270108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d4e8add-9d6d-4077-8500-904ba0953371 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:01.406998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7d4e8add-9d6d-4077-8500-904ba0953371 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:01.415197 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7d4e8add-9d6d-4077-8500-904ba0953371 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1375 microversion: 2.1 time: 0.159238 Oct 12 22:43:01.415812 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3002/6642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:01 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:02.440987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-35e46a77-2ce0-4bcb-82a3-6c20c673776e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:02.441609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-35e46a77-2ce0-4bcb-82a3-6c20c673776e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:02.450467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35e46a77-2ce0-4bcb-82a3-6c20c673776e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:02.450958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35e46a77-2ce0-4bcb-82a3-6c20c673776e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:02.451452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35e46a77-2ce0-4bcb-82a3-6c20c673776e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:02.452167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35e46a77-2ce0-4bcb-82a3-6c20c673776e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:02.452618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35e46a77-2ce0-4bcb-82a3-6c20c673776e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:02.453061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35e46a77-2ce0-4bcb-82a3-6c20c673776e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:02.607066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-35e46a77-2ce0-4bcb-82a3-6c20c673776e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:02.618396 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-35e46a77-2ce0-4bcb-82a3-6c20c673776e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1375 microversion: 2.1 time: 0.181660 Oct 12 22:43:02.619322 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3641/6643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:02 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1375 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:03.348554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b1d5f78b-e856-434f-b10f-0c0336a853de tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:03.349147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b1d5f78b-e856-434f-b10f-0c0336a853de tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:03.355299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1d5f78b-e856-434f-b10f-0c0336a853de tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:03.355802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1d5f78b-e856-434f-b10f-0c0336a853de tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:03.356254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1d5f78b-e856-434f-b10f-0c0336a853de tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:03.356966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1d5f78b-e856-434f-b10f-0c0336a853de tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:03.357432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1d5f78b-e856-434f-b10f-0c0336a853de tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:03.357875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1d5f78b-e856-434f-b10f-0c0336a853de tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:03.496694 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b1d5f78b-e856-434f-b10f-0c0336a853de tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1833 microversion: 2.1 time: 0.261568 Oct 12 22:43:03.497498 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3003/6644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:03 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1833 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:03.643132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9563bebc-4856-4d58-abe0-6935c26ec08f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:03.643857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9563bebc-4856-4d58-abe0-6935c26ec08f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:03.656357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9563bebc-4856-4d58-abe0-6935c26ec08f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:03.656926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9563bebc-4856-4d58-abe0-6935c26ec08f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:03.657985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9563bebc-4856-4d58-abe0-6935c26ec08f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:03.658715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9563bebc-4856-4d58-abe0-6935c26ec08f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:03.659216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9563bebc-4856-4d58-abe0-6935c26ec08f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:03.659678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9563bebc-4856-4d58-abe0-6935c26ec08f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:03.824222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9563bebc-4856-4d58-abe0-6935c26ec08f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:03.833129 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9563bebc-4856-4d58-abe0-6935c26ec08f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1375 microversion: 2.1 time: 0.194720 Oct 12 22:43:03.835514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2d43100b-512b-4e87-bf0c-c78e2dd5a6aa tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:03.836684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2d43100b-512b-4e87-bf0c-c78e2dd5a6aa tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:03.843791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d43100b-512b-4e87-bf0c-c78e2dd5a6aa tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:03.844759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d43100b-512b-4e87-bf0c-c78e2dd5a6aa tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:03.845376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d43100b-512b-4e87-bf0c-c78e2dd5a6aa tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:03.846584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d43100b-512b-4e87-bf0c-c78e2dd5a6aa tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:03.847320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d43100b-512b-4e87-bf0c-c78e2dd5a6aa tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:03.847808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d43100b-512b-4e87-bf0c-c78e2dd5a6aa tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:03.848496 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3642/6645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:03 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1375 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:03.878427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2d43100b-512b-4e87-bf0c-c78e2dd5a6aa tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:43:03.979636 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2d43100b-512b-4e87-bf0c-c78e2dd5a6aa tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 204 len: 0 microversion: 2.1 time: 0.148734 Oct 12 22:43:03.984175 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3004/6646] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:43:03 2022] DELETE /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:43:03.990096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f87aa292-b3ec-4d18-910c-b25d380fc05b tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:03.990722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f87aa292-b3ec-4d18-910c-b25d380fc05b tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:04.007361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f87aa292-b3ec-4d18-910c-b25d380fc05b tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:04.008167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f87aa292-b3ec-4d18-910c-b25d380fc05b tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:04.008705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f87aa292-b3ec-4d18-910c-b25d380fc05b tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:04.009360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f87aa292-b3ec-4d18-910c-b25d380fc05b tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:04.009825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f87aa292-b3ec-4d18-910c-b25d380fc05b tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:04.010253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f87aa292-b3ec-4d18-910c-b25d380fc05b tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:04.190906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f87aa292-b3ec-4d18-910c-b25d380fc05b tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5affeb55a85f49409606c84e4de040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5331169dc284a98be1b4c9801f9d24f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:04.201868 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f87aa292-b3ec-4d18-910c-b25d380fc05b tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 200 len: 1731 microversion: 2.1 time: 0.216199 Oct 12 22:43:04.202529 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3643/6647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:03 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 1731 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:04.357847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-22db238e-2f76-48e4-b707-17b60b103036 req-9e9be999-0652-47ab-a75f-2c17943aa483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6c2ea15-06b2-434a-a9df-210053f8871d", "name": "network-vif-plugged", "status": "completed", "tag": "9b5e5b93-180b-493d-b567-6d500f1e4e17"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:04.375228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-22db238e-2f76-48e4-b707-17b60b103036 req-9e9be999-0652-47ab-a75f-2c17943aa483 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:04.375869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-22db238e-2f76-48e4-b707-17b60b103036 req-9e9be999-0652-47ab-a75f-2c17943aa483 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:04.376781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-22db238e-2f76-48e4-b707-17b60b103036 req-9e9be999-0652-47ab-a75f-2c17943aa483 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:04.391204 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-22db238e-2f76-48e4-b707-17b60b103036 req-9e9be999-0652-47ab-a75f-2c17943aa483 service nova] Creating event network-vif-plugged:9b5e5b93-180b-493d-b567-6d500f1e4e17 for instance b6c2ea15-06b2-434a-a9df-210053f8871d on n-h2-861111-1 Oct 12 22:43:04.397112 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-22db238e-2f76-48e4-b707-17b60b103036 req-9e9be999-0652-47ab-a75f-2c17943aa483 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053678 Oct 12 22:43:04.398047 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3005/6648] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:04.682690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c5d3adc5-0dc4-4641-96e7-a63aba63e09f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:04.684016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c5d3adc5-0dc4-4641-96e7-a63aba63e09f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:04.692351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5d3adc5-0dc4-4641-96e7-a63aba63e09f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:04.693099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5d3adc5-0dc4-4641-96e7-a63aba63e09f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:04.693722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5d3adc5-0dc4-4641-96e7-a63aba63e09f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:04.694882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d0aed1fd-978f-4b03-961f-dfbde2f3da95 req-2857ff68-e03a-4eb0-990e-e209e1905714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f", "tag": "f09a9c76-1253-4c10-afae-3e74c87a8ea4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:04.695079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5d3adc5-0dc4-4641-96e7-a63aba63e09f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:04.695854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5d3adc5-0dc4-4641-96e7-a63aba63e09f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:04.696700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c5d3adc5-0dc4-4641-96e7-a63aba63e09f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:04.712309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d0aed1fd-978f-4b03-961f-dfbde2f3da95 req-2857ff68-e03a-4eb0-990e-e209e1905714 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:04.713150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d0aed1fd-978f-4b03-961f-dfbde2f3da95 req-2857ff68-e03a-4eb0-990e-e209e1905714 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:04.713861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d0aed1fd-978f-4b03-961f-dfbde2f3da95 req-2857ff68-e03a-4eb0-990e-e209e1905714 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:04.726914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c5d3adc5-0dc4-4641-96e7-a63aba63e09f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:43:04.729665 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d0aed1fd-978f-4b03-961f-dfbde2f3da95 req-2857ff68-e03a-4eb0-990e-e209e1905714 service nova] Creating event network-changed:f09a9c76-1253-4c10-afae-3e74c87a8ea4 for instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f on n-h2-861111-1 Oct 12 22:43:04.736317 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d0aed1fd-978f-4b03-961f-dfbde2f3da95 req-2857ff68-e03a-4eb0-990e-e209e1905714 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054867 Oct 12 22:43:04.737420 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3006/6649] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:04.822461 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c5d3adc5-0dc4-4641-96e7-a63aba63e09f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 204 len: 0 microversion: 2.1 time: 0.143817 Oct 12 22:43:04.823200 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3644/6650] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:43:04 2022] DELETE /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:43:04.832673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a212c94-f490-4b59-ac6d-3f1b418b568a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:04.833460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7a212c94-f490-4b59-ac6d-3f1b418b568a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:04.840152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a212c94-f490-4b59-ac6d-3f1b418b568a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:04.840578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a212c94-f490-4b59-ac6d-3f1b418b568a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:04.841018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a212c94-f490-4b59-ac6d-3f1b418b568a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:04.841723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a212c94-f490-4b59-ac6d-3f1b418b568a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:04.842183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a212c94-f490-4b59-ac6d-3f1b418b568a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:04.842620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a212c94-f490-4b59-ac6d-3f1b418b568a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:04.861060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-60cba19f-c03c-4a1d-bc9a-c959eb3759ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:04.862202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-60cba19f-c03c-4a1d-bc9a-c959eb3759ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:04.868626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60cba19f-c03c-4a1d-bc9a-c959eb3759ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:04.869132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60cba19f-c03c-4a1d-bc9a-c959eb3759ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:04.869588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60cba19f-c03c-4a1d-bc9a-c959eb3759ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:04.870411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60cba19f-c03c-4a1d-bc9a-c959eb3759ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:04.870886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60cba19f-c03c-4a1d-bc9a-c959eb3759ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:04.871351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60cba19f-c03c-4a1d-bc9a-c959eb3759ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:05.017982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a212c94-f490-4b59-ac6d-3f1b418b568a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:05.041815 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7a212c94-f490-4b59-ac6d-3f1b418b568a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1688 microversion: 2.1 time: 0.209519 Oct 12 22:43:05.041815 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3007/6651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:04 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1688 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:05.061242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-60cba19f-c03c-4a1d-bc9a-c959eb3759ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:05.070777 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-60cba19f-c03c-4a1d-bc9a-c959eb3759ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1375 microversion: 2.1 time: 0.216083 Oct 12 22:43:05.071402 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3645/6652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:04 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1375 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:05.368074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2e62029a-ab90-4607-82ca-f769ddc8d272 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:05.369318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2e62029a-ab90-4607-82ca-f769ddc8d272 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:05.378979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e62029a-ab90-4607-82ca-f769ddc8d272 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:05.379786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e62029a-ab90-4607-82ca-f769ddc8d272 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:05.380447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e62029a-ab90-4607-82ca-f769ddc8d272 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:05.381608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e62029a-ab90-4607-82ca-f769ddc8d272 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:05.382423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e62029a-ab90-4607-82ca-f769ddc8d272 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:05.383047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e62029a-ab90-4607-82ca-f769ddc8d272 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:05.617980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2e62029a-ab90-4607-82ca-f769ddc8d272 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5affeb55a85f49409606c84e4de040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5331169dc284a98be1b4c9801f9d24f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:05.628351 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2e62029a-ab90-4607-82ca-f769ddc8d272 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 200 len: 1731 microversion: 2.1 time: 0.402168 Oct 12 22:43:05.647821 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3008/6653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:05 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 1731 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:06.070679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-382b7204-cd44-4aa1-9a7f-3b5bacf99615 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:06.072502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-382b7204-cd44-4aa1-9a7f-3b5bacf99615 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:06.081104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-382b7204-cd44-4aa1-9a7f-3b5bacf99615 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:06.081846 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-382b7204-cd44-4aa1-9a7f-3b5bacf99615 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:06.082729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-382b7204-cd44-4aa1-9a7f-3b5bacf99615 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:06.083848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-382b7204-cd44-4aa1-9a7f-3b5bacf99615 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:06.084985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-382b7204-cd44-4aa1-9a7f-3b5bacf99615 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:06.085853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-382b7204-cd44-4aa1-9a7f-3b5bacf99615 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:06.095998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7add9bfd-4a1c-4f7e-beba-9a401e61ddc2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:06.096861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7add9bfd-4a1c-4f7e-beba-9a401e61ddc2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:06.107036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7add9bfd-4a1c-4f7e-beba-9a401e61ddc2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:06.107693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7add9bfd-4a1c-4f7e-beba-9a401e61ddc2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:06.109498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7add9bfd-4a1c-4f7e-beba-9a401e61ddc2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:06.110895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7add9bfd-4a1c-4f7e-beba-9a401e61ddc2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:06.113780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7add9bfd-4a1c-4f7e-beba-9a401e61ddc2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:06.114709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7add9bfd-4a1c-4f7e-beba-9a401e61ddc2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:06.286074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-382b7204-cd44-4aa1-9a7f-3b5bacf99615 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:06.294704 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-382b7204-cd44-4aa1-9a7f-3b5bacf99615 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1688 microversion: 2.1 time: 0.229501 Oct 12 22:43:06.295578 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3646/6654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:06 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1688 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:06.363037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7add9bfd-4a1c-4f7e-beba-9a401e61ddc2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:06.374458 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7add9bfd-4a1c-4f7e-beba-9a401e61ddc2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1375 microversion: 2.1 time: 0.282224 Oct 12 22:43:06.385395 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3009/6655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:06 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1375 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:06.659698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-56d87583-b5a5-449e-ab8c-73ec5e9b40d3 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:06.660611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-56d87583-b5a5-449e-ab8c-73ec5e9b40d3 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:06.668836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56d87583-b5a5-449e-ab8c-73ec5e9b40d3 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:06.669774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56d87583-b5a5-449e-ab8c-73ec5e9b40d3 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:06.670402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56d87583-b5a5-449e-ab8c-73ec5e9b40d3 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:06.671403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56d87583-b5a5-449e-ab8c-73ec5e9b40d3 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:06.672033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56d87583-b5a5-449e-ab8c-73ec5e9b40d3 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:06.672463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-56d87583-b5a5-449e-ab8c-73ec5e9b40d3 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:06.805197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-56d87583-b5a5-449e-ab8c-73ec5e9b40d3 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5affeb55a85f49409606c84e4de040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5331169dc284a98be1b4c9801f9d24f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:06.818730 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-56d87583-b5a5-449e-ab8c-73ec5e9b40d3 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 200 len: 1664 microversion: 2.1 time: 0.165520 Oct 12 22:43:06.832845 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3647/6656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:06 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 1664 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:07.123173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-265cb05e-0a91-43cd-9b9d-6b5789d08af1 req-8fe11ddc-fd21-48cc-af08-aa22667efcaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa", "name": "network-vif-deleted", "tag": "a445749d-e1fb-4cf4-a4e9-29d2afd930ce"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:07.161643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-265cb05e-0a91-43cd-9b9d-6b5789d08af1 req-8fe11ddc-fd21-48cc-af08-aa22667efcaa service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:07.163626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-265cb05e-0a91-43cd-9b9d-6b5789d08af1 req-8fe11ddc-fd21-48cc-af08-aa22667efcaa service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:07.165326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-265cb05e-0a91-43cd-9b9d-6b5789d08af1 req-8fe11ddc-fd21-48cc-af08-aa22667efcaa service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:07.202263 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-265cb05e-0a91-43cd-9b9d-6b5789d08af1 req-8fe11ddc-fd21-48cc-af08-aa22667efcaa service nova] Creating event network-vif-deleted:a445749d-e1fb-4cf4-a4e9-29d2afd930ce for instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa on n-h1-861111-1 Oct 12 22:43:07.220107 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-265cb05e-0a91-43cd-9b9d-6b5789d08af1 req-8fe11ddc-fd21-48cc-af08-aa22667efcaa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103237 Oct 12 22:43:07.224156 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3010/6657] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:07.322012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8e7e5f92-1d2e-48fb-a31c-83c1f8be2953 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:07.323276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8e7e5f92-1d2e-48fb-a31c-83c1f8be2953 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:07.345041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e7e5f92-1d2e-48fb-a31c-83c1f8be2953 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:07.355613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e7e5f92-1d2e-48fb-a31c-83c1f8be2953 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:07.358985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e7e5f92-1d2e-48fb-a31c-83c1f8be2953 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:07.359801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e7e5f92-1d2e-48fb-a31c-83c1f8be2953 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:07.360289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e7e5f92-1d2e-48fb-a31c-83c1f8be2953 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:07.362456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e7e5f92-1d2e-48fb-a31c-83c1f8be2953 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:07.400729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a5eddbf0-6c4b-42e5-8ba9-f09c2be73d8a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:07.401460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a5eddbf0-6c4b-42e5-8ba9-f09c2be73d8a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:07.415714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5eddbf0-6c4b-42e5-8ba9-f09c2be73d8a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:07.416463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5eddbf0-6c4b-42e5-8ba9-f09c2be73d8a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:07.417106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5eddbf0-6c4b-42e5-8ba9-f09c2be73d8a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:07.418083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5eddbf0-6c4b-42e5-8ba9-f09c2be73d8a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:07.418729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5eddbf0-6c4b-42e5-8ba9-f09c2be73d8a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:07.419408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5eddbf0-6c4b-42e5-8ba9-f09c2be73d8a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:07.563262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8e7e5f92-1d2e-48fb-a31c-83c1f8be2953 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:07.574348 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8e7e5f92-1d2e-48fb-a31c-83c1f8be2953 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1688 microversion: 2.1 time: 0.258011 Oct 12 22:43:07.575111 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3648/6658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:07 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1688 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:07.580467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1946678599", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "7f25dd6f-a021-4d21-9e99-73e8f56b6e5b"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:07.674720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] validate_networks() for [('7f25dd6f-a021-4d21-9e99-73e8f56b6e5b', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:43:07.790161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a5eddbf0-6c4b-42e5-8ba9-f09c2be73d8a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:07.802524 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a5eddbf0-6c4b-42e5-8ba9-f09c2be73d8a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1561 microversion: 2.1 time: 0.406229 Oct 12 22:43:07.803129 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3011/6659] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:07 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1561 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:07.834098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0ee275f7-32a2-423f-93b7-a2ce0eed1e45 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:07.834939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0ee275f7-32a2-423f-93b7-a2ce0eed1e45 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:07.847033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ee275f7-32a2-423f-93b7-a2ce0eed1e45 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:07.847581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ee275f7-32a2-423f-93b7-a2ce0eed1e45 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:07.848668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ee275f7-32a2-423f-93b7-a2ce0eed1e45 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:07.849480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ee275f7-32a2-423f-93b7-a2ce0eed1e45 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:07.849991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ee275f7-32a2-423f-93b7-a2ce0eed1e45 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:07.854733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ee275f7-32a2-423f-93b7-a2ce0eed1e45 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:08.154555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:43:08.155527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:43:08.156153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:43:08.156683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:43:08.162038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:43:08.174937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:08.175864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:08.176420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:08.177345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:08.178450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:08.179031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:08.204432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Getting quotas for project 1cc51c59f6b348f7a707a864ce232516. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:43:08.211594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Getting quotas for user b8be40d3bedf44e5855cb97f7832bd65 and project 1cc51c59f6b348f7a707a864ce232516. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:43:08.236084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:43:08.238901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:43:08.303000 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e58df78a-fb48-433d-b115-2f3dacc50a6e tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726591 Oct 12 22:43:08.303886 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3649/6660] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:43:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:43:08.316564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d21f26e4-a0b7-484f-837e-a9d260b8a398 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:08.317658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d21f26e4-a0b7-484f-837e-a9d260b8a398 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:08.329476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d21f26e4-a0b7-484f-837e-a9d260b8a398 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:08.331097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d21f26e4-a0b7-484f-837e-a9d260b8a398 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:08.332340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d21f26e4-a0b7-484f-837e-a9d260b8a398 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:08.333645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d21f26e4-a0b7-484f-837e-a9d260b8a398 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:08.334834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d21f26e4-a0b7-484f-837e-a9d260b8a398 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:08.335522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d21f26e4-a0b7-484f-837e-a9d260b8a398 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:08.367707 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-d21f26e4-a0b7-484f-837e-a9d260b8a398 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] HTTP exception thrown: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d21f26e4-a0b7-484f-837e-a9d260b8a398 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Request method failure captured: Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa HTTP/1.1 Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0HB9n7fayoNZ3vK7XMVxu6uOVIyot2mQbRkdFaogTaGhvNBkQtAVj3kjKrfmYdZhZOp3TXrwd5ltgYxkNz5KcchxpLjknecUTcbzvWG_XYiSItkQdvTtk1c0RXmvBg8aJ3uDAav3n63SKU_moZWAymZwLsvnVPZ2rqEmd8SiUcil-E Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: a5331169dc284a98be1b4c9801f9d24f Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestServerBasicOps-373488780 Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5331169dc284a98be1b4c9801f9d24f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5331169dc284a98be1b4c9801f9d24f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a5331169dc284a98be1b4c9801f9d24f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a5331169dc284a98be1b4c9801f9d24f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestServerBasicOps-373488780 Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: a5331169dc284a98be1b4c9801f9d24f Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestServerBasicOps-373488780 Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestServerBasicOps-373488780-project Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 5affeb55a85f49409606c84e4de040a7 Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestServerBasicOps-373488780-project Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'd2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa'} Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:08.369327 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:08.375980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:08.375980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:08.375980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:08.375980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:43:08.375980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:43:08.375980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. Oct 12 22:43:08.375980 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:08.375980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d21f26e4-a0b7-484f-837e-a9d260b8a398 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Returning 404 to user: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:43:08.375980 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d21f26e4-a0b7-484f-837e-a9d260b8a398 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 404 len: 111 microversion: 2.1 time: 0.063925 Oct 12 22:43:08.381684 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3650/6661] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:08 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:43:08.391882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1e8868f4-8462-48ab-8097-f27d6ef48507 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:08.392570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1e8868f4-8462-48ab-8097-f27d6ef48507 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:08.538938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0ee275f7-32a2-423f-93b7-a2ce0eed1e45 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:08.549744 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0ee275f7-32a2-423f-93b7-a2ce0eed1e45 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1561 microversion: 2.1 time: 0.720678 Oct 12 22:43:08.550280 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3012/6662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:07 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1561 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:08.581012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1e8868f4-8462-48ab-8097-f27d6ef48507 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:08.600368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-834d6a8d-c261-45ba-9420-0e00ab6eca49 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:08.600927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-834d6a8d-c261-45ba-9420-0e00ab6eca49 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:08.618659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-834d6a8d-c261-45ba-9420-0e00ab6eca49 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:08.619130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-834d6a8d-c261-45ba-9420-0e00ab6eca49 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:08.619637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-834d6a8d-c261-45ba-9420-0e00ab6eca49 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:08.620748 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1e8868f4-8462-48ab-8097-f27d6ef48507 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c" status: 200 len: 1219 microversion: 2.1 time: 0.239739 Oct 12 22:43:08.623090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-834d6a8d-c261-45ba-9420-0e00ab6eca49 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:08.624265 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3651/6663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:08 2022] GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c => generated 1219 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:08.644479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-834d6a8d-c261-45ba-9420-0e00ab6eca49 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:08.644987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-834d6a8d-c261-45ba-9420-0e00ab6eca49 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:08.719280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b62af000-f9f2-4c21-8b2e-3bb07683982a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:08.720245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b62af000-f9f2-4c21-8b2e-3bb07683982a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:08.729588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b62af000-f9f2-4c21-8b2e-3bb07683982a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:08.730951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b62af000-f9f2-4c21-8b2e-3bb07683982a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:08.731498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b62af000-f9f2-4c21-8b2e-3bb07683982a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:08.732810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b62af000-f9f2-4c21-8b2e-3bb07683982a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:08.733357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b62af000-f9f2-4c21-8b2e-3bb07683982a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:08.733868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b62af000-f9f2-4c21-8b2e-3bb07683982a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:08.736815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-834d6a8d-c261-45ba-9420-0e00ab6eca49 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:08.740021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-834d6a8d-c261-45ba-9420-0e00ab6eca49 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:08.740812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-834d6a8d-c261-45ba-9420-0e00ab6eca49 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:08.741544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-834d6a8d-c261-45ba-9420-0e00ab6eca49 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lazy-loading 'fault' on Instance uuid e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:43:08.783696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b62af000-f9f2-4c21-8b2e-3bb07683982a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:43:08.795605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-834d6a8d-c261-45ba-9420-0e00ab6eca49 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:08.797918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:08.807949 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-834d6a8d-c261-45ba-9420-0e00ab6eca49 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 200 len: 1355 microversion: 2.1 time: 0.210986 Oct 12 22:43:08.809021 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3013/6664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:08 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 1355 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:08.826659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:08.905426 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b62af000-f9f2-4c21-8b2e-3bb07683982a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 204 len: 0 microversion: 2.1 time: 0.189560 Oct 12 22:43:08.906084 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3652/6665] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:43:08 2022] DELETE /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:43:08.915648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-45a96ab6-dc5f-4e03-90d0-ce94e704d248 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:08.916625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-45a96ab6-dc5f-4e03-90d0-ce94e704d248 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:08.926933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45a96ab6-dc5f-4e03-90d0-ce94e704d248 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:08.927834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45a96ab6-dc5f-4e03-90d0-ce94e704d248 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:08.928338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45a96ab6-dc5f-4e03-90d0-ce94e704d248 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:08.929335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45a96ab6-dc5f-4e03-90d0-ce94e704d248 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:08.929874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45a96ab6-dc5f-4e03-90d0-ce94e704d248 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:08.930375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45a96ab6-dc5f-4e03-90d0-ce94e704d248 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:09.078970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-45a96ab6-dc5f-4e03-90d0-ce94e704d248 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:09.087991 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-45a96ab6-dc5f-4e03-90d0-ce94e704d248 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1567 microversion: 2.1 time: 0.177704 Oct 12 22:43:09.088567 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3014/6666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:08 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:09.106401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0d495d03-de29-4867-a57e-37a2d2981355 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:09.107122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0d495d03-de29-4867-a57e-37a2d2981355 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:09.113873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d495d03-de29-4867-a57e-37a2d2981355 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:09.114363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d495d03-de29-4867-a57e-37a2d2981355 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:09.114809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d495d03-de29-4867-a57e-37a2d2981355 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:09.115550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d495d03-de29-4867-a57e-37a2d2981355 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:09.116049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d495d03-de29-4867-a57e-37a2d2981355 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:09.116487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d495d03-de29-4867-a57e-37a2d2981355 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:09.131382 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-0d495d03-de29-4867-a57e-37a2d2981355 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] HTTP exception thrown: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0d495d03-de29-4867-a57e-37a2d2981355 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Request method failure captured: Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa HTTP/1.1 Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0HB9n7fayoNZ3vK7XMVxu6uOVIyot2mQbRkdFaogTaGhvNBkQtAVj3kjKrfmYdZhZOp3TXrwd5ltgYxkNz5KcchxpLjknecUTcbzvWG_XYiSItkQdvTtk1c0RXmvBg8aJ3uDAav3n63SKU_moZWAymZwLsvnVPZ2rqEmd8SiUcil-E Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: a5331169dc284a98be1b4c9801f9d24f Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestServerBasicOps-373488780 Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5331169dc284a98be1b4c9801f9d24f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5331169dc284a98be1b4c9801f9d24f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a5331169dc284a98be1b4c9801f9d24f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a5331169dc284a98be1b4c9801f9d24f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestServerBasicOps-373488780 Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: a5331169dc284a98be1b4c9801f9d24f Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestServerBasicOps-373488780 Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestServerBasicOps-373488780-project Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 5affeb55a85f49409606c84e4de040a7 Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestServerBasicOps-373488780-project Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'd2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa'} Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:43:09.133076 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:43:09.138400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. Oct 12 22:43:09.138400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:09.138400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:09.138400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:09.138400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:09.138400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:09.138400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:09.138400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:43:09.138400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:43:09.138400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. Oct 12 22:43:09.138400 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:09.138400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0d495d03-de29-4867-a57e-37a2d2981355 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Returning 404 to user: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:43:09.138400 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0d495d03-de29-4867-a57e-37a2d2981355 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 404 len: 111 microversion: 2.1 time: 0.032776 Oct 12 22:43:09.138400 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3653/6667] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:43:09 2022] DELETE /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:43:09.144211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9cea8588-9829-45f8-b21d-5f265f5af723 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:09.144698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9cea8588-9829-45f8-b21d-5f265f5af723 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [instance: d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:09.151690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cea8588-9829-45f8-b21d-5f265f5af723 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:09.152180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cea8588-9829-45f8-b21d-5f265f5af723 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:09.152628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cea8588-9829-45f8-b21d-5f265f5af723 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:09.153346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cea8588-9829-45f8-b21d-5f265f5af723 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:09.153804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cea8588-9829-45f8-b21d-5f265f5af723 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:09.154237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cea8588-9829-45f8-b21d-5f265f5af723 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:09.171167 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-9cea8588-9829-45f8-b21d-5f265f5af723 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] HTTP exception thrown: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9cea8588-9829-45f8-b21d-5f265f5af723 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Request method failure captured: Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa HTTP/1.1 Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0HB9n7fayoNZ3vK7XMVxu6uOVIyot2mQbRkdFaogTaGhvNBkQtAVj3kjKrfmYdZhZOp3TXrwd5ltgYxkNz5KcchxpLjknecUTcbzvWG_XYiSItkQdvTtk1c0RXmvBg8aJ3uDAav3n63SKU_moZWAymZwLsvnVPZ2rqEmd8SiUcil-E Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: a5331169dc284a98be1b4c9801f9d24f Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestServerBasicOps-373488780 Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5331169dc284a98be1b4c9801f9d24f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5331169dc284a98be1b4c9801f9d24f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a5331169dc284a98be1b4c9801f9d24f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a5331169dc284a98be1b4c9801f9d24f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestServerBasicOps-373488780 Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: a5331169dc284a98be1b4c9801f9d24f Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestServerBasicOps-373488780 Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestServerBasicOps-373488780-project Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 5affeb55a85f49409606c84e4de040a7 Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestServerBasicOps-373488780-project Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'd2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa'} Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:09.172756 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:09.178321 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:09.178321 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:09.178321 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:09.178321 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:43:09.178321 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:43:09.178321 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. Oct 12 22:43:09.178321 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:09.178321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9cea8588-9829-45f8-b21d-5f265f5af723 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Returning 404 to user: Instance d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:43:09.178321 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9cea8588-9829-45f8-b21d-5f265f5af723 tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa" status: 404 len: 111 microversion: 2.1 time: 0.034908 Oct 12 22:43:09.178321 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3015/6668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:09 2022] GET /compute/v2.1/servers/d2818ed0-0a1d-4da2-86b9-ae6b6b0ccfaa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:43:09.250430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-c21026fc-6805-4163-85e1-0d362994ab8d req-f17db0ef-00da-4858-9a65-8a57d6493a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f", "name": "network-vif-deleted", "tag": "f09a9c76-1253-4c10-afae-3e74c87a8ea4"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:09.260202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c21026fc-6805-4163-85e1-0d362994ab8d req-f17db0ef-00da-4858-9a65-8a57d6493a72 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:09.260689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c21026fc-6805-4163-85e1-0d362994ab8d req-f17db0ef-00da-4858-9a65-8a57d6493a72 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:09.261125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c21026fc-6805-4163-85e1-0d362994ab8d req-f17db0ef-00da-4858-9a65-8a57d6493a72 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:09.274202 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-c21026fc-6805-4163-85e1-0d362994ab8d req-f17db0ef-00da-4858-9a65-8a57d6493a72 service nova] Creating event network-vif-deleted:f09a9c76-1253-4c10-afae-3e74c87a8ea4 for instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f on n-h2-861111-1 Oct 12 22:43:09.279003 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-c21026fc-6805-4163-85e1-0d362994ab8d req-f17db0ef-00da-4858-9a65-8a57d6493a72 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032413 Oct 12 22:43:09.280038 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3654/6669] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:09.355481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f56fea84-b93c-4052-a3d4-183c45b8be3f tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] Calling method '.version_select at 0x7f5123692e50>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:09.361030 n-d-861111-1 devstack@n-api.service[120452]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f56fea84-b93c-4052-a3d4-183c45b8be3f tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [964e3926-3add-4edc-bbbe-de4152248cc8] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 22:43:09.651376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a695b1c7-77f3-4a23-8cea-8fe0c220a5c9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:09.652116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a695b1c7-77f3-4a23-8cea-8fe0c220a5c9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:09.659955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a695b1c7-77f3-4a23-8cea-8fe0c220a5c9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:09.660457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a695b1c7-77f3-4a23-8cea-8fe0c220a5c9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:09.660923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a695b1c7-77f3-4a23-8cea-8fe0c220a5c9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:09.661618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a695b1c7-77f3-4a23-8cea-8fe0c220a5c9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:09.662098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a695b1c7-77f3-4a23-8cea-8fe0c220a5c9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:09.662489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a695b1c7-77f3-4a23-8cea-8fe0c220a5c9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:09.727558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a695b1c7-77f3-4a23-8cea-8fe0c220a5c9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:09.736133 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a695b1c7-77f3-4a23-8cea-8fe0c220a5c9 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c" status: 200 len: 1279 microversion: 2.1 time: 0.089091 Oct 12 22:43:09.736939 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3655/6670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:09 2022] GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:09.834667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-81b7241d-3207-46bb-8cc6-a87d8c82b0a8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:09.835302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-81b7241d-3207-46bb-8cc6-a87d8c82b0a8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:09.841255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81b7241d-3207-46bb-8cc6-a87d8c82b0a8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:09.841739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81b7241d-3207-46bb-8cc6-a87d8c82b0a8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:09.842179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81b7241d-3207-46bb-8cc6-a87d8c82b0a8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:09.842868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81b7241d-3207-46bb-8cc6-a87d8c82b0a8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:09.843415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81b7241d-3207-46bb-8cc6-a87d8c82b0a8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:09.843849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81b7241d-3207-46bb-8cc6-a87d8c82b0a8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:09.858273 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-81b7241d-3207-46bb-8cc6-a87d8c82b0a8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] HTTP exception thrown: Instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f could not be found. Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-81b7241d-3207-46bb-8cc6-a87d8c82b0a8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Request method failure captured: Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f HTTP/1.1 Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0GT7kMjoeYhQ1Th4q7G_rjSfBz-SOd6Bk2_ScJ5gdprLwVptEtdNViG1pBtatnIyIuIXK-pDsF5xb7TwO3bZt7IWwrbvVcGcwuSVCzGTfwLlYAWKRg5O0DaNHlhbZQtTS0lSPT92gMQCb3wkKvhYt9T6IUbiTCIN3iqt07wMQT2obc Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: aa5cc899bfb3403c9aa9d192833cafa9 Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1768289362 Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aa5cc899bfb3403c9aa9d192833cafa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aa5cc899bfb3403c9aa9d192833cafa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aa5cc899bfb3403c9aa9d192833cafa9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aa5cc899bfb3403c9aa9d192833cafa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1768289362 Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: aa5cc899bfb3403c9aa9d192833cafa9 Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1768289362 Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestNetworkAdvancedServerOps-1768289362-project Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 2acd162da21348b6acb725bfe572bc00 Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1768289362-project Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f could not be found. Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f'} Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f could not be found. Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f could not be found. Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:09.860226 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:09.865534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:09.865534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:09.865534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:09.865534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:09.865534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:43:09.865534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:43:09.865534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f could not be found. Oct 12 22:43:09.865534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:09.865534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-81b7241d-3207-46bb-8cc6-a87d8c82b0a8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Returning 404 to user: Instance e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:43:09.865534 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-81b7241d-3207-46bb-8cc6-a87d8c82b0a8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f" status: 404 len: 111 microversion: 2.1 time: 0.031358 Oct 12 22:43:09.865534 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3656/6671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:09 2022] GET /compute/v2.1/servers/e7522f4b-d3d4-4a05-9641-d24ebe5aaa0f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:43:10.118001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-833596ac-db6f-4d96-a6dc-26ec73b30b58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:10.119959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-833596ac-db6f-4d96-a6dc-26ec73b30b58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:10.131732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-833596ac-db6f-4d96-a6dc-26ec73b30b58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:10.132316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-833596ac-db6f-4d96-a6dc-26ec73b30b58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:10.132928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-833596ac-db6f-4d96-a6dc-26ec73b30b58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:10.133802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-833596ac-db6f-4d96-a6dc-26ec73b30b58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:10.134261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-833596ac-db6f-4d96-a6dc-26ec73b30b58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:10.134691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-833596ac-db6f-4d96-a6dc-26ec73b30b58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:10.369011 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [None req-f56fea84-b93c-4052-a3d4-183c45b8be3f tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] [964e3926-3add-4edc-bbbe-de4152248cc8] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60046. Oct 12 22:43:10.379780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:10.382202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-833596ac-db6f-4d96-a6dc-26ec73b30b58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:10.395485 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-833596ac-db6f-4d96-a6dc-26ec73b30b58 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1567 microversion: 2.1 time: 0.284690 Oct 12 22:43:10.396544 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3657/6672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:10 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:10.405292 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f56fea84-b93c-4052-a3d4-183c45b8be3f tempest-TestServerBasicOps-373488780 tempest-TestServerBasicOps-373488780-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-636203393" status: 202 len: 0 microversion: 2.1 time: 1.053823 Oct 12 22:43:10.406291 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3016/6673] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 12 22:43:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-636203393 => generated 0 bytes in 1056 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:43:10.760526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d39f2bac-e15a-427a-ac93-d6e7a86d7767 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:10.761712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d39f2bac-e15a-427a-ac93-d6e7a86d7767 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:10.769206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d39f2bac-e15a-427a-ac93-d6e7a86d7767 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:10.770103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d39f2bac-e15a-427a-ac93-d6e7a86d7767 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:10.770842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d39f2bac-e15a-427a-ac93-d6e7a86d7767 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:10.772231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d39f2bac-e15a-427a-ac93-d6e7a86d7767 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:10.772889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d39f2bac-e15a-427a-ac93-d6e7a86d7767 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:10.773342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d39f2bac-e15a-427a-ac93-d6e7a86d7767 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:11.025047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d39f2bac-e15a-427a-ac93-d6e7a86d7767 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:11.035375 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d39f2bac-e15a-427a-ac93-d6e7a86d7767 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c" status: 200 len: 1319 microversion: 2.1 time: 0.279534 Oct 12 22:43:11.038571 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3017/6674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:10 2022] GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:11.420605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-440dae1f-1f6b-4ec9-acac-18cc76034a85 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:11.421092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-440dae1f-1f6b-4ec9-acac-18cc76034a85 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:11.434792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440dae1f-1f6b-4ec9-acac-18cc76034a85 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:11.435272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440dae1f-1f6b-4ec9-acac-18cc76034a85 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:11.435923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440dae1f-1f6b-4ec9-acac-18cc76034a85 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:11.436800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440dae1f-1f6b-4ec9-acac-18cc76034a85 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:11.437420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440dae1f-1f6b-4ec9-acac-18cc76034a85 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:11.438093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-440dae1f-1f6b-4ec9-acac-18cc76034a85 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:11.442021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-12a09b28-8c08-468d-b46e-4160e046178a req-fd17fe53-822d-48ff-8036-ab4c05c9f8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6c2ea15-06b2-434a-a9df-210053f8871d", "name": "network-vif-deleted", "tag": "9b5e5b93-180b-493d-b567-6d500f1e4e17"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:11.472162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-12a09b28-8c08-468d-b46e-4160e046178a req-fd17fe53-822d-48ff-8036-ab4c05c9f8e7 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:11.473188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-12a09b28-8c08-468d-b46e-4160e046178a req-fd17fe53-822d-48ff-8036-ab4c05c9f8e7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:11.477495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-12a09b28-8c08-468d-b46e-4160e046178a req-fd17fe53-822d-48ff-8036-ab4c05c9f8e7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:11.506865 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-12a09b28-8c08-468d-b46e-4160e046178a req-fd17fe53-822d-48ff-8036-ab4c05c9f8e7 service nova] Creating event network-vif-deleted:9b5e5b93-180b-493d-b567-6d500f1e4e17 for instance b6c2ea15-06b2-434a-a9df-210053f8871d on n-h2-861111-1 Oct 12 22:43:11.518378 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-12a09b28-8c08-468d-b46e-4160e046178a req-fd17fe53-822d-48ff-8036-ab4c05c9f8e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093844 Oct 12 22:43:11.523445 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3018/6675] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:43:11.557161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-440dae1f-1f6b-4ec9-acac-18cc76034a85 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:11.574113 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-440dae1f-1f6b-4ec9-acac-18cc76034a85 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1525 microversion: 2.1 time: 0.157452 Oct 12 22:43:11.590039 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3658/6676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:11 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1525 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:12.059743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f1e05568-6770-4d13-810e-c3a053e899c5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:12.060361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f1e05568-6770-4d13-810e-c3a053e899c5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:12.068820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1e05568-6770-4d13-810e-c3a053e899c5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:12.069330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1e05568-6770-4d13-810e-c3a053e899c5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:12.069791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1e05568-6770-4d13-810e-c3a053e899c5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:12.070506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1e05568-6770-4d13-810e-c3a053e899c5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:12.070973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1e05568-6770-4d13-810e-c3a053e899c5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:12.071438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1e05568-6770-4d13-810e-c3a053e899c5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:12.332604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f1e05568-6770-4d13-810e-c3a053e899c5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:12.342758 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f1e05568-6770-4d13-810e-c3a053e899c5 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c" status: 200 len: 1319 microversion: 2.1 time: 0.287303 Oct 12 22:43:12.344046 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3019/6677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:12 2022] GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:12.598590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-618510dd-603a-438e-9ea5-1ecaf9491425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:12.600666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-618510dd-603a-438e-9ea5-1ecaf9491425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:12.606149 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 22:43:12.606527 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 22:43:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d (ip 10.222.0.16) !!! Oct 12 22:43:12.609821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:12.630154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-618510dd-603a-438e-9ea5-1ecaf9491425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:12.630888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-618510dd-603a-438e-9ea5-1ecaf9491425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:12.632013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-618510dd-603a-438e-9ea5-1ecaf9491425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:12.633290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-618510dd-603a-438e-9ea5-1ecaf9491425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:12.634089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-618510dd-603a-438e-9ea5-1ecaf9491425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:12.634733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-618510dd-603a-438e-9ea5-1ecaf9491425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:12.806234 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-618510dd-603a-438e-9ea5-1ecaf9491425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:12.816454 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-618510dd-603a-438e-9ea5-1ecaf9491425 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1360 microversion: 2.1 time: 0.222652 Oct 12 22:43:12.833605 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3659/6678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:12 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1360 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:13.367827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-654ba72e-191e-4197-b894-eb77a0f1805d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:13.368454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-654ba72e-191e-4197-b894-eb77a0f1805d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:13.385733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-654ba72e-191e-4197-b894-eb77a0f1805d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:13.387504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-654ba72e-191e-4197-b894-eb77a0f1805d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:13.388120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-654ba72e-191e-4197-b894-eb77a0f1805d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:13.396353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-654ba72e-191e-4197-b894-eb77a0f1805d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:13.397381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-654ba72e-191e-4197-b894-eb77a0f1805d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:13.398108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-654ba72e-191e-4197-b894-eb77a0f1805d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:13.552613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-6cf4da8e-a21d-4b47-9494-d667bda18a54 req-3cd69da8-0399-48d6-8733-6464309017c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a909e3-6584-4f69-81e7-849c667b159c", "tag": "5c9e7f2b-b54f-4309-863d-4e4de620b3ba"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:13.568273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6cf4da8e-a21d-4b47-9494-d667bda18a54 req-3cd69da8-0399-48d6-8733-6464309017c5 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:13.569625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6cf4da8e-a21d-4b47-9494-d667bda18a54 req-3cd69da8-0399-48d6-8733-6464309017c5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:13.570292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6cf4da8e-a21d-4b47-9494-d667bda18a54 req-3cd69da8-0399-48d6-8733-6464309017c5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:13.587757 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6cf4da8e-a21d-4b47-9494-d667bda18a54 req-3cd69da8-0399-48d6-8733-6464309017c5 service nova] Creating event network-changed:5c9e7f2b-b54f-4309-863d-4e4de620b3ba for instance 34a909e3-6584-4f69-81e7-849c667b159c on n-h1-861111-1 Oct 12 22:43:13.598072 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-6cf4da8e-a21d-4b47-9494-d667bda18a54 req-3cd69da8-0399-48d6-8733-6464309017c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061678 Oct 12 22:43:13.600177 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3660/6679] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:43:13.843275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eff18a50-f4b5-460e-8361-6f4e73493340 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:13.843988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eff18a50-f4b5-460e-8361-6f4e73493340 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:13.858785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eff18a50-f4b5-460e-8361-6f4e73493340 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:13.859797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eff18a50-f4b5-460e-8361-6f4e73493340 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:13.861565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eff18a50-f4b5-460e-8361-6f4e73493340 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:13.862404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eff18a50-f4b5-460e-8361-6f4e73493340 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:13.862870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eff18a50-f4b5-460e-8361-6f4e73493340 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:13.866204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eff18a50-f4b5-460e-8361-6f4e73493340 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:13.884180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-654ba72e-191e-4197-b894-eb77a0f1805d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:13.895693 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-654ba72e-191e-4197-b894-eb77a0f1805d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c" status: 200 len: 1319 microversion: 2.1 time: 0.531690 Oct 12 22:43:13.896594 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3020/6680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:13 2022] GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c => generated 1319 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:13.991881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eff18a50-f4b5-460e-8361-6f4e73493340 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:14.026012 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eff18a50-f4b5-460e-8361-6f4e73493340 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1360 microversion: 2.1 time: 0.187339 Oct 12 22:43:14.037249 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3661/6681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:13 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1360 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:14.922947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-330dccdc-657e-497e-bdb9-8f56d6fbb2bb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:14.923644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-330dccdc-657e-497e-bdb9-8f56d6fbb2bb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:14.936521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330dccdc-657e-497e-bdb9-8f56d6fbb2bb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:14.937038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330dccdc-657e-497e-bdb9-8f56d6fbb2bb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:14.937810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330dccdc-657e-497e-bdb9-8f56d6fbb2bb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:14.938556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330dccdc-657e-497e-bdb9-8f56d6fbb2bb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:14.939060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330dccdc-657e-497e-bdb9-8f56d6fbb2bb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:14.939534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330dccdc-657e-497e-bdb9-8f56d6fbb2bb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:15.054523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ee4c9285-be3d-49e8-98e3-eb5745a4ee46 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:15.055260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ee4c9285-be3d-49e8-98e3-eb5745a4ee46 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:15.071447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee4c9285-be3d-49e8-98e3-eb5745a4ee46 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:15.073808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee4c9285-be3d-49e8-98e3-eb5745a4ee46 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:15.074547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee4c9285-be3d-49e8-98e3-eb5745a4ee46 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:15.076269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee4c9285-be3d-49e8-98e3-eb5745a4ee46 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:15.076989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee4c9285-be3d-49e8-98e3-eb5745a4ee46 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:15.077807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee4c9285-be3d-49e8-98e3-eb5745a4ee46 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:15.167657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ee4c9285-be3d-49e8-98e3-eb5745a4ee46 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:15.180557 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ee4c9285-be3d-49e8-98e3-eb5745a4ee46 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1360 microversion: 2.1 time: 0.130102 Oct 12 22:43:15.182025 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3662/6682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:15 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1360 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:15.857726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-330dccdc-657e-497e-bdb9-8f56d6fbb2bb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:15.880609 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-330dccdc-657e-497e-bdb9-8f56d6fbb2bb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c" status: 200 len: 1319 microversion: 2.1 time: 0.960829 Oct 12 22:43:15.881851 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3021/6683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:14 2022] GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c => generated 1319 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:16.207805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-631d70e1-94f5-49f7-8ca9-e53fabce74c8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:16.208610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-631d70e1-94f5-49f7-8ca9-e53fabce74c8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:16.224525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-631d70e1-94f5-49f7-8ca9-e53fabce74c8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:16.225280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-631d70e1-94f5-49f7-8ca9-e53fabce74c8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:16.225780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-631d70e1-94f5-49f7-8ca9-e53fabce74c8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:16.226509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-631d70e1-94f5-49f7-8ca9-e53fabce74c8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:16.226970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-631d70e1-94f5-49f7-8ca9-e53fabce74c8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:16.227432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-631d70e1-94f5-49f7-8ca9-e53fabce74c8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:16.420053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-631d70e1-94f5-49f7-8ca9-e53fabce74c8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:16.431573 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-631d70e1-94f5-49f7-8ca9-e53fabce74c8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1360 microversion: 2.1 time: 0.228895 Oct 12 22:43:16.432830 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3663/6684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:16 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1360 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:16.807559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-81affe02-999a-47b5-a3c9-b95bf4303707 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '.version_select at 0x7f5128717550>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:16.840895 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-81affe02-999a-47b5-a3c9-b95bf4303707 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-314377209" status: 202 len: 0 microversion: 2.1 time: 0.039348 Oct 12 22:43:16.846252 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3022/6685] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Oct 12 22:43:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-314377209 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:43:16.890538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7a73272c-55b1-498b-bb18-367a259a5179 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'create', calling method: .version_select at 0x7f512c431af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-568091937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMlM3EQzT0wzVmcriOaHxbejXjgQjhQvRJu6t9wPBHP/KHZB1XVx279HmCnHM3tNzIJ4CPV97/X3hx8n/uHCDOzX8aYNPQgyPFwokeO52nvKPF8EfUPenJAnSrCWsk5dQ=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:16.905413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f05e3362-74f8-4698-a255-c03a7000eebb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:16.906107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f05e3362-74f8-4698-a255-c03a7000eebb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:16.930251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f05e3362-74f8-4698-a255-c03a7000eebb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:16.930877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f05e3362-74f8-4698-a255-c03a7000eebb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:16.933349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f05e3362-74f8-4698-a255-c03a7000eebb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:16.934122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f05e3362-74f8-4698-a255-c03a7000eebb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:16.936128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-7a73272c-55b1-498b-bb18-367a259a5179 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Getting quotas for project aa5cc899bfb3403c9aa9d192833cafa9. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:43:16.938908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f05e3362-74f8-4698-a255-c03a7000eebb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:16.939977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f05e3362-74f8-4698-a255-c03a7000eebb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:16.952815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-7a73272c-55b1-498b-bb18-367a259a5179 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Getting quotas for user 2acd162da21348b6acb725bfe572bc00 and project aa5cc899bfb3403c9aa9d192833cafa9. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:43:17.030586 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7a73272c-55b1-498b-bb18-367a259a5179 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.145562 Oct 12 22:43:17.032097 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3664/6686] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:43:16 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:17.294475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-c46c2687-d3d0-4cda-924b-e36c6aaca306 req-c2a96083-0e41-4fc8-a94f-14f5005ef2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a909e3-6584-4f69-81e7-849c667b159c", "name": "network-vif-plugged", "status": "completed", "tag": "5c9e7f2b-b54f-4309-863d-4e4de620b3ba"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:17.335789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c46c2687-d3d0-4cda-924b-e36c6aaca306 req-c2a96083-0e41-4fc8-a94f-14f5005ef2b9 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:17.337919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c46c2687-d3d0-4cda-924b-e36c6aaca306 req-c2a96083-0e41-4fc8-a94f-14f5005ef2b9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:17.339374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c46c2687-d3d0-4cda-924b-e36c6aaca306 req-c2a96083-0e41-4fc8-a94f-14f5005ef2b9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:17.381129 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-c46c2687-d3d0-4cda-924b-e36c6aaca306 req-c2a96083-0e41-4fc8-a94f-14f5005ef2b9 service nova] Creating event network-vif-plugged:5c9e7f2b-b54f-4309-863d-4e4de620b3ba for instance 34a909e3-6584-4f69-81e7-849c667b159c on n-h1-861111-1 Oct 12 22:43:17.387571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f05e3362-74f8-4698-a255-c03a7000eebb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:17.399631 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f05e3362-74f8-4698-a255-c03a7000eebb tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c" status: 200 len: 1319 microversion: 2.1 time: 0.498831 Oct 12 22:43:17.400678 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-c46c2687-d3d0-4cda-924b-e36c6aaca306 req-c2a96083-0e41-4fc8-a94f-14f5005ef2b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109281 Oct 12 22:43:17.403647 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3665/6687] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:43:17.419097 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3023/6688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:16 2022] GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:17.471713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-61763f58-9ec8-4682-9428-8161a9635ef4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:17.473378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-61763f58-9ec8-4682-9428-8161a9635ef4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:17.482808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61763f58-9ec8-4682-9428-8161a9635ef4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:17.483805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61763f58-9ec8-4682-9428-8161a9635ef4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:17.484706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61763f58-9ec8-4682-9428-8161a9635ef4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:17.487329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61763f58-9ec8-4682-9428-8161a9635ef4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:17.488316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61763f58-9ec8-4682-9428-8161a9635ef4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:17.489040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-61763f58-9ec8-4682-9428-8161a9635ef4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:17.589288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-61763f58-9ec8-4682-9428-8161a9635ef4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:17.604447 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-61763f58-9ec8-4682-9428-8161a9635ef4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1360 microversion: 2.1 time: 0.143348 Oct 12 22:43:17.627803 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3666/6689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:17 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:18.427354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5aadb0b5-fd47-4be0-930f-432697d68403 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:18.428177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5aadb0b5-fd47-4be0-930f-432697d68403 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:18.444727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5aadb0b5-fd47-4be0-930f-432697d68403 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:18.445239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5aadb0b5-fd47-4be0-930f-432697d68403 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:18.445701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5aadb0b5-fd47-4be0-930f-432697d68403 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:18.446438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5aadb0b5-fd47-4be0-930f-432697d68403 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:18.446912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5aadb0b5-fd47-4be0-930f-432697d68403 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:18.447401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5aadb0b5-fd47-4be0-930f-432697d68403 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:18.636757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-438965bd-bd03-4e86-83c1-1fbe601866f5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:18.637659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-438965bd-bd03-4e86-83c1-1fbe601866f5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:18.643670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:18.665312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-438965bd-bd03-4e86-83c1-1fbe601866f5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:18.667891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-438965bd-bd03-4e86-83c1-1fbe601866f5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:18.668546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-438965bd-bd03-4e86-83c1-1fbe601866f5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:18.670178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-438965bd-bd03-4e86-83c1-1fbe601866f5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:18.670836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-438965bd-bd03-4e86-83c1-1fbe601866f5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:18.671584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-438965bd-bd03-4e86-83c1-1fbe601866f5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:18.737978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-438965bd-bd03-4e86-83c1-1fbe601866f5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:18.741214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-438965bd-bd03-4e86-83c1-1fbe601866f5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:18.741981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-438965bd-bd03-4e86-83c1-1fbe601866f5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:18.742719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-438965bd-bd03-4e86-83c1-1fbe601866f5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lazy-loading 'fault' on Instance uuid b6c2ea15-06b2-434a-a9df-210053f8871d {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:43:18.810535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5aadb0b5-fd47-4be0-930f-432697d68403 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:18.822965 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5aadb0b5-fd47-4be0-930f-432697d68403 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c" status: 200 len: 1319 microversion: 2.1 time: 0.400053 Oct 12 22:43:18.825114 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3024/6690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:18 2022] GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:18.926199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-438965bd-bd03-4e86-83c1-1fbe601866f5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:18.937568 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-438965bd-bd03-4e86-83c1-1fbe601866f5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 200 len: 1319 microversion: 2.1 time: 0.304530 Oct 12 22:43:18.938498 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3667/6691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:18 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:19.851537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4994385c-0078-4787-90d7-f9aadcb03384 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:19.861534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4994385c-0078-4787-90d7-f9aadcb03384 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:19.880790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4994385c-0078-4787-90d7-f9aadcb03384 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:19.885751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4994385c-0078-4787-90d7-f9aadcb03384 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:19.885751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4994385c-0078-4787-90d7-f9aadcb03384 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:19.889136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4994385c-0078-4787-90d7-f9aadcb03384 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:19.889960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4994385c-0078-4787-90d7-f9aadcb03384 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:19.892901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4994385c-0078-4787-90d7-f9aadcb03384 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:19.963445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-38d4095e-62c2-410a-a517-6e8f850fae16 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:19.964683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-38d4095e-62c2-410a-a517-6e8f850fae16 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:19.984316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38d4095e-62c2-410a-a517-6e8f850fae16 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:19.985141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38d4095e-62c2-410a-a517-6e8f850fae16 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:19.985773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38d4095e-62c2-410a-a517-6e8f850fae16 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:19.986742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38d4095e-62c2-410a-a517-6e8f850fae16 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:19.987410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38d4095e-62c2-410a-a517-6e8f850fae16 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:19.988011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-38d4095e-62c2-410a-a517-6e8f850fae16 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:20.013391 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-38d4095e-62c2-410a-a517-6e8f850fae16 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] HTTP exception thrown: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-38d4095e-62c2-410a-a517-6e8f850fae16 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Request method failure captured: Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d HTTP/1.1 Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0IharzkU0EI5od_tYFYiimWbIhiU_Z2qWiELggh5UckxeqrnYnnrwzymqi7TUfpjzQhGi9AT7nHEyzZohAJui-4vZv6nTEy801Fmq2zP90o12d8oz0UHjyBxm9MxKWeYUrTwr-9KmypVoqQEOknLfZ_qBqmv_P1kjCeo-X5DoGtv6Y Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef79a1f4c33c46f1a7536c37f910e2b0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7d141d93d7a74a57b5b6475294c9af5e Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'b6c2ea15-06b2-434a-a9df-210053f8871d'} Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:20.015444 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:20.021306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:20.021306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:20.021306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:20.021306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:43:20.021306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:43:20.021306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. Oct 12 22:43:20.021306 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:20.022602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-38d4095e-62c2-410a-a517-6e8f850fae16 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Returning 404 to user: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:43:20.033012 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-38d4095e-62c2-410a-a517-6e8f850fae16 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 404 len: 111 microversion: 2.1 time: 0.073279 Oct 12 22:43:20.034732 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3668/6692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:19 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:43:20.268400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4994385c-0078-4787-90d7-f9aadcb03384 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:20.280257 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4994385c-0078-4787-90d7-f9aadcb03384 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c" status: 200 len: 1508 microversion: 2.1 time: 0.432512 Oct 12 22:43:20.285235 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3025/6693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:19 2022] GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:20.308716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fd9946d2-1d92-4b39-883d-d16b324cd368 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "126343cc-a993-4e3f-8494-a5b8b629acce", "device": "/dev/sdb"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:20.311872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fd9946d2-1d92-4b39-883d-d16b324cd368 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:20.325379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd9946d2-1d92-4b39-883d-d16b324cd368 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:20.328429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd9946d2-1d92-4b39-883d-d16b324cd368 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:20.328968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd9946d2-1d92-4b39-883d-d16b324cd368 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:20.334999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd9946d2-1d92-4b39-883d-d16b324cd368 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:20.337228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd9946d2-1d92-4b39-883d-d16b324cd368 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:20.337891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd9946d2-1d92-4b39-883d-d16b324cd368 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:20.743976 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fd9946d2-1d92-4b39-883d-d16b324cd368 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "POST /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439229 Oct 12 22:43:20.744782 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3669/6694] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 22:43:20 2022] POST /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:25.693791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-df3d279d-9ee8-4e43-9640-5fbf6160a90d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:25.694395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-df3d279d-9ee8-4e43-9640-5fbf6160a90d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:25.713267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df3d279d-9ee8-4e43-9640-5fbf6160a90d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:25.715954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df3d279d-9ee8-4e43-9640-5fbf6160a90d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:25.717533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df3d279d-9ee8-4e43-9640-5fbf6160a90d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:25.722858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df3d279d-9ee8-4e43-9640-5fbf6160a90d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:25.723970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df3d279d-9ee8-4e43-9640-5fbf6160a90d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:25.725220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df3d279d-9ee8-4e43-9640-5fbf6160a90d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:25.779201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-df3d279d-9ee8-4e43-9640-5fbf6160a90d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:43:25.926137 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-df3d279d-9ee8-4e43-9640-5fbf6160a90d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 204 len: 0 microversion: 2.1 time: 0.237542 Oct 12 22:43:25.938659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d3390ec2-8b23-4608-b91c-7f5431ba59b3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:25.940038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d3390ec2-8b23-4608-b91c-7f5431ba59b3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:25.949608 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3026/6695] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:43:25 2022] DELETE /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:43:25.958284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3390ec2-8b23-4608-b91c-7f5431ba59b3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:25.958902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3390ec2-8b23-4608-b91c-7f5431ba59b3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:25.960778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3390ec2-8b23-4608-b91c-7f5431ba59b3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:25.962372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3390ec2-8b23-4608-b91c-7f5431ba59b3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:25.963113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3390ec2-8b23-4608-b91c-7f5431ba59b3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:25.963843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3390ec2-8b23-4608-b91c-7f5431ba59b3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:26.295197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d3390ec2-8b23-4608-b91c-7f5431ba59b3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:26.313258 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d3390ec2-8b23-4608-b91c-7f5431ba59b3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1409 microversion: 2.1 time: 0.380609 Oct 12 22:43:26.314512 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3670/6696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:25 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1409 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:27.346150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-786a52ca-6b90-428d-8771-baf2e89e0397 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:27.346960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-786a52ca-6b90-428d-8771-baf2e89e0397 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:27.357749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-786a52ca-6b90-428d-8771-baf2e89e0397 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:27.360313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-786a52ca-6b90-428d-8771-baf2e89e0397 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:27.362480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-786a52ca-6b90-428d-8771-baf2e89e0397 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:27.363516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-786a52ca-6b90-428d-8771-baf2e89e0397 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:27.364244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-786a52ca-6b90-428d-8771-baf2e89e0397 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:27.365109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-786a52ca-6b90-428d-8771-baf2e89e0397 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:27.448967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2097861484", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "bc716e05-9a56-44cf-ab36-4beb0cf00ffa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-568091937", "security_groups": [{"name": "tempest-secgroup-smoke-1523988285"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:27.471417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=12 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:27.618339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] validate_networks() for [('bc716e05-9a56-44cf-ab36-4beb0cf00ffa', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:43:28.354570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-786a52ca-6b90-428d-8771-baf2e89e0397 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:28.368535 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-786a52ca-6b90-428d-8771-baf2e89e0397 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1409 microversion: 2.1 time: 1.027997 Oct 12 22:43:28.385557 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3027/6697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:27 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1409 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:28.509880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:43:28.511006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:43:28.511663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:43:28.512298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:43:28.512828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:43:28.540269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:28.543867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:28.544401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:28.545244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:28.548662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:28.548916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:28.625146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Getting quotas for project aa5cc899bfb3403c9aa9d192833cafa9. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:43:28.638716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Getting quotas for user 2acd162da21348b6acb725bfe572bc00 and project aa5cc899bfb3403c9aa9d192833cafa9. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:43:28.665510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:43:28.668028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:43:28.785856 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-95bc57c5-ecb5-4e06-be8c-994f3e46e35e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.340904 Oct 12 22:43:28.791884 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3671/6698] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:43:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:43:28.798552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-722ca250-3123-4711-a7d8-1f81eea93d9f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:28.799276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-722ca250-3123-4711-a7d8-1f81eea93d9f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:29.401122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-722ca250-3123-4711-a7d8-1f81eea93d9f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:29.401729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-992af342-e5a0-48e4-9f22-2884b4cddb76 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:29.401946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-992af342-e5a0-48e4-9f22-2884b4cddb76 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:29.408361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-992af342-e5a0-48e4-9f22-2884b4cddb76 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:29.410224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-992af342-e5a0-48e4-9f22-2884b4cddb76 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:29.410685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-992af342-e5a0-48e4-9f22-2884b4cddb76 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:29.411455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-992af342-e5a0-48e4-9f22-2884b4cddb76 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:29.411906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-992af342-e5a0-48e4-9f22-2884b4cddb76 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:29.412339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-992af342-e5a0-48e4-9f22-2884b4cddb76 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:29.413406 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-722ca250-3123-4711-a7d8-1f81eea93d9f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1266 microversion: 2.1 time: 0.618776 Oct 12 22:43:29.416982 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3028/6699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:28 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1266 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:29.427453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:29.633274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-992af342-e5a0-48e4-9f22-2884b4cddb76 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:29.659174 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-992af342-e5a0-48e4-9f22-2884b4cddb76 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1409 microversion: 2.1 time: 0.267320 Oct 12 22:43:29.672050 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3672/6700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:29 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1409 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:29.798805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-e60f7fa8-9f33-4de1-9e4e-83c0ba7bdb1c req-b00d707e-6d78-40f1-81a7-0afc517f4b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff1c156-3133-4c24-81e5-770b0a6faaa4", "name": "network-vif-deleted", "tag": "376adc19-ae45-49d6-8914-7087df7dcf21"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:29.819857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e60f7fa8-9f33-4de1-9e4e-83c0ba7bdb1c req-b00d707e-6d78-40f1-81a7-0afc517f4b32 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:29.824035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e60f7fa8-9f33-4de1-9e4e-83c0ba7bdb1c req-b00d707e-6d78-40f1-81a7-0afc517f4b32 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:29.825040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e60f7fa8-9f33-4de1-9e4e-83c0ba7bdb1c req-b00d707e-6d78-40f1-81a7-0afc517f4b32 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:29.856962 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-e60f7fa8-9f33-4de1-9e4e-83c0ba7bdb1c req-b00d707e-6d78-40f1-81a7-0afc517f4b32 service nova] Creating event network-vif-deleted:376adc19-ae45-49d6-8914-7087df7dcf21 for instance cff1c156-3133-4c24-81e5-770b0a6faaa4 on n-h1-861111-1 Oct 12 22:43:29.863343 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-e60f7fa8-9f33-4de1-9e4e-83c0ba7bdb1c req-b00d707e-6d78-40f1-81a7-0afc517f4b32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069492 Oct 12 22:43:29.865399 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3029/6701] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:30.438706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a7046bf7-bb06-4b69-b3d5-b346387970da tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:30.441253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a7046bf7-bb06-4b69-b3d5-b346387970da tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:30.452964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7046bf7-bb06-4b69-b3d5-b346387970da tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:30.468002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7046bf7-bb06-4b69-b3d5-b346387970da tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:30.468728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7046bf7-bb06-4b69-b3d5-b346387970da tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:30.469671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7046bf7-bb06-4b69-b3d5-b346387970da tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:30.470575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7046bf7-bb06-4b69-b3d5-b346387970da tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:30.471262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7046bf7-bb06-4b69-b3d5-b346387970da tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:30.566474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a7046bf7-bb06-4b69-b3d5-b346387970da tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:30.580166 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a7046bf7-bb06-4b69-b3d5-b346387970da tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1326 microversion: 2.1 time: 0.145837 Oct 12 22:43:30.587933 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3673/6702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:30 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1326 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:30.685932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-43857da5-297d-4401-9a80-9edc455fc011 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:30.686655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-43857da5-297d-4401-9a80-9edc455fc011 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:30.712004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43857da5-297d-4401-9a80-9edc455fc011 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:30.714285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43857da5-297d-4401-9a80-9edc455fc011 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:30.714772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43857da5-297d-4401-9a80-9edc455fc011 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:30.719050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43857da5-297d-4401-9a80-9edc455fc011 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:30.719659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43857da5-297d-4401-9a80-9edc455fc011 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:30.721979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43857da5-297d-4401-9a80-9edc455fc011 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:30.929728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-43857da5-297d-4401-9a80-9edc455fc011 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:30.940294 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-43857da5-297d-4401-9a80-9edc455fc011 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1202 microversion: 2.1 time: 0.259733 Oct 12 22:43:30.941243 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3030/6703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:30 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1202 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:31.606093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f215a814-853b-4063-8a67-b6451f5b4206 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:31.606732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f215a814-853b-4063-8a67-b6451f5b4206 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:31.621080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f215a814-853b-4063-8a67-b6451f5b4206 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:31.621585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f215a814-853b-4063-8a67-b6451f5b4206 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:31.622038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f215a814-853b-4063-8a67-b6451f5b4206 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:31.622770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f215a814-853b-4063-8a67-b6451f5b4206 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:31.623258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f215a814-853b-4063-8a67-b6451f5b4206 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:31.623700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f215a814-853b-4063-8a67-b6451f5b4206 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:31.709090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f215a814-853b-4063-8a67-b6451f5b4206 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:31.720764 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f215a814-853b-4063-8a67-b6451f5b4206 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1324 microversion: 2.1 time: 0.118496 Oct 12 22:43:31.729980 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3674/6704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:31 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1324 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:31.965103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-931b743b-33ca-4886-82f1-062e4acd4591 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:31.965734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-931b743b-33ca-4886-82f1-062e4acd4591 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:31.981185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931b743b-33ca-4886-82f1-062e4acd4591 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:31.981618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931b743b-33ca-4886-82f1-062e4acd4591 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:31.984601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931b743b-33ca-4886-82f1-062e4acd4591 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:31.985372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931b743b-33ca-4886-82f1-062e4acd4591 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:31.986711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931b743b-33ca-4886-82f1-062e4acd4591 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:31.992021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-931b743b-33ca-4886-82f1-062e4acd4591 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:32.090994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-931b743b-33ca-4886-82f1-062e4acd4591 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:32.099427 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-931b743b-33ca-4886-82f1-062e4acd4591 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1202 microversion: 2.1 time: 0.139308 Oct 12 22:43:32.100020 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3031/6705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:31 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1202 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:32.749585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cf78bfa0-6a2b-4cf2-a2c5-a27a756a8e29 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:32.750805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cf78bfa0-6a2b-4cf2-a2c5-a27a756a8e29 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:32.774800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf78bfa0-6a2b-4cf2-a2c5-a27a756a8e29 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:32.775566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf78bfa0-6a2b-4cf2-a2c5-a27a756a8e29 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:32.776194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf78bfa0-6a2b-4cf2-a2c5-a27a756a8e29 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:32.777084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf78bfa0-6a2b-4cf2-a2c5-a27a756a8e29 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:32.777704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf78bfa0-6a2b-4cf2-a2c5-a27a756a8e29 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:32.778301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cf78bfa0-6a2b-4cf2-a2c5-a27a756a8e29 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:33.012792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cf78bfa0-6a2b-4cf2-a2c5-a27a756a8e29 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:33.027186 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cf78bfa0-6a2b-4cf2-a2c5-a27a756a8e29 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1392 microversion: 2.1 time: 0.281369 Oct 12 22:43:33.043391 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3675/6706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:32 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1392 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:33.123307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6888eb3c-9a95-41b4-ad66-393b71a750f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:33.123950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6888eb3c-9a95-41b4-ad66-393b71a750f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:33.137981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6888eb3c-9a95-41b4-ad66-393b71a750f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:33.138839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6888eb3c-9a95-41b4-ad66-393b71a750f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:33.139480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6888eb3c-9a95-41b4-ad66-393b71a750f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:33.147417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6888eb3c-9a95-41b4-ad66-393b71a750f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:33.148157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6888eb3c-9a95-41b4-ad66-393b71a750f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:33.148771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6888eb3c-9a95-41b4-ad66-393b71a750f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:33.167308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-127d06cd-9d47-4cc2-9bc6-8e2fd1e25b7d req-6b6f7301-31a1-42bd-b87e-ec22feed9f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc12d46-f730-4955-9942-73f64e4ff744", "tag": "089c1c1c-c07a-44b7-9a56-e6bc3b8ef56c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:33.188372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-127d06cd-9d47-4cc2-9bc6-8e2fd1e25b7d req-6b6f7301-31a1-42bd-b87e-ec22feed9f0a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:33.188868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-127d06cd-9d47-4cc2-9bc6-8e2fd1e25b7d req-6b6f7301-31a1-42bd-b87e-ec22feed9f0a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:33.190869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-127d06cd-9d47-4cc2-9bc6-8e2fd1e25b7d req-6b6f7301-31a1-42bd-b87e-ec22feed9f0a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:33.220421 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-127d06cd-9d47-4cc2-9bc6-8e2fd1e25b7d req-6b6f7301-31a1-42bd-b87e-ec22feed9f0a service nova] Creating event network-changed:089c1c1c-c07a-44b7-9a56-e6bc3b8ef56c for instance bbc12d46-f730-4955-9942-73f64e4ff744 on n-h2-861111-1 Oct 12 22:43:33.228891 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-127d06cd-9d47-4cc2-9bc6-8e2fd1e25b7d req-6b6f7301-31a1-42bd-b87e-ec22feed9f0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066931 Oct 12 22:43:33.231344 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3676/6707] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:43:33.309222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6888eb3c-9a95-41b4-ad66-393b71a750f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:33.317785 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6888eb3c-9a95-41b4-ad66-393b71a750f8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1202 microversion: 2.1 time: 0.199228 Oct 12 22:43:33.318382 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3032/6708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:33 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1202 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:34.053949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fa09de91-78d1-4c2c-937a-9bc740fa07e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:34.055382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fa09de91-78d1-4c2c-937a-9bc740fa07e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:34.075389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa09de91-78d1-4c2c-937a-9bc740fa07e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:34.076180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa09de91-78d1-4c2c-937a-9bc740fa07e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:34.076798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa09de91-78d1-4c2c-937a-9bc740fa07e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:34.077682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa09de91-78d1-4c2c-937a-9bc740fa07e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:34.078301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa09de91-78d1-4c2c-937a-9bc740fa07e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:34.078921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa09de91-78d1-4c2c-937a-9bc740fa07e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:34.344167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-534b580f-cd0e-434b-8449-47dce839ae99 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:34.345437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-534b580f-cd0e-434b-8449-47dce839ae99 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:34.353145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-534b580f-cd0e-434b-8449-47dce839ae99 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:34.353787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-534b580f-cd0e-434b-8449-47dce839ae99 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:34.355271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-534b580f-cd0e-434b-8449-47dce839ae99 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:34.355271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-534b580f-cd0e-434b-8449-47dce839ae99 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:34.361143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-534b580f-cd0e-434b-8449-47dce839ae99 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:34.361839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-534b580f-cd0e-434b-8449-47dce839ae99 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:34.449676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-534b580f-cd0e-434b-8449-47dce839ae99 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:34.456342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:34.460177 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-534b580f-cd0e-434b-8449-47dce839ae99 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1202 microversion: 2.1 time: 0.119855 Oct 12 22:43:34.461838 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3033/6709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:34 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1202 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:34.619684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fa09de91-78d1-4c2c-937a-9bc740fa07e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:34.637529 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fa09de91-78d1-4c2c-937a-9bc740fa07e6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1392 microversion: 2.1 time: 0.587769 Oct 12 22:43:34.638498 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3677/6710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:34 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1392 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:35.488010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-20588f02-7629-4ed5-8340-3c7e75ca6bc3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:35.488655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-20588f02-7629-4ed5-8340-3c7e75ca6bc3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:35.504090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20588f02-7629-4ed5-8340-3c7e75ca6bc3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:35.504604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20588f02-7629-4ed5-8340-3c7e75ca6bc3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:35.505056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20588f02-7629-4ed5-8340-3c7e75ca6bc3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:35.505789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20588f02-7629-4ed5-8340-3c7e75ca6bc3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:35.506252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20588f02-7629-4ed5-8340-3c7e75ca6bc3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:35.506690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-20588f02-7629-4ed5-8340-3c7e75ca6bc3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:35.602146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-20588f02-7629-4ed5-8340-3c7e75ca6bc3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:35.654995 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-20588f02-7629-4ed5-8340-3c7e75ca6bc3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 200 len: 1202 microversion: 2.1 time: 0.171850 Oct 12 22:43:35.659557 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3034/6711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:35 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 1202 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:35.675189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e47adff-db95-4866-8442-0736078f63db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:35.675909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9e47adff-db95-4866-8442-0736078f63db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:35.685940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e47adff-db95-4866-8442-0736078f63db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:35.688816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e47adff-db95-4866-8442-0736078f63db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:35.689402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e47adff-db95-4866-8442-0736078f63db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:35.694218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e47adff-db95-4866-8442-0736078f63db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:35.696323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e47adff-db95-4866-8442-0736078f63db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:35.696999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e47adff-db95-4866-8442-0736078f63db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:36.305491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9e47adff-db95-4866-8442-0736078f63db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:36.314823 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9e47adff-db95-4866-8442-0736078f63db tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1392 microversion: 2.1 time: 0.643656 Oct 12 22:43:36.315525 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3678/6712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:35 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1392 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:36.679005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83404770-ae3c-492b-b121-677d95d0f7e3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:36.680634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-83404770-ae3c-492b-b121-677d95d0f7e3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:36.695564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83404770-ae3c-492b-b121-677d95d0f7e3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:36.696979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83404770-ae3c-492b-b121-677d95d0f7e3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:36.698601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83404770-ae3c-492b-b121-677d95d0f7e3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:36.700634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83404770-ae3c-492b-b121-677d95d0f7e3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:36.703136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83404770-ae3c-492b-b121-677d95d0f7e3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:36.705822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83404770-ae3c-492b-b121-677d95d0f7e3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:36.735632 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-83404770-ae3c-492b-b121-677d95d0f7e3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] HTTP exception thrown: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83404770-ae3c-492b-b121-677d95d0f7e3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Request method failure captured: Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 HTTP/1.1 Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0IharzkU0EI5od_tYFYiimWbIhiU_Z2qWiELggh5UckxeqrnYnnrwzymqi7TUfpjzQhGi9AT7nHEyzZohAJui-4vZv6nTEy801Fmq2zP90o12d8oz0UHjyBxm9MxKWeYUrTwr-9KmypVoqQEOknLfZ_qBqmv_P1kjCeo-X5DoGtv6Y Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef79a1f4c33c46f1a7536c37f910e2b0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7d141d93d7a74a57b5b6475294c9af5e Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'cff1c156-3133-4c24-81e5-770b0a6faaa4'} Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:36.741517 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:36.746633 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:36.746633 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:36.746633 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:36.746633 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:43:36.746633 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:43:36.746633 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. Oct 12 22:43:36.746633 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:36.746633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83404770-ae3c-492b-b121-677d95d0f7e3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Returning 404 to user: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:43:36.746633 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-83404770-ae3c-492b-b121-677d95d0f7e3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 404 len: 111 microversion: 2.1 time: 0.069633 Oct 12 22:43:36.746633 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3035/6713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:36 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:43:37.356192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-266c0d9a-c870-4b31-b35a-b258dd989089 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:37.357584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-266c0d9a-c870-4b31-b35a-b258dd989089 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:37.380425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-266c0d9a-c870-4b31-b35a-b258dd989089 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:37.385190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-266c0d9a-c870-4b31-b35a-b258dd989089 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:37.390183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-266c0d9a-c870-4b31-b35a-b258dd989089 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:37.391370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-266c0d9a-c870-4b31-b35a-b258dd989089 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:37.395539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-266c0d9a-c870-4b31-b35a-b258dd989089 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:37.398109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-266c0d9a-c870-4b31-b35a-b258dd989089 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:37.916497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-266c0d9a-c870-4b31-b35a-b258dd989089 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:37.925721 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-266c0d9a-c870-4b31-b35a-b258dd989089 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1392 microversion: 2.1 time: 0.587399 Oct 12 22:43:37.930030 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3679/6714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:37 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1392 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:38.956143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-46866da5-6857-4f27-8670-3595ae2e9bcb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:38.956771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-46866da5-6857-4f27-8670-3595ae2e9bcb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:38.988967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46866da5-6857-4f27-8670-3595ae2e9bcb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:38.989481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46866da5-6857-4f27-8670-3595ae2e9bcb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:38.993964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46866da5-6857-4f27-8670-3595ae2e9bcb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:38.997319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46866da5-6857-4f27-8670-3595ae2e9bcb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:38.998102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46866da5-6857-4f27-8670-3595ae2e9bcb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:39.000997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46866da5-6857-4f27-8670-3595ae2e9bcb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:39.407838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:40.014881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-46866da5-6857-4f27-8670-3595ae2e9bcb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:40.032413 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-46866da5-6857-4f27-8670-3595ae2e9bcb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1392 microversion: 2.1 time: 1.080157 Oct 12 22:43:40.033049 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3036/6715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:38 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1392 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:40.179189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-924e42e7-12fe-4aa5-a150-0ecbb66e66c5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:40.179813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-924e42e7-12fe-4aa5-a150-0ecbb66e66c5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:40.187425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:40.188341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:40.191155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-924e42e7-12fe-4aa5-a150-0ecbb66e66c5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:40.192315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-924e42e7-12fe-4aa5-a150-0ecbb66e66c5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:40.193097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-924e42e7-12fe-4aa5-a150-0ecbb66e66c5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:40.194150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-924e42e7-12fe-4aa5-a150-0ecbb66e66c5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:40.194820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-924e42e7-12fe-4aa5-a150-0ecbb66e66c5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:40.195524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-924e42e7-12fe-4aa5-a150-0ecbb66e66c5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:40.221168 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-924e42e7-12fe-4aa5-a150-0ecbb66e66c5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] HTTP exception thrown: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-924e42e7-12fe-4aa5-a150-0ecbb66e66c5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Request method failure captured: Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d HTTP/1.1 Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0IharzkU0EI5od_tYFYiimWbIhiU_Z2qWiELggh5UckxeqrnYnnrwzymqi7TUfpjzQhGi9AT7nHEyzZohAJui-4vZv6nTEy801Fmq2zP90o12d8oz0UHjyBxm9MxKWeYUrTwr-9KmypVoqQEOknLfZ_qBqmv_P1kjCeo-X5DoGtv6Y Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef79a1f4c33c46f1a7536c37f910e2b0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7d141d93d7a74a57b5b6475294c9af5e Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'b6c2ea15-06b2-434a-a9df-210053f8871d'} Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:43:40.224642 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:43:40.230770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. Oct 12 22:43:40.230770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:40.230770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:40.230770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:40.230770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:40.230770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:40.230770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:40.230770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:43:40.230770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:43:40.230770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. Oct 12 22:43:40.230770 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:43:40.233945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-924e42e7-12fe-4aa5-a150-0ecbb66e66c5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Returning 404 to user: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:43:40.235044 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-924e42e7-12fe-4aa5-a150-0ecbb66e66c5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 404 len: 111 microversion: 2.1 time: 0.061122 Oct 12 22:43:40.236836 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3680/6716] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:43:40 2022] DELETE /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:43:40.247140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af7544a4-d68e-473a-b6da-6a40a9c35f5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:40.250955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-af7544a4-d68e-473a-b6da-6a40a9c35f5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: b6c2ea15-06b2-434a-a9df-210053f8871d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:40.265792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af7544a4-d68e-473a-b6da-6a40a9c35f5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:40.267351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af7544a4-d68e-473a-b6da-6a40a9c35f5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:40.272272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af7544a4-d68e-473a-b6da-6a40a9c35f5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:40.273426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af7544a4-d68e-473a-b6da-6a40a9c35f5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:40.274094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af7544a4-d68e-473a-b6da-6a40a9c35f5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:40.274719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af7544a4-d68e-473a-b6da-6a40a9c35f5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:40.309233 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-af7544a4-d68e-473a-b6da-6a40a9c35f5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] HTTP exception thrown: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af7544a4-d68e-473a-b6da-6a40a9c35f5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Request method failure captured: Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d HTTP/1.1 Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0IharzkU0EI5od_tYFYiimWbIhiU_Z2qWiELggh5UckxeqrnYnnrwzymqi7TUfpjzQhGi9AT7nHEyzZohAJui-4vZv6nTEy801Fmq2zP90o12d8oz0UHjyBxm9MxKWeYUrTwr-9KmypVoqQEOknLfZ_qBqmv_P1kjCeo-X5DoGtv6Y Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef79a1f4c33c46f1a7536c37f910e2b0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7d141d93d7a74a57b5b6475294c9af5e Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'b6c2ea15-06b2-434a-a9df-210053f8871d'} Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:40.310865 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:40.316230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:40.316230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:40.316230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:40.316230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:43:40.316230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:43:40.316230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. Oct 12 22:43:40.316230 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:40.318003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af7544a4-d68e-473a-b6da-6a40a9c35f5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Returning 404 to user: Instance b6c2ea15-06b2-434a-a9df-210053f8871d could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:43:40.319218 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-af7544a4-d68e-473a-b6da-6a40a9c35f5c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d" status: 404 len: 111 microversion: 2.1 time: 0.077539 Oct 12 22:43:40.319826 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3037/6717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:40 2022] GET /compute/v2.1/servers/b6c2ea15-06b2-434a-a9df-210053f8871d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:43:41.063989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0ee2ffd8-2f45-40b7-badb-360a8207715d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:41.064627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0ee2ffd8-2f45-40b7-badb-360a8207715d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:41.074070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ee2ffd8-2f45-40b7-badb-360a8207715d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:41.074823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ee2ffd8-2f45-40b7-badb-360a8207715d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:41.087991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ee2ffd8-2f45-40b7-badb-360a8207715d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:41.089233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ee2ffd8-2f45-40b7-badb-360a8207715d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:41.095988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ee2ffd8-2f45-40b7-badb-360a8207715d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:41.100233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0ee2ffd8-2f45-40b7-badb-360a8207715d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:41.178294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4d297428-b9cc-4b7c-8061-5cac3028a3ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:41.178855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4d297428-b9cc-4b7c-8061-5cac3028a3ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:41.181951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:41.204393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d297428-b9cc-4b7c-8061-5cac3028a3ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:41.206743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d297428-b9cc-4b7c-8061-5cac3028a3ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:41.207575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d297428-b9cc-4b7c-8061-5cac3028a3ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:41.207970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d297428-b9cc-4b7c-8061-5cac3028a3ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:41.208442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d297428-b9cc-4b7c-8061-5cac3028a3ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:41.208885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d297428-b9cc-4b7c-8061-5cac3028a3ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:41.243045 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-4d297428-b9cc-4b7c-8061-5cac3028a3ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] HTTP exception thrown: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4d297428-b9cc-4b7c-8061-5cac3028a3ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Request method failure captured: Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 HTTP/1.1 Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0IharzkU0EI5od_tYFYiimWbIhiU_Z2qWiELggh5UckxeqrnYnnrwzymqi7TUfpjzQhGi9AT7nHEyzZohAJui-4vZv6nTEy801Fmq2zP90o12d8oz0UHjyBxm9MxKWeYUrTwr-9KmypVoqQEOknLfZ_qBqmv_P1kjCeo-X5DoGtv6Y Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef79a1f4c33c46f1a7536c37f910e2b0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7d141d93d7a74a57b5b6475294c9af5e Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'cff1c156-3133-4c24-81e5-770b0a6faaa4'} Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:43:41.246459 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:43:41.251512 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. Oct 12 22:43:41.251512 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:41.251512 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:41.251512 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:41.251512 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:41.251512 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:41.251512 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:41.251512 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:43:41.251512 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:43:41.251512 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. Oct 12 22:43:41.251512 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:41.255129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4d297428-b9cc-4b7c-8061-5cac3028a3ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Returning 404 to user: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:43:41.257155 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4d297428-b9cc-4b7c-8061-5cac3028a3ce tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 404 len: 111 microversion: 2.1 time: 0.085023 Oct 12 22:43:41.258989 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3038/6718] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:43:41 2022] DELETE /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:43:41.269688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-59e53094-548d-42fa-92a8-616bff749b2d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:41.270715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-59e53094-548d-42fa-92a8-616bff749b2d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: cff1c156-3133-4c24-81e5-770b0a6faaa4] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:41.280038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59e53094-548d-42fa-92a8-616bff749b2d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:41.289064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59e53094-548d-42fa-92a8-616bff749b2d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:41.336343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59e53094-548d-42fa-92a8-616bff749b2d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:41.337822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59e53094-548d-42fa-92a8-616bff749b2d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:41.338562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59e53094-548d-42fa-92a8-616bff749b2d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:41.339299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59e53094-548d-42fa-92a8-616bff749b2d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:41.398828 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-59e53094-548d-42fa-92a8-616bff749b2d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] HTTP exception thrown: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-59e53094-548d-42fa-92a8-616bff749b2d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Request method failure captured: Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 HTTP/1.1 Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0IharzkU0EI5od_tYFYiimWbIhiU_Z2qWiELggh5UckxeqrnYnnrwzymqi7TUfpjzQhGi9AT7nHEyzZohAJui-4vZv6nTEy801Fmq2zP90o12d8oz0UHjyBxm9MxKWeYUrTwr-9KmypVoqQEOknLfZ_qBqmv_P1kjCeo-X5DoGtv6Y Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef79a1f4c33c46f1a7536c37f910e2b0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7d141d93d7a74a57b5b6475294c9af5e Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'cff1c156-3133-4c24-81e5-770b0a6faaa4'} Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:41.410631 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:41.417378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:41.417378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:41.417378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:41.417378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:43:41.417378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:43:41.417378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. Oct 12 22:43:41.417378 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:43:41.417378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-59e53094-548d-42fa-92a8-616bff749b2d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Returning 404 to user: Instance cff1c156-3133-4c24-81e5-770b0a6faaa4 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:43:41.417378 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-59e53094-548d-42fa-92a8-616bff749b2d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4" status: 404 len: 111 microversion: 2.1 time: 0.148677 Oct 12 22:43:41.417378 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3039/6719] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:41 2022] GET /compute/v2.1/servers/cff1c156-3133-4c24-81e5-770b0a6faaa4 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:43:41.612790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c9a6cb28-00b5-4f18-bc6f-7ad74a3ee9bb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Action: 'create', calling method: .version_select at 0x7f51233f31f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-96398279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoxar7Fvnbw2IK41r5eTxwLizYAYaYE8NH9FxtX8IZ7NEnf8lD3FLDRk/ZkAu2jTwNbXJlbvTfWAkmLy3M7saylLYx8xQpPQgUhvtX86Nee4aKJ7qEuiPJ2ljEh/VtczA=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:41.641275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c9a6cb28-00b5-4f18-bc6f-7ad74a3ee9bb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:43:41.648567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0ee2ffd8-2f45-40b7-badb-360a8207715d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:41.650474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c9a6cb28-00b5-4f18-bc6f-7ad74a3ee9bb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for user 7d141d93d7a74a57b5b6475294c9af5e and project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:43:41.673824 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0ee2ffd8-2f45-40b7-badb-360a8207715d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1392 microversion: 2.1 time: 0.612688 Oct 12 22:43:41.680603 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3681/6720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:41 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1392 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:41.713736 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c9a6cb28-00b5-4f18-bc6f-7ad74a3ee9bb tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.108957 Oct 12 22:43:41.719287 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3040/6721] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:43:41 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:43:42.710431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8e37a05c-78b2-4579-93a8-29f234d6374f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:42.712226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8e37a05c-78b2-4579-93a8-29f234d6374f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:42.723174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:42.730212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e37a05c-78b2-4579-93a8-29f234d6374f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:42.733218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e37a05c-78b2-4579-93a8-29f234d6374f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:42.736182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e37a05c-78b2-4579-93a8-29f234d6374f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:42.740506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e37a05c-78b2-4579-93a8-29f234d6374f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:42.742440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e37a05c-78b2-4579-93a8-29f234d6374f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:42.743776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8e37a05c-78b2-4579-93a8-29f234d6374f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:43.025338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8e37a05c-78b2-4579-93a8-29f234d6374f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:43.037697 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8e37a05c-78b2-4579-93a8-29f234d6374f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1392 microversion: 2.1 time: 0.335051 Oct 12 22:43:43.058607 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3682/6722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:42 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1392 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:43.247378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-9faf0ea9-2228-4130-983b-5d3494a12df6 req-e7bfa64c-37e5-4c9e-9d6a-77a288a30865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc12d46-f730-4955-9942-73f64e4ff744", "name": "network-vif-plugged", "status": "completed", "tag": "089c1c1c-c07a-44b7-9a56-e6bc3b8ef56c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:43.275509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9faf0ea9-2228-4130-983b-5d3494a12df6 req-e7bfa64c-37e5-4c9e-9d6a-77a288a30865 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:43.280363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9faf0ea9-2228-4130-983b-5d3494a12df6 req-e7bfa64c-37e5-4c9e-9d6a-77a288a30865 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:43.280781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9faf0ea9-2228-4130-983b-5d3494a12df6 req-e7bfa64c-37e5-4c9e-9d6a-77a288a30865 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:43.299179 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-9faf0ea9-2228-4130-983b-5d3494a12df6 req-e7bfa64c-37e5-4c9e-9d6a-77a288a30865 service nova] Creating event network-vif-plugged:089c1c1c-c07a-44b7-9a56-e6bc3b8ef56c for instance bbc12d46-f730-4955-9942-73f64e4ff744 on n-h2-861111-1 Oct 12 22:43:43.305178 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-9faf0ea9-2228-4130-983b-5d3494a12df6 req-e7bfa64c-37e5-4c9e-9d6a-77a288a30865 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065466 Oct 12 22:43:43.306020 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3041/6723] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:44.070356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ee03e74a-30f9-43ab-86cf-19118b4c7fe1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:44.072694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ee03e74a-30f9-43ab-86cf-19118b4c7fe1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:44.106453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee03e74a-30f9-43ab-86cf-19118b4c7fe1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:44.109733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee03e74a-30f9-43ab-86cf-19118b4c7fe1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:44.111700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee03e74a-30f9-43ab-86cf-19118b4c7fe1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:44.115352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee03e74a-30f9-43ab-86cf-19118b4c7fe1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:44.116085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee03e74a-30f9-43ab-86cf-19118b4c7fe1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:44.117800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee03e74a-30f9-43ab-86cf-19118b4c7fe1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:44.473104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ee03e74a-30f9-43ab-86cf-19118b4c7fe1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:44.487918 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ee03e74a-30f9-43ab-86cf-19118b4c7fe1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1392 microversion: 2.1 time: 0.425490 Oct 12 22:43:44.489119 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3683/6724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:44 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1392 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:45.514506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5ada32cf-6485-4213-a4ae-b5402cab7eb6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:45.515282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5ada32cf-6485-4213-a4ae-b5402cab7eb6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:45.523219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ada32cf-6485-4213-a4ae-b5402cab7eb6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:45.523765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ada32cf-6485-4213-a4ae-b5402cab7eb6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:45.524208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ada32cf-6485-4213-a4ae-b5402cab7eb6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:45.524939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ada32cf-6485-4213-a4ae-b5402cab7eb6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:45.525415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ada32cf-6485-4213-a4ae-b5402cab7eb6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:45.525975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ada32cf-6485-4213-a4ae-b5402cab7eb6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:45.724473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5ada32cf-6485-4213-a4ae-b5402cab7eb6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:45.744279 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5ada32cf-6485-4213-a4ae-b5402cab7eb6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1563 microversion: 2.1 time: 0.233910 Oct 12 22:43:45.755738 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3042/6725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:45 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:45.768111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-83a45ee6-cd32-4e78-8964-b1ec9484c46e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:45.769293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-83a45ee6-cd32-4e78-8964-b1ec9484c46e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:45.776740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83a45ee6-cd32-4e78-8964-b1ec9484c46e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:45.777508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83a45ee6-cd32-4e78-8964-b1ec9484c46e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:45.778183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83a45ee6-cd32-4e78-8964-b1ec9484c46e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:45.779177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83a45ee6-cd32-4e78-8964-b1ec9484c46e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:45.779936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83a45ee6-cd32-4e78-8964-b1ec9484c46e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:45.780741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83a45ee6-cd32-4e78-8964-b1ec9484c46e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:45.973739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-83a45ee6-cd32-4e78-8964-b1ec9484c46e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:45.982624 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-83a45ee6-cd32-4e78-8964-b1ec9484c46e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1563 microversion: 2.1 time: 0.218573 Oct 12 22:43:45.983210 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3684/6726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:45 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1563 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:48.621487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-27a24dca-a48c-4963-a13e-6c161d1e3fee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:48.622119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-27a24dca-a48c-4963-a13e-6c161d1e3fee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:48.627215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-e18b839f-df83-4fc1-879e-2d3175b2f431 req-85734d5f-5c03-45ce-8746-9d4ad0e033b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc12d46-f730-4955-9942-73f64e4ff744", "tag": "089c1c1c-c07a-44b7-9a56-e6bc3b8ef56c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:48.634877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27a24dca-a48c-4963-a13e-6c161d1e3fee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:48.635430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27a24dca-a48c-4963-a13e-6c161d1e3fee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:48.635951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27a24dca-a48c-4963-a13e-6c161d1e3fee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:48.636671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27a24dca-a48c-4963-a13e-6c161d1e3fee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:48.637133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27a24dca-a48c-4963-a13e-6c161d1e3fee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:48.637568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-27a24dca-a48c-4963-a13e-6c161d1e3fee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:48.639761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e18b839f-df83-4fc1-879e-2d3175b2f431 req-85734d5f-5c03-45ce-8746-9d4ad0e033b2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:48.640244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e18b839f-df83-4fc1-879e-2d3175b2f431 req-85734d5f-5c03-45ce-8746-9d4ad0e033b2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:48.640674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e18b839f-df83-4fc1-879e-2d3175b2f431 req-85734d5f-5c03-45ce-8746-9d4ad0e033b2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:48.656360 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-e18b839f-df83-4fc1-879e-2d3175b2f431 req-85734d5f-5c03-45ce-8746-9d4ad0e033b2 service nova] Creating event network-changed:089c1c1c-c07a-44b7-9a56-e6bc3b8ef56c for instance bbc12d46-f730-4955-9942-73f64e4ff744 on n-h2-861111-1 Oct 12 22:43:48.662420 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-e18b839f-df83-4fc1-879e-2d3175b2f431 req-85734d5f-5c03-45ce-8746-9d4ad0e033b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041374 Oct 12 22:43:48.663806 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3685/6727] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:43:49.161251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-27a24dca-a48c-4963-a13e-6c161d1e3fee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:49.177630 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-27a24dca-a48c-4963-a13e-6c161d1e3fee tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1563 microversion: 2.1 time: 0.561300 Oct 12 22:43:49.178510 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3043/6728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:48 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1563 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:50.948247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f6d2a50f-c1c3-4dca-9408-d5fb3280afb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:50.949578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f6d2a50f-c1c3-4dca-9408-d5fb3280afb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:50.961718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6d2a50f-c1c3-4dca-9408-d5fb3280afb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:50.962229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6d2a50f-c1c3-4dca-9408-d5fb3280afb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:50.962681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6d2a50f-c1c3-4dca-9408-d5fb3280afb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:50.963451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6d2a50f-c1c3-4dca-9408-d5fb3280afb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:50.963910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6d2a50f-c1c3-4dca-9408-d5fb3280afb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:50.964345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6d2a50f-c1c3-4dca-9408-d5fb3280afb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:51.060937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-f6d2a50f-c1c3-4dca-9408-d5fb3280afb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lazy-loading 'services' on Instance uuid 34a909e3-6584-4f69-81e7-849c667b159c {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:43:51.165261 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f6d2a50f-c1c3-4dca-9408-d5fb3280afb2 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "DELETE /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c/os-volume_attachments/126343cc-a993-4e3f-8494-a5b8b629acce" status: 202 len: 0 microversion: 2.1 time: 0.222048 Oct 12 22:43:51.166126 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3686/6729] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 22:43:50 2022] DELETE /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c/os-volume_attachments/126343cc-a993-4e3f-8494-a5b8b629acce => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:43:56.592533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd5b83f3-04d7-4cb6-8029-233a93549d02 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:56.593288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cd5b83f3-04d7-4cb6-8029-233a93549d02 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:56.596599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:56.605279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd5b83f3-04d7-4cb6-8029-233a93549d02 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:56.605776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd5b83f3-04d7-4cb6-8029-233a93549d02 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:56.606218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd5b83f3-04d7-4cb6-8029-233a93549d02 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:56.606928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd5b83f3-04d7-4cb6-8029-233a93549d02 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:56.607417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd5b83f3-04d7-4cb6-8029-233a93549d02 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:56.607852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd5b83f3-04d7-4cb6-8029-233a93549d02 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:56.638046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cd5b83f3-04d7-4cb6-8029-233a93549d02 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:43:56.724910 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cd5b83f3-04d7-4cb6-8029-233a93549d02 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "DELETE /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c" status: 204 len: 0 microversion: 2.1 time: 0.136008 Oct 12 22:43:56.725552 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3044/6730] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:43:56 2022] DELETE /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:43:56.735871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7af5e6ed-d0b6-4267-8124-dc4e2d200d01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:56.736806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7af5e6ed-d0b6-4267-8124-dc4e2d200d01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:56.743973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af5e6ed-d0b6-4267-8124-dc4e2d200d01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:56.744733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af5e6ed-d0b6-4267-8124-dc4e2d200d01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:56.745194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af5e6ed-d0b6-4267-8124-dc4e2d200d01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:56.745905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af5e6ed-d0b6-4267-8124-dc4e2d200d01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:56.746514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af5e6ed-d0b6-4267-8124-dc4e2d200d01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:56.746972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7af5e6ed-d0b6-4267-8124-dc4e2d200d01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:56.884216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7af5e6ed-d0b6-4267-8124-dc4e2d200d01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:56.893827 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7af5e6ed-d0b6-4267-8124-dc4e2d200d01 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c" status: 200 len: 1514 microversion: 2.1 time: 0.163181 Oct 12 22:43:56.894967 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3687/6731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:56 2022] GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:57.919196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-04da466e-beec-4283-9b05-59387ec008b1 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:57.919955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-04da466e-beec-4283-9b05-59387ec008b1 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:57.927155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04da466e-beec-4283-9b05-59387ec008b1 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:57.927703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04da466e-beec-4283-9b05-59387ec008b1 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:57.928148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04da466e-beec-4283-9b05-59387ec008b1 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:57.928868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04da466e-beec-4283-9b05-59387ec008b1 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:57.929340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04da466e-beec-4283-9b05-59387ec008b1 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:57.929780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04da466e-beec-4283-9b05-59387ec008b1 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:58.088086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-04da466e-beec-4283-9b05-59387ec008b1 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:58.096749 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-04da466e-beec-4283-9b05-59387ec008b1 tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c" status: 200 len: 1514 microversion: 2.1 time: 0.182101 Oct 12 22:43:58.097478 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3045/6732] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:57 2022] GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:58.887874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-74139576-3e68-4664-a00a-830e66171a24 req-2171b4e5-c265-4d54-80b1-077f461449a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a909e3-6584-4f69-81e7-849c667b159c", "name": "network-vif-deleted", "tag": "5c9e7f2b-b54f-4309-863d-4e4de620b3ba"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:58.902020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-74139576-3e68-4664-a00a-830e66171a24 req-2171b4e5-c265-4d54-80b1-077f461449a7 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:58.902714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-74139576-3e68-4664-a00a-830e66171a24 req-2171b4e5-c265-4d54-80b1-077f461449a7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:58.909433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-74139576-3e68-4664-a00a-830e66171a24 req-2171b4e5-c265-4d54-80b1-077f461449a7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:58.921683 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-74139576-3e68-4664-a00a-830e66171a24 req-2171b4e5-c265-4d54-80b1-077f461449a7 service nova] Creating event network-vif-deleted:5c9e7f2b-b54f-4309-863d-4e4de620b3ba for instance 34a909e3-6584-4f69-81e7-849c667b159c on n-h1-861111-1 Oct 12 22:43:58.931040 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-74139576-3e68-4664-a00a-830e66171a24 req-2171b4e5-c265-4d54-80b1-077f461449a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047282 Oct 12 22:43:58.932148 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3688/6733] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:59.120679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-38a3b7f7-7139-4e08-97a8-36637997cc3f tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:59.121451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-38a3b7f7-7139-4e08-97a8-36637997cc3f tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:59.132505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38a3b7f7-7139-4e08-97a8-36637997cc3f tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:59.133560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38a3b7f7-7139-4e08-97a8-36637997cc3f tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:59.134026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38a3b7f7-7139-4e08-97a8-36637997cc3f tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:59.136300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38a3b7f7-7139-4e08-97a8-36637997cc3f tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:59.136779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38a3b7f7-7139-4e08-97a8-36637997cc3f tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:59.137223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38a3b7f7-7139-4e08-97a8-36637997cc3f tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:59.174994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38a3b7f7-7139-4e08-97a8-36637997cc3f tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:59.175687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38a3b7f7-7139-4e08-97a8-36637997cc3f tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:59.176251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38a3b7f7-7139-4e08-97a8-36637997cc3f tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:59.176972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-38a3b7f7-7139-4e08-97a8-36637997cc3f tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lazy-loading 'fault' on Instance uuid 34a909e3-6584-4f69-81e7-849c667b159c {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:43:59.221247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-38a3b7f7-7139-4e08-97a8-36637997cc3f tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8be40d3bedf44e5855cb97f7832bd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc51c59f6b348f7a707a864ce232516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:59.231063 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-38a3b7f7-7139-4e08-97a8-36637997cc3f tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c" status: 200 len: 1309 microversion: 2.1 time: 0.115137 Oct 12 22:43:59.231684 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3046/6734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:59 2022] GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c => generated 1309 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:00.255722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ba50f931-20e2-4352-b02f-edc7b5d51a0d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:00.256464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ba50f931-20e2-4352-b02f-edc7b5d51a0d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] [instance: 34a909e3-6584-4f69-81e7-849c667b159c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:00.263739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba50f931-20e2-4352-b02f-edc7b5d51a0d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:00.264279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba50f931-20e2-4352-b02f-edc7b5d51a0d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:00.264705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba50f931-20e2-4352-b02f-edc7b5d51a0d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:00.265655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba50f931-20e2-4352-b02f-edc7b5d51a0d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:00.266305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba50f931-20e2-4352-b02f-edc7b5d51a0d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:00.266750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba50f931-20e2-4352-b02f-edc7b5d51a0d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:00.270042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:00.282890 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-ba50f931-20e2-4352-b02f-edc7b5d51a0d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] HTTP exception thrown: Instance 34a909e3-6584-4f69-81e7-849c667b159c could not be found. Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ba50f931-20e2-4352-b02f-edc7b5d51a0d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Request method failure captured: Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c HTTP/1.1 Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0J4QhmtW5_v1N6yo-394UHGfA4AHVoTKVi7e74UOzkQHm3mUSjhJaQgrYlpqP62wWPTdLj-H1lJ6wZfW4i2UtJKOJy_p3RfZq3ckZK_6PucWEaGFyGMDD02MxavaGVFIC3sLzkIGx06VPmscBJ4OsmU_23x-6pSnfFbPbwDtn_U9Ok Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 1cc51c59f6b348f7a707a864ce232516 Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1077196455 Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1cc51c59f6b348f7a707a864ce232516"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1cc51c59f6b348f7a707a864ce232516"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1cc51c59f6b348f7a707a864ce232516", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1cc51c59f6b348f7a707a864ce232516"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-VolumesSnapshotTestJSON-1077196455 Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 1cc51c59f6b348f7a707a864ce232516 Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1077196455 Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-VolumesSnapshotTestJSON-1077196455-project Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: b8be40d3bedf44e5855cb97f7832bd65 Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-VolumesSnapshotTestJSON-1077196455-project Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 34a909e3-6584-4f69-81e7-849c667b159c could not be found. Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '34a909e3-6584-4f69-81e7-849c667b159c'} Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34a909e3-6584-4f69-81e7-849c667b159c could not be found. Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34a909e3-6584-4f69-81e7-849c667b159c could not be found. Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:44:00.284539 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:44:00.289804 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:44:00.289804 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:44:00.289804 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:44:00.289804 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:44:00.289804 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:44:00.289804 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34a909e3-6584-4f69-81e7-849c667b159c could not be found. Oct 12 22:44:00.289804 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:44:00.289804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ba50f931-20e2-4352-b02f-edc7b5d51a0d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] Returning 404 to user: Instance 34a909e3-6584-4f69-81e7-849c667b159c could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:44:00.289804 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ba50f931-20e2-4352-b02f-edc7b5d51a0d tempest-VolumesSnapshotTestJSON-1077196455 tempest-VolumesSnapshotTestJSON-1077196455-project] 10.222.0.16 "GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c" status: 404 len: 111 microversion: 2.1 time: 0.035371 Oct 12 22:44:00.289804 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3689/6735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:00 2022] GET /compute/v2.1/servers/34a909e3-6584-4f69-81e7-849c667b159c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:44:09.306222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-523092207", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-96398279", "security_groups": [{"name": "tempest-secgroup-smoke-1530106101"}], "block_device_mapping_v2": [{"uuid": "71d9bebe-e5de-45a7-9dbc-7b33dd89d9b7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6d173dd3-914e-48d4-bcc2-81061c8da03d"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:09.319069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:09.319995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:09.450515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] validate_networks() for [('6d173dd3-914e-48d4-bcc2-81061c8da03d', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:44:10.078046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:44:10.078506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:44:10.079289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:44:10.079730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:44:10.080150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:44:10.095943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:10.096674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:10.097116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:10.097889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:10.098363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:10.099191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:10.118770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:44:10.124720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for user 7d141d93d7a74a57b5b6475294c9af5e and project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:44:10.197957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:44:10.200879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='71d9bebe-e5de-45a7-9dbc-7b33dd89d9b7',volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:44:10.350361 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d71c777e-31b6-45a1-adf4-0db56986a61b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.049027 Oct 12 22:44:10.351913 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3047/6736] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:44:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:44:10.365862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-45495143-acbc-4dd7-aae9-6d1d2fd56297 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:10.367089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-45495143-acbc-4dd7-aae9-6d1d2fd56297 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:10.380637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=15 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:10.382092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:10.450131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-45495143-acbc-4dd7-aae9-6d1d2fd56297 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:10.458811 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-45495143-acbc-4dd7-aae9-6d1d2fd56297 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1092 microversion: 2.1 time: 0.099588 Oct 12 22:44:10.465394 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3690/6737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:10 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1092 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:11.482076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a5d1477b-c1d7-43e8-bb96-af1277129122 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:11.483496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a5d1477b-c1d7-43e8-bb96-af1277129122 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:11.492138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5d1477b-c1d7-43e8-bb96-af1277129122 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:11.492970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5d1477b-c1d7-43e8-bb96-af1277129122 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:11.493606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5d1477b-c1d7-43e8-bb96-af1277129122 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:11.494486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5d1477b-c1d7-43e8-bb96-af1277129122 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:11.495113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5d1477b-c1d7-43e8-bb96-af1277129122 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:11.495756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5d1477b-c1d7-43e8-bb96-af1277129122 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:11.576460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a5d1477b-c1d7-43e8-bb96-af1277129122 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:11.595299 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a5d1477b-c1d7-43e8-bb96-af1277129122 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1190 microversion: 2.1 time: 0.117224 Oct 12 22:44:11.596480 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3048/6738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:11 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1190 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:12.624760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1f444582-411b-43bc-b0da-4aeb9b21732d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:12.626179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1f444582-411b-43bc-b0da-4aeb9b21732d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:12.635666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f444582-411b-43bc-b0da-4aeb9b21732d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:12.636520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f444582-411b-43bc-b0da-4aeb9b21732d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:12.637215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f444582-411b-43bc-b0da-4aeb9b21732d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:12.638481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f444582-411b-43bc-b0da-4aeb9b21732d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:12.639221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f444582-411b-43bc-b0da-4aeb9b21732d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:12.639902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f444582-411b-43bc-b0da-4aeb9b21732d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:12.720609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1f444582-411b-43bc-b0da-4aeb9b21732d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:12.729012 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1f444582-411b-43bc-b0da-4aeb9b21732d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1208 microversion: 2.1 time: 0.109355 Oct 12 22:44:12.729661 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3691/6739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:12 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1208 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:13.687532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-979ca4b4-7f4b-45ed-9aba-07bf329362fe req-ae8d4f2f-eb14-41c6-b565-31c2288a18e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939ea0f2-a100-4c6e-ada6-5cf434c39070", "tag": "854b50ba-aecf-4eba-8674-0ce0052a117c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:13.698571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-979ca4b4-7f4b-45ed-9aba-07bf329362fe req-ae8d4f2f-eb14-41c6-b565-31c2288a18e6 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:13.699054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-979ca4b4-7f4b-45ed-9aba-07bf329362fe req-ae8d4f2f-eb14-41c6-b565-31c2288a18e6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:13.699529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-979ca4b4-7f4b-45ed-9aba-07bf329362fe req-ae8d4f2f-eb14-41c6-b565-31c2288a18e6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:13.711609 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-979ca4b4-7f4b-45ed-9aba-07bf329362fe req-ae8d4f2f-eb14-41c6-b565-31c2288a18e6 service nova] Creating event network-changed:854b50ba-aecf-4eba-8674-0ce0052a117c for instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 on n-h1-861111-1 Oct 12 22:44:13.717256 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-979ca4b4-7f4b-45ed-9aba-07bf329362fe req-ae8d4f2f-eb14-41c6-b565-31c2288a18e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033399 Oct 12 22:44:13.718130 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3049/6740] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:13.753567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-05b169b1-80b8-4915-8b39-13aaa87fe84b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:13.754815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-05b169b1-80b8-4915-8b39-13aaa87fe84b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:13.761960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05b169b1-80b8-4915-8b39-13aaa87fe84b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:13.762750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05b169b1-80b8-4915-8b39-13aaa87fe84b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:13.763470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05b169b1-80b8-4915-8b39-13aaa87fe84b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:13.764435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05b169b1-80b8-4915-8b39-13aaa87fe84b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:13.765108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05b169b1-80b8-4915-8b39-13aaa87fe84b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:13.765766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05b169b1-80b8-4915-8b39-13aaa87fe84b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:13.930669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-05b169b1-80b8-4915-8b39-13aaa87fe84b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:13.939196 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-05b169b1-80b8-4915-8b39-13aaa87fe84b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1276 microversion: 2.1 time: 0.189813 Oct 12 22:44:13.939917 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3692/6741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:13 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:14.965774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-31400b99-085f-4f5e-8a60-1d980375c6a8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:14.967191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-31400b99-085f-4f5e-8a60-1d980375c6a8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:14.975410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31400b99-085f-4f5e-8a60-1d980375c6a8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:14.976396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31400b99-085f-4f5e-8a60-1d980375c6a8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:14.977099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31400b99-085f-4f5e-8a60-1d980375c6a8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:14.978217 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31400b99-085f-4f5e-8a60-1d980375c6a8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:14.978940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31400b99-085f-4f5e-8a60-1d980375c6a8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:14.979649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31400b99-085f-4f5e-8a60-1d980375c6a8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:15.124656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-31400b99-085f-4f5e-8a60-1d980375c6a8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:15.138331 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-31400b99-085f-4f5e-8a60-1d980375c6a8 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1276 microversion: 2.1 time: 0.177501 Oct 12 22:44:15.138951 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3050/6742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:14 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:16.162871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-125665e2-e7bf-4cfe-9e06-3748385ab10c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:16.164751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-125665e2-e7bf-4cfe-9e06-3748385ab10c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:16.172892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-125665e2-e7bf-4cfe-9e06-3748385ab10c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:16.173668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-125665e2-e7bf-4cfe-9e06-3748385ab10c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:16.176899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-125665e2-e7bf-4cfe-9e06-3748385ab10c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:16.177878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-125665e2-e7bf-4cfe-9e06-3748385ab10c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:16.178768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-125665e2-e7bf-4cfe-9e06-3748385ab10c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:16.179645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-125665e2-e7bf-4cfe-9e06-3748385ab10c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:16.351566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-125665e2-e7bf-4cfe-9e06-3748385ab10c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:16.371931 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-125665e2-e7bf-4cfe-9e06-3748385ab10c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1276 microversion: 2.1 time: 0.213964 Oct 12 22:44:16.372544 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3693/6743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:16 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1276 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:17.402002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7be04413-ffbd-41a6-80d9-22339a255506 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:17.403250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7be04413-ffbd-41a6-80d9-22339a255506 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:17.415723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7be04413-ffbd-41a6-80d9-22339a255506 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:17.421120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7be04413-ffbd-41a6-80d9-22339a255506 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:17.421740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7be04413-ffbd-41a6-80d9-22339a255506 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:17.422626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7be04413-ffbd-41a6-80d9-22339a255506 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:17.425187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7be04413-ffbd-41a6-80d9-22339a255506 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:17.425811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7be04413-ffbd-41a6-80d9-22339a255506 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:17.638095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7be04413-ffbd-41a6-80d9-22339a255506 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:17.652314 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7be04413-ffbd-41a6-80d9-22339a255506 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1276 microversion: 2.1 time: 0.260344 Oct 12 22:44:17.653020 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3051/6744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:17 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1276 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:18.675724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-957aa006-110e-457c-aadb-c9d3d443b2f4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:18.677155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-957aa006-110e-457c-aadb-c9d3d443b2f4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:18.686159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-957aa006-110e-457c-aadb-c9d3d443b2f4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:18.687099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-957aa006-110e-457c-aadb-c9d3d443b2f4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:18.687745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-957aa006-110e-457c-aadb-c9d3d443b2f4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:18.688771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-957aa006-110e-457c-aadb-c9d3d443b2f4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:18.689423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-957aa006-110e-457c-aadb-c9d3d443b2f4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:18.690028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-957aa006-110e-457c-aadb-c9d3d443b2f4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:18.840283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-957aa006-110e-457c-aadb-c9d3d443b2f4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:18.849450 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-957aa006-110e-457c-aadb-c9d3d443b2f4 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1276 microversion: 2.1 time: 0.179090 Oct 12 22:44:18.864564 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3694/6745] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:18 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:19.608256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-99ebff55-4548-49df-b06c-24ad8111d0d5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:19.610845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-99ebff55-4548-49df-b06c-24ad8111d0d5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:19.618487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99ebff55-4548-49df-b06c-24ad8111d0d5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:19.619379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99ebff55-4548-49df-b06c-24ad8111d0d5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:19.619933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99ebff55-4548-49df-b06c-24ad8111d0d5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:19.620762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99ebff55-4548-49df-b06c-24ad8111d0d5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:19.621323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99ebff55-4548-49df-b06c-24ad8111d0d5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:19.621857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99ebff55-4548-49df-b06c-24ad8111d0d5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:19.678991 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-99ebff55-4548-49df-b06c-24ad8111d0d5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744/action" status: 200 len: 24574 microversion: 2.1 time: 0.074441 Oct 12 22:44:19.686061 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3052/6746] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:44:19 2022] POST /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744/action => generated 24574 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:44:19.871964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bd6a749a-2834-4037-b90d-62de0f4e9413 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:19.872579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bd6a749a-2834-4037-b90d-62de0f4e9413 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:19.879400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd6a749a-2834-4037-b90d-62de0f4e9413 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:19.880387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd6a749a-2834-4037-b90d-62de0f4e9413 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:19.880821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd6a749a-2834-4037-b90d-62de0f4e9413 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:19.881506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd6a749a-2834-4037-b90d-62de0f4e9413 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:19.881957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd6a749a-2834-4037-b90d-62de0f4e9413 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:19.882406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bd6a749a-2834-4037-b90d-62de0f4e9413 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:20.014628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bd6a749a-2834-4037-b90d-62de0f4e9413 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:20.022535 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bd6a749a-2834-4037-b90d-62de0f4e9413 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1264 microversion: 2.1 time: 0.154344 Oct 12 22:44:20.023012 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3695/6747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:19 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:21.046807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7b0061db-e477-4d7f-93d2-d0fd5c64011c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:21.047660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7b0061db-e477-4d7f-93d2-d0fd5c64011c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:21.050390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:21.051161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:21.058764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b0061db-e477-4d7f-93d2-d0fd5c64011c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:21.059298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b0061db-e477-4d7f-93d2-d0fd5c64011c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:21.059758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b0061db-e477-4d7f-93d2-d0fd5c64011c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:21.060470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b0061db-e477-4d7f-93d2-d0fd5c64011c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:21.060940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b0061db-e477-4d7f-93d2-d0fd5c64011c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:21.061379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b0061db-e477-4d7f-93d2-d0fd5c64011c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:21.206948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7b0061db-e477-4d7f-93d2-d0fd5c64011c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:21.216830 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7b0061db-e477-4d7f-93d2-d0fd5c64011c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1264 microversion: 2.1 time: 0.174431 Oct 12 22:44:21.228763 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3053/6748] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:21 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:22.240672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3e9941eb-4ea7-4d36-9d8c-9b51274a52dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:22.242033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3e9941eb-4ea7-4d36-9d8c-9b51274a52dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:22.243982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:22.251614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e9941eb-4ea7-4d36-9d8c-9b51274a52dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:22.252105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e9941eb-4ea7-4d36-9d8c-9b51274a52dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:22.252542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e9941eb-4ea7-4d36-9d8c-9b51274a52dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:22.253245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e9941eb-4ea7-4d36-9d8c-9b51274a52dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:22.253700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e9941eb-4ea7-4d36-9d8c-9b51274a52dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:22.254124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e9941eb-4ea7-4d36-9d8c-9b51274a52dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:22.553978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3e9941eb-4ea7-4d36-9d8c-9b51274a52dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:22.571208 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3e9941eb-4ea7-4d36-9d8c-9b51274a52dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1264 microversion: 2.1 time: 0.334552 Oct 12 22:44:22.584556 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3696/6749] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:22 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1264 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:23.596681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd1fbd78-63ee-49bf-b8d8-c6375e4f28a1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:23.598195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cd1fbd78-63ee-49bf-b8d8-c6375e4f28a1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:23.606365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd1fbd78-63ee-49bf-b8d8-c6375e4f28a1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:23.606997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd1fbd78-63ee-49bf-b8d8-c6375e4f28a1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:23.609653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd1fbd78-63ee-49bf-b8d8-c6375e4f28a1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:23.610400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd1fbd78-63ee-49bf-b8d8-c6375e4f28a1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:23.611041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd1fbd78-63ee-49bf-b8d8-c6375e4f28a1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:23.611361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd1fbd78-63ee-49bf-b8d8-c6375e4f28a1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:23.800297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cd1fbd78-63ee-49bf-b8d8-c6375e4f28a1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:23.811885 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cd1fbd78-63ee-49bf-b8d8-c6375e4f28a1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1264 microversion: 2.1 time: 0.219395 Oct 12 22:44:23.827515 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3054/6750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:23 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1264 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:24.835011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9cea16c5-7d29-4259-be5c-1d6c1f7c1cde tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:24.836995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9cea16c5-7d29-4259-be5c-1d6c1f7c1cde tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:24.844499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cea16c5-7d29-4259-be5c-1d6c1f7c1cde tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:24.845231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cea16c5-7d29-4259-be5c-1d6c1f7c1cde tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:24.846158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cea16c5-7d29-4259-be5c-1d6c1f7c1cde tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:24.847310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cea16c5-7d29-4259-be5c-1d6c1f7c1cde tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:24.848027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cea16c5-7d29-4259-be5c-1d6c1f7c1cde tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:24.849440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cea16c5-7d29-4259-be5c-1d6c1f7c1cde tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:24.994034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9cea16c5-7d29-4259-be5c-1d6c1f7c1cde tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:25.002090 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9cea16c5-7d29-4259-be5c-1d6c1f7c1cde tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1264 microversion: 2.1 time: 0.171532 Oct 12 22:44:25.015481 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3697/6751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:24 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:26.026200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5f4dcce0-b51a-4779-9103-4389e820048d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:26.027468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5f4dcce0-b51a-4779-9103-4389e820048d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:26.036932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f4dcce0-b51a-4779-9103-4389e820048d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:26.037427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f4dcce0-b51a-4779-9103-4389e820048d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:26.038220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f4dcce0-b51a-4779-9103-4389e820048d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:26.039420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f4dcce0-b51a-4779-9103-4389e820048d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:26.040139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f4dcce0-b51a-4779-9103-4389e820048d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:26.040824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f4dcce0-b51a-4779-9103-4389e820048d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:26.203863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5f4dcce0-b51a-4779-9103-4389e820048d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:26.213654 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5f4dcce0-b51a-4779-9103-4389e820048d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1264 microversion: 2.1 time: 0.191378 Oct 12 22:44:26.214760 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3055/6752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:26 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:27.236384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-19f3c632-a2fc-410c-ba97-afec4c12de7f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:27.237028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-19f3c632-a2fc-410c-ba97-afec4c12de7f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:27.245615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19f3c632-a2fc-410c-ba97-afec4c12de7f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:27.246108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19f3c632-a2fc-410c-ba97-afec4c12de7f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:27.246543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19f3c632-a2fc-410c-ba97-afec4c12de7f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:27.247457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19f3c632-a2fc-410c-ba97-afec4c12de7f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:27.248732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19f3c632-a2fc-410c-ba97-afec4c12de7f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:27.248732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-19f3c632-a2fc-410c-ba97-afec4c12de7f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:27.450525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-19f3c632-a2fc-410c-ba97-afec4c12de7f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:27.461746 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-19f3c632-a2fc-410c-ba97-afec4c12de7f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1264 microversion: 2.1 time: 0.229252 Oct 12 22:44:27.463131 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3698/6753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:27 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:28.485071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1ad07de9-8e57-4373-867e-96199133d9c3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:28.485737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1ad07de9-8e57-4373-867e-96199133d9c3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:28.495628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ad07de9-8e57-4373-867e-96199133d9c3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:28.497714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ad07de9-8e57-4373-867e-96199133d9c3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:28.498174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ad07de9-8e57-4373-867e-96199133d9c3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:28.498934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ad07de9-8e57-4373-867e-96199133d9c3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:28.499438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ad07de9-8e57-4373-867e-96199133d9c3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:28.499876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ad07de9-8e57-4373-867e-96199133d9c3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:28.632034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1ad07de9-8e57-4373-867e-96199133d9c3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:28.639799 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1ad07de9-8e57-4373-867e-96199133d9c3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1264 microversion: 2.1 time: 0.158715 Oct 12 22:44:28.640469 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3056/6754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:28 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:29.451009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-b16ceb8d-8fc9-4c1f-8993-3bfb7f2c8614 req-6bd58364-74d9-4cad-bb21-c63bb08745bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "939ea0f2-a100-4c6e-ada6-5cf434c39070", "name": "network-vif-plugged", "status": "completed", "tag": "854b50ba-aecf-4eba-8674-0ce0052a117c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:29.465856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b16ceb8d-8fc9-4c1f-8993-3bfb7f2c8614 req-6bd58364-74d9-4cad-bb21-c63bb08745bd service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:29.466689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b16ceb8d-8fc9-4c1f-8993-3bfb7f2c8614 req-6bd58364-74d9-4cad-bb21-c63bb08745bd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:29.468566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b16ceb8d-8fc9-4c1f-8993-3bfb7f2c8614 req-6bd58364-74d9-4cad-bb21-c63bb08745bd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:29.483628 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-b16ceb8d-8fc9-4c1f-8993-3bfb7f2c8614 req-6bd58364-74d9-4cad-bb21-c63bb08745bd service nova] Creating event network-vif-plugged:854b50ba-aecf-4eba-8674-0ce0052a117c for instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 on n-h1-861111-1 Oct 12 22:44:29.490752 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-b16ceb8d-8fc9-4c1f-8993-3bfb7f2c8614 req-6bd58364-74d9-4cad-bb21-c63bb08745bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046191 Oct 12 22:44:29.491966 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3699/6755] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:29.665664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a147cdd-d718-4105-8c45-adb4388e14b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:29.668022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7a147cdd-d718-4105-8c45-adb4388e14b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:29.676593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a147cdd-d718-4105-8c45-adb4388e14b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:29.677677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a147cdd-d718-4105-8c45-adb4388e14b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:29.678131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a147cdd-d718-4105-8c45-adb4388e14b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:29.678898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a147cdd-d718-4105-8c45-adb4388e14b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:29.679388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a147cdd-d718-4105-8c45-adb4388e14b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:29.679829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a147cdd-d718-4105-8c45-adb4388e14b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:29.820669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a147cdd-d718-4105-8c45-adb4388e14b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:29.828824 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7a147cdd-d718-4105-8c45-adb4388e14b9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1264 microversion: 2.1 time: 0.170383 Oct 12 22:44:29.829397 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3057/6756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:29 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:30.853923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a8365167-bc09-457c-889b-8930fa7e1d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:30.854825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a8365167-bc09-457c-889b-8930fa7e1d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:30.870175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8365167-bc09-457c-889b-8930fa7e1d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:30.870674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8365167-bc09-457c-889b-8930fa7e1d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:30.871180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8365167-bc09-457c-889b-8930fa7e1d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:30.871939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8365167-bc09-457c-889b-8930fa7e1d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:30.872396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8365167-bc09-457c-889b-8930fa7e1d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:30.875692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8365167-bc09-457c-889b-8930fa7e1d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:31.035941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a8365167-bc09-457c-889b-8930fa7e1d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:31.050442 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a8365167-bc09-457c-889b-8930fa7e1d43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1450 microversion: 2.1 time: 0.201960 Oct 12 22:44:31.057298 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3700/6757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:30 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1450 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:31.072853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-998ad8e9-91b5-4dba-9c5c-06260dacb02a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:31.073566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-998ad8e9-91b5-4dba-9c5c-06260dacb02a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:31.080806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998ad8e9-91b5-4dba-9c5c-06260dacb02a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:31.081301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998ad8e9-91b5-4dba-9c5c-06260dacb02a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:31.081931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998ad8e9-91b5-4dba-9c5c-06260dacb02a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:31.082637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998ad8e9-91b5-4dba-9c5c-06260dacb02a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:31.083132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998ad8e9-91b5-4dba-9c5c-06260dacb02a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:31.083891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998ad8e9-91b5-4dba-9c5c-06260dacb02a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:31.226595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-998ad8e9-91b5-4dba-9c5c-06260dacb02a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:31.234649 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-998ad8e9-91b5-4dba-9c5c-06260dacb02a tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1450 microversion: 2.1 time: 0.165625 Oct 12 22:44:31.235403 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3058/6758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:31 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1450 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:33.396636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-80a307f6-6172-40f2-afda-527882aaeca5 req-5025eb36-db7c-4a91-9831-ea1e5be84ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939ea0f2-a100-4c6e-ada6-5cf434c39070", "tag": "854b50ba-aecf-4eba-8674-0ce0052a117c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:33.408263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-80a307f6-6172-40f2-afda-527882aaeca5 req-5025eb36-db7c-4a91-9831-ea1e5be84ae4 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:33.408746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-80a307f6-6172-40f2-afda-527882aaeca5 req-5025eb36-db7c-4a91-9831-ea1e5be84ae4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:33.409196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-80a307f6-6172-40f2-afda-527882aaeca5 req-5025eb36-db7c-4a91-9831-ea1e5be84ae4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:33.420288 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-80a307f6-6172-40f2-afda-527882aaeca5 req-5025eb36-db7c-4a91-9831-ea1e5be84ae4 service nova] Creating event network-changed:854b50ba-aecf-4eba-8674-0ce0052a117c for instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 on n-h1-861111-1 Oct 12 22:44:33.425327 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-80a307f6-6172-40f2-afda-527882aaeca5 req-5025eb36-db7c-4a91-9831-ea1e5be84ae4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032995 Oct 12 22:44:33.426359 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3701/6759] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:50.123867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3658c7fb-a83e-4964-a359-2f4ba55d4c2d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:50.125711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3658c7fb-a83e-4964-a359-2f4ba55d4c2d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:50.134004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:50.134968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=62 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:50.139949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3658c7fb-a83e-4964-a359-2f4ba55d4c2d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:50.140523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3658c7fb-a83e-4964-a359-2f4ba55d4c2d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:50.141083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3658c7fb-a83e-4964-a359-2f4ba55d4c2d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:50.141889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3658c7fb-a83e-4964-a359-2f4ba55d4c2d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:50.142374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3658c7fb-a83e-4964-a359-2f4ba55d4c2d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:50.142822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3658c7fb-a83e-4964-a359-2f4ba55d4c2d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:50.567825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3658c7fb-a83e-4964-a359-2f4ba55d4c2d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:50.582986 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3658c7fb-a83e-4964-a359-2f4ba55d4c2d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1682 microversion: 2.1 time: 0.464025 Oct 12 22:44:50.584037 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3059/6760] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:50 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1682 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:50.699197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9897fc31-5941-4386-b36e-c5c3b47959bc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:50.702590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9897fc31-5941-4386-b36e-c5c3b47959bc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:50.710218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=26 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:50.710868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=58 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:50.713681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9897fc31-5941-4386-b36e-c5c3b47959bc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:50.714306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9897fc31-5941-4386-b36e-c5c3b47959bc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:50.714836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9897fc31-5941-4386-b36e-c5c3b47959bc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:50.715568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9897fc31-5941-4386-b36e-c5c3b47959bc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:50.716026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9897fc31-5941-4386-b36e-c5c3b47959bc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:50.716453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9897fc31-5941-4386-b36e-c5c3b47959bc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:50.774199 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9897fc31-5941-4386-b36e-c5c3b47959bc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744/action" status: 200 len: 32646 microversion: 2.1 time: 0.081730 Oct 12 22:44:50.781334 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3702/6761] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:44:50 2022] POST /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744/action => generated 32646 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:44:50.942676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-28abf623-75db-49cf-9e00-331c4f8b4c6d tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:50.944304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-28abf623-75db-49cf-9e00-331c4f8b4c6d tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:50.953148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28abf623-75db-49cf-9e00-331c4f8b4c6d tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:50.954169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28abf623-75db-49cf-9e00-331c4f8b4c6d tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:50.955003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28abf623-75db-49cf-9e00-331c4f8b4c6d tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:50.956508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28abf623-75db-49cf-9e00-331c4f8b4c6d tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:50.957165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28abf623-75db-49cf-9e00-331c4f8b4c6d tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:50.968848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28abf623-75db-49cf-9e00-331c4f8b4c6d tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:51.161226 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-28abf623-75db-49cf-9e00-331c4f8b4c6d tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1833 microversion: 2.1 time: 0.222814 Oct 12 22:44:51.169369 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3060/6762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:50 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1833 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:51.194174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8cce6411-332c-4acc-8248-fb6463914b2b tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:51.197339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8cce6411-332c-4acc-8248-fb6463914b2b tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:51.205863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8cce6411-332c-4acc-8248-fb6463914b2b tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:51.206572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8cce6411-332c-4acc-8248-fb6463914b2b tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:51.207024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8cce6411-332c-4acc-8248-fb6463914b2b tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:51.207829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8cce6411-332c-4acc-8248-fb6463914b2b tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:51.208451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8cce6411-332c-4acc-8248-fb6463914b2b tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:51.209062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8cce6411-332c-4acc-8248-fb6463914b2b tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:51.239127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-8cce6411-332c-4acc-8248-fb6463914b2b tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lazy-loading 'flavor' on Instance uuid bbc12d46-f730-4955-9942-73f64e4ff744 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:44:51.253289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8cce6411-332c-4acc-8248-fb6463914b2b tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Going to try to live migrate instance to another host {{(pid=120453) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:44:53.242208 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8cce6411-332c-4acc-8248-fb6463914b2b tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744/action" status: 202 len: 0 microversion: 2.1 time: 2.052689 Oct 12 22:44:53.243229 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3703/6763] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:44:51 2022] POST /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744/action => generated 0 bytes in 2055 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:44:53.258466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8ca4b5f1-377b-4b52-9d2c-57c1662fdbe6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:53.262321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8ca4b5f1-377b-4b52-9d2c-57c1662fdbe6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:53.272575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ca4b5f1-377b-4b52-9d2c-57c1662fdbe6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:53.273407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ca4b5f1-377b-4b52-9d2c-57c1662fdbe6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:53.274105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ca4b5f1-377b-4b52-9d2c-57c1662fdbe6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:53.275784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ca4b5f1-377b-4b52-9d2c-57c1662fdbe6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:53.276475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ca4b5f1-377b-4b52-9d2c-57c1662fdbe6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:53.277771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ca4b5f1-377b-4b52-9d2c-57c1662fdbe6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:53.509028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8ca4b5f1-377b-4b52-9d2c-57c1662fdbe6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:53.524242 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8ca4b5f1-377b-4b52-9d2c-57c1662fdbe6 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1692 microversion: 2.1 time: 0.275016 Oct 12 22:44:53.538869 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3061/6764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:53 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1692 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:53.758837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1315380612", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "4a2ce498-b072-4671-8063-2ba106126ac4"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:53.840521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] validate_networks() for [('4a2ce498-b072-4671-8063-2ba106126ac4', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:44:54.236606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:44:54.237129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:44:54.237820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:44:54.238574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:44:54.239186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:44:54.250688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:54.252443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:54.253200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:54.254142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:54.254810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:54.255465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:54.276785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Getting quotas for project 9d400580dee84553bfc03450415c1558. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:44:54.284074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Getting quotas for user 03e972ee645b496eb171bd3c6984ab23 and project 9d400580dee84553bfc03450415c1558. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:44:54.300725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:44:54.304009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:44:54.359695 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-be713d75-c5f1-4fda-aaab-944785618265 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739125 Oct 12 22:44:54.360419 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3704/6765] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:44:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:44:54.372574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ced4ec57-2f72-4fdf-a7c6-9a3552fc22de tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:54.373978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ced4ec57-2f72-4fdf-a7c6-9a3552fc22de tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:54.518884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ced4ec57-2f72-4fdf-a7c6-9a3552fc22de tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:54.529473 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ced4ec57-2f72-4fdf-a7c6-9a3552fc22de tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1215 microversion: 2.1 time: 0.161293 Oct 12 22:44:54.530058 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3062/6766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:54 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:54.554527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7db030a5-43ac-4c18-bfbb-2a91a2f2b31c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:54.555708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7db030a5-43ac-4c18-bfbb-2a91a2f2b31c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:54.563063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7db030a5-43ac-4c18-bfbb-2a91a2f2b31c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:54.563583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7db030a5-43ac-4c18-bfbb-2a91a2f2b31c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:54.564119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7db030a5-43ac-4c18-bfbb-2a91a2f2b31c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:54.564866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7db030a5-43ac-4c18-bfbb-2a91a2f2b31c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:54.565313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7db030a5-43ac-4c18-bfbb-2a91a2f2b31c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:54.565734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7db030a5-43ac-4c18-bfbb-2a91a2f2b31c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:54.678598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-e84a1936-6997-4b5a-9b30-3b2353f189e3 req-e674e633-61cb-4fcd-8ee0-ad482df6f54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc12d46-f730-4955-9942-73f64e4ff744", "name": "network-vif-unplugged", "status": "completed", "tag": "089c1c1c-c07a-44b7-9a56-e6bc3b8ef56c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:54.700873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e84a1936-6997-4b5a-9b30-3b2353f189e3 req-e674e633-61cb-4fcd-8ee0-ad482df6f54a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:54.701896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e84a1936-6997-4b5a-9b30-3b2353f189e3 req-e674e633-61cb-4fcd-8ee0-ad482df6f54a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:54.705263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e84a1936-6997-4b5a-9b30-3b2353f189e3 req-e674e633-61cb-4fcd-8ee0-ad482df6f54a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:54.734924 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-e84a1936-6997-4b5a-9b30-3b2353f189e3 req-e674e633-61cb-4fcd-8ee0-ad482df6f54a service nova] Creating event network-vif-unplugged:089c1c1c-c07a-44b7-9a56-e6bc3b8ef56c for instance bbc12d46-f730-4955-9942-73f64e4ff744 on n-h2-861111-1 Oct 12 22:44:54.742774 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-e84a1936-6997-4b5a-9b30-3b2353f189e3 req-e674e633-61cb-4fcd-8ee0-ad482df6f54a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068835 Oct 12 22:44:54.744274 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3063/6767] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:54.753755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7db030a5-43ac-4c18-bfbb-2a91a2f2b31c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:54.767779 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7db030a5-43ac-4c18-bfbb-2a91a2f2b31c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1692 microversion: 2.1 time: 0.219317 Oct 12 22:44:54.768882 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3705/6768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:54 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1692 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:55.567748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9a9b98f6-e433-4be0-a48b-57cb95428235 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:55.569052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9a9b98f6-e433-4be0-a48b-57cb95428235 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:55.585134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a9b98f6-e433-4be0-a48b-57cb95428235 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:55.585715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a9b98f6-e433-4be0-a48b-57cb95428235 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:55.586183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a9b98f6-e433-4be0-a48b-57cb95428235 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:55.588380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a9b98f6-e433-4be0-a48b-57cb95428235 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:55.588860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a9b98f6-e433-4be0-a48b-57cb95428235 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:55.589342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a9b98f6-e433-4be0-a48b-57cb95428235 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:55.700852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9a9b98f6-e433-4be0-a48b-57cb95428235 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:55.711460 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9a9b98f6-e433-4be0-a48b-57cb95428235 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1267 microversion: 2.1 time: 0.160844 Oct 12 22:44:55.724034 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3064/6769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:55 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:55.793972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5d74bd34-018b-4bce-979f-424496bfd8e3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:55.795506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5d74bd34-018b-4bce-979f-424496bfd8e3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:55.810963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d74bd34-018b-4bce-979f-424496bfd8e3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:55.811717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d74bd34-018b-4bce-979f-424496bfd8e3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:55.812306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d74bd34-018b-4bce-979f-424496bfd8e3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:55.813199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d74bd34-018b-4bce-979f-424496bfd8e3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:55.813853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d74bd34-018b-4bce-979f-424496bfd8e3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:55.814438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d74bd34-018b-4bce-979f-424496bfd8e3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:55.983699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5d74bd34-018b-4bce-979f-424496bfd8e3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:55.992604 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5d74bd34-018b-4bce-979f-424496bfd8e3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1692 microversion: 2.1 time: 0.203876 Oct 12 22:44:55.993316 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3706/6770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:55 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1692 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:56.736584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4d06e2bc-cadf-4222-95db-3934d6d2d334 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:56.737417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4d06e2bc-cadf-4222-95db-3934d6d2d334 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:56.745812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d06e2bc-cadf-4222-95db-3934d6d2d334 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:56.746314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d06e2bc-cadf-4222-95db-3934d6d2d334 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:56.746799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d06e2bc-cadf-4222-95db-3934d6d2d334 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:56.747544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d06e2bc-cadf-4222-95db-3934d6d2d334 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:56.748009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d06e2bc-cadf-4222-95db-3934d6d2d334 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:56.748608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d06e2bc-cadf-4222-95db-3934d6d2d334 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:56.772523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-876b6ec5-9266-4bc4-8f1a-06a2b70cee42 req-e3e723f7-3270-46e6-ae71-0fb11bb906a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc12d46-f730-4955-9942-73f64e4ff744", "tag": "089c1c1c-c07a-44b7-9a56-e6bc3b8ef56c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:56.805533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-876b6ec5-9266-4bc4-8f1a-06a2b70cee42 req-e3e723f7-3270-46e6-ae71-0fb11bb906a1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:56.806628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-876b6ec5-9266-4bc4-8f1a-06a2b70cee42 req-e3e723f7-3270-46e6-ae71-0fb11bb906a1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:56.807210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-876b6ec5-9266-4bc4-8f1a-06a2b70cee42 req-e3e723f7-3270-46e6-ae71-0fb11bb906a1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:56.827852 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-876b6ec5-9266-4bc4-8f1a-06a2b70cee42 req-e3e723f7-3270-46e6-ae71-0fb11bb906a1 service nova] Creating event network-changed:089c1c1c-c07a-44b7-9a56-e6bc3b8ef56c for instance bbc12d46-f730-4955-9942-73f64e4ff744 on n-h2-861111-1 Oct 12 22:44:56.835766 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-876b6ec5-9266-4bc4-8f1a-06a2b70cee42 req-e3e723f7-3270-46e6-ae71-0fb11bb906a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068300 Oct 12 22:44:56.836953 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3707/6771] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:44:57.018351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-31560770-0165-4ce6-a11d-65ef7464200e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:57.019082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-31560770-0165-4ce6-a11d-65ef7464200e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:57.025907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31560770-0165-4ce6-a11d-65ef7464200e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:57.026405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31560770-0165-4ce6-a11d-65ef7464200e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:57.026852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31560770-0165-4ce6-a11d-65ef7464200e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:57.027630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31560770-0165-4ce6-a11d-65ef7464200e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:57.028092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31560770-0165-4ce6-a11d-65ef7464200e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:57.028715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31560770-0165-4ce6-a11d-65ef7464200e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:57.121270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4d06e2bc-cadf-4222-95db-3934d6d2d334 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:57.135192 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4d06e2bc-cadf-4222-95db-3934d6d2d334 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1315 microversion: 2.1 time: 0.396957 Oct 12 22:44:57.136196 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3065/6772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:56 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:57.186072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-31560770-0165-4ce6-a11d-65ef7464200e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:57.194764 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-31560770-0165-4ce6-a11d-65ef7464200e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1692 microversion: 2.1 time: 0.180886 Oct 12 22:44:57.195374 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3708/6773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:57 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:58.161498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-66141637-1e8e-41d8-a720-d5718c4e879b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:58.162664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-66141637-1e8e-41d8-a720-d5718c4e879b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:58.169909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66141637-1e8e-41d8-a720-d5718c4e879b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:58.170424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66141637-1e8e-41d8-a720-d5718c4e879b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:58.170878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66141637-1e8e-41d8-a720-d5718c4e879b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:58.171634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66141637-1e8e-41d8-a720-d5718c4e879b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:58.172107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66141637-1e8e-41d8-a720-d5718c4e879b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:58.172547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66141637-1e8e-41d8-a720-d5718c4e879b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:58.219852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f2f60410-4c70-4418-a778-e46c4d041e5c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:58.220470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f2f60410-4c70-4418-a778-e46c4d041e5c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:58.229610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2f60410-4c70-4418-a778-e46c4d041e5c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:58.230360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2f60410-4c70-4418-a778-e46c4d041e5c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:58.230953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2f60410-4c70-4418-a778-e46c4d041e5c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:58.231856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2f60410-4c70-4418-a778-e46c4d041e5c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:58.232459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2f60410-4c70-4418-a778-e46c4d041e5c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:58.233026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2f60410-4c70-4418-a778-e46c4d041e5c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:58.362943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-66141637-1e8e-41d8-a720-d5718c4e879b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:58.370821 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-66141637-1e8e-41d8-a720-d5718c4e879b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1315 microversion: 2.1 time: 0.213222 Oct 12 22:44:58.372103 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3066/6774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:58 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:58.389251 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f2f60410-4c70-4418-a778-e46c4d041e5c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:58.397529 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f2f60410-4c70-4418-a778-e46c4d041e5c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1692 microversion: 2.1 time: 0.181727 Oct 12 22:44:58.398110 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3709/6775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:58 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1692 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:58.862746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-a32ad521-e246-434d-a15c-9c07f01739cf req-677d8d26-4dc2-40c6-a540-1e82b691eae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e25b7ae6-a2f7-4c88-8aad-6615ad22ff54", "tag": "9e5ca79e-faba-4740-975d-058cf7719f47"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:58.873414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a32ad521-e246-434d-a15c-9c07f01739cf req-677d8d26-4dc2-40c6-a540-1e82b691eae3 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:58.874003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a32ad521-e246-434d-a15c-9c07f01739cf req-677d8d26-4dc2-40c6-a540-1e82b691eae3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:58.874587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a32ad521-e246-434d-a15c-9c07f01739cf req-677d8d26-4dc2-40c6-a540-1e82b691eae3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:58.886157 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-a32ad521-e246-434d-a15c-9c07f01739cf req-677d8d26-4dc2-40c6-a540-1e82b691eae3 service nova] Creating event network-changed:9e5ca79e-faba-4740-975d-058cf7719f47 for instance e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 on n-h2-861111-1 Oct 12 22:44:58.891139 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-a32ad521-e246-434d-a15c-9c07f01739cf req-677d8d26-4dc2-40c6-a540-1e82b691eae3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032414 Oct 12 22:44:58.891737 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3067/6776] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:59.393585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f392324f-d39a-4f9b-97c1-7671e33f8907 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:59.394199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f392324f-d39a-4f9b-97c1-7671e33f8907 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:59.402163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f392324f-d39a-4f9b-97c1-7671e33f8907 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:59.402659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f392324f-d39a-4f9b-97c1-7671e33f8907 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:59.403097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f392324f-d39a-4f9b-97c1-7671e33f8907 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:59.403825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f392324f-d39a-4f9b-97c1-7671e33f8907 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:59.404434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f392324f-d39a-4f9b-97c1-7671e33f8907 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:59.404861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f392324f-d39a-4f9b-97c1-7671e33f8907 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:59.421041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3adae705-1925-4b52-af5f-e522b2b7b11e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:59.422083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3adae705-1925-4b52-af5f-e522b2b7b11e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:59.430575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3adae705-1925-4b52-af5f-e522b2b7b11e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:59.431174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3adae705-1925-4b52-af5f-e522b2b7b11e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:59.431823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3adae705-1925-4b52-af5f-e522b2b7b11e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:59.432605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3adae705-1925-4b52-af5f-e522b2b7b11e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:59.433144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3adae705-1925-4b52-af5f-e522b2b7b11e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:59.433721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3adae705-1925-4b52-af5f-e522b2b7b11e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:59.568125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f392324f-d39a-4f9b-97c1-7671e33f8907 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:59.578154 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f392324f-d39a-4f9b-97c1-7671e33f8907 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1315 microversion: 2.1 time: 0.188437 Oct 12 22:44:59.579034 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3710/6777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:59 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:59.598694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3adae705-1925-4b52-af5f-e522b2b7b11e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:59.607412 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3adae705-1925-4b52-af5f-e522b2b7b11e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1692 microversion: 2.1 time: 0.190502 Oct 12 22:44:59.608000 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3068/6778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:59 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1692 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:00.602872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2cb5e732-358f-49c7-89b6-6e58bc6dca66 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:00.603984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2cb5e732-358f-49c7-89b6-6e58bc6dca66 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:00.612274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb5e732-358f-49c7-89b6-6e58bc6dca66 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:00.612775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb5e732-358f-49c7-89b6-6e58bc6dca66 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:00.613221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb5e732-358f-49c7-89b6-6e58bc6dca66 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:00.614101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb5e732-358f-49c7-89b6-6e58bc6dca66 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:00.614695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb5e732-358f-49c7-89b6-6e58bc6dca66 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:00.615959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb5e732-358f-49c7-89b6-6e58bc6dca66 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:00.631708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-158c6679-368a-4e81-b365-551d9cb7e3c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:00.632634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-158c6679-368a-4e81-b365-551d9cb7e3c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:00.640084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-158c6679-368a-4e81-b365-551d9cb7e3c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:00.645328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-158c6679-368a-4e81-b365-551d9cb7e3c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:00.648276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-158c6679-368a-4e81-b365-551d9cb7e3c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:00.649128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-158c6679-368a-4e81-b365-551d9cb7e3c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:00.649697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-158c6679-368a-4e81-b365-551d9cb7e3c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:00.650733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-158c6679-368a-4e81-b365-551d9cb7e3c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:00.767541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2cb5e732-358f-49c7-89b6-6e58bc6dca66 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:00.778516 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2cb5e732-358f-49c7-89b6-6e58bc6dca66 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1315 microversion: 2.1 time: 0.180295 Oct 12 22:45:00.780017 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3711/6779] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:00 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:00.985371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-158c6679-368a-4e81-b365-551d9cb7e3c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:00.996451 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-158c6679-368a-4e81-b365-551d9cb7e3c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1692 microversion: 2.1 time: 0.369139 Oct 12 22:45:01.000819 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3069/6780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:00 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1692 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:01.804273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c6114eaa-004b-4b0b-931f-56177842cf72 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:01.804908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c6114eaa-004b-4b0b-931f-56177842cf72 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:01.814033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6114eaa-004b-4b0b-931f-56177842cf72 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:01.814537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6114eaa-004b-4b0b-931f-56177842cf72 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:01.814986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6114eaa-004b-4b0b-931f-56177842cf72 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:01.815722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6114eaa-004b-4b0b-931f-56177842cf72 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:01.816324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6114eaa-004b-4b0b-931f-56177842cf72 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:01.816913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6114eaa-004b-4b0b-931f-56177842cf72 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:02.010034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c6114eaa-004b-4b0b-931f-56177842cf72 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:02.020712 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c6114eaa-004b-4b0b-931f-56177842cf72 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1315 microversion: 2.1 time: 0.221001 Oct 12 22:45:02.021312 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3712/6781] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:01 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:02.023916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-58aa3abd-4b84-47bb-b64c-54b471d02f53 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:02.024571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-58aa3abd-4b84-47bb-b64c-54b471d02f53 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:02.032874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58aa3abd-4b84-47bb-b64c-54b471d02f53 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:02.033870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58aa3abd-4b84-47bb-b64c-54b471d02f53 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:02.035967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58aa3abd-4b84-47bb-b64c-54b471d02f53 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:02.036940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58aa3abd-4b84-47bb-b64c-54b471d02f53 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:02.037527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58aa3abd-4b84-47bb-b64c-54b471d02f53 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:02.037979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58aa3abd-4b84-47bb-b64c-54b471d02f53 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:02.257403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-58aa3abd-4b84-47bb-b64c-54b471d02f53 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:02.266855 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-58aa3abd-4b84-47bb-b64c-54b471d02f53 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1692 microversion: 2.1 time: 0.247993 Oct 12 22:45:02.267460 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3070/6782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:02 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1692 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:03.044650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe799f88-6025-4831-ae03-9744a0219b26 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:03.045372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fe799f88-6025-4831-ae03-9744a0219b26 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:03.052353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe799f88-6025-4831-ae03-9744a0219b26 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:03.052954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe799f88-6025-4831-ae03-9744a0219b26 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:03.053452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe799f88-6025-4831-ae03-9744a0219b26 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:03.054350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe799f88-6025-4831-ae03-9744a0219b26 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:03.054881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe799f88-6025-4831-ae03-9744a0219b26 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:03.055492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe799f88-6025-4831-ae03-9744a0219b26 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:03.205829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fe799f88-6025-4831-ae03-9744a0219b26 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:03.214635 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fe799f88-6025-4831-ae03-9744a0219b26 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1315 microversion: 2.1 time: 0.173777 Oct 12 22:45:03.215440 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3713/6783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:03 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:03.293341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f5633192-4a28-43e5-9caf-a694fe61201d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:03.294103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f5633192-4a28-43e5-9caf-a694fe61201d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:03.302682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5633192-4a28-43e5-9caf-a694fe61201d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:03.303895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5633192-4a28-43e5-9caf-a694fe61201d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:03.304576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5633192-4a28-43e5-9caf-a694fe61201d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:03.305301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5633192-4a28-43e5-9caf-a694fe61201d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:03.305843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5633192-4a28-43e5-9caf-a694fe61201d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:03.306293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5633192-4a28-43e5-9caf-a694fe61201d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:03.444300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f5633192-4a28-43e5-9caf-a694fe61201d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:03.452913 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f5633192-4a28-43e5-9caf-a694fe61201d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1682 microversion: 2.1 time: 0.164060 Oct 12 22:45:03.453514 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3071/6784] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:03 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:03.476950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b1aad3c0-2bf6-4910-8bdb-42180b3ec49a tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:03.477798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b1aad3c0-2bf6-4910-8bdb-42180b3ec49a tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:03.484894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1aad3c0-2bf6-4910-8bdb-42180b3ec49a tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:03.485533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1aad3c0-2bf6-4910-8bdb-42180b3ec49a tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:03.486212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1aad3c0-2bf6-4910-8bdb-42180b3ec49a tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:03.487029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1aad3c0-2bf6-4910-8bdb-42180b3ec49a tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:03.487646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1aad3c0-2bf6-4910-8bdb-42180b3ec49a tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:03.488182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b1aad3c0-2bf6-4910-8bdb-42180b3ec49a tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:03.658471 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b1aad3c0-2bf6-4910-8bdb-42180b3ec49a tempest-TestNetworkAdvancedServerOps-1760244367 tempest-TestNetworkAdvancedServerOps-1760244367-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1833 microversion: 2.1 time: 0.186433 Oct 12 22:45:03.659069 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3714/6785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:03 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1833 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:03.682431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f4446aa1-87e0-4fdd-b730-1e5c0345a7a4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:03.683055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f4446aa1-87e0-4fdd-b730-1e5c0345a7a4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:03.689312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4446aa1-87e0-4fdd-b730-1e5c0345a7a4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:03.689822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4446aa1-87e0-4fdd-b730-1e5c0345a7a4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:03.690280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4446aa1-87e0-4fdd-b730-1e5c0345a7a4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:03.690997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4446aa1-87e0-4fdd-b730-1e5c0345a7a4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:03.691499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4446aa1-87e0-4fdd-b730-1e5c0345a7a4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:03.691999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4446aa1-87e0-4fdd-b730-1e5c0345a7a4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:03.846015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f4446aa1-87e0-4fdd-b730-1e5c0345a7a4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:03.854442 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f4446aa1-87e0-4fdd-b730-1e5c0345a7a4 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1682 microversion: 2.1 time: 0.175824 Oct 12 22:45:03.854952 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3072/6786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:03 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:03.948904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3f07c465-0e12-4c3a-ad73-cf814c3d10d3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:03.951404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3f07c465-0e12-4c3a-ad73-cf814c3d10d3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:03.957613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f07c465-0e12-4c3a-ad73-cf814c3d10d3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:03.958103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f07c465-0e12-4c3a-ad73-cf814c3d10d3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:03.958548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f07c465-0e12-4c3a-ad73-cf814c3d10d3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:03.959340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f07c465-0e12-4c3a-ad73-cf814c3d10d3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:03.960339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f07c465-0e12-4c3a-ad73-cf814c3d10d3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:03.960774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f07c465-0e12-4c3a-ad73-cf814c3d10d3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:04.015651 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3f07c465-0e12-4c3a-ad73-cf814c3d10d3 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744/action" status: 200 len: 38645 microversion: 2.1 time: 0.070320 Oct 12 22:45:04.016810 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3715/6787] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:45:03 2022] POST /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744/action => generated 38645 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:45:04.239852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cf999298-f472-4011-821f-d2eb1c1a3f00 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:04.241360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cf999298-f472-4011-821f-d2eb1c1a3f00 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:04.248110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf999298-f472-4011-821f-d2eb1c1a3f00 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:04.248610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf999298-f472-4011-821f-d2eb1c1a3f00 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:04.249228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf999298-f472-4011-821f-d2eb1c1a3f00 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:04.249942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf999298-f472-4011-821f-d2eb1c1a3f00 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:04.250556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf999298-f472-4011-821f-d2eb1c1a3f00 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:04.251011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cf999298-f472-4011-821f-d2eb1c1a3f00 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:04.390048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cf999298-f472-4011-821f-d2eb1c1a3f00 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:04.399359 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cf999298-f472-4011-821f-d2eb1c1a3f00 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1315 microversion: 2.1 time: 0.163451 Oct 12 22:45:04.400177 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3073/6788] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:04 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:04.957024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-6c0b43b6-437c-44b8-b42f-a4c2ffcb0ad6 req-fca60ec3-205a-469b-a51d-80ada5997663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e25b7ae6-a2f7-4c88-8aad-6615ad22ff54", "name": "network-vif-plugged", "status": "completed", "tag": "9e5ca79e-faba-4740-975d-058cf7719f47"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:04.972085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:04.974070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:04.979553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6c0b43b6-437c-44b8-b42f-a4c2ffcb0ad6 req-fca60ec3-205a-469b-a51d-80ada5997663 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:04.980841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6c0b43b6-437c-44b8-b42f-a4c2ffcb0ad6 req-fca60ec3-205a-469b-a51d-80ada5997663 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:04.981788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6c0b43b6-437c-44b8-b42f-a4c2ffcb0ad6 req-fca60ec3-205a-469b-a51d-80ada5997663 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:05.003490 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6c0b43b6-437c-44b8-b42f-a4c2ffcb0ad6 req-fca60ec3-205a-469b-a51d-80ada5997663 service nova] Creating event network-vif-plugged:9e5ca79e-faba-4740-975d-058cf7719f47 for instance e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 on n-h2-861111-1 Oct 12 22:45:05.009119 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-6c0b43b6-437c-44b8-b42f-a4c2ffcb0ad6 req-fca60ec3-205a-469b-a51d-80ada5997663 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056358 Oct 12 22:45:05.010987 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3716/6789] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:05.292945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:05.297444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7855227f-6b87-4481-8047-d90abbebc05a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:05.297948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7855227f-6b87-4481-8047-d90abbebc05a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:05.319621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7855227f-6b87-4481-8047-d90abbebc05a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:05.320128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7855227f-6b87-4481-8047-d90abbebc05a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:05.320580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7855227f-6b87-4481-8047-d90abbebc05a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:05.321308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7855227f-6b87-4481-8047-d90abbebc05a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:05.323709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7855227f-6b87-4481-8047-d90abbebc05a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:05.324327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7855227f-6b87-4481-8047-d90abbebc05a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:05.359414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7855227f-6b87-4481-8047-d90abbebc05a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:45:05.388702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f4b8180a-767e-49d2-ae74-68e103619635 req-aab8714b-6953-491c-8745-b0a26ae3696d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc12d46-f730-4955-9942-73f64e4ff744", "tag": "089c1c1c-c07a-44b7-9a56-e6bc3b8ef56c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:05.403753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f4b8180a-767e-49d2-ae74-68e103619635 req-aab8714b-6953-491c-8745-b0a26ae3696d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:05.404233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f4b8180a-767e-49d2-ae74-68e103619635 req-aab8714b-6953-491c-8745-b0a26ae3696d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:05.404667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f4b8180a-767e-49d2-ae74-68e103619635 req-aab8714b-6953-491c-8745-b0a26ae3696d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:05.425794 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f4b8180a-767e-49d2-ae74-68e103619635 req-aab8714b-6953-491c-8745-b0a26ae3696d service nova] Creating event network-changed:089c1c1c-c07a-44b7-9a56-e6bc3b8ef56c for instance bbc12d46-f730-4955-9942-73f64e4ff744 on n-h1-861111-1 Oct 12 22:45:05.432169 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f4b8180a-767e-49d2-ae74-68e103619635 req-aab8714b-6953-491c-8745-b0a26ae3696d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126734 Oct 12 22:45:05.433278 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3717/6790] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:05.439278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3e7de734-c1d6-445b-aeab-ac10040699c1 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:05.440125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3e7de734-c1d6-445b-aeab-ac10040699c1 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:05.449784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e7de734-c1d6-445b-aeab-ac10040699c1 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:05.451149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e7de734-c1d6-445b-aeab-ac10040699c1 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:05.452034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e7de734-c1d6-445b-aeab-ac10040699c1 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:05.452908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e7de734-c1d6-445b-aeab-ac10040699c1 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:05.453669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e7de734-c1d6-445b-aeab-ac10040699c1 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:05.454239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3e7de734-c1d6-445b-aeab-ac10040699c1 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:05.506018 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7855227f-6b87-4481-8047-d90abbebc05a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 204 len: 0 microversion: 2.1 time: 0.213560 Oct 12 22:45:05.507597 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3074/6791] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:45:05 2022] DELETE /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:45:05.519266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a91c056d-4308-4581-873d-e5de6eb9ae66 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:05.520404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a91c056d-4308-4581-873d-e5de6eb9ae66 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:05.527774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a91c056d-4308-4581-873d-e5de6eb9ae66 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:05.528430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a91c056d-4308-4581-873d-e5de6eb9ae66 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:05.529255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a91c056d-4308-4581-873d-e5de6eb9ae66 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:05.530326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a91c056d-4308-4581-873d-e5de6eb9ae66 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:05.530963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a91c056d-4308-4581-873d-e5de6eb9ae66 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:05.532247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a91c056d-4308-4581-873d-e5de6eb9ae66 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:05.619799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3e7de734-c1d6-445b-aeab-ac10040699c1 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:05.631906 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3e7de734-c1d6-445b-aeab-ac10040699c1 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1315 microversion: 2.1 time: 0.195251 Oct 12 22:45:05.632671 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3718/6792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:05 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:05.729557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a91c056d-4308-4581-873d-e5de6eb9ae66 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:05.742506 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a91c056d-4308-4581-873d-e5de6eb9ae66 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1688 microversion: 2.1 time: 0.227671 Oct 12 22:45:05.743711 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3075/6793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:05 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1688 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:06.659669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-74ca4e21-fbc8-4166-9947-5faf8d127135 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:06.660310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-74ca4e21-fbc8-4166-9947-5faf8d127135 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:06.669295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74ca4e21-fbc8-4166-9947-5faf8d127135 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:06.669792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74ca4e21-fbc8-4166-9947-5faf8d127135 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:06.670235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74ca4e21-fbc8-4166-9947-5faf8d127135 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:06.670969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74ca4e21-fbc8-4166-9947-5faf8d127135 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:06.671460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74ca4e21-fbc8-4166-9947-5faf8d127135 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:06.672096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74ca4e21-fbc8-4166-9947-5faf8d127135 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:06.721030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-3229fa03-fcd9-406e-86b7-76dcac618675 req-033dfee2-34ac-4111-927d-786055ad374d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc12d46-f730-4955-9942-73f64e4ff744", "name": "network-vif-deleted", "tag": "089c1c1c-c07a-44b7-9a56-e6bc3b8ef56c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:06.737585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3229fa03-fcd9-406e-86b7-76dcac618675 req-033dfee2-34ac-4111-927d-786055ad374d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:06.738184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3229fa03-fcd9-406e-86b7-76dcac618675 req-033dfee2-34ac-4111-927d-786055ad374d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:06.738637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3229fa03-fcd9-406e-86b7-76dcac618675 req-033dfee2-34ac-4111-927d-786055ad374d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:06.758727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:06.779371 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-3229fa03-fcd9-406e-86b7-76dcac618675 req-033dfee2-34ac-4111-927d-786055ad374d service nova] Creating event network-vif-deleted:089c1c1c-c07a-44b7-9a56-e6bc3b8ef56c for instance bbc12d46-f730-4955-9942-73f64e4ff744 on n-h1-861111-1 Oct 12 22:45:06.785038 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-3229fa03-fcd9-406e-86b7-76dcac618675 req-033dfee2-34ac-4111-927d-786055ad374d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068828 Oct 12 22:45:06.786146 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3076/6794] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:06.793605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d5628ce7-283a-4fca-980d-3d4bd1ec31e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:06.794829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d5628ce7-283a-4fca-980d-3d4bd1ec31e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:06.804422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5628ce7-283a-4fca-980d-3d4bd1ec31e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:06.805303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5628ce7-283a-4fca-980d-3d4bd1ec31e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:06.806616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5628ce7-283a-4fca-980d-3d4bd1ec31e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:06.807546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5628ce7-283a-4fca-980d-3d4bd1ec31e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:06.808149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5628ce7-283a-4fca-980d-3d4bd1ec31e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:06.809526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5628ce7-283a-4fca-980d-3d4bd1ec31e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:06.902376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d5628ce7-283a-4fca-980d-3d4bd1ec31e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:06.912051 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d5628ce7-283a-4fca-980d-3d4bd1ec31e8 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 200 len: 1351 microversion: 2.1 time: 0.124536 Oct 12 22:45:06.913024 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3077/6795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:06 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 1351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:06.936175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-74ca4e21-fbc8-4166-9947-5faf8d127135 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:06.944964 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-74ca4e21-fbc8-4166-9947-5faf8d127135 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1501 microversion: 2.1 time: 0.293376 Oct 12 22:45:06.947315 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3719/6796] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:06 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1501 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:06.969783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-16e945e1-6435-4a48-b8b5-e67cb7ccc753 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:06.970636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-16e945e1-6435-4a48-b8b5-e67cb7ccc753 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:06.977002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16e945e1-6435-4a48-b8b5-e67cb7ccc753 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:06.977515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16e945e1-6435-4a48-b8b5-e67cb7ccc753 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:06.977982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16e945e1-6435-4a48-b8b5-e67cb7ccc753 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:06.979764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16e945e1-6435-4a48-b8b5-e67cb7ccc753 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:06.980452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16e945e1-6435-4a48-b8b5-e67cb7ccc753 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:06.981236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16e945e1-6435-4a48-b8b5-e67cb7ccc753 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:07.214065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-16e945e1-6435-4a48-b8b5-e67cb7ccc753 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:07.227421 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-16e945e1-6435-4a48-b8b5-e67cb7ccc753 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1501 microversion: 2.1 time: 0.262797 Oct 12 22:45:07.228014 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3078/6797] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:06 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1501 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:07.252348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bfbacd9d-3630-4242-8168-4eb4946f824b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:07.252886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bfbacd9d-3630-4242-8168-4eb4946f824b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:07.260363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfbacd9d-3630-4242-8168-4eb4946f824b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:07.260852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfbacd9d-3630-4242-8168-4eb4946f824b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:07.261288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfbacd9d-3630-4242-8168-4eb4946f824b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:07.261993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfbacd9d-3630-4242-8168-4eb4946f824b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:07.262440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfbacd9d-3630-4242-8168-4eb4946f824b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:07.263084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfbacd9d-3630-4242-8168-4eb4946f824b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:07.267811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:07.290725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-bfbacd9d-3630-4242-8168-4eb4946f824b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lazy-loading 'flavor' on Instance uuid e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:45:07.357864 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bfbacd9d-3630-4242-8168-4eb4946f824b tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "POST /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54/action" status: 202 len: 0 microversion: 2.1 time: 0.110002 Oct 12 22:45:07.358835 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3720/6798] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:45:07 2022] POST /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:45:07.368323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5e442680-5170-4803-bd29-034d5003fbd6 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:07.368927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5e442680-5170-4803-bd29-034d5003fbd6 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:07.375612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e442680-5170-4803-bd29-034d5003fbd6 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:07.376185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e442680-5170-4803-bd29-034d5003fbd6 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:07.376840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e442680-5170-4803-bd29-034d5003fbd6 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:07.377649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e442680-5170-4803-bd29-034d5003fbd6 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:07.378293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e442680-5170-4803-bd29-034d5003fbd6 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:07.378808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e442680-5170-4803-bd29-034d5003fbd6 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:07.514118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5e442680-5170-4803-bd29-034d5003fbd6 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:07.521914 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5e442680-5170-4803-bd29-034d5003fbd6 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1509 microversion: 2.1 time: 0.158505 Oct 12 22:45:07.522481 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3079/6799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:07 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:45:07.936188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cc4ba2d0-f626-49a7-898b-5aba47fc77df tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:07.936906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cc4ba2d0-f626-49a7-898b-5aba47fc77df tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: bbc12d46-f730-4955-9942-73f64e4ff744] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:07.943676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc4ba2d0-f626-49a7-898b-5aba47fc77df tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:07.944173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc4ba2d0-f626-49a7-898b-5aba47fc77df tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:07.944621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc4ba2d0-f626-49a7-898b-5aba47fc77df tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:07.945342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc4ba2d0-f626-49a7-898b-5aba47fc77df tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:07.945785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc4ba2d0-f626-49a7-898b-5aba47fc77df tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:07.946224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc4ba2d0-f626-49a7-898b-5aba47fc77df tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:07.962043 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-cc4ba2d0-f626-49a7-898b-5aba47fc77df tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] HTTP exception thrown: Instance bbc12d46-f730-4955-9942-73f64e4ff744 could not be found. Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cc4ba2d0-f626-49a7-898b-5aba47fc77df tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Request method failure captured: Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 HTTP/1.1 Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0GT7kMjoeYhQ1Th4q7G_rjSfBz-SOd6Bk2_ScJ5gdprLwVptEtdNViG1pBtatnIyIuIXK-pDsF5xb7TwO3bZt7IWwrbvVcGcwuSVCzGTfwLlYAWKRg5O0DaNHlhbZQtTS0lSPT92gMQCb3wkKvhYt9T6IUbiTCIN3iqt07wMQT2obc Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: aa5cc899bfb3403c9aa9d192833cafa9 Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1768289362 Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aa5cc899bfb3403c9aa9d192833cafa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aa5cc899bfb3403c9aa9d192833cafa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aa5cc899bfb3403c9aa9d192833cafa9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aa5cc899bfb3403c9aa9d192833cafa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1768289362 Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: aa5cc899bfb3403c9aa9d192833cafa9 Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1768289362 Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestNetworkAdvancedServerOps-1768289362-project Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 2acd162da21348b6acb725bfe572bc00 Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1768289362-project Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance bbc12d46-f730-4955-9942-73f64e4ff744 could not be found. Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'bbc12d46-f730-4955-9942-73f64e4ff744'} Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc12d46-f730-4955-9942-73f64e4ff744 could not be found. Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc12d46-f730-4955-9942-73f64e4ff744 could not be found. Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:45:07.963888 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:07.970433 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:45:07.970433 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:07.970433 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:07.970433 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:07.970433 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:45:07.970433 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:45:07.970433 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc12d46-f730-4955-9942-73f64e4ff744 could not be found. Oct 12 22:45:07.970433 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:45:07.970433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cc4ba2d0-f626-49a7-898b-5aba47fc77df tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Returning 404 to user: Instance bbc12d46-f730-4955-9942-73f64e4ff744 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:45:07.970433 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cc4ba2d0-f626-49a7-898b-5aba47fc77df tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744" status: 404 len: 111 microversion: 2.1 time: 0.033497 Oct 12 22:45:07.970433 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3721/6800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:07 2022] GET /compute/v2.1/servers/bbc12d46-f730-4955-9942-73f64e4ff744 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:45:08.544956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aa5202f8-dfc9-42c8-bf73-936aca4f51e0 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:08.545875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-aa5202f8-dfc9-42c8-bf73-936aca4f51e0 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:08.553144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa5202f8-dfc9-42c8-bf73-936aca4f51e0 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:08.554350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa5202f8-dfc9-42c8-bf73-936aca4f51e0 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:08.554895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa5202f8-dfc9-42c8-bf73-936aca4f51e0 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:08.555772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa5202f8-dfc9-42c8-bf73-936aca4f51e0 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:08.556312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa5202f8-dfc9-42c8-bf73-936aca4f51e0 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:08.556832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa5202f8-dfc9-42c8-bf73-936aca4f51e0 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:08.700127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-aa5202f8-dfc9-42c8-bf73-936aca4f51e0 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:08.709539 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-aa5202f8-dfc9-42c8-bf73-936aca4f51e0 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1492 microversion: 2.1 time: 0.168886 Oct 12 22:45:08.710318 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3080/6801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:08 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1492 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:08.732816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e9c11bcb-a4f6-493f-b689-02de1854a1c8 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:08.733404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e9c11bcb-a4f6-493f-b689-02de1854a1c8 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:08.740350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9c11bcb-a4f6-493f-b689-02de1854a1c8 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:08.741399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9c11bcb-a4f6-493f-b689-02de1854a1c8 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:08.741845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9c11bcb-a4f6-493f-b689-02de1854a1c8 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:08.742551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9c11bcb-a4f6-493f-b689-02de1854a1c8 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:08.743010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9c11bcb-a4f6-493f-b689-02de1854a1c8 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:08.743473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9c11bcb-a4f6-493f-b689-02de1854a1c8 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:08.841444 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e9c11bcb-a4f6-493f-b689-02de1854a1c8 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "POST /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54/action" status: 202 len: 0 microversion: 2.1 time: 0.112484 Oct 12 22:45:08.843492 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3722/6802] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:45:08 2022] POST /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:45:08.851752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f63d829b-f262-436d-8aa4-9b6a43200b7a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:08.852690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f63d829b-f262-436d-8aa4-9b6a43200b7a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:08.859849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f63d829b-f262-436d-8aa4-9b6a43200b7a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:08.860927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f63d829b-f262-436d-8aa4-9b6a43200b7a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:08.861577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f63d829b-f262-436d-8aa4-9b6a43200b7a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:08.862391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f63d829b-f262-436d-8aa4-9b6a43200b7a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:08.862949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f63d829b-f262-436d-8aa4-9b6a43200b7a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:08.863501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f63d829b-f262-436d-8aa4-9b6a43200b7a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:09.163376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f63d829b-f262-436d-8aa4-9b6a43200b7a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:09.175559 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f63d829b-f262-436d-8aa4-9b6a43200b7a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1498 microversion: 2.1 time: 0.328140 Oct 12 22:45:09.182422 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3081/6803] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:08 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1498 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:10.210628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cc5aec80-c59d-42bd-b71a-cbb84aaf5ccd tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:10.217367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cc5aec80-c59d-42bd-b71a-cbb84aaf5ccd tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:10.232934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc5aec80-c59d-42bd-b71a-cbb84aaf5ccd tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:10.235947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc5aec80-c59d-42bd-b71a-cbb84aaf5ccd tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:10.236621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc5aec80-c59d-42bd-b71a-cbb84aaf5ccd tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:10.237570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc5aec80-c59d-42bd-b71a-cbb84aaf5ccd tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:10.238674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc5aec80-c59d-42bd-b71a-cbb84aaf5ccd tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:10.240021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc5aec80-c59d-42bd-b71a-cbb84aaf5ccd tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:10.456104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cc5aec80-c59d-42bd-b71a-cbb84aaf5ccd tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:10.468917 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cc5aec80-c59d-42bd-b71a-cbb84aaf5ccd tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1498 microversion: 2.1 time: 0.263248 Oct 12 22:45:10.469832 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3723/6804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:10 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1498 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:11.496374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b57f1db-8432-4e67-a7b6-f9a75ef1f05a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:11.498872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6b57f1db-8432-4e67-a7b6-f9a75ef1f05a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:11.507837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b57f1db-8432-4e67-a7b6-f9a75ef1f05a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:11.508663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b57f1db-8432-4e67-a7b6-f9a75ef1f05a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:11.509267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b57f1db-8432-4e67-a7b6-f9a75ef1f05a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:11.510210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b57f1db-8432-4e67-a7b6-f9a75ef1f05a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:11.511479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b57f1db-8432-4e67-a7b6-f9a75ef1f05a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:11.512180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b57f1db-8432-4e67-a7b6-f9a75ef1f05a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:11.718746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6b57f1db-8432-4e67-a7b6-f9a75ef1f05a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:11.719168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a1074fff-52d0-4889-a3ad-4425272b4ac0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '.version_select at 0x7f51235391f0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:11.728931 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6b57f1db-8432-4e67-a7b6-f9a75ef1f05a tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1501 microversion: 2.1 time: 0.236565 Oct 12 22:45:11.732352 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3082/6805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:11 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1501 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:11.754075 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a1074fff-52d0-4889-a3ad-4425272b4ac0 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-568091937" status: 202 len: 0 microversion: 2.1 time: 0.040793 Oct 12 22:45:11.755215 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3724/6806] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Oct 12 22:45:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-568091937 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:45:11.759496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bdc06f77-f128-4a0f-8e44-7a12e3b769b2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:11.760390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bdc06f77-f128-4a0f-8e44-7a12e3b769b2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:11.772633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdc06f77-f128-4a0f-8e44-7a12e3b769b2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:11.773348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdc06f77-f128-4a0f-8e44-7a12e3b769b2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:11.774342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdc06f77-f128-4a0f-8e44-7a12e3b769b2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:11.775198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdc06f77-f128-4a0f-8e44-7a12e3b769b2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:11.780929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdc06f77-f128-4a0f-8e44-7a12e3b769b2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:11.780929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdc06f77-f128-4a0f-8e44-7a12e3b769b2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:11.791070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b1b090b3-616e-4fe7-b64c-57103254d028 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'create', calling method: .version_select at 0x7f51283555e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1881954767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/JiBC1SFM8LO7qXG8pVL9GOmGjiyslxzvojf50Hj4W+sYp7sfMoTYZFVML9KdpBgp3MflSkUsZTTah77/DsKoU3ckBB32onrGkwKnbnaFKLCjU0mCMhIVchjdPz0Wr+A=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:11.819634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-bdc06f77-f128-4a0f-8e44-7a12e3b769b2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lazy-loading 'flavor' on Instance uuid e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:45:11.820751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-b1b090b3-616e-4fe7-b64c-57103254d028 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Getting quotas for project aa5cc899bfb3403c9aa9d192833cafa9. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:45:11.827425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-b1b090b3-616e-4fe7-b64c-57103254d028 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Getting quotas for user 2acd162da21348b6acb725bfe572bc00 and project aa5cc899bfb3403c9aa9d192833cafa9. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:45:11.856269 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b1b090b3-616e-4fe7-b64c-57103254d028 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.072920 Oct 12 22:45:11.858390 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3725/6807] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:45:11 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:11.902861 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bdc06f77-f128-4a0f-8e44-7a12e3b769b2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "POST /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54/action" status: 202 len: 0 microversion: 2.1 time: 0.153885 Oct 12 22:45:11.903686 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3083/6808] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:45:11 2022] POST /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:45:11.912423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ddc40b8a-40be-4624-ae2d-d237ec6c17af tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:11.913472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ddc40b8a-40be-4624-ae2d-d237ec6c17af tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:11.919919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddc40b8a-40be-4624-ae2d-d237ec6c17af tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:11.920448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddc40b8a-40be-4624-ae2d-d237ec6c17af tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:11.920933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddc40b8a-40be-4624-ae2d-d237ec6c17af tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:11.921853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddc40b8a-40be-4624-ae2d-d237ec6c17af tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:11.922317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddc40b8a-40be-4624-ae2d-d237ec6c17af tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:11.922764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddc40b8a-40be-4624-ae2d-d237ec6c17af tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:12.083985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ddc40b8a-40be-4624-ae2d-d237ec6c17af tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:12.102362 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ddc40b8a-40be-4624-ae2d-d237ec6c17af tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1509 microversion: 2.1 time: 0.194083 Oct 12 22:45:12.103610 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3726/6809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:11 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:13.128247 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-38416c38-4c12-44d9-b3eb-e5a2ed1e65a2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:13.129290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-38416c38-4c12-44d9-b3eb-e5a2ed1e65a2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:13.135955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38416c38-4c12-44d9-b3eb-e5a2ed1e65a2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:13.136575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38416c38-4c12-44d9-b3eb-e5a2ed1e65a2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:13.137133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38416c38-4c12-44d9-b3eb-e5a2ed1e65a2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:13.137986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38416c38-4c12-44d9-b3eb-e5a2ed1e65a2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:13.138559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38416c38-4c12-44d9-b3eb-e5a2ed1e65a2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:13.139166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38416c38-4c12-44d9-b3eb-e5a2ed1e65a2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:13.317644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-38416c38-4c12-44d9-b3eb-e5a2ed1e65a2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:13.326123 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-38416c38-4c12-44d9-b3eb-e5a2ed1e65a2 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1492 microversion: 2.1 time: 0.203322 Oct 12 22:45:13.339440 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3084/6810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:13 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1492 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:13.353164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0d25e4f9-a524-4662-b062-9773c87e7c27 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:13.353732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0d25e4f9-a524-4662-b062-9773c87e7c27 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:13.360906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d25e4f9-a524-4662-b062-9773c87e7c27 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:13.361402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d25e4f9-a524-4662-b062-9773c87e7c27 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:13.362217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d25e4f9-a524-4662-b062-9773c87e7c27 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:13.363393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d25e4f9-a524-4662-b062-9773c87e7c27 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:13.363776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d25e4f9-a524-4662-b062-9773c87e7c27 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:13.364373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0d25e4f9-a524-4662-b062-9773c87e7c27 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:13.458483 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0d25e4f9-a524-4662-b062-9773c87e7c27 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "POST /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54/action" status: 202 len: 0 microversion: 2.1 time: 0.111336 Oct 12 22:45:13.460341 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3727/6811] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:45:13 2022] POST /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:45:13.469510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-140805c2-5c45-432e-94be-4d5df52b8726 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:13.470540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-140805c2-5c45-432e-94be-4d5df52b8726 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:13.480478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-140805c2-5c45-432e-94be-4d5df52b8726 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:13.481160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-140805c2-5c45-432e-94be-4d5df52b8726 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:13.481939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-140805c2-5c45-432e-94be-4d5df52b8726 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:13.483081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-140805c2-5c45-432e-94be-4d5df52b8726 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:13.483669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-140805c2-5c45-432e-94be-4d5df52b8726 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:13.484227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-140805c2-5c45-432e-94be-4d5df52b8726 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:13.750886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-140805c2-5c45-432e-94be-4d5df52b8726 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:13.763431 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-140805c2-5c45-432e-94be-4d5df52b8726 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1498 microversion: 2.1 time: 0.298697 Oct 12 22:45:13.764045 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3085/6812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:13 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1498 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:45:14.789355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-220dbaea-98da-4dd3-b403-fcda0f1315bb tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:14.790796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-220dbaea-98da-4dd3-b403-fcda0f1315bb tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:14.808082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-220dbaea-98da-4dd3-b403-fcda0f1315bb tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:14.808594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-220dbaea-98da-4dd3-b403-fcda0f1315bb tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:14.809107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-220dbaea-98da-4dd3-b403-fcda0f1315bb tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:14.810140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-220dbaea-98da-4dd3-b403-fcda0f1315bb tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:14.811188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-220dbaea-98da-4dd3-b403-fcda0f1315bb tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:14.811835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-220dbaea-98da-4dd3-b403-fcda0f1315bb tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:14.999784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-220dbaea-98da-4dd3-b403-fcda0f1315bb tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:15.020277 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-220dbaea-98da-4dd3-b403-fcda0f1315bb tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1498 microversion: 2.1 time: 0.236730 Oct 12 22:45:15.021211 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3728/6813] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:14 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1498 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:16.045157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-75ced597-8c2f-4e08-8343-b8f48d2bcbe9 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:16.046030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-75ced597-8c2f-4e08-8343-b8f48d2bcbe9 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:16.059829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75ced597-8c2f-4e08-8343-b8f48d2bcbe9 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:16.060666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75ced597-8c2f-4e08-8343-b8f48d2bcbe9 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:16.061433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75ced597-8c2f-4e08-8343-b8f48d2bcbe9 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:16.062376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75ced597-8c2f-4e08-8343-b8f48d2bcbe9 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:16.064605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75ced597-8c2f-4e08-8343-b8f48d2bcbe9 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:16.065294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75ced597-8c2f-4e08-8343-b8f48d2bcbe9 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:16.320376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-75ced597-8c2f-4e08-8343-b8f48d2bcbe9 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:16.345257 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-75ced597-8c2f-4e08-8343-b8f48d2bcbe9 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1501 microversion: 2.1 time: 0.304416 Oct 12 22:45:16.346789 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3086/6814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:16 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1501 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:16.368722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eb93fa71-777f-45bb-90fd-cb3516344461 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:16.371054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eb93fa71-777f-45bb-90fd-cb3516344461 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:16.384997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb93fa71-777f-45bb-90fd-cb3516344461 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:16.385914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb93fa71-777f-45bb-90fd-cb3516344461 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:16.386515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb93fa71-777f-45bb-90fd-cb3516344461 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:16.394261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb93fa71-777f-45bb-90fd-cb3516344461 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:16.394759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb93fa71-777f-45bb-90fd-cb3516344461 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:16.395209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eb93fa71-777f-45bb-90fd-cb3516344461 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:16.469883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eb93fa71-777f-45bb-90fd-cb3516344461 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:45:16.602697 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eb93fa71-777f-45bb-90fd-cb3516344461 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 204 len: 0 microversion: 2.1 time: 0.237770 Oct 12 22:45:16.607352 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3729/6815] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:45:16 2022] DELETE /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:45:16.614069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a4d187a-d6b8-4393-a87e-357a2cf12a8e tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:16.614938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7a4d187a-d6b8-4393-a87e-357a2cf12a8e tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:16.669186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a4d187a-d6b8-4393-a87e-357a2cf12a8e tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:16.669847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a4d187a-d6b8-4393-a87e-357a2cf12a8e tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:16.670428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a4d187a-d6b8-4393-a87e-357a2cf12a8e tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:16.671338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a4d187a-d6b8-4393-a87e-357a2cf12a8e tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:16.671908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a4d187a-d6b8-4393-a87e-357a2cf12a8e tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:16.672460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a4d187a-d6b8-4393-a87e-357a2cf12a8e tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:16.958280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a4d187a-d6b8-4393-a87e-357a2cf12a8e tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:16.975067 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7a4d187a-d6b8-4393-a87e-357a2cf12a8e tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1507 microversion: 2.1 time: 0.364576 Oct 12 22:45:16.981485 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3087/6816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:16 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1507 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:45:18.005873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e421bb0b-f1b8-4d76-bcfd-23241ae1a187 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:18.008348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e421bb0b-f1b8-4d76-bcfd-23241ae1a187 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:18.029382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e421bb0b-f1b8-4d76-bcfd-23241ae1a187 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:18.030152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e421bb0b-f1b8-4d76-bcfd-23241ae1a187 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:18.030833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e421bb0b-f1b8-4d76-bcfd-23241ae1a187 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:18.032343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e421bb0b-f1b8-4d76-bcfd-23241ae1a187 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:18.033829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e421bb0b-f1b8-4d76-bcfd-23241ae1a187 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:18.034600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e421bb0b-f1b8-4d76-bcfd-23241ae1a187 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:18.732633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e421bb0b-f1b8-4d76-bcfd-23241ae1a187 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:18.746524 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e421bb0b-f1b8-4d76-bcfd-23241ae1a187 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1507 microversion: 2.1 time: 0.740247 Oct 12 22:45:18.748006 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3730/6817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:17 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1507 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:18.933421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-61808822", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "3f6d105a-07f0-4f18-a14d-57524099a2f8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1881954767", "security_groups": [{"name": "tempest-secgroup-smoke-534342170"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:19.246484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] validate_networks() for [('3f6d105a-07f0-4f18-a14d-57524099a2f8', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:45:19.425402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-9c115c68-4b26-46a1-9c71-9b4d168b9dc1 req-93d72e4a-bb6a-4996-abba-e4bda9a42c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e25b7ae6-a2f7-4c88-8aad-6615ad22ff54", "name": "network-vif-deleted", "tag": "9e5ca79e-faba-4740-975d-058cf7719f47"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:19.456750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9c115c68-4b26-46a1-9c71-9b4d168b9dc1 req-93d72e4a-bb6a-4996-abba-e4bda9a42c04 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:19.457510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9c115c68-4b26-46a1-9c71-9b4d168b9dc1 req-93d72e4a-bb6a-4996-abba-e4bda9a42c04 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:19.457962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9c115c68-4b26-46a1-9c71-9b4d168b9dc1 req-93d72e4a-bb6a-4996-abba-e4bda9a42c04 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:19.493875 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-9c115c68-4b26-46a1-9c71-9b4d168b9dc1 req-93d72e4a-bb6a-4996-abba-e4bda9a42c04 service nova] Creating event network-vif-deleted:9e5ca79e-faba-4740-975d-058cf7719f47 for instance e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 on n-h2-861111-1 Oct 12 22:45:19.499570 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-9c115c68-4b26-46a1-9c71-9b4d168b9dc1 req-93d72e4a-bb6a-4996-abba-e4bda9a42c04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077662 Oct 12 22:45:19.500714 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3731/6818] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:19.778391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-71b7484b-c7ba-40ef-9513-1eecfba45210 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:19.779342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-71b7484b-c7ba-40ef-9513-1eecfba45210 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:19.785949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71b7484b-c7ba-40ef-9513-1eecfba45210 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:19.786613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71b7484b-c7ba-40ef-9513-1eecfba45210 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:19.787194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71b7484b-c7ba-40ef-9513-1eecfba45210 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:19.788137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71b7484b-c7ba-40ef-9513-1eecfba45210 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:19.788732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71b7484b-c7ba-40ef-9513-1eecfba45210 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:19.789307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71b7484b-c7ba-40ef-9513-1eecfba45210 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:19.822247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71b7484b-c7ba-40ef-9513-1eecfba45210 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:19.822965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71b7484b-c7ba-40ef-9513-1eecfba45210 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:19.823572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71b7484b-c7ba-40ef-9513-1eecfba45210 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:19.824218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-71b7484b-c7ba-40ef-9513-1eecfba45210 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lazy-loading 'fault' on Instance uuid e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:45:19.830262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:45:19.832013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:45:19.833282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:45:19.833605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:45:19.834049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:45:19.849432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:19.849947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:19.850441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:19.851206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:19.853372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:19.853844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:19.871807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-71b7484b-c7ba-40ef-9513-1eecfba45210 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e972ee645b496eb171bd3c6984ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d400580dee84553bfc03450415c1558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:19.882410 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-71b7484b-c7ba-40ef-9513-1eecfba45210 tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 200 len: 1305 microversion: 2.1 time: 0.109900 Oct 12 22:45:19.883413 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3732/6819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:19 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:19.901482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Getting quotas for project aa5cc899bfb3403c9aa9d192833cafa9. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:45:19.909091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Getting quotas for user 2acd162da21348b6acb725bfe572bc00 and project aa5cc899bfb3403c9aa9d192833cafa9. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:45:19.922358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:45:19.924813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:45:19.983652 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7ae15e00-2889-4904-b88b-f672c164a5fd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.054027 Oct 12 22:45:19.984700 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3088/6820] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:45:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:45:19.996649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f3ad0e24-3d04-4d20-94c0-f8c1166e7ca2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:19.997418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f3ad0e24-3d04-4d20-94c0-f8c1166e7ca2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:20.000608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:20.099881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f3ad0e24-3d04-4d20-94c0-f8c1166e7ca2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:20.123969 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f3ad0e24-3d04-4d20-94c0-f8c1166e7ca2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1265 microversion: 2.1 time: 0.130297 Oct 12 22:45:20.146722 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3733/6821] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:19 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:20.906610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-05c20d3b-4e5a-4e99-bb3c-6c74d58eae2f tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:20.907416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-05c20d3b-4e5a-4e99-bb3c-6c74d58eae2f tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] [instance: e25b7ae6-a2f7-4c88-8aad-6615ad22ff54] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:20.909934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:20.919251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05c20d3b-4e5a-4e99-bb3c-6c74d58eae2f tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:20.919904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05c20d3b-4e5a-4e99-bb3c-6c74d58eae2f tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:20.920453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05c20d3b-4e5a-4e99-bb3c-6c74d58eae2f tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:20.921277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05c20d3b-4e5a-4e99-bb3c-6c74d58eae2f tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:20.921849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05c20d3b-4e5a-4e99-bb3c-6c74d58eae2f tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:20.922501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05c20d3b-4e5a-4e99-bb3c-6c74d58eae2f tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:20.941689 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-05c20d3b-4e5a-4e99-bb3c-6c74d58eae2f tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] HTTP exception thrown: Instance e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 could not be found. Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-05c20d3b-4e5a-4e99-bb3c-6c74d58eae2f tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Request method failure captured: Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 HTTP/1.1 Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0NjV92x4jsMh8vVCyl5Nx9fSJN9P_VneBmRldqA50egyKkt9NxlM_YuegJKHbhf4MjH1hr2OuQYeSRtdSnELpVkVVd3wJ5B-4WmpqczdkObTAWcTGhTyhf_NeWDD2QkMMRa3ovNR8M2zXQMBVIrglHj1wKFcA03ayTFMqyG3szLD6k Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 9d400580dee84553bfc03450415c1558 Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestServerAdvancedOps-1970919469 Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9d400580dee84553bfc03450415c1558"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9d400580dee84553bfc03450415c1558"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9d400580dee84553bfc03450415c1558", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9d400580dee84553bfc03450415c1558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestServerAdvancedOps-1970919469 Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 9d400580dee84553bfc03450415c1558 Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestServerAdvancedOps-1970919469 Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestServerAdvancedOps-1970919469-project Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 03e972ee645b496eb171bd3c6984ab23 Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestServerAdvancedOps-1970919469-project Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 could not be found. Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'e25b7ae6-a2f7-4c88-8aad-6615ad22ff54'} Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 could not be found. Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 could not be found. Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:20.943656 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:45:20.947662 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:20.947662 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:20.947662 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:20.947662 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:45:20.947662 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:45:20.947662 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 could not be found. Oct 12 22:45:20.947662 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:45:20.948975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-05c20d3b-4e5a-4e99-bb3c-6c74d58eae2f tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] Returning 404 to user: Instance e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:45:20.950105 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-05c20d3b-4e5a-4e99-bb3c-6c74d58eae2f tempest-TestServerAdvancedOps-1970919469 tempest-TestServerAdvancedOps-1970919469-project] 10.222.0.16 "GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54" status: 404 len: 111 microversion: 2.1 time: 0.048094 Oct 12 22:45:20.950671 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3089/6822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:20 2022] GET /compute/v2.1/servers/e25b7ae6-a2f7-4c88-8aad-6615ad22ff54 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:45:21.153778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1ebf88f8-7af1-47de-9c44-c4f3ce61b809 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:21.155124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1ebf88f8-7af1-47de-9c44-c4f3ce61b809 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:21.175202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ebf88f8-7af1-47de-9c44-c4f3ce61b809 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:21.176464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ebf88f8-7af1-47de-9c44-c4f3ce61b809 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:21.177119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ebf88f8-7af1-47de-9c44-c4f3ce61b809 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:21.178308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ebf88f8-7af1-47de-9c44-c4f3ce61b809 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:21.179537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ebf88f8-7af1-47de-9c44-c4f3ce61b809 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:21.180176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ebf88f8-7af1-47de-9c44-c4f3ce61b809 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:21.314409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1ebf88f8-7af1-47de-9c44-c4f3ce61b809 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:21.347017 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1ebf88f8-7af1-47de-9c44-c4f3ce61b809 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1325 microversion: 2.1 time: 0.196914 Oct 12 22:45:21.371152 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3734/6823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:21 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1325 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:45:22.374502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f31105ce-ec40-439d-b4ac-5d321c6942fc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:22.375144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f31105ce-ec40-439d-b4ac-5d321c6942fc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:22.392064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f31105ce-ec40-439d-b4ac-5d321c6942fc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:22.392596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f31105ce-ec40-439d-b4ac-5d321c6942fc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:22.393055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f31105ce-ec40-439d-b4ac-5d321c6942fc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:22.393857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f31105ce-ec40-439d-b4ac-5d321c6942fc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:22.394336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f31105ce-ec40-439d-b4ac-5d321c6942fc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:22.394787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f31105ce-ec40-439d-b4ac-5d321c6942fc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:22.822962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f31105ce-ec40-439d-b4ac-5d321c6942fc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:22.839497 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f31105ce-ec40-439d-b4ac-5d321c6942fc tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1390 microversion: 2.1 time: 0.468971 Oct 12 22:45:22.840657 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3090/6824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:22 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1390 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:23.799886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-db7cd383-58d5-4446-bce5-0acf3ba4fd9e req-1d878e27-dfee-4ede-8b96-75f5bb5b5bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c188bc3c-f2ef-4c11-b840-9349df36bac1", "tag": "b36e4f13-822d-4329-a3da-3086e28addf8"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:23.816019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-db7cd383-58d5-4446-bce5-0acf3ba4fd9e req-1d878e27-dfee-4ede-8b96-75f5bb5b5bb3 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:23.816497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-db7cd383-58d5-4446-bce5-0acf3ba4fd9e req-1d878e27-dfee-4ede-8b96-75f5bb5b5bb3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:23.817016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-db7cd383-58d5-4446-bce5-0acf3ba4fd9e req-1d878e27-dfee-4ede-8b96-75f5bb5b5bb3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:23.839496 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-db7cd383-58d5-4446-bce5-0acf3ba4fd9e req-1d878e27-dfee-4ede-8b96-75f5bb5b5bb3 service nova] Creating event network-changed:b36e4f13-822d-4329-a3da-3086e28addf8 for instance c188bc3c-f2ef-4c11-b840-9349df36bac1 on n-h2-861111-1 Oct 12 22:45:23.849612 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-db7cd383-58d5-4446-bce5-0acf3ba4fd9e req-1d878e27-dfee-4ede-8b96-75f5bb5b5bb3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054558 Oct 12 22:45:23.850562 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3735/6825] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:45:23.865201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-11c7423e-0734-4456-a611-5a9319493919 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:23.865944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-11c7423e-0734-4456-a611-5a9319493919 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:23.876158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11c7423e-0734-4456-a611-5a9319493919 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:23.876732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11c7423e-0734-4456-a611-5a9319493919 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:23.877250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11c7423e-0734-4456-a611-5a9319493919 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:23.878093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11c7423e-0734-4456-a611-5a9319493919 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:23.878628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11c7423e-0734-4456-a611-5a9319493919 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:23.879150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11c7423e-0734-4456-a611-5a9319493919 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:24.094698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-11c7423e-0734-4456-a611-5a9319493919 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:24.106260 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-11c7423e-0734-4456-a611-5a9319493919 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1390 microversion: 2.1 time: 0.247817 Oct 12 22:45:24.123836 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3091/6826] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:23 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1390 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:25.138766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-96f779cd-0df5-4f6b-ade1-f6234f34ce88 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:25.139567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-96f779cd-0df5-4f6b-ade1-f6234f34ce88 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:25.147851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96f779cd-0df5-4f6b-ade1-f6234f34ce88 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:25.148577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96f779cd-0df5-4f6b-ade1-f6234f34ce88 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:25.149167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96f779cd-0df5-4f6b-ade1-f6234f34ce88 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:25.150271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96f779cd-0df5-4f6b-ade1-f6234f34ce88 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:25.150847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96f779cd-0df5-4f6b-ade1-f6234f34ce88 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:25.151457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-96f779cd-0df5-4f6b-ade1-f6234f34ce88 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:25.156417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:25.296425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-96f779cd-0df5-4f6b-ade1-f6234f34ce88 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:25.304896 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-96f779cd-0df5-4f6b-ade1-f6234f34ce88 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1390 microversion: 2.1 time: 0.171198 Oct 12 22:45:25.305496 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3736/6827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:25 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:26.327687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ed3d7795-99aa-456f-895b-491ec52ecf08 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:26.328589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ed3d7795-99aa-456f-895b-491ec52ecf08 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:26.336280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed3d7795-99aa-456f-895b-491ec52ecf08 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:26.336858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed3d7795-99aa-456f-895b-491ec52ecf08 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:26.337384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed3d7795-99aa-456f-895b-491ec52ecf08 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:26.338130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed3d7795-99aa-456f-895b-491ec52ecf08 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:26.338596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed3d7795-99aa-456f-895b-491ec52ecf08 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:26.339035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed3d7795-99aa-456f-895b-491ec52ecf08 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:26.475024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ed3d7795-99aa-456f-895b-491ec52ecf08 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:26.482838 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ed3d7795-99aa-456f-895b-491ec52ecf08 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1390 microversion: 2.1 time: 0.159061 Oct 12 22:45:26.483446 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3092/6828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:26 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:27.506078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d27aeebf-4f43-4bf5-99ac-ec275097a29d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:27.506698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d27aeebf-4f43-4bf5-99ac-ec275097a29d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:27.513848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d27aeebf-4f43-4bf5-99ac-ec275097a29d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:27.514360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d27aeebf-4f43-4bf5-99ac-ec275097a29d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:27.514799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d27aeebf-4f43-4bf5-99ac-ec275097a29d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:27.515524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d27aeebf-4f43-4bf5-99ac-ec275097a29d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:27.515973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d27aeebf-4f43-4bf5-99ac-ec275097a29d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:27.516398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d27aeebf-4f43-4bf5-99ac-ec275097a29d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:27.649908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d27aeebf-4f43-4bf5-99ac-ec275097a29d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:27.657640 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d27aeebf-4f43-4bf5-99ac-ec275097a29d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1390 microversion: 2.1 time: 0.155493 Oct 12 22:45:27.658222 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3737/6829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:27 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:28.682135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2c21f74c-3664-45cd-bdb1-7d2a4a051367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:28.682648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2c21f74c-3664-45cd-bdb1-7d2a4a051367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:28.689467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c21f74c-3664-45cd-bdb1-7d2a4a051367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:28.689957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c21f74c-3664-45cd-bdb1-7d2a4a051367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:28.690404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c21f74c-3664-45cd-bdb1-7d2a4a051367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:28.691095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c21f74c-3664-45cd-bdb1-7d2a4a051367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:28.691587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c21f74c-3664-45cd-bdb1-7d2a4a051367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:28.692020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c21f74c-3664-45cd-bdb1-7d2a4a051367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:28.696103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:28.831013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2c21f74c-3664-45cd-bdb1-7d2a4a051367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:28.839036 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2c21f74c-3664-45cd-bdb1-7d2a4a051367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1390 microversion: 2.1 time: 0.161523 Oct 12 22:45:28.839656 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3093/6830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:28 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:29.862814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ee117f0c-0cf2-4385-b4e1-b7b9aa36770b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:29.863461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ee117f0c-0cf2-4385-b4e1-b7b9aa36770b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:29.870726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee117f0c-0cf2-4385-b4e1-b7b9aa36770b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:29.871208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee117f0c-0cf2-4385-b4e1-b7b9aa36770b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:29.871678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee117f0c-0cf2-4385-b4e1-b7b9aa36770b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:29.872367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee117f0c-0cf2-4385-b4e1-b7b9aa36770b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:29.872818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee117f0c-0cf2-4385-b4e1-b7b9aa36770b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:29.873242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ee117f0c-0cf2-4385-b4e1-b7b9aa36770b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:30.017067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ee117f0c-0cf2-4385-b4e1-b7b9aa36770b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:30.025779 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ee117f0c-0cf2-4385-b4e1-b7b9aa36770b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1390 microversion: 2.1 time: 0.166775 Oct 12 22:45:30.026374 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3738/6831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:29 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:31.050095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-31210546-0614-4f23-893c-1d840daa10e2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:31.051489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-31210546-0614-4f23-893c-1d840daa10e2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:31.054527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:31.055341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:31.061869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31210546-0614-4f23-893c-1d840daa10e2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:31.062380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31210546-0614-4f23-893c-1d840daa10e2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:31.062838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31210546-0614-4f23-893c-1d840daa10e2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:31.063592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31210546-0614-4f23-893c-1d840daa10e2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:31.064061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31210546-0614-4f23-893c-1d840daa10e2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:31.064503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31210546-0614-4f23-893c-1d840daa10e2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:31.073892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-1595131b-9e94-4344-8577-322cc13b92fe req-645bb23a-fcb7-4198-b168-c87724d21c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c188bc3c-f2ef-4c11-b840-9349df36bac1", "name": "network-vif-plugged", "status": "completed", "tag": "b36e4f13-822d-4329-a3da-3086e28addf8"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:31.084028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:31.095970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1595131b-9e94-4344-8577-322cc13b92fe req-645bb23a-fcb7-4198-b168-c87724d21c04 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:31.099845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1595131b-9e94-4344-8577-322cc13b92fe req-645bb23a-fcb7-4198-b168-c87724d21c04 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:31.100687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1595131b-9e94-4344-8577-322cc13b92fe req-645bb23a-fcb7-4198-b168-c87724d21c04 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:31.119348 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-1595131b-9e94-4344-8577-322cc13b92fe req-645bb23a-fcb7-4198-b168-c87724d21c04 service nova] Creating event network-vif-plugged:b36e4f13-822d-4329-a3da-3086e28addf8 for instance c188bc3c-f2ef-4c11-b840-9349df36bac1 on n-h2-861111-1 Oct 12 22:45:31.125519 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-1595131b-9e94-4344-8577-322cc13b92fe req-645bb23a-fcb7-4198-b168-c87724d21c04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056663 Oct 12 22:45:31.126739 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3739/6832] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:45:31.256834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-31210546-0614-4f23-893c-1d840daa10e2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:31.265463 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-31210546-0614-4f23-893c-1d840daa10e2 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1390 microversion: 2.1 time: 0.219275 Oct 12 22:45:31.266324 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3094/6833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:31 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1390 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:32.290163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bc9ed700-f33e-4248-acf1-c1e64c133367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:32.290872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bc9ed700-f33e-4248-acf1-c1e64c133367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:32.297020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc9ed700-f33e-4248-acf1-c1e64c133367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:32.297504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc9ed700-f33e-4248-acf1-c1e64c133367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:32.297944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc9ed700-f33e-4248-acf1-c1e64c133367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:32.298732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc9ed700-f33e-4248-acf1-c1e64c133367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:32.299309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc9ed700-f33e-4248-acf1-c1e64c133367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:32.299708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc9ed700-f33e-4248-acf1-c1e64c133367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:32.442882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bc9ed700-f33e-4248-acf1-c1e64c133367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:32.451541 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bc9ed700-f33e-4248-acf1-c1e64c133367 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1390 microversion: 2.1 time: 0.167021 Oct 12 22:45:32.452132 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3740/6834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:32 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:45:33.476632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-22894bfb-2886-4976-b7ea-85f8a09871e9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:33.477333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-22894bfb-2886-4976-b7ea-85f8a09871e9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:33.484832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22894bfb-2886-4976-b7ea-85f8a09871e9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:33.485324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22894bfb-2886-4976-b7ea-85f8a09871e9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:33.485774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22894bfb-2886-4976-b7ea-85f8a09871e9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:33.486484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22894bfb-2886-4976-b7ea-85f8a09871e9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:33.486946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22894bfb-2886-4976-b7ea-85f8a09871e9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:33.487424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22894bfb-2886-4976-b7ea-85f8a09871e9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:33.633280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-22894bfb-2886-4976-b7ea-85f8a09871e9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:33.641433 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-22894bfb-2886-4976-b7ea-85f8a09871e9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1562 microversion: 2.1 time: 0.169661 Oct 12 22:45:33.642346 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3095/6835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:33 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:33.666538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f868162f-e95f-4ca5-a581-3cc35ab9b941 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:33.667160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f868162f-e95f-4ca5-a581-3cc35ab9b941 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:33.674745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f868162f-e95f-4ca5-a581-3cc35ab9b941 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:33.675275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f868162f-e95f-4ca5-a581-3cc35ab9b941 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:33.675726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f868162f-e95f-4ca5-a581-3cc35ab9b941 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:33.676453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f868162f-e95f-4ca5-a581-3cc35ab9b941 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:33.676916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f868162f-e95f-4ca5-a581-3cc35ab9b941 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:33.677356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f868162f-e95f-4ca5-a581-3cc35ab9b941 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:33.825545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f868162f-e95f-4ca5-a581-3cc35ab9b941 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:33.834405 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f868162f-e95f-4ca5-a581-3cc35ab9b941 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1562 microversion: 2.1 time: 0.172484 Oct 12 22:45:33.835028 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3741/6836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:33 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1562 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:35.519521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-90e353ad-06c8-4c05-961a-44483c1d638e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:35.520890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-90e353ad-06c8-4c05-961a-44483c1d638e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:35.527099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-6ce1a7ee-0450-430c-920a-0e5c0de18213 req-aada2c3a-7a8a-4ba2-b5e3-044e2f13b99b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c188bc3c-f2ef-4c11-b840-9349df36bac1", "tag": "b36e4f13-822d-4329-a3da-3086e28addf8"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:35.530104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90e353ad-06c8-4c05-961a-44483c1d638e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:35.530660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90e353ad-06c8-4c05-961a-44483c1d638e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:35.531115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90e353ad-06c8-4c05-961a-44483c1d638e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:35.531860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90e353ad-06c8-4c05-961a-44483c1d638e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:35.532323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90e353ad-06c8-4c05-961a-44483c1d638e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:35.532909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90e353ad-06c8-4c05-961a-44483c1d638e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:35.539843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6ce1a7ee-0450-430c-920a-0e5c0de18213 req-aada2c3a-7a8a-4ba2-b5e3-044e2f13b99b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:35.540620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6ce1a7ee-0450-430c-920a-0e5c0de18213 req-aada2c3a-7a8a-4ba2-b5e3-044e2f13b99b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:35.541257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6ce1a7ee-0450-430c-920a-0e5c0de18213 req-aada2c3a-7a8a-4ba2-b5e3-044e2f13b99b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:35.553206 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6ce1a7ee-0450-430c-920a-0e5c0de18213 req-aada2c3a-7a8a-4ba2-b5e3-044e2f13b99b service nova] Creating event network-changed:b36e4f13-822d-4329-a3da-3086e28addf8 for instance c188bc3c-f2ef-4c11-b840-9349df36bac1 on n-h2-861111-1 Oct 12 22:45:35.559625 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-6ce1a7ee-0450-430c-920a-0e5c0de18213 req-aada2c3a-7a8a-4ba2-b5e3-044e2f13b99b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035955 Oct 12 22:45:35.573743 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3742/6837] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:45:35.774210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-90e353ad-06c8-4c05-961a-44483c1d638e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:35.811500 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-90e353ad-06c8-4c05-961a-44483c1d638e tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1562 microversion: 2.1 time: 0.295520 Oct 12 22:45:35.812763 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3096/6838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:35 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1562 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:49.098208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=20 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:49.098955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=32 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:49.103513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a48feb71-8001-400c-8909-8426722fe810 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Action: 'create', calling method: .version_select at 0x7f5122d550d0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-690282953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5Ei/UE86ZOINUVs/ZYHRokSk2b0jR5dwiXAp6mzKqlV7/NSbRZPjj9ChKOz1H/7HgznaqnHILV3GtRAU2b+3icOLD4CcbiwXc4jKkD9QC2y3UEGgOzKFcuS9oC/6PftA=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:49.119957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-a48feb71-8001-400c-8909-8426722fe810 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Getting quotas for project 47aa1e29deaa421e835d1773dd3210d1. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:45:49.125083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-a48feb71-8001-400c-8909-8426722fe810 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Getting quotas for user c14719be7020488b828f998d587df3eb and project 47aa1e29deaa421e835d1773dd3210d1. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:45:49.148861 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a48feb71-8001-400c-8909-8426722fe810 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.052512 Oct 12 22:45:49.149452 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3743/6839] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:45:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:50.118116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-2076944185", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "97e61d86-3bc8-4422-8854-f9527bc0dcfc", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-690282953", "security_groups": [{"name": "tempest-secgroup-smoke-1471258359"}], "networks": [{"uuid": "df1b9fd8-ffd7-4d66-a56d-fe6874cee68d"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:50.128459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=15 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:50.129123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=22 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:50.231752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] validate_networks() for [('df1b9fd8-ffd7-4d66-a56d-fe6874cee68d', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:45:50.597462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:45:50.597896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:45:50.598406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:45:50.598828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:45:50.599269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:45:50.608316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:50.608804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:50.609248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:50.609975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:50.610435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:50.610872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:50.627773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Getting quotas for project 47aa1e29deaa421e835d1773dd3210d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:45:50.632794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Getting quotas for user c14719be7020488b828f998d587df3eb and project 47aa1e29deaa421e835d1773dd3210d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:45:50.690820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:45:50.692890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97e61d86-3bc8-4422-8854-f9527bc0dcfc',volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:45:50.821032 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5be89428-bfd6-423b-9687-61745f1d8eda tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.707538 Oct 12 22:45:50.821689 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3097/6840] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:45:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:45:50.833592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f65bf07d-9c94-46be-b0dd-2e4e502b31d1 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:50.834567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f65bf07d-9c94-46be-b0dd-2e4e502b31d1 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:50.889346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f65bf07d-9c94-46be-b0dd-2e4e502b31d1 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:50.896169 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f65bf07d-9c94-46be-b0dd-2e4e502b31d1 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1098 microversion: 2.1 time: 0.067353 Oct 12 22:45:50.896812 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3744/6841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:50 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1098 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:51.920628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f5e93db-a25d-4567-a527-29377da22dae tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:51.921945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8f5e93db-a25d-4567-a527-29377da22dae tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:51.928592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f5e93db-a25d-4567-a527-29377da22dae tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:51.929116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f5e93db-a25d-4567-a527-29377da22dae tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:51.929589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f5e93db-a25d-4567-a527-29377da22dae tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:51.930962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f5e93db-a25d-4567-a527-29377da22dae tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:51.931457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f5e93db-a25d-4567-a527-29377da22dae tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:51.931898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f5e93db-a25d-4567-a527-29377da22dae tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:52.009370 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f5e93db-a25d-4567-a527-29377da22dae tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:52.017188 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f5e93db-a25d-4567-a527-29377da22dae tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1204 microversion: 2.1 time: 0.101677 Oct 12 22:45:52.017781 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3098/6842] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:51 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1204 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:53.041802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a3a5bec3-99e5-4517-99a6-9fcf45ee99ad tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:53.042426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a3a5bec3-99e5-4517-99a6-9fcf45ee99ad tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:53.049809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3a5bec3-99e5-4517-99a6-9fcf45ee99ad tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:53.050298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3a5bec3-99e5-4517-99a6-9fcf45ee99ad tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:53.050947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3a5bec3-99e5-4517-99a6-9fcf45ee99ad tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:53.051691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3a5bec3-99e5-4517-99a6-9fcf45ee99ad tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:53.052154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3a5bec3-99e5-4517-99a6-9fcf45ee99ad tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:53.052585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3a5bec3-99e5-4517-99a6-9fcf45ee99ad tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:53.210675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a3a5bec3-99e5-4517-99a6-9fcf45ee99ad tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:53.219340 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a3a5bec3-99e5-4517-99a6-9fcf45ee99ad tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1282 microversion: 2.1 time: 0.182027 Oct 12 22:45:53.220347 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3745/6843] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:53 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1282 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:53.378706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-59c869aa-ef34-4d84-8d53-fc375663f1df req-0140fbdd-4b42-4db7-846c-96126c449014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "923106e7-a75e-4c43-8a30-3d406d22fe29", "tag": "4b02bf31-1792-4338-884a-2dab9161ff7c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:53.392048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-59c869aa-ef34-4d84-8d53-fc375663f1df req-0140fbdd-4b42-4db7-846c-96126c449014 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:53.393141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-59c869aa-ef34-4d84-8d53-fc375663f1df req-0140fbdd-4b42-4db7-846c-96126c449014 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:53.393607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-59c869aa-ef34-4d84-8d53-fc375663f1df req-0140fbdd-4b42-4db7-846c-96126c449014 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:53.406649 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-59c869aa-ef34-4d84-8d53-fc375663f1df req-0140fbdd-4b42-4db7-846c-96126c449014 service nova] Creating event network-changed:4b02bf31-1792-4338-884a-2dab9161ff7c for instance 923106e7-a75e-4c43-8a30-3d406d22fe29 on n-h1-861111-1 Oct 12 22:45:53.412570 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-59c869aa-ef34-4d84-8d53-fc375663f1df req-0140fbdd-4b42-4db7-846c-96126c449014 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038970 Oct 12 22:45:53.413184 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3099/6844] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:45:54.243249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3d24b81f-e1b3-4b8b-a613-146aa028150c tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:54.243929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3d24b81f-e1b3-4b8b-a613-146aa028150c tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:54.251053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d24b81f-e1b3-4b8b-a613-146aa028150c tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:54.251614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d24b81f-e1b3-4b8b-a613-146aa028150c tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:54.252117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d24b81f-e1b3-4b8b-a613-146aa028150c tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:54.252847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d24b81f-e1b3-4b8b-a613-146aa028150c tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:54.253338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d24b81f-e1b3-4b8b-a613-146aa028150c tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:54.253772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d24b81f-e1b3-4b8b-a613-146aa028150c tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:54.401929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3d24b81f-e1b3-4b8b-a613-146aa028150c tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:54.409784 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3d24b81f-e1b3-4b8b-a613-146aa028150c tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1282 microversion: 2.1 time: 0.171361 Oct 12 22:45:54.410358 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3746/6845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:54 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:55.433529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7f7811d9-eb00-4ea1-9389-7dcd2b8f6257 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:55.434134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7f7811d9-eb00-4ea1-9389-7dcd2b8f6257 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:55.441237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f7811d9-eb00-4ea1-9389-7dcd2b8f6257 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:55.441725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f7811d9-eb00-4ea1-9389-7dcd2b8f6257 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:55.442168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f7811d9-eb00-4ea1-9389-7dcd2b8f6257 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:55.442896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f7811d9-eb00-4ea1-9389-7dcd2b8f6257 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:55.443394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f7811d9-eb00-4ea1-9389-7dcd2b8f6257 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:55.443831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f7811d9-eb00-4ea1-9389-7dcd2b8f6257 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:55.916280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7f7811d9-eb00-4ea1-9389-7dcd2b8f6257 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:55.924423 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7f7811d9-eb00-4ea1-9389-7dcd2b8f6257 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1282 microversion: 2.1 time: 0.495151 Oct 12 22:45:55.925029 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3100/6846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:55 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1282 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:45:56.947556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e460ed10-2941-4d34-aad4-dfec912b2d54 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:56.948165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e460ed10-2941-4d34-aad4-dfec912b2d54 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:56.955101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e460ed10-2941-4d34-aad4-dfec912b2d54 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:56.955625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e460ed10-2941-4d34-aad4-dfec912b2d54 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:56.956065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e460ed10-2941-4d34-aad4-dfec912b2d54 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:56.956769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e460ed10-2941-4d34-aad4-dfec912b2d54 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:56.957227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e460ed10-2941-4d34-aad4-dfec912b2d54 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:56.957654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e460ed10-2941-4d34-aad4-dfec912b2d54 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:57.094931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e460ed10-2941-4d34-aad4-dfec912b2d54 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:57.103506 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e460ed10-2941-4d34-aad4-dfec912b2d54 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1282 microversion: 2.1 time: 0.160009 Oct 12 22:45:57.104079 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3747/6847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:56 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:58.126157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-05ca4ad5-02e2-4f5f-b4dd-5ffe626d9b3a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:58.126780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-05ca4ad5-02e2-4f5f-b4dd-5ffe626d9b3a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:58.133639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05ca4ad5-02e2-4f5f-b4dd-5ffe626d9b3a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:58.134130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05ca4ad5-02e2-4f5f-b4dd-5ffe626d9b3a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:58.134582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05ca4ad5-02e2-4f5f-b4dd-5ffe626d9b3a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:58.135307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05ca4ad5-02e2-4f5f-b4dd-5ffe626d9b3a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:58.135774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05ca4ad5-02e2-4f5f-b4dd-5ffe626d9b3a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:58.136211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-05ca4ad5-02e2-4f5f-b4dd-5ffe626d9b3a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:58.269377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-05ca4ad5-02e2-4f5f-b4dd-5ffe626d9b3a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:58.277776 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-05ca4ad5-02e2-4f5f-b4dd-5ffe626d9b3a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1270 microversion: 2.1 time: 0.155487 Oct 12 22:45:58.278375 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3101/6848] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:58 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:59.301520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-65862946-ab0a-4693-90d3-cbe074c041c5 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:59.302142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-65862946-ab0a-4693-90d3-cbe074c041c5 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:59.309163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65862946-ab0a-4693-90d3-cbe074c041c5 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:59.309649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65862946-ab0a-4693-90d3-cbe074c041c5 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:59.310094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65862946-ab0a-4693-90d3-cbe074c041c5 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:59.310789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65862946-ab0a-4693-90d3-cbe074c041c5 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:59.311273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65862946-ab0a-4693-90d3-cbe074c041c5 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:59.311698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65862946-ab0a-4693-90d3-cbe074c041c5 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:59.439421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-65862946-ab0a-4693-90d3-cbe074c041c5 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:59.447662 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-65862946-ab0a-4693-90d3-cbe074c041c5 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1270 microversion: 2.1 time: 0.150150 Oct 12 22:45:59.448234 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3748/6849] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:59 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1270 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:00.470988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7f29a2da-9130-40ef-9959-e5b4adf29498 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:00.471552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7f29a2da-9130-40ef-9959-e5b4adf29498 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:00.478402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f29a2da-9130-40ef-9959-e5b4adf29498 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:00.478917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f29a2da-9130-40ef-9959-e5b4adf29498 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:00.479379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f29a2da-9130-40ef-9959-e5b4adf29498 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:00.480158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f29a2da-9130-40ef-9959-e5b4adf29498 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:00.480569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f29a2da-9130-40ef-9959-e5b4adf29498 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:00.481016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f29a2da-9130-40ef-9959-e5b4adf29498 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:00.612850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7f29a2da-9130-40ef-9959-e5b4adf29498 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:00.619256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:00.621980 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7f29a2da-9130-40ef-9959-e5b4adf29498 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1270 microversion: 2.1 time: 0.155025 Oct 12 22:46:00.622577 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3102/6850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:00 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:01.645058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-696389a0-419f-4a91-9ea6-f444ce821bfe tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:01.645671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-696389a0-419f-4a91-9ea6-f444ce821bfe tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:01.648327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:01.653774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696389a0-419f-4a91-9ea6-f444ce821bfe tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:01.654254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696389a0-419f-4a91-9ea6-f444ce821bfe tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:01.654689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696389a0-419f-4a91-9ea6-f444ce821bfe tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:01.655400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696389a0-419f-4a91-9ea6-f444ce821bfe tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:01.655851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696389a0-419f-4a91-9ea6-f444ce821bfe tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:01.656275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-696389a0-419f-4a91-9ea6-f444ce821bfe tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:01.787868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-696389a0-419f-4a91-9ea6-f444ce821bfe tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:01.798899 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-696389a0-419f-4a91-9ea6-f444ce821bfe tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1270 microversion: 2.1 time: 0.157647 Oct 12 22:46:01.799539 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3749/6851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:01 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:02.823272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1a791b7b-0c89-4d0a-ae7c-d03a5b0d711e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:02.823895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1a791b7b-0c89-4d0a-ae7c-d03a5b0d711e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:02.825692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:02.832031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a791b7b-0c89-4d0a-ae7c-d03a5b0d711e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:02.832527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a791b7b-0c89-4d0a-ae7c-d03a5b0d711e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:02.832972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a791b7b-0c89-4d0a-ae7c-d03a5b0d711e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:02.833670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a791b7b-0c89-4d0a-ae7c-d03a5b0d711e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:02.834129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a791b7b-0c89-4d0a-ae7c-d03a5b0d711e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:02.834561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a791b7b-0c89-4d0a-ae7c-d03a5b0d711e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:02.963702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1a791b7b-0c89-4d0a-ae7c-d03a5b0d711e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:02.971392 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1a791b7b-0c89-4d0a-ae7c-d03a5b0d711e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1270 microversion: 2.1 time: 0.153167 Oct 12 22:46:02.971965 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3103/6852] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:02 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:03.993971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e9171776-f7c3-4898-b32f-ef25377c686d tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:03.994589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e9171776-f7c3-4898-b32f-ef25377c686d tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:04.001506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9171776-f7c3-4898-b32f-ef25377c686d tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:04.001988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9171776-f7c3-4898-b32f-ef25377c686d tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:04.002429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9171776-f7c3-4898-b32f-ef25377c686d tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:04.003123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9171776-f7c3-4898-b32f-ef25377c686d tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:04.003605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9171776-f7c3-4898-b32f-ef25377c686d tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:04.004034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e9171776-f7c3-4898-b32f-ef25377c686d tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:04.136912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e9171776-f7c3-4898-b32f-ef25377c686d tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:04.145282 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e9171776-f7c3-4898-b32f-ef25377c686d tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1270 microversion: 2.1 time: 0.155105 Oct 12 22:46:04.145821 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3750/6853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:03 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:05.169947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ea0722b5-b910-41fc-8f3f-5632f8cea159 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:05.170497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ea0722b5-b910-41fc-8f3f-5632f8cea159 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:05.177311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea0722b5-b910-41fc-8f3f-5632f8cea159 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:05.177805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea0722b5-b910-41fc-8f3f-5632f8cea159 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:05.178255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea0722b5-b910-41fc-8f3f-5632f8cea159 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:05.178955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea0722b5-b910-41fc-8f3f-5632f8cea159 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:05.179449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea0722b5-b910-41fc-8f3f-5632f8cea159 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:05.179889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea0722b5-b910-41fc-8f3f-5632f8cea159 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:05.310660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ea0722b5-b910-41fc-8f3f-5632f8cea159 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:05.318348 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ea0722b5-b910-41fc-8f3f-5632f8cea159 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1270 microversion: 2.1 time: 0.152439 Oct 12 22:46:05.319019 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3104/6854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:05 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:06.341794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cc086b51-564d-4b53-941d-5abb02688ab3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:06.342536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cc086b51-564d-4b53-941d-5abb02688ab3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:06.349253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc086b51-564d-4b53-941d-5abb02688ab3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:06.349771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc086b51-564d-4b53-941d-5abb02688ab3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:06.350225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc086b51-564d-4b53-941d-5abb02688ab3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:06.350931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc086b51-564d-4b53-941d-5abb02688ab3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:06.351433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc086b51-564d-4b53-941d-5abb02688ab3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:06.351871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cc086b51-564d-4b53-941d-5abb02688ab3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:06.482857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cc086b51-564d-4b53-941d-5abb02688ab3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:06.490691 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cc086b51-564d-4b53-941d-5abb02688ab3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1270 microversion: 2.1 time: 0.153427 Oct 12 22:46:06.491282 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3751/6855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:06 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:07.130780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0cb01b7d-e986-4108-b22c-3916e970beea tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:07.133085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0cb01b7d-e986-4108-b22c-3916e970beea tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:07.140428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cb01b7d-e986-4108-b22c-3916e970beea tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:07.140926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cb01b7d-e986-4108-b22c-3916e970beea tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:07.141379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cb01b7d-e986-4108-b22c-3916e970beea tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:07.142081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cb01b7d-e986-4108-b22c-3916e970beea tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:07.142551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cb01b7d-e986-4108-b22c-3916e970beea tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:07.143043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cb01b7d-e986-4108-b22c-3916e970beea tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:07.195341 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0cb01b7d-e986-4108-b22c-3916e970beea tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1/action" status: 200 len: 24570 microversion: 2.1 time: 0.068413 Oct 12 22:46:07.196617 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3105/6856] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:46:07 2022] POST /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1/action => generated 24570 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:46:07.514679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5ee95574-8212-42b8-bb13-dd54680bcceb tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:07.515320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5ee95574-8212-42b8-bb13-dd54680bcceb tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:07.522138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ee95574-8212-42b8-bb13-dd54680bcceb tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:07.522616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ee95574-8212-42b8-bb13-dd54680bcceb tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:07.523055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ee95574-8212-42b8-bb13-dd54680bcceb tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:07.523773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ee95574-8212-42b8-bb13-dd54680bcceb tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:07.524225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ee95574-8212-42b8-bb13-dd54680bcceb tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:07.524646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ee95574-8212-42b8-bb13-dd54680bcceb tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:07.655282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5ee95574-8212-42b8-bb13-dd54680bcceb tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:07.662955 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5ee95574-8212-42b8-bb13-dd54680bcceb tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1270 microversion: 2.1 time: 0.152267 Oct 12 22:46:07.663571 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3752/6857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:07 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:07.851389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-40190251-7d6f-441d-b545-2502995585db req-6bf658fb-1350-4236-b47a-081528f11ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923106e7-a75e-4c43-8a30-3d406d22fe29", "name": "network-vif-plugged", "status": "completed", "tag": "4b02bf31-1792-4338-884a-2dab9161ff7c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:07.862495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-40190251-7d6f-441d-b545-2502995585db req-6bf658fb-1350-4236-b47a-081528f11ff0 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:07.862986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-40190251-7d6f-441d-b545-2502995585db req-6bf658fb-1350-4236-b47a-081528f11ff0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:07.863504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-40190251-7d6f-441d-b545-2502995585db req-6bf658fb-1350-4236-b47a-081528f11ff0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:07.875524 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-40190251-7d6f-441d-b545-2502995585db req-6bf658fb-1350-4236-b47a-081528f11ff0 service nova] Creating event network-vif-plugged:4b02bf31-1792-4338-884a-2dab9161ff7c for instance 923106e7-a75e-4c43-8a30-3d406d22fe29 on n-h1-861111-1 Oct 12 22:46:07.880227 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-40190251-7d6f-441d-b545-2502995585db req-6bf658fb-1350-4236-b47a-081528f11ff0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033080 Oct 12 22:46:07.880806 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3106/6858] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:08.686704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-266bb646-683a-4c89-9784-5404473d997e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:08.687358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-266bb646-683a-4c89-9784-5404473d997e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:08.694149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-266bb646-683a-4c89-9784-5404473d997e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:08.694632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-266bb646-683a-4c89-9784-5404473d997e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:08.695077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-266bb646-683a-4c89-9784-5404473d997e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:08.695800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-266bb646-683a-4c89-9784-5404473d997e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:08.696255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-266bb646-683a-4c89-9784-5404473d997e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:08.696684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-266bb646-683a-4c89-9784-5404473d997e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:08.829533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-266bb646-683a-4c89-9784-5404473d997e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:08.838109 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-266bb646-683a-4c89-9784-5404473d997e tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1270 microversion: 2.1 time: 0.155411 Oct 12 22:46:08.838681 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3753/6859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:08 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:09.862876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0b69406f-89fe-48cf-95a0-a560b3a398e9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:09.863660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0b69406f-89fe-48cf-95a0-a560b3a398e9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:09.869814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b69406f-89fe-48cf-95a0-a560b3a398e9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:09.870306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b69406f-89fe-48cf-95a0-a560b3a398e9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:09.870751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b69406f-89fe-48cf-95a0-a560b3a398e9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:09.871470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b69406f-89fe-48cf-95a0-a560b3a398e9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:09.871928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b69406f-89fe-48cf-95a0-a560b3a398e9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:09.872359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b69406f-89fe-48cf-95a0-a560b3a398e9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:10.006482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0b69406f-89fe-48cf-95a0-a560b3a398e9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:10.014932 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0b69406f-89fe-48cf-95a0-a560b3a398e9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1458 microversion: 2.1 time: 0.157196 Oct 12 22:46:10.015531 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3107/6860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:09 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1458 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:10.037332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b482230f-da4d-4ab3-ac8b-eff28cda1d2a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:10.037922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b482230f-da4d-4ab3-ac8b-eff28cda1d2a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:10.044898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b482230f-da4d-4ab3-ac8b-eff28cda1d2a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:10.045385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b482230f-da4d-4ab3-ac8b-eff28cda1d2a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:10.045825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b482230f-da4d-4ab3-ac8b-eff28cda1d2a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:10.046523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b482230f-da4d-4ab3-ac8b-eff28cda1d2a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:10.046978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b482230f-da4d-4ab3-ac8b-eff28cda1d2a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:10.047442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b482230f-da4d-4ab3-ac8b-eff28cda1d2a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:10.176737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b482230f-da4d-4ab3-ac8b-eff28cda1d2a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:10.184612 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b482230f-da4d-4ab3-ac8b-eff28cda1d2a tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1458 microversion: 2.1 time: 0.151240 Oct 12 22:46:10.185188 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3754/6861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:10 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1458 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:12.170439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-5a18f5f5-a706-46b4-8e1d-ba2d43640829 req-43673938-4b6d-4278-9c5b-f798abd03de9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "923106e7-a75e-4c43-8a30-3d406d22fe29", "tag": "4b02bf31-1792-4338-884a-2dab9161ff7c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:12.182214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5a18f5f5-a706-46b4-8e1d-ba2d43640829 req-43673938-4b6d-4278-9c5b-f798abd03de9 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:12.182703 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5a18f5f5-a706-46b4-8e1d-ba2d43640829 req-43673938-4b6d-4278-9c5b-f798abd03de9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:12.183143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5a18f5f5-a706-46b4-8e1d-ba2d43640829 req-43673938-4b6d-4278-9c5b-f798abd03de9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:12.194825 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-5a18f5f5-a706-46b4-8e1d-ba2d43640829 req-43673938-4b6d-4278-9c5b-f798abd03de9 service nova] Creating event network-changed:4b02bf31-1792-4338-884a-2dab9161ff7c for instance 923106e7-a75e-4c43-8a30-3d406d22fe29 on n-h1-861111-1 Oct 12 22:46:12.200125 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-5a18f5f5-a706-46b4-8e1d-ba2d43640829 req-43673938-4b6d-4278-9c5b-f798abd03de9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033628 Oct 12 22:46:12.201102 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3108/6862] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:14.216000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d257fb94-176b-4a03-9fdf-5be910e4f4fb req-1e1ec7f1-a997-438a-addf-923df092164f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "923106e7-a75e-4c43-8a30-3d406d22fe29", "tag": "4b02bf31-1792-4338-884a-2dab9161ff7c"}, {"name": "network-changed", "server_uuid": "923106e7-a75e-4c43-8a30-3d406d22fe29", "tag": "4b02bf31-1792-4338-884a-2dab9161ff7c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:14.229907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d257fb94-176b-4a03-9fdf-5be910e4f4fb req-1e1ec7f1-a997-438a-addf-923df092164f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:14.230384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d257fb94-176b-4a03-9fdf-5be910e4f4fb req-1e1ec7f1-a997-438a-addf-923df092164f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:14.230863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d257fb94-176b-4a03-9fdf-5be910e4f4fb req-1e1ec7f1-a997-438a-addf-923df092164f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:14.245472 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d257fb94-176b-4a03-9fdf-5be910e4f4fb req-1e1ec7f1-a997-438a-addf-923df092164f service nova] Creating event network-changed:4b02bf31-1792-4338-884a-2dab9161ff7c for instance 923106e7-a75e-4c43-8a30-3d406d22fe29 on n-h1-861111-1 Oct 12 22:46:14.246030 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d257fb94-176b-4a03-9fdf-5be910e4f4fb req-1e1ec7f1-a997-438a-addf-923df092164f service nova] Creating event network-changed:4b02bf31-1792-4338-884a-2dab9161ff7c for instance 923106e7-a75e-4c43-8a30-3d406d22fe29 on n-h1-861111-1 Oct 12 22:46:14.251186 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d257fb94-176b-4a03-9fdf-5be910e4f4fb req-1e1ec7f1-a997-438a-addf-923df092164f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040012 Oct 12 22:46:14.251795 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3755/6863] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:32.049634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:32.050304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=54 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:32.051299 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 22:46:32.051430 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 22:46:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 (ip 10.222.0.16) !!! Oct 12 22:46:32.224532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ba233700-7849-4678-9bac-0659381d5563 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:32.225228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ba233700-7849-4678-9bac-0659381d5563 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:32.231460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba233700-7849-4678-9bac-0659381d5563 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:32.231958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba233700-7849-4678-9bac-0659381d5563 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:32.232410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba233700-7849-4678-9bac-0659381d5563 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:32.233115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba233700-7849-4678-9bac-0659381d5563 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:32.233587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba233700-7849-4678-9bac-0659381d5563 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:32.234025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba233700-7849-4678-9bac-0659381d5563 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:32.259995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ba233700-7849-4678-9bac-0659381d5563 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:46:32.331971 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ba233700-7849-4678-9bac-0659381d5563 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "DELETE /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 204 len: 0 microversion: 2.1 time: 0.287621 Oct 12 22:46:32.335569 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3109/6864] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:46:32 2022] DELETE /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:46:32.339076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:32.339882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=62 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:32.344116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5c93547d-2495-469e-afb5-f5bf94fed520 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:32.344826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5c93547d-2495-469e-afb5-f5bf94fed520 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:32.352076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c93547d-2495-469e-afb5-f5bf94fed520 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:32.352556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c93547d-2495-469e-afb5-f5bf94fed520 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:32.353005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c93547d-2495-469e-afb5-f5bf94fed520 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:32.353701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c93547d-2495-469e-afb5-f5bf94fed520 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:32.354160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c93547d-2495-469e-afb5-f5bf94fed520 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:32.354588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c93547d-2495-469e-afb5-f5bf94fed520 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:32.497182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5c93547d-2495-469e-afb5-f5bf94fed520 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:32.506115 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5c93547d-2495-469e-afb5-f5bf94fed520 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1575 microversion: 2.1 time: 0.169273 Oct 12 22:46:32.506699 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3756/6865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:32 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:46:33.531733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1c882261-adb4-4b72-be4a-a0fe86f91a6c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:33.532455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1c882261-adb4-4b72-be4a-a0fe86f91a6c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:33.540438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c882261-adb4-4b72-be4a-a0fe86f91a6c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:33.540971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c882261-adb4-4b72-be4a-a0fe86f91a6c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:33.541454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c882261-adb4-4b72-be4a-a0fe86f91a6c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:33.542231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c882261-adb4-4b72-be4a-a0fe86f91a6c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:33.542863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c882261-adb4-4b72-be4a-a0fe86f91a6c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:33.543374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c882261-adb4-4b72-be4a-a0fe86f91a6c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:33.685380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1c882261-adb4-4b72-be4a-a0fe86f91a6c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:33.694996 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1c882261-adb4-4b72-be4a-a0fe86f91a6c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1575 microversion: 2.1 time: 0.168005 Oct 12 22:46:33.695665 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3110/6866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:33 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:34.719876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7ce7c4ad-7506-4e85-8e2f-04ed5885e5df tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:34.720620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7ce7c4ad-7506-4e85-8e2f-04ed5885e5df tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:34.729500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ce7c4ad-7506-4e85-8e2f-04ed5885e5df tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:34.730169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ce7c4ad-7506-4e85-8e2f-04ed5885e5df tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:34.730793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ce7c4ad-7506-4e85-8e2f-04ed5885e5df tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:34.731531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ce7c4ad-7506-4e85-8e2f-04ed5885e5df tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:34.731995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ce7c4ad-7506-4e85-8e2f-04ed5885e5df tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:34.732421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ce7c4ad-7506-4e85-8e2f-04ed5885e5df tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:34.795411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7ce7c4ad-7506-4e85-8e2f-04ed5885e5df tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:34.803403 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7ce7c4ad-7506-4e85-8e2f-04ed5885e5df tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1507 microversion: 2.1 time: 0.087552 Oct 12 22:46:34.803982 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3757/6867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:34 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1507 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:34.913078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-dadde0d6-a62d-4630-a33e-c3772f2c30f3 req-289adfe3-d820-4d57-9869-551eabf89f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "939ea0f2-a100-4c6e-ada6-5cf434c39070", "name": "network-vif-deleted", "tag": "854b50ba-aecf-4eba-8674-0ce0052a117c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:34.923919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dadde0d6-a62d-4630-a33e-c3772f2c30f3 req-289adfe3-d820-4d57-9869-551eabf89f88 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:34.924410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dadde0d6-a62d-4630-a33e-c3772f2c30f3 req-289adfe3-d820-4d57-9869-551eabf89f88 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:34.924855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dadde0d6-a62d-4630-a33e-c3772f2c30f3 req-289adfe3-d820-4d57-9869-551eabf89f88 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:34.936930 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-dadde0d6-a62d-4630-a33e-c3772f2c30f3 req-289adfe3-d820-4d57-9869-551eabf89f88 service nova] Creating event network-vif-deleted:854b50ba-aecf-4eba-8674-0ce0052a117c for instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 on n-h1-861111-1 Oct 12 22:46:34.942564 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-dadde0d6-a62d-4630-a33e-c3772f2c30f3 req-289adfe3-d820-4d57-9869-551eabf89f88 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033501 Oct 12 22:46:34.943273 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3111/6868] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:35.827539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dfac9f79-8fff-42bb-99b7-04fd504b955f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:35.828162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dfac9f79-8fff-42bb-99b7-04fd504b955f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:35.837701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfac9f79-8fff-42bb-99b7-04fd504b955f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:35.838467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfac9f79-8fff-42bb-99b7-04fd504b955f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:35.838907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfac9f79-8fff-42bb-99b7-04fd504b955f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:35.839639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfac9f79-8fff-42bb-99b7-04fd504b955f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:35.840095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfac9f79-8fff-42bb-99b7-04fd504b955f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:35.840522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dfac9f79-8fff-42bb-99b7-04fd504b955f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:35.916634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dfac9f79-8fff-42bb-99b7-04fd504b955f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:35.925396 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dfac9f79-8fff-42bb-99b7-04fd504b955f tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1223 microversion: 2.1 time: 0.102092 Oct 12 22:46:35.925993 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3758/6869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:35 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:36.952253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3ae7bf99-5244-4683-b9a5-c623f6078c0d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:36.952816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3ae7bf99-5244-4683-b9a5-c623f6078c0d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:36.959996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ae7bf99-5244-4683-b9a5-c623f6078c0d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:36.960648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ae7bf99-5244-4683-b9a5-c623f6078c0d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:36.961135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ae7bf99-5244-4683-b9a5-c623f6078c0d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:36.961903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ae7bf99-5244-4683-b9a5-c623f6078c0d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:36.962627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ae7bf99-5244-4683-b9a5-c623f6078c0d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:36.963111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ae7bf99-5244-4683-b9a5-c623f6078c0d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:37.031597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3ae7bf99-5244-4683-b9a5-c623f6078c0d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:37.040707 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3ae7bf99-5244-4683-b9a5-c623f6078c0d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1223 microversion: 2.1 time: 0.094182 Oct 12 22:46:37.041349 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3112/6870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:36 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:37.630969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:37.633997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:37.641309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:37.641796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:37.642299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:37.643086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:37.643831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:37.644805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:37.736828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:46:37.737368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:46:37.737957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:46:37.738465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:46:37.738992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:46:37.828615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:37.838548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:37.839148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:37.839929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:37.840734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:37.841725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:37.841864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:37.875761 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a4bc7117-a257-42a3-bea4-2729d4c21f58 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1/action" status: 202 len: 1135 microversion: 2.1 time: 0.248207 Oct 12 22:46:37.877209 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3759/6871] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:46:37 2022] POST /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1/action => generated 1135 bytes in 251 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 12 22:46:37.900593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c5d00378-bc63-4c04-86de-70db02734639 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:37.901496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c5d00378-bc63-4c04-86de-70db02734639 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:37.911466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5d00378-bc63-4c04-86de-70db02734639 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:37.917291 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5d00378-bc63-4c04-86de-70db02734639 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:37.918118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5d00378-bc63-4c04-86de-70db02734639 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:37.919347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5d00378-bc63-4c04-86de-70db02734639 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:37.922021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5d00378-bc63-4c04-86de-70db02734639 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:37.922621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5d00378-bc63-4c04-86de-70db02734639 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:38.066914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-da71b79f-0d26-4270-a95e-b02c236ab267 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:38.067883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-da71b79f-0d26-4270-a95e-b02c236ab267 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:38.074534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da71b79f-0d26-4270-a95e-b02c236ab267 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:38.075026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da71b79f-0d26-4270-a95e-b02c236ab267 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:38.075491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da71b79f-0d26-4270-a95e-b02c236ab267 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:38.076430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da71b79f-0d26-4270-a95e-b02c236ab267 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:38.076890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da71b79f-0d26-4270-a95e-b02c236ab267 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:38.077522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da71b79f-0d26-4270-a95e-b02c236ab267 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:38.106640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c5d00378-bc63-4c04-86de-70db02734639 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:38.121787 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c5d00378-bc63-4c04-86de-70db02734639 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1689 microversion: 2.1 time: 0.225695 Oct 12 22:46:38.122573 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3113/6872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:37 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1689 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:38.170110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-da71b79f-0d26-4270-a95e-b02c236ab267 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:38.179862 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-da71b79f-0d26-4270-a95e-b02c236ab267 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1223 microversion: 2.1 time: 0.117946 Oct 12 22:46:38.180870 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3760/6873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:38 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1223 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:39.146219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9b1647fc-7402-4fea-830f-0ca470017c8d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:39.146829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9b1647fc-7402-4fea-830f-0ca470017c8d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:39.153678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b1647fc-7402-4fea-830f-0ca470017c8d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:39.154177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b1647fc-7402-4fea-830f-0ca470017c8d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:39.154635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b1647fc-7402-4fea-830f-0ca470017c8d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:39.155379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b1647fc-7402-4fea-830f-0ca470017c8d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:39.155850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b1647fc-7402-4fea-830f-0ca470017c8d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:39.156290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b1647fc-7402-4fea-830f-0ca470017c8d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:39.206705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-416309e5-f89a-4027-9f34-2af31476997c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:39.207370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-416309e5-f89a-4027-9f34-2af31476997c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:39.216741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-416309e5-f89a-4027-9f34-2af31476997c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:39.218361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-416309e5-f89a-4027-9f34-2af31476997c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:39.218809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-416309e5-f89a-4027-9f34-2af31476997c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:39.219998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-416309e5-f89a-4027-9f34-2af31476997c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:39.220839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-416309e5-f89a-4027-9f34-2af31476997c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:39.221505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-416309e5-f89a-4027-9f34-2af31476997c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:39.267627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-416309e5-f89a-4027-9f34-2af31476997c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:39.268124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-416309e5-f89a-4027-9f34-2af31476997c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:39.268569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-416309e5-f89a-4027-9f34-2af31476997c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:39.269024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-416309e5-f89a-4027-9f34-2af31476997c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lazy-loading 'fault' on Instance uuid 939ea0f2-a100-4c6e-ada6-5cf434c39070 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:46:39.314673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9b1647fc-7402-4fea-830f-0ca470017c8d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:39.319314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-416309e5-f89a-4027-9f34-2af31476997c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:39.325296 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9b1647fc-7402-4fea-830f-0ca470017c8d tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1689 microversion: 2.1 time: 0.183222 Oct 12 22:46:39.325873 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3114/6874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:39 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:39.327741 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-416309e5-f89a-4027-9f34-2af31476997c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 200 len: 1228 microversion: 2.1 time: 0.124862 Oct 12 22:46:39.328487 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3761/6875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:39 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 1228 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:40.349821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fee02f57-ad6c-4276-8bb8-6530963a1bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:40.350543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9fc2787f-1fbc-4b69-aeed-ead21ddff528 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:40.350930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fee02f57-ad6c-4276-8bb8-6530963a1bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:40.351036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9fc2787f-1fbc-4b69-aeed-ead21ddff528 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:40.357268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fee02f57-ad6c-4276-8bb8-6530963a1bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:40.357410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fc2787f-1fbc-4b69-aeed-ead21ddff528 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:40.357746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fee02f57-ad6c-4276-8bb8-6530963a1bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:40.357854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fc2787f-1fbc-4b69-aeed-ead21ddff528 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:40.358177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fee02f57-ad6c-4276-8bb8-6530963a1bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:40.358269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fc2787f-1fbc-4b69-aeed-ead21ddff528 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:40.358889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fee02f57-ad6c-4276-8bb8-6530963a1bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:40.359020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fc2787f-1fbc-4b69-aeed-ead21ddff528 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:40.359385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fc2787f-1fbc-4b69-aeed-ead21ddff528 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:40.359513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fee02f57-ad6c-4276-8bb8-6530963a1bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:40.359810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fee02f57-ad6c-4276-8bb8-6530963a1bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:40.359912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9fc2787f-1fbc-4b69-aeed-ead21ddff528 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:40.373154 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-fee02f57-ad6c-4276-8bb8-6530963a1bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] HTTP exception thrown: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fee02f57-ad6c-4276-8bb8-6530963a1bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Request method failure captured: Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 HTTP/1.1 Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0IharzkU0EI5od_tYFYiimWbIhiU_Z2qWiELggh5UckxeqrnYnnrwzymqi7TUfpjzQhGi9AT7nHEyzZohAJui-4vZv6nTEy801Fmq2zP90o12d8oz0UHjyBxm9MxKWeYUrTwr-9KmypVoqQEOknLfZ_qBqmv_P1kjCeo-X5DoGtv6Y Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef79a1f4c33c46f1a7536c37f910e2b0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7d141d93d7a74a57b5b6475294c9af5e Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '939ea0f2-a100-4c6e-ada6-5cf434c39070'} Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:40.374848 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:46:40.379129 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:40.379129 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:40.379129 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:40.379129 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:46:40.379129 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:46:40.379129 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. Oct 12 22:46:40.379129 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:46:40.379129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fee02f57-ad6c-4276-8bb8-6530963a1bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Returning 404 to user: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:46:40.379129 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fee02f57-ad6c-4276-8bb8-6530963a1bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 404 len: 111 microversion: 2.1 time: 0.030413 Oct 12 22:46:40.379129 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3762/6876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:40 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:46:40.427573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-608848890", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-96398279", "security_groups": [{"name": "tempest-secgroup-smoke-1530106101"}], "block_device_mapping_v2": [{"uuid": "71d9bebe-e5de-45a7-9dbc-7b33dd89d9b7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6d173dd3-914e-48d4-bcc2-81061c8da03d"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:40.498773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9fc2787f-1fbc-4b69-aeed-ead21ddff528 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:40.509470 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9fc2787f-1fbc-4b69-aeed-ead21ddff528 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1689 microversion: 2.1 time: 0.163551 Oct 12 22:46:40.510053 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3115/6877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:40 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:40.542904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] validate_networks() for [('6d173dd3-914e-48d4-bcc2-81061c8da03d', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:46:40.905055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:46:40.905486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:46:40.905970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:46:40.906388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:46:40.906805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:46:40.916342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:40.916781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:40.917219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:40.917964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:40.918414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:40.918839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:40.935768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:46:40.940887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for user 7d141d93d7a74a57b5b6475294c9af5e and project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:46:40.999460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:46:41.001669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='71d9bebe-e5de-45a7-9dbc-7b33dd89d9b7',volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:46:41.127491 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b935a1ee-dd78-4489-80bd-2fb63ce57138 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.704377 Oct 12 22:46:41.128172 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3763/6878] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:46:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:46:41.139337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-714b5936-5288-4a5b-972c-36498637f676 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:41.139975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-714b5936-5288-4a5b-972c-36498637f676 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:41.194721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-714b5936-5288-4a5b-972c-36498637f676 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:41.201721 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-714b5936-5288-4a5b-972c-36498637f676 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1092 microversion: 2.1 time: 0.066271 Oct 12 22:46:41.210613 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3116/6879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:41 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1092 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:41.533729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dc068da3-f98c-4f82-95bd-458d88f6429f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:41.534353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dc068da3-f98c-4f82-95bd-458d88f6429f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:41.540542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc068da3-f98c-4f82-95bd-458d88f6429f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:41.541030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc068da3-f98c-4f82-95bd-458d88f6429f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:41.541471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc068da3-f98c-4f82-95bd-458d88f6429f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:41.542171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc068da3-f98c-4f82-95bd-458d88f6429f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:41.542634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc068da3-f98c-4f82-95bd-458d88f6429f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:41.543160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc068da3-f98c-4f82-95bd-458d88f6429f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:41.681172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dc068da3-f98c-4f82-95bd-458d88f6429f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:41.689225 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dc068da3-f98c-4f82-95bd-458d88f6429f tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1689 microversion: 2.1 time: 0.160353 Oct 12 22:46:41.689803 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3764/6880] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:41 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:42.224713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-959b9067-bbf1-48a7-9703-f81d79b60427 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:42.225342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-959b9067-bbf1-48a7-9703-f81d79b60427 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:42.233044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-959b9067-bbf1-48a7-9703-f81d79b60427 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:42.233559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-959b9067-bbf1-48a7-9703-f81d79b60427 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:42.234097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-959b9067-bbf1-48a7-9703-f81d79b60427 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:42.234874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-959b9067-bbf1-48a7-9703-f81d79b60427 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:42.235384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-959b9067-bbf1-48a7-9703-f81d79b60427 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:42.235825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-959b9067-bbf1-48a7-9703-f81d79b60427 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:42.320162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-959b9067-bbf1-48a7-9703-f81d79b60427 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:42.328972 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-959b9067-bbf1-48a7-9703-f81d79b60427 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1190 microversion: 2.1 time: 0.108084 Oct 12 22:46:42.329729 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3117/6881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:42 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1190 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:42.715331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-93f193f8-7e39-41d8-acf3-26eb7fd185b7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:42.715965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-93f193f8-7e39-41d8-acf3-26eb7fd185b7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:42.723680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93f193f8-7e39-41d8-acf3-26eb7fd185b7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:42.724160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93f193f8-7e39-41d8-acf3-26eb7fd185b7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:42.724588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93f193f8-7e39-41d8-acf3-26eb7fd185b7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:42.725615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93f193f8-7e39-41d8-acf3-26eb7fd185b7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:42.726108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93f193f8-7e39-41d8-acf3-26eb7fd185b7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:42.726572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93f193f8-7e39-41d8-acf3-26eb7fd185b7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:42.893379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-93f193f8-7e39-41d8-acf3-26eb7fd185b7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:42.902998 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-93f193f8-7e39-41d8-acf3-26eb7fd185b7 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1689 microversion: 2.1 time: 0.192794 Oct 12 22:46:42.903800 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3765/6882] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:42 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1689 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:43.356276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-022ce909-6d0b-486f-899b-33e026406b43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:43.357265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-022ce909-6d0b-486f-899b-33e026406b43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:43.364929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-022ce909-6d0b-486f-899b-33e026406b43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:43.365428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-022ce909-6d0b-486f-899b-33e026406b43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:43.365903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-022ce909-6d0b-486f-899b-33e026406b43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:43.366648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-022ce909-6d0b-486f-899b-33e026406b43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:43.367115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-022ce909-6d0b-486f-899b-33e026406b43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:43.367580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-022ce909-6d0b-486f-899b-33e026406b43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:43.592635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-022ce909-6d0b-486f-899b-33e026406b43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:43.601686 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-022ce909-6d0b-486f-899b-33e026406b43 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1276 microversion: 2.1 time: 0.249485 Oct 12 22:46:43.602831 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3118/6883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:43 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1276 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:43.937806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-63df7365-d7dd-4466-bec7-f2cdb49e61fe req-a1408db7-efdd-424a-bc67-8e2b88c8591f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "275a1602-666d-406c-a460-24dad702174c", "tag": "9e9b85c3-5938-4d68-bcbf-11cc5cf40741"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:43.938496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1f18be5-b57b-444e-b749-fac12088c5cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:43.946414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a1f18be5-b57b-444e-b749-fac12088c5cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:43.952839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1f18be5-b57b-444e-b749-fac12088c5cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:43.956009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1f18be5-b57b-444e-b749-fac12088c5cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:43.956009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1f18be5-b57b-444e-b749-fac12088c5cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:43.957369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1f18be5-b57b-444e-b749-fac12088c5cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:43.957854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1f18be5-b57b-444e-b749-fac12088c5cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:43.958304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1f18be5-b57b-444e-b749-fac12088c5cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:43.961575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-63df7365-d7dd-4466-bec7-f2cdb49e61fe req-a1408db7-efdd-424a-bc67-8e2b88c8591f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:43.962562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-63df7365-d7dd-4466-bec7-f2cdb49e61fe req-a1408db7-efdd-424a-bc67-8e2b88c8591f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:43.963510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-63df7365-d7dd-4466-bec7-f2cdb49e61fe req-a1408db7-efdd-424a-bc67-8e2b88c8591f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:43.978040 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-63df7365-d7dd-4466-bec7-f2cdb49e61fe req-a1408db7-efdd-424a-bc67-8e2b88c8591f service nova] Creating event network-changed:9e9b85c3-5938-4d68-bcbf-11cc5cf40741 for instance 275a1602-666d-406c-a460-24dad702174c on n-h2-861111-1 Oct 12 22:46:43.983625 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-63df7365-d7dd-4466-bec7-f2cdb49e61fe req-a1408db7-efdd-424a-bc67-8e2b88c8591f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145905 Oct 12 22:46:43.985307 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3766/6884] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:44.537302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a1f18be5-b57b-444e-b749-fac12088c5cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:44.545827 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a1f18be5-b57b-444e-b749-fac12088c5cd tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1689 microversion: 2.1 time: 0.622157 Oct 12 22:46:44.546641 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3119/6885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:43 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1689 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:44.626511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9fecfe10-dcd2-4246-9a60-eae3babfe1c0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:44.627370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9fecfe10-dcd2-4246-9a60-eae3babfe1c0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:44.633955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9fecfe10-dcd2-4246-9a60-eae3babfe1c0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:44.634745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9fecfe10-dcd2-4246-9a60-eae3babfe1c0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:44.635277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9fecfe10-dcd2-4246-9a60-eae3babfe1c0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:44.635975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9fecfe10-dcd2-4246-9a60-eae3babfe1c0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:44.636444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9fecfe10-dcd2-4246-9a60-eae3babfe1c0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:44.636852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9fecfe10-dcd2-4246-9a60-eae3babfe1c0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:44.812335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9fecfe10-dcd2-4246-9a60-eae3babfe1c0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:44.821387 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9fecfe10-dcd2-4246-9a60-eae3babfe1c0 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1276 microversion: 2.1 time: 0.199387 Oct 12 22:46:44.822481 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3767/6886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:44 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1276 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:45.570452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7d883522-f762-45ba-ae22-11378b80c39b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:45.571808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7d883522-f762-45ba-ae22-11378b80c39b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:45.578944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d883522-f762-45ba-ae22-11378b80c39b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:45.579673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d883522-f762-45ba-ae22-11378b80c39b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:45.580292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d883522-f762-45ba-ae22-11378b80c39b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:45.581176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d883522-f762-45ba-ae22-11378b80c39b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:45.581946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d883522-f762-45ba-ae22-11378b80c39b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:45.582469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d883522-f762-45ba-ae22-11378b80c39b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:45.830354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7d883522-f762-45ba-ae22-11378b80c39b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:45.842316 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7d883522-f762-45ba-ae22-11378b80c39b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1689 microversion: 2.1 time: 0.275763 Oct 12 22:46:45.843145 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3120/6887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:45 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1689 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:45.850049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4e6d9ed0-fa69-4803-91a9-7398df623986 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:45.850903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4e6d9ed0-fa69-4803-91a9-7398df623986 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:45.860131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e6d9ed0-fa69-4803-91a9-7398df623986 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:45.860736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e6d9ed0-fa69-4803-91a9-7398df623986 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:45.861411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e6d9ed0-fa69-4803-91a9-7398df623986 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:45.862399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e6d9ed0-fa69-4803-91a9-7398df623986 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:45.862878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e6d9ed0-fa69-4803-91a9-7398df623986 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:45.863817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e6d9ed0-fa69-4803-91a9-7398df623986 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:46.000683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4e6d9ed0-fa69-4803-91a9-7398df623986 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:46.009265 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4e6d9ed0-fa69-4803-91a9-7398df623986 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1276 microversion: 2.1 time: 0.167092 Oct 12 22:46:46.009843 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3768/6888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:45 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:46.866246 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-280a1fe0-e1e0-4c30-880f-42d85471c6c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:46.866786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-280a1fe0-e1e0-4c30-880f-42d85471c6c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:46.874520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-280a1fe0-e1e0-4c30-880f-42d85471c6c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:46.875027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-280a1fe0-e1e0-4c30-880f-42d85471c6c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:46.875517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-280a1fe0-e1e0-4c30-880f-42d85471c6c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:46.876447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-280a1fe0-e1e0-4c30-880f-42d85471c6c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:46.876925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-280a1fe0-e1e0-4c30-880f-42d85471c6c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:46.877374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-280a1fe0-e1e0-4c30-880f-42d85471c6c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:47.033557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fc6dfa4b-ce4c-4e16-9cb1-87bbf96adcbc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:47.034195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fc6dfa4b-ce4c-4e16-9cb1-87bbf96adcbc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:47.048229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc6dfa4b-ce4c-4e16-9cb1-87bbf96adcbc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:47.048483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc6dfa4b-ce4c-4e16-9cb1-87bbf96adcbc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:47.048933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc6dfa4b-ce4c-4e16-9cb1-87bbf96adcbc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:47.049656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc6dfa4b-ce4c-4e16-9cb1-87bbf96adcbc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:47.050119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc6dfa4b-ce4c-4e16-9cb1-87bbf96adcbc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:47.050554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc6dfa4b-ce4c-4e16-9cb1-87bbf96adcbc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:47.160193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-280a1fe0-e1e0-4c30-880f-42d85471c6c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:47.170388 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-280a1fe0-e1e0-4c30-880f-42d85471c6c1 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1689 microversion: 2.1 time: 0.308082 Oct 12 22:46:47.187537 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3121/6889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:46 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1689 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:47.187537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ba0be6d9-02c4-4962-856f-931617eb8d1f tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:47.187537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ba0be6d9-02c4-4962-856f-931617eb8d1f tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:47.187537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0be6d9-02c4-4962-856f-931617eb8d1f tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:47.187537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0be6d9-02c4-4962-856f-931617eb8d1f tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:47.187537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0be6d9-02c4-4962-856f-931617eb8d1f tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:47.187537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0be6d9-02c4-4962-856f-931617eb8d1f tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:47.187537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0be6d9-02c4-4962-856f-931617eb8d1f tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:47.187537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0be6d9-02c4-4962-856f-931617eb8d1f tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:47.215333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ba0be6d9-02c4-4962-856f-931617eb8d1f tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:46:47.232108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fc6dfa4b-ce4c-4e16-9cb1-87bbf96adcbc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:47.241144 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fc6dfa4b-ce4c-4e16-9cb1-87bbf96adcbc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1276 microversion: 2.1 time: 0.213177 Oct 12 22:46:47.255679 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3769/6890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:47 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1276 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:47.264503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-eb8cf21f-2c95-47df-ab9b-cdac2cca1b07 req-26e50210-6d9e-4d17-a131-6f1b55c9a91e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "923106e7-a75e-4c43-8a30-3d406d22fe29", "tag": "4b02bf31-1792-4338-884a-2dab9161ff7c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:47.275068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-eb8cf21f-2c95-47df-ab9b-cdac2cca1b07 req-26e50210-6d9e-4d17-a131-6f1b55c9a91e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:47.275590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-eb8cf21f-2c95-47df-ab9b-cdac2cca1b07 req-26e50210-6d9e-4d17-a131-6f1b55c9a91e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:47.276027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-eb8cf21f-2c95-47df-ab9b-cdac2cca1b07 req-26e50210-6d9e-4d17-a131-6f1b55c9a91e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:47.287883 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-eb8cf21f-2c95-47df-ab9b-cdac2cca1b07 req-26e50210-6d9e-4d17-a131-6f1b55c9a91e service nova] Creating event network-changed:4b02bf31-1792-4338-884a-2dab9161ff7c for instance 923106e7-a75e-4c43-8a30-3d406d22fe29 on n-h1-861111-1 Oct 12 22:46:47.293652 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-eb8cf21f-2c95-47df-ab9b-cdac2cca1b07 req-26e50210-6d9e-4d17-a131-6f1b55c9a91e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036662 Oct 12 22:46:47.294844 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3770/6891] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:47.327457 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ba0be6d9-02c4-4962-856f-931617eb8d1f tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "DELETE /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 204 len: 0 microversion: 2.1 time: 0.155012 Oct 12 22:46:47.331391 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3122/6892] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:46:47 2022] DELETE /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:46:47.337668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-904cce59-bf3c-41d2-9dc0-8d69142260a9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:47.338677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-904cce59-bf3c-41d2-9dc0-8d69142260a9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:47.346150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-904cce59-bf3c-41d2-9dc0-8d69142260a9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:47.346700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-904cce59-bf3c-41d2-9dc0-8d69142260a9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:47.347177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-904cce59-bf3c-41d2-9dc0-8d69142260a9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:47.348020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-904cce59-bf3c-41d2-9dc0-8d69142260a9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:47.348481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-904cce59-bf3c-41d2-9dc0-8d69142260a9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:47.349141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-904cce59-bf3c-41d2-9dc0-8d69142260a9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:47.513654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-904cce59-bf3c-41d2-9dc0-8d69142260a9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:47.523006 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-904cce59-bf3c-41d2-9dc0-8d69142260a9 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1582 microversion: 2.1 time: 0.189779 Oct 12 22:46:47.523611 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3771/6893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:47 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1582 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:46:48.199174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a5497907-9533-46fa-96fd-29daab0d1672 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:48.199929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a5497907-9533-46fa-96fd-29daab0d1672 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:48.207977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5497907-9533-46fa-96fd-29daab0d1672 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:48.208475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5497907-9533-46fa-96fd-29daab0d1672 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:48.209131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5497907-9533-46fa-96fd-29daab0d1672 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:48.210190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5497907-9533-46fa-96fd-29daab0d1672 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:48.210809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5497907-9533-46fa-96fd-29daab0d1672 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:48.211305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5497907-9533-46fa-96fd-29daab0d1672 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:48.269190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9ef84558-2354-42d5-9c62-4f3c04091b40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:48.269873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9ef84558-2354-42d5-9c62-4f3c04091b40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:48.277195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ef84558-2354-42d5-9c62-4f3c04091b40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:48.277715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ef84558-2354-42d5-9c62-4f3c04091b40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:48.278157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ef84558-2354-42d5-9c62-4f3c04091b40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:48.278881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ef84558-2354-42d5-9c62-4f3c04091b40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:48.279366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ef84558-2354-42d5-9c62-4f3c04091b40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:48.279794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ef84558-2354-42d5-9c62-4f3c04091b40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:48.364586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a5497907-9533-46fa-96fd-29daab0d1672 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:48.367793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:48.372996 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a5497907-9533-46fa-96fd-29daab0d1672 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1689 microversion: 2.1 time: 0.178344 Oct 12 22:46:48.373623 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3123/6894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:48 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:48.420348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9ef84558-2354-42d5-9c62-4f3c04091b40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:48.424152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:48.429455 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9ef84558-2354-42d5-9c62-4f3c04091b40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1264 microversion: 2.1 time: 0.164372 Oct 12 22:46:48.430032 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3772/6895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:48 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:46:48.551685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9c0c0223-463f-406a-a8fc-df58a340cd90 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:48.552321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9c0c0223-463f-406a-a8fc-df58a340cd90 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:48.559683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c0c0223-463f-406a-a8fc-df58a340cd90 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:48.559936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c0c0223-463f-406a-a8fc-df58a340cd90 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:48.560388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c0c0223-463f-406a-a8fc-df58a340cd90 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:48.561105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c0c0223-463f-406a-a8fc-df58a340cd90 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:48.561602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c0c0223-463f-406a-a8fc-df58a340cd90 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:48.562043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c0c0223-463f-406a-a8fc-df58a340cd90 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:48.690368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9c0c0223-463f-406a-a8fc-df58a340cd90 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:48.698710 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9c0c0223-463f-406a-a8fc-df58a340cd90 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1582 microversion: 2.1 time: 0.151020 Oct 12 22:46:48.699295 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3124/6896] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:48 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1582 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:49.399036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ae388437-d251-41fb-964f-3166b91fc469 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:49.399913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ae388437-d251-41fb-964f-3166b91fc469 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:49.407597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae388437-d251-41fb-964f-3166b91fc469 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:49.408062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae388437-d251-41fb-964f-3166b91fc469 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:49.408507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae388437-d251-41fb-964f-3166b91fc469 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:49.409293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae388437-d251-41fb-964f-3166b91fc469 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:49.409786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae388437-d251-41fb-964f-3166b91fc469 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:49.410217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae388437-d251-41fb-964f-3166b91fc469 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:49.453480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-edd08e4e-5c1f-4a0f-813b-83dfc0074e30 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:49.454753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-edd08e4e-5c1f-4a0f-813b-83dfc0074e30 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:49.462397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-edd08e4e-5c1f-4a0f-813b-83dfc0074e30 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:49.462927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-edd08e4e-5c1f-4a0f-813b-83dfc0074e30 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:49.463725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-edd08e4e-5c1f-4a0f-813b-83dfc0074e30 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:49.464445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-edd08e4e-5c1f-4a0f-813b-83dfc0074e30 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:49.464907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-edd08e4e-5c1f-4a0f-813b-83dfc0074e30 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:49.465353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-edd08e4e-5c1f-4a0f-813b-83dfc0074e30 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:49.546418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ae388437-d251-41fb-964f-3166b91fc469 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:49.554421 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ae388437-d251-41fb-964f-3166b91fc469 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1689 microversion: 2.1 time: 0.160453 Oct 12 22:46:49.555144 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3773/6897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:49 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:49.695395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-edd08e4e-5c1f-4a0f-813b-83dfc0074e30 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:49.703303 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-edd08e4e-5c1f-4a0f-813b-83dfc0074e30 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1264 microversion: 2.1 time: 0.253828 Oct 12 22:46:49.704117 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3125/6898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:49 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1264 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:49.724991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-68aca46d-0bbe-453a-a59f-30d02f06c0ba tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:49.725635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-68aca46d-0bbe-453a-a59f-30d02f06c0ba tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:49.731611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68aca46d-0bbe-453a-a59f-30d02f06c0ba tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:49.732093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68aca46d-0bbe-453a-a59f-30d02f06c0ba tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:49.732537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68aca46d-0bbe-453a-a59f-30d02f06c0ba tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:49.733228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68aca46d-0bbe-453a-a59f-30d02f06c0ba tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:49.733687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68aca46d-0bbe-453a-a59f-30d02f06c0ba tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:49.734114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68aca46d-0bbe-453a-a59f-30d02f06c0ba tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:49.873221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-68aca46d-0bbe-453a-a59f-30d02f06c0ba tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:49.882375 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-68aca46d-0bbe-453a-a59f-30d02f06c0ba tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1464 microversion: 2.1 time: 0.161707 Oct 12 22:46:49.894996 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3774/6899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:49 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1464 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:49.960645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-af0e12b6-ae89-41f1-9547-af23b5c9e7f6 req-de138eb3-5f31-4d32-a0e2-afcf7d1bf0ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923106e7-a75e-4c43-8a30-3d406d22fe29", "name": "network-vif-deleted", "tag": "4b02bf31-1792-4338-884a-2dab9161ff7c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:49.970952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-af0e12b6-ae89-41f1-9547-af23b5c9e7f6 req-de138eb3-5f31-4d32-a0e2-afcf7d1bf0ab service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:49.971584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-af0e12b6-ae89-41f1-9547-af23b5c9e7f6 req-de138eb3-5f31-4d32-a0e2-afcf7d1bf0ab service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:49.972031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-af0e12b6-ae89-41f1-9547-af23b5c9e7f6 req-de138eb3-5f31-4d32-a0e2-afcf7d1bf0ab service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:49.983668 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-af0e12b6-ae89-41f1-9547-af23b5c9e7f6 req-de138eb3-5f31-4d32-a0e2-afcf7d1bf0ab service nova] Creating event network-vif-deleted:4b02bf31-1792-4338-884a-2dab9161ff7c for instance 923106e7-a75e-4c43-8a30-3d406d22fe29 on n-h1-861111-1 Oct 12 22:46:49.988804 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-af0e12b6-ae89-41f1-9547-af23b5c9e7f6 req-de138eb3-5f31-4d32-a0e2-afcf7d1bf0ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032462 Oct 12 22:46:49.989900 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3126/6900] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:50.578071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-970a7b26-6f0d-4ac4-b4b6-e2791c4e8ccb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:50.578596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-970a7b26-6f0d-4ac4-b4b6-e2791c4e8ccb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:50.585545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-970a7b26-6f0d-4ac4-b4b6-e2791c4e8ccb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:50.586044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-970a7b26-6f0d-4ac4-b4b6-e2791c4e8ccb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:50.586487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-970a7b26-6f0d-4ac4-b4b6-e2791c4e8ccb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:50.587184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-970a7b26-6f0d-4ac4-b4b6-e2791c4e8ccb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:50.587675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-970a7b26-6f0d-4ac4-b4b6-e2791c4e8ccb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:50.588350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-970a7b26-6f0d-4ac4-b4b6-e2791c4e8ccb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:50.720910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-970a7b26-6f0d-4ac4-b4b6-e2791c4e8ccb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:50.728576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d01af646-b5e6-4e6b-b4c5-11ec76c60bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:50.729209 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-970a7b26-6f0d-4ac4-b4b6-e2791c4e8ccb tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1695 microversion: 2.1 time: 0.155077 Oct 12 22:46:50.729426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d01af646-b5e6-4e6b-b4c5-11ec76c60bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:50.729986 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3775/6901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:50 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:50.735626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d01af646-b5e6-4e6b-b4c5-11ec76c60bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:50.736122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d01af646-b5e6-4e6b-b4c5-11ec76c60bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:50.736568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d01af646-b5e6-4e6b-b4c5-11ec76c60bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:50.737277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d01af646-b5e6-4e6b-b4c5-11ec76c60bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:50.737737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d01af646-b5e6-4e6b-b4c5-11ec76c60bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:50.738170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d01af646-b5e6-4e6b-b4c5-11ec76c60bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:50.884012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d01af646-b5e6-4e6b-b4c5-11ec76c60bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:50.891948 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d01af646-b5e6-4e6b-b4c5-11ec76c60bca tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1264 microversion: 2.1 time: 0.168404 Oct 12 22:46:50.892523 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3127/6902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:50 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:46:50.909239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2c602821-aeaf-4e0a-8a8e-8fe5cc1c7fd3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:50.910088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2c602821-aeaf-4e0a-8a8e-8fe5cc1c7fd3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:50.916128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c602821-aeaf-4e0a-8a8e-8fe5cc1c7fd3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:50.916609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c602821-aeaf-4e0a-8a8e-8fe5cc1c7fd3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:50.917042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c602821-aeaf-4e0a-8a8e-8fe5cc1c7fd3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:50.917728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c602821-aeaf-4e0a-8a8e-8fe5cc1c7fd3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:50.918231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c602821-aeaf-4e0a-8a8e-8fe5cc1c7fd3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:50.918829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2c602821-aeaf-4e0a-8a8e-8fe5cc1c7fd3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:50.933899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:50.950016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:50.982420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2c602821-aeaf-4e0a-8a8e-8fe5cc1c7fd3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:50.990861 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2c602821-aeaf-4e0a-8a8e-8fe5cc1c7fd3 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1229 microversion: 2.1 time: 0.085569 Oct 12 22:46:50.991566 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3776/6903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:50 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1229 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:51.753451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-810bcb51-c43e-4182-b45e-b0facbae9786 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:51.754116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-810bcb51-c43e-4182-b45e-b0facbae9786 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:51.756166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:51.762930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-810bcb51-c43e-4182-b45e-b0facbae9786 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:51.763458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-810bcb51-c43e-4182-b45e-b0facbae9786 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:51.763921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-810bcb51-c43e-4182-b45e-b0facbae9786 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:51.764646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-810bcb51-c43e-4182-b45e-b0facbae9786 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:51.765116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-810bcb51-c43e-4182-b45e-b0facbae9786 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:51.765555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-810bcb51-c43e-4182-b45e-b0facbae9786 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:51.897292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-810bcb51-c43e-4182-b45e-b0facbae9786 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:51.905138 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-810bcb51-c43e-4182-b45e-b0facbae9786 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1695 microversion: 2.1 time: 0.155705 Oct 12 22:46:51.905717 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3128/6904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:51 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:51.916231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7154c813-f8d1-4abc-a408-6f218a0ea76c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:51.916933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7154c813-f8d1-4abc-a408-6f218a0ea76c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:51.923470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7154c813-f8d1-4abc-a408-6f218a0ea76c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:51.924043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7154c813-f8d1-4abc-a408-6f218a0ea76c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:51.924918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7154c813-f8d1-4abc-a408-6f218a0ea76c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:51.925341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7154c813-f8d1-4abc-a408-6f218a0ea76c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:51.925873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7154c813-f8d1-4abc-a408-6f218a0ea76c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:51.926605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7154c813-f8d1-4abc-a408-6f218a0ea76c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:52.014333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ecf5c6a0-c3af-4e87-a38e-89730517ce1b tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:52.022077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ecf5c6a0-c3af-4e87-a38e-89730517ce1b tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:52.032136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecf5c6a0-c3af-4e87-a38e-89730517ce1b tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:52.032779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecf5c6a0-c3af-4e87-a38e-89730517ce1b tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:52.033331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecf5c6a0-c3af-4e87-a38e-89730517ce1b tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:52.034577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecf5c6a0-c3af-4e87-a38e-89730517ce1b tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:52.034696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecf5c6a0-c3af-4e87-a38e-89730517ce1b tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:52.035310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecf5c6a0-c3af-4e87-a38e-89730517ce1b tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:52.066017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7154c813-f8d1-4abc-a408-6f218a0ea76c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:52.074690 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7154c813-f8d1-4abc-a408-6f218a0ea76c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1264 microversion: 2.1 time: 0.164106 Oct 12 22:46:52.087335 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3777/6905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:51 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:52.104583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ecf5c6a0-c3af-4e87-a38e-89730517ce1b tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:52.112469 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ecf5c6a0-c3af-4e87-a38e-89730517ce1b tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1229 microversion: 2.1 time: 0.102103 Oct 12 22:46:52.113045 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3129/6906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:52 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:52.929937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe3e5b9f-62a0-4ca7-bf5f-bb0907817259 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:52.930584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fe3e5b9f-62a0-4ca7-bf5f-bb0907817259 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:52.937867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe3e5b9f-62a0-4ca7-bf5f-bb0907817259 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:52.938364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe3e5b9f-62a0-4ca7-bf5f-bb0907817259 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:52.938801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe3e5b9f-62a0-4ca7-bf5f-bb0907817259 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:52.939533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe3e5b9f-62a0-4ca7-bf5f-bb0907817259 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:52.939991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe3e5b9f-62a0-4ca7-bf5f-bb0907817259 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:52.940419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe3e5b9f-62a0-4ca7-bf5f-bb0907817259 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:53.075527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fe3e5b9f-62a0-4ca7-bf5f-bb0907817259 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:53.083440 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fe3e5b9f-62a0-4ca7-bf5f-bb0907817259 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1695 microversion: 2.1 time: 0.158069 Oct 12 22:46:53.084012 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3778/6907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:52 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:53.097756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-08d50549-6cfc-49be-8127-4e494b14935e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:53.098972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-08d50549-6cfc-49be-8127-4e494b14935e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:53.105854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08d50549-6cfc-49be-8127-4e494b14935e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:53.106352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08d50549-6cfc-49be-8127-4e494b14935e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:53.106801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08d50549-6cfc-49be-8127-4e494b14935e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:53.107535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08d50549-6cfc-49be-8127-4e494b14935e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:53.108004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08d50549-6cfc-49be-8127-4e494b14935e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:53.108444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08d50549-6cfc-49be-8127-4e494b14935e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:53.135433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6de0d496-679a-4d90-82c4-dd535c270051 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:53.136064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6de0d496-679a-4d90-82c4-dd535c270051 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:53.144061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6de0d496-679a-4d90-82c4-dd535c270051 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:53.144560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6de0d496-679a-4d90-82c4-dd535c270051 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:53.145002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6de0d496-679a-4d90-82c4-dd535c270051 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:53.146312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6de0d496-679a-4d90-82c4-dd535c270051 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:53.146768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6de0d496-679a-4d90-82c4-dd535c270051 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:53.147277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6de0d496-679a-4d90-82c4-dd535c270051 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:53.214123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6de0d496-679a-4d90-82c4-dd535c270051 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:53.222428 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6de0d496-679a-4d90-82c4-dd535c270051 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1229 microversion: 2.1 time: 0.090857 Oct 12 22:46:53.223032 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3779/6908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:53 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1229 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:46:53.252637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-08d50549-6cfc-49be-8127-4e494b14935e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:53.261092 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-08d50549-6cfc-49be-8127-4e494b14935e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1264 microversion: 2.1 time: 0.167169 Oct 12 22:46:53.261671 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3130/6909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:53 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:54.108003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5c4e553e-4d85-4150-92df-e4404df7921a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:54.108758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5c4e553e-4d85-4150-92df-e4404df7921a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:54.116260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c4e553e-4d85-4150-92df-e4404df7921a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:54.116957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c4e553e-4d85-4150-92df-e4404df7921a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:54.117521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c4e553e-4d85-4150-92df-e4404df7921a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:54.119247 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c4e553e-4d85-4150-92df-e4404df7921a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:54.119540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c4e553e-4d85-4150-92df-e4404df7921a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:54.120118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c4e553e-4d85-4150-92df-e4404df7921a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:54.246027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-22ec9527-f36b-4f3a-9436-d1f8d88aac18 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:54.246941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-22ec9527-f36b-4f3a-9436-d1f8d88aac18 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:54.254016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22ec9527-f36b-4f3a-9436-d1f8d88aac18 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:54.254618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22ec9527-f36b-4f3a-9436-d1f8d88aac18 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:54.255695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22ec9527-f36b-4f3a-9436-d1f8d88aac18 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:54.256971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22ec9527-f36b-4f3a-9436-d1f8d88aac18 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:54.257519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22ec9527-f36b-4f3a-9436-d1f8d88aac18 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:54.258037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22ec9527-f36b-4f3a-9436-d1f8d88aac18 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:54.267764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5c4e553e-4d85-4150-92df-e4404df7921a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:54.276467 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5c4e553e-4d85-4150-92df-e4404df7921a tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1680 microversion: 2.1 time: 0.172713 Oct 12 22:46:54.277083 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3780/6910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:54 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:54.284295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-22d2dfcd-af42-4732-b076-1a2461da3c79 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:54.284904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-22d2dfcd-af42-4732-b076-1a2461da3c79 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:54.290888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22d2dfcd-af42-4732-b076-1a2461da3c79 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:54.291101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22ec9527-f36b-4f3a-9436-d1f8d88aac18 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:54.291402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22d2dfcd-af42-4732-b076-1a2461da3c79 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:54.291840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22d2dfcd-af42-4732-b076-1a2461da3c79 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:54.291961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22ec9527-f36b-4f3a-9436-d1f8d88aac18 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:54.292464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22ec9527-f36b-4f3a-9436-d1f8d88aac18 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:54.292570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22d2dfcd-af42-4732-b076-1a2461da3c79 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:54.292963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22d2dfcd-af42-4732-b076-1a2461da3c79 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:54.293184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-22ec9527-f36b-4f3a-9436-d1f8d88aac18 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lazy-loading 'fault' on Instance uuid 923106e7-a75e-4c43-8a30-3d406d22fe29 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:46:54.293386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22d2dfcd-af42-4732-b076-1a2461da3c79 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:54.370331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-22ec9527-f36b-4f3a-9436-d1f8d88aac18 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14719be7020488b828f998d587df3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aa1e29deaa421e835d1773dd3210d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:54.378511 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-22ec9527-f36b-4f3a-9436-d1f8d88aac18 tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 200 len: 1234 microversion: 2.1 time: 0.136425 Oct 12 22:46:54.379101 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3131/6911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:54 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 1234 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:46:54.432666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-22d2dfcd-af42-4732-b076-1a2461da3c79 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:54.440420 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-22d2dfcd-af42-4732-b076-1a2461da3c79 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1264 microversion: 2.1 time: 0.159832 Oct 12 22:46:54.440989 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3781/6912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:54 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:55.402981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-57ea56c3-f670-488c-9554-96cc4ba5a8dc tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:55.403582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-57ea56c3-f670-488c-9554-96cc4ba5a8dc tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] [instance: 923106e7-a75e-4c43-8a30-3d406d22fe29] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:55.410459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57ea56c3-f670-488c-9554-96cc4ba5a8dc tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:55.410958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57ea56c3-f670-488c-9554-96cc4ba5a8dc tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:55.411443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57ea56c3-f670-488c-9554-96cc4ba5a8dc tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:55.412153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57ea56c3-f670-488c-9554-96cc4ba5a8dc tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:55.412625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57ea56c3-f670-488c-9554-96cc4ba5a8dc tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:55.413066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57ea56c3-f670-488c-9554-96cc4ba5a8dc tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:55.427023 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-57ea56c3-f670-488c-9554-96cc4ba5a8dc tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] HTTP exception thrown: Instance 923106e7-a75e-4c43-8a30-3d406d22fe29 could not be found. Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-57ea56c3-f670-488c-9554-96cc4ba5a8dc tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Request method failure captured: Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 HTTP/1.1 Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0MWtcJOKtYNAliNsbxnLC6vLXUXwUUz6CVkuoPPBH5_ePKJ4CZeEvwqlY3qWyB2um2j_BjeOexA8Ndfs3ItRJmEO9OwqbLalJDY0ZoYId21igJZ8WuMpsEK40tZOJ7_KcV7MLDfTRyd04JnjRTnM35gchsTDyJqdeMHfbr35hbaKEM Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 47aa1e29deaa421e835d1773dd3210d1 Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestVolumeBackupRestore-750229456 Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47aa1e29deaa421e835d1773dd3210d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47aa1e29deaa421e835d1773dd3210d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47aa1e29deaa421e835d1773dd3210d1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47aa1e29deaa421e835d1773dd3210d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestVolumeBackupRestore-750229456 Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 47aa1e29deaa421e835d1773dd3210d1 Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestVolumeBackupRestore-750229456 Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestVolumeBackupRestore-750229456-project Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: c14719be7020488b828f998d587df3eb Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestVolumeBackupRestore-750229456-project Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 923106e7-a75e-4c43-8a30-3d406d22fe29 could not be found. Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '923106e7-a75e-4c43-8a30-3d406d22fe29'} Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 923106e7-a75e-4c43-8a30-3d406d22fe29 could not be found. Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 923106e7-a75e-4c43-8a30-3d406d22fe29 could not be found. Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:55.428759 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:46:55.432630 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:55.432630 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:55.432630 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:55.432630 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:46:55.432630 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:46:55.432630 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 923106e7-a75e-4c43-8a30-3d406d22fe29 could not be found. Oct 12 22:46:55.432630 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:46:55.432630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-57ea56c3-f670-488c-9554-96cc4ba5a8dc tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Returning 404 to user: Instance 923106e7-a75e-4c43-8a30-3d406d22fe29 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:46:55.432630 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-57ea56c3-f670-488c-9554-96cc4ba5a8dc tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29" status: 404 len: 111 microversion: 2.1 time: 0.032156 Oct 12 22:46:55.432630 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3132/6913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:55 2022] GET /compute/v2.1/servers/923106e7-a75e-4c43-8a30-3d406d22fe29 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:46:55.464031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-410aa938-dd50-479f-9108-1bb32302d4ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:55.464680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-410aa938-dd50-479f-9108-1bb32302d4ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:55.471753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-410aa938-dd50-479f-9108-1bb32302d4ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:55.472243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-410aa938-dd50-479f-9108-1bb32302d4ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:55.472907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-410aa938-dd50-479f-9108-1bb32302d4ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:55.473616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-410aa938-dd50-479f-9108-1bb32302d4ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:55.474077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-410aa938-dd50-479f-9108-1bb32302d4ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:55.474509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-410aa938-dd50-479f-9108-1bb32302d4ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:55.563718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-fd366884-432c-4bc8-9825-be9270e3e4fa req-9946acbd-32dc-4f0b-8c49-43915282d28c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c188bc3c-f2ef-4c11-b840-9349df36bac1", "name": "network-vif-plugged", "status": "completed", "tag": "b36e4f13-822d-4329-a3da-3086e28addf8"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:55.573891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fd366884-432c-4bc8-9825-be9270e3e4fa req-9946acbd-32dc-4f0b-8c49-43915282d28c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:55.574389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fd366884-432c-4bc8-9825-be9270e3e4fa req-9946acbd-32dc-4f0b-8c49-43915282d28c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:55.574838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fd366884-432c-4bc8-9825-be9270e3e4fa req-9946acbd-32dc-4f0b-8c49-43915282d28c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:55.586652 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-fd366884-432c-4bc8-9825-be9270e3e4fa req-9946acbd-32dc-4f0b-8c49-43915282d28c service nova] Creating event network-vif-plugged:b36e4f13-822d-4329-a3da-3086e28addf8 for instance c188bc3c-f2ef-4c11-b840-9349df36bac1 on n-h2-861111-1 Oct 12 22:46:55.595880 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-fd366884-432c-4bc8-9825-be9270e3e4fa req-9946acbd-32dc-4f0b-8c49-43915282d28c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035698 Oct 12 22:46:55.596714 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3133/6914] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:46:55.618067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4b09e492-87ea-4131-a8f1-36aa039d1caa tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] Calling method '.version_select at 0x7f51235dcdc0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:55.633434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-410aa938-dd50-479f-9108-1bb32302d4ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:55.642268 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-410aa938-dd50-479f-9108-1bb32302d4ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1264 microversion: 2.1 time: 0.182273 Oct 12 22:46:55.643131 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3782/6915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:55 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:55.647894 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4b09e492-87ea-4131-a8f1-36aa039d1caa tempest-TestVolumeBackupRestore-750229456 tempest-TestVolumeBackupRestore-750229456-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-690282953" status: 202 len: 0 microversion: 2.1 time: 0.036380 Oct 12 22:46:55.652332 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3134/6916] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 12 22:46:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-690282953 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:46:56.666585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1dcfde86-e4e8-4f65-8115-a327e600a466 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:56.669818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1dcfde86-e4e8-4f65-8115-a327e600a466 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:56.680432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dcfde86-e4e8-4f65-8115-a327e600a466 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:56.681093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dcfde86-e4e8-4f65-8115-a327e600a466 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:56.681590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dcfde86-e4e8-4f65-8115-a327e600a466 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:56.682382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dcfde86-e4e8-4f65-8115-a327e600a466 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:56.683064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dcfde86-e4e8-4f65-8115-a327e600a466 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:56.683985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1dcfde86-e4e8-4f65-8115-a327e600a466 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:56.964600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1dcfde86-e4e8-4f65-8115-a327e600a466 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:56.979985 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1dcfde86-e4e8-4f65-8115-a327e600a466 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1264 microversion: 2.1 time: 0.317243 Oct 12 22:46:56.993478 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3783/6917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:56 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1264 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:58.008613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0bd200e1-3956-49ce-9370-a7e21d0a04ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:58.010026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0bd200e1-3956-49ce-9370-a7e21d0a04ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:58.022480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd200e1-3956-49ce-9370-a7e21d0a04ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:58.023800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd200e1-3956-49ce-9370-a7e21d0a04ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:58.024858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd200e1-3956-49ce-9370-a7e21d0a04ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:58.026591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd200e1-3956-49ce-9370-a7e21d0a04ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:58.037795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd200e1-3956-49ce-9370-a7e21d0a04ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:58.039924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd200e1-3956-49ce-9370-a7e21d0a04ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:58.304850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0bd200e1-3956-49ce-9370-a7e21d0a04ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:58.320719 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0bd200e1-3956-49ce-9370-a7e21d0a04ab tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1264 microversion: 2.1 time: 0.316979 Oct 12 22:46:58.322914 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3135/6918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:58 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1264 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:59.350174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b72a71d0-0849-40cf-8fd3-9dbaedab5408 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:59.350891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b72a71d0-0849-40cf-8fd3-9dbaedab5408 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:59.358894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b72a71d0-0849-40cf-8fd3-9dbaedab5408 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:59.359526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b72a71d0-0849-40cf-8fd3-9dbaedab5408 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:59.359970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b72a71d0-0849-40cf-8fd3-9dbaedab5408 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:59.360717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b72a71d0-0849-40cf-8fd3-9dbaedab5408 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:59.361263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b72a71d0-0849-40cf-8fd3-9dbaedab5408 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:59.361879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b72a71d0-0849-40cf-8fd3-9dbaedab5408 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:59.524116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b72a71d0-0849-40cf-8fd3-9dbaedab5408 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:59.533831 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b72a71d0-0849-40cf-8fd3-9dbaedab5408 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1264 microversion: 2.1 time: 0.188235 Oct 12 22:46:59.534415 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3784/6919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:59 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:59.619540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-afc2292a-f588-4636-af9d-0cc358b157d5 req-b310f92c-293b-4444-9f59-294943d485c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "275a1602-666d-406c-a460-24dad702174c", "name": "network-vif-plugged", "status": "completed", "tag": "9e9b85c3-5938-4d68-bcbf-11cc5cf40741"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:59.631696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-afc2292a-f588-4636-af9d-0cc358b157d5 req-b310f92c-293b-4444-9f59-294943d485c1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:59.632621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-afc2292a-f588-4636-af9d-0cc358b157d5 req-b310f92c-293b-4444-9f59-294943d485c1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:59.633345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-afc2292a-f588-4636-af9d-0cc358b157d5 req-b310f92c-293b-4444-9f59-294943d485c1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:59.669497 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-afc2292a-f588-4636-af9d-0cc358b157d5 req-b310f92c-293b-4444-9f59-294943d485c1 service nova] Creating event network-vif-plugged:9e9b85c3-5938-4d68-bcbf-11cc5cf40741 for instance 275a1602-666d-406c-a460-24dad702174c on n-h2-861111-1 Oct 12 22:46:59.685321 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-afc2292a-f588-4636-af9d-0cc358b157d5 req-b310f92c-293b-4444-9f59-294943d485c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069442 Oct 12 22:46:59.688439 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3136/6920] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:47:00.558059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-629c43d5-cebf-4993-a73b-26fcffea8428 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:00.558769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-629c43d5-cebf-4993-a73b-26fcffea8428 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:00.567711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-629c43d5-cebf-4993-a73b-26fcffea8428 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:00.568280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-629c43d5-cebf-4993-a73b-26fcffea8428 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:00.568732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-629c43d5-cebf-4993-a73b-26fcffea8428 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:00.569582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-629c43d5-cebf-4993-a73b-26fcffea8428 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:00.570048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-629c43d5-cebf-4993-a73b-26fcffea8428 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:00.570478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-629c43d5-cebf-4993-a73b-26fcffea8428 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:00.716603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-629c43d5-cebf-4993-a73b-26fcffea8428 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:00.725823 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-629c43d5-cebf-4993-a73b-26fcffea8428 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1264 microversion: 2.1 time: 0.171725 Oct 12 22:47:00.726401 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3785/6921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:00 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:01.750006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3b18ddf0-bf20-4ea3-aee7-2edbf0652378 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:01.751536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3b18ddf0-bf20-4ea3-aee7-2edbf0652378 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:01.758574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b18ddf0-bf20-4ea3-aee7-2edbf0652378 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:01.759382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b18ddf0-bf20-4ea3-aee7-2edbf0652378 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:01.760037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b18ddf0-bf20-4ea3-aee7-2edbf0652378 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:01.761124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b18ddf0-bf20-4ea3-aee7-2edbf0652378 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:01.761932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b18ddf0-bf20-4ea3-aee7-2edbf0652378 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:01.762577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b18ddf0-bf20-4ea3-aee7-2edbf0652378 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:01.979681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3b18ddf0-bf20-4ea3-aee7-2edbf0652378 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:01.988206 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3b18ddf0-bf20-4ea3-aee7-2edbf0652378 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1450 microversion: 2.1 time: 0.243280 Oct 12 22:47:01.989960 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3137/6922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:01 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1450 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:02.011473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6767e4b9-e603-4782-a906-63768f62fb56 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:02.012860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6767e4b9-e603-4782-a906-63768f62fb56 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:02.020710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6767e4b9-e603-4782-a906-63768f62fb56 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:02.021208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6767e4b9-e603-4782-a906-63768f62fb56 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:02.021651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6767e4b9-e603-4782-a906-63768f62fb56 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:02.022367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6767e4b9-e603-4782-a906-63768f62fb56 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:02.022836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6767e4b9-e603-4782-a906-63768f62fb56 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:02.023266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6767e4b9-e603-4782-a906-63768f62fb56 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:02.252152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6767e4b9-e603-4782-a906-63768f62fb56 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:02.261344 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6767e4b9-e603-4782-a906-63768f62fb56 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1450 microversion: 2.1 time: 0.253834 Oct 12 22:47:02.262897 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3786/6923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:02 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1450 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:04.258821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-02792a87-642e-42b4-8701-97d74f948fb6 req-b3556259-d6d7-4c8a-9e51-cc4d3f73eeb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "275a1602-666d-406c-a460-24dad702174c", "tag": "9e9b85c3-5938-4d68-bcbf-11cc5cf40741"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:04.269799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:04.273782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-02792a87-642e-42b4-8701-97d74f948fb6 req-b3556259-d6d7-4c8a-9e51-cc4d3f73eeb2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:04.274745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-02792a87-642e-42b4-8701-97d74f948fb6 req-b3556259-d6d7-4c8a-9e51-cc4d3f73eeb2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:04.275513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-02792a87-642e-42b4-8701-97d74f948fb6 req-b3556259-d6d7-4c8a-9e51-cc4d3f73eeb2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:04.290467 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-02792a87-642e-42b4-8701-97d74f948fb6 req-b3556259-d6d7-4c8a-9e51-cc4d3f73eeb2 service nova] Creating event network-changed:9e9b85c3-5938-4d68-bcbf-11cc5cf40741 for instance 275a1602-666d-406c-a460-24dad702174c on n-h2-861111-1 Oct 12 22:47:04.297296 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-02792a87-642e-42b4-8701-97d74f948fb6 req-b3556259-d6d7-4c8a-9e51-cc4d3f73eeb2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041871 Oct 12 22:47:04.298823 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3138/6924] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:47:28.561195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-915e7a2b-67a0-43dc-8a23-73d58866ccaa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:28.563524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-915e7a2b-67a0-43dc-8a23-73d58866ccaa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:28.565944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:28.566594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=84 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:28.572632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-915e7a2b-67a0-43dc-8a23-73d58866ccaa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:28.573122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-915e7a2b-67a0-43dc-8a23-73d58866ccaa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:28.573565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-915e7a2b-67a0-43dc-8a23-73d58866ccaa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:28.574261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-915e7a2b-67a0-43dc-8a23-73d58866ccaa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:28.574717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-915e7a2b-67a0-43dc-8a23-73d58866ccaa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:28.575148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-915e7a2b-67a0-43dc-8a23-73d58866ccaa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:28.631843 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-915e7a2b-67a0-43dc-8a23-73d58866ccaa tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "POST /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1/action" status: 200 len: 24569 microversion: 2.1 time: 0.074338 Oct 12 22:47:28.632798 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3787/6925] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:47:28 2022] POST /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1/action => generated 24569 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:48:00.128954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-92c4ce2d-04c9-49ce-92f9-24a28271d057 req-49df8889-5295-4753-ad98-c493ccf840fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c188bc3c-f2ef-4c11-b840-9349df36bac1", "tag": "b36e4f13-822d-4329-a3da-3086e28addf8"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:00.137511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dd6ddf9e-2944-417e-9da4-af237348fe82 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:00.138153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dd6ddf9e-2944-417e-9da4-af237348fe82 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:00.140408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=66 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:00.145590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:00.146339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:00.154229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd6ddf9e-2944-417e-9da4-af237348fe82 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:00.156850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-92c4ce2d-04c9-49ce-92f9-24a28271d057 req-49df8889-5295-4753-ad98-c493ccf840fc service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:00.157364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-92c4ce2d-04c9-49ce-92f9-24a28271d057 req-49df8889-5295-4753-ad98-c493ccf840fc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:00.157785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-92c4ce2d-04c9-49ce-92f9-24a28271d057 req-49df8889-5295-4753-ad98-c493ccf840fc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:00.167342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd6ddf9e-2944-417e-9da4-af237348fe82 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:00.167876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd6ddf9e-2944-417e-9da4-af237348fe82 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:00.168640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd6ddf9e-2944-417e-9da4-af237348fe82 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:00.169130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd6ddf9e-2944-417e-9da4-af237348fe82 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:00.169588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd6ddf9e-2944-417e-9da4-af237348fe82 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:00.178195 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-92c4ce2d-04c9-49ce-92f9-24a28271d057 req-49df8889-5295-4753-ad98-c493ccf840fc service nova] Creating event network-changed:b36e4f13-822d-4329-a3da-3086e28addf8 for instance c188bc3c-f2ef-4c11-b840-9349df36bac1 on n-h2-861111-1 Oct 12 22:48:00.185623 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-92c4ce2d-04c9-49ce-92f9-24a28271d057 req-49df8889-5295-4753-ad98-c493ccf840fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060872 Oct 12 22:48:00.186487 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3788/6926] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:48:00.197535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dd6ddf9e-2944-417e-9da4-af237348fe82 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:48:00.294638 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dd6ddf9e-2944-417e-9da4-af237348fe82 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 204 len: 0 microversion: 2.1 time: 0.172587 Oct 12 22:48:00.295321 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3139/6927] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:48:00 2022] DELETE /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:48:00.305686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-10477184-c0d8-491a-baf0-ae60014e0617 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:00.306577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-10477184-c0d8-491a-baf0-ae60014e0617 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:00.313480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10477184-c0d8-491a-baf0-ae60014e0617 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:00.314102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10477184-c0d8-491a-baf0-ae60014e0617 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:00.314816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10477184-c0d8-491a-baf0-ae60014e0617 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:00.315814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10477184-c0d8-491a-baf0-ae60014e0617 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:00.316386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10477184-c0d8-491a-baf0-ae60014e0617 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:00.316964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10477184-c0d8-491a-baf0-ae60014e0617 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:00.475610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-10477184-c0d8-491a-baf0-ae60014e0617 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:00.484787 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-10477184-c0d8-491a-baf0-ae60014e0617 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1686 microversion: 2.1 time: 0.183891 Oct 12 22:48:00.485384 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3789/6928] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:00 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1686 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:01.510299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2d9a7968-0af5-4d58-b1f8-bdbf44cc3c7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:01.511593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2d9a7968-0af5-4d58-b1f8-bdbf44cc3c7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:01.518752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d9a7968-0af5-4d58-b1f8-bdbf44cc3c7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:01.519277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d9a7968-0af5-4d58-b1f8-bdbf44cc3c7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:01.519740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d9a7968-0af5-4d58-b1f8-bdbf44cc3c7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:01.520454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d9a7968-0af5-4d58-b1f8-bdbf44cc3c7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:01.520924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d9a7968-0af5-4d58-b1f8-bdbf44cc3c7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:01.521371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2d9a7968-0af5-4d58-b1f8-bdbf44cc3c7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:01.728680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2d9a7968-0af5-4d58-b1f8-bdbf44cc3c7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:01.736648 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2d9a7968-0af5-4d58-b1f8-bdbf44cc3c7b tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1686 microversion: 2.1 time: 0.230806 Oct 12 22:48:01.737231 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3140/6929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:01 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1686 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:02.298813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-b0519c9e-ea7f-4b93-a655-5440ec3666d7 req-8bf3eed2-c7ae-4ec4-83be-62f6d1c3095f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c188bc3c-f2ef-4c11-b840-9349df36bac1", "name": "network-vif-deleted", "tag": "b36e4f13-822d-4329-a3da-3086e28addf8"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:02.309649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b0519c9e-ea7f-4b93-a655-5440ec3666d7 req-8bf3eed2-c7ae-4ec4-83be-62f6d1c3095f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:02.310161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b0519c9e-ea7f-4b93-a655-5440ec3666d7 req-8bf3eed2-c7ae-4ec4-83be-62f6d1c3095f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:02.310574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b0519c9e-ea7f-4b93-a655-5440ec3666d7 req-8bf3eed2-c7ae-4ec4-83be-62f6d1c3095f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:02.322129 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-b0519c9e-ea7f-4b93-a655-5440ec3666d7 req-8bf3eed2-c7ae-4ec4-83be-62f6d1c3095f service nova] Creating event network-vif-deleted:b36e4f13-822d-4329-a3da-3086e28addf8 for instance c188bc3c-f2ef-4c11-b840-9349df36bac1 on n-h2-861111-1 Oct 12 22:48:02.327722 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-b0519c9e-ea7f-4b93-a655-5440ec3666d7 req-8bf3eed2-c7ae-4ec4-83be-62f6d1c3095f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032568 Oct 12 22:48:02.328499 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3790/6930] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:02.762049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-061ea4dd-2821-404d-a9e3-c7ce3d8d5ca9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:02.763413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-061ea4dd-2821-404d-a9e3-c7ce3d8d5ca9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:02.772599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-061ea4dd-2821-404d-a9e3-c7ce3d8d5ca9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:02.773111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-061ea4dd-2821-404d-a9e3-c7ce3d8d5ca9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:02.773574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-061ea4dd-2821-404d-a9e3-c7ce3d8d5ca9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:02.774298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-061ea4dd-2821-404d-a9e3-c7ce3d8d5ca9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:02.774769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-061ea4dd-2821-404d-a9e3-c7ce3d8d5ca9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:02.775211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-061ea4dd-2821-404d-a9e3-c7ce3d8d5ca9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:02.807180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-061ea4dd-2821-404d-a9e3-c7ce3d8d5ca9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:02.808220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-061ea4dd-2821-404d-a9e3-c7ce3d8d5ca9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:02.808661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-061ea4dd-2821-404d-a9e3-c7ce3d8d5ca9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:02.809376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-061ea4dd-2821-404d-a9e3-c7ce3d8d5ca9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lazy-loading 'fault' on Instance uuid c188bc3c-f2ef-4c11-b840-9349df36bac1 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:48:02.851807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-061ea4dd-2821-404d-a9e3-c7ce3d8d5ca9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acd162da21348b6acb725bfe572bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5cc899bfb3403c9aa9d192833cafa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:02.859785 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-061ea4dd-2821-404d-a9e3-c7ce3d8d5ca9 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 200 len: 1355 microversion: 2.1 time: 0.102671 Oct 12 22:48:02.860453 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3141/6931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:02 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 1355 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:03.885318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-92d7efde-5996-4ed3-b79e-60be47da357c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:03.885939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-92d7efde-5996-4ed3-b79e-60be47da357c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] [instance: c188bc3c-f2ef-4c11-b840-9349df36bac1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:03.892725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92d7efde-5996-4ed3-b79e-60be47da357c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:03.893208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92d7efde-5996-4ed3-b79e-60be47da357c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:03.893642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92d7efde-5996-4ed3-b79e-60be47da357c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:03.894328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92d7efde-5996-4ed3-b79e-60be47da357c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:03.894780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92d7efde-5996-4ed3-b79e-60be47da357c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:03.895206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-92d7efde-5996-4ed3-b79e-60be47da357c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:03.908883 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-92d7efde-5996-4ed3-b79e-60be47da357c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] HTTP exception thrown: Instance c188bc3c-f2ef-4c11-b840-9349df36bac1 could not be found. Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-92d7efde-5996-4ed3-b79e-60be47da357c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Request method failure captured: Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 HTTP/1.1 Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0GT7kMjoeYhQ1Th4q7G_rjSfBz-SOd6Bk2_ScJ5gdprLwVptEtdNViG1pBtatnIyIuIXK-pDsF5xb7TwO3bZt7IWwrbvVcGcwuSVCzGTfwLlYAWKRg5O0DaNHlhbZQtTS0lSPT92gMQCb3wkKvhYt9T6IUbiTCIN3iqt07wMQT2obc Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: aa5cc899bfb3403c9aa9d192833cafa9 Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1768289362 Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aa5cc899bfb3403c9aa9d192833cafa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aa5cc899bfb3403c9aa9d192833cafa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aa5cc899bfb3403c9aa9d192833cafa9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aa5cc899bfb3403c9aa9d192833cafa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1768289362 Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: aa5cc899bfb3403c9aa9d192833cafa9 Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1768289362 Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestNetworkAdvancedServerOps-1768289362-project Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 2acd162da21348b6acb725bfe572bc00 Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1768289362-project Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance c188bc3c-f2ef-4c11-b840-9349df36bac1 could not be found. Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'c188bc3c-f2ef-4c11-b840-9349df36bac1'} Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c188bc3c-f2ef-4c11-b840-9349df36bac1 could not be found. Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c188bc3c-f2ef-4c11-b840-9349df36bac1 could not be found. Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:48:03.910500 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:48:03.914648 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:48:03.914648 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:03.914648 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:48:03.914648 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:48:03.914648 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:48:03.914648 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:48:03.914648 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c188bc3c-f2ef-4c11-b840-9349df36bac1 could not be found. Oct 12 22:48:03.914648 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:48:03.914648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-92d7efde-5996-4ed3-b79e-60be47da357c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Returning 404 to user: Instance c188bc3c-f2ef-4c11-b840-9349df36bac1 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:48:03.914648 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-92d7efde-5996-4ed3-b79e-60be47da357c tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1" status: 404 len: 111 microversion: 2.1 time: 0.031800 Oct 12 22:48:03.914648 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3791/6932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:03 2022] GET /compute/v2.1/servers/c188bc3c-f2ef-4c11-b840-9349df36bac1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:48:07.165578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-250539cc-7834-40e3-a585-0a4dd20c31c5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] Calling method '.version_select at 0x7f512317ed30>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:07.187534 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-250539cc-7834-40e3-a585-0a4dd20c31c5 tempest-TestNetworkAdvancedServerOps-1768289362 tempest-TestNetworkAdvancedServerOps-1768289362-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1881954767" status: 202 len: 0 microversion: 2.1 time: 0.025731 Oct 12 22:48:07.188619 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3142/6933] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Oct 12 22:48:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1881954767 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:48:54.353422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-347634837", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-96398279", "security_groups": [{"name": "tempest-secgroup-smoke-1530106101"}], "block_device_mapping_v2": [{"uuid": "b4800052-fb0f-47f6-a4e3-e056bd11cf31", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6d173dd3-914e-48d4-bcc2-81061c8da03d"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:54.363735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=8 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:54.364600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=12 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:54.366747 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 22:48:54.366903 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 22:48:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 12 22:48:54.368427 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 22:48:54.368563 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 22:48:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 12 22:48:54.475172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] validate_networks() for [('6d173dd3-914e-48d4-bcc2-81061c8da03d', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:48:54.951008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:48:54.951478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:48:54.951991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:48:54.952405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:48:54.952825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:48:54.962135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:54.962621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:54.963062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:54.963839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:54.964293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:54.964722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:54.982137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:54.987379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Getting quotas for user 7d141d93d7a74a57b5b6475294c9af5e and project ef79a1f4c33c46f1a7536c37f910e2b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:55.045165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:48:55.047982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b4800052-fb0f-47f6-a4e3-e056bd11cf31',volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:48:55.173212 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6ac45070-ecd4-4571-b95c-fedfde2a227b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.823866 Oct 12 22:48:55.174098 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3792/6934] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:48:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:48:55.185478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6be7298e-256a-43de-9485-ac9c6d5c9ea5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:55.186720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6be7298e-256a-43de-9485-ac9c6d5c9ea5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:55.189792 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 22:48:55.189996 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 22:48:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 (ip 10.222.0.16) !!! Oct 12 22:48:55.191432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:55.192864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:55.263078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6be7298e-256a-43de-9485-ac9c6d5c9ea5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:55.270577 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6be7298e-256a-43de-9485-ac9c6d5c9ea5 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1092 microversion: 2.1 time: 0.088853 Oct 12 22:48:55.270737 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3143/6935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:55 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1092 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:56.292692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1957f362-0a8c-4d91-a8fa-908a02ca5634 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:56.293313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1957f362-0a8c-4d91-a8fa-908a02ca5634 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:56.300057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1957f362-0a8c-4d91-a8fa-908a02ca5634 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:56.300545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1957f362-0a8c-4d91-a8fa-908a02ca5634 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:56.300979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1957f362-0a8c-4d91-a8fa-908a02ca5634 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:56.301673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1957f362-0a8c-4d91-a8fa-908a02ca5634 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:56.302124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1957f362-0a8c-4d91-a8fa-908a02ca5634 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:56.302547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1957f362-0a8c-4d91-a8fa-908a02ca5634 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:56.365032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1957f362-0a8c-4d91-a8fa-908a02ca5634 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:56.372894 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1957f362-0a8c-4d91-a8fa-908a02ca5634 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1190 microversion: 2.1 time: 0.084991 Oct 12 22:48:56.373466 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3793/6936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:56 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1190 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:57.397563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b2f5ec67-b7ec-49e1-a9d2-a650e1e9349c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:57.398931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b2f5ec67-b7ec-49e1-a9d2-a650e1e9349c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:57.405970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2f5ec67-b7ec-49e1-a9d2-a650e1e9349c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:57.407086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2f5ec67-b7ec-49e1-a9d2-a650e1e9349c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:57.407634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2f5ec67-b7ec-49e1-a9d2-a650e1e9349c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:57.409094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2f5ec67-b7ec-49e1-a9d2-a650e1e9349c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:57.409656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2f5ec67-b7ec-49e1-a9d2-a650e1e9349c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:57.410170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2f5ec67-b7ec-49e1-a9d2-a650e1e9349c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:57.677351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b2f5ec67-b7ec-49e1-a9d2-a650e1e9349c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:57.686082 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b2f5ec67-b7ec-49e1-a9d2-a650e1e9349c tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1276 microversion: 2.1 time: 0.292535 Oct 12 22:48:57.686683 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3144/6937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:57 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1276 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:57.881799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-dc9b3ef1-a7e6-4862-aafb-dbbb4da1395a req-ab2cc68e-1c90-435d-a2e8-ad1f8f466837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0", "tag": "af450f19-ffa5-466b-a68c-f1f4826ac124"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:57.896239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-dc9b3ef1-a7e6-4862-aafb-dbbb4da1395a req-ab2cc68e-1c90-435d-a2e8-ad1f8f466837 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:57.897028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-dc9b3ef1-a7e6-4862-aafb-dbbb4da1395a req-ab2cc68e-1c90-435d-a2e8-ad1f8f466837 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:57.897471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-dc9b3ef1-a7e6-4862-aafb-dbbb4da1395a req-ab2cc68e-1c90-435d-a2e8-ad1f8f466837 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:57.911343 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-dc9b3ef1-a7e6-4862-aafb-dbbb4da1395a req-ab2cc68e-1c90-435d-a2e8-ad1f8f466837 service nova] Creating event network-changed:af450f19-ffa5-466b-a68c-f1f4826ac124 for instance ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 on n-h1-861111-1 Oct 12 22:48:57.917095 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-dc9b3ef1-a7e6-4862-aafb-dbbb4da1395a req-ab2cc68e-1c90-435d-a2e8-ad1f8f466837 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040454 Oct 12 22:48:57.918018 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3794/6938] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:58.710574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5807cdcf-b8fa-403b-8386-26788a868001 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:58.711426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5807cdcf-b8fa-403b-8386-26788a868001 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:58.719776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5807cdcf-b8fa-403b-8386-26788a868001 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:58.720894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5807cdcf-b8fa-403b-8386-26788a868001 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:58.721620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5807cdcf-b8fa-403b-8386-26788a868001 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:58.723182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5807cdcf-b8fa-403b-8386-26788a868001 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:58.726422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5807cdcf-b8fa-403b-8386-26788a868001 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:58.727012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5807cdcf-b8fa-403b-8386-26788a868001 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:58.945699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5807cdcf-b8fa-403b-8386-26788a868001 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:58.954582 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5807cdcf-b8fa-403b-8386-26788a868001 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1276 microversion: 2.1 time: 0.247832 Oct 12 22:48:58.955284 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3145/6939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:58 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1276 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:59.977945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bf8c75bc-0f47-4b16-b517-7169de706e3b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:59.978760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bf8c75bc-0f47-4b16-b517-7169de706e3b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:59.986142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf8c75bc-0f47-4b16-b517-7169de706e3b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:59.986696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf8c75bc-0f47-4b16-b517-7169de706e3b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:59.987136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf8c75bc-0f47-4b16-b517-7169de706e3b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:59.987862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf8c75bc-0f47-4b16-b517-7169de706e3b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:59.988313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf8c75bc-0f47-4b16-b517-7169de706e3b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:59.988736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf8c75bc-0f47-4b16-b517-7169de706e3b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:00.125392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bf8c75bc-0f47-4b16-b517-7169de706e3b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:00.134017 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bf8c75bc-0f47-4b16-b517-7169de706e3b tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1276 microversion: 2.1 time: 0.160346 Oct 12 22:49:00.134519 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3795/6940] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:59 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:01.158677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b7dd952-3e92-4d0c-bc5d-e0de3f5d3661 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:01.159540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6b7dd952-3e92-4d0c-bc5d-e0de3f5d3661 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:01.168443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b7dd952-3e92-4d0c-bc5d-e0de3f5d3661 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:01.168968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b7dd952-3e92-4d0c-bc5d-e0de3f5d3661 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:01.169561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b7dd952-3e92-4d0c-bc5d-e0de3f5d3661 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:01.170529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b7dd952-3e92-4d0c-bc5d-e0de3f5d3661 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:01.171063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b7dd952-3e92-4d0c-bc5d-e0de3f5d3661 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:01.171757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b7dd952-3e92-4d0c-bc5d-e0de3f5d3661 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:01.352356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6b7dd952-3e92-4d0c-bc5d-e0de3f5d3661 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:01.360962 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6b7dd952-3e92-4d0c-bc5d-e0de3f5d3661 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1276 microversion: 2.1 time: 0.207630 Oct 12 22:49:01.361714 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3146/6941] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:01 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1276 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:02.386250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bca6b8ff-480c-499c-8a5b-ea4bf20d08dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:02.387063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bca6b8ff-480c-499c-8a5b-ea4bf20d08dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:02.396022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bca6b8ff-480c-499c-8a5b-ea4bf20d08dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:02.396605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bca6b8ff-480c-499c-8a5b-ea4bf20d08dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:02.397186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bca6b8ff-480c-499c-8a5b-ea4bf20d08dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:02.398039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bca6b8ff-480c-499c-8a5b-ea4bf20d08dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:02.398744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bca6b8ff-480c-499c-8a5b-ea4bf20d08dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:02.399291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bca6b8ff-480c-499c-8a5b-ea4bf20d08dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:02.568922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bca6b8ff-480c-499c-8a5b-ea4bf20d08dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:02.577664 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bca6b8ff-480c-499c-8a5b-ea4bf20d08dd tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1264 microversion: 2.1 time: 0.196230 Oct 12 22:49:02.578201 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3796/6942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:02 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:03.600789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0aeae412-bc55-4d93-bc93-190a1353d1d6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:03.601423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0aeae412-bc55-4d93-bc93-190a1353d1d6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:03.608393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0aeae412-bc55-4d93-bc93-190a1353d1d6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:03.608890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0aeae412-bc55-4d93-bc93-190a1353d1d6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:03.609843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0aeae412-bc55-4d93-bc93-190a1353d1d6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:03.610589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0aeae412-bc55-4d93-bc93-190a1353d1d6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:03.611063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0aeae412-bc55-4d93-bc93-190a1353d1d6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:03.611540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0aeae412-bc55-4d93-bc93-190a1353d1d6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:03.744403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0aeae412-bc55-4d93-bc93-190a1353d1d6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:03.752928 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0aeae412-bc55-4d93-bc93-190a1353d1d6 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1264 microversion: 2.1 time: 0.156018 Oct 12 22:49:03.753514 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3147/6943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:03 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:04.775770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-995879d6-4489-45af-9368-f6d8f645dead tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:04.776408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-995879d6-4489-45af-9368-f6d8f645dead tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:04.782816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-995879d6-4489-45af-9368-f6d8f645dead tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:04.783323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-995879d6-4489-45af-9368-f6d8f645dead tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:04.783760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-995879d6-4489-45af-9368-f6d8f645dead tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:04.784440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-995879d6-4489-45af-9368-f6d8f645dead tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:04.784888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-995879d6-4489-45af-9368-f6d8f645dead tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:04.785316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-995879d6-4489-45af-9368-f6d8f645dead tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:04.912758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-995879d6-4489-45af-9368-f6d8f645dead tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:04.920461 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-995879d6-4489-45af-9368-f6d8f645dead tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1264 microversion: 2.1 time: 0.148800 Oct 12 22:49:04.921031 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3797/6944] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:04 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:05.942645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c193267d-acb6-4407-8b22-398b0036fc66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:05.943210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c193267d-acb6-4407-8b22-398b0036fc66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:05.945988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:05.951435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c193267d-acb6-4407-8b22-398b0036fc66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:05.951937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c193267d-acb6-4407-8b22-398b0036fc66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:05.952389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c193267d-acb6-4407-8b22-398b0036fc66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:05.953606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c193267d-acb6-4407-8b22-398b0036fc66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:05.954075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c193267d-acb6-4407-8b22-398b0036fc66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:05.954517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c193267d-acb6-4407-8b22-398b0036fc66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:06.082324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c193267d-acb6-4407-8b22-398b0036fc66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:06.090125 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c193267d-acb6-4407-8b22-398b0036fc66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1264 microversion: 2.1 time: 0.151503 Oct 12 22:49:06.090700 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3148/6945] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:05 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:07.114482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3d2391ae-3b89-4cd4-a0d0-d857133fd6d3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:07.115011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3d2391ae-3b89-4cd4-a0d0-d857133fd6d3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:07.117033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:07.117702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:07.125382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d2391ae-3b89-4cd4-a0d0-d857133fd6d3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:07.125859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d2391ae-3b89-4cd4-a0d0-d857133fd6d3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:07.126293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d2391ae-3b89-4cd4-a0d0-d857133fd6d3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:07.126972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d2391ae-3b89-4cd4-a0d0-d857133fd6d3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:07.127452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d2391ae-3b89-4cd4-a0d0-d857133fd6d3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:07.127875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d2391ae-3b89-4cd4-a0d0-d857133fd6d3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:07.258787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3d2391ae-3b89-4cd4-a0d0-d857133fd6d3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:07.267033 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3d2391ae-3b89-4cd4-a0d0-d857133fd6d3 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1264 microversion: 2.1 time: 0.156573 Oct 12 22:49:07.267632 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3798/6946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:07 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:08.289922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-79f6d956-22cb-492e-a9ae-f06d9d872d8e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:08.290545 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-79f6d956-22cb-492e-a9ae-f06d9d872d8e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:08.297775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79f6d956-22cb-492e-a9ae-f06d9d872d8e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:08.298265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79f6d956-22cb-492e-a9ae-f06d9d872d8e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:08.298712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79f6d956-22cb-492e-a9ae-f06d9d872d8e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:08.299444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79f6d956-22cb-492e-a9ae-f06d9d872d8e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:08.299908 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79f6d956-22cb-492e-a9ae-f06d9d872d8e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:08.300342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79f6d956-22cb-492e-a9ae-f06d9d872d8e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:08.428503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-79f6d956-22cb-492e-a9ae-f06d9d872d8e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:08.436214 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-79f6d956-22cb-492e-a9ae-f06d9d872d8e tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1264 microversion: 2.1 time: 0.150198 Oct 12 22:49:08.436784 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3149/6947] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:08 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:09.459553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe2d35e2-ae9e-44bc-a0ff-9ccf2a2909f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:09.460175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fe2d35e2-ae9e-44bc-a0ff-9ccf2a2909f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:09.466969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe2d35e2-ae9e-44bc-a0ff-9ccf2a2909f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:09.467488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe2d35e2-ae9e-44bc-a0ff-9ccf2a2909f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:09.467933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe2d35e2-ae9e-44bc-a0ff-9ccf2a2909f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:09.468624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe2d35e2-ae9e-44bc-a0ff-9ccf2a2909f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:09.469082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe2d35e2-ae9e-44bc-a0ff-9ccf2a2909f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:09.469508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe2d35e2-ae9e-44bc-a0ff-9ccf2a2909f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:09.597665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fe2d35e2-ae9e-44bc-a0ff-9ccf2a2909f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:09.605329 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fe2d35e2-ae9e-44bc-a0ff-9ccf2a2909f9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1264 microversion: 2.1 time: 0.149730 Oct 12 22:49:09.605897 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3799/6948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:09 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:10.630138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a30aa6bd-9aa4-4488-9b29-3259fd191a5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:10.630865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a30aa6bd-9aa4-4488-9b29-3259fd191a5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:10.638476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a30aa6bd-9aa4-4488-9b29-3259fd191a5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:10.639066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a30aa6bd-9aa4-4488-9b29-3259fd191a5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:10.639603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a30aa6bd-9aa4-4488-9b29-3259fd191a5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:10.640509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a30aa6bd-9aa4-4488-9b29-3259fd191a5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:10.641582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a30aa6bd-9aa4-4488-9b29-3259fd191a5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:10.642016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a30aa6bd-9aa4-4488-9b29-3259fd191a5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:10.784657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-c9421ecf-8dd2-4f25-88af-e940f50efffc req-085b71d9-7fc4-4d2e-8fc0-4b80af98251a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0", "name": "network-vif-plugged", "status": "completed", "tag": "af450f19-ffa5-466b-a68c-f1f4826ac124"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:10.787833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a30aa6bd-9aa4-4488-9b29-3259fd191a5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:10.794971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c9421ecf-8dd2-4f25-88af-e940f50efffc req-085b71d9-7fc4-4d2e-8fc0-4b80af98251a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:10.795507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c9421ecf-8dd2-4f25-88af-e940f50efffc req-085b71d9-7fc4-4d2e-8fc0-4b80af98251a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:10.795690 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a30aa6bd-9aa4-4488-9b29-3259fd191a5d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1264 microversion: 2.1 time: 0.171336 Oct 12 22:49:10.795960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c9421ecf-8dd2-4f25-88af-e940f50efffc req-085b71d9-7fc4-4d2e-8fc0-4b80af98251a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:10.796266 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3800/6949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:10 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:10.806911 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-c9421ecf-8dd2-4f25-88af-e940f50efffc req-085b71d9-7fc4-4d2e-8fc0-4b80af98251a service nova] Creating event network-vif-plugged:af450f19-ffa5-466b-a68c-f1f4826ac124 for instance ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 on n-h1-861111-1 Oct 12 22:49:10.812220 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-c9421ecf-8dd2-4f25-88af-e940f50efffc req-085b71d9-7fc4-4d2e-8fc0-4b80af98251a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194609 Oct 12 22:49:10.813334 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3150/6950] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:49:11.818797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f7368da1-a3ef-4288-aa61-649e92d5ff83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:11.819475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f7368da1-a3ef-4288-aa61-649e92d5ff83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:11.826331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7368da1-a3ef-4288-aa61-649e92d5ff83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:11.826812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7368da1-a3ef-4288-aa61-649e92d5ff83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:11.827268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7368da1-a3ef-4288-aa61-649e92d5ff83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:11.827971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7368da1-a3ef-4288-aa61-649e92d5ff83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:11.828461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7368da1-a3ef-4288-aa61-649e92d5ff83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:11.828892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7368da1-a3ef-4288-aa61-649e92d5ff83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:11.970863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f7368da1-a3ef-4288-aa61-649e92d5ff83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:11.978629 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f7368da1-a3ef-4288-aa61-649e92d5ff83 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1264 microversion: 2.1 time: 0.163720 Oct 12 22:49:11.979202 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3801/6951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:11 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:13.003289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ad6435bd-39e2-4617-b302-fb763352f879 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:13.004007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ad6435bd-39e2-4617-b302-fb763352f879 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:13.010763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad6435bd-39e2-4617-b302-fb763352f879 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:13.011271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad6435bd-39e2-4617-b302-fb763352f879 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:13.011726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad6435bd-39e2-4617-b302-fb763352f879 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:13.012430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad6435bd-39e2-4617-b302-fb763352f879 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:13.012896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad6435bd-39e2-4617-b302-fb763352f879 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:13.013337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad6435bd-39e2-4617-b302-fb763352f879 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:13.144454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ad6435bd-39e2-4617-b302-fb763352f879 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:13.152221 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ad6435bd-39e2-4617-b302-fb763352f879 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1451 microversion: 2.1 time: 0.153960 Oct 12 22:49:13.152807 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3151/6952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:12 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:13.174245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4f225b3d-31be-4c77-80d9-4ad392504eaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:13.174895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4f225b3d-31be-4c77-80d9-4ad392504eaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:13.181866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f225b3d-31be-4c77-80d9-4ad392504eaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:13.182355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f225b3d-31be-4c77-80d9-4ad392504eaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:13.182823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f225b3d-31be-4c77-80d9-4ad392504eaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:13.183557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f225b3d-31be-4c77-80d9-4ad392504eaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:13.184025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f225b3d-31be-4c77-80d9-4ad392504eaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:13.184456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4f225b3d-31be-4c77-80d9-4ad392504eaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:13.316388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4f225b3d-31be-4c77-80d9-4ad392504eaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:13.324362 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4f225b3d-31be-4c77-80d9-4ad392504eaa tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1451 microversion: 2.1 time: 0.153986 Oct 12 22:49:13.324949 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3802/6953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:13 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:15.149597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-2f6d85f3-c4cd-4240-a4bd-5666b9a29c45 req-3664c5dd-e406-411b-bd1b-83b3d1036ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0", "tag": "af450f19-ffa5-466b-a68c-f1f4826ac124"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:15.160248 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2f6d85f3-c4cd-4240-a4bd-5666b9a29c45 req-3664c5dd-e406-411b-bd1b-83b3d1036ae8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:15.160823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2f6d85f3-c4cd-4240-a4bd-5666b9a29c45 req-3664c5dd-e406-411b-bd1b-83b3d1036ae8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:15.161375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2f6d85f3-c4cd-4240-a4bd-5666b9a29c45 req-3664c5dd-e406-411b-bd1b-83b3d1036ae8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:15.173125 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-2f6d85f3-c4cd-4240-a4bd-5666b9a29c45 req-3664c5dd-e406-411b-bd1b-83b3d1036ae8 service nova] Creating event network-changed:af450f19-ffa5-466b-a68c-f1f4826ac124 for instance ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 on n-h1-861111-1 Oct 12 22:49:15.178226 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-2f6d85f3-c4cd-4240-a4bd-5666b9a29c45 req-3664c5dd-e406-411b-bd1b-83b3d1036ae8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032438 Oct 12 22:49:15.178810 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3152/6954] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:43.650199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:43.651560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=58 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:43.653517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=22 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:43.654346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=46 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:43.655796 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 22:50:43.656165 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 22:50:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 12 22:50:43.658598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5d0477a4-46cd-4688-a1a8-f73575b304e1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:43.660097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5d0477a4-46cd-4688-a1a8-f73575b304e1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:43.668987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d0477a4-46cd-4688-a1a8-f73575b304e1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:43.669560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d0477a4-46cd-4688-a1a8-f73575b304e1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:43.670065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d0477a4-46cd-4688-a1a8-f73575b304e1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:43.670848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d0477a4-46cd-4688-a1a8-f73575b304e1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:43.671461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d0477a4-46cd-4688-a1a8-f73575b304e1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:43.671989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5d0477a4-46cd-4688-a1a8-f73575b304e1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:43.698690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5d0477a4-46cd-4688-a1a8-f73575b304e1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:50:43.726769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d55d3489-8450-4f4a-9629-8ca9b6d3d5e8 req-bb778fb6-5b60-4f15-bd19-c0f724e14527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0", "tag": "af450f19-ffa5-466b-a68c-f1f4826ac124"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:43.737670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d55d3489-8450-4f4a-9629-8ca9b6d3d5e8 req-bb778fb6-5b60-4f15-bd19-c0f724e14527 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:43.738186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d55d3489-8450-4f4a-9629-8ca9b6d3d5e8 req-bb778fb6-5b60-4f15-bd19-c0f724e14527 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:43.738676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d55d3489-8450-4f4a-9629-8ca9b6d3d5e8 req-bb778fb6-5b60-4f15-bd19-c0f724e14527 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:43.750333 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d55d3489-8450-4f4a-9629-8ca9b6d3d5e8 req-bb778fb6-5b60-4f15-bd19-c0f724e14527 service nova] Creating event network-changed:af450f19-ffa5-466b-a68c-f1f4826ac124 for instance ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 on n-h1-861111-1 Oct 12 22:50:43.755989 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d55d3489-8450-4f4a-9629-8ca9b6d3d5e8 req-bb778fb6-5b60-4f15-bd19-c0f724e14527 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105394 Oct 12 22:50:43.756567 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3153/6955] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:43.790581 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5d0477a4-46cd-4688-a1a8-f73575b304e1 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 204 len: 0 microversion: 2.1 time: 0.142226 Oct 12 22:50:43.791548 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3803/6956] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:50:43 2022] DELETE /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:50:43.802032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-71372c73-a31a-4652-936e-988701777fbe tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:43.802867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-71372c73-a31a-4652-936e-988701777fbe tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:43.810652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71372c73-a31a-4652-936e-988701777fbe tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:43.811404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71372c73-a31a-4652-936e-988701777fbe tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:43.811866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71372c73-a31a-4652-936e-988701777fbe tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:43.812614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71372c73-a31a-4652-936e-988701777fbe tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:43.813104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71372c73-a31a-4652-936e-988701777fbe tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:43.813775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71372c73-a31a-4652-936e-988701777fbe tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:44.007992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-71372c73-a31a-4652-936e-988701777fbe tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:44.016545 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-71372c73-a31a-4652-936e-988701777fbe tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1575 microversion: 2.1 time: 0.220011 Oct 12 22:50:44.017224 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3154/6957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:43 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:45.041495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-15d725e3-8bb0-4483-8400-b1e60df26555 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:45.042283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-15d725e3-8bb0-4483-8400-b1e60df26555 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:45.049390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15d725e3-8bb0-4483-8400-b1e60df26555 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:45.049873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15d725e3-8bb0-4483-8400-b1e60df26555 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:45.050307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15d725e3-8bb0-4483-8400-b1e60df26555 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:45.050999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15d725e3-8bb0-4483-8400-b1e60df26555 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:45.051477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15d725e3-8bb0-4483-8400-b1e60df26555 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:45.051901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-15d725e3-8bb0-4483-8400-b1e60df26555 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:45.244038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-15d725e3-8bb0-4483-8400-b1e60df26555 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:45.251988 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-15d725e3-8bb0-4483-8400-b1e60df26555 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1575 microversion: 2.1 time: 0.215324 Oct 12 22:50:45.252586 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3804/6958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:45 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1575 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:46.128486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-961853aa-1823-4232-aa46-d25d7f93a188 req-ecf8ca9e-24c9-47c0-8042-a9d0ff7b3e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0", "name": "network-vif-deleted", "tag": "af450f19-ffa5-466b-a68c-f1f4826ac124"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:46.141146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-961853aa-1823-4232-aa46-d25d7f93a188 req-ecf8ca9e-24c9-47c0-8042-a9d0ff7b3e08 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:46.142272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-961853aa-1823-4232-aa46-d25d7f93a188 req-ecf8ca9e-24c9-47c0-8042-a9d0ff7b3e08 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:46.142748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-961853aa-1823-4232-aa46-d25d7f93a188 req-ecf8ca9e-24c9-47c0-8042-a9d0ff7b3e08 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:46.155902 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-961853aa-1823-4232-aa46-d25d7f93a188 req-ecf8ca9e-24c9-47c0-8042-a9d0ff7b3e08 service nova] Creating event network-vif-deleted:af450f19-ffa5-466b-a68c-f1f4826ac124 for instance ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 on n-h1-861111-1 Oct 12 22:50:46.162153 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-961853aa-1823-4232-aa46-d25d7f93a188 req-ecf8ca9e-24c9-47c0-8042-a9d0ff7b3e08 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037565 Oct 12 22:50:46.162740 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3155/6959] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:46.275367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1abffdfe-5ccf-46df-afa7-3162b72e3f14 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:46.276148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1abffdfe-5ccf-46df-afa7-3162b72e3f14 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:46.283449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1abffdfe-5ccf-46df-afa7-3162b72e3f14 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:46.283944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1abffdfe-5ccf-46df-afa7-3162b72e3f14 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:46.284442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1abffdfe-5ccf-46df-afa7-3162b72e3f14 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:46.285151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1abffdfe-5ccf-46df-afa7-3162b72e3f14 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:46.285612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1abffdfe-5ccf-46df-afa7-3162b72e3f14 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:46.286201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1abffdfe-5ccf-46df-afa7-3162b72e3f14 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:46.348500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1abffdfe-5ccf-46df-afa7-3162b72e3f14 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:46.356607 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1abffdfe-5ccf-46df-afa7-3162b72e3f14 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1223 microversion: 2.1 time: 0.085907 Oct 12 22:50:46.357184 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3805/6960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:46 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:47.379054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-676055f9-5d0c-41cb-8d84-6fd4612f2d40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:47.379751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-676055f9-5d0c-41cb-8d84-6fd4612f2d40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:47.386700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-676055f9-5d0c-41cb-8d84-6fd4612f2d40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:47.387201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-676055f9-5d0c-41cb-8d84-6fd4612f2d40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:47.387701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-676055f9-5d0c-41cb-8d84-6fd4612f2d40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:47.388406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-676055f9-5d0c-41cb-8d84-6fd4612f2d40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:47.388869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-676055f9-5d0c-41cb-8d84-6fd4612f2d40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:47.389308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-676055f9-5d0c-41cb-8d84-6fd4612f2d40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:47.454509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-676055f9-5d0c-41cb-8d84-6fd4612f2d40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:47.463071 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-676055f9-5d0c-41cb-8d84-6fd4612f2d40 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1223 microversion: 2.1 time: 0.088442 Oct 12 22:50:47.463662 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3156/6961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:47 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:48.486236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-883ff638-ec64-49b3-8541-fde676b45fcc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:48.487036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-883ff638-ec64-49b3-8541-fde676b45fcc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:48.495070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883ff638-ec64-49b3-8541-fde676b45fcc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:48.495595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883ff638-ec64-49b3-8541-fde676b45fcc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:48.496042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883ff638-ec64-49b3-8541-fde676b45fcc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:48.496776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883ff638-ec64-49b3-8541-fde676b45fcc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:48.497271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883ff638-ec64-49b3-8541-fde676b45fcc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:48.497704 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-883ff638-ec64-49b3-8541-fde676b45fcc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:48.565677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-883ff638-ec64-49b3-8541-fde676b45fcc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:48.573494 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-883ff638-ec64-49b3-8541-fde676b45fcc tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1223 microversion: 2.1 time: 0.091352 Oct 12 22:50:48.574065 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3806/6962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:48 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:49.596178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-44dea88f-4b02-4ee0-9820-9c4458908a66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:49.596861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-44dea88f-4b02-4ee0-9820-9c4458908a66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:49.603871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44dea88f-4b02-4ee0-9820-9c4458908a66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:49.604316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44dea88f-4b02-4ee0-9820-9c4458908a66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:49.604758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44dea88f-4b02-4ee0-9820-9c4458908a66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:49.605452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44dea88f-4b02-4ee0-9820-9c4458908a66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:49.605910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44dea88f-4b02-4ee0-9820-9c4458908a66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:49.606344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44dea88f-4b02-4ee0-9820-9c4458908a66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:49.667500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-44dea88f-4b02-4ee0-9820-9c4458908a66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:49.675450 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-44dea88f-4b02-4ee0-9820-9c4458908a66 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1223 microversion: 2.1 time: 0.083202 Oct 12 22:50:49.676136 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3157/6963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:49 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:50.698397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0545b5ee-fa7a-4015-b3cd-4c26b0070957 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:50.698939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0545b5ee-fa7a-4015-b3cd-4c26b0070957 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:50.705755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0545b5ee-fa7a-4015-b3cd-4c26b0070957 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:50.706237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0545b5ee-fa7a-4015-b3cd-4c26b0070957 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:50.706675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0545b5ee-fa7a-4015-b3cd-4c26b0070957 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:50.707401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0545b5ee-fa7a-4015-b3cd-4c26b0070957 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:50.707856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0545b5ee-fa7a-4015-b3cd-4c26b0070957 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:50.708283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0545b5ee-fa7a-4015-b3cd-4c26b0070957 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:50.738822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0545b5ee-fa7a-4015-b3cd-4c26b0070957 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:50.739330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0545b5ee-fa7a-4015-b3cd-4c26b0070957 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:50.739797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0545b5ee-fa7a-4015-b3cd-4c26b0070957 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:50.740240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-0545b5ee-fa7a-4015-b3cd-4c26b0070957 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lazy-loading 'fault' on Instance uuid ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:50:50.781145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0545b5ee-fa7a-4015-b3cd-4c26b0070957 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:50.789580 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0545b5ee-fa7a-4015-b3cd-4c26b0070957 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 200 len: 1228 microversion: 2.1 time: 0.095595 Oct 12 22:50:50.790165 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3807/6964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:50 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 1228 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:51.813240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eddc4288-a82b-47db-b62c-5a60e71c9118 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:51.813898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eddc4288-a82b-47db-b62c-5a60e71c9118 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:51.820667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eddc4288-a82b-47db-b62c-5a60e71c9118 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:51.821166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eddc4288-a82b-47db-b62c-5a60e71c9118 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:51.821613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eddc4288-a82b-47db-b62c-5a60e71c9118 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:51.822309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eddc4288-a82b-47db-b62c-5a60e71c9118 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:51.822768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eddc4288-a82b-47db-b62c-5a60e71c9118 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:51.823199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eddc4288-a82b-47db-b62c-5a60e71c9118 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:51.836200 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-eddc4288-a82b-47db-b62c-5a60e71c9118 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] HTTP exception thrown: Instance ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 could not be found. Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eddc4288-a82b-47db-b62c-5a60e71c9118 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Request method failure captured: Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 HTTP/1.1 Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0IharzkU0EI5od_tYFYiimWbIhiU_Z2qWiELggh5UckxeqrnYnnrwzymqi7TUfpjzQhGi9AT7nHEyzZohAJui-4vZv6nTEy801Fmq2zP90o12d8oz0UHjyBxm9MxKWeYUrTwr-9KmypVoqQEOknLfZ_qBqmv_P1kjCeo-X5DoGtv6Y Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef79a1f4c33c46f1a7536c37f910e2b0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7d141d93d7a74a57b5b6475294c9af5e Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 could not be found. Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0'} Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 could not be found. Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 could not be found. Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:51.838350 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:50:51.842362 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:51.842362 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:51.842362 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:51.842362 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:50:51.842362 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:50:51.842362 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 could not be found. Oct 12 22:50:51.842362 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:50:51.842362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eddc4288-a82b-47db-b62c-5a60e71c9118 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Returning 404 to user: Instance ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:50:51.842362 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eddc4288-a82b-47db-b62c-5a60e71c9118 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0" status: 404 len: 111 microversion: 2.1 time: 0.030449 Oct 12 22:50:51.842362 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3158/6965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:51 2022] GET /compute/v2.1/servers/ce9bfb77-83ba-4a5c-8add-0fe5ab64e3e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:50:58.033601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-27ef0c3f-8d1a-435b-8f2a-a57ee968b126 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:58.034124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-27ef0c3f-8d1a-435b-8f2a-a57ee968b126 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:58.035454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-299dca87-3701-47c0-bdca-559b8c74746d req-71fd2fb0-7bd0-4adc-855d-2f4bbb96d969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "275a1602-666d-406c-a460-24dad702174c", "tag": "9e9b85c3-5938-4d68-bcbf-11cc5cf40741"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:58.041415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27ef0c3f-8d1a-435b-8f2a-a57ee968b126 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.041991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27ef0c3f-8d1a-435b-8f2a-a57ee968b126 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.042686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27ef0c3f-8d1a-435b-8f2a-a57ee968b126 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.043502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27ef0c3f-8d1a-435b-8f2a-a57ee968b126 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.044035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27ef0c3f-8d1a-435b-8f2a-a57ee968b126 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.044557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27ef0c3f-8d1a-435b-8f2a-a57ee968b126 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.047615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-299dca87-3701-47c0-bdca-559b8c74746d req-71fd2fb0-7bd0-4adc-855d-2f4bbb96d969 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.048100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-299dca87-3701-47c0-bdca-559b8c74746d req-71fd2fb0-7bd0-4adc-855d-2f4bbb96d969 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.048716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-299dca87-3701-47c0-bdca-559b8c74746d req-71fd2fb0-7bd0-4adc-855d-2f4bbb96d969 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.059403 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-299dca87-3701-47c0-bdca-559b8c74746d req-71fd2fb0-7bd0-4adc-855d-2f4bbb96d969 service nova] Creating event network-changed:9e9b85c3-5938-4d68-bcbf-11cc5cf40741 for instance 275a1602-666d-406c-a460-24dad702174c on n-h2-861111-1 Oct 12 22:50:58.064865 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-299dca87-3701-47c0-bdca-559b8c74746d req-71fd2fb0-7bd0-4adc-855d-2f4bbb96d969 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033231 Oct 12 22:50:58.065728 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3159/6966] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:58.075207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-27ef0c3f-8d1a-435b-8f2a-a57ee968b126 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:50:58.161319 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-27ef0c3f-8d1a-435b-8f2a-a57ee968b126 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "DELETE /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 204 len: 0 microversion: 2.1 time: 0.131595 Oct 12 22:50:58.161839 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3808/6967] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:50:58 2022] DELETE /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:50:58.170868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-222dc66e-1366-4050-90c1-b5fb69db6df2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:58.171902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-222dc66e-1366-4050-90c1-b5fb69db6df2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:58.179075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-222dc66e-1366-4050-90c1-b5fb69db6df2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.179907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-222dc66e-1366-4050-90c1-b5fb69db6df2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.180532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-222dc66e-1366-4050-90c1-b5fb69db6df2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.181448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-222dc66e-1366-4050-90c1-b5fb69db6df2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.182105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-222dc66e-1366-4050-90c1-b5fb69db6df2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.182762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-222dc66e-1366-4050-90c1-b5fb69db6df2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.337264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-222dc66e-1366-4050-90c1-b5fb69db6df2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:58.346763 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-222dc66e-1366-4050-90c1-b5fb69db6df2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1575 microversion: 2.1 time: 0.180290 Oct 12 22:50:58.347377 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3160/6968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:58 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:50:59.371013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bcef4038-ad60-4fdc-a1a1-fb67c24db071 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:59.372345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bcef4038-ad60-4fdc-a1a1-fb67c24db071 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:59.380499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcef4038-ad60-4fdc-a1a1-fb67c24db071 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:59.381000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcef4038-ad60-4fdc-a1a1-fb67c24db071 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:59.381444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcef4038-ad60-4fdc-a1a1-fb67c24db071 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:59.382179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcef4038-ad60-4fdc-a1a1-fb67c24db071 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:59.382636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcef4038-ad60-4fdc-a1a1-fb67c24db071 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:59.383064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcef4038-ad60-4fdc-a1a1-fb67c24db071 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:59.516172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bcef4038-ad60-4fdc-a1a1-fb67c24db071 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:59.524062 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bcef4038-ad60-4fdc-a1a1-fb67c24db071 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1575 microversion: 2.1 time: 0.157899 Oct 12 22:50:59.524645 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3809/6969] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:59 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:00.247851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-3fecf4d3-f372-487a-8f5e-e96861dfc751 req-1b4e640f-bf73-47fb-8e03-a3825e17cd70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "275a1602-666d-406c-a460-24dad702174c", "name": "network-vif-deleted", "tag": "9e9b85c3-5938-4d68-bcbf-11cc5cf40741"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:00.258376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3fecf4d3-f372-487a-8f5e-e96861dfc751 req-1b4e640f-bf73-47fb-8e03-a3825e17cd70 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:00.258847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3fecf4d3-f372-487a-8f5e-e96861dfc751 req-1b4e640f-bf73-47fb-8e03-a3825e17cd70 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:00.259310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-3fecf4d3-f372-487a-8f5e-e96861dfc751 req-1b4e640f-bf73-47fb-8e03-a3825e17cd70 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:00.271007 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-3fecf4d3-f372-487a-8f5e-e96861dfc751 req-1b4e640f-bf73-47fb-8e03-a3825e17cd70 service nova] Creating event network-vif-deleted:9e9b85c3-5938-4d68-bcbf-11cc5cf40741 for instance 275a1602-666d-406c-a460-24dad702174c on n-h2-861111-1 Oct 12 22:51:00.276637 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-3fecf4d3-f372-487a-8f5e-e96861dfc751 req-1b4e640f-bf73-47fb-8e03-a3825e17cd70 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032427 Oct 12 22:51:00.277287 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3161/6970] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:51:00.549466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4e3c2050-d4e7-46e9-bdf4-3eedca30dc39 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:00.550658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4e3c2050-d4e7-46e9-bdf4-3eedca30dc39 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:00.559718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e3c2050-d4e7-46e9-bdf4-3eedca30dc39 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:00.560528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e3c2050-d4e7-46e9-bdf4-3eedca30dc39 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:00.560968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e3c2050-d4e7-46e9-bdf4-3eedca30dc39 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:00.561708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e3c2050-d4e7-46e9-bdf4-3eedca30dc39 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:00.563484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e3c2050-d4e7-46e9-bdf4-3eedca30dc39 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:00.563918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e3c2050-d4e7-46e9-bdf4-3eedca30dc39 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:00.632569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4e3c2050-d4e7-46e9-bdf4-3eedca30dc39 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:00.641386 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4e3c2050-d4e7-46e9-bdf4-3eedca30dc39 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1223 microversion: 2.1 time: 0.096766 Oct 12 22:51:00.641983 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3810/6971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:00 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:01.666959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f980f496-5277-4b9e-ac11-5e14cadee0c2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:01.667700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f980f496-5277-4b9e-ac11-5e14cadee0c2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:01.674044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f980f496-5277-4b9e-ac11-5e14cadee0c2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:01.674540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f980f496-5277-4b9e-ac11-5e14cadee0c2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:01.674993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f980f496-5277-4b9e-ac11-5e14cadee0c2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:01.675725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f980f496-5277-4b9e-ac11-5e14cadee0c2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:01.676193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f980f496-5277-4b9e-ac11-5e14cadee0c2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:01.676649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f980f496-5277-4b9e-ac11-5e14cadee0c2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:01.740048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f980f496-5277-4b9e-ac11-5e14cadee0c2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:01.748093 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f980f496-5277-4b9e-ac11-5e14cadee0c2 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1223 microversion: 2.1 time: 0.086868 Oct 12 22:51:01.748756 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3162/6972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:01 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:02.771002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-196a513e-5ed2-48f0-9a4f-0b3d4ff9b6a9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:02.771423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-196a513e-5ed2-48f0-9a4f-0b3d4ff9b6a9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:02.779033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-196a513e-5ed2-48f0-9a4f-0b3d4ff9b6a9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:02.779552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-196a513e-5ed2-48f0-9a4f-0b3d4ff9b6a9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:02.779989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-196a513e-5ed2-48f0-9a4f-0b3d4ff9b6a9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:02.780714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-196a513e-5ed2-48f0-9a4f-0b3d4ff9b6a9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:02.781190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-196a513e-5ed2-48f0-9a4f-0b3d4ff9b6a9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:02.781609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-196a513e-5ed2-48f0-9a4f-0b3d4ff9b6a9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:02.847132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-196a513e-5ed2-48f0-9a4f-0b3d4ff9b6a9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:02.855439 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-196a513e-5ed2-48f0-9a4f-0b3d4ff9b6a9 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1223 microversion: 2.1 time: 0.088649 Oct 12 22:51:02.856021 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3811/6973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:02 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:03.878105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2ceed13a-6a64-4139-8b68-bebedb403515 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:03.878753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2ceed13a-6a64-4139-8b68-bebedb403515 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:03.885529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ceed13a-6a64-4139-8b68-bebedb403515 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:03.886019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ceed13a-6a64-4139-8b68-bebedb403515 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:03.886466 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ceed13a-6a64-4139-8b68-bebedb403515 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:03.887181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ceed13a-6a64-4139-8b68-bebedb403515 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:03.887712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ceed13a-6a64-4139-8b68-bebedb403515 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:03.888153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ceed13a-6a64-4139-8b68-bebedb403515 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:03.949671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2ceed13a-6a64-4139-8b68-bebedb403515 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d141d93d7a74a57b5b6475294c9af5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79a1f4c33c46f1a7536c37f910e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:03.957712 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2ceed13a-6a64-4139-8b68-bebedb403515 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 200 len: 1223 microversion: 2.1 time: 0.083627 Oct 12 22:51:03.958286 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3163/6974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:03 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:04.981528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-52706264-c854-46cc-92b5-5d7365883581 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:04.982070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-52706264-c854-46cc-92b5-5d7365883581 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 275a1602-666d-406c-a460-24dad702174c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:04.988705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52706264-c854-46cc-92b5-5d7365883581 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:04.989194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52706264-c854-46cc-92b5-5d7365883581 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:04.989652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52706264-c854-46cc-92b5-5d7365883581 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:04.990335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52706264-c854-46cc-92b5-5d7365883581 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:04.990804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52706264-c854-46cc-92b5-5d7365883581 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:04.991214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-52706264-c854-46cc-92b5-5d7365883581 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.005660 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-52706264-c854-46cc-92b5-5d7365883581 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] HTTP exception thrown: Instance 275a1602-666d-406c-a460-24dad702174c could not be found. Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-52706264-c854-46cc-92b5-5d7365883581 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Request method failure captured: Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c HTTP/1.1 Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0IharzkU0EI5od_tYFYiimWbIhiU_Z2qWiELggh5UckxeqrnYnnrwzymqi7TUfpjzQhGi9AT7nHEyzZohAJui-4vZv6nTEy801Fmq2zP90o12d8oz0UHjyBxm9MxKWeYUrTwr-9KmypVoqQEOknLfZ_qBqmv_P1kjCeo-X5DoGtv6Y Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef79a1f4c33c46f1a7536c37f910e2b0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7d141d93d7a74a57b5b6475294c9af5e Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 275a1602-666d-406c-a460-24dad702174c could not be found. Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '275a1602-666d-406c-a460-24dad702174c'} Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 275a1602-666d-406c-a460-24dad702174c could not be found. Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 275a1602-666d-406c-a460-24dad702174c could not be found. Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:05.007369 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.011468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.011468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:05.011468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:05.011468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:05.011468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:05.011468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 275a1602-666d-406c-a460-24dad702174c could not be found. Oct 12 22:51:05.011468 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.011468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-52706264-c854-46cc-92b5-5d7365883581 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Returning 404 to user: Instance 275a1602-666d-406c-a460-24dad702174c could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:05.011468 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-52706264-c854-46cc-92b5-5d7365883581 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c" status: 404 len: 111 microversion: 2.1 time: 0.031831 Oct 12 22:51:05.011468 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3812/6975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:04 2022] GET /compute/v2.1/servers/275a1602-666d-406c-a460-24dad702174c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:51:05.445224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4fb201f9-73d5-47da-9b1d-0f343d71cf87 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:05.445744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4fb201f9-73d5-47da-9b1d-0f343d71cf87 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:05.453129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4fb201f9-73d5-47da-9b1d-0f343d71cf87 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.453622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4fb201f9-73d5-47da-9b1d-0f343d71cf87 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.454076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4fb201f9-73d5-47da-9b1d-0f343d71cf87 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.454778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4fb201f9-73d5-47da-9b1d-0f343d71cf87 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.455263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4fb201f9-73d5-47da-9b1d-0f343d71cf87 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.455710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4fb201f9-73d5-47da-9b1d-0f343d71cf87 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.468688 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-4fb201f9-73d5-47da-9b1d-0f343d71cf87 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] HTTP exception thrown: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4fb201f9-73d5-47da-9b1d-0f343d71cf87 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Request method failure captured: Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 HTTP/1.1 Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0IharzkU0EI5od_tYFYiimWbIhiU_Z2qWiELggh5UckxeqrnYnnrwzymqi7TUfpjzQhGi9AT7nHEyzZohAJui-4vZv6nTEy801Fmq2zP90o12d8oz0UHjyBxm9MxKWeYUrTwr-9KmypVoqQEOknLfZ_qBqmv_P1kjCeo-X5DoGtv6Y Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef79a1f4c33c46f1a7536c37f910e2b0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7d141d93d7a74a57b5b6475294c9af5e Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '939ea0f2-a100-4c6e-ada6-5cf434c39070'} Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:05.470386 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:05.474078 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. Oct 12 22:51:05.474078 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.474078 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:05.474078 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.474078 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.474078 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:05.474078 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:05.474078 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:05.474078 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:05.474078 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. Oct 12 22:51:05.474078 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.474078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4fb201f9-73d5-47da-9b1d-0f343d71cf87 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Returning 404 to user: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:05.474078 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4fb201f9-73d5-47da-9b1d-0f343d71cf87 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "DELETE /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 404 len: 111 microversion: 2.1 time: 0.030547 Oct 12 22:51:05.474078 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3164/6976] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:51:05 2022] DELETE /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:51:05.480736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a7c80923-a49f-42a1-8e49-d81513347a38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:05.481380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a7c80923-a49f-42a1-8e49-d81513347a38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] [instance: 939ea0f2-a100-4c6e-ada6-5cf434c39070] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:05.487370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7c80923-a49f-42a1-8e49-d81513347a38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.487852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7c80923-a49f-42a1-8e49-d81513347a38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.488290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7c80923-a49f-42a1-8e49-d81513347a38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.488974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7c80923-a49f-42a1-8e49-d81513347a38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.489427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7c80923-a49f-42a1-8e49-d81513347a38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.489850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a7c80923-a49f-42a1-8e49-d81513347a38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.503916 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-a7c80923-a49f-42a1-8e49-d81513347a38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] HTTP exception thrown: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a7c80923-a49f-42a1-8e49-d81513347a38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Request method failure captured: Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 HTTP/1.1 Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0IharzkU0EI5od_tYFYiimWbIhiU_Z2qWiELggh5UckxeqrnYnnrwzymqi7TUfpjzQhGi9AT7nHEyzZohAJui-4vZv6nTEy801Fmq2zP90o12d8oz0UHjyBxm9MxKWeYUrTwr-9KmypVoqQEOknLfZ_qBqmv_P1kjCeo-X5DoGtv6Y Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef79a1f4c33c46f1a7536c37f910e2b0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef79a1f4c33c46f1a7536c37f910e2b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: ef79a1f4c33c46f1a7536c37f910e2b0 Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010722898 Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7d141d93d7a74a57b5b6475294c9af5e Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestVolumeBootPattern-1010722898-project Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '939ea0f2-a100-4c6e-ada6-5cf434c39070'} Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:05.505481 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.509426 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.509426 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:05.509426 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:05.509426 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:05.509426 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:05.509426 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. Oct 12 22:51:05.509426 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.509426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a7c80923-a49f-42a1-8e49-d81513347a38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Returning 404 to user: Instance 939ea0f2-a100-4c6e-ada6-5cf434c39070 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:05.509426 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a7c80923-a49f-42a1-8e49-d81513347a38 tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070" status: 404 len: 111 microversion: 2.1 time: 0.030071 Oct 12 22:51:05.509426 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3813/6977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:05 2022] GET /compute/v2.1/servers/939ea0f2-a100-4c6e-ada6-5cf434c39070 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:51:08.911818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2caf5ce3-dc1a-45b3-82f1-5d27a3a7f57d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] Calling method '.version_select at 0x7f512311a9d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:08.948189 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2caf5ce3-dc1a-45b3-82f1-5d27a3a7f57d tempest-TestVolumeBootPattern-1010722898 tempest-TestVolumeBootPattern-1010722898-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-96398279" status: 202 len: 0 microversion: 2.1 time: 0.039849 Oct 12 22:51:08.949757 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3165/6978] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 12 22:51:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-96398279 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:51:27.387160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:27.387912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:27.498294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-41303657", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:27.552967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] validate_networks() for None {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:51:27.820781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:51:27.821210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:51:27.821689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:51:27.822218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:51:27.822651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:51:27.832534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:27.833021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:27.833463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:27.834195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:27.834660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:27.835092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:27.851825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Getting quotas for project 1e093a96797549ec9c2d0b4cecdb0b82. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:51:27.857029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Getting quotas for user e5a78a7f463d44409710b902d59e8130 and project 1e093a96797549ec9c2d0b4cecdb0b82. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:51:27.869179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:51:27.872033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:51:27.915075 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fd5de476-48d1-485a-a559-520178651bf6 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533791 Oct 12 22:51:27.915754 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3814/6979] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:51:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:51:27.929090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-36684021-b8fd-4357-ba85-8acf12f707ba tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:27.929700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-36684021-b8fd-4357-ba85-8acf12f707ba tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:27.934339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=48 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:27.935104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:27.987560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-36684021-b8fd-4357-ba85-8acf12f707ba tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a78a7f463d44409710b902d59e8130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e093a96797549ec9c2d0b4cecdb0b82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:27.994425 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-36684021-b8fd-4357-ba85-8acf12f707ba tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49" status: 200 len: 1220 microversion: 2.1 time: 0.069835 Oct 12 22:51:27.995674 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3166/6980] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:27 2022] GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49 => generated 1220 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:29.018612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3ec32140-0370-471b-a722-5bb23e9486ff tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:29.019879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3ec32140-0370-471b-a722-5bb23e9486ff tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:29.027164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ec32140-0370-471b-a722-5bb23e9486ff tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:29.027683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ec32140-0370-471b-a722-5bb23e9486ff tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:29.028134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ec32140-0370-471b-a722-5bb23e9486ff tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:29.028836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ec32140-0370-471b-a722-5bb23e9486ff tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:29.029372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ec32140-0370-471b-a722-5bb23e9486ff tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:29.029814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ec32140-0370-471b-a722-5bb23e9486ff tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:29.098120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3ec32140-0370-471b-a722-5bb23e9486ff tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a78a7f463d44409710b902d59e8130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e093a96797549ec9c2d0b4cecdb0b82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:29.106614 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3ec32140-0370-471b-a722-5bb23e9486ff tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49" status: 200 len: 1280 microversion: 2.1 time: 0.092698 Oct 12 22:51:29.107216 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3815/6981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:29 2022] GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49 => generated 1280 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:30.131306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-029ce1f5-70c5-495a-bc2b-c34107ba12ca tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:30.131934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-029ce1f5-70c5-495a-bc2b-c34107ba12ca tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:30.139470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-029ce1f5-70c5-495a-bc2b-c34107ba12ca tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:30.139973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-029ce1f5-70c5-495a-bc2b-c34107ba12ca tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:30.140424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-029ce1f5-70c5-495a-bc2b-c34107ba12ca tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:30.141134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-029ce1f5-70c5-495a-bc2b-c34107ba12ca tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:30.141599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-029ce1f5-70c5-495a-bc2b-c34107ba12ca tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:30.142035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-029ce1f5-70c5-495a-bc2b-c34107ba12ca tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:30.367022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-029ce1f5-70c5-495a-bc2b-c34107ba12ca tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a78a7f463d44409710b902d59e8130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e093a96797549ec9c2d0b4cecdb0b82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:30.375530 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-029ce1f5-70c5-495a-bc2b-c34107ba12ca tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49" status: 200 len: 1320 microversion: 2.1 time: 0.248116 Oct 12 22:51:30.376111 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3167/6982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:30 2022] GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49 => generated 1320 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:30.594308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-e46c56ab-b299-4ee0-b6f4-6b1db9359d38 req-b71a14e3-a8ef-478c-950d-5379a7d5fd67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b5413e-1a2e-4319-bcaf-ed673c921e49", "tag": "191ddb34-01b3-42da-ae76-dffb312c5a75"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:30.609118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e46c56ab-b299-4ee0-b6f4-6b1db9359d38 req-b71a14e3-a8ef-478c-950d-5379a7d5fd67 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:30.609738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e46c56ab-b299-4ee0-b6f4-6b1db9359d38 req-b71a14e3-a8ef-478c-950d-5379a7d5fd67 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:30.610415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e46c56ab-b299-4ee0-b6f4-6b1db9359d38 req-b71a14e3-a8ef-478c-950d-5379a7d5fd67 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:30.624263 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-e46c56ab-b299-4ee0-b6f4-6b1db9359d38 req-b71a14e3-a8ef-478c-950d-5379a7d5fd67 service nova] Creating event network-changed:191ddb34-01b3-42da-ae76-dffb312c5a75 for instance b6b5413e-1a2e-4319-bcaf-ed673c921e49 on n-h2-861111-1 Oct 12 22:51:30.629192 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-e46c56ab-b299-4ee0-b6f4-6b1db9359d38 req-b71a14e3-a8ef-478c-950d-5379a7d5fd67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038778 Oct 12 22:51:30.629803 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3816/6983] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:31.398733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2840458f-b56d-4a9e-942c-bf6e42134430 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:31.399389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2840458f-b56d-4a9e-942c-bf6e42134430 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:31.406713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2840458f-b56d-4a9e-942c-bf6e42134430 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:31.407203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2840458f-b56d-4a9e-942c-bf6e42134430 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:31.407677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2840458f-b56d-4a9e-942c-bf6e42134430 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:31.408375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2840458f-b56d-4a9e-942c-bf6e42134430 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:31.408837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2840458f-b56d-4a9e-942c-bf6e42134430 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:31.409274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2840458f-b56d-4a9e-942c-bf6e42134430 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:31.540208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2840458f-b56d-4a9e-942c-bf6e42134430 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a78a7f463d44409710b902d59e8130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e093a96797549ec9c2d0b4cecdb0b82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:31.547882 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2840458f-b56d-4a9e-942c-bf6e42134430 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49" status: 200 len: 1320 microversion: 2.1 time: 0.153018 Oct 12 22:51:31.548449 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3168/6984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:31 2022] GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49 => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:32.572767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a95b3220-d643-4837-920f-69590a7858dd tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:32.573902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a95b3220-d643-4837-920f-69590a7858dd tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:32.580148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a95b3220-d643-4837-920f-69590a7858dd tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:32.580630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a95b3220-d643-4837-920f-69590a7858dd tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:32.581070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a95b3220-d643-4837-920f-69590a7858dd tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:32.581765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a95b3220-d643-4837-920f-69590a7858dd tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:32.582222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a95b3220-d643-4837-920f-69590a7858dd tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:32.582650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a95b3220-d643-4837-920f-69590a7858dd tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:32.715078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a95b3220-d643-4837-920f-69590a7858dd tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a78a7f463d44409710b902d59e8130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e093a96797549ec9c2d0b4cecdb0b82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:32.722709 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a95b3220-d643-4837-920f-69590a7858dd tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49" status: 200 len: 1320 microversion: 2.1 time: 0.155171 Oct 12 22:51:32.723293 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3817/6985] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:32 2022] GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49 => generated 1320 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:33.745737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-69f0acc2-500b-4c1a-a22c-da9fe73fc3ed tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:33.746365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-69f0acc2-500b-4c1a-a22c-da9fe73fc3ed tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:33.753204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69f0acc2-500b-4c1a-a22c-da9fe73fc3ed tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:33.753728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69f0acc2-500b-4c1a-a22c-da9fe73fc3ed tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:33.754208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69f0acc2-500b-4c1a-a22c-da9fe73fc3ed tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:33.754910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69f0acc2-500b-4c1a-a22c-da9fe73fc3ed tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:33.755402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69f0acc2-500b-4c1a-a22c-da9fe73fc3ed tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:33.755872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69f0acc2-500b-4c1a-a22c-da9fe73fc3ed tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:33.886622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-69f0acc2-500b-4c1a-a22c-da9fe73fc3ed tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a78a7f463d44409710b902d59e8130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e093a96797549ec9c2d0b4cecdb0b82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:33.894337 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-69f0acc2-500b-4c1a-a22c-da9fe73fc3ed tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49" status: 200 len: 1320 microversion: 2.1 time: 0.152487 Oct 12 22:51:33.894919 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3169/6986] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:33 2022] GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49 => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:34.919031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d315d03e-8507-4361-a740-e1796ab07129 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:34.919674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d315d03e-8507-4361-a740-e1796ab07129 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:34.926131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d315d03e-8507-4361-a740-e1796ab07129 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:34.926614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d315d03e-8507-4361-a740-e1796ab07129 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:34.927050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d315d03e-8507-4361-a740-e1796ab07129 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:34.927772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d315d03e-8507-4361-a740-e1796ab07129 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:34.928226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d315d03e-8507-4361-a740-e1796ab07129 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:34.928650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d315d03e-8507-4361-a740-e1796ab07129 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:35.054761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d315d03e-8507-4361-a740-e1796ab07129 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a78a7f463d44409710b902d59e8130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e093a96797549ec9c2d0b4cecdb0b82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:35.063019 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d315d03e-8507-4361-a740-e1796ab07129 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49" status: 200 len: 1320 microversion: 2.1 time: 0.148812 Oct 12 22:51:35.063617 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3818/6987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:34 2022] GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49 => generated 1320 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:36.085866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9764f663-ae84-422f-9c81-866df96c18f3 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:36.086395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9764f663-ae84-422f-9c81-866df96c18f3 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:36.093238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9764f663-ae84-422f-9c81-866df96c18f3 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:36.093735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9764f663-ae84-422f-9c81-866df96c18f3 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:36.094187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9764f663-ae84-422f-9c81-866df96c18f3 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:36.094892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9764f663-ae84-422f-9c81-866df96c18f3 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:36.095395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9764f663-ae84-422f-9c81-866df96c18f3 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:36.095835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9764f663-ae84-422f-9c81-866df96c18f3 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:36.223077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9764f663-ae84-422f-9c81-866df96c18f3 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a78a7f463d44409710b902d59e8130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e093a96797549ec9c2d0b4cecdb0b82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:36.231003 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9764f663-ae84-422f-9c81-866df96c18f3 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49" status: 200 len: 1320 microversion: 2.1 time: 0.149223 Oct 12 22:51:36.231607 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3170/6988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:36 2022] GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49 => generated 1320 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:36.904096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-08cda35d-78df-47a9-8ab0-abbc5af3738d req-935da2ec-bfc1-43b2-b3de-946230e6f862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b5413e-1a2e-4319-bcaf-ed673c921e49", "name": "network-vif-plugged", "status": "completed", "tag": "191ddb34-01b3-42da-ae76-dffb312c5a75"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:36.914648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-08cda35d-78df-47a9-8ab0-abbc5af3738d req-935da2ec-bfc1-43b2-b3de-946230e6f862 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:36.915135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-08cda35d-78df-47a9-8ab0-abbc5af3738d req-935da2ec-bfc1-43b2-b3de-946230e6f862 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:36.915597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-08cda35d-78df-47a9-8ab0-abbc5af3738d req-935da2ec-bfc1-43b2-b3de-946230e6f862 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:36.926498 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-08cda35d-78df-47a9-8ab0-abbc5af3738d req-935da2ec-bfc1-43b2-b3de-946230e6f862 service nova] Creating event network-vif-plugged:191ddb34-01b3-42da-ae76-dffb312c5a75 for instance b6b5413e-1a2e-4319-bcaf-ed673c921e49 on n-h2-861111-1 Oct 12 22:51:36.931480 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-08cda35d-78df-47a9-8ab0-abbc5af3738d req-935da2ec-bfc1-43b2-b3de-946230e6f862 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031245 Oct 12 22:51:36.932081 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3819/6989] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:37.254067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f9550434-3c80-4150-b860-8e90e16ad7c2 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:37.254693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f9550434-3c80-4150-b860-8e90e16ad7c2 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:37.261500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9550434-3c80-4150-b860-8e90e16ad7c2 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:37.261998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9550434-3c80-4150-b860-8e90e16ad7c2 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:37.262458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9550434-3c80-4150-b860-8e90e16ad7c2 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:37.263166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9550434-3c80-4150-b860-8e90e16ad7c2 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:37.263660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9550434-3c80-4150-b860-8e90e16ad7c2 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:37.264105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9550434-3c80-4150-b860-8e90e16ad7c2 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:37.391067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f9550434-3c80-4150-b860-8e90e16ad7c2 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a78a7f463d44409710b902d59e8130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e093a96797549ec9c2d0b4cecdb0b82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:37.398652 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f9550434-3c80-4150-b860-8e90e16ad7c2 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49" status: 200 len: 1320 microversion: 2.1 time: 0.148546 Oct 12 22:51:37.399266 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3171/6990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:37 2022] GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49 => generated 1320 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:38.418679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:38.419523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:38.424821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-abd643fc-6058-43b5-93c7-0748bc458f61 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:38.425534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-abd643fc-6058-43b5-93c7-0748bc458f61 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:38.432432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abd643fc-6058-43b5-93c7-0748bc458f61 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:38.432922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abd643fc-6058-43b5-93c7-0748bc458f61 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:38.433856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abd643fc-6058-43b5-93c7-0748bc458f61 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:38.434679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abd643fc-6058-43b5-93c7-0748bc458f61 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:38.435008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abd643fc-6058-43b5-93c7-0748bc458f61 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:38.435467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-abd643fc-6058-43b5-93c7-0748bc458f61 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:38.569076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-abd643fc-6058-43b5-93c7-0748bc458f61 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a78a7f463d44409710b902d59e8130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e093a96797549ec9c2d0b4cecdb0b82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:38.576841 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-abd643fc-6058-43b5-93c7-0748bc458f61 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49" status: 200 len: 1470 microversion: 2.1 time: 0.159197 Oct 12 22:51:38.577412 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3820/6991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:38 2022] GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:38.602524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:38.658441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d2b5640a-5c1a-4dcd-a7c9-d30291e54c87 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Calling method '.version_select at 0x7f512303ea60>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:38.723932 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d2b5640a-5c1a-4dcd-a7c9-d30291e54c87 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/43d5fb310e3f4cc2ae1168f0282c1832" status: 200 len: 371 microversion: 2.1 time: 0.126107 Oct 12 22:51:38.724488 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3172/6992] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 12 22:51:38 2022] GET /compute/v2.1/os-quota-sets/43d5fb310e3f4cc2ae1168f0282c1832 => generated 371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:38.737292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f91a2433-6398-4d88-bfda-0f0ebb64fb4d tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-643379979", "id": 1475958256, "os-flavor-access:is_public": "True"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:38.754963 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f91a2433-6398-4d88-bfda-0f0ebb64fb4d tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021456 Oct 12 22:51:38.755578 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3821/6993] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:51:38 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:38.768152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1475958256"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:38.770727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:38.776705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:38.777207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:38.777655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:38.778360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:38.778820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:38.779270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:38.961650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7712a5abd1fe43e3b07302e5782a4fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d5fb310e3f4cc2ae1168f0282c1832', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:38.968375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-643379979 {{(pid=120452) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:51:38.974929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:38.975452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:38.975925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:38.976918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:38.977389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:38.977824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:39.003201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Getting quotas for project 1e093a96797549ec9c2d0b4cecdb0b82. Resources: {'ram', 'cores'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:51:39.008223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Getting quotas for user e5a78a7f463d44409710b902d59e8130 and project 1e093a96797549ec9c2d0b4cecdb0b82. Resources: {'ram', 'cores'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:51:39.020664 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.compute.api [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] ram quota exceeded for 43d5fb310e3f4cc2ae1168f0282c1832, tried to resize instance. Oct 12 22:51:39.021211 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Request method failure captured: Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49/action HTTP/1.1 Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 39 Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0Tv84LkfmB-jaiOZn5yNLd-gWTRmoGpwMiCsDoiOLe3wvXrxanOU4Meitd3Jbc8kvTvOEqVJEXFvm27_4WYPBuqKOOzsnfzRwiPcZQNu3FyJZC09USQAMo2-iJryS6iTX0VllfKzieykRY7jDfZSqdUZW25MyA4gmSU9qUy711OpsE Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 43d5fb310e3f4cc2ae1168f0282c1832 Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1903787703 Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-Role: admin,reader,member Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: admin,reader,member Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43d5fb310e3f4cc2ae1168f0282c1832"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43d5fb310e3f4cc2ae1168f0282c1832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_43d5fb310e3f4cc2ae1168f0282c1832", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/43d5fb310e3f4cc2ae1168f0282c1832"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1903787703 Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 43d5fb310e3f4cc2ae1168f0282c1832 Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1903787703 Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersAdminNegativeTestJSON-1903787703-project-admin Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 7712a5abd1fe43e3b07302e5782a4fe7 Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1903787703-project-admin Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: {"resize": {"flavorRef": "1475958256"}} Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'b6b5413e-1a2e-4319-bcaf-ed673c921e49', 'body': {'resize': {'flavorRef': '1475958256'}}} Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:51:39.030087 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-47f45af7-bc14-49e7-b5f4-78c9f3d59b43 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49/action" status: 403 len: 118 microversion: 2.1 time: 0.267556 Oct 12 22:51:39.034588 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3173/6994] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:51:38 2022] POST /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49/action => generated 118 bytes in 269 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:51:39.040440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a327e76b-45f5-4103-b697-d24e210269ff tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:39.057222 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a327e76b-45f5-4103-b697-d24e210269ff tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1475958256" status: 202 len: 0 microversion: 2.1 time: 0.020537 Oct 12 22:51:39.057768 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3822/6995] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 12 22:51:39 2022] DELETE /compute/v2.1/flavors/1475958256 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:51:39.066034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d52bc8e7-f965-495b-bb00-31f014e9a594 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:39.090253 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d52bc8e7-f965-495b-bb00-31f014e9a594 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027879 Oct 12 22:51:39.090820 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3174/6996] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:51:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:39.111300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b1246d07-104d-43d9-a923-a6bdf9c060cb tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Calling method '.version_select at 0x7f5122c43b80>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:39.182551 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b1246d07-104d-43d9-a923-a6bdf9c060cb tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/43d5fb310e3f4cc2ae1168f0282c1832" status: 200 len: 371 microversion: 2.1 time: 0.074922 Oct 12 22:51:39.183121 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3823/6997] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 12 22:51:39 2022] GET /compute/v2.1/os-quota-sets/43d5fb310e3f4cc2ae1168f0282c1832 => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:39.195315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c14e7374-9b37-4096-a9fe-36f6398c9a0f tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1776762450", "id": 1073909152, "os-flavor-access:is_public": "True"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:39.213432 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c14e7374-9b37-4096-a9fe-36f6398c9a0f tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021825 Oct 12 22:51:39.213978 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3175/6998] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:51:39 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:39.225818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1073909152"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:39.228426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:39.234848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:39.235385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:39.235801 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:39.236484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:39.236932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:39.237354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:39.324014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7712a5abd1fe43e3b07302e5782a4fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d5fb310e3f4cc2ae1168f0282c1832', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:39.329754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1776762450 {{(pid=120453) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:51:39.336185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:39.336658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:39.337086 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:39.337800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:39.338245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:39.338666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:39.358933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Getting quotas for project 1e093a96797549ec9c2d0b4cecdb0b82. Resources: {'ram', 'cores'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:51:39.364070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Getting quotas for user e5a78a7f463d44409710b902d59e8130 and project 1e093a96797549ec9c2d0b4cecdb0b82. Resources: {'ram', 'cores'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:51:39.376398 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.compute.api [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] cores quota exceeded for 43d5fb310e3f4cc2ae1168f0282c1832, tried to resize instance. Oct 12 22:51:39.376927 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Request method failure captured: Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49/action HTTP/1.1 Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 39 Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0Tv84LkfmB-jaiOZn5yNLd-gWTRmoGpwMiCsDoiOLe3wvXrxanOU4Meitd3Jbc8kvTvOEqVJEXFvm27_4WYPBuqKOOzsnfzRwiPcZQNu3FyJZC09USQAMo2-iJryS6iTX0VllfKzieykRY7jDfZSqdUZW25MyA4gmSU9qUy711OpsE Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 43d5fb310e3f4cc2ae1168f0282c1832 Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1903787703 Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-Role: admin,reader,member Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: admin,reader,member Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43d5fb310e3f4cc2ae1168f0282c1832"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43d5fb310e3f4cc2ae1168f0282c1832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_43d5fb310e3f4cc2ae1168f0282c1832", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/43d5fb310e3f4cc2ae1168f0282c1832"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1903787703 Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 43d5fb310e3f4cc2ae1168f0282c1832 Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1903787703 Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersAdminNegativeTestJSON-1903787703-project-admin Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 7712a5abd1fe43e3b07302e5782a4fe7 Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1903787703-project-admin Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: {"resize": {"flavorRef": "1073909152"}} Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'b6b5413e-1a2e-4319-bcaf-ed673c921e49', 'body': {'resize': {'flavorRef': '1073909152'}}} Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:51:39.378977 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a535bd45-db13-4381-8e7c-b7f7f17eb6e0 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49/action" status: 403 len: 113 microversion: 2.1 time: 0.158390 Oct 12 22:51:39.382597 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3824/6999] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:51:39 2022] POST /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49/action => generated 113 bytes in 159 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:51:39.389070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1e08c047-8b37-4037-ab60-eb1511f4f63a tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:39.407457 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1e08c047-8b37-4037-ab60-eb1511f4f63a tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1073909152" status: 202 len: 0 microversion: 2.1 time: 0.021921 Oct 12 22:51:39.408035 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3176/7000] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 12 22:51:39 2022] DELETE /compute/v2.1/flavors/1073909152 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:51:39.415861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4b0aa841-0916-43b8-8e91-e538a8082346 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:39.437099 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4b0aa841-0916-43b8-8e91-e538a8082346 tempest-ServersAdminNegativeTestJSON-1903787703 tempest-ServersAdminNegativeTestJSON-1903787703-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024916 Oct 12 22:51:39.437674 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3825/7001] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 12 22:51:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:39.457676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4396a8c9-ba8e-49b1-b30a-8e463b970c6d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:39.458188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4396a8c9-ba8e-49b1-b30a-8e463b970c6d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:39.464116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4396a8c9-ba8e-49b1-b30a-8e463b970c6d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:39.464614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4396a8c9-ba8e-49b1-b30a-8e463b970c6d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:39.465064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4396a8c9-ba8e-49b1-b30a-8e463b970c6d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:39.465767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4396a8c9-ba8e-49b1-b30a-8e463b970c6d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:39.466529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4396a8c9-ba8e-49b1-b30a-8e463b970c6d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:39.466980 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4396a8c9-ba8e-49b1-b30a-8e463b970c6d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:39.492705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4396a8c9-ba8e-49b1-b30a-8e463b970c6d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:51:39.565566 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4396a8c9-ba8e-49b1-b30a-8e463b970c6d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49" status: 204 len: 0 microversion: 2.1 time: 0.111444 Oct 12 22:51:39.566147 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3177/7002] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:51:39 2022] DELETE /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:51:39.574870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b787fc0b-d5d4-446b-aaf2-dae7e5628530 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:39.575534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b787fc0b-d5d4-446b-aaf2-dae7e5628530 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:39.581966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b787fc0b-d5d4-446b-aaf2-dae7e5628530 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:39.582451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b787fc0b-d5d4-446b-aaf2-dae7e5628530 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:39.582886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b787fc0b-d5d4-446b-aaf2-dae7e5628530 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:39.583604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b787fc0b-d5d4-446b-aaf2-dae7e5628530 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:39.584055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b787fc0b-d5d4-446b-aaf2-dae7e5628530 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:39.584479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b787fc0b-d5d4-446b-aaf2-dae7e5628530 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:39.709647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b787fc0b-d5d4-446b-aaf2-dae7e5628530 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a78a7f463d44409710b902d59e8130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e093a96797549ec9c2d0b4cecdb0b82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:39.717809 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b787fc0b-d5d4-446b-aaf2-dae7e5628530 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49" status: 200 len: 1476 microversion: 2.1 time: 0.147610 Oct 12 22:51:39.718368 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3826/7003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:39 2022] GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49 => generated 1476 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:40.742053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-770ec6d3-4ddc-40c2-bcfe-2b73c78bff2d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:40.742760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-770ec6d3-4ddc-40c2-bcfe-2b73c78bff2d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:40.750036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-770ec6d3-4ddc-40c2-bcfe-2b73c78bff2d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:40.750523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-770ec6d3-4ddc-40c2-bcfe-2b73c78bff2d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:40.750966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-770ec6d3-4ddc-40c2-bcfe-2b73c78bff2d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:40.751685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-770ec6d3-4ddc-40c2-bcfe-2b73c78bff2d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:40.752144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-770ec6d3-4ddc-40c2-bcfe-2b73c78bff2d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:40.752579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-770ec6d3-4ddc-40c2-bcfe-2b73c78bff2d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:40.888000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-770ec6d3-4ddc-40c2-bcfe-2b73c78bff2d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a78a7f463d44409710b902d59e8130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e093a96797549ec9c2d0b4cecdb0b82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:40.895660 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-770ec6d3-4ddc-40c2-bcfe-2b73c78bff2d tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49" status: 200 len: 1476 microversion: 2.1 time: 0.157870 Oct 12 22:51:40.896230 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3178/7004] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:40 2022] GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49 => generated 1476 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:41.409851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-09d1ee69-2ec6-4e7e-b817-22bfb7162956 req-97bf98f4-31e8-4bea-a2ba-e529fa3c9691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b5413e-1a2e-4319-bcaf-ed673c921e49", "name": "network-vif-deleted", "tag": "191ddb34-01b3-42da-ae76-dffb312c5a75"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:41.424154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-09d1ee69-2ec6-4e7e-b817-22bfb7162956 req-97bf98f4-31e8-4bea-a2ba-e529fa3c9691 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:41.424634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-09d1ee69-2ec6-4e7e-b817-22bfb7162956 req-97bf98f4-31e8-4bea-a2ba-e529fa3c9691 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:41.425063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-09d1ee69-2ec6-4e7e-b817-22bfb7162956 req-97bf98f4-31e8-4bea-a2ba-e529fa3c9691 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:41.438070 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-09d1ee69-2ec6-4e7e-b817-22bfb7162956 req-97bf98f4-31e8-4bea-a2ba-e529fa3c9691 service nova] Creating event network-vif-deleted:191ddb34-01b3-42da-ae76-dffb312c5a75 for instance b6b5413e-1a2e-4319-bcaf-ed673c921e49 on n-h2-861111-1 Oct 12 22:51:41.443173 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-09d1ee69-2ec6-4e7e-b817-22bfb7162956 req-97bf98f4-31e8-4bea-a2ba-e529fa3c9691 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037421 Oct 12 22:51:41.443907 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3827/7005] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:41.918560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ab707f0d-c5ee-42f6-9f21-2348a5d46064 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:41.919179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ab707f0d-c5ee-42f6-9f21-2348a5d46064 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] [instance: b6b5413e-1a2e-4319-bcaf-ed673c921e49] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:41.925877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab707f0d-c5ee-42f6-9f21-2348a5d46064 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:41.926376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab707f0d-c5ee-42f6-9f21-2348a5d46064 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:41.926827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab707f0d-c5ee-42f6-9f21-2348a5d46064 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:41.927587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab707f0d-c5ee-42f6-9f21-2348a5d46064 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:41.928057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab707f0d-c5ee-42f6-9f21-2348a5d46064 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:41.928498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab707f0d-c5ee-42f6-9f21-2348a5d46064 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:41.942079 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-ab707f0d-c5ee-42f6-9f21-2348a5d46064 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] HTTP exception thrown: Instance b6b5413e-1a2e-4319-bcaf-ed673c921e49 could not be found. Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ab707f0d-c5ee-42f6-9f21-2348a5d46064 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Request method failure captured: Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49 HTTP/1.1 Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0TukEhc4TNFDgoW86g4RVJLlRS1bksHhUfj50FvsTPTPGLoh3I8Jr7VA_8r3In8MIkjAi3MGNsgFYH2Mff0QnjR1cpWzo7bO9al9sekkjFseyzVKSSnQxJAh-JgN6xp70hEmi__hOwQhUi5Fr7QGGRjR0jye8lwip7yCJbU8aP5q5Y Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 1e093a96797549ec9c2d0b4cecdb0b82 Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1362504892 Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e093a96797549ec9c2d0b4cecdb0b82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e093a96797549ec9c2d0b4cecdb0b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1e093a96797549ec9c2d0b4cecdb0b82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1e093a96797549ec9c2d0b4cecdb0b82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1362504892 Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 1e093a96797549ec9c2d0b4cecdb0b82 Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1362504892 Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersAdminNegativeTestJSON-1362504892-project Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: e5a78a7f463d44409710b902d59e8130 Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1362504892-project Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance b6b5413e-1a2e-4319-bcaf-ed673c921e49 could not be found. Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'b6b5413e-1a2e-4319-bcaf-ed673c921e49'} Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b5413e-1a2e-4319-bcaf-ed673c921e49 could not be found. Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b5413e-1a2e-4319-bcaf-ed673c921e49 could not be found. Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:51:41.943742 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:41.947879 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:51:41.947879 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:41.947879 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:41.947879 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:41.947879 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:41.947879 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:41.947879 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b5413e-1a2e-4319-bcaf-ed673c921e49 could not be found. Oct 12 22:51:41.947879 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:51:41.947879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ab707f0d-c5ee-42f6-9f21-2348a5d46064 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] Returning 404 to user: Instance b6b5413e-1a2e-4319-bcaf-ed673c921e49 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:41.947879 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ab707f0d-c5ee-42f6-9f21-2348a5d46064 tempest-ServersAdminNegativeTestJSON-1362504892 tempest-ServersAdminNegativeTestJSON-1362504892-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49" status: 404 len: 111 microversion: 2.1 time: 0.030618 Oct 12 22:51:41.947879 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3179/7006] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:41 2022] GET /compute/v2.1/servers/b6b5413e-1a2e-4319-bcaf-ed673c921e49 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:51:48.154919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1266215571", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "71604e5c-20e0-44cb-b0b3-12d7e707df3c"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:48.210949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] validate_networks() for [('71604e5c-20e0-44cb-b0b3-12d7e707df3c', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:51:48.598441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:51:48.598865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:51:48.599392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:51:48.599802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:51:48.600212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:51:48.609344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:48.609826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:48.610259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:48.610979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:48.611474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:48.611901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:48.629301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Getting quotas for project a12c898b4462405e91084f081359ac1b. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:51:48.635110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Getting quotas for user 9ff57b7247ff46ccad5054ace442de69 and project a12c898b4462405e91084f081359ac1b. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:51:48.648849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:51:48.651258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:51:48.695732 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-12e4da23-72a5-4e3e-9584-84c1c6e444a9 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668738 Oct 12 22:51:48.696983 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3828/7007] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:51:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:51:48.708265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b4169e2b-5c5c-4d85-9949-e15b837a95ef tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:48.708905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b4169e2b-5c5c-4d85-9949-e15b837a95ef tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:48.716900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:48.772669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b4169e2b-5c5c-4d85-9949-e15b837a95ef tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:48.783033 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b4169e2b-5c5c-4d85-9949-e15b837a95ef tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1215 microversion: 2.1 time: 0.078918 Oct 12 22:51:48.783966 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3180/7008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:48 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:49.807737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-67f52024-72f7-4402-9e66-0b3fc418bffa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:49.810523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-67f52024-72f7-4402-9e66-0b3fc418bffa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:49.822050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f52024-72f7-4402-9e66-0b3fc418bffa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:49.823953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f52024-72f7-4402-9e66-0b3fc418bffa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:49.824770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f52024-72f7-4402-9e66-0b3fc418bffa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:49.826194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f52024-72f7-4402-9e66-0b3fc418bffa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:49.826824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f52024-72f7-4402-9e66-0b3fc418bffa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:49.827472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-67f52024-72f7-4402-9e66-0b3fc418bffa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:49.895425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-67f52024-72f7-4402-9e66-0b3fc418bffa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:49.904414 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-67f52024-72f7-4402-9e66-0b3fc418bffa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1273 microversion: 2.1 time: 0.102247 Oct 12 22:51:49.905141 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3829/7009] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:49 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:50.928086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cbde3a27-4b95-4f48-b4d6-d8a4d76cef22 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:50.928724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cbde3a27-4b95-4f48-b4d6-d8a4d76cef22 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:50.930649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:50.938958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbde3a27-4b95-4f48-b4d6-d8a4d76cef22 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:50.939493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbde3a27-4b95-4f48-b4d6-d8a4d76cef22 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:50.939945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbde3a27-4b95-4f48-b4d6-d8a4d76cef22 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:50.940658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbde3a27-4b95-4f48-b4d6-d8a4d76cef22 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:50.941302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbde3a27-4b95-4f48-b4d6-d8a4d76cef22 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:50.941739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbde3a27-4b95-4f48-b4d6-d8a4d76cef22 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:51.137995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cbde3a27-4b95-4f48-b4d6-d8a4d76cef22 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:51.147636 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cbde3a27-4b95-4f48-b4d6-d8a4d76cef22 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1315 microversion: 2.1 time: 0.223300 Oct 12 22:51:51.148322 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3181/7010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:50 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:51.301374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-debd54bd-c068-4e60-a33e-3904d4de180a req-54c5f739-e0e4-4839-a9b0-76ce5358990f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bd3ee67-0e15-489c-bbac-1db00d1f9212", "tag": "d4f55184-0969-4bf4-801a-3e0003320c1d"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:51.312649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-debd54bd-c068-4e60-a33e-3904d4de180a req-54c5f739-e0e4-4839-a9b0-76ce5358990f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:51.313297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-debd54bd-c068-4e60-a33e-3904d4de180a req-54c5f739-e0e4-4839-a9b0-76ce5358990f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:51.313832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-debd54bd-c068-4e60-a33e-3904d4de180a req-54c5f739-e0e4-4839-a9b0-76ce5358990f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:51.327388 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-debd54bd-c068-4e60-a33e-3904d4de180a req-54c5f739-e0e4-4839-a9b0-76ce5358990f service nova] Creating event network-changed:d4f55184-0969-4bf4-801a-3e0003320c1d for instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 on n-h2-861111-1 Oct 12 22:51:51.333134 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-debd54bd-c068-4e60-a33e-3904d4de180a req-54c5f739-e0e4-4839-a9b0-76ce5358990f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110222 Oct 12 22:51:51.334292 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3830/7011] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:52.172025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8646118a-3376-4d71-a566-f3c62c05ec44 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:52.172757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8646118a-3376-4d71-a566-f3c62c05ec44 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:52.180003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8646118a-3376-4d71-a566-f3c62c05ec44 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:52.180441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8646118a-3376-4d71-a566-f3c62c05ec44 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:52.180892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8646118a-3376-4d71-a566-f3c62c05ec44 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:52.181590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8646118a-3376-4d71-a566-f3c62c05ec44 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:52.182048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8646118a-3376-4d71-a566-f3c62c05ec44 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:52.182483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8646118a-3376-4d71-a566-f3c62c05ec44 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:52.309388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8646118a-3376-4d71-a566-f3c62c05ec44 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:52.316968 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8646118a-3376-4d71-a566-f3c62c05ec44 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1315 microversion: 2.1 time: 0.149611 Oct 12 22:51:52.317534 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3182/7012] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:52 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:53.341381 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f6bde64a-7d57-4bff-a5b8-21b5c4fd1af4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:53.342097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f6bde64a-7d57-4bff-a5b8-21b5c4fd1af4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:53.348284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6bde64a-7d57-4bff-a5b8-21b5c4fd1af4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:53.348767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6bde64a-7d57-4bff-a5b8-21b5c4fd1af4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:53.349197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6bde64a-7d57-4bff-a5b8-21b5c4fd1af4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:53.349881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6bde64a-7d57-4bff-a5b8-21b5c4fd1af4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:53.350331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6bde64a-7d57-4bff-a5b8-21b5c4fd1af4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:53.350761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6bde64a-7d57-4bff-a5b8-21b5c4fd1af4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:53.483941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f6bde64a-7d57-4bff-a5b8-21b5c4fd1af4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:53.491591 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f6bde64a-7d57-4bff-a5b8-21b5c4fd1af4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1315 microversion: 2.1 time: 0.155421 Oct 12 22:51:53.492163 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3831/7013] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:53 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:54.515692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-95cba841-364f-4d4e-8291-40a8855d793c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:54.516321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-95cba841-364f-4d4e-8291-40a8855d793c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:54.523076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95cba841-364f-4d4e-8291-40a8855d793c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:54.523607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95cba841-364f-4d4e-8291-40a8855d793c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:54.524063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95cba841-364f-4d4e-8291-40a8855d793c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:54.524766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95cba841-364f-4d4e-8291-40a8855d793c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:54.525231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95cba841-364f-4d4e-8291-40a8855d793c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:54.525671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95cba841-364f-4d4e-8291-40a8855d793c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:54.665363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-95cba841-364f-4d4e-8291-40a8855d793c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:54.673610 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-95cba841-364f-4d4e-8291-40a8855d793c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1315 microversion: 2.1 time: 0.162360 Oct 12 22:51:54.674210 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3183/7014] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:54 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:55.696611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ca4d7616-4720-49a1-8f0b-01990548ea27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:55.697265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ca4d7616-4720-49a1-8f0b-01990548ea27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:55.704487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca4d7616-4720-49a1-8f0b-01990548ea27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:55.704977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca4d7616-4720-49a1-8f0b-01990548ea27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:55.705418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca4d7616-4720-49a1-8f0b-01990548ea27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:55.706110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca4d7616-4720-49a1-8f0b-01990548ea27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:55.706568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca4d7616-4720-49a1-8f0b-01990548ea27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:55.706998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca4d7616-4720-49a1-8f0b-01990548ea27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:55.836390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ca4d7616-4720-49a1-8f0b-01990548ea27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:55.844025 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ca4d7616-4720-49a1-8f0b-01990548ea27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1315 microversion: 2.1 time: 0.151397 Oct 12 22:51:55.844608 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3832/7015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:55 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:56.866757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-96ce75e1-717b-40d7-a967-2da7a80faf7b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:56.867408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-96ce75e1-717b-40d7-a967-2da7a80faf7b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:56.874636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96ce75e1-717b-40d7-a967-2da7a80faf7b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:56.875126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96ce75e1-717b-40d7-a967-2da7a80faf7b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:56.876016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96ce75e1-717b-40d7-a967-2da7a80faf7b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:56.876293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96ce75e1-717b-40d7-a967-2da7a80faf7b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:56.876753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96ce75e1-717b-40d7-a967-2da7a80faf7b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:56.877181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96ce75e1-717b-40d7-a967-2da7a80faf7b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:57.007618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-96ce75e1-717b-40d7-a967-2da7a80faf7b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:57.013489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-227c0145-1c5a-4107-8b28-8227d39b8846 req-a9467dca-3980-4506-bcf3-f129a401858d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bd3ee67-0e15-489c-bbac-1db00d1f9212", "name": "network-vif-plugged", "status": "completed", "tag": "d4f55184-0969-4bf4-801a-3e0003320c1d"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:57.016599 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-96ce75e1-717b-40d7-a967-2da7a80faf7b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1315 microversion: 2.1 time: 0.153628 Oct 12 22:51:57.023473 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3184/7016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:56 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:57.024973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-227c0145-1c5a-4107-8b28-8227d39b8846 req-a9467dca-3980-4506-bcf3-f129a401858d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:57.025577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-227c0145-1c5a-4107-8b28-8227d39b8846 req-a9467dca-3980-4506-bcf3-f129a401858d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:57.026117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-227c0145-1c5a-4107-8b28-8227d39b8846 req-a9467dca-3980-4506-bcf3-f129a401858d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:57.037742 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-227c0145-1c5a-4107-8b28-8227d39b8846 req-a9467dca-3980-4506-bcf3-f129a401858d service nova] Creating event network-vif-plugged:d4f55184-0969-4bf4-801a-3e0003320c1d for instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 on n-h2-861111-1 Oct 12 22:51:57.042638 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-227c0145-1c5a-4107-8b28-8227d39b8846 req-a9467dca-3980-4506-bcf3-f129a401858d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034246 Oct 12 22:51:57.043307 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3833/7017] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:58.040920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8417390f-2ff1-4717-90e9-0998bf67530e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:58.041477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8417390f-2ff1-4717-90e9-0998bf67530e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:58.044236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:58.049514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8417390f-2ff1-4717-90e9-0998bf67530e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:58.050023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8417390f-2ff1-4717-90e9-0998bf67530e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:58.050476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8417390f-2ff1-4717-90e9-0998bf67530e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:58.051184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8417390f-2ff1-4717-90e9-0998bf67530e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:58.051679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8417390f-2ff1-4717-90e9-0998bf67530e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:58.052128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8417390f-2ff1-4717-90e9-0998bf67530e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:58.056845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:58.186949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8417390f-2ff1-4717-90e9-0998bf67530e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:58.194924 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8417390f-2ff1-4717-90e9-0998bf67530e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1315 microversion: 2.1 time: 0.158049 Oct 12 22:51:58.195664 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3185/7018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:58 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:59.216796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=5 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:59.217594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=8 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:59.221847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-27f9cb58-cc7e-4358-af4a-bda7f6aa3e27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:59.222550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-27f9cb58-cc7e-4358-af4a-bda7f6aa3e27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:59.224398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:59.232052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27f9cb58-cc7e-4358-af4a-bda7f6aa3e27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:59.232536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27f9cb58-cc7e-4358-af4a-bda7f6aa3e27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:59.232975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27f9cb58-cc7e-4358-af4a-bda7f6aa3e27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:59.233662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27f9cb58-cc7e-4358-af4a-bda7f6aa3e27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:59.234117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27f9cb58-cc7e-4358-af4a-bda7f6aa3e27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:59.234545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27f9cb58-cc7e-4358-af4a-bda7f6aa3e27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:59.238963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=76 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:59.366269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-27f9cb58-cc7e-4358-af4a-bda7f6aa3e27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:59.374190 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-27f9cb58-cc7e-4358-af4a-bda7f6aa3e27 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1502 microversion: 2.1 time: 0.159644 Oct 12 22:51:59.374767 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3834/7019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:59 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:59.396361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:59.398674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:59.400602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:59.407868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:59.408380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:59.408836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:59.409555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:59.410041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:59.410585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:59.484917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:59.490286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Old instance type m1.heat2, new instance type m1.heat {{(pid=120452) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:51:59.496758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:51:59.497193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:51:59.497677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:51:59.498097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:51:59.498520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:51:59.606962 n-d-861111-1 devstack@n-api.service[120452]: ERROR oslo.messaging._drivers.impl_rabbit [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [3f43aec9-e4e3-4d70-83f1-ac7aeaf3512f] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 22:52:00.614535 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [3f43aec9-e4e3-4d70-83f1-ac7aeaf3512f] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 35722. Oct 12 22:52:00.617666 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-39a821f8-93a5-49c7-9828-6f5226c9a33b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "POST /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212/action" status: 202 len: 0 microversion: 2.1 time: 1.225281 Oct 12 22:52:00.618305 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3186/7020] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:51:59 2022] POST /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212/action => generated 0 bytes in 1226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:52:00.627041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fd05faf1-9453-4888-b0ee-fd29c8bb7107 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:00.627900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fd05faf1-9453-4888-b0ee-fd29c8bb7107 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:00.635481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd05faf1-9453-4888-b0ee-fd29c8bb7107 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:00.636134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd05faf1-9453-4888-b0ee-fd29c8bb7107 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:00.636579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd05faf1-9453-4888-b0ee-fd29c8bb7107 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:00.637356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd05faf1-9453-4888-b0ee-fd29c8bb7107 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:00.637809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd05faf1-9453-4888-b0ee-fd29c8bb7107 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:00.638235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd05faf1-9453-4888-b0ee-fd29c8bb7107 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:00.817307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fd05faf1-9453-4888-b0ee-fd29c8bb7107 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:00.826359 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fd05faf1-9453-4888-b0ee-fd29c8bb7107 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1511 microversion: 2.1 time: 0.203128 Oct 12 22:52:00.827604 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3835/7021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:00 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:01.851137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ba0c33df-d934-4f1e-902a-3cc03a5deeb7 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:01.851804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ba0c33df-d934-4f1e-902a-3cc03a5deeb7 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:01.860003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0c33df-d934-4f1e-902a-3cc03a5deeb7 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:01.860519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0c33df-d934-4f1e-902a-3cc03a5deeb7 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:01.860982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0c33df-d934-4f1e-902a-3cc03a5deeb7 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:01.861693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0c33df-d934-4f1e-902a-3cc03a5deeb7 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:01.862165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0c33df-d934-4f1e-902a-3cc03a5deeb7 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:01.862607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0c33df-d934-4f1e-902a-3cc03a5deeb7 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:01.991455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba0c33df-d934-4f1e-902a-3cc03a5deeb7 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:01.999700 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ba0c33df-d934-4f1e-902a-3cc03a5deeb7 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1511 microversion: 2.1 time: 0.153737 Oct 12 22:52:02.000282 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3187/7022] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:01 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:03.023018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe2d799e-1d28-4932-bd19-a8f8d1daf903 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:03.023580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fe2d799e-1d28-4932-bd19-a8f8d1daf903 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:03.030455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe2d799e-1d28-4932-bd19-a8f8d1daf903 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:03.030943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe2d799e-1d28-4932-bd19-a8f8d1daf903 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:03.031420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe2d799e-1d28-4932-bd19-a8f8d1daf903 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:03.032115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe2d799e-1d28-4932-bd19-a8f8d1daf903 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:03.032578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe2d799e-1d28-4932-bd19-a8f8d1daf903 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:03.033009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe2d799e-1d28-4932-bd19-a8f8d1daf903 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:03.161242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fe2d799e-1d28-4932-bd19-a8f8d1daf903 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:03.168970 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fe2d799e-1d28-4932-bd19-a8f8d1daf903 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.149950 Oct 12 22:52:03.169546 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3836/7023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:03 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:04.192748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-25546765-abd9-4cb8-95d3-126381d3529e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:04.193375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-25546765-abd9-4cb8-95d3-126381d3529e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:04.200772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25546765-abd9-4cb8-95d3-126381d3529e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:04.201267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25546765-abd9-4cb8-95d3-126381d3529e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:04.201717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25546765-abd9-4cb8-95d3-126381d3529e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:04.202411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25546765-abd9-4cb8-95d3-126381d3529e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:04.202875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25546765-abd9-4cb8-95d3-126381d3529e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:04.203337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25546765-abd9-4cb8-95d3-126381d3529e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:04.336111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-25546765-abd9-4cb8-95d3-126381d3529e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:04.344326 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-25546765-abd9-4cb8-95d3-126381d3529e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.155489 Oct 12 22:52:04.344899 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3188/7024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:04 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:05.367776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4a24e503-3900-4c25-9a7b-466d9c34112d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:05.368401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4a24e503-3900-4c25-9a7b-466d9c34112d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:05.374832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a24e503-3900-4c25-9a7b-466d9c34112d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:05.375360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a24e503-3900-4c25-9a7b-466d9c34112d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:05.375803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a24e503-3900-4c25-9a7b-466d9c34112d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:05.376496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a24e503-3900-4c25-9a7b-466d9c34112d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:05.376951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a24e503-3900-4c25-9a7b-466d9c34112d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:05.377382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a24e503-3900-4c25-9a7b-466d9c34112d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:05.507257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4a24e503-3900-4c25-9a7b-466d9c34112d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:05.515369 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4a24e503-3900-4c25-9a7b-466d9c34112d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.151669 Oct 12 22:52:05.515942 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3837/7025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:05 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:06.538630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2316c45d-3a8e-4efb-8f71-f71523eac655 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:06.539301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2316c45d-3a8e-4efb-8f71-f71523eac655 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:06.546632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2316c45d-3a8e-4efb-8f71-f71523eac655 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:06.547128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2316c45d-3a8e-4efb-8f71-f71523eac655 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:06.547605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2316c45d-3a8e-4efb-8f71-f71523eac655 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:06.548308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2316c45d-3a8e-4efb-8f71-f71523eac655 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:06.548774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2316c45d-3a8e-4efb-8f71-f71523eac655 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:06.549214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2316c45d-3a8e-4efb-8f71-f71523eac655 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:06.677496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2316c45d-3a8e-4efb-8f71-f71523eac655 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:06.685268 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2316c45d-3a8e-4efb-8f71-f71523eac655 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.150823 Oct 12 22:52:06.685840 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3189/7026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:06 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:07.707745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ff75041b-c2d3-4ad2-b381-3fb62bbfee35 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:07.708365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ff75041b-c2d3-4ad2-b381-3fb62bbfee35 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:07.715319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff75041b-c2d3-4ad2-b381-3fb62bbfee35 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:07.715806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff75041b-c2d3-4ad2-b381-3fb62bbfee35 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:07.716246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff75041b-c2d3-4ad2-b381-3fb62bbfee35 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:07.716934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff75041b-c2d3-4ad2-b381-3fb62bbfee35 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:07.717386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff75041b-c2d3-4ad2-b381-3fb62bbfee35 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:07.717810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff75041b-c2d3-4ad2-b381-3fb62bbfee35 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:07.846780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ff75041b-c2d3-4ad2-b381-3fb62bbfee35 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:07.854784 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ff75041b-c2d3-4ad2-b381-3fb62bbfee35 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.150938 Oct 12 22:52:07.855378 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3838/7027] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:07 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:08.878860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4bbf7e2c-4e9d-4d02-a150-1ae7c5f50897 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:08.879515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4bbf7e2c-4e9d-4d02-a150-1ae7c5f50897 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:08.886362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bbf7e2c-4e9d-4d02-a150-1ae7c5f50897 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:08.887501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bbf7e2c-4e9d-4d02-a150-1ae7c5f50897 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:08.887982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bbf7e2c-4e9d-4d02-a150-1ae7c5f50897 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:08.888660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bbf7e2c-4e9d-4d02-a150-1ae7c5f50897 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:08.889121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bbf7e2c-4e9d-4d02-a150-1ae7c5f50897 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:08.889553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4bbf7e2c-4e9d-4d02-a150-1ae7c5f50897 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:09.016260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4bbf7e2c-4e9d-4d02-a150-1ae7c5f50897 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:09.023985 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4bbf7e2c-4e9d-4d02-a150-1ae7c5f50897 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.148951 Oct 12 22:52:09.024493 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3190/7028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:08 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:10.046452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0a726c47-d80a-446f-8828-212d527bd692 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:10.047026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0a726c47-d80a-446f-8828-212d527bd692 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:10.053913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a726c47-d80a-446f-8828-212d527bd692 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:10.054387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a726c47-d80a-446f-8828-212d527bd692 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:10.054820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a726c47-d80a-446f-8828-212d527bd692 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:10.055532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a726c47-d80a-446f-8828-212d527bd692 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:10.055983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a726c47-d80a-446f-8828-212d527bd692 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:10.056405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0a726c47-d80a-446f-8828-212d527bd692 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:10.188642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0a726c47-d80a-446f-8828-212d527bd692 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:10.196485 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0a726c47-d80a-446f-8828-212d527bd692 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.154022 Oct 12 22:52:10.197066 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3839/7029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:10 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:11.220525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a800451b-33b1-4c9b-9fbe-9e953a06e823 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:11.221268 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a800451b-33b1-4c9b-9fbe-9e953a06e823 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:11.228323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a800451b-33b1-4c9b-9fbe-9e953a06e823 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:11.228809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a800451b-33b1-4c9b-9fbe-9e953a06e823 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:11.229253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a800451b-33b1-4c9b-9fbe-9e953a06e823 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:11.229947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a800451b-33b1-4c9b-9fbe-9e953a06e823 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:11.230405 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a800451b-33b1-4c9b-9fbe-9e953a06e823 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:11.230833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a800451b-33b1-4c9b-9fbe-9e953a06e823 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:11.361821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a800451b-33b1-4c9b-9fbe-9e953a06e823 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:11.369490 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a800451b-33b1-4c9b-9fbe-9e953a06e823 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.153345 Oct 12 22:52:11.370044 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3191/7030] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:11 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:12.392338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a73cf1a7-e835-4da1-8bb0-f6f8ca7d320f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:12.392976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a73cf1a7-e835-4da1-8bb0-f6f8ca7d320f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:12.399775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a73cf1a7-e835-4da1-8bb0-f6f8ca7d320f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:12.400254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a73cf1a7-e835-4da1-8bb0-f6f8ca7d320f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:12.400684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a73cf1a7-e835-4da1-8bb0-f6f8ca7d320f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:12.401364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a73cf1a7-e835-4da1-8bb0-f6f8ca7d320f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:12.401815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a73cf1a7-e835-4da1-8bb0-f6f8ca7d320f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:12.402236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a73cf1a7-e835-4da1-8bb0-f6f8ca7d320f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:12.534518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a73cf1a7-e835-4da1-8bb0-f6f8ca7d320f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:12.542220 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a73cf1a7-e835-4da1-8bb0-f6f8ca7d320f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.153796 Oct 12 22:52:12.542791 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3840/7031] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:12 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:13.565890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c4fa15fb-aaa9-4396-b73b-ad2e2e852887 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:13.566516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c4fa15fb-aaa9-4396-b73b-ad2e2e852887 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:13.573187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4fa15fb-aaa9-4396-b73b-ad2e2e852887 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:13.573657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4fa15fb-aaa9-4396-b73b-ad2e2e852887 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:13.574104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4fa15fb-aaa9-4396-b73b-ad2e2e852887 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:13.574798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4fa15fb-aaa9-4396-b73b-ad2e2e852887 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:13.575278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4fa15fb-aaa9-4396-b73b-ad2e2e852887 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:13.576349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c4fa15fb-aaa9-4396-b73b-ad2e2e852887 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:13.708679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c4fa15fb-aaa9-4396-b73b-ad2e2e852887 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:13.716341 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c4fa15fb-aaa9-4396-b73b-ad2e2e852887 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.154352 Oct 12 22:52:13.716912 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3192/7032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:13 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:14.740724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7fb47ede-a907-4161-a43a-ddbc0261434e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:14.741363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7fb47ede-a907-4161-a43a-ddbc0261434e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:14.748692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fb47ede-a907-4161-a43a-ddbc0261434e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:14.749415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fb47ede-a907-4161-a43a-ddbc0261434e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:14.749867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fb47ede-a907-4161-a43a-ddbc0261434e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:14.750611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fb47ede-a907-4161-a43a-ddbc0261434e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:14.751076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fb47ede-a907-4161-a43a-ddbc0261434e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:14.751747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fb47ede-a907-4161-a43a-ddbc0261434e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:14.884166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7fb47ede-a907-4161-a43a-ddbc0261434e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:14.892423 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7fb47ede-a907-4161-a43a-ddbc0261434e tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.155637 Oct 12 22:52:14.892998 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3841/7033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:14 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:15.915512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-205458f4-3b10-4fdc-82c1-5cfe75e85575 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:15.916194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-205458f4-3b10-4fdc-82c1-5cfe75e85575 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:15.923337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-205458f4-3b10-4fdc-82c1-5cfe75e85575 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:15.923836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-205458f4-3b10-4fdc-82c1-5cfe75e85575 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:15.924283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-205458f4-3b10-4fdc-82c1-5cfe75e85575 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:15.924977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-205458f4-3b10-4fdc-82c1-5cfe75e85575 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:15.925436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-205458f4-3b10-4fdc-82c1-5cfe75e85575 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:15.925870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-205458f4-3b10-4fdc-82c1-5cfe75e85575 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:16.057438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-205458f4-3b10-4fdc-82c1-5cfe75e85575 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:16.065123 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-205458f4-3b10-4fdc-82c1-5cfe75e85575 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.153844 Oct 12 22:52:16.065700 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3193/7034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:15 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:17.088888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5541e7e1-c907-450a-95a7-ab8f8ac442e8 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:17.089417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5541e7e1-c907-450a-95a7-ab8f8ac442e8 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:17.096772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5541e7e1-c907-450a-95a7-ab8f8ac442e8 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:17.097258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5541e7e1-c907-450a-95a7-ab8f8ac442e8 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:17.097699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5541e7e1-c907-450a-95a7-ab8f8ac442e8 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:17.098394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5541e7e1-c907-450a-95a7-ab8f8ac442e8 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:17.098848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5541e7e1-c907-450a-95a7-ab8f8ac442e8 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:17.099299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5541e7e1-c907-450a-95a7-ab8f8ac442e8 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:17.228480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5541e7e1-c907-450a-95a7-ab8f8ac442e8 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:17.237125 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5541e7e1-c907-450a-95a7-ab8f8ac442e8 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.152229 Oct 12 22:52:17.237707 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3842/7035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:17 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:18.259954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9ef4ebac-2723-4dcc-aa7f-bd804e662112 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:18.260577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9ef4ebac-2723-4dcc-aa7f-bd804e662112 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:18.267507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ef4ebac-2723-4dcc-aa7f-bd804e662112 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:18.267995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ef4ebac-2723-4dcc-aa7f-bd804e662112 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:18.268435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ef4ebac-2723-4dcc-aa7f-bd804e662112 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:18.269129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ef4ebac-2723-4dcc-aa7f-bd804e662112 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:18.269593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ef4ebac-2723-4dcc-aa7f-bd804e662112 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:18.270027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ef4ebac-2723-4dcc-aa7f-bd804e662112 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:18.398609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9ef4ebac-2723-4dcc-aa7f-bd804e662112 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:18.406281 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9ef4ebac-2723-4dcc-aa7f-bd804e662112 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.150040 Oct 12 22:52:18.406769 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3194/7036] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:18 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:19.429930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fb6f0624-e208-4def-a49a-23f0e4796b8d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:19.430549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fb6f0624-e208-4def-a49a-23f0e4796b8d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:19.437843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fb6f0624-e208-4def-a49a-23f0e4796b8d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:19.438420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fb6f0624-e208-4def-a49a-23f0e4796b8d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:19.438864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fb6f0624-e208-4def-a49a-23f0e4796b8d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:19.439604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fb6f0624-e208-4def-a49a-23f0e4796b8d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:19.440067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fb6f0624-e208-4def-a49a-23f0e4796b8d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:19.440497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fb6f0624-e208-4def-a49a-23f0e4796b8d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:19.567683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fb6f0624-e208-4def-a49a-23f0e4796b8d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:19.575366 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fb6f0624-e208-4def-a49a-23f0e4796b8d tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.149323 Oct 12 22:52:19.576601 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3843/7037] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:19 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:20.599283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-57dddb23-6243-4241-8ae5-07b24448ef79 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:20.599839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-57dddb23-6243-4241-8ae5-07b24448ef79 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:20.606892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57dddb23-6243-4241-8ae5-07b24448ef79 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:20.607425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57dddb23-6243-4241-8ae5-07b24448ef79 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:20.607880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57dddb23-6243-4241-8ae5-07b24448ef79 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:20.608588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57dddb23-6243-4241-8ae5-07b24448ef79 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:20.609053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57dddb23-6243-4241-8ae5-07b24448ef79 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:20.609491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57dddb23-6243-4241-8ae5-07b24448ef79 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:20.737155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-57dddb23-6243-4241-8ae5-07b24448ef79 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:20.744824 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-57dddb23-6243-4241-8ae5-07b24448ef79 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.149493 Oct 12 22:52:20.745389 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3195/7038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:20 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:21.768108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-02b33db8-4647-4d83-850b-e6d557c8aa8b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:21.768815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-02b33db8-4647-4d83-850b-e6d557c8aa8b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:21.775907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b33db8-4647-4d83-850b-e6d557c8aa8b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:21.776398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b33db8-4647-4d83-850b-e6d557c8aa8b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:21.776841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b33db8-4647-4d83-850b-e6d557c8aa8b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:21.777535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b33db8-4647-4d83-850b-e6d557c8aa8b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:21.777995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b33db8-4647-4d83-850b-e6d557c8aa8b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:21.778426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-02b33db8-4647-4d83-850b-e6d557c8aa8b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:21.912030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-02b33db8-4647-4d83-850b-e6d557c8aa8b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:21.920646 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-02b33db8-4647-4d83-850b-e6d557c8aa8b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.156467 Oct 12 22:52:21.921241 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3844/7039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:21 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:22.943121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ff7a7275-f972-43d8-9905-e40fb11ace99 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:22.943709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ff7a7275-f972-43d8-9905-e40fb11ace99 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:22.950863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff7a7275-f972-43d8-9905-e40fb11ace99 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:22.951396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff7a7275-f972-43d8-9905-e40fb11ace99 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:22.951850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff7a7275-f972-43d8-9905-e40fb11ace99 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:22.952559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff7a7275-f972-43d8-9905-e40fb11ace99 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:22.953023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff7a7275-f972-43d8-9905-e40fb11ace99 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:22.953475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff7a7275-f972-43d8-9905-e40fb11ace99 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:23.078938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ff7a7275-f972-43d8-9905-e40fb11ace99 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:23.086578 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ff7a7275-f972-43d8-9905-e40fb11ace99 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.147454 Oct 12 22:52:23.087144 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3196/7040] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:22 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:24.110415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a2f7a67e-bf97-4eb9-8c51-482f95ace93c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:24.110976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a2f7a67e-bf97-4eb9-8c51-482f95ace93c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:24.114073 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 22:52:24.114217 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 22:52:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 (ip 10.222.0.16) !!! Oct 12 22:52:24.120196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2f7a67e-bf97-4eb9-8c51-482f95ace93c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:24.120684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2f7a67e-bf97-4eb9-8c51-482f95ace93c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:24.121129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2f7a67e-bf97-4eb9-8c51-482f95ace93c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:24.121832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2f7a67e-bf97-4eb9-8c51-482f95ace93c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:24.122292 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2f7a67e-bf97-4eb9-8c51-482f95ace93c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:24.123229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2f7a67e-bf97-4eb9-8c51-482f95ace93c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:24.259340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a2f7a67e-bf97-4eb9-8c51-482f95ace93c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:24.267163 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a2f7a67e-bf97-4eb9-8c51-482f95ace93c tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.160764 Oct 12 22:52:24.267768 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3845/7041] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:24 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:25.289945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2caaf8d5-8d6b-4f8e-9176-6d016403c811 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:25.290608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2caaf8d5-8d6b-4f8e-9176-6d016403c811 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:25.298024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2caaf8d5-8d6b-4f8e-9176-6d016403c811 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:25.298518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2caaf8d5-8d6b-4f8e-9176-6d016403c811 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:25.298971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2caaf8d5-8d6b-4f8e-9176-6d016403c811 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:25.299698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2caaf8d5-8d6b-4f8e-9176-6d016403c811 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:25.300161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2caaf8d5-8d6b-4f8e-9176-6d016403c811 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:25.300595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2caaf8d5-8d6b-4f8e-9176-6d016403c811 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:25.426570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2caaf8d5-8d6b-4f8e-9176-6d016403c811 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:25.434458 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2caaf8d5-8d6b-4f8e-9176-6d016403c811 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.148437 Oct 12 22:52:25.435528 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3197/7042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:25 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:26.458430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-60e7fa6c-2815-4aaa-b327-300a929afd67 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:26.459083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-60e7fa6c-2815-4aaa-b327-300a929afd67 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:26.465917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60e7fa6c-2815-4aaa-b327-300a929afd67 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:26.466402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60e7fa6c-2815-4aaa-b327-300a929afd67 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:26.466962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60e7fa6c-2815-4aaa-b327-300a929afd67 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:26.468176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60e7fa6c-2815-4aaa-b327-300a929afd67 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:26.468641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60e7fa6c-2815-4aaa-b327-300a929afd67 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:26.469069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60e7fa6c-2815-4aaa-b327-300a929afd67 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:26.599454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-60e7fa6c-2815-4aaa-b327-300a929afd67 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:26.607520 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-60e7fa6c-2815-4aaa-b327-300a929afd67 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.153004 Oct 12 22:52:26.608101 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3846/7043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:26 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:27.630671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c007e41f-b1f7-4590-888b-259c354a61ec tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:27.631324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c007e41f-b1f7-4590-888b-259c354a61ec tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:27.638050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c007e41f-b1f7-4590-888b-259c354a61ec tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:27.638538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c007e41f-b1f7-4590-888b-259c354a61ec tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:27.639015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c007e41f-b1f7-4590-888b-259c354a61ec tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:27.639738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c007e41f-b1f7-4590-888b-259c354a61ec tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:27.640238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c007e41f-b1f7-4590-888b-259c354a61ec tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:27.640669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c007e41f-b1f7-4590-888b-259c354a61ec tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:28.099155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c007e41f-b1f7-4590-888b-259c354a61ec tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:28.101354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:28.108262 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c007e41f-b1f7-4590-888b-259c354a61ec tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.481463 Oct 12 22:52:28.108852 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3198/7044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:27 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:29.130741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-737dcf75-00e0-402c-84a8-944b779a505b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:29.131310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-737dcf75-00e0-402c-84a8-944b779a505b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:29.138117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-737dcf75-00e0-402c-84a8-944b779a505b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:29.138606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-737dcf75-00e0-402c-84a8-944b779a505b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:29.139046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-737dcf75-00e0-402c-84a8-944b779a505b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:29.139768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-737dcf75-00e0-402c-84a8-944b779a505b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:29.140226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-737dcf75-00e0-402c-84a8-944b779a505b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:29.140658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-737dcf75-00e0-402c-84a8-944b779a505b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:29.268594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-737dcf75-00e0-402c-84a8-944b779a505b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:29.270777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=82 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:29.277553 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-737dcf75-00e0-402c-84a8-944b779a505b tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1516 microversion: 2.1 time: 0.150780 Oct 12 22:52:29.278132 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3847/7045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:29 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:29.991754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-8c39dd6c-6c40-4e5f-a21e-ea6011e6107a req-715e17c5-2ca7-4a44-b440-0ed019262666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bd3ee67-0e15-489c-bbac-1db00d1f9212", "name": "network-vif-unplugged", "status": "completed", "tag": "d4f55184-0969-4bf4-801a-3e0003320c1d"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:30.001160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=32 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:30.006999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8c39dd6c-6c40-4e5f-a21e-ea6011e6107a req-715e17c5-2ca7-4a44-b440-0ed019262666 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:30.007608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8c39dd6c-6c40-4e5f-a21e-ea6011e6107a req-715e17c5-2ca7-4a44-b440-0ed019262666 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:30.008182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8c39dd6c-6c40-4e5f-a21e-ea6011e6107a req-715e17c5-2ca7-4a44-b440-0ed019262666 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:30.020871 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-8c39dd6c-6c40-4e5f-a21e-ea6011e6107a req-715e17c5-2ca7-4a44-b440-0ed019262666 service nova] Creating event network-vif-unplugged:d4f55184-0969-4bf4-801a-3e0003320c1d for instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 on n-h1-861111-1 Oct 12 22:52:30.026351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-8c39dd6c-6c40-4e5f-a21e-ea6011e6107a req-715e17c5-2ca7-4a44-b440-0ed019262666 service nova] Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:52:30.040086 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-8c39dd6c-6c40-4e5f-a21e-ea6011e6107a req-715e17c5-2ca7-4a44-b440-0ed019262666 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051955 Oct 12 22:52:30.040694 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3199/7046] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:30.302169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-22af06f2-3f04-4093-838b-396336ff877f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:30.302828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-22af06f2-3f04-4093-838b-396336ff877f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:30.306712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=28 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:30.313642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22af06f2-3f04-4093-838b-396336ff877f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:30.314461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22af06f2-3f04-4093-838b-396336ff877f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:30.314907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22af06f2-3f04-4093-838b-396336ff877f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:30.315671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22af06f2-3f04-4093-838b-396336ff877f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:30.316135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22af06f2-3f04-4093-838b-396336ff877f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:30.316569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-22af06f2-3f04-4093-838b-396336ff877f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:30.463616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-22af06f2-3f04-4093-838b-396336ff877f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:30.471383 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-22af06f2-3f04-4093-838b-396336ff877f tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1515 microversion: 2.1 time: 0.173538 Oct 12 22:52:30.471967 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3848/7047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:30 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:31.496115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7c6519a6-2b2d-437e-8cb0-2a1c49b44d5a tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:31.496885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7c6519a6-2b2d-437e-8cb0-2a1c49b44d5a tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:31.504508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6519a6-2b2d-437e-8cb0-2a1c49b44d5a tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:31.505007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6519a6-2b2d-437e-8cb0-2a1c49b44d5a tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:31.505462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6519a6-2b2d-437e-8cb0-2a1c49b44d5a tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:31.506168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6519a6-2b2d-437e-8cb0-2a1c49b44d5a tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:31.506641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6519a6-2b2d-437e-8cb0-2a1c49b44d5a tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:31.507086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c6519a6-2b2d-437e-8cb0-2a1c49b44d5a tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:31.639398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7c6519a6-2b2d-437e-8cb0-2a1c49b44d5a tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:31.647756 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7c6519a6-2b2d-437e-8cb0-2a1c49b44d5a tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1513 microversion: 2.1 time: 0.155893 Oct 12 22:52:31.648327 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3200/7048] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:31 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:32.067571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-91bea7c6-4a70-4ad5-b8b7-06bf505cb982 req-abc6b56d-861b-486c-911e-2f41a8b91b76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bd3ee67-0e15-489c-bbac-1db00d1f9212", "tag": "d4f55184-0969-4bf4-801a-3e0003320c1d"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:32.077822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-91bea7c6-4a70-4ad5-b8b7-06bf505cb982 req-abc6b56d-861b-486c-911e-2f41a8b91b76 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:32.078299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-91bea7c6-4a70-4ad5-b8b7-06bf505cb982 req-abc6b56d-861b-486c-911e-2f41a8b91b76 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:32.078730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-91bea7c6-4a70-4ad5-b8b7-06bf505cb982 req-abc6b56d-861b-486c-911e-2f41a8b91b76 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:32.090113 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-91bea7c6-4a70-4ad5-b8b7-06bf505cb982 req-abc6b56d-861b-486c-911e-2f41a8b91b76 service nova] Creating event network-changed:d4f55184-0969-4bf4-801a-3e0003320c1d for instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 on n-h1-861111-1 Oct 12 22:52:32.095833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-91bea7c6-4a70-4ad5-b8b7-06bf505cb982 req-abc6b56d-861b-486c-911e-2f41a8b91b76 service nova] Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:52:32.106404 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-91bea7c6-4a70-4ad5-b8b7-06bf505cb982 req-abc6b56d-861b-486c-911e-2f41a8b91b76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042591 Oct 12 22:52:32.106979 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3849/7049] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:32.671286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e86f1f11-9a50-495a-87c4-c5ac49dc23dc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:32.671935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e86f1f11-9a50-495a-87c4-c5ac49dc23dc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:32.678563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e86f1f11-9a50-495a-87c4-c5ac49dc23dc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:32.679066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e86f1f11-9a50-495a-87c4-c5ac49dc23dc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:32.679576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e86f1f11-9a50-495a-87c4-c5ac49dc23dc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:32.680289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e86f1f11-9a50-495a-87c4-c5ac49dc23dc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:32.680753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e86f1f11-9a50-495a-87c4-c5ac49dc23dc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:32.681189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e86f1f11-9a50-495a-87c4-c5ac49dc23dc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:32.934580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e86f1f11-9a50-495a-87c4-c5ac49dc23dc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:32.942804 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e86f1f11-9a50-495a-87c4-c5ac49dc23dc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1510 microversion: 2.1 time: 0.275476 Oct 12 22:52:32.943409 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3201/7050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:32 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1510 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:32.966261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e47e1dd0-554b-4505-a768-6607fd694bfa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:32.966859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e47e1dd0-554b-4505-a768-6607fd694bfa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:32.973007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e47e1dd0-554b-4505-a768-6607fd694bfa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:32.973498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e47e1dd0-554b-4505-a768-6607fd694bfa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:32.974048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e47e1dd0-554b-4505-a768-6607fd694bfa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:32.974757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e47e1dd0-554b-4505-a768-6607fd694bfa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:32.975217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e47e1dd0-554b-4505-a768-6607fd694bfa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:32.975674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e47e1dd0-554b-4505-a768-6607fd694bfa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:33.002540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e47e1dd0-554b-4505-a768-6607fd694bfa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:52:33.060306 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.compute.api [None req-e47e1dd0-554b-4505-a768-6607fd694bfa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Found an unconfirmed migration during delete, id: 16, status: finished Oct 12 22:52:34.574547 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e47e1dd0-554b-4505-a768-6607fd694bfa tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 204 len: 0 microversion: 2.1 time: 1.612030 Oct 12 22:52:34.575344 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3850/7051] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:52:32 2022] DELETE /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 0 bytes in 1614 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:52:34.584502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd4d57f8-2522-4a21-9289-b52cf4b714e4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:34.585068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cd4d57f8-2522-4a21-9289-b52cf4b714e4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:34.591993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd4d57f8-2522-4a21-9289-b52cf4b714e4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:34.592498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd4d57f8-2522-4a21-9289-b52cf4b714e4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:34.592952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd4d57f8-2522-4a21-9289-b52cf4b714e4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:34.593688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd4d57f8-2522-4a21-9289-b52cf4b714e4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:34.594157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd4d57f8-2522-4a21-9289-b52cf4b714e4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:34.594628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd4d57f8-2522-4a21-9289-b52cf4b714e4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:34.720906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cd4d57f8-2522-4a21-9289-b52cf4b714e4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:34.728496 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cd4d57f8-2522-4a21-9289-b52cf4b714e4 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1502 microversion: 2.1 time: 0.147993 Oct 12 22:52:34.729321 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3202/7052] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:34 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1502 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:35.463137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-683abf3b-99d4-4556-8170-9b623f5b8347 req-efa2ac63-8d4e-4771-af1a-d8af175c789b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bd3ee67-0e15-489c-bbac-1db00d1f9212", "name": "network-vif-plugged", "status": "completed", "tag": "d4f55184-0969-4bf4-801a-3e0003320c1d"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:35.474525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-683abf3b-99d4-4556-8170-9b623f5b8347 req-efa2ac63-8d4e-4771-af1a-d8af175c789b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:35.475000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-683abf3b-99d4-4556-8170-9b623f5b8347 req-efa2ac63-8d4e-4771-af1a-d8af175c789b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:35.475459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-683abf3b-99d4-4556-8170-9b623f5b8347 req-efa2ac63-8d4e-4771-af1a-d8af175c789b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:35.486695 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-683abf3b-99d4-4556-8170-9b623f5b8347 req-efa2ac63-8d4e-4771-af1a-d8af175c789b service nova] Creating event network-vif-plugged:d4f55184-0969-4bf4-801a-3e0003320c1d for instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 on n-h1-861111-1 Oct 12 22:52:35.491402 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-683abf3b-99d4-4556-8170-9b623f5b8347 req-efa2ac63-8d4e-4771-af1a-d8af175c789b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032402 Oct 12 22:52:35.492152 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3851/7053] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:35.752269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0daf075d-38c2-4189-b2b7-f84602a33afc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:35.752956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0daf075d-38c2-4189-b2b7-f84602a33afc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:35.759837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0daf075d-38c2-4189-b2b7-f84602a33afc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:35.760329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0daf075d-38c2-4189-b2b7-f84602a33afc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:35.760776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0daf075d-38c2-4189-b2b7-f84602a33afc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:35.761469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0daf075d-38c2-4189-b2b7-f84602a33afc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:35.761923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0daf075d-38c2-4189-b2b7-f84602a33afc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:35.762361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0daf075d-38c2-4189-b2b7-f84602a33afc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:35.901630 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0daf075d-38c2-4189-b2b7-f84602a33afc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff57b7247ff46ccad5054ace442de69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12c898b4462405e91084f081359ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:35.909312 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0daf075d-38c2-4189-b2b7-f84602a33afc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 200 len: 1502 microversion: 2.1 time: 0.160895 Oct 12 22:52:35.909881 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3203/7054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:35 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:36.438965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-ee70d0a0-4949-4951-ab55-a35a5e07925c req-d3744202-917f-4194-9b70-38cd33a57783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bd3ee67-0e15-489c-bbac-1db00d1f9212", "name": "network-vif-deleted", "tag": "d4f55184-0969-4bf4-801a-3e0003320c1d"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:36.455591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ee70d0a0-4949-4951-ab55-a35a5e07925c req-d3744202-917f-4194-9b70-38cd33a57783 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:36.456061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ee70d0a0-4949-4951-ab55-a35a5e07925c req-d3744202-917f-4194-9b70-38cd33a57783 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:36.456507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ee70d0a0-4949-4951-ab55-a35a5e07925c req-d3744202-917f-4194-9b70-38cd33a57783 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:36.469244 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-ee70d0a0-4949-4951-ab55-a35a5e07925c req-d3744202-917f-4194-9b70-38cd33a57783 service nova] Creating event network-vif-deleted:d4f55184-0969-4bf4-801a-3e0003320c1d for instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 on n-h1-861111-1 Oct 12 22:52:36.476120 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-ee70d0a0-4949-4951-ab55-a35a5e07925c req-d3744202-917f-4194-9b70-38cd33a57783 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044383 Oct 12 22:52:36.476746 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3852/7055] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:36.932728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7c5c6171-e7cb-4f25-9e93-4a6f3529d4fc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:36.933312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7c5c6171-e7cb-4f25-9e93-4a6f3529d4fc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:36.940974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c5c6171-e7cb-4f25-9e93-4a6f3529d4fc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:36.941468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c5c6171-e7cb-4f25-9e93-4a6f3529d4fc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:36.941912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c5c6171-e7cb-4f25-9e93-4a6f3529d4fc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:36.942611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c5c6171-e7cb-4f25-9e93-4a6f3529d4fc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:36.943100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c5c6171-e7cb-4f25-9e93-4a6f3529d4fc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:36.943581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c5c6171-e7cb-4f25-9e93-4a6f3529d4fc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:36.956430 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-7c5c6171-e7cb-4f25-9e93-4a6f3529d4fc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] HTTP exception thrown: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7c5c6171-e7cb-4f25-9e93-4a6f3529d4fc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Request method failure captured: Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 HTTP/1.1 Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0UDvkfrVM0TFZko_skmkTHcWf5YG6Y3endl50RroCqdSM3mC4cIfYKep2lye4SlNP1vIy9tWCT25Ne_zwXgZYoq7NWZU-W2ZfUVRpezfg93dKPyreYgaIvQm5Nu7oUaaXAqjP9wCxOo4xwbK-u4GYY4LZaVAsF1-J14EIMagFnPJfQ Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: a12c898b4462405e91084f081359ac1b Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersTestJSON-734985238 Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a12c898b4462405e91084f081359ac1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a12c898b4462405e91084f081359ac1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a12c898b4462405e91084f081359ac1b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a12c898b4462405e91084f081359ac1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersTestJSON-734985238 Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: a12c898b4462405e91084f081359ac1b Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersTestJSON-734985238 Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-DeleteServersTestJSON-734985238-project Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 9ff57b7247ff46ccad5054ace442de69 Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersTestJSON-734985238-project Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '0bd3ee67-0e15-489c-bbac-1db00d1f9212'} Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:52:36.958082 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:52:36.962831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:36.962831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:52:36.962831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:52:36.962831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:52:36.962831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:52:36.962831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. Oct 12 22:52:36.962831 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:52:36.962831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7c5c6171-e7cb-4f25-9e93-4a6f3529d4fc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Returning 404 to user: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:52:36.962831 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7c5c6171-e7cb-4f25-9e93-4a6f3529d4fc tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 404 len: 111 microversion: 2.1 time: 0.030776 Oct 12 22:52:36.962831 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3204/7056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:36 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:52:36.976745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-93d5481f-86b1-4a5b-83f7-b1799dec7f25 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:36.977361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-93d5481f-86b1-4a5b-83f7-b1799dec7f25 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:36.986500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93d5481f-86b1-4a5b-83f7-b1799dec7f25 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:36.986986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93d5481f-86b1-4a5b-83f7-b1799dec7f25 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:36.987468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93d5481f-86b1-4a5b-83f7-b1799dec7f25 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:36.988184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93d5481f-86b1-4a5b-83f7-b1799dec7f25 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:36.989437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93d5481f-86b1-4a5b-83f7-b1799dec7f25 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:36.989875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-93d5481f-86b1-4a5b-83f7-b1799dec7f25 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:37.007940 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-93d5481f-86b1-4a5b-83f7-b1799dec7f25 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] HTTP exception thrown: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-93d5481f-86b1-4a5b-83f7-b1799dec7f25 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Request method failure captured: Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 HTTP/1.1 Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0UDvkfrVM0TFZko_skmkTHcWf5YG6Y3endl50RroCqdSM3mC4cIfYKep2lye4SlNP1vIy9tWCT25Ne_zwXgZYoq7NWZU-W2ZfUVRpezfg93dKPyreYgaIvQm5Nu7oUaaXAqjP9wCxOo4xwbK-u4GYY4LZaVAsF1-J14EIMagFnPJfQ Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: a12c898b4462405e91084f081359ac1b Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-DeleteServersTestJSON-734985238 Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a12c898b4462405e91084f081359ac1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a12c898b4462405e91084f081359ac1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a12c898b4462405e91084f081359ac1b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a12c898b4462405e91084f081359ac1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-DeleteServersTestJSON-734985238 Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: a12c898b4462405e91084f081359ac1b Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-DeleteServersTestJSON-734985238 Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-DeleteServersTestJSON-734985238-project Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 9ff57b7247ff46ccad5054ace442de69 Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-DeleteServersTestJSON-734985238-project Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '0bd3ee67-0e15-489c-bbac-1db00d1f9212'} Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:52:37.009613 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:52:37.013827 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. Oct 12 22:52:37.013827 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:52:37.013827 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:52:37.013827 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:52:37.013827 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:37.013827 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:52:37.013827 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:52:37.013827 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:52:37.013827 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:52:37.013827 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. Oct 12 22:52:37.013827 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:52:37.013827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-93d5481f-86b1-4a5b-83f7-b1799dec7f25 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Returning 404 to user: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:52:37.013827 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-93d5481f-86b1-4a5b-83f7-b1799dec7f25 tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 404 len: 111 microversion: 2.1 time: 0.039977 Oct 12 22:52:37.013827 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3853/7057] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:52:36 2022] DELETE /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:52:37.019705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c445fea6-b943-494f-9ea8-0e933fa401bd tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:37.020343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c445fea6-b943-494f-9ea8-0e933fa401bd tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] [instance: 0bd3ee67-0e15-489c-bbac-1db00d1f9212] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:37.026213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c445fea6-b943-494f-9ea8-0e933fa401bd tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:37.026704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c445fea6-b943-494f-9ea8-0e933fa401bd tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:37.027171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c445fea6-b943-494f-9ea8-0e933fa401bd tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:37.027874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c445fea6-b943-494f-9ea8-0e933fa401bd tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:37.028339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c445fea6-b943-494f-9ea8-0e933fa401bd tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:37.028773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c445fea6-b943-494f-9ea8-0e933fa401bd tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:37.041787 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-c445fea6-b943-494f-9ea8-0e933fa401bd tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] HTTP exception thrown: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c445fea6-b943-494f-9ea8-0e933fa401bd tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Request method failure captured: Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 HTTP/1.1 Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0UDvkfrVM0TFZko_skmkTHcWf5YG6Y3endl50RroCqdSM3mC4cIfYKep2lye4SlNP1vIy9tWCT25Ne_zwXgZYoq7NWZU-W2ZfUVRpezfg93dKPyreYgaIvQm5Nu7oUaaXAqjP9wCxOo4xwbK-u4GYY4LZaVAsF1-J14EIMagFnPJfQ Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: a12c898b4462405e91084f081359ac1b Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersTestJSON-734985238 Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a12c898b4462405e91084f081359ac1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a12c898b4462405e91084f081359ac1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a12c898b4462405e91084f081359ac1b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a12c898b4462405e91084f081359ac1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersTestJSON-734985238 Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: a12c898b4462405e91084f081359ac1b Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersTestJSON-734985238 Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-DeleteServersTestJSON-734985238-project Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 9ff57b7247ff46ccad5054ace442de69 Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersTestJSON-734985238-project Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '0bd3ee67-0e15-489c-bbac-1db00d1f9212'} Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:52:37.043320 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:52:37.048357 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:37.048357 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:52:37.048357 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:52:37.048357 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:52:37.048357 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:52:37.048357 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. Oct 12 22:52:37.048357 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:52:37.048357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c445fea6-b943-494f-9ea8-0e933fa401bd tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] Returning 404 to user: Instance 0bd3ee67-0e15-489c-bbac-1db00d1f9212 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:52:37.048357 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c445fea6-b943-494f-9ea8-0e933fa401bd tempest-DeleteServersTestJSON-734985238 tempest-DeleteServersTestJSON-734985238-project] 10.222.0.16 "GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212" status: 404 len: 111 microversion: 2.1 time: 0.028845 Oct 12 22:52:37.049211 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3205/7058] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:37 2022] GET /compute/v2.1/servers/0bd3ee67-0e15-489c-bbac-1db00d1f9212 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:52:45.319199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-721772248", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "947f9c30-09d8-4c56-ae83-420f9033e37d"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:45.377532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] validate_networks() for [('947f9c30-09d8-4c56-ae83-420f9033e37d', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:52:46.076168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:52:46.076662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:52:46.077210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:52:46.077687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:52:46.078167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:52:46.087580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:46.088169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:46.088610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:46.089336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:46.089787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:46.090212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:46.108229 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Getting quotas for project 75136851bb664bddb37e690f4c2bc5e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:52:46.114238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Getting quotas for user 396658689060469fbb042d011d2cb350 and project 75136851bb664bddb37e690f4c2bc5e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:52:46.127320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:52:46.129635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:52:46.176676 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9ed47cd6-17cc-489e-8aaa-10314c741d39 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.004627 Oct 12 22:52:46.177664 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3854/7059] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:52:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:52:46.189499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8be9a3ea-4baa-47a6-b401-2706292a408c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:46.190301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8be9a3ea-4baa-47a6-b401-2706292a408c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:46.259947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8be9a3ea-4baa-47a6-b401-2706292a408c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:46.268852 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8be9a3ea-4baa-47a6-b401-2706292a408c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1217 microversion: 2.1 time: 0.083410 Oct 12 22:52:46.269691 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3206/7060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:46 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:47.295816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7027c2ed-8aa2-4130-ae65-dea9e7dc4bdd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:47.298540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7027c2ed-8aa2-4130-ae65-dea9e7dc4bdd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:47.307998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7027c2ed-8aa2-4130-ae65-dea9e7dc4bdd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:47.308775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7027c2ed-8aa2-4130-ae65-dea9e7dc4bdd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:47.309396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7027c2ed-8aa2-4130-ae65-dea9e7dc4bdd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:47.310364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7027c2ed-8aa2-4130-ae65-dea9e7dc4bdd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:47.310994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7027c2ed-8aa2-4130-ae65-dea9e7dc4bdd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:47.311678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7027c2ed-8aa2-4130-ae65-dea9e7dc4bdd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:47.377727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7027c2ed-8aa2-4130-ae65-dea9e7dc4bdd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:47.386900 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7027c2ed-8aa2-4130-ae65-dea9e7dc4bdd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1277 microversion: 2.1 time: 0.097459 Oct 12 22:52:47.388182 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3855/7061] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:47 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:48.410091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0d2cefb1-d1e2-4fa6-9258-68eae590bd52 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:48.411461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0d2cefb1-d1e2-4fa6-9258-68eae590bd52 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:48.413469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=33 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:48.423384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d2cefb1-d1e2-4fa6-9258-68eae590bd52 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:48.424145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d2cefb1-d1e2-4fa6-9258-68eae590bd52 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:48.424599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d2cefb1-d1e2-4fa6-9258-68eae590bd52 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:48.425482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d2cefb1-d1e2-4fa6-9258-68eae590bd52 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:48.425954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d2cefb1-d1e2-4fa6-9258-68eae590bd52 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:48.426398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d2cefb1-d1e2-4fa6-9258-68eae590bd52 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:48.694386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0d2cefb1-d1e2-4fa6-9258-68eae590bd52 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:48.709033 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0d2cefb1-d1e2-4fa6-9258-68eae590bd52 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1317 microversion: 2.1 time: 0.302608 Oct 12 22:52:48.724385 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3207/7062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:48 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:48.918483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-1f0db74f-d98d-4985-a465-45eaaf03bdc1 req-5c29e12e-dec0-45e1-97f5-f1f2b420e9ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66545dfe-0c54-44a5-b7c0-7ae1d750a18c", "tag": "446d934f-d702-43f7-af7f-2e958991f0d4"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:48.930542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1f0db74f-d98d-4985-a465-45eaaf03bdc1 req-5c29e12e-dec0-45e1-97f5-f1f2b420e9ec service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:48.931078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1f0db74f-d98d-4985-a465-45eaaf03bdc1 req-5c29e12e-dec0-45e1-97f5-f1f2b420e9ec service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:48.931557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1f0db74f-d98d-4985-a465-45eaaf03bdc1 req-5c29e12e-dec0-45e1-97f5-f1f2b420e9ec service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:48.945240 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-1f0db74f-d98d-4985-a465-45eaaf03bdc1 req-5c29e12e-dec0-45e1-97f5-f1f2b420e9ec service nova] Creating event network-changed:446d934f-d702-43f7-af7f-2e958991f0d4 for instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c on n-h1-861111-1 Oct 12 22:52:48.950341 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-1f0db74f-d98d-4985-a465-45eaaf03bdc1 req-5c29e12e-dec0-45e1-97f5-f1f2b420e9ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036256 Oct 12 22:52:48.951329 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3856/7063] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:49.734543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-33539d18-2be8-45f0-8eb0-33ffda5a4077 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:49.735148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-33539d18-2be8-45f0-8eb0-33ffda5a4077 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:49.741783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33539d18-2be8-45f0-8eb0-33ffda5a4077 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:49.742275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33539d18-2be8-45f0-8eb0-33ffda5a4077 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:49.742722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33539d18-2be8-45f0-8eb0-33ffda5a4077 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:49.743459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33539d18-2be8-45f0-8eb0-33ffda5a4077 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:49.743926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33539d18-2be8-45f0-8eb0-33ffda5a4077 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:49.744366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33539d18-2be8-45f0-8eb0-33ffda5a4077 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:49.876903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-33539d18-2be8-45f0-8eb0-33ffda5a4077 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:49.884427 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-33539d18-2be8-45f0-8eb0-33ffda5a4077 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1317 microversion: 2.1 time: 0.154231 Oct 12 22:52:49.884983 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3208/7064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:49 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:50.909250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d698b8ec-db27-4205-a6f2-10572d1ca6f7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:50.909989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d698b8ec-db27-4205-a6f2-10572d1ca6f7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:50.916127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d698b8ec-db27-4205-a6f2-10572d1ca6f7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:50.916620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d698b8ec-db27-4205-a6f2-10572d1ca6f7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:50.917146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d698b8ec-db27-4205-a6f2-10572d1ca6f7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:50.917968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d698b8ec-db27-4205-a6f2-10572d1ca6f7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:50.918546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d698b8ec-db27-4205-a6f2-10572d1ca6f7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:50.919072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d698b8ec-db27-4205-a6f2-10572d1ca6f7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:51.050441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d698b8ec-db27-4205-a6f2-10572d1ca6f7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:51.058065 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d698b8ec-db27-4205-a6f2-10572d1ca6f7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1317 microversion: 2.1 time: 0.154559 Oct 12 22:52:51.058699 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3857/7065] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:50 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:52.082011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e57d9cac-26d1-41dd-8689-80d0b0dbb456 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:52.082673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e57d9cac-26d1-41dd-8689-80d0b0dbb456 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:52.090430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e57d9cac-26d1-41dd-8689-80d0b0dbb456 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:52.090923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e57d9cac-26d1-41dd-8689-80d0b0dbb456 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:52.091409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e57d9cac-26d1-41dd-8689-80d0b0dbb456 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:52.092110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e57d9cac-26d1-41dd-8689-80d0b0dbb456 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:52.092574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e57d9cac-26d1-41dd-8689-80d0b0dbb456 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:52.093012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e57d9cac-26d1-41dd-8689-80d0b0dbb456 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:52.220252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e57d9cac-26d1-41dd-8689-80d0b0dbb456 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:52.227798 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e57d9cac-26d1-41dd-8689-80d0b0dbb456 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1317 microversion: 2.1 time: 0.150246 Oct 12 22:52:52.228357 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3209/7066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:52 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:53.250795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ab08ad58-98d8-48ed-87f8-e7dc1f80fe48 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:53.251443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ab08ad58-98d8-48ed-87f8-e7dc1f80fe48 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:53.258156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab08ad58-98d8-48ed-87f8-e7dc1f80fe48 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:53.258632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab08ad58-98d8-48ed-87f8-e7dc1f80fe48 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:53.259066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab08ad58-98d8-48ed-87f8-e7dc1f80fe48 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:53.259773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab08ad58-98d8-48ed-87f8-e7dc1f80fe48 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:53.260250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab08ad58-98d8-48ed-87f8-e7dc1f80fe48 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:53.260669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab08ad58-98d8-48ed-87f8-e7dc1f80fe48 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:53.395052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ab08ad58-98d8-48ed-87f8-e7dc1f80fe48 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:53.403133 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ab08ad58-98d8-48ed-87f8-e7dc1f80fe48 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1317 microversion: 2.1 time: 0.156152 Oct 12 22:52:53.403858 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3858/7067] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:53 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:54.426563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2f23c38d-20b9-4b29-8584-b021bc65d9b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:54.427095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f23c38d-20b9-4b29-8584-b021bc65d9b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:54.434993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f23c38d-20b9-4b29-8584-b021bc65d9b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:54.435514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f23c38d-20b9-4b29-8584-b021bc65d9b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:54.435960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f23c38d-20b9-4b29-8584-b021bc65d9b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:54.436647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f23c38d-20b9-4b29-8584-b021bc65d9b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:54.437761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f23c38d-20b9-4b29-8584-b021bc65d9b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:54.438196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f23c38d-20b9-4b29-8584-b021bc65d9b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:54.568676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f23c38d-20b9-4b29-8584-b021bc65d9b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:54.577373 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2f23c38d-20b9-4b29-8584-b021bc65d9b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1317 microversion: 2.1 time: 0.154811 Oct 12 22:52:54.577939 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3210/7068] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:54 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:55.566995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-3596d296-0494-456e-90d6-1469fe994763 req-b2874cc6-e419-408d-95ef-b922519631d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66545dfe-0c54-44a5-b7c0-7ae1d750a18c", "name": "network-vif-plugged", "status": "completed", "tag": "446d934f-d702-43f7-af7f-2e958991f0d4"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:55.578725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3596d296-0494-456e-90d6-1469fe994763 req-b2874cc6-e419-408d-95ef-b922519631d0 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:55.579584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3596d296-0494-456e-90d6-1469fe994763 req-b2874cc6-e419-408d-95ef-b922519631d0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:55.580135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3596d296-0494-456e-90d6-1469fe994763 req-b2874cc6-e419-408d-95ef-b922519631d0 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:55.593902 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-3596d296-0494-456e-90d6-1469fe994763 req-b2874cc6-e419-408d-95ef-b922519631d0 service nova] Creating event network-vif-plugged:446d934f-d702-43f7-af7f-2e958991f0d4 for instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c on n-h1-861111-1 Oct 12 22:52:55.599310 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-3596d296-0494-456e-90d6-1469fe994763 req-b2874cc6-e419-408d-95ef-b922519631d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036004 Oct 12 22:52:55.600069 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3859/7069] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:55.600564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6be2c69b-5b07-4078-afea-779028c6254c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:55.601306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6be2c69b-5b07-4078-afea-779028c6254c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:55.608460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be2c69b-5b07-4078-afea-779028c6254c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:55.608958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be2c69b-5b07-4078-afea-779028c6254c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:55.609406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be2c69b-5b07-4078-afea-779028c6254c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:55.610114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be2c69b-5b07-4078-afea-779028c6254c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:55.610579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be2c69b-5b07-4078-afea-779028c6254c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:55.611015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6be2c69b-5b07-4078-afea-779028c6254c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:55.809676 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6be2c69b-5b07-4078-afea-779028c6254c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:55.817926 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6be2c69b-5b07-4078-afea-779028c6254c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1317 microversion: 2.1 time: 0.221675 Oct 12 22:52:55.818486 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3211/7070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:55 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:56.841705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5839fcb1-34ec-443d-b934-375854ee1cc2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:56.842613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5839fcb1-34ec-443d-b934-375854ee1cc2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:56.844661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:56.845321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:56.852565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5839fcb1-34ec-443d-b934-375854ee1cc2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:56.853050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5839fcb1-34ec-443d-b934-375854ee1cc2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:56.853482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5839fcb1-34ec-443d-b934-375854ee1cc2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:56.854189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5839fcb1-34ec-443d-b934-375854ee1cc2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:56.854895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5839fcb1-34ec-443d-b934-375854ee1cc2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:56.855424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5839fcb1-34ec-443d-b934-375854ee1cc2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:56.989981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5839fcb1-34ec-443d-b934-375854ee1cc2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:56.997600 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5839fcb1-34ec-443d-b934-375854ee1cc2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1317 microversion: 2.1 time: 0.160240 Oct 12 22:52:56.998175 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3860/7071] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:56 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:58.022060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-11981508-1291-4e11-919b-a484ba12487a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:58.022713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-11981508-1291-4e11-919b-a484ba12487a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:58.024658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:58.032006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11981508-1291-4e11-919b-a484ba12487a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.032512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11981508-1291-4e11-919b-a484ba12487a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.032970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11981508-1291-4e11-919b-a484ba12487a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:58.033684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11981508-1291-4e11-919b-a484ba12487a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.034153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11981508-1291-4e11-919b-a484ba12487a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.034593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11981508-1291-4e11-919b-a484ba12487a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:58.174508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-11981508-1291-4e11-919b-a484ba12487a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:58.183818 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-11981508-1291-4e11-919b-a484ba12487a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1505 microversion: 2.1 time: 0.165766 Oct 12 22:52:58.184692 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3212/7072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:58 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:58.207040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-63dee68e-61bd-4334-9a55-ed69f415325e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:58.207712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-63dee68e-61bd-4334-9a55-ed69f415325e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:58.214577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63dee68e-61bd-4334-9a55-ed69f415325e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.215060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63dee68e-61bd-4334-9a55-ed69f415325e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.215535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63dee68e-61bd-4334-9a55-ed69f415325e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:58.216250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63dee68e-61bd-4334-9a55-ed69f415325e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.216882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63dee68e-61bd-4334-9a55-ed69f415325e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.217333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-63dee68e-61bd-4334-9a55-ed69f415325e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:58.349231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-63dee68e-61bd-4334-9a55-ed69f415325e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:58.357831 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-63dee68e-61bd-4334-9a55-ed69f415325e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1505 microversion: 2.1 time: 0.155184 Oct 12 22:52:58.358407 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3861/7073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:58 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:58.380765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-98eb0c22-2234-4456-8337-cb97c8a277b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:58.383342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-98eb0c22-2234-4456-8337-cb97c8a277b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:58.389166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98eb0c22-2234-4456-8337-cb97c8a277b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.389651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98eb0c22-2234-4456-8337-cb97c8a277b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.390709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98eb0c22-2234-4456-8337-cb97c8a277b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:58.391431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98eb0c22-2234-4456-8337-cb97c8a277b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.391894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98eb0c22-2234-4456-8337-cb97c8a277b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.392328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98eb0c22-2234-4456-8337-cb97c8a277b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:58.456278 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-98eb0c22-2234-4456-8337-cb97c8a277b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "PUT /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1077 microversion: 2.1 time: 0.079623 Oct 12 22:52:58.456897 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3213/7074] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 12 22:52:58 2022] PUT /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1077 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:52:58.475723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1eda1d9a-741d-47c4-8f67-18c8cbe8404a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:58.476341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1eda1d9a-741d-47c4-8f67-18c8cbe8404a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:58.482526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1eda1d9a-741d-47c4-8f67-18c8cbe8404a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.483007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1eda1d9a-741d-47c4-8f67-18c8cbe8404a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.483476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1eda1d9a-741d-47c4-8f67-18c8cbe8404a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:58.484769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1eda1d9a-741d-47c4-8f67-18c8cbe8404a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.485225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1eda1d9a-741d-47c4-8f67-18c8cbe8404a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.485655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1eda1d9a-741d-47c4-8f67-18c8cbe8404a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:58.612230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1eda1d9a-741d-47c4-8f67-18c8cbe8404a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:58.620032 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1eda1d9a-741d-47c4-8f67-18c8cbe8404a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1503 microversion: 2.1 time: 0.148133 Oct 12 22:52:58.620605 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3862/7075] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:58 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:58.641937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-71bc985c-5727-4439-bd62-a4e745865bc9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:58.642555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-71bc985c-5727-4439-bd62-a4e745865bc9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:58.648781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71bc985c-5727-4439-bd62-a4e745865bc9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.649265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71bc985c-5727-4439-bd62-a4e745865bc9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.649705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71bc985c-5727-4439-bd62-a4e745865bc9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:58.650390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71bc985c-5727-4439-bd62-a4e745865bc9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.650846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71bc985c-5727-4439-bd62-a4e745865bc9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.651295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71bc985c-5727-4439-bd62-a4e745865bc9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:58.777413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-71bc985c-5727-4439-bd62-a4e745865bc9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:58.785546 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-71bc985c-5727-4439-bd62-a4e745865bc9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1503 microversion: 2.1 time: 0.147551 Oct 12 22:52:58.786116 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3214/7076] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:58 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:52:58.807760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d9490c83-19ed-4b63-87f8-8d2bc0d1297a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:58.810020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d9490c83-19ed-4b63-87f8-8d2bc0d1297a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:58.816026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9490c83-19ed-4b63-87f8-8d2bc0d1297a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.816447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9490c83-19ed-4b63-87f8-8d2bc0d1297a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.816884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9490c83-19ed-4b63-87f8-8d2bc0d1297a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:58.817570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9490c83-19ed-4b63-87f8-8d2bc0d1297a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.818020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9490c83-19ed-4b63-87f8-8d2bc0d1297a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.818462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d9490c83-19ed-4b63-87f8-8d2bc0d1297a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:58.846949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d9490c83-19ed-4b63-87f8-8d2bc0d1297a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:58.852288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d9490c83-19ed-4b63-87f8-8d2bc0d1297a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Old instance type m1.heat2, new instance type m1.heat {{(pid=120453) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:52:58.858884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d9490c83-19ed-4b63-87f8-8d2bc0d1297a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:52:58.859333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d9490c83-19ed-4b63-87f8-8d2bc0d1297a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:52:58.859814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d9490c83-19ed-4b63-87f8-8d2bc0d1297a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:52:58.860228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d9490c83-19ed-4b63-87f8-8d2bc0d1297a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:52:58.860639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d9490c83-19ed-4b63-87f8-8d2bc0d1297a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:52:58.921052 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d9490c83-19ed-4b63-87f8-8d2bc0d1297a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "POST /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c/action" status: 202 len: 0 microversion: 2.1 time: 0.117174 Oct 12 22:52:58.924749 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3863/7077] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:52:58 2022] POST /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:52:58.929864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-97e521b9-1ce4-4cb5-b572-bb64cf6546a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:58.930627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-97e521b9-1ce4-4cb5-b572-bb64cf6546a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:58.936903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97e521b9-1ce4-4cb5-b572-bb64cf6546a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.937347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97e521b9-1ce4-4cb5-b572-bb64cf6546a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.937904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97e521b9-1ce4-4cb5-b572-bb64cf6546a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:58.938613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97e521b9-1ce4-4cb5-b572-bb64cf6546a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.939083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97e521b9-1ce4-4cb5-b572-bb64cf6546a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.939580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-97e521b9-1ce4-4cb5-b572-bb64cf6546a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:59.080842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-97e521b9-1ce4-4cb5-b572-bb64cf6546a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:59.088837 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-97e521b9-1ce4-4cb5-b572-bb64cf6546a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1514 microversion: 2.1 time: 0.162653 Oct 12 22:52:59.089458 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3215/7078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:58 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:00.112839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c601229f-0a76-4a54-a039-f49e3a3ba99c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:00.113467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c601229f-0a76-4a54-a039-f49e3a3ba99c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:00.120516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c601229f-0a76-4a54-a039-f49e3a3ba99c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:00.121007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c601229f-0a76-4a54-a039-f49e3a3ba99c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:00.121454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c601229f-0a76-4a54-a039-f49e3a3ba99c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:00.122154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c601229f-0a76-4a54-a039-f49e3a3ba99c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:00.122650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c601229f-0a76-4a54-a039-f49e3a3ba99c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:00.123082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c601229f-0a76-4a54-a039-f49e3a3ba99c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:00.127681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:00.261891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c601229f-0a76-4a54-a039-f49e3a3ba99c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:00.270594 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c601229f-0a76-4a54-a039-f49e3a3ba99c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1514 microversion: 2.1 time: 0.162568 Oct 12 22:53:00.271178 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3864/7079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:00 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:01.293872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-604008fa-c6c3-49af-93dd-247db4e2e534 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:01.294508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-604008fa-c6c3-49af-93dd-247db4e2e534 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:01.297209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=36 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:01.302952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-604008fa-c6c3-49af-93dd-247db4e2e534 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:01.303491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-604008fa-c6c3-49af-93dd-247db4e2e534 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:01.303973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-604008fa-c6c3-49af-93dd-247db4e2e534 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:01.304680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-604008fa-c6c3-49af-93dd-247db4e2e534 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:01.305170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-604008fa-c6c3-49af-93dd-247db4e2e534 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:01.305608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-604008fa-c6c3-49af-93dd-247db4e2e534 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:01.434271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-604008fa-c6c3-49af-93dd-247db4e2e534 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:01.442437 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-604008fa-c6c3-49af-93dd-247db4e2e534 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.152571 Oct 12 22:53:01.443002 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3216/7080] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:01 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:02.466273 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4317a714-4910-4af8-afdd-d2d918c983da tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:02.466892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4317a714-4910-4af8-afdd-d2d918c983da tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:02.470200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:02.475493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4317a714-4910-4af8-afdd-d2d918c983da tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:02.475980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4317a714-4910-4af8-afdd-d2d918c983da tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:02.476419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4317a714-4910-4af8-afdd-d2d918c983da tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:02.477108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4317a714-4910-4af8-afdd-d2d918c983da tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:02.477564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4317a714-4910-4af8-afdd-d2d918c983da tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:02.477992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4317a714-4910-4af8-afdd-d2d918c983da tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:02.609186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4317a714-4910-4af8-afdd-d2d918c983da tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:02.617263 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4317a714-4910-4af8-afdd-d2d918c983da tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.154864 Oct 12 22:53:02.617842 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3865/7081] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:02 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:03.640766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9ea24e46-ec7f-4510-bdd8-4717f6a04693 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:03.641411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9ea24e46-ec7f-4510-bdd8-4717f6a04693 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:03.648092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ea24e46-ec7f-4510-bdd8-4717f6a04693 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:03.648577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ea24e46-ec7f-4510-bdd8-4717f6a04693 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:03.649017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ea24e46-ec7f-4510-bdd8-4717f6a04693 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:03.649707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ea24e46-ec7f-4510-bdd8-4717f6a04693 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:03.650162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ea24e46-ec7f-4510-bdd8-4717f6a04693 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:03.650593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ea24e46-ec7f-4510-bdd8-4717f6a04693 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:03.782110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9ea24e46-ec7f-4510-bdd8-4717f6a04693 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:03.789944 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9ea24e46-ec7f-4510-bdd8-4717f6a04693 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.153750 Oct 12 22:53:03.790541 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3217/7082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:03 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:04.814652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6c0e0ad7-7b86-4010-984a-7e85389e43b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:04.815333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6c0e0ad7-7b86-4010-984a-7e85389e43b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:04.821754 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c0e0ad7-7b86-4010-984a-7e85389e43b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:04.822236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c0e0ad7-7b86-4010-984a-7e85389e43b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:04.822672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c0e0ad7-7b86-4010-984a-7e85389e43b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:04.823401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c0e0ad7-7b86-4010-984a-7e85389e43b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:04.823854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c0e0ad7-7b86-4010-984a-7e85389e43b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:04.824298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c0e0ad7-7b86-4010-984a-7e85389e43b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:04.949293 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6c0e0ad7-7b86-4010-984a-7e85389e43b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:04.957377 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6c0e0ad7-7b86-4010-984a-7e85389e43b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.146819 Oct 12 22:53:04.957953 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3866/7083] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:04 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:05.980790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-62d80f58-43ff-4128-b00b-3b6c0d354ceb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:05.981415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-62d80f58-43ff-4128-b00b-3b6c0d354ceb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:05.988974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62d80f58-43ff-4128-b00b-3b6c0d354ceb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:05.989469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62d80f58-43ff-4128-b00b-3b6c0d354ceb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:05.989954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62d80f58-43ff-4128-b00b-3b6c0d354ceb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:05.990648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62d80f58-43ff-4128-b00b-3b6c0d354ceb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:05.991111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62d80f58-43ff-4128-b00b-3b6c0d354ceb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:05.991589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62d80f58-43ff-4128-b00b-3b6c0d354ceb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:06.117060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-62d80f58-43ff-4128-b00b-3b6c0d354ceb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:06.124702 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-62d80f58-43ff-4128-b00b-3b6c0d354ceb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.148092 Oct 12 22:53:06.125277 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3218/7084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:05 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:07.147958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e38098ec-d9c8-452e-a21e-be78a1b2aafa tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:07.148506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e38098ec-d9c8-452e-a21e-be78a1b2aafa tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:07.155527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e38098ec-d9c8-452e-a21e-be78a1b2aafa tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:07.156019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e38098ec-d9c8-452e-a21e-be78a1b2aafa tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:07.156463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e38098ec-d9c8-452e-a21e-be78a1b2aafa tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:07.157158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e38098ec-d9c8-452e-a21e-be78a1b2aafa tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:07.157614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e38098ec-d9c8-452e-a21e-be78a1b2aafa tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:07.158045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e38098ec-d9c8-452e-a21e-be78a1b2aafa tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:07.287051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e38098ec-d9c8-452e-a21e-be78a1b2aafa tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:07.294846 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e38098ec-d9c8-452e-a21e-be78a1b2aafa tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.150909 Oct 12 22:53:07.295456 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3867/7085] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:07 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:08.318877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-88d2ec4f-db74-4293-bc68-db1647c9dd83 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:08.319529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-88d2ec4f-db74-4293-bc68-db1647c9dd83 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:08.326283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88d2ec4f-db74-4293-bc68-db1647c9dd83 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:08.326776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88d2ec4f-db74-4293-bc68-db1647c9dd83 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:08.327225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88d2ec4f-db74-4293-bc68-db1647c9dd83 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:08.328519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88d2ec4f-db74-4293-bc68-db1647c9dd83 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:08.328981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88d2ec4f-db74-4293-bc68-db1647c9dd83 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:08.329419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88d2ec4f-db74-4293-bc68-db1647c9dd83 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:08.460038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-88d2ec4f-db74-4293-bc68-db1647c9dd83 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:08.468645 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-88d2ec4f-db74-4293-bc68-db1647c9dd83 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.153072 Oct 12 22:53:08.469210 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3219/7086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:08 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:09.491921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5ac832a4-4514-40b9-b71c-8f768841337c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:09.492605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5ac832a4-4514-40b9-b71c-8f768841337c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:09.500094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac832a4-4514-40b9-b71c-8f768841337c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:09.500578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac832a4-4514-40b9-b71c-8f768841337c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:09.501018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac832a4-4514-40b9-b71c-8f768841337c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:09.501697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac832a4-4514-40b9-b71c-8f768841337c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:09.502155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac832a4-4514-40b9-b71c-8f768841337c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:09.503066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5ac832a4-4514-40b9-b71c-8f768841337c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:09.630757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5ac832a4-4514-40b9-b71c-8f768841337c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:09.638531 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5ac832a4-4514-40b9-b71c-8f768841337c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.150546 Oct 12 22:53:09.639111 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3868/7087] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:09 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:10.661005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ee98ec1f-9228-4660-b27c-e6e06be12ac4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:10.661647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ee98ec1f-9228-4660-b27c-e6e06be12ac4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:10.668472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee98ec1f-9228-4660-b27c-e6e06be12ac4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:10.668957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee98ec1f-9228-4660-b27c-e6e06be12ac4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:10.669408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee98ec1f-9228-4660-b27c-e6e06be12ac4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:10.670115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee98ec1f-9228-4660-b27c-e6e06be12ac4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:10.670570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee98ec1f-9228-4660-b27c-e6e06be12ac4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:10.671003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee98ec1f-9228-4660-b27c-e6e06be12ac4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:11.049665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ee98ec1f-9228-4660-b27c-e6e06be12ac4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:11.057213 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ee98ec1f-9228-4660-b27c-e6e06be12ac4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.400128 Oct 12 22:53:11.057775 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3220/7088] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:10 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:53:12.080970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0cc5efde-3ec5-4eb0-ad56-627f02114c4b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:12.081591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0cc5efde-3ec5-4eb0-ad56-627f02114c4b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:12.088527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cc5efde-3ec5-4eb0-ad56-627f02114c4b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:12.089009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cc5efde-3ec5-4eb0-ad56-627f02114c4b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:12.089449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cc5efde-3ec5-4eb0-ad56-627f02114c4b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:12.090141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cc5efde-3ec5-4eb0-ad56-627f02114c4b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:12.090599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cc5efde-3ec5-4eb0-ad56-627f02114c4b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:12.091027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0cc5efde-3ec5-4eb0-ad56-627f02114c4b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:12.221732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0cc5efde-3ec5-4eb0-ad56-627f02114c4b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:12.229405 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0cc5efde-3ec5-4eb0-ad56-627f02114c4b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.152929 Oct 12 22:53:12.230240 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3869/7089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:12 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:13.253377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b134766-16e0-47ac-b401-0d44b8a5cb6a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:13.254003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6b134766-16e0-47ac-b401-0d44b8a5cb6a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:13.260507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b134766-16e0-47ac-b401-0d44b8a5cb6a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:13.260998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b134766-16e0-47ac-b401-0d44b8a5cb6a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:13.261444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b134766-16e0-47ac-b401-0d44b8a5cb6a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:13.262142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b134766-16e0-47ac-b401-0d44b8a5cb6a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:13.262602 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b134766-16e0-47ac-b401-0d44b8a5cb6a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:13.263038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b134766-16e0-47ac-b401-0d44b8a5cb6a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:13.393572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6b134766-16e0-47ac-b401-0d44b8a5cb6a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:13.401324 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6b134766-16e0-47ac-b401-0d44b8a5cb6a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.151827 Oct 12 22:53:13.401880 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3221/7090] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:13 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:14.425171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6aa58b96-30c9-4d30-ad86-cc249c2f6274 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:14.425788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6aa58b96-30c9-4d30-ad86-cc249c2f6274 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:14.432683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6aa58b96-30c9-4d30-ad86-cc249c2f6274 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:14.433165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6aa58b96-30c9-4d30-ad86-cc249c2f6274 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:14.433599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6aa58b96-30c9-4d30-ad86-cc249c2f6274 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:14.434287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6aa58b96-30c9-4d30-ad86-cc249c2f6274 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:14.434739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6aa58b96-30c9-4d30-ad86-cc249c2f6274 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:14.435167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6aa58b96-30c9-4d30-ad86-cc249c2f6274 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:14.565427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6aa58b96-30c9-4d30-ad86-cc249c2f6274 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:14.573186 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6aa58b96-30c9-4d30-ad86-cc249c2f6274 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.152480 Oct 12 22:53:14.573756 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3870/7091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:14 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:15.596316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-012707db-8f0f-445d-9bb7-b46a1fec7ca7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:15.596947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-012707db-8f0f-445d-9bb7-b46a1fec7ca7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:15.603496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-012707db-8f0f-445d-9bb7-b46a1fec7ca7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:15.603990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-012707db-8f0f-445d-9bb7-b46a1fec7ca7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:15.604442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-012707db-8f0f-445d-9bb7-b46a1fec7ca7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:15.605398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-012707db-8f0f-445d-9bb7-b46a1fec7ca7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:15.605862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-012707db-8f0f-445d-9bb7-b46a1fec7ca7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:15.606301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-012707db-8f0f-445d-9bb7-b46a1fec7ca7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:15.740534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-012707db-8f0f-445d-9bb7-b46a1fec7ca7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:15.744084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:15.749793 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-012707db-8f0f-445d-9bb7-b46a1fec7ca7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.156829 Oct 12 22:53:15.750365 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3222/7092] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:15 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:16.774020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7670595b-69f3-4782-80eb-966cd303cb8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:16.774637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7670595b-69f3-4782-80eb-966cd303cb8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:16.782142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7670595b-69f3-4782-80eb-966cd303cb8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:16.782625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7670595b-69f3-4782-80eb-966cd303cb8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:16.783067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7670595b-69f3-4782-80eb-966cd303cb8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:16.783795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7670595b-69f3-4782-80eb-966cd303cb8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:16.784248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7670595b-69f3-4782-80eb-966cd303cb8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:16.784674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7670595b-69f3-4782-80eb-966cd303cb8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:16.914857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7670595b-69f3-4782-80eb-966cd303cb8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:16.922517 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7670595b-69f3-4782-80eb-966cd303cb8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.152471 Oct 12 22:53:16.923097 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3871/7093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:16 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:17.945074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1908e8da-9c70-498f-832d-f050d0ae806d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:17.945679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1908e8da-9c70-498f-832d-f050d0ae806d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:17.953776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1908e8da-9c70-498f-832d-f050d0ae806d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:17.954273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1908e8da-9c70-498f-832d-f050d0ae806d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:17.954722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1908e8da-9c70-498f-832d-f050d0ae806d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:17.955457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1908e8da-9c70-498f-832d-f050d0ae806d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:17.955983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1908e8da-9c70-498f-832d-f050d0ae806d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:17.956424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1908e8da-9c70-498f-832d-f050d0ae806d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:18.089262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1908e8da-9c70-498f-832d-f050d0ae806d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:18.097712 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1908e8da-9c70-498f-832d-f050d0ae806d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.156662 Oct 12 22:53:18.098268 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3223/7094] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:17 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:19.121671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9b47627b-fed5-4b9c-ba74-2084e48bcb62 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:19.122208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9b47627b-fed5-4b9c-ba74-2084e48bcb62 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:19.129736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b47627b-fed5-4b9c-ba74-2084e48bcb62 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:19.130212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b47627b-fed5-4b9c-ba74-2084e48bcb62 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:19.130649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b47627b-fed5-4b9c-ba74-2084e48bcb62 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:19.131357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b47627b-fed5-4b9c-ba74-2084e48bcb62 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:19.131812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b47627b-fed5-4b9c-ba74-2084e48bcb62 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:19.132236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9b47627b-fed5-4b9c-ba74-2084e48bcb62 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:19.259694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9b47627b-fed5-4b9c-ba74-2084e48bcb62 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:19.267499 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9b47627b-fed5-4b9c-ba74-2084e48bcb62 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.149763 Oct 12 22:53:19.268074 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3872/7095] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:19 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:20.290330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ffea3743-8399-4cf6-ac4b-cb63f084dc0d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:20.290994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ffea3743-8399-4cf6-ac4b-cb63f084dc0d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:20.297999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffea3743-8399-4cf6-ac4b-cb63f084dc0d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:20.298490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffea3743-8399-4cf6-ac4b-cb63f084dc0d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:20.298939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffea3743-8399-4cf6-ac4b-cb63f084dc0d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:20.299669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffea3743-8399-4cf6-ac4b-cb63f084dc0d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:20.300136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffea3743-8399-4cf6-ac4b-cb63f084dc0d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:20.300572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ffea3743-8399-4cf6-ac4b-cb63f084dc0d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:20.430758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ffea3743-8399-4cf6-ac4b-cb63f084dc0d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:20.439205 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ffea3743-8399-4cf6-ac4b-cb63f084dc0d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.152715 Oct 12 22:53:20.439799 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3224/7096] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:20 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:21.462655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a8f09863-d4b8-42cc-ba1c-ff1e5bf4a370 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:21.463359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a8f09863-d4b8-42cc-ba1c-ff1e5bf4a370 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:21.470732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8f09863-d4b8-42cc-ba1c-ff1e5bf4a370 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:21.471210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8f09863-d4b8-42cc-ba1c-ff1e5bf4a370 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:21.471672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8f09863-d4b8-42cc-ba1c-ff1e5bf4a370 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:21.472352 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8f09863-d4b8-42cc-ba1c-ff1e5bf4a370 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:21.472798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8f09863-d4b8-42cc-ba1c-ff1e5bf4a370 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:21.473219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8f09863-d4b8-42cc-ba1c-ff1e5bf4a370 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:21.601483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a8f09863-d4b8-42cc-ba1c-ff1e5bf4a370 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:21.609547 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a8f09863-d4b8-42cc-ba1c-ff1e5bf4a370 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.150760 Oct 12 22:53:21.610132 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3873/7097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:21 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:22.633015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-191fc58e-d034-4ed4-b853-6679b9902765 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:22.633656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-191fc58e-d034-4ed4-b853-6679b9902765 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:22.640461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191fc58e-d034-4ed4-b853-6679b9902765 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:22.640958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191fc58e-d034-4ed4-b853-6679b9902765 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:22.641410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191fc58e-d034-4ed4-b853-6679b9902765 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:22.642117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191fc58e-d034-4ed4-b853-6679b9902765 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:22.642582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191fc58e-d034-4ed4-b853-6679b9902765 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:22.643022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191fc58e-d034-4ed4-b853-6679b9902765 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:22.774642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-191fc58e-d034-4ed4-b853-6679b9902765 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:22.783115 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-191fc58e-d034-4ed4-b853-6679b9902765 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.153949 Oct 12 22:53:22.783707 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3225/7098] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:22 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:23.805957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e8d9d0ea-3eac-4f0a-8002-b62b7c247b1f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:23.806574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e8d9d0ea-3eac-4f0a-8002-b62b7c247b1f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:23.813841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8d9d0ea-3eac-4f0a-8002-b62b7c247b1f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:23.814346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8d9d0ea-3eac-4f0a-8002-b62b7c247b1f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:23.814782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8d9d0ea-3eac-4f0a-8002-b62b7c247b1f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:23.815565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8d9d0ea-3eac-4f0a-8002-b62b7c247b1f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:23.816028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8d9d0ea-3eac-4f0a-8002-b62b7c247b1f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:23.816455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e8d9d0ea-3eac-4f0a-8002-b62b7c247b1f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:23.946366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e8d9d0ea-3eac-4f0a-8002-b62b7c247b1f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:23.954547 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e8d9d0ea-3eac-4f0a-8002-b62b7c247b1f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.152508 Oct 12 22:53:23.955124 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3874/7099] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:23 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:24.977307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a289de36-a192-4779-87bc-a5c72fd0c9b7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:24.977932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a289de36-a192-4779-87bc-a5c72fd0c9b7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:24.984951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a289de36-a192-4779-87bc-a5c72fd0c9b7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:24.985444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a289de36-a192-4779-87bc-a5c72fd0c9b7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:24.985892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a289de36-a192-4779-87bc-a5c72fd0c9b7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:24.986594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a289de36-a192-4779-87bc-a5c72fd0c9b7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:24.987064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a289de36-a192-4779-87bc-a5c72fd0c9b7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:24.987527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a289de36-a192-4779-87bc-a5c72fd0c9b7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:25.112996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a289de36-a192-4779-87bc-a5c72fd0c9b7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:25.120648 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a289de36-a192-4779-87bc-a5c72fd0c9b7 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.147216 Oct 12 22:53:25.121218 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3226/7100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:24 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:26.143948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c986f43f-506a-4b12-bbbb-2e040eec4e33 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:26.144568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c986f43f-506a-4b12-bbbb-2e040eec4e33 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:26.151125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c986f43f-506a-4b12-bbbb-2e040eec4e33 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:26.151636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c986f43f-506a-4b12-bbbb-2e040eec4e33 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:26.152076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c986f43f-506a-4b12-bbbb-2e040eec4e33 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:26.152766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c986f43f-506a-4b12-bbbb-2e040eec4e33 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:26.153226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c986f43f-506a-4b12-bbbb-2e040eec4e33 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:26.153652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c986f43f-506a-4b12-bbbb-2e040eec4e33 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:26.280114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c986f43f-506a-4b12-bbbb-2e040eec4e33 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:26.288361 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c986f43f-506a-4b12-bbbb-2e040eec4e33 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.148323 Oct 12 22:53:26.288938 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3875/7101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:26 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:27.312053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-18883fad-ad02-447a-bcd0-6012f79a1f63 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:27.312681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-18883fad-ad02-447a-bcd0-6012f79a1f63 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:27.319577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18883fad-ad02-447a-bcd0-6012f79a1f63 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:27.320070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18883fad-ad02-447a-bcd0-6012f79a1f63 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:27.320521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18883fad-ad02-447a-bcd0-6012f79a1f63 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:27.321223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18883fad-ad02-447a-bcd0-6012f79a1f63 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:27.321687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18883fad-ad02-447a-bcd0-6012f79a1f63 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:27.322127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18883fad-ad02-447a-bcd0-6012f79a1f63 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:27.451539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-18883fad-ad02-447a-bcd0-6012f79a1f63 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:27.459610 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-18883fad-ad02-447a-bcd0-6012f79a1f63 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1519 microversion: 2.1 time: 0.151508 Oct 12 22:53:27.460459 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3227/7102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:27 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:28.450983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-df8653c5-786b-48a1-849d-2f2a2d998557 req-20ce147f-32ac-420f-b3fe-87c507d0a88c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66545dfe-0c54-44a5-b7c0-7ae1d750a18c", "name": "network-vif-unplugged", "status": "completed", "tag": "446d934f-d702-43f7-af7f-2e958991f0d4"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:28.463268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-df8653c5-786b-48a1-849d-2f2a2d998557 req-20ce147f-32ac-420f-b3fe-87c507d0a88c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:28.463797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-df8653c5-786b-48a1-849d-2f2a2d998557 req-20ce147f-32ac-420f-b3fe-87c507d0a88c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:28.464741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-df8653c5-786b-48a1-849d-2f2a2d998557 req-20ce147f-32ac-420f-b3fe-87c507d0a88c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:28.476763 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-df8653c5-786b-48a1-849d-2f2a2d998557 req-20ce147f-32ac-420f-b3fe-87c507d0a88c service nova] Creating event network-vif-unplugged:446d934f-d702-43f7-af7f-2e958991f0d4 for instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c on n-h2-861111-1 Oct 12 22:53:28.482706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-df8653c5-786b-48a1-849d-2f2a2d998557 req-20ce147f-32ac-420f-b3fe-87c507d0a88c service nova] Instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:53:28.484596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1b39486-fbca-4284-9166-ac30919f85b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:28.485783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a1b39486-fbca-4284-9166-ac30919f85b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:28.492672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b39486-fbca-4284-9166-ac30919f85b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:28.493180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b39486-fbca-4284-9166-ac30919f85b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:28.493663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b39486-fbca-4284-9166-ac30919f85b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:28.494380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b39486-fbca-4284-9166-ac30919f85b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:28.495029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b39486-fbca-4284-9166-ac30919f85b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:28.495486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b39486-fbca-4284-9166-ac30919f85b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:28.495595 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-df8653c5-786b-48a1-849d-2f2a2d998557 req-20ce147f-32ac-420f-b3fe-87c507d0a88c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048228 Oct 12 22:53:28.496620 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3876/7103] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:28.708539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a1b39486-fbca-4284-9166-ac30919f85b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:28.716927 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a1b39486-fbca-4284-9166-ac30919f85b9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1518 microversion: 2.1 time: 0.236902 Oct 12 22:53:28.717541 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3228/7104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:28 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1518 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:53:29.741591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7f3f6fb6-0ef4-4ef3-8fd2-7d475084e799 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:29.742331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7f3f6fb6-0ef4-4ef3-8fd2-7d475084e799 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:29.749510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f3f6fb6-0ef4-4ef3-8fd2-7d475084e799 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:29.749994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f3f6fb6-0ef4-4ef3-8fd2-7d475084e799 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:29.750437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f3f6fb6-0ef4-4ef3-8fd2-7d475084e799 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:29.751128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f3f6fb6-0ef4-4ef3-8fd2-7d475084e799 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:29.751680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f3f6fb6-0ef4-4ef3-8fd2-7d475084e799 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:29.752110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f3f6fb6-0ef4-4ef3-8fd2-7d475084e799 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:29.886286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7f3f6fb6-0ef4-4ef3-8fd2-7d475084e799 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:29.895474 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7f3f6fb6-0ef4-4ef3-8fd2-7d475084e799 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1516 microversion: 2.1 time: 0.158155 Oct 12 22:53:29.896069 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3877/7105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:29 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:30.522194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-ba9ce00a-01cf-4753-a3e8-dcc160471148 req-773c510b-cd54-4312-8665-30c926dbc127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66545dfe-0c54-44a5-b7c0-7ae1d750a18c", "tag": "446d934f-d702-43f7-af7f-2e958991f0d4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:30.532957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ba9ce00a-01cf-4753-a3e8-dcc160471148 req-773c510b-cd54-4312-8665-30c926dbc127 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:30.533448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ba9ce00a-01cf-4753-a3e8-dcc160471148 req-773c510b-cd54-4312-8665-30c926dbc127 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:30.533897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ba9ce00a-01cf-4753-a3e8-dcc160471148 req-773c510b-cd54-4312-8665-30c926dbc127 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:30.545199 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-ba9ce00a-01cf-4753-a3e8-dcc160471148 req-773c510b-cd54-4312-8665-30c926dbc127 service nova] Creating event network-changed:446d934f-d702-43f7-af7f-2e958991f0d4 for instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c on n-h2-861111-1 Oct 12 22:53:30.550366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-ba9ce00a-01cf-4753-a3e8-dcc160471148 req-773c510b-cd54-4312-8665-30c926dbc127 service nova] Instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:53:30.560918 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-ba9ce00a-01cf-4753-a3e8-dcc160471148 req-773c510b-cd54-4312-8665-30c926dbc127 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042396 Oct 12 22:53:30.561491 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3229/7106] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:30.918130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-718bc283-8f86-4173-a5b9-563653fc5e2e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:30.918890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-718bc283-8f86-4173-a5b9-563653fc5e2e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:30.926418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-718bc283-8f86-4173-a5b9-563653fc5e2e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:30.926939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-718bc283-8f86-4173-a5b9-563653fc5e2e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:30.927427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-718bc283-8f86-4173-a5b9-563653fc5e2e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:30.928138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-718bc283-8f86-4173-a5b9-563653fc5e2e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:30.928612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-718bc283-8f86-4173-a5b9-563653fc5e2e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:30.929083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-718bc283-8f86-4173-a5b9-563653fc5e2e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:30.933389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=82 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:31.060634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-718bc283-8f86-4173-a5b9-563653fc5e2e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:31.069159 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-718bc283-8f86-4173-a5b9-563653fc5e2e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1516 microversion: 2.1 time: 0.155058 Oct 12 22:53:31.069748 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3878/7107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:30 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:32.096420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7ea78a6f-f18f-4049-9d36-3811fab13b00 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:32.097236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7ea78a6f-f18f-4049-9d36-3811fab13b00 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:32.099098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=28 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:32.105127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ea78a6f-f18f-4049-9d36-3811fab13b00 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:32.105920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ea78a6f-f18f-4049-9d36-3811fab13b00 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:32.106373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ea78a6f-f18f-4049-9d36-3811fab13b00 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:32.107212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ea78a6f-f18f-4049-9d36-3811fab13b00 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:32.107717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ea78a6f-f18f-4049-9d36-3811fab13b00 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:32.108166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ea78a6f-f18f-4049-9d36-3811fab13b00 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:32.240687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7ea78a6f-f18f-4049-9d36-3811fab13b00 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:32.248500 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7ea78a6f-f18f-4049-9d36-3811fab13b00 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1513 microversion: 2.1 time: 0.157743 Oct 12 22:53:32.249073 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3230/7108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:32 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:32.270819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1437e362-9a48-4363-be81-381507b184b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:32.271392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1437e362-9a48-4363-be81-381507b184b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:32.278127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1437e362-9a48-4363-be81-381507b184b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:32.278612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1437e362-9a48-4363-be81-381507b184b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:32.279064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1437e362-9a48-4363-be81-381507b184b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:32.279859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1437e362-9a48-4363-be81-381507b184b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:32.280828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1437e362-9a48-4363-be81-381507b184b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:32.281246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1437e362-9a48-4363-be81-381507b184b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:32.338363 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1437e362-9a48-4363-be81-381507b184b2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "POST /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c/action" status: 204 len: 0 microversion: 2.1 time: 0.071279 Oct 12 22:53:32.339003 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3879/7109] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:53:32 2022] POST /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:53:32.347317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fb8c2a36-0a24-46e0-aea3-f8ecc132a37f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:32.347954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fb8c2a36-0a24-46e0-aea3-f8ecc132a37f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:32.353989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb8c2a36-0a24-46e0-aea3-f8ecc132a37f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:32.354512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb8c2a36-0a24-46e0-aea3-f8ecc132a37f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:32.354997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb8c2a36-0a24-46e0-aea3-f8ecc132a37f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:32.355997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb8c2a36-0a24-46e0-aea3-f8ecc132a37f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:32.356472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb8c2a36-0a24-46e0-aea3-f8ecc132a37f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:32.356917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb8c2a36-0a24-46e0-aea3-f8ecc132a37f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:32.533518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fb8c2a36-0a24-46e0-aea3-f8ecc132a37f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:32.541413 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fb8c2a36-0a24-46e0-aea3-f8ecc132a37f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1513 microversion: 2.1 time: 0.198041 Oct 12 22:53:32.541990 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3231/7110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:32 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:33.566671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-de40c834-cab7-4b2b-b820-2428f2e3ea10 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:33.568128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-de40c834-cab7-4b2b-b820-2428f2e3ea10 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:33.571265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=30 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:33.576990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de40c834-cab7-4b2b-b820-2428f2e3ea10 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:33.578182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de40c834-cab7-4b2b-b820-2428f2e3ea10 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:33.578626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de40c834-cab7-4b2b-b820-2428f2e3ea10 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:33.579349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de40c834-cab7-4b2b-b820-2428f2e3ea10 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:33.579808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de40c834-cab7-4b2b-b820-2428f2e3ea10 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:33.580240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-de40c834-cab7-4b2b-b820-2428f2e3ea10 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:33.716062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-de40c834-cab7-4b2b-b820-2428f2e3ea10 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:33.725743 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-de40c834-cab7-4b2b-b820-2428f2e3ea10 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1513 microversion: 2.1 time: 0.162958 Oct 12 22:53:33.725743 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3880/7111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:33 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:34.748971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ac6465a4-46f2-459f-b5a6-a7ac71eb3f0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:34.749604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ac6465a4-46f2-459f-b5a6-a7ac71eb3f0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:34.759193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac6465a4-46f2-459f-b5a6-a7ac71eb3f0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:34.759193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac6465a4-46f2-459f-b5a6-a7ac71eb3f0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:34.759193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac6465a4-46f2-459f-b5a6-a7ac71eb3f0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:34.759605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac6465a4-46f2-459f-b5a6-a7ac71eb3f0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:34.760098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac6465a4-46f2-459f-b5a6-a7ac71eb3f0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:34.760535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac6465a4-46f2-459f-b5a6-a7ac71eb3f0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:34.890930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ac6465a4-46f2-459f-b5a6-a7ac71eb3f0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:34.898519 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ac6465a4-46f2-459f-b5a6-a7ac71eb3f0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1505 microversion: 2.1 time: 0.153509 Oct 12 22:53:34.899092 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3232/7112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:34 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:34.921417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4ed4f6ae-2dc6-412d-b9e8-a5638d9045a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:34.922071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4ed4f6ae-2dc6-412d-b9e8-a5638d9045a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:34.928617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ed4f6ae-2dc6-412d-b9e8-a5638d9045a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:34.929103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ed4f6ae-2dc6-412d-b9e8-a5638d9045a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:34.929542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ed4f6ae-2dc6-412d-b9e8-a5638d9045a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:34.930235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ed4f6ae-2dc6-412d-b9e8-a5638d9045a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:34.930693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ed4f6ae-2dc6-412d-b9e8-a5638d9045a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:34.931120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ed4f6ae-2dc6-412d-b9e8-a5638d9045a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:35.059361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4ed4f6ae-2dc6-412d-b9e8-a5638d9045a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:35.067515 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4ed4f6ae-2dc6-412d-b9e8-a5638d9045a0 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1505 microversion: 2.1 time: 0.150168 Oct 12 22:53:35.068087 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3881/7113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:34 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:35.093298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-315636fd-24f1-471e-b50a-c5e766c28043 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Action: 'create', calling method: .version_select at 0x7f512303e0d0>, body: {"keypair": {"name": "tempest-keypair-1658783260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXxCcCOfpvvJC6uJ1/0KZbqlwhe0NXoHrBWDyQ6zPU1ELlRFTfpAlwSls7PfuaSAp62omL5ZpCdl7kzXUSRkPFgwJHynmcBdcOBhg8zTEZwUnF0qFClGoJjfMhu6B1sZA=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:35.109339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-315636fd-24f1-471e-b50a-c5e766c28043 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Getting quotas for project 75136851bb664bddb37e690f4c2bc5e5. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:53:35.114527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-315636fd-24f1-471e-b50a-c5e766c28043 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Getting quotas for user 396658689060469fbb042d011d2cb350 and project 75136851bb664bddb37e690f4c2bc5e5. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:53:35.138969 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-315636fd-24f1-471e-b50a-c5e766c28043 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049472 Oct 12 22:53:35.139630 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3233/7114] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:53:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:35.348391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-0c0368b2-a52e-460a-942e-771edf2912cd req-6a2bf359-6f84-4a77-9314-423d2a51a433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66545dfe-0c54-44a5-b7c0-7ae1d750a18c", "name": "network-vif-plugged", "status": "completed", "tag": "446d934f-d702-43f7-af7f-2e958991f0d4"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:35.360960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0c0368b2-a52e-460a-942e-771edf2912cd req-6a2bf359-6f84-4a77-9314-423d2a51a433 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:35.361116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0c0368b2-a52e-460a-942e-771edf2912cd req-6a2bf359-6f84-4a77-9314-423d2a51a433 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:35.362141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0c0368b2-a52e-460a-942e-771edf2912cd req-6a2bf359-6f84-4a77-9314-423d2a51a433 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:35.378415 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-0c0368b2-a52e-460a-942e-771edf2912cd req-6a2bf359-6f84-4a77-9314-423d2a51a433 service nova] Creating event network-vif-plugged:446d934f-d702-43f7-af7f-2e958991f0d4 for instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c on n-h2-861111-1 Oct 12 22:53:35.387777 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-0c0368b2-a52e-460a-942e-771edf2912cd req-6a2bf359-6f84-4a77-9314-423d2a51a433 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043133 Oct 12 22:53:35.388392 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3882/7115] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:36.291362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4a3e0160-1cf2-4b57-ad4e-a132b3b4eeea tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:36.292000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4a3e0160-1cf2-4b57-ad4e-a132b3b4eeea tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:36.298887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a3e0160-1cf2-4b57-ad4e-a132b3b4eeea tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:36.299417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a3e0160-1cf2-4b57-ad4e-a132b3b4eeea tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:36.299879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a3e0160-1cf2-4b57-ad4e-a132b3b4eeea tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:36.300594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a3e0160-1cf2-4b57-ad4e-a132b3b4eeea tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:36.301066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a3e0160-1cf2-4b57-ad4e-a132b3b4eeea tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:36.301514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a3e0160-1cf2-4b57-ad4e-a132b3b4eeea tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:36.427477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4a3e0160-1cf2-4b57-ad4e-a132b3b4eeea tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:36.435349 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4a3e0160-1cf2-4b57-ad4e-a132b3b4eeea tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 200 len: 1505 microversion: 2.1 time: 0.148919 Oct 12 22:53:36.435947 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3234/7116] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:36 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:36.460024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-299f67b4-cac6-4c8f-a55f-a83da160a635 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:36.460550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-299f67b4-cac6-4c8f-a55f-a83da160a635 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:36.466661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-299f67b4-cac6-4c8f-a55f-a83da160a635 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:36.467141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-299f67b4-cac6-4c8f-a55f-a83da160a635 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:36.467631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-299f67b4-cac6-4c8f-a55f-a83da160a635 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:36.468855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-299f67b4-cac6-4c8f-a55f-a83da160a635 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:36.469305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-299f67b4-cac6-4c8f-a55f-a83da160a635 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:36.469740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-299f67b4-cac6-4c8f-a55f-a83da160a635 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:36.496998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-299f67b4-cac6-4c8f-a55f-a83da160a635 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:53:36.570611 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-299f67b4-cac6-4c8f-a55f-a83da160a635 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "DELETE /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 204 len: 0 microversion: 2.1 time: 0.115357 Oct 12 22:53:36.571292 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3883/7117] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:53:36 2022] DELETE /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:53:36.629336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1502710859", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "947f9c30-09d8-4c56-ae83-420f9033e37d"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:36.681416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] validate_networks() for [('947f9c30-09d8-4c56-ae83-420f9033e37d', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:53:37.370537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:53:37.371108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:53:37.371517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:53:37.371948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:53:37.372378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:53:37.381528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:37.382031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:37.382484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:37.383252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:37.383723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:37.384166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:37.400939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Getting quotas for project 75136851bb664bddb37e690f4c2bc5e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:53:37.406132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Getting quotas for user 396658689060469fbb042d011d2cb350 and project 75136851bb664bddb37e690f4c2bc5e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:53:37.418113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:53:37.420425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:53:37.465298 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b95e2376-d34c-43a3-a4cf-cece5cf83847 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839786 Oct 12 22:53:37.466017 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3235/7118] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:53:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:53:37.477769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3af10bc8-b2bb-4ad6-a8a4-8cb9ed8ac03b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:37.478474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3af10bc8-b2bb-4ad6-a8a4-8cb9ed8ac03b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:37.535587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3af10bc8-b2bb-4ad6-a8a4-8cb9ed8ac03b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:37.543339 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3af10bc8-b2bb-4ad6-a8a4-8cb9ed8ac03b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1218 microversion: 2.1 time: 0.069735 Oct 12 22:53:37.543913 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3884/7119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:37 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:38.411317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-b97365d9-6339-4263-ac69-da7cc578ed43 req-cb1281ea-59dc-4175-a3b8-8a43afc0cb82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66545dfe-0c54-44a5-b7c0-7ae1d750a18c", "name": "network-vif-deleted", "tag": "446d934f-d702-43f7-af7f-2e958991f0d4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:38.425858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b97365d9-6339-4263-ac69-da7cc578ed43 req-cb1281ea-59dc-4175-a3b8-8a43afc0cb82 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:38.426353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b97365d9-6339-4263-ac69-da7cc578ed43 req-cb1281ea-59dc-4175-a3b8-8a43afc0cb82 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:38.426789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b97365d9-6339-4263-ac69-da7cc578ed43 req-cb1281ea-59dc-4175-a3b8-8a43afc0cb82 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:38.437943 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-b97365d9-6339-4263-ac69-da7cc578ed43 req-cb1281ea-59dc-4175-a3b8-8a43afc0cb82 service nova] Creating event network-vif-deleted:446d934f-d702-43f7-af7f-2e958991f0d4 for instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c on n-h2-861111-1 Oct 12 22:53:38.443772 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-b97365d9-6339-4263-ac69-da7cc578ed43 req-cb1281ea-59dc-4175-a3b8-8a43afc0cb82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038908 Oct 12 22:53:38.444714 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3236/7120] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:38.569326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-288e4966-1ad0-4e28-ae2e-42a83050b4dd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:38.573402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-288e4966-1ad0-4e28-ae2e-42a83050b4dd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:38.583487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-288e4966-1ad0-4e28-ae2e-42a83050b4dd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:38.584344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-288e4966-1ad0-4e28-ae2e-42a83050b4dd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:38.584921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-288e4966-1ad0-4e28-ae2e-42a83050b4dd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:38.586054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-288e4966-1ad0-4e28-ae2e-42a83050b4dd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:38.586868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-288e4966-1ad0-4e28-ae2e-42a83050b4dd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:38.587649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-288e4966-1ad0-4e28-ae2e-42a83050b4dd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:38.664209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-288e4966-1ad0-4e28-ae2e-42a83050b4dd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:38.672673 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-288e4966-1ad0-4e28-ae2e-42a83050b4dd tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1288 microversion: 2.1 time: 0.108247 Oct 12 22:53:38.673425 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3885/7121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:38 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1288 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:39.698316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0cca604a-cd6b-4f8b-9763-39c284fb3b0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:39.699163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0cca604a-cd6b-4f8b-9763-39c284fb3b0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:39.705356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cca604a-cd6b-4f8b-9763-39c284fb3b0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:39.705962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cca604a-cd6b-4f8b-9763-39c284fb3b0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:39.706392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cca604a-cd6b-4f8b-9763-39c284fb3b0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:39.707196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cca604a-cd6b-4f8b-9763-39c284fb3b0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:39.707842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cca604a-cd6b-4f8b-9763-39c284fb3b0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:39.708285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0cca604a-cd6b-4f8b-9763-39c284fb3b0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:39.897041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0cca604a-cd6b-4f8b-9763-39c284fb3b0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:39.904723 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0cca604a-cd6b-4f8b-9763-39c284fb3b0b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1318 microversion: 2.1 time: 0.211539 Oct 12 22:53:39.905799 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3237/7122] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:39 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:40.458962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-5d0d622d-2111-4969-a4f7-0a6b253f6e51 req-6cb87adb-a881-4382-9461-1d0e54e3b5dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c78f731-1aa6-421e-8783-0feb6be2acc9", "tag": "ac806191-f019-4ccd-b0de-49c7e1f574b3"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:40.469065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5d0d622d-2111-4969-a4f7-0a6b253f6e51 req-6cb87adb-a881-4382-9461-1d0e54e3b5dd service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:40.469536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5d0d622d-2111-4969-a4f7-0a6b253f6e51 req-6cb87adb-a881-4382-9461-1d0e54e3b5dd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:40.469963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5d0d622d-2111-4969-a4f7-0a6b253f6e51 req-6cb87adb-a881-4382-9461-1d0e54e3b5dd service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:40.482048 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-5d0d622d-2111-4969-a4f7-0a6b253f6e51 req-6cb87adb-a881-4382-9461-1d0e54e3b5dd service nova] Creating event network-changed:ac806191-f019-4ccd-b0de-49c7e1f574b3 for instance 7c78f731-1aa6-421e-8783-0feb6be2acc9 on n-h2-861111-1 Oct 12 22:53:40.487081 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-5d0d622d-2111-4969-a4f7-0a6b253f6e51 req-6cb87adb-a881-4382-9461-1d0e54e3b5dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031773 Oct 12 22:53:40.487695 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3886/7123] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:40.928537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bc5cf9b1-2929-4883-b7b8-bf4004b0cad5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:40.929164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bc5cf9b1-2929-4883-b7b8-bf4004b0cad5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:40.936163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc5cf9b1-2929-4883-b7b8-bf4004b0cad5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:40.937257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc5cf9b1-2929-4883-b7b8-bf4004b0cad5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:40.937705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc5cf9b1-2929-4883-b7b8-bf4004b0cad5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:40.938444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc5cf9b1-2929-4883-b7b8-bf4004b0cad5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:40.938914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc5cf9b1-2929-4883-b7b8-bf4004b0cad5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:40.939384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bc5cf9b1-2929-4883-b7b8-bf4004b0cad5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:41.069844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bc5cf9b1-2929-4883-b7b8-bf4004b0cad5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:41.077436 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bc5cf9b1-2929-4883-b7b8-bf4004b0cad5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1318 microversion: 2.1 time: 0.152856 Oct 12 22:53:41.078005 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3238/7124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:40 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:42.100964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d5787c8a-b663-4b94-a22d-fcaf4b321dd9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:42.101594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d5787c8a-b663-4b94-a22d-fcaf4b321dd9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:42.108926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5787c8a-b663-4b94-a22d-fcaf4b321dd9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:42.109411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5787c8a-b663-4b94-a22d-fcaf4b321dd9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:42.109855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5787c8a-b663-4b94-a22d-fcaf4b321dd9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:42.110557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5787c8a-b663-4b94-a22d-fcaf4b321dd9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:42.111005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5787c8a-b663-4b94-a22d-fcaf4b321dd9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:42.111476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5787c8a-b663-4b94-a22d-fcaf4b321dd9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:42.244805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d5787c8a-b663-4b94-a22d-fcaf4b321dd9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:42.253400 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d5787c8a-b663-4b94-a22d-fcaf4b321dd9 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1318 microversion: 2.1 time: 0.156830 Oct 12 22:53:42.254316 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3887/7125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:42 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:43.276204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-199f0175-59bf-4d59-a4e8-ca9151e8027f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:43.276825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-199f0175-59bf-4d59-a4e8-ca9151e8027f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:43.284014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-199f0175-59bf-4d59-a4e8-ca9151e8027f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:43.284503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-199f0175-59bf-4d59-a4e8-ca9151e8027f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:43.284985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-199f0175-59bf-4d59-a4e8-ca9151e8027f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:43.285692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-199f0175-59bf-4d59-a4e8-ca9151e8027f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:43.286152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-199f0175-59bf-4d59-a4e8-ca9151e8027f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:43.286590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-199f0175-59bf-4d59-a4e8-ca9151e8027f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:43.418860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-199f0175-59bf-4d59-a4e8-ca9151e8027f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:43.426536 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-199f0175-59bf-4d59-a4e8-ca9151e8027f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1318 microversion: 2.1 time: 0.154228 Oct 12 22:53:43.427109 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3239/7126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:43 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:44.449854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4afa8df8-0422-4fe0-a659-b5fc46a7f267 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:44.450463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4afa8df8-0422-4fe0-a659-b5fc46a7f267 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:44.458028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4afa8df8-0422-4fe0-a659-b5fc46a7f267 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:44.458513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4afa8df8-0422-4fe0-a659-b5fc46a7f267 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:44.458951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4afa8df8-0422-4fe0-a659-b5fc46a7f267 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:44.459694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4afa8df8-0422-4fe0-a659-b5fc46a7f267 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:44.460148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4afa8df8-0422-4fe0-a659-b5fc46a7f267 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:44.460580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4afa8df8-0422-4fe0-a659-b5fc46a7f267 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:44.589985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4afa8df8-0422-4fe0-a659-b5fc46a7f267 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:44.598572 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4afa8df8-0422-4fe0-a659-b5fc46a7f267 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1318 microversion: 2.1 time: 0.152571 Oct 12 22:53:44.599142 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3888/7127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:44 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:45.381439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d3fbfad3-ab6e-419b-8024-d65a099d8385 req-06542b79-2fb0-419a-a4c5-4962b65f3410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c78f731-1aa6-421e-8783-0feb6be2acc9", "name": "network-vif-plugged", "status": "completed", "tag": "ac806191-f019-4ccd-b0de-49c7e1f574b3"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:45.395648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d3fbfad3-ab6e-419b-8024-d65a099d8385 req-06542b79-2fb0-419a-a4c5-4962b65f3410 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:45.396152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d3fbfad3-ab6e-419b-8024-d65a099d8385 req-06542b79-2fb0-419a-a4c5-4962b65f3410 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:45.396595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d3fbfad3-ab6e-419b-8024-d65a099d8385 req-06542b79-2fb0-419a-a4c5-4962b65f3410 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:45.410702 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d3fbfad3-ab6e-419b-8024-d65a099d8385 req-06542b79-2fb0-419a-a4c5-4962b65f3410 service nova] Creating event network-vif-plugged:ac806191-f019-4ccd-b0de-49c7e1f574b3 for instance 7c78f731-1aa6-421e-8783-0feb6be2acc9 on n-h2-861111-1 Oct 12 22:53:45.415911 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d3fbfad3-ab6e-419b-8024-d65a099d8385 req-06542b79-2fb0-419a-a4c5-4962b65f3410 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039166 Oct 12 22:53:45.416505 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3240/7128] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:53:45.621151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-348c2f99-65f4-4041-bfcb-70187608c3cb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:45.621769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-348c2f99-65f4-4041-bfcb-70187608c3cb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:45.628623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-348c2f99-65f4-4041-bfcb-70187608c3cb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:45.629104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-348c2f99-65f4-4041-bfcb-70187608c3cb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:45.629539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-348c2f99-65f4-4041-bfcb-70187608c3cb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:45.630233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-348c2f99-65f4-4041-bfcb-70187608c3cb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:45.630686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-348c2f99-65f4-4041-bfcb-70187608c3cb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:45.631117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-348c2f99-65f4-4041-bfcb-70187608c3cb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:45.757560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-348c2f99-65f4-4041-bfcb-70187608c3cb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:45.765410 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-348c2f99-65f4-4041-bfcb-70187608c3cb tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1318 microversion: 2.1 time: 0.148250 Oct 12 22:53:45.765988 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3889/7129] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:45 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:46.789238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ca7d9fff-2352-4c92-8da0-3c41efc7f83c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:46.790029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ca7d9fff-2352-4c92-8da0-3c41efc7f83c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:46.797988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca7d9fff-2352-4c92-8da0-3c41efc7f83c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:46.798581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca7d9fff-2352-4c92-8da0-3c41efc7f83c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:46.799106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca7d9fff-2352-4c92-8da0-3c41efc7f83c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:46.799950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca7d9fff-2352-4c92-8da0-3c41efc7f83c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:46.800530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca7d9fff-2352-4c92-8da0-3c41efc7f83c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:46.800971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca7d9fff-2352-4c92-8da0-3c41efc7f83c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:46.933580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ca7d9fff-2352-4c92-8da0-3c41efc7f83c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:46.941816 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ca7d9fff-2352-4c92-8da0-3c41efc7f83c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1318 microversion: 2.1 time: 0.157141 Oct 12 22:53:46.942387 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3241/7130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:46 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:47.963696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-df48e7c9-2a9e-4ff3-b598-ea08803f1c66 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:47.964336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-df48e7c9-2a9e-4ff3-b598-ea08803f1c66 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:47.967163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:47.972682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df48e7c9-2a9e-4ff3-b598-ea08803f1c66 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:47.973168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df48e7c9-2a9e-4ff3-b598-ea08803f1c66 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:47.973605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df48e7c9-2a9e-4ff3-b598-ea08803f1c66 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:47.974299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df48e7c9-2a9e-4ff3-b598-ea08803f1c66 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:47.974755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df48e7c9-2a9e-4ff3-b598-ea08803f1c66 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:47.975186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df48e7c9-2a9e-4ff3-b598-ea08803f1c66 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:48.104196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-df48e7c9-2a9e-4ff3-b598-ea08803f1c66 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:48.112191 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-df48e7c9-2a9e-4ff3-b598-ea08803f1c66 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1506 microversion: 2.1 time: 0.152375 Oct 12 22:53:48.112713 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3890/7131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:47 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:48.135141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f68fa17e-918c-4e35-ac07-db89a9fc8735 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:48.135799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f68fa17e-918c-4e35-ac07-db89a9fc8735 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:48.137736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:48.138414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=10 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:48.146021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f68fa17e-918c-4e35-ac07-db89a9fc8735 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:48.146520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f68fa17e-918c-4e35-ac07-db89a9fc8735 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:48.146972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f68fa17e-918c-4e35-ac07-db89a9fc8735 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:48.147716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f68fa17e-918c-4e35-ac07-db89a9fc8735 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:48.148188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f68fa17e-918c-4e35-ac07-db89a9fc8735 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:48.148628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f68fa17e-918c-4e35-ac07-db89a9fc8735 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:48.152517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=95 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:48.276700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f68fa17e-918c-4e35-ac07-db89a9fc8735 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:48.284621 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f68fa17e-918c-4e35-ac07-db89a9fc8735 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1506 microversion: 2.1 time: 0.153266 Oct 12 22:53:48.285344 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3242/7132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:48 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:48.307483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f7d72988-401e-4305-a7d0-1d63dff9d3f3 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:48.309722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f7d72988-401e-4305-a7d0-1d63dff9d3f3 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:48.316282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7d72988-401e-4305-a7d0-1d63dff9d3f3 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:48.316762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7d72988-401e-4305-a7d0-1d63dff9d3f3 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:48.317198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7d72988-401e-4305-a7d0-1d63dff9d3f3 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:48.317885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7d72988-401e-4305-a7d0-1d63dff9d3f3 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:48.318337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7d72988-401e-4305-a7d0-1d63dff9d3f3 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:48.318762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f7d72988-401e-4305-a7d0-1d63dff9d3f3 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:48.345804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f7d72988-401e-4305-a7d0-1d63dff9d3f3 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:48.351061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f7d72988-401e-4305-a7d0-1d63dff9d3f3 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Old instance type m1.heat2, new instance type m1.heat {{(pid=120453) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:53:48.357776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-f7d72988-401e-4305-a7d0-1d63dff9d3f3 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:53:48.358196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-f7d72988-401e-4305-a7d0-1d63dff9d3f3 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:53:48.358675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-f7d72988-401e-4305-a7d0-1d63dff9d3f3 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:53:48.359618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-f7d72988-401e-4305-a7d0-1d63dff9d3f3 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:53:48.360032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-f7d72988-401e-4305-a7d0-1d63dff9d3f3 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:53:48.421769 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f7d72988-401e-4305-a7d0-1d63dff9d3f3 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "POST /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9/action" status: 202 len: 0 microversion: 2.1 time: 0.117617 Oct 12 22:53:48.422384 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3891/7133] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:53:48 2022] POST /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:53:48.430533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e7c8ccd3-5ccd-4e2f-ba30-b110536aaa43 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:48.431171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e7c8ccd3-5ccd-4e2f-ba30-b110536aaa43 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:48.437689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7c8ccd3-5ccd-4e2f-ba30-b110536aaa43 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:48.438198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7c8ccd3-5ccd-4e2f-ba30-b110536aaa43 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:48.438657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7c8ccd3-5ccd-4e2f-ba30-b110536aaa43 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:48.439409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7c8ccd3-5ccd-4e2f-ba30-b110536aaa43 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:48.439882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7c8ccd3-5ccd-4e2f-ba30-b110536aaa43 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:48.440330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7c8ccd3-5ccd-4e2f-ba30-b110536aaa43 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:48.579548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e7c8ccd3-5ccd-4e2f-ba30-b110536aaa43 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:48.587702 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e7c8ccd3-5ccd-4e2f-ba30-b110536aaa43 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1513 microversion: 2.1 time: 0.160951 Oct 12 22:53:48.588370 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3243/7134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:48 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:49.613857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4da8ada2-75f2-4b8c-8a1f-c232be3b5614 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:49.614370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4da8ada2-75f2-4b8c-8a1f-c232be3b5614 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:49.621249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4da8ada2-75f2-4b8c-8a1f-c232be3b5614 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:49.621744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4da8ada2-75f2-4b8c-8a1f-c232be3b5614 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:49.622167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4da8ada2-75f2-4b8c-8a1f-c232be3b5614 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:49.622853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4da8ada2-75f2-4b8c-8a1f-c232be3b5614 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:49.623330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4da8ada2-75f2-4b8c-8a1f-c232be3b5614 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:49.623758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4da8ada2-75f2-4b8c-8a1f-c232be3b5614 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:49.753932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4da8ada2-75f2-4b8c-8a1f-c232be3b5614 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:49.757623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:49.763180 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4da8ada2-75f2-4b8c-8a1f-c232be3b5614 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1513 microversion: 2.1 time: 0.154643 Oct 12 22:53:49.763601 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3892/7135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:49 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:50.787729 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a150e666-405a-47a2-ac02-8da31f0477b4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:50.788359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a150e666-405a-47a2-ac02-8da31f0477b4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:50.795091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a150e666-405a-47a2-ac02-8da31f0477b4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:50.795619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a150e666-405a-47a2-ac02-8da31f0477b4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:50.796067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a150e666-405a-47a2-ac02-8da31f0477b4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:50.796767 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a150e666-405a-47a2-ac02-8da31f0477b4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:50.797229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a150e666-405a-47a2-ac02-8da31f0477b4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:50.797667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a150e666-405a-47a2-ac02-8da31f0477b4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:50.924919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a150e666-405a-47a2-ac02-8da31f0477b4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:50.932588 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a150e666-405a-47a2-ac02-8da31f0477b4 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.148757 Oct 12 22:53:50.933153 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3244/7136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:50 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:51.956787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-294c6580-fa97-48be-8beb-cfb57ea0532a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:51.957405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-294c6580-fa97-48be-8beb-cfb57ea0532a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:51.965532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-294c6580-fa97-48be-8beb-cfb57ea0532a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:51.966011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-294c6580-fa97-48be-8beb-cfb57ea0532a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:51.966446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-294c6580-fa97-48be-8beb-cfb57ea0532a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:51.967130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-294c6580-fa97-48be-8beb-cfb57ea0532a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:51.967605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-294c6580-fa97-48be-8beb-cfb57ea0532a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:51.968054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-294c6580-fa97-48be-8beb-cfb57ea0532a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:52.100235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-294c6580-fa97-48be-8beb-cfb57ea0532a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:52.108338 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-294c6580-fa97-48be-8beb-cfb57ea0532a tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.155955 Oct 12 22:53:52.108906 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3893/7137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:51 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:53.130682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9164c32a-f5b6-4c1c-a2a3-90fe194c2c12 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:53.131213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9164c32a-f5b6-4c1c-a2a3-90fe194c2c12 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:53.138021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9164c32a-f5b6-4c1c-a2a3-90fe194c2c12 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:53.138515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9164c32a-f5b6-4c1c-a2a3-90fe194c2c12 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:53.138962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9164c32a-f5b6-4c1c-a2a3-90fe194c2c12 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:53.139692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9164c32a-f5b6-4c1c-a2a3-90fe194c2c12 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:53.140155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9164c32a-f5b6-4c1c-a2a3-90fe194c2c12 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:53.140592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9164c32a-f5b6-4c1c-a2a3-90fe194c2c12 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:53.270929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9164c32a-f5b6-4c1c-a2a3-90fe194c2c12 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:53.278715 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9164c32a-f5b6-4c1c-a2a3-90fe194c2c12 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.151976 Oct 12 22:53:53.279295 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3245/7138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:53 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:54.301814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-132278b0-b374-4411-9f5e-e09de8860e16 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:54.302426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-132278b0-b374-4411-9f5e-e09de8860e16 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:54.309082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-132278b0-b374-4411-9f5e-e09de8860e16 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:54.309567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-132278b0-b374-4411-9f5e-e09de8860e16 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:54.310004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-132278b0-b374-4411-9f5e-e09de8860e16 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:54.310690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-132278b0-b374-4411-9f5e-e09de8860e16 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:54.311143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-132278b0-b374-4411-9f5e-e09de8860e16 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:54.311591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-132278b0-b374-4411-9f5e-e09de8860e16 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:54.442470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-132278b0-b374-4411-9f5e-e09de8860e16 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:54.450313 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-132278b0-b374-4411-9f5e-e09de8860e16 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.153053 Oct 12 22:53:54.450887 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3894/7139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:54 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:55.474640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2e21d89e-f1a2-458a-aab4-ef107a3e3418 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:55.475290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2e21d89e-f1a2-458a-aab4-ef107a3e3418 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:55.482330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e21d89e-f1a2-458a-aab4-ef107a3e3418 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:55.482825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e21d89e-f1a2-458a-aab4-ef107a3e3418 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:55.483290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e21d89e-f1a2-458a-aab4-ef107a3e3418 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:55.483996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e21d89e-f1a2-458a-aab4-ef107a3e3418 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:55.484456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e21d89e-f1a2-458a-aab4-ef107a3e3418 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:55.484896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e21d89e-f1a2-458a-aab4-ef107a3e3418 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:55.613412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2e21d89e-f1a2-458a-aab4-ef107a3e3418 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:55.621023 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2e21d89e-f1a2-458a-aab4-ef107a3e3418 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.150263 Oct 12 22:53:55.621590 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3246/7140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:55 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:56.644056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6ce40de1-79ac-4531-9c48-ea59734bb147 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:56.644658 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6ce40de1-79ac-4531-9c48-ea59734bb147 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:56.651518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ce40de1-79ac-4531-9c48-ea59734bb147 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:56.652003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ce40de1-79ac-4531-9c48-ea59734bb147 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:56.652440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ce40de1-79ac-4531-9c48-ea59734bb147 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:56.653133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ce40de1-79ac-4531-9c48-ea59734bb147 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:56.653583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ce40de1-79ac-4531-9c48-ea59734bb147 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:56.654011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6ce40de1-79ac-4531-9c48-ea59734bb147 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:56.783000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6ce40de1-79ac-4531-9c48-ea59734bb147 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:56.790645 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6ce40de1-79ac-4531-9c48-ea59734bb147 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.150556 Oct 12 22:53:56.791207 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3895/7141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:56 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:57.815155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dfa07c1a-d2cc-4777-9296-0f551d8524bc tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:57.815848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dfa07c1a-d2cc-4777-9296-0f551d8524bc tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:57.823115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfa07c1a-d2cc-4777-9296-0f551d8524bc tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:57.823699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfa07c1a-d2cc-4777-9296-0f551d8524bc tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:57.824153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfa07c1a-d2cc-4777-9296-0f551d8524bc tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:57.824867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfa07c1a-d2cc-4777-9296-0f551d8524bc tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:57.825371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfa07c1a-d2cc-4777-9296-0f551d8524bc tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:57.825812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfa07c1a-d2cc-4777-9296-0f551d8524bc tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:57.954414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dfa07c1a-d2cc-4777-9296-0f551d8524bc tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:57.962101 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dfa07c1a-d2cc-4777-9296-0f551d8524bc tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.151394 Oct 12 22:53:57.962687 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3247/7142] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:57 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:58.985428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4b2dd264-4b7d-4ee8-81dd-b728b1728497 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:58.986050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4b2dd264-4b7d-4ee8-81dd-b728b1728497 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:58.993006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b2dd264-4b7d-4ee8-81dd-b728b1728497 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:58.993490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b2dd264-4b7d-4ee8-81dd-b728b1728497 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:58.993933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b2dd264-4b7d-4ee8-81dd-b728b1728497 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:58.994623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b2dd264-4b7d-4ee8-81dd-b728b1728497 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:58.995081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b2dd264-4b7d-4ee8-81dd-b728b1728497 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:58.995540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b2dd264-4b7d-4ee8-81dd-b728b1728497 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:59.129254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b2dd264-4b7d-4ee8-81dd-b728b1728497 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:59.137008 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4b2dd264-4b7d-4ee8-81dd-b728b1728497 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.155727 Oct 12 22:53:59.137586 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3896/7143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:58 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:00.161609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-191eaea4-87dc-4b50-b468-24d7dab76ccf tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:00.162235 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-191eaea4-87dc-4b50-b468-24d7dab76ccf tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:00.169066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191eaea4-87dc-4b50-b468-24d7dab76ccf tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:00.169560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191eaea4-87dc-4b50-b468-24d7dab76ccf tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:00.170010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191eaea4-87dc-4b50-b468-24d7dab76ccf tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:00.170709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191eaea4-87dc-4b50-b468-24d7dab76ccf tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:00.171169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191eaea4-87dc-4b50-b468-24d7dab76ccf tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:00.171634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-191eaea4-87dc-4b50-b468-24d7dab76ccf tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:00.306634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-191eaea4-87dc-4b50-b468-24d7dab76ccf tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:00.314603 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-191eaea4-87dc-4b50-b468-24d7dab76ccf tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.157508 Oct 12 22:54:00.315177 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3248/7144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:00 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:01.337977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-598cace7-5e82-414c-9e37-2a7268a96237 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:01.338588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-598cace7-5e82-414c-9e37-2a7268a96237 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:01.345872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-598cace7-5e82-414c-9e37-2a7268a96237 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:01.346377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-598cace7-5e82-414c-9e37-2a7268a96237 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:01.346835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-598cace7-5e82-414c-9e37-2a7268a96237 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:01.347554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-598cace7-5e82-414c-9e37-2a7268a96237 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:01.348008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-598cace7-5e82-414c-9e37-2a7268a96237 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:01.348427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-598cace7-5e82-414c-9e37-2a7268a96237 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:01.474708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-598cace7-5e82-414c-9e37-2a7268a96237 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:01.482741 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-598cace7-5e82-414c-9e37-2a7268a96237 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.148716 Oct 12 22:54:01.483338 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3897/7145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:01 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:02.507111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-22596640-d68a-4e1b-ac0f-abd8199cd9ef tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:02.507820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-22596640-d68a-4e1b-ac0f-abd8199cd9ef tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:02.510532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:02.515871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22596640-d68a-4e1b-ac0f-abd8199cd9ef tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:02.516510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22596640-d68a-4e1b-ac0f-abd8199cd9ef tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:02.516967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22596640-d68a-4e1b-ac0f-abd8199cd9ef tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:02.517699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22596640-d68a-4e1b-ac0f-abd8199cd9ef tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:02.518161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22596640-d68a-4e1b-ac0f-abd8199cd9ef tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:02.518599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22596640-d68a-4e1b-ac0f-abd8199cd9ef tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:02.645892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-22596640-d68a-4e1b-ac0f-abd8199cd9ef tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:02.654937 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-22596640-d68a-4e1b-ac0f-abd8199cd9ef tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.152027 Oct 12 22:54:02.655533 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3249/7146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:02 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:03.678536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c6d02124-e0ef-402f-b722-2276e502bd8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:03.679275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c6d02124-e0ef-402f-b722-2276e502bd8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:03.681992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:03.687109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6d02124-e0ef-402f-b722-2276e502bd8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:03.687629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6d02124-e0ef-402f-b722-2276e502bd8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:03.688063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6d02124-e0ef-402f-b722-2276e502bd8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:03.688810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6d02124-e0ef-402f-b722-2276e502bd8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:03.689330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6d02124-e0ef-402f-b722-2276e502bd8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:03.689767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6d02124-e0ef-402f-b722-2276e502bd8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:03.823508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c6d02124-e0ef-402f-b722-2276e502bd8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:03.831189 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c6d02124-e0ef-402f-b722-2276e502bd8e tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.156610 Oct 12 22:54:03.831808 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3898/7147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:03 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:04.855045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8107d091-e2ee-4ec4-9a3c-2e32a9f01853 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:04.855721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8107d091-e2ee-4ec4-9a3c-2e32a9f01853 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:04.863556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8107d091-e2ee-4ec4-9a3c-2e32a9f01853 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:04.864056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8107d091-e2ee-4ec4-9a3c-2e32a9f01853 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:04.864510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8107d091-e2ee-4ec4-9a3c-2e32a9f01853 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:04.865216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8107d091-e2ee-4ec4-9a3c-2e32a9f01853 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:04.865683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8107d091-e2ee-4ec4-9a3c-2e32a9f01853 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:04.866121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8107d091-e2ee-4ec4-9a3c-2e32a9f01853 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:04.997450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8107d091-e2ee-4ec4-9a3c-2e32a9f01853 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:05.005683 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8107d091-e2ee-4ec4-9a3c-2e32a9f01853 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.154607 Oct 12 22:54:05.006254 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3250/7148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:04 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:06.029241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4b1f0416-c62a-4735-919d-bccc66430ee2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:06.029844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4b1f0416-c62a-4735-919d-bccc66430ee2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:06.037063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b1f0416-c62a-4735-919d-bccc66430ee2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:06.037546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b1f0416-c62a-4735-919d-bccc66430ee2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:06.037984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b1f0416-c62a-4735-919d-bccc66430ee2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:06.038674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b1f0416-c62a-4735-919d-bccc66430ee2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:06.039128 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b1f0416-c62a-4735-919d-bccc66430ee2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:06.039583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4b1f0416-c62a-4735-919d-bccc66430ee2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:06.166238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4b1f0416-c62a-4735-919d-bccc66430ee2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:06.174409 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4b1f0416-c62a-4735-919d-bccc66430ee2 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.149415 Oct 12 22:54:06.174980 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3899/7149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:06 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:07.198077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-554814b3-7e99-4ec2-8c52-3e2e3fb2d893 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:07.198634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-554814b3-7e99-4ec2-8c52-3e2e3fb2d893 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:07.206384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-554814b3-7e99-4ec2-8c52-3e2e3fb2d893 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:07.206891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-554814b3-7e99-4ec2-8c52-3e2e3fb2d893 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:07.207376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-554814b3-7e99-4ec2-8c52-3e2e3fb2d893 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:07.208086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-554814b3-7e99-4ec2-8c52-3e2e3fb2d893 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:07.208555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-554814b3-7e99-4ec2-8c52-3e2e3fb2d893 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:07.209005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-554814b3-7e99-4ec2-8c52-3e2e3fb2d893 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:07.337286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-554814b3-7e99-4ec2-8c52-3e2e3fb2d893 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:07.345111 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-554814b3-7e99-4ec2-8c52-3e2e3fb2d893 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.151049 Oct 12 22:54:07.345678 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3251/7150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:07 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:08.368508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-23cf5a6f-3104-49dc-bab5-11259f364506 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:08.369148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-23cf5a6f-3104-49dc-bab5-11259f364506 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:08.376034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23cf5a6f-3104-49dc-bab5-11259f364506 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:08.376521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23cf5a6f-3104-49dc-bab5-11259f364506 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:08.376965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23cf5a6f-3104-49dc-bab5-11259f364506 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:08.377654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23cf5a6f-3104-49dc-bab5-11259f364506 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:08.378105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23cf5a6f-3104-49dc-bab5-11259f364506 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:08.378534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-23cf5a6f-3104-49dc-bab5-11259f364506 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:08.506059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-23cf5a6f-3104-49dc-bab5-11259f364506 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:08.513790 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-23cf5a6f-3104-49dc-bab5-11259f364506 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.149232 Oct 12 22:54:08.514404 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3900/7151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:08 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:09.538503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f5d28f1c-d149-46ef-80d0-d9ed771dd700 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:09.539130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f5d28f1c-d149-46ef-80d0-d9ed771dd700 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:09.545921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5d28f1c-d149-46ef-80d0-d9ed771dd700 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:09.546417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5d28f1c-d149-46ef-80d0-d9ed771dd700 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:09.546867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5d28f1c-d149-46ef-80d0-d9ed771dd700 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:09.547597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5d28f1c-d149-46ef-80d0-d9ed771dd700 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:09.548632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5d28f1c-d149-46ef-80d0-d9ed771dd700 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:09.549073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5d28f1c-d149-46ef-80d0-d9ed771dd700 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:09.676114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f5d28f1c-d149-46ef-80d0-d9ed771dd700 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:09.683986 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f5d28f1c-d149-46ef-80d0-d9ed771dd700 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.149394 Oct 12 22:54:09.684550 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3252/7152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:09 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:10.707035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7a4c9e00-948b-4484-ae8b-b6cf1e296854 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:10.707687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7a4c9e00-948b-4484-ae8b-b6cf1e296854 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:10.715312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a4c9e00-948b-4484-ae8b-b6cf1e296854 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:10.715823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a4c9e00-948b-4484-ae8b-b6cf1e296854 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:10.716257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a4c9e00-948b-4484-ae8b-b6cf1e296854 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:10.716959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a4c9e00-948b-4484-ae8b-b6cf1e296854 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:10.717435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a4c9e00-948b-4484-ae8b-b6cf1e296854 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:10.717858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7a4c9e00-948b-4484-ae8b-b6cf1e296854 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:10.850897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7a4c9e00-948b-4484-ae8b-b6cf1e296854 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:10.858818 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7a4c9e00-948b-4484-ae8b-b6cf1e296854 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.155721 Oct 12 22:54:10.859418 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3901/7153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:10 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:11.882965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-62113b62-46d0-487b-a6e9-ceb88459bec6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:11.883625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-62113b62-46d0-487b-a6e9-ceb88459bec6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:11.890560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62113b62-46d0-487b-a6e9-ceb88459bec6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:11.891066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62113b62-46d0-487b-a6e9-ceb88459bec6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:11.892288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62113b62-46d0-487b-a6e9-ceb88459bec6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:11.892952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62113b62-46d0-487b-a6e9-ceb88459bec6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:11.893425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62113b62-46d0-487b-a6e9-ceb88459bec6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:11.893874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62113b62-46d0-487b-a6e9-ceb88459bec6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:12.027411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-62113b62-46d0-487b-a6e9-ceb88459bec6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:12.035112 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-62113b62-46d0-487b-a6e9-ceb88459bec6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.156129 Oct 12 22:54:12.035720 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3253/7154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:11 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:13.057564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d51ce017-7f27-49ff-89c4-05eed5f19e84 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:13.058096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d51ce017-7f27-49ff-89c4-05eed5f19e84 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:13.064922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d51ce017-7f27-49ff-89c4-05eed5f19e84 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:13.065405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d51ce017-7f27-49ff-89c4-05eed5f19e84 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:13.065841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d51ce017-7f27-49ff-89c4-05eed5f19e84 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:13.066526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d51ce017-7f27-49ff-89c4-05eed5f19e84 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:13.066976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d51ce017-7f27-49ff-89c4-05eed5f19e84 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:13.067436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d51ce017-7f27-49ff-89c4-05eed5f19e84 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:13.193992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d51ce017-7f27-49ff-89c4-05eed5f19e84 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:13.201584 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d51ce017-7f27-49ff-89c4-05eed5f19e84 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.147973 Oct 12 22:54:13.202145 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3902/7155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:13 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:14.226081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c912f323-0f5e-4daf-865b-d695f7798979 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:14.226723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c912f323-0f5e-4daf-865b-d695f7798979 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:14.233596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c912f323-0f5e-4daf-865b-d695f7798979 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:14.234095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c912f323-0f5e-4daf-865b-d695f7798979 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:14.234547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c912f323-0f5e-4daf-865b-d695f7798979 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:14.235307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c912f323-0f5e-4daf-865b-d695f7798979 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:14.235779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c912f323-0f5e-4daf-865b-d695f7798979 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:14.236813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c912f323-0f5e-4daf-865b-d695f7798979 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:14.364606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c912f323-0f5e-4daf-865b-d695f7798979 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:14.372292 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c912f323-0f5e-4daf-865b-d695f7798979 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.150287 Oct 12 22:54:14.372864 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3254/7156] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:14 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:15.395633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3c2faa21-1f39-4ab3-9581-478095053c2f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:15.396258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3c2faa21-1f39-4ab3-9581-478095053c2f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:15.403373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c2faa21-1f39-4ab3-9581-478095053c2f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:15.404041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c2faa21-1f39-4ab3-9581-478095053c2f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:15.404323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c2faa21-1f39-4ab3-9581-478095053c2f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:15.405013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c2faa21-1f39-4ab3-9581-478095053c2f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:15.405461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c2faa21-1f39-4ab3-9581-478095053c2f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:15.405884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3c2faa21-1f39-4ab3-9581-478095053c2f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:15.539577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3c2faa21-1f39-4ab3-9581-478095053c2f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:15.547592 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3c2faa21-1f39-4ab3-9581-478095053c2f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.155883 Oct 12 22:54:15.548374 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3903/7157] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:15 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:16.572416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fab6eaf4-bf57-4136-a481-b420400d5f2c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:16.573038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fab6eaf4-bf57-4136-a481-b420400d5f2c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:16.580319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fab6eaf4-bf57-4136-a481-b420400d5f2c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:16.580808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fab6eaf4-bf57-4136-a481-b420400d5f2c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:16.581256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fab6eaf4-bf57-4136-a481-b420400d5f2c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:16.581955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fab6eaf4-bf57-4136-a481-b420400d5f2c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:16.582417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fab6eaf4-bf57-4136-a481-b420400d5f2c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:16.582851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fab6eaf4-bf57-4136-a481-b420400d5f2c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:16.714018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fab6eaf4-bf57-4136-a481-b420400d5f2c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:16.722239 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fab6eaf4-bf57-4136-a481-b420400d5f2c tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1518 microversion: 2.1 time: 0.153749 Oct 12 22:54:16.722812 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3255/7158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:16 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:17.561083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-4b32ad25-bb01-49e1-9ce2-3f3d5968ee55 req-3c576827-1bbb-44cc-aec2-241be3a9369c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c78f731-1aa6-421e-8783-0feb6be2acc9", "name": "network-vif-unplugged", "status": "completed", "tag": "ac806191-f019-4ccd-b0de-49c7e1f574b3"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:17.573559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4b32ad25-bb01-49e1-9ce2-3f3d5968ee55 req-3c576827-1bbb-44cc-aec2-241be3a9369c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:17.574136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4b32ad25-bb01-49e1-9ce2-3f3d5968ee55 req-3c576827-1bbb-44cc-aec2-241be3a9369c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:17.574621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-4b32ad25-bb01-49e1-9ce2-3f3d5968ee55 req-3c576827-1bbb-44cc-aec2-241be3a9369c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:17.589092 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-4b32ad25-bb01-49e1-9ce2-3f3d5968ee55 req-3c576827-1bbb-44cc-aec2-241be3a9369c service nova] Creating event network-vif-unplugged:ac806191-f019-4ccd-b0de-49c7e1f574b3 for instance 7c78f731-1aa6-421e-8783-0feb6be2acc9 on n-h1-861111-1 Oct 12 22:54:17.595767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-4b32ad25-bb01-49e1-9ce2-3f3d5968ee55 req-3c576827-1bbb-44cc-aec2-241be3a9369c service nova] Instance 7c78f731-1aa6-421e-8783-0feb6be2acc9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:54:17.607775 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-4b32ad25-bb01-49e1-9ce2-3f3d5968ee55 req-3c576827-1bbb-44cc-aec2-241be3a9369c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050419 Oct 12 22:54:17.608698 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3904/7159] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:17.744757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f51a61ae-fe19-4588-b24f-bf38c3e14130 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:17.745468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f51a61ae-fe19-4588-b24f-bf38c3e14130 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:17.752649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f51a61ae-fe19-4588-b24f-bf38c3e14130 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:17.753152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f51a61ae-fe19-4588-b24f-bf38c3e14130 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:17.753599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f51a61ae-fe19-4588-b24f-bf38c3e14130 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:17.754314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f51a61ae-fe19-4588-b24f-bf38c3e14130 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:17.754775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f51a61ae-fe19-4588-b24f-bf38c3e14130 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:17.755472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f51a61ae-fe19-4588-b24f-bf38c3e14130 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:17.951948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f51a61ae-fe19-4588-b24f-bf38c3e14130 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:17.962006 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f51a61ae-fe19-4588-b24f-bf38c3e14130 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1517 microversion: 2.1 time: 0.221036 Oct 12 22:54:17.975302 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3256/7160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:17 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1517 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:18.988762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dacf1e00-3b40-4d66-9dd6-4cbd9575bb09 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:18.989384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dacf1e00-3b40-4d66-9dd6-4cbd9575bb09 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:18.995549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dacf1e00-3b40-4d66-9dd6-4cbd9575bb09 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:18.996031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dacf1e00-3b40-4d66-9dd6-4cbd9575bb09 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:18.996465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dacf1e00-3b40-4d66-9dd6-4cbd9575bb09 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:18.997147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dacf1e00-3b40-4d66-9dd6-4cbd9575bb09 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:18.997593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dacf1e00-3b40-4d66-9dd6-4cbd9575bb09 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:18.998017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dacf1e00-3b40-4d66-9dd6-4cbd9575bb09 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:19.125106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dacf1e00-3b40-4d66-9dd6-4cbd9575bb09 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:19.133390 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dacf1e00-3b40-4d66-9dd6-4cbd9575bb09 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1515 microversion: 2.1 time: 0.150294 Oct 12 22:54:19.133961 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3905/7161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:18 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:19.639030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-2599f38d-5e1f-4523-8751-08e72f771e77 req-94c7aa03-1410-4b9f-b5a8-643f4abe6887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c78f731-1aa6-421e-8783-0feb6be2acc9", "tag": "ac806191-f019-4ccd-b0de-49c7e1f574b3"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:19.650110 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2599f38d-5e1f-4523-8751-08e72f771e77 req-94c7aa03-1410-4b9f-b5a8-643f4abe6887 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:19.650655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2599f38d-5e1f-4523-8751-08e72f771e77 req-94c7aa03-1410-4b9f-b5a8-643f4abe6887 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:19.651102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2599f38d-5e1f-4523-8751-08e72f771e77 req-94c7aa03-1410-4b9f-b5a8-643f4abe6887 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:19.653747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=90 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:19.664331 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-2599f38d-5e1f-4523-8751-08e72f771e77 req-94c7aa03-1410-4b9f-b5a8-643f4abe6887 service nova] Creating event network-changed:ac806191-f019-4ccd-b0de-49c7e1f574b3 for instance 7c78f731-1aa6-421e-8783-0feb6be2acc9 on n-h1-861111-1 Oct 12 22:54:19.669470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-2599f38d-5e1f-4523-8751-08e72f771e77 req-94c7aa03-1410-4b9f-b5a8-643f4abe6887 service nova] Instance 7c78f731-1aa6-421e-8783-0feb6be2acc9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:54:19.680079 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-2599f38d-5e1f-4523-8751-08e72f771e77 req-94c7aa03-1410-4b9f-b5a8-643f4abe6887 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044785 Oct 12 22:54:19.680670 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3257/7162] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:20.157067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6d070dd4-bc34-4da1-9850-e0110e9aa24b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:20.157688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6d070dd4-bc34-4da1-9850-e0110e9aa24b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:20.164538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d070dd4-bc34-4da1-9850-e0110e9aa24b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:20.165026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d070dd4-bc34-4da1-9850-e0110e9aa24b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:20.165467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d070dd4-bc34-4da1-9850-e0110e9aa24b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:20.166169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d070dd4-bc34-4da1-9850-e0110e9aa24b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:20.166653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d070dd4-bc34-4da1-9850-e0110e9aa24b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:20.167088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6d070dd4-bc34-4da1-9850-e0110e9aa24b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:20.310914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6d070dd4-bc34-4da1-9850-e0110e9aa24b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:20.319546 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6d070dd4-bc34-4da1-9850-e0110e9aa24b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1515 microversion: 2.1 time: 0.166418 Oct 12 22:54:20.320132 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3906/7163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:20 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:21.344779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c563c22c-6b07-4f65-b09d-57f63211859f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:21.346098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c563c22c-6b07-4f65-b09d-57f63211859f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:21.352317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c563c22c-6b07-4f65-b09d-57f63211859f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:21.352814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c563c22c-6b07-4f65-b09d-57f63211859f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:21.353260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c563c22c-6b07-4f65-b09d-57f63211859f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:21.353961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c563c22c-6b07-4f65-b09d-57f63211859f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:21.354463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c563c22c-6b07-4f65-b09d-57f63211859f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:21.354901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c563c22c-6b07-4f65-b09d-57f63211859f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:21.815326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c563c22c-6b07-4f65-b09d-57f63211859f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:21.823031 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c563c22c-6b07-4f65-b09d-57f63211859f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1512 microversion: 2.1 time: 0.483366 Oct 12 22:54:21.823630 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3258/7164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:21 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1512 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:21.846872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1ca9f832-a88e-45ec-a251-74a79d34840d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:21.847479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1ca9f832-a88e-45ec-a251-74a79d34840d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:21.854404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ca9f832-a88e-45ec-a251-74a79d34840d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:21.854890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ca9f832-a88e-45ec-a251-74a79d34840d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:21.855359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ca9f832-a88e-45ec-a251-74a79d34840d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:21.856071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ca9f832-a88e-45ec-a251-74a79d34840d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:21.856525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ca9f832-a88e-45ec-a251-74a79d34840d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:21.857216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1ca9f832-a88e-45ec-a251-74a79d34840d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:21.920649 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1ca9f832-a88e-45ec-a251-74a79d34840d tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "POST /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9/action" status: 204 len: 0 microversion: 2.1 time: 0.077568 Oct 12 22:54:21.921298 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3907/7165] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:54:21 2022] POST /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:54:21.930138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dfa39a3d-26b5-414b-b19b-d2b9384b8e01 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:21.930788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dfa39a3d-26b5-414b-b19b-d2b9384b8e01 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:21.937077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfa39a3d-26b5-414b-b19b-d2b9384b8e01 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:21.937634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfa39a3d-26b5-414b-b19b-d2b9384b8e01 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:21.938106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfa39a3d-26b5-414b-b19b-d2b9384b8e01 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:21.938884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfa39a3d-26b5-414b-b19b-d2b9384b8e01 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:21.940022 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfa39a3d-26b5-414b-b19b-d2b9384b8e01 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:21.940476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfa39a3d-26b5-414b-b19b-d2b9384b8e01 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:22.156057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dfa39a3d-26b5-414b-b19b-d2b9384b8e01 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:22.164262 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dfa39a3d-26b5-414b-b19b-d2b9384b8e01 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1512 microversion: 2.1 time: 0.238017 Oct 12 22:54:22.164839 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3259/7166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:21 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:23.191215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-424daa6f-e03d-4108-b600-9ebcad901405 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:23.191975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-424daa6f-e03d-4108-b600-9ebcad901405 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:23.198108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-424daa6f-e03d-4108-b600-9ebcad901405 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:23.198600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-424daa6f-e03d-4108-b600-9ebcad901405 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:23.199040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-424daa6f-e03d-4108-b600-9ebcad901405 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:23.199777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-424daa6f-e03d-4108-b600-9ebcad901405 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:23.200236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-424daa6f-e03d-4108-b600-9ebcad901405 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:23.200672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-424daa6f-e03d-4108-b600-9ebcad901405 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:23.205377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:23.336049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-424daa6f-e03d-4108-b600-9ebcad901405 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:23.343889 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-424daa6f-e03d-4108-b600-9ebcad901405 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1504 microversion: 2.1 time: 0.158340 Oct 12 22:54:23.344488 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3908/7167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:23 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:23.367018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3d4a35bd-1fbc-46b4-86e3-9f4bc1eab1df tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:23.367675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3d4a35bd-1fbc-46b4-86e3-9f4bc1eab1df tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:23.374393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d4a35bd-1fbc-46b4-86e3-9f4bc1eab1df tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:23.374886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d4a35bd-1fbc-46b4-86e3-9f4bc1eab1df tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:23.375362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d4a35bd-1fbc-46b4-86e3-9f4bc1eab1df tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:23.376069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d4a35bd-1fbc-46b4-86e3-9f4bc1eab1df tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:23.377181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d4a35bd-1fbc-46b4-86e3-9f4bc1eab1df tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:23.377621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d4a35bd-1fbc-46b4-86e3-9f4bc1eab1df tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:23.505069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3d4a35bd-1fbc-46b4-86e3-9f4bc1eab1df tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:23.512834 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3d4a35bd-1fbc-46b4-86e3-9f4bc1eab1df tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1504 microversion: 2.1 time: 0.149767 Oct 12 22:54:23.513398 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3260/7168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:23 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:23.534545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb345a40-8937-4457-b786-112f4ff0ede1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:23.535160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cb345a40-8937-4457-b786-112f4ff0ede1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:23.541092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb345a40-8937-4457-b786-112f4ff0ede1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:23.541572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb345a40-8937-4457-b786-112f4ff0ede1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:23.542003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb345a40-8937-4457-b786-112f4ff0ede1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:23.542692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb345a40-8937-4457-b786-112f4ff0ede1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:23.543209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb345a40-8937-4457-b786-112f4ff0ede1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:23.543657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb345a40-8937-4457-b786-112f4ff0ede1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:23.671106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cb345a40-8937-4457-b786-112f4ff0ede1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:23.679394 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cb345a40-8937-4457-b786-112f4ff0ede1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1504 microversion: 2.1 time: 0.148702 Oct 12 22:54:23.679972 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3909/7169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:23 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:23.702142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bb0c3cec-dd46-4126-a0ea-61132fde184f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:23.702655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bb0c3cec-dd46-4126-a0ea-61132fde184f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:23.708571 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb0c3cec-dd46-4126-a0ea-61132fde184f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:23.709066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb0c3cec-dd46-4126-a0ea-61132fde184f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:23.709518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb0c3cec-dd46-4126-a0ea-61132fde184f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:23.710227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb0c3cec-dd46-4126-a0ea-61132fde184f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:23.710697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb0c3cec-dd46-4126-a0ea-61132fde184f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:23.711159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb0c3cec-dd46-4126-a0ea-61132fde184f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:23.735618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bb0c3cec-dd46-4126-a0ea-61132fde184f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:54:23.811806 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bb0c3cec-dd46-4126-a0ea-61132fde184f tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 204 len: 0 microversion: 2.1 time: 0.113198 Oct 12 22:54:23.812597 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3261/7170] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:54:23 2022] DELETE /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:54:23.828650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9adaa0ba-b3ac-43bf-a9d5-4ce61247971b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:23.829145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9adaa0ba-b3ac-43bf-a9d5-4ce61247971b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:23.835309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9adaa0ba-b3ac-43bf-a9d5-4ce61247971b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:23.835791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9adaa0ba-b3ac-43bf-a9d5-4ce61247971b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:23.836224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9adaa0ba-b3ac-43bf-a9d5-4ce61247971b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:23.836907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9adaa0ba-b3ac-43bf-a9d5-4ce61247971b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:23.837359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9adaa0ba-b3ac-43bf-a9d5-4ce61247971b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:23.837784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9adaa0ba-b3ac-43bf-a9d5-4ce61247971b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:23.865189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9adaa0ba-b3ac-43bf-a9d5-4ce61247971b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:54:23.911660 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.compute.api [None req-9adaa0ba-b3ac-43bf-a9d5-4ce61247971b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Instance is already in deleting state, ignoring this request Oct 12 22:54:23.912492 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9adaa0ba-b3ac-43bf-a9d5-4ce61247971b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 204 len: 0 microversion: 2.1 time: 0.088463 Oct 12 22:54:23.913060 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3910/7171] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:54:23 2022] DELETE /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:54:23.921895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af75fb1c-a0f5-4e75-bd41-2c66faa35cb5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:23.922610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-af75fb1c-a0f5-4e75-bd41-2c66faa35cb5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:23.929223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af75fb1c-a0f5-4e75-bd41-2c66faa35cb5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:23.929721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af75fb1c-a0f5-4e75-bd41-2c66faa35cb5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:23.930174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af75fb1c-a0f5-4e75-bd41-2c66faa35cb5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:23.930877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af75fb1c-a0f5-4e75-bd41-2c66faa35cb5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:23.931368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af75fb1c-a0f5-4e75-bd41-2c66faa35cb5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:23.931809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af75fb1c-a0f5-4e75-bd41-2c66faa35cb5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:24.081687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-dcf310b1-05f2-4bfe-9382-ad8962d917be req-1ae793ec-8560-4ca9-b9c7-3641d65dddf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c78f731-1aa6-421e-8783-0feb6be2acc9", "name": "network-vif-plugged", "status": "completed", "tag": "ac806191-f019-4ccd-b0de-49c7e1f574b3"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:24.083482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-af75fb1c-a0f5-4e75-bd41-2c66faa35cb5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:24.091016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-dcf310b1-05f2-4bfe-9382-ad8962d917be req-1ae793ec-8560-4ca9-b9c7-3641d65dddf7 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:24.091435 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-af75fb1c-a0f5-4e75-bd41-2c66faa35cb5 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1510 microversion: 2.1 time: 0.173769 Oct 12 22:54:24.091651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-dcf310b1-05f2-4bfe-9382-ad8962d917be req-1ae793ec-8560-4ca9-b9c7-3641d65dddf7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:24.092016 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3262/7172] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:23 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:24.092162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-dcf310b1-05f2-4bfe-9382-ad8962d917be req-1ae793ec-8560-4ca9-b9c7-3641d65dddf7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:24.103741 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-dcf310b1-05f2-4bfe-9382-ad8962d917be req-1ae793ec-8560-4ca9-b9c7-3641d65dddf7 service nova] Creating event network-vif-plugged:ac806191-f019-4ccd-b0de-49c7e1f574b3 for instance 7c78f731-1aa6-421e-8783-0feb6be2acc9 on n-h1-861111-1 Oct 12 22:54:24.108805 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-dcf310b1-05f2-4bfe-9382-ad8962d917be req-1ae793ec-8560-4ca9-b9c7-3641d65dddf7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103500 Oct 12 22:54:24.109389 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3911/7173] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:54:25.116149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c8ccfd1d-6fe2-4a2f-bb34-03e49e1957e1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:25.116698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c8ccfd1d-6fe2-4a2f-bb34-03e49e1957e1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:25.123527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8ccfd1d-6fe2-4a2f-bb34-03e49e1957e1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:25.124028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8ccfd1d-6fe2-4a2f-bb34-03e49e1957e1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:25.124482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8ccfd1d-6fe2-4a2f-bb34-03e49e1957e1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:25.125193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8ccfd1d-6fe2-4a2f-bb34-03e49e1957e1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:25.125662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8ccfd1d-6fe2-4a2f-bb34-03e49e1957e1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:25.126106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8ccfd1d-6fe2-4a2f-bb34-03e49e1957e1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:25.325846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c8ccfd1d-6fe2-4a2f-bb34-03e49e1957e1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396658689060469fbb042d011d2cb350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75136851bb664bddb37e690f4c2bc5e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:25.333715 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c8ccfd1d-6fe2-4a2f-bb34-03e49e1957e1 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 200 len: 1510 microversion: 2.1 time: 0.221578 Oct 12 22:54:25.334304 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3263/7174] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:25 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 1510 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:25.690731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-67a0a37d-03ee-4191-8e82-f93ded7f06a9 req-2467bf58-8554-495a-a3b7-96ee6edaa24c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c78f731-1aa6-421e-8783-0feb6be2acc9", "name": "network-vif-deleted", "tag": "ac806191-f019-4ccd-b0de-49c7e1f574b3"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:25.703713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-67a0a37d-03ee-4191-8e82-f93ded7f06a9 req-2467bf58-8554-495a-a3b7-96ee6edaa24c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:25.704126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-67a0a37d-03ee-4191-8e82-f93ded7f06a9 req-2467bf58-8554-495a-a3b7-96ee6edaa24c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:25.704557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-67a0a37d-03ee-4191-8e82-f93ded7f06a9 req-2467bf58-8554-495a-a3b7-96ee6edaa24c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:25.722095 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-67a0a37d-03ee-4191-8e82-f93ded7f06a9 req-2467bf58-8554-495a-a3b7-96ee6edaa24c service nova] Creating event network-vif-deleted:ac806191-f019-4ccd-b0de-49c7e1f574b3 for instance 7c78f731-1aa6-421e-8783-0feb6be2acc9 on n-h1-861111-1 Oct 12 22:54:25.727398 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-67a0a37d-03ee-4191-8e82-f93ded7f06a9 req-2467bf58-8554-495a-a3b7-96ee6edaa24c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041571 Oct 12 22:54:25.728008 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3912/7175] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:26.357873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cdce0fd8-11e8-4442-b048-ae5e85691e73 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:26.358511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cdce0fd8-11e8-4442-b048-ae5e85691e73 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 7c78f731-1aa6-421e-8783-0feb6be2acc9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:26.365802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdce0fd8-11e8-4442-b048-ae5e85691e73 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:26.366305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdce0fd8-11e8-4442-b048-ae5e85691e73 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:26.366763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdce0fd8-11e8-4442-b048-ae5e85691e73 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:26.367510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdce0fd8-11e8-4442-b048-ae5e85691e73 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:26.367983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdce0fd8-11e8-4442-b048-ae5e85691e73 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:26.368429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdce0fd8-11e8-4442-b048-ae5e85691e73 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:26.382149 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-cdce0fd8-11e8-4442-b048-ae5e85691e73 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] HTTP exception thrown: Instance 7c78f731-1aa6-421e-8783-0feb6be2acc9 could not be found. Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cdce0fd8-11e8-4442-b048-ae5e85691e73 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Request method failure captured: Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 HTTP/1.1 Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0U93mEhetD1DRnzMm6U-NXcrlN3lfPKu3jhTBH0f1yDjm2Sma9iDhDl4-NKdXTk465lX_lpiDDZSAEQMfEckBj5jSKZQAXStsHBn6G0AEeToLLEHL9Vo8JGqE0NgEJ77cmKqUGIDfh8bFShbkSytiBVd9HhY6t0_0jyv8TGcZyitSk Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 75136851bb664bddb37e690f4c2bc5e5 Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1291973976 Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/75136851bb664bddb37e690f4c2bc5e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/75136851bb664bddb37e690f4c2bc5e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_75136851bb664bddb37e690f4c2bc5e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/75136851bb664bddb37e690f4c2bc5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerDiskConfigTestJSON-1291973976 Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 75136851bb664bddb37e690f4c2bc5e5 Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1291973976 Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerDiskConfigTestJSON-1291973976-project Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 396658689060469fbb042d011d2cb350 Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerDiskConfigTestJSON-1291973976-project Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 7c78f731-1aa6-421e-8783-0feb6be2acc9 could not be found. Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '7c78f731-1aa6-421e-8783-0feb6be2acc9'} Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c78f731-1aa6-421e-8783-0feb6be2acc9 could not be found. Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c78f731-1aa6-421e-8783-0feb6be2acc9 could not be found. Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:54:26.383855 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:54:26.388989 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:54:26.388989 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:54:26.388989 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:54:26.388989 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:54:26.388989 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:54:26.388989 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c78f731-1aa6-421e-8783-0feb6be2acc9 could not be found. Oct 12 22:54:26.388989 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:54:26.388989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cdce0fd8-11e8-4442-b048-ae5e85691e73 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Returning 404 to user: Instance 7c78f731-1aa6-421e-8783-0feb6be2acc9 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:54:26.388989 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cdce0fd8-11e8-4442-b048-ae5e85691e73 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9" status: 404 len: 111 microversion: 2.1 time: 0.031711 Oct 12 22:54:26.388989 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3264/7176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:26 2022] GET /compute/v2.1/servers/7c78f731-1aa6-421e-8783-0feb6be2acc9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:54:26.394644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-787ebf63-101e-43f6-847c-2d6653cba36b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '.version_select at 0x7f5122bc1040>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:26.417506 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-787ebf63-101e-43f6-847c-2d6653cba36b tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1658783260" status: 202 len: 0 microversion: 2.1 time: 0.027067 Oct 12 22:54:26.418088 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3913/7177] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 12 22:54:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1658783260 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:54:27.010893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-718f8f09-1dee-49ea-90af-44bcf5f6cae6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:27.011470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-718f8f09-1dee-49ea-90af-44bcf5f6cae6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:27.018183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-718f8f09-1dee-49ea-90af-44bcf5f6cae6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:27.018690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-718f8f09-1dee-49ea-90af-44bcf5f6cae6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:27.019147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-718f8f09-1dee-49ea-90af-44bcf5f6cae6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:27.019889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-718f8f09-1dee-49ea-90af-44bcf5f6cae6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:27.020370 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-718f8f09-1dee-49ea-90af-44bcf5f6cae6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:27.020823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-718f8f09-1dee-49ea-90af-44bcf5f6cae6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:27.035604 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-718f8f09-1dee-49ea-90af-44bcf5f6cae6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] HTTP exception thrown: Instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c could not be found. Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-718f8f09-1dee-49ea-90af-44bcf5f6cae6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Request method failure captured: Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c HTTP/1.1 Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0U93mEhetD1DRnzMm6U-NXcrlN3lfPKu3jhTBH0f1yDjm2Sma9iDhDl4-NKdXTk465lX_lpiDDZSAEQMfEckBj5jSKZQAXStsHBn6G0AEeToLLEHL9Vo8JGqE0NgEJ77cmKqUGIDfh8bFShbkSytiBVd9HhY6t0_0jyv8TGcZyitSk Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 75136851bb664bddb37e690f4c2bc5e5 Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1291973976 Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/75136851bb664bddb37e690f4c2bc5e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/75136851bb664bddb37e690f4c2bc5e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_75136851bb664bddb37e690f4c2bc5e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/75136851bb664bddb37e690f4c2bc5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerDiskConfigTestJSON-1291973976 Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 75136851bb664bddb37e690f4c2bc5e5 Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1291973976 Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerDiskConfigTestJSON-1291973976-project Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 396658689060469fbb042d011d2cb350 Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerDiskConfigTestJSON-1291973976-project Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c could not be found. Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '66545dfe-0c54-44a5-b7c0-7ae1d750a18c'} Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c could not be found. Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:54:27.037967 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:54:27.043154 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c could not be found. Oct 12 22:54:27.043154 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:54:27.043154 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:54:27.043154 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:54:27.043154 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:54:27.043154 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:54:27.043154 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:54:27.043154 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:54:27.043154 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:54:27.043154 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c could not be found. Oct 12 22:54:27.043154 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:54:27.043154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-718f8f09-1dee-49ea-90af-44bcf5f6cae6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Returning 404 to user: Instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:54:27.043154 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-718f8f09-1dee-49ea-90af-44bcf5f6cae6 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "DELETE /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 404 len: 111 microversion: 2.1 time: 0.032757 Oct 12 22:54:27.043154 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3265/7178] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:54:27 2022] DELETE /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:54:27.051072 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-28209aa9-1e03-4e8b-b2dc-ef61271d2607 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:27.051842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-28209aa9-1e03-4e8b-b2dc-ef61271d2607 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] [instance: 66545dfe-0c54-44a5-b7c0-7ae1d750a18c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:27.058553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28209aa9-1e03-4e8b-b2dc-ef61271d2607 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:27.059028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28209aa9-1e03-4e8b-b2dc-ef61271d2607 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:27.059495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28209aa9-1e03-4e8b-b2dc-ef61271d2607 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:27.060201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28209aa9-1e03-4e8b-b2dc-ef61271d2607 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:27.060650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28209aa9-1e03-4e8b-b2dc-ef61271d2607 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:27.061071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28209aa9-1e03-4e8b-b2dc-ef61271d2607 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:27.074175 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-28209aa9-1e03-4e8b-b2dc-ef61271d2607 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] HTTP exception thrown: Instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c could not be found. Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-28209aa9-1e03-4e8b-b2dc-ef61271d2607 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Request method failure captured: Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c HTTP/1.1 Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0U93mEhetD1DRnzMm6U-NXcrlN3lfPKu3jhTBH0f1yDjm2Sma9iDhDl4-NKdXTk465lX_lpiDDZSAEQMfEckBj5jSKZQAXStsHBn6G0AEeToLLEHL9Vo8JGqE0NgEJ77cmKqUGIDfh8bFShbkSytiBVd9HhY6t0_0jyv8TGcZyitSk Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 75136851bb664bddb37e690f4c2bc5e5 Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1291973976 Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/75136851bb664bddb37e690f4c2bc5e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/75136851bb664bddb37e690f4c2bc5e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_75136851bb664bddb37e690f4c2bc5e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/75136851bb664bddb37e690f4c2bc5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerDiskConfigTestJSON-1291973976 Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 75136851bb664bddb37e690f4c2bc5e5 Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1291973976 Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerDiskConfigTestJSON-1291973976-project Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 396658689060469fbb042d011d2cb350 Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerDiskConfigTestJSON-1291973976-project Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c could not be found. Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '66545dfe-0c54-44a5-b7c0-7ae1d750a18c'} Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c could not be found. Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c could not be found. Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:54:27.075824 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:54:27.080988 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:54:27.080988 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:54:27.080988 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:54:27.080988 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:54:27.080988 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:54:27.080988 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c could not be found. Oct 12 22:54:27.080988 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:54:27.080988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-28209aa9-1e03-4e8b-b2dc-ef61271d2607 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] Returning 404 to user: Instance 66545dfe-0c54-44a5-b7c0-7ae1d750a18c could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:54:27.080988 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-28209aa9-1e03-4e8b-b2dc-ef61271d2607 tempest-ServerDiskConfigTestJSON-1291973976 tempest-ServerDiskConfigTestJSON-1291973976-project] 10.222.0.16 "GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c" status: 404 len: 111 microversion: 2.1 time: 0.032378 Oct 12 22:54:27.080988 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3914/7179] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:27 2022] GET /compute/v2.1/servers/66545dfe-0c54-44a5-b7c0-7ae1d750a18c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:54:35.231662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-de3e7630-4ef8-471e-b061-4473d8382a7c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Action: 'create', calling method: .version_select at 0x7f51286edaf0>, body: {"keypair": {"name": "tempest-keypair-1203075025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcOb1xDJRrMZUerHqxmbx3CqR2kGjZa44ZwiQr3ml/OEWzuPHeb6G/hUmF91LuDtF2dy6+RnwkMXzbAeGnc75Xmbj35ZxGWNIz31w9p9KGNzwwc6nJveRCmm1R9eLx1yQ=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:35.238212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:35.252228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-de3e7630-4ef8-471e-b061-4473d8382a7c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Getting quotas for project e44a4f6e4faa450b9850cd5bfbe53d59. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:54:35.258773 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-de3e7630-4ef8-471e-b061-4473d8382a7c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Getting quotas for user dc38342011d04f98aa06f9474fe6f402 and project e44a4f6e4faa450b9850cd5bfbe53d59. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:54:35.284948 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-de3e7630-4ef8-471e-b061-4473d8382a7c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174845 Oct 12 22:54:35.285560 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3266/7180] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 22:54:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:36.543148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1336759567", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e6b601d-4bd2-489e-9269-4cf57f84b9f1"}], "security_groups": [{"name": "tempest-securitygroup--91822578"}], "key_name": "tempest-keypair-1203075025", "user_data": "}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:36.553797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:36.652065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] validate_networks() for [('9e6b601d-4bd2-489e-9269-4cf57f84b9f1', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:54:37.066020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:37.077105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:54:37.077537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:54:37.078026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:54:37.078519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:54:37.078882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:54:37.088114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:37.088602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:37.089046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:37.089779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:37.090239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:37.090668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:37.108519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Getting quotas for project e44a4f6e4faa450b9850cd5bfbe53d59. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:54:37.114083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Getting quotas for user dc38342011d04f98aa06f9474fe6f402 and project e44a4f6e4faa450b9850cd5bfbe53d59. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:54:37.126693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:54:37.129025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:54:37.175565 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c93f7fae-2932-4a82-96ff-da6e9316472c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.636094 Oct 12 22:54:37.175565 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3915/7181] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:54:36 2022] POST /compute/v2.1/servers => generated 407 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:54:37.186961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a05216ca-673b-4049-9774-ca3b66ad4cde tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:37.187627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a05216ca-673b-4049-9774-ca3b66ad4cde tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:37.190834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:37.259326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a05216ca-673b-4049-9774-ca3b66ad4cde tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:37.266522 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a05216ca-673b-4049-9774-ca3b66ad4cde tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1239 microversion: 2.1 time: 0.084042 Oct 12 22:54:37.267765 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3267/7182] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:37 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:38.291057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a9e53c31-5b6f-4c60-8e21-b55b4a32865d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:38.291861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a9e53c31-5b6f-4c60-8e21-b55b4a32865d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:38.301572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9e53c31-5b6f-4c60-8e21-b55b4a32865d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:38.302167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9e53c31-5b6f-4c60-8e21-b55b4a32865d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:38.302676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9e53c31-5b6f-4c60-8e21-b55b4a32865d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:38.303412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9e53c31-5b6f-4c60-8e21-b55b4a32865d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:38.303867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9e53c31-5b6f-4c60-8e21-b55b4a32865d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:38.304290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a9e53c31-5b6f-4c60-8e21-b55b4a32865d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:38.376266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a9e53c31-5b6f-4c60-8e21-b55b4a32865d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:38.384815 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a9e53c31-5b6f-4c60-8e21-b55b4a32865d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1291 microversion: 2.1 time: 0.098636 Oct 12 22:54:38.385658 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3916/7183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:38 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1291 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:39.409060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-00029297-4241-4c41-81cb-522895a32227 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:39.409678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-00029297-4241-4c41-81cb-522895a32227 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:39.428281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00029297-4241-4c41-81cb-522895a32227 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:39.428801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00029297-4241-4c41-81cb-522895a32227 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:39.429259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00029297-4241-4c41-81cb-522895a32227 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:39.429985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00029297-4241-4c41-81cb-522895a32227 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:39.430460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00029297-4241-4c41-81cb-522895a32227 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:39.433334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00029297-4241-4c41-81cb-522895a32227 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:39.627614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-00029297-4241-4c41-81cb-522895a32227 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:39.635400 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-00029297-4241-4c41-81cb-522895a32227 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1363 microversion: 2.1 time: 0.230216 Oct 12 22:54:39.635974 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3268/7184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:39 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:39.966973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a5055ab8-9716-49d1-a21e-1db4e4ac1072 req-9ae4cd04-1574-47c2-9f85-21a230c3351f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4a03f0-5862-4c3e-9e20-c141d0c7f666", "tag": "f7ba33a9-b14e-4c93-8fca-c97bb58318af"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:39.979586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a5055ab8-9716-49d1-a21e-1db4e4ac1072 req-9ae4cd04-1574-47c2-9f85-21a230c3351f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:39.980635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a5055ab8-9716-49d1-a21e-1db4e4ac1072 req-9ae4cd04-1574-47c2-9f85-21a230c3351f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:39.981160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a5055ab8-9716-49d1-a21e-1db4e4ac1072 req-9ae4cd04-1574-47c2-9f85-21a230c3351f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:39.995017 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a5055ab8-9716-49d1-a21e-1db4e4ac1072 req-9ae4cd04-1574-47c2-9f85-21a230c3351f service nova] Creating event network-changed:f7ba33a9-b14e-4c93-8fca-c97bb58318af for instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 on n-h1-861111-1 Oct 12 22:54:40.000057 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a5055ab8-9716-49d1-a21e-1db4e4ac1072 req-9ae4cd04-1574-47c2-9f85-21a230c3351f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037064 Oct 12 22:54:40.000824 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3917/7185] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:40.658522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ba7de23d-47d0-4741-9c0c-3dc94841bde6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:40.659152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ba7de23d-47d0-4741-9c0c-3dc94841bde6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:40.666137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba7de23d-47d0-4741-9c0c-3dc94841bde6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:40.666637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba7de23d-47d0-4741-9c0c-3dc94841bde6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:40.667086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba7de23d-47d0-4741-9c0c-3dc94841bde6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:40.667838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba7de23d-47d0-4741-9c0c-3dc94841bde6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:40.668304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba7de23d-47d0-4741-9c0c-3dc94841bde6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:40.668743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba7de23d-47d0-4741-9c0c-3dc94841bde6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:40.823551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba7de23d-47d0-4741-9c0c-3dc94841bde6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:40.831409 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ba7de23d-47d0-4741-9c0c-3dc94841bde6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1363 microversion: 2.1 time: 0.176849 Oct 12 22:54:40.831972 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3269/7186] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:40 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:41.854700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-05c348ea-b073-403d-a71e-e38275286ea8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:41.855460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-05c348ea-b073-403d-a71e-e38275286ea8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:41.863698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05c348ea-b073-403d-a71e-e38275286ea8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:41.864190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05c348ea-b073-403d-a71e-e38275286ea8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:41.864665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05c348ea-b073-403d-a71e-e38275286ea8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:41.865369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05c348ea-b073-403d-a71e-e38275286ea8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:41.865830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05c348ea-b073-403d-a71e-e38275286ea8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:41.866278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-05c348ea-b073-403d-a71e-e38275286ea8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:42.277779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-05c348ea-b073-403d-a71e-e38275286ea8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:42.286184 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-05c348ea-b073-403d-a71e-e38275286ea8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1363 microversion: 2.1 time: 0.435760 Oct 12 22:54:42.286754 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3918/7187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:41 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1363 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:43.308947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f1201611-bd4e-4c36-9037-2dde157183d7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:43.309576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f1201611-bd4e-4c36-9037-2dde157183d7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:43.316302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1201611-bd4e-4c36-9037-2dde157183d7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:43.316804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1201611-bd4e-4c36-9037-2dde157183d7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:43.317254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1201611-bd4e-4c36-9037-2dde157183d7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:43.317956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1201611-bd4e-4c36-9037-2dde157183d7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:43.318422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1201611-bd4e-4c36-9037-2dde157183d7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:43.318861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1201611-bd4e-4c36-9037-2dde157183d7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:43.444810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f1201611-bd4e-4c36-9037-2dde157183d7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:43.452517 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f1201611-bd4e-4c36-9037-2dde157183d7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1363 microversion: 2.1 time: 0.147639 Oct 12 22:54:43.453083 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3270/7188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:43 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:44.475255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af80160e-b462-4d7e-af27-e8b3c4043c69 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:44.475919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-af80160e-b462-4d7e-af27-e8b3c4043c69 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:44.482925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af80160e-b462-4d7e-af27-e8b3c4043c69 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:44.483452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af80160e-b462-4d7e-af27-e8b3c4043c69 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:44.483893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af80160e-b462-4d7e-af27-e8b3c4043c69 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:44.484581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af80160e-b462-4d7e-af27-e8b3c4043c69 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:44.485033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af80160e-b462-4d7e-af27-e8b3c4043c69 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:44.485458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af80160e-b462-4d7e-af27-e8b3c4043c69 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:44.612450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-af80160e-b462-4d7e-af27-e8b3c4043c69 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:44.620461 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-af80160e-b462-4d7e-af27-e8b3c4043c69 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1363 microversion: 2.1 time: 0.149105 Oct 12 22:54:44.621072 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3919/7189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:44 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:45.644547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7fa160f7-2dbb-47bd-a87a-5b9325f2919e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:45.645181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7fa160f7-2dbb-47bd-a87a-5b9325f2919e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:45.652108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fa160f7-2dbb-47bd-a87a-5b9325f2919e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:45.652608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fa160f7-2dbb-47bd-a87a-5b9325f2919e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:45.653055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fa160f7-2dbb-47bd-a87a-5b9325f2919e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:45.653769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fa160f7-2dbb-47bd-a87a-5b9325f2919e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:45.654227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fa160f7-2dbb-47bd-a87a-5b9325f2919e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:45.654665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fa160f7-2dbb-47bd-a87a-5b9325f2919e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:45.781576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7fa160f7-2dbb-47bd-a87a-5b9325f2919e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:45.789262 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7fa160f7-2dbb-47bd-a87a-5b9325f2919e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1363 microversion: 2.1 time: 0.149312 Oct 12 22:54:45.789821 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3271/7190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:45 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:46.104636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-921e6563-f814-4f9f-a249-e9dfd3fe3258 req-4db7728c-476c-4cfb-8a67-0c6987a87356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4a03f0-5862-4c3e-9e20-c141d0c7f666", "name": "network-vif-plugged", "status": "completed", "tag": "f7ba33a9-b14e-4c93-8fca-c97bb58318af"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:46.115668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-921e6563-f814-4f9f-a249-e9dfd3fe3258 req-4db7728c-476c-4cfb-8a67-0c6987a87356 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:46.116153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-921e6563-f814-4f9f-a249-e9dfd3fe3258 req-4db7728c-476c-4cfb-8a67-0c6987a87356 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:46.116588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-921e6563-f814-4f9f-a249-e9dfd3fe3258 req-4db7728c-476c-4cfb-8a67-0c6987a87356 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:46.128368 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-921e6563-f814-4f9f-a249-e9dfd3fe3258 req-4db7728c-476c-4cfb-8a67-0c6987a87356 service nova] Creating event network-vif-plugged:f7ba33a9-b14e-4c93-8fca-c97bb58318af for instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 on n-h1-861111-1 Oct 12 22:54:46.133291 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-921e6563-f814-4f9f-a249-e9dfd3fe3258 req-4db7728c-476c-4cfb-8a67-0c6987a87356 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032450 Oct 12 22:54:46.133886 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3920/7191] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:46.811968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b1843628-17b8-45b1-a8c2-f257a77ea8da tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:46.812610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b1843628-17b8-45b1-a8c2-f257a77ea8da tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:46.819511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1843628-17b8-45b1-a8c2-f257a77ea8da tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:46.820055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1843628-17b8-45b1-a8c2-f257a77ea8da tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:46.820514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1843628-17b8-45b1-a8c2-f257a77ea8da tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:46.821231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1843628-17b8-45b1-a8c2-f257a77ea8da tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:46.821701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1843628-17b8-45b1-a8c2-f257a77ea8da tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:46.822149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1843628-17b8-45b1-a8c2-f257a77ea8da tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:46.951430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b1843628-17b8-45b1-a8c2-f257a77ea8da tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:46.959691 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b1843628-17b8-45b1-a8c2-f257a77ea8da tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1363 microversion: 2.1 time: 0.151667 Oct 12 22:54:46.960300 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3272/7192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:46 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:47.980713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:47.982461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:47.986996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-975decf3-c57d-4532-8db5-ca26f84bab55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:47.987733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-975decf3-c57d-4532-8db5-ca26f84bab55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:47.994796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-975decf3-c57d-4532-8db5-ca26f84bab55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:47.995310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-975decf3-c57d-4532-8db5-ca26f84bab55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:47.995759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-975decf3-c57d-4532-8db5-ca26f84bab55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:47.996456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-975decf3-c57d-4532-8db5-ca26f84bab55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:47.996943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-975decf3-c57d-4532-8db5-ca26f84bab55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:47.997379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-975decf3-c57d-4532-8db5-ca26f84bab55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:48.131299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-975decf3-c57d-4532-8db5-ca26f84bab55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:48.138990 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-975decf3-c57d-4532-8db5-ca26f84bab55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1549 microversion: 2.1 time: 0.159251 Oct 12 22:54:48.139590 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3921/7193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:47 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:48.161623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dc3e8f84-9e1c-4d12-a2e9-a2b6f3ca13cf tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:48.162143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dc3e8f84-9e1c-4d12-a2e9-a2b6f3ca13cf tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:48.164009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:48.170143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc3e8f84-9e1c-4d12-a2e9-a2b6f3ca13cf tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:48.170593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc3e8f84-9e1c-4d12-a2e9-a2b6f3ca13cf tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:48.171063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc3e8f84-9e1c-4d12-a2e9-a2b6f3ca13cf tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:48.171845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc3e8f84-9e1c-4d12-a2e9-a2b6f3ca13cf tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:48.172324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc3e8f84-9e1c-4d12-a2e9-a2b6f3ca13cf tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:48.172779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc3e8f84-9e1c-4d12-a2e9-a2b6f3ca13cf tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:48.252658 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dc3e8f84-9e1c-4d12-a2e9-a2b6f3ca13cf tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095001 Oct 12 22:54:48.253265 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3273/7194] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:54:48 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:49.169885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-983b85fc-fc3e-4d8e-9ad1-2d7437f63b80 req-e54b5e24-bbd3-4c78-ad90-4c61801f10ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4a03f0-5862-4c3e-9e20-c141d0c7f666", "tag": "f7ba33a9-b14e-4c93-8fca-c97bb58318af"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:49.180321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-983b85fc-fc3e-4d8e-9ad1-2d7437f63b80 req-e54b5e24-bbd3-4c78-ad90-4c61801f10ef service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:49.180795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-983b85fc-fc3e-4d8e-9ad1-2d7437f63b80 req-e54b5e24-bbd3-4c78-ad90-4c61801f10ef service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:49.181223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-983b85fc-fc3e-4d8e-9ad1-2d7437f63b80 req-e54b5e24-bbd3-4c78-ad90-4c61801f10ef service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:49.193546 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-983b85fc-fc3e-4d8e-9ad1-2d7437f63b80 req-e54b5e24-bbd3-4c78-ad90-4c61801f10ef service nova] Creating event network-changed:f7ba33a9-b14e-4c93-8fca-c97bb58318af for instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 on n-h1-861111-1 Oct 12 22:54:49.198491 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-983b85fc-fc3e-4d8e-9ad1-2d7437f63b80 req-e54b5e24-bbd3-4c78-ad90-4c61801f10ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032349 Oct 12 22:54:49.199151 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3922/7195] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:25.012032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:25.012858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=34 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:25.017260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5481a6c0-2966-4d7d-9c8b-1ad3fa861484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:25.017896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5481a6c0-2966-4d7d-9c8b-1ad3fa861484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:25.025481 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5481a6c0-2966-4d7d-9c8b-1ad3fa861484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:25.026014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5481a6c0-2966-4d7d-9c8b-1ad3fa861484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:25.026470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5481a6c0-2966-4d7d-9c8b-1ad3fa861484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:25.027180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5481a6c0-2966-4d7d-9c8b-1ad3fa861484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:25.027674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5481a6c0-2966-4d7d-9c8b-1ad3fa861484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:25.028119 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5481a6c0-2966-4d7d-9c8b-1ad3fa861484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:25.155020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5481a6c0-2966-4d7d-9c8b-1ad3fa861484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:25.162672 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5481a6c0-2966-4d7d-9c8b-1ad3fa861484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1667 microversion: 2.1 time: 0.153270 Oct 12 22:55:25.163253 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3274/7196] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:25 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:25.185549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bf7bf13f-7f3e-4e70-847b-bca98ca9602b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:25.186265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bf7bf13f-7f3e-4e70-847b-bca98ca9602b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:25.189299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:25.190699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=32 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:25.197856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf7bf13f-7f3e-4e70-847b-bca98ca9602b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:25.198344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf7bf13f-7f3e-4e70-847b-bca98ca9602b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:25.198786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf7bf13f-7f3e-4e70-847b-bca98ca9602b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:25.199509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf7bf13f-7f3e-4e70-847b-bca98ca9602b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:25.199966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf7bf13f-7f3e-4e70-847b-bca98ca9602b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:25.200397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bf7bf13f-7f3e-4e70-847b-bca98ca9602b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:25.328879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bf7bf13f-7f3e-4e70-847b-bca98ca9602b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:25.336592 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bf7bf13f-7f3e-4e70-847b-bca98ca9602b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1667 microversion: 2.1 time: 0.155247 Oct 12 22:55:25.337161 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3923/7197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:25 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:25.359549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dcb71e47-8c75-453b-81f0-7c62e7d15912 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:25.360182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dcb71e47-8c75-453b-81f0-7c62e7d15912 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:25.366681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcb71e47-8c75-453b-81f0-7c62e7d15912 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:25.367187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcb71e47-8c75-453b-81f0-7c62e7d15912 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:25.367678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcb71e47-8c75-453b-81f0-7c62e7d15912 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:25.368394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcb71e47-8c75-453b-81f0-7c62e7d15912 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:25.368869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcb71e47-8c75-453b-81f0-7c62e7d15912 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:25.369339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcb71e47-8c75-453b-81f0-7c62e7d15912 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:25.501484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dcb71e47-8c75-453b-81f0-7c62e7d15912 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:25.509263 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dcb71e47-8c75-453b-81f0-7c62e7d15912 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1667 microversion: 2.1 time: 0.153881 Oct 12 22:55:25.509832 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3275/7198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:25 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:25.531559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6b5546c3-98c2-49f6-a6d5-0d9a34d4ee0d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:25.534351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6b5546c3-98c2-49f6-a6d5-0d9a34d4ee0d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:25.540258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b5546c3-98c2-49f6-a6d5-0d9a34d4ee0d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:25.540745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b5546c3-98c2-49f6-a6d5-0d9a34d4ee0d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:25.541173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b5546c3-98c2-49f6-a6d5-0d9a34d4ee0d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:25.541861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b5546c3-98c2-49f6-a6d5-0d9a34d4ee0d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:25.542309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b5546c3-98c2-49f6-a6d5-0d9a34d4ee0d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:25.542732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b5546c3-98c2-49f6-a6d5-0d9a34d4ee0d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:25.574522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6b5546c3-98c2-49f6-a6d5-0d9a34d4ee0d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:25.580541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6b5546c3-98c2-49f6-a6d5-0d9a34d4ee0d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Old instance type m1.heat2, new instance type m1.heat {{(pid=120453) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:55:25.586956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6b5546c3-98c2-49f6-a6d5-0d9a34d4ee0d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:55:25.587414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6b5546c3-98c2-49f6-a6d5-0d9a34d4ee0d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:55:25.587892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6b5546c3-98c2-49f6-a6d5-0d9a34d4ee0d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:55:25.588305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6b5546c3-98c2-49f6-a6d5-0d9a34d4ee0d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:55:25.588717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6b5546c3-98c2-49f6-a6d5-0d9a34d4ee0d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:55:25.651385 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6b5546c3-98c2-49f6-a6d5-0d9a34d4ee0d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "POST /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666/action" status: 202 len: 0 microversion: 2.1 time: 0.123406 Oct 12 22:55:25.652010 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3924/7199] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:55:25 2022] POST /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:55:25.660637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b22cbe88-e7b4-4011-ad8e-98ee82ac8be1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:25.661263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b22cbe88-e7b4-4011-ad8e-98ee82ac8be1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:25.667307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b22cbe88-e7b4-4011-ad8e-98ee82ac8be1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:25.667812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b22cbe88-e7b4-4011-ad8e-98ee82ac8be1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:25.668258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b22cbe88-e7b4-4011-ad8e-98ee82ac8be1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:25.668964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b22cbe88-e7b4-4011-ad8e-98ee82ac8be1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:25.669443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b22cbe88-e7b4-4011-ad8e-98ee82ac8be1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:25.669863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b22cbe88-e7b4-4011-ad8e-98ee82ac8be1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:25.803605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b22cbe88-e7b4-4011-ad8e-98ee82ac8be1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:25.811691 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b22cbe88-e7b4-4011-ad8e-98ee82ac8be1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1676 microversion: 2.1 time: 0.155422 Oct 12 22:55:25.812260 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3276/7200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:25 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:55:26.835532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-793a9d46-219a-415e-a86e-4d19d8488767 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:26.836175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-793a9d46-219a-415e-a86e-4d19d8488767 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:26.843153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-793a9d46-219a-415e-a86e-4d19d8488767 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:26.843676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-793a9d46-219a-415e-a86e-4d19d8488767 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:26.844118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-793a9d46-219a-415e-a86e-4d19d8488767 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:26.844819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-793a9d46-219a-415e-a86e-4d19d8488767 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:26.845283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-793a9d46-219a-415e-a86e-4d19d8488767 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:26.845723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-793a9d46-219a-415e-a86e-4d19d8488767 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:26.978452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-793a9d46-219a-415e-a86e-4d19d8488767 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:26.986491 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-793a9d46-219a-415e-a86e-4d19d8488767 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1676 microversion: 2.1 time: 0.154974 Oct 12 22:55:26.987077 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3925/7201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:26 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:28.010468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-709c3b6b-c1c1-4fcd-a616-76f52ec11ce4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:28.011093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-709c3b6b-c1c1-4fcd-a616-76f52ec11ce4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:28.018433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-709c3b6b-c1c1-4fcd-a616-76f52ec11ce4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:28.018938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-709c3b6b-c1c1-4fcd-a616-76f52ec11ce4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:28.019426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-709c3b6b-c1c1-4fcd-a616-76f52ec11ce4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:28.020181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-709c3b6b-c1c1-4fcd-a616-76f52ec11ce4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:28.020610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-709c3b6b-c1c1-4fcd-a616-76f52ec11ce4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:28.021050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-709c3b6b-c1c1-4fcd-a616-76f52ec11ce4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:28.152361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-709c3b6b-c1c1-4fcd-a616-76f52ec11ce4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:28.160616 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-709c3b6b-c1c1-4fcd-a616-76f52ec11ce4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1681 microversion: 2.1 time: 0.154113 Oct 12 22:55:28.161181 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3277/7202] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:28 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:29.184173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b9770c25-b719-4009-9dd5-36ae9391e940 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:29.184734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b9770c25-b719-4009-9dd5-36ae9391e940 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:29.192100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9770c25-b719-4009-9dd5-36ae9391e940 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:29.192582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9770c25-b719-4009-9dd5-36ae9391e940 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:29.193017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9770c25-b719-4009-9dd5-36ae9391e940 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:29.193701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9770c25-b719-4009-9dd5-36ae9391e940 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:29.194147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9770c25-b719-4009-9dd5-36ae9391e940 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:29.194569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b9770c25-b719-4009-9dd5-36ae9391e940 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:29.321931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b9770c25-b719-4009-9dd5-36ae9391e940 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:29.329677 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b9770c25-b719-4009-9dd5-36ae9391e940 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1681 microversion: 2.1 time: 0.149537 Oct 12 22:55:29.330761 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3926/7203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:29 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:30.354050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-93f4cdc6-72a5-4e33-b59b-6316efeac645 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:30.354707 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-93f4cdc6-72a5-4e33-b59b-6316efeac645 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:30.362340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93f4cdc6-72a5-4e33-b59b-6316efeac645 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:30.362838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93f4cdc6-72a5-4e33-b59b-6316efeac645 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:30.363341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93f4cdc6-72a5-4e33-b59b-6316efeac645 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:30.364058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93f4cdc6-72a5-4e33-b59b-6316efeac645 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:30.364525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93f4cdc6-72a5-4e33-b59b-6316efeac645 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:30.364965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93f4cdc6-72a5-4e33-b59b-6316efeac645 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:30.493315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-93f4cdc6-72a5-4e33-b59b-6316efeac645 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:30.501115 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-93f4cdc6-72a5-4e33-b59b-6316efeac645 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1681 microversion: 2.1 time: 0.151029 Oct 12 22:55:30.501715 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3278/7204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:30 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:31.525124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1bf73ef9-f66f-4d88-ab03-59eb73ffc86b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:31.525742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1bf73ef9-f66f-4d88-ab03-59eb73ffc86b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:31.532604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bf73ef9-f66f-4d88-ab03-59eb73ffc86b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:31.533088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bf73ef9-f66f-4d88-ab03-59eb73ffc86b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:31.533526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bf73ef9-f66f-4d88-ab03-59eb73ffc86b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:31.534217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bf73ef9-f66f-4d88-ab03-59eb73ffc86b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:31.534673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bf73ef9-f66f-4d88-ab03-59eb73ffc86b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:31.535102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1bf73ef9-f66f-4d88-ab03-59eb73ffc86b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:31.669255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1bf73ef9-f66f-4d88-ab03-59eb73ffc86b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:31.677501 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1bf73ef9-f66f-4d88-ab03-59eb73ffc86b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1681 microversion: 2.1 time: 0.156402 Oct 12 22:55:31.678079 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3927/7205] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:31 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:32.702239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-77218100-7dad-4bbb-ad50-3cef3551de70 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:32.702865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-77218100-7dad-4bbb-ad50-3cef3551de70 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:32.710358 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77218100-7dad-4bbb-ad50-3cef3551de70 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:32.710862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77218100-7dad-4bbb-ad50-3cef3551de70 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:32.711360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77218100-7dad-4bbb-ad50-3cef3551de70 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:32.712071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77218100-7dad-4bbb-ad50-3cef3551de70 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:32.712543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77218100-7dad-4bbb-ad50-3cef3551de70 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:32.712987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77218100-7dad-4bbb-ad50-3cef3551de70 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:32.846859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-77218100-7dad-4bbb-ad50-3cef3551de70 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:32.854785 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-77218100-7dad-4bbb-ad50-3cef3551de70 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1681 microversion: 2.1 time: 0.156671 Oct 12 22:55:32.855566 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3279/7206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:32 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:33.878404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7903cb5a-c368-458d-8fa0-7e729166acc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:33.879022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7903cb5a-c368-458d-8fa0-7e729166acc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:33.886383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7903cb5a-c368-458d-8fa0-7e729166acc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:33.886865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7903cb5a-c368-458d-8fa0-7e729166acc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:33.887327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7903cb5a-c368-458d-8fa0-7e729166acc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:33.888017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7903cb5a-c368-458d-8fa0-7e729166acc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:33.888474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7903cb5a-c368-458d-8fa0-7e729166acc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:33.888901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7903cb5a-c368-458d-8fa0-7e729166acc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:34.016190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7903cb5a-c368-458d-8fa0-7e729166acc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:34.024821 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7903cb5a-c368-458d-8fa0-7e729166acc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1681 microversion: 2.1 time: 0.150011 Oct 12 22:55:34.025360 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3928/7207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:33 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:35.048809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-71c30ef0-4aee-4f5b-a72c-f4eaf4b5b17a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:35.049446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-71c30ef0-4aee-4f5b-a72c-f4eaf4b5b17a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:35.056347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c30ef0-4aee-4f5b-a72c-f4eaf4b5b17a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:35.056850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c30ef0-4aee-4f5b-a72c-f4eaf4b5b17a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:35.057306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c30ef0-4aee-4f5b-a72c-f4eaf4b5b17a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:35.058013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c30ef0-4aee-4f5b-a72c-f4eaf4b5b17a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:35.058487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c30ef0-4aee-4f5b-a72c-f4eaf4b5b17a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:35.058930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c30ef0-4aee-4f5b-a72c-f4eaf4b5b17a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:35.185090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-71c30ef0-4aee-4f5b-a72c-f4eaf4b5b17a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:35.193579 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-71c30ef0-4aee-4f5b-a72c-f4eaf4b5b17a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1681 microversion: 2.1 time: 0.148748 Oct 12 22:55:35.194159 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3280/7208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:35 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:36.217559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fc035152-a9a2-4425-ba9f-8cc7e26a4629 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:36.218182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fc035152-a9a2-4425-ba9f-8cc7e26a4629 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:36.225485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc035152-a9a2-4425-ba9f-8cc7e26a4629 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:36.225961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc035152-a9a2-4425-ba9f-8cc7e26a4629 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:36.226393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc035152-a9a2-4425-ba9f-8cc7e26a4629 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:36.227076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc035152-a9a2-4425-ba9f-8cc7e26a4629 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:36.227573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc035152-a9a2-4425-ba9f-8cc7e26a4629 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:36.227999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fc035152-a9a2-4425-ba9f-8cc7e26a4629 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:36.357043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fc035152-a9a2-4425-ba9f-8cc7e26a4629 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:36.365023 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fc035152-a9a2-4425-ba9f-8cc7e26a4629 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1681 microversion: 2.1 time: 0.151882 Oct 12 22:55:36.365635 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3929/7209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:36 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:37.388893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2a2515fc-085d-4c7f-a483-1748cfe8e2b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:37.389560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2a2515fc-085d-4c7f-a483-1748cfe8e2b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:37.397088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a2515fc-085d-4c7f-a483-1748cfe8e2b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:37.397589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a2515fc-085d-4c7f-a483-1748cfe8e2b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:37.398044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a2515fc-085d-4c7f-a483-1748cfe8e2b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:37.398753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a2515fc-085d-4c7f-a483-1748cfe8e2b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:37.399222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a2515fc-085d-4c7f-a483-1748cfe8e2b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:37.399692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2a2515fc-085d-4c7f-a483-1748cfe8e2b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:37.527209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2a2515fc-085d-4c7f-a483-1748cfe8e2b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:37.535061 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2a2515fc-085d-4c7f-a483-1748cfe8e2b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1681 microversion: 2.1 time: 0.150110 Oct 12 22:55:37.535666 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3281/7210] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:37 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:38.558277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-68639a37-b22d-418f-9d86-e91aecb74252 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:38.558899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-68639a37-b22d-418f-9d86-e91aecb74252 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:38.566135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68639a37-b22d-418f-9d86-e91aecb74252 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:38.566624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68639a37-b22d-418f-9d86-e91aecb74252 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:38.567059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68639a37-b22d-418f-9d86-e91aecb74252 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:38.567784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68639a37-b22d-418f-9d86-e91aecb74252 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:38.568241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68639a37-b22d-418f-9d86-e91aecb74252 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:38.568669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-68639a37-b22d-418f-9d86-e91aecb74252 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:38.703837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-68639a37-b22d-418f-9d86-e91aecb74252 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:38.712565 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-68639a37-b22d-418f-9d86-e91aecb74252 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1681 microversion: 2.1 time: 0.158139 Oct 12 22:55:38.713163 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3930/7211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:38 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:39.736406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-43635738-7aa9-4761-9c69-c3273d70845b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:39.737041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-43635738-7aa9-4761-9c69-c3273d70845b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:39.744598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43635738-7aa9-4761-9c69-c3273d70845b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:39.745094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43635738-7aa9-4761-9c69-c3273d70845b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:39.745549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43635738-7aa9-4761-9c69-c3273d70845b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:39.746257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43635738-7aa9-4761-9c69-c3273d70845b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:39.746726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43635738-7aa9-4761-9c69-c3273d70845b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:39.747167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-43635738-7aa9-4761-9c69-c3273d70845b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:39.880454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-43635738-7aa9-4761-9c69-c3273d70845b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:39.888194 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-43635738-7aa9-4761-9c69-c3273d70845b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1681 microversion: 2.1 time: 0.156153 Oct 12 22:55:39.888775 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3282/7212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:39 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:40.912745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9bc08f3b-7830-4694-8b6f-d09c3ff3a8b2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:40.913291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9bc08f3b-7830-4694-8b6f-d09c3ff3a8b2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:40.920157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9bc08f3b-7830-4694-8b6f-d09c3ff3a8b2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:40.920635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9bc08f3b-7830-4694-8b6f-d09c3ff3a8b2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:40.921068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9bc08f3b-7830-4694-8b6f-d09c3ff3a8b2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:40.921749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9bc08f3b-7830-4694-8b6f-d09c3ff3a8b2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:40.922198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9bc08f3b-7830-4694-8b6f-d09c3ff3a8b2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:40.922622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9bc08f3b-7830-4694-8b6f-d09c3ff3a8b2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:41.048493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9bc08f3b-7830-4694-8b6f-d09c3ff3a8b2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:41.056251 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9bc08f3b-7830-4694-8b6f-d09c3ff3a8b2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1681 microversion: 2.1 time: 0.148174 Oct 12 22:55:41.056831 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3931/7213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:40 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:42.079610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6ce6324b-b325-4541-bbb9-eda98f112fb5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:42.080243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6ce6324b-b325-4541-bbb9-eda98f112fb5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:42.087035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ce6324b-b325-4541-bbb9-eda98f112fb5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:42.087557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ce6324b-b325-4541-bbb9-eda98f112fb5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:42.088005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ce6324b-b325-4541-bbb9-eda98f112fb5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:42.088705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ce6324b-b325-4541-bbb9-eda98f112fb5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:42.089171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ce6324b-b325-4541-bbb9-eda98f112fb5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:42.089607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ce6324b-b325-4541-bbb9-eda98f112fb5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:42.218856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6ce6324b-b325-4541-bbb9-eda98f112fb5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:42.226593 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6ce6324b-b325-4541-bbb9-eda98f112fb5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1681 microversion: 2.1 time: 0.151029 Oct 12 22:55:42.227165 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3283/7214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:42 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:43.252275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e10ff44f-d853-4fa0-a55b-a3629ea1e7bd tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:43.252893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e10ff44f-d853-4fa0-a55b-a3629ea1e7bd tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:43.260255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e10ff44f-d853-4fa0-a55b-a3629ea1e7bd tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:43.260737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e10ff44f-d853-4fa0-a55b-a3629ea1e7bd tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:43.261175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e10ff44f-d853-4fa0-a55b-a3629ea1e7bd tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:43.261859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e10ff44f-d853-4fa0-a55b-a3629ea1e7bd tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:43.262310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e10ff44f-d853-4fa0-a55b-a3629ea1e7bd tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:43.262733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e10ff44f-d853-4fa0-a55b-a3629ea1e7bd tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:43.392455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e10ff44f-d853-4fa0-a55b-a3629ea1e7bd tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:43.400837 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e10ff44f-d853-4fa0-a55b-a3629ea1e7bd tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1681 microversion: 2.1 time: 0.152473 Oct 12 22:55:43.401413 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3932/7215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:43 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:44.423453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ba0c8c23-b798-4bc2-be99-56d2103ca3fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:44.424082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ba0c8c23-b798-4bc2-be99-56d2103ca3fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:44.430708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0c8c23-b798-4bc2-be99-56d2103ca3fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:44.431201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0c8c23-b798-4bc2-be99-56d2103ca3fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:44.431685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0c8c23-b798-4bc2-be99-56d2103ca3fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:44.432402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0c8c23-b798-4bc2-be99-56d2103ca3fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:44.432861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0c8c23-b798-4bc2-be99-56d2103ca3fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:44.433300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba0c8c23-b798-4bc2-be99-56d2103ca3fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:44.632672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba0c8c23-b798-4bc2-be99-56d2103ca3fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:44.642652 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ba0c8c23-b798-4bc2-be99-56d2103ca3fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1681 microversion: 2.1 time: 0.223268 Oct 12 22:55:44.643248 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3284/7216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:44 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1681 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:45.032989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-2e7d819b-8f0b-409f-85c2-8428decfb27d req-9c3878d6-73b2-408f-93a9-2aa917cd44c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4a03f0-5862-4c3e-9e20-c141d0c7f666", "name": "network-vif-unplugged", "status": "completed", "tag": "f7ba33a9-b14e-4c93-8fca-c97bb58318af"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:45.043596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2e7d819b-8f0b-409f-85c2-8428decfb27d req-9c3878d6-73b2-408f-93a9-2aa917cd44c6 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:45.044080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2e7d819b-8f0b-409f-85c2-8428decfb27d req-9c3878d6-73b2-408f-93a9-2aa917cd44c6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:45.044508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2e7d819b-8f0b-409f-85c2-8428decfb27d req-9c3878d6-73b2-408f-93a9-2aa917cd44c6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:45.057119 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-2e7d819b-8f0b-409f-85c2-8428decfb27d req-9c3878d6-73b2-408f-93a9-2aa917cd44c6 service nova] Creating event network-vif-unplugged:f7ba33a9-b14e-4c93-8fca-c97bb58318af for instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 on n-h2-861111-1 Oct 12 22:55:45.062546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-2e7d819b-8f0b-409f-85c2-8428decfb27d req-9c3878d6-73b2-408f-93a9-2aa917cd44c6 service nova] Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:55:45.074262 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-2e7d819b-8f0b-409f-85c2-8428decfb27d req-9c3878d6-73b2-408f-93a9-2aa917cd44c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044975 Oct 12 22:55:45.074896 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3933/7217] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:45.666550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cec1ad22-b470-4ec3-bf3f-99480f6a9e76 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:45.667186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cec1ad22-b470-4ec3-bf3f-99480f6a9e76 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:45.674327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cec1ad22-b470-4ec3-bf3f-99480f6a9e76 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:45.674841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cec1ad22-b470-4ec3-bf3f-99480f6a9e76 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:45.675326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cec1ad22-b470-4ec3-bf3f-99480f6a9e76 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:45.676054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cec1ad22-b470-4ec3-bf3f-99480f6a9e76 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:45.676536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cec1ad22-b470-4ec3-bf3f-99480f6a9e76 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:45.676985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cec1ad22-b470-4ec3-bf3f-99480f6a9e76 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:45.964617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cec1ad22-b470-4ec3-bf3f-99480f6a9e76 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:45.972312 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cec1ad22-b470-4ec3-bf3f-99480f6a9e76 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1680 microversion: 2.1 time: 0.309683 Oct 12 22:55:45.972886 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3285/7218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:45 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1680 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:46.998853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a3714766-4bdb-44b6-b796-90ce8208f194 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:46.999655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a3714766-4bdb-44b6-b796-90ce8208f194 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:47.006223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3714766-4bdb-44b6-b796-90ce8208f194 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:47.006712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3714766-4bdb-44b6-b796-90ce8208f194 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:47.007159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3714766-4bdb-44b6-b796-90ce8208f194 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:47.007875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3714766-4bdb-44b6-b796-90ce8208f194 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:47.008338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3714766-4bdb-44b6-b796-90ce8208f194 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:47.008776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3714766-4bdb-44b6-b796-90ce8208f194 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:47.092420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-72cf8a25-9763-410a-bb0a-c9b6e4642fd3 req-c4588b47-0493-4da6-90ca-a903982bc947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4a03f0-5862-4c3e-9e20-c141d0c7f666", "tag": "f7ba33a9-b14e-4c93-8fca-c97bb58318af"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:47.103176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-72cf8a25-9763-410a-bb0a-c9b6e4642fd3 req-c4588b47-0493-4da6-90ca-a903982bc947 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:47.103712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-72cf8a25-9763-410a-bb0a-c9b6e4642fd3 req-c4588b47-0493-4da6-90ca-a903982bc947 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:47.104156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-72cf8a25-9763-410a-bb0a-c9b6e4642fd3 req-c4588b47-0493-4da6-90ca-a903982bc947 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:47.116896 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-72cf8a25-9763-410a-bb0a-c9b6e4642fd3 req-c4588b47-0493-4da6-90ca-a903982bc947 service nova] Creating event network-changed:f7ba33a9-b14e-4c93-8fca-c97bb58318af for instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 on n-h2-861111-1 Oct 12 22:55:47.122196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-72cf8a25-9763-410a-bb0a-c9b6e4642fd3 req-c4588b47-0493-4da6-90ca-a903982bc947 service nova] Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:55:47.133140 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-72cf8a25-9763-410a-bb0a-c9b6e4642fd3 req-c4588b47-0493-4da6-90ca-a903982bc947 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044422 Oct 12 22:55:47.133745 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3286/7219] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:55:47.197773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a3714766-4bdb-44b6-b796-90ce8208f194 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:47.205509 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a3714766-4bdb-44b6-b796-90ce8208f194 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1678 microversion: 2.1 time: 0.212432 Oct 12 22:55:47.206088 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3934/7220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:46 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:48.231155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb7bd285-8b18-419a-a59e-c589421c450e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:48.231899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eb7bd285-8b18-419a-a59e-c589421c450e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:48.238457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb7bd285-8b18-419a-a59e-c589421c450e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:48.238954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb7bd285-8b18-419a-a59e-c589421c450e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:48.239433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb7bd285-8b18-419a-a59e-c589421c450e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:48.240637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb7bd285-8b18-419a-a59e-c589421c450e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:48.241099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb7bd285-8b18-419a-a59e-c589421c450e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:48.241532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb7bd285-8b18-419a-a59e-c589421c450e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:48.702242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eb7bd285-8b18-419a-a59e-c589421c450e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:48.710072 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb7bd285-8b18-419a-a59e-c589421c450e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1678 microversion: 2.1 time: 0.484899 Oct 12 22:55:48.710645 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3287/7221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:48 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1678 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:49.736344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8f998f0b-fe78-4df9-aa1e-cdf7246cd381 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:49.736884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8f998f0b-fe78-4df9-aa1e-cdf7246cd381 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:49.744143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f998f0b-fe78-4df9-aa1e-cdf7246cd381 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:49.744624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f998f0b-fe78-4df9-aa1e-cdf7246cd381 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:49.745056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f998f0b-fe78-4df9-aa1e-cdf7246cd381 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:49.745745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f998f0b-fe78-4df9-aa1e-cdf7246cd381 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:49.746197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f998f0b-fe78-4df9-aa1e-cdf7246cd381 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:49.746618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f998f0b-fe78-4df9-aa1e-cdf7246cd381 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:49.878576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8f998f0b-fe78-4df9-aa1e-cdf7246cd381 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:49.886619 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8f998f0b-fe78-4df9-aa1e-cdf7246cd381 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1675 microversion: 2.1 time: 0.155932 Oct 12 22:55:49.887197 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3935/7222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:49 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:49.909484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4ff5143a-2e4b-4b11-90ad-f473c136a16c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:49.910157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4ff5143a-2e4b-4b11-90ad-f473c136a16c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:49.917829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ff5143a-2e4b-4b11-90ad-f473c136a16c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:49.918406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ff5143a-2e4b-4b11-90ad-f473c136a16c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:49.918925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ff5143a-2e4b-4b11-90ad-f473c136a16c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:49.919744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ff5143a-2e4b-4b11-90ad-f473c136a16c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:49.920274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ff5143a-2e4b-4b11-90ad-f473c136a16c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:49.920803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4ff5143a-2e4b-4b11-90ad-f473c136a16c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:49.983887 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4ff5143a-2e4b-4b11-90ad-f473c136a16c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "POST /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666/action" status: 204 len: 0 microversion: 2.1 time: 0.078159 Oct 12 22:55:49.984845 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3288/7223] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:55:49 2022] POST /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:55:49.993815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4e59018b-fd8b-48e3-bf92-3484068ae3b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:49.994713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4e59018b-fd8b-48e3-bf92-3484068ae3b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:50.002030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e59018b-fd8b-48e3-bf92-3484068ae3b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:50.002625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e59018b-fd8b-48e3-bf92-3484068ae3b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:50.003123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e59018b-fd8b-48e3-bf92-3484068ae3b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:50.003945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e59018b-fd8b-48e3-bf92-3484068ae3b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:50.004601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e59018b-fd8b-48e3-bf92-3484068ae3b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:50.005057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4e59018b-fd8b-48e3-bf92-3484068ae3b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:50.144457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4e59018b-fd8b-48e3-bf92-3484068ae3b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:50.152230 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4e59018b-fd8b-48e3-bf92-3484068ae3b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1675 microversion: 2.1 time: 0.163215 Oct 12 22:55:50.152821 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3936/7224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:49 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:51.176619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af47f0bb-b003-4f4a-a3af-2f6d3c735e9e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:51.177762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-af47f0bb-b003-4f4a-a3af-2f6d3c735e9e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:51.184734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af47f0bb-b003-4f4a-a3af-2f6d3c735e9e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:51.185230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af47f0bb-b003-4f4a-a3af-2f6d3c735e9e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:51.185686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af47f0bb-b003-4f4a-a3af-2f6d3c735e9e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:51.186382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af47f0bb-b003-4f4a-a3af-2f6d3c735e9e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:51.186849 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af47f0bb-b003-4f4a-a3af-2f6d3c735e9e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:51.187309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af47f0bb-b003-4f4a-a3af-2f6d3c735e9e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:51.328593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-af47f0bb-b003-4f4a-a3af-2f6d3c735e9e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:51.330967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:51.337825 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-af47f0bb-b003-4f4a-a3af-2f6d3c735e9e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1675 microversion: 2.1 time: 0.165490 Oct 12 22:55:51.341548 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3289/7225] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:51 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:51.910663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-71724671-b56b-4f4b-a1ce-1e6d42b0411a req-4a3dc63f-6cfe-4988-b321-8a955940f451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4a03f0-5862-4c3e-9e20-c141d0c7f666", "name": "network-vif-plugged", "status": "completed", "tag": "f7ba33a9-b14e-4c93-8fca-c97bb58318af"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:51.921953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-71724671-b56b-4f4b-a1ce-1e6d42b0411a req-4a3dc63f-6cfe-4988-b321-8a955940f451 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:51.922443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-71724671-b56b-4f4b-a1ce-1e6d42b0411a req-4a3dc63f-6cfe-4988-b321-8a955940f451 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:51.922873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-71724671-b56b-4f4b-a1ce-1e6d42b0411a req-4a3dc63f-6cfe-4988-b321-8a955940f451 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:51.934004 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-71724671-b56b-4f4b-a1ce-1e6d42b0411a req-4a3dc63f-6cfe-4988-b321-8a955940f451 service nova] Creating event network-vif-plugged:f7ba33a9-b14e-4c93-8fca-c97bb58318af for instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 on n-h2-861111-1 Oct 12 22:55:51.938849 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-71724671-b56b-4f4b-a1ce-1e6d42b0411a req-4a3dc63f-6cfe-4988-b321-8a955940f451 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031912 Oct 12 22:55:51.939492 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3937/7226] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:52.362824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a5ad1859-c4c1-4093-aebf-4b0451a8fdf8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:52.363500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a5ad1859-c4c1-4093-aebf-4b0451a8fdf8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:52.370873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ad1859-c4c1-4093-aebf-4b0451a8fdf8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:52.371408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ad1859-c4c1-4093-aebf-4b0451a8fdf8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:52.371862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ad1859-c4c1-4093-aebf-4b0451a8fdf8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:52.372574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ad1859-c4c1-4093-aebf-4b0451a8fdf8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:52.373044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ad1859-c4c1-4093-aebf-4b0451a8fdf8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:52.373478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ad1859-c4c1-4093-aebf-4b0451a8fdf8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:52.500864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a5ad1859-c4c1-4093-aebf-4b0451a8fdf8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:52.510769 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a5ad1859-c4c1-4093-aebf-4b0451a8fdf8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1667 microversion: 2.1 time: 0.152806 Oct 12 22:55:52.511544 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3290/7227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:52 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:52.535218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6af16ab2-a55d-4b68-aa75-bdaf02ba5815 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:52.535940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6af16ab2-a55d-4b68-aa75-bdaf02ba5815 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:52.542245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6af16ab2-a55d-4b68-aa75-bdaf02ba5815 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:52.542737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6af16ab2-a55d-4b68-aa75-bdaf02ba5815 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:52.543230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6af16ab2-a55d-4b68-aa75-bdaf02ba5815 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:52.543927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6af16ab2-a55d-4b68-aa75-bdaf02ba5815 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:52.544386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6af16ab2-a55d-4b68-aa75-bdaf02ba5815 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:52.544813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6af16ab2-a55d-4b68-aa75-bdaf02ba5815 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:52.672690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6af16ab2-a55d-4b68-aa75-bdaf02ba5815 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:52.680973 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6af16ab2-a55d-4b68-aa75-bdaf02ba5815 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1667 microversion: 2.1 time: 0.150042 Oct 12 22:55:52.681563 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3938/7228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:52 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:52.703666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-30f51d5f-41a4-486c-809a-8f8fe47188d8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:52.704288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-30f51d5f-41a4-486c-809a-8f8fe47188d8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:52.710895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30f51d5f-41a4-486c-809a-8f8fe47188d8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:52.711426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30f51d5f-41a4-486c-809a-8f8fe47188d8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:52.711876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30f51d5f-41a4-486c-809a-8f8fe47188d8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:52.712578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30f51d5f-41a4-486c-809a-8f8fe47188d8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:52.713038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30f51d5f-41a4-486c-809a-8f8fe47188d8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:52.713478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30f51d5f-41a4-486c-809a-8f8fe47188d8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:52.843629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-30f51d5f-41a4-486c-809a-8f8fe47188d8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:52.851832 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-30f51d5f-41a4-486c-809a-8f8fe47188d8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1667 microversion: 2.1 time: 0.152009 Oct 12 22:55:52.852429 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3291/7229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:52 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1667 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:52.874838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f3ca5014-f356-4a84-8fae-0c7a66970e53 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:52.875294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f3ca5014-f356-4a84-8fae-0c7a66970e53 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:52.881221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3ca5014-f356-4a84-8fae-0c7a66970e53 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:52.881729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3ca5014-f356-4a84-8fae-0c7a66970e53 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:52.882165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3ca5014-f356-4a84-8fae-0c7a66970e53 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:52.882849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3ca5014-f356-4a84-8fae-0c7a66970e53 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:52.883327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3ca5014-f356-4a84-8fae-0c7a66970e53 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:52.883761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3ca5014-f356-4a84-8fae-0c7a66970e53 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:52.887743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:52.909112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f3ca5014-f356-4a84-8fae-0c7a66970e53 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:55:52.982371 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f3ca5014-f356-4a84-8fae-0c7a66970e53 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 204 len: 0 microversion: 2.1 time: 0.111167 Oct 12 22:55:52.983065 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3939/7230] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:55:52 2022] DELETE /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:55:52.994218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-953e2413-236f-438e-8cfe-c77d0e7bdc55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:52.994852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-953e2413-236f-438e-8cfe-c77d0e7bdc55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:53.000988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-953e2413-236f-438e-8cfe-c77d0e7bdc55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:53.001496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-953e2413-236f-438e-8cfe-c77d0e7bdc55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:53.001987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-953e2413-236f-438e-8cfe-c77d0e7bdc55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:53.002705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-953e2413-236f-438e-8cfe-c77d0e7bdc55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:53.003179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-953e2413-236f-438e-8cfe-c77d0e7bdc55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:53.003674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-953e2413-236f-438e-8cfe-c77d0e7bdc55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:53.131959 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-953e2413-236f-438e-8cfe-c77d0e7bdc55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:53.139803 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-953e2413-236f-438e-8cfe-c77d0e7bdc55 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1673 microversion: 2.1 time: 0.151894 Oct 12 22:55:53.140372 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3292/7231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:52 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:54.164265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-baffc57a-df9d-44fc-b5d1-ea1b2df5e731 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:54.164896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-baffc57a-df9d-44fc-b5d1-ea1b2df5e731 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:54.171662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-baffc57a-df9d-44fc-b5d1-ea1b2df5e731 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:54.172151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-baffc57a-df9d-44fc-b5d1-ea1b2df5e731 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:54.172589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-baffc57a-df9d-44fc-b5d1-ea1b2df5e731 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:54.173283 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-baffc57a-df9d-44fc-b5d1-ea1b2df5e731 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:54.173738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-baffc57a-df9d-44fc-b5d1-ea1b2df5e731 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:54.174166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-baffc57a-df9d-44fc-b5d1-ea1b2df5e731 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:54.309516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-baffc57a-df9d-44fc-b5d1-ea1b2df5e731 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:54.317941 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-baffc57a-df9d-44fc-b5d1-ea1b2df5e731 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 200 len: 1673 microversion: 2.1 time: 0.158610 Oct 12 22:55:54.320227 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3940/7232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:54 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:55.092506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-1d69acde-c5ed-4fd1-a634-b8e45d3a480a req-2158dcc1-cc01-4525-aa69-aeede4dc3e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4a03f0-5862-4c3e-9e20-c141d0c7f666", "name": "network-vif-deleted", "tag": "f7ba33a9-b14e-4c93-8fca-c97bb58318af"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:55.101836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=39 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:55.108697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1d69acde-c5ed-4fd1-a634-b8e45d3a480a req-2158dcc1-cc01-4525-aa69-aeede4dc3e2e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:55.109808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1d69acde-c5ed-4fd1-a634-b8e45d3a480a req-2158dcc1-cc01-4525-aa69-aeede4dc3e2e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:55.110570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1d69acde-c5ed-4fd1-a634-b8e45d3a480a req-2158dcc1-cc01-4525-aa69-aeede4dc3e2e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:55.126355 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-1d69acde-c5ed-4fd1-a634-b8e45d3a480a req-2158dcc1-cc01-4525-aa69-aeede4dc3e2e service nova] Creating event network-vif-deleted:f7ba33a9-b14e-4c93-8fca-c97bb58318af for instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 on n-h2-861111-1 Oct 12 22:55:55.132503 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-1d69acde-c5ed-4fd1-a634-b8e45d3a480a req-2158dcc1-cc01-4525-aa69-aeede4dc3e2e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043943 Oct 12 22:55:55.133766 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3293/7233] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:55.342781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5782f7fc-dabc-4e95-93f8-d93014a37ee1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:55.343376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5782f7fc-dabc-4e95-93f8-d93014a37ee1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:55.346136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:55.352409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5782f7fc-dabc-4e95-93f8-d93014a37ee1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:55.352902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5782f7fc-dabc-4e95-93f8-d93014a37ee1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:55.353342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5782f7fc-dabc-4e95-93f8-d93014a37ee1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:55.354051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5782f7fc-dabc-4e95-93f8-d93014a37ee1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:55.354504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5782f7fc-dabc-4e95-93f8-d93014a37ee1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:55.354978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5782f7fc-dabc-4e95-93f8-d93014a37ee1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:55.369828 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-5782f7fc-dabc-4e95-93f8-d93014a37ee1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] HTTP exception thrown: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5782f7fc-dabc-4e95-93f8-d93014a37ee1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Request method failure captured: Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 HTTP/1.1 Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0WrKQiBfy0XSANASA5fCFbD4GR8tuMwOAMN25efH-T8eGJGJ9GqINSx71zrrS3STQYGkkMmRKLW9d4tVwDR4SqLAQg3JTIXjTWQBGkushtLJhuadXQwH02STvq4BQuhp2LfpRdQBY1OcY_j-rJ13jlHiZrptRT0JEkKLcabSXJo4D8 Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e44a4f6e4faa450b9850cd5bfbe53d59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerActionsTestJSON-486969938 Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerActionsTestJSON-486969938-project Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: dc38342011d04f98aa06f9474fe6f402 Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerActionsTestJSON-486969938-project Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '8c4a03f0-5862-4c3e-9e20-c141d0c7f666'} Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:55.371522 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:55:55.375606 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:55.375606 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:55.375606 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:55.375606 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:55:55.375606 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:55:55.375606 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 22:55:55.375606 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:55:55.375606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5782f7fc-dabc-4e95-93f8-d93014a37ee1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Returning 404 to user: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:55:55.375606 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5782f7fc-dabc-4e95-93f8-d93014a37ee1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 404 len: 111 microversion: 2.1 time: 0.034267 Oct 12 22:55:55.375606 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3941/7234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:55 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:55:55.385536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-92fcd0d2-d49c-42ef-9b93-1b9a629a3bc9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:55.386255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-92fcd0d2-d49c-42ef-9b93-1b9a629a3bc9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:55.392461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92fcd0d2-d49c-42ef-9b93-1b9a629a3bc9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:55.392962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92fcd0d2-d49c-42ef-9b93-1b9a629a3bc9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:55.393414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92fcd0d2-d49c-42ef-9b93-1b9a629a3bc9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:55.394124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92fcd0d2-d49c-42ef-9b93-1b9a629a3bc9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:55.394592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92fcd0d2-d49c-42ef-9b93-1b9a629a3bc9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:55.395035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-92fcd0d2-d49c-42ef-9b93-1b9a629a3bc9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:55.408392 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-92fcd0d2-d49c-42ef-9b93-1b9a629a3bc9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] HTTP exception thrown: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-92fcd0d2-d49c-42ef-9b93-1b9a629a3bc9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Request method failure captured: Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 HTTP/1.1 Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0WrKQiBfy0XSANASA5fCFbD4GR8tuMwOAMN25efH-T8eGJGJ9GqINSx71zrrS3STQYGkkMmRKLW9d4tVwDR4SqLAQg3JTIXjTWQBGkushtLJhuadXQwH02STvq4BQuhp2LfpRdQBY1OcY_j-rJ13jlHiZrptRT0JEkKLcabSXJo4D8 Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e44a4f6e4faa450b9850cd5bfbe53d59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerActionsTestJSON-486969938 Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerActionsTestJSON-486969938-project Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: dc38342011d04f98aa06f9474fe6f402 Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerActionsTestJSON-486969938-project Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '8c4a03f0-5862-4c3e-9e20-c141d0c7f666'} Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:55.410070 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:55:55.414519 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:55.414519 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:55.414519 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:55.414519 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:55:55.414519 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:55:55.414519 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 22:55:55.414519 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:55:55.414519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-92fcd0d2-d49c-42ef-9b93-1b9a629a3bc9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Returning 404 to user: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:55:55.414519 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-92fcd0d2-d49c-42ef-9b93-1b9a629a3bc9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 404 len: 111 microversion: 2.1 time: 0.030218 Oct 12 22:55:55.414519 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3294/7235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:55 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:55:55.460739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2115672180", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "9e6b601d-4bd2-489e-9269-4cf57f84b9f1"}], "security_groups": [{"name": "tempest-securitygroup--91822578"}], "key_name": "tempest-keypair-1203075025", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:55.566654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] validate_networks() for [('9e6b601d-4bd2-489e-9269-4cf57f84b9f1', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:55:55.946532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:55:55.946956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:55:55.947600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:55:55.948011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:55:55.948424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:55:55.957480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:55.957965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:55.960900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:55.961727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:55.962197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:55.962627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:55.980199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Getting quotas for project e44a4f6e4faa450b9850cd5bfbe53d59. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:55:55.985855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Getting quotas for user dc38342011d04f98aa06f9474fe6f402 and project e44a4f6e4faa450b9850cd5bfbe53d59. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:55:55.998641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:55:56.000972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:55:56.056351 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fa8b9d49-d4b9-4cab-b784-70761894dd11 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.599448 Oct 12 22:55:56.056993 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3942/7236] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:55:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:55:56.068949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1b9e876c-9a2d-4f5c-99d8-ee72607b6867 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:56.069580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1b9e876c-9a2d-4f5c-99d8-ee72607b6867 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:56.128041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1b9e876c-9a2d-4f5c-99d8-ee72607b6867 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:56.138666 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1b9e876c-9a2d-4f5c-99d8-ee72607b6867 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1239 microversion: 2.1 time: 0.074024 Oct 12 22:55:56.147610 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3295/7237] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:56 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:57.162142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-89a63420-3286-4a49-8c33-a30637306e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:57.162783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-89a63420-3286-4a49-8c33-a30637306e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:57.169680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89a63420-3286-4a49-8c33-a30637306e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:57.170163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89a63420-3286-4a49-8c33-a30637306e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:57.170593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89a63420-3286-4a49-8c33-a30637306e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:57.171295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89a63420-3286-4a49-8c33-a30637306e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:57.171748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89a63420-3286-4a49-8c33-a30637306e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:57.172169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-89a63420-3286-4a49-8c33-a30637306e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:57.236622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-89a63420-3286-4a49-8c33-a30637306e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:57.244962 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-89a63420-3286-4a49-8c33-a30637306e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1291 microversion: 2.1 time: 0.086943 Oct 12 22:55:57.245531 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3943/7238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:57 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1291 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:58.269993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-576611b4-b622-471e-af8c-0e9ecea664c0 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:58.270628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-576611b4-b622-471e-af8c-0e9ecea664c0 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:58.278260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-576611b4-b622-471e-af8c-0e9ecea664c0 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:58.278768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-576611b4-b622-471e-af8c-0e9ecea664c0 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:58.279223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-576611b4-b622-471e-af8c-0e9ecea664c0 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:58.280015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-576611b4-b622-471e-af8c-0e9ecea664c0 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:58.280532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-576611b4-b622-471e-af8c-0e9ecea664c0 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:58.280978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-576611b4-b622-471e-af8c-0e9ecea664c0 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:58.532153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-576611b4-b622-471e-af8c-0e9ecea664c0 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:58.541173 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-576611b4-b622-471e-af8c-0e9ecea664c0 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1363 microversion: 2.1 time: 0.274175 Oct 12 22:55:58.541772 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3296/7239] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:58 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:59.002694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-168b43e5-de6c-447e-b452-c4d71d927752 req-d1534b9e-27e4-432d-8c2e-56e0354a6c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6347f3-f269-4c9b-aea9-5c81bc71d0a8", "tag": "6098fa41-5c85-48c4-9967-41883bcdffe6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:59.016501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-168b43e5-de6c-447e-b452-c4d71d927752 req-d1534b9e-27e4-432d-8c2e-56e0354a6c60 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:59.016981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-168b43e5-de6c-447e-b452-c4d71d927752 req-d1534b9e-27e4-432d-8c2e-56e0354a6c60 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:59.017599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-168b43e5-de6c-447e-b452-c4d71d927752 req-d1534b9e-27e4-432d-8c2e-56e0354a6c60 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:59.029089 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-168b43e5-de6c-447e-b452-c4d71d927752 req-d1534b9e-27e4-432d-8c2e-56e0354a6c60 service nova] Creating event network-changed:6098fa41-5c85-48c4-9967-41883bcdffe6 for instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 on n-h1-861111-1 Oct 12 22:55:59.033848 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-168b43e5-de6c-447e-b452-c4d71d927752 req-d1534b9e-27e4-432d-8c2e-56e0354a6c60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036009 Oct 12 22:55:59.034535 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3944/7240] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:59.565715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5fdd2093-144b-4b46-9fa8-858e551598db tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:59.566346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5fdd2093-144b-4b46-9fa8-858e551598db tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:59.573417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fdd2093-144b-4b46-9fa8-858e551598db tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:59.573944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fdd2093-144b-4b46-9fa8-858e551598db tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:59.574391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fdd2093-144b-4b46-9fa8-858e551598db tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:59.575101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fdd2093-144b-4b46-9fa8-858e551598db tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:59.576492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fdd2093-144b-4b46-9fa8-858e551598db tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:59.576937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5fdd2093-144b-4b46-9fa8-858e551598db tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:59.706934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5fdd2093-144b-4b46-9fa8-858e551598db tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:59.715153 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5fdd2093-144b-4b46-9fa8-858e551598db tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1363 microversion: 2.1 time: 0.153408 Oct 12 22:55:59.715748 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3297/7241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:59 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:00.740090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-be9660de-6de4-410b-aeec-2039e5b495d1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:00.740731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-be9660de-6de4-410b-aeec-2039e5b495d1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:00.746763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be9660de-6de4-410b-aeec-2039e5b495d1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:00.747264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be9660de-6de4-410b-aeec-2039e5b495d1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:00.747714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be9660de-6de4-410b-aeec-2039e5b495d1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:00.748403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be9660de-6de4-410b-aeec-2039e5b495d1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:00.748851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be9660de-6de4-410b-aeec-2039e5b495d1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:00.749276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-be9660de-6de4-410b-aeec-2039e5b495d1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:00.890612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-be9660de-6de4-410b-aeec-2039e5b495d1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:00.898893 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-be9660de-6de4-410b-aeec-2039e5b495d1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1363 microversion: 2.1 time: 0.164181 Oct 12 22:56:00.899502 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3945/7242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:00 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:01.922782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4e5a14aa-fefa-4f42-b73e-3675dc03b685 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:01.923454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4e5a14aa-fefa-4f42-b73e-3675dc03b685 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:01.930887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e5a14aa-fefa-4f42-b73e-3675dc03b685 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:01.931416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e5a14aa-fefa-4f42-b73e-3675dc03b685 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:01.931872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e5a14aa-fefa-4f42-b73e-3675dc03b685 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:01.932613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e5a14aa-fefa-4f42-b73e-3675dc03b685 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:01.933102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e5a14aa-fefa-4f42-b73e-3675dc03b685 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:01.933540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e5a14aa-fefa-4f42-b73e-3675dc03b685 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:02.066933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4e5a14aa-fefa-4f42-b73e-3675dc03b685 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:02.074817 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4e5a14aa-fefa-4f42-b73e-3675dc03b685 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1363 microversion: 2.1 time: 0.155943 Oct 12 22:56:02.075431 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3298/7243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:01 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:03.097567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a3db3bc2-5bbb-4031-895e-e4a0159ef1e3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:03.098126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a3db3bc2-5bbb-4031-895e-e4a0159ef1e3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:03.104908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3db3bc2-5bbb-4031-895e-e4a0159ef1e3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:03.105397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3db3bc2-5bbb-4031-895e-e4a0159ef1e3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:03.105836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3db3bc2-5bbb-4031-895e-e4a0159ef1e3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:03.106536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3db3bc2-5bbb-4031-895e-e4a0159ef1e3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:03.106994 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3db3bc2-5bbb-4031-895e-e4a0159ef1e3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:03.107468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3db3bc2-5bbb-4031-895e-e4a0159ef1e3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:03.237586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a3db3bc2-5bbb-4031-895e-e4a0159ef1e3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:03.245622 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a3db3bc2-5bbb-4031-895e-e4a0159ef1e3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1363 microversion: 2.1 time: 0.152093 Oct 12 22:56:03.246197 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3946/7244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:03 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:04.270209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6a8def44-e529-4f60-915e-aa9873dea93b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:04.270815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6a8def44-e529-4f60-915e-aa9873dea93b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:04.278448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a8def44-e529-4f60-915e-aa9873dea93b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:04.278949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a8def44-e529-4f60-915e-aa9873dea93b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:04.279429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a8def44-e529-4f60-915e-aa9873dea93b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:04.280141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a8def44-e529-4f60-915e-aa9873dea93b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:04.280754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a8def44-e529-4f60-915e-aa9873dea93b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:04.281218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a8def44-e529-4f60-915e-aa9873dea93b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:04.413083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6a8def44-e529-4f60-915e-aa9873dea93b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:04.420920 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6a8def44-e529-4f60-915e-aa9873dea93b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1363 microversion: 2.1 time: 0.154765 Oct 12 22:56:04.421720 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3299/7245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:04 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:04.471348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d5466765-97e4-45ed-a9fe-6b8b3f6ec59d req-9d80b802-a673-4c4a-af0b-d4856d3442ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6347f3-f269-4c9b-aea9-5c81bc71d0a8", "name": "network-vif-plugged", "status": "completed", "tag": "6098fa41-5c85-48c4-9967-41883bcdffe6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:04.481588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d5466765-97e4-45ed-a9fe-6b8b3f6ec59d req-9d80b802-a673-4c4a-af0b-d4856d3442ba service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:04.482869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d5466765-97e4-45ed-a9fe-6b8b3f6ec59d req-9d80b802-a673-4c4a-af0b-d4856d3442ba service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:04.483362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d5466765-97e4-45ed-a9fe-6b8b3f6ec59d req-9d80b802-a673-4c4a-af0b-d4856d3442ba service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:04.495717 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d5466765-97e4-45ed-a9fe-6b8b3f6ec59d req-9d80b802-a673-4c4a-af0b-d4856d3442ba service nova] Creating event network-vif-plugged:6098fa41-5c85-48c4-9967-41883bcdffe6 for instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 on n-h1-861111-1 Oct 12 22:56:04.500794 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d5466765-97e4-45ed-a9fe-6b8b3f6ec59d req-9d80b802-a673-4c4a-af0b-d4856d3442ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033811 Oct 12 22:56:04.501381 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3947/7246] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:05.444880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f0325fbc-74cb-48bb-a08d-1a3d357f5e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:05.445511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f0325fbc-74cb-48bb-a08d-1a3d357f5e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:05.452365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0325fbc-74cb-48bb-a08d-1a3d357f5e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:05.452867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0325fbc-74cb-48bb-a08d-1a3d357f5e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:05.453325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0325fbc-74cb-48bb-a08d-1a3d357f5e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:05.454031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0325fbc-74cb-48bb-a08d-1a3d357f5e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:05.454503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0325fbc-74cb-48bb-a08d-1a3d357f5e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:05.454946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0325fbc-74cb-48bb-a08d-1a3d357f5e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:05.588044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f0325fbc-74cb-48bb-a08d-1a3d357f5e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:05.595745 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f0325fbc-74cb-48bb-a08d-1a3d357f5e42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1363 microversion: 2.1 time: 0.154787 Oct 12 22:56:05.596316 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3300/7247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:05 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:06.620873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-60d9d895-4208-4798-bee0-7fca78008554 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:06.621570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-60d9d895-4208-4798-bee0-7fca78008554 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:06.624367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:06.625028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:06.631540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d9d895-4208-4798-bee0-7fca78008554 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:06.632059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d9d895-4208-4798-bee0-7fca78008554 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:06.632502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d9d895-4208-4798-bee0-7fca78008554 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:06.633219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d9d895-4208-4798-bee0-7fca78008554 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:06.633677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d9d895-4208-4798-bee0-7fca78008554 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:06.634107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d9d895-4208-4798-bee0-7fca78008554 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:06.761353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-60d9d895-4208-4798-bee0-7fca78008554 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:06.769174 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-60d9d895-4208-4798-bee0-7fca78008554 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1549 microversion: 2.1 time: 0.152510 Oct 12 22:56:06.769751 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3948/7248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:06 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:06.793748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-73f0e771-d545-483e-86de-8884d2e57653 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:06.794267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-73f0e771-d545-483e-86de-8884d2e57653 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:06.796266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:06.802189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73f0e771-d545-483e-86de-8884d2e57653 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:06.802688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73f0e771-d545-483e-86de-8884d2e57653 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:06.803141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73f0e771-d545-483e-86de-8884d2e57653 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:06.803878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73f0e771-d545-483e-86de-8884d2e57653 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:06.804346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73f0e771-d545-483e-86de-8884d2e57653 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:06.804792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73f0e771-d545-483e-86de-8884d2e57653 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:06.880032 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-73f0e771-d545-483e-86de-8884d2e57653 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090207 Oct 12 22:56:06.880644 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3301/7249] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:56:06 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:08.116661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f87dcf36-f476-4695-a429-7d1e289af2d2 req-f5bf7bc1-3b75-4eb2-ab5f-4e75850a7bba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6347f3-f269-4c9b-aea9-5c81bc71d0a8", "tag": "6098fa41-5c85-48c4-9967-41883bcdffe6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:08.126921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f87dcf36-f476-4695-a429-7d1e289af2d2 req-f5bf7bc1-3b75-4eb2-ab5f-4e75850a7bba service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:08.127448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f87dcf36-f476-4695-a429-7d1e289af2d2 req-f5bf7bc1-3b75-4eb2-ab5f-4e75850a7bba service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:08.127889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f87dcf36-f476-4695-a429-7d1e289af2d2 req-f5bf7bc1-3b75-4eb2-ab5f-4e75850a7bba service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:08.138716 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f87dcf36-f476-4695-a429-7d1e289af2d2 req-f5bf7bc1-3b75-4eb2-ab5f-4e75850a7bba service nova] Creating event network-changed:6098fa41-5c85-48c4-9967-41883bcdffe6 for instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 on n-h1-861111-1 Oct 12 22:56:08.144547 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f87dcf36-f476-4695-a429-7d1e289af2d2 req-f5bf7bc1-3b75-4eb2-ab5f-4e75850a7bba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032325 Oct 12 22:56:08.145362 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3949/7250] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:41.284648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=19 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:41.285491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=57 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:41.290216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6ac62f1b-8c93-4a28-9ba1-f32b698e59cb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:41.297019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ac62f1b-8c93-4a28-9ba1-f32b698e59cb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:41.297521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ac62f1b-8c93-4a28-9ba1-f32b698e59cb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:41.297978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6ac62f1b-8c93-4a28-9ba1-f32b698e59cb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:41.319921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6ac62f1b-8c93-4a28-9ba1-f32b698e59cb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Going to try to stop instance {{(pid=120452) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 22:56:41.361747 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6ac62f1b-8c93-4a28-9ba1-f32b698e59cb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "POST /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8/action" status: 202 len: 0 microversion: 2.1 time: 0.078877 Oct 12 22:56:41.362538 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3302/7251] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:56:41 2022] POST /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:56:41.370737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:41.371529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:41.375853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6f3728a1-0a4b-42cc-904f-8ecdcb31f5c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:41.376678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6f3728a1-0a4b-42cc-904f-8ecdcb31f5c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:41.387036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f3728a1-0a4b-42cc-904f-8ecdcb31f5c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:41.387553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f3728a1-0a4b-42cc-904f-8ecdcb31f5c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:41.387996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f3728a1-0a4b-42cc-904f-8ecdcb31f5c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:41.388679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f3728a1-0a4b-42cc-904f-8ecdcb31f5c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:41.389126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f3728a1-0a4b-42cc-904f-8ecdcb31f5c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:41.389548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f3728a1-0a4b-42cc-904f-8ecdcb31f5c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:41.525394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6f3728a1-0a4b-42cc-904f-8ecdcb31f5c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:41.533468 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6f3728a1-0a4b-42cc-904f-8ecdcb31f5c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1677 microversion: 2.1 time: 0.166555 Oct 12 22:56:41.534055 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3950/7252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:41 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:42.558815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ef8f2960-5c42-4f40-bfc7-02f10c239459 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:42.559572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ef8f2960-5c42-4f40-bfc7-02f10c239459 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:42.565744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef8f2960-5c42-4f40-bfc7-02f10c239459 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:42.566249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef8f2960-5c42-4f40-bfc7-02f10c239459 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:42.566698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef8f2960-5c42-4f40-bfc7-02f10c239459 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:42.567425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef8f2960-5c42-4f40-bfc7-02f10c239459 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:42.567895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef8f2960-5c42-4f40-bfc7-02f10c239459 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:42.568327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef8f2960-5c42-4f40-bfc7-02f10c239459 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:42.701408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ef8f2960-5c42-4f40-bfc7-02f10c239459 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:42.709185 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ef8f2960-5c42-4f40-bfc7-02f10c239459 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1677 microversion: 2.1 time: 0.155504 Oct 12 22:56:42.709773 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3303/7253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:42 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:43.733040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-37538e14-69c8-4562-86af-9cf53c119d2b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:43.733651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-37538e14-69c8-4562-86af-9cf53c119d2b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:43.740671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37538e14-69c8-4562-86af-9cf53c119d2b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:43.741149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37538e14-69c8-4562-86af-9cf53c119d2b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:43.741590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37538e14-69c8-4562-86af-9cf53c119d2b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:43.742274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37538e14-69c8-4562-86af-9cf53c119d2b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:43.742725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37538e14-69c8-4562-86af-9cf53c119d2b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:43.743146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37538e14-69c8-4562-86af-9cf53c119d2b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:44.142304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-37538e14-69c8-4562-86af-9cf53c119d2b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:44.150607 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-37538e14-69c8-4562-86af-9cf53c119d2b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1677 microversion: 2.1 time: 0.421462 Oct 12 22:56:44.151170 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3951/7254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:43 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1677 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:45.175411 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eff85b2e-d208-4246-b2c1-68a0dd60bafa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:45.176040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eff85b2e-d208-4246-b2c1-68a0dd60bafa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:45.182973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eff85b2e-d208-4246-b2c1-68a0dd60bafa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:45.183505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eff85b2e-d208-4246-b2c1-68a0dd60bafa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:45.183965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eff85b2e-d208-4246-b2c1-68a0dd60bafa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:45.184667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eff85b2e-d208-4246-b2c1-68a0dd60bafa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:45.185136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eff85b2e-d208-4246-b2c1-68a0dd60bafa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:45.185580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eff85b2e-d208-4246-b2c1-68a0dd60bafa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:45.312834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eff85b2e-d208-4246-b2c1-68a0dd60bafa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:45.320570 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eff85b2e-d208-4246-b2c1-68a0dd60bafa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1677 microversion: 2.1 time: 0.149346 Oct 12 22:56:45.321133 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3304/7255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:45 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:46.344062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e19c2b83-4089-4c20-86d2-b741e845f7ec tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:46.344682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e19c2b83-4089-4c20-86d2-b741e845f7ec tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:46.352016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e19c2b83-4089-4c20-86d2-b741e845f7ec tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:46.352503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e19c2b83-4089-4c20-86d2-b741e845f7ec tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:46.352939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e19c2b83-4089-4c20-86d2-b741e845f7ec tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:46.353624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e19c2b83-4089-4c20-86d2-b741e845f7ec tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:46.354079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e19c2b83-4089-4c20-86d2-b741e845f7ec tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:46.354503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e19c2b83-4089-4c20-86d2-b741e845f7ec tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:46.482781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e19c2b83-4089-4c20-86d2-b741e845f7ec tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:46.490810 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e19c2b83-4089-4c20-86d2-b741e845f7ec tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1677 microversion: 2.1 time: 0.150621 Oct 12 22:56:46.491397 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3952/7256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:46 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:47.514015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fddf1801-41a8-4404-988f-7cc101d94226 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:47.514670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fddf1801-41a8-4404-988f-7cc101d94226 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:47.521059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fddf1801-41a8-4404-988f-7cc101d94226 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:47.521554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fddf1801-41a8-4404-988f-7cc101d94226 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:47.522003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fddf1801-41a8-4404-988f-7cc101d94226 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:47.522704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fddf1801-41a8-4404-988f-7cc101d94226 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:47.523793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fddf1801-41a8-4404-988f-7cc101d94226 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:47.524243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fddf1801-41a8-4404-988f-7cc101d94226 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:47.653827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-fddf1801-41a8-4404-988f-7cc101d94226 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:47.661778 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fddf1801-41a8-4404-988f-7cc101d94226 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1677 microversion: 2.1 time: 0.151771 Oct 12 22:56:47.662346 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3305/7257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:47 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:48.685173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ca1da9b5-a4f9-4d32-bbee-990c01396722 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:48.685789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ca1da9b5-a4f9-4d32-bbee-990c01396722 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:48.692600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca1da9b5-a4f9-4d32-bbee-990c01396722 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:48.693084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca1da9b5-a4f9-4d32-bbee-990c01396722 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:48.693522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca1da9b5-a4f9-4d32-bbee-990c01396722 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:48.694212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca1da9b5-a4f9-4d32-bbee-990c01396722 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:48.694668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca1da9b5-a4f9-4d32-bbee-990c01396722 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:48.695096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca1da9b5-a4f9-4d32-bbee-990c01396722 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:48.821325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ca1da9b5-a4f9-4d32-bbee-990c01396722 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:48.829024 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ca1da9b5-a4f9-4d32-bbee-990c01396722 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1677 microversion: 2.1 time: 0.147853 Oct 12 22:56:48.829589 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3953/7258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:48 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:49.853357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb79bd70-875c-45b5-810a-e052aa4e38fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:49.853985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eb79bd70-875c-45b5-810a-e052aa4e38fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:49.861099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb79bd70-875c-45b5-810a-e052aa4e38fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:49.861627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb79bd70-875c-45b5-810a-e052aa4e38fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:49.862085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb79bd70-875c-45b5-810a-e052aa4e38fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:49.862794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb79bd70-875c-45b5-810a-e052aa4e38fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:49.863287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb79bd70-875c-45b5-810a-e052aa4e38fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:49.863735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb79bd70-875c-45b5-810a-e052aa4e38fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:49.991686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eb79bd70-875c-45b5-810a-e052aa4e38fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:49.999930 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb79bd70-875c-45b5-810a-e052aa4e38fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1677 microversion: 2.1 time: 0.151045 Oct 12 22:56:50.000523 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3306/7259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:49 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:51.023553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ecf35605-381b-4d45-940e-9cb1cd1d556f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:51.024184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ecf35605-381b-4d45-940e-9cb1cd1d556f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:51.031179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecf35605-381b-4d45-940e-9cb1cd1d556f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:51.031700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecf35605-381b-4d45-940e-9cb1cd1d556f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:51.032143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecf35605-381b-4d45-940e-9cb1cd1d556f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:51.032864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecf35605-381b-4d45-940e-9cb1cd1d556f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:51.033328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecf35605-381b-4d45-940e-9cb1cd1d556f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:51.033758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ecf35605-381b-4d45-940e-9cb1cd1d556f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:51.159069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ecf35605-381b-4d45-940e-9cb1cd1d556f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:51.167441 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ecf35605-381b-4d45-940e-9cb1cd1d556f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1677 microversion: 2.1 time: 0.148411 Oct 12 22:56:51.168009 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3954/7260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:51 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:52.190675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a92735ef-9e35-4cd3-b030-aec35fccd81b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:52.191355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a92735ef-9e35-4cd3-b030-aec35fccd81b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:52.198520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a92735ef-9e35-4cd3-b030-aec35fccd81b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:52.199015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a92735ef-9e35-4cd3-b030-aec35fccd81b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:52.199498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a92735ef-9e35-4cd3-b030-aec35fccd81b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:52.200224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a92735ef-9e35-4cd3-b030-aec35fccd81b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:52.200670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a92735ef-9e35-4cd3-b030-aec35fccd81b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:52.201109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a92735ef-9e35-4cd3-b030-aec35fccd81b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:52.330798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a92735ef-9e35-4cd3-b030-aec35fccd81b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:52.338589 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a92735ef-9e35-4cd3-b030-aec35fccd81b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1654 microversion: 2.1 time: 0.151823 Oct 12 22:56:52.339148 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3307/7261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:52 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:52.362110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6c90b5c6-3d16-4819-b76a-928bf354ce96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:52.364402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6c90b5c6-3d16-4819-b76a-928bf354ce96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:52.371796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c90b5c6-3d16-4819-b76a-928bf354ce96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:52.372278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c90b5c6-3d16-4819-b76a-928bf354ce96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:52.372709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c90b5c6-3d16-4819-b76a-928bf354ce96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:52.373395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c90b5c6-3d16-4819-b76a-928bf354ce96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:52.373845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c90b5c6-3d16-4819-b76a-928bf354ce96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:52.374269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c90b5c6-3d16-4819-b76a-928bf354ce96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:52.401779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6c90b5c6-3d16-4819-b76a-928bf354ce96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:52.407054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6c90b5c6-3d16-4819-b76a-928bf354ce96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Old instance type m1.heat2, new instance type m1.heat {{(pid=120453) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:56:52.413481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6c90b5c6-3d16-4819-b76a-928bf354ce96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:56:52.414517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6c90b5c6-3d16-4819-b76a-928bf354ce96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:56:52.414991 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6c90b5c6-3d16-4819-b76a-928bf354ce96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:56:52.415429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6c90b5c6-3d16-4819-b76a-928bf354ce96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:56:52.415839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-6c90b5c6-3d16-4819-b76a-928bf354ce96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:56:52.480731 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6c90b5c6-3d16-4819-b76a-928bf354ce96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "POST /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8/action" status: 202 len: 0 microversion: 2.1 time: 0.122813 Oct 12 22:56:52.481340 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3955/7262] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:56:52 2022] POST /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:56:52.489694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5e8e5b08-67e5-42ba-a964-e180f3a4f9d2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:52.490329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5e8e5b08-67e5-42ba-a964-e180f3a4f9d2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:52.496236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e8e5b08-67e5-42ba-a964-e180f3a4f9d2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:52.497243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e8e5b08-67e5-42ba-a964-e180f3a4f9d2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:52.497243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e8e5b08-67e5-42ba-a964-e180f3a4f9d2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:52.497869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e8e5b08-67e5-42ba-a964-e180f3a4f9d2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:52.498337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e8e5b08-67e5-42ba-a964-e180f3a4f9d2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:52.498780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e8e5b08-67e5-42ba-a964-e180f3a4f9d2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:52.637520 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5e8e5b08-67e5-42ba-a964-e180f3a4f9d2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:52.645426 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5e8e5b08-67e5-42ba-a964-e180f3a4f9d2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1677 microversion: 2.1 time: 0.159866 Oct 12 22:56:52.646000 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3308/7263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:52 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:53.671300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-76f4b525-af7c-4018-a8cc-c8f54d413989 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:53.671929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-76f4b525-af7c-4018-a8cc-c8f54d413989 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:53.677977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76f4b525-af7c-4018-a8cc-c8f54d413989 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:53.678472 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76f4b525-af7c-4018-a8cc-c8f54d413989 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:53.678910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76f4b525-af7c-4018-a8cc-c8f54d413989 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:53.680241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76f4b525-af7c-4018-a8cc-c8f54d413989 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:53.680884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76f4b525-af7c-4018-a8cc-c8f54d413989 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:53.681322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-76f4b525-af7c-4018-a8cc-c8f54d413989 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:53.811416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-76f4b525-af7c-4018-a8cc-c8f54d413989 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:53.819457 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-76f4b525-af7c-4018-a8cc-c8f54d413989 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1677 microversion: 2.1 time: 0.152959 Oct 12 22:56:53.820038 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3956/7264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:53 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:54.843452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7181dc2b-ab10-4684-9850-029b7dfc1a17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:54.844006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7181dc2b-ab10-4684-9850-029b7dfc1a17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:54.850801 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7181dc2b-ab10-4684-9850-029b7dfc1a17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:54.851339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7181dc2b-ab10-4684-9850-029b7dfc1a17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:54.851797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7181dc2b-ab10-4684-9850-029b7dfc1a17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:54.852501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7181dc2b-ab10-4684-9850-029b7dfc1a17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:54.852968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7181dc2b-ab10-4684-9850-029b7dfc1a17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:54.853413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7181dc2b-ab10-4684-9850-029b7dfc1a17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:54.988989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7181dc2b-ab10-4684-9850-029b7dfc1a17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:54.997541 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7181dc2b-ab10-4684-9850-029b7dfc1a17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1682 microversion: 2.1 time: 0.158298 Oct 12 22:56:54.998141 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3309/7265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:54 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:56.022019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dea88016-c413-4242-a2df-6546b5bae556 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:56.022632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dea88016-c413-4242-a2df-6546b5bae556 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:56.029896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dea88016-c413-4242-a2df-6546b5bae556 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:56.030425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dea88016-c413-4242-a2df-6546b5bae556 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:56.030918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dea88016-c413-4242-a2df-6546b5bae556 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:56.031640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dea88016-c413-4242-a2df-6546b5bae556 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:56.032100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dea88016-c413-4242-a2df-6546b5bae556 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:56.032532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dea88016-c413-4242-a2df-6546b5bae556 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:56.161134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dea88016-c413-4242-a2df-6546b5bae556 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:56.169077 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dea88016-c413-4242-a2df-6546b5bae556 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1682 microversion: 2.1 time: 0.151170 Oct 12 22:56:56.169657 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3957/7266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:56 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:56.890327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-17bd4275-ac29-450f-8acb-8d910e08f91a req-01c91c7d-b59c-4be9-8a60-bc27e881c17e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6347f3-f269-4c9b-aea9-5c81bc71d0a8", "name": "network-vif-unplugged", "status": "completed", "tag": "6098fa41-5c85-48c4-9967-41883bcdffe6"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:56.900348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-17bd4275-ac29-450f-8acb-8d910e08f91a req-01c91c7d-b59c-4be9-8a60-bc27e881c17e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:56.900846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-17bd4275-ac29-450f-8acb-8d910e08f91a req-01c91c7d-b59c-4be9-8a60-bc27e881c17e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:56.901298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-17bd4275-ac29-450f-8acb-8d910e08f91a req-01c91c7d-b59c-4be9-8a60-bc27e881c17e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:56.913199 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-17bd4275-ac29-450f-8acb-8d910e08f91a req-01c91c7d-b59c-4be9-8a60-bc27e881c17e service nova] Creating event network-vif-unplugged:6098fa41-5c85-48c4-9967-41883bcdffe6 for instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 on n-h2-861111-1 Oct 12 22:56:56.919385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-17bd4275-ac29-450f-8acb-8d910e08f91a req-01c91c7d-b59c-4be9-8a60-bc27e881c17e service nova] Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:56:56.930153 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-17bd4275-ac29-450f-8acb-8d910e08f91a req-01c91c7d-b59c-4be9-8a60-bc27e881c17e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119754 Oct 12 22:56:56.930939 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3310/7267] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:57.193202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c86e0295-c68f-4066-a996-f321b75d5153 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:57.193910 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c86e0295-c68f-4066-a996-f321b75d5153 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:57.201230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86e0295-c68f-4066-a996-f321b75d5153 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.201724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86e0295-c68f-4066-a996-f321b75d5153 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.202171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86e0295-c68f-4066-a996-f321b75d5153 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:57.202947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86e0295-c68f-4066-a996-f321b75d5153 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.203473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86e0295-c68f-4066-a996-f321b75d5153 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.203914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86e0295-c68f-4066-a996-f321b75d5153 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:57.337611 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c86e0295-c68f-4066-a996-f321b75d5153 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:57.345853 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c86e0295-c68f-4066-a996-f321b75d5153 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1681 microversion: 2.1 time: 0.156806 Oct 12 22:56:57.346449 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3958/7268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:57 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:58.373395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0991d50f-7c8f-493d-b556-9bffb6ac2544 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:58.374126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0991d50f-7c8f-493d-b556-9bffb6ac2544 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:58.380527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0991d50f-7c8f-493d-b556-9bffb6ac2544 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:58.381032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0991d50f-7c8f-493d-b556-9bffb6ac2544 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:58.381490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0991d50f-7c8f-493d-b556-9bffb6ac2544 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:58.382203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0991d50f-7c8f-493d-b556-9bffb6ac2544 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:58.382680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0991d50f-7c8f-493d-b556-9bffb6ac2544 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:58.383112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0991d50f-7c8f-493d-b556-9bffb6ac2544 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:58.520815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0991d50f-7c8f-493d-b556-9bffb6ac2544 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:58.529108 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0991d50f-7c8f-493d-b556-9bffb6ac2544 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1679 microversion: 2.1 time: 0.162184 Oct 12 22:56:58.529683 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3311/7269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:58 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:58.947703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-2999aa7b-cce3-4ca4-a9c0-eca1ea32c104 req-3c771e40-5419-4b76-90c5-ed3baab93fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6347f3-f269-4c9b-aea9-5c81bc71d0a8", "tag": "6098fa41-5c85-48c4-9967-41883bcdffe6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:58.957936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2999aa7b-cce3-4ca4-a9c0-eca1ea32c104 req-3c771e40-5419-4b76-90c5-ed3baab93fd4 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:58.958417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2999aa7b-cce3-4ca4-a9c0-eca1ea32c104 req-3c771e40-5419-4b76-90c5-ed3baab93fd4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:58.958852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2999aa7b-cce3-4ca4-a9c0-eca1ea32c104 req-3c771e40-5419-4b76-90c5-ed3baab93fd4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:58.970786 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-2999aa7b-cce3-4ca4-a9c0-eca1ea32c104 req-3c771e40-5419-4b76-90c5-ed3baab93fd4 service nova] Creating event network-changed:6098fa41-5c85-48c4-9967-41883bcdffe6 for instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 on n-h2-861111-1 Oct 12 22:56:58.975999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-2999aa7b-cce3-4ca4-a9c0-eca1ea32c104 req-3c771e40-5419-4b76-90c5-ed3baab93fd4 service nova] Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:56:58.986790 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-2999aa7b-cce3-4ca4-a9c0-eca1ea32c104 req-3c771e40-5419-4b76-90c5-ed3baab93fd4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043303 Oct 12 22:56:58.987403 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3959/7270] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:56:59.554031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-998ad7c2-6577-410e-b2cd-41e3d7a9fa57 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:59.554659 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-998ad7c2-6577-410e-b2cd-41e3d7a9fa57 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:59.562397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998ad7c2-6577-410e-b2cd-41e3d7a9fa57 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:59.562901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998ad7c2-6577-410e-b2cd-41e3d7a9fa57 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:59.563375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998ad7c2-6577-410e-b2cd-41e3d7a9fa57 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:59.564092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998ad7c2-6577-410e-b2cd-41e3d7a9fa57 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:59.564560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998ad7c2-6577-410e-b2cd-41e3d7a9fa57 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:59.564999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-998ad7c2-6577-410e-b2cd-41e3d7a9fa57 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:59.692536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-998ad7c2-6577-410e-b2cd-41e3d7a9fa57 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:59.700828 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-998ad7c2-6577-410e-b2cd-41e3d7a9fa57 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1679 microversion: 2.1 time: 0.150788 Oct 12 22:56:59.701387 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3312/7271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:59 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:00.725645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e97d19df-f445-4a02-ae39-dccd107d1fde tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:00.726432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e97d19df-f445-4a02-ae39-dccd107d1fde tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:00.733115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e97d19df-f445-4a02-ae39-dccd107d1fde tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:00.733693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e97d19df-f445-4a02-ae39-dccd107d1fde tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:00.734132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e97d19df-f445-4a02-ae39-dccd107d1fde tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:00.734822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e97d19df-f445-4a02-ae39-dccd107d1fde tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:00.735297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e97d19df-f445-4a02-ae39-dccd107d1fde tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:00.735972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e97d19df-f445-4a02-ae39-dccd107d1fde tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:00.865122 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e97d19df-f445-4a02-ae39-dccd107d1fde tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:00.872865 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e97d19df-f445-4a02-ae39-dccd107d1fde tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1675 microversion: 2.1 time: 0.152291 Oct 12 22:57:00.873463 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3960/7272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:00 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:00.895502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6889966a-e75e-42fb-996c-1bb9e94972b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:00.896051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6889966a-e75e-42fb-996c-1bb9e94972b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:00.903327 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6889966a-e75e-42fb-996c-1bb9e94972b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:00.903825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6889966a-e75e-42fb-996c-1bb9e94972b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:00.904278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6889966a-e75e-42fb-996c-1bb9e94972b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:00.904979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6889966a-e75e-42fb-996c-1bb9e94972b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:00.905442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6889966a-e75e-42fb-996c-1bb9e94972b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:00.905878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6889966a-e75e-42fb-996c-1bb9e94972b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:00.961557 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6889966a-e75e-42fb-996c-1bb9e94972b7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "POST /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8/action" status: 204 len: 0 microversion: 2.1 time: 0.069440 Oct 12 22:57:00.962220 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3313/7273] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:57:00 2022] POST /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:57:00.970665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-532be788-d82d-47c6-a6d7-2efc382f51bb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:00.971301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-532be788-d82d-47c6-a6d7-2efc382f51bb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:00.978226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-532be788-d82d-47c6-a6d7-2efc382f51bb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:00.978772 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-532be788-d82d-47c6-a6d7-2efc382f51bb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:00.979218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-532be788-d82d-47c6-a6d7-2efc382f51bb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:00.979996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-532be788-d82d-47c6-a6d7-2efc382f51bb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:00.980458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-532be788-d82d-47c6-a6d7-2efc382f51bb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:00.980893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-532be788-d82d-47c6-a6d7-2efc382f51bb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:01.118344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-532be788-d82d-47c6-a6d7-2efc382f51bb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:01.126134 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-532be788-d82d-47c6-a6d7-2efc382f51bb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1675 microversion: 2.1 time: 0.159335 Oct 12 22:57:01.126720 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3961/7274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:00 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:02.152231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f6321068-8715-40ac-9f2e-2cab4a60466d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:02.152955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f6321068-8715-40ac-9f2e-2cab4a60466d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:02.159354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6321068-8715-40ac-9f2e-2cab4a60466d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:02.159870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6321068-8715-40ac-9f2e-2cab4a60466d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:02.160317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6321068-8715-40ac-9f2e-2cab4a60466d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:02.161039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6321068-8715-40ac-9f2e-2cab4a60466d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:02.161515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6321068-8715-40ac-9f2e-2cab4a60466d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:02.162131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6321068-8715-40ac-9f2e-2cab4a60466d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:02.181708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-22fdbbf0-9252-4e35-a643-6035516a0aa3 req-29b3fc17-560e-4334-8d8f-ab014199eec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6347f3-f269-4c9b-aea9-5c81bc71d0a8", "name": "network-vif-plugged", "status": "completed", "tag": "6098fa41-5c85-48c4-9967-41883bcdffe6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:02.197808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-22fdbbf0-9252-4e35-a643-6035516a0aa3 req-29b3fc17-560e-4334-8d8f-ab014199eec6 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:02.198640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-22fdbbf0-9252-4e35-a643-6035516a0aa3 req-29b3fc17-560e-4334-8d8f-ab014199eec6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:02.199169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-22fdbbf0-9252-4e35-a643-6035516a0aa3 req-29b3fc17-560e-4334-8d8f-ab014199eec6 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:02.217105 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-22fdbbf0-9252-4e35-a643-6035516a0aa3 req-29b3fc17-560e-4334-8d8f-ab014199eec6 service nova] Creating event network-vif-plugged:6098fa41-5c85-48c4-9967-41883bcdffe6 for instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 on n-h2-861111-1 Oct 12 22:57:02.222285 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-22fdbbf0-9252-4e35-a643-6035516a0aa3 req-29b3fc17-560e-4334-8d8f-ab014199eec6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046455 Oct 12 22:57:02.223190 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3962/7275] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:02.301189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f6321068-8715-40ac-9f2e-2cab4a60466d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:02.308926 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f6321068-8715-40ac-9f2e-2cab4a60466d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1675 microversion: 2.1 time: 0.162401 Oct 12 22:57:02.309514 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3314/7276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:02 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:03.333085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2451a9b6-be5f-4669-8221-d20f6bcc7783 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:03.333785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2451a9b6-be5f-4669-8221-d20f6bcc7783 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:03.339912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2451a9b6-be5f-4669-8221-d20f6bcc7783 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:03.340393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2451a9b6-be5f-4669-8221-d20f6bcc7783 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:03.340829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2451a9b6-be5f-4669-8221-d20f6bcc7783 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:03.341512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2451a9b6-be5f-4669-8221-d20f6bcc7783 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:03.341963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2451a9b6-be5f-4669-8221-d20f6bcc7783 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:03.342387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2451a9b6-be5f-4669-8221-d20f6bcc7783 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:03.472392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2451a9b6-be5f-4669-8221-d20f6bcc7783 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:03.480663 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2451a9b6-be5f-4669-8221-d20f6bcc7783 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1654 microversion: 2.1 time: 0.152780 Oct 12 22:57:03.481242 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3963/7277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:03 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:03.503964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d0bb5366-cf8d-4905-a000-c17b5d16ef17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:03.504604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d0bb5366-cf8d-4905-a000-c17b5d16ef17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:03.511500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0bb5366-cf8d-4905-a000-c17b5d16ef17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:03.512004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0bb5366-cf8d-4905-a000-c17b5d16ef17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:03.512463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0bb5366-cf8d-4905-a000-c17b5d16ef17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:03.513177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0bb5366-cf8d-4905-a000-c17b5d16ef17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:03.513649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0bb5366-cf8d-4905-a000-c17b5d16ef17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:03.514093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0bb5366-cf8d-4905-a000-c17b5d16ef17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:03.644976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d0bb5366-cf8d-4905-a000-c17b5d16ef17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:03.653247 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d0bb5366-cf8d-4905-a000-c17b5d16ef17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1654 microversion: 2.1 time: 0.153175 Oct 12 22:57:03.653807 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3315/7278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:03 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:03.676168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0da795b8-8d0c-4f25-8f5e-e4f478543988 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:03.682334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0da795b8-8d0c-4f25-8f5e-e4f478543988 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:03.682833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0da795b8-8d0c-4f25-8f5e-e4f478543988 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:03.683298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0da795b8-8d0c-4f25-8f5e-e4f478543988 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:03.705446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0da795b8-8d0c-4f25-8f5e-e4f478543988 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Going to try to start instance {{(pid=120453) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 22:57:03.748337 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0da795b8-8d0c-4f25-8f5e-e4f478543988 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "POST /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8/action" status: 202 len: 0 microversion: 2.1 time: 0.075918 Oct 12 22:57:03.749148 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3964/7279] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:57:03 2022] POST /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:57:03.757226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ba5b2a4c-ff8e-4150-bb1e-83dfa8a576d6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:03.757865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ba5b2a4c-ff8e-4150-bb1e-83dfa8a576d6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:03.764293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba5b2a4c-ff8e-4150-bb1e-83dfa8a576d6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:03.764884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba5b2a4c-ff8e-4150-bb1e-83dfa8a576d6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:03.765340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba5b2a4c-ff8e-4150-bb1e-83dfa8a576d6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:03.766243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba5b2a4c-ff8e-4150-bb1e-83dfa8a576d6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:03.767028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba5b2a4c-ff8e-4150-bb1e-83dfa8a576d6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:03.767668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba5b2a4c-ff8e-4150-bb1e-83dfa8a576d6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:03.983437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba5b2a4c-ff8e-4150-bb1e-83dfa8a576d6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:03.987184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:03.992782 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ba5b2a4c-ff8e-4150-bb1e-83dfa8a576d6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1663 microversion: 2.1 time: 0.239477 Oct 12 22:57:03.993365 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3316/7280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:03 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1663 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:05.018411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3193ffca-de4c-47ef-b5d0-640b687a21ae tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:05.019124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3193ffca-de4c-47ef-b5d0-640b687a21ae tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:05.025415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3193ffca-de4c-47ef-b5d0-640b687a21ae tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:05.025902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3193ffca-de4c-47ef-b5d0-640b687a21ae tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:05.026351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3193ffca-de4c-47ef-b5d0-640b687a21ae tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:05.027044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3193ffca-de4c-47ef-b5d0-640b687a21ae tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:05.027533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3193ffca-de4c-47ef-b5d0-640b687a21ae tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:05.027964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3193ffca-de4c-47ef-b5d0-640b687a21ae tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:05.032013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:05.161369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3193ffca-de4c-47ef-b5d0-640b687a21ae tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:05.169723 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3193ffca-de4c-47ef-b5d0-640b687a21ae tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1667 microversion: 2.1 time: 0.156558 Oct 12 22:57:05.170306 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3965/7281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:05 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:05.192874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-89a1b28b-e74c-4b0e-a291-33411f6ad29b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:05.193398 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-89a1b28b-e74c-4b0e-a291-33411f6ad29b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:05.201155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89a1b28b-e74c-4b0e-a291-33411f6ad29b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:05.201651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89a1b28b-e74c-4b0e-a291-33411f6ad29b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:05.202102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89a1b28b-e74c-4b0e-a291-33411f6ad29b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:05.202809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89a1b28b-e74c-4b0e-a291-33411f6ad29b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:05.203302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89a1b28b-e74c-4b0e-a291-33411f6ad29b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:05.203750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89a1b28b-e74c-4b0e-a291-33411f6ad29b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:05.230143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-89a1b28b-e74c-4b0e-a291-33411f6ad29b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:57:05.303355 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-89a1b28b-e74c-4b0e-a291-33411f6ad29b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 204 len: 0 microversion: 2.1 time: 0.114539 Oct 12 22:57:05.304260 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3317/7282] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:57:05 2022] DELETE /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:57:05.312765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9465e7ed-9669-4145-9fde-892ff741cd78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:05.313375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9465e7ed-9669-4145-9fde-892ff741cd78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:05.319350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9465e7ed-9669-4145-9fde-892ff741cd78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:05.319860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9465e7ed-9669-4145-9fde-892ff741cd78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:05.320297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9465e7ed-9669-4145-9fde-892ff741cd78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:05.321124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9465e7ed-9669-4145-9fde-892ff741cd78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:05.321433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9465e7ed-9669-4145-9fde-892ff741cd78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:05.321854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9465e7ed-9669-4145-9fde-892ff741cd78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:05.448148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9465e7ed-9669-4145-9fde-892ff741cd78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:05.455717 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9465e7ed-9669-4145-9fde-892ff741cd78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1673 microversion: 2.1 time: 0.147198 Oct 12 22:57:05.456287 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3966/7283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:05 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:06.480639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0018d90a-39fc-4353-aa06-4a5a106478a7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:06.481362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0018d90a-39fc-4353-aa06-4a5a106478a7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:06.488438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0018d90a-39fc-4353-aa06-4a5a106478a7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:06.488944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0018d90a-39fc-4353-aa06-4a5a106478a7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:06.489403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0018d90a-39fc-4353-aa06-4a5a106478a7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:06.490114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0018d90a-39fc-4353-aa06-4a5a106478a7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:06.490588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0018d90a-39fc-4353-aa06-4a5a106478a7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:06.491033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0018d90a-39fc-4353-aa06-4a5a106478a7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:06.714230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0018d90a-39fc-4353-aa06-4a5a106478a7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:06.722040 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0018d90a-39fc-4353-aa06-4a5a106478a7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1673 microversion: 2.1 time: 0.246256 Oct 12 22:57:06.722620 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3318/7284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:06 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1673 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:07.746640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-44b9ea00-a31f-4f8c-859b-0d93b4633383 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:07.748730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-44b9ea00-a31f-4f8c-859b-0d93b4633383 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:07.749204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-96759b1a-e28e-45dd-ac69-cd2a8b93d2eb req-fd3439ce-3928-447c-8384-a72a45fda0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6347f3-f269-4c9b-aea9-5c81bc71d0a8", "name": "network-vif-deleted", "tag": "6098fa41-5c85-48c4-9967-41883bcdffe6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:07.765478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44b9ea00-a31f-4f8c-859b-0d93b4633383 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:07.766294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44b9ea00-a31f-4f8c-859b-0d93b4633383 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:07.766971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44b9ea00-a31f-4f8c-859b-0d93b4633383 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:07.767972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44b9ea00-a31f-4f8c-859b-0d93b4633383 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:07.769914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44b9ea00-a31f-4f8c-859b-0d93b4633383 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:07.771188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-44b9ea00-a31f-4f8c-859b-0d93b4633383 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:07.778018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-96759b1a-e28e-45dd-ac69-cd2a8b93d2eb req-fd3439ce-3928-447c-8384-a72a45fda0f5 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:07.778702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-96759b1a-e28e-45dd-ac69-cd2a8b93d2eb req-fd3439ce-3928-447c-8384-a72a45fda0f5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:07.781540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-96759b1a-e28e-45dd-ac69-cd2a8b93d2eb req-fd3439ce-3928-447c-8384-a72a45fda0f5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:07.811502 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-96759b1a-e28e-45dd-ac69-cd2a8b93d2eb req-fd3439ce-3928-447c-8384-a72a45fda0f5 service nova] Creating event network-vif-deleted:6098fa41-5c85-48c4-9967-41883bcdffe6 for instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 on n-h2-861111-1 Oct 12 22:57:07.817334 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-96759b1a-e28e-45dd-ac69-cd2a8b93d2eb req-fd3439ce-3928-447c-8384-a72a45fda0f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082233 Oct 12 22:57:07.823561 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3967/7285] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:07.878595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-44b9ea00-a31f-4f8c-859b-0d93b4633383 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:07.888268 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-44b9ea00-a31f-4f8c-859b-0d93b4633383 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 200 len: 1607 microversion: 2.1 time: 0.145478 Oct 12 22:57:07.891309 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3319/7286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:07 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 1607 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:08.915831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9ca21ba5-e924-424e-a404-087fdb04c7a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:08.916461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9ca21ba5-e924-424e-a404-087fdb04c7a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:08.923711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ca21ba5-e924-424e-a404-087fdb04c7a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:08.924204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ca21ba5-e924-424e-a404-087fdb04c7a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:08.924674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ca21ba5-e924-424e-a404-087fdb04c7a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:08.925371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ca21ba5-e924-424e-a404-087fdb04c7a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:08.925829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ca21ba5-e924-424e-a404-087fdb04c7a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:08.926261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9ca21ba5-e924-424e-a404-087fdb04c7a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:08.939396 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-9ca21ba5-e924-424e-a404-087fdb04c7a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] HTTP exception thrown: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9ca21ba5-e924-424e-a404-087fdb04c7a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Request method failure captured: Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 HTTP/1.1 Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0WrKQiBfy0XSANASA5fCFbD4GR8tuMwOAMN25efH-T8eGJGJ9GqINSx71zrrS3STQYGkkMmRKLW9d4tVwDR4SqLAQg3JTIXjTWQBGkushtLJhuadXQwH02STvq4BQuhp2LfpRdQBY1OcY_j-rJ13jlHiZrptRT0JEkKLcabSXJo4D8 Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e44a4f6e4faa450b9850cd5bfbe53d59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerActionsTestJSON-486969938 Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerActionsTestJSON-486969938-project Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: dc38342011d04f98aa06f9474fe6f402 Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerActionsTestJSON-486969938-project Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '4d6347f3-f269-4c9b-aea9-5c81bc71d0a8'} Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:08.941022 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:57:08.945575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:08.945575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:08.945575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:08.945575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:08.945575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:08.945575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 22:57:08.945575 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:57:08.945575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9ca21ba5-e924-424e-a404-087fdb04c7a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Returning 404 to user: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:08.945575 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9ca21ba5-e924-424e-a404-087fdb04c7a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 404 len: 111 microversion: 2.1 time: 0.031958 Oct 12 22:57:08.945575 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3968/7287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:08 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:08.958627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-908c201d-17b2-4ed1-b710-4027e1422999 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:08.959272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-908c201d-17b2-4ed1-b710-4027e1422999 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:08.966531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-908c201d-17b2-4ed1-b710-4027e1422999 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:08.967024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-908c201d-17b2-4ed1-b710-4027e1422999 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:08.967555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-908c201d-17b2-4ed1-b710-4027e1422999 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:08.968253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-908c201d-17b2-4ed1-b710-4027e1422999 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:08.968717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-908c201d-17b2-4ed1-b710-4027e1422999 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:08.969154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-908c201d-17b2-4ed1-b710-4027e1422999 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:08.982909 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-908c201d-17b2-4ed1-b710-4027e1422999 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] HTTP exception thrown: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-908c201d-17b2-4ed1-b710-4027e1422999 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Request method failure captured: Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 HTTP/1.1 Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0WrKQiBfy0XSANASA5fCFbD4GR8tuMwOAMN25efH-T8eGJGJ9GqINSx71zrrS3STQYGkkMmRKLW9d4tVwDR4SqLAQg3JTIXjTWQBGkushtLJhuadXQwH02STvq4BQuhp2LfpRdQBY1OcY_j-rJ13jlHiZrptRT0JEkKLcabSXJo4D8 Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e44a4f6e4faa450b9850cd5bfbe53d59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerActionsTestJSON-486969938 Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerActionsTestJSON-486969938-project Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: dc38342011d04f98aa06f9474fe6f402 Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerActionsTestJSON-486969938-project Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '4d6347f3-f269-4c9b-aea9-5c81bc71d0a8'} Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:08.984595 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:57:08.988799 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:08.988799 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:08.988799 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:08.988799 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:08.988799 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:08.988799 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 22:57:08.988799 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:57:08.988799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-908c201d-17b2-4ed1-b710-4027e1422999 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Returning 404 to user: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:08.988799 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-908c201d-17b2-4ed1-b710-4027e1422999 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 404 len: 111 microversion: 2.1 time: 0.031248 Oct 12 22:57:08.988799 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3320/7288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:08 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:09.043256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-867717134", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "9e6b601d-4bd2-489e-9269-4cf57f84b9f1"}], "security_groups": [{"name": "tempest-securitygroup--91822578"}], "key_name": "tempest-keypair-1203075025", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:09.145564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] validate_networks() for [('9e6b601d-4bd2-489e-9269-4cf57f84b9f1', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:57:09.505880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:57:09.506333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:57:09.506812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:57:09.507227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:57:09.508206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:57:09.516941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:09.517422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:09.517860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:09.518608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:09.519060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:09.519518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:09.535806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Getting quotas for project e44a4f6e4faa450b9850cd5bfbe53d59. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:09.541454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Getting quotas for user dc38342011d04f98aa06f9474fe6f402 and project e44a4f6e4faa450b9850cd5bfbe53d59. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:09.553554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:57:09.556444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:57:09.605992 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d1209f46-49e1-4c0f-be70-f4af2203d1f7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.566682 Oct 12 22:57:09.606949 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3969/7289] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:57:09 2022] POST /compute/v2.1/servers => generated 404 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:57:09.619007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-be816192-33ed-4b3e-9046-859752a8ad78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:09.619670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-be816192-33ed-4b3e-9046-859752a8ad78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:09.676074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-be816192-33ed-4b3e-9046-859752a8ad78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:09.683071 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-be816192-33ed-4b3e-9046-859752a8ad78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1238 microversion: 2.1 time: 0.068650 Oct 12 22:57:09.683682 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3321/7290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:09 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:10.707179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2094482e-9a44-4fe3-92a6-9740dec6ef60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:10.709312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2094482e-9a44-4fe3-92a6-9740dec6ef60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:10.717537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2094482e-9a44-4fe3-92a6-9740dec6ef60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:10.718115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2094482e-9a44-4fe3-92a6-9740dec6ef60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:10.718745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2094482e-9a44-4fe3-92a6-9740dec6ef60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:10.719554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2094482e-9a44-4fe3-92a6-9740dec6ef60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:10.720090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2094482e-9a44-4fe3-92a6-9740dec6ef60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:10.720615 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2094482e-9a44-4fe3-92a6-9740dec6ef60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:10.791645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2094482e-9a44-4fe3-92a6-9740dec6ef60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:10.800177 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2094482e-9a44-4fe3-92a6-9740dec6ef60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1308 microversion: 2.1 time: 0.097842 Oct 12 22:57:10.800755 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3970/7291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:10 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:11.823844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0eea65ef-910d-4e0c-97e1-04782ec3106e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:11.824501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0eea65ef-910d-4e0c-97e1-04782ec3106e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:11.829254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:11.833170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0eea65ef-910d-4e0c-97e1-04782ec3106e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:11.833675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0eea65ef-910d-4e0c-97e1-04782ec3106e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:11.834125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0eea65ef-910d-4e0c-97e1-04782ec3106e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:11.834839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0eea65ef-910d-4e0c-97e1-04782ec3106e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:11.835333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0eea65ef-910d-4e0c-97e1-04782ec3106e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:11.835820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0eea65ef-910d-4e0c-97e1-04782ec3106e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:12.040498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0eea65ef-910d-4e0c-97e1-04782ec3106e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:12.048174 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0eea65ef-910d-4e0c-97e1-04782ec3106e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1362 microversion: 2.1 time: 0.228257 Oct 12 22:57:12.048742 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3322/7292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:11 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:12.095597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-0915451b-58ff-447f-9202-8737b25e8440 req-e45b6c61-4a1b-42ca-ada9-793ae3c3e745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e3d132e-7e81-4f58-b6ea-b4e6c02d6974", "tag": "36bb80eb-7c87-4394-9f37-81ecfb30df40"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:12.102475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:12.108406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0915451b-58ff-447f-9202-8737b25e8440 req-e45b6c61-4a1b-42ca-ada9-793ae3c3e745 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:12.108890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0915451b-58ff-447f-9202-8737b25e8440 req-e45b6c61-4a1b-42ca-ada9-793ae3c3e745 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:12.109326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0915451b-58ff-447f-9202-8737b25e8440 req-e45b6c61-4a1b-42ca-ada9-793ae3c3e745 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:12.122844 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-0915451b-58ff-447f-9202-8737b25e8440 req-e45b6c61-4a1b-42ca-ada9-793ae3c3e745 service nova] Creating event network-changed:36bb80eb-7c87-4394-9f37-81ecfb30df40 for instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 on n-h2-861111-1 Oct 12 22:57:12.127877 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-0915451b-58ff-447f-9202-8737b25e8440 req-e45b6c61-4a1b-42ca-ada9-793ae3c3e745 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036072 Oct 12 22:57:12.128647 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3971/7293] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:57:13.072417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-626bc179-0d18-4b6a-b102-4790ba4c9280 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:13.073045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-626bc179-0d18-4b6a-b102-4790ba4c9280 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:13.079832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-626bc179-0d18-4b6a-b102-4790ba4c9280 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:13.080334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-626bc179-0d18-4b6a-b102-4790ba4c9280 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:13.080787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-626bc179-0d18-4b6a-b102-4790ba4c9280 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:13.081502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-626bc179-0d18-4b6a-b102-4790ba4c9280 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:13.081991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-626bc179-0d18-4b6a-b102-4790ba4c9280 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:13.082431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-626bc179-0d18-4b6a-b102-4790ba4c9280 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:13.217831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-626bc179-0d18-4b6a-b102-4790ba4c9280 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:13.225462 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-626bc179-0d18-4b6a-b102-4790ba4c9280 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1362 microversion: 2.1 time: 0.157089 Oct 12 22:57:13.226036 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3323/7294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:13 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:14.251973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2d25e248-fead-4630-94b6-0f09f1d8e9ad tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:14.252717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2d25e248-fead-4630-94b6-0f09f1d8e9ad tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:14.258877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d25e248-fead-4630-94b6-0f09f1d8e9ad tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:14.259413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d25e248-fead-4630-94b6-0f09f1d8e9ad tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:14.259877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d25e248-fead-4630-94b6-0f09f1d8e9ad tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:14.260559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d25e248-fead-4630-94b6-0f09f1d8e9ad tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:14.261019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d25e248-fead-4630-94b6-0f09f1d8e9ad tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:14.261456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2d25e248-fead-4630-94b6-0f09f1d8e9ad tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:14.447966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2d25e248-fead-4630-94b6-0f09f1d8e9ad tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:14.455826 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2d25e248-fead-4630-94b6-0f09f1d8e9ad tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1362 microversion: 2.1 time: 0.209137 Oct 12 22:57:14.456428 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3972/7295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:14 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:15.480456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-be96ef05-14c8-4717-9e00-f032a8d05c1d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:15.481088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-be96ef05-14c8-4717-9e00-f032a8d05c1d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:15.487874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be96ef05-14c8-4717-9e00-f032a8d05c1d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:15.488375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be96ef05-14c8-4717-9e00-f032a8d05c1d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:15.488830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be96ef05-14c8-4717-9e00-f032a8d05c1d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:15.489544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be96ef05-14c8-4717-9e00-f032a8d05c1d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:15.490014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be96ef05-14c8-4717-9e00-f032a8d05c1d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:15.490457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be96ef05-14c8-4717-9e00-f032a8d05c1d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:15.654770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-be96ef05-14c8-4717-9e00-f032a8d05c1d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:15.662526 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-be96ef05-14c8-4717-9e00-f032a8d05c1d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1362 microversion: 2.1 time: 0.186644 Oct 12 22:57:15.663096 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3324/7296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:15 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:16.686419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-12ece53a-9328-441c-914c-8820284bc83e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:16.687032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-12ece53a-9328-441c-914c-8820284bc83e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:16.693827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12ece53a-9328-441c-914c-8820284bc83e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:16.694307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12ece53a-9328-441c-914c-8820284bc83e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:16.694744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12ece53a-9328-441c-914c-8820284bc83e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:16.696036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12ece53a-9328-441c-914c-8820284bc83e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:16.696489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12ece53a-9328-441c-914c-8820284bc83e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:16.696911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12ece53a-9328-441c-914c-8820284bc83e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:16.912744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-12ece53a-9328-441c-914c-8820284bc83e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:16.920938 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-12ece53a-9328-441c-914c-8820284bc83e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1362 microversion: 2.1 time: 0.238437 Oct 12 22:57:16.921509 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3973/7297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:16 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:17.945879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-efd60fa9-9e4d-411e-b3e4-4dc788c563a1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:17.946536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-efd60fa9-9e4d-411e-b3e4-4dc788c563a1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:17.953533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd60fa9-9e4d-411e-b3e4-4dc788c563a1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:17.954075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd60fa9-9e4d-411e-b3e4-4dc788c563a1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:17.954536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd60fa9-9e4d-411e-b3e4-4dc788c563a1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:17.955292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd60fa9-9e4d-411e-b3e4-4dc788c563a1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:17.955774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd60fa9-9e4d-411e-b3e4-4dc788c563a1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:17.956251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd60fa9-9e4d-411e-b3e4-4dc788c563a1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:18.087850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-efd60fa9-9e4d-411e-b3e4-4dc788c563a1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:18.095459 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-efd60fa9-9e4d-411e-b3e4-4dc788c563a1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1362 microversion: 2.1 time: 0.154375 Oct 12 22:57:18.096022 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3325/7298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:17 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:18.411957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-081408d4-2337-4cd6-ab6b-6d113ec16f85 req-9272d1e1-42ef-455c-8a16-af560024fa89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3d132e-7e81-4f58-b6ea-b4e6c02d6974", "name": "network-vif-plugged", "status": "completed", "tag": "36bb80eb-7c87-4394-9f37-81ecfb30df40"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:18.425617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-081408d4-2337-4cd6-ab6b-6d113ec16f85 req-9272d1e1-42ef-455c-8a16-af560024fa89 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:18.426106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-081408d4-2337-4cd6-ab6b-6d113ec16f85 req-9272d1e1-42ef-455c-8a16-af560024fa89 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:18.426550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-081408d4-2337-4cd6-ab6b-6d113ec16f85 req-9272d1e1-42ef-455c-8a16-af560024fa89 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:18.437625 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-081408d4-2337-4cd6-ab6b-6d113ec16f85 req-9272d1e1-42ef-455c-8a16-af560024fa89 service nova] Creating event network-vif-plugged:36bb80eb-7c87-4394-9f37-81ecfb30df40 for instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 on n-h2-861111-1 Oct 12 22:57:18.442700 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-081408d4-2337-4cd6-ab6b-6d113ec16f85 req-9272d1e1-42ef-455c-8a16-af560024fa89 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035840 Oct 12 22:57:18.443315 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3974/7299] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:19.118758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d1f5340d-aab1-482e-a190-01a3a6b0e1e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:19.119450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d1f5340d-aab1-482e-a190-01a3a6b0e1e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:19.126246 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1f5340d-aab1-482e-a190-01a3a6b0e1e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:19.126747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1f5340d-aab1-482e-a190-01a3a6b0e1e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:19.127199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1f5340d-aab1-482e-a190-01a3a6b0e1e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:19.127939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1f5340d-aab1-482e-a190-01a3a6b0e1e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:19.128409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1f5340d-aab1-482e-a190-01a3a6b0e1e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:19.128850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d1f5340d-aab1-482e-a190-01a3a6b0e1e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:19.257159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d1f5340d-aab1-482e-a190-01a3a6b0e1e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:19.265392 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d1f5340d-aab1-482e-a190-01a3a6b0e1e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1362 microversion: 2.1 time: 0.150562 Oct 12 22:57:19.265960 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3326/7300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:19 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:20.291254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0992ee3c-c3d3-4e61-8948-7fade0d63291 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:20.291967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0992ee3c-c3d3-4e61-8948-7fade0d63291 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:20.294751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:20.295479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:20.301519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0992ee3c-c3d3-4e61-8948-7fade0d63291 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:20.302007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0992ee3c-c3d3-4e61-8948-7fade0d63291 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:20.302449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0992ee3c-c3d3-4e61-8948-7fade0d63291 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:20.303148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0992ee3c-c3d3-4e61-8948-7fade0d63291 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:20.303640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0992ee3c-c3d3-4e61-8948-7fade0d63291 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:20.304088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0992ee3c-c3d3-4e61-8948-7fade0d63291 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:20.433521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0992ee3c-c3d3-4e61-8948-7fade0d63291 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:20.441316 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0992ee3c-c3d3-4e61-8948-7fade0d63291 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1548 microversion: 2.1 time: 0.155098 Oct 12 22:57:20.441888 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3975/7301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:20 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:20.464593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a2b07a75-a3ff-461f-9313-510079acf167 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:20.465107 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a2b07a75-a3ff-461f-9313-510079acf167 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:20.466937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:20.473122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2b07a75-a3ff-461f-9313-510079acf167 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:20.473621 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2b07a75-a3ff-461f-9313-510079acf167 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:20.474084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2b07a75-a3ff-461f-9313-510079acf167 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:20.474795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2b07a75-a3ff-461f-9313-510079acf167 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:20.475281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2b07a75-a3ff-461f-9313-510079acf167 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:20.475727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2b07a75-a3ff-461f-9313-510079acf167 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:20.554814 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a2b07a75-a3ff-461f-9313-510079acf167 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094559 Oct 12 22:57:20.555450 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3327/7302] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:57:20 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:21.463550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-1d80d30a-7685-44b9-bd4a-1d9c9c72ad54 req-41210288-4e0d-4bce-abc1-850e6a75aa04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e3d132e-7e81-4f58-b6ea-b4e6c02d6974", "tag": "36bb80eb-7c87-4394-9f37-81ecfb30df40"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:21.473803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1d80d30a-7685-44b9-bd4a-1d9c9c72ad54 req-41210288-4e0d-4bce-abc1-850e6a75aa04 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:21.474287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1d80d30a-7685-44b9-bd4a-1d9c9c72ad54 req-41210288-4e0d-4bce-abc1-850e6a75aa04 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:21.474722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1d80d30a-7685-44b9-bd4a-1d9c9c72ad54 req-41210288-4e0d-4bce-abc1-850e6a75aa04 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:21.486469 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-1d80d30a-7685-44b9-bd4a-1d9c9c72ad54 req-41210288-4e0d-4bce-abc1-850e6a75aa04 service nova] Creating event network-changed:36bb80eb-7c87-4394-9f37-81ecfb30df40 for instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 on n-h2-861111-1 Oct 12 22:57:21.491387 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-1d80d30a-7685-44b9-bd4a-1d9c9c72ad54 req-41210288-4e0d-4bce-abc1-850e6a75aa04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031622 Oct 12 22:57:21.492643 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3976/7303] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:23.173296 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 22:58:23.173860 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 22:58:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974/action (ip 10.222.0.16) !!! Oct 12 22:58:23.175070 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 22:58:23.175226 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 22:58:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974/action (ip 10.222.0.16) !!! Oct 12 22:58:23.176073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=11 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:23.176895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:23.181931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f59b7c9b-5245-4148-b99d-ba35fc05c5fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:23.185122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f59b7c9b-5245-4148-b99d-ba35fc05c5fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:23.195055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f59b7c9b-5245-4148-b99d-ba35fc05c5fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:23.195578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f59b7c9b-5245-4148-b99d-ba35fc05c5fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:23.196524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f59b7c9b-5245-4148-b99d-ba35fc05c5fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:23.197231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f59b7c9b-5245-4148-b99d-ba35fc05c5fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:23.197694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f59b7c9b-5245-4148-b99d-ba35fc05c5fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:23.198133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f59b7c9b-5245-4148-b99d-ba35fc05c5fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:23.227058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f59b7c9b-5245-4148-b99d-ba35fc05c5fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:23.232671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f59b7c9b-5245-4148-b99d-ba35fc05c5fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Old instance type m1.heat2, new instance type m1.heat {{(pid=120452) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:58:23.239381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f59b7c9b-5245-4148-b99d-ba35fc05c5fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:58:23.239814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f59b7c9b-5245-4148-b99d-ba35fc05c5fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:58:23.240297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f59b7c9b-5245-4148-b99d-ba35fc05c5fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:58:23.240719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f59b7c9b-5245-4148-b99d-ba35fc05c5fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:58:23.241141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f59b7c9b-5245-4148-b99d-ba35fc05c5fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:58:23.303569 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f59b7c9b-5245-4148-b99d-ba35fc05c5fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "POST /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974/action" status: 202 len: 0 microversion: 2.1 time: 0.133642 Oct 12 22:58:23.304175 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3328/7304] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:23 2022] POST /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:58:23.311575 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 22:58:23.312078 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 22:58:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 (ip 10.222.0.16) !!! Oct 12 22:58:23.312810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=11 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:23.313590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=46 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:23.318062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-357fb3d9-88d1-4900-bfcf-32c5b3ce8fd1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:23.318768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-357fb3d9-88d1-4900-bfcf-32c5b3ce8fd1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:23.330905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-357fb3d9-88d1-4900-bfcf-32c5b3ce8fd1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:23.331436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-357fb3d9-88d1-4900-bfcf-32c5b3ce8fd1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:23.331871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-357fb3d9-88d1-4900-bfcf-32c5b3ce8fd1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:23.332571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-357fb3d9-88d1-4900-bfcf-32c5b3ce8fd1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:23.333025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-357fb3d9-88d1-4900-bfcf-32c5b3ce8fd1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:23.333451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-357fb3d9-88d1-4900-bfcf-32c5b3ce8fd1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:23.497808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-357fb3d9-88d1-4900-bfcf-32c5b3ce8fd1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:23.505633 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-357fb3d9-88d1-4900-bfcf-32c5b3ce8fd1 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1675 microversion: 2.1 time: 0.197016 Oct 12 22:58:23.506312 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3977/7305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:23 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1675 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:24.530536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d69fc3bd-aecb-419b-ae8c-867244aa9833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:24.531122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d69fc3bd-aecb-419b-ae8c-867244aa9833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:24.537146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69fc3bd-aecb-419b-ae8c-867244aa9833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:24.537645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69fc3bd-aecb-419b-ae8c-867244aa9833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:24.538096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69fc3bd-aecb-419b-ae8c-867244aa9833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:24.538806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69fc3bd-aecb-419b-ae8c-867244aa9833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:24.539288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69fc3bd-aecb-419b-ae8c-867244aa9833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:24.539731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69fc3bd-aecb-419b-ae8c-867244aa9833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:24.751990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d69fc3bd-aecb-419b-ae8c-867244aa9833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:24.760537 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d69fc3bd-aecb-419b-ae8c-867244aa9833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1675 microversion: 2.1 time: 0.234937 Oct 12 22:58:24.761442 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3329/7306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:24 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1675 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:25.785899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-62e228a1-ced9-46db-b4e0-d6a0e6c74988 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:25.786518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-62e228a1-ced9-46db-b4e0-d6a0e6c74988 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:25.793974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e228a1-ced9-46db-b4e0-d6a0e6c74988 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:25.794493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e228a1-ced9-46db-b4e0-d6a0e6c74988 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:25.795013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e228a1-ced9-46db-b4e0-d6a0e6c74988 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:25.795749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e228a1-ced9-46db-b4e0-d6a0e6c74988 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:25.796207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e228a1-ced9-46db-b4e0-d6a0e6c74988 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:25.796636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e228a1-ced9-46db-b4e0-d6a0e6c74988 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:25.926953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-62e228a1-ced9-46db-b4e0-d6a0e6c74988 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:25.935303 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-62e228a1-ced9-46db-b4e0-d6a0e6c74988 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1680 microversion: 2.1 time: 0.154111 Oct 12 22:58:25.935888 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3978/7307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:25 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:58:26.960580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6863d2f2-458b-4662-9175-996b06f18b9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:26.961131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6863d2f2-458b-4662-9175-996b06f18b9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:26.968661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6863d2f2-458b-4662-9175-996b06f18b9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:26.969188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6863d2f2-458b-4662-9175-996b06f18b9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:26.969636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6863d2f2-458b-4662-9175-996b06f18b9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:26.970342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6863d2f2-458b-4662-9175-996b06f18b9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:26.970804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6863d2f2-458b-4662-9175-996b06f18b9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:26.971263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6863d2f2-458b-4662-9175-996b06f18b9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:27.100569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6863d2f2-458b-4662-9175-996b06f18b9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:27.108251 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6863d2f2-458b-4662-9175-996b06f18b9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1680 microversion: 2.1 time: 0.151689 Oct 12 22:58:27.108834 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3330/7308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:26 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:28.131936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6c4cd362-14b4-4c44-8271-9e73a3b664a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:28.132499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6c4cd362-14b4-4c44-8271-9e73a3b664a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:28.139319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c4cd362-14b4-4c44-8271-9e73a3b664a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:28.139804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c4cd362-14b4-4c44-8271-9e73a3b664a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:28.140241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c4cd362-14b4-4c44-8271-9e73a3b664a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:28.140933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c4cd362-14b4-4c44-8271-9e73a3b664a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:28.141388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c4cd362-14b4-4c44-8271-9e73a3b664a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:28.141821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6c4cd362-14b4-4c44-8271-9e73a3b664a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:28.267176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6c4cd362-14b4-4c44-8271-9e73a3b664a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:28.275321 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6c4cd362-14b4-4c44-8271-9e73a3b664a2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1680 microversion: 2.1 time: 0.147465 Oct 12 22:58:28.275889 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3979/7309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:28 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:29.299260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1e0a9bc2-cfca-4831-b086-0ac2c0ca8eb9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:29.299915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1e0a9bc2-cfca-4831-b086-0ac2c0ca8eb9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:29.307384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e0a9bc2-cfca-4831-b086-0ac2c0ca8eb9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:29.307883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e0a9bc2-cfca-4831-b086-0ac2c0ca8eb9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:29.308335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e0a9bc2-cfca-4831-b086-0ac2c0ca8eb9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:29.309042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e0a9bc2-cfca-4831-b086-0ac2c0ca8eb9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:29.309517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e0a9bc2-cfca-4831-b086-0ac2c0ca8eb9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:29.309961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e0a9bc2-cfca-4831-b086-0ac2c0ca8eb9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:29.441731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1e0a9bc2-cfca-4831-b086-0ac2c0ca8eb9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:29.449459 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1e0a9bc2-cfca-4831-b086-0ac2c0ca8eb9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1680 microversion: 2.1 time: 0.154149 Oct 12 22:58:29.450031 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3331/7310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:29 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:30.472874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-726703ea-9e62-4856-bb8e-0b29b77c8b34 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:30.473398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-726703ea-9e62-4856-bb8e-0b29b77c8b34 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:30.480325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-726703ea-9e62-4856-bb8e-0b29b77c8b34 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:30.480811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-726703ea-9e62-4856-bb8e-0b29b77c8b34 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:30.481249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-726703ea-9e62-4856-bb8e-0b29b77c8b34 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:30.481934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-726703ea-9e62-4856-bb8e-0b29b77c8b34 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:30.482383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-726703ea-9e62-4856-bb8e-0b29b77c8b34 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:30.482806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-726703ea-9e62-4856-bb8e-0b29b77c8b34 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:30.612412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-726703ea-9e62-4856-bb8e-0b29b77c8b34 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:30.621108 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-726703ea-9e62-4856-bb8e-0b29b77c8b34 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1680 microversion: 2.1 time: 0.152224 Oct 12 22:58:30.621688 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3980/7311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:30 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:31.644242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3e311382-b515-4fba-8b21-1ddfea39f22d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:31.644871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3e311382-b515-4fba-8b21-1ddfea39f22d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:31.652574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e311382-b515-4fba-8b21-1ddfea39f22d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:31.653077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e311382-b515-4fba-8b21-1ddfea39f22d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:31.653529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e311382-b515-4fba-8b21-1ddfea39f22d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:31.654230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e311382-b515-4fba-8b21-1ddfea39f22d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:31.654696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e311382-b515-4fba-8b21-1ddfea39f22d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:31.655136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e311382-b515-4fba-8b21-1ddfea39f22d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:31.781653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3e311382-b515-4fba-8b21-1ddfea39f22d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:31.789389 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3e311382-b515-4fba-8b21-1ddfea39f22d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1680 microversion: 2.1 time: 0.149089 Oct 12 22:58:31.789959 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3332/7312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:31 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:32.812371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-91ae9ffc-5d6f-4aff-bcdd-62dcbb8ae22c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:32.812990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-91ae9ffc-5d6f-4aff-bcdd-62dcbb8ae22c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:32.819842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91ae9ffc-5d6f-4aff-bcdd-62dcbb8ae22c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:32.820322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91ae9ffc-5d6f-4aff-bcdd-62dcbb8ae22c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:32.820761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91ae9ffc-5d6f-4aff-bcdd-62dcbb8ae22c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:32.821444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91ae9ffc-5d6f-4aff-bcdd-62dcbb8ae22c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:32.821898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91ae9ffc-5d6f-4aff-bcdd-62dcbb8ae22c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:32.822324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-91ae9ffc-5d6f-4aff-bcdd-62dcbb8ae22c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:32.948033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-91ae9ffc-5d6f-4aff-bcdd-62dcbb8ae22c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:32.955796 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-91ae9ffc-5d6f-4aff-bcdd-62dcbb8ae22c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1680 microversion: 2.1 time: 0.147402 Oct 12 22:58:32.956382 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3981/7313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:32 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:33.980063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f3cc815d-a987-4584-b6fa-1fb64a7b900f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:33.980748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f3cc815d-a987-4584-b6fa-1fb64a7b900f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:33.989943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3cc815d-a987-4584-b6fa-1fb64a7b900f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:33.990455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3cc815d-a987-4584-b6fa-1fb64a7b900f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:33.990888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3cc815d-a987-4584-b6fa-1fb64a7b900f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:33.991614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3cc815d-a987-4584-b6fa-1fb64a7b900f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:33.992082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3cc815d-a987-4584-b6fa-1fb64a7b900f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:33.992521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3cc815d-a987-4584-b6fa-1fb64a7b900f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:34.125177 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f3cc815d-a987-4584-b6fa-1fb64a7b900f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:34.132885 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f3cc815d-a987-4584-b6fa-1fb64a7b900f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1680 microversion: 2.1 time: 0.157241 Oct 12 22:58:34.133448 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3333/7314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:33 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:35.156211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-940fa413-5033-4498-ad0f-d5a2eab78ddb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:35.156757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-940fa413-5033-4498-ad0f-d5a2eab78ddb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:35.166020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-940fa413-5033-4498-ad0f-d5a2eab78ddb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:35.166505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-940fa413-5033-4498-ad0f-d5a2eab78ddb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:35.166950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-940fa413-5033-4498-ad0f-d5a2eab78ddb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:35.167678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-940fa413-5033-4498-ad0f-d5a2eab78ddb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:35.168139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-940fa413-5033-4498-ad0f-d5a2eab78ddb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:35.168567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-940fa413-5033-4498-ad0f-d5a2eab78ddb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:35.298882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-940fa413-5033-4498-ad0f-d5a2eab78ddb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:35.307358 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-940fa413-5033-4498-ad0f-d5a2eab78ddb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1680 microversion: 2.1 time: 0.155186 Oct 12 22:58:35.307934 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3982/7315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:35 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:36.330976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8494be09-091f-409d-ab55-355344c17449 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:36.331631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8494be09-091f-409d-ab55-355344c17449 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:36.338516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8494be09-091f-409d-ab55-355344c17449 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:36.339019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8494be09-091f-409d-ab55-355344c17449 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:36.339496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8494be09-091f-409d-ab55-355344c17449 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:36.340204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8494be09-091f-409d-ab55-355344c17449 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:36.340670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8494be09-091f-409d-ab55-355344c17449 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:36.341109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8494be09-091f-409d-ab55-355344c17449 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:36.469297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8494be09-091f-409d-ab55-355344c17449 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:36.477079 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8494be09-091f-409d-ab55-355344c17449 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1680 microversion: 2.1 time: 0.150032 Oct 12 22:58:36.477644 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3334/7316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:36 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:37.501104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4d69faa8-2465-4c3e-b67a-e8026b59f05d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:37.501750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4d69faa8-2465-4c3e-b67a-e8026b59f05d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:37.509111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d69faa8-2465-4c3e-b67a-e8026b59f05d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:37.509600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d69faa8-2465-4c3e-b67a-e8026b59f05d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:37.510044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d69faa8-2465-4c3e-b67a-e8026b59f05d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:37.510740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d69faa8-2465-4c3e-b67a-e8026b59f05d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:37.511195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d69faa8-2465-4c3e-b67a-e8026b59f05d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:37.511649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d69faa8-2465-4c3e-b67a-e8026b59f05d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:37.644701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4d69faa8-2465-4c3e-b67a-e8026b59f05d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:37.653565 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4d69faa8-2465-4c3e-b67a-e8026b59f05d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1680 microversion: 2.1 time: 0.156348 Oct 12 22:58:37.654161 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3983/7317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:37 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:38.366257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-43453c86-ca91-4c40-b045-cb47e901023f req-54966732-cb62-45b6-9ee6-d12885719736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3d132e-7e81-4f58-b6ea-b4e6c02d6974", "name": "network-vif-unplugged", "status": "completed", "tag": "36bb80eb-7c87-4394-9f37-81ecfb30df40"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:38.378093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-43453c86-ca91-4c40-b045-cb47e901023f req-54966732-cb62-45b6-9ee6-d12885719736 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:38.378695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-43453c86-ca91-4c40-b045-cb47e901023f req-54966732-cb62-45b6-9ee6-d12885719736 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:38.379297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-43453c86-ca91-4c40-b045-cb47e901023f req-54966732-cb62-45b6-9ee6-d12885719736 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:38.391299 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-43453c86-ca91-4c40-b045-cb47e901023f req-54966732-cb62-45b6-9ee6-d12885719736 service nova] Creating event network-vif-unplugged:36bb80eb-7c87-4394-9f37-81ecfb30df40 for instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 on n-h1-861111-1 Oct 12 22:58:38.397152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-43453c86-ca91-4c40-b045-cb47e901023f req-54966732-cb62-45b6-9ee6-d12885719736 service nova] Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:58:38.408222 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-43453c86-ca91-4c40-b045-cb47e901023f req-54966732-cb62-45b6-9ee6-d12885719736 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110074 Oct 12 22:58:38.408814 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3335/7318] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:38.677239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9d471380-1518-4b6b-bae9-5814c1989244 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:38.678015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9d471380-1518-4b6b-bae9-5814c1989244 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:38.685024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d471380-1518-4b6b-bae9-5814c1989244 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:38.685691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d471380-1518-4b6b-bae9-5814c1989244 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:38.686132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d471380-1518-4b6b-bae9-5814c1989244 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:38.687034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d471380-1518-4b6b-bae9-5814c1989244 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:38.687517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d471380-1518-4b6b-bae9-5814c1989244 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:38.687946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d471380-1518-4b6b-bae9-5814c1989244 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:38.821525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9d471380-1518-4b6b-bae9-5814c1989244 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:38.829536 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9d471380-1518-4b6b-bae9-5814c1989244 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1679 microversion: 2.1 time: 0.156447 Oct 12 22:58:38.830199 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3984/7319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:38 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:39.855975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-89945228-eb19-42bf-9466-34a8266d6cb8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:39.856690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-89945228-eb19-42bf-9466-34a8266d6cb8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:39.863102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89945228-eb19-42bf-9466-34a8266d6cb8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:39.863692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89945228-eb19-42bf-9466-34a8266d6cb8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:39.864143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89945228-eb19-42bf-9466-34a8266d6cb8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:39.864841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89945228-eb19-42bf-9466-34a8266d6cb8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:39.865305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89945228-eb19-42bf-9466-34a8266d6cb8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:39.865742 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89945228-eb19-42bf-9466-34a8266d6cb8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:39.997660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-89945228-eb19-42bf-9466-34a8266d6cb8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:40.005257 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-89945228-eb19-42bf-9466-34a8266d6cb8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1677 microversion: 2.1 time: 0.154996 Oct 12 22:58:40.005838 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3336/7320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:39 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:40.423085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-ec54a416-4eea-4d41-8bd0-74256605e6ca req-f8e100ca-28ca-47f6-8f95-47770eb7e545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e3d132e-7e81-4f58-b6ea-b4e6c02d6974", "tag": "36bb80eb-7c87-4394-9f37-81ecfb30df40"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:40.433196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ec54a416-4eea-4d41-8bd0-74256605e6ca req-f8e100ca-28ca-47f6-8f95-47770eb7e545 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:40.433665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ec54a416-4eea-4d41-8bd0-74256605e6ca req-f8e100ca-28ca-47f6-8f95-47770eb7e545 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:40.434093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ec54a416-4eea-4d41-8bd0-74256605e6ca req-f8e100ca-28ca-47f6-8f95-47770eb7e545 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:40.445377 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-ec54a416-4eea-4d41-8bd0-74256605e6ca req-f8e100ca-28ca-47f6-8f95-47770eb7e545 service nova] Creating event network-changed:36bb80eb-7c87-4394-9f37-81ecfb30df40 for instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 on n-h1-861111-1 Oct 12 22:58:40.451030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-ec54a416-4eea-4d41-8bd0-74256605e6ca req-f8e100ca-28ca-47f6-8f95-47770eb7e545 service nova] Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:58:40.462475 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-ec54a416-4eea-4d41-8bd0-74256605e6ca req-f8e100ca-28ca-47f6-8f95-47770eb7e545 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042364 Oct 12 22:58:40.462976 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3985/7321] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:58:41.029422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ee054c36-8835-4694-af7d-a972914b156c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:41.030204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ee054c36-8835-4694-af7d-a972914b156c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:41.037215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee054c36-8835-4694-af7d-a972914b156c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:41.037714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee054c36-8835-4694-af7d-a972914b156c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:41.038165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee054c36-8835-4694-af7d-a972914b156c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:41.038871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee054c36-8835-4694-af7d-a972914b156c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:41.040198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee054c36-8835-4694-af7d-a972914b156c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:41.040505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee054c36-8835-4694-af7d-a972914b156c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:41.328278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ee054c36-8835-4694-af7d-a972914b156c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:41.336241 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ee054c36-8835-4694-af7d-a972914b156c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1674 microversion: 2.1 time: 0.310778 Oct 12 22:58:41.337393 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3337/7322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:41 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1674 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:41.360540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-17304984-23fe-485b-a42e-21a5930dd213 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:41.361320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-17304984-23fe-485b-a42e-21a5930dd213 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:41.367947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17304984-23fe-485b-a42e-21a5930dd213 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:41.368738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17304984-23fe-485b-a42e-21a5930dd213 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:41.368906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17304984-23fe-485b-a42e-21a5930dd213 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:41.369589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17304984-23fe-485b-a42e-21a5930dd213 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:41.370047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17304984-23fe-485b-a42e-21a5930dd213 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:41.370500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17304984-23fe-485b-a42e-21a5930dd213 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:41.408432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17304984-23fe-485b-a42e-21a5930dd213 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:41.408920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17304984-23fe-485b-a42e-21a5930dd213 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:41.409360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17304984-23fe-485b-a42e-21a5930dd213 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:41.410089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17304984-23fe-485b-a42e-21a5930dd213 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:41.410544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17304984-23fe-485b-a42e-21a5930dd213 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:41.410974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17304984-23fe-485b-a42e-21a5930dd213 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:41.435933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-17304984-23fe-485b-a42e-21a5930dd213 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Getting quotas for project e44a4f6e4faa450b9850cd5bfbe53d59. Resources: {'ram', 'cores'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:58:41.441096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-17304984-23fe-485b-a42e-21a5930dd213 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Getting quotas for user dc38342011d04f98aa06f9474fe6f402 and project e44a4f6e4faa450b9850cd5bfbe53d59. Resources: {'ram', 'cores'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:58:41.544366 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-17304984-23fe-485b-a42e-21a5930dd213 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "POST /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974/action" status: 202 len: 0 microversion: 2.1 time: 0.187771 Oct 12 22:58:41.545348 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3986/7323] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:41 2022] POST /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:58:41.553564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-71216321-5281-4c8a-a9bc-aa81423e697c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:41.554193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-71216321-5281-4c8a-a9bc-aa81423e697c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:41.560180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71216321-5281-4c8a-a9bc-aa81423e697c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:41.560679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71216321-5281-4c8a-a9bc-aa81423e697c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:41.561130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71216321-5281-4c8a-a9bc-aa81423e697c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:41.561856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71216321-5281-4c8a-a9bc-aa81423e697c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:41.562319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71216321-5281-4c8a-a9bc-aa81423e697c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:41.562758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71216321-5281-4c8a-a9bc-aa81423e697c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:41.759964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-71216321-5281-4c8a-a9bc-aa81423e697c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:41.771850 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-71216321-5281-4c8a-a9bc-aa81423e697c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1673 microversion: 2.1 time: 0.222121 Oct 12 22:58:41.772655 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3338/7324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:41 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1673 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:42.797101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8758bd18-3e28-4209-882f-da8a718181e9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:42.798002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8758bd18-3e28-4209-882f-da8a718181e9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:42.806849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8758bd18-3e28-4209-882f-da8a718181e9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:42.807446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8758bd18-3e28-4209-882f-da8a718181e9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:42.807897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8758bd18-3e28-4209-882f-da8a718181e9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:42.808606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8758bd18-3e28-4209-882f-da8a718181e9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:42.809071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8758bd18-3e28-4209-882f-da8a718181e9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:42.809500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8758bd18-3e28-4209-882f-da8a718181e9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:42.952384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8758bd18-3e28-4209-882f-da8a718181e9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:42.960232 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8758bd18-3e28-4209-882f-da8a718181e9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1673 microversion: 2.1 time: 0.167491 Oct 12 22:58:42.960798 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3987/7325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:42 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:42.965558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-fedd0da2-51ff-4688-9f31-35043066d38e req-fd86984e-094b-43fa-a8d3-6e690cdd8053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3d132e-7e81-4f58-b6ea-b4e6c02d6974", "name": "network-vif-plugged", "status": "completed", "tag": "36bb80eb-7c87-4394-9f37-81ecfb30df40"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:42.975428 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fedd0da2-51ff-4688-9f31-35043066d38e req-fd86984e-094b-43fa-a8d3-6e690cdd8053 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:42.975933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fedd0da2-51ff-4688-9f31-35043066d38e req-fd86984e-094b-43fa-a8d3-6e690cdd8053 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:42.976583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fedd0da2-51ff-4688-9f31-35043066d38e req-fd86984e-094b-43fa-a8d3-6e690cdd8053 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:42.988974 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-fedd0da2-51ff-4688-9f31-35043066d38e req-fd86984e-094b-43fa-a8d3-6e690cdd8053 service nova] Creating event network-vif-plugged:36bb80eb-7c87-4394-9f37-81ecfb30df40 for instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 on n-h1-861111-1 Oct 12 22:58:42.994880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-fedd0da2-51ff-4688-9f31-35043066d38e req-fd86984e-094b-43fa-a8d3-6e690cdd8053 service nova] Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:58:43.005512 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-fedd0da2-51ff-4688-9f31-35043066d38e req-fd86984e-094b-43fa-a8d3-6e690cdd8053 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097780 Oct 12 22:58:43.006216 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3339/7326] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:43.983477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a2f75df2-236b-4e75-8502-c6bf1d9219b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:43.984013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a2f75df2-236b-4e75-8502-c6bf1d9219b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:43.990961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2f75df2-236b-4e75-8502-c6bf1d9219b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:43.991480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2f75df2-236b-4e75-8502-c6bf1d9219b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:43.991923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2f75df2-236b-4e75-8502-c6bf1d9219b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:43.993108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2f75df2-236b-4e75-8502-c6bf1d9219b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:43.993559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2f75df2-236b-4e75-8502-c6bf1d9219b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:43.993984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a2f75df2-236b-4e75-8502-c6bf1d9219b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:44.121460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a2f75df2-236b-4e75-8502-c6bf1d9219b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:44.129503 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a2f75df2-236b-4e75-8502-c6bf1d9219b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1673 microversion: 2.1 time: 0.150087 Oct 12 22:58:44.130062 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3988/7327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:43 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:44.835141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-5bb5ad39-4010-4ac4-afdf-676d77d6af4a req-77913d9c-fae2-45bf-8c7b-d00ca775bdf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3d132e-7e81-4f58-b6ea-b4e6c02d6974", "name": "network-vif-unplugged", "status": "completed", "tag": "36bb80eb-7c87-4394-9f37-81ecfb30df40"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:44.845534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5bb5ad39-4010-4ac4-afdf-676d77d6af4a req-77913d9c-fae2-45bf-8c7b-d00ca775bdf2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:44.846025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5bb5ad39-4010-4ac4-afdf-676d77d6af4a req-77913d9c-fae2-45bf-8c7b-d00ca775bdf2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:44.846511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5bb5ad39-4010-4ac4-afdf-676d77d6af4a req-77913d9c-fae2-45bf-8c7b-d00ca775bdf2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:44.858878 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-5bb5ad39-4010-4ac4-afdf-676d77d6af4a req-77913d9c-fae2-45bf-8c7b-d00ca775bdf2 service nova] Creating event network-vif-unplugged:36bb80eb-7c87-4394-9f37-81ecfb30df40 for instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 on n-h2-861111-1 Oct 12 22:58:44.864612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-5bb5ad39-4010-4ac4-afdf-676d77d6af4a req-77913d9c-fae2-45bf-8c7b-d00ca775bdf2 service nova] Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:58:44.875172 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-5bb5ad39-4010-4ac4-afdf-676d77d6af4a req-77913d9c-fae2-45bf-8c7b-d00ca775bdf2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046560 Oct 12 22:58:44.875959 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3340/7328] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:45.154017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3ffdfc7c-2bfe-4e13-80d8-0f61ed84a4fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:45.154636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3ffdfc7c-2bfe-4e13-80d8-0f61ed84a4fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:45.161576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ffdfc7c-2bfe-4e13-80d8-0f61ed84a4fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:45.162060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ffdfc7c-2bfe-4e13-80d8-0f61ed84a4fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:45.162496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ffdfc7c-2bfe-4e13-80d8-0f61ed84a4fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:45.163188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ffdfc7c-2bfe-4e13-80d8-0f61ed84a4fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:45.163668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ffdfc7c-2bfe-4e13-80d8-0f61ed84a4fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:45.164093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ffdfc7c-2bfe-4e13-80d8-0f61ed84a4fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:45.301553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3ffdfc7c-2bfe-4e13-80d8-0f61ed84a4fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:45.309450 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3ffdfc7c-2bfe-4e13-80d8-0f61ed84a4fa tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1673 microversion: 2.1 time: 0.159342 Oct 12 22:58:45.310146 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3989/7329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:45 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:46.334263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0a54ce48-ff46-4c4f-b696-48561a6cb6fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:46.334932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0a54ce48-ff46-4c4f-b696-48561a6cb6fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:46.341385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a54ce48-ff46-4c4f-b696-48561a6cb6fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:46.341885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a54ce48-ff46-4c4f-b696-48561a6cb6fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:46.342343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a54ce48-ff46-4c4f-b696-48561a6cb6fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:46.343056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a54ce48-ff46-4c4f-b696-48561a6cb6fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:46.343564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a54ce48-ff46-4c4f-b696-48561a6cb6fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:46.344011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a54ce48-ff46-4c4f-b696-48561a6cb6fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:46.474894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0a54ce48-ff46-4c4f-b696-48561a6cb6fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:46.483103 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0a54ce48-ff46-4c4f-b696-48561a6cb6fc tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1673 microversion: 2.1 time: 0.154059 Oct 12 22:58:46.483710 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3341/7330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:46 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:46.921433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-788ca147-ae81-4960-986c-2e6d88a38750 req-07f8dfc1-6775-4313-86b0-2fc90f9b0970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e3d132e-7e81-4f58-b6ea-b4e6c02d6974", "tag": "36bb80eb-7c87-4394-9f37-81ecfb30df40"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:46.931767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-788ca147-ae81-4960-986c-2e6d88a38750 req-07f8dfc1-6775-4313-86b0-2fc90f9b0970 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:46.932243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-788ca147-ae81-4960-986c-2e6d88a38750 req-07f8dfc1-6775-4313-86b0-2fc90f9b0970 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:46.932678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-788ca147-ae81-4960-986c-2e6d88a38750 req-07f8dfc1-6775-4313-86b0-2fc90f9b0970 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:46.944553 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-788ca147-ae81-4960-986c-2e6d88a38750 req-07f8dfc1-6775-4313-86b0-2fc90f9b0970 service nova] Creating event network-changed:36bb80eb-7c87-4394-9f37-81ecfb30df40 for instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 on n-h2-861111-1 Oct 12 22:58:46.950232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-788ca147-ae81-4960-986c-2e6d88a38750 req-07f8dfc1-6775-4313-86b0-2fc90f9b0970 service nova] Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:58:46.961739 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-788ca147-ae81-4960-986c-2e6d88a38750 req-07f8dfc1-6775-4313-86b0-2fc90f9b0970 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043671 Oct 12 22:58:46.962333 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3990/7331] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:47.507410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6c72f3a2-cf98-44af-8011-a2372de6982b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:47.508607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6c72f3a2-cf98-44af-8011-a2372de6982b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:47.515331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c72f3a2-cf98-44af-8011-a2372de6982b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:47.515834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c72f3a2-cf98-44af-8011-a2372de6982b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:47.516288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c72f3a2-cf98-44af-8011-a2372de6982b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:47.517026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c72f3a2-cf98-44af-8011-a2372de6982b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:47.517497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c72f3a2-cf98-44af-8011-a2372de6982b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:47.517941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c72f3a2-cf98-44af-8011-a2372de6982b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:47.647768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6c72f3a2-cf98-44af-8011-a2372de6982b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:47.655520 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6c72f3a2-cf98-44af-8011-a2372de6982b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1673 microversion: 2.1 time: 0.152010 Oct 12 22:58:47.656094 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3342/7332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:47 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:58:48.680413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1e9c4626-088e-4ece-8c82-378cbf31713f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:48.681404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1e9c4626-088e-4ece-8c82-378cbf31713f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:48.687768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e9c4626-088e-4ece-8c82-378cbf31713f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:48.688250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e9c4626-088e-4ece-8c82-378cbf31713f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:48.688688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e9c4626-088e-4ece-8c82-378cbf31713f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:48.689375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e9c4626-088e-4ece-8c82-378cbf31713f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:48.689853 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e9c4626-088e-4ece-8c82-378cbf31713f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:48.690279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1e9c4626-088e-4ece-8c82-378cbf31713f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:48.694237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:48.889569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1e9c4626-088e-4ece-8c82-378cbf31713f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:48.901226 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1e9c4626-088e-4ece-8c82-378cbf31713f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1673 microversion: 2.1 time: 0.225886 Oct 12 22:58:48.902594 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3991/7333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:48 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1673 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:49.926078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5a454394-ec7e-4981-8e9f-86bd7b482ad8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:49.926636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5a454394-ec7e-4981-8e9f-86bd7b482ad8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:49.933509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a454394-ec7e-4981-8e9f-86bd7b482ad8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:49.934015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a454394-ec7e-4981-8e9f-86bd7b482ad8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:49.934469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a454394-ec7e-4981-8e9f-86bd7b482ad8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:49.935179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a454394-ec7e-4981-8e9f-86bd7b482ad8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:49.935675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a454394-ec7e-4981-8e9f-86bd7b482ad8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:49.936120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a454394-ec7e-4981-8e9f-86bd7b482ad8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:50.069668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5a454394-ec7e-4981-8e9f-86bd7b482ad8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:50.077436 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5a454394-ec7e-4981-8e9f-86bd7b482ad8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1666 microversion: 2.1 time: 0.155383 Oct 12 22:58:50.078019 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3343/7334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:49 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:50.100198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-754f629b-0d43-4ef9-86a7-d65e72f5da6e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:50.100819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-754f629b-0d43-4ef9-86a7-d65e72f5da6e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:50.108187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-754f629b-0d43-4ef9-86a7-d65e72f5da6e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:50.108667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-754f629b-0d43-4ef9-86a7-d65e72f5da6e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:50.109103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-754f629b-0d43-4ef9-86a7-d65e72f5da6e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:50.109782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-754f629b-0d43-4ef9-86a7-d65e72f5da6e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:50.110230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-754f629b-0d43-4ef9-86a7-d65e72f5da6e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:50.110652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-754f629b-0d43-4ef9-86a7-d65e72f5da6e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:50.236582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-754f629b-0d43-4ef9-86a7-d65e72f5da6e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:50.244553 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-754f629b-0d43-4ef9-86a7-d65e72f5da6e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1666 microversion: 2.1 time: 0.148238 Oct 12 22:58:50.245119 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3992/7335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:50 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1666 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:50.266862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b99add64-609e-451a-b693-7feab35ad108 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:50.267508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b99add64-609e-451a-b693-7feab35ad108 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:50.273339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b99add64-609e-451a-b693-7feab35ad108 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:50.274443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b99add64-609e-451a-b693-7feab35ad108 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:50.274888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b99add64-609e-451a-b693-7feab35ad108 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:50.275613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b99add64-609e-451a-b693-7feab35ad108 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:50.276074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b99add64-609e-451a-b693-7feab35ad108 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:50.276510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b99add64-609e-451a-b693-7feab35ad108 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:50.280503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:50.403461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b99add64-609e-451a-b693-7feab35ad108 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:50.411103 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b99add64-609e-451a-b693-7feab35ad108 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1666 microversion: 2.1 time: 0.148104 Oct 12 22:58:50.411703 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3344/7336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:50 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1666 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:50.432903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2feaa422-b53c-4284-8c0e-ff174add2b2c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:50.433410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2feaa422-b53c-4284-8c0e-ff174add2b2c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:50.439475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2feaa422-b53c-4284-8c0e-ff174add2b2c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:50.439888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2feaa422-b53c-4284-8c0e-ff174add2b2c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:50.440325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2feaa422-b53c-4284-8c0e-ff174add2b2c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:50.441019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2feaa422-b53c-4284-8c0e-ff174add2b2c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:50.441477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2feaa422-b53c-4284-8c0e-ff174add2b2c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:50.441911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2feaa422-b53c-4284-8c0e-ff174add2b2c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:50.466580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2feaa422-b53c-4284-8c0e-ff174add2b2c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:58:50.540866 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2feaa422-b53c-4284-8c0e-ff174add2b2c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 204 len: 0 microversion: 2.1 time: 0.111508 Oct 12 22:58:50.541529 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3993/7337] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 22:58:50 2022] DELETE /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:58:50.549832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ec2afbc4-b1ef-4a41-a286-67ca4f5545fb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:50.550459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ec2afbc4-b1ef-4a41-a286-67ca4f5545fb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:50.556471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec2afbc4-b1ef-4a41-a286-67ca4f5545fb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:50.556972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec2afbc4-b1ef-4a41-a286-67ca4f5545fb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:50.557427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec2afbc4-b1ef-4a41-a286-67ca4f5545fb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:50.558133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec2afbc4-b1ef-4a41-a286-67ca4f5545fb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:50.558603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec2afbc4-b1ef-4a41-a286-67ca4f5545fb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:50.559045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec2afbc4-b1ef-4a41-a286-67ca4f5545fb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:50.689306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ec2afbc4-b1ef-4a41-a286-67ca4f5545fb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:50.697348 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ec2afbc4-b1ef-4a41-a286-67ca4f5545fb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1672 microversion: 2.1 time: 0.151439 Oct 12 22:58:50.697928 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3345/7338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:50 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:50.850689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f556766e-990b-47f0-a2e0-743e15f5941f req-de010e01-adc0-4efd-86dc-dae2bebbde5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3d132e-7e81-4f58-b6ea-b4e6c02d6974", "name": "network-vif-plugged", "status": "completed", "tag": "36bb80eb-7c87-4394-9f37-81ecfb30df40"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:50.860901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f556766e-990b-47f0-a2e0-743e15f5941f req-de010e01-adc0-4efd-86dc-dae2bebbde5a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:50.861386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f556766e-990b-47f0-a2e0-743e15f5941f req-de010e01-adc0-4efd-86dc-dae2bebbde5a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:50.861824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f556766e-990b-47f0-a2e0-743e15f5941f req-de010e01-adc0-4efd-86dc-dae2bebbde5a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:50.873584 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f556766e-990b-47f0-a2e0-743e15f5941f req-de010e01-adc0-4efd-86dc-dae2bebbde5a service nova] Creating event network-vif-plugged:36bb80eb-7c87-4394-9f37-81ecfb30df40 for instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 on n-h2-861111-1 Oct 12 22:58:50.878404 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f556766e-990b-47f0-a2e0-743e15f5941f req-de010e01-adc0-4efd-86dc-dae2bebbde5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031892 Oct 12 22:58:50.879002 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3994/7339] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:51.722353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-98442f5f-9dea-4d17-8682-b3174a2e5573 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:51.722984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-98442f5f-9dea-4d17-8682-b3174a2e5573 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:51.730337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98442f5f-9dea-4d17-8682-b3174a2e5573 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:51.730834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98442f5f-9dea-4d17-8682-b3174a2e5573 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:51.731314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98442f5f-9dea-4d17-8682-b3174a2e5573 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:51.732020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98442f5f-9dea-4d17-8682-b3174a2e5573 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:51.732489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98442f5f-9dea-4d17-8682-b3174a2e5573 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:51.732934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98442f5f-9dea-4d17-8682-b3174a2e5573 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:51.859989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-98442f5f-9dea-4d17-8682-b3174a2e5573 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:51.868578 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-98442f5f-9dea-4d17-8682-b3174a2e5573 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1672 microversion: 2.1 time: 0.150290 Oct 12 22:58:51.869248 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3346/7340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:51 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:52.700572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:52.705782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-3e414924-0d94-4fbc-b427-be59981336b4 req-5eea551d-534b-4bd1-ad49-8b3f144dbc83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3d132e-7e81-4f58-b6ea-b4e6c02d6974", "name": "network-vif-deleted", "tag": "36bb80eb-7c87-4394-9f37-81ecfb30df40"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:52.716956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3e414924-0d94-4fbc-b427-be59981336b4 req-5eea551d-534b-4bd1-ad49-8b3f144dbc83 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:52.717450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3e414924-0d94-4fbc-b427-be59981336b4 req-5eea551d-534b-4bd1-ad49-8b3f144dbc83 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:52.717891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3e414924-0d94-4fbc-b427-be59981336b4 req-5eea551d-534b-4bd1-ad49-8b3f144dbc83 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:52.730441 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-3e414924-0d94-4fbc-b427-be59981336b4 req-5eea551d-534b-4bd1-ad49-8b3f144dbc83 service nova] Creating event network-vif-deleted:36bb80eb-7c87-4394-9f37-81ecfb30df40 for instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 on n-h2-861111-1 Oct 12 22:58:52.735186 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-3e414924-0d94-4fbc-b427-be59981336b4 req-5eea551d-534b-4bd1-ad49-8b3f144dbc83 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036274 Oct 12 22:58:52.735820 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3995/7341] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:52.892242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9180036d-b365-4766-9a34-e434eaa4cd89 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:52.892867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9180036d-b365-4766-9a34-e434eaa4cd89 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:52.899784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9180036d-b365-4766-9a34-e434eaa4cd89 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:52.900280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9180036d-b365-4766-9a34-e434eaa4cd89 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:52.900732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9180036d-b365-4766-9a34-e434eaa4cd89 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:52.901439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9180036d-b365-4766-9a34-e434eaa4cd89 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:52.901902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9180036d-b365-4766-9a34-e434eaa4cd89 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:52.902341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9180036d-b365-4766-9a34-e434eaa4cd89 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:52.933677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9180036d-b365-4766-9a34-e434eaa4cd89 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:52.934172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9180036d-b365-4766-9a34-e434eaa4cd89 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:52.934623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9180036d-b365-4766-9a34-e434eaa4cd89 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:52.935082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-9180036d-b365-4766-9a34-e434eaa4cd89 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lazy-loading 'fault' on Instance uuid 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:58:52.976231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9180036d-b365-4766-9a34-e434eaa4cd89 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:52.984053 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9180036d-b365-4766-9a34-e434eaa4cd89 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 200 len: 1328 microversion: 2.1 time: 0.095749 Oct 12 22:58:52.984719 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3347/7342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:52 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:58:54.010030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-80afb182-3ff7-4768-873e-b30ea5e62716 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:54.010776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-80afb182-3ff7-4768-873e-b30ea5e62716 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:54.012727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:54.019305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80afb182-3ff7-4768-873e-b30ea5e62716 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.019798 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80afb182-3ff7-4768-873e-b30ea5e62716 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.020291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80afb182-3ff7-4768-873e-b30ea5e62716 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.020988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80afb182-3ff7-4768-873e-b30ea5e62716 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.021448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80afb182-3ff7-4768-873e-b30ea5e62716 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.021880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-80afb182-3ff7-4768-873e-b30ea5e62716 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.036519 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-80afb182-3ff7-4768-873e-b30ea5e62716 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] HTTP exception thrown: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-80afb182-3ff7-4768-873e-b30ea5e62716 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Request method failure captured: Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 HTTP/1.1 Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0WrKQiBfy0XSANASA5fCFbD4GR8tuMwOAMN25efH-T8eGJGJ9GqINSx71zrrS3STQYGkkMmRKLW9d4tVwDR4SqLAQg3JTIXjTWQBGkushtLJhuadXQwH02STvq4BQuhp2LfpRdQBY1OcY_j-rJ13jlHiZrptRT0JEkKLcabSXJo4D8 Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e44a4f6e4faa450b9850cd5bfbe53d59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerActionsTestJSON-486969938 Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerActionsTestJSON-486969938-project Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: dc38342011d04f98aa06f9474fe6f402 Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerActionsTestJSON-486969938-project Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '8e3d132e-7e81-4f58-b6ea-b4e6c02d6974'} Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:58:54.038149 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:58:54.045216 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:58:54.045216 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:58:54.045216 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:58:54.045216 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:58:54.045216 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:58:54.045216 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 22:58:54.045216 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 22:58:54.045216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-80afb182-3ff7-4768-873e-b30ea5e62716 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Returning 404 to user: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:58:54.045216 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-80afb182-3ff7-4768-873e-b30ea5e62716 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 404 len: 111 microversion: 2.1 time: 0.035182 Oct 12 22:58:54.045216 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3996/7343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:54 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:58:54.054814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b7a9e672-21d7-4cd0-99b3-dbd4a432fc38 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:54.055475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b7a9e672-21d7-4cd0-99b3-dbd4a432fc38 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:54.058108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=47 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:54.063254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7a9e672-21d7-4cd0-99b3-dbd4a432fc38 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.063755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7a9e672-21d7-4cd0-99b3-dbd4a432fc38 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.064205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7a9e672-21d7-4cd0-99b3-dbd4a432fc38 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.064904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7a9e672-21d7-4cd0-99b3-dbd4a432fc38 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.065368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7a9e672-21d7-4cd0-99b3-dbd4a432fc38 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.065811 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7a9e672-21d7-4cd0-99b3-dbd4a432fc38 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.079603 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-b7a9e672-21d7-4cd0-99b3-dbd4a432fc38 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] HTTP exception thrown: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b7a9e672-21d7-4cd0-99b3-dbd4a432fc38 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Request method failure captured: Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 HTTP/1.1 Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0WrKQiBfy0XSANASA5fCFbD4GR8tuMwOAMN25efH-T8eGJGJ9GqINSx71zrrS3STQYGkkMmRKLW9d4tVwDR4SqLAQg3JTIXjTWQBGkushtLJhuadXQwH02STvq4BQuhp2LfpRdQBY1OcY_j-rJ13jlHiZrptRT0JEkKLcabSXJo4D8 Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e44a4f6e4faa450b9850cd5bfbe53d59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerActionsTestJSON-486969938 Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerActionsTestJSON-486969938-project Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: dc38342011d04f98aa06f9474fe6f402 Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerActionsTestJSON-486969938-project Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '8e3d132e-7e81-4f58-b6ea-b4e6c02d6974'} Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:58:54.081283 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:58:54.085870 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:58:54.085870 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:58:54.085870 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:58:54.085870 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:58:54.085870 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:58:54.085870 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 22:58:54.085870 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 22:58:54.085870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b7a9e672-21d7-4cd0-99b3-dbd4a432fc38 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Returning 404 to user: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:58:54.085870 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b7a9e672-21d7-4cd0-99b3-dbd4a432fc38 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 404 len: 111 microversion: 2.1 time: 0.031856 Oct 12 22:58:54.085870 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3348/7344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:54 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:58:54.129866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1433085133", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "9e6b601d-4bd2-489e-9269-4cf57f84b9f1"}], "security_groups": [{"name": "tempest-securitygroup--91822578"}], "key_name": "tempest-keypair-1203075025", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:54.238537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] validate_networks() for [('9e6b601d-4bd2-489e-9269-4cf57f84b9f1', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:58:54.950201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:58:54.950641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:58:54.951126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:58:54.951571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:58:54.951987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:58:54.963525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.964000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.964432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.965149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.965598 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.966018 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.982263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Getting quotas for project e44a4f6e4faa450b9850cd5bfbe53d59. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:58:54.987506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Getting quotas for user dc38342011d04f98aa06f9474fe6f402 and project e44a4f6e4faa450b9850cd5bfbe53d59. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:58:55.000328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:58:55.002610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:58:55.048335 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a297439d-5516-43c9-8a90-3541c58c0080 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.922272 Oct 12 22:58:55.049683 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3997/7345] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 22:58:54 2022] POST /compute/v2.1/servers => generated 404 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:58:55.060778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ddf43cef-7804-4333-8efa-dfca1558139d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:55.061408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ddf43cef-7804-4333-8efa-dfca1558139d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:55.118005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ddf43cef-7804-4333-8efa-dfca1558139d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:55.128791 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ddf43cef-7804-4333-8efa-dfca1558139d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1239 microversion: 2.1 time: 0.071779 Oct 12 22:58:55.129365 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3349/7346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:55 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:56.156232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d4ba0495-926e-41a0-9520-79e88069cc0f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:56.157089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d4ba0495-926e-41a0-9520-79e88069cc0f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:56.164657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4ba0495-926e-41a0-9520-79e88069cc0f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:56.165425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4ba0495-926e-41a0-9520-79e88069cc0f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:56.165968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4ba0495-926e-41a0-9520-79e88069cc0f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:56.166677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4ba0495-926e-41a0-9520-79e88069cc0f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:56.167135 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4ba0495-926e-41a0-9520-79e88069cc0f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:56.167710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4ba0495-926e-41a0-9520-79e88069cc0f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:56.229595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d4ba0495-926e-41a0-9520-79e88069cc0f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:56.237283 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d4ba0495-926e-41a0-9520-79e88069cc0f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1297 microversion: 2.1 time: 0.088658 Oct 12 22:58:56.237847 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3998/7347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:56 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:57.262100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1b083946-abd0-4a99-9549-b90b1d56f90e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:57.262733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1b083946-abd0-4a99-9549-b90b1d56f90e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:57.269704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b083946-abd0-4a99-9549-b90b1d56f90e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:57.270201 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b083946-abd0-4a99-9549-b90b1d56f90e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:57.270652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b083946-abd0-4a99-9549-b90b1d56f90e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:57.271397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b083946-abd0-4a99-9549-b90b1d56f90e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:57.271862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b083946-abd0-4a99-9549-b90b1d56f90e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:57.272300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b083946-abd0-4a99-9549-b90b1d56f90e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:57.466292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1b083946-abd0-4a99-9549-b90b1d56f90e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:57.473347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-70d1f18d-86a4-405b-a549-fcaca801c1fc req-0590b6d8-23b5-4fc5-8c0f-983d6f7f8552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2", "tag": "491fbd96-f1e3-4077-8a2b-06901af984f6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:57.480490 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1b083946-abd0-4a99-9549-b90b1d56f90e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1363 microversion: 2.1 time: 0.222281 Oct 12 22:58:57.481086 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3350/7348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:57 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:57.486148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-70d1f18d-86a4-405b-a549-fcaca801c1fc req-0590b6d8-23b5-4fc5-8c0f-983d6f7f8552 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:57.486633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-70d1f18d-86a4-405b-a549-fcaca801c1fc req-0590b6d8-23b5-4fc5-8c0f-983d6f7f8552 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:57.487067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-70d1f18d-86a4-405b-a549-fcaca801c1fc req-0590b6d8-23b5-4fc5-8c0f-983d6f7f8552 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:57.500004 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-70d1f18d-86a4-405b-a549-fcaca801c1fc req-0590b6d8-23b5-4fc5-8c0f-983d6f7f8552 service nova] Creating event network-changed:491fbd96-f1e3-4077-8a2b-06901af984f6 for instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 on n-h2-861111-1 Oct 12 22:58:57.504663 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-70d1f18d-86a4-405b-a549-fcaca801c1fc req-0590b6d8-23b5-4fc5-8c0f-983d6f7f8552 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035387 Oct 12 22:58:57.505940 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 3999/7349] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:58.506168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-16bbde32-b3eb-4a6a-871e-8764ea1e045b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:58.506798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-16bbde32-b3eb-4a6a-871e-8764ea1e045b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:58.514044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16bbde32-b3eb-4a6a-871e-8764ea1e045b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:58.514543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16bbde32-b3eb-4a6a-871e-8764ea1e045b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:58.514991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16bbde32-b3eb-4a6a-871e-8764ea1e045b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:58.515727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16bbde32-b3eb-4a6a-871e-8764ea1e045b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:58.516197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16bbde32-b3eb-4a6a-871e-8764ea1e045b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:58.516636 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16bbde32-b3eb-4a6a-871e-8764ea1e045b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:58.650289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-16bbde32-b3eb-4a6a-871e-8764ea1e045b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:58.657947 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-16bbde32-b3eb-4a6a-871e-8764ea1e045b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1363 microversion: 2.1 time: 0.155788 Oct 12 22:58:58.658540 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3351/7350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:58 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:59.683337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8758cf18-5549-4239-996b-50adc04352c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:59.684003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8758cf18-5549-4239-996b-50adc04352c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:59.690242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8758cf18-5549-4239-996b-50adc04352c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:59.690728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8758cf18-5549-4239-996b-50adc04352c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:59.691171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8758cf18-5549-4239-996b-50adc04352c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:59.691886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8758cf18-5549-4239-996b-50adc04352c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:59.692343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8758cf18-5549-4239-996b-50adc04352c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:59.692773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8758cf18-5549-4239-996b-50adc04352c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:59.822513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8758cf18-5549-4239-996b-50adc04352c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:59.830615 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8758cf18-5549-4239-996b-50adc04352c4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1363 microversion: 2.1 time: 0.152957 Oct 12 22:58:59.831412 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4000/7351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:59 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:00.854042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ecce5c84-7179-423d-a6c0-2b0c1bd1b501 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:00.854671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ecce5c84-7179-423d-a6c0-2b0c1bd1b501 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:00.861653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecce5c84-7179-423d-a6c0-2b0c1bd1b501 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:00.862150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecce5c84-7179-423d-a6c0-2b0c1bd1b501 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:00.862600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecce5c84-7179-423d-a6c0-2b0c1bd1b501 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:00.863592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecce5c84-7179-423d-a6c0-2b0c1bd1b501 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:00.864083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecce5c84-7179-423d-a6c0-2b0c1bd1b501 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:00.864497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ecce5c84-7179-423d-a6c0-2b0c1bd1b501 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:00.995592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ecce5c84-7179-423d-a6c0-2b0c1bd1b501 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:01.003368 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ecce5c84-7179-423d-a6c0-2b0c1bd1b501 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1363 microversion: 2.1 time: 0.153297 Oct 12 22:59:01.003946 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3352/7352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:00 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:02.028133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b25e60c8-2eb7-47c7-bc16-3860c3722847 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:02.028649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b25e60c8-2eb7-47c7-bc16-3860c3722847 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:02.035540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b25e60c8-2eb7-47c7-bc16-3860c3722847 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:02.036022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b25e60c8-2eb7-47c7-bc16-3860c3722847 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:02.036458 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b25e60c8-2eb7-47c7-bc16-3860c3722847 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:02.037146 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b25e60c8-2eb7-47c7-bc16-3860c3722847 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:02.037599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b25e60c8-2eb7-47c7-bc16-3860c3722847 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:02.038024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b25e60c8-2eb7-47c7-bc16-3860c3722847 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:02.167638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b25e60c8-2eb7-47c7-bc16-3860c3722847 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:02.175170 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b25e60c8-2eb7-47c7-bc16-3860c3722847 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1363 microversion: 2.1 time: 0.151605 Oct 12 22:59:02.175760 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4001/7353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:02 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:02.921436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-103432d5-c8a7-4f69-b995-1100bca0de30 req-670f1700-2068-43f5-aef0-68408fc3cdb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2", "name": "network-vif-plugged", "status": "completed", "tag": "491fbd96-f1e3-4077-8a2b-06901af984f6"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:02.931755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-103432d5-c8a7-4f69-b995-1100bca0de30 req-670f1700-2068-43f5-aef0-68408fc3cdb7 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:02.932253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-103432d5-c8a7-4f69-b995-1100bca0de30 req-670f1700-2068-43f5-aef0-68408fc3cdb7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:02.932710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-103432d5-c8a7-4f69-b995-1100bca0de30 req-670f1700-2068-43f5-aef0-68408fc3cdb7 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:02.943874 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-103432d5-c8a7-4f69-b995-1100bca0de30 req-670f1700-2068-43f5-aef0-68408fc3cdb7 service nova] Creating event network-vif-plugged:491fbd96-f1e3-4077-8a2b-06901af984f6 for instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 on n-h2-861111-1 Oct 12 22:59:02.949259 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-103432d5-c8a7-4f69-b995-1100bca0de30 req-670f1700-2068-43f5-aef0-68408fc3cdb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032077 Oct 12 22:59:02.949856 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3353/7354] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:59:03.198670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aae6b632-2ddc-4fa6-acf9-c415d49571e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:03.199193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aae6b632-2ddc-4fa6-acf9-c415d49571e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:03.206350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aae6b632-2ddc-4fa6-acf9-c415d49571e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:03.206862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aae6b632-2ddc-4fa6-acf9-c415d49571e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:03.207336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aae6b632-2ddc-4fa6-acf9-c415d49571e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:03.208032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aae6b632-2ddc-4fa6-acf9-c415d49571e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:03.208487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aae6b632-2ddc-4fa6-acf9-c415d49571e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:03.208919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aae6b632-2ddc-4fa6-acf9-c415d49571e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:03.338330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-aae6b632-2ddc-4fa6-acf9-c415d49571e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:03.346135 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aae6b632-2ddc-4fa6-acf9-c415d49571e4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1363 microversion: 2.1 time: 0.151943 Oct 12 22:59:03.346706 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4002/7355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:03 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:04.371430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eddba40e-1e12-4584-83c8-e9ce7b4bfb8f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:04.372181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eddba40e-1e12-4584-83c8-e9ce7b4bfb8f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:04.378471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eddba40e-1e12-4584-83c8-e9ce7b4bfb8f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:04.378976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eddba40e-1e12-4584-83c8-e9ce7b4bfb8f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:04.379517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eddba40e-1e12-4584-83c8-e9ce7b4bfb8f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:04.380240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eddba40e-1e12-4584-83c8-e9ce7b4bfb8f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:04.380711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eddba40e-1e12-4584-83c8-e9ce7b4bfb8f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:04.381153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eddba40e-1e12-4584-83c8-e9ce7b4bfb8f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:04.517877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eddba40e-1e12-4584-83c8-e9ce7b4bfb8f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:04.525721 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eddba40e-1e12-4584-83c8-e9ce7b4bfb8f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1363 microversion: 2.1 time: 0.160039 Oct 12 22:59:04.526291 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3354/7356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:04 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:05.551721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7f36c702-8f3a-45b5-a4bf-d4cf28d8a833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:05.552343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7f36c702-8f3a-45b5-a4bf-d4cf28d8a833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:05.555471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:05.556142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:05.561940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f36c702-8f3a-45b5-a4bf-d4cf28d8a833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:05.562431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f36c702-8f3a-45b5-a4bf-d4cf28d8a833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:05.562881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f36c702-8f3a-45b5-a4bf-d4cf28d8a833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:05.563606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f36c702-8f3a-45b5-a4bf-d4cf28d8a833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:05.564063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f36c702-8f3a-45b5-a4bf-d4cf28d8a833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:05.564499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f36c702-8f3a-45b5-a4bf-d4cf28d8a833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:05.693636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7f36c702-8f3a-45b5-a4bf-d4cf28d8a833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:05.702082 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7f36c702-8f3a-45b5-a4bf-d4cf28d8a833 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1549 microversion: 2.1 time: 0.154294 Oct 12 22:59:05.702670 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4003/7357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:05 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:05.725024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e36e5b52-5438-4b74-a415-e4fca5dea488 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:05.725540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e36e5b52-5438-4b74-a415-e4fca5dea488 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:05.727585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:05.733657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e36e5b52-5438-4b74-a415-e4fca5dea488 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:05.734155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e36e5b52-5438-4b74-a415-e4fca5dea488 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:05.734611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e36e5b52-5438-4b74-a415-e4fca5dea488 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:05.735353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e36e5b52-5438-4b74-a415-e4fca5dea488 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:05.735824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e36e5b52-5438-4b74-a415-e4fca5dea488 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:05.736267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e36e5b52-5438-4b74-a415-e4fca5dea488 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:05.812647 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e36e5b52-5438-4b74-a415-e4fca5dea488 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091447 Oct 12 22:59:05.813256 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3355/7358] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 22:59:05 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:59:06.724573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-196e972f-8b8a-41b0-a1a5-107d03cb8159 req-44450b4f-d3c1-4ed0-b718-65730cbab4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2", "tag": "491fbd96-f1e3-4077-8a2b-06901af984f6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:06.734792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-196e972f-8b8a-41b0-a1a5-107d03cb8159 req-44450b4f-d3c1-4ed0-b718-65730cbab4a5 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:06.735379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-196e972f-8b8a-41b0-a1a5-107d03cb8159 req-44450b4f-d3c1-4ed0-b718-65730cbab4a5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:06.735896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-196e972f-8b8a-41b0-a1a5-107d03cb8159 req-44450b4f-d3c1-4ed0-b718-65730cbab4a5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:06.749854 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-196e972f-8b8a-41b0-a1a5-107d03cb8159 req-44450b4f-d3c1-4ed0-b718-65730cbab4a5 service nova] Creating event network-changed:491fbd96-f1e3-4077-8a2b-06901af984f6 for instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 on n-h2-861111-1 Oct 12 22:59:06.754819 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-196e972f-8b8a-41b0-a1a5-107d03cb8159 req-44450b4f-d3c1-4ed0-b718-65730cbab4a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033921 Oct 12 22:59:06.755833 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4004/7359] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 22:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:00:20.360144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=17 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:20.360965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=56 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:20.367019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9411d133-04f1-45d7-8472-554051aaaa96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:20.367623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9411d133-04f1-45d7-8472-554051aaaa96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:20.374606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9411d133-04f1-45d7-8472-554051aaaa96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:20.375062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9411d133-04f1-45d7-8472-554051aaaa96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:20.375570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9411d133-04f1-45d7-8472-554051aaaa96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:20.376274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9411d133-04f1-45d7-8472-554051aaaa96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:20.376748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9411d133-04f1-45d7-8472-554051aaaa96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:20.377233 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9411d133-04f1-45d7-8472-554051aaaa96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:20.510067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9411d133-04f1-45d7-8472-554051aaaa96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:20.517807 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9411d133-04f1-45d7-8472-554051aaaa96 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1667 microversion: 2.1 time: 0.160131 Oct 12 23:00:20.518381 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3356/7360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:20 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1667 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:20.539725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:20.540471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:20.546992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3a2b93f3-bdb2-46bf-bd1d-e1c28857b4f5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d55f1fd6-785a-4bbd-86e9-359bca693792"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:20.549410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3a2b93f3-bdb2-46bf-bd1d-e1c28857b4f5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:20.560696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a2b93f3-bdb2-46bf-bd1d-e1c28857b4f5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:20.561178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a2b93f3-bdb2-46bf-bd1d-e1c28857b4f5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:20.561642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a2b93f3-bdb2-46bf-bd1d-e1c28857b4f5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:20.562331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a2b93f3-bdb2-46bf-bd1d-e1c28857b4f5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:20.562779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a2b93f3-bdb2-46bf-bd1d-e1c28857b4f5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:20.563204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3a2b93f3-bdb2-46bf-bd1d-e1c28857b4f5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:20.797708 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3a2b93f3-bdb2-46bf-bd1d-e1c28857b4f5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "POST /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260919 Oct 12 23:00:20.798348 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4005/7361] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 23:00:20 2022] POST /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:00:31.510307 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3a00d770-6f77-45ba-8161-247c61b7d5ac tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:31.512622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3a00d770-6f77-45ba-8161-247c61b7d5ac tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:31.516042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:31.516752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:31.524628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a00d770-6f77-45ba-8161-247c61b7d5ac tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:31.525120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a00d770-6f77-45ba-8161-247c61b7d5ac tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:31.525575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a00d770-6f77-45ba-8161-247c61b7d5ac tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:31.526290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a00d770-6f77-45ba-8161-247c61b7d5ac tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:31.526759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a00d770-6f77-45ba-8161-247c61b7d5ac tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:31.527199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a00d770-6f77-45ba-8161-247c61b7d5ac tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:31.554999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3a00d770-6f77-45ba-8161-247c61b7d5ac tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:31.563294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3a00d770-6f77-45ba-8161-247c61b7d5ac tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Old instance type m1.heat2, new instance type m1.heat {{(pid=120452) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 23:00:31.570275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3a00d770-6f77-45ba-8161-247c61b7d5ac tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:00:31.570711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3a00d770-6f77-45ba-8161-247c61b7d5ac tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:00:31.571198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3a00d770-6f77-45ba-8161-247c61b7d5ac tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:00:31.571652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3a00d770-6f77-45ba-8161-247c61b7d5ac tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:00:31.572081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3a00d770-6f77-45ba-8161-247c61b7d5ac tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:00:31.637956 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3a00d770-6f77-45ba-8161-247c61b7d5ac tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "POST /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2/action" status: 202 len: 0 microversion: 2.1 time: 0.131529 Oct 12 23:00:31.638630 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3357/7362] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:00:31 2022] POST /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:00:31.645735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:31.646672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:31.651097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-53a31c9f-c39e-454a-bbc2-76a8657d7f5b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:31.651843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-53a31c9f-c39e-454a-bbc2-76a8657d7f5b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:31.663648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53a31c9f-c39e-454a-bbc2-76a8657d7f5b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:31.664148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53a31c9f-c39e-454a-bbc2-76a8657d7f5b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:31.664592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53a31c9f-c39e-454a-bbc2-76a8657d7f5b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:31.665386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53a31c9f-c39e-454a-bbc2-76a8657d7f5b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:31.665849 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53a31c9f-c39e-454a-bbc2-76a8657d7f5b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:31.666365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-53a31c9f-c39e-454a-bbc2-76a8657d7f5b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:31.831047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-53a31c9f-c39e-454a-bbc2-76a8657d7f5b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:31.839501 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-53a31c9f-c39e-454a-bbc2-76a8657d7f5b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1722 microversion: 2.1 time: 0.195848 Oct 12 23:00:31.840073 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4006/7363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:31 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:32.863945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3539fb89-9377-4995-a817-116eedb165a4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:32.864590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3539fb89-9377-4995-a817-116eedb165a4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:32.878719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3539fb89-9377-4995-a817-116eedb165a4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:32.879246 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3539fb89-9377-4995-a817-116eedb165a4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:32.879722 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3539fb89-9377-4995-a817-116eedb165a4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:32.880447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3539fb89-9377-4995-a817-116eedb165a4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:32.880921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3539fb89-9377-4995-a817-116eedb165a4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:32.881373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3539fb89-9377-4995-a817-116eedb165a4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:33.093507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3539fb89-9377-4995-a817-116eedb165a4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:33.101818 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3539fb89-9377-4995-a817-116eedb165a4 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1722 microversion: 2.1 time: 0.241970 Oct 12 23:00:33.102581 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3358/7364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:32 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:34.126672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0676e902-3a34-4c8c-ac0a-ba31b15df4c5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:34.127202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0676e902-3a34-4c8c-ac0a-ba31b15df4c5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:34.134084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0676e902-3a34-4c8c-ac0a-ba31b15df4c5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:34.134575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0676e902-3a34-4c8c-ac0a-ba31b15df4c5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:34.135023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0676e902-3a34-4c8c-ac0a-ba31b15df4c5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:34.135766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0676e902-3a34-4c8c-ac0a-ba31b15df4c5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:34.136228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0676e902-3a34-4c8c-ac0a-ba31b15df4c5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:34.136664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0676e902-3a34-4c8c-ac0a-ba31b15df4c5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:34.274076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0676e902-3a34-4c8c-ac0a-ba31b15df4c5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:34.282634 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0676e902-3a34-4c8c-ac0a-ba31b15df4c5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1727 microversion: 2.1 time: 0.160544 Oct 12 23:00:34.283224 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4007/7365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:34 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:35.307128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2e9c7ff6-2c64-4bed-8e53-56d909c905fe tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:35.307784 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2e9c7ff6-2c64-4bed-8e53-56d909c905fe tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:35.315072 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e9c7ff6-2c64-4bed-8e53-56d909c905fe tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:35.315603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e9c7ff6-2c64-4bed-8e53-56d909c905fe tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:35.316061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e9c7ff6-2c64-4bed-8e53-56d909c905fe tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:35.316769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e9c7ff6-2c64-4bed-8e53-56d909c905fe tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:35.317239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e9c7ff6-2c64-4bed-8e53-56d909c905fe tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:35.317680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2e9c7ff6-2c64-4bed-8e53-56d909c905fe tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:35.449818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2e9c7ff6-2c64-4bed-8e53-56d909c905fe tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:35.458733 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2e9c7ff6-2c64-4bed-8e53-56d909c905fe tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1727 microversion: 2.1 time: 0.155584 Oct 12 23:00:35.459328 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3359/7366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:35 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:36.482220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4c05fc5f-77a1-44c1-8973-dafacdd467a9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:36.482820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4c05fc5f-77a1-44c1-8973-dafacdd467a9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:36.489607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c05fc5f-77a1-44c1-8973-dafacdd467a9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:36.490338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c05fc5f-77a1-44c1-8973-dafacdd467a9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:36.490770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c05fc5f-77a1-44c1-8973-dafacdd467a9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:36.491481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c05fc5f-77a1-44c1-8973-dafacdd467a9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:36.491931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c05fc5f-77a1-44c1-8973-dafacdd467a9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:36.492355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4c05fc5f-77a1-44c1-8973-dafacdd467a9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:36.619775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4c05fc5f-77a1-44c1-8973-dafacdd467a9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:36.628042 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4c05fc5f-77a1-44c1-8973-dafacdd467a9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1727 microversion: 2.1 time: 0.149765 Oct 12 23:00:36.628615 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4008/7367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:36 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:37.652114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e9865459-a079-4a2f-b59d-4dbe3057bc9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:37.652741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e9865459-a079-4a2f-b59d-4dbe3057bc9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:37.659579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9865459-a079-4a2f-b59d-4dbe3057bc9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:37.660094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9865459-a079-4a2f-b59d-4dbe3057bc9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:37.660527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9865459-a079-4a2f-b59d-4dbe3057bc9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:37.661230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9865459-a079-4a2f-b59d-4dbe3057bc9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:37.661695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9865459-a079-4a2f-b59d-4dbe3057bc9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:37.662132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9865459-a079-4a2f-b59d-4dbe3057bc9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:37.789699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e9865459-a079-4a2f-b59d-4dbe3057bc9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:37.797936 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e9865459-a079-4a2f-b59d-4dbe3057bc9b tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1727 microversion: 2.1 time: 0.149760 Oct 12 23:00:37.798498 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3360/7368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:37 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:38.821600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e2b5dd84-fbb3-40e4-b6ff-e977f96badf5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:38.822244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e2b5dd84-fbb3-40e4-b6ff-e977f96badf5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:38.829576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2b5dd84-fbb3-40e4-b6ff-e977f96badf5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:38.830056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2b5dd84-fbb3-40e4-b6ff-e977f96badf5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:38.830490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2b5dd84-fbb3-40e4-b6ff-e977f96badf5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:38.831176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2b5dd84-fbb3-40e4-b6ff-e977f96badf5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:38.831664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2b5dd84-fbb3-40e4-b6ff-e977f96badf5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:38.832089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e2b5dd84-fbb3-40e4-b6ff-e977f96badf5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:38.960909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e2b5dd84-fbb3-40e4-b6ff-e977f96badf5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:38.969943 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e2b5dd84-fbb3-40e4-b6ff-e977f96badf5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1727 microversion: 2.1 time: 0.152285 Oct 12 23:00:38.970517 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4009/7369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:38 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:39.993642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9e8e87d9-60b5-4d30-8417-f9c761249217 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:39.994275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9e8e87d9-60b5-4d30-8417-f9c761249217 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:40.001613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e8e87d9-60b5-4d30-8417-f9c761249217 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:40.002117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e8e87d9-60b5-4d30-8417-f9c761249217 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:40.002574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e8e87d9-60b5-4d30-8417-f9c761249217 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:40.003304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e8e87d9-60b5-4d30-8417-f9c761249217 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:40.003777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e8e87d9-60b5-4d30-8417-f9c761249217 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:40.004225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e8e87d9-60b5-4d30-8417-f9c761249217 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:40.132939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9e8e87d9-60b5-4d30-8417-f9c761249217 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:40.141806 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9e8e87d9-60b5-4d30-8417-f9c761249217 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1727 microversion: 2.1 time: 0.152354 Oct 12 23:00:40.142382 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3361/7370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:39 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:41.165629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3ab36136-e127-408a-ae7f-6a190f17a506 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:41.166255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3ab36136-e127-408a-ae7f-6a190f17a506 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:41.173670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ab36136-e127-408a-ae7f-6a190f17a506 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:41.174155 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ab36136-e127-408a-ae7f-6a190f17a506 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:41.174603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ab36136-e127-408a-ae7f-6a190f17a506 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:41.175382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ab36136-e127-408a-ae7f-6a190f17a506 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:41.175845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ab36136-e127-408a-ae7f-6a190f17a506 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:41.176279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3ab36136-e127-408a-ae7f-6a190f17a506 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:41.306187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3ab36136-e127-408a-ae7f-6a190f17a506 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:41.314530 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3ab36136-e127-408a-ae7f-6a190f17a506 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1727 microversion: 2.1 time: 0.152888 Oct 12 23:00:41.315117 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4010/7371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:41 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:42.337799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6223e45b-e7b8-4b61-9a40-6739e19aba6c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:42.338447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6223e45b-e7b8-4b61-9a40-6739e19aba6c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:42.345497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6223e45b-e7b8-4b61-9a40-6739e19aba6c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:42.346003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6223e45b-e7b8-4b61-9a40-6739e19aba6c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:42.346465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6223e45b-e7b8-4b61-9a40-6739e19aba6c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:42.347179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6223e45b-e7b8-4b61-9a40-6739e19aba6c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:42.347685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6223e45b-e7b8-4b61-9a40-6739e19aba6c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:42.348137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6223e45b-e7b8-4b61-9a40-6739e19aba6c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:42.477926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6223e45b-e7b8-4b61-9a40-6739e19aba6c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:42.486666 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6223e45b-e7b8-4b61-9a40-6739e19aba6c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1727 microversion: 2.1 time: 0.152782 Oct 12 23:00:42.487230 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3362/7372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:42 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:43.510336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0438f977-3fb6-4c09-9b8c-955fa25e631f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:43.510988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0438f977-3fb6-4c09-9b8c-955fa25e631f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:43.518398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0438f977-3fb6-4c09-9b8c-955fa25e631f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:43.518897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0438f977-3fb6-4c09-9b8c-955fa25e631f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:43.519374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0438f977-3fb6-4c09-9b8c-955fa25e631f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:43.520092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0438f977-3fb6-4c09-9b8c-955fa25e631f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:43.520621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0438f977-3fb6-4c09-9b8c-955fa25e631f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:43.521060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0438f977-3fb6-4c09-9b8c-955fa25e631f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:43.656545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0438f977-3fb6-4c09-9b8c-955fa25e631f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:43.666137 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0438f977-3fb6-4c09-9b8c-955fa25e631f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1727 microversion: 2.1 time: 0.159759 Oct 12 23:00:43.666715 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4011/7373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:43 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:44.690197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6caabb82-eabc-4a8e-ac7e-4d8943ebce58 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:44.690833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6caabb82-eabc-4a8e-ac7e-4d8943ebce58 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:44.697474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6caabb82-eabc-4a8e-ac7e-4d8943ebce58 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:44.697975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6caabb82-eabc-4a8e-ac7e-4d8943ebce58 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:44.698434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6caabb82-eabc-4a8e-ac7e-4d8943ebce58 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:44.699139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6caabb82-eabc-4a8e-ac7e-4d8943ebce58 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:44.699637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6caabb82-eabc-4a8e-ac7e-4d8943ebce58 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:44.700083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6caabb82-eabc-4a8e-ac7e-4d8943ebce58 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:44.829462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6caabb82-eabc-4a8e-ac7e-4d8943ebce58 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:44.837745 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6caabb82-eabc-4a8e-ac7e-4d8943ebce58 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1727 microversion: 2.1 time: 0.152132 Oct 12 23:00:44.838316 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3363/7374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:44 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:45.862054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-152d7054-bc18-4856-b77f-be8943d070a3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:45.862673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-152d7054-bc18-4856-b77f-be8943d070a3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:45.869809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-152d7054-bc18-4856-b77f-be8943d070a3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:45.870295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-152d7054-bc18-4856-b77f-be8943d070a3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:45.870738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-152d7054-bc18-4856-b77f-be8943d070a3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:45.871486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-152d7054-bc18-4856-b77f-be8943d070a3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:45.871940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-152d7054-bc18-4856-b77f-be8943d070a3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:45.872365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-152d7054-bc18-4856-b77f-be8943d070a3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:46.000542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-152d7054-bc18-4856-b77f-be8943d070a3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:46.008796 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-152d7054-bc18-4856-b77f-be8943d070a3 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1727 microversion: 2.1 time: 0.151383 Oct 12 23:00:46.009367 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4012/7375] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:45 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:47.033623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f0c670a1-d7c0-49c0-897f-3fdef26fb555 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:47.034195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f0c670a1-d7c0-49c0-897f-3fdef26fb555 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:47.040785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0c670a1-d7c0-49c0-897f-3fdef26fb555 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:47.041287 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0c670a1-d7c0-49c0-897f-3fdef26fb555 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:47.041743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0c670a1-d7c0-49c0-897f-3fdef26fb555 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:47.042455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0c670a1-d7c0-49c0-897f-3fdef26fb555 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:47.042940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0c670a1-d7c0-49c0-897f-3fdef26fb555 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:47.043401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0c670a1-d7c0-49c0-897f-3fdef26fb555 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:47.180365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f0c670a1-d7c0-49c0-897f-3fdef26fb555 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:47.189003 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f0c670a1-d7c0-49c0-897f-3fdef26fb555 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1727 microversion: 2.1 time: 0.159951 Oct 12 23:00:47.189608 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3364/7376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:47 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:47.971635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-e4b6a03a-db4e-4e63-9492-58a0831fedd7 req-a9032c40-0dbf-4607-8de0-dd7d7825e13f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2", "name": "network-vif-unplugged", "status": "completed", "tag": "491fbd96-f1e3-4077-8a2b-06901af984f6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:47.982429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e4b6a03a-db4e-4e63-9492-58a0831fedd7 req-a9032c40-0dbf-4607-8de0-dd7d7825e13f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:47.983690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e4b6a03a-db4e-4e63-9492-58a0831fedd7 req-a9032c40-0dbf-4607-8de0-dd7d7825e13f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:47.984131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e4b6a03a-db4e-4e63-9492-58a0831fedd7 req-a9032c40-0dbf-4607-8de0-dd7d7825e13f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:47.996629 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-e4b6a03a-db4e-4e63-9492-58a0831fedd7 req-a9032c40-0dbf-4607-8de0-dd7d7825e13f service nova] Creating event network-vif-unplugged:491fbd96-f1e3-4077-8a2b-06901af984f6 for instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 on n-h1-861111-1 Oct 12 23:00:48.002823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-e4b6a03a-db4e-4e63-9492-58a0831fedd7 req-a9032c40-0dbf-4607-8de0-dd7d7825e13f service nova] Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:00:48.013578 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-e4b6a03a-db4e-4e63-9492-58a0831fedd7 req-a9032c40-0dbf-4607-8de0-dd7d7825e13f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045715 Oct 12 23:00:48.014554 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4013/7377] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:00:48.213031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-28a39a2d-1f29-4175-ba90-3b1bbded2eab tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:48.213618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-28a39a2d-1f29-4175-ba90-3b1bbded2eab tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:48.220803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28a39a2d-1f29-4175-ba90-3b1bbded2eab tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:48.221308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28a39a2d-1f29-4175-ba90-3b1bbded2eab tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:48.221761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28a39a2d-1f29-4175-ba90-3b1bbded2eab tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:48.222475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28a39a2d-1f29-4175-ba90-3b1bbded2eab tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:48.222945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28a39a2d-1f29-4175-ba90-3b1bbded2eab tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:48.223420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28a39a2d-1f29-4175-ba90-3b1bbded2eab tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:48.417463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-28a39a2d-1f29-4175-ba90-3b1bbded2eab tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:48.425864 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-28a39a2d-1f29-4175-ba90-3b1bbded2eab tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1726 microversion: 2.1 time: 0.216867 Oct 12 23:00:48.426452 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3365/7378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:48 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:49.450417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0aaf5007-4288-4024-a6dc-d487c7ac328c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:49.451047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0aaf5007-4288-4024-a6dc-d487c7ac328c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:49.457429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0aaf5007-4288-4024-a6dc-d487c7ac328c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:49.457921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0aaf5007-4288-4024-a6dc-d487c7ac328c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:49.458361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0aaf5007-4288-4024-a6dc-d487c7ac328c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:49.459055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0aaf5007-4288-4024-a6dc-d487c7ac328c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:49.459550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0aaf5007-4288-4024-a6dc-d487c7ac328c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:49.459983 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0aaf5007-4288-4024-a6dc-d487c7ac328c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:49.597538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0aaf5007-4288-4024-a6dc-d487c7ac328c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:49.606110 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0aaf5007-4288-4024-a6dc-d487c7ac328c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1724 microversion: 2.1 time: 0.160980 Oct 12 23:00:49.606691 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4014/7379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:49 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:50.053118 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-fc770a99-4b3a-4fa8-957a-3a9aaa722cd4 req-9a14d5a4-e7d8-4b8c-a97f-b8aa42967995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2", "tag": "491fbd96-f1e3-4077-8a2b-06901af984f6"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:50.064140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fc770a99-4b3a-4fa8-957a-3a9aaa722cd4 req-9a14d5a4-e7d8-4b8c-a97f-b8aa42967995 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:50.064639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fc770a99-4b3a-4fa8-957a-3a9aaa722cd4 req-9a14d5a4-e7d8-4b8c-a97f-b8aa42967995 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:50.065090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-fc770a99-4b3a-4fa8-957a-3a9aaa722cd4 req-9a14d5a4-e7d8-4b8c-a97f-b8aa42967995 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:50.076696 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-fc770a99-4b3a-4fa8-957a-3a9aaa722cd4 req-9a14d5a4-e7d8-4b8c-a97f-b8aa42967995 service nova] Creating event network-changed:491fbd96-f1e3-4077-8a2b-06901af984f6 for instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 on n-h1-861111-1 Oct 12 23:00:50.082226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-fc770a99-4b3a-4fa8-957a-3a9aaa722cd4 req-9a14d5a4-e7d8-4b8c-a97f-b8aa42967995 service nova] Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:00:50.093337 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-fc770a99-4b3a-4fa8-957a-3a9aaa722cd4 req-9a14d5a4-e7d8-4b8c-a97f-b8aa42967995 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043946 Oct 12 23:00:50.094125 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3366/7380] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:00:50.631723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-07f058a0-3512-411c-8f5b-143bbeae283a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:50.632159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-07f058a0-3512-411c-8f5b-143bbeae283a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:50.639589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07f058a0-3512-411c-8f5b-143bbeae283a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:50.640330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07f058a0-3512-411c-8f5b-143bbeae283a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:50.640928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07f058a0-3512-411c-8f5b-143bbeae283a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:50.641763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07f058a0-3512-411c-8f5b-143bbeae283a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:50.642287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07f058a0-3512-411c-8f5b-143bbeae283a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:50.642885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07f058a0-3512-411c-8f5b-143bbeae283a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:50.786689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-07f058a0-3512-411c-8f5b-143bbeae283a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:50.795916 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-07f058a0-3512-411c-8f5b-143bbeae283a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1724 microversion: 2.1 time: 0.168225 Oct 12 23:00:50.796710 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4015/7381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:50 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:51.821129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7169462e-5dc1-426c-b9cf-68e167689e5d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:51.821970 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7169462e-5dc1-426c-b9cf-68e167689e5d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:51.828252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7169462e-5dc1-426c-b9cf-68e167689e5d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:51.828758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7169462e-5dc1-426c-b9cf-68e167689e5d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:51.829210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7169462e-5dc1-426c-b9cf-68e167689e5d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:51.829917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7169462e-5dc1-426c-b9cf-68e167689e5d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:51.830390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7169462e-5dc1-426c-b9cf-68e167689e5d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:51.830833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7169462e-5dc1-426c-b9cf-68e167689e5d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:51.961443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7169462e-5dc1-426c-b9cf-68e167689e5d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:51.970319 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7169462e-5dc1-426c-b9cf-68e167689e5d tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1724 microversion: 2.1 time: 0.154481 Oct 12 23:00:51.970892 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3367/7382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:51 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:52.994013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-07145733-6108-4a1e-b114-b8549d086059 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:52.994725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-07145733-6108-4a1e-b114-b8549d086059 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:53.002558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07145733-6108-4a1e-b114-b8549d086059 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:53.003045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07145733-6108-4a1e-b114-b8549d086059 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:53.003514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07145733-6108-4a1e-b114-b8549d086059 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:53.004216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07145733-6108-4a1e-b114-b8549d086059 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:53.004668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07145733-6108-4a1e-b114-b8549d086059 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:53.005096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07145733-6108-4a1e-b114-b8549d086059 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:53.133954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-07145733-6108-4a1e-b114-b8549d086059 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:53.142486 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-07145733-6108-4a1e-b114-b8549d086059 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1724 microversion: 2.1 time: 0.152650 Oct 12 23:00:53.143065 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4016/7383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:52 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:54.165650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-704ab70f-2145-4637-a62e-43246b313dff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:54.166284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-704ab70f-2145-4637-a62e-43246b313dff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:54.173944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-704ab70f-2145-4637-a62e-43246b313dff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:54.174464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-704ab70f-2145-4637-a62e-43246b313dff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:54.174915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-704ab70f-2145-4637-a62e-43246b313dff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:54.175649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-704ab70f-2145-4637-a62e-43246b313dff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:54.176114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-704ab70f-2145-4637-a62e-43246b313dff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:54.176554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-704ab70f-2145-4637-a62e-43246b313dff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:54.303495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-704ab70f-2145-4637-a62e-43246b313dff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:54.311645 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-704ab70f-2145-4637-a62e-43246b313dff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1724 microversion: 2.1 time: 0.149854 Oct 12 23:00:54.312215 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3368/7384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:54 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:55.335158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c1edb2e8-8162-4187-ad81-99fd26f694f8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:55.335802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c1edb2e8-8162-4187-ad81-99fd26f694f8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:55.342532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1edb2e8-8162-4187-ad81-99fd26f694f8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:55.343010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1edb2e8-8162-4187-ad81-99fd26f694f8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:55.343486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1edb2e8-8162-4187-ad81-99fd26f694f8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:55.344174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1edb2e8-8162-4187-ad81-99fd26f694f8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:55.344625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1edb2e8-8162-4187-ad81-99fd26f694f8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:55.345054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c1edb2e8-8162-4187-ad81-99fd26f694f8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:55.481192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c1edb2e8-8162-4187-ad81-99fd26f694f8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:55.489983 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c1edb2e8-8162-4187-ad81-99fd26f694f8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1724 microversion: 2.1 time: 0.158780 Oct 12 23:00:55.490815 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4017/7385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:55 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:00:56.514084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a443146e-80cc-419e-b3a8-51098c8c0196 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:56.514720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a443146e-80cc-419e-b3a8-51098c8c0196 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:56.521574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a443146e-80cc-419e-b3a8-51098c8c0196 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:56.522073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a443146e-80cc-419e-b3a8-51098c8c0196 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:56.522530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a443146e-80cc-419e-b3a8-51098c8c0196 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:56.523254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a443146e-80cc-419e-b3a8-51098c8c0196 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:56.523726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a443146e-80cc-419e-b3a8-51098c8c0196 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:56.524170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a443146e-80cc-419e-b3a8-51098c8c0196 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:56.657012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a443146e-80cc-419e-b3a8-51098c8c0196 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:56.665908 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a443146e-80cc-419e-b3a8-51098c8c0196 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1724 microversion: 2.1 time: 0.155766 Oct 12 23:00:56.666478 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3369/7386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:56 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:57.689980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c89299ba-e129-474f-8aeb-190612761578 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:57.690622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c89299ba-e129-474f-8aeb-190612761578 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:57.697398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c89299ba-e129-474f-8aeb-190612761578 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:57.697879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c89299ba-e129-474f-8aeb-190612761578 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:57.698314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c89299ba-e129-474f-8aeb-190612761578 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:57.699002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c89299ba-e129-474f-8aeb-190612761578 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:57.699481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c89299ba-e129-474f-8aeb-190612761578 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:57.699909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c89299ba-e129-474f-8aeb-190612761578 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:57.827093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c89299ba-e129-474f-8aeb-190612761578 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:57.835281 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c89299ba-e129-474f-8aeb-190612761578 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1724 microversion: 2.1 time: 0.149810 Oct 12 23:00:57.835855 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4018/7387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:57 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:58.859033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7d49b989-e1d8-4879-beb7-e65edb195e1a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:58.859689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7d49b989-e1d8-4879-beb7-e65edb195e1a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:58.866769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d49b989-e1d8-4879-beb7-e65edb195e1a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:58.867283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d49b989-e1d8-4879-beb7-e65edb195e1a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:58.867736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d49b989-e1d8-4879-beb7-e65edb195e1a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:58.868456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d49b989-e1d8-4879-beb7-e65edb195e1a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:58.868910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d49b989-e1d8-4879-beb7-e65edb195e1a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:58.869347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7d49b989-e1d8-4879-beb7-e65edb195e1a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:58.997450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7d49b989-e1d8-4879-beb7-e65edb195e1a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:59.006276 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7d49b989-e1d8-4879-beb7-e65edb195e1a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1724 microversion: 2.1 time: 0.151155 Oct 12 23:00:59.006845 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3370/7388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:58 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:00.030210 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3d485f3c-abf5-4a3d-8685-1f437ff8c406 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:00.030736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3d485f3c-abf5-4a3d-8685-1f437ff8c406 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:00.037516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d485f3c-abf5-4a3d-8685-1f437ff8c406 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:00.037996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d485f3c-abf5-4a3d-8685-1f437ff8c406 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:00.038435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d485f3c-abf5-4a3d-8685-1f437ff8c406 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:00.039152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d485f3c-abf5-4a3d-8685-1f437ff8c406 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:00.039633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d485f3c-abf5-4a3d-8685-1f437ff8c406 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:00.040063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d485f3c-abf5-4a3d-8685-1f437ff8c406 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:00.165839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3d485f3c-abf5-4a3d-8685-1f437ff8c406 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:00.174491 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3d485f3c-abf5-4a3d-8685-1f437ff8c406 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1724 microversion: 2.1 time: 0.148818 Oct 12 23:01:00.175066 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4019/7389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:00 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:01.198146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9c1b6c0d-c9d5-47e4-80a9-cfe37e2651ff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:01.198894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9c1b6c0d-c9d5-47e4-80a9-cfe37e2651ff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:01.205831 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c1b6c0d-c9d5-47e4-80a9-cfe37e2651ff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:01.206401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c1b6c0d-c9d5-47e4-80a9-cfe37e2651ff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:01.206856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c1b6c0d-c9d5-47e4-80a9-cfe37e2651ff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:01.207616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c1b6c0d-c9d5-47e4-80a9-cfe37e2651ff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:01.208129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c1b6c0d-c9d5-47e4-80a9-cfe37e2651ff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:01.208515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c1b6c0d-c9d5-47e4-80a9-cfe37e2651ff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:01.434925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9c1b6c0d-c9d5-47e4-80a9-cfe37e2651ff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:01.443624 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9c1b6c0d-c9d5-47e4-80a9-cfe37e2651ff tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1721 microversion: 2.1 time: 0.249366 Oct 12 23:01:01.444228 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3371/7390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:01 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:01.467446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6a088a9e-0b30-4da0-8e1f-1e462f3c9bd9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:01.467984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6a088a9e-0b30-4da0-8e1f-1e462f3c9bd9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:01.475266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a088a9e-0b30-4da0-8e1f-1e462f3c9bd9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:01.475415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a088a9e-0b30-4da0-8e1f-1e462f3c9bd9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:01.475791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a088a9e-0b30-4da0-8e1f-1e462f3c9bd9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:01.476504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a088a9e-0b30-4da0-8e1f-1e462f3c9bd9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:01.476982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a088a9e-0b30-4da0-8e1f-1e462f3c9bd9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:01.477405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a088a9e-0b30-4da0-8e1f-1e462f3c9bd9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:01.518663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a088a9e-0b30-4da0-8e1f-1e462f3c9bd9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:01.519163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a088a9e-0b30-4da0-8e1f-1e462f3c9bd9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:01.519627 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a088a9e-0b30-4da0-8e1f-1e462f3c9bd9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:01.520363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a088a9e-0b30-4da0-8e1f-1e462f3c9bd9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:01.520823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a088a9e-0b30-4da0-8e1f-1e462f3c9bd9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:01.521252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a088a9e-0b30-4da0-8e1f-1e462f3c9bd9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:01.544550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-6a088a9e-0b30-4da0-8e1f-1e462f3c9bd9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Getting quotas for project e44a4f6e4faa450b9850cd5bfbe53d59. Resources: {'ram', 'cores'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:01:01.550149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-6a088a9e-0b30-4da0-8e1f-1e462f3c9bd9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Getting quotas for user dc38342011d04f98aa06f9474fe6f402 and project e44a4f6e4faa450b9850cd5bfbe53d59. Resources: {'ram', 'cores'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:01:01.619261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:01.660936 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6a088a9e-0b30-4da0-8e1f-1e462f3c9bd9 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "POST /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2/action" status: 202 len: 0 microversion: 2.1 time: 0.197814 Oct 12 23:01:01.662056 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4020/7391] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:01:01 2022] POST /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:01:01.670017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-87634ab6-f5c4-4be5-8f34-10d6c43a7269 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:01.670646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-87634ab6-f5c4-4be5-8f34-10d6c43a7269 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:01.676213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=35 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:01.677628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-87634ab6-f5c4-4be5-8f34-10d6c43a7269 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:01.678127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-87634ab6-f5c4-4be5-8f34-10d6c43a7269 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:01.678830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-87634ab6-f5c4-4be5-8f34-10d6c43a7269 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:01.679583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-87634ab6-f5c4-4be5-8f34-10d6c43a7269 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:01.680052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-87634ab6-f5c4-4be5-8f34-10d6c43a7269 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:01.680492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-87634ab6-f5c4-4be5-8f34-10d6c43a7269 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:01.685371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:01.885904 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-87634ab6-f5c4-4be5-8f34-10d6c43a7269 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:01.895921 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-87634ab6-f5c4-4be5-8f34-10d6c43a7269 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1720 microversion: 2.1 time: 0.229408 Oct 12 23:01:01.896518 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3372/7392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:01 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1720 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:02.921766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-65a26b46-c0c1-4a73-a379-cfd75ebcb38e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:02.922508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-65a26b46-c0c1-4a73-a379-cfd75ebcb38e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:02.925298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:02.931694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65a26b46-c0c1-4a73-a379-cfd75ebcb38e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.932185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65a26b46-c0c1-4a73-a379-cfd75ebcb38e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.932629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65a26b46-c0c1-4a73-a379-cfd75ebcb38e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.933329 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65a26b46-c0c1-4a73-a379-cfd75ebcb38e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.933785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65a26b46-c0c1-4a73-a379-cfd75ebcb38e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.934214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65a26b46-c0c1-4a73-a379-cfd75ebcb38e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:03.065529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-65a26b46-c0c1-4a73-a379-cfd75ebcb38e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:03.073869 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-65a26b46-c0c1-4a73-a379-cfd75ebcb38e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1720 microversion: 2.1 time: 0.157089 Oct 12 23:01:03.074448 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4021/7393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:02 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:03.453410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-29e575b9-8e39-4d13-93fe-74ce609d6fe3 req-0a57100e-63c2-488d-9b84-2cf091004133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2", "name": "network-vif-plugged", "status": "completed", "tag": "491fbd96-f1e3-4077-8a2b-06901af984f6"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:03.464815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-29e575b9-8e39-4d13-93fe-74ce609d6fe3 req-0a57100e-63c2-488d-9b84-2cf091004133 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:03.465314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-29e575b9-8e39-4d13-93fe-74ce609d6fe3 req-0a57100e-63c2-488d-9b84-2cf091004133 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:03.466145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-29e575b9-8e39-4d13-93fe-74ce609d6fe3 req-0a57100e-63c2-488d-9b84-2cf091004133 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:03.478423 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-29e575b9-8e39-4d13-93fe-74ce609d6fe3 req-0a57100e-63c2-488d-9b84-2cf091004133 service nova] Creating event network-vif-plugged:491fbd96-f1e3-4077-8a2b-06901af984f6 for instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 on n-h1-861111-1 Oct 12 23:01:03.483724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-29e575b9-8e39-4d13-93fe-74ce609d6fe3 req-0a57100e-63c2-488d-9b84-2cf091004133 service nova] Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:01:03.495667 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-29e575b9-8e39-4d13-93fe-74ce609d6fe3 req-0a57100e-63c2-488d-9b84-2cf091004133 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046242 Oct 12 23:01:03.496270 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3373/7394] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:04.097949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-714f19ea-963b-4a85-9fd4-2f2b9cceff5e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:04.098579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-714f19ea-963b-4a85-9fd4-2f2b9cceff5e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:04.105690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-714f19ea-963b-4a85-9fd4-2f2b9cceff5e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:04.106180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-714f19ea-963b-4a85-9fd4-2f2b9cceff5e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:04.106650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-714f19ea-963b-4a85-9fd4-2f2b9cceff5e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:04.107921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-714f19ea-963b-4a85-9fd4-2f2b9cceff5e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:04.108391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-714f19ea-963b-4a85-9fd4-2f2b9cceff5e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:04.108852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-714f19ea-963b-4a85-9fd4-2f2b9cceff5e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:04.236005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-714f19ea-963b-4a85-9fd4-2f2b9cceff5e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:04.244493 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-714f19ea-963b-4a85-9fd4-2f2b9cceff5e tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1720 microversion: 2.1 time: 0.150521 Oct 12 23:01:04.245070 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4022/7395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:04 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:05.268587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9b7eb3d5-3f7c-428d-b008-53eca93f79f6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:05.269311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9b7eb3d5-3f7c-428d-b008-53eca93f79f6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:05.276708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b7eb3d5-3f7c-428d-b008-53eca93f79f6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:05.277209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b7eb3d5-3f7c-428d-b008-53eca93f79f6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:05.277664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b7eb3d5-3f7c-428d-b008-53eca93f79f6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:05.278385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b7eb3d5-3f7c-428d-b008-53eca93f79f6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:05.278855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b7eb3d5-3f7c-428d-b008-53eca93f79f6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:05.279822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b7eb3d5-3f7c-428d-b008-53eca93f79f6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:05.414868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9b7eb3d5-3f7c-428d-b008-53eca93f79f6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:05.423517 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9b7eb3d5-3f7c-428d-b008-53eca93f79f6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1720 microversion: 2.1 time: 0.159227 Oct 12 23:01:05.424098 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3374/7396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:05 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:06.447457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-10d91312-90b8-42d8-a7f0-c4d4ee54dd16 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:06.448103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-10d91312-90b8-42d8-a7f0-c4d4ee54dd16 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:06.455431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10d91312-90b8-42d8-a7f0-c4d4ee54dd16 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:06.455914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10d91312-90b8-42d8-a7f0-c4d4ee54dd16 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:06.456348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10d91312-90b8-42d8-a7f0-c4d4ee54dd16 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:06.457040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10d91312-90b8-42d8-a7f0-c4d4ee54dd16 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:06.457490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10d91312-90b8-42d8-a7f0-c4d4ee54dd16 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:06.457917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-10d91312-90b8-42d8-a7f0-c4d4ee54dd16 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:06.594482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-10d91312-90b8-42d8-a7f0-c4d4ee54dd16 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:06.602766 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-10d91312-90b8-42d8-a7f0-c4d4ee54dd16 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1720 microversion: 2.1 time: 0.159257 Oct 12 23:01:06.603373 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4023/7397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:06 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:07.465130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-2411051a-d136-4ea3-bf2e-b3a024a2f6de req-80e69cd6-de5c-49df-9fa7-81b3bcfdb20f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2", "name": "network-vif-unplugged", "status": "completed", "tag": "491fbd96-f1e3-4077-8a2b-06901af984f6"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:07.478207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2411051a-d136-4ea3-bf2e-b3a024a2f6de req-80e69cd6-de5c-49df-9fa7-81b3bcfdb20f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:07.478599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2411051a-d136-4ea3-bf2e-b3a024a2f6de req-80e69cd6-de5c-49df-9fa7-81b3bcfdb20f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:07.480293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2411051a-d136-4ea3-bf2e-b3a024a2f6de req-80e69cd6-de5c-49df-9fa7-81b3bcfdb20f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:07.494175 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-2411051a-d136-4ea3-bf2e-b3a024a2f6de req-80e69cd6-de5c-49df-9fa7-81b3bcfdb20f service nova] Creating event network-vif-unplugged:491fbd96-f1e3-4077-8a2b-06901af984f6 for instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 on n-h2-861111-1 Oct 12 23:01:07.502600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-2411051a-d136-4ea3-bf2e-b3a024a2f6de req-80e69cd6-de5c-49df-9fa7-81b3bcfdb20f service nova] Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:01:07.517347 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-2411051a-d136-4ea3-bf2e-b3a024a2f6de req-80e69cd6-de5c-49df-9fa7-81b3bcfdb20f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056340 Oct 12 23:01:07.518137 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3375/7398] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:07.626748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2280c01f-c09c-4fb9-a11b-dfda30bbea78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:07.627426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2280c01f-c09c-4fb9-a11b-dfda30bbea78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:07.634456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2280c01f-c09c-4fb9-a11b-dfda30bbea78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:07.635390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2280c01f-c09c-4fb9-a11b-dfda30bbea78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:07.636061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2280c01f-c09c-4fb9-a11b-dfda30bbea78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:07.636848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2280c01f-c09c-4fb9-a11b-dfda30bbea78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:07.637528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2280c01f-c09c-4fb9-a11b-dfda30bbea78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:07.638104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2280c01f-c09c-4fb9-a11b-dfda30bbea78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:07.770868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2280c01f-c09c-4fb9-a11b-dfda30bbea78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:07.779585 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2280c01f-c09c-4fb9-a11b-dfda30bbea78 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1720 microversion: 2.1 time: 0.157542 Oct 12 23:01:07.780254 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4024/7399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:07 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:08.806697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b9be13b7-0fe7-457f-9a8b-3f4fc18f6ad2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:08.807474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b9be13b7-0fe7-457f-9a8b-3f4fc18f6ad2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:08.813683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9be13b7-0fe7-457f-9a8b-3f4fc18f6ad2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:08.814190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9be13b7-0fe7-457f-9a8b-3f4fc18f6ad2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:08.814647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9be13b7-0fe7-457f-9a8b-3f4fc18f6ad2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:08.815382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9be13b7-0fe7-457f-9a8b-3f4fc18f6ad2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:08.815855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9be13b7-0fe7-457f-9a8b-3f4fc18f6ad2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:08.816297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9be13b7-0fe7-457f-9a8b-3f4fc18f6ad2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:08.949279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b9be13b7-0fe7-457f-9a8b-3f4fc18f6ad2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:08.957759 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b9be13b7-0fe7-457f-9a8b-3f4fc18f6ad2 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1720 microversion: 2.1 time: 0.156368 Oct 12 23:01:08.958336 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3376/7400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:08 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:09.541807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d3c6a2db-bb43-4e21-bebd-d55f01333aa3 req-0c59ca4c-2c8a-44fc-bc8a-8dd40ddd4213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2", "tag": "491fbd96-f1e3-4077-8a2b-06901af984f6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:09.552638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d3c6a2db-bb43-4e21-bebd-d55f01333aa3 req-0c59ca4c-2c8a-44fc-bc8a-8dd40ddd4213 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:09.553124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d3c6a2db-bb43-4e21-bebd-d55f01333aa3 req-0c59ca4c-2c8a-44fc-bc8a-8dd40ddd4213 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:09.553559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d3c6a2db-bb43-4e21-bebd-d55f01333aa3 req-0c59ca4c-2c8a-44fc-bc8a-8dd40ddd4213 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:09.565286 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d3c6a2db-bb43-4e21-bebd-d55f01333aa3 req-0c59ca4c-2c8a-44fc-bc8a-8dd40ddd4213 service nova] Creating event network-changed:491fbd96-f1e3-4077-8a2b-06901af984f6 for instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 on n-h2-861111-1 Oct 12 23:01:09.570606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-d3c6a2db-bb43-4e21-bebd-d55f01333aa3 req-0c59ca4c-2c8a-44fc-bc8a-8dd40ddd4213 service nova] Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:01:09.581340 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d3c6a2db-bb43-4e21-bebd-d55f01333aa3 req-0c59ca4c-2c8a-44fc-bc8a-8dd40ddd4213 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043290 Oct 12 23:01:09.581947 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4025/7401] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:09.981626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c803b471-8fd2-47c7-8eb7-bf45d4b20361 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:09.982584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c803b471-8fd2-47c7-8eb7-bf45d4b20361 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:09.989615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c803b471-8fd2-47c7-8eb7-bf45d4b20361 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:09.990204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c803b471-8fd2-47c7-8eb7-bf45d4b20361 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:09.990990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c803b471-8fd2-47c7-8eb7-bf45d4b20361 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:09.991808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c803b471-8fd2-47c7-8eb7-bf45d4b20361 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:09.992499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c803b471-8fd2-47c7-8eb7-bf45d4b20361 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:09.993012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c803b471-8fd2-47c7-8eb7-bf45d4b20361 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:10.287892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c803b471-8fd2-47c7-8eb7-bf45d4b20361 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:10.296425 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c803b471-8fd2-47c7-8eb7-bf45d4b20361 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1720 microversion: 2.1 time: 0.318769 Oct 12 23:01:10.297130 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3377/7402] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:09 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1720 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:11.322073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f390c476-61f8-4641-b325-405fb98d4640 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:11.322787 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f390c476-61f8-4641-b325-405fb98d4640 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:11.329685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f390c476-61f8-4641-b325-405fb98d4640 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:11.330186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f390c476-61f8-4641-b325-405fb98d4640 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:11.330631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f390c476-61f8-4641-b325-405fb98d4640 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:11.331373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f390c476-61f8-4641-b325-405fb98d4640 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:11.331837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f390c476-61f8-4641-b325-405fb98d4640 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:11.332270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f390c476-61f8-4641-b325-405fb98d4640 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:11.474022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f390c476-61f8-4641-b325-405fb98d4640 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:11.482607 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f390c476-61f8-4641-b325-405fb98d4640 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1720 microversion: 2.1 time: 0.165779 Oct 12 23:01:11.483179 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4026/7403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:11 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:12.506130 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-03d987cb-fd1e-44cb-937d-179ce1cb5c0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:12.506761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-03d987cb-fd1e-44cb-937d-179ce1cb5c0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:12.514191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03d987cb-fd1e-44cb-937d-179ce1cb5c0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:12.514777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03d987cb-fd1e-44cb-937d-179ce1cb5c0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:12.516459 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03d987cb-fd1e-44cb-937d-179ce1cb5c0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:12.517785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03d987cb-fd1e-44cb-937d-179ce1cb5c0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:12.518280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03d987cb-fd1e-44cb-937d-179ce1cb5c0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:12.518746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03d987cb-fd1e-44cb-937d-179ce1cb5c0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:12.656611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-03d987cb-fd1e-44cb-937d-179ce1cb5c0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:12.665088 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-03d987cb-fd1e-44cb-937d-179ce1cb5c0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1720 microversion: 2.1 time: 0.162965 Oct 12 23:01:12.665676 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3378/7404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:12 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:13.689806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-84115bb1-31c1-4000-b179-bc9ad1ac4566 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:13.690427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-84115bb1-31c1-4000-b179-bc9ad1ac4566 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:13.692433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:13.698768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84115bb1-31c1-4000-b179-bc9ad1ac4566 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:13.699274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84115bb1-31c1-4000-b179-bc9ad1ac4566 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:13.699708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84115bb1-31c1-4000-b179-bc9ad1ac4566 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:13.700489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84115bb1-31c1-4000-b179-bc9ad1ac4566 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:13.700945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84115bb1-31c1-4000-b179-bc9ad1ac4566 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:13.701369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-84115bb1-31c1-4000-b179-bc9ad1ac4566 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:13.829946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-84115bb1-31c1-4000-b179-bc9ad1ac4566 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:13.838223 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-84115bb1-31c1-4000-b179-bc9ad1ac4566 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1720 microversion: 2.1 time: 0.152989 Oct 12 23:01:13.838796 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4027/7405] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:13 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:14.861186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b4e20276-0de2-439b-9c1b-aa79fa93b0cb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:14.861825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b4e20276-0de2-439b-9c1b-aa79fa93b0cb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:14.868597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4e20276-0de2-439b-9c1b-aa79fa93b0cb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:14.869101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4e20276-0de2-439b-9c1b-aa79fa93b0cb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:14.869556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4e20276-0de2-439b-9c1b-aa79fa93b0cb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:14.870276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4e20276-0de2-439b-9c1b-aa79fa93b0cb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:14.870749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4e20276-0de2-439b-9c1b-aa79fa93b0cb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:14.871225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4e20276-0de2-439b-9c1b-aa79fa93b0cb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:15.002755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b4e20276-0de2-439b-9c1b-aa79fa93b0cb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:15.011066 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b4e20276-0de2-439b-9c1b-aa79fa93b0cb tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1720 microversion: 2.1 time: 0.153880 Oct 12 23:01:15.011661 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3379/7406] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:14 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:16.035891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-407ac64c-cc4f-440d-91cd-552e13a26f0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:16.036468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-407ac64c-cc4f-440d-91cd-552e13a26f0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:16.043264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-407ac64c-cc4f-440d-91cd-552e13a26f0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:16.043745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-407ac64c-cc4f-440d-91cd-552e13a26f0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:16.044198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-407ac64c-cc4f-440d-91cd-552e13a26f0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:16.044869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-407ac64c-cc4f-440d-91cd-552e13a26f0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:16.045323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-407ac64c-cc4f-440d-91cd-552e13a26f0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:16.045751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-407ac64c-cc4f-440d-91cd-552e13a26f0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:16.173486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-407ac64c-cc4f-440d-91cd-552e13a26f0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:16.181676 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-407ac64c-cc4f-440d-91cd-552e13a26f0c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1720 microversion: 2.1 time: 0.149793 Oct 12 23:01:16.182248 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4028/7407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:16 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:17.205211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-18a33e41-a26c-4e92-a9a0-8a5e47307d7a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:17.205816 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-18a33e41-a26c-4e92-a9a0-8a5e47307d7a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:17.212591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18a33e41-a26c-4e92-a9a0-8a5e47307d7a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:17.213093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18a33e41-a26c-4e92-a9a0-8a5e47307d7a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:17.213548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18a33e41-a26c-4e92-a9a0-8a5e47307d7a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:17.214263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18a33e41-a26c-4e92-a9a0-8a5e47307d7a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:17.214733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18a33e41-a26c-4e92-a9a0-8a5e47307d7a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:17.215179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18a33e41-a26c-4e92-a9a0-8a5e47307d7a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:17.344876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-18a33e41-a26c-4e92-a9a0-8a5e47307d7a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:17.353312 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-18a33e41-a26c-4e92-a9a0-8a5e47307d7a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1720 microversion: 2.1 time: 0.152281 Oct 12 23:01:17.353893 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3380/7408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:17 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:18.378942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ca9c7147-d637-4f2a-8749-2b19b7daa25c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:18.379498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ca9c7147-d637-4f2a-8749-2b19b7daa25c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:18.386630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca9c7147-d637-4f2a-8749-2b19b7daa25c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:18.387118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca9c7147-d637-4f2a-8749-2b19b7daa25c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:18.387581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca9c7147-d637-4f2a-8749-2b19b7daa25c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:18.388269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca9c7147-d637-4f2a-8749-2b19b7daa25c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:18.388739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca9c7147-d637-4f2a-8749-2b19b7daa25c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:18.389166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca9c7147-d637-4f2a-8749-2b19b7daa25c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:18.523643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ca9c7147-d637-4f2a-8749-2b19b7daa25c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:18.532389 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ca9c7147-d637-4f2a-8749-2b19b7daa25c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1720 microversion: 2.1 time: 0.157425 Oct 12 23:01:18.532976 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4029/7409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:18 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:19.556586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aa6adf6d-e711-479f-a944-cb0b1ddca40f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:19.557219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-aa6adf6d-e711-479f-a944-cb0b1ddca40f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:19.564639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa6adf6d-e711-479f-a944-cb0b1ddca40f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:19.565135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa6adf6d-e711-479f-a944-cb0b1ddca40f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:19.565589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa6adf6d-e711-479f-a944-cb0b1ddca40f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:19.566288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa6adf6d-e711-479f-a944-cb0b1ddca40f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:19.566754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa6adf6d-e711-479f-a944-cb0b1ddca40f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:19.567191 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa6adf6d-e711-479f-a944-cb0b1ddca40f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:19.694951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-aa6adf6d-e711-479f-a944-cb0b1ddca40f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:19.704224 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-aa6adf6d-e711-479f-a944-cb0b1ddca40f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1720 microversion: 2.1 time: 0.151873 Oct 12 23:01:19.704791 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3381/7410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:19 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:20.727809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ef99c6fb-7542-4a1c-8a5b-eb0586495212 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:20.728430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ef99c6fb-7542-4a1c-8a5b-eb0586495212 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:20.735449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef99c6fb-7542-4a1c-8a5b-eb0586495212 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:20.735938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef99c6fb-7542-4a1c-8a5b-eb0586495212 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:20.736374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef99c6fb-7542-4a1c-8a5b-eb0586495212 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:20.737065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef99c6fb-7542-4a1c-8a5b-eb0586495212 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:20.737519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef99c6fb-7542-4a1c-8a5b-eb0586495212 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:20.737944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef99c6fb-7542-4a1c-8a5b-eb0586495212 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:20.866597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ef99c6fb-7542-4a1c-8a5b-eb0586495212 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:20.875450 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ef99c6fb-7542-4a1c-8a5b-eb0586495212 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1720 microversion: 2.1 time: 0.151778 Oct 12 23:01:20.876021 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4030/7411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:20 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:21.899472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9bfa0980-c97e-4828-9bcd-82d32441b339 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:21.900126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9bfa0980-c97e-4828-9bcd-82d32441b339 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:21.906947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bfa0980-c97e-4828-9bcd-82d32441b339 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:21.907482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bfa0980-c97e-4828-9bcd-82d32441b339 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:21.907941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bfa0980-c97e-4828-9bcd-82d32441b339 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:21.908653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bfa0980-c97e-4828-9bcd-82d32441b339 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:21.909126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bfa0980-c97e-4828-9bcd-82d32441b339 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:21.909568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bfa0980-c97e-4828-9bcd-82d32441b339 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:22.038795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9bfa0980-c97e-4828-9bcd-82d32441b339 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:22.047681 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9bfa0980-c97e-4828-9bcd-82d32441b339 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1713 microversion: 2.1 time: 0.152134 Oct 12 23:01:22.048251 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3382/7412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:21 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1713 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:22.070091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-801595b6-25c5-4696-99f5-ed53c3ea228a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:22.070734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-801595b6-25c5-4696-99f5-ed53c3ea228a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:22.078027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-801595b6-25c5-4696-99f5-ed53c3ea228a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:22.078507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-801595b6-25c5-4696-99f5-ed53c3ea228a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:22.078943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-801595b6-25c5-4696-99f5-ed53c3ea228a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:22.079664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-801595b6-25c5-4696-99f5-ed53c3ea228a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:22.080115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-801595b6-25c5-4696-99f5-ed53c3ea228a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:22.080637 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-801595b6-25c5-4696-99f5-ed53c3ea228a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:22.210946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-801595b6-25c5-4696-99f5-ed53c3ea228a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:22.219910 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-801595b6-25c5-4696-99f5-ed53c3ea228a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1713 microversion: 2.1 time: 0.153731 Oct 12 23:01:22.220514 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4031/7413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:22 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1713 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:22.242331 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dfb2e172-3423-4069-9d32-2f7e76a234e6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:22.242961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dfb2e172-3423-4069-9d32-2f7e76a234e6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:22.249376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfb2e172-3423-4069-9d32-2f7e76a234e6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:22.249876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfb2e172-3423-4069-9d32-2f7e76a234e6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:22.250329 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfb2e172-3423-4069-9d32-2f7e76a234e6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:22.251036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfb2e172-3423-4069-9d32-2f7e76a234e6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:22.251540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfb2e172-3423-4069-9d32-2f7e76a234e6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:22.251986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dfb2e172-3423-4069-9d32-2f7e76a234e6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:22.378123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dfb2e172-3423-4069-9d32-2f7e76a234e6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:22.386484 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dfb2e172-3423-4069-9d32-2f7e76a234e6 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1713 microversion: 2.1 time: 0.148340 Oct 12 23:01:22.387058 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3383/7414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:22 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1713 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:22.409157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e0a4729b-a6c8-4a83-8c9a-603b82d16379 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:22.409668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e0a4729b-a6c8-4a83-8c9a-603b82d16379 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:22.415633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0a4729b-a6c8-4a83-8c9a-603b82d16379 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:22.416121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0a4729b-a6c8-4a83-8c9a-603b82d16379 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:22.416566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0a4729b-a6c8-4a83-8c9a-603b82d16379 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:22.417266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0a4729b-a6c8-4a83-8c9a-603b82d16379 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:22.417729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0a4729b-a6c8-4a83-8c9a-603b82d16379 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:22.418165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e0a4729b-a6c8-4a83-8c9a-603b82d16379 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:22.442869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e0a4729b-a6c8-4a83-8c9a-603b82d16379 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:01:22.520140 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e0a4729b-a6c8-4a83-8c9a-603b82d16379 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 204 len: 0 microversion: 2.1 time: 0.114550 Oct 12 23:01:22.520814 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4032/7415] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:01:22 2022] DELETE /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:01:22.532383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b2546e28-54e9-49bc-aeb6-f74aad137f0a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:22.533011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b2546e28-54e9-49bc-aeb6-f74aad137f0a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:22.538966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2546e28-54e9-49bc-aeb6-f74aad137f0a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:22.539524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2546e28-54e9-49bc-aeb6-f74aad137f0a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:22.539974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2546e28-54e9-49bc-aeb6-f74aad137f0a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:22.540691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2546e28-54e9-49bc-aeb6-f74aad137f0a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:22.541145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2546e28-54e9-49bc-aeb6-f74aad137f0a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:22.541582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2546e28-54e9-49bc-aeb6-f74aad137f0a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:22.675089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b2546e28-54e9-49bc-aeb6-f74aad137f0a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:22.683680 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b2546e28-54e9-49bc-aeb6-f74aad137f0a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1719 microversion: 2.1 time: 0.157953 Oct 12 23:01:22.684268 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3384/7416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:22 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:23.708825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-83edaa62-f07b-4684-af57-16f52aa68c4f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:23.709548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-83edaa62-f07b-4684-af57-16f52aa68c4f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:23.717060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83edaa62-f07b-4684-af57-16f52aa68c4f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:23.717564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83edaa62-f07b-4684-af57-16f52aa68c4f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:23.718108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83edaa62-f07b-4684-af57-16f52aa68c4f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:23.718739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83edaa62-f07b-4684-af57-16f52aa68c4f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:23.719202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83edaa62-f07b-4684-af57-16f52aa68c4f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:23.719661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83edaa62-f07b-4684-af57-16f52aa68c4f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:23.858414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-83edaa62-f07b-4684-af57-16f52aa68c4f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:23.867115 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-83edaa62-f07b-4684-af57-16f52aa68c4f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1719 microversion: 2.1 time: 0.162693 Oct 12 23:01:23.867732 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4033/7417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:23 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:24.948473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-25b71998-1daf-4836-be21-13c7f7779bc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:24.949213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-25b71998-1daf-4836-be21-13c7f7779bc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:24.956438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25b71998-1daf-4836-be21-13c7f7779bc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:24.957031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25b71998-1daf-4836-be21-13c7f7779bc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:24.957554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25b71998-1daf-4836-be21-13c7f7779bc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:24.958349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25b71998-1daf-4836-be21-13c7f7779bc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:24.958899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25b71998-1daf-4836-be21-13c7f7779bc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:24.959517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25b71998-1daf-4836-be21-13c7f7779bc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:24.982516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-b3cf3deb-cf7c-458b-94b9-55e1f1c943f7 req-c482da45-034f-4d8b-a823-01e95be1dab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2", "name": "network-vif-deleted", "tag": "491fbd96-f1e3-4077-8a2b-06901af984f6"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:24.995515 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b3cf3deb-cf7c-458b-94b9-55e1f1c943f7 req-c482da45-034f-4d8b-a823-01e95be1dab4 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:24.996296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b3cf3deb-cf7c-458b-94b9-55e1f1c943f7 req-c482da45-034f-4d8b-a823-01e95be1dab4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:24.996889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b3cf3deb-cf7c-458b-94b9-55e1f1c943f7 req-c482da45-034f-4d8b-a823-01e95be1dab4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:25.011428 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-b3cf3deb-cf7c-458b-94b9-55e1f1c943f7 req-c482da45-034f-4d8b-a823-01e95be1dab4 service nova] Creating event network-vif-deleted:491fbd96-f1e3-4077-8a2b-06901af984f6 for instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 on n-h2-861111-1 Oct 12 23:01:25.020418 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-b3cf3deb-cf7c-458b-94b9-55e1f1c943f7 req-c482da45-034f-4d8b-a823-01e95be1dab4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042206 Oct 12 23:01:25.022014 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4034/7418] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:01:25.057057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-25b71998-1daf-4836-be21-13c7f7779bc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:25.067333 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-25b71998-1daf-4836-be21-13c7f7779bc7 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1653 microversion: 2.1 time: 0.122701 Oct 12 23:01:25.074156 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3385/7419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:24 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1653 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:26.092450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ff0823f4-f66a-4d9e-ad61-93785b4b9484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:26.093157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ff0823f4-f66a-4d9e-ad61-93785b4b9484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:26.100200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff0823f4-f66a-4d9e-ad61-93785b4b9484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:26.100688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff0823f4-f66a-4d9e-ad61-93785b4b9484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:26.101131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff0823f4-f66a-4d9e-ad61-93785b4b9484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:26.101827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff0823f4-f66a-4d9e-ad61-93785b4b9484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:26.102289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff0823f4-f66a-4d9e-ad61-93785b4b9484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:26.102719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ff0823f4-f66a-4d9e-ad61-93785b4b9484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:26.165681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ff0823f4-f66a-4d9e-ad61-93785b4b9484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:26.169225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:26.176561 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ff0823f4-f66a-4d9e-ad61-93785b4b9484 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1370 microversion: 2.1 time: 0.088925 Oct 12 23:01:26.177146 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4035/7420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:26 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1370 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:27.199796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3bf9bc68-c94f-4347-af2a-8857ac2a202c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:27.200454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3bf9bc68-c94f-4347-af2a-8857ac2a202c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:27.207860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bf9bc68-c94f-4347-af2a-8857ac2a202c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:27.208360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bf9bc68-c94f-4347-af2a-8857ac2a202c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:27.208812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bf9bc68-c94f-4347-af2a-8857ac2a202c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:27.209517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bf9bc68-c94f-4347-af2a-8857ac2a202c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:27.209988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bf9bc68-c94f-4347-af2a-8857ac2a202c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:27.210427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3bf9bc68-c94f-4347-af2a-8857ac2a202c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:27.273059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3bf9bc68-c94f-4347-af2a-8857ac2a202c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:27.282120 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3bf9bc68-c94f-4347-af2a-8857ac2a202c tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1370 microversion: 2.1 time: 0.086291 Oct 12 23:01:27.282701 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3386/7421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:27 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1370 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:28.306237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cd003de5-f89d-4140-aec8-63079a1fb0b8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:28.306996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cd003de5-f89d-4140-aec8-63079a1fb0b8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:28.314433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd003de5-f89d-4140-aec8-63079a1fb0b8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:28.314959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd003de5-f89d-4140-aec8-63079a1fb0b8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:28.315433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd003de5-f89d-4140-aec8-63079a1fb0b8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:28.316129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd003de5-f89d-4140-aec8-63079a1fb0b8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:28.316585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd003de5-f89d-4140-aec8-63079a1fb0b8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:28.317021 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd003de5-f89d-4140-aec8-63079a1fb0b8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:28.387506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cd003de5-f89d-4140-aec8-63079a1fb0b8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc38342011d04f98aa06f9474fe6f402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44a4f6e4faa450b9850cd5bfbe53d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:28.396031 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cd003de5-f89d-4140-aec8-63079a1fb0b8 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 200 len: 1370 microversion: 2.1 time: 0.094437 Oct 12 23:01:28.396612 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4036/7422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:28 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 1370 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:29.421297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-21223a53-bc2e-41f9-afb5-27a7d030f73a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:29.422180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-21223a53-bc2e-41f9-afb5-27a7d030f73a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:29.429917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21223a53-bc2e-41f9-afb5-27a7d030f73a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:29.430420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21223a53-bc2e-41f9-afb5-27a7d030f73a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:29.430874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21223a53-bc2e-41f9-afb5-27a7d030f73a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:29.431617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21223a53-bc2e-41f9-afb5-27a7d030f73a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:29.432365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21223a53-bc2e-41f9-afb5-27a7d030f73a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:29.432946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21223a53-bc2e-41f9-afb5-27a7d030f73a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:29.447769 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-21223a53-bc2e-41f9-afb5-27a7d030f73a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] HTTP exception thrown: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-21223a53-bc2e-41f9-afb5-27a7d030f73a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Request method failure captured: Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 HTTP/1.1 Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0WrKQiBfy0XSANASA5fCFbD4GR8tuMwOAMN25efH-T8eGJGJ9GqINSx71zrrS3STQYGkkMmRKLW9d4tVwDR4SqLAQg3JTIXjTWQBGkushtLJhuadXQwH02STvq4BQuhp2LfpRdQBY1OcY_j-rJ13jlHiZrptRT0JEkKLcabSXJo4D8 Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e44a4f6e4faa450b9850cd5bfbe53d59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: dc38342011d04f98aa06f9474fe6f402 Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2'} Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:29.449620 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:29.455011 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:29.455011 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:29.455011 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:29.455011 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:29.455011 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:29.455011 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:29.455011 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:29.455011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-21223a53-bc2e-41f9-afb5-27a7d030f73a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Returning 404 to user: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:29.455011 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-21223a53-bc2e-41f9-afb5-27a7d030f73a tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 404 len: 111 microversion: 2.1 time: 0.035094 Oct 12 23:01:29.455011 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3387/7423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:29 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:01:29.515110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-24ecae8c-59de-41ac-9f30-cb89ba1b8f77 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:29.517305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-24ecae8c-59de-41ac-9f30-cb89ba1b8f77 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:29.524011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24ecae8c-59de-41ac-9f30-cb89ba1b8f77 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:29.524497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24ecae8c-59de-41ac-9f30-cb89ba1b8f77 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:29.524931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24ecae8c-59de-41ac-9f30-cb89ba1b8f77 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:29.525621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24ecae8c-59de-41ac-9f30-cb89ba1b8f77 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:29.526068 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24ecae8c-59de-41ac-9f30-cb89ba1b8f77 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:29.526495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24ecae8c-59de-41ac-9f30-cb89ba1b8f77 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:29.539560 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-24ecae8c-59de-41ac-9f30-cb89ba1b8f77 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] HTTP exception thrown: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-24ecae8c-59de-41ac-9f30-cb89ba1b8f77 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Request method failure captured: Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2/os-volume_attachments HTTP/1.1 Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0WrKQiBfy0XSANASA5fCFbD4GR8tuMwOAMN25efH-T8eGJGJ9GqINSx71zrrS3STQYGkkMmRKLW9d4tVwDR4SqLAQg3JTIXjTWQBGkushtLJhuadXQwH02STvq4BQuhp2LfpRdQBY1OcY_j-rJ13jlHiZrptRT0JEkKLcabSXJo4D8 Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e44a4f6e4faa450b9850cd5bfbe53d59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: dc38342011d04f98aa06f9474fe6f402 Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'server_id': 'dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2'} Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:29.541244 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:29.545690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:29.545690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:29.545690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:29.545690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:29.545690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:29.545690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:29.545690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:29.545690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:29.545690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:29.545690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:29.545690 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:29.545690 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-24ecae8c-59de-41ac-9f30-cb89ba1b8f77 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Returning 404 to user: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:29.545690 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-24ecae8c-59de-41ac-9f30-cb89ba1b8f77 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031981 Oct 12 23:01:29.545690 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4037/7424] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:01:29 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:01:32.865165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e48441a7-02e5-4d6e-a366-39b32d707c26 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:32.865968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e48441a7-02e5-4d6e-a366-39b32d707c26 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:32.869342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=32 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:32.875230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e48441a7-02e5-4d6e-a366-39b32d707c26 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:32.875759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e48441a7-02e5-4d6e-a366-39b32d707c26 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:32.876211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e48441a7-02e5-4d6e-a366-39b32d707c26 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:32.876933 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e48441a7-02e5-4d6e-a366-39b32d707c26 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:32.877401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e48441a7-02e5-4d6e-a366-39b32d707c26 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:32.877935 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e48441a7-02e5-4d6e-a366-39b32d707c26 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:32.880865 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=88 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:32.893980 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-e48441a7-02e5-4d6e-a366-39b32d707c26 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] HTTP exception thrown: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e48441a7-02e5-4d6e-a366-39b32d707c26 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Request method failure captured: Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 HTTP/1.1 Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0WrKQiBfy0XSANASA5fCFbD4GR8tuMwOAMN25efH-T8eGJGJ9GqINSx71zrrS3STQYGkkMmRKLW9d4tVwDR4SqLAQg3JTIXjTWQBGkushtLJhuadXQwH02STvq4BQuhp2LfpRdQBY1OcY_j-rJ13jlHiZrptRT0JEkKLcabSXJo4D8 Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e44a4f6e4faa450b9850cd5bfbe53d59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: dc38342011d04f98aa06f9474fe6f402 Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2'} Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:32.895622 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:32.899449 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:32.899449 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:32.899449 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:32.899449 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:32.899449 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:32.899449 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:32.899449 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:32.899449 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:32.899449 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:32.899449 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:32.899449 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:32.899449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e48441a7-02e5-4d6e-a366-39b32d707c26 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Returning 404 to user: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:32.899449 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e48441a7-02e5-4d6e-a366-39b32d707c26 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 404 len: 111 microversion: 2.1 time: 0.035946 Oct 12 23:01:32.899449 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3388/7425] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:01:32 2022] DELETE /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:01:32.906370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-37713604-baca-4bb1-84fc-1a401ac3a4b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:32.906999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-37713604-baca-4bb1-84fc-1a401ac3a4b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:32.914370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37713604-baca-4bb1-84fc-1a401ac3a4b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:32.914739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37713604-baca-4bb1-84fc-1a401ac3a4b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:32.915179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37713604-baca-4bb1-84fc-1a401ac3a4b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:32.915908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37713604-baca-4bb1-84fc-1a401ac3a4b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:32.916367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37713604-baca-4bb1-84fc-1a401ac3a4b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:32.916795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-37713604-baca-4bb1-84fc-1a401ac3a4b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:32.931937 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-37713604-baca-4bb1-84fc-1a401ac3a4b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] HTTP exception thrown: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-37713604-baca-4bb1-84fc-1a401ac3a4b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Request method failure captured: Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 HTTP/1.1 Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0WrKQiBfy0XSANASA5fCFbD4GR8tuMwOAMN25efH-T8eGJGJ9GqINSx71zrrS3STQYGkkMmRKLW9d4tVwDR4SqLAQg3JTIXjTWQBGkushtLJhuadXQwH02STvq4BQuhp2LfpRdQBY1OcY_j-rJ13jlHiZrptRT0JEkKLcabSXJo4D8 Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e44a4f6e4faa450b9850cd5bfbe53d59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: dc38342011d04f98aa06f9474fe6f402 Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2'} Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:32.933579 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:32.937354 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:32.937354 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:32.937354 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:32.937354 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:32.937354 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:32.937354 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. Oct 12 23:01:32.937354 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:32.937354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-37713604-baca-4bb1-84fc-1a401ac3a4b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Returning 404 to user: Instance dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:32.937354 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-37713604-baca-4bb1-84fc-1a401ac3a4b5 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2" status: 404 len: 111 microversion: 2.1 time: 0.033032 Oct 12 23:01:32.937354 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4038/7426] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:32 2022] GET /compute/v2.1/servers/dc7d3d9e-2ac6-44b9-aac5-8e6a91525fb2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:01:32.943965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-00c629cd-ef1c-4273-91f3-4a9ec67da849 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:32.944486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-00c629cd-ef1c-4273-91f3-4a9ec67da849 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:32.950607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00c629cd-ef1c-4273-91f3-4a9ec67da849 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:32.951112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00c629cd-ef1c-4273-91f3-4a9ec67da849 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:32.951627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00c629cd-ef1c-4273-91f3-4a9ec67da849 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:32.952350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00c629cd-ef1c-4273-91f3-4a9ec67da849 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:32.952826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00c629cd-ef1c-4273-91f3-4a9ec67da849 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:32.953277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00c629cd-ef1c-4273-91f3-4a9ec67da849 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:32.967486 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-00c629cd-ef1c-4273-91f3-4a9ec67da849 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] HTTP exception thrown: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-00c629cd-ef1c-4273-91f3-4a9ec67da849 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Request method failure captured: Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 HTTP/1.1 Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0WrKQiBfy0XSANASA5fCFbD4GR8tuMwOAMN25efH-T8eGJGJ9GqINSx71zrrS3STQYGkkMmRKLW9d4tVwDR4SqLAQg3JTIXjTWQBGkushtLJhuadXQwH02STvq4BQuhp2LfpRdQBY1OcY_j-rJ13jlHiZrptRT0JEkKLcabSXJo4D8 Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e44a4f6e4faa450b9850cd5bfbe53d59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: dc38342011d04f98aa06f9474fe6f402 Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '8e3d132e-7e81-4f58-b6ea-b4e6c02d6974'} Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:32.969102 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:32.973482 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 23:01:32.973482 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:32.973482 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:32.973482 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:32.973482 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:32.973482 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:32.973482 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:32.973482 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:32.973482 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:32.973482 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 23:01:32.973482 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:32.973482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-00c629cd-ef1c-4273-91f3-4a9ec67da849 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Returning 404 to user: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:32.973482 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-00c629cd-ef1c-4273-91f3-4a9ec67da849 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 404 len: 111 microversion: 2.1 time: 0.030601 Oct 12 23:01:32.974367 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3389/7427] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:01:32 2022] DELETE /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:01:32.979671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6285e779-d112-4b93-bf13-64edbe1d3b1f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:32.980303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6285e779-d112-4b93-bf13-64edbe1d3b1f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:32.982674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:32.988651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6285e779-d112-4b93-bf13-64edbe1d3b1f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:32.989184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6285e779-d112-4b93-bf13-64edbe1d3b1f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:32.989632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6285e779-d112-4b93-bf13-64edbe1d3b1f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:32.990339 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6285e779-d112-4b93-bf13-64edbe1d3b1f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:32.991053 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6285e779-d112-4b93-bf13-64edbe1d3b1f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:32.991508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6285e779-d112-4b93-bf13-64edbe1d3b1f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:33.005643 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-6285e779-d112-4b93-bf13-64edbe1d3b1f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] HTTP exception thrown: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6285e779-d112-4b93-bf13-64edbe1d3b1f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Request method failure captured: Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 HTTP/1.1 Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0WrKQiBfy0XSANASA5fCFbD4GR8tuMwOAMN25efH-T8eGJGJ9GqINSx71zrrS3STQYGkkMmRKLW9d4tVwDR4SqLAQg3JTIXjTWQBGkushtLJhuadXQwH02STvq4BQuhp2LfpRdQBY1OcY_j-rJ13jlHiZrptRT0JEkKLcabSXJo4D8 Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e44a4f6e4faa450b9850cd5bfbe53d59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: dc38342011d04f98aa06f9474fe6f402 Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '8e3d132e-7e81-4f58-b6ea-b4e6c02d6974'} Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:33.007194 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.011527 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:33.011527 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:33.011527 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:33.011527 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:33.011527 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:33.011527 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. Oct 12 23:01:33.011527 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.011527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6285e779-d112-4b93-bf13-64edbe1d3b1f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Returning 404 to user: Instance 8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:33.011527 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6285e779-d112-4b93-bf13-64edbe1d3b1f tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974" status: 404 len: 111 microversion: 2.1 time: 0.032895 Oct 12 23:01:33.011527 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4039/7428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:32 2022] GET /compute/v2.1/servers/8e3d132e-7e81-4f58-b6ea-b4e6c02d6974 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:01:33.017356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-77103e8d-e21d-4789-b235-7b1c4909ec17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:33.017877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-77103e8d-e21d-4789-b235-7b1c4909ec17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:33.023856 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77103e8d-e21d-4789-b235-7b1c4909ec17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:33.024361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77103e8d-e21d-4789-b235-7b1c4909ec17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:33.024820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77103e8d-e21d-4789-b235-7b1c4909ec17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:33.025538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77103e8d-e21d-4789-b235-7b1c4909ec17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:33.026013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77103e8d-e21d-4789-b235-7b1c4909ec17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:33.026463 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77103e8d-e21d-4789-b235-7b1c4909ec17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:33.040750 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-77103e8d-e21d-4789-b235-7b1c4909ec17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] HTTP exception thrown: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-77103e8d-e21d-4789-b235-7b1c4909ec17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Request method failure captured: Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 HTTP/1.1 Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0WrKQiBfy0XSANASA5fCFbD4GR8tuMwOAMN25efH-T8eGJGJ9GqINSx71zrrS3STQYGkkMmRKLW9d4tVwDR4SqLAQg3JTIXjTWQBGkushtLJhuadXQwH02STvq4BQuhp2LfpRdQBY1OcY_j-rJ13jlHiZrptRT0JEkKLcabSXJo4D8 Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e44a4f6e4faa450b9850cd5bfbe53d59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: dc38342011d04f98aa06f9474fe6f402 Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '4d6347f3-f269-4c9b-aea9-5c81bc71d0a8'} Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:33.042319 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:33.047577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 23:01:33.047577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.047577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:33.047577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.047577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:33.047577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:33.047577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:33.047577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:33.047577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:33.047577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 23:01:33.047577 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.047577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-77103e8d-e21d-4789-b235-7b1c4909ec17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Returning 404 to user: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:33.047577 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-77103e8d-e21d-4789-b235-7b1c4909ec17 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 404 len: 111 microversion: 2.1 time: 0.030428 Oct 12 23:01:33.047577 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3390/7429] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:01:33 2022] DELETE /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:01:33.052985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-acbca8be-ed54-4357-bcee-f974829bcb42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:33.053617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-acbca8be-ed54-4357-bcee-f974829bcb42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:33.059691 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acbca8be-ed54-4357-bcee-f974829bcb42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:33.060225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acbca8be-ed54-4357-bcee-f974829bcb42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:33.060670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acbca8be-ed54-4357-bcee-f974829bcb42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:33.061373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acbca8be-ed54-4357-bcee-f974829bcb42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:33.061836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acbca8be-ed54-4357-bcee-f974829bcb42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:33.062267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acbca8be-ed54-4357-bcee-f974829bcb42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:33.076475 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-acbca8be-ed54-4357-bcee-f974829bcb42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] HTTP exception thrown: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-acbca8be-ed54-4357-bcee-f974829bcb42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Request method failure captured: Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 HTTP/1.1 Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0WrKQiBfy0XSANASA5fCFbD4GR8tuMwOAMN25efH-T8eGJGJ9GqINSx71zrrS3STQYGkkMmRKLW9d4tVwDR4SqLAQg3JTIXjTWQBGkushtLJhuadXQwH02STvq4BQuhp2LfpRdQBY1OcY_j-rJ13jlHiZrptRT0JEkKLcabSXJo4D8 Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e44a4f6e4faa450b9850cd5bfbe53d59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: dc38342011d04f98aa06f9474fe6f402 Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '4d6347f3-f269-4c9b-aea9-5c81bc71d0a8'} Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:33.078035 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.082179 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:33.082179 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:33.082179 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:33.082179 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:33.082179 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:33.082179 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. Oct 12 23:01:33.082179 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.082179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-acbca8be-ed54-4357-bcee-f974829bcb42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Returning 404 to user: Instance 4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:33.082179 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-acbca8be-ed54-4357-bcee-f974829bcb42 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8" status: 404 len: 111 microversion: 2.1 time: 0.030390 Oct 12 23:01:33.082179 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4040/7430] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:33 2022] GET /compute/v2.1/servers/4d6347f3-f269-4c9b-aea9-5c81bc71d0a8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:01:33.088554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b6af7a39-be2f-4e1e-ace1-a56fe683cd33 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:33.089188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b6af7a39-be2f-4e1e-ace1-a56fe683cd33 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:33.096030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6af7a39-be2f-4e1e-ace1-a56fe683cd33 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:33.096575 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6af7a39-be2f-4e1e-ace1-a56fe683cd33 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:33.097038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6af7a39-be2f-4e1e-ace1-a56fe683cd33 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:33.097764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6af7a39-be2f-4e1e-ace1-a56fe683cd33 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:33.098264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6af7a39-be2f-4e1e-ace1-a56fe683cd33 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:33.098717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6af7a39-be2f-4e1e-ace1-a56fe683cd33 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:33.112585 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-b6af7a39-be2f-4e1e-ace1-a56fe683cd33 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] HTTP exception thrown: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b6af7a39-be2f-4e1e-ace1-a56fe683cd33 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Request method failure captured: Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 HTTP/1.1 Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0WrKQiBfy0XSANASA5fCFbD4GR8tuMwOAMN25efH-T8eGJGJ9GqINSx71zrrS3STQYGkkMmRKLW9d4tVwDR4SqLAQg3JTIXjTWQBGkushtLJhuadXQwH02STvq4BQuhp2LfpRdQBY1OcY_j-rJ13jlHiZrptRT0JEkKLcabSXJo4D8 Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e44a4f6e4faa450b9850cd5bfbe53d59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: dc38342011d04f98aa06f9474fe6f402 Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '8c4a03f0-5862-4c3e-9e20-c141d0c7f666'} Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:33.114175 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:33.121765 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 23:01:33.121765 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.121765 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:33.121765 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.121765 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:33.121765 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:33.121765 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:33.121765 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:33.121765 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:33.121765 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 23:01:33.121765 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.121765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b6af7a39-be2f-4e1e-ace1-a56fe683cd33 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Returning 404 to user: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:33.121765 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b6af7a39-be2f-4e1e-ace1-a56fe683cd33 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 404 len: 111 microversion: 2.1 time: 0.031134 Oct 12 23:01:33.121765 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3391/7431] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:01:33 2022] DELETE /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:01:33.124321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f63804a4-905d-4ab4-8032-fb862f5f7d60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:33.124944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f63804a4-905d-4ab4-8032-fb862f5f7d60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [instance: 8c4a03f0-5862-4c3e-9e20-c141d0c7f666] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:33.130940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f63804a4-905d-4ab4-8032-fb862f5f7d60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:33.131470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f63804a4-905d-4ab4-8032-fb862f5f7d60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:33.131918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f63804a4-905d-4ab4-8032-fb862f5f7d60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:33.132614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f63804a4-905d-4ab4-8032-fb862f5f7d60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:33.133076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f63804a4-905d-4ab4-8032-fb862f5f7d60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:33.133509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f63804a4-905d-4ab4-8032-fb862f5f7d60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:33.147978 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-f63804a4-905d-4ab4-8032-fb862f5f7d60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] HTTP exception thrown: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f63804a4-905d-4ab4-8032-fb862f5f7d60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Request method failure captured: Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 HTTP/1.1 Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0WrKQiBfy0XSANASA5fCFbD4GR8tuMwOAMN25efH-T8eGJGJ9GqINSx71zrrS3STQYGkkMmRKLW9d4tVwDR4SqLAQg3JTIXjTWQBGkushtLJhuadXQwH02STvq4BQuhp2LfpRdQBY1OcY_j-rJ13jlHiZrptRT0JEkKLcabSXJo4D8 Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e44a4f6e4faa450b9850cd5bfbe53d59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e44a4f6e4faa450b9850cd5bfbe53d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: e44a4f6e4faa450b9850cd5bfbe53d59 Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServerActionsTestJSON-486969938 Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: dc38342011d04f98aa06f9474fe6f402 Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServerActionsTestJSON-486969938-project Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '8c4a03f0-5862-4c3e-9e20-c141d0c7f666'} Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:33.149562 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.157114 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:33.157114 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:33.157114 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:33.157114 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:33.157114 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:33.157114 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. Oct 12 23:01:33.157114 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:01:33.157114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f63804a4-905d-4ab4-8032-fb862f5f7d60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Returning 404 to user: Instance 8c4a03f0-5862-4c3e-9e20-c141d0c7f666 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:33.157114 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f63804a4-905d-4ab4-8032-fb862f5f7d60 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666" status: 404 len: 111 microversion: 2.1 time: 0.030539 Oct 12 23:01:33.157114 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4041/7432] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:33 2022] GET /compute/v2.1/servers/8c4a03f0-5862-4c3e-9e20-c141d0c7f666 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:01:33.159608 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-43966923-000c-4b04-86cc-45175fc4dc14 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] Calling method '.version_select at 0x7f5123501160>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:33.164082 n-d-861111-1 devstack@n-api.service[120452]: ERROR oslo.messaging._drivers.impl_rabbit [None req-43966923-000c-4b04-86cc-45175fc4dc14 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [964e3926-3add-4edc-bbbe-de4152248cc8] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:01:34.171917 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [None req-43966923-000c-4b04-86cc-45175fc4dc14 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] [964e3926-3add-4edc-bbbe-de4152248cc8] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37214. Oct 12 23:01:34.191348 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-43966923-000c-4b04-86cc-45175fc4dc14 tempest-ServerActionsTestJSON-486969938 tempest-ServerActionsTestJSON-486969938-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203075025" status: 202 len: 0 microversion: 2.1 time: 1.035469 Oct 12 23:01:34.191930 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3392/7433] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 12 23:01:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203075025 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 23:01:43.331000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=5 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:43.331771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=16 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:43.468868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-123770866", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "310f994a-6e14-4ca0-8e0b-6770400db92d"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:43.525570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] validate_networks() for [('310f994a-6e14-4ca0-8e0b-6770400db92d', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:01:43.926520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:01:43.926932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:01:43.927446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:01:43.927861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:01:43.928275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:01:43.938557 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:43.939047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:43.939526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:43.940291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:43.940746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:43.941174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:43.958789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Getting quotas for project 398f228d3ac84789866ef670782dd42f. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:01:43.964260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Getting quotas for user 81fa26b870b54dadb8169bce6ce4ccc8 and project 398f228d3ac84789866ef670782dd42f. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:01:43.977362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:01:43.979723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:01:44.027412 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7824f4d1-6958-48bb-bc65-4061415f8218 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701893 Oct 12 23:01:44.035384 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4042/7434] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 23:01:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:01:44.040276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-005dde18-b332-43e8-b79f-284f86ba7447 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:44.040920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-005dde18-b332-43e8-b79f-284f86ba7447 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:44.044657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=7 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:44.105782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-005dde18-b332-43e8-b79f-284f86ba7447 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:44.112933 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-005dde18-b332-43e8-b79f-284f86ba7447 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1216 microversion: 2.1 time: 0.076499 Oct 12 23:01:44.113516 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3393/7435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:44 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1216 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:45.139048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5babe3e5-aeba-4b4b-9108-90c9dd7c75a4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:45.139731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5babe3e5-aeba-4b4b-9108-90c9dd7c75a4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:45.152950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5babe3e5-aeba-4b4b-9108-90c9dd7c75a4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:45.153484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5babe3e5-aeba-4b4b-9108-90c9dd7c75a4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:45.158372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5babe3e5-aeba-4b4b-9108-90c9dd7c75a4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:45.159268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5babe3e5-aeba-4b4b-9108-90c9dd7c75a4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:45.159815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5babe3e5-aeba-4b4b-9108-90c9dd7c75a4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:45.163169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5babe3e5-aeba-4b4b-9108-90c9dd7c75a4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:45.239192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5babe3e5-aeba-4b4b-9108-90c9dd7c75a4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:45.250039 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5babe3e5-aeba-4b4b-9108-90c9dd7c75a4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1276 microversion: 2.1 time: 0.117007 Oct 12 23:01:45.250778 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4043/7436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:45 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1276 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:46.279353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7abb8d43-1000-4587-9361-dc83e60eae1c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:46.280000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7abb8d43-1000-4587-9361-dc83e60eae1c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:46.287846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7abb8d43-1000-4587-9361-dc83e60eae1c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:46.288585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7abb8d43-1000-4587-9361-dc83e60eae1c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:46.289479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7abb8d43-1000-4587-9361-dc83e60eae1c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:46.290368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7abb8d43-1000-4587-9361-dc83e60eae1c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:46.291009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7abb8d43-1000-4587-9361-dc83e60eae1c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:46.291669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7abb8d43-1000-4587-9361-dc83e60eae1c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:46.571552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7abb8d43-1000-4587-9361-dc83e60eae1c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:46.585311 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7abb8d43-1000-4587-9361-dc83e60eae1c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1316 microversion: 2.1 time: 0.314402 Oct 12 23:01:46.585916 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3394/7437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:46 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:46.790230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f0ea2e45-1756-4d20-ac2d-8d9bd09bd043 req-568a9082-627f-490b-a4f7-2687614dc402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1899bc-9491-44cf-b4cf-3233706e6ae9", "tag": "ada5e56d-48db-4ed3-ba00-35aa319db72c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:46.803323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f0ea2e45-1756-4d20-ac2d-8d9bd09bd043 req-568a9082-627f-490b-a4f7-2687614dc402 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:46.803820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f0ea2e45-1756-4d20-ac2d-8d9bd09bd043 req-568a9082-627f-490b-a4f7-2687614dc402 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:46.804294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f0ea2e45-1756-4d20-ac2d-8d9bd09bd043 req-568a9082-627f-490b-a4f7-2687614dc402 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:46.823133 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f0ea2e45-1756-4d20-ac2d-8d9bd09bd043 req-568a9082-627f-490b-a4f7-2687614dc402 service nova] Creating event network-changed:ada5e56d-48db-4ed3-ba00-35aa319db72c for instance 6f1899bc-9491-44cf-b4cf-3233706e6ae9 on n-h2-861111-1 Oct 12 23:01:46.830593 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f0ea2e45-1756-4d20-ac2d-8d9bd09bd043 req-568a9082-627f-490b-a4f7-2687614dc402 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044067 Oct 12 23:01:46.831217 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4044/7438] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:47.609418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-089dc3d3-4f91-4a60-bddd-025f84a048d7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:47.610051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-089dc3d3-4f91-4a60-bddd-025f84a048d7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:47.617112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-089dc3d3-4f91-4a60-bddd-025f84a048d7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:47.617607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-089dc3d3-4f91-4a60-bddd-025f84a048d7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:47.618083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-089dc3d3-4f91-4a60-bddd-025f84a048d7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:47.618818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-089dc3d3-4f91-4a60-bddd-025f84a048d7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:47.619290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-089dc3d3-4f91-4a60-bddd-025f84a048d7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:47.619736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-089dc3d3-4f91-4a60-bddd-025f84a048d7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:47.753741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-089dc3d3-4f91-4a60-bddd-025f84a048d7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:47.761520 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-089dc3d3-4f91-4a60-bddd-025f84a048d7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1316 microversion: 2.1 time: 0.156582 Oct 12 23:01:47.762088 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3395/7439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:47 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:48.784949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-276ce195-ea96-41f3-bc68-a8727a17a257 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:48.785657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-276ce195-ea96-41f3-bc68-a8727a17a257 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:48.791867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-276ce195-ea96-41f3-bc68-a8727a17a257 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:48.792351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-276ce195-ea96-41f3-bc68-a8727a17a257 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:48.792793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-276ce195-ea96-41f3-bc68-a8727a17a257 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:48.793488 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-276ce195-ea96-41f3-bc68-a8727a17a257 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:48.793942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-276ce195-ea96-41f3-bc68-a8727a17a257 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:48.794376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-276ce195-ea96-41f3-bc68-a8727a17a257 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:48.931080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-276ce195-ea96-41f3-bc68-a8727a17a257 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:48.939437 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-276ce195-ea96-41f3-bc68-a8727a17a257 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1316 microversion: 2.1 time: 0.159544 Oct 12 23:01:48.940028 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4045/7440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:48 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:49.962010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-58d03bda-17d3-4274-8fef-e68f5d56a6b6 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:49.962582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-58d03bda-17d3-4274-8fef-e68f5d56a6b6 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:49.970121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58d03bda-17d3-4274-8fef-e68f5d56a6b6 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:49.970595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58d03bda-17d3-4274-8fef-e68f5d56a6b6 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:49.971046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58d03bda-17d3-4274-8fef-e68f5d56a6b6 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:49.971774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58d03bda-17d3-4274-8fef-e68f5d56a6b6 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:49.972369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58d03bda-17d3-4274-8fef-e68f5d56a6b6 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:49.972810 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58d03bda-17d3-4274-8fef-e68f5d56a6b6 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:50.098990 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-58d03bda-17d3-4274-8fef-e68f5d56a6b6 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:50.106893 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-58d03bda-17d3-4274-8fef-e68f5d56a6b6 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1316 microversion: 2.1 time: 0.148605 Oct 12 23:01:50.107499 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3396/7441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:49 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:51.129958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a04eabb8-7793-44ba-b240-0dc30325488c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:51.130601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a04eabb8-7793-44ba-b240-0dc30325488c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:51.137347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a04eabb8-7793-44ba-b240-0dc30325488c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:51.138320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a04eabb8-7793-44ba-b240-0dc30325488c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:51.138756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a04eabb8-7793-44ba-b240-0dc30325488c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:51.139468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a04eabb8-7793-44ba-b240-0dc30325488c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:51.139923 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a04eabb8-7793-44ba-b240-0dc30325488c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:51.140347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a04eabb8-7793-44ba-b240-0dc30325488c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:51.267071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a04eabb8-7793-44ba-b240-0dc30325488c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:51.274677 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a04eabb8-7793-44ba-b240-0dc30325488c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1316 microversion: 2.1 time: 0.148677 Oct 12 23:01:51.275258 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4046/7442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:51 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:52.297903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5343a279-329d-4732-bf84-60f43bf1d00c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:52.298531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5343a279-329d-4732-bf84-60f43bf1d00c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:52.305199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5343a279-329d-4732-bf84-60f43bf1d00c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:52.305688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5343a279-329d-4732-bf84-60f43bf1d00c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:52.306136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5343a279-329d-4732-bf84-60f43bf1d00c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:52.306838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5343a279-329d-4732-bf84-60f43bf1d00c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:52.307325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5343a279-329d-4732-bf84-60f43bf1d00c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:52.307766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5343a279-329d-4732-bf84-60f43bf1d00c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:52.434288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5343a279-329d-4732-bf84-60f43bf1d00c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:52.442628 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5343a279-329d-4732-bf84-60f43bf1d00c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1316 microversion: 2.1 time: 0.148633 Oct 12 23:01:52.443201 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3397/7443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:52 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:53.466371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-24c4d861-fdb7-425d-a1b1-e9502362ae88 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:53.466996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-24c4d861-fdb7-425d-a1b1-e9502362ae88 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:53.473790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24c4d861-fdb7-425d-a1b1-e9502362ae88 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:53.474274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24c4d861-fdb7-425d-a1b1-e9502362ae88 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:53.474716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24c4d861-fdb7-425d-a1b1-e9502362ae88 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:53.475444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24c4d861-fdb7-425d-a1b1-e9502362ae88 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:53.475903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24c4d861-fdb7-425d-a1b1-e9502362ae88 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:53.476332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-24c4d861-fdb7-425d-a1b1-e9502362ae88 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:53.605535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-24c4d861-fdb7-425d-a1b1-e9502362ae88 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:53.613703 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-24c4d861-fdb7-425d-a1b1-e9502362ae88 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1316 microversion: 2.1 time: 0.151249 Oct 12 23:01:53.614284 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4047/7444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:53 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:53.831797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-b5b13348-aecb-44f5-b9c9-7a38144b764f req-a620b279-ae13-4dde-922f-6cf8baeb64c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1899bc-9491-44cf-b4cf-3233706e6ae9", "name": "network-vif-plugged", "status": "completed", "tag": "ada5e56d-48db-4ed3-ba00-35aa319db72c"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:53.844028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b5b13348-aecb-44f5-b9c9-7a38144b764f req-a620b279-ae13-4dde-922f-6cf8baeb64c3 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:53.844527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b5b13348-aecb-44f5-b9c9-7a38144b764f req-a620b279-ae13-4dde-922f-6cf8baeb64c3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:53.844976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b5b13348-aecb-44f5-b9c9-7a38144b764f req-a620b279-ae13-4dde-922f-6cf8baeb64c3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:53.856957 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-b5b13348-aecb-44f5-b9c9-7a38144b764f req-a620b279-ae13-4dde-922f-6cf8baeb64c3 service nova] Creating event network-vif-plugged:ada5e56d-48db-4ed3-ba00-35aa319db72c for instance 6f1899bc-9491-44cf-b4cf-3233706e6ae9 on n-h2-861111-1 Oct 12 23:01:53.862295 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-b5b13348-aecb-44f5-b9c9-7a38144b764f req-a620b279-ae13-4dde-922f-6cf8baeb64c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034293 Oct 12 23:01:53.863095 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3398/7445] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:54.637655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a1d3491c-f41a-433e-8004-dac4889fb4f0 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:54.638903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a1d3491c-f41a-433e-8004-dac4889fb4f0 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:54.641123 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:54.641860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:54.648389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1d3491c-f41a-433e-8004-dac4889fb4f0 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:54.648878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1d3491c-f41a-433e-8004-dac4889fb4f0 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:54.649318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1d3491c-f41a-433e-8004-dac4889fb4f0 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:54.650016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1d3491c-f41a-433e-8004-dac4889fb4f0 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:54.650474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1d3491c-f41a-433e-8004-dac4889fb4f0 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:54.650905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a1d3491c-f41a-433e-8004-dac4889fb4f0 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:54.779202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a1d3491c-f41a-433e-8004-dac4889fb4f0 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:54.787688 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a1d3491c-f41a-433e-8004-dac4889fb4f0 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1316 microversion: 2.1 time: 0.153973 Oct 12 23:01:54.788271 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4048/7446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:54 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:55.812195 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ae2d7036-4282-4a35-99e6-21e23e79ebec tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:55.812928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ae2d7036-4282-4a35-99e6-21e23e79ebec tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:55.814937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:55.821265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae2d7036-4282-4a35-99e6-21e23e79ebec tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:55.821759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae2d7036-4282-4a35-99e6-21e23e79ebec tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:55.822215 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae2d7036-4282-4a35-99e6-21e23e79ebec tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:55.822927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae2d7036-4282-4a35-99e6-21e23e79ebec tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:55.823445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae2d7036-4282-4a35-99e6-21e23e79ebec tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:55.823888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae2d7036-4282-4a35-99e6-21e23e79ebec tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:55.950152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ae2d7036-4282-4a35-99e6-21e23e79ebec tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:55.957934 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ae2d7036-4282-4a35-99e6-21e23e79ebec tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1506 microversion: 2.1 time: 0.150718 Oct 12 23:01:55.958510 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3399/7447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:55 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:56.019574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1702718889", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "310f994a-6e14-4ca0-8e0b-6770400db92d"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:56.072931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] validate_networks() for [('310f994a-6e14-4ca0-8e0b-6770400db92d', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:01:56.435650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:01:56.436108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:01:56.436619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:01:56.437040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:01:56.437466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:01:56.446446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:56.446937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:56.447420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:56.448183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:56.448667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:56.449130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:56.467112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Getting quotas for project 398f228d3ac84789866ef670782dd42f. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:01:56.472419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Getting quotas for user 81fa26b870b54dadb8169bce6ce4ccc8 and project 398f228d3ac84789866ef670782dd42f. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:01:56.484856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:01:56.487179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:01:56.533785 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9d3662f6-f5a2-4e3f-81e2-f4230a1582ee tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518079 Oct 12 23:01:56.534455 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4049/7448] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 23:01:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:01:56.546102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d5c669f6-466a-4560-b7b6-572196abcc65 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:56.547399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d5c669f6-466a-4560-b7b6-572196abcc65 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:56.600651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d5c669f6-466a-4560-b7b6-572196abcc65 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:56.607628 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d5c669f6-466a-4560-b7b6-572196abcc65 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d" status: 200 len: 1217 microversion: 2.1 time: 0.065691 Oct 12 23:01:56.608203 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3400/7449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:56 2022] GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:57.632099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0eb7b63c-8636-4ef2-9c9e-76c050122fba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:57.632868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0eb7b63c-8636-4ef2-9c9e-76c050122fba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:57.640543 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0eb7b63c-8636-4ef2-9c9e-76c050122fba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:57.641055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0eb7b63c-8636-4ef2-9c9e-76c050122fba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:57.641516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0eb7b63c-8636-4ef2-9c9e-76c050122fba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:57.642250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0eb7b63c-8636-4ef2-9c9e-76c050122fba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:57.642742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0eb7b63c-8636-4ef2-9c9e-76c050122fba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:57.643204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0eb7b63c-8636-4ef2-9c9e-76c050122fba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:57.712610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0eb7b63c-8636-4ef2-9c9e-76c050122fba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:57.721261 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0eb7b63c-8636-4ef2-9c9e-76c050122fba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d" status: 200 len: 1277 microversion: 2.1 time: 0.094224 Oct 12 23:01:57.722289 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4050/7450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:57 2022] GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:58.753671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b23b7ed9-5849-4df6-bce7-bf82cbd550d8 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:58.754436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b23b7ed9-5849-4df6-bce7-bf82cbd550d8 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:58.762079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b23b7ed9-5849-4df6-bce7-bf82cbd550d8 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:58.763200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b23b7ed9-5849-4df6-bce7-bf82cbd550d8 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:58.767336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b23b7ed9-5849-4df6-bce7-bf82cbd550d8 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:58.767336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b23b7ed9-5849-4df6-bce7-bf82cbd550d8 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:58.767336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b23b7ed9-5849-4df6-bce7-bf82cbd550d8 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:58.767336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b23b7ed9-5849-4df6-bce7-bf82cbd550d8 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:58.959146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b23b7ed9-5849-4df6-bce7-bf82cbd550d8 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:58.967497 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b23b7ed9-5849-4df6-bce7-bf82cbd550d8 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d" status: 200 len: 1317 microversion: 2.1 time: 0.217731 Oct 12 23:01:58.968069 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3401/7451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:58 2022] GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:59.093972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-74ca22d2-5cc4-42e0-b327-72779c40f51e req-11fe8156-505c-43b1-b3e2-c4d3aae1a71f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d", "tag": "6f4e3194-de15-4222-aa74-94f844724100"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:59.111678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-74ca22d2-5cc4-42e0-b327-72779c40f51e req-11fe8156-505c-43b1-b3e2-c4d3aae1a71f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:59.112269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-74ca22d2-5cc4-42e0-b327-72779c40f51e req-11fe8156-505c-43b1-b3e2-c4d3aae1a71f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:59.112785 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-74ca22d2-5cc4-42e0-b327-72779c40f51e req-11fe8156-505c-43b1-b3e2-c4d3aae1a71f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:59.125980 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-74ca22d2-5cc4-42e0-b327-72779c40f51e req-11fe8156-505c-43b1-b3e2-c4d3aae1a71f service nova] Creating event network-changed:6f4e3194-de15-4222-aa74-94f844724100 for instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d on n-h1-861111-1 Oct 12 23:01:59.130872 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-74ca22d2-5cc4-42e0-b327-72779c40f51e req-11fe8156-505c-43b1-b3e2-c4d3aae1a71f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040742 Oct 12 23:01:59.131525 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4051/7452] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:59.991400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0357b034-ccda-4f40-a620-a4359be56f62 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:59.992037 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0357b034-ccda-4f40-a620-a4359be56f62 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:59.998821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0357b034-ccda-4f40-a620-a4359be56f62 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:59.999347 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0357b034-ccda-4f40-a620-a4359be56f62 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:59.999806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0357b034-ccda-4f40-a620-a4359be56f62 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:00.000516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0357b034-ccda-4f40-a620-a4359be56f62 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:00.000981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0357b034-ccda-4f40-a620-a4359be56f62 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:00.001425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0357b034-ccda-4f40-a620-a4359be56f62 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:00.139171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0357b034-ccda-4f40-a620-a4359be56f62 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:00.146901 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0357b034-ccda-4f40-a620-a4359be56f62 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d" status: 200 len: 1317 microversion: 2.1 time: 0.159737 Oct 12 23:02:00.147517 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3402/7453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:59 2022] GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:01.168496 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:02:01.169115 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 23:02:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d (ip 10.222.0.16) !!! Oct 12 23:02:01.173096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9254c435-a77d-4e87-953c-53cf5593ae87 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:01.173825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9254c435-a77d-4e87-953c-53cf5593ae87 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:01.181563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9254c435-a77d-4e87-953c-53cf5593ae87 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:01.182043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9254c435-a77d-4e87-953c-53cf5593ae87 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:01.182477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9254c435-a77d-4e87-953c-53cf5593ae87 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:01.183161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9254c435-a77d-4e87-953c-53cf5593ae87 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:01.183638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9254c435-a77d-4e87-953c-53cf5593ae87 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:01.184060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9254c435-a77d-4e87-953c-53cf5593ae87 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:01.315099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9254c435-a77d-4e87-953c-53cf5593ae87 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:01.322771 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9254c435-a77d-4e87-953c-53cf5593ae87 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d" status: 200 len: 1317 microversion: 2.1 time: 0.156572 Oct 12 23:02:01.323399 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4052/7454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:01 2022] GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:02.346711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a8739711-b2a9-41fb-b2d6-7c7448ea555e tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:02.347367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a8739711-b2a9-41fb-b2d6-7c7448ea555e tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:02.354723 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8739711-b2a9-41fb-b2d6-7c7448ea555e tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:02.355224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8739711-b2a9-41fb-b2d6-7c7448ea555e tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:02.355718 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8739711-b2a9-41fb-b2d6-7c7448ea555e tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:02.356432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8739711-b2a9-41fb-b2d6-7c7448ea555e tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:02.356902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8739711-b2a9-41fb-b2d6-7c7448ea555e tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:02.357344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8739711-b2a9-41fb-b2d6-7c7448ea555e tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:02.484262 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a8739711-b2a9-41fb-b2d6-7c7448ea555e tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:02.492267 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a8739711-b2a9-41fb-b2d6-7c7448ea555e tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d" status: 200 len: 1317 microversion: 2.1 time: 0.149518 Oct 12 23:02:02.492861 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3403/7455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:02 2022] GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:03.515028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2923de15-6bc3-40ed-a96a-125a5ab75a68 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:03.515667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2923de15-6bc3-40ed-a96a-125a5ab75a68 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:03.522459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2923de15-6bc3-40ed-a96a-125a5ab75a68 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:03.522936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2923de15-6bc3-40ed-a96a-125a5ab75a68 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:03.523402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2923de15-6bc3-40ed-a96a-125a5ab75a68 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:03.524084 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2923de15-6bc3-40ed-a96a-125a5ab75a68 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:03.524531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2923de15-6bc3-40ed-a96a-125a5ab75a68 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:03.524954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2923de15-6bc3-40ed-a96a-125a5ab75a68 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:03.652222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2923de15-6bc3-40ed-a96a-125a5ab75a68 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:03.660374 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2923de15-6bc3-40ed-a96a-125a5ab75a68 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d" status: 200 len: 1317 microversion: 2.1 time: 0.149222 Oct 12 23:02:03.660995 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4053/7456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:03 2022] GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:03.782335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-855b5070-8aff-45e3-a422-a037a2607d57 req-df6fc6b0-4cfe-4c49-8972-557ff6795b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d", "name": "network-vif-plugged", "status": "completed", "tag": "6f4e3194-de15-4222-aa74-94f844724100"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:03.788363 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:03.794883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-855b5070-8aff-45e3-a422-a037a2607d57 req-df6fc6b0-4cfe-4c49-8972-557ff6795b88 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:03.795414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-855b5070-8aff-45e3-a422-a037a2607d57 req-df6fc6b0-4cfe-4c49-8972-557ff6795b88 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:03.795938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-855b5070-8aff-45e3-a422-a037a2607d57 req-df6fc6b0-4cfe-4c49-8972-557ff6795b88 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:03.808928 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-855b5070-8aff-45e3-a422-a037a2607d57 req-df6fc6b0-4cfe-4c49-8972-557ff6795b88 service nova] Creating event network-vif-plugged:6f4e3194-de15-4222-aa74-94f844724100 for instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d on n-h1-861111-1 Oct 12 23:02:03.813926 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-855b5070-8aff-45e3-a422-a037a2607d57 req-df6fc6b0-4cfe-4c49-8972-557ff6795b88 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035911 Oct 12 23:02:03.814533 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3404/7457] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:04.685854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ec906625-a755-43a5-a3df-c98917ca4751 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:04.686415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ec906625-a755-43a5-a3df-c98917ca4751 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:04.692921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec906625-a755-43a5-a3df-c98917ca4751 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:04.693403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec906625-a755-43a5-a3df-c98917ca4751 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:04.693838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec906625-a755-43a5-a3df-c98917ca4751 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:04.694522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec906625-a755-43a5-a3df-c98917ca4751 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:04.694972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec906625-a755-43a5-a3df-c98917ca4751 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:04.695548 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ec906625-a755-43a5-a3df-c98917ca4751 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:04.829861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ec906625-a755-43a5-a3df-c98917ca4751 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:04.837615 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ec906625-a755-43a5-a3df-c98917ca4751 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d" status: 200 len: 1317 microversion: 2.1 time: 0.156466 Oct 12 23:02:04.838185 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4054/7458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:04 2022] GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:05.862243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8a856181-5d22-4837-bc84-89f0a0afabb9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:05.862971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8a856181-5d22-4837-bc84-89f0a0afabb9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:05.869494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a856181-5d22-4837-bc84-89f0a0afabb9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:05.869998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a856181-5d22-4837-bc84-89f0a0afabb9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:05.870461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a856181-5d22-4837-bc84-89f0a0afabb9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:05.871173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a856181-5d22-4837-bc84-89f0a0afabb9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:05.872216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a856181-5d22-4837-bc84-89f0a0afabb9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:05.872667 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a856181-5d22-4837-bc84-89f0a0afabb9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:06.002219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8a856181-5d22-4837-bc84-89f0a0afabb9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:06.009967 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8a856181-5d22-4837-bc84-89f0a0afabb9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d" status: 200 len: 1506 microversion: 2.1 time: 0.153077 Oct 12 23:02:06.010588 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3405/7459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:05 2022] GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:06.032930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6f2f7e03-7298-4247-babd-cba185a5c3ba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:06.033428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6f2f7e03-7298-4247-babd-cba185a5c3ba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:06.040109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f2f7e03-7298-4247-babd-cba185a5c3ba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:06.040584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f2f7e03-7298-4247-babd-cba185a5c3ba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:06.041017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f2f7e03-7298-4247-babd-cba185a5c3ba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:06.041700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f2f7e03-7298-4247-babd-cba185a5c3ba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:06.042152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f2f7e03-7298-4247-babd-cba185a5c3ba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:06.042575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6f2f7e03-7298-4247-babd-cba185a5c3ba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:06.068369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6f2f7e03-7298-4247-babd-cba185a5c3ba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:02:06.141488 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6f2f7e03-7298-4247-babd-cba185a5c3ba tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d" status: 204 len: 0 microversion: 2.1 time: 0.112244 Oct 12 23:02:06.142201 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4055/7460] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:02:06 2022] DELETE /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:02:06.150228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-844bf49e-4206-41e0-b3be-1f93bb64d1eb tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:06.150952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-844bf49e-4206-41e0-b3be-1f93bb64d1eb tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:06.156799 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-844bf49e-4206-41e0-b3be-1f93bb64d1eb tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:06.157294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-844bf49e-4206-41e0-b3be-1f93bb64d1eb tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:06.157743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-844bf49e-4206-41e0-b3be-1f93bb64d1eb tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:06.158439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-844bf49e-4206-41e0-b3be-1f93bb64d1eb tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:06.158902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-844bf49e-4206-41e0-b3be-1f93bb64d1eb tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:06.159376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-844bf49e-4206-41e0-b3be-1f93bb64d1eb tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:06.288570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-844bf49e-4206-41e0-b3be-1f93bb64d1eb tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:06.296901 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-844bf49e-4206-41e0-b3be-1f93bb64d1eb tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d" status: 200 len: 1512 microversion: 2.1 time: 0.150612 Oct 12 23:02:06.297470 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3406/7461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:06 2022] GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:07.320626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c4738035-67eb-4458-9227-6e5a9c793bce tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:07.321335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c4738035-67eb-4458-9227-6e5a9c793bce tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:07.323337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:07.324172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:07.332041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4738035-67eb-4458-9227-6e5a9c793bce tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:07.332532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4738035-67eb-4458-9227-6e5a9c793bce tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:07.332972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4738035-67eb-4458-9227-6e5a9c793bce tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:07.333673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4738035-67eb-4458-9227-6e5a9c793bce tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:07.334129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4738035-67eb-4458-9227-6e5a9c793bce tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:07.334556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4738035-67eb-4458-9227-6e5a9c793bce tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:07.462885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c4738035-67eb-4458-9227-6e5a9c793bce tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:07.470749 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c4738035-67eb-4458-9227-6e5a9c793bce tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d" status: 200 len: 1512 microversion: 2.1 time: 0.154377 Oct 12 23:02:07.471336 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4056/7462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:07 2022] GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:08.373600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-dfd4d0bf-a026-4182-8682-cd55eda52152 req-7e7f37e2-e161-4312-b9c4-ba87d7266d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d", "name": "network-vif-deleted", "tag": "6f4e3194-de15-4222-aa74-94f844724100"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:08.378607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:08.385480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dfd4d0bf-a026-4182-8682-cd55eda52152 req-7e7f37e2-e161-4312-b9c4-ba87d7266d2a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:08.385983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dfd4d0bf-a026-4182-8682-cd55eda52152 req-7e7f37e2-e161-4312-b9c4-ba87d7266d2a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:08.386437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-dfd4d0bf-a026-4182-8682-cd55eda52152 req-7e7f37e2-e161-4312-b9c4-ba87d7266d2a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:08.399387 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-dfd4d0bf-a026-4182-8682-cd55eda52152 req-7e7f37e2-e161-4312-b9c4-ba87d7266d2a service nova] Creating event network-vif-deleted:6f4e3194-de15-4222-aa74-94f844724100 for instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d on n-h1-861111-1 Oct 12 23:02:08.405051 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-dfd4d0bf-a026-4182-8682-cd55eda52152 req-7e7f37e2-e161-4312-b9c4-ba87d7266d2a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035186 Oct 12 23:02:08.405684 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3407/7463] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:08.493674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-07cb25f2-d816-4e20-b134-9a75816e394b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:08.494578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-07cb25f2-d816-4e20-b134-9a75816e394b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:08.502885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07cb25f2-d816-4e20-b134-9a75816e394b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:08.503409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07cb25f2-d816-4e20-b134-9a75816e394b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:08.503903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07cb25f2-d816-4e20-b134-9a75816e394b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:08.504765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07cb25f2-d816-4e20-b134-9a75816e394b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:08.505219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07cb25f2-d816-4e20-b134-9a75816e394b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:08.505706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07cb25f2-d816-4e20-b134-9a75816e394b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:08.537807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07cb25f2-d816-4e20-b134-9a75816e394b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:08.538286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07cb25f2-d816-4e20-b134-9a75816e394b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:08.538719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-07cb25f2-d816-4e20-b134-9a75816e394b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:08.539169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-07cb25f2-d816-4e20-b134-9a75816e394b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lazy-loading 'fault' on Instance uuid 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:02:08.580359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-07cb25f2-d816-4e20-b134-9a75816e394b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:08.588136 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-07cb25f2-d816-4e20-b134-9a75816e394b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d" status: 200 len: 1307 microversion: 2.1 time: 0.099076 Oct 12 23:02:08.588701 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4057/7464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:08 2022] GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:02:09.613452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-270a2c98-52c0-4347-ab1f-531ddb7adbc1 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:09.614167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-270a2c98-52c0-4347-ab1f-531ddb7adbc1 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:09.620566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-270a2c98-52c0-4347-ab1f-531ddb7adbc1 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:09.621059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-270a2c98-52c0-4347-ab1f-531ddb7adbc1 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:09.621502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-270a2c98-52c0-4347-ab1f-531ddb7adbc1 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:09.622194 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-270a2c98-52c0-4347-ab1f-531ddb7adbc1 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:09.622651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-270a2c98-52c0-4347-ab1f-531ddb7adbc1 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:09.623082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-270a2c98-52c0-4347-ab1f-531ddb7adbc1 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:09.636157 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-270a2c98-52c0-4347-ab1f-531ddb7adbc1 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] HTTP exception thrown: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-270a2c98-52c0-4347-ab1f-531ddb7adbc1 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Request method failure captured: Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d HTTP/1.1 Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0dX1p9tMvZ-pYVLlI5N7Cwp6lqaDKHyO56gyUn39KM5rfsyM-blqm4nB-w9ZUdTsuZrei9akkMY4X0dzbfaimLV1ydx4y2bz0VsmuPdcu6wthOn27wr4hP0-uekJIPbvuEEnfCyrRJZs_W-ZwXJWGpvO9fxpm9LCNNrZ1ZdXgThejw Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 398f228d3ac84789866ef670782dd42f Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/398f228d3ac84789866ef670782dd42f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/398f228d3ac84789866ef670782dd42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_398f228d3ac84789866ef670782dd42f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/398f228d3ac84789866ef670782dd42f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 398f228d3ac84789866ef670782dd42f Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1873095955-project Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 81fa26b870b54dadb8169bce6ce4ccc8 Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1873095955-project Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d'} Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:09.637797 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:09.642794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:09.642794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:09.642794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:09.642794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:02:09.642794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:02:09.642794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. Oct 12 23:02:09.642794 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:09.642794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-270a2c98-52c0-4347-ab1f-531ddb7adbc1 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Returning 404 to user: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:02:09.642794 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-270a2c98-52c0-4347-ab1f-531ddb7adbc1 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d" status: 404 len: 111 microversion: 2.1 time: 0.030937 Oct 12 23:02:09.642794 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3408/7465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:09 2022] GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:02:09.648578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f369f82c-51e8-47fc-adcc-c692a1dbab9a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:09.649260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f369f82c-51e8-47fc-adcc-c692a1dbab9a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:09.657039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f369f82c-51e8-47fc-adcc-c692a1dbab9a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:09.657555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f369f82c-51e8-47fc-adcc-c692a1dbab9a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:09.658027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f369f82c-51e8-47fc-adcc-c692a1dbab9a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:09.658757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f369f82c-51e8-47fc-adcc-c692a1dbab9a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:09.659320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f369f82c-51e8-47fc-adcc-c692a1dbab9a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:09.659752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f369f82c-51e8-47fc-adcc-c692a1dbab9a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:09.795703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f369f82c-51e8-47fc-adcc-c692a1dbab9a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:09.803792 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f369f82c-51e8-47fc-adcc-c692a1dbab9a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1506 microversion: 2.1 time: 0.159460 Oct 12 23:02:09.804373 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4058/7466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:09 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:09.827357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4ca7730e-baef-4f43-9ae6-1722fd45e136 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:09.829564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4ca7730e-baef-4f43-9ae6-1722fd45e136 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: eff2c685-f083-445e-b19d-9bf4c587abec] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:09.834964 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-4ca7730e-baef-4f43-9ae6-1722fd45e136 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] HTTP exception thrown: Instance eff2c685-f083-445e-b19d-9bf4c587abec could not be found. Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4ca7730e-baef-4f43-9ae6-1722fd45e136 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Request method failure captured: Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/eff2c685-f083-445e-b19d-9bf4c587abec/action HTTP/1.1 Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 32 Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0dX1p9tMvZ-pYVLlI5N7Cwp6lqaDKHyO56gyUn39KM5rfsyM-blqm4nB-w9ZUdTsuZrei9akkMY4X0dzbfaimLV1ydx4y2bz0VsmuPdcu6wthOn27wr4hP0-uekJIPbvuEEnfCyrRJZs_W-ZwXJWGpvO9fxpm9LCNNrZ1ZdXgThejw Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 398f228d3ac84789866ef670782dd42f Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/398f228d3ac84789866ef670782dd42f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/398f228d3ac84789866ef670782dd42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_398f228d3ac84789866ef670782dd42f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/398f228d3ac84789866ef670782dd42f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 398f228d3ac84789866ef670782dd42f Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1873095955-project Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 81fa26b870b54dadb8169bce6ce4ccc8 Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1873095955-project Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: {"resize": {"flavorRef": "452"}} Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance eff2c685-f083-445e-b19d-9bf4c587abec could not be found. Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'eff2c685-f083-445e-b19d-9bf4c587abec', 'body': {'resize': {'flavorRef': '452'}}} Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eff2c685-f083-445e-b19d-9bf4c587abec could not be found. Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:02:09.836561 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:02:09.842127 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eff2c685-f083-445e-b19d-9bf4c587abec could not be found. Oct 12 23:02:09.842127 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:09.842127 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:09.842127 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:09.842127 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:09.842127 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:09.842127 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:09.842127 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:02:09.842127 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:02:09.842127 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eff2c685-f083-445e-b19d-9bf4c587abec could not be found. Oct 12 23:02:09.842127 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:09.842127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4ca7730e-baef-4f43-9ae6-1722fd45e136 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Returning 404 to user: Instance eff2c685-f083-445e-b19d-9bf4c587abec could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:02:09.842127 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4ca7730e-baef-4f43-9ae6-1722fd45e136 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "POST /compute/v2.1/servers/eff2c685-f083-445e-b19d-9bf4c587abec/action" status: 404 len: 111 microversion: 2.1 time: 0.015231 Oct 12 23:02:09.842127 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3409/7467] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:02:09 2022] POST /compute/v2.1/servers/eff2c685-f083-445e-b19d-9bf4c587abec/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:02:09.846620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1d257468-2620-4401-b8d9-57b7c02fdd5c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:09.847254 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1d257468-2620-4401-b8d9-57b7c02fdd5c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:09.853014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d257468-2620-4401-b8d9-57b7c02fdd5c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:09.853497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d257468-2620-4401-b8d9-57b7c02fdd5c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:09.853933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d257468-2620-4401-b8d9-57b7c02fdd5c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:09.854618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d257468-2620-4401-b8d9-57b7c02fdd5c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:09.855067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d257468-2620-4401-b8d9-57b7c02fdd5c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:09.855534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d257468-2620-4401-b8d9-57b7c02fdd5c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:09.859465 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:09.983157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1d257468-2620-4401-b8d9-57b7c02fdd5c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:09.991623 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1d257468-2620-4401-b8d9-57b7c02fdd5c tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1506 microversion: 2.1 time: 0.148337 Oct 12 23:02:09.992230 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4059/7468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:09 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:10.014877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-989b1113-4fd6-4fef-b2a8-b3859ff3b9d9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:10.015540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-989b1113-4fd6-4fef-b2a8-b3859ff3b9d9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:10.022394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-989b1113-4fd6-4fef-b2a8-b3859ff3b9d9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.022895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-989b1113-4fd6-4fef-b2a8-b3859ff3b9d9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.023404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-989b1113-4fd6-4fef-b2a8-b3859ff3b9d9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:10.024121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-989b1113-4fd6-4fef-b2a8-b3859ff3b9d9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.024588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-989b1113-4fd6-4fef-b2a8-b3859ff3b9d9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.025032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-989b1113-4fd6-4fef-b2a8-b3859ff3b9d9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:10.154359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-989b1113-4fd6-4fef-b2a8-b3859ff3b9d9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:10.162051 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-989b1113-4fd6-4fef-b2a8-b3859ff3b9d9 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1506 microversion: 2.1 time: 0.151519 Oct 12 23:02:10.162623 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3410/7469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:10 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:10.184327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-913c1d46-6740-4183-8cd5-6c4cba0a9cd7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "bf80ee72-5853-47cd-80a6-62622f7c63b7"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:10.186625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-913c1d46-6740-4183-8cd5-6c4cba0a9cd7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:10.192496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-913c1d46-6740-4183-8cd5-6c4cba0a9cd7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.192974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-913c1d46-6740-4183-8cd5-6c4cba0a9cd7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.193408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-913c1d46-6740-4183-8cd5-6c4cba0a9cd7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:10.194093 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-913c1d46-6740-4183-8cd5-6c4cba0a9cd7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.194544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-913c1d46-6740-4183-8cd5-6c4cba0a9cd7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.194971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-913c1d46-6740-4183-8cd5-6c4cba0a9cd7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:10.239446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-913c1d46-6740-4183-8cd5-6c4cba0a9cd7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:10.244897 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-913c1d46-6740-4183-8cd5-6c4cba0a9cd7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] HTTP exception thrown: Flavor bf80ee72-5853-47cd-80a6-62622f7c63b7 could not be found. Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-913c1d46-6740-4183-8cd5-6c4cba0a9cd7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Request method failure captured: Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: request: POST /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9/action HTTP/1.1 Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 65 Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0dX1p9tMvZ-pYVLlI5N7Cwp6lqaDKHyO56gyUn39KM5rfsyM-blqm4nB-w9ZUdTsuZrei9akkMY4X0dzbfaimLV1ydx4y2bz0VsmuPdcu6wthOn27wr4hP0-uekJIPbvuEEnfCyrRJZs_W-ZwXJWGpvO9fxpm9LCNNrZ1ZdXgThejw Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 398f228d3ac84789866ef670782dd42f Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/398f228d3ac84789866ef670782dd42f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/398f228d3ac84789866ef670782dd42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_398f228d3ac84789866ef670782dd42f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/398f228d3ac84789866ef670782dd42f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 398f228d3ac84789866ef670782dd42f Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1873095955-project Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 81fa26b870b54dadb8169bce6ce4ccc8 Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1873095955-project Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: {"resize": {"flavorRef": "bf80ee72-5853-47cd-80a6-62622f7c63b7"}} Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: exception: Flavor bf80ee72-5853-47cd-80a6-62622f7c63b7 could not be found. Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '6f1899bc-9491-44cf-b4cf-3233706e6ae9', 'body': {'resize': {'flavorRef': 'bf80ee72-5853-47cd-80a6-62622f7c63b7'}}} Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:02:10.253747 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor bf80ee72-5853-47cd-80a6-62622f7c63b7 could not be found. Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor bf80ee72-5853-47cd-80a6-62622f7c63b7 could not be found. Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor bf80ee72-5853-47cd-80a6-62622f7c63b7 could not be found. Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-913c1d46-6740-4183-8cd5-6c4cba0a9cd7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Returning 400 to user: Flavor bf80ee72-5853-47cd-80a6-62622f7c63b7 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-913c1d46-6740-4183-8cd5-6c4cba0a9cd7 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "POST /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9/action" status: 400 len: 107 microversion: 2.1 time: 0.074980 Oct 12 23:02:10.258248 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4060/7470] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:02:10 2022] POST /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9/action => generated 107 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:02:10.264645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3261f852-509d-4a51-97f7-bf5c86c3d9f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:10.265281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3261f852-509d-4a51-97f7-bf5c86c3d9f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:10.271303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3261f852-509d-4a51-97f7-bf5c86c3d9f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.271803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3261f852-509d-4a51-97f7-bf5c86c3d9f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.272257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3261f852-509d-4a51-97f7-bf5c86c3d9f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:10.272967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3261f852-509d-4a51-97f7-bf5c86c3d9f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.273434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3261f852-509d-4a51-97f7-bf5c86c3d9f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.273875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3261f852-509d-4a51-97f7-bf5c86c3d9f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:10.403364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3261f852-509d-4a51-97f7-bf5c86c3d9f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:10.411011 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3261f852-509d-4a51-97f7-bf5c86c3d9f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1506 microversion: 2.1 time: 0.150901 Oct 12 23:02:10.411611 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3411/7471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:10 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:10.434773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-016a85b1-585a-47e8-a3c0-7244d71f0c80 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:10.435355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-016a85b1-585a-47e8-a3c0-7244d71f0c80 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:10.441260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-016a85b1-585a-47e8-a3c0-7244d71f0c80 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.441740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-016a85b1-585a-47e8-a3c0-7244d71f0c80 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.442180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-016a85b1-585a-47e8-a3c0-7244d71f0c80 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:10.442869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-016a85b1-585a-47e8-a3c0-7244d71f0c80 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.443354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-016a85b1-585a-47e8-a3c0-7244d71f0c80 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.443786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-016a85b1-585a-47e8-a3c0-7244d71f0c80 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:10.573979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-016a85b1-585a-47e8-a3c0-7244d71f0c80 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:10.582389 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-016a85b1-585a-47e8-a3c0-7244d71f0c80 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1506 microversion: 2.1 time: 0.152193 Oct 12 23:02:10.582960 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4061/7472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:10 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:10.604595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6d3ee09c-40af-4836-af66-6367ab117715 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6d3ee09c-40af-4836-af66-6367ab117715 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Request method failure captured: Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9/action HTTP/1.1 Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 29 Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0dX1p9tMvZ-pYVLlI5N7Cwp6lqaDKHyO56gyUn39KM5rfsyM-blqm4nB-w9ZUdTsuZrei9akkMY4X0dzbfaimLV1ydx4y2bz0VsmuPdcu6wthOn27wr4hP0-uekJIPbvuEEnfCyrRJZs_W-ZwXJWGpvO9fxpm9LCNNrZ1ZdXgThejw Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 398f228d3ac84789866ef670782dd42f Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/398f228d3ac84789866ef670782dd42f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/398f228d3ac84789866ef670782dd42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_398f228d3ac84789866ef670782dd42f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/398f228d3ac84789866ef670782dd42f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 398f228d3ac84789866ef670782dd42f Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1873095955-project Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 81fa26b870b54dadb8169bce6ce4ccc8 Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1873095955-project Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: {"resize": {"flavorRef": ""}} Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '6f1899bc-9491-44cf-b4cf-3233706e6ae9', 'body': {'resize': {'flavorRef': ''}}} Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi '' Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.608746 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:10.614244 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.614244 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:10.614244 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:10.614244 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:10.614244 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:02:10.614244 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:02:10.614244 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 12 23:02:10.614244 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.614244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6d3ee09c-40af-4836-af66-6367ab117715 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:02:10.614244 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6d3ee09c-40af-4836-af66-6367ab117715 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "POST /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9/action" status: 400 len: 113 microversion: 2.1 time: 0.009512 Oct 12 23:02:10.614244 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3412/7473] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:02:10 2022] POST /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:02:10.618350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-393bc59a-7e94-4952-8253-da3c0334569b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:10.618962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-393bc59a-7e94-4952-8253-da3c0334569b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:10.625457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-393bc59a-7e94-4952-8253-da3c0334569b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.625933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-393bc59a-7e94-4952-8253-da3c0334569b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.626362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-393bc59a-7e94-4952-8253-da3c0334569b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:10.627052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-393bc59a-7e94-4952-8253-da3c0334569b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.627529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-393bc59a-7e94-4952-8253-da3c0334569b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.627955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-393bc59a-7e94-4952-8253-da3c0334569b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:10.755305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-393bc59a-7e94-4952-8253-da3c0334569b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:10.763169 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-393bc59a-7e94-4952-8253-da3c0334569b tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1506 microversion: 2.1 time: 0.148805 Oct 12 23:02:10.763791 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4062/7474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:10 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:10.789686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-440d85d0-7a42-4c67-ba16-89b17da80976 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:10.790202 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-440d85d0-7a42-4c67-ba16-89b17da80976 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:10.797815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-440d85d0-7a42-4c67-ba16-89b17da80976 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.798311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-440d85d0-7a42-4c67-ba16-89b17da80976 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.798797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-440d85d0-7a42-4c67-ba16-89b17da80976 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:10.799536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-440d85d0-7a42-4c67-ba16-89b17da80976 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.800009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-440d85d0-7a42-4c67-ba16-89b17da80976 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.800454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-440d85d0-7a42-4c67-ba16-89b17da80976 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:10.814109 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-440d85d0-7a42-4c67-ba16-89b17da80976 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] HTTP exception thrown: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-440d85d0-7a42-4c67-ba16-89b17da80976 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Request method failure captured: Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d HTTP/1.1 Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0dX1p9tMvZ-pYVLlI5N7Cwp6lqaDKHyO56gyUn39KM5rfsyM-blqm4nB-w9ZUdTsuZrei9akkMY4X0dzbfaimLV1ydx4y2bz0VsmuPdcu6wthOn27wr4hP0-uekJIPbvuEEnfCyrRJZs_W-ZwXJWGpvO9fxpm9LCNNrZ1ZdXgThejw Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 398f228d3ac84789866ef670782dd42f Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/398f228d3ac84789866ef670782dd42f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/398f228d3ac84789866ef670782dd42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_398f228d3ac84789866ef670782dd42f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/398f228d3ac84789866ef670782dd42f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 398f228d3ac84789866ef670782dd42f Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-ServersNegativeTestJSON-1873095955-project Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 81fa26b870b54dadb8169bce6ce4ccc8 Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-ServersNegativeTestJSON-1873095955-project Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d'} Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:02:10.815710 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:02:10.820040 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. Oct 12 23:02:10.820040 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.820040 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:10.820040 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.820040 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:10.820040 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:10.820040 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:10.820040 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:02:10.820040 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:02:10.820040 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. Oct 12 23:02:10.820040 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.820040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-440d85d0-7a42-4c67-ba16-89b17da80976 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Returning 404 to user: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:02:10.820040 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-440d85d0-7a42-4c67-ba16-89b17da80976 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d" status: 404 len: 111 microversion: 2.1 time: 0.032187 Oct 12 23:02:10.820040 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3413/7475] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:02:10 2022] DELETE /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:02:10.825486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9827526c-d851-4f9b-8399-204e587fc740 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:10.826113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9827526c-d851-4f9b-8399-204e587fc740 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:10.832011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9827526c-d851-4f9b-8399-204e587fc740 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.832495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9827526c-d851-4f9b-8399-204e587fc740 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.832935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9827526c-d851-4f9b-8399-204e587fc740 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:10.833626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9827526c-d851-4f9b-8399-204e587fc740 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.834081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9827526c-d851-4f9b-8399-204e587fc740 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.834511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9827526c-d851-4f9b-8399-204e587fc740 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:10.848002 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-9827526c-d851-4f9b-8399-204e587fc740 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] HTTP exception thrown: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9827526c-d851-4f9b-8399-204e587fc740 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Request method failure captured: Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d HTTP/1.1 Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0dX1p9tMvZ-pYVLlI5N7Cwp6lqaDKHyO56gyUn39KM5rfsyM-blqm4nB-w9ZUdTsuZrei9akkMY4X0dzbfaimLV1ydx4y2bz0VsmuPdcu6wthOn27wr4hP0-uekJIPbvuEEnfCyrRJZs_W-ZwXJWGpvO9fxpm9LCNNrZ1ZdXgThejw Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 398f228d3ac84789866ef670782dd42f Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/398f228d3ac84789866ef670782dd42f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/398f228d3ac84789866ef670782dd42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_398f228d3ac84789866ef670782dd42f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/398f228d3ac84789866ef670782dd42f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 398f228d3ac84789866ef670782dd42f Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1873095955-project Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 81fa26b870b54dadb8169bce6ce4ccc8 Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1873095955-project Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d'} Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:10.849534 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.854092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:10.854092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:10.854092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:10.854092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:02:10.854092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:02:10.854092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. Oct 12 23:02:10.854092 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:02:10.854092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9827526c-d851-4f9b-8399-204e587fc740 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Returning 404 to user: Instance 69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:02:10.854092 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9827526c-d851-4f9b-8399-204e587fc740 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d" status: 404 len: 111 microversion: 2.1 time: 0.029308 Oct 12 23:02:10.854092 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4063/7476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:10 2022] GET /compute/v2.1/servers/69ebff37-1aa0-47f6-a5e9-d06cbb41ed7d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:02:10.859907 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9db1fa1d-0d8b-4a58-9aef-6f7096907c7a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:10.860417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9db1fa1d-0d8b-4a58-9aef-6f7096907c7a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:10.866567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9db1fa1d-0d8b-4a58-9aef-6f7096907c7a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.867056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9db1fa1d-0d8b-4a58-9aef-6f7096907c7a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.867531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9db1fa1d-0d8b-4a58-9aef-6f7096907c7a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:10.868232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9db1fa1d-0d8b-4a58-9aef-6f7096907c7a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.868700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9db1fa1d-0d8b-4a58-9aef-6f7096907c7a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.869137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9db1fa1d-0d8b-4a58-9aef-6f7096907c7a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:10.894373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9db1fa1d-0d8b-4a58-9aef-6f7096907c7a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:02:10.968208 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9db1fa1d-0d8b-4a58-9aef-6f7096907c7a tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 204 len: 0 microversion: 2.1 time: 0.112469 Oct 12 23:02:10.968657 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3414/7477] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:02:10 2022] DELETE /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:02:10.977938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5db950ea-791b-484d-a547-a4475e7f0d3f tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:10.978559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5db950ea-791b-484d-a547-a4475e7f0d3f tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:10.985198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5db950ea-791b-484d-a547-a4475e7f0d3f tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.985676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5db950ea-791b-484d-a547-a4475e7f0d3f tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.986108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5db950ea-791b-484d-a547-a4475e7f0d3f tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:10.986792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5db950ea-791b-484d-a547-a4475e7f0d3f tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:10.987261 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5db950ea-791b-484d-a547-a4475e7f0d3f tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:10.987713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5db950ea-791b-484d-a547-a4475e7f0d3f tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:11.120256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5db950ea-791b-484d-a547-a4475e7f0d3f tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:11.128061 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5db950ea-791b-484d-a547-a4475e7f0d3f tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1512 microversion: 2.1 time: 0.154433 Oct 12 23:02:11.128638 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4064/7478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:10 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:12.151732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-063f9d7b-a62f-443b-9e66-4cf0d870c024 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:12.152458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-063f9d7b-a62f-443b-9e66-4cf0d870c024 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:12.159259 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-063f9d7b-a62f-443b-9e66-4cf0d870c024 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:12.159772 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-063f9d7b-a62f-443b-9e66-4cf0d870c024 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:12.160222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-063f9d7b-a62f-443b-9e66-4cf0d870c024 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:12.160930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-063f9d7b-a62f-443b-9e66-4cf0d870c024 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:12.161399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-063f9d7b-a62f-443b-9e66-4cf0d870c024 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:12.161843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-063f9d7b-a62f-443b-9e66-4cf0d870c024 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:12.166604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:12.295765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-063f9d7b-a62f-443b-9e66-4cf0d870c024 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:12.303488 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-063f9d7b-a62f-443b-9e66-4cf0d870c024 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1512 microversion: 2.1 time: 0.156175 Oct 12 23:02:12.304057 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3415/7479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:12 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:12.958427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-cc2b00d0-38bc-4afd-a981-61f473f4cacd req-07dd435a-3be6-4184-bcf1-93d82d7292a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1899bc-9491-44cf-b4cf-3233706e6ae9", "name": "network-vif-deleted", "tag": "ada5e56d-48db-4ed3-ba00-35aa319db72c"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:12.969495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cc2b00d0-38bc-4afd-a981-61f473f4cacd req-07dd435a-3be6-4184-bcf1-93d82d7292a9 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:12.970085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cc2b00d0-38bc-4afd-a981-61f473f4cacd req-07dd435a-3be6-4184-bcf1-93d82d7292a9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:12.970522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cc2b00d0-38bc-4afd-a981-61f473f4cacd req-07dd435a-3be6-4184-bcf1-93d82d7292a9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:12.985017 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-cc2b00d0-38bc-4afd-a981-61f473f4cacd req-07dd435a-3be6-4184-bcf1-93d82d7292a9 service nova] Creating event network-vif-deleted:ada5e56d-48db-4ed3-ba00-35aa319db72c for instance 6f1899bc-9491-44cf-b4cf-3233706e6ae9 on n-h2-861111-1 Oct 12 23:02:12.990163 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-cc2b00d0-38bc-4afd-a981-61f473f4cacd req-07dd435a-3be6-4184-bcf1-93d82d7292a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035845 Oct 12 23:02:12.991458 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4065/7480] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:13.326851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5a13de5e-2e4e-4025-ba1e-50ac28bfd1af tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:13.327425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5a13de5e-2e4e-4025-ba1e-50ac28bfd1af tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:13.333899 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a13de5e-2e4e-4025-ba1e-50ac28bfd1af tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:13.334400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a13de5e-2e4e-4025-ba1e-50ac28bfd1af tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:13.334854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a13de5e-2e4e-4025-ba1e-50ac28bfd1af tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:13.335593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a13de5e-2e4e-4025-ba1e-50ac28bfd1af tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:13.336060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a13de5e-2e4e-4025-ba1e-50ac28bfd1af tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:13.336504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a13de5e-2e4e-4025-ba1e-50ac28bfd1af tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:13.371079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a13de5e-2e4e-4025-ba1e-50ac28bfd1af tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:13.372104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a13de5e-2e4e-4025-ba1e-50ac28bfd1af tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:13.373084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a13de5e-2e4e-4025-ba1e-50ac28bfd1af tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:13.373675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-5a13de5e-2e4e-4025-ba1e-50ac28bfd1af tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lazy-loading 'fault' on Instance uuid 6f1899bc-9491-44cf-b4cf-3233706e6ae9 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:02:13.415312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5a13de5e-2e4e-4025-ba1e-50ac28bfd1af tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81fa26b870b54dadb8169bce6ce4ccc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f228d3ac84789866ef670782dd42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:13.423916 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5a13de5e-2e4e-4025-ba1e-50ac28bfd1af tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 200 len: 1306 microversion: 2.1 time: 0.101833 Oct 12 23:02:13.424497 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3416/7481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:13 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 1306 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:14.449028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a6f8e954-27c8-4cc9-af7b-3e20970814f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:14.450239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a6f8e954-27c8-4cc9-af7b-3e20970814f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] [instance: 6f1899bc-9491-44cf-b4cf-3233706e6ae9] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:14.452187 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:14.457959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6f8e954-27c8-4cc9-af7b-3e20970814f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:14.458448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6f8e954-27c8-4cc9-af7b-3e20970814f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:14.458899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6f8e954-27c8-4cc9-af7b-3e20970814f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:14.459592 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6f8e954-27c8-4cc9-af7b-3e20970814f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:14.460045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6f8e954-27c8-4cc9-af7b-3e20970814f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:14.460471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a6f8e954-27c8-4cc9-af7b-3e20970814f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:14.475400 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-a6f8e954-27c8-4cc9-af7b-3e20970814f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] HTTP exception thrown: Instance 6f1899bc-9491-44cf-b4cf-3233706e6ae9 could not be found. Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a6f8e954-27c8-4cc9-af7b-3e20970814f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Request method failure captured: Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 HTTP/1.1 Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0dX1p9tMvZ-pYVLlI5N7Cwp6lqaDKHyO56gyUn39KM5rfsyM-blqm4nB-w9ZUdTsuZrei9akkMY4X0dzbfaimLV1ydx4y2bz0VsmuPdcu6wthOn27wr4hP0-uekJIPbvuEEnfCyrRJZs_W-ZwXJWGpvO9fxpm9LCNNrZ1ZdXgThejw Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 398f228d3ac84789866ef670782dd42f Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/398f228d3ac84789866ef670782dd42f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/398f228d3ac84789866ef670782dd42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_398f228d3ac84789866ef670782dd42f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/398f228d3ac84789866ef670782dd42f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 398f228d3ac84789866ef670782dd42f Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1873095955 Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-ServersNegativeTestJSON-1873095955-project Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 81fa26b870b54dadb8169bce6ce4ccc8 Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-ServersNegativeTestJSON-1873095955-project Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 6f1899bc-9491-44cf-b4cf-3233706e6ae9 could not be found. Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '6f1899bc-9491-44cf-b4cf-3233706e6ae9'} Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f1899bc-9491-44cf-b4cf-3233706e6ae9 could not be found. Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f1899bc-9491-44cf-b4cf-3233706e6ae9 could not be found. Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:14.477066 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:02:14.481675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:14.481675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:14.481675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:14.481675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:02:14.481675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:02:14.481675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f1899bc-9491-44cf-b4cf-3233706e6ae9 could not be found. Oct 12 23:02:14.481675 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:02:14.481675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a6f8e954-27c8-4cc9-af7b-3e20970814f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] Returning 404 to user: Instance 6f1899bc-9491-44cf-b4cf-3233706e6ae9 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:02:14.481675 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a6f8e954-27c8-4cc9-af7b-3e20970814f4 tempest-ServersNegativeTestJSON-1873095955 tempest-ServersNegativeTestJSON-1873095955-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9" status: 404 len: 111 microversion: 2.1 time: 0.034634 Oct 12 23:02:14.481675 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4066/7482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:14 2022] GET /compute/v2.1/servers/6f1899bc-9491-44cf-b4cf-3233706e6ae9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:02:44.900153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:44.901564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=12 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:45.101617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-14a71630-60dc-47c5-86b1-ca5cd6a06b35 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Action: 'create', calling method: .version_select at 0x7f512862d280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-364700640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnJfdIEyQBCbV2S2Tolb1/RQ+e4hcTJmCBx5L5eO4er6PI+mylV63EeQOSjl3mD0KXRbgyZa8OiuTZ04CzXVteMEWCet1DGOnr+u39jH6MLMx2LsJsUR199eaM32uaqlg=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:45.118519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-14a71630-60dc-47c5-86b1-ca5cd6a06b35 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Getting quotas for project dac589d01bd348dfb8cea3fdd0968792. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:02:45.124437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-14a71630-60dc-47c5-86b1-ca5cd6a06b35 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Getting quotas for user fea7512a34264853b45f04188b32e0a3 and project dac589d01bd348dfb8cea3fdd0968792. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:02:45.155431 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-14a71630-60dc-47c5-86b1-ca5cd6a06b35 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.260559 Oct 12 23:02:45.156051 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3417/7483] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 23:02:44 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:45.210044 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-402463923", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-364700640", "networks": [{"uuid": "e7962cf6-f9da-4b90-ab53-9bb0e3802b64"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:45.220990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=32 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:45.222280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:45.480767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] validate_networks() for [('e7962cf6-f9da-4b90-ab53-9bb0e3802b64', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:02:45.874677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:02:45.875108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:02:45.875620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:02:45.876042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:02:45.876461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:02:45.885790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:45.886312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:45.886755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:45.888012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:45.888474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:45.888916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:45.907957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Getting quotas for project dac589d01bd348dfb8cea3fdd0968792. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:02:45.913243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Getting quotas for user fea7512a34264853b45f04188b32e0a3 and project dac589d01bd348dfb8cea3fdd0968792. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:02:45.925713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:02:45.928004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:02:45.975400 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2ff1e394-3bc9-402d-a1a5-1f0af7d7b43c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.769169 Oct 12 23:02:45.976070 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4067/7484] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 23:02:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:02:45.987157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a37795e0-87f9-4536-b988-05927b0e3d7e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:45.987828 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a37795e0-87f9-4536-b988-05927b0e3d7e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:46.042592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a37795e0-87f9-4536-b988-05927b0e3d7e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:46.050772 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a37795e0-87f9-4536-b988-05927b0e3d7e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6" status: 200 len: 1261 microversion: 2.1 time: 0.067405 Oct 12 23:02:46.051381 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3418/7485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:45 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 => generated 1261 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:47.076617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8d097aa1-c8fe-4c9e-a593-f2ec6ba3a8fc tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:47.078099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8d097aa1-c8fe-4c9e-a593-f2ec6ba3a8fc tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:47.089729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d097aa1-c8fe-4c9e-a593-f2ec6ba3a8fc tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:47.090226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d097aa1-c8fe-4c9e-a593-f2ec6ba3a8fc tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:47.091546 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d097aa1-c8fe-4c9e-a593-f2ec6ba3a8fc tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:47.092582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d097aa1-c8fe-4c9e-a593-f2ec6ba3a8fc tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:47.093241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d097aa1-c8fe-4c9e-a593-f2ec6ba3a8fc tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:47.093898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8d097aa1-c8fe-4c9e-a593-f2ec6ba3a8fc tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:47.176481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8d097aa1-c8fe-4c9e-a593-f2ec6ba3a8fc tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:47.186009 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8d097aa1-c8fe-4c9e-a593-f2ec6ba3a8fc tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6" status: 200 len: 1331 microversion: 2.1 time: 0.114961 Oct 12 23:02:47.186924 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4068/7486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:47 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:48.209721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-53f4d6a0-32fb-4105-839b-3889cbb1b871 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:48.211112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-53f4d6a0-32fb-4105-839b-3889cbb1b871 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:48.218998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53f4d6a0-32fb-4105-839b-3889cbb1b871 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:48.219802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53f4d6a0-32fb-4105-839b-3889cbb1b871 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:48.220487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53f4d6a0-32fb-4105-839b-3889cbb1b871 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:48.221449 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53f4d6a0-32fb-4105-839b-3889cbb1b871 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:48.222004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53f4d6a0-32fb-4105-839b-3889cbb1b871 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:48.222395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53f4d6a0-32fb-4105-839b-3889cbb1b871 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:48.423866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-53f4d6a0-32fb-4105-839b-3889cbb1b871 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:48.433713 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-53f4d6a0-32fb-4105-839b-3889cbb1b871 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6" status: 200 len: 1361 microversion: 2.1 time: 0.227240 Oct 12 23:02:48.435452 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3419/7487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:48 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:48.501485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-6af8e0b3-89de-48ab-b201-d5bf5ed9b8df req-450c9fba-d57c-486b-a82f-82591be78e75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2d2af9a-8a4f-44de-9ce8-a63942e22ce6", "tag": "f54ce69a-c85d-419f-bc72-fce21e6ef427"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:48.516946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6af8e0b3-89de-48ab-b201-d5bf5ed9b8df req-450c9fba-d57c-486b-a82f-82591be78e75 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:48.517447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6af8e0b3-89de-48ab-b201-d5bf5ed9b8df req-450c9fba-d57c-486b-a82f-82591be78e75 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:48.518136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6af8e0b3-89de-48ab-b201-d5bf5ed9b8df req-450c9fba-d57c-486b-a82f-82591be78e75 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:48.532636 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6af8e0b3-89de-48ab-b201-d5bf5ed9b8df req-450c9fba-d57c-486b-a82f-82591be78e75 service nova] Creating event network-changed:f54ce69a-c85d-419f-bc72-fce21e6ef427 for instance d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 on n-h2-861111-1 Oct 12 23:02:48.538225 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-6af8e0b3-89de-48ab-b201-d5bf5ed9b8df req-450c9fba-d57c-486b-a82f-82591be78e75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041026 Oct 12 23:02:48.539157 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4069/7488] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:49.458134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-366c1d3b-2dcd-4bca-8b37-87d212e7fde5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:49.458687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-366c1d3b-2dcd-4bca-8b37-87d212e7fde5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:49.466044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-366c1d3b-2dcd-4bca-8b37-87d212e7fde5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:49.466558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-366c1d3b-2dcd-4bca-8b37-87d212e7fde5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:49.467042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-366c1d3b-2dcd-4bca-8b37-87d212e7fde5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:49.467776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-366c1d3b-2dcd-4bca-8b37-87d212e7fde5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:49.468252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-366c1d3b-2dcd-4bca-8b37-87d212e7fde5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:49.468698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-366c1d3b-2dcd-4bca-8b37-87d212e7fde5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:49.599871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-366c1d3b-2dcd-4bca-8b37-87d212e7fde5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:49.607816 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-366c1d3b-2dcd-4bca-8b37-87d212e7fde5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6" status: 200 len: 1361 microversion: 2.1 time: 0.153722 Oct 12 23:02:49.608406 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3420/7489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:49 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:50.631263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-941d8b9b-012f-4530-829e-43c019d43a1e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:50.631911 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-941d8b9b-012f-4530-829e-43c019d43a1e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:50.639558 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-941d8b9b-012f-4530-829e-43c019d43a1e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:50.640284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-941d8b9b-012f-4530-829e-43c019d43a1e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:50.640733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-941d8b9b-012f-4530-829e-43c019d43a1e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:50.641426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-941d8b9b-012f-4530-829e-43c019d43a1e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:50.641885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-941d8b9b-012f-4530-829e-43c019d43a1e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:50.642312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-941d8b9b-012f-4530-829e-43c019d43a1e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:50.776538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-941d8b9b-012f-4530-829e-43c019d43a1e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:50.784652 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-941d8b9b-012f-4530-829e-43c019d43a1e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6" status: 200 len: 1361 microversion: 2.1 time: 0.157786 Oct 12 23:02:50.785222 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4070/7490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:50 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:51.807778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8aa8ac45-9a10-4299-9333-80b7ab5f5579 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:51.808412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8aa8ac45-9a10-4299-9333-80b7ab5f5579 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:51.815136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8aa8ac45-9a10-4299-9333-80b7ab5f5579 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:51.815672 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8aa8ac45-9a10-4299-9333-80b7ab5f5579 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:51.816129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8aa8ac45-9a10-4299-9333-80b7ab5f5579 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:51.816843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8aa8ac45-9a10-4299-9333-80b7ab5f5579 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:51.817310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8aa8ac45-9a10-4299-9333-80b7ab5f5579 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:51.817755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8aa8ac45-9a10-4299-9333-80b7ab5f5579 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:51.943981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8aa8ac45-9a10-4299-9333-80b7ab5f5579 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:51.952171 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8aa8ac45-9a10-4299-9333-80b7ab5f5579 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6" status: 200 len: 1361 microversion: 2.1 time: 0.148342 Oct 12 23:02:51.952747 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3421/7491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:51 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:52.975830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fe4d2d56-f094-4a48-9226-172599e5fbd7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:52.976444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fe4d2d56-f094-4a48-9226-172599e5fbd7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:52.984020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe4d2d56-f094-4a48-9226-172599e5fbd7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:52.984501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe4d2d56-f094-4a48-9226-172599e5fbd7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:52.984934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe4d2d56-f094-4a48-9226-172599e5fbd7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:52.985629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe4d2d56-f094-4a48-9226-172599e5fbd7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:52.986080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe4d2d56-f094-4a48-9226-172599e5fbd7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:52.986506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fe4d2d56-f094-4a48-9226-172599e5fbd7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:53.113225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-fe4d2d56-f094-4a48-9226-172599e5fbd7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:53.121228 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fe4d2d56-f094-4a48-9226-172599e5fbd7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6" status: 200 len: 1361 microversion: 2.1 time: 0.149453 Oct 12 23:02:53.121803 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4071/7492] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:52 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:54.144255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0de156af-297a-431c-a380-fa84558e0d13 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:54.144888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0de156af-297a-431c-a380-fa84558e0d13 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:54.151728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0de156af-297a-431c-a380-fa84558e0d13 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:54.152235 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0de156af-297a-431c-a380-fa84558e0d13 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:54.152688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0de156af-297a-431c-a380-fa84558e0d13 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:54.153452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0de156af-297a-431c-a380-fa84558e0d13 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:54.153924 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0de156af-297a-431c-a380-fa84558e0d13 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:54.154365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0de156af-297a-431c-a380-fa84558e0d13 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:54.286346 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0de156af-297a-431c-a380-fa84558e0d13 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:54.294639 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0de156af-297a-431c-a380-fa84558e0d13 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6" status: 200 len: 1361 microversion: 2.1 time: 0.154438 Oct 12 23:02:54.295200 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3422/7493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:54 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:55.318961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-af339e19-cbbd-4af4-9248-3dd6b381fd26 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:55.319681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-af339e19-cbbd-4af4-9248-3dd6b381fd26 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:55.326313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af339e19-cbbd-4af4-9248-3dd6b381fd26 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:55.326976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af339e19-cbbd-4af4-9248-3dd6b381fd26 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:55.327539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af339e19-cbbd-4af4-9248-3dd6b381fd26 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:55.328391 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af339e19-cbbd-4af4-9248-3dd6b381fd26 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:55.329092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af339e19-cbbd-4af4-9248-3dd6b381fd26 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:55.329638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-af339e19-cbbd-4af4-9248-3dd6b381fd26 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:55.459430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-af339e19-cbbd-4af4-9248-3dd6b381fd26 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:55.467641 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-af339e19-cbbd-4af4-9248-3dd6b381fd26 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6" status: 200 len: 1361 microversion: 2.1 time: 0.153573 Oct 12 23:02:55.468218 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4072/7494] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:55 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:56.035400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-1380f1db-a72d-40fb-ad93-33783213659e req-ee37d674-1c29-4cf1-89a0-f81729351cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2d2af9a-8a4f-44de-9ce8-a63942e22ce6", "name": "network-vif-plugged", "status": "completed", "tag": "f54ce69a-c85d-419f-bc72-fce21e6ef427"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:56.046577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1380f1db-a72d-40fb-ad93-33783213659e req-ee37d674-1c29-4cf1-89a0-f81729351cfe service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:56.047090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1380f1db-a72d-40fb-ad93-33783213659e req-ee37d674-1c29-4cf1-89a0-f81729351cfe service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:56.047589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1380f1db-a72d-40fb-ad93-33783213659e req-ee37d674-1c29-4cf1-89a0-f81729351cfe service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:56.051488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:56.059336 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-1380f1db-a72d-40fb-ad93-33783213659e req-ee37d674-1c29-4cf1-89a0-f81729351cfe service nova] Creating event network-vif-plugged:f54ce69a-c85d-419f-bc72-fce21e6ef427 for instance d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 on n-h2-861111-1 Oct 12 23:02:56.064307 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-1380f1db-a72d-40fb-ad93-33783213659e req-ee37d674-1c29-4cf1-89a0-f81729351cfe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032654 Oct 12 23:02:56.064955 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3423/7495] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:56.491645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ebb51c00-4fb4-4d31-8b05-2dac8f75779b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:56.492537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ebb51c00-4fb4-4d31-8b05-2dac8f75779b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:56.494526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:56.495196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:56.501959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebb51c00-4fb4-4d31-8b05-2dac8f75779b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:56.502446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebb51c00-4fb4-4d31-8b05-2dac8f75779b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:56.502888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebb51c00-4fb4-4d31-8b05-2dac8f75779b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:56.503603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebb51c00-4fb4-4d31-8b05-2dac8f75779b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:56.504089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebb51c00-4fb4-4d31-8b05-2dac8f75779b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:56.504517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ebb51c00-4fb4-4d31-8b05-2dac8f75779b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:56.636447 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ebb51c00-4fb4-4d31-8b05-2dac8f75779b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:56.644695 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ebb51c00-4fb4-4d31-8b05-2dac8f75779b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6" status: 200 len: 1361 microversion: 2.1 time: 0.157050 Oct 12 23:02:56.645286 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4073/7496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:56 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:02:57.669779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a05597b6-4e92-42f9-87e8-c70d1e7fdddb tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:57.670498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a05597b6-4e92-42f9-87e8-c70d1e7fdddb tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:57.676777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a05597b6-4e92-42f9-87e8-c70d1e7fdddb tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:57.677277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a05597b6-4e92-42f9-87e8-c70d1e7fdddb tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:57.677730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a05597b6-4e92-42f9-87e8-c70d1e7fdddb tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:57.678436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a05597b6-4e92-42f9-87e8-c70d1e7fdddb tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:57.678903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a05597b6-4e92-42f9-87e8-c70d1e7fdddb tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:57.679372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a05597b6-4e92-42f9-87e8-c70d1e7fdddb tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:57.809126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a05597b6-4e92-42f9-87e8-c70d1e7fdddb tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:57.817082 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a05597b6-4e92-42f9-87e8-c70d1e7fdddb tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6" status: 200 len: 1553 microversion: 2.1 time: 0.152535 Oct 12 23:02:57.817655 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3424/7497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:57 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:57.839607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-78a7cada-ab28-47b0-8ed4-24e7a5373eda tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:57.840236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-78a7cada-ab28-47b0-8ed4-24e7a5373eda tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:57.847713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78a7cada-ab28-47b0-8ed4-24e7a5373eda tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:57.848202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78a7cada-ab28-47b0-8ed4-24e7a5373eda tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:57.848641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78a7cada-ab28-47b0-8ed4-24e7a5373eda tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:57.849338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78a7cada-ab28-47b0-8ed4-24e7a5373eda tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:57.849796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78a7cada-ab28-47b0-8ed4-24e7a5373eda tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:57.850232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-78a7cada-ab28-47b0-8ed4-24e7a5373eda tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:57.978600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-78a7cada-ab28-47b0-8ed4-24e7a5373eda tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:57.986487 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-78a7cada-ab28-47b0-8ed4-24e7a5373eda tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6" status: 200 len: 1553 microversion: 2.1 time: 0.150728 Oct 12 23:02:57.987065 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4074/7498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:57 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:59.615409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-03ad1bf4-bbc4-48e8-9089-df3c1c6c1028 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be297474-f3ae-457f-90e4-b9edb740e4f8"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:59.618068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-03ad1bf4-bbc4-48e8-9089-df3c1c6c1028 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:59.625254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03ad1bf4-bbc4-48e8-9089-df3c1c6c1028 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:59.625756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03ad1bf4-bbc4-48e8-9089-df3c1c6c1028 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:59.626208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03ad1bf4-bbc4-48e8-9089-df3c1c6c1028 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:59.626931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03ad1bf4-bbc4-48e8-9089-df3c1c6c1028 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:59.627424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03ad1bf4-bbc4-48e8-9089-df3c1c6c1028 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:59.627867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03ad1bf4-bbc4-48e8-9089-df3c1c6c1028 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:59.869370 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-03ad1bf4-bbc4-48e8-9089-df3c1c6c1028 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "POST /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257796 Oct 12 23:02:59.870042 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3425/7499] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 23:02:59 2022] POST /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:10.576487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f2df2485-a028-4c2e-b36c-5f2617d2fd3e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:10.577017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f2df2485-a028-4c2e-b36c-5f2617d2fd3e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:10.579499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:10.580188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=40 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:10.586011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2df2485-a028-4c2e-b36c-5f2617d2fd3e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:10.586504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2df2485-a028-4c2e-b36c-5f2617d2fd3e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:10.586945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2df2485-a028-4c2e-b36c-5f2617d2fd3e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:10.587674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2df2485-a028-4c2e-b36c-5f2617d2fd3e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:10.588136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2df2485-a028-4c2e-b36c-5f2617d2fd3e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:10.588569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f2df2485-a028-4c2e-b36c-5f2617d2fd3e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:10.668195 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-f2df2485-a028-4c2e-b36c-5f2617d2fd3e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lazy-loading 'services' on Instance uuid d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:03:10.739128 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f2df2485-a028-4c2e-b36c-5f2617d2fd3e tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments/be297474-f3ae-457f-90e4-b9edb740e4f8" status: 202 len: 0 microversion: 2.1 time: 0.166595 Oct 12 23:03:10.739808 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4075/7500] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 23:03:10 2022] DELETE /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments/be297474-f3ae-457f-90e4-b9edb740e4f8 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:03:10.746624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:10.747443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:10.752034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4969a94e-47b5-428a-8e60-8eca1346f852 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:10.754762 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4969a94e-47b5-428a-8e60-8eca1346f852 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:10.763286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4969a94e-47b5-428a-8e60-8eca1346f852 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:10.763796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4969a94e-47b5-428a-8e60-8eca1346f852 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:10.764256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4969a94e-47b5-428a-8e60-8eca1346f852 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:10.764982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4969a94e-47b5-428a-8e60-8eca1346f852 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:10.765454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4969a94e-47b5-428a-8e60-8eca1346f852 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:10.765901 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4969a94e-47b5-428a-8e60-8eca1346f852 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:10.799051 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4969a94e-47b5-428a-8e60-8eca1346f852 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054327 Oct 12 23:03:10.799658 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3426/7501] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:03:10 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:11.813265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b7bd919a-af9c-47d9-91ff-3fc32a6991d5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:11.815666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b7bd919a-af9c-47d9-91ff-3fc32a6991d5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:11.821921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7bd919a-af9c-47d9-91ff-3fc32a6991d5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:11.822408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7bd919a-af9c-47d9-91ff-3fc32a6991d5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:11.822856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7bd919a-af9c-47d9-91ff-3fc32a6991d5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:11.823578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7bd919a-af9c-47d9-91ff-3fc32a6991d5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:11.824032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7bd919a-af9c-47d9-91ff-3fc32a6991d5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:11.824462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7bd919a-af9c-47d9-91ff-3fc32a6991d5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:11.856364 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b7bd919a-af9c-47d9-91ff-3fc32a6991d5 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048359 Oct 12 23:03:11.856999 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4076/7502] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:03:11 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:12.869325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f2e0c64b-4c00-4edb-ad81-47b8343e8508 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:12.871552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f2e0c64b-4c00-4edb-ad81-47b8343e8508 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:12.879552 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e0c64b-4c00-4edb-ad81-47b8343e8508 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:12.880062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e0c64b-4c00-4edb-ad81-47b8343e8508 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:12.880531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e0c64b-4c00-4edb-ad81-47b8343e8508 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:12.881256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e0c64b-4c00-4edb-ad81-47b8343e8508 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:12.881732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e0c64b-4c00-4edb-ad81-47b8343e8508 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:12.882180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f2e0c64b-4c00-4edb-ad81-47b8343e8508 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:12.912312 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f2e0c64b-4c00-4edb-ad81-47b8343e8508 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047228 Oct 12 23:03:12.912890 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3427/7503] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:03:12 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:13.925115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cb4f07ef-89ab-464f-afb9-ba8d3255f5d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:13.927296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cb4f07ef-89ab-464f-afb9-ba8d3255f5d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:13.934159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb4f07ef-89ab-464f-afb9-ba8d3255f5d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:13.934639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb4f07ef-89ab-464f-afb9-ba8d3255f5d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:13.935588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb4f07ef-89ab-464f-afb9-ba8d3255f5d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:13.936280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb4f07ef-89ab-464f-afb9-ba8d3255f5d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:13.936728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb4f07ef-89ab-464f-afb9-ba8d3255f5d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:13.937149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cb4f07ef-89ab-464f-afb9-ba8d3255f5d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:13.967423 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cb4f07ef-89ab-464f-afb9-ba8d3255f5d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046445 Oct 12 23:03:13.968030 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4077/7504] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:03:13 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:14.980556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-432dcf5d-ced6-40a5-8d52-9a4e28e345d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:14.982776 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-432dcf5d-ced6-40a5-8d52-9a4e28e345d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:14.989237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-432dcf5d-ced6-40a5-8d52-9a4e28e345d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:14.989730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-432dcf5d-ced6-40a5-8d52-9a4e28e345d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:14.990179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-432dcf5d-ced6-40a5-8d52-9a4e28e345d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:14.990880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-432dcf5d-ced6-40a5-8d52-9a4e28e345d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:14.991375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-432dcf5d-ced6-40a5-8d52-9a4e28e345d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:14.991813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-432dcf5d-ced6-40a5-8d52-9a4e28e345d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:15.022699 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-432dcf5d-ced6-40a5-8d52-9a4e28e345d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046209 Oct 12 23:03:15.023195 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3428/7505] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:03:14 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:16.034511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-94188d46-0559-4d7a-b38d-be3ab18ced69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:16.036713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-94188d46-0559-4d7a-b38d-be3ab18ced69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:16.043501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94188d46-0559-4d7a-b38d-be3ab18ced69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:16.043992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94188d46-0559-4d7a-b38d-be3ab18ced69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:16.044434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94188d46-0559-4d7a-b38d-be3ab18ced69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:16.045126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94188d46-0559-4d7a-b38d-be3ab18ced69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:16.045583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94188d46-0559-4d7a-b38d-be3ab18ced69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:16.046010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-94188d46-0559-4d7a-b38d-be3ab18ced69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:16.076423 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-94188d46-0559-4d7a-b38d-be3ab18ced69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045311 Oct 12 23:03:16.077006 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4078/7506] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:03:16 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:03:16.087757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-03147d8b-ab6f-4e38-8fe6-aea3312ae872 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:16.088299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-03147d8b-ab6f-4e38-8fe6-aea3312ae872 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:16.095076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03147d8b-ab6f-4e38-8fe6-aea3312ae872 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:16.095613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03147d8b-ab6f-4e38-8fe6-aea3312ae872 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:16.096068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03147d8b-ab6f-4e38-8fe6-aea3312ae872 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:16.096778 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03147d8b-ab6f-4e38-8fe6-aea3312ae872 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:16.097245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03147d8b-ab6f-4e38-8fe6-aea3312ae872 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:16.097689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03147d8b-ab6f-4e38-8fe6-aea3312ae872 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:16.174193 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-03147d8b-ab6f-4e38-8fe6-aea3312ae872 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] HTTP exception thrown: Instance d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 is not attached to volume be297474-f3ae-457f-90e4-b9edb740e4f8 Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-03147d8b-ab6f-4e38-8fe6-aea3312ae872 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Request method failure captured: Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments/be297474-f3ae-457f-90e4-b9edb740e4f8 HTTP/1.1 Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0ePONCZpsIcyWsaEmALIXAIrJVxSiNEVVuC0T-hclLcZuvU7sOeaYt3E7l9tI-JcvWB4WX1qhUC4ktaSDciTklOOdA5yt3tKaiz1ZQLMtS46dwTEQK2OOjr0j00VyFmXzHc_iO3Sk4HC8D5D-iqwECDqPEku89sRiBtUp8JW5EEfW4 Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: dac589d01bd348dfb8cea3fdd0968792 Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dac589d01bd348dfb8cea3fdd0968792", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: dac589d01bd348dfb8cea3fdd0968792 Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestEncryptedCinderVolumes-1774869705-project Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: fea7512a34264853b45f04188b32e0a3 Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestEncryptedCinderVolumes-1774869705-project Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 is not attached to volume be297474-f3ae-457f-90e4-b9edb740e4f8 Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'server_id': 'd2d2af9a-8a4f-44de-9ce8-a63942e22ce6', 'id': 'be297474-f3ae-457f-90e4-b9edb740e4f8'} Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id be297474-f3ae-457f-90e4-b9edb740e4f8. Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 is not attached to volume be297474-f3ae-457f-90e4-b9edb740e4f8 Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:16.185505 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:16.190250 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:03:16.190250 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:03:16.190250 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 is not attached to volume be297474-f3ae-457f-90e4-b9edb740e4f8 Oct 12 23:03:16.190250 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:03:16.190250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-03147d8b-ab6f-4e38-8fe6-aea3312ae872 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Returning 404 to user: Instance d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 is not attached to volume be297474-f3ae-457f-90e4-b9edb740e4f8 {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:03:16.190250 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-03147d8b-ab6f-4e38-8fe6-aea3312ae872 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments/be297474-f3ae-457f-90e4-b9edb740e4f8" status: 404 len: 154 microversion: 2.1 time: 0.103390 Oct 12 23:03:16.190250 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3429/7507] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 23:03:16 2022] DELETE /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6/os-volume_attachments/be297474-f3ae-457f-90e4-b9edb740e4f8 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:03:19.715842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-74636fec-d283-4442-823a-b15ccc7c91c3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:19.717225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-74636fec-d283-4442-823a-b15ccc7c91c3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:19.724305 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74636fec-d283-4442-823a-b15ccc7c91c3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:19.724805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74636fec-d283-4442-823a-b15ccc7c91c3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:19.725277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74636fec-d283-4442-823a-b15ccc7c91c3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:19.725987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74636fec-d283-4442-823a-b15ccc7c91c3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:19.726446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74636fec-d283-4442-823a-b15ccc7c91c3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:19.726882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-74636fec-d283-4442-823a-b15ccc7c91c3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:19.757281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-74636fec-d283-4442-823a-b15ccc7c91c3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:03:19.840871 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-74636fec-d283-4442-823a-b15ccc7c91c3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6" status: 204 len: 0 microversion: 2.1 time: 0.128459 Oct 12 23:03:19.842347 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4079/7508] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:03:19 2022] DELETE /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:03:19.851014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-573488ad-c330-4c0c-85a5-3f87c72e26d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:19.851897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-573488ad-c330-4c0c-85a5-3f87c72e26d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:19.860160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-573488ad-c330-4c0c-85a5-3f87c72e26d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:19.860753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-573488ad-c330-4c0c-85a5-3f87c72e26d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:19.861272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-573488ad-c330-4c0c-85a5-3f87c72e26d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:19.862200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-573488ad-c330-4c0c-85a5-3f87c72e26d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:19.862669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-573488ad-c330-4c0c-85a5-3f87c72e26d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:19.863117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-573488ad-c330-4c0c-85a5-3f87c72e26d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:19.996426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-573488ad-c330-4c0c-85a5-3f87c72e26d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:20.004356 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-573488ad-c330-4c0c-85a5-3f87c72e26d4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6" status: 200 len: 1559 microversion: 2.1 time: 0.157437 Oct 12 23:03:20.004929 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3430/7509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:19 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:21.028965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2acb2981-a9f5-49aa-bcc4-7de4b9520790 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:21.029630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2acb2981-a9f5-49aa-bcc4-7de4b9520790 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:21.036361 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2acb2981-a9f5-49aa-bcc4-7de4b9520790 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:21.036839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2acb2981-a9f5-49aa-bcc4-7de4b9520790 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:21.037274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2acb2981-a9f5-49aa-bcc4-7de4b9520790 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:21.037955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2acb2981-a9f5-49aa-bcc4-7de4b9520790 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:21.038406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2acb2981-a9f5-49aa-bcc4-7de4b9520790 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:21.038830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2acb2981-a9f5-49aa-bcc4-7de4b9520790 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:21.172955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2acb2981-a9f5-49aa-bcc4-7de4b9520790 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:21.180757 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2acb2981-a9f5-49aa-bcc4-7de4b9520790 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6" status: 200 len: 1559 microversion: 2.1 time: 0.156271 Oct 12 23:03:21.181329 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4080/7510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:21 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:21.983750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-a426aa99-d166-4ddc-9dc3-b8cf2b1a5dae req-5f63d6d7-d65c-442a-b746-2122695affc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2d2af9a-8a4f-44de-9ce8-a63942e22ce6", "name": "network-vif-deleted", "tag": "f54ce69a-c85d-419f-bc72-fce21e6ef427"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:21.995860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a426aa99-d166-4ddc-9dc3-b8cf2b1a5dae req-5f63d6d7-d65c-442a-b746-2122695affc3 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:21.996416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a426aa99-d166-4ddc-9dc3-b8cf2b1a5dae req-5f63d6d7-d65c-442a-b746-2122695affc3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:21.996871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a426aa99-d166-4ddc-9dc3-b8cf2b1a5dae req-5f63d6d7-d65c-442a-b746-2122695affc3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:22.009225 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-a426aa99-d166-4ddc-9dc3-b8cf2b1a5dae req-5f63d6d7-d65c-442a-b746-2122695affc3 service nova] Creating event network-vif-deleted:f54ce69a-c85d-419f-bc72-fce21e6ef427 for instance d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 on n-h2-861111-1 Oct 12 23:03:22.014354 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-a426aa99-d166-4ddc-9dc3-b8cf2b1a5dae req-5f63d6d7-d65c-442a-b746-2122695affc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034890 Oct 12 23:03:22.014973 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3431/7511] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:22.204717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b55291e8-70fc-47f1-8abf-80f15d37d690 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:22.205267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b55291e8-70fc-47f1-8abf-80f15d37d690 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:22.212117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b55291e8-70fc-47f1-8abf-80f15d37d690 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:22.212597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b55291e8-70fc-47f1-8abf-80f15d37d690 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:22.213031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b55291e8-70fc-47f1-8abf-80f15d37d690 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:22.213716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b55291e8-70fc-47f1-8abf-80f15d37d690 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:22.214167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b55291e8-70fc-47f1-8abf-80f15d37d690 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:22.214591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b55291e8-70fc-47f1-8abf-80f15d37d690 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:22.247344 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b55291e8-70fc-47f1-8abf-80f15d37d690 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:22.247818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b55291e8-70fc-47f1-8abf-80f15d37d690 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:22.248259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b55291e8-70fc-47f1-8abf-80f15d37d690 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:22.248763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-b55291e8-70fc-47f1-8abf-80f15d37d690 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lazy-loading 'fault' on Instance uuid d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:03:22.289632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b55291e8-70fc-47f1-8abf-80f15d37d690 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:22.297470 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b55291e8-70fc-47f1-8abf-80f15d37d690 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6" status: 200 len: 1351 microversion: 2.1 time: 0.097222 Oct 12 23:03:22.298047 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4081/7512] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:22 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:23.322643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b1b48f54-9459-49b6-a4bb-8b459ec8bce1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:23.323383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b1b48f54-9459-49b6-a4bb-8b459ec8bce1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: d2d2af9a-8a4f-44de-9ce8-a63942e22ce6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:23.330061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1b48f54-9459-49b6-a4bb-8b459ec8bce1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:23.330549 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1b48f54-9459-49b6-a4bb-8b459ec8bce1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:23.330998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1b48f54-9459-49b6-a4bb-8b459ec8bce1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:23.331733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1b48f54-9459-49b6-a4bb-8b459ec8bce1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:23.332197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1b48f54-9459-49b6-a4bb-8b459ec8bce1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:23.332634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1b48f54-9459-49b6-a4bb-8b459ec8bce1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:23.348577 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-b1b48f54-9459-49b6-a4bb-8b459ec8bce1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] HTTP exception thrown: Instance d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 could not be found. Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b1b48f54-9459-49b6-a4bb-8b459ec8bce1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Request method failure captured: Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 HTTP/1.1 Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0ePONCZpsIcyWsaEmALIXAIrJVxSiNEVVuC0T-hclLcZuvU7sOeaYt3E7l9tI-JcvWB4WX1qhUC4ktaSDciTklOOdA5yt3tKaiz1ZQLMtS46dwTEQK2OOjr0j00VyFmXzHc_iO3Sk4HC8D5D-iqwECDqPEku89sRiBtUp8JW5EEfW4 Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: dac589d01bd348dfb8cea3fdd0968792 Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dac589d01bd348dfb8cea3fdd0968792", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: dac589d01bd348dfb8cea3fdd0968792 Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestEncryptedCinderVolumes-1774869705-project Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: fea7512a34264853b45f04188b32e0a3 Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestEncryptedCinderVolumes-1774869705-project Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 could not be found. Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'd2d2af9a-8a4f-44de-9ce8-a63942e22ce6'} Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 could not be found. Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 could not be found. Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:03:23.350218 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:23.354862 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:03:23.354862 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:23.354862 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:23.354862 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:23.354862 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:03:23.354862 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:03:23.354862 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 could not be found. Oct 12 23:03:23.354862 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:03:23.354862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b1b48f54-9459-49b6-a4bb-8b459ec8bce1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Returning 404 to user: Instance d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:03:23.354862 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b1b48f54-9459-49b6-a4bb-8b459ec8bce1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6" status: 404 len: 111 microversion: 2.1 time: 0.034094 Oct 12 23:03:23.354862 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3432/7513] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:23 2022] GET /compute/v2.1/servers/d2d2af9a-8a4f-44de-9ce8-a63942e22ce6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:03:23.360347 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c551d7ae-6072-4b55-8b84-c8b938c5d844 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '.version_select at 0x7f51233a0670>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:23.383871 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c551d7ae-6072-4b55-8b84-c8b938c5d844 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-364700640" status: 202 len: 0 microversion: 2.1 time: 0.027292 Oct 12 23:03:23.384450 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4082/7514] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 23:03:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-364700640 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 23:03:23.402407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b508140a-73e8-484e-b73e-c21f21bad6ca tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Action: 'create', calling method: .version_select at 0x7f512c39f8b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-192374643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnS3Yxvmp8nLWWm1qSZgHo/O64Vo4CRod5tJk6QC4bWvX0GdkWVv7/8KaSk66EXpwefmPEDW5TodZnnCyMN3W4JxQqOM/7uJ5c+O2rUC7pfDwEO86iaU9oRuJK0H1EPOw=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:23.417546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-b508140a-73e8-484e-b73e-c21f21bad6ca tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Getting quotas for project dac589d01bd348dfb8cea3fdd0968792. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:03:23.422603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-b508140a-73e8-484e-b73e-c21f21bad6ca tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Getting quotas for user fea7512a34264853b45f04188b32e0a3 and project dac589d01bd348dfb8cea3fdd0968792. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:03:23.446000 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b508140a-73e8-484e-b73e-c21f21bad6ca tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.047525 Oct 12 23:03:23.446652 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3433/7515] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 23:03:23 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:03:23.495612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-928732732", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-192374643", "networks": [{"uuid": "e7962cf6-f9da-4b90-ab53-9bb0e3802b64"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:23.548858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] validate_networks() for [('e7962cf6-f9da-4b90-ab53-9bb0e3802b64', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:03:23.924689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:03:23.925116 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:03:23.925594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:03:23.926007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:03:23.926424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:03:23.935175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:23.935685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:23.936720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:23.937470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:23.937924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:23.938350 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:23.955260 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Getting quotas for project dac589d01bd348dfb8cea3fdd0968792. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:03:23.960496 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Getting quotas for user fea7512a34264853b45f04188b32e0a3 and project dac589d01bd348dfb8cea3fdd0968792. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:03:23.972594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:03:23.974874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:03:24.021255 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-128d1cb8-3e82-4287-9095-f4652090efd9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529715 Oct 12 23:03:24.027964 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4083/7516] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 23:03:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:03:24.033807 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8a0ff908-5f96-4676-ae85-06635b1c1611 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:24.034443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8a0ff908-5f96-4676-ae85-06635b1c1611 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:24.095511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8a0ff908-5f96-4676-ae85-06635b1c1611 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:24.104640 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8a0ff908-5f96-4676-ae85-06635b1c1611 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6" status: 200 len: 1261 microversion: 2.1 time: 0.074775 Oct 12 23:03:24.105468 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3434/7517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:24 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 => generated 1261 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:25.129836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-eafdcd1f-c141-4e71-afde-95bca0280f21 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:25.130491 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-eafdcd1f-c141-4e71-afde-95bca0280f21 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:25.137090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eafdcd1f-c141-4e71-afde-95bca0280f21 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:25.137582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eafdcd1f-c141-4e71-afde-95bca0280f21 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:25.138024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eafdcd1f-c141-4e71-afde-95bca0280f21 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:25.138738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eafdcd1f-c141-4e71-afde-95bca0280f21 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:25.139815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eafdcd1f-c141-4e71-afde-95bca0280f21 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:25.140248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-eafdcd1f-c141-4e71-afde-95bca0280f21 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:25.203855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-eafdcd1f-c141-4e71-afde-95bca0280f21 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:25.211609 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-eafdcd1f-c141-4e71-afde-95bca0280f21 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6" status: 200 len: 1319 microversion: 2.1 time: 0.086530 Oct 12 23:03:25.212188 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4084/7518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:25 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 => generated 1319 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:26.234822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4b258851-9359-4acb-8d1e-b880be011c71 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:26.235493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4b258851-9359-4acb-8d1e-b880be011c71 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:26.242357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b258851-9359-4acb-8d1e-b880be011c71 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:26.242864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b258851-9359-4acb-8d1e-b880be011c71 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:26.243360 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b258851-9359-4acb-8d1e-b880be011c71 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:26.244067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b258851-9359-4acb-8d1e-b880be011c71 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:26.244532 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b258851-9359-4acb-8d1e-b880be011c71 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:26.244969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b258851-9359-4acb-8d1e-b880be011c71 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:26.456230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-8a6ebd0a-c26b-4b61-b439-53aceb8af75d req-fc9739e5-4be0-4bf2-a544-9ad811e71ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0900cc35-84aa-4897-a10d-a4469363d1f6", "tag": "b3c676ee-897b-4c58-aa58-56b97db82b70"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:26.466903 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8a6ebd0a-c26b-4b61-b439-53aceb8af75d req-fc9739e5-4be0-4bf2-a544-9ad811e71ce5 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:26.468325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8a6ebd0a-c26b-4b61-b439-53aceb8af75d req-fc9739e5-4be0-4bf2-a544-9ad811e71ce5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:26.468838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8a6ebd0a-c26b-4b61-b439-53aceb8af75d req-fc9739e5-4be0-4bf2-a544-9ad811e71ce5 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:26.481344 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-8a6ebd0a-c26b-4b61-b439-53aceb8af75d req-fc9739e5-4be0-4bf2-a544-9ad811e71ce5 service nova] Creating event network-changed:b3c676ee-897b-4c58-aa58-56b97db82b70 for instance 0900cc35-84aa-4897-a10d-a4469363d1f6 on n-h2-861111-1 Oct 12 23:03:26.486876 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-8a6ebd0a-c26b-4b61-b439-53aceb8af75d req-fc9739e5-4be0-4bf2-a544-9ad811e71ce5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036871 Oct 12 23:03:26.487514 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4085/7519] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:26.535349 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4b258851-9359-4acb-8d1e-b880be011c71 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:26.543304 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4b258851-9359-4acb-8d1e-b880be011c71 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6" status: 200 len: 1361 microversion: 2.1 time: 0.312449 Oct 12 23:03:26.543892 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3435/7520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:26 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 => generated 1361 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:27.567340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a4afd1aa-c8d4-465d-a808-27057409728f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:27.568046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a4afd1aa-c8d4-465d-a808-27057409728f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:27.574959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4afd1aa-c8d4-465d-a808-27057409728f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:27.575469 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4afd1aa-c8d4-465d-a808-27057409728f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:27.575913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4afd1aa-c8d4-465d-a808-27057409728f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:27.576601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4afd1aa-c8d4-465d-a808-27057409728f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:27.577058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4afd1aa-c8d4-465d-a808-27057409728f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:27.577516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4afd1aa-c8d4-465d-a808-27057409728f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:27.712573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a4afd1aa-c8d4-465d-a808-27057409728f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:27.721770 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a4afd1aa-c8d4-465d-a808-27057409728f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6" status: 200 len: 1361 microversion: 2.1 time: 0.158582 Oct 12 23:03:27.722522 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4086/7521] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:27 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:28.746033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-049f7540-7c3d-49b8-a07b-5cb9a7dfa4b1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:28.746661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-049f7540-7c3d-49b8-a07b-5cb9a7dfa4b1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:28.753490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-049f7540-7c3d-49b8-a07b-5cb9a7dfa4b1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:28.753985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-049f7540-7c3d-49b8-a07b-5cb9a7dfa4b1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:28.754438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-049f7540-7c3d-49b8-a07b-5cb9a7dfa4b1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:28.755148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-049f7540-7c3d-49b8-a07b-5cb9a7dfa4b1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:28.755639 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-049f7540-7c3d-49b8-a07b-5cb9a7dfa4b1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:28.756077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-049f7540-7c3d-49b8-a07b-5cb9a7dfa4b1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:28.883090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-049f7540-7c3d-49b8-a07b-5cb9a7dfa4b1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:28.890683 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-049f7540-7c3d-49b8-a07b-5cb9a7dfa4b1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6" status: 200 len: 1361 microversion: 2.1 time: 0.148846 Oct 12 23:03:28.891254 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3436/7522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:28 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:29.914144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-964f48e7-02d0-4265-b1a5-7f9d3a19c6b4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:29.914757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-964f48e7-02d0-4265-b1a5-7f9d3a19c6b4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:29.922237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964f48e7-02d0-4265-b1a5-7f9d3a19c6b4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:29.922725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964f48e7-02d0-4265-b1a5-7f9d3a19c6b4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:29.923165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964f48e7-02d0-4265-b1a5-7f9d3a19c6b4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:29.923881 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964f48e7-02d0-4265-b1a5-7f9d3a19c6b4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:29.924343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964f48e7-02d0-4265-b1a5-7f9d3a19c6b4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:29.924767 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-964f48e7-02d0-4265-b1a5-7f9d3a19c6b4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:30.050619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-964f48e7-02d0-4265-b1a5-7f9d3a19c6b4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:30.058464 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-964f48e7-02d0-4265-b1a5-7f9d3a19c6b4 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6" status: 200 len: 1361 microversion: 2.1 time: 0.148201 Oct 12 23:03:30.059049 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4087/7523] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:29 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:31.081750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ec0b042a-8340-4a14-86d5-fe4f5952e2aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:31.082296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ec0b042a-8340-4a14-86d5-fe4f5952e2aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:31.089178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec0b042a-8340-4a14-86d5-fe4f5952e2aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:31.089678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec0b042a-8340-4a14-86d5-fe4f5952e2aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:31.090134 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec0b042a-8340-4a14-86d5-fe4f5952e2aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:31.090902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec0b042a-8340-4a14-86d5-fe4f5952e2aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:31.091396 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec0b042a-8340-4a14-86d5-fe4f5952e2aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:31.091842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec0b042a-8340-4a14-86d5-fe4f5952e2aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:31.220809 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ec0b042a-8340-4a14-86d5-fe4f5952e2aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:31.228588 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ec0b042a-8340-4a14-86d5-fe4f5952e2aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6" status: 200 len: 1361 microversion: 2.1 time: 0.150909 Oct 12 23:03:31.229168 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3437/7524] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:31 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:32.252012 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-270aeb62-1f6a-4c66-a928-32212b69d12a tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:32.252821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-270aeb62-1f6a-4c66-a928-32212b69d12a tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:32.260408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-270aeb62-1f6a-4c66-a928-32212b69d12a tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:32.260896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-270aeb62-1f6a-4c66-a928-32212b69d12a tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:32.261371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-270aeb62-1f6a-4c66-a928-32212b69d12a tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:32.262113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-270aeb62-1f6a-4c66-a928-32212b69d12a tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:32.262528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-270aeb62-1f6a-4c66-a928-32212b69d12a tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:32.262947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-270aeb62-1f6a-4c66-a928-32212b69d12a tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:32.397660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-270aeb62-1f6a-4c66-a928-32212b69d12a tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:32.405441 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-270aeb62-1f6a-4c66-a928-32212b69d12a tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6" status: 200 len: 1361 microversion: 2.1 time: 0.157439 Oct 12 23:03:32.406014 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4088/7525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:32 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:33.428241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5f65ba98-d5aa-4083-8dc5-e67153a38782 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:33.428941 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5f65ba98-d5aa-4083-8dc5-e67153a38782 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:33.435960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f65ba98-d5aa-4083-8dc5-e67153a38782 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:33.436993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f65ba98-d5aa-4083-8dc5-e67153a38782 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:33.437483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f65ba98-d5aa-4083-8dc5-e67153a38782 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:33.438197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f65ba98-d5aa-4083-8dc5-e67153a38782 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:33.438675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f65ba98-d5aa-4083-8dc5-e67153a38782 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:33.439143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f65ba98-d5aa-4083-8dc5-e67153a38782 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:33.571416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5f65ba98-d5aa-4083-8dc5-e67153a38782 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:33.579262 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5f65ba98-d5aa-4083-8dc5-e67153a38782 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6" status: 200 len: 1361 microversion: 2.1 time: 0.154965 Oct 12 23:03:33.579839 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3438/7526] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:33 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:34.256376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-1756c2e7-2219-4267-aecf-95d84f349fa6 req-26d1d07a-14a3-44ca-ac63-1f5468da9faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0900cc35-84aa-4897-a10d-a4469363d1f6", "name": "network-vif-plugged", "status": "completed", "tag": "b3c676ee-897b-4c58-aa58-56b97db82b70"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:34.262145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:34.263013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:34.269451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1756c2e7-2219-4267-aecf-95d84f349fa6 req-26d1d07a-14a3-44ca-ac63-1f5468da9faf service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:34.269951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1756c2e7-2219-4267-aecf-95d84f349fa6 req-26d1d07a-14a3-44ca-ac63-1f5468da9faf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:34.270387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-1756c2e7-2219-4267-aecf-95d84f349fa6 req-26d1d07a-14a3-44ca-ac63-1f5468da9faf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:34.282290 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-1756c2e7-2219-4267-aecf-95d84f349fa6 req-26d1d07a-14a3-44ca-ac63-1f5468da9faf service nova] Creating event network-vif-plugged:b3c676ee-897b-4c58-aa58-56b97db82b70 for instance 0900cc35-84aa-4897-a10d-a4469363d1f6 on n-h2-861111-1 Oct 12 23:03:34.287155 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-1756c2e7-2219-4267-aecf-95d84f349fa6 req-26d1d07a-14a3-44ca-ac63-1f5468da9faf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034597 Oct 12 23:03:34.287957 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4089/7527] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:34.603352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-95e09283-f5ac-4b80-856f-72eac873ed25 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:34.603949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-95e09283-f5ac-4b80-856f-72eac873ed25 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:34.605940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:34.612589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95e09283-f5ac-4b80-856f-72eac873ed25 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:34.613115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95e09283-f5ac-4b80-856f-72eac873ed25 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:34.613570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95e09283-f5ac-4b80-856f-72eac873ed25 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:34.614279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95e09283-f5ac-4b80-856f-72eac873ed25 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:34.614749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95e09283-f5ac-4b80-856f-72eac873ed25 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:34.615193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95e09283-f5ac-4b80-856f-72eac873ed25 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:34.751455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-95e09283-f5ac-4b80-856f-72eac873ed25 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:34.759760 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-95e09283-f5ac-4b80-856f-72eac873ed25 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6" status: 200 len: 1361 microversion: 2.1 time: 0.160348 Oct 12 23:03:34.773547 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3439/7528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:34 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:35.785034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-632a7857-bcf0-4ec8-afb7-c05dc056c2a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:35.785736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-632a7857-bcf0-4ec8-afb7-c05dc056c2a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:35.793956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-632a7857-bcf0-4ec8-afb7-c05dc056c2a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:35.794437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-632a7857-bcf0-4ec8-afb7-c05dc056c2a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:35.794872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-632a7857-bcf0-4ec8-afb7-c05dc056c2a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:35.795588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-632a7857-bcf0-4ec8-afb7-c05dc056c2a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:35.796040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-632a7857-bcf0-4ec8-afb7-c05dc056c2a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:35.796462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-632a7857-bcf0-4ec8-afb7-c05dc056c2a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:35.927343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-632a7857-bcf0-4ec8-afb7-c05dc056c2a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:35.935055 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-632a7857-bcf0-4ec8-afb7-c05dc056c2a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6" status: 200 len: 1553 microversion: 2.1 time: 0.155747 Oct 12 23:03:35.935660 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4090/7529] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:35 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:35.957748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0df3bcda-e3fa-432d-b257-366deafe2620 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:35.958400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0df3bcda-e3fa-432d-b257-366deafe2620 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:35.965081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0df3bcda-e3fa-432d-b257-366deafe2620 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:35.965582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0df3bcda-e3fa-432d-b257-366deafe2620 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:35.966035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0df3bcda-e3fa-432d-b257-366deafe2620 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:35.966746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0df3bcda-e3fa-432d-b257-366deafe2620 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:35.967217 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0df3bcda-e3fa-432d-b257-366deafe2620 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:35.967686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0df3bcda-e3fa-432d-b257-366deafe2620 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:36.097883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0df3bcda-e3fa-432d-b257-366deafe2620 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:36.105637 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0df3bcda-e3fa-432d-b257-366deafe2620 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6" status: 200 len: 1553 microversion: 2.1 time: 0.152300 Oct 12 23:03:36.106220 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3440/7530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:35 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:37.590765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4cbb0ae3-29a5-4d67-aade-133c764fec69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad0c0e73-538c-45b0-b7d7-f10d008a9db7"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:37.593163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4cbb0ae3-29a5-4d67-aade-133c764fec69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:37.599979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cbb0ae3-29a5-4d67-aade-133c764fec69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:37.600470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cbb0ae3-29a5-4d67-aade-133c764fec69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:37.600914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cbb0ae3-29a5-4d67-aade-133c764fec69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:37.601606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cbb0ae3-29a5-4d67-aade-133c764fec69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:37.602065 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cbb0ae3-29a5-4d67-aade-133c764fec69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:37.602508 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4cbb0ae3-29a5-4d67-aade-133c764fec69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:37.672669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:37.840644 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4cbb0ae3-29a5-4d67-aade-133c764fec69 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "POST /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253648 Oct 12 23:03:37.841393 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4091/7531] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 23:03:37 2022] POST /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:48.559034 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-99f50d8d-392e-4dd4-b521-bcf06d75e515 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:48.559620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-99f50d8d-392e-4dd4-b521-bcf06d75e515 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:48.561964 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:03:48.562111 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 23:03:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments/ad0c0e73-538c-45b0-b7d7-f10d008a9db7 (ip 10.222.0.16) !!! Oct 12 23:03:48.563183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:48.564500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=70 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:48.571817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99f50d8d-392e-4dd4-b521-bcf06d75e515 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:48.572318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99f50d8d-392e-4dd4-b521-bcf06d75e515 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:48.572771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99f50d8d-392e-4dd4-b521-bcf06d75e515 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:48.573486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99f50d8d-392e-4dd4-b521-bcf06d75e515 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:48.573952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99f50d8d-392e-4dd4-b521-bcf06d75e515 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:48.574395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99f50d8d-392e-4dd4-b521-bcf06d75e515 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:48.655168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-99f50d8d-392e-4dd4-b521-bcf06d75e515 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lazy-loading 'services' on Instance uuid 0900cc35-84aa-4897-a10d-a4469363d1f6 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:03:48.723921 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-99f50d8d-392e-4dd4-b521-bcf06d75e515 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments/ad0c0e73-538c-45b0-b7d7-f10d008a9db7" status: 202 len: 0 microversion: 2.1 time: 0.169006 Oct 12 23:03:48.724506 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3441/7532] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 23:03:48 2022] DELETE /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments/ad0c0e73-538c-45b0-b7d7-f10d008a9db7 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:03:48.732448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:48.733218 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=5,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:48.738796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-97518af5-5307-4348-b59f-7537793b4ffe tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:48.741744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-97518af5-5307-4348-b59f-7537793b4ffe tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:48.757880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97518af5-5307-4348-b59f-7537793b4ffe tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:48.758379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97518af5-5307-4348-b59f-7537793b4ffe tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:48.758808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97518af5-5307-4348-b59f-7537793b4ffe tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:48.759539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97518af5-5307-4348-b59f-7537793b4ffe tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:48.759998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97518af5-5307-4348-b59f-7537793b4ffe tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:48.760423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97518af5-5307-4348-b59f-7537793b4ffe tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:48.798012 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-97518af5-5307-4348-b59f-7537793b4ffe tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068249 Oct 12 23:03:48.799200 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4092/7533] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:03:48 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:49.811946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0fd6395a-a68c-4780-8c95-aeacb51890bf tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:49.814910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0fd6395a-a68c-4780-8c95-aeacb51890bf tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:49.822364 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fd6395a-a68c-4780-8c95-aeacb51890bf tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:49.822871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fd6395a-a68c-4780-8c95-aeacb51890bf tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:49.823348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fd6395a-a68c-4780-8c95-aeacb51890bf tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:49.824075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fd6395a-a68c-4780-8c95-aeacb51890bf tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:49.824556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fd6395a-a68c-4780-8c95-aeacb51890bf tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:49.825007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fd6395a-a68c-4780-8c95-aeacb51890bf tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:49.855951 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0fd6395a-a68c-4780-8c95-aeacb51890bf tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048491 Oct 12 23:03:49.856526 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3442/7534] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:03:49 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:50.868820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b4e305f5-e879-499d-8d03-8c3b15b60590 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:50.871045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b4e305f5-e879-499d-8d03-8c3b15b60590 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:50.878038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4e305f5-e879-499d-8d03-8c3b15b60590 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:50.878523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4e305f5-e879-499d-8d03-8c3b15b60590 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:50.878966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4e305f5-e879-499d-8d03-8c3b15b60590 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:50.879698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4e305f5-e879-499d-8d03-8c3b15b60590 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:50.880171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4e305f5-e879-499d-8d03-8c3b15b60590 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:50.880633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b4e305f5-e879-499d-8d03-8c3b15b60590 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:50.911374 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b4e305f5-e879-499d-8d03-8c3b15b60590 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046850 Oct 12 23:03:50.911946 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4093/7535] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:03:50 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:51.924163 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd447833-898a-4ae8-bf5a-afb4b7c2502b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:51.926323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cd447833-898a-4ae8-bf5a-afb4b7c2502b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:51.933126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd447833-898a-4ae8-bf5a-afb4b7c2502b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:51.933617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd447833-898a-4ae8-bf5a-afb4b7c2502b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:51.934062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd447833-898a-4ae8-bf5a-afb4b7c2502b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:51.935410 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd447833-898a-4ae8-bf5a-afb4b7c2502b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:51.935880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd447833-898a-4ae8-bf5a-afb4b7c2502b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:51.936323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd447833-898a-4ae8-bf5a-afb4b7c2502b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:51.966843 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cd447833-898a-4ae8-bf5a-afb4b7c2502b tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046822 Oct 12 23:03:51.967434 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3443/7536] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:03:51 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:52.979450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e3b2e099-7540-40a3-9abf-471a69dfdff1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:52.981686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e3b2e099-7540-40a3-9abf-471a69dfdff1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:52.989232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3b2e099-7540-40a3-9abf-471a69dfdff1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:52.989730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3b2e099-7540-40a3-9abf-471a69dfdff1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:52.990180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3b2e099-7540-40a3-9abf-471a69dfdff1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:52.990888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3b2e099-7540-40a3-9abf-471a69dfdff1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:52.991375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3b2e099-7540-40a3-9abf-471a69dfdff1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:52.991814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e3b2e099-7540-40a3-9abf-471a69dfdff1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:53.022845 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e3b2e099-7540-40a3-9abf-471a69dfdff1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047395 Oct 12 23:03:53.023374 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4094/7537] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:03:52 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:54.035500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b6d89d07-daf6-4fc7-ae46-94397d07e7ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:54.037692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b6d89d07-daf6-4fc7-ae46-94397d07e7ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:54.044527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6d89d07-daf6-4fc7-ae46-94397d07e7ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:54.045032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6d89d07-daf6-4fc7-ae46-94397d07e7ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:54.045487 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6d89d07-daf6-4fc7-ae46-94397d07e7ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:54.046197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6d89d07-daf6-4fc7-ae46-94397d07e7ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:54.046700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6d89d07-daf6-4fc7-ae46-94397d07e7ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:54.047147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6d89d07-daf6-4fc7-ae46-94397d07e7ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:54.076074 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b6d89d07-daf6-4fc7-ae46-94397d07e7ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044798 Oct 12 23:03:54.076626 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3444/7538] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:03:54 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:03:54.088294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c87d034c-01b7-4387-9fb3-c10c1c274027 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:54.088823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c87d034c-01b7-4387-9fb3-c10c1c274027 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:54.095554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c87d034c-01b7-4387-9fb3-c10c1c274027 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:54.096035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c87d034c-01b7-4387-9fb3-c10c1c274027 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:54.096473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c87d034c-01b7-4387-9fb3-c10c1c274027 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:54.097153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c87d034c-01b7-4387-9fb3-c10c1c274027 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:54.097603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c87d034c-01b7-4387-9fb3-c10c1c274027 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:54.098032 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c87d034c-01b7-4387-9fb3-c10c1c274027 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:54.173229 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-c87d034c-01b7-4387-9fb3-c10c1c274027 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] HTTP exception thrown: Instance 0900cc35-84aa-4897-a10d-a4469363d1f6 is not attached to volume ad0c0e73-538c-45b0-b7d7-f10d008a9db7 Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c87d034c-01b7-4387-9fb3-c10c1c274027 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Request method failure captured: Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments/ad0c0e73-538c-45b0-b7d7-f10d008a9db7 HTTP/1.1 Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0ePONCZpsIcyWsaEmALIXAIrJVxSiNEVVuC0T-hclLcZuvU7sOeaYt3E7l9tI-JcvWB4WX1qhUC4ktaSDciTklOOdA5yt3tKaiz1ZQLMtS46dwTEQK2OOjr0j00VyFmXzHc_iO3Sk4HC8D5D-iqwECDqPEku89sRiBtUp8JW5EEfW4 Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: dac589d01bd348dfb8cea3fdd0968792 Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dac589d01bd348dfb8cea3fdd0968792", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: dac589d01bd348dfb8cea3fdd0968792 Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestEncryptedCinderVolumes-1774869705-project Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: fea7512a34264853b45f04188b32e0a3 Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestEncryptedCinderVolumes-1774869705-project Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 0900cc35-84aa-4897-a10d-a4469363d1f6 is not attached to volume ad0c0e73-538c-45b0-b7d7-f10d008a9db7 Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'server_id': '0900cc35-84aa-4897-a10d-a4469363d1f6', 'id': 'ad0c0e73-538c-45b0-b7d7-f10d008a9db7'} Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ad0c0e73-538c-45b0-b7d7-f10d008a9db7. Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0900cc35-84aa-4897-a10d-a4469363d1f6 is not attached to volume ad0c0e73-538c-45b0-b7d7-f10d008a9db7 Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:54.175171 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:54.179641 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:03:54.179641 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:03:54.179641 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0900cc35-84aa-4897-a10d-a4469363d1f6 is not attached to volume ad0c0e73-538c-45b0-b7d7-f10d008a9db7 Oct 12 23:03:54.179641 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:03:54.179641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c87d034c-01b7-4387-9fb3-c10c1c274027 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Returning 404 to user: Instance 0900cc35-84aa-4897-a10d-a4469363d1f6 is not attached to volume ad0c0e73-538c-45b0-b7d7-f10d008a9db7 {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:03:54.179641 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c87d034c-01b7-4387-9fb3-c10c1c274027 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments/ad0c0e73-538c-45b0-b7d7-f10d008a9db7" status: 404 len: 154 microversion: 2.1 time: 0.092377 Oct 12 23:03:54.179641 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4095/7539] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 23:03:54 2022] DELETE /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6/os-volume_attachments/ad0c0e73-538c-45b0-b7d7-f10d008a9db7 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:03:57.522042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9259d226-2e94-4a5a-869c-abf05826a0e7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:57.522547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9259d226-2e94-4a5a-869c-abf05826a0e7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:57.529341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9259d226-2e94-4a5a-869c-abf05826a0e7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:57.529847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9259d226-2e94-4a5a-869c-abf05826a0e7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:57.530312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9259d226-2e94-4a5a-869c-abf05826a0e7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:57.531031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9259d226-2e94-4a5a-869c-abf05826a0e7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:57.531526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9259d226-2e94-4a5a-869c-abf05826a0e7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:57.531981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9259d226-2e94-4a5a-869c-abf05826a0e7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:57.558064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9259d226-2e94-4a5a-869c-abf05826a0e7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:03:57.637185 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9259d226-2e94-4a5a-869c-abf05826a0e7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6" status: 204 len: 0 microversion: 2.1 time: 0.118732 Oct 12 23:03:57.637784 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3445/7540] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:03:57 2022] DELETE /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:03:57.647056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-477d8589-f839-4c0f-85d2-1a3b46da9c9d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:57.647716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-477d8589-f839-4c0f-85d2-1a3b46da9c9d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:57.655669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-477d8589-f839-4c0f-85d2-1a3b46da9c9d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:57.656099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-477d8589-f839-4c0f-85d2-1a3b46da9c9d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:57.656576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-477d8589-f839-4c0f-85d2-1a3b46da9c9d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:57.657276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-477d8589-f839-4c0f-85d2-1a3b46da9c9d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:57.658314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-477d8589-f839-4c0f-85d2-1a3b46da9c9d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:57.658746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-477d8589-f839-4c0f-85d2-1a3b46da9c9d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:57.789235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-477d8589-f839-4c0f-85d2-1a3b46da9c9d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:57.797184 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-477d8589-f839-4c0f-85d2-1a3b46da9c9d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6" status: 200 len: 1559 microversion: 2.1 time: 0.154146 Oct 12 23:03:57.797762 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4096/7541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:57 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:58.821789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ef8bfc0d-08fa-4d19-a159-a5559965c929 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:58.822513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ef8bfc0d-08fa-4d19-a159-a5559965c929 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:58.829625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef8bfc0d-08fa-4d19-a159-a5559965c929 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:58.830127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef8bfc0d-08fa-4d19-a159-a5559965c929 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:58.830581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef8bfc0d-08fa-4d19-a159-a5559965c929 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:58.831821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef8bfc0d-08fa-4d19-a159-a5559965c929 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:58.832315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef8bfc0d-08fa-4d19-a159-a5559965c929 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:58.832757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef8bfc0d-08fa-4d19-a159-a5559965c929 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:58.965298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ef8bfc0d-08fa-4d19-a159-a5559965c929 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:58.973306 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ef8bfc0d-08fa-4d19-a159-a5559965c929 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6" status: 200 len: 1559 microversion: 2.1 time: 0.155860 Oct 12 23:03:58.973885 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3446/7542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:58 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:59.708666 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-8cd1808c-fdad-43f8-810b-85c3496f8431 req-59c6f9a0-afaa-4512-9eeb-b295a2d40c8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0900cc35-84aa-4897-a10d-a4469363d1f6", "name": "network-vif-deleted", "tag": "b3c676ee-897b-4c58-aa58-56b97db82b70"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:59.719981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8cd1808c-fdad-43f8-810b-85c3496f8431 req-59c6f9a0-afaa-4512-9eeb-b295a2d40c8d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:59.721296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8cd1808c-fdad-43f8-810b-85c3496f8431 req-59c6f9a0-afaa-4512-9eeb-b295a2d40c8d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:59.721815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-8cd1808c-fdad-43f8-810b-85c3496f8431 req-59c6f9a0-afaa-4512-9eeb-b295a2d40c8d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:59.734116 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-8cd1808c-fdad-43f8-810b-85c3496f8431 req-59c6f9a0-afaa-4512-9eeb-b295a2d40c8d service nova] Creating event network-vif-deleted:b3c676ee-897b-4c58-aa58-56b97db82b70 for instance 0900cc35-84aa-4897-a10d-a4469363d1f6 on n-h2-861111-1 Oct 12 23:03:59.739618 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-8cd1808c-fdad-43f8-810b-85c3496f8431 req-59c6f9a0-afaa-4512-9eeb-b295a2d40c8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101027 Oct 12 23:03:59.743528 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4097/7543] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:59.997276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8494630d-40dc-4c41-85d9-f361e3a793aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:59.997906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8494630d-40dc-4c41-85d9-f361e3a793aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:00.005884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8494630d-40dc-4c41-85d9-f361e3a793aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:00.006389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8494630d-40dc-4c41-85d9-f361e3a793aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:00.006846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8494630d-40dc-4c41-85d9-f361e3a793aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:00.007595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8494630d-40dc-4c41-85d9-f361e3a793aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:00.008070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8494630d-40dc-4c41-85d9-f361e3a793aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:00.008541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8494630d-40dc-4c41-85d9-f361e3a793aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:00.040928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8494630d-40dc-4c41-85d9-f361e3a793aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:00.041359 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8494630d-40dc-4c41-85d9-f361e3a793aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:00.041840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8494630d-40dc-4c41-85d9-f361e3a793aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:00.042285 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-8494630d-40dc-4c41-85d9-f361e3a793aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lazy-loading 'fault' on Instance uuid 0900cc35-84aa-4897-a10d-a4469363d1f6 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:04:00.088460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8494630d-40dc-4c41-85d9-f361e3a793aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:00.096418 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8494630d-40dc-4c41-85d9-f361e3a793aa tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6" status: 200 len: 1351 microversion: 2.1 time: 0.102893 Oct 12 23:04:00.097018 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3447/7544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:59 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:04:01.121951 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e17bbe06-2a60-47eb-a311-7889b3e39c9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:01.122609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e17bbe06-2a60-47eb-a311-7889b3e39c9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 0900cc35-84aa-4897-a10d-a4469363d1f6] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:01.128799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e17bbe06-2a60-47eb-a311-7889b3e39c9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:01.129285 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e17bbe06-2a60-47eb-a311-7889b3e39c9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:01.129729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e17bbe06-2a60-47eb-a311-7889b3e39c9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:01.130421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e17bbe06-2a60-47eb-a311-7889b3e39c9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:01.130877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e17bbe06-2a60-47eb-a311-7889b3e39c9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:01.131342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e17bbe06-2a60-47eb-a311-7889b3e39c9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:01.145028 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-e17bbe06-2a60-47eb-a311-7889b3e39c9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] HTTP exception thrown: Instance 0900cc35-84aa-4897-a10d-a4469363d1f6 could not be found. Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e17bbe06-2a60-47eb-a311-7889b3e39c9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Request method failure captured: Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 HTTP/1.1 Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0ePONCZpsIcyWsaEmALIXAIrJVxSiNEVVuC0T-hclLcZuvU7sOeaYt3E7l9tI-JcvWB4WX1qhUC4ktaSDciTklOOdA5yt3tKaiz1ZQLMtS46dwTEQK2OOjr0j00VyFmXzHc_iO3Sk4HC8D5D-iqwECDqPEku89sRiBtUp8JW5EEfW4 Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: dac589d01bd348dfb8cea3fdd0968792 Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dac589d01bd348dfb8cea3fdd0968792", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: dac589d01bd348dfb8cea3fdd0968792 Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestEncryptedCinderVolumes-1774869705-project Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: fea7512a34264853b45f04188b32e0a3 Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestEncryptedCinderVolumes-1774869705-project Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 0900cc35-84aa-4897-a10d-a4469363d1f6 could not be found. Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '0900cc35-84aa-4897-a10d-a4469363d1f6'} Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0900cc35-84aa-4897-a10d-a4469363d1f6 could not be found. Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0900cc35-84aa-4897-a10d-a4469363d1f6 could not be found. Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:04:01.146652 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:01.150955 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:04:01.150955 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:01.150955 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:01.150955 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:01.150955 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:04:01.150955 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:04:01.150955 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0900cc35-84aa-4897-a10d-a4469363d1f6 could not be found. Oct 12 23:04:01.150955 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:04:01.150955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e17bbe06-2a60-47eb-a311-7889b3e39c9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Returning 404 to user: Instance 0900cc35-84aa-4897-a10d-a4469363d1f6 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:04:01.150955 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e17bbe06-2a60-47eb-a311-7889b3e39c9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6" status: 404 len: 111 microversion: 2.1 time: 0.031661 Oct 12 23:04:01.150955 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4098/7545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:01 2022] GET /compute/v2.1/servers/0900cc35-84aa-4897-a10d-a4469363d1f6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:04:01.157111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cc1e7c69-3d66-46e2-bcf8-c4728e364ce7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '.version_select at 0x7f512c4d1700>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:01.178983 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cc1e7c69-3d66-46e2-bcf8-c4728e364ce7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-192374643" status: 202 len: 0 microversion: 2.1 time: 0.025704 Oct 12 23:04:01.179603 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3448/7546] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 12 23:04:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-192374643 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:04:01.197120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bf7e3bbf-57e8-4a48-8015-1da6869fc10f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Action: 'create', calling method: .version_select at 0x7f512827f790>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1871150658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyqG55yN80TGgepuG4XuLkdeR26G8Xy6BF863zAcZkLU5BEZsoUhS3HdKT2acpSYSndfzRqsAZ6aVmLZ+B+wxDhXDbZ2h1bo+dIOPBy3bNYwm61B2cOk3fbxVt0SV835g=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:04:01.212978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-bf7e3bbf-57e8-4a48-8015-1da6869fc10f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Getting quotas for project dac589d01bd348dfb8cea3fdd0968792. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:04:01.222312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-bf7e3bbf-57e8-4a48-8015-1da6869fc10f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Getting quotas for user fea7512a34264853b45f04188b32e0a3 and project dac589d01bd348dfb8cea3fdd0968792. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:04:01.246660 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bf7e3bbf-57e8-4a48-8015-1da6869fc10f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.053467 Oct 12 23:04:01.247297 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4099/7547] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 23:04:01 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:01.297378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-227838450", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1871150658", "networks": [{"uuid": "e7962cf6-f9da-4b90-ab53-9bb0e3802b64"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:04:01.350180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] validate_networks() for [('e7962cf6-f9da-4b90-ab53-9bb0e3802b64', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:04:01.802788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:04:01.803301 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:04:01.803824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:04:01.804253 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:04:01.804682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:04:01.813431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:01.814441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:01.814896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:01.815690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:01.816162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:01.816606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:01.836454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Getting quotas for project dac589d01bd348dfb8cea3fdd0968792. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:04:01.841858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Getting quotas for user fea7512a34264853b45f04188b32e0a3 and project dac589d01bd348dfb8cea3fdd0968792. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:04:01.854076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:04:01.856430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:04:01.906237 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3fa223b6-2a62-4b64-9e3f-021f8fb0b317 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612736 Oct 12 23:04:01.906888 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3449/7548] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 23:04:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:04:01.917965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b1c3cd76-e714-4530-a078-baee1943d264 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:01.918593 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b1c3cd76-e714-4530-a078-baee1943d264 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:01.976228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b1c3cd76-e714-4530-a078-baee1943d264 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:01.983156 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b1c3cd76-e714-4530-a078-baee1943d264 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987" status: 200 len: 1262 microversion: 2.1 time: 0.069029 Oct 12 23:04:01.983777 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4100/7549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:01 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987 => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:03.007204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-57f4a849-0751-4755-827f-1d1158797ef3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:03.007892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-57f4a849-0751-4755-827f-1d1158797ef3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:03.016566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57f4a849-0751-4755-827f-1d1158797ef3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:03.017653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57f4a849-0751-4755-827f-1d1158797ef3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:03.018106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57f4a849-0751-4755-827f-1d1158797ef3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:03.018813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57f4a849-0751-4755-827f-1d1158797ef3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:03.019295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57f4a849-0751-4755-827f-1d1158797ef3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:03.019735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57f4a849-0751-4755-827f-1d1158797ef3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:03.087929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-57f4a849-0751-4755-827f-1d1158797ef3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:03.096404 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-57f4a849-0751-4755-827f-1d1158797ef3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987" status: 200 len: 1320 microversion: 2.1 time: 0.093163 Oct 12 23:04:03.096985 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3450/7550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:03 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987 => generated 1320 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:04.120280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d2af04e5-0cc9-485c-b8db-0a5707a97bf6 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:04.120990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d2af04e5-0cc9-485c-b8db-0a5707a97bf6 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:04.128055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2af04e5-0cc9-485c-b8db-0a5707a97bf6 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:04.128544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2af04e5-0cc9-485c-b8db-0a5707a97bf6 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:04.129198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2af04e5-0cc9-485c-b8db-0a5707a97bf6 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:04.129832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2af04e5-0cc9-485c-b8db-0a5707a97bf6 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:04.130383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2af04e5-0cc9-485c-b8db-0a5707a97bf6 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:04.130856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2af04e5-0cc9-485c-b8db-0a5707a97bf6 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:04.185536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-99c2f594-2f47-4016-8f3e-81bf89f5abfa req-00ab3495-3077-4370-812c-8c4f42ccafae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9958ccf3-f61b-4122-99b8-cef6e4f41987", "tag": "45063811-8ad8-490f-b90f-447919b079a9"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:04:04.205660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-99c2f594-2f47-4016-8f3e-81bf89f5abfa req-00ab3495-3077-4370-812c-8c4f42ccafae service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:04.206159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-99c2f594-2f47-4016-8f3e-81bf89f5abfa req-00ab3495-3077-4370-812c-8c4f42ccafae service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:04.209732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-99c2f594-2f47-4016-8f3e-81bf89f5abfa req-00ab3495-3077-4370-812c-8c4f42ccafae service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:04.222528 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-99c2f594-2f47-4016-8f3e-81bf89f5abfa req-00ab3495-3077-4370-812c-8c4f42ccafae service nova] Creating event network-changed:45063811-8ad8-490f-b90f-447919b079a9 for instance 9958ccf3-f61b-4122-99b8-cef6e4f41987 on n-h2-861111-1 Oct 12 23:04:04.228283 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-99c2f594-2f47-4016-8f3e-81bf89f5abfa req-00ab3495-3077-4370-812c-8c4f42ccafae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046237 Oct 12 23:04:04.229026 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3451/7551] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:04.268891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d2af04e5-0cc9-485c-b8db-0a5707a97bf6 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:04.277434 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d2af04e5-0cc9-485c-b8db-0a5707a97bf6 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987" status: 200 len: 1362 microversion: 2.1 time: 0.161307 Oct 12 23:04:04.278496 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4101/7552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:04 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:05.302384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0bd42f1f-a164-47cd-9d37-2640577e986f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:05.303114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0bd42f1f-a164-47cd-9d37-2640577e986f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:05.310182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd42f1f-a164-47cd-9d37-2640577e986f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:05.310691 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd42f1f-a164-47cd-9d37-2640577e986f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:05.311145 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd42f1f-a164-47cd-9d37-2640577e986f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:05.311891 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd42f1f-a164-47cd-9d37-2640577e986f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:05.312365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd42f1f-a164-47cd-9d37-2640577e986f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:05.312812 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd42f1f-a164-47cd-9d37-2640577e986f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:05.445147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0bd42f1f-a164-47cd-9d37-2640577e986f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:05.452759 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0bd42f1f-a164-47cd-9d37-2640577e986f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987" status: 200 len: 1362 microversion: 2.1 time: 0.155271 Oct 12 23:04:05.453326 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3452/7553] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:05 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:06.477074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ba153c34-9b18-46d4-99b2-5e589a7ea4e0 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:06.477698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ba153c34-9b18-46d4-99b2-5e589a7ea4e0 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:06.484551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba153c34-9b18-46d4-99b2-5e589a7ea4e0 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:06.485039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba153c34-9b18-46d4-99b2-5e589a7ea4e0 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:06.485532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba153c34-9b18-46d4-99b2-5e589a7ea4e0 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:06.486228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba153c34-9b18-46d4-99b2-5e589a7ea4e0 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:06.486686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba153c34-9b18-46d4-99b2-5e589a7ea4e0 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:06.487113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba153c34-9b18-46d4-99b2-5e589a7ea4e0 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:06.621436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ba153c34-9b18-46d4-99b2-5e589a7ea4e0 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:06.629392 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ba153c34-9b18-46d4-99b2-5e589a7ea4e0 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987" status: 200 len: 1362 microversion: 2.1 time: 0.156221 Oct 12 23:04:06.629988 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4102/7554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:06 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:07.653003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-80e30d4f-a551-4fda-9f00-42307182c8ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:07.653646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-80e30d4f-a551-4fda-9f00-42307182c8ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:07.660979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80e30d4f-a551-4fda-9f00-42307182c8ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:07.661468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80e30d4f-a551-4fda-9f00-42307182c8ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:07.661915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80e30d4f-a551-4fda-9f00-42307182c8ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:07.662614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80e30d4f-a551-4fda-9f00-42307182c8ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:07.663082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80e30d4f-a551-4fda-9f00-42307182c8ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:07.663541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80e30d4f-a551-4fda-9f00-42307182c8ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:07.793452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-80e30d4f-a551-4fda-9f00-42307182c8ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:07.801848 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-80e30d4f-a551-4fda-9f00-42307182c8ce tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987" status: 200 len: 1362 microversion: 2.1 time: 0.152738 Oct 12 23:04:07.802429 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3453/7555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:07 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:08.824848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1f4aaa40-7c16-4d25-b8c7-26f3611b6cf9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:08.825555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1f4aaa40-7c16-4d25-b8c7-26f3611b6cf9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:08.832320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f4aaa40-7c16-4d25-b8c7-26f3611b6cf9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:08.832808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f4aaa40-7c16-4d25-b8c7-26f3611b6cf9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:08.833360 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f4aaa40-7c16-4d25-b8c7-26f3611b6cf9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:08.834118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f4aaa40-7c16-4d25-b8c7-26f3611b6cf9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:08.834572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f4aaa40-7c16-4d25-b8c7-26f3611b6cf9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:08.834997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f4aaa40-7c16-4d25-b8c7-26f3611b6cf9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:08.965680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1f4aaa40-7c16-4d25-b8c7-26f3611b6cf9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:08.973402 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1f4aaa40-7c16-4d25-b8c7-26f3611b6cf9 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987" status: 200 len: 1362 microversion: 2.1 time: 0.152479 Oct 12 23:04:08.973968 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4103/7556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:08 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:09.997064 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-21380e67-b04d-4aaa-929a-799e54423ae3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:09.997699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-21380e67-b04d-4aaa-929a-799e54423ae3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:10.004515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21380e67-b04d-4aaa-929a-799e54423ae3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:10.005012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21380e67-b04d-4aaa-929a-799e54423ae3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:10.005464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21380e67-b04d-4aaa-929a-799e54423ae3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:10.006174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21380e67-b04d-4aaa-929a-799e54423ae3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:10.006640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21380e67-b04d-4aaa-929a-799e54423ae3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:10.007081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21380e67-b04d-4aaa-929a-799e54423ae3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:10.138881 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-21380e67-b04d-4aaa-929a-799e54423ae3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:10.147058 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-21380e67-b04d-4aaa-929a-799e54423ae3 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987" status: 200 len: 1362 microversion: 2.1 time: 0.154224 Oct 12 23:04:10.147665 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3454/7557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:09 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:10.517519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-c3c05ba1-ff24-4848-ae42-cecfbd2153bf req-a342c232-e410-4f3a-b1d4-cce64e247ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9958ccf3-f61b-4122-99b8-cef6e4f41987", "name": "network-vif-plugged", "status": "completed", "tag": "45063811-8ad8-490f-b90f-447919b079a9"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:04:10.528066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c3c05ba1-ff24-4848-ae42-cecfbd2153bf req-a342c232-e410-4f3a-b1d4-cce64e247ab9 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:10.528167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c3c05ba1-ff24-4848-ae42-cecfbd2153bf req-a342c232-e410-4f3a-b1d4-cce64e247ab9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:10.528599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c3c05ba1-ff24-4848-ae42-cecfbd2153bf req-a342c232-e410-4f3a-b1d4-cce64e247ab9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:10.539745 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-c3c05ba1-ff24-4848-ae42-cecfbd2153bf req-a342c232-e410-4f3a-b1d4-cce64e247ab9 service nova] Creating event network-vif-plugged:45063811-8ad8-490f-b90f-447919b079a9 for instance 9958ccf3-f61b-4122-99b8-cef6e4f41987 on n-h2-861111-1 Oct 12 23:04:10.544764 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-c3c05ba1-ff24-4848-ae42-cecfbd2153bf req-a342c232-e410-4f3a-b1d4-cce64e247ab9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088141 Oct 12 23:04:10.545353 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4104/7558] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:11.170593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-67bb1eba-65a3-45af-833b-528ba84f1c05 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:11.171230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-67bb1eba-65a3-45af-833b-528ba84f1c05 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:11.178558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67bb1eba-65a3-45af-833b-528ba84f1c05 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:11.179057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67bb1eba-65a3-45af-833b-528ba84f1c05 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:11.179550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67bb1eba-65a3-45af-833b-528ba84f1c05 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:11.180286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67bb1eba-65a3-45af-833b-528ba84f1c05 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:11.180758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67bb1eba-65a3-45af-833b-528ba84f1c05 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:11.181203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-67bb1eba-65a3-45af-833b-528ba84f1c05 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:11.306710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-67bb1eba-65a3-45af-833b-528ba84f1c05 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:11.314326 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-67bb1eba-65a3-45af-833b-528ba84f1c05 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987" status: 200 len: 1362 microversion: 2.1 time: 0.147616 Oct 12 23:04:11.314903 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3455/7559] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:11 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:12.335667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:12.340132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3fbd5ff1-d420-43c5-8820-aab53771db9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:12.340835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3fbd5ff1-d420-43c5-8820-aab53771db9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:12.347196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fbd5ff1-d420-43c5-8820-aab53771db9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:12.347708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fbd5ff1-d420-43c5-8820-aab53771db9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:12.348142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fbd5ff1-d420-43c5-8820-aab53771db9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:12.348832 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fbd5ff1-d420-43c5-8820-aab53771db9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:12.349281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fbd5ff1-d420-43c5-8820-aab53771db9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:12.349702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3fbd5ff1-d420-43c5-8820-aab53771db9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:12.476830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3fbd5ff1-d420-43c5-8820-aab53771db9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:12.484560 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3fbd5ff1-d420-43c5-8820-aab53771db9c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987" status: 200 len: 1555 microversion: 2.1 time: 0.150731 Oct 12 23:04:12.485617 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4105/7560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:12 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:12.507872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-13f718cd-0840-4f9c-a7d4-d84cbbd169e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:12.508539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-13f718cd-0840-4f9c-a7d4-d84cbbd169e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:12.510592 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:12.511468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:12.518089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13f718cd-0840-4f9c-a7d4-d84cbbd169e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:12.518596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13f718cd-0840-4f9c-a7d4-d84cbbd169e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:12.519054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13f718cd-0840-4f9c-a7d4-d84cbbd169e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:12.519918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13f718cd-0840-4f9c-a7d4-d84cbbd169e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:12.520556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13f718cd-0840-4f9c-a7d4-d84cbbd169e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:12.520923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13f718cd-0840-4f9c-a7d4-d84cbbd169e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:12.652851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-13f718cd-0840-4f9c-a7d4-d84cbbd169e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:12.660622 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-13f718cd-0840-4f9c-a7d4-d84cbbd169e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987" status: 200 len: 1555 microversion: 2.1 time: 0.156606 Oct 12 23:04:12.661189 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3456/7561] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:12 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:14.150919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c0c23fe9-ba1c-4712-baf1-e6223c7692ff tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb77d048-2df5-45f9-8ccd-cf8f97ce02d1"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:04:14.153382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c0c23fe9-ba1c-4712-baf1-e6223c7692ff tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:14.160124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0c23fe9-ba1c-4712-baf1-e6223c7692ff tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:14.160606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0c23fe9-ba1c-4712-baf1-e6223c7692ff tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:14.161038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0c23fe9-ba1c-4712-baf1-e6223c7692ff tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:14.161729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0c23fe9-ba1c-4712-baf1-e6223c7692ff tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:14.162177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0c23fe9-ba1c-4712-baf1-e6223c7692ff tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:14.162602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c0c23fe9-ba1c-4712-baf1-e6223c7692ff tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:14.395268 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c0c23fe9-ba1c-4712-baf1-e6223c7692ff tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "POST /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247557 Oct 12 23:04:14.395913 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4106/7562] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 23:04:14 2022] POST /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:25.104227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-41ae624f-287a-4f0b-8460-87c4ee084286 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:25.104737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-41ae624f-287a-4f0b-8460-87c4ee084286 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:25.106986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:25.107888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:25.115975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41ae624f-287a-4f0b-8460-87c4ee084286 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:25.116476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41ae624f-287a-4f0b-8460-87c4ee084286 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:25.116927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41ae624f-287a-4f0b-8460-87c4ee084286 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:25.117629 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41ae624f-287a-4f0b-8460-87c4ee084286 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:25.118348 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41ae624f-287a-4f0b-8460-87c4ee084286 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:25.118780 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41ae624f-287a-4f0b-8460-87c4ee084286 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:25.200829 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-41ae624f-287a-4f0b-8460-87c4ee084286 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lazy-loading 'services' on Instance uuid 9958ccf3-f61b-4122-99b8-cef6e4f41987 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:04:25.271006 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-41ae624f-287a-4f0b-8460-87c4ee084286 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments/cb77d048-2df5-45f9-8ccd-cf8f97ce02d1" status: 202 len: 0 microversion: 2.1 time: 0.170559 Oct 12 23:04:25.271644 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3457/7563] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 23:04:25 2022] DELETE /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments/cb77d048-2df5-45f9-8ccd-cf8f97ce02d1 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:04:25.280466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b00d8fa0-9a69-4f40-ae99-61a70b3e0c87 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:25.283589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b00d8fa0-9a69-4f40-ae99-61a70b3e0c87 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:25.286913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:25.287689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:25.295145 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b00d8fa0-9a69-4f40-ae99-61a70b3e0c87 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:25.295677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b00d8fa0-9a69-4f40-ae99-61a70b3e0c87 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:25.296119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b00d8fa0-9a69-4f40-ae99-61a70b3e0c87 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:25.296834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b00d8fa0-9a69-4f40-ae99-61a70b3e0c87 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:25.297294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b00d8fa0-9a69-4f40-ae99-61a70b3e0c87 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:25.297730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b00d8fa0-9a69-4f40-ae99-61a70b3e0c87 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:25.330017 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b00d8fa0-9a69-4f40-ae99-61a70b3e0c87 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053917 Oct 12 23:04:25.330589 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4107/7564] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:04:25 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:26.343789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ad536ca3-9e7a-48ed-bb21-26ec03f92e59 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:26.346303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ad536ca3-9e7a-48ed-bb21-26ec03f92e59 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:26.352682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad536ca3-9e7a-48ed-bb21-26ec03f92e59 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:26.353280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad536ca3-9e7a-48ed-bb21-26ec03f92e59 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:26.353804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad536ca3-9e7a-48ed-bb21-26ec03f92e59 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:26.354529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad536ca3-9e7a-48ed-bb21-26ec03f92e59 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:26.355000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad536ca3-9e7a-48ed-bb21-26ec03f92e59 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:26.355470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad536ca3-9e7a-48ed-bb21-26ec03f92e59 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:26.385951 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ad536ca3-9e7a-48ed-bb21-26ec03f92e59 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047475 Oct 12 23:04:26.386513 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3458/7565] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:04:26 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:27.398182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-09ca2c95-40bc-4ad9-91bb-8510df48f96c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:27.400457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-09ca2c95-40bc-4ad9-91bb-8510df48f96c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:27.407544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09ca2c95-40bc-4ad9-91bb-8510df48f96c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:27.408090 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09ca2c95-40bc-4ad9-91bb-8510df48f96c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:27.408539 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09ca2c95-40bc-4ad9-91bb-8510df48f96c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:27.409252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09ca2c95-40bc-4ad9-91bb-8510df48f96c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:27.409719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09ca2c95-40bc-4ad9-91bb-8510df48f96c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:27.410156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09ca2c95-40bc-4ad9-91bb-8510df48f96c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:27.443966 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-09ca2c95-40bc-4ad9-91bb-8510df48f96c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049788 Oct 12 23:04:27.444562 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4108/7566] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:04:27 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:28.457122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ca68e023-6fed-4e87-a7ac-4fa01f16b2e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:28.459333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ca68e023-6fed-4e87-a7ac-4fa01f16b2e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:28.466240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca68e023-6fed-4e87-a7ac-4fa01f16b2e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:28.466747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca68e023-6fed-4e87-a7ac-4fa01f16b2e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:28.467210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca68e023-6fed-4e87-a7ac-4fa01f16b2e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:28.467953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca68e023-6fed-4e87-a7ac-4fa01f16b2e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:28.468431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca68e023-6fed-4e87-a7ac-4fa01f16b2e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:28.468888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca68e023-6fed-4e87-a7ac-4fa01f16b2e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:28.502309 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ca68e023-6fed-4e87-a7ac-4fa01f16b2e2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049828 Oct 12 23:04:28.502878 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3459/7567] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:04:28 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:29.514303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-17464875-3a5a-4954-9753-67616ab6baf1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:29.516630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-17464875-3a5a-4954-9753-67616ab6baf1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:29.523745 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17464875-3a5a-4954-9753-67616ab6baf1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:29.524238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17464875-3a5a-4954-9753-67616ab6baf1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:29.524677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17464875-3a5a-4954-9753-67616ab6baf1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:29.525380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17464875-3a5a-4954-9753-67616ab6baf1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:29.525842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17464875-3a5a-4954-9753-67616ab6baf1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:29.526277 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17464875-3a5a-4954-9753-67616ab6baf1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:29.557859 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-17464875-3a5a-4954-9753-67616ab6baf1 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047655 Oct 12 23:04:29.558430 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4109/7568] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:04:29 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:30.570209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cc753fa9-148d-415c-9cfd-134229aa34a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:30.572385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cc753fa9-148d-415c-9cfd-134229aa34a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:30.579111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc753fa9-148d-415c-9cfd-134229aa34a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:30.580156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc753fa9-148d-415c-9cfd-134229aa34a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:30.580628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc753fa9-148d-415c-9cfd-134229aa34a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:30.581326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc753fa9-148d-415c-9cfd-134229aa34a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:30.581788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc753fa9-148d-415c-9cfd-134229aa34a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:30.582225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc753fa9-148d-415c-9cfd-134229aa34a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:30.612190 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cc753fa9-148d-415c-9cfd-134229aa34a7 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046045 Oct 12 23:04:30.612747 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3460/7569] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:04:30 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:04:30.623748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-26be3fee-1dfb-426e-8242-a60a278b488f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:30.624233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-26be3fee-1dfb-426e-8242-a60a278b488f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:30.630974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26be3fee-1dfb-426e-8242-a60a278b488f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:30.631506 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26be3fee-1dfb-426e-8242-a60a278b488f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:30.631952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26be3fee-1dfb-426e-8242-a60a278b488f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:30.632646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26be3fee-1dfb-426e-8242-a60a278b488f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:30.633103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26be3fee-1dfb-426e-8242-a60a278b488f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:30.633563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-26be3fee-1dfb-426e-8242-a60a278b488f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:30.709364 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-26be3fee-1dfb-426e-8242-a60a278b488f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] HTTP exception thrown: Instance 9958ccf3-f61b-4122-99b8-cef6e4f41987 is not attached to volume cb77d048-2df5-45f9-8ccd-cf8f97ce02d1 Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-26be3fee-1dfb-426e-8242-a60a278b488f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Request method failure captured: Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments/cb77d048-2df5-45f9-8ccd-cf8f97ce02d1 HTTP/1.1 Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0ePONCZpsIcyWsaEmALIXAIrJVxSiNEVVuC0T-hclLcZuvU7sOeaYt3E7l9tI-JcvWB4WX1qhUC4ktaSDciTklOOdA5yt3tKaiz1ZQLMtS46dwTEQK2OOjr0j00VyFmXzHc_iO3Sk4HC8D5D-iqwECDqPEku89sRiBtUp8JW5EEfW4 Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: dac589d01bd348dfb8cea3fdd0968792 Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dac589d01bd348dfb8cea3fdd0968792", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: dac589d01bd348dfb8cea3fdd0968792 Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestEncryptedCinderVolumes-1774869705-project Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: fea7512a34264853b45f04188b32e0a3 Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestEncryptedCinderVolumes-1774869705-project Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 9958ccf3-f61b-4122-99b8-cef6e4f41987 is not attached to volume cb77d048-2df5-45f9-8ccd-cf8f97ce02d1 Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'server_id': '9958ccf3-f61b-4122-99b8-cef6e4f41987', 'id': 'cb77d048-2df5-45f9-8ccd-cf8f97ce02d1'} Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cb77d048-2df5-45f9-8ccd-cf8f97ce02d1. Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9958ccf3-f61b-4122-99b8-cef6e4f41987 is not attached to volume cb77d048-2df5-45f9-8ccd-cf8f97ce02d1 Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:30.711204 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:30.715577 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:04:30.715577 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:04:30.715577 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9958ccf3-f61b-4122-99b8-cef6e4f41987 is not attached to volume cb77d048-2df5-45f9-8ccd-cf8f97ce02d1 Oct 12 23:04:30.715577 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:04:30.715577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-26be3fee-1dfb-426e-8242-a60a278b488f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Returning 404 to user: Instance 9958ccf3-f61b-4122-99b8-cef6e4f41987 is not attached to volume cb77d048-2df5-45f9-8ccd-cf8f97ce02d1 {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:04:30.715577 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-26be3fee-1dfb-426e-8242-a60a278b488f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments/cb77d048-2df5-45f9-8ccd-cf8f97ce02d1" status: 404 len: 154 microversion: 2.1 time: 0.092947 Oct 12 23:04:30.715577 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4110/7570] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 23:04:30 2022] DELETE /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987/os-volume_attachments/cb77d048-2df5-45f9-8ccd-cf8f97ce02d1 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:04:34.060987 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-04e9e75c-a239-454c-be71-98b24001314f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:34.061500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-04e9e75c-a239-454c-be71-98b24001314f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:34.068467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04e9e75c-a239-454c-be71-98b24001314f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:34.068969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04e9e75c-a239-454c-be71-98b24001314f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:34.069430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04e9e75c-a239-454c-be71-98b24001314f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:34.070160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04e9e75c-a239-454c-be71-98b24001314f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:34.070627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04e9e75c-a239-454c-be71-98b24001314f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:34.071075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04e9e75c-a239-454c-be71-98b24001314f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:34.097893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-04e9e75c-a239-454c-be71-98b24001314f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:04:34.175590 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-04e9e75c-a239-454c-be71-98b24001314f tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987" status: 204 len: 0 microversion: 2.1 time: 0.118195 Oct 12 23:04:34.176789 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3461/7571] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:04:34 2022] DELETE /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 23:04:34.184875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-cd52c3d9-6fd4-42e4-8742-c2c9b61b228d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:34.185498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-cd52c3d9-6fd4-42e4-8742-c2c9b61b228d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:34.193041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd52c3d9-6fd4-42e4-8742-c2c9b61b228d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:34.193536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd52c3d9-6fd4-42e4-8742-c2c9b61b228d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:34.194022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd52c3d9-6fd4-42e4-8742-c2c9b61b228d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:34.194734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd52c3d9-6fd4-42e4-8742-c2c9b61b228d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:34.195225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd52c3d9-6fd4-42e4-8742-c2c9b61b228d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:34.195695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-cd52c3d9-6fd4-42e4-8742-c2c9b61b228d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:34.332494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-cd52c3d9-6fd4-42e4-8742-c2c9b61b228d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:34.340518 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-cd52c3d9-6fd4-42e4-8742-c2c9b61b228d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987" status: 200 len: 1561 microversion: 2.1 time: 0.159574 Oct 12 23:04:34.341177 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4111/7572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:34 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:04:35.364746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d6c0315e-de4d-489b-a002-7316a41cfde2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:35.365514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d6c0315e-de4d-489b-a002-7316a41cfde2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:35.372669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6c0315e-de4d-489b-a002-7316a41cfde2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:35.373166 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6c0315e-de4d-489b-a002-7316a41cfde2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:35.373618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6c0315e-de4d-489b-a002-7316a41cfde2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:35.374318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6c0315e-de4d-489b-a002-7316a41cfde2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:35.374785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6c0315e-de4d-489b-a002-7316a41cfde2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:35.375225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6c0315e-de4d-489b-a002-7316a41cfde2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:35.502383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d6c0315e-de4d-489b-a002-7316a41cfde2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:35.510179 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d6c0315e-de4d-489b-a002-7316a41cfde2 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987" status: 200 len: 1561 microversion: 2.1 time: 0.149758 Oct 12 23:04:35.510743 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3462/7573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:35 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:36.247544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-6be345f5-b033-4b6b-b0bf-0a99f6821441 req-aa339d80-ad4d-456e-8ab3-1786659c1795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9958ccf3-f61b-4122-99b8-cef6e4f41987", "name": "network-vif-deleted", "tag": "45063811-8ad8-490f-b90f-447919b079a9"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:04:36.262064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6be345f5-b033-4b6b-b0bf-0a99f6821441 req-aa339d80-ad4d-456e-8ab3-1786659c1795 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:36.262635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6be345f5-b033-4b6b-b0bf-0a99f6821441 req-aa339d80-ad4d-456e-8ab3-1786659c1795 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:36.263180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6be345f5-b033-4b6b-b0bf-0a99f6821441 req-aa339d80-ad4d-456e-8ab3-1786659c1795 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:36.277735 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6be345f5-b033-4b6b-b0bf-0a99f6821441 req-aa339d80-ad4d-456e-8ab3-1786659c1795 service nova] Creating event network-vif-deleted:45063811-8ad8-490f-b90f-447919b079a9 for instance 9958ccf3-f61b-4122-99b8-cef6e4f41987 on n-h2-861111-1 Oct 12 23:04:36.284174 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-6be345f5-b033-4b6b-b0bf-0a99f6821441 req-aa339d80-ad4d-456e-8ab3-1786659c1795 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040897 Oct 12 23:04:36.284788 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4112/7574] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:36.534641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c5f416b2-e383-4eb5-a6b7-f2169453ef2d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:36.535319 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c5f416b2-e383-4eb5-a6b7-f2169453ef2d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:36.542089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5f416b2-e383-4eb5-a6b7-f2169453ef2d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:36.542584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5f416b2-e383-4eb5-a6b7-f2169453ef2d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:36.543057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5f416b2-e383-4eb5-a6b7-f2169453ef2d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:36.543788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5f416b2-e383-4eb5-a6b7-f2169453ef2d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:36.544258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5f416b2-e383-4eb5-a6b7-f2169453ef2d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:36.544695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5f416b2-e383-4eb5-a6b7-f2169453ef2d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:36.574196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5f416b2-e383-4eb5-a6b7-f2169453ef2d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:36.574686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5f416b2-e383-4eb5-a6b7-f2169453ef2d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:36.575133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5f416b2-e383-4eb5-a6b7-f2169453ef2d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:36.575615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-c5f416b2-e383-4eb5-a6b7-f2169453ef2d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lazy-loading 'fault' on Instance uuid 9958ccf3-f61b-4122-99b8-cef6e4f41987 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:04:36.617490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c5f416b2-e383-4eb5-a6b7-f2169453ef2d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7512a34264853b45f04188b32e0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac589d01bd348dfb8cea3fdd0968792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:36.625745 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c5f416b2-e383-4eb5-a6b7-f2169453ef2d tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987" status: 200 len: 1352 microversion: 2.1 time: 0.095672 Oct 12 23:04:36.626347 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3463/7575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:36 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:37.649937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-161c0d6e-8cf0-4f16-ad1c-3f83c2292b1c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:37.650669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-161c0d6e-8cf0-4f16-ad1c-3f83c2292b1c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] [instance: 9958ccf3-f61b-4122-99b8-cef6e4f41987] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:37.657687 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-161c0d6e-8cf0-4f16-ad1c-3f83c2292b1c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:37.658167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-161c0d6e-8cf0-4f16-ad1c-3f83c2292b1c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:37.658602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-161c0d6e-8cf0-4f16-ad1c-3f83c2292b1c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:37.659307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-161c0d6e-8cf0-4f16-ad1c-3f83c2292b1c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:37.659760 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-161c0d6e-8cf0-4f16-ad1c-3f83c2292b1c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:37.660183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-161c0d6e-8cf0-4f16-ad1c-3f83c2292b1c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:37.673239 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-161c0d6e-8cf0-4f16-ad1c-3f83c2292b1c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] HTTP exception thrown: Instance 9958ccf3-f61b-4122-99b8-cef6e4f41987 could not be found. Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-161c0d6e-8cf0-4f16-ad1c-3f83c2292b1c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Request method failure captured: Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987 HTTP/1.1 Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0ePONCZpsIcyWsaEmALIXAIrJVxSiNEVVuC0T-hclLcZuvU7sOeaYt3E7l9tI-JcvWB4WX1qhUC4ktaSDciTklOOdA5yt3tKaiz1ZQLMtS46dwTEQK2OOjr0j00VyFmXzHc_iO3Sk4HC8D5D-iqwECDqPEku89sRiBtUp8JW5EEfW4 Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: dac589d01bd348dfb8cea3fdd0968792 Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dac589d01bd348dfb8cea3fdd0968792", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dac589d01bd348dfb8cea3fdd0968792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: dac589d01bd348dfb8cea3fdd0968792 Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1774869705 Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestEncryptedCinderVolumes-1774869705-project Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: fea7512a34264853b45f04188b32e0a3 Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestEncryptedCinderVolumes-1774869705-project Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 9958ccf3-f61b-4122-99b8-cef6e4f41987 could not be found. Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '9958ccf3-f61b-4122-99b8-cef6e4f41987'} Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9958ccf3-f61b-4122-99b8-cef6e4f41987 could not be found. Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9958ccf3-f61b-4122-99b8-cef6e4f41987 could not be found. Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:04:37.674856 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:37.679795 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:04:37.679795 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:37.679795 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:37.679795 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:37.679795 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:04:37.679795 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:04:37.679795 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9958ccf3-f61b-4122-99b8-cef6e4f41987 could not be found. Oct 12 23:04:37.679795 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:04:37.679795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-161c0d6e-8cf0-4f16-ad1c-3f83c2292b1c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Returning 404 to user: Instance 9958ccf3-f61b-4122-99b8-cef6e4f41987 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:04:37.679795 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-161c0d6e-8cf0-4f16-ad1c-3f83c2292b1c tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987" status: 404 len: 111 microversion: 2.1 time: 0.030597 Oct 12 23:04:37.679795 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4113/7576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:37 2022] GET /compute/v2.1/servers/9958ccf3-f61b-4122-99b8-cef6e4f41987 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:04:37.685171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-480548c4-ac70-4a41-98b8-d58dd7441b16 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] Calling method '.version_select at 0x7f512391cdc0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:37.706949 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-480548c4-ac70-4a41-98b8-d58dd7441b16 tempest-TestEncryptedCinderVolumes-1774869705 tempest-TestEncryptedCinderVolumes-1774869705-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1871150658" status: 202 len: 0 microversion: 2.1 time: 0.025612 Oct 12 23:04:37.707570 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3464/7577] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 12 23:04:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1871150658 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:05:04.948688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a36520ac-877a-4b2b-90e2-9e7a1a05014d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Action: 'create', calling method: .version_select at 0x7f5123511160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-542907669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSmS8PnkdTfFnPWJsSBAiSh75YP+Ec9rhFLW6s7m1J9+/N0H0AsgCRHm/1/WcwtnRRjHrs19ZtHW24yop1qXhDQyqi5GXZGRp683tSjzCOYJp3TmT+ag1JgDobmTWNSVA=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:04.954833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=14 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:04.955512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=34 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:04.971105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-a36520ac-877a-4b2b-90e2-9e7a1a05014d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Getting quotas for project cea0d2fdebb74c388a4eae1183dc4763. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:05:04.973250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-a36520ac-877a-4b2b-90e2-9e7a1a05014d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Getting quotas for user b204f4c9508e4a30aab167cca736ed3e and project cea0d2fdebb74c388a4eae1183dc4763. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:05:04.998856 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a36520ac-877a-4b2b-90e2-9e7a1a05014d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055103 Oct 12 23:05:04.999497 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4114/7578] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 23:05:04 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:05.052535 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:05.053294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:05.057421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-250771574", "imageRef": "7f4f4328-aa51-46c7-8f94-d66fe57bd8a3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-542907669", "networks": [{"uuid": "bca7fdc1-e003-4bad-960c-c23737065714"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:05.111743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] validate_networks() for [('bca7fdc1-e003-4bad-960c-c23737065714', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:05:05.496664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:05:05.497103 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:05:05.497589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:05:05.498011 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:05:05.498462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:05:05.508157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:05.508642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:05.509096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:05.509833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:05.510299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:05.510737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:05.529143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Getting quotas for project cea0d2fdebb74c388a4eae1183dc4763. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:05:05.534968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Getting quotas for user b204f4c9508e4a30aab167cca736ed3e and project cea0d2fdebb74c388a4eae1183dc4763. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:05:05.547093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:05:05.550017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7f4f4328-aa51-46c7-8f94-d66fe57bd8a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:05:05.596635 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0d52f16c-8c23-4208-a5f5-074f8de1d33d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546126 Oct 12 23:05:05.597773 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3465/7579] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 23:05:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:05:05.608623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c171c0ed-5a45-43f6-aa89-954a0dfab397 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:05.609401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c171c0ed-5a45-43f6-aa89-954a0dfab397 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:05.668949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c171c0ed-5a45-43f6-aa89-954a0dfab397 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:05.676366 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c171c0ed-5a45-43f6-aa89-954a0dfab397 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1257 microversion: 2.1 time: 0.071690 Oct 12 23:05:05.677185 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4115/7580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:05 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:06.699940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ed768667-4506-4bf7-936d-a4cc4996b942 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:06.700701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ed768667-4506-4bf7-936d-a4cc4996b942 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:06.711581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed768667-4506-4bf7-936d-a4cc4996b942 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:06.712188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed768667-4506-4bf7-936d-a4cc4996b942 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:06.712651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed768667-4506-4bf7-936d-a4cc4996b942 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:06.713384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed768667-4506-4bf7-936d-a4cc4996b942 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:06.713855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed768667-4506-4bf7-936d-a4cc4996b942 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:06.714299 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed768667-4506-4bf7-936d-a4cc4996b942 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:06.811683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ed768667-4506-4bf7-936d-a4cc4996b942 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:06.820824 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ed768667-4506-4bf7-936d-a4cc4996b942 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1327 microversion: 2.1 time: 0.125002 Oct 12 23:05:06.822163 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3466/7581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:06 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1327 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:07.844211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ddeba8dc-f8bb-45d9-a342-02d62e8d88e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:07.844762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ddeba8dc-f8bb-45d9-a342-02d62e8d88e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:07.851708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddeba8dc-f8bb-45d9-a342-02d62e8d88e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:07.852201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddeba8dc-f8bb-45d9-a342-02d62e8d88e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:07.852652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddeba8dc-f8bb-45d9-a342-02d62e8d88e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:07.853349 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddeba8dc-f8bb-45d9-a342-02d62e8d88e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:07.853807 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddeba8dc-f8bb-45d9-a342-02d62e8d88e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:07.854235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ddeba8dc-f8bb-45d9-a342-02d62e8d88e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:07.991946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ddeba8dc-f8bb-45d9-a342-02d62e8d88e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:08.001767 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ddeba8dc-f8bb-45d9-a342-02d62e8d88e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1357 microversion: 2.1 time: 0.161422 Oct 12 23:05:08.011938 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4116/7582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:07 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:09.027444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a475ddf-5632-4d18-8321-94220ff021b8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:09.028708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7a475ddf-5632-4d18-8321-94220ff021b8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:09.036800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a475ddf-5632-4d18-8321-94220ff021b8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:09.037566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a475ddf-5632-4d18-8321-94220ff021b8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:09.038188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a475ddf-5632-4d18-8321-94220ff021b8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:09.039083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a475ddf-5632-4d18-8321-94220ff021b8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:09.039737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a475ddf-5632-4d18-8321-94220ff021b8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:09.040344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a475ddf-5632-4d18-8321-94220ff021b8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:09.177483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a475ddf-5632-4d18-8321-94220ff021b8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:09.185328 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7a475ddf-5632-4d18-8321-94220ff021b8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1357 microversion: 2.1 time: 0.161793 Oct 12 23:05:09.185907 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3467/7583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:09 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:10.210130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e080902f-03d3-4476-85fb-efb4bc122d3a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:10.210773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e080902f-03d3-4476-85fb-efb4bc122d3a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:10.218313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e080902f-03d3-4476-85fb-efb4bc122d3a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:10.218806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e080902f-03d3-4476-85fb-efb4bc122d3a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:10.219270 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e080902f-03d3-4476-85fb-efb4bc122d3a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:10.219995 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e080902f-03d3-4476-85fb-efb4bc122d3a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:10.220452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e080902f-03d3-4476-85fb-efb4bc122d3a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:10.221511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e080902f-03d3-4476-85fb-efb4bc122d3a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:10.378972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e080902f-03d3-4476-85fb-efb4bc122d3a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:10.388060 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e080902f-03d3-4476-85fb-efb4bc122d3a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1357 microversion: 2.1 time: 0.181835 Oct 12 23:05:10.388661 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4117/7584] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:10 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:11.411312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c559a6df-fcf7-451f-ac32-c251643c663d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:11.411943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c559a6df-fcf7-451f-ac32-c251643c663d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:11.420031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c559a6df-fcf7-451f-ac32-c251643c663d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:11.420503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c559a6df-fcf7-451f-ac32-c251643c663d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:11.420978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c559a6df-fcf7-451f-ac32-c251643c663d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:11.421698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c559a6df-fcf7-451f-ac32-c251643c663d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:11.422200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c559a6df-fcf7-451f-ac32-c251643c663d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:11.422686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c559a6df-fcf7-451f-ac32-c251643c663d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:11.565938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c559a6df-fcf7-451f-ac32-c251643c663d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:11.574060 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c559a6df-fcf7-451f-ac32-c251643c663d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1357 microversion: 2.1 time: 0.166848 Oct 12 23:05:11.574660 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3468/7585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:11 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:12.600073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-965247f1-7e90-458d-bbe7-01742b13ee20 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:12.600705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-965247f1-7e90-458d-bbe7-01742b13ee20 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:12.607752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-965247f1-7e90-458d-bbe7-01742b13ee20 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:12.608239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-965247f1-7e90-458d-bbe7-01742b13ee20 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:12.608682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-965247f1-7e90-458d-bbe7-01742b13ee20 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:12.609379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-965247f1-7e90-458d-bbe7-01742b13ee20 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:12.609838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-965247f1-7e90-458d-bbe7-01742b13ee20 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:12.610268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-965247f1-7e90-458d-bbe7-01742b13ee20 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:12.748895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-965247f1-7e90-458d-bbe7-01742b13ee20 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:12.769544 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-965247f1-7e90-458d-bbe7-01742b13ee20 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1357 microversion: 2.1 time: 0.173236 Oct 12 23:05:12.770962 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4118/7586] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:12 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:13.794056 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-321f557f-025b-4776-8cfe-54b61477eedf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:13.794832 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-321f557f-025b-4776-8cfe-54b61477eedf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:13.801591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-321f557f-025b-4776-8cfe-54b61477eedf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:13.802089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-321f557f-025b-4776-8cfe-54b61477eedf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:13.802543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-321f557f-025b-4776-8cfe-54b61477eedf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:13.803293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-321f557f-025b-4776-8cfe-54b61477eedf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:13.803753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-321f557f-025b-4776-8cfe-54b61477eedf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:13.804210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-321f557f-025b-4776-8cfe-54b61477eedf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:13.947680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-321f557f-025b-4776-8cfe-54b61477eedf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:13.956186 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-321f557f-025b-4776-8cfe-54b61477eedf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1357 microversion: 2.1 time: 0.165962 Oct 12 23:05:13.956770 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3469/7587] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:13 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:14.978928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b7522448-25ac-47ca-a2ce-9ad9029876c2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:14.979560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b7522448-25ac-47ca-a2ce-9ad9029876c2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:14.986702 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7522448-25ac-47ca-a2ce-9ad9029876c2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:14.987184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7522448-25ac-47ca-a2ce-9ad9029876c2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:14.987649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7522448-25ac-47ca-a2ce-9ad9029876c2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:14.988343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7522448-25ac-47ca-a2ce-9ad9029876c2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:14.988794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7522448-25ac-47ca-a2ce-9ad9029876c2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:14.989223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b7522448-25ac-47ca-a2ce-9ad9029876c2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:15.117956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b7522448-25ac-47ca-a2ce-9ad9029876c2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:15.125819 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b7522448-25ac-47ca-a2ce-9ad9029876c2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1357 microversion: 2.1 time: 0.150889 Oct 12 23:05:15.126389 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4119/7588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:14 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:16.149746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9bb66a9c-9f44-4c17-899f-4d2df1d323c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:16.150373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9bb66a9c-9f44-4c17-899f-4d2df1d323c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:16.152701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:16.153510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:16.159429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bb66a9c-9f44-4c17-899f-4d2df1d323c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:16.159923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bb66a9c-9f44-4c17-899f-4d2df1d323c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:16.160375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bb66a9c-9f44-4c17-899f-4d2df1d323c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:16.161074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bb66a9c-9f44-4c17-899f-4d2df1d323c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:16.161536 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bb66a9c-9f44-4c17-899f-4d2df1d323c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:16.161971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9bb66a9c-9f44-4c17-899f-4d2df1d323c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:16.291415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9bb66a9c-9f44-4c17-899f-4d2df1d323c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:16.299029 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9bb66a9c-9f44-4c17-899f-4d2df1d323c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1357 microversion: 2.1 time: 0.153388 Oct 12 23:05:16.299626 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3470/7589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:16 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:17.318941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:17.325484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-00bf945e-0669-4165-990c-2d1f01fdb830 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:17.326106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-00bf945e-0669-4165-990c-2d1f01fdb830 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:17.333810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00bf945e-0669-4165-990c-2d1f01fdb830 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:17.335138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00bf945e-0669-4165-990c-2d1f01fdb830 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:17.335138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00bf945e-0669-4165-990c-2d1f01fdb830 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:17.337071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00bf945e-0669-4165-990c-2d1f01fdb830 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:17.337071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00bf945e-0669-4165-990c-2d1f01fdb830 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:17.337071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-00bf945e-0669-4165-990c-2d1f01fdb830 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:17.465720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-00bf945e-0669-4165-990c-2d1f01fdb830 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:17.473958 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-00bf945e-0669-4165-990c-2d1f01fdb830 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1357 microversion: 2.1 time: 0.156069 Oct 12 23:05:17.474530 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4120/7590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:17 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:05:18.334288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-cc1ec80e-fd5c-4f1b-86cb-3c0d85a1fd6e req-a2048871-be14-4dbe-abbe-11e2db2dae45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74588b5e-30c4-491e-92df-9caa4896ff58", "tag": "07d647c6-1ea5-450e-9c10-274e600c3b25"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:18.346290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-cc1ec80e-fd5c-4f1b-86cb-3c0d85a1fd6e req-a2048871-be14-4dbe-abbe-11e2db2dae45 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:18.346877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-cc1ec80e-fd5c-4f1b-86cb-3c0d85a1fd6e req-a2048871-be14-4dbe-abbe-11e2db2dae45 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:18.347611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-cc1ec80e-fd5c-4f1b-86cb-3c0d85a1fd6e req-a2048871-be14-4dbe-abbe-11e2db2dae45 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:18.359063 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-cc1ec80e-fd5c-4f1b-86cb-3c0d85a1fd6e req-a2048871-be14-4dbe-abbe-11e2db2dae45 service nova] Creating event network-changed:07d647c6-1ea5-450e-9c10-274e600c3b25 for instance 74588b5e-30c4-491e-92df-9caa4896ff58 on n-h2-861111-1 Oct 12 23:05:18.365394 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-cc1ec80e-fd5c-4f1b-86cb-3c0d85a1fd6e req-a2048871-be14-4dbe-abbe-11e2db2dae45 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035082 Oct 12 23:05:18.366324 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3471/7591] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:18.496964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d4488223-ff3b-41f1-ba9f-bd54cbad21bf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:18.497638 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d4488223-ff3b-41f1-ba9f-bd54cbad21bf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:18.504532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4488223-ff3b-41f1-ba9f-bd54cbad21bf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:18.505042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4488223-ff3b-41f1-ba9f-bd54cbad21bf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:18.505482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4488223-ff3b-41f1-ba9f-bd54cbad21bf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:18.506194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4488223-ff3b-41f1-ba9f-bd54cbad21bf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:18.506649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4488223-ff3b-41f1-ba9f-bd54cbad21bf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:18.507075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4488223-ff3b-41f1-ba9f-bd54cbad21bf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:18.641890 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d4488223-ff3b-41f1-ba9f-bd54cbad21bf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:18.649659 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d4488223-ff3b-41f1-ba9f-bd54cbad21bf tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1357 microversion: 2.1 time: 0.156826 Oct 12 23:05:18.650250 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4121/7592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:18 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:19.674387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-99213094-9ddc-4424-8ef3-d5f915f60936 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:19.675098 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-99213094-9ddc-4424-8ef3-d5f915f60936 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:19.682068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99213094-9ddc-4424-8ef3-d5f915f60936 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:19.682566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99213094-9ddc-4424-8ef3-d5f915f60936 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:19.683017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99213094-9ddc-4424-8ef3-d5f915f60936 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:19.683745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99213094-9ddc-4424-8ef3-d5f915f60936 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:19.684208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99213094-9ddc-4424-8ef3-d5f915f60936 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:19.684645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99213094-9ddc-4424-8ef3-d5f915f60936 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:19.811388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-99213094-9ddc-4424-8ef3-d5f915f60936 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:19.819725 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-99213094-9ddc-4424-8ef3-d5f915f60936 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1357 microversion: 2.1 time: 0.150063 Oct 12 23:05:19.820289 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3472/7593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:19 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:20.842101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1a268f41-dfc0-41cb-a49a-d9cdb9ecb180 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:20.842749 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1a268f41-dfc0-41cb-a49a-d9cdb9ecb180 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:20.850035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a268f41-dfc0-41cb-a49a-d9cdb9ecb180 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:20.850516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a268f41-dfc0-41cb-a49a-d9cdb9ecb180 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:20.850956 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a268f41-dfc0-41cb-a49a-d9cdb9ecb180 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:20.851677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a268f41-dfc0-41cb-a49a-d9cdb9ecb180 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:20.852132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a268f41-dfc0-41cb-a49a-d9cdb9ecb180 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:20.852562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a268f41-dfc0-41cb-a49a-d9cdb9ecb180 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:20.981184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1a268f41-dfc0-41cb-a49a-d9cdb9ecb180 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:20.989267 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1a268f41-dfc0-41cb-a49a-d9cdb9ecb180 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1357 microversion: 2.1 time: 0.151066 Oct 12 23:05:20.990259 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4122/7594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:20 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:22.012947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-34e03e96-5a10-4e52-9793-19553c3110f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:22.013587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-34e03e96-5a10-4e52-9793-19553c3110f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:22.020517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34e03e96-5a10-4e52-9793-19553c3110f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:22.020964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34e03e96-5a10-4e52-9793-19553c3110f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:22.021417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34e03e96-5a10-4e52-9793-19553c3110f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:22.022125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34e03e96-5a10-4e52-9793-19553c3110f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:22.022613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34e03e96-5a10-4e52-9793-19553c3110f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:22.023058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34e03e96-5a10-4e52-9793-19553c3110f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:22.154692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-34e03e96-5a10-4e52-9793-19553c3110f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:22.162809 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-34e03e96-5a10-4e52-9793-19553c3110f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1357 microversion: 2.1 time: 0.153901 Oct 12 23:05:22.163404 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3473/7595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:22 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:23.186303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-81964e0d-becc-4f58-a6e1-0b0a61e7197e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:23.187060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-81964e0d-becc-4f58-a6e1-0b0a61e7197e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:23.194297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81964e0d-becc-4f58-a6e1-0b0a61e7197e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:23.194780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81964e0d-becc-4f58-a6e1-0b0a61e7197e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:23.195214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81964e0d-becc-4f58-a6e1-0b0a61e7197e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:23.195961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81964e0d-becc-4f58-a6e1-0b0a61e7197e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:23.196409 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81964e0d-becc-4f58-a6e1-0b0a61e7197e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:23.196862 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81964e0d-becc-4f58-a6e1-0b0a61e7197e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:23.324438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-81964e0d-becc-4f58-a6e1-0b0a61e7197e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:23.332278 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-81964e0d-becc-4f58-a6e1-0b0a61e7197e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1357 microversion: 2.1 time: 0.149964 Oct 12 23:05:23.332851 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4123/7596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:23 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:24.355390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-04fec1b2-71af-47f0-92a9-0aca1144112e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:24.356053 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-04fec1b2-71af-47f0-92a9-0aca1144112e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:24.362835 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04fec1b2-71af-47f0-92a9-0aca1144112e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:24.363370 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04fec1b2-71af-47f0-92a9-0aca1144112e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:24.363827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04fec1b2-71af-47f0-92a9-0aca1144112e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:24.364537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04fec1b2-71af-47f0-92a9-0aca1144112e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:24.365009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04fec1b2-71af-47f0-92a9-0aca1144112e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:24.365454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04fec1b2-71af-47f0-92a9-0aca1144112e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:24.491591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-04fec1b2-71af-47f0-92a9-0aca1144112e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:24.499563 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-04fec1b2-71af-47f0-92a9-0aca1144112e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1357 microversion: 2.1 time: 0.148113 Oct 12 23:05:24.500125 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3474/7597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:24 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:24.804803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-5ceb8053-8c21-4de1-9135-8af8c2672681 req-5662c70a-5eaa-4056-902c-e67d71e00e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74588b5e-30c4-491e-92df-9caa4896ff58", "name": "network-vif-plugged", "status": "completed", "tag": "07d647c6-1ea5-450e-9c10-274e600c3b25"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:24.816907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5ceb8053-8c21-4de1-9135-8af8c2672681 req-5662c70a-5eaa-4056-902c-e67d71e00e3e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:24.817466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5ceb8053-8c21-4de1-9135-8af8c2672681 req-5662c70a-5eaa-4056-902c-e67d71e00e3e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:24.817975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5ceb8053-8c21-4de1-9135-8af8c2672681 req-5662c70a-5eaa-4056-902c-e67d71e00e3e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:24.829324 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-5ceb8053-8c21-4de1-9135-8af8c2672681 req-5662c70a-5eaa-4056-902c-e67d71e00e3e service nova] Creating event network-vif-plugged:07d647c6-1ea5-450e-9c10-274e600c3b25 for instance 74588b5e-30c4-491e-92df-9caa4896ff58 on n-h2-861111-1 Oct 12 23:05:24.835400 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-5ceb8053-8c21-4de1-9135-8af8c2672681 req-5662c70a-5eaa-4056-902c-e67d71e00e3e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034668 Oct 12 23:05:24.836274 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4124/7598] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:25.523817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8ee4c258-cb01-4f02-b254-f1929dcb2f5d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:25.524452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8ee4c258-cb01-4f02-b254-f1929dcb2f5d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:25.531171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ee4c258-cb01-4f02-b254-f1929dcb2f5d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:25.531706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ee4c258-cb01-4f02-b254-f1929dcb2f5d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:25.532162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ee4c258-cb01-4f02-b254-f1929dcb2f5d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:25.533524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ee4c258-cb01-4f02-b254-f1929dcb2f5d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:25.533995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ee4c258-cb01-4f02-b254-f1929dcb2f5d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:25.534439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ee4c258-cb01-4f02-b254-f1929dcb2f5d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:25.662846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8ee4c258-cb01-4f02-b254-f1929dcb2f5d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:25.670615 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8ee4c258-cb01-4f02-b254-f1929dcb2f5d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1357 microversion: 2.1 time: 0.150771 Oct 12 23:05:25.671185 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3475/7599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:25 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:05:26.695109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a207c58e-156c-4d85-80ec-349ed5f9d07e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:26.695869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a207c58e-156c-4d85-80ec-349ed5f9d07e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:26.701985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a207c58e-156c-4d85-80ec-349ed5f9d07e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:26.702466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a207c58e-156c-4d85-80ec-349ed5f9d07e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:26.702899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a207c58e-156c-4d85-80ec-349ed5f9d07e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:26.703610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a207c58e-156c-4d85-80ec-349ed5f9d07e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:26.704059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a207c58e-156c-4d85-80ec-349ed5f9d07e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:26.706367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a207c58e-156c-4d85-80ec-349ed5f9d07e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:26.837670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a207c58e-156c-4d85-80ec-349ed5f9d07e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:26.846633 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a207c58e-156c-4d85-80ec-349ed5f9d07e tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1547 microversion: 2.1 time: 0.156704 Oct 12 23:05:26.847210 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4125/7600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:26 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:26.869889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83f4f7dd-da8f-432c-b073-8674129161ef tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:26.870565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-83f4f7dd-da8f-432c-b073-8674129161ef tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:26.877427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83f4f7dd-da8f-432c-b073-8674129161ef tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:26.877930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83f4f7dd-da8f-432c-b073-8674129161ef tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:26.878384 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83f4f7dd-da8f-432c-b073-8674129161ef tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:26.879092 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83f4f7dd-da8f-432c-b073-8674129161ef tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:26.879609 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83f4f7dd-da8f-432c-b073-8674129161ef tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:26.880055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83f4f7dd-da8f-432c-b073-8674129161ef tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:27.006306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-83f4f7dd-da8f-432c-b073-8674129161ef tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:27.014001 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-83f4f7dd-da8f-432c-b073-8674129161ef tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1547 microversion: 2.1 time: 0.148219 Oct 12 23:05:27.014625 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3476/7601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:26 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:27.036721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5350eac4-aa63-449d-9e21-8fa5be54d81f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:27.041471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5350eac4-aa63-449d-9e21-8fa5be54d81f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:27.042241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5350eac4-aa63-449d-9e21-8fa5be54d81f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Searching by: {'deleted': False, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 23:05:27.047448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5350eac4-aa63-449d-9e21-8fa5be54d81f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:27.047920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5350eac4-aa63-449d-9e21-8fa5be54d81f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:27.048353 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5350eac4-aa63-449d-9e21-8fa5be54d81f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:27.049064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5350eac4-aa63-449d-9e21-8fa5be54d81f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:27.049511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5350eac4-aa63-449d-9e21-8fa5be54d81f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:27.049934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5350eac4-aa63-449d-9e21-8fa5be54d81f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:27.072810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-5350eac4-aa63-449d-9e21-8fa5be54d81f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 23:05:27.100007 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5350eac4-aa63-449d-9e21-8fa5be54d81f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.067696 Oct 12 23:05:27.100576 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4126/7602] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 12 23:05:27 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:05:27.112094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b6b30a2-421a-46ee-bacd-9da378858334 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:27.112731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6b6b30a2-421a-46ee-bacd-9da378858334 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:27.118886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b6b30a2-421a-46ee-bacd-9da378858334 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:27.119425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b6b30a2-421a-46ee-bacd-9da378858334 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:27.119879 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b6b30a2-421a-46ee-bacd-9da378858334 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:27.120591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b6b30a2-421a-46ee-bacd-9da378858334 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:27.121059 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b6b30a2-421a-46ee-bacd-9da378858334 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:27.121501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b6b30a2-421a-46ee-bacd-9da378858334 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:27.251047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6b6b30a2-421a-46ee-bacd-9da378858334 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:27.259032 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6b6b30a2-421a-46ee-bacd-9da378858334 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1547 microversion: 2.1 time: 0.150761 Oct 12 23:05:27.259656 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3477/7603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:27 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:28.807107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a0104d64-ad46-4dcf-9116-d787f3fde8eb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3504f737-5319-4936-b947-e61d50d1bdca"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:28.809492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a0104d64-ad46-4dcf-9116-d787f3fde8eb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:28.817677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0104d64-ad46-4dcf-9116-d787f3fde8eb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:28.818160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0104d64-ad46-4dcf-9116-d787f3fde8eb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:28.818595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0104d64-ad46-4dcf-9116-d787f3fde8eb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:28.819304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0104d64-ad46-4dcf-9116-d787f3fde8eb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:28.819758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0104d64-ad46-4dcf-9116-d787f3fde8eb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:28.820182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a0104d64-ad46-4dcf-9116-d787f3fde8eb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:29.055820 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a0104d64-ad46-4dcf-9116-d787f3fde8eb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "POST /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252449 Oct 12 23:05:29.056453 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4127/7604] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 23:05:28 2022] POST /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:42.082439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-06a43373-46ed-40df-b631-aba28d3b9686 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:42.083069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-06a43373-46ed-40df-b631-aba28d3b9686 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:42.086598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:42.087325 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=70 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:42.093380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06a43373-46ed-40df-b631-aba28d3b9686 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:42.093905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06a43373-46ed-40df-b631-aba28d3b9686 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:42.094361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06a43373-46ed-40df-b631-aba28d3b9686 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:42.095069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06a43373-46ed-40df-b631-aba28d3b9686 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:42.095572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06a43373-46ed-40df-b631-aba28d3b9686 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:42.096018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06a43373-46ed-40df-b631-aba28d3b9686 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:42.224684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-06a43373-46ed-40df-b631-aba28d3b9686 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:42.232983 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-06a43373-46ed-40df-b631-aba28d3b9686 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1593 microversion: 2.1 time: 0.154496 Oct 12 23:05:42.233563 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3478/7605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:42 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:44.221062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:44.222342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:44.223007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:44.227164 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-cbdf4cc8-ea89-4d05-985e-25f0b43c0c64 req-3b35cbb2-47b4-4f0f-a412-8f504523339b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74588b5e-30c4-491e-92df-9caa4896ff58", "tag": "07d647c6-1ea5-450e-9c10-274e600c3b25"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:44.239071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cbdf4cc8-ea89-4d05-985e-25f0b43c0c64 req-3b35cbb2-47b4-4f0f-a412-8f504523339b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:44.239607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cbdf4cc8-ea89-4d05-985e-25f0b43c0c64 req-3b35cbb2-47b4-4f0f-a412-8f504523339b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:44.240095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cbdf4cc8-ea89-4d05-985e-25f0b43c0c64 req-3b35cbb2-47b4-4f0f-a412-8f504523339b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:44.253234 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-cbdf4cc8-ea89-4d05-985e-25f0b43c0c64 req-3b35cbb2-47b4-4f0f-a412-8f504523339b service nova] Creating event network-changed:07d647c6-1ea5-450e-9c10-274e600c3b25 for instance 74588b5e-30c4-491e-92df-9caa4896ff58 on n-h2-861111-1 Oct 12 23:05:44.258504 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-cbdf4cc8-ea89-4d05-985e-25f0b43c0c64 req-3b35cbb2-47b4-4f0f-a412-8f504523339b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039841 Oct 12 23:05:44.259562 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4128/7606] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:45.213981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a0f35580-54a0-4b22-8552-847b620a8071 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1890153327"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:45.214543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a0f35580-54a0-4b22-8552-847b620a8071 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:45.221567 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0f35580-54a0-4b22-8552-847b620a8071 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:45.222075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0f35580-54a0-4b22-8552-847b620a8071 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:45.222531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0f35580-54a0-4b22-8552-847b620a8071 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:45.223265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0f35580-54a0-4b22-8552-847b620a8071 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:45.223731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0f35580-54a0-4b22-8552-847b620a8071 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:45.224174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a0f35580-54a0-4b22-8552-847b620a8071 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:45.349383 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.network.security_group_api [None req-a0f35580-54a0-4b22-8552-847b620a8071 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Adding security group 0d50bda2-3aa0-4adf-9c52-a2ee76322c96 to port 07d647c6-1ea5-450e-9c10-274e600c3b25 Oct 12 23:05:45.659867 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a0f35580-54a0-4b22-8552-847b620a8071 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "POST /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/action" status: 202 len: 0 microversion: 2.1 time: 0.450022 Oct 12 23:05:45.660509 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3479/7607] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:05:45 2022] POST /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:05:45.669930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3dad5dde-3694-473d-8709-a40883c1587d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:45.670642 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3dad5dde-3694-473d-8709-a40883c1587d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:45.677006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3dad5dde-3694-473d-8709-a40883c1587d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:45.677715 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3dad5dde-3694-473d-8709-a40883c1587d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:45.678150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3dad5dde-3694-473d-8709-a40883c1587d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:45.678841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3dad5dde-3694-473d-8709-a40883c1587d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:45.679478 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3dad5dde-3694-473d-8709-a40883c1587d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:45.680094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3dad5dde-3694-473d-8709-a40883c1587d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:45.828955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3dad5dde-3694-473d-8709-a40883c1587d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:45.837358 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3dad5dde-3694-473d-8709-a40883c1587d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1758 microversion: 2.1 time: 0.172470 Oct 12 23:05:45.837970 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4129/7608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:45 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:05:46.275484 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-7d08a62a-cca6-47a1-8d38-cae57a9f73a5 req-b43819ec-4b05-4fb5-a386-fb090139ae03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74588b5e-30c4-491e-92df-9caa4896ff58", "tag": "07d647c6-1ea5-450e-9c10-274e600c3b25"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:46.285365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7d08a62a-cca6-47a1-8d38-cae57a9f73a5 req-b43819ec-4b05-4fb5-a386-fb090139ae03 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:46.285936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7d08a62a-cca6-47a1-8d38-cae57a9f73a5 req-b43819ec-4b05-4fb5-a386-fb090139ae03 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:46.286380 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7d08a62a-cca6-47a1-8d38-cae57a9f73a5 req-b43819ec-4b05-4fb5-a386-fb090139ae03 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:46.300717 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-7d08a62a-cca6-47a1-8d38-cae57a9f73a5 req-b43819ec-4b05-4fb5-a386-fb090139ae03 service nova] Creating event network-changed:07d647c6-1ea5-450e-9c10-274e600c3b25 for instance 74588b5e-30c4-491e-92df-9caa4896ff58 on n-h2-861111-1 Oct 12 23:05:46.305721 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-7d08a62a-cca6-47a1-8d38-cae57a9f73a5 req-b43819ec-4b05-4fb5-a386-fb090139ae03 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034479 Oct 12 23:05:46.306318 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3480/7609] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:07:57.500334 n-d-861111-1 devstack@n-api.service[120453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84ea943b-c2e8-46fe-b7cd-216120f59743] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 23:07:57.501272 n-d-861111-1 devstack@n-api.service[120453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aee61eb9-c5dd-4991-902f-85ebd1f559fb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 23:07:57.502007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:57.502751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=8 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:57.504290 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:07:57.504450 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 23:07:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/action (ip 10.222.0.16) !!! Oct 12 23:07:57.506123 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 12 23:07:57.510483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bc9d79d5-94fe-4870-800b-00d8a0a77e09 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:57.512737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bc9d79d5-94fe-4870-800b-00d8a0a77e09 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:57.522473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc9d79d5-94fe-4870-800b-00d8a0a77e09 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:57.522959 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc9d79d5-94fe-4870-800b-00d8a0a77e09 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:57.523437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc9d79d5-94fe-4870-800b-00d8a0a77e09 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:57.524142 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc9d79d5-94fe-4870-800b-00d8a0a77e09 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:57.524599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc9d79d5-94fe-4870-800b-00d8a0a77e09 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:57.525035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc9d79d5-94fe-4870-800b-00d8a0a77e09 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:57.599442 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bc9d79d5-94fe-4870-800b-00d8a0a77e09 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "POST /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/action" status: 202 len: 0 microversion: 2.1 time: 0.100868 Oct 12 23:07:57.600083 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4130/7610] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:07:57 2022] POST /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:07:57.607031 n-d-861111-1 devstack@n-api.service[120452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d1e6222c-d1f8-4742-acce-113cd0d666eb] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:07:57.608131 n-d-861111-1 devstack@n-api.service[120452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b0df6e00-df54-42f7-81d1-59721b28bd80] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:07:57.608698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:57.609642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=12 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:57.610584 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:07:57.610735 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 23:07:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 (ip 10.222.0.16) !!! Oct 12 23:07:57.611747 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:07:57.611865 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 23:07:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 (ip 10.222.0.16) !!! Oct 12 23:07:57.618546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d04d8fb0-e6ba-43eb-af0c-e544b9aefa0c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:57.619270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d04d8fb0-e6ba-43eb-af0c-e544b9aefa0c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:57.628805 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d04d8fb0-e6ba-43eb-af0c-e544b9aefa0c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:57.629313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d04d8fb0-e6ba-43eb-af0c-e544b9aefa0c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:57.629759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d04d8fb0-e6ba-43eb-af0c-e544b9aefa0c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:57.630498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d04d8fb0-e6ba-43eb-af0c-e544b9aefa0c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:57.630963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d04d8fb0-e6ba-43eb-af0c-e544b9aefa0c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:57.631431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d04d8fb0-e6ba-43eb-af0c-e544b9aefa0c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:57.859288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d04d8fb0-e6ba-43eb-af0c-e544b9aefa0c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:57.867552 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d04d8fb0-e6ba-43eb-af0c-e544b9aefa0c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1760 microversion: 2.1 time: 0.262424 Oct 12 23:07:57.868130 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3481/7611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:57 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1760 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:58.892940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-43d8ed89-621a-42c8-b9d3-51020067b444 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:58.893652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-43d8ed89-621a-42c8-b9d3-51020067b444 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:58.902812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43d8ed89-621a-42c8-b9d3-51020067b444 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:58.903330 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43d8ed89-621a-42c8-b9d3-51020067b444 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:58.903775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43d8ed89-621a-42c8-b9d3-51020067b444 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:58.904482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43d8ed89-621a-42c8-b9d3-51020067b444 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:58.904970 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43d8ed89-621a-42c8-b9d3-51020067b444 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:58.905403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-43d8ed89-621a-42c8-b9d3-51020067b444 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:58.911490 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] [aee61eb9-c5dd-4991-902f-85ebd1f559fb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38554. Oct 12 23:07:58.923324 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] [84ea943b-c2e8-46fe-b7cd-216120f59743] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38552. Oct 12 23:07:59.186590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-43d8ed89-621a-42c8-b9d3-51020067b444 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:59.194990 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-43d8ed89-621a-42c8-b9d3-51020067b444 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1758 microversion: 2.1 time: 0.307720 Oct 12 23:07:59.195587 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4131/7612] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:58 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1758 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:30.730504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:30.731181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:30.737062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a211a8fb-34ef-45bf-8e10-df4dddf029c7 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1890153327"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:30.737606 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a211a8fb-34ef-45bf-8e10-df4dddf029c7 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:30.747709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a211a8fb-34ef-45bf-8e10-df4dddf029c7 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:30.748204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a211a8fb-34ef-45bf-8e10-df4dddf029c7 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:30.748653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a211a8fb-34ef-45bf-8e10-df4dddf029c7 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:30.749351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a211a8fb-34ef-45bf-8e10-df4dddf029c7 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:30.749814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a211a8fb-34ef-45bf-8e10-df4dddf029c7 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:30.750256 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a211a8fb-34ef-45bf-8e10-df4dddf029c7 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:30.750876 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] [d1e6222c-d1f8-4742-acce-113cd0d666eb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38596. Oct 12 23:09:30.755280 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] [b0df6e00-df54-42f7-81d1-59721b28bd80] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38598. Oct 12 23:09:30.957716 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.network.security_group_api [None req-a211a8fb-34ef-45bf-8e10-df4dddf029c7 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Removing security group 0d50bda2-3aa0-4adf-9c52-a2ee76322c96 from port 07d647c6-1ea5-450e-9c10-274e600c3b25 Oct 12 23:09:31.253208 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a211a8fb-34ef-45bf-8e10-df4dddf029c7 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "POST /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/action" status: 202 len: 0 microversion: 2.1 time: 0.526258 Oct 12 23:09:31.260345 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3482/7613] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:09:30 2022] POST /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:09:31.269167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:31.270753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:31.348274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-0aed07bd-84f0-4eb0-b990-8d05e3cb497b req-b286c886-a926-4d52-b747-2c2b89318289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74588b5e-30c4-491e-92df-9caa4896ff58", "tag": "07d647c6-1ea5-450e-9c10-274e600c3b25"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:31.359451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0aed07bd-84f0-4eb0-b990-8d05e3cb497b req-b286c886-a926-4d52-b747-2c2b89318289 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:31.360144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0aed07bd-84f0-4eb0-b990-8d05e3cb497b req-b286c886-a926-4d52-b747-2c2b89318289 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:31.360781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-0aed07bd-84f0-4eb0-b990-8d05e3cb497b req-b286c886-a926-4d52-b747-2c2b89318289 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:31.374680 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-0aed07bd-84f0-4eb0-b990-8d05e3cb497b req-b286c886-a926-4d52-b747-2c2b89318289 service nova] Creating event network-changed:07d647c6-1ea5-450e-9c10-274e600c3b25 for instance 74588b5e-30c4-491e-92df-9caa4896ff58 on n-h2-861111-1 Oct 12 23:09:31.380770 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-0aed07bd-84f0-4eb0-b990-8d05e3cb497b req-b286c886-a926-4d52-b747-2c2b89318289 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116697 Oct 12 23:09:31.381698 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4132/7614] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:09:33.045157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-28435e65-5999-4dab-9291-80373652485b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:33.045749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-28435e65-5999-4dab-9291-80373652485b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:33.052509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28435e65-5999-4dab-9291-80373652485b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:33.052996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28435e65-5999-4dab-9291-80373652485b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:33.053445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28435e65-5999-4dab-9291-80373652485b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:33.054164 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28435e65-5999-4dab-9291-80373652485b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:33.054628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28435e65-5999-4dab-9291-80373652485b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:33.055067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28435e65-5999-4dab-9291-80373652485b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:33.139352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-28435e65-5999-4dab-9291-80373652485b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lazy-loading 'services' on Instance uuid 74588b5e-30c4-491e-92df-9caa4896ff58 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:09:33.210163 n-d-861111-1 devstack@n-api.service[120452]: ERROR oslo.messaging._drivers.impl_rabbit [None req-28435e65-5999-4dab-9291-80373652485b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [75f240bb-79e9-4050-a853-c197a1740333] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:09:33.397750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-59bca2e8-82b7-41a5-a8b4-c4969113ed9f req-f44ef98d-f245-48b1-bc6a-9ffdfd33ee36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74588b5e-30c4-491e-92df-9caa4896ff58", "tag": "07d647c6-1ea5-450e-9c10-274e600c3b25"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:33.407179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-59bca2e8-82b7-41a5-a8b4-c4969113ed9f req-f44ef98d-f245-48b1-bc6a-9ffdfd33ee36 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:33.407688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-59bca2e8-82b7-41a5-a8b4-c4969113ed9f req-f44ef98d-f245-48b1-bc6a-9ffdfd33ee36 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:33.408127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-59bca2e8-82b7-41a5-a8b4-c4969113ed9f req-f44ef98d-f245-48b1-bc6a-9ffdfd33ee36 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:33.418886 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-59bca2e8-82b7-41a5-a8b4-c4969113ed9f req-f44ef98d-f245-48b1-bc6a-9ffdfd33ee36 service nova] Creating event network-changed:07d647c6-1ea5-450e-9c10-274e600c3b25 for instance 74588b5e-30c4-491e-92df-9caa4896ff58 on n-h2-861111-1 Oct 12 23:09:33.423873 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-59bca2e8-82b7-41a5-a8b4-c4969113ed9f req-f44ef98d-f245-48b1-bc6a-9ffdfd33ee36 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031653 Oct 12 23:09:33.424465 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4133/7615] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:09:34.217412 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [None req-28435e65-5999-4dab-9291-80373652485b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [75f240bb-79e9-4050-a853-c197a1740333] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38630. Oct 12 23:09:34.220984 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-28435e65-5999-4dab-9291-80373652485b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "DELETE /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments/3504f737-5319-4936-b947-e61d50d1bdca" status: 202 len: 0 microversion: 2.1 time: 1.180766 Oct 12 23:09:34.221595 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3483/7616] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 23:09:33 2022] DELETE /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments/3504f737-5319-4936-b947-e61d50d1bdca => generated 0 bytes in 1182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:09:34.231466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-391498ba-d60f-4d29-9a13-2087db624837 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:34.233756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-391498ba-d60f-4d29-9a13-2087db624837 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:34.240870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-391498ba-d60f-4d29-9a13-2087db624837 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:34.241390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-391498ba-d60f-4d29-9a13-2087db624837 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:34.241810 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-391498ba-d60f-4d29-9a13-2087db624837 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:34.242513 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-391498ba-d60f-4d29-9a13-2087db624837 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:34.242969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-391498ba-d60f-4d29-9a13-2087db624837 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:34.243428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-391498ba-d60f-4d29-9a13-2087db624837 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:34.275329 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-391498ba-d60f-4d29-9a13-2087db624837 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048236 Oct 12 23:09:34.276036 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4134/7617] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:09:34 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:09:35.290343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0876a99d-7e88-4575-b209-50009e9c123a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:35.292739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0876a99d-7e88-4575-b209-50009e9c123a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:35.299726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0876a99d-7e88-4575-b209-50009e9c123a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:35.300233 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0876a99d-7e88-4575-b209-50009e9c123a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:35.300690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0876a99d-7e88-4575-b209-50009e9c123a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:35.301412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0876a99d-7e88-4575-b209-50009e9c123a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:35.301972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0876a99d-7e88-4575-b209-50009e9c123a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:35.302422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0876a99d-7e88-4575-b209-50009e9c123a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:35.331740 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0876a99d-7e88-4575-b209-50009e9c123a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047220 Oct 12 23:09:35.332315 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3484/7618] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:09:35 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:09:36.345179 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a8adec65-1dbc-4d58-8044-564055037642 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:36.347380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a8adec65-1dbc-4d58-8044-564055037642 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:36.354661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8adec65-1dbc-4d58-8044-564055037642 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:36.355143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8adec65-1dbc-4d58-8044-564055037642 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:36.355614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8adec65-1dbc-4d58-8044-564055037642 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:36.356326 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8adec65-1dbc-4d58-8044-564055037642 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:36.356768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8adec65-1dbc-4d58-8044-564055037642 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:36.357196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a8adec65-1dbc-4d58-8044-564055037642 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:36.390056 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a8adec65-1dbc-4d58-8044-564055037642 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048974 Oct 12 23:09:36.390628 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4135/7619] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:09:36 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:09:37.402333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-30a80999-e689-4ea3-8b83-5d87b9173f1d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:37.404524 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-30a80999-e689-4ea3-8b83-5d87b9173f1d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:37.411465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30a80999-e689-4ea3-8b83-5d87b9173f1d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:37.411976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30a80999-e689-4ea3-8b83-5d87b9173f1d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:37.412433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30a80999-e689-4ea3-8b83-5d87b9173f1d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:37.413148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30a80999-e689-4ea3-8b83-5d87b9173f1d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:37.413654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30a80999-e689-4ea3-8b83-5d87b9173f1d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:37.414101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30a80999-e689-4ea3-8b83-5d87b9173f1d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:37.444111 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-30a80999-e689-4ea3-8b83-5d87b9173f1d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045890 Oct 12 23:09:37.444678 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3485/7620] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:09:37 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:09:38.456647 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7f3b5f24-2fee-4c70-9235-56b4c5b67ace tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:38.459385 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7f3b5f24-2fee-4c70-9235-56b4c5b67ace tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:38.466851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f3b5f24-2fee-4c70-9235-56b4c5b67ace tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:38.467357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f3b5f24-2fee-4c70-9235-56b4c5b67ace tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:38.467791 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f3b5f24-2fee-4c70-9235-56b4c5b67ace tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:38.468477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f3b5f24-2fee-4c70-9235-56b4c5b67ace tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:38.468928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f3b5f24-2fee-4c70-9235-56b4c5b67ace tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:38.469356 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7f3b5f24-2fee-4c70-9235-56b4c5b67ace tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:38.500287 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7f3b5f24-2fee-4c70-9235-56b4c5b67ace tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047617 Oct 12 23:09:38.500912 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4136/7621] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:09:38 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:09:39.513099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-64fbc4cc-a94d-4064-9fed-6ef7d0b63d85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:39.515321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-64fbc4cc-a94d-4064-9fed-6ef7d0b63d85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:39.523706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64fbc4cc-a94d-4064-9fed-6ef7d0b63d85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:39.524206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64fbc4cc-a94d-4064-9fed-6ef7d0b63d85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:39.524662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64fbc4cc-a94d-4064-9fed-6ef7d0b63d85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:39.525375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64fbc4cc-a94d-4064-9fed-6ef7d0b63d85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:39.525848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64fbc4cc-a94d-4064-9fed-6ef7d0b63d85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:39.526296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64fbc4cc-a94d-4064-9fed-6ef7d0b63d85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:39.554507 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-64fbc4cc-a94d-4064-9fed-6ef7d0b63d85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045546 Oct 12 23:09:39.555069 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3486/7622] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:09:39 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:09:39.565773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aba31650-c0aa-4e53-bca7-ae5d7a87f789 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:39.566280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-aba31650-c0aa-4e53-bca7-ae5d7a87f789 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:39.573859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aba31650-c0aa-4e53-bca7-ae5d7a87f789 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:39.574366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aba31650-c0aa-4e53-bca7-ae5d7a87f789 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:39.574812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aba31650-c0aa-4e53-bca7-ae5d7a87f789 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:39.575573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aba31650-c0aa-4e53-bca7-ae5d7a87f789 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:39.576034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aba31650-c0aa-4e53-bca7-ae5d7a87f789 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:39.576467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-aba31650-c0aa-4e53-bca7-ae5d7a87f789 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:39.650295 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-aba31650-c0aa-4e53-bca7-ae5d7a87f789 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] HTTP exception thrown: Instance 74588b5e-30c4-491e-92df-9caa4896ff58 is not attached to volume 3504f737-5319-4936-b947-e61d50d1bdca Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aba31650-c0aa-4e53-bca7-ae5d7a87f789 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Request method failure captured: Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: request: DELETE /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments/3504f737-5319-4936-b947-e61d50d1bdca HTTP/1.1 Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0gRUA6Rha7F7Gj3JtQyZi6vWW2vUDOqd0K1xl0APntjM4eLjtey8fU94eQwLjlbYtEMn3YOh5iTTyqVJsTIDIWeRbdXIzoZci4eP6oNCBJHphPWIGcbacY0tACquGuzMk505eZ2fll1Xadwpqe0eP8oL84jmd9Q4cgDnv_Jlw8es5g Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: cea0d2fdebb74c388a4eae1183dc4763 Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestMinimumBasicScenario-465247151 Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cea0d2fdebb74c388a4eae1183dc4763"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cea0d2fdebb74c388a4eae1183dc4763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cea0d2fdebb74c388a4eae1183dc4763", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cea0d2fdebb74c388a4eae1183dc4763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestMinimumBasicScenario-465247151 Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: cea0d2fdebb74c388a4eae1183dc4763 Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestMinimumBasicScenario-465247151 Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestMinimumBasicScenario-465247151-project Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: b204f4c9508e4a30aab167cca736ed3e Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestMinimumBasicScenario-465247151-project Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 74588b5e-30c4-491e-92df-9caa4896ff58 is not attached to volume 3504f737-5319-4936-b947-e61d50d1bdca Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'server_id': '74588b5e-30c4-491e-92df-9caa4896ff58', 'id': '3504f737-5319-4936-b947-e61d50d1bdca'} Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3504f737-5319-4936-b947-e61d50d1bdca. Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74588b5e-30c4-491e-92df-9caa4896ff58 is not attached to volume 3504f737-5319-4936-b947-e61d50d1bdca Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:39.651952 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:39.656744 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:09:39.656744 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:09:39.656744 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74588b5e-30c4-491e-92df-9caa4896ff58 is not attached to volume 3504f737-5319-4936-b947-e61d50d1bdca Oct 12 23:09:39.656744 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:09:39.656744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-aba31650-c0aa-4e53-bca7-ae5d7a87f789 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Returning 404 to user: Instance 74588b5e-30c4-491e-92df-9caa4896ff58 is not attached to volume 3504f737-5319-4936-b947-e61d50d1bdca {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:09:39.656744 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-aba31650-c0aa-4e53-bca7-ae5d7a87f789 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "DELETE /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments/3504f737-5319-4936-b947-e61d50d1bdca" status: 404 len: 154 microversion: 2.1 time: 0.091792 Oct 12 23:09:39.656744 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4137/7623] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 23:09:39 2022] DELETE /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58/os-volume_attachments/3504f737-5319-4936-b947-e61d50d1bdca => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:09:42.902472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b7228001-f8b5-4eb6-9f8a-2fbc3aa5cac3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:42.902991 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b7228001-f8b5-4eb6-9f8a-2fbc3aa5cac3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:42.910029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7228001-f8b5-4eb6-9f8a-2fbc3aa5cac3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:42.910538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7228001-f8b5-4eb6-9f8a-2fbc3aa5cac3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:42.911001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7228001-f8b5-4eb6-9f8a-2fbc3aa5cac3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:42.911745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7228001-f8b5-4eb6-9f8a-2fbc3aa5cac3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:42.912224 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7228001-f8b5-4eb6-9f8a-2fbc3aa5cac3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:42.912673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b7228001-f8b5-4eb6-9f8a-2fbc3aa5cac3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:42.943111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b7228001-f8b5-4eb6-9f8a-2fbc3aa5cac3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:09:43.023220 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b7228001-f8b5-4eb6-9f8a-2fbc3aa5cac3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "DELETE /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 204 len: 0 microversion: 2.1 time: 0.124214 Oct 12 23:09:43.024136 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3487/7624] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:09:42 2022] DELETE /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:09:43.032818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8ccecdd0-8b4d-4ab2-b737-e593139c9e51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:43.034134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8ccecdd0-8b4d-4ab2-b737-e593139c9e51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:43.041943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ccecdd0-8b4d-4ab2-b737-e593139c9e51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:43.042432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ccecdd0-8b4d-4ab2-b737-e593139c9e51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:43.042877 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ccecdd0-8b4d-4ab2-b737-e593139c9e51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:43.043860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ccecdd0-8b4d-4ab2-b737-e593139c9e51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:43.044331 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ccecdd0-8b4d-4ab2-b737-e593139c9e51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:43.044769 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ccecdd0-8b4d-4ab2-b737-e593139c9e51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:43.177957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8ccecdd0-8b4d-4ab2-b737-e593139c9e51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:43.186020 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8ccecdd0-8b4d-4ab2-b737-e593139c9e51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1553 microversion: 2.1 time: 0.157093 Oct 12 23:09:43.186599 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4138/7625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:43 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:09:44.210830 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-164c92a0-0a8d-452a-8e8d-b06cb0a614c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:44.211472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-164c92a0-0a8d-452a-8e8d-b06cb0a614c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:44.218351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-164c92a0-0a8d-452a-8e8d-b06cb0a614c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:44.218846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-164c92a0-0a8d-452a-8e8d-b06cb0a614c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:44.219323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-164c92a0-0a8d-452a-8e8d-b06cb0a614c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:44.220028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-164c92a0-0a8d-452a-8e8d-b06cb0a614c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:44.220493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-164c92a0-0a8d-452a-8e8d-b06cb0a614c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:44.220960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-164c92a0-0a8d-452a-8e8d-b06cb0a614c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:44.350820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-164c92a0-0a8d-452a-8e8d-b06cb0a614c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:44.358540 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-164c92a0-0a8d-452a-8e8d-b06cb0a614c4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1553 microversion: 2.1 time: 0.152153 Oct 12 23:09:44.359108 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3488/7626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:44 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:45.187527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-5bc2793e-1c9b-4e4e-8aa5-3d89f969243f req-93372494-1570-4f6c-9cb6-2b0e2bcb9992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74588b5e-30c4-491e-92df-9caa4896ff58", "name": "network-vif-deleted", "tag": "07d647c6-1ea5-450e-9c10-274e600c3b25"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:45.198165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5bc2793e-1c9b-4e4e-8aa5-3d89f969243f req-93372494-1570-4f6c-9cb6-2b0e2bcb9992 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:45.198644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5bc2793e-1c9b-4e4e-8aa5-3d89f969243f req-93372494-1570-4f6c-9cb6-2b0e2bcb9992 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:45.199082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5bc2793e-1c9b-4e4e-8aa5-3d89f969243f req-93372494-1570-4f6c-9cb6-2b0e2bcb9992 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:45.210472 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-5bc2793e-1c9b-4e4e-8aa5-3d89f969243f req-93372494-1570-4f6c-9cb6-2b0e2bcb9992 service nova] Creating event network-vif-deleted:07d647c6-1ea5-450e-9c10-274e600c3b25 for instance 74588b5e-30c4-491e-92df-9caa4896ff58 on n-h2-861111-1 Oct 12 23:09:45.215401 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-5bc2793e-1c9b-4e4e-8aa5-3d89f969243f req-93372494-1570-4f6c-9cb6-2b0e2bcb9992 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031771 Oct 12 23:09:45.215975 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4139/7627] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:09:45.382342 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1d265086-3336-4b89-b5a4-7ae7286fa02b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:45.382967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1d265086-3336-4b89-b5a4-7ae7286fa02b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:45.389920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d265086-3336-4b89-b5a4-7ae7286fa02b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:45.390422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d265086-3336-4b89-b5a4-7ae7286fa02b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:45.390878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d265086-3336-4b89-b5a4-7ae7286fa02b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:45.391666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d265086-3336-4b89-b5a4-7ae7286fa02b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:45.392136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d265086-3336-4b89-b5a4-7ae7286fa02b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:45.392601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d265086-3336-4b89-b5a4-7ae7286fa02b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:45.423165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d265086-3336-4b89-b5a4-7ae7286fa02b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:45.423628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d265086-3336-4b89-b5a4-7ae7286fa02b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:45.424079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d265086-3336-4b89-b5a4-7ae7286fa02b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:45.424585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-1d265086-3336-4b89-b5a4-7ae7286fa02b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lazy-loading 'fault' on Instance uuid 74588b5e-30c4-491e-92df-9caa4896ff58 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:09:45.465840 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1d265086-3336-4b89-b5a4-7ae7286fa02b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:45.474078 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1d265086-3336-4b89-b5a4-7ae7286fa02b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 200 len: 1347 microversion: 2.1 time: 0.096044 Oct 12 23:09:45.474651 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3489/7628] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:45 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 1347 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:46.501303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-719e4418-f9a0-4a30-9123-7e481279a404 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:46.502007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-719e4418-f9a0-4a30-9123-7e481279a404 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 74588b5e-30c4-491e-92df-9caa4896ff58] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:46.508186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-719e4418-f9a0-4a30-9123-7e481279a404 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:46.508667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-719e4418-f9a0-4a30-9123-7e481279a404 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:46.509103 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-719e4418-f9a0-4a30-9123-7e481279a404 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:46.509792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-719e4418-f9a0-4a30-9123-7e481279a404 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:46.510245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-719e4418-f9a0-4a30-9123-7e481279a404 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:46.510678 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-719e4418-f9a0-4a30-9123-7e481279a404 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:46.524347 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-719e4418-f9a0-4a30-9123-7e481279a404 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] HTTP exception thrown: Instance 74588b5e-30c4-491e-92df-9caa4896ff58 could not be found. Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-719e4418-f9a0-4a30-9123-7e481279a404 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Request method failure captured: Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 HTTP/1.1 Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0gRUA6Rha7F7Gj3JtQyZi6vWW2vUDOqd0K1xl0APntjM4eLjtey8fU94eQwLjlbYtEMn3YOh5iTTyqVJsTIDIWeRbdXIzoZci4eP6oNCBJHphPWIGcbacY0tACquGuzMk505eZ2fll1Xadwpqe0eP8oL84jmd9Q4cgDnv_Jlw8es5g Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: cea0d2fdebb74c388a4eae1183dc4763 Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestMinimumBasicScenario-465247151 Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cea0d2fdebb74c388a4eae1183dc4763"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cea0d2fdebb74c388a4eae1183dc4763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cea0d2fdebb74c388a4eae1183dc4763", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cea0d2fdebb74c388a4eae1183dc4763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestMinimumBasicScenario-465247151 Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: cea0d2fdebb74c388a4eae1183dc4763 Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestMinimumBasicScenario-465247151 Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestMinimumBasicScenario-465247151-project Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: b204f4c9508e4a30aab167cca736ed3e Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestMinimumBasicScenario-465247151-project Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 74588b5e-30c4-491e-92df-9caa4896ff58 could not be found. Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '74588b5e-30c4-491e-92df-9caa4896ff58'} Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74588b5e-30c4-491e-92df-9caa4896ff58 could not be found. Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74588b5e-30c4-491e-92df-9caa4896ff58 could not be found. Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:46.525989 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:09:46.530657 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:46.530657 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:46.530657 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:46.530657 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:09:46.530657 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:09:46.530657 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74588b5e-30c4-491e-92df-9caa4896ff58 could not be found. Oct 12 23:09:46.530657 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:09:46.530657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-719e4418-f9a0-4a30-9123-7e481279a404 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Returning 404 to user: Instance 74588b5e-30c4-491e-92df-9caa4896ff58 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:09:46.530657 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-719e4418-f9a0-4a30-9123-7e481279a404 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58" status: 404 len: 111 microversion: 2.1 time: 0.031501 Oct 12 23:09:46.530657 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4140/7629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:46 2022] GET /compute/v2.1/servers/74588b5e-30c4-491e-92df-9caa4896ff58 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:09:46.536617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-edffb1db-9360-478b-a972-78d2a2867537 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '.version_select at 0x7f51234513a0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:46.559846 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-edffb1db-9360-478b-a972-78d2a2867537 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-542907669" status: 202 len: 0 microversion: 2.1 time: 0.027633 Oct 12 23:09:46.560434 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3490/7630] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 12 23:09:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-542907669 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:09:55.597504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e47e8aac-2563-418e-90cf-b40a768023ba tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Action: 'create', calling method: .version_select at 0x7f512875a3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1079549168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSB8yL3zJ0W049yKBL4ljlc+cMoiONvJRcn3dsvgRFg2YQkC3UY0lwcraCgDn/XUssgWUUUV9nCg98l1D/XbUwnz1QNR7wvSSALzeZHa0IYq7aNwbn4Us7kB0wpXQyDnQ=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:55.613529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-e47e8aac-2563-418e-90cf-b40a768023ba tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Getting quotas for project cea0d2fdebb74c388a4eae1183dc4763. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:09:55.618641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-e47e8aac-2563-418e-90cf-b40a768023ba tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Getting quotas for user b204f4c9508e4a30aab167cca736ed3e and project cea0d2fdebb74c388a4eae1183dc4763. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:09:55.645813 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e47e8aac-2563-418e-90cf-b40a768023ba tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.098361 Oct 12 23:09:55.646446 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4141/7631] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 23:09:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:09:55.693973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:55.698124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-442852971", "imageRef": "06833ff8-a3e8-44e0-8eea-8397eecedb3a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1079549168", "networks": [{"uuid": "bca7fdc1-e003-4bad-960c-c23737065714"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:55.750132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] validate_networks() for [('bca7fdc1-e003-4bad-960c-c23737065714', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:09:56.156967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:09:56.157444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:09:56.157940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:09:56.158369 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:09:56.158800 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:09:56.167653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:56.168169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:56.168605 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:56.169345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:56.169813 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:56.170254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:56.188198 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Getting quotas for project cea0d2fdebb74c388a4eae1183dc4763. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:09:56.193950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Getting quotas for user b204f4c9508e4a30aab167cca736ed3e and project cea0d2fdebb74c388a4eae1183dc4763. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:09:56.206052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:09:56.208314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='06833ff8-a3e8-44e0-8eea-8397eecedb3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:09:56.255822 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-51ac2467-cc97-42bf-8961-bad44d2f15ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563886 Oct 12 23:09:56.256746 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3491/7632] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 23:09:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:09:56.267547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ad960c3e-6301-474e-aac4-47fe579bd1b7 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:56.268170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ad960c3e-6301-474e-aac4-47fe579bd1b7 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:56.322368 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ad960c3e-6301-474e-aac4-47fe579bd1b7 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:56.330209 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ad960c3e-6301-474e-aac4-47fe579bd1b7 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1258 microversion: 2.1 time: 0.066565 Oct 12 23:09:56.330799 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4142/7633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:56 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:57.353923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3718b555-48ee-4ccf-bb3e-1f99553068b0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:57.354736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3718b555-48ee-4ccf-bb3e-1f99553068b0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:57.361793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3718b555-48ee-4ccf-bb3e-1f99553068b0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:57.362385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3718b555-48ee-4ccf-bb3e-1f99553068b0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:57.362841 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3718b555-48ee-4ccf-bb3e-1f99553068b0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:57.364231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3718b555-48ee-4ccf-bb3e-1f99553068b0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:57.364734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3718b555-48ee-4ccf-bb3e-1f99553068b0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:57.365180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3718b555-48ee-4ccf-bb3e-1f99553068b0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:57.444945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3718b555-48ee-4ccf-bb3e-1f99553068b0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:57.453803 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3718b555-48ee-4ccf-bb3e-1f99553068b0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1328 microversion: 2.1 time: 0.104620 Oct 12 23:09:57.455393 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3492/7634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:57 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:58.478739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ed188212-f77f-4ffe-a26e-9ba5c4693f43 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:58.479400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ed188212-f77f-4ffe-a26e-9ba5c4693f43 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:58.481639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=38 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:58.488485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed188212-f77f-4ffe-a26e-9ba5c4693f43 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:58.489058 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed188212-f77f-4ffe-a26e-9ba5c4693f43 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:58.489568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed188212-f77f-4ffe-a26e-9ba5c4693f43 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:58.490348 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed188212-f77f-4ffe-a26e-9ba5c4693f43 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:58.490884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed188212-f77f-4ffe-a26e-9ba5c4693f43 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:58.491524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed188212-f77f-4ffe-a26e-9ba5c4693f43 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:58.626483 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ed188212-f77f-4ffe-a26e-9ba5c4693f43 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:58.636560 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ed188212-f77f-4ffe-a26e-9ba5c4693f43 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1358 microversion: 2.1 time: 0.161799 Oct 12 23:09:58.637153 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4143/7635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:58 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:59.662214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-79c75500-51bc-46e6-9521-193ec7d91e4d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:59.662945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-79c75500-51bc-46e6-9521-193ec7d91e4d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:59.670356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79c75500-51bc-46e6-9521-193ec7d91e4d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:59.670859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79c75500-51bc-46e6-9521-193ec7d91e4d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:59.671324 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79c75500-51bc-46e6-9521-193ec7d91e4d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:59.672038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79c75500-51bc-46e6-9521-193ec7d91e4d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:59.672503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79c75500-51bc-46e6-9521-193ec7d91e4d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:59.672939 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79c75500-51bc-46e6-9521-193ec7d91e4d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:59.830946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-79c75500-51bc-46e6-9521-193ec7d91e4d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:59.838901 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-79c75500-51bc-46e6-9521-193ec7d91e4d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1358 microversion: 2.1 time: 0.181711 Oct 12 23:09:59.839720 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3493/7636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:59 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:00.863160 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7978c64e-2a03-489f-b21a-1d6dc1e69f6c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:00.864964 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7978c64e-2a03-489f-b21a-1d6dc1e69f6c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:00.872914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7978c64e-2a03-489f-b21a-1d6dc1e69f6c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:00.873376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7978c64e-2a03-489f-b21a-1d6dc1e69f6c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:00.873814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7978c64e-2a03-489f-b21a-1d6dc1e69f6c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:00.874523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7978c64e-2a03-489f-b21a-1d6dc1e69f6c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:00.874978 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7978c64e-2a03-489f-b21a-1d6dc1e69f6c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:00.875440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7978c64e-2a03-489f-b21a-1d6dc1e69f6c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:01.017932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7978c64e-2a03-489f-b21a-1d6dc1e69f6c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:01.027327 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7978c64e-2a03-489f-b21a-1d6dc1e69f6c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1358 microversion: 2.1 time: 0.168585 Oct 12 23:10:01.028159 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4144/7637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:00 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:02.051909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7e2af078-fa2b-4ba0-8324-8f3441342dc2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:02.052566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7e2af078-fa2b-4ba0-8324-8f3441342dc2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:02.054423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:02.060010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e2af078-fa2b-4ba0-8324-8f3441342dc2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:02.060519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e2af078-fa2b-4ba0-8324-8f3441342dc2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:02.060978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e2af078-fa2b-4ba0-8324-8f3441342dc2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:02.061695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e2af078-fa2b-4ba0-8324-8f3441342dc2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:02.062161 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e2af078-fa2b-4ba0-8324-8f3441342dc2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:02.062633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e2af078-fa2b-4ba0-8324-8f3441342dc2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:02.214537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e2af078-fa2b-4ba0-8324-8f3441342dc2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:02.222355 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7e2af078-fa2b-4ba0-8324-8f3441342dc2 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1358 microversion: 2.1 time: 0.174920 Oct 12 23:10:02.223532 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3494/7638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:02 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:10:03.245797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-545f0cf0-f2c7-4565-9224-9c84b8b96480 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:03.246780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-545f0cf0-f2c7-4565-9224-9c84b8b96480 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:03.249369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:03.256271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-545f0cf0-f2c7-4565-9224-9c84b8b96480 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:03.256860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-545f0cf0-f2c7-4565-9224-9c84b8b96480 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:03.257378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-545f0cf0-f2c7-4565-9224-9c84b8b96480 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:03.258101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-545f0cf0-f2c7-4565-9224-9c84b8b96480 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:03.258587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-545f0cf0-f2c7-4565-9224-9c84b8b96480 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:03.259017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-545f0cf0-f2c7-4565-9224-9c84b8b96480 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:03.421863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-545f0cf0-f2c7-4565-9224-9c84b8b96480 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:03.431684 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-545f0cf0-f2c7-4565-9224-9c84b8b96480 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1358 microversion: 2.1 time: 0.189698 Oct 12 23:10:03.432288 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4145/7639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:03 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:04.457476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5bbf2074-1816-45cc-a0c2-b442d71caa40 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:04.458367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5bbf2074-1816-45cc-a0c2-b442d71caa40 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:04.465967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5bbf2074-1816-45cc-a0c2-b442d71caa40 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:04.467001 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5bbf2074-1816-45cc-a0c2-b442d71caa40 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:04.467706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5bbf2074-1816-45cc-a0c2-b442d71caa40 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:04.468786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5bbf2074-1816-45cc-a0c2-b442d71caa40 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:04.469465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5bbf2074-1816-45cc-a0c2-b442d71caa40 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:04.470117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5bbf2074-1816-45cc-a0c2-b442d71caa40 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:04.610688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5bbf2074-1816-45cc-a0c2-b442d71caa40 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:04.619359 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5bbf2074-1816-45cc-a0c2-b442d71caa40 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1358 microversion: 2.1 time: 0.166620 Oct 12 23:10:04.620263 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3495/7640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:04 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:05.647403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8120cf56-73e9-4783-8a15-4f27d80fa996 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:05.648022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8120cf56-73e9-4783-8a15-4f27d80fa996 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:05.654876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8120cf56-73e9-4783-8a15-4f27d80fa996 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:05.655456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8120cf56-73e9-4783-8a15-4f27d80fa996 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:05.655896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8120cf56-73e9-4783-8a15-4f27d80fa996 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:05.656587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8120cf56-73e9-4783-8a15-4f27d80fa996 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:05.657040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8120cf56-73e9-4783-8a15-4f27d80fa996 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:05.657467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8120cf56-73e9-4783-8a15-4f27d80fa996 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:05.789043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8120cf56-73e9-4783-8a15-4f27d80fa996 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:05.796688 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8120cf56-73e9-4783-8a15-4f27d80fa996 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1358 microversion: 2.1 time: 0.153213 Oct 12 23:10:05.797250 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4146/7641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:05 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:06.821013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-552606d5-cb64-4d77-b0f0-47ddd6215a54 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:06.821650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-552606d5-cb64-4d77-b0f0-47ddd6215a54 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:06.824335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:06.825158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:06.830788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-552606d5-cb64-4d77-b0f0-47ddd6215a54 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:06.831308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-552606d5-cb64-4d77-b0f0-47ddd6215a54 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:06.831768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-552606d5-cb64-4d77-b0f0-47ddd6215a54 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:06.832474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-552606d5-cb64-4d77-b0f0-47ddd6215a54 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:06.832942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-552606d5-cb64-4d77-b0f0-47ddd6215a54 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:06.833383 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-552606d5-cb64-4d77-b0f0-47ddd6215a54 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:06.959782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-552606d5-cb64-4d77-b0f0-47ddd6215a54 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:06.967401 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-552606d5-cb64-4d77-b0f0-47ddd6215a54 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1358 microversion: 2.1 time: 0.150942 Oct 12 23:10:06.967969 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3496/7642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:06 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:07.991067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0fb25d6c-bd95-45cf-a288-7af0dc9f86ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:07.991751 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0fb25d6c-bd95-45cf-a288-7af0dc9f86ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:07.993559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:08.000076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0fb25d6c-bd95-45cf-a288-7af0dc9f86ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:08.000565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0fb25d6c-bd95-45cf-a288-7af0dc9f86ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:08.001008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0fb25d6c-bd95-45cf-a288-7af0dc9f86ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:08.001706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0fb25d6c-bd95-45cf-a288-7af0dc9f86ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:08.002169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0fb25d6c-bd95-45cf-a288-7af0dc9f86ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:08.002604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0fb25d6c-bd95-45cf-a288-7af0dc9f86ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:08.128633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0fb25d6c-bd95-45cf-a288-7af0dc9f86ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:08.136849 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0fb25d6c-bd95-45cf-a288-7af0dc9f86ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1358 microversion: 2.1 time: 0.150375 Oct 12 23:10:08.137414 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4147/7643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:07 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:09.161373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-69208c46-508e-41ce-935b-b25109267e85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:09.162193 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-69208c46-508e-41ce-935b-b25109267e85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:09.169005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69208c46-508e-41ce-935b-b25109267e85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:09.169509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69208c46-508e-41ce-935b-b25109267e85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:09.169960 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69208c46-508e-41ce-935b-b25109267e85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:09.170669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69208c46-508e-41ce-935b-b25109267e85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:09.171133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69208c46-508e-41ce-935b-b25109267e85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:09.171600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69208c46-508e-41ce-935b-b25109267e85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:09.310893 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-6c7ac3fa-a960-4b2a-ae35-f1c7421ed78a req-f634c08f-7998-451a-9a63-196556d216f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8765cb63-0dac-406e-8e2e-b2091d43edb1", "tag": "65d48100-feac-44f8-95dc-cfa713cb2e58"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:09.322814 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6c7ac3fa-a960-4b2a-ae35-f1c7421ed78a req-f634c08f-7998-451a-9a63-196556d216f8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:09.323318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6c7ac3fa-a960-4b2a-ae35-f1c7421ed78a req-f634c08f-7998-451a-9a63-196556d216f8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:09.323757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6c7ac3fa-a960-4b2a-ae35-f1c7421ed78a req-f634c08f-7998-451a-9a63-196556d216f8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:09.336419 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6c7ac3fa-a960-4b2a-ae35-f1c7421ed78a req-f634c08f-7998-451a-9a63-196556d216f8 service nova] Creating event network-changed:65d48100-feac-44f8-95dc-cfa713cb2e58 for instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 on n-h2-861111-1 Oct 12 23:10:09.341354 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-6c7ac3fa-a960-4b2a-ae35-f1c7421ed78a req-f634c08f-7998-451a-9a63-196556d216f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034399 Oct 12 23:10:09.341971 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4148/7644] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:10:09.411660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-69208c46-508e-41ce-935b-b25109267e85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:09.419389 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-69208c46-508e-41ce-935b-b25109267e85 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1358 microversion: 2.1 time: 0.262426 Oct 12 23:10:09.419971 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3497/7645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:09 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:10.444008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-83e1ef99-9b03-4e71-b5cb-1f2c8868e238 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:10.444670 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-83e1ef99-9b03-4e71-b5cb-1f2c8868e238 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:10.450790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83e1ef99-9b03-4e71-b5cb-1f2c8868e238 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:10.451313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83e1ef99-9b03-4e71-b5cb-1f2c8868e238 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:10.451755 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83e1ef99-9b03-4e71-b5cb-1f2c8868e238 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:10.452454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83e1ef99-9b03-4e71-b5cb-1f2c8868e238 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:10.452914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83e1ef99-9b03-4e71-b5cb-1f2c8868e238 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:10.453345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-83e1ef99-9b03-4e71-b5cb-1f2c8868e238 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:10.582463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-83e1ef99-9b03-4e71-b5cb-1f2c8868e238 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:10.590118 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-83e1ef99-9b03-4e71-b5cb-1f2c8868e238 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1358 microversion: 2.1 time: 0.151402 Oct 12 23:10:10.590692 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4149/7646] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:10 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:11.612850 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d20ef0dc-5262-4bd8-b4fd-c45087ae21e4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:11.614045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d20ef0dc-5262-4bd8-b4fd-c45087ae21e4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:11.621137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d20ef0dc-5262-4bd8-b4fd-c45087ae21e4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:11.621886 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d20ef0dc-5262-4bd8-b4fd-c45087ae21e4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:11.622338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d20ef0dc-5262-4bd8-b4fd-c45087ae21e4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:11.623047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d20ef0dc-5262-4bd8-b4fd-c45087ae21e4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:11.623534 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d20ef0dc-5262-4bd8-b4fd-c45087ae21e4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:11.623969 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d20ef0dc-5262-4bd8-b4fd-c45087ae21e4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:11.861873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d20ef0dc-5262-4bd8-b4fd-c45087ae21e4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:11.869721 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d20ef0dc-5262-4bd8-b4fd-c45087ae21e4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1358 microversion: 2.1 time: 0.260780 Oct 12 23:10:11.870219 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3498/7647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:11 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:12.893158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c620b1a0-2adc-4893-abe7-6610f2a1baa3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:12.893840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c620b1a0-2adc-4893-abe7-6610f2a1baa3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:12.900735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c620b1a0-2adc-4893-abe7-6610f2a1baa3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:12.901222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c620b1a0-2adc-4893-abe7-6610f2a1baa3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:12.901742 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c620b1a0-2adc-4893-abe7-6610f2a1baa3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:12.902485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c620b1a0-2adc-4893-abe7-6610f2a1baa3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:12.902943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c620b1a0-2adc-4893-abe7-6610f2a1baa3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:12.903419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c620b1a0-2adc-4893-abe7-6610f2a1baa3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:13.034002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c620b1a0-2adc-4893-abe7-6610f2a1baa3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:13.042621 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c620b1a0-2adc-4893-abe7-6610f2a1baa3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1358 microversion: 2.1 time: 0.153431 Oct 12 23:10:13.043205 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4150/7648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:12 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:14.066671 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-112e2f28-0f6e-4b30-8569-9c461eb5ea6d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:14.067333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-112e2f28-0f6e-4b30-8569-9c461eb5ea6d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:14.074024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-112e2f28-0f6e-4b30-8569-9c461eb5ea6d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:14.074523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-112e2f28-0f6e-4b30-8569-9c461eb5ea6d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:14.074972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-112e2f28-0f6e-4b30-8569-9c461eb5ea6d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:14.075711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-112e2f28-0f6e-4b30-8569-9c461eb5ea6d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:14.076298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-112e2f28-0f6e-4b30-8569-9c461eb5ea6d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:14.076742 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-112e2f28-0f6e-4b30-8569-9c461eb5ea6d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:14.207898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-112e2f28-0f6e-4b30-8569-9c461eb5ea6d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:14.215679 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-112e2f28-0f6e-4b30-8569-9c461eb5ea6d tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1358 microversion: 2.1 time: 0.153450 Oct 12 23:10:14.216246 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3499/7649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:14 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:15.238912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4a4147d2-63aa-4deb-9ef2-4649cb12f2ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:15.239544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4a4147d2-63aa-4deb-9ef2-4649cb12f2ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:15.247077 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a4147d2-63aa-4deb-9ef2-4649cb12f2ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:15.247635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a4147d2-63aa-4deb-9ef2-4649cb12f2ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:15.248099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a4147d2-63aa-4deb-9ef2-4649cb12f2ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:15.248809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a4147d2-63aa-4deb-9ef2-4649cb12f2ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:15.249275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a4147d2-63aa-4deb-9ef2-4649cb12f2ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:15.249709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4a4147d2-63aa-4deb-9ef2-4649cb12f2ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:15.380294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4a4147d2-63aa-4deb-9ef2-4649cb12f2ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:15.387953 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4a4147d2-63aa-4deb-9ef2-4649cb12f2ad tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1358 microversion: 2.1 time: 0.153855 Oct 12 23:10:15.388533 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4151/7650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:15 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:16.168033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-ca8fc37d-a169-4f5f-838c-78f25a07bfe2 req-5c9524c9-654e-449d-a41a-e62780965baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8765cb63-0dac-406e-8e2e-b2091d43edb1", "name": "network-vif-plugged", "status": "completed", "tag": "65d48100-feac-44f8-95dc-cfa713cb2e58"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:16.177928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ca8fc37d-a169-4f5f-838c-78f25a07bfe2 req-5c9524c9-654e-449d-a41a-e62780965baf service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:16.178415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ca8fc37d-a169-4f5f-838c-78f25a07bfe2 req-5c9524c9-654e-449d-a41a-e62780965baf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:16.178854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ca8fc37d-a169-4f5f-838c-78f25a07bfe2 req-5c9524c9-654e-449d-a41a-e62780965baf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:16.193027 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-ca8fc37d-a169-4f5f-838c-78f25a07bfe2 req-5c9524c9-654e-449d-a41a-e62780965baf service nova] Creating event network-vif-plugged:65d48100-feac-44f8-95dc-cfa713cb2e58 for instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 on n-h2-861111-1 Oct 12 23:10:16.198154 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-ca8fc37d-a169-4f5f-838c-78f25a07bfe2 req-5c9524c9-654e-449d-a41a-e62780965baf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097745 Oct 12 23:10:16.198760 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3500/7651] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:10:16.410663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1f747116-a57d-4abf-bba1-a2a0ad3e9ca6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:16.411320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1f747116-a57d-4abf-bba1-a2a0ad3e9ca6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:16.418092 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f747116-a57d-4abf-bba1-a2a0ad3e9ca6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:16.418577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f747116-a57d-4abf-bba1-a2a0ad3e9ca6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:16.419020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f747116-a57d-4abf-bba1-a2a0ad3e9ca6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:16.419753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f747116-a57d-4abf-bba1-a2a0ad3e9ca6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:16.420211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f747116-a57d-4abf-bba1-a2a0ad3e9ca6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:16.420643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1f747116-a57d-4abf-bba1-a2a0ad3e9ca6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:16.550206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1f747116-a57d-4abf-bba1-a2a0ad3e9ca6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:16.558528 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1f747116-a57d-4abf-bba1-a2a0ad3e9ca6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1358 microversion: 2.1 time: 0.151880 Oct 12 23:10:16.559103 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4152/7652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:16 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:17.585043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d108a8b1-1056-47de-ba43-158c36668c36 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:17.585768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d108a8b1-1056-47de-ba43-158c36668c36 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:17.592278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d108a8b1-1056-47de-ba43-158c36668c36 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:17.592790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d108a8b1-1056-47de-ba43-158c36668c36 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:17.593927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d108a8b1-1056-47de-ba43-158c36668c36 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:17.594073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d108a8b1-1056-47de-ba43-158c36668c36 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:17.594471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d108a8b1-1056-47de-ba43-158c36668c36 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:17.595203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d108a8b1-1056-47de-ba43-158c36668c36 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:17.734747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d108a8b1-1056-47de-ba43-158c36668c36 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:17.743519 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d108a8b1-1056-47de-ba43-158c36668c36 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1358 microversion: 2.1 time: 0.164398 Oct 12 23:10:17.744101 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3501/7653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:17 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:18.767586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b3e1a13b-acd6-4c3b-8ee4-878a94bd94a8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:18.768214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b3e1a13b-acd6-4c3b-8ee4-878a94bd94a8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:18.775632 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3e1a13b-acd6-4c3b-8ee4-878a94bd94a8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:18.776118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3e1a13b-acd6-4c3b-8ee4-878a94bd94a8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:18.776559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3e1a13b-acd6-4c3b-8ee4-878a94bd94a8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:18.777253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3e1a13b-acd6-4c3b-8ee4-878a94bd94a8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:18.777709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3e1a13b-acd6-4c3b-8ee4-878a94bd94a8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:18.778138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b3e1a13b-acd6-4c3b-8ee4-878a94bd94a8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:18.904180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b3e1a13b-acd6-4c3b-8ee4-878a94bd94a8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:18.912563 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b3e1a13b-acd6-4c3b-8ee4-878a94bd94a8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1549 microversion: 2.1 time: 0.148985 Oct 12 23:10:18.913147 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4153/7654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:18 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:18.935418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-48439916-2817-49c1-b222-017192dda9aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:18.936068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-48439916-2817-49c1-b222-017192dda9aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:18.942716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48439916-2817-49c1-b222-017192dda9aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:18.943205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48439916-2817-49c1-b222-017192dda9aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:18.943686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48439916-2817-49c1-b222-017192dda9aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:18.944413 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48439916-2817-49c1-b222-017192dda9aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:18.944871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48439916-2817-49c1-b222-017192dda9aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:18.945308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48439916-2817-49c1-b222-017192dda9aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:19.070283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-48439916-2817-49c1-b222-017192dda9aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:19.077982 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-48439916-2817-49c1-b222-017192dda9aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1549 microversion: 2.1 time: 0.146431 Oct 12 23:10:19.078561 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3502/7655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:18 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:19.100274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-33f094ff-139b-4c09-b38d-78b5bf121011 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:19.105048 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-33f094ff-139b-4c09-b38d-78b5bf121011 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:19.105816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-33f094ff-139b-4c09-b38d-78b5bf121011 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Searching by: {'deleted': False, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763'} {{(pid=120453) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 23:10:19.111028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33f094ff-139b-4c09-b38d-78b5bf121011 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:19.111536 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33f094ff-139b-4c09-b38d-78b5bf121011 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:19.111988 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33f094ff-139b-4c09-b38d-78b5bf121011 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:19.112689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33f094ff-139b-4c09-b38d-78b5bf121011 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:19.113140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33f094ff-139b-4c09-b38d-78b5bf121011 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:19.113564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-33f094ff-139b-4c09-b38d-78b5bf121011 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:19.137127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.multi_cell_list [None req-33f094ff-139b-4c09-b38d-78b5bf121011 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 23:10:19.163430 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-33f094ff-139b-4c09-b38d-78b5bf121011 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.067514 Oct 12 23:10:19.163998 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4154/7656] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 12 23:10:19 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:10:19.175769 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d15b6f0c-01d9-47a0-924f-3be06b47c4aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:19.177137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d15b6f0c-01d9-47a0-924f-3be06b47c4aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:19.183418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d15b6f0c-01d9-47a0-924f-3be06b47c4aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:19.183951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d15b6f0c-01d9-47a0-924f-3be06b47c4aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:19.184405 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d15b6f0c-01d9-47a0-924f-3be06b47c4aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:19.185115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d15b6f0c-01d9-47a0-924f-3be06b47c4aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:19.185584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d15b6f0c-01d9-47a0-924f-3be06b47c4aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:19.186035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d15b6f0c-01d9-47a0-924f-3be06b47c4aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:19.315668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d15b6f0c-01d9-47a0-924f-3be06b47c4aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:19.323357 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d15b6f0c-01d9-47a0-924f-3be06b47c4aa tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1549 microversion: 2.1 time: 0.151476 Oct 12 23:10:19.323935 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3503/7657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:19 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:20.825143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d843fa8e-c26a-4981-923f-83f617f54319 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d34d3c9-1eea-4e4d-ac26-63a220b4496d"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:20.827523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d843fa8e-c26a-4981-923f-83f617f54319 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:20.834408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d843fa8e-c26a-4981-923f-83f617f54319 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:20.834896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d843fa8e-c26a-4981-923f-83f617f54319 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:20.835376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d843fa8e-c26a-4981-923f-83f617f54319 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:20.836075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d843fa8e-c26a-4981-923f-83f617f54319 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:20.836531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d843fa8e-c26a-4981-923f-83f617f54319 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:20.836960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d843fa8e-c26a-4981-923f-83f617f54319 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:21.067008 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d843fa8e-c26a-4981-923f-83f617f54319 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "POST /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245698 Oct 12 23:10:21.068149 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4155/7658] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 12 23:10:20 2022] POST /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:10:31.837033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-345ef317-f2d2-4fdd-96e5-3bd63e0c30f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:31.837705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-345ef317-f2d2-4fdd-96e5-3bd63e0c30f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:31.839870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=19 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:31.840548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=70 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:31.847003 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-345ef317-f2d2-4fdd-96e5-3bd63e0c30f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:31.847544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-345ef317-f2d2-4fdd-96e5-3bd63e0c30f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:31.848075 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-345ef317-f2d2-4fdd-96e5-3bd63e0c30f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:31.848750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-345ef317-f2d2-4fdd-96e5-3bd63e0c30f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:31.849228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-345ef317-f2d2-4fdd-96e5-3bd63e0c30f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:31.849673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-345ef317-f2d2-4fdd-96e5-3bd63e0c30f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:31.977377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-345ef317-f2d2-4fdd-96e5-3bd63e0c30f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:31.985493 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-345ef317-f2d2-4fdd-96e5-3bd63e0c30f8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1595 microversion: 2.1 time: 0.153243 Oct 12 23:10:31.986054 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3504/7659] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:31 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1595 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:33.939527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-ad0ac5ce-159f-40f5-890f-4f22621abfdb req-f2c15fb4-435a-42ee-8165-74060b028b16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8765cb63-0dac-406e-8e2e-b2091d43edb1", "tag": "65d48100-feac-44f8-95dc-cfa713cb2e58"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:33.946790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:33.947856 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=21 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:33.948551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:33.954605 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ad0ac5ce-159f-40f5-890f-4f22621abfdb req-f2c15fb4-435a-42ee-8165-74060b028b16 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:33.955117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ad0ac5ce-159f-40f5-890f-4f22621abfdb req-f2c15fb4-435a-42ee-8165-74060b028b16 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:33.955542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-ad0ac5ce-159f-40f5-890f-4f22621abfdb req-f2c15fb4-435a-42ee-8165-74060b028b16 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:33.969088 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-ad0ac5ce-159f-40f5-890f-4f22621abfdb req-f2c15fb4-435a-42ee-8165-74060b028b16 service nova] Creating event network-changed:65d48100-feac-44f8-95dc-cfa713cb2e58 for instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 on n-h2-861111-1 Oct 12 23:10:33.974143 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-ad0ac5ce-159f-40f5-890f-4f22621abfdb req-f2c15fb4-435a-42ee-8165-74060b028b16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038823 Oct 12 23:10:33.975132 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4156/7660] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:10:34.968171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-10f8bd84-26f9-44b8-9a8d-70cb8ab611a6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1732425367"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:34.968655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-10f8bd84-26f9-44b8-9a8d-70cb8ab611a6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:34.977250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10f8bd84-26f9-44b8-9a8d-70cb8ab611a6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:34.977760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10f8bd84-26f9-44b8-9a8d-70cb8ab611a6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:34.978209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10f8bd84-26f9-44b8-9a8d-70cb8ab611a6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:34.978932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10f8bd84-26f9-44b8-9a8d-70cb8ab611a6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:34.979432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10f8bd84-26f9-44b8-9a8d-70cb8ab611a6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:34.979877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10f8bd84-26f9-44b8-9a8d-70cb8ab611a6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:35.114814 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.network.security_group_api [None req-10f8bd84-26f9-44b8-9a8d-70cb8ab611a6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Adding security group 17d2d74d-37cd-43f5-9772-5297f7916b66 to port 65d48100-feac-44f8-95dc-cfa713cb2e58 Oct 12 23:10:35.423901 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-10f8bd84-26f9-44b8-9a8d-70cb8ab611a6 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "POST /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/action" status: 202 len: 0 microversion: 2.1 time: 0.459790 Oct 12 23:10:35.424837 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3505/7661] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:10:34 2022] POST /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:10:35.433303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ed4c5345-131c-41d1-9086-b4dd07011f51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:35.434609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ed4c5345-131c-41d1-9086-b4dd07011f51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:35.443452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed4c5345-131c-41d1-9086-b4dd07011f51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:35.445648 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed4c5345-131c-41d1-9086-b4dd07011f51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:35.446256 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed4c5345-131c-41d1-9086-b4dd07011f51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:35.447327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed4c5345-131c-41d1-9086-b4dd07011f51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:35.447607 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed4c5345-131c-41d1-9086-b4dd07011f51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:35.448039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ed4c5345-131c-41d1-9086-b4dd07011f51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:35.603752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ed4c5345-131c-41d1-9086-b4dd07011f51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:35.612489 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ed4c5345-131c-41d1-9086-b4dd07011f51 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1761 microversion: 2.1 time: 0.183376 Oct 12 23:10:35.613096 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4157/7662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:35 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1761 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:35.991857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-18e370b4-9f0a-4574-9096-a8e5edbbe6a9 req-45709ca7-2511-4715-a1ef-02251df98f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8765cb63-0dac-406e-8e2e-b2091d43edb1", "tag": "65d48100-feac-44f8-95dc-cfa713cb2e58"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:36.001763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-18e370b4-9f0a-4574-9096-a8e5edbbe6a9 req-45709ca7-2511-4715-a1ef-02251df98f57 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:36.002330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-18e370b4-9f0a-4574-9096-a8e5edbbe6a9 req-45709ca7-2511-4715-a1ef-02251df98f57 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:36.002781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-18e370b4-9f0a-4574-9096-a8e5edbbe6a9 req-45709ca7-2511-4715-a1ef-02251df98f57 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:36.014658 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-18e370b4-9f0a-4574-9096-a8e5edbbe6a9 req-45709ca7-2511-4715-a1ef-02251df98f57 service nova] Creating event network-changed:65d48100-feac-44f8-95dc-cfa713cb2e58 for instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 on n-h2-861111-1 Oct 12 23:10:36.019727 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-18e370b4-9f0a-4574-9096-a8e5edbbe6a9 req-45709ca7-2511-4715-a1ef-02251df98f57 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033031 Oct 12 23:10:36.020316 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3506/7663] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:23.683263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bfb5b498-d5df-4337-b104-0460cc856904 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:23.685492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bfb5b498-d5df-4337-b104-0460cc856904 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:23.687909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:23.688688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=8 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:23.689769 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:11:23.689907 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 23:11:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/action (ip 10.222.0.16) !!! Oct 12 23:11:23.699706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfb5b498-d5df-4337-b104-0460cc856904 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:23.700196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfb5b498-d5df-4337-b104-0460cc856904 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:23.700643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfb5b498-d5df-4337-b104-0460cc856904 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:23.701346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfb5b498-d5df-4337-b104-0460cc856904 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:23.701805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfb5b498-d5df-4337-b104-0460cc856904 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:23.702240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bfb5b498-d5df-4337-b104-0460cc856904 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:23.775985 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bfb5b498-d5df-4337-b104-0460cc856904 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "POST /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/action" status: 202 len: 0 microversion: 2.1 time: 0.096648 Oct 12 23:11:23.777006 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4158/7664] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:11:23 2022] POST /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:11:23.783619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:23.784381 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=12 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:23.789684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2ac0086f-d0b5-4059-8aaf-8d4134a404a4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:23.790397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2ac0086f-d0b5-4059-8aaf-8d4134a404a4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:23.797735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ac0086f-d0b5-4059-8aaf-8d4134a404a4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:23.798235 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ac0086f-d0b5-4059-8aaf-8d4134a404a4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:23.798682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ac0086f-d0b5-4059-8aaf-8d4134a404a4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:23.799421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ac0086f-d0b5-4059-8aaf-8d4134a404a4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:23.799888 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ac0086f-d0b5-4059-8aaf-8d4134a404a4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:23.800321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2ac0086f-d0b5-4059-8aaf-8d4134a404a4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:24.036294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2ac0086f-d0b5-4059-8aaf-8d4134a404a4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:24.044508 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2ac0086f-d0b5-4059-8aaf-8d4134a404a4 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1753 microversion: 2.1 time: 0.262934 Oct 12 23:11:24.045285 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3507/7665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:23 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1753 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:25.068579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e74fc8d8-283b-4e1c-b564-9a34927065cb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:25.069219 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e74fc8d8-283b-4e1c-b564-9a34927065cb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:25.076639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e74fc8d8-283b-4e1c-b564-9a34927065cb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:25.077118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e74fc8d8-283b-4e1c-b564-9a34927065cb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:25.077556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e74fc8d8-283b-4e1c-b564-9a34927065cb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:25.078239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e74fc8d8-283b-4e1c-b564-9a34927065cb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:25.078684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e74fc8d8-283b-4e1c-b564-9a34927065cb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:25.079107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e74fc8d8-283b-4e1c-b564-9a34927065cb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:25.220779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e74fc8d8-283b-4e1c-b564-9a34927065cb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:25.229650 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e74fc8d8-283b-4e1c-b564-9a34927065cb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1758 microversion: 2.1 time: 0.165429 Oct 12 23:11:25.230227 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4159/7666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:25 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:26.252995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2795d49d-d6ec-4db9-b6ab-54d229279aed tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:26.253655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2795d49d-d6ec-4db9-b6ab-54d229279aed tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:26.260560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2795d49d-d6ec-4db9-b6ab-54d229279aed tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:26.261057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2795d49d-d6ec-4db9-b6ab-54d229279aed tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:26.261506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2795d49d-d6ec-4db9-b6ab-54d229279aed tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:26.262251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2795d49d-d6ec-4db9-b6ab-54d229279aed tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:26.262768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2795d49d-d6ec-4db9-b6ab-54d229279aed tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:26.263275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2795d49d-d6ec-4db9-b6ab-54d229279aed tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:26.410018 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2795d49d-d6ec-4db9-b6ab-54d229279aed tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:26.418865 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2795d49d-d6ec-4db9-b6ab-54d229279aed tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1758 microversion: 2.1 time: 0.169813 Oct 12 23:11:26.419494 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3508/7667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:26 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:27.442823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-87e11c68-b8b6-4598-92b3-f40d00f5cfdb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:27.444113 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-87e11c68-b8b6-4598-92b3-f40d00f5cfdb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:27.451051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e11c68-b8b6-4598-92b3-f40d00f5cfdb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:27.451563 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e11c68-b8b6-4598-92b3-f40d00f5cfdb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:27.452006 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e11c68-b8b6-4598-92b3-f40d00f5cfdb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:27.452707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e11c68-b8b6-4598-92b3-f40d00f5cfdb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:27.453193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e11c68-b8b6-4598-92b3-f40d00f5cfdb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:27.453623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-87e11c68-b8b6-4598-92b3-f40d00f5cfdb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:27.596111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-87e11c68-b8b6-4598-92b3-f40d00f5cfdb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:27.604284 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-87e11c68-b8b6-4598-92b3-f40d00f5cfdb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1758 microversion: 2.1 time: 0.165447 Oct 12 23:11:27.604866 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4160/7668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:27 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:28.628898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-38352234-d297-4726-b1a4-81a38c3810e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:28.629533 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-38352234-d297-4726-b1a4-81a38c3810e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:28.636485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38352234-d297-4726-b1a4-81a38c3810e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:28.636985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38352234-d297-4726-b1a4-81a38c3810e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:28.637446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38352234-d297-4726-b1a4-81a38c3810e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:28.638264 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38352234-d297-4726-b1a4-81a38c3810e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:28.638777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38352234-d297-4726-b1a4-81a38c3810e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:28.639339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-38352234-d297-4726-b1a4-81a38c3810e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:28.779579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-38352234-d297-4726-b1a4-81a38c3810e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:28.788528 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-38352234-d297-4726-b1a4-81a38c3810e8 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1758 microversion: 2.1 time: 0.163550 Oct 12 23:11:28.789097 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3509/7669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:28 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:29.812523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b8115df3-b3ab-4504-96eb-40b44025c150 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:29.813140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b8115df3-b3ab-4504-96eb-40b44025c150 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:29.819630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8115df3-b3ab-4504-96eb-40b44025c150 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:29.820110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8115df3-b3ab-4504-96eb-40b44025c150 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:29.820565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8115df3-b3ab-4504-96eb-40b44025c150 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:29.821231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8115df3-b3ab-4504-96eb-40b44025c150 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:29.821682 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8115df3-b3ab-4504-96eb-40b44025c150 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:29.822106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b8115df3-b3ab-4504-96eb-40b44025c150 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:29.960730 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b8115df3-b3ab-4504-96eb-40b44025c150 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:29.968898 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b8115df3-b3ab-4504-96eb-40b44025c150 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1758 microversion: 2.1 time: 0.160283 Oct 12 23:11:29.969464 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4161/7670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:29 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:30.992978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-535eb334-f2a4-4c6d-87e3-67a516f7fa1a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:30.993611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-535eb334-f2a4-4c6d-87e3-67a516f7fa1a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:31.000000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-535eb334-f2a4-4c6d-87e3-67a516f7fa1a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:31.000496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-535eb334-f2a4-4c6d-87e3-67a516f7fa1a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:31.000948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-535eb334-f2a4-4c6d-87e3-67a516f7fa1a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:31.001649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-535eb334-f2a4-4c6d-87e3-67a516f7fa1a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:31.002113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-535eb334-f2a4-4c6d-87e3-67a516f7fa1a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:31.002553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-535eb334-f2a4-4c6d-87e3-67a516f7fa1a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:31.143216 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-535eb334-f2a4-4c6d-87e3-67a516f7fa1a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:31.151516 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-535eb334-f2a4-4c6d-87e3-67a516f7fa1a tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1758 microversion: 2.1 time: 0.163268 Oct 12 23:11:31.152089 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3510/7671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:30 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:32.174109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-41cedd70-9675-4ce3-a756-42f31c454e6b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:32.174686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-41cedd70-9675-4ce3-a756-42f31c454e6b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:32.181521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41cedd70-9675-4ce3-a756-42f31c454e6b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:32.182007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41cedd70-9675-4ce3-a756-42f31c454e6b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:32.182473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41cedd70-9675-4ce3-a756-42f31c454e6b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:32.183162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41cedd70-9675-4ce3-a756-42f31c454e6b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:32.183643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41cedd70-9675-4ce3-a756-42f31c454e6b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:32.184069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-41cedd70-9675-4ce3-a756-42f31c454e6b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:32.324338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-41cedd70-9675-4ce3-a756-42f31c454e6b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:32.332613 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-41cedd70-9675-4ce3-a756-42f31c454e6b tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1758 microversion: 2.1 time: 0.162506 Oct 12 23:11:32.333185 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4162/7672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:32 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:33.357196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-71f234d3-6673-49e0-9767-6c16f3416fd9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:33.357751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-71f234d3-6673-49e0-9767-6c16f3416fd9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:33.364525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71f234d3-6673-49e0-9767-6c16f3416fd9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:33.365045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71f234d3-6673-49e0-9767-6c16f3416fd9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:33.365511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71f234d3-6673-49e0-9767-6c16f3416fd9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:33.366211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71f234d3-6673-49e0-9767-6c16f3416fd9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:33.366668 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71f234d3-6673-49e0-9767-6c16f3416fd9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:33.367104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71f234d3-6673-49e0-9767-6c16f3416fd9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:33.507964 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-71f234d3-6673-49e0-9767-6c16f3416fd9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:33.516241 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-71f234d3-6673-49e0-9767-6c16f3416fd9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1758 microversion: 2.1 time: 0.163063 Oct 12 23:11:33.516800 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3511/7673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:33 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:34.540387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-71399b65-8650-4a64-845d-8b4305951620 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:34.541009 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-71399b65-8650-4a64-845d-8b4305951620 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:34.547982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71399b65-8650-4a64-845d-8b4305951620 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:34.548498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71399b65-8650-4a64-845d-8b4305951620 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:34.549114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71399b65-8650-4a64-845d-8b4305951620 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:34.550014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71399b65-8650-4a64-845d-8b4305951620 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:34.550470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71399b65-8650-4a64-845d-8b4305951620 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:34.550904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-71399b65-8650-4a64-845d-8b4305951620 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:34.696821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-71399b65-8650-4a64-845d-8b4305951620 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:34.705102 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-71399b65-8650-4a64-845d-8b4305951620 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1758 microversion: 2.1 time: 0.169160 Oct 12 23:11:34.705685 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4163/7674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:34 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:35.728859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2b549315-d00b-444c-a815-b7c8356985ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:35.729593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2b549315-d00b-444c-a815-b7c8356985ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:35.736340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b549315-d00b-444c-a815-b7c8356985ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:35.736833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b549315-d00b-444c-a815-b7c8356985ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:35.737277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b549315-d00b-444c-a815-b7c8356985ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:35.737981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b549315-d00b-444c-a815-b7c8356985ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:35.738471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b549315-d00b-444c-a815-b7c8356985ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:35.738884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2b549315-d00b-444c-a815-b7c8356985ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:35.885105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2b549315-d00b-444c-a815-b7c8356985ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:35.893426 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2b549315-d00b-444c-a815-b7c8356985ea tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1758 microversion: 2.1 time: 0.168616 Oct 12 23:11:35.893989 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3512/7675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:35 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:36.916792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2cb5b1c0-ada4-481d-810f-9dbf9b7a84ee tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:36.917406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2cb5b1c0-ada4-481d-810f-9dbf9b7a84ee tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:36.924259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb5b1c0-ada4-481d-810f-9dbf9b7a84ee tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:36.924739 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb5b1c0-ada4-481d-810f-9dbf9b7a84ee tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:36.925168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb5b1c0-ada4-481d-810f-9dbf9b7a84ee tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:36.925851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb5b1c0-ada4-481d-810f-9dbf9b7a84ee tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:36.926302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb5b1c0-ada4-481d-810f-9dbf9b7a84ee tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:36.926725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2cb5b1c0-ada4-481d-810f-9dbf9b7a84ee tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:37.067131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2cb5b1c0-ada4-481d-810f-9dbf9b7a84ee tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:37.075919 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2cb5b1c0-ada4-481d-810f-9dbf9b7a84ee tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1758 microversion: 2.1 time: 0.163067 Oct 12 23:11:37.076486 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4164/7676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:36 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:38.099147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-90817e32-d82f-4ceb-9459-fbaabd1606d9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:38.099982 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-90817e32-d82f-4ceb-9459-fbaabd1606d9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:38.107546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90817e32-d82f-4ceb-9459-fbaabd1606d9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:38.108043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90817e32-d82f-4ceb-9459-fbaabd1606d9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:38.108490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90817e32-d82f-4ceb-9459-fbaabd1606d9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:38.109192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90817e32-d82f-4ceb-9459-fbaabd1606d9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:38.109654 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90817e32-d82f-4ceb-9459-fbaabd1606d9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:38.110133 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90817e32-d82f-4ceb-9459-fbaabd1606d9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:38.248239 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-90817e32-d82f-4ceb-9459-fbaabd1606d9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:38.256386 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-90817e32-d82f-4ceb-9459-fbaabd1606d9 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1758 microversion: 2.1 time: 0.161313 Oct 12 23:11:38.257455 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3513/7677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:38 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:39.280981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-51288918-1fab-423e-9060-e453523ef23f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:39.281534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-51288918-1fab-423e-9060-e453523ef23f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:39.288318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51288918-1fab-423e-9060-e453523ef23f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:39.288799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51288918-1fab-423e-9060-e453523ef23f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:39.289236 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51288918-1fab-423e-9060-e453523ef23f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:39.289932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51288918-1fab-423e-9060-e453523ef23f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:39.290382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51288918-1fab-423e-9060-e453523ef23f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:39.290803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-51288918-1fab-423e-9060-e453523ef23f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:39.436259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-51288918-1fab-423e-9060-e453523ef23f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:39.444660 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-51288918-1fab-423e-9060-e453523ef23f tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1758 microversion: 2.1 time: 0.167722 Oct 12 23:11:39.445232 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4165/7678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:39 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:40.468956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2dfd8cb0-8ab3-4a79-a717-feea8e55b125 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:40.469623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2dfd8cb0-8ab3-4a79-a717-feea8e55b125 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:40.476496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2dfd8cb0-8ab3-4a79-a717-feea8e55b125 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:40.476994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2dfd8cb0-8ab3-4a79-a717-feea8e55b125 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:40.477452 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2dfd8cb0-8ab3-4a79-a717-feea8e55b125 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:40.478168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2dfd8cb0-8ab3-4a79-a717-feea8e55b125 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:40.478637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2dfd8cb0-8ab3-4a79-a717-feea8e55b125 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:40.479078 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2dfd8cb0-8ab3-4a79-a717-feea8e55b125 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:40.620315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2dfd8cb0-8ab3-4a79-a717-feea8e55b125 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:40.628902 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2dfd8cb0-8ab3-4a79-a717-feea8e55b125 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1761 microversion: 2.1 time: 0.163883 Oct 12 23:11:40.629473 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3514/7679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:40 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1761 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:43.843137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=16 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:12:43.843929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:12:43.848847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6cbbbd33-6555-4d47-985b-042de73e406c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1732425367"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:43.849379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6cbbbd33-6555-4d47-985b-042de73e406c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:43.856867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cbbbd33-6555-4d47-985b-042de73e406c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:43.857332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cbbbd33-6555-4d47-985b-042de73e406c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:43.857768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cbbbd33-6555-4d47-985b-042de73e406c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:43.858455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cbbbd33-6555-4d47-985b-042de73e406c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:43.858904 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cbbbd33-6555-4d47-985b-042de73e406c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:43.859369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6cbbbd33-6555-4d47-985b-042de73e406c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:43.986250 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.network.security_group_api [None req-6cbbbd33-6555-4d47-985b-042de73e406c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Removing security group 17d2d74d-37cd-43f5-9772-5297f7916b66 from port 65d48100-feac-44f8-95dc-cfa713cb2e58 Oct 12 23:12:44.285721 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6cbbbd33-6555-4d47-985b-042de73e406c tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "POST /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/action" status: 202 len: 0 microversion: 2.1 time: 0.444419 Oct 12 23:12:44.286557 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4166/7680] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:12:43 2022] POST /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:12:44.414012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=16 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:12:44.415006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=48 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:12:44.486171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-5bf74c3f-5b5c-4d60-85c5-bb0c4b6cf174 req-26bfb6d6-ef0a-48b7-8fc9-e289d57540df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8765cb63-0dac-406e-8e2e-b2091d43edb1", "tag": "65d48100-feac-44f8-95dc-cfa713cb2e58"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:44.498572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5bf74c3f-5b5c-4d60-85c5-bb0c4b6cf174 req-26bfb6d6-ef0a-48b7-8fc9-e289d57540df service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:44.499122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5bf74c3f-5b5c-4d60-85c5-bb0c4b6cf174 req-26bfb6d6-ef0a-48b7-8fc9-e289d57540df service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:44.499611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5bf74c3f-5b5c-4d60-85c5-bb0c4b6cf174 req-26bfb6d6-ef0a-48b7-8fc9-e289d57540df service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:44.513661 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-5bf74c3f-5b5c-4d60-85c5-bb0c4b6cf174 req-26bfb6d6-ef0a-48b7-8fc9-e289d57540df service nova] Creating event network-changed:65d48100-feac-44f8-95dc-cfa713cb2e58 for instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 on n-h2-861111-1 Oct 12 23:12:44.519631 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-5bf74c3f-5b5c-4d60-85c5-bb0c4b6cf174 req-26bfb6d6-ef0a-48b7-8fc9-e289d57540df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108756 Oct 12 23:12:44.520960 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3515/7681] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:12:45.769352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-adf02586-261d-4747-92fb-952ac307a786 req-08d54ad2-0459-4c14-a331-ccfe32635812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8765cb63-0dac-406e-8e2e-b2091d43edb1", "tag": "65d48100-feac-44f8-95dc-cfa713cb2e58"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:45.776652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3d2ff140-77c2-4fe6-b117-e2506348f448 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:45.777163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3d2ff140-77c2-4fe6-b117-e2506348f448 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:45.784340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d2ff140-77c2-4fe6-b117-e2506348f448 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:45.784836 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d2ff140-77c2-4fe6-b117-e2506348f448 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:45.785278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d2ff140-77c2-4fe6-b117-e2506348f448 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:45.785989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d2ff140-77c2-4fe6-b117-e2506348f448 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:45.786444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d2ff140-77c2-4fe6-b117-e2506348f448 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:45.786872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3d2ff140-77c2-4fe6-b117-e2506348f448 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:45.795230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-adf02586-261d-4747-92fb-952ac307a786 req-08d54ad2-0459-4c14-a331-ccfe32635812 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:45.795754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-adf02586-261d-4747-92fb-952ac307a786 req-08d54ad2-0459-4c14-a331-ccfe32635812 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:45.796189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-adf02586-261d-4747-92fb-952ac307a786 req-08d54ad2-0459-4c14-a331-ccfe32635812 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:45.807468 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-adf02586-261d-4747-92fb-952ac307a786 req-08d54ad2-0459-4c14-a331-ccfe32635812 service nova] Creating event network-changed:65d48100-feac-44f8-95dc-cfa713cb2e58 for instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 on n-h2-861111-1 Oct 12 23:12:45.812394 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-adf02586-261d-4747-92fb-952ac307a786 req-08d54ad2-0459-4c14-a331-ccfe32635812 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048086 Oct 12 23:12:45.812994 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3516/7682] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:12:45.884621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-3d2ff140-77c2-4fe6-b117-e2506348f448 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lazy-loading 'services' on Instance uuid 8765cb63-0dac-406e-8e2e-b2091d43edb1 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:12:45.966700 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3d2ff140-77c2-4fe6-b117-e2506348f448 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments/7d34d3c9-1eea-4e4d-ac26-63a220b4496d" status: 202 len: 0 microversion: 2.1 time: 0.205272 Oct 12 23:12:45.967953 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4167/7683] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 23:12:45 2022] DELETE /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments/7d34d3c9-1eea-4e4d-ac26-63a220b4496d => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:12:45.983634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bf39e852-6216-4e9b-bccd-9da966f7d329 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:45.987787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bf39e852-6216-4e9b-bccd-9da966f7d329 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:45.997387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf39e852-6216-4e9b-bccd-9da966f7d329 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:45.998339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf39e852-6216-4e9b-bccd-9da966f7d329 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:45.998961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf39e852-6216-4e9b-bccd-9da966f7d329 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:46.000067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf39e852-6216-4e9b-bccd-9da966f7d329 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:46.000768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf39e852-6216-4e9b-bccd-9da966f7d329 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:46.001414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf39e852-6216-4e9b-bccd-9da966f7d329 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:46.041293 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bf39e852-6216-4e9b-bccd-9da966f7d329 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067657 Oct 12 23:12:46.041882 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3517/7684] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:12:45 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:12:47.055672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4d9e05fc-3c2f-40d3-92c8-adec57376808 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:47.058307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4d9e05fc-3c2f-40d3-92c8-adec57376808 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:47.065443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d9e05fc-3c2f-40d3-92c8-adec57376808 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:47.066015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d9e05fc-3c2f-40d3-92c8-adec57376808 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:47.066549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d9e05fc-3c2f-40d3-92c8-adec57376808 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:47.067389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d9e05fc-3c2f-40d3-92c8-adec57376808 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:47.067947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d9e05fc-3c2f-40d3-92c8-adec57376808 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:47.068438 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d9e05fc-3c2f-40d3-92c8-adec57376808 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:47.098899 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4d9e05fc-3c2f-40d3-92c8-adec57376808 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048604 Oct 12 23:12:47.099648 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4168/7685] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:12:47 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:12:48.113014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3587cc1d-eb06-479a-ad80-0d1647e015a3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:48.115923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3587cc1d-eb06-479a-ad80-0d1647e015a3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:48.122919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3587cc1d-eb06-479a-ad80-0d1647e015a3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:48.123448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3587cc1d-eb06-479a-ad80-0d1647e015a3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:48.123900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3587cc1d-eb06-479a-ad80-0d1647e015a3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:48.124604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3587cc1d-eb06-479a-ad80-0d1647e015a3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:48.125067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3587cc1d-eb06-479a-ad80-0d1647e015a3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:48.125498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3587cc1d-eb06-479a-ad80-0d1647e015a3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:48.153939 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3587cc1d-eb06-479a-ad80-0d1647e015a3 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044929 Oct 12 23:12:48.154496 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3518/7686] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:12:48 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:12:49.166282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4d1225f2-d198-42e7-a659-282b7805c8e0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:49.169029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4d1225f2-d198-42e7-a659-282b7805c8e0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:49.175982 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d1225f2-d198-42e7-a659-282b7805c8e0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:49.176475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d1225f2-d198-42e7-a659-282b7805c8e0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:49.176946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d1225f2-d198-42e7-a659-282b7805c8e0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:49.177649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d1225f2-d198-42e7-a659-282b7805c8e0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:49.178604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d1225f2-d198-42e7-a659-282b7805c8e0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:49.179047 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4d1225f2-d198-42e7-a659-282b7805c8e0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:49.212007 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4d1225f2-d198-42e7-a659-282b7805c8e0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049829 Oct 12 23:12:49.212577 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4169/7687] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:12:49 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:12:50.225274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-66f23a93-8d56-4c9c-b6fc-5f1b9a9ff172 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:50.227446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-66f23a93-8d56-4c9c-b6fc-5f1b9a9ff172 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:50.234269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66f23a93-8d56-4c9c-b6fc-5f1b9a9ff172 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:50.234763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66f23a93-8d56-4c9c-b6fc-5f1b9a9ff172 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:50.235226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66f23a93-8d56-4c9c-b6fc-5f1b9a9ff172 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:50.235937 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66f23a93-8d56-4c9c-b6fc-5f1b9a9ff172 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:50.236401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66f23a93-8d56-4c9c-b6fc-5f1b9a9ff172 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:50.236836 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66f23a93-8d56-4c9c-b6fc-5f1b9a9ff172 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:50.266514 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-66f23a93-8d56-4c9c-b6fc-5f1b9a9ff172 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045770 Oct 12 23:12:50.267084 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3519/7688] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:12:50 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:12:51.279492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d4734d79-c7c0-4855-9129-780ac245f0f0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:51.281683 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d4734d79-c7c0-4855-9129-780ac245f0f0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:51.288471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4734d79-c7c0-4855-9129-780ac245f0f0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:51.288961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4734d79-c7c0-4855-9129-780ac245f0f0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:51.289429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4734d79-c7c0-4855-9129-780ac245f0f0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:51.290108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4734d79-c7c0-4855-9129-780ac245f0f0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:51.290567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4734d79-c7c0-4855-9129-780ac245f0f0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:51.290998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d4734d79-c7c0-4855-9129-780ac245f0f0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:51.320104 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d4734d79-c7c0-4855-9129-780ac245f0f0 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044564 Oct 12 23:12:51.320597 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4170/7689] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 12 23:12:51 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:12:51.331490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0d00d0a1-a721-46ee-a51f-7d35eae91aeb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:51.331997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0d00d0a1-a721-46ee-a51f-7d35eae91aeb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:51.338768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d00d0a1-a721-46ee-a51f-7d35eae91aeb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:51.339294 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d00d0a1-a721-46ee-a51f-7d35eae91aeb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:51.339749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d00d0a1-a721-46ee-a51f-7d35eae91aeb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:51.340457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d00d0a1-a721-46ee-a51f-7d35eae91aeb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:51.340929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d00d0a1-a721-46ee-a51f-7d35eae91aeb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:51.341371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d00d0a1-a721-46ee-a51f-7d35eae91aeb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:51.414848 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-0d00d0a1-a721-46ee-a51f-7d35eae91aeb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] HTTP exception thrown: Instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 is not attached to volume 7d34d3c9-1eea-4e4d-ac26-63a220b4496d Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0d00d0a1-a721-46ee-a51f-7d35eae91aeb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Request method failure captured: Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments/7d34d3c9-1eea-4e4d-ac26-63a220b4496d HTTP/1.1 Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0gRUA6Rha7F7Gj3JtQyZi6vWW2vUDOqd0K1xl0APntjM4eLjtey8fU94eQwLjlbYtEMn3YOh5iTTyqVJsTIDIWeRbdXIzoZci4eP6oNCBJHphPWIGcbacY0tACquGuzMk505eZ2fll1Xadwpqe0eP8oL84jmd9Q4cgDnv_Jlw8es5g Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: cea0d2fdebb74c388a4eae1183dc4763 Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestMinimumBasicScenario-465247151 Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cea0d2fdebb74c388a4eae1183dc4763"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cea0d2fdebb74c388a4eae1183dc4763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cea0d2fdebb74c388a4eae1183dc4763", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cea0d2fdebb74c388a4eae1183dc4763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestMinimumBasicScenario-465247151 Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: cea0d2fdebb74c388a4eae1183dc4763 Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestMinimumBasicScenario-465247151 Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestMinimumBasicScenario-465247151-project Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: b204f4c9508e4a30aab167cca736ed3e Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestMinimumBasicScenario-465247151-project Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 is not attached to volume 7d34d3c9-1eea-4e4d-ac26-63a220b4496d Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'server_id': '8765cb63-0dac-406e-8e2e-b2091d43edb1', 'id': '7d34d3c9-1eea-4e4d-ac26-63a220b4496d'} Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7d34d3c9-1eea-4e4d-ac26-63a220b4496d. Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 is not attached to volume 7d34d3c9-1eea-4e4d-ac26-63a220b4496d Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:12:51.416500 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:12:51.421424 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:12:51.421424 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:12:51.421424 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 is not attached to volume 7d34d3c9-1eea-4e4d-ac26-63a220b4496d Oct 12 23:12:51.421424 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:12:51.421424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0d00d0a1-a721-46ee-a51f-7d35eae91aeb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Returning 404 to user: Instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 is not attached to volume 7d34d3c9-1eea-4e4d-ac26-63a220b4496d {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:12:51.421424 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0d00d0a1-a721-46ee-a51f-7d35eae91aeb tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments/7d34d3c9-1eea-4e4d-ac26-63a220b4496d" status: 404 len: 154 microversion: 2.1 time: 0.090656 Oct 12 23:12:51.421424 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3520/7690] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 12 23:12:51 2022] DELETE /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1/os-volume_attachments/7d34d3c9-1eea-4e4d-ac26-63a220b4496d => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:12:54.674860 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-461d0d27-e1d3-470f-ba72-78ef8c2e2a96 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:54.675406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-461d0d27-e1d3-470f-ba72-78ef8c2e2a96 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:54.682871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-461d0d27-e1d3-470f-ba72-78ef8c2e2a96 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:54.683494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-461d0d27-e1d3-470f-ba72-78ef8c2e2a96 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:54.683940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-461d0d27-e1d3-470f-ba72-78ef8c2e2a96 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:54.684643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-461d0d27-e1d3-470f-ba72-78ef8c2e2a96 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:54.685102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-461d0d27-e1d3-470f-ba72-78ef8c2e2a96 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:54.685534 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-461d0d27-e1d3-470f-ba72-78ef8c2e2a96 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:54.712709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-461d0d27-e1d3-470f-ba72-78ef8c2e2a96 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:12:54.795715 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-461d0d27-e1d3-470f-ba72-78ef8c2e2a96 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 204 len: 0 microversion: 2.1 time: 0.123908 Oct 12 23:12:54.796693 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4171/7691] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:12:54 2022] DELETE /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:12:54.805419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-267414a0-54fd-4b08-8065-4932405759c1 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:54.806251 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-267414a0-54fd-4b08-8065-4932405759c1 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:54.815372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-267414a0-54fd-4b08-8065-4932405759c1 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:54.815948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-267414a0-54fd-4b08-8065-4932405759c1 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:54.816560 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-267414a0-54fd-4b08-8065-4932405759c1 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:54.817337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-267414a0-54fd-4b08-8065-4932405759c1 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:54.817868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-267414a0-54fd-4b08-8065-4932405759c1 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:54.818523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-267414a0-54fd-4b08-8065-4932405759c1 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:54.953603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-267414a0-54fd-4b08-8065-4932405759c1 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:54.962259 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-267414a0-54fd-4b08-8065-4932405759c1 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1555 microversion: 2.1 time: 0.161456 Oct 12 23:12:54.968607 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3521/7692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:54 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:55.987056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a52b70f2-0a66-4b68-b6a7-4e29f27e1b64 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:55.987708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a52b70f2-0a66-4b68-b6a7-4e29f27e1b64 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:55.995257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a52b70f2-0a66-4b68-b6a7-4e29f27e1b64 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:55.995753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a52b70f2-0a66-4b68-b6a7-4e29f27e1b64 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:55.996225 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a52b70f2-0a66-4b68-b6a7-4e29f27e1b64 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:55.996912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a52b70f2-0a66-4b68-b6a7-4e29f27e1b64 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:55.997364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a52b70f2-0a66-4b68-b6a7-4e29f27e1b64 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:55.998046 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a52b70f2-0a66-4b68-b6a7-4e29f27e1b64 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:56.127610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a52b70f2-0a66-4b68-b6a7-4e29f27e1b64 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:56.135945 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a52b70f2-0a66-4b68-b6a7-4e29f27e1b64 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1555 microversion: 2.1 time: 0.153329 Oct 12 23:12:56.136518 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4172/7693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:55 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:56.987870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-77e196d8-ffa2-45c0-b0e2-a9cb486106c0 req-d2cda63d-056c-429a-b673-e1926d35027f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8765cb63-0dac-406e-8e2e-b2091d43edb1", "name": "network-vif-deleted", "tag": "65d48100-feac-44f8-95dc-cfa713cb2e58"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:57.000443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-77e196d8-ffa2-45c0-b0e2-a9cb486106c0 req-d2cda63d-056c-429a-b673-e1926d35027f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:57.001207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-77e196d8-ffa2-45c0-b0e2-a9cb486106c0 req-d2cda63d-056c-429a-b673-e1926d35027f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:57.001430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-77e196d8-ffa2-45c0-b0e2-a9cb486106c0 req-d2cda63d-056c-429a-b673-e1926d35027f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:57.013690 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-77e196d8-ffa2-45c0-b0e2-a9cb486106c0 req-d2cda63d-056c-429a-b673-e1926d35027f service nova] Creating event network-vif-deleted:65d48100-feac-44f8-95dc-cfa713cb2e58 for instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 on n-h2-861111-1 Oct 12 23:12:57.018653 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-77e196d8-ffa2-45c0-b0e2-a9cb486106c0 req-d2cda63d-056c-429a-b673-e1926d35027f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034820 Oct 12 23:12:57.019264 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3522/7694] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:12:57.157870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1d244f7b-c2a0-4872-9f73-7047e555b293 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:57.158503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1d244f7b-c2a0-4872-9f73-7047e555b293 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:57.165830 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d244f7b-c2a0-4872-9f73-7047e555b293 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:57.166317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d244f7b-c2a0-4872-9f73-7047e555b293 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:57.166756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d244f7b-c2a0-4872-9f73-7047e555b293 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:57.167512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d244f7b-c2a0-4872-9f73-7047e555b293 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:57.167972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d244f7b-c2a0-4872-9f73-7047e555b293 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:57.168410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d244f7b-c2a0-4872-9f73-7047e555b293 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:57.198550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d244f7b-c2a0-4872-9f73-7047e555b293 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:57.198937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d244f7b-c2a0-4872-9f73-7047e555b293 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:57.199415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1d244f7b-c2a0-4872-9f73-7047e555b293 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:57.199864 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-1d244f7b-c2a0-4872-9f73-7047e555b293 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lazy-loading 'fault' on Instance uuid 8765cb63-0dac-406e-8e2e-b2091d43edb1 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:12:57.239882 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1d244f7b-c2a0-4872-9f73-7047e555b293 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b204f4c9508e4a30aab167cca736ed3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea0d2fdebb74c388a4eae1183dc4763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:57.248631 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1d244f7b-c2a0-4872-9f73-7047e555b293 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 200 len: 1348 microversion: 2.1 time: 0.094720 Oct 12 23:12:57.249247 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4173/7695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:57 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:58.273576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cfe6189e-6ebc-434e-b129-6da135da3556 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:58.274288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cfe6189e-6ebc-434e-b129-6da135da3556 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [instance: 8765cb63-0dac-406e-8e2e-b2091d43edb1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:58.280432 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfe6189e-6ebc-434e-b129-6da135da3556 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:58.280922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfe6189e-6ebc-434e-b129-6da135da3556 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:58.281370 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfe6189e-6ebc-434e-b129-6da135da3556 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:58.282066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfe6189e-6ebc-434e-b129-6da135da3556 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:58.282526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfe6189e-6ebc-434e-b129-6da135da3556 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:58.282958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfe6189e-6ebc-434e-b129-6da135da3556 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:58.295932 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-cfe6189e-6ebc-434e-b129-6da135da3556 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] HTTP exception thrown: Instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 could not be found. Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cfe6189e-6ebc-434e-b129-6da135da3556 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Request method failure captured: Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 HTTP/1.1 Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0gRUA6Rha7F7Gj3JtQyZi6vWW2vUDOqd0K1xl0APntjM4eLjtey8fU94eQwLjlbYtEMn3YOh5iTTyqVJsTIDIWeRbdXIzoZci4eP6oNCBJHphPWIGcbacY0tACquGuzMk505eZ2fll1Xadwpqe0eP8oL84jmd9Q4cgDnv_Jlw8es5g Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: cea0d2fdebb74c388a4eae1183dc4763 Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestMinimumBasicScenario-465247151 Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cea0d2fdebb74c388a4eae1183dc4763"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cea0d2fdebb74c388a4eae1183dc4763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cea0d2fdebb74c388a4eae1183dc4763", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cea0d2fdebb74c388a4eae1183dc4763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestMinimumBasicScenario-465247151 Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: cea0d2fdebb74c388a4eae1183dc4763 Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestMinimumBasicScenario-465247151 Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestMinimumBasicScenario-465247151-project Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: b204f4c9508e4a30aab167cca736ed3e Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestMinimumBasicScenario-465247151-project Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 could not be found. Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '8765cb63-0dac-406e-8e2e-b2091d43edb1'} Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 could not be found. Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 could not be found. Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:12:58.297573 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:12:58.301989 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:12:58.301989 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:12:58.301989 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:12:58.301989 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:12:58.301989 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:12:58.301989 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 could not be found. Oct 12 23:12:58.301989 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:12:58.301989 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cfe6189e-6ebc-434e-b129-6da135da3556 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Returning 404 to user: Instance 8765cb63-0dac-406e-8e2e-b2091d43edb1 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:12:58.301989 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cfe6189e-6ebc-434e-b129-6da135da3556 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1" status: 404 len: 111 microversion: 2.1 time: 0.030538 Oct 12 23:12:58.301989 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3523/7696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:58 2022] GET /compute/v2.1/servers/8765cb63-0dac-406e-8e2e-b2091d43edb1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:12:58.308374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dc7c2342-4708-4bba-a05b-c8ddb4588312 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] Calling method '.version_select at 0x7f512826ca60>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:58.312937 n-d-861111-1 devstack@n-api.service[120453]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dc7c2342-4708-4bba-a05b-c8ddb4588312 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [55e88b13-f8be-4c2c-80f9-a8b0dda35e96] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:12:59.319994 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [None req-dc7c2342-4708-4bba-a05b-c8ddb4588312 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] [55e88b13-f8be-4c2c-80f9-a8b0dda35e96] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39086. Oct 12 23:12:59.340339 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dc7c2342-4708-4bba-a05b-c8ddb4588312 tempest-TestMinimumBasicScenario-465247151 tempest-TestMinimumBasicScenario-465247151-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1079549168" status: 202 len: 0 microversion: 2.1 time: 1.035765 Oct 12 23:12:59.340929 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4174/7697] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 12 23:12:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1079549168 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:13:08.403919 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:13:08.404464 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 23:13:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.16) !!! Oct 12 23:13:08.405202 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:13:08.405310 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 23:13:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.16) !!! Oct 12 23:13:08.406739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=18 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:08.407509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=38 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:08.565794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a9b34960-942f-4d26-85a9-1410c3caa572 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'create', calling method: .version_select at 0x7f51231591f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1167885305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4W42e+Ec+dGdg4CKtKKtM7x9iMsuFk2YlyRbIVZxFuZqPKKLlFKFKKViX7GswGHW5ztGacgO0CDP308cCx7BOFd23shQU83W7PIlAdigIWRs051osvNbIzSnqEqkufRg=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:08.582283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-a9b34960-942f-4d26-85a9-1410c3caa572 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:13:08.587365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-a9b34960-942f-4d26-85a9-1410c3caa572 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for user 764c04554c2a4616bf01531df31e717e and project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:13:08.614332 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a9b34960-942f-4d26-85a9-1410c3caa572 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.215598 Oct 12 23:13:08.615521 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3524/7698] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 23:13:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:14.277843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:14.279147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:14.283482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1744313284", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "f5f506b0-43c8-4d67-bce6-ce2c6dcf2989"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1167885305", "security_groups": [{"name": "tempest-secgroup-smoke-1955787599"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:14.546657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] validate_networks() for [('f5f506b0-43c8-4d67-bce6-ce2c6dcf2989', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:13:14.993932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:13:14.994357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:13:14.994834 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:13:14.995294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:13:14.995844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:13:15.005181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:15.005668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:15.006127 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:15.006847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:15.007327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:15.007753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:15.024604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:13:15.029823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for user 764c04554c2a4616bf01531df31e717e and project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:13:15.042774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:13:15.045137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:13:15.101303 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-534eb5cd-ce5b-4b25-84b5-95c059af991b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.825807 Oct 12 23:13:15.107256 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4175/7699] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 23:13:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:13:15.128916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-76e10da3-c4b5-4108-bece-d0129494cc0c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:15.135594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-76e10da3-c4b5-4108-bece-d0129494cc0c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:15.217755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-76e10da3-c4b5-4108-bece-d0129494cc0c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:15.227725 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-76e10da3-c4b5-4108-bece-d0129494cc0c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1267 microversion: 2.1 time: 0.115092 Oct 12 23:13:15.244895 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3525/7700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:15 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:16.253125 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-508a6a18-b6d7-4fc2-a894-60dfbd768fc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:16.253848 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-508a6a18-b6d7-4fc2-a894-60dfbd768fc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:16.261803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-508a6a18-b6d7-4fc2-a894-60dfbd768fc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:16.262336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-508a6a18-b6d7-4fc2-a894-60dfbd768fc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:16.262957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-508a6a18-b6d7-4fc2-a894-60dfbd768fc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:16.263771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-508a6a18-b6d7-4fc2-a894-60dfbd768fc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:16.264346 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-508a6a18-b6d7-4fc2-a894-60dfbd768fc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:16.264828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-508a6a18-b6d7-4fc2-a894-60dfbd768fc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:16.345824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-508a6a18-b6d7-4fc2-a894-60dfbd768fc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:16.357880 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-508a6a18-b6d7-4fc2-a894-60dfbd768fc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1327 microversion: 2.1 time: 0.109739 Oct 12 23:13:16.363284 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4176/7701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:16 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1327 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:17.384069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-776379a5-5f70-4620-be41-0b3402881104 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:17.385821 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-776379a5-5f70-4620-be41-0b3402881104 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:17.400457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-776379a5-5f70-4620-be41-0b3402881104 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:17.401656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-776379a5-5f70-4620-be41-0b3402881104 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:17.402356 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-776379a5-5f70-4620-be41-0b3402881104 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:17.403618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-776379a5-5f70-4620-be41-0b3402881104 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:17.404451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-776379a5-5f70-4620-be41-0b3402881104 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:17.405461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-776379a5-5f70-4620-be41-0b3402881104 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:18.036765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-776379a5-5f70-4620-be41-0b3402881104 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:18.049171 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-776379a5-5f70-4620-be41-0b3402881104 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1393 microversion: 2.1 time: 0.670859 Oct 12 23:13:18.050002 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3526/7702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:17 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1393 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:18.201309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-79a9420e-6145-4f84-a44b-640b977943a7 req-2b23fb80-e01b-4bab-a857-ee13428e218c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c", "tag": "f378d84d-d783-4be4-9e33-c52ba8bc2cac"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:18.213825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-79a9420e-6145-4f84-a44b-640b977943a7 req-2b23fb80-e01b-4bab-a857-ee13428e218c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:18.214309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-79a9420e-6145-4f84-a44b-640b977943a7 req-2b23fb80-e01b-4bab-a857-ee13428e218c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:18.214764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-79a9420e-6145-4f84-a44b-640b977943a7 req-2b23fb80-e01b-4bab-a857-ee13428e218c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:18.227953 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-79a9420e-6145-4f84-a44b-640b977943a7 req-2b23fb80-e01b-4bab-a857-ee13428e218c service nova] Creating event network-changed:f378d84d-d783-4be4-9e33-c52ba8bc2cac for instance 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c on n-h2-861111-1 Oct 12 23:13:18.233074 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-79a9420e-6145-4f84-a44b-640b977943a7 req-2b23fb80-e01b-4bab-a857-ee13428e218c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035722 Oct 12 23:13:18.233693 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4177/7703] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:19.075972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a547125-d8da-4ec6-aee1-8104ea32d5ae tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:19.076648 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7a547125-d8da-4ec6-aee1-8104ea32d5ae tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:19.083702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a547125-d8da-4ec6-aee1-8104ea32d5ae tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:19.084205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a547125-d8da-4ec6-aee1-8104ea32d5ae tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:19.084661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a547125-d8da-4ec6-aee1-8104ea32d5ae tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:19.085377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a547125-d8da-4ec6-aee1-8104ea32d5ae tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:19.085851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a547125-d8da-4ec6-aee1-8104ea32d5ae tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:19.086295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a547125-d8da-4ec6-aee1-8104ea32d5ae tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:19.218275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a547125-d8da-4ec6-aee1-8104ea32d5ae tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:19.226591 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7a547125-d8da-4ec6-aee1-8104ea32d5ae tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1393 microversion: 2.1 time: 0.154606 Oct 12 23:13:19.227167 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3527/7704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:19 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:20.251085 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ef362282-8a5e-49d3-b434-59d3bbc281eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:20.251823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ef362282-8a5e-49d3-b434-59d3bbc281eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:20.258568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef362282-8a5e-49d3-b434-59d3bbc281eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:20.259055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef362282-8a5e-49d3-b434-59d3bbc281eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:20.259531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef362282-8a5e-49d3-b434-59d3bbc281eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:20.260228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef362282-8a5e-49d3-b434-59d3bbc281eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:20.260689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef362282-8a5e-49d3-b434-59d3bbc281eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:20.261124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ef362282-8a5e-49d3-b434-59d3bbc281eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:20.395304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ef362282-8a5e-49d3-b434-59d3bbc281eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:20.403532 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ef362282-8a5e-49d3-b434-59d3bbc281eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1393 microversion: 2.1 time: 0.157756 Oct 12 23:13:20.404097 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4178/7705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:20 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:21.426082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dab3b94d-a159-4db4-a05e-e903dfefbef9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:21.426625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dab3b94d-a159-4db4-a05e-e903dfefbef9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:21.434402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dab3b94d-a159-4db4-a05e-e903dfefbef9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:21.434897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dab3b94d-a159-4db4-a05e-e903dfefbef9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:21.435373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dab3b94d-a159-4db4-a05e-e903dfefbef9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:21.436077 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dab3b94d-a159-4db4-a05e-e903dfefbef9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:21.436542 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dab3b94d-a159-4db4-a05e-e903dfefbef9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:21.436979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dab3b94d-a159-4db4-a05e-e903dfefbef9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:21.569685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dab3b94d-a159-4db4-a05e-e903dfefbef9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:21.577727 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dab3b94d-a159-4db4-a05e-e903dfefbef9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1393 microversion: 2.1 time: 0.155338 Oct 12 23:13:21.578008 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3528/7706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:21 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:22.600621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ca72bd06-d8f6-475d-a0d6-21e888bc04af tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:22.601240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ca72bd06-d8f6-475d-a0d6-21e888bc04af tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:22.607993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca72bd06-d8f6-475d-a0d6-21e888bc04af tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:22.608477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca72bd06-d8f6-475d-a0d6-21e888bc04af tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:22.608917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca72bd06-d8f6-475d-a0d6-21e888bc04af tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:22.609610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca72bd06-d8f6-475d-a0d6-21e888bc04af tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:22.610067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca72bd06-d8f6-475d-a0d6-21e888bc04af tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:22.610495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ca72bd06-d8f6-475d-a0d6-21e888bc04af tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:22.738051 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ca72bd06-d8f6-475d-a0d6-21e888bc04af tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:22.746287 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ca72bd06-d8f6-475d-a0d6-21e888bc04af tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1393 microversion: 2.1 time: 0.150162 Oct 12 23:13:22.746860 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4179/7707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:22 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1393 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:23.152404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-6db59ee4-2872-41dd-ade7-d5acdb210594 req-f9edcd2f-b8f8-4b9f-ba5d-acc93b915f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c", "name": "network-vif-plugged", "status": "completed", "tag": "f378d84d-d783-4be4-9e33-c52ba8bc2cac"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:23.165017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6db59ee4-2872-41dd-ade7-d5acdb210594 req-f9edcd2f-b8f8-4b9f-ba5d-acc93b915f8d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:23.165514 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6db59ee4-2872-41dd-ade7-d5acdb210594 req-f9edcd2f-b8f8-4b9f-ba5d-acc93b915f8d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:23.166150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6db59ee4-2872-41dd-ade7-d5acdb210594 req-f9edcd2f-b8f8-4b9f-ba5d-acc93b915f8d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:23.177746 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-6db59ee4-2872-41dd-ade7-d5acdb210594 req-f9edcd2f-b8f8-4b9f-ba5d-acc93b915f8d service nova] Creating event network-vif-plugged:f378d84d-d783-4be4-9e33-c52ba8bc2cac for instance 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c on n-h2-861111-1 Oct 12 23:13:23.182981 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-6db59ee4-2872-41dd-ade7-d5acdb210594 req-f9edcd2f-b8f8-4b9f-ba5d-acc93b915f8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034339 Oct 12 23:13:23.183869 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3529/7708] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:23.768812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-398d73d0-e204-4e67-82bc-74a3894d33bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:23.769705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-398d73d0-e204-4e67-82bc-74a3894d33bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:23.776553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-398d73d0-e204-4e67-82bc-74a3894d33bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:23.777033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-398d73d0-e204-4e67-82bc-74a3894d33bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:23.777504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-398d73d0-e204-4e67-82bc-74a3894d33bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:23.778199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-398d73d0-e204-4e67-82bc-74a3894d33bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:23.778653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-398d73d0-e204-4e67-82bc-74a3894d33bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:23.779078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-398d73d0-e204-4e67-82bc-74a3894d33bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:23.907434 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-398d73d0-e204-4e67-82bc-74a3894d33bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:23.915725 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-398d73d0-e204-4e67-82bc-74a3894d33bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1393 microversion: 2.1 time: 0.150805 Oct 12 23:13:23.916292 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4180/7709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:23 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:24.939837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-46cc638b-8854-4d97-95ff-d50575769948 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:24.940548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-46cc638b-8854-4d97-95ff-d50575769948 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:24.948117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46cc638b-8854-4d97-95ff-d50575769948 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:24.948614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46cc638b-8854-4d97-95ff-d50575769948 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:24.949088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46cc638b-8854-4d97-95ff-d50575769948 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:24.949787 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46cc638b-8854-4d97-95ff-d50575769948 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:24.950250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46cc638b-8854-4d97-95ff-d50575769948 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:24.950681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46cc638b-8854-4d97-95ff-d50575769948 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:25.084210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-46cc638b-8854-4d97-95ff-d50575769948 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:25.091945 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-46cc638b-8854-4d97-95ff-d50575769948 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1566 microversion: 2.1 time: 0.156431 Oct 12 23:13:25.092508 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3530/7710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:24 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:13:25.113865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3522f043-3dd3-4de5-a137-9ea625b8fb2c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:25.114480 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3522f043-3dd3-4de5-a137-9ea625b8fb2c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:25.117789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:25.118640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:25.125147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3522f043-3dd3-4de5-a137-9ea625b8fb2c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:25.125665 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3522f043-3dd3-4de5-a137-9ea625b8fb2c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:25.126129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3522f043-3dd3-4de5-a137-9ea625b8fb2c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:25.126858 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3522f043-3dd3-4de5-a137-9ea625b8fb2c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:25.127343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3522f043-3dd3-4de5-a137-9ea625b8fb2c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:25.127777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3522f043-3dd3-4de5-a137-9ea625b8fb2c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:25.262033 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3522f043-3dd3-4de5-a137-9ea625b8fb2c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:25.269787 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3522f043-3dd3-4de5-a137-9ea625b8fb2c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1566 microversion: 2.1 time: 0.159773 Oct 12 23:13:25.270357 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4181/7711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:25 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:26.815683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6f50220b-795a-40a2-9c72-3a05520c7b29 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:26.816318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6f50220b-795a-40a2-9c72-3a05520c7b29 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:26.818313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:26.826183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-72303798-afa8-496c-a1f7-2be192dc2889 req-45184ad7-4705-4575-8953-eb5aa2c0d9bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c", "tag": "f378d84d-d783-4be4-9e33-c52ba8bc2cac"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:26.837015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f50220b-795a-40a2-9c72-3a05520c7b29 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:26.837527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f50220b-795a-40a2-9c72-3a05520c7b29 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:26.837985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f50220b-795a-40a2-9c72-3a05520c7b29 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:26.838705 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f50220b-795a-40a2-9c72-3a05520c7b29 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:26.839175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f50220b-795a-40a2-9c72-3a05520c7b29 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:26.839643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f50220b-795a-40a2-9c72-3a05520c7b29 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:26.846835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-72303798-afa8-496c-a1f7-2be192dc2889 req-45184ad7-4705-4575-8953-eb5aa2c0d9bc service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:26.847327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-72303798-afa8-496c-a1f7-2be192dc2889 req-45184ad7-4705-4575-8953-eb5aa2c0d9bc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:26.847765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-72303798-afa8-496c-a1f7-2be192dc2889 req-45184ad7-4705-4575-8953-eb5aa2c0d9bc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:26.859939 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-72303798-afa8-496c-a1f7-2be192dc2889 req-45184ad7-4705-4575-8953-eb5aa2c0d9bc service nova] Creating event network-changed:f378d84d-d783-4be4-9e33-c52ba8bc2cac for instance 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c on n-h2-861111-1 Oct 12 23:13:26.865002 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-72303798-afa8-496c-a1f7-2be192dc2889 req-45184ad7-4705-4575-8953-eb5aa2c0d9bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042442 Oct 12 23:13:26.865720 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4182/7712] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:27.072666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6f50220b-795a-40a2-9c72-3a05520c7b29 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:27.081036 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6f50220b-795a-40a2-9c72-3a05520c7b29 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1566 microversion: 2.1 time: 0.269363 Oct 12 23:13:27.081803 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3531/7713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:26 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1566 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:00.386688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:00.387500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=36 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:00.392470 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9eb93731-77b2-4418-8260-24ddd8cdeaaf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:00.394706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9eb93731-77b2-4418-8260-24ddd8cdeaaf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:00.402685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eb93731-77b2-4418-8260-24ddd8cdeaaf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:00.403174 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eb93731-77b2-4418-8260-24ddd8cdeaaf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:00.403633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eb93731-77b2-4418-8260-24ddd8cdeaaf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:00.404319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eb93731-77b2-4418-8260-24ddd8cdeaaf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:00.404773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eb93731-77b2-4418-8260-24ddd8cdeaaf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:00.405197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eb93731-77b2-4418-8260-24ddd8cdeaaf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:00.463775 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9eb93731-77b2-4418-8260-24ddd8cdeaaf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c/action" status: 200 len: 24566 microversion: 2.1 time: 0.079347 Oct 12 23:14:00.464426 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4183/7714] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:14:00 2022] POST /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c/action => generated 24566 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:14:30.842999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:30.843847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=32 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:30.848302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3588fbe8-9c8a-44a9-a118-ce3f41c4bc73 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:30.848848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3588fbe8-9c8a-44a9-a118-ce3f41c4bc73 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:30.855936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3588fbe8-9c8a-44a9-a118-ce3f41c4bc73 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:30.856436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3588fbe8-9c8a-44a9-a118-ce3f41c4bc73 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:30.856889 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3588fbe8-9c8a-44a9-a118-ce3f41c4bc73 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:30.857597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3588fbe8-9c8a-44a9-a118-ce3f41c4bc73 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:30.858062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3588fbe8-9c8a-44a9-a118-ce3f41c4bc73 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:30.858503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3588fbe8-9c8a-44a9-a118-ce3f41c4bc73 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:30.926001 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3588fbe8-9c8a-44a9-a118-ce3f41c4bc73 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.084593 Oct 12 23:14:30.926643 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3532/7715] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:14:30 2022] POST /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:14:30.936217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3754b74b-e80a-44aa-ad71-e78d5bd6423b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:30.936924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3754b74b-e80a-44aa-ad71-e78d5bd6423b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:30.939680 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:30.940482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:30.945761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3754b74b-e80a-44aa-ad71-e78d5bd6423b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:30.946224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3754b74b-e80a-44aa-ad71-e78d5bd6423b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:30.946656 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3754b74b-e80a-44aa-ad71-e78d5bd6423b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:30.947373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3754b74b-e80a-44aa-ad71-e78d5bd6423b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:30.947825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3754b74b-e80a-44aa-ad71-e78d5bd6423b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:30.948250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3754b74b-e80a-44aa-ad71-e78d5bd6423b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:31.081141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3754b74b-e80a-44aa-ad71-e78d5bd6423b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:31.089707 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3754b74b-e80a-44aa-ad71-e78d5bd6423b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1689 microversion: 2.1 time: 0.158325 Oct 12 23:14:31.090291 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4184/7716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:30 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:32.115677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9f828763-bb73-4677-8762-468339063f48 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:32.116303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9f828763-bb73-4677-8762-468339063f48 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:32.122461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f828763-bb73-4677-8762-468339063f48 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:32.122957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f828763-bb73-4677-8762-468339063f48 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:32.123695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f828763-bb73-4677-8762-468339063f48 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:32.124403 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f828763-bb73-4677-8762-468339063f48 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:32.124868 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f828763-bb73-4677-8762-468339063f48 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:32.125309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f828763-bb73-4677-8762-468339063f48 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:32.304104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9f828763-bb73-4677-8762-468339063f48 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:32.312234 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9f828763-bb73-4677-8762-468339063f48 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1669 microversion: 2.1 time: 0.202009 Oct 12 23:14:32.312797 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3533/7717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:32 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1669 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:33.409440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ab3356a5-276f-438f-a7b8-41803ec1271d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:33.411575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ab3356a5-276f-438f-a7b8-41803ec1271d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:33.419662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab3356a5-276f-438f-a7b8-41803ec1271d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:33.420140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab3356a5-276f-438f-a7b8-41803ec1271d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:33.420576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab3356a5-276f-438f-a7b8-41803ec1271d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:33.421259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab3356a5-276f-438f-a7b8-41803ec1271d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:33.421710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab3356a5-276f-438f-a7b8-41803ec1271d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:33.422143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab3356a5-276f-438f-a7b8-41803ec1271d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:33.479326 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ab3356a5-276f-438f-a7b8-41803ec1271d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c/action" status: 200 len: 32637 microversion: 2.1 time: 0.073688 Oct 12 23:14:33.479975 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4185/7718] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:14:33 2022] POST /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c/action => generated 32637 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:14:33.491626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a6ad38de-9531-47aa-b006-be010317b715 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:33.492169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a6ad38de-9531-47aa-b006-be010317b715 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:33.499165 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6ad38de-9531-47aa-b006-be010317b715 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:33.499684 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6ad38de-9531-47aa-b006-be010317b715 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:33.500125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6ad38de-9531-47aa-b006-be010317b715 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:33.500820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6ad38de-9531-47aa-b006-be010317b715 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:33.501280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6ad38de-9531-47aa-b006-be010317b715 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:33.501710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a6ad38de-9531-47aa-b006-be010317b715 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:33.565378 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a6ad38de-9531-47aa-b006-be010317b715 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.077580 Oct 12 23:14:33.565995 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3534/7719] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:14:33 2022] POST /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:14:33.575667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0bccad0a-bbd2-4b70-8eca-066edcf0ac13 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:33.576657 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0bccad0a-bbd2-4b70-8eca-066edcf0ac13 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:33.584025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bccad0a-bbd2-4b70-8eca-066edcf0ac13 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:33.584519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bccad0a-bbd2-4b70-8eca-066edcf0ac13 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:33.584955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bccad0a-bbd2-4b70-8eca-066edcf0ac13 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:33.585717 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bccad0a-bbd2-4b70-8eca-066edcf0ac13 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:33.586168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bccad0a-bbd2-4b70-8eca-066edcf0ac13 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:33.586590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0bccad0a-bbd2-4b70-8eca-066edcf0ac13 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:33.719511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0bccad0a-bbd2-4b70-8eca-066edcf0ac13 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:33.728143 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0bccad0a-bbd2-4b70-8eca-066edcf0ac13 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1676 microversion: 2.1 time: 0.157329 Oct 12 23:14:33.728743 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4186/7720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:33 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:34.753701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7264917c-f6da-4c8a-9f16-4dac32dc6851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:34.754405 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7264917c-f6da-4c8a-9f16-4dac32dc6851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:34.760887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7264917c-f6da-4c8a-9f16-4dac32dc6851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:34.761427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7264917c-f6da-4c8a-9f16-4dac32dc6851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:34.761880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7264917c-f6da-4c8a-9f16-4dac32dc6851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:34.762593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7264917c-f6da-4c8a-9f16-4dac32dc6851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:34.763062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7264917c-f6da-4c8a-9f16-4dac32dc6851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:34.763565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7264917c-f6da-4c8a-9f16-4dac32dc6851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:34.894958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7264917c-f6da-4c8a-9f16-4dac32dc6851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:34.903181 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7264917c-f6da-4c8a-9f16-4dac32dc6851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1684 microversion: 2.1 time: 0.154863 Oct 12 23:14:34.903777 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3535/7721] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:34 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:35.002482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7fb132c8-2f1d-48d5-a9ca-a517b234587b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:35.004719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7fb132c8-2f1d-48d5-a9ca-a517b234587b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:35.012780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fb132c8-2f1d-48d5-a9ca-a517b234587b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:35.013269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fb132c8-2f1d-48d5-a9ca-a517b234587b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:35.013709 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fb132c8-2f1d-48d5-a9ca-a517b234587b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:35.014405 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fb132c8-2f1d-48d5-a9ca-a517b234587b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:35.014861 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fb132c8-2f1d-48d5-a9ca-a517b234587b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:35.015315 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7fb132c8-2f1d-48d5-a9ca-a517b234587b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:35.063497 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7fb132c8-2f1d-48d5-a9ca-a517b234587b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c/action" status: 200 len: 36654 microversion: 2.1 time: 0.065182 Oct 12 23:14:35.064126 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4187/7722] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:14:34 2022] POST /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c/action => generated 36654 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:14:36.055270 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-40e68f43-0e15-4e1b-8ce3-b7132383b350 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:36.056055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-40e68f43-0e15-4e1b-8ce3-b7132383b350 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:36.063775 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40e68f43-0e15-4e1b-8ce3-b7132383b350 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:36.064340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40e68f43-0e15-4e1b-8ce3-b7132383b350 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:36.064962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40e68f43-0e15-4e1b-8ce3-b7132383b350 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:36.065740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40e68f43-0e15-4e1b-8ce3-b7132383b350 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:36.066600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40e68f43-0e15-4e1b-8ce3-b7132383b350 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:36.067213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40e68f43-0e15-4e1b-8ce3-b7132383b350 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:36.094374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-40e68f43-0e15-4e1b-8ce3-b7132383b350 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:14:36.122713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-5c1b9973-e005-4f8e-8fe1-367d419b7e21 req-8dcb4d60-6235-4dea-953f-a830a31cf5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c", "tag": "f378d84d-d783-4be4-9e33-c52ba8bc2cac"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:36.134129 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5c1b9973-e005-4f8e-8fe1-367d419b7e21 req-8dcb4d60-6235-4dea-953f-a830a31cf5b3 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:36.134610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5c1b9973-e005-4f8e-8fe1-367d419b7e21 req-8dcb4d60-6235-4dea-953f-a830a31cf5b3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:36.135043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5c1b9973-e005-4f8e-8fe1-367d419b7e21 req-8dcb4d60-6235-4dea-953f-a830a31cf5b3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:36.146166 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-5c1b9973-e005-4f8e-8fe1-367d419b7e21 req-8dcb4d60-6235-4dea-953f-a830a31cf5b3 service nova] Creating event network-changed:f378d84d-d783-4be4-9e33-c52ba8bc2cac for instance 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c on n-h2-861111-1 Oct 12 23:14:36.151333 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-5c1b9973-e005-4f8e-8fe1-367d419b7e21 req-8dcb4d60-6235-4dea-953f-a830a31cf5b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097409 Oct 12 23:14:36.152519 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4188/7723] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:14:36.180153 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-40e68f43-0e15-4e1b-8ce3-b7132383b350 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 204 len: 0 microversion: 2.1 time: 0.128644 Oct 12 23:14:36.181067 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3536/7724] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:14:36 2022] DELETE /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:14:36.190014 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a131c99c-d3e8-4d22-9a44-cc7fc241902f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:36.190720 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a131c99c-d3e8-4d22-9a44-cc7fc241902f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:36.197182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a131c99c-d3e8-4d22-9a44-cc7fc241902f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:36.197669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a131c99c-d3e8-4d22-9a44-cc7fc241902f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:36.198101 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a131c99c-d3e8-4d22-9a44-cc7fc241902f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:36.199039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a131c99c-d3e8-4d22-9a44-cc7fc241902f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:36.199520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a131c99c-d3e8-4d22-9a44-cc7fc241902f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:36.200134 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a131c99c-d3e8-4d22-9a44-cc7fc241902f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:36.336934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a131c99c-d3e8-4d22-9a44-cc7fc241902f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:36.345433 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a131c99c-d3e8-4d22-9a44-cc7fc241902f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1690 microversion: 2.1 time: 0.159632 Oct 12 23:14:36.346097 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4189/7725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:36 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:37.371538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e7210f17-fc0f-4c33-8319-1f81ae2c88d5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:37.372290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e7210f17-fc0f-4c33-8319-1f81ae2c88d5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:37.379454 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7210f17-fc0f-4c33-8319-1f81ae2c88d5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:37.379963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7210f17-fc0f-4c33-8319-1f81ae2c88d5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:37.380417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7210f17-fc0f-4c33-8319-1f81ae2c88d5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:37.381140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7210f17-fc0f-4c33-8319-1f81ae2c88d5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:37.381607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7210f17-fc0f-4c33-8319-1f81ae2c88d5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:37.382572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7210f17-fc0f-4c33-8319-1f81ae2c88d5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:37.591695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e7210f17-fc0f-4c33-8319-1f81ae2c88d5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:37.599617 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e7210f17-fc0f-4c33-8319-1f81ae2c88d5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1690 microversion: 2.1 time: 0.233051 Oct 12 23:14:37.600193 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3537/7726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:37 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1690 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:38.376641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-97b960a2-dab0-4963-b662-0db2b243bdca req-e84f8562-7cff-4ed4-8416-b420633bca48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c", "name": "network-vif-deleted", "tag": "f378d84d-d783-4be4-9e33-c52ba8bc2cac"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:38.390089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-97b960a2-dab0-4963-b662-0db2b243bdca req-e84f8562-7cff-4ed4-8416-b420633bca48 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:38.390578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-97b960a2-dab0-4963-b662-0db2b243bdca req-e84f8562-7cff-4ed4-8416-b420633bca48 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:38.391027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-97b960a2-dab0-4963-b662-0db2b243bdca req-e84f8562-7cff-4ed4-8416-b420633bca48 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:38.407982 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-97b960a2-dab0-4963-b662-0db2b243bdca req-e84f8562-7cff-4ed4-8416-b420633bca48 service nova] Creating event network-vif-deleted:f378d84d-d783-4be4-9e33-c52ba8bc2cac for instance 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c on n-h2-861111-1 Oct 12 23:14:38.412894 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-97b960a2-dab0-4963-b662-0db2b243bdca req-e84f8562-7cff-4ed4-8416-b420633bca48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040406 Oct 12 23:14:38.414021 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4190/7727] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:14:38.626095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c63932f2-d69b-4b8e-a32a-2851a9800776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:38.626584 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c63932f2-d69b-4b8e-a32a-2851a9800776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:38.633414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c63932f2-d69b-4b8e-a32a-2851a9800776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:38.633916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c63932f2-d69b-4b8e-a32a-2851a9800776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:38.634390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c63932f2-d69b-4b8e-a32a-2851a9800776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:38.635087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c63932f2-d69b-4b8e-a32a-2851a9800776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:38.635588 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c63932f2-d69b-4b8e-a32a-2851a9800776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:38.636616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c63932f2-d69b-4b8e-a32a-2851a9800776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:38.672568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c63932f2-d69b-4b8e-a32a-2851a9800776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:38.672804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c63932f2-d69b-4b8e-a32a-2851a9800776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:38.673254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c63932f2-d69b-4b8e-a32a-2851a9800776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:38.673724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-c63932f2-d69b-4b8e-a32a-2851a9800776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lazy-loading 'fault' on Instance uuid 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:14:38.715461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c63932f2-d69b-4b8e-a32a-2851a9800776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:38.723550 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c63932f2-d69b-4b8e-a32a-2851a9800776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 200 len: 1357 microversion: 2.1 time: 0.101690 Oct 12 23:14:38.724177 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3538/7728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:38 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 1357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:39.748841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-45e8cf57-4a62-45a2-959c-19cc7d8b3a70 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:39.749600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-45e8cf57-4a62-45a2-959c-19cc7d8b3a70 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:39.756650 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45e8cf57-4a62-45a2-959c-19cc7d8b3a70 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:39.757130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45e8cf57-4a62-45a2-959c-19cc7d8b3a70 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:39.757589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45e8cf57-4a62-45a2-959c-19cc7d8b3a70 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:39.758280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45e8cf57-4a62-45a2-959c-19cc7d8b3a70 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:39.758731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45e8cf57-4a62-45a2-959c-19cc7d8b3a70 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:39.759154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-45e8cf57-4a62-45a2-959c-19cc7d8b3a70 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:39.773440 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-45e8cf57-4a62-45a2-959c-19cc7d8b3a70 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] HTTP exception thrown: Instance 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c could not be found. Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-45e8cf57-4a62-45a2-959c-19cc7d8b3a70 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Request method failure captured: Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c HTTP/1.1 Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0oDcsNZbK1s9UNJvxMC8RxC4ab4VJ9ZKIMF77QJsJZvVUWjtNdnoFUDs5DSCBdxR5bWpQMeaN0YxqWPQUxJY0Xl9lZ1L0H_qo_58rDYn9dWgmYp9aHXIvU5wG05-LSRMRtk73J6MtC3Hv8Dnt7etVEPS2sKlXDRy4IcGnrNH7WIBVA Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 42fa1a0f52f94b8ebd34b42034d66b70 Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-799438933 Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42fa1a0f52f94b8ebd34b42034d66b70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42fa1a0f52f94b8ebd34b42034d66b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42fa1a0f52f94b8ebd34b42034d66b70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42fa1a0f52f94b8ebd34b42034d66b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestNetworkAdvancedServerOps-799438933 Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 42fa1a0f52f94b8ebd34b42034d66b70 Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-799438933 Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestNetworkAdvancedServerOps-799438933-project Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 764c04554c2a4616bf01531df31e717e Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestNetworkAdvancedServerOps-799438933-project Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c could not be found. Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c'} Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c could not be found. Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c could not be found. Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:14:39.775110 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:39.781188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:14:39.781188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:39.781188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:39.781188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:39.781188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:14:39.781188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:14:39.781188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c could not be found. Oct 12 23:14:39.781188 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:14:39.781188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-45e8cf57-4a62-45a2-959c-19cc7d8b3a70 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Returning 404 to user: Instance 4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:14:39.781188 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-45e8cf57-4a62-45a2-959c-19cc7d8b3a70 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c" status: 404 len: 111 microversion: 2.1 time: 0.032212 Oct 12 23:14:39.781188 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4191/7729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:39 2022] GET /compute/v2.1/servers/4551bbf0-820b-4ccb-bf77-1c9f1e47ca7c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:14:43.048494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d33adac4-8615-43a6-a698-16ffa25d70f2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '.version_select at 0x7f51233e5e50>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:43.068324 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d33adac4-8615-43a6-a698-16ffa25d70f2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1167885305" status: 202 len: 0 microversion: 2.1 time: 0.023579 Oct 12 23:14:43.069104 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3539/7730] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Oct 12 23:14:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1167885305 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:14:43.091610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3f411581-b9b1-46eb-98b6-48ddb25cdce6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'create', calling method: .version_select at 0x7f512341b9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1294076237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4XXLm/8NTp8ro0R1DKMCV/5SoJqKDuWGRQpClarwMG//XI+A4JBSlH1VnlE5sOrvjExcvJK9sOLrur4ZklJhsA+L3y0Tmo4wFv3J7vROS+z0YvIcFneQfUh+9gSNZEXg=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:43.109725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-3f411581-b9b1-46eb-98b6-48ddb25cdce6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:14:43.116182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-3f411581-b9b1-46eb-98b6-48ddb25cdce6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for user 764c04554c2a4616bf01531df31e717e and project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:14:43.143160 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3f411581-b9b1-46eb-98b6-48ddb25cdce6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055912 Oct 12 23:14:43.144361 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4192/7731] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 23:14:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:14:48.798995 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:48.803476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1624752025", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "e5f48569-d2cd-4df2-85bf-4013509b3665"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1294076237", "security_groups": [{"name": "tempest-secgroup-smoke-611611430"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:48.938660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] validate_networks() for [('e5f48569-d2cd-4df2-85bf-4013509b3665', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:14:49.414399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:14:49.415114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:14:49.415628 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:14:49.416052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:14:49.416468 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:14:49.426632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:49.427125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:49.427808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:49.428548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:49.429477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:49.431109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:49.450205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:14:49.455508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for user 764c04554c2a4616bf01531df31e717e and project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:14:49.468761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:14:49.471646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:14:49.523283 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-30ef510d-b30d-4f79-ba51-226c57532a1d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.726475 Oct 12 23:14:49.530278 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3540/7732] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 23:14:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:14:49.543824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3224d6e4-c724-4228-a9e0-06b697bdc41b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:49.544551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3224d6e4-c724-4228-a9e0-06b697bdc41b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:49.615750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3224d6e4-c724-4228-a9e0-06b697bdc41b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:49.631018 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3224d6e4-c724-4228-a9e0-06b697bdc41b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1267 microversion: 2.1 time: 0.098575 Oct 12 23:14:49.632412 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4193/7733] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:49 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:50.657102 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-91d99ec7-ecee-47bd-9f85-bad7083a7367 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:50.658669 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-91d99ec7-ecee-47bd-9f85-bad7083a7367 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:50.666339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91d99ec7-ecee-47bd-9f85-bad7083a7367 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:50.666999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91d99ec7-ecee-47bd-9f85-bad7083a7367 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:50.667544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91d99ec7-ecee-47bd-9f85-bad7083a7367 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:50.668385 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91d99ec7-ecee-47bd-9f85-bad7083a7367 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:50.668920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91d99ec7-ecee-47bd-9f85-bad7083a7367 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:50.669585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-91d99ec7-ecee-47bd-9f85-bad7083a7367 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:50.751804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-91d99ec7-ecee-47bd-9f85-bad7083a7367 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:50.760093 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-91d99ec7-ecee-47bd-9f85-bad7083a7367 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1337 microversion: 2.1 time: 0.107661 Oct 12 23:14:50.761723 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3541/7734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:50 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1337 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:14:51.786912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f4df8980-3abe-4cbf-9f06-7c32614d3850 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:51.788308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f4df8980-3abe-4cbf-9f06-7c32614d3850 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:51.790340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=32 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:51.798604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4df8980-3abe-4cbf-9f06-7c32614d3850 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:51.799100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4df8980-3abe-4cbf-9f06-7c32614d3850 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:51.799667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4df8980-3abe-4cbf-9f06-7c32614d3850 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:51.800382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4df8980-3abe-4cbf-9f06-7c32614d3850 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:51.800865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4df8980-3abe-4cbf-9f06-7c32614d3850 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:51.801307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f4df8980-3abe-4cbf-9f06-7c32614d3850 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:52.041375 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f4df8980-3abe-4cbf-9f06-7c32614d3850 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:52.049840 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f4df8980-3abe-4cbf-9f06-7c32614d3850 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1392 microversion: 2.1 time: 0.268621 Oct 12 23:14:52.050418 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4194/7735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:51 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1392 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:52.238437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-b2a85705-8ea6-4023-a325-93106f46e2b1 req-2830d3ab-7894-4a1b-8e91-330044bf70c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4a75c80-0ab3-4971-af4e-70d03420c4f3", "tag": "66ea8e62-c1c7-42b7-8d9a-ab932ab0f866"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:52.250099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b2a85705-8ea6-4023-a325-93106f46e2b1 req-2830d3ab-7894-4a1b-8e91-330044bf70c1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:52.250601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b2a85705-8ea6-4023-a325-93106f46e2b1 req-2830d3ab-7894-4a1b-8e91-330044bf70c1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:52.251045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b2a85705-8ea6-4023-a325-93106f46e2b1 req-2830d3ab-7894-4a1b-8e91-330044bf70c1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:52.263985 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-b2a85705-8ea6-4023-a325-93106f46e2b1 req-2830d3ab-7894-4a1b-8e91-330044bf70c1 service nova] Creating event network-changed:66ea8e62-c1c7-42b7-8d9a-ab932ab0f866 for instance b4a75c80-0ab3-4971-af4e-70d03420c4f3 on n-h2-861111-1 Oct 12 23:14:52.269617 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-b2a85705-8ea6-4023-a325-93106f46e2b1 req-2830d3ab-7894-4a1b-8e91-330044bf70c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034929 Oct 12 23:14:52.270417 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3542/7736] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:14:53.073645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-16c37c56-d707-452d-a465-d7edc95f61fe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:53.074269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-16c37c56-d707-452d-a465-d7edc95f61fe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:53.081166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16c37c56-d707-452d-a465-d7edc95f61fe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:53.081655 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16c37c56-d707-452d-a465-d7edc95f61fe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:53.082105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16c37c56-d707-452d-a465-d7edc95f61fe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:53.082805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16c37c56-d707-452d-a465-d7edc95f61fe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:53.083287 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16c37c56-d707-452d-a465-d7edc95f61fe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:53.083727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16c37c56-d707-452d-a465-d7edc95f61fe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:53.218839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-16c37c56-d707-452d-a465-d7edc95f61fe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:53.226544 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-16c37c56-d707-452d-a465-d7edc95f61fe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1392 microversion: 2.1 time: 0.157370 Oct 12 23:14:53.227120 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4195/7737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:53 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:54.250759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-96b8dad3-c228-40c9-9035-a1ce3772338b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:54.251507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-96b8dad3-c228-40c9-9035-a1ce3772338b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:54.258451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96b8dad3-c228-40c9-9035-a1ce3772338b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:54.258946 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96b8dad3-c228-40c9-9035-a1ce3772338b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:54.259429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96b8dad3-c228-40c9-9035-a1ce3772338b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:54.260135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96b8dad3-c228-40c9-9035-a1ce3772338b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:54.261200 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96b8dad3-c228-40c9-9035-a1ce3772338b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:54.261640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96b8dad3-c228-40c9-9035-a1ce3772338b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:54.391180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-96b8dad3-c228-40c9-9035-a1ce3772338b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:54.398859 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-96b8dad3-c228-40c9-9035-a1ce3772338b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1392 microversion: 2.1 time: 0.152654 Oct 12 23:14:54.399460 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3543/7738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:54 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:55.421809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-886d74e9-b09d-4fb9-a9cd-6cb4d962b7c2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:55.422332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-886d74e9-b09d-4fb9-a9cd-6cb4d962b7c2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:55.429774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-886d74e9-b09d-4fb9-a9cd-6cb4d962b7c2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:55.430262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-886d74e9-b09d-4fb9-a9cd-6cb4d962b7c2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:55.430706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-886d74e9-b09d-4fb9-a9cd-6cb4d962b7c2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:55.431428 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-886d74e9-b09d-4fb9-a9cd-6cb4d962b7c2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:55.431889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-886d74e9-b09d-4fb9-a9cd-6cb4d962b7c2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:55.432320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-886d74e9-b09d-4fb9-a9cd-6cb4d962b7c2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:55.563193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-886d74e9-b09d-4fb9-a9cd-6cb4d962b7c2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:55.570987 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-886d74e9-b09d-4fb9-a9cd-6cb4d962b7c2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1392 microversion: 2.1 time: 0.153137 Oct 12 23:14:55.571623 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4196/7739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:55 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:56.594284 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0520ef41-440a-4222-afba-c2ea37199cfc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:56.594945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0520ef41-440a-4222-afba-c2ea37199cfc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:56.602715 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0520ef41-440a-4222-afba-c2ea37199cfc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:56.603213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0520ef41-440a-4222-afba-c2ea37199cfc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:56.603688 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0520ef41-440a-4222-afba-c2ea37199cfc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:56.605026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0520ef41-440a-4222-afba-c2ea37199cfc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:56.605493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0520ef41-440a-4222-afba-c2ea37199cfc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:56.605936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0520ef41-440a-4222-afba-c2ea37199cfc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:56.737977 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0520ef41-440a-4222-afba-c2ea37199cfc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:56.746280 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0520ef41-440a-4222-afba-c2ea37199cfc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1392 microversion: 2.1 time: 0.155897 Oct 12 23:14:56.746848 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3544/7740] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:56 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:57.622662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-e2727c6a-673c-4c69-9ed6-b38c6b144491 req-47f8a03e-f8ae-4200-937e-ab1b459b7aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a75c80-0ab3-4971-af4e-70d03420c4f3", "name": "network-vif-plugged", "status": "completed", "tag": "66ea8e62-c1c7-42b7-8d9a-ab932ab0f866"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:57.633662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e2727c6a-673c-4c69-9ed6-b38c6b144491 req-47f8a03e-f8ae-4200-937e-ab1b459b7aba service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:57.634149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e2727c6a-673c-4c69-9ed6-b38c6b144491 req-47f8a03e-f8ae-4200-937e-ab1b459b7aba service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:57.634589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e2727c6a-673c-4c69-9ed6-b38c6b144491 req-47f8a03e-f8ae-4200-937e-ab1b459b7aba service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:57.645841 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-e2727c6a-673c-4c69-9ed6-b38c6b144491 req-47f8a03e-f8ae-4200-937e-ab1b459b7aba service nova] Creating event network-vif-plugged:66ea8e62-c1c7-42b7-8d9a-ab932ab0f866 for instance b4a75c80-0ab3-4971-af4e-70d03420c4f3 on n-h2-861111-1 Oct 12 23:14:57.650799 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-e2727c6a-673c-4c69-9ed6-b38c6b144491 req-47f8a03e-f8ae-4200-937e-ab1b459b7aba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032559 Oct 12 23:14:57.651463 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4197/7741] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:14:57.769885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b94cf36b-9e12-4ecd-a982-98d1e1868723 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:57.770958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b94cf36b-9e12-4ecd-a982-98d1e1868723 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:57.777374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b94cf36b-9e12-4ecd-a982-98d1e1868723 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:57.777878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b94cf36b-9e12-4ecd-a982-98d1e1868723 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:57.778339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b94cf36b-9e12-4ecd-a982-98d1e1868723 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:57.779088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b94cf36b-9e12-4ecd-a982-98d1e1868723 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:57.779591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b94cf36b-9e12-4ecd-a982-98d1e1868723 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:57.780040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b94cf36b-9e12-4ecd-a982-98d1e1868723 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:57.913512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b94cf36b-9e12-4ecd-a982-98d1e1868723 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:57.921816 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b94cf36b-9e12-4ecd-a982-98d1e1868723 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1392 microversion: 2.1 time: 0.156201 Oct 12 23:14:57.922405 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3545/7742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:57 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:58.946168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a3aa77ce-bfa4-4ba6-8bdc-91fd56282cc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:58.946869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a3aa77ce-bfa4-4ba6-8bdc-91fd56282cc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:58.953706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3aa77ce-bfa4-4ba6-8bdc-91fd56282cc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:58.954189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3aa77ce-bfa4-4ba6-8bdc-91fd56282cc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:58.954625 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3aa77ce-bfa4-4ba6-8bdc-91fd56282cc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:58.955340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3aa77ce-bfa4-4ba6-8bdc-91fd56282cc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:58.955793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3aa77ce-bfa4-4ba6-8bdc-91fd56282cc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:58.956217 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3aa77ce-bfa4-4ba6-8bdc-91fd56282cc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:59.087366 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a3aa77ce-bfa4-4ba6-8bdc-91fd56282cc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:59.095864 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a3aa77ce-bfa4-4ba6-8bdc-91fd56282cc8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1392 microversion: 2.1 time: 0.154823 Oct 12 23:14:59.096751 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4198/7743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:58 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:15:00.198430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2f548dfd-a269-4fdc-b53c-efde9ddb7391 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:15:00.199055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f548dfd-a269-4fdc-b53c-efde9ddb7391 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:00.201853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:15:00.202555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:15:00.208600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f548dfd-a269-4fdc-b53c-efde9ddb7391 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:00.209095 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f548dfd-a269-4fdc-b53c-efde9ddb7391 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:00.209547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f548dfd-a269-4fdc-b53c-efde9ddb7391 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:00.210277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f548dfd-a269-4fdc-b53c-efde9ddb7391 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:00.210743 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f548dfd-a269-4fdc-b53c-efde9ddb7391 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:00.211180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f548dfd-a269-4fdc-b53c-efde9ddb7391 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:00.345212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f548dfd-a269-4fdc-b53c-efde9ddb7391 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:15:00.352952 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2f548dfd-a269-4fdc-b53c-efde9ddb7391 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1565 microversion: 2.1 time: 0.158448 Oct 12 23:15:00.353523 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3546/7744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:15:00 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:15:00.376396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-18bb5a78-95c5-431a-9243-e7d58c1422ad tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:15:00.377010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-18bb5a78-95c5-431a-9243-e7d58c1422ad tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:00.380043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:15:00.384759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18bb5a78-95c5-431a-9243-e7d58c1422ad tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:00.385237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18bb5a78-95c5-431a-9243-e7d58c1422ad tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:00.385672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18bb5a78-95c5-431a-9243-e7d58c1422ad tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:00.386367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18bb5a78-95c5-431a-9243-e7d58c1422ad tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:00.386819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18bb5a78-95c5-431a-9243-e7d58c1422ad tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:00.387269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18bb5a78-95c5-431a-9243-e7d58c1422ad tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:00.556204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-18bb5a78-95c5-431a-9243-e7d58c1422ad tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:15:00.564170 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-18bb5a78-95c5-431a-9243-e7d58c1422ad tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1565 microversion: 2.1 time: 0.191904 Oct 12 23:15:00.564775 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4199/7745] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:15:00 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1565 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:15:02.128978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-116bd598-621c-4ba6-932d-290f6dfdeb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:15:02.130252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-5f236540-472e-4796-8924-6fceb5653b25 req-a49745ef-5335-4c6c-bc94-a2d902c3607d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4a75c80-0ab3-4971-af4e-70d03420c4f3", "tag": "66ea8e62-c1c7-42b7-8d9a-ab932ab0f866"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:15:02.130797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-116bd598-621c-4ba6-932d-290f6dfdeb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:02.133010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:15:02.137161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:15:02.140071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-116bd598-621c-4ba6-932d-290f6dfdeb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:02.140851 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-116bd598-621c-4ba6-932d-290f6dfdeb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:02.141543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-116bd598-621c-4ba6-932d-290f6dfdeb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:02.142339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-116bd598-621c-4ba6-932d-290f6dfdeb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:02.142816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5f236540-472e-4796-8924-6fceb5653b25 req-a49745ef-5335-4c6c-bc94-a2d902c3607d service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:02.143272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-116bd598-621c-4ba6-932d-290f6dfdeb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:02.143396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5f236540-472e-4796-8924-6fceb5653b25 req-a49745ef-5335-4c6c-bc94-a2d902c3607d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:02.143737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-5f236540-472e-4796-8924-6fceb5653b25 req-a49745ef-5335-4c6c-bc94-a2d902c3607d service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:02.144300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-116bd598-621c-4ba6-932d-290f6dfdeb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:02.157436 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-5f236540-472e-4796-8924-6fceb5653b25 req-a49745ef-5335-4c6c-bc94-a2d902c3607d service nova] Creating event network-changed:66ea8e62-c1c7-42b7-8d9a-ab932ab0f866 for instance b4a75c80-0ab3-4971-af4e-70d03420c4f3 on n-h2-861111-1 Oct 12 23:15:02.162976 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-5f236540-472e-4796-8924-6fceb5653b25 req-a49745ef-5335-4c6c-bc94-a2d902c3607d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036373 Oct 12 23:15:02.163620 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4200/7746] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:15:02.292838 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-116bd598-621c-4ba6-932d-290f6dfdeb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:15:02.304133 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-116bd598-621c-4ba6-932d-290f6dfdeb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1565 microversion: 2.1 time: 0.179573 Oct 12 23:15:02.304883 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3547/7747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:15:02 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:15:33.573793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=34 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:15:33.574663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:15:33.579193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a795c22f-0f8b-459d-b34a-8dd611a21e6f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:15:33.581507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a795c22f-0f8b-459d-b34a-8dd611a21e6f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:33.588321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a795c22f-0f8b-459d-b34a-8dd611a21e6f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:33.588809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a795c22f-0f8b-459d-b34a-8dd611a21e6f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:33.589246 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a795c22f-0f8b-459d-b34a-8dd611a21e6f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:33.589938 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a795c22f-0f8b-459d-b34a-8dd611a21e6f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:33.590537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a795c22f-0f8b-459d-b34a-8dd611a21e6f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:33.590969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a795c22f-0f8b-459d-b34a-8dd611a21e6f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:33.648227 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a795c22f-0f8b-459d-b34a-8dd611a21e6f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3/action" status: 200 len: 24568 microversion: 2.1 time: 0.076357 Oct 12 23:15:33.648887 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4201/7748] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:15:33 2022] POST /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3/action => generated 24568 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:16:04.017589 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:04.018357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=40 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:04.022641 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c3d40920-3dfb-466d-9cfe-f95169486ad9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:16:04.024882 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c3d40920-3dfb-466d-9cfe-f95169486ad9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:04.032120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d40920-3dfb-466d-9cfe-f95169486ad9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:04.032618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d40920-3dfb-466d-9cfe-f95169486ad9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:04.033066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d40920-3dfb-466d-9cfe-f95169486ad9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:04.033771 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d40920-3dfb-466d-9cfe-f95169486ad9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:04.034246 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d40920-3dfb-466d-9cfe-f95169486ad9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:04.034687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d40920-3dfb-466d-9cfe-f95169486ad9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:04.104561 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c3d40920-3dfb-466d-9cfe-f95169486ad9 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3/action" status: 202 len: 0 microversion: 2.1 time: 0.089193 Oct 12 23:16:04.105181 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3548/7749] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:16:04 2022] POST /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:16:04.114079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8ffa994c-37b9-4083-ae7e-cbf3c3750107 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:04.114786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8ffa994c-37b9-4083-ae7e-cbf3c3750107 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:04.117452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:04.118111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:04.124578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ffa994c-37b9-4083-ae7e-cbf3c3750107 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:04.125071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ffa994c-37b9-4083-ae7e-cbf3c3750107 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:04.125507 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ffa994c-37b9-4083-ae7e-cbf3c3750107 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:04.126206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ffa994c-37b9-4083-ae7e-cbf3c3750107 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:04.126674 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ffa994c-37b9-4083-ae7e-cbf3c3750107 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:04.127112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8ffa994c-37b9-4083-ae7e-cbf3c3750107 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:04.342406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8ffa994c-37b9-4083-ae7e-cbf3c3750107 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:04.350990 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8ffa994c-37b9-4083-ae7e-cbf3c3750107 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1676 microversion: 2.1 time: 0.241305 Oct 12 23:16:04.351608 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4202/7750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:04 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:05.376501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-62a0489e-6ebe-45a8-82eb-5bc01ad9da36 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:05.377223 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-62a0489e-6ebe-45a8-82eb-5bc01ad9da36 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:05.383569 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62a0489e-6ebe-45a8-82eb-5bc01ad9da36 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:05.384065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62a0489e-6ebe-45a8-82eb-5bc01ad9da36 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:05.384559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62a0489e-6ebe-45a8-82eb-5bc01ad9da36 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:05.385288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62a0489e-6ebe-45a8-82eb-5bc01ad9da36 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:05.385755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62a0489e-6ebe-45a8-82eb-5bc01ad9da36 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:05.386496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62a0489e-6ebe-45a8-82eb-5bc01ad9da36 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:05.842597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-62a0489e-6ebe-45a8-82eb-5bc01ad9da36 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:05.851226 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-62a0489e-6ebe-45a8-82eb-5bc01ad9da36 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1681 microversion: 2.1 time: 0.480893 Oct 12 23:16:05.851906 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3549/7751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:05 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1681 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:06.875289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4ff4b22f-2103-49bc-9d73-4e4a037cef45 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:06.875917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4ff4b22f-2103-49bc-9d73-4e4a037cef45 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:06.882950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ff4b22f-2103-49bc-9d73-4e4a037cef45 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:06.883471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ff4b22f-2103-49bc-9d73-4e4a037cef45 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:06.883912 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ff4b22f-2103-49bc-9d73-4e4a037cef45 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:06.884636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ff4b22f-2103-49bc-9d73-4e4a037cef45 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:06.885089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ff4b22f-2103-49bc-9d73-4e4a037cef45 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:06.885514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ff4b22f-2103-49bc-9d73-4e4a037cef45 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:07.019181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4ff4b22f-2103-49bc-9d73-4e4a037cef45 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:07.027048 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4ff4b22f-2103-49bc-9d73-4e4a037cef45 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1681 microversion: 2.1 time: 0.156011 Oct 12 23:16:07.027596 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4203/7752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:06 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:08.052017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ab8c7e2e-61c3-4896-b7ad-c77bca63ca6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:08.052548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ab8c7e2e-61c3-4896-b7ad-c77bca63ca6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:08.059368 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab8c7e2e-61c3-4896-b7ad-c77bca63ca6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:08.059871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab8c7e2e-61c3-4896-b7ad-c77bca63ca6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:08.060311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab8c7e2e-61c3-4896-b7ad-c77bca63ca6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:08.061005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab8c7e2e-61c3-4896-b7ad-c77bca63ca6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:08.061465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab8c7e2e-61c3-4896-b7ad-c77bca63ca6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:08.062529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ab8c7e2e-61c3-4896-b7ad-c77bca63ca6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:08.191054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ab8c7e2e-61c3-4896-b7ad-c77bca63ca6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:08.198715 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ab8c7e2e-61c3-4896-b7ad-c77bca63ca6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1681 microversion: 2.1 time: 0.150697 Oct 12 23:16:08.199287 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3550/7753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:08 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:09.222774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-47d9525b-4626-4ccc-8fae-f4abc3230274 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:09.223432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-47d9525b-4626-4ccc-8fae-f4abc3230274 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:09.230183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47d9525b-4626-4ccc-8fae-f4abc3230274 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:09.230663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47d9525b-4626-4ccc-8fae-f4abc3230274 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:09.231104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47d9525b-4626-4ccc-8fae-f4abc3230274 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:09.231829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47d9525b-4626-4ccc-8fae-f4abc3230274 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:09.232280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47d9525b-4626-4ccc-8fae-f4abc3230274 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:09.232705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-47d9525b-4626-4ccc-8fae-f4abc3230274 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:09.360681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-47d9525b-4626-4ccc-8fae-f4abc3230274 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:09.368405 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-47d9525b-4626-4ccc-8fae-f4abc3230274 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1681 microversion: 2.1 time: 0.149634 Oct 12 23:16:09.368972 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4204/7754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:09 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:10.392917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9efc2cab-c231-4ca4-8dc0-2228a37213d0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:10.393489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9efc2cab-c231-4ca4-8dc0-2228a37213d0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:10.400382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9efc2cab-c231-4ca4-8dc0-2228a37213d0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:10.400883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9efc2cab-c231-4ca4-8dc0-2228a37213d0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:10.401334 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9efc2cab-c231-4ca4-8dc0-2228a37213d0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:10.402039 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9efc2cab-c231-4ca4-8dc0-2228a37213d0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:10.402504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9efc2cab-c231-4ca4-8dc0-2228a37213d0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:10.402942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9efc2cab-c231-4ca4-8dc0-2228a37213d0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:10.540373 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9efc2cab-c231-4ca4-8dc0-2228a37213d0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:10.548174 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9efc2cab-c231-4ca4-8dc0-2228a37213d0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1681 microversion: 2.1 time: 0.159793 Oct 12 23:16:10.548741 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3551/7755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:10 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:11.572255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a64f1710-3a71-42ca-bfce-fc953bc7d908 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:11.572941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a64f1710-3a71-42ca-bfce-fc953bc7d908 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:11.580404 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a64f1710-3a71-42ca-bfce-fc953bc7d908 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:11.580891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a64f1710-3a71-42ca-bfce-fc953bc7d908 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:11.581332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a64f1710-3a71-42ca-bfce-fc953bc7d908 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:11.582028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a64f1710-3a71-42ca-bfce-fc953bc7d908 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:11.582487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a64f1710-3a71-42ca-bfce-fc953bc7d908 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:11.582921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a64f1710-3a71-42ca-bfce-fc953bc7d908 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:11.715027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a64f1710-3a71-42ca-bfce-fc953bc7d908 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:11.723335 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a64f1710-3a71-42ca-bfce-fc953bc7d908 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1681 microversion: 2.1 time: 0.155075 Oct 12 23:16:11.723911 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4205/7756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:11 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:12.746950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-93af9ea4-451e-43d2-bb1f-98ea016e163e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:12.747633 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-93af9ea4-451e-43d2-bb1f-98ea016e163e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:12.754824 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93af9ea4-451e-43d2-bb1f-98ea016e163e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:12.755351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93af9ea4-451e-43d2-bb1f-98ea016e163e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:12.755804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93af9ea4-451e-43d2-bb1f-98ea016e163e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:12.756541 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93af9ea4-451e-43d2-bb1f-98ea016e163e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:12.757009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93af9ea4-451e-43d2-bb1f-98ea016e163e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:12.757464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93af9ea4-451e-43d2-bb1f-98ea016e163e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:12.885852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-93af9ea4-451e-43d2-bb1f-98ea016e163e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:12.893527 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-93af9ea4-451e-43d2-bb1f-98ea016e163e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1681 microversion: 2.1 time: 0.150487 Oct 12 23:16:12.894089 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3552/7757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:12 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:13.917582 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3374f82b-3c7d-41c1-a29a-967943f354bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:13.918197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3374f82b-3c7d-41c1-a29a-967943f354bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:13.925495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3374f82b-3c7d-41c1-a29a-967943f354bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:13.925974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3374f82b-3c7d-41c1-a29a-967943f354bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:13.926407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3374f82b-3c7d-41c1-a29a-967943f354bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:13.927099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3374f82b-3c7d-41c1-a29a-967943f354bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:13.927584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3374f82b-3c7d-41c1-a29a-967943f354bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:13.928008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3374f82b-3c7d-41c1-a29a-967943f354bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:14.057512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3374f82b-3c7d-41c1-a29a-967943f354bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:14.065721 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3374f82b-3c7d-41c1-a29a-967943f354bc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1681 microversion: 2.1 time: 0.152110 Oct 12 23:16:14.066302 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4206/7758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:13 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:15.088954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0ea8f249-9903-43a2-bcdd-75f51e4c88cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:15.089509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0ea8f249-9903-43a2-bcdd-75f51e4c88cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:15.096415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ea8f249-9903-43a2-bcdd-75f51e4c88cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:15.096910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ea8f249-9903-43a2-bcdd-75f51e4c88cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:15.097361 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ea8f249-9903-43a2-bcdd-75f51e4c88cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:15.098065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ea8f249-9903-43a2-bcdd-75f51e4c88cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:15.098531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ea8f249-9903-43a2-bcdd-75f51e4c88cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:15.098971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ea8f249-9903-43a2-bcdd-75f51e4c88cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:15.230252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0ea8f249-9903-43a2-bcdd-75f51e4c88cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:15.238032 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0ea8f249-9903-43a2-bcdd-75f51e4c88cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1681 microversion: 2.1 time: 0.153122 Oct 12 23:16:15.238596 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3553/7759] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:15 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:16.261934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bc2b4b67-c642-4c3d-8ee8-40297b9ad989 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:16.262566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bc2b4b67-c642-4c3d-8ee8-40297b9ad989 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:16.269931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2b4b67-c642-4c3d-8ee8-40297b9ad989 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:16.270413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2b4b67-c642-4c3d-8ee8-40297b9ad989 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:16.270851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2b4b67-c642-4c3d-8ee8-40297b9ad989 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:16.271571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2b4b67-c642-4c3d-8ee8-40297b9ad989 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:16.272025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2b4b67-c642-4c3d-8ee8-40297b9ad989 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:16.272450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bc2b4b67-c642-4c3d-8ee8-40297b9ad989 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:16.412460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bc2b4b67-c642-4c3d-8ee8-40297b9ad989 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:16.420345 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bc2b4b67-c642-4c3d-8ee8-40297b9ad989 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1684 microversion: 2.1 time: 0.162321 Oct 12 23:16:16.420920 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4207/7760] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:16 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:48.635614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-54acec2f-d0fa-4b3e-9896-31ea1d7e952d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:16:48.637825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-54acec2f-d0fa-4b3e-9896-31ea1d7e952d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:48.640093 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=12 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:48.640756 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:48.647647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54acec2f-d0fa-4b3e-9896-31ea1d7e952d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:48.648143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54acec2f-d0fa-4b3e-9896-31ea1d7e952d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:48.648590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54acec2f-d0fa-4b3e-9896-31ea1d7e952d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:48.649289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54acec2f-d0fa-4b3e-9896-31ea1d7e952d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:48.649754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54acec2f-d0fa-4b3e-9896-31ea1d7e952d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:48.650188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54acec2f-d0fa-4b3e-9896-31ea1d7e952d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:48.705972 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-54acec2f-d0fa-4b3e-9896-31ea1d7e952d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3/action" status: 200 len: 69086 microversion: 2.1 time: 0.074278 Oct 12 23:16:48.706633 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3554/7761] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:16:48 2022] POST /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3/action => generated 69086 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:17:05.711775 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-27600a73-396b-4a13-8529-c34fea0a7a46 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:05.712370 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-27600a73-396b-4a13-8529-c34fea0a7a46 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:05.714639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=12 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:05.725167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-09159a90-b5de-43e3-a5cd-939309bd62dd req-1ac57ba5-3ff1-4740-8154-f70e48e1ba87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4a75c80-0ab3-4971-af4e-70d03420c4f3", "tag": "66ea8e62-c1c7-42b7-8d9a-ab932ab0f866"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:17:05.725744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=36 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:05.727157 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:17:05.727527 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 23:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 (ip 10.222.0.16) !!! Oct 12 23:17:05.728426 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:17:05.728542 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 23:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 (ip 10.222.0.16) !!! Oct 12 23:17:05.735507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:05.736423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:05.737622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27600a73-396b-4a13-8529-c34fea0a7a46 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:05.738183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27600a73-396b-4a13-8529-c34fea0a7a46 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:05.738661 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27600a73-396b-4a13-8529-c34fea0a7a46 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:05.739439 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27600a73-396b-4a13-8529-c34fea0a7a46 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:05.739779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-09159a90-b5de-43e3-a5cd-939309bd62dd req-1ac57ba5-3ff1-4740-8154-f70e48e1ba87 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:05.739913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27600a73-396b-4a13-8529-c34fea0a7a46 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:05.740276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-09159a90-b5de-43e3-a5cd-939309bd62dd req-1ac57ba5-3ff1-4740-8154-f70e48e1ba87 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:05.740390 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-27600a73-396b-4a13-8529-c34fea0a7a46 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:05.740720 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-09159a90-b5de-43e3-a5cd-939309bd62dd req-1ac57ba5-3ff1-4740-8154-f70e48e1ba87 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:05.761796 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-09159a90-b5de-43e3-a5cd-939309bd62dd req-1ac57ba5-3ff1-4740-8154-f70e48e1ba87 service nova] Creating event network-changed:66ea8e62-c1c7-42b7-8d9a-ab932ab0f866 for instance b4a75c80-0ab3-4971-af4e-70d03420c4f3 on n-h2-861111-1 Oct 12 23:17:05.768940 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-27600a73-396b-4a13-8529-c34fea0a7a46 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:17:05.771922 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-09159a90-b5de-43e3-a5cd-939309bd62dd req-1ac57ba5-3ff1-4740-8154-f70e48e1ba87 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054955 Oct 12 23:17:05.772407 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3555/7762] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:17:05.856745 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-27600a73-396b-4a13-8529-c34fea0a7a46 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 204 len: 0 microversion: 2.1 time: 0.147518 Oct 12 23:17:05.857566 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4208/7763] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:17:05 2022] DELETE /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:17:05.867741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-568c77b8-6973-4af1-9b23-891aaf6504c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:05.868461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-568c77b8-6973-4af1-9b23-891aaf6504c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:05.875561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-568c77b8-6973-4af1-9b23-891aaf6504c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:05.876206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-568c77b8-6973-4af1-9b23-891aaf6504c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:05.876675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-568c77b8-6973-4af1-9b23-891aaf6504c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:05.877389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-568c77b8-6973-4af1-9b23-891aaf6504c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:05.878038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-568c77b8-6973-4af1-9b23-891aaf6504c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:05.878483 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-568c77b8-6973-4af1-9b23-891aaf6504c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:06.014023 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-568c77b8-6973-4af1-9b23-891aaf6504c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:06.021972 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-568c77b8-6973-4af1-9b23-891aaf6504c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1690 microversion: 2.1 time: 0.159250 Oct 12 23:17:06.022566 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3556/7764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:05 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:17:07.048713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ab20f91c-3138-45c7-97d0-740f87f0d75e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:07.049431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ab20f91c-3138-45c7-97d0-740f87f0d75e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:07.056634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab20f91c-3138-45c7-97d0-740f87f0d75e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:07.057131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab20f91c-3138-45c7-97d0-740f87f0d75e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:07.057581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab20f91c-3138-45c7-97d0-740f87f0d75e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:07.058281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab20f91c-3138-45c7-97d0-740f87f0d75e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:07.058744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab20f91c-3138-45c7-97d0-740f87f0d75e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:07.059180 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab20f91c-3138-45c7-97d0-740f87f0d75e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:07.263406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ab20f91c-3138-45c7-97d0-740f87f0d75e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:07.272145 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ab20f91c-3138-45c7-97d0-740f87f0d75e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1690 microversion: 2.1 time: 0.228179 Oct 12 23:17:07.272755 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4209/7765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:07 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1690 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:07.929235 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-bd91bdb3-d293-4e5d-85f8-1d0463af6849 req-5d96d01a-b545-474c-858c-fc1ebc50ef93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a75c80-0ab3-4971-af4e-70d03420c4f3", "name": "network-vif-deleted", "tag": "66ea8e62-c1c7-42b7-8d9a-ab932ab0f866"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:17:07.942207 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-bd91bdb3-d293-4e5d-85f8-1d0463af6849 req-5d96d01a-b545-474c-858c-fc1ebc50ef93 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:07.942698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-bd91bdb3-d293-4e5d-85f8-1d0463af6849 req-5d96d01a-b545-474c-858c-fc1ebc50ef93 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:07.943148 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-bd91bdb3-d293-4e5d-85f8-1d0463af6849 req-5d96d01a-b545-474c-858c-fc1ebc50ef93 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:07.955848 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-bd91bdb3-d293-4e5d-85f8-1d0463af6849 req-5d96d01a-b545-474c-858c-fc1ebc50ef93 service nova] Creating event network-vif-deleted:66ea8e62-c1c7-42b7-8d9a-ab932ab0f866 for instance b4a75c80-0ab3-4971-af4e-70d03420c4f3 on n-h2-861111-1 Oct 12 23:17:07.961081 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-bd91bdb3-d293-4e5d-85f8-1d0463af6849 req-5d96d01a-b545-474c-858c-fc1ebc50ef93 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035747 Oct 12 23:17:07.961892 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3557/7766] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:17:08.296635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c4a877b9-cead-4912-b2d2-522388163a2d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:08.297237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c4a877b9-cead-4912-b2d2-522388163a2d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:08.304237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4a877b9-cead-4912-b2d2-522388163a2d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:08.304734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4a877b9-cead-4912-b2d2-522388163a2d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:08.305416 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4a877b9-cead-4912-b2d2-522388163a2d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:08.306138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4a877b9-cead-4912-b2d2-522388163a2d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:08.306603 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4a877b9-cead-4912-b2d2-522388163a2d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:08.307042 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4a877b9-cead-4912-b2d2-522388163a2d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:08.349621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4a877b9-cead-4912-b2d2-522388163a2d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:08.350118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4a877b9-cead-4912-b2d2-522388163a2d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:08.350554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c4a877b9-cead-4912-b2d2-522388163a2d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:08.351007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-c4a877b9-cead-4912-b2d2-522388163a2d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lazy-loading 'fault' on Instance uuid b4a75c80-0ab3-4971-af4e-70d03420c4f3 {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:17:08.393612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c4a877b9-cead-4912-b2d2-522388163a2d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:08.401631 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c4a877b9-cead-4912-b2d2-522388163a2d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 200 len: 1357 microversion: 2.1 time: 0.110060 Oct 12 23:17:08.402209 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4210/7767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:08 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 1357 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:09.426867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5e993823-f712-4b1d-97e9-979149fd1ef8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:09.427644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5e993823-f712-4b1d-97e9-979149fd1ef8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: b4a75c80-0ab3-4971-af4e-70d03420c4f3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:09.434753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e993823-f712-4b1d-97e9-979149fd1ef8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:09.435274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e993823-f712-4b1d-97e9-979149fd1ef8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:09.435738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e993823-f712-4b1d-97e9-979149fd1ef8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:09.437121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e993823-f712-4b1d-97e9-979149fd1ef8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:09.437597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e993823-f712-4b1d-97e9-979149fd1ef8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:09.438046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5e993823-f712-4b1d-97e9-979149fd1ef8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:09.451258 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-5e993823-f712-4b1d-97e9-979149fd1ef8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] HTTP exception thrown: Instance b4a75c80-0ab3-4971-af4e-70d03420c4f3 could not be found. Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5e993823-f712-4b1d-97e9-979149fd1ef8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Request method failure captured: Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 HTTP/1.1 Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0oDcsNZbK1s9UNJvxMC8RxC4ab4VJ9ZKIMF77QJsJZvVUWjtNdnoFUDs5DSCBdxR5bWpQMeaN0YxqWPQUxJY0Xl9lZ1L0H_qo_58rDYn9dWgmYp9aHXIvU5wG05-LSRMRtk73J6MtC3Hv8Dnt7etVEPS2sKlXDRy4IcGnrNH7WIBVA Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 42fa1a0f52f94b8ebd34b42034d66b70 Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-799438933 Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42fa1a0f52f94b8ebd34b42034d66b70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42fa1a0f52f94b8ebd34b42034d66b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42fa1a0f52f94b8ebd34b42034d66b70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42fa1a0f52f94b8ebd34b42034d66b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestNetworkAdvancedServerOps-799438933 Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 42fa1a0f52f94b8ebd34b42034d66b70 Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-799438933 Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestNetworkAdvancedServerOps-799438933-project Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 764c04554c2a4616bf01531df31e717e Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestNetworkAdvancedServerOps-799438933-project Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance b4a75c80-0ab3-4971-af4e-70d03420c4f3 could not be found. Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'b4a75c80-0ab3-4971-af4e-70d03420c4f3'} Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4a75c80-0ab3-4971-af4e-70d03420c4f3 could not be found. Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4a75c80-0ab3-4971-af4e-70d03420c4f3 could not be found. Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:17:09.452839 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:17:09.457845 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:17:09.457845 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:17:09.457845 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:17:09.457845 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:17:09.457845 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:17:09.457845 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:17:09.457845 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4a75c80-0ab3-4971-af4e-70d03420c4f3 could not be found. Oct 12 23:17:09.457845 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:17:09.457845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5e993823-f712-4b1d-97e9-979149fd1ef8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Returning 404 to user: Instance b4a75c80-0ab3-4971-af4e-70d03420c4f3 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:17:09.457845 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5e993823-f712-4b1d-97e9-979149fd1ef8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3" status: 404 len: 111 microversion: 2.1 time: 0.031717 Oct 12 23:17:09.457845 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3558/7768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:09 2022] GET /compute/v2.1/servers/b4a75c80-0ab3-4971-af4e-70d03420c4f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:17:12.453193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e132cec4-8764-487d-aa95-079eb478eda7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '.version_select at 0x7f512827fc10>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:12.481458 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e132cec4-8764-487d-aa95-079eb478eda7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1294076237" status: 202 len: 0 microversion: 2.1 time: 0.032083 Oct 12 23:17:12.482374 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4211/7769] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Oct 12 23:17:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1294076237 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 23:17:12.509806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-17d9524e-f35f-46b3-98f8-9a122ca624ad tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'create', calling method: .version_select at 0x7f512c51e160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1094335564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2vR3YJ1XcCyONWvJ1j8tv4SV2v2CXrMe4g3Bj4Ldj61TiD2pvCgn9LffewOFM7S3vPvp5xXoCSDot1cYMvDoPTtA5+unpnBQevrqlu4a6i8EbOGpGemIc8HfFxnV6Ijg=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:17:12.529288 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-17d9524e-f35f-46b3-98f8-9a122ca624ad tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:17:12.535157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-17d9524e-f35f-46b3-98f8-9a122ca624ad tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for user 764c04554c2a4616bf01531df31e717e and project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:17:12.564888 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-17d9524e-f35f-46b3-98f8-9a122ca624ad tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.059092 Oct 12 23:17:12.565501 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3559/7770] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 23:17:12 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:17:18.456445 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:18.461689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-458817432", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "f24674ff-fbb8-44a2-b994-d2a315439155"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1094335564", "security_groups": [{"name": "tempest-secgroup-smoke-1886619169"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:17:18.583423 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] validate_networks() for [('f24674ff-fbb8-44a2-b994-d2a315439155', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:17:19.010537 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:17:19.010980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:17:19.011497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:17:19.011916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:17:19.012415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:17:19.022531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:19.023041 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:19.023520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:19.024268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:19.024734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:19.025321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:19.049318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:17:19.054839 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for user 764c04554c2a4616bf01531df31e717e and project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:17:19.068029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:17:19.070373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:17:19.119275 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5196e5b6-bfc6-441c-8e38-a7a92f5ab585 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.665506 Oct 12 23:17:19.119854 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4212/7771] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 23:17:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:17:19.132323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7fb8daa0-8257-45ce-9c24-11949873c732 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:19.133590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7fb8daa0-8257-45ce-9c24-11949873c732 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:19.200143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7fb8daa0-8257-45ce-9c24-11949873c732 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:19.208994 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7fb8daa0-8257-45ce-9c24-11949873c732 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1266 microversion: 2.1 time: 0.081888 Oct 12 23:17:19.209666 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3560/7772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:19 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:20.235001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f3f3e92e-2d9e-4d28-ba22-9ce21609e41f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:20.236851 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f3f3e92e-2d9e-4d28-ba22-9ce21609e41f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:20.245028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3f3e92e-2d9e-4d28-ba22-9ce21609e41f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:20.247124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3f3e92e-2d9e-4d28-ba22-9ce21609e41f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:20.247918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3f3e92e-2d9e-4d28-ba22-9ce21609e41f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:20.249811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3f3e92e-2d9e-4d28-ba22-9ce21609e41f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:20.250500 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3f3e92e-2d9e-4d28-ba22-9ce21609e41f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:20.251279 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f3f3e92e-2d9e-4d28-ba22-9ce21609e41f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:20.323732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f3f3e92e-2d9e-4d28-ba22-9ce21609e41f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:20.334239 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f3f3e92e-2d9e-4d28-ba22-9ce21609e41f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1336 microversion: 2.1 time: 0.104116 Oct 12 23:17:20.335634 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4213/7773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:20 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1336 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:21.359902 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-57dc6edc-3bbe-434e-a79f-84d6ef149796 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:21.361777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-57dc6edc-3bbe-434e-a79f-84d6ef149796 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:21.365337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=12 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:21.374480 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57dc6edc-3bbe-434e-a79f-84d6ef149796 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:21.375539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57dc6edc-3bbe-434e-a79f-84d6ef149796 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:21.376229 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57dc6edc-3bbe-434e-a79f-84d6ef149796 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:21.377141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57dc6edc-3bbe-434e-a79f-84d6ef149796 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:21.377788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57dc6edc-3bbe-434e-a79f-84d6ef149796 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:21.378395 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57dc6edc-3bbe-434e-a79f-84d6ef149796 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:21.605326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-57dc6edc-3bbe-434e-a79f-84d6ef149796 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:21.613878 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-57dc6edc-3bbe-434e-a79f-84d6ef149796 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1392 microversion: 2.1 time: 0.259606 Oct 12 23:17:21.614612 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3561/7774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:21 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1392 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:21.766184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-bc0f1a13-74b5-4b2e-b150-fb1ed8ad8c4b req-5058705f-497f-43fb-af4a-0abf045eeb66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46045a64-d654-45de-acfb-02835073e1db", "tag": "4a24f6f4-62fe-4350-8aab-5ea451ef1b2e"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:17:21.779045 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-bc0f1a13-74b5-4b2e-b150-fb1ed8ad8c4b req-5058705f-497f-43fb-af4a-0abf045eeb66 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:21.780096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-bc0f1a13-74b5-4b2e-b150-fb1ed8ad8c4b req-5058705f-497f-43fb-af4a-0abf045eeb66 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:21.780718 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-bc0f1a13-74b5-4b2e-b150-fb1ed8ad8c4b req-5058705f-497f-43fb-af4a-0abf045eeb66 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:21.792800 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-bc0f1a13-74b5-4b2e-b150-fb1ed8ad8c4b req-5058705f-497f-43fb-af4a-0abf045eeb66 service nova] Creating event network-changed:4a24f6f4-62fe-4350-8aab-5ea451ef1b2e for instance 46045a64-d654-45de-acfb-02835073e1db on n-h2-861111-1 Oct 12 23:17:21.799039 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-bc0f1a13-74b5-4b2e-b150-fb1ed8ad8c4b req-5058705f-497f-43fb-af4a-0abf045eeb66 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040560 Oct 12 23:17:21.800067 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4214/7775] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:17:22.638172 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb9892aa-7c4d-4f59-b82b-d5ed65b67665 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:22.639404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eb9892aa-7c4d-4f59-b82b-d5ed65b67665 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:22.646237 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb9892aa-7c4d-4f59-b82b-d5ed65b67665 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:22.646730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb9892aa-7c4d-4f59-b82b-d5ed65b67665 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:22.647182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb9892aa-7c4d-4f59-b82b-d5ed65b67665 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:22.647978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb9892aa-7c4d-4f59-b82b-d5ed65b67665 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:22.648448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb9892aa-7c4d-4f59-b82b-d5ed65b67665 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:22.648887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb9892aa-7c4d-4f59-b82b-d5ed65b67665 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:22.784783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eb9892aa-7c4d-4f59-b82b-d5ed65b67665 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:22.792475 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb9892aa-7c4d-4f59-b82b-d5ed65b67665 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1392 microversion: 2.1 time: 0.158287 Oct 12 23:17:22.793044 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3562/7776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:22 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:23.817531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-139b1a21-2ff8-49b4-afcd-f700272b24da tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:23.818230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-139b1a21-2ff8-49b4-afcd-f700272b24da tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:23.824407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-139b1a21-2ff8-49b4-afcd-f700272b24da tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:23.824889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-139b1a21-2ff8-49b4-afcd-f700272b24da tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:23.825327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-139b1a21-2ff8-49b4-afcd-f700272b24da tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:23.826016 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-139b1a21-2ff8-49b4-afcd-f700272b24da tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:23.826953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-139b1a21-2ff8-49b4-afcd-f700272b24da tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:23.827414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-139b1a21-2ff8-49b4-afcd-f700272b24da tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:23.957475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-139b1a21-2ff8-49b4-afcd-f700272b24da tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:23.964980 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-139b1a21-2ff8-49b4-afcd-f700272b24da tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1392 microversion: 2.1 time: 0.152772 Oct 12 23:17:23.965554 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4215/7777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:23 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:24.987631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1450603a-87ef-4a6d-b3b2-03576bd91a89 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:24.988257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1450603a-87ef-4a6d-b3b2-03576bd91a89 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:24.995847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1450603a-87ef-4a6d-b3b2-03576bd91a89 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:24.996337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1450603a-87ef-4a6d-b3b2-03576bd91a89 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:24.996783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1450603a-87ef-4a6d-b3b2-03576bd91a89 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:24.997476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1450603a-87ef-4a6d-b3b2-03576bd91a89 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:24.998446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1450603a-87ef-4a6d-b3b2-03576bd91a89 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:24.998883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1450603a-87ef-4a6d-b3b2-03576bd91a89 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:25.129768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1450603a-87ef-4a6d-b3b2-03576bd91a89 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:25.137350 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1450603a-87ef-4a6d-b3b2-03576bd91a89 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1392 microversion: 2.1 time: 0.153955 Oct 12 23:17:25.137925 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3563/7778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:24 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:26.161075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e6b31821-2ee8-4975-89bb-c64bf80149b4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:26.161696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e6b31821-2ee8-4975-89bb-c64bf80149b4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:26.168069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6b31821-2ee8-4975-89bb-c64bf80149b4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:26.168555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6b31821-2ee8-4975-89bb-c64bf80149b4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:26.168989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6b31821-2ee8-4975-89bb-c64bf80149b4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:26.169677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6b31821-2ee8-4975-89bb-c64bf80149b4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:26.170757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6b31821-2ee8-4975-89bb-c64bf80149b4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:26.171184 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6b31821-2ee8-4975-89bb-c64bf80149b4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:26.309003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e6b31821-2ee8-4975-89bb-c64bf80149b4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:26.317042 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e6b31821-2ee8-4975-89bb-c64bf80149b4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1392 microversion: 2.1 time: 0.159844 Oct 12 23:17:26.317696 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4216/7779] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:26 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:27.340240 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-468fd54e-85e7-4dfb-b1a2-3416eefd2734 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:27.340864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-468fd54e-85e7-4dfb-b1a2-3416eefd2734 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:27.348275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-468fd54e-85e7-4dfb-b1a2-3416eefd2734 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:27.348765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-468fd54e-85e7-4dfb-b1a2-3416eefd2734 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:27.349213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-468fd54e-85e7-4dfb-b1a2-3416eefd2734 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:27.349909 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-468fd54e-85e7-4dfb-b1a2-3416eefd2734 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:27.350375 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-468fd54e-85e7-4dfb-b1a2-3416eefd2734 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:27.350808 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-468fd54e-85e7-4dfb-b1a2-3416eefd2734 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:27.480706 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-468fd54e-85e7-4dfb-b1a2-3416eefd2734 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:27.488809 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-468fd54e-85e7-4dfb-b1a2-3416eefd2734 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1392 microversion: 2.1 time: 0.152512 Oct 12 23:17:27.489379 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3564/7780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:27 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:28.366317 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-9a82f21d-ba5b-482d-9f6f-62947d1b3155 req-b5708dc2-a048-4057-8ab0-08f217913953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46045a64-d654-45de-acfb-02835073e1db", "name": "network-vif-plugged", "status": "completed", "tag": "4a24f6f4-62fe-4350-8aab-5ea451ef1b2e"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:17:28.376892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9a82f21d-ba5b-482d-9f6f-62947d1b3155 req-b5708dc2-a048-4057-8ab0-08f217913953 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:28.377363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9a82f21d-ba5b-482d-9f6f-62947d1b3155 req-b5708dc2-a048-4057-8ab0-08f217913953 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:28.377788 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-9a82f21d-ba5b-482d-9f6f-62947d1b3155 req-b5708dc2-a048-4057-8ab0-08f217913953 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:28.388714 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-9a82f21d-ba5b-482d-9f6f-62947d1b3155 req-b5708dc2-a048-4057-8ab0-08f217913953 service nova] Creating event network-vif-plugged:4a24f6f4-62fe-4350-8aab-5ea451ef1b2e for instance 46045a64-d654-45de-acfb-02835073e1db on n-h2-861111-1 Oct 12 23:17:28.393638 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-9a82f21d-ba5b-482d-9f6f-62947d1b3155 req-b5708dc2-a048-4057-8ab0-08f217913953 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087786 Oct 12 23:17:28.394217 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4217/7781] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:17:28.512504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-73962cff-db23-451e-b39f-3a0787020851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:28.513138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-73962cff-db23-451e-b39f-3a0787020851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:28.519917 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73962cff-db23-451e-b39f-3a0787020851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:28.520427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73962cff-db23-451e-b39f-3a0787020851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:28.520873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73962cff-db23-451e-b39f-3a0787020851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:28.521585 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73962cff-db23-451e-b39f-3a0787020851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:28.522051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73962cff-db23-451e-b39f-3a0787020851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:28.522490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73962cff-db23-451e-b39f-3a0787020851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:28.653936 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-73962cff-db23-451e-b39f-3a0787020851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:28.662081 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-73962cff-db23-451e-b39f-3a0787020851 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1392 microversion: 2.1 time: 0.153539 Oct 12 23:17:28.662657 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3565/7782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:28 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:29.682721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:29.683571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:29.690300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2a3f7c41-829f-430b-b25c-760d60170251 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:29.691024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2a3f7c41-829f-430b-b25c-760d60170251 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:29.698130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a3f7c41-829f-430b-b25c-760d60170251 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:29.698617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a3f7c41-829f-430b-b25c-760d60170251 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:29.699056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a3f7c41-829f-430b-b25c-760d60170251 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:29.699780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a3f7c41-829f-430b-b25c-760d60170251 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:29.700234 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a3f7c41-829f-430b-b25c-760d60170251 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:29.700667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2a3f7c41-829f-430b-b25c-760d60170251 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:29.837320 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2a3f7c41-829f-430b-b25c-760d60170251 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:29.854894 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2a3f7c41-829f-430b-b25c-760d60170251 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1392 microversion: 2.1 time: 0.172826 Oct 12 23:17:29.855572 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4218/7783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:29 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:30.878343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3d6e18a9-a291-4d8e-bc8a-fa2898b64f49 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:30.878981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3d6e18a9-a291-4d8e-bc8a-fa2898b64f49 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:30.881306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:30.886857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d6e18a9-a291-4d8e-bc8a-fa2898b64f49 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:30.887393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d6e18a9-a291-4d8e-bc8a-fa2898b64f49 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:30.887853 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d6e18a9-a291-4d8e-bc8a-fa2898b64f49 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:30.888576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d6e18a9-a291-4d8e-bc8a-fa2898b64f49 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:30.889045 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d6e18a9-a291-4d8e-bc8a-fa2898b64f49 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:30.889489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d6e18a9-a291-4d8e-bc8a-fa2898b64f49 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:31.018834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3d6e18a9-a291-4d8e-bc8a-fa2898b64f49 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:31.026647 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3d6e18a9-a291-4d8e-bc8a-fa2898b64f49 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1563 microversion: 2.1 time: 0.152515 Oct 12 23:17:31.027164 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3566/7784] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:30 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:31.049531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-82fb015c-dd94-4aa1-a8a6-3194f2a43889 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:31.050153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-82fb015c-dd94-4aa1-a8a6-3194f2a43889 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:31.056885 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82fb015c-dd94-4aa1-a8a6-3194f2a43889 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:31.057371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82fb015c-dd94-4aa1-a8a6-3194f2a43889 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:31.057815 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82fb015c-dd94-4aa1-a8a6-3194f2a43889 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:31.058510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82fb015c-dd94-4aa1-a8a6-3194f2a43889 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:31.058966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82fb015c-dd94-4aa1-a8a6-3194f2a43889 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:31.059432 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-82fb015c-dd94-4aa1-a8a6-3194f2a43889 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:31.194396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-82fb015c-dd94-4aa1-a8a6-3194f2a43889 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:31.202267 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-82fb015c-dd94-4aa1-a8a6-3194f2a43889 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1563 microversion: 2.1 time: 0.156648 Oct 12 23:17:31.202848 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4219/7785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:31 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:33.058036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-151909c5-6c64-4ac0-92e4-2c7193703d80 req-454798d1-1886-4892-baed-696ac8ea4b69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46045a64-d654-45de-acfb-02835073e1db", "tag": "4a24f6f4-62fe-4350-8aab-5ea451ef1b2e"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:17:33.062730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5c5dd3fa-0e50-4f32-b8ef-ca28f4d39706 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:33.063561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5c5dd3fa-0e50-4f32-b8ef-ca28f4d39706 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:33.069074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-151909c5-6c64-4ac0-92e4-2c7193703d80 req-454798d1-1886-4892-baed-696ac8ea4b69 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:33.069555 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-151909c5-6c64-4ac0-92e4-2c7193703d80 req-454798d1-1886-4892-baed-696ac8ea4b69 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:33.070192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-151909c5-6c64-4ac0-92e4-2c7193703d80 req-454798d1-1886-4892-baed-696ac8ea4b69 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:33.070903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c5dd3fa-0e50-4f32-b8ef-ca28f4d39706 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:33.071445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c5dd3fa-0e50-4f32-b8ef-ca28f4d39706 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:33.071903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c5dd3fa-0e50-4f32-b8ef-ca28f4d39706 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:33.072645 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c5dd3fa-0e50-4f32-b8ef-ca28f4d39706 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:33.073121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c5dd3fa-0e50-4f32-b8ef-ca28f4d39706 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:33.073566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c5dd3fa-0e50-4f32-b8ef-ca28f4d39706 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:33.082376 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-151909c5-6c64-4ac0-92e4-2c7193703d80 req-454798d1-1886-4892-baed-696ac8ea4b69 service nova] Creating event network-changed:4a24f6f4-62fe-4350-8aab-5ea451ef1b2e for instance 46045a64-d654-45de-acfb-02835073e1db on n-h2-861111-1 Oct 12 23:17:33.088011 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-151909c5-6c64-4ac0-92e4-2c7193703d80 req-454798d1-1886-4892-baed-696ac8ea4b69 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033548 Oct 12 23:17:33.088859 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4220/7786] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:17:33.293719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5c5dd3fa-0e50-4f32-b8ef-ca28f4d39706 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:33.302457 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5c5dd3fa-0e50-4f32-b8ef-ca28f4d39706 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1563 microversion: 2.1 time: 0.252599 Oct 12 23:17:33.303441 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3567/7787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:33 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1563 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:04.574369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8661c83c-24d7-436f-bf44-dfc2b5c41550 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:18:04.576697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8661c83c-24d7-436f-bf44-dfc2b5c41550 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:04.578825 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:18:04.579484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=38 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:18:04.585747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8661c83c-24d7-436f-bf44-dfc2b5c41550 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:04.586271 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8661c83c-24d7-436f-bf44-dfc2b5c41550 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:04.586693 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8661c83c-24d7-436f-bf44-dfc2b5c41550 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:04.587429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8661c83c-24d7-436f-bf44-dfc2b5c41550 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:04.587889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8661c83c-24d7-436f-bf44-dfc2b5c41550 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:04.588321 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8661c83c-24d7-436f-bf44-dfc2b5c41550 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:04.642745 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8661c83c-24d7-436f-bf44-dfc2b5c41550 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db/action" status: 200 len: 24570 microversion: 2.1 time: 0.072790 Oct 12 23:18:04.643352 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4221/7788] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:18:04 2022] POST /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db/action => generated 24570 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:18:35.072637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:18:35.073555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=42 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:18:35.074938 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:18:35.075071 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 23:18:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db/action (ip 10.222.0.16) !!! Oct 12 23:18:35.139317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f8bcfcd-0c38-4aa7-99a8-b878ca09c0c6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:18:35.141623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8f8bcfcd-0c38-4aa7-99a8-b878ca09c0c6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:35.148004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f8bcfcd-0c38-4aa7-99a8-b878ca09c0c6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:35.148491 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f8bcfcd-0c38-4aa7-99a8-b878ca09c0c6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:35.148940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f8bcfcd-0c38-4aa7-99a8-b878ca09c0c6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:35.149631 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f8bcfcd-0c38-4aa7-99a8-b878ca09c0c6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:35.150089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f8bcfcd-0c38-4aa7-99a8-b878ca09c0c6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:35.150523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f8bcfcd-0c38-4aa7-99a8-b878ca09c0c6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:35.251187 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f8bcfcd-0c38-4aa7-99a8-b878ca09c0c6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:35.257443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8f8bcfcd-0c38-4aa7-99a8-b878ca09c0c6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Old instance type m1.heat2, new instance type m1.heat {{(pid=120452) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 23:18:35.263915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8f8bcfcd-0c38-4aa7-99a8-b878ca09c0c6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:18:35.264343 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8f8bcfcd-0c38-4aa7-99a8-b878ca09c0c6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:18:35.264848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8f8bcfcd-0c38-4aa7-99a8-b878ca09c0c6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:18:35.265269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8f8bcfcd-0c38-4aa7-99a8-b878ca09c0c6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:18:35.265680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-8f8bcfcd-0c38-4aa7-99a8-b878ca09c0c6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:18:35.330192 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f8bcfcd-0c38-4aa7-99a8-b878ca09c0c6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db/action" status: 202 len: 0 microversion: 2.1 time: 0.259144 Oct 12 23:18:35.330726 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3568/7789] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:18:35 2022] POST /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:18:35.340169 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c8da44ea-4025-4835-9987-21b5faf7f19a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:35.340863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c8da44ea-4025-4835-9987-21b5faf7f19a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:35.343580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:18:35.344383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:18:35.350872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8da44ea-4025-4835-9987-21b5faf7f19a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:35.351424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8da44ea-4025-4835-9987-21b5faf7f19a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:35.351952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8da44ea-4025-4835-9987-21b5faf7f19a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:35.352750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8da44ea-4025-4835-9987-21b5faf7f19a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:35.353235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8da44ea-4025-4835-9987-21b5faf7f19a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:35.353694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c8da44ea-4025-4835-9987-21b5faf7f19a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:35.572731 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c8da44ea-4025-4835-9987-21b5faf7f19a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:35.580804 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c8da44ea-4025-4835-9987-21b5faf7f19a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1691 microversion: 2.1 time: 0.244888 Oct 12 23:18:35.581309 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4222/7790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:35 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1691 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:18:36.606123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1b5fe16b-9b65-4efa-aa2f-03f61313c4c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:36.606766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1b5fe16b-9b65-4efa-aa2f-03f61313c4c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:36.615052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b5fe16b-9b65-4efa-aa2f-03f61313c4c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:36.615583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b5fe16b-9b65-4efa-aa2f-03f61313c4c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:36.616041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b5fe16b-9b65-4efa-aa2f-03f61313c4c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:36.616758 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b5fe16b-9b65-4efa-aa2f-03f61313c4c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:36.617226 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b5fe16b-9b65-4efa-aa2f-03f61313c4c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:36.617673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1b5fe16b-9b65-4efa-aa2f-03f61313c4c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:36.746490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1b5fe16b-9b65-4efa-aa2f-03f61313c4c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:36.754553 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1b5fe16b-9b65-4efa-aa2f-03f61313c4c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1691 microversion: 2.1 time: 0.152564 Oct 12 23:18:36.755133 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3569/7791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:36 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:37.777950 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b0d51b15-51e8-4406-b773-1c3d0bc565cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:37.778576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b0d51b15-51e8-4406-b773-1c3d0bc565cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:37.785572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0d51b15-51e8-4406-b773-1c3d0bc565cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:37.786559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0d51b15-51e8-4406-b773-1c3d0bc565cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:37.787004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0d51b15-51e8-4406-b773-1c3d0bc565cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:37.787734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0d51b15-51e8-4406-b773-1c3d0bc565cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:37.788193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0d51b15-51e8-4406-b773-1c3d0bc565cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:37.788626 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b0d51b15-51e8-4406-b773-1c3d0bc565cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:37.918157 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b0d51b15-51e8-4406-b773-1c3d0bc565cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:37.925964 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b0d51b15-51e8-4406-b773-1c3d0bc565cf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1696 microversion: 2.1 time: 0.151934 Oct 12 23:18:37.927201 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4223/7792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:37 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:38.949979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e590f80c-ab42-47bc-b34e-ba4fe67b4adf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:38.950604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e590f80c-ab42-47bc-b34e-ba4fe67b4adf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:38.957391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e590f80c-ab42-47bc-b34e-ba4fe67b4adf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:38.957944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e590f80c-ab42-47bc-b34e-ba4fe67b4adf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:38.958390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e590f80c-ab42-47bc-b34e-ba4fe67b4adf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:38.959087 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e590f80c-ab42-47bc-b34e-ba4fe67b4adf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:38.959574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e590f80c-ab42-47bc-b34e-ba4fe67b4adf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:38.960010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e590f80c-ab42-47bc-b34e-ba4fe67b4adf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:39.091025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e590f80c-ab42-47bc-b34e-ba4fe67b4adf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:39.099157 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e590f80c-ab42-47bc-b34e-ba4fe67b4adf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1696 microversion: 2.1 time: 0.153156 Oct 12 23:18:39.099782 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3570/7793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:38 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:40.123733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ad6ba4d3-18ac-4efb-a3cd-c1623777b35b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:40.124278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ad6ba4d3-18ac-4efb-a3cd-c1623777b35b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:40.131294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad6ba4d3-18ac-4efb-a3cd-c1623777b35b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:40.131777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad6ba4d3-18ac-4efb-a3cd-c1623777b35b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:40.132211 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad6ba4d3-18ac-4efb-a3cd-c1623777b35b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:40.132892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad6ba4d3-18ac-4efb-a3cd-c1623777b35b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:40.133341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad6ba4d3-18ac-4efb-a3cd-c1623777b35b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:40.133763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad6ba4d3-18ac-4efb-a3cd-c1623777b35b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:40.262365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ad6ba4d3-18ac-4efb-a3cd-c1623777b35b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:40.270657 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ad6ba4d3-18ac-4efb-a3cd-c1623777b35b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1696 microversion: 2.1 time: 0.150502 Oct 12 23:18:40.271258 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4224/7794] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:40 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1696 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:41.294727 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1717dc08-29b0-4106-a8dc-d33a100c0368 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:41.295424 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1717dc08-29b0-4106-a8dc-d33a100c0368 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:41.302455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1717dc08-29b0-4106-a8dc-d33a100c0368 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:41.302955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1717dc08-29b0-4106-a8dc-d33a100c0368 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:41.303433 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1717dc08-29b0-4106-a8dc-d33a100c0368 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:41.304144 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1717dc08-29b0-4106-a8dc-d33a100c0368 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:41.304610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1717dc08-29b0-4106-a8dc-d33a100c0368 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:41.305051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1717dc08-29b0-4106-a8dc-d33a100c0368 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:41.433678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1717dc08-29b0-4106-a8dc-d33a100c0368 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:41.441456 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1717dc08-29b0-4106-a8dc-d33a100c0368 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1696 microversion: 2.1 time: 0.150659 Oct 12 23:18:41.442523 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3571/7795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:41 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1696 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:42.465963 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9da22640-6390-46f2-be3c-a37d0c4565fb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:42.466566 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9da22640-6390-46f2-be3c-a37d0c4565fb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:42.473945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9da22640-6390-46f2-be3c-a37d0c4565fb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:42.474425 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9da22640-6390-46f2-be3c-a37d0c4565fb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:42.474859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9da22640-6390-46f2-be3c-a37d0c4565fb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:42.475578 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9da22640-6390-46f2-be3c-a37d0c4565fb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:42.476029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9da22640-6390-46f2-be3c-a37d0c4565fb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:42.476455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9da22640-6390-46f2-be3c-a37d0c4565fb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:42.611653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9da22640-6390-46f2-be3c-a37d0c4565fb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:42.619477 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9da22640-6390-46f2-be3c-a37d0c4565fb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1696 microversion: 2.1 time: 0.157369 Oct 12 23:18:42.620052 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4225/7796] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:42 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:43.642744 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-337a00f0-5bbf-4a8a-873f-71309834eb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:43.643323 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-337a00f0-5bbf-4a8a-873f-71309834eb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:43.650162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-337a00f0-5bbf-4a8a-873f-71309834eb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:43.650663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-337a00f0-5bbf-4a8a-873f-71309834eb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:43.651115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-337a00f0-5bbf-4a8a-873f-71309834eb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:43.651846 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-337a00f0-5bbf-4a8a-873f-71309834eb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:43.652315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-337a00f0-5bbf-4a8a-873f-71309834eb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:43.652759 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-337a00f0-5bbf-4a8a-873f-71309834eb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:43.784333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-337a00f0-5bbf-4a8a-873f-71309834eb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:43.792582 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-337a00f0-5bbf-4a8a-873f-71309834eb7e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1696 microversion: 2.1 time: 0.153889 Oct 12 23:18:43.793161 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3572/7797] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:43 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:44.817576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8fd31694-d9d2-471b-91d3-0e6864252ab7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:44.818199 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8fd31694-d9d2-471b-91d3-0e6864252ab7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:44.825091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fd31694-d9d2-471b-91d3-0e6864252ab7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:44.825580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fd31694-d9d2-471b-91d3-0e6864252ab7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:44.826023 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fd31694-d9d2-471b-91d3-0e6864252ab7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:44.826722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fd31694-d9d2-471b-91d3-0e6864252ab7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:44.827185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fd31694-d9d2-471b-91d3-0e6864252ab7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:44.827643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8fd31694-d9d2-471b-91d3-0e6864252ab7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:44.959770 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8fd31694-d9d2-471b-91d3-0e6864252ab7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:44.967496 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8fd31694-d9d2-471b-91d3-0e6864252ab7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1696 microversion: 2.1 time: 0.154391 Oct 12 23:18:44.968068 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4226/7798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:44 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:45.991465 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-24c84ae1-f6cb-4aa0-9606-e84161cddd2e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:45.992120 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-24c84ae1-f6cb-4aa0-9606-e84161cddd2e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:45.998963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24c84ae1-f6cb-4aa0-9606-e84161cddd2e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:45.999496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24c84ae1-f6cb-4aa0-9606-e84161cddd2e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:45.999943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24c84ae1-f6cb-4aa0-9606-e84161cddd2e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:46.000894 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24c84ae1-f6cb-4aa0-9606-e84161cddd2e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:46.001353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24c84ae1-f6cb-4aa0-9606-e84161cddd2e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:46.001788 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24c84ae1-f6cb-4aa0-9606-e84161cddd2e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:46.134017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-24c84ae1-f6cb-4aa0-9606-e84161cddd2e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:46.141852 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-24c84ae1-f6cb-4aa0-9606-e84161cddd2e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1696 microversion: 2.1 time: 0.154373 Oct 12 23:18:46.142425 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3573/7799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:45 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:47.166240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2ee34be3-cce0-4fe8-a367-022ca773b0d1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:47.166869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2ee34be3-cce0-4fe8-a367-022ca773b0d1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:47.174492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ee34be3-cce0-4fe8-a367-022ca773b0d1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:47.174981 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ee34be3-cce0-4fe8-a367-022ca773b0d1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:47.175460 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ee34be3-cce0-4fe8-a367-022ca773b0d1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:47.176163 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ee34be3-cce0-4fe8-a367-022ca773b0d1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:47.176630 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ee34be3-cce0-4fe8-a367-022ca773b0d1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:47.177067 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ee34be3-cce0-4fe8-a367-022ca773b0d1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:47.311394 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2ee34be3-cce0-4fe8-a367-022ca773b0d1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:47.319704 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2ee34be3-cce0-4fe8-a367-022ca773b0d1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1696 microversion: 2.1 time: 0.157349 Oct 12 23:18:47.320282 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4227/7800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:47 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:48.343726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f8ca31af-471e-4e43-be53-caad0f025728 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:48.344357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f8ca31af-471e-4e43-be53-caad0f025728 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:48.351737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8ca31af-471e-4e43-be53-caad0f025728 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:48.352235 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8ca31af-471e-4e43-be53-caad0f025728 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:48.352689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8ca31af-471e-4e43-be53-caad0f025728 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:48.353394 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8ca31af-471e-4e43-be53-caad0f025728 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:48.353861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8ca31af-471e-4e43-be53-caad0f025728 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:48.354300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8ca31af-471e-4e43-be53-caad0f025728 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:48.484184 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f8ca31af-471e-4e43-be53-caad0f025728 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:48.491890 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f8ca31af-471e-4e43-be53-caad0f025728 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1696 microversion: 2.1 time: 0.152110 Oct 12 23:18:48.492472 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3574/7801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:48 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:49.515589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e61b1f5-4bb7-4d13-b64b-89f33295d3b5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:49.516214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9e61b1f5-4bb7-4d13-b64b-89f33295d3b5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:49.522799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e61b1f5-4bb7-4d13-b64b-89f33295d3b5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:49.523316 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e61b1f5-4bb7-4d13-b64b-89f33295d3b5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:49.523758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e61b1f5-4bb7-4d13-b64b-89f33295d3b5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:49.524456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e61b1f5-4bb7-4d13-b64b-89f33295d3b5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:49.524971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e61b1f5-4bb7-4d13-b64b-89f33295d3b5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:49.525328 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e61b1f5-4bb7-4d13-b64b-89f33295d3b5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:49.760602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9e61b1f5-4bb7-4d13-b64b-89f33295d3b5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:49.768632 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9e61b1f5-4bb7-4d13-b64b-89f33295d3b5 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1695 microversion: 2.1 time: 0.256819 Oct 12 23:18:49.769351 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4228/7802] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:49 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1695 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:50.106422 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-eee2720d-25ea-4ea2-a903-c315eea3971e req-17ab9327-ec51-4d29-8581-cbefdd59f8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46045a64-d654-45de-acfb-02835073e1db", "name": "network-vif-unplugged", "status": "completed", "tag": "4a24f6f4-62fe-4350-8aab-5ea451ef1b2e"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:18:50.116171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-eee2720d-25ea-4ea2-a903-c315eea3971e req-17ab9327-ec51-4d29-8581-cbefdd59f8f1 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:50.116660 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-eee2720d-25ea-4ea2-a903-c315eea3971e req-17ab9327-ec51-4d29-8581-cbefdd59f8f1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:50.117139 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-eee2720d-25ea-4ea2-a903-c315eea3971e req-17ab9327-ec51-4d29-8581-cbefdd59f8f1 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:50.129168 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-eee2720d-25ea-4ea2-a903-c315eea3971e req-17ab9327-ec51-4d29-8581-cbefdd59f8f1 service nova] Creating event network-vif-unplugged:4a24f6f4-62fe-4350-8aab-5ea451ef1b2e for instance 46045a64-d654-45de-acfb-02835073e1db on n-h1-861111-1 Oct 12 23:18:50.134555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [req-eee2720d-25ea-4ea2-a903-c315eea3971e req-17ab9327-ec51-4d29-8581-cbefdd59f8f1 service nova] Instance 46045a64-d654-45de-acfb-02835073e1db is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:18:50.145857 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-eee2720d-25ea-4ea2-a903-c315eea3971e req-17ab9327-ec51-4d29-8581-cbefdd59f8f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100996 Oct 12 23:18:50.146470 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3575/7803] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:18:50.792549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9cea91d7-e7c4-4cbe-985a-3fa179cf91f8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:50.793175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9cea91d7-e7c4-4cbe-985a-3fa179cf91f8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:50.800056 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cea91d7-e7c4-4cbe-985a-3fa179cf91f8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:50.800545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cea91d7-e7c4-4cbe-985a-3fa179cf91f8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:50.801802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cea91d7-e7c4-4cbe-985a-3fa179cf91f8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:50.802181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cea91d7-e7c4-4cbe-985a-3fa179cf91f8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:50.802641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cea91d7-e7c4-4cbe-985a-3fa179cf91f8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:50.803071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9cea91d7-e7c4-4cbe-985a-3fa179cf91f8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:51.023567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9cea91d7-e7c4-4cbe-985a-3fa179cf91f8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:51.031306 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9cea91d7-e7c4-4cbe-985a-3fa179cf91f8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1695 microversion: 2.1 time: 0.242634 Oct 12 23:18:51.031887 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4229/7804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:50 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1695 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:52.056083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0a105ec9-16d7-4d97-bc08-cb0508c1ec18 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:52.056708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0a105ec9-16d7-4d97-bc08-cb0508c1ec18 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:52.062921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a105ec9-16d7-4d97-bc08-cb0508c1ec18 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:52.063447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a105ec9-16d7-4d97-bc08-cb0508c1ec18 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:52.063900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a105ec9-16d7-4d97-bc08-cb0508c1ec18 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:52.064593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a105ec9-16d7-4d97-bc08-cb0508c1ec18 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:52.065054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a105ec9-16d7-4d97-bc08-cb0508c1ec18 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:52.065489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a105ec9-16d7-4d97-bc08-cb0508c1ec18 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:52.163667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-17297fb6-5994-4c7d-b2d3-b3d567cb0688 req-fdd72fc0-849f-4cc2-90fb-52f112c69542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46045a64-d654-45de-acfb-02835073e1db", "tag": "4a24f6f4-62fe-4350-8aab-5ea451ef1b2e"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:18:52.173706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-17297fb6-5994-4c7d-b2d3-b3d567cb0688 req-fdd72fc0-849f-4cc2-90fb-52f112c69542 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:52.174182 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-17297fb6-5994-4c7d-b2d3-b3d567cb0688 req-fdd72fc0-849f-4cc2-90fb-52f112c69542 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:52.174613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-17297fb6-5994-4c7d-b2d3-b3d567cb0688 req-fdd72fc0-849f-4cc2-90fb-52f112c69542 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:52.186603 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-17297fb6-5994-4c7d-b2d3-b3d567cb0688 req-fdd72fc0-849f-4cc2-90fb-52f112c69542 service nova] Creating event network-changed:4a24f6f4-62fe-4350-8aab-5ea451ef1b2e for instance 46045a64-d654-45de-acfb-02835073e1db on n-h1-861111-1 Oct 12 23:18:52.192451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [req-17297fb6-5994-4c7d-b2d3-b3d567cb0688 req-fdd72fc0-849f-4cc2-90fb-52f112c69542 service nova] Instance 46045a64-d654-45de-acfb-02835073e1db is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861111-1', 'n-h2-861111-1'} {{(pid=120453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:18:52.202998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0a105ec9-16d7-4d97-bc08-cb0508c1ec18 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:52.203184 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-17297fb6-5994-4c7d-b2d3-b3d567cb0688 req-fdd72fc0-849f-4cc2-90fb-52f112c69542 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043026 Oct 12 23:18:52.203700 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4230/7805] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:18:52.211028 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0a105ec9-16d7-4d97-bc08-cb0508c1ec18 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1693 microversion: 2.1 time: 0.160254 Oct 12 23:18:52.211740 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3576/7806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:52 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:53.236505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a72f2e99-2ee1-4319-95d6-80b59402a0a3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:53.237131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a72f2e99-2ee1-4319-95d6-80b59402a0a3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:53.243333 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a72f2e99-2ee1-4319-95d6-80b59402a0a3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:53.243827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a72f2e99-2ee1-4319-95d6-80b59402a0a3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:53.244272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a72f2e99-2ee1-4319-95d6-80b59402a0a3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:53.244968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a72f2e99-2ee1-4319-95d6-80b59402a0a3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:53.245430 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a72f2e99-2ee1-4319-95d6-80b59402a0a3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:53.245870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a72f2e99-2ee1-4319-95d6-80b59402a0a3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:53.376535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a72f2e99-2ee1-4319-95d6-80b59402a0a3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:53.384782 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a72f2e99-2ee1-4319-95d6-80b59402a0a3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1690 microversion: 2.1 time: 0.153543 Oct 12 23:18:53.385360 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4231/7807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:53 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:53.408183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb9ae8df-0ac4-4a0e-aca3-0da5469dab3c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:18:53.408728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eb9ae8df-0ac4-4a0e-aca3-0da5469dab3c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:53.415456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb9ae8df-0ac4-4a0e-aca3-0da5469dab3c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:53.415949 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb9ae8df-0ac4-4a0e-aca3-0da5469dab3c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:53.416399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb9ae8df-0ac4-4a0e-aca3-0da5469dab3c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:53.417128 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb9ae8df-0ac4-4a0e-aca3-0da5469dab3c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:53.417593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb9ae8df-0ac4-4a0e-aca3-0da5469dab3c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:53.418026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb9ae8df-0ac4-4a0e-aca3-0da5469dab3c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:53.474440 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb9ae8df-0ac4-4a0e-aca3-0da5469dab3c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db/action" status: 204 len: 0 microversion: 2.1 time: 0.069977 Oct 12 23:18:53.475072 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3577/7808] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:18:53 2022] POST /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:18:53.483399 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c58d5f0c-deb8-4032-b235-b70fb9ef4e33 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:53.484120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c58d5f0c-deb8-4032-b235-b70fb9ef4e33 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:53.490521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c58d5f0c-deb8-4032-b235-b70fb9ef4e33 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:53.491131 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c58d5f0c-deb8-4032-b235-b70fb9ef4e33 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:53.491725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c58d5f0c-deb8-4032-b235-b70fb9ef4e33 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:53.492422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c58d5f0c-deb8-4032-b235-b70fb9ef4e33 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:53.492927 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c58d5f0c-deb8-4032-b235-b70fb9ef4e33 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:53.493490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c58d5f0c-deb8-4032-b235-b70fb9ef4e33 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:53.630502 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c58d5f0c-deb8-4032-b235-b70fb9ef4e33 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:53.638591 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c58d5f0c-deb8-4032-b235-b70fb9ef4e33 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1690 microversion: 2.1 time: 0.159329 Oct 12 23:18:53.639207 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4232/7809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:53 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:53.664203 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af1e24db-156a-479d-853e-b5d01b6f9bf7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:53.664922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-af1e24db-156a-479d-853e-b5d01b6f9bf7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:53.671013 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af1e24db-156a-479d-853e-b5d01b6f9bf7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:53.671561 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af1e24db-156a-479d-853e-b5d01b6f9bf7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:53.672014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af1e24db-156a-479d-853e-b5d01b6f9bf7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:53.672724 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af1e24db-156a-479d-853e-b5d01b6f9bf7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:53.673188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af1e24db-156a-479d-853e-b5d01b6f9bf7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:53.673624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af1e24db-156a-479d-853e-b5d01b6f9bf7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:54.225190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-af1e24db-156a-479d-853e-b5d01b6f9bf7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:54.233198 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-af1e24db-156a-479d-853e-b5d01b6f9bf7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1690 microversion: 2.1 time: 0.573258 Oct 12 23:18:54.233954 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3578/7810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:53 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1690 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:55.256695 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1c2a0aee-9eea-4c78-8783-014d78658cfa tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:55.257302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1c2a0aee-9eea-4c78-8783-014d78658cfa tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:55.264377 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c2a0aee-9eea-4c78-8783-014d78658cfa tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:55.264866 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c2a0aee-9eea-4c78-8783-014d78658cfa tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:55.265307 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c2a0aee-9eea-4c78-8783-014d78658cfa tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:55.266029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c2a0aee-9eea-4c78-8783-014d78658cfa tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:55.266493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c2a0aee-9eea-4c78-8783-014d78658cfa tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:55.266922 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1c2a0aee-9eea-4c78-8783-014d78658cfa tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:55.399290 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-1c2a0aee-9eea-4c78-8783-014d78658cfa tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:55.407105 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1c2a0aee-9eea-4c78-8783-014d78658cfa tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1682 microversion: 2.1 time: 0.154321 Oct 12 23:18:55.407725 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4233/7811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:55 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:56.367898 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-74e711b7-5668-42af-a6a4-a1b99bc72c71 req-0d87be07-243d-477b-8822-29ffbd7805a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46045a64-d654-45de-acfb-02835073e1db", "name": "network-vif-plugged", "status": "completed", "tag": "4a24f6f4-62fe-4350-8aab-5ea451ef1b2e"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:18:56.378748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-74e711b7-5668-42af-a6a4-a1b99bc72c71 req-0d87be07-243d-477b-8822-29ffbd7805a8 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:56.379274 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-74e711b7-5668-42af-a6a4-a1b99bc72c71 req-0d87be07-243d-477b-8822-29ffbd7805a8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:56.379745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-74e711b7-5668-42af-a6a4-a1b99bc72c71 req-0d87be07-243d-477b-8822-29ffbd7805a8 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:56.394814 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-74e711b7-5668-42af-a6a4-a1b99bc72c71 req-0d87be07-243d-477b-8822-29ffbd7805a8 service nova] Creating event network-vif-plugged:4a24f6f4-62fe-4350-8aab-5ea451ef1b2e for instance 46045a64-d654-45de-acfb-02835073e1db on n-h1-861111-1 Oct 12 23:18:56.399815 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-74e711b7-5668-42af-a6a4-a1b99bc72c71 req-0d87be07-243d-477b-8822-29ffbd7805a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036215 Oct 12 23:18:56.400607 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3579/7812] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:19:17.597821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0c132cc4-53aa-4f52-a0b9-6571c0ec8bee tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:19:17.600552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0c132cc4-53aa-4f52-a0b9-6571c0ec8bee tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:17.603189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=24 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:19:17.604097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=70 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:19:17.609828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c132cc4-53aa-4f52-a0b9-6571c0ec8bee tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:17.610323 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c132cc4-53aa-4f52-a0b9-6571c0ec8bee tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:17.610765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c132cc4-53aa-4f52-a0b9-6571c0ec8bee tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:17.611526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c132cc4-53aa-4f52-a0b9-6571c0ec8bee tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:17.611985 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c132cc4-53aa-4f52-a0b9-6571c0ec8bee tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:17.612419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-0c132cc4-53aa-4f52-a0b9-6571c0ec8bee tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:17.673200 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0c132cc4-53aa-4f52-a0b9-6571c0ec8bee tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db/action" status: 200 len: 24575 microversion: 2.1 time: 0.079114 Oct 12 23:19:17.673859 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4234/7813] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:19:17 2022] POST /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db/action => generated 24575 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:19:24.883174 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=28 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:19:24.883963 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:19:24.889067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a66188dc-f56c-4309-bead-321eb0a3ecfe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:24.889919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a66188dc-f56c-4309-bead-321eb0a3ecfe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:24.891173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-2e268f19-91f4-4d06-a7a5-8ca6b86a69fa req-0fc97d61-4d27-47a4-a37c-2fe833696005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46045a64-d654-45de-acfb-02835073e1db", "tag": "4a24f6f4-62fe-4350-8aab-5ea451ef1b2e"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:19:24.899599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a66188dc-f56c-4309-bead-321eb0a3ecfe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:24.900382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a66188dc-f56c-4309-bead-321eb0a3ecfe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:24.901054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a66188dc-f56c-4309-bead-321eb0a3ecfe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:24.901993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a66188dc-f56c-4309-bead-321eb0a3ecfe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:24.902647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a66188dc-f56c-4309-bead-321eb0a3ecfe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:24.903074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2e268f19-91f4-4d06-a7a5-8ca6b86a69fa req-0fc97d61-4d27-47a4-a37c-2fe833696005 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:24.903427 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a66188dc-f56c-4309-bead-321eb0a3ecfe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:24.903590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2e268f19-91f4-4d06-a7a5-8ca6b86a69fa req-0fc97d61-4d27-47a4-a37c-2fe833696005 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:24.904222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-2e268f19-91f4-4d06-a7a5-8ca6b86a69fa req-0fc97d61-4d27-47a4-a37c-2fe833696005 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:24.917251 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-2e268f19-91f4-4d06-a7a5-8ca6b86a69fa req-0fc97d61-4d27-47a4-a37c-2fe833696005 service nova] Creating event network-changed:4a24f6f4-62fe-4350-8aab-5ea451ef1b2e for instance 46045a64-d654-45de-acfb-02835073e1db on n-h1-861111-1 Oct 12 23:19:24.922682 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-2e268f19-91f4-4d06-a7a5-8ca6b86a69fa req-0fc97d61-4d27-47a4-a37c-2fe833696005 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035769 Oct 12 23:19:24.923318 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4235/7814] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:19:24.933739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a66188dc-f56c-4309-bead-321eb0a3ecfe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:19:25.020736 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a66188dc-f56c-4309-bead-321eb0a3ecfe tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "DELETE /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 204 len: 0 microversion: 2.1 time: 0.138725 Oct 12 23:19:25.021731 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3580/7815] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:19:24 2022] DELETE /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:19:25.031284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-acbdadb3-9514-45fb-b26f-072bb691119b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:25.032332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-acbdadb3-9514-45fb-b26f-072bb691119b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:25.039694 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acbdadb3-9514-45fb-b26f-072bb691119b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:25.040193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acbdadb3-9514-45fb-b26f-072bb691119b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:25.040667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acbdadb3-9514-45fb-b26f-072bb691119b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:25.041342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acbdadb3-9514-45fb-b26f-072bb691119b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:25.041804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acbdadb3-9514-45fb-b26f-072bb691119b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:25.042242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-acbdadb3-9514-45fb-b26f-072bb691119b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:25.194335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-acbdadb3-9514-45fb-b26f-072bb691119b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:19:25.202249 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-acbdadb3-9514-45fb-b26f-072bb691119b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1688 microversion: 2.1 time: 0.175825 Oct 12 23:19:25.202829 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4236/7816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:19:25 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:19:26.227322 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cc2077c7-ba0d-4454-aa7e-1a968f5b438a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:26.228082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cc2077c7-ba0d-4454-aa7e-1a968f5b438a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:26.234906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc2077c7-ba0d-4454-aa7e-1a968f5b438a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:26.235441 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc2077c7-ba0d-4454-aa7e-1a968f5b438a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:26.235895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc2077c7-ba0d-4454-aa7e-1a968f5b438a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:26.236600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc2077c7-ba0d-4454-aa7e-1a968f5b438a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:26.237067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc2077c7-ba0d-4454-aa7e-1a968f5b438a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:26.237508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cc2077c7-ba0d-4454-aa7e-1a968f5b438a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:26.377160 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cc2077c7-ba0d-4454-aa7e-1a968f5b438a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:19:26.385083 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cc2077c7-ba0d-4454-aa7e-1a968f5b438a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1688 microversion: 2.1 time: 0.162728 Oct 12 23:19:26.385664 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3581/7817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:19:26 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:19:26.961463 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-50c954c3-51da-4936-9a87-5e3bd03b205c req-89f47aa1-1405-419a-a32f-2c49773dda35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46045a64-d654-45de-acfb-02835073e1db", "name": "network-vif-deleted", "tag": "4a24f6f4-62fe-4350-8aab-5ea451ef1b2e"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:19:26.971624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-50c954c3-51da-4936-9a87-5e3bd03b205c req-89f47aa1-1405-419a-a32f-2c49773dda35 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:26.972109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-50c954c3-51da-4936-9a87-5e3bd03b205c req-89f47aa1-1405-419a-a32f-2c49773dda35 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:26.972547 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-50c954c3-51da-4936-9a87-5e3bd03b205c req-89f47aa1-1405-419a-a32f-2c49773dda35 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:26.984842 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-50c954c3-51da-4936-9a87-5e3bd03b205c req-89f47aa1-1405-419a-a32f-2c49773dda35 service nova] Creating event network-vif-deleted:4a24f6f4-62fe-4350-8aab-5ea451ef1b2e for instance 46045a64-d654-45de-acfb-02835073e1db on n-h1-861111-1 Oct 12 23:19:26.989507 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-50c954c3-51da-4936-9a87-5e3bd03b205c req-89f47aa1-1405-419a-a32f-2c49773dda35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032310 Oct 12 23:19:26.990107 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4237/7818] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:19:27.409895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a5299195-02bd-406a-918e-48072b767e51 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:27.411017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a5299195-02bd-406a-918e-48072b767e51 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:27.417815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5299195-02bd-406a-918e-48072b767e51 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:27.418313 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5299195-02bd-406a-918e-48072b767e51 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:27.418765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5299195-02bd-406a-918e-48072b767e51 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:27.419488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5299195-02bd-406a-918e-48072b767e51 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:27.419952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5299195-02bd-406a-918e-48072b767e51 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:27.420386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5299195-02bd-406a-918e-48072b767e51 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:27.452783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5299195-02bd-406a-918e-48072b767e51 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:27.453289 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5299195-02bd-406a-918e-48072b767e51 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:27.453922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5299195-02bd-406a-918e-48072b767e51 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:27.454412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-a5299195-02bd-406a-918e-48072b767e51 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lazy-loading 'fault' on Instance uuid 46045a64-d654-45de-acfb-02835073e1db {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:19:27.496108 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a5299195-02bd-406a-918e-48072b767e51 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:19:27.504207 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a5299195-02bd-406a-918e-48072b767e51 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 200 len: 1356 microversion: 2.1 time: 0.098242 Oct 12 23:19:27.504795 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3582/7819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:19:27 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 1356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:19:28.530874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-85de86de-aaae-41c1-90ab-9cb20caa71f7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:28.531610 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-85de86de-aaae-41c1-90ab-9cb20caa71f7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: 46045a64-d654-45de-acfb-02835073e1db] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:28.537900 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85de86de-aaae-41c1-90ab-9cb20caa71f7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:28.538388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85de86de-aaae-41c1-90ab-9cb20caa71f7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:28.538831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85de86de-aaae-41c1-90ab-9cb20caa71f7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:28.539551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85de86de-aaae-41c1-90ab-9cb20caa71f7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:28.540015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85de86de-aaae-41c1-90ab-9cb20caa71f7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:28.540448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-85de86de-aaae-41c1-90ab-9cb20caa71f7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:28.554197 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-85de86de-aaae-41c1-90ab-9cb20caa71f7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] HTTP exception thrown: Instance 46045a64-d654-45de-acfb-02835073e1db could not be found. Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-85de86de-aaae-41c1-90ab-9cb20caa71f7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Request method failure captured: Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db HTTP/1.1 Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0oDcsNZbK1s9UNJvxMC8RxC4ab4VJ9ZKIMF77QJsJZvVUWjtNdnoFUDs5DSCBdxR5bWpQMeaN0YxqWPQUxJY0Xl9lZ1L0H_qo_58rDYn9dWgmYp9aHXIvU5wG05-LSRMRtk73J6MtC3Hv8Dnt7etVEPS2sKlXDRy4IcGnrNH7WIBVA Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 42fa1a0f52f94b8ebd34b42034d66b70 Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-799438933 Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42fa1a0f52f94b8ebd34b42034d66b70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42fa1a0f52f94b8ebd34b42034d66b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42fa1a0f52f94b8ebd34b42034d66b70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42fa1a0f52f94b8ebd34b42034d66b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestNetworkAdvancedServerOps-799438933 Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 42fa1a0f52f94b8ebd34b42034d66b70 Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-799438933 Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestNetworkAdvancedServerOps-799438933-project Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 764c04554c2a4616bf01531df31e717e Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestNetworkAdvancedServerOps-799438933-project Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 46045a64-d654-45de-acfb-02835073e1db could not be found. Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '46045a64-d654-45de-acfb-02835073e1db'} Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46045a64-d654-45de-acfb-02835073e1db could not be found. Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46045a64-d654-45de-acfb-02835073e1db could not be found. Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:19:28.555859 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:19:28.561275 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:19:28.561275 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:19:28.561275 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:19:28.561275 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:19:28.561275 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:19:28.561275 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:19:28.561275 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46045a64-d654-45de-acfb-02835073e1db could not be found. Oct 12 23:19:28.561275 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:19:28.561275 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-85de86de-aaae-41c1-90ab-9cb20caa71f7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Returning 404 to user: Instance 46045a64-d654-45de-acfb-02835073e1db could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:19:28.561275 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-85de86de-aaae-41c1-90ab-9cb20caa71f7 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db" status: 404 len: 111 microversion: 2.1 time: 0.031714 Oct 12 23:19:28.561275 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4238/7820] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:19:28 2022] GET /compute/v2.1/servers/46045a64-d654-45de-acfb-02835073e1db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:19:31.518290 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7bd6c663-d0e4-428e-834d-4b2e882daaab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '.version_select at 0x7f51234015e0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:31.538323 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7bd6c663-d0e4-428e-834d-4b2e882daaab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1094335564" status: 202 len: 0 microversion: 2.1 time: 0.024167 Oct 12 23:19:31.538919 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3583/7821] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Oct 12 23:19:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1094335564 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:19:31.563949 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-67a94b8e-0013-47a0-b16c-b75cc6e8ab8c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'create', calling method: .version_select at 0x7f5123511ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1438501890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImxWDHA50wGjesBh1l0pj2cTYh8T7kUsH3ibzjaI+hL8kpm9PTKLb+d70gTJ694V40ixDHPXOJ6QjRn7A8gVZ3VQ5+eY+cmlBK46Jm8T9kovU3hZ+XHk8QETgob8MVpow=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:19:31.580676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-67a94b8e-0013-47a0-b16c-b75cc6e8ab8c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:19:31.587181 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-67a94b8e-0013-47a0-b16c-b75cc6e8ab8c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for user 764c04554c2a4616bf01531df31e717e and project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:19:31.613239 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-67a94b8e-0013-47a0-b16c-b75cc6e8ab8c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053216 Oct 12 23:19:31.614370 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4239/7822] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 23:19:31 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:19:37.346273 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1827171892", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "5982599e-aa5d-4b34-9fe4-cefc58b3ab3d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1438501890", "security_groups": [{"name": "tempest-secgroup-smoke-1321495219"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:19:37.500595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:19:37.513595 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] validate_networks() for [('5982599e-aa5d-4b34-9fe4-cefc58b3ab3d', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:19:37.956713 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:19:37.957745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:19:37.958235 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:19:37.958864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:19:37.959497 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:19:37.971685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:37.972185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:37.973038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:37.973419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:37.973885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:37.974326 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:37.992954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:19:37.998508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for user 764c04554c2a4616bf01531df31e717e and project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:19:38.013208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:19:38.015603 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:19:38.081003 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c84a449e-d25d-4e73-989e-26a8d37547b3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.739750 Oct 12 23:19:38.088314 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3584/7823] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 23:19:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:19:38.095436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ba095708-eb92-4d26-b840-4151abef7322 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:38.096193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ba095708-eb92-4d26-b840-4151abef7322 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:38.176795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ba095708-eb92-4d26-b840-4151abef7322 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:19:38.184626 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ba095708-eb92-4d26-b840-4151abef7322 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1267 microversion: 2.1 time: 0.094827 Oct 12 23:19:38.200472 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4240/7824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:19:38 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1267 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:19:39.211021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e112b264-d4ba-4928-9982-4d2fc4655bd0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:39.211973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e112b264-d4ba-4928-9982-4d2fc4655bd0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:39.223014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e112b264-d4ba-4928-9982-4d2fc4655bd0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:39.224269 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e112b264-d4ba-4928-9982-4d2fc4655bd0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:39.224932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e112b264-d4ba-4928-9982-4d2fc4655bd0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:39.225857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e112b264-d4ba-4928-9982-4d2fc4655bd0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:39.226519 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e112b264-d4ba-4928-9982-4d2fc4655bd0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:39.227281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e112b264-d4ba-4928-9982-4d2fc4655bd0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:39.333208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e112b264-d4ba-4928-9982-4d2fc4655bd0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:19:39.342626 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e112b264-d4ba-4928-9982-4d2fc4655bd0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1327 microversion: 2.1 time: 0.137231 Oct 12 23:19:39.343402 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3585/7825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:19:39 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1327 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:19:40.366852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3f7b4c1f-b983-47b4-b680-253ec307d0df tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:40.367550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3f7b4c1f-b983-47b4-b680-253ec307d0df tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:40.370826 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=16 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:19:40.377649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f7b4c1f-b983-47b4-b680-253ec307d0df tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:40.378392 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f7b4c1f-b983-47b4-b680-253ec307d0df tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:40.379584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f7b4c1f-b983-47b4-b680-253ec307d0df tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:40.380312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f7b4c1f-b983-47b4-b680-253ec307d0df tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:40.380766 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f7b4c1f-b983-47b4-b680-253ec307d0df tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:40.381198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3f7b4c1f-b983-47b4-b680-253ec307d0df tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:40.534585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3f7b4c1f-b983-47b4-b680-253ec307d0df tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:19:40.543823 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3f7b4c1f-b983-47b4-b680-253ec307d0df tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1393 microversion: 2.1 time: 0.181602 Oct 12 23:19:40.544978 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4241/7826] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:19:40 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1393 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:19:40.893632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d32414c4-5d80-4f10-8a28-2e06490b5631 req-b54cc315-d12f-42e7-bdf5-0bc7ab7cbf3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6856458-57f6-449c-91f9-4e462e33563c", "tag": "e61928d1-ad05-42ea-a297-789baff146e4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:19:40.903419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d32414c4-5d80-4f10-8a28-2e06490b5631 req-b54cc315-d12f-42e7-bdf5-0bc7ab7cbf3e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:40.903760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d32414c4-5d80-4f10-8a28-2e06490b5631 req-b54cc315-d12f-42e7-bdf5-0bc7ab7cbf3e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:40.904196 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d32414c4-5d80-4f10-8a28-2e06490b5631 req-b54cc315-d12f-42e7-bdf5-0bc7ab7cbf3e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:40.916003 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d32414c4-5d80-4f10-8a28-2e06490b5631 req-b54cc315-d12f-42e7-bdf5-0bc7ab7cbf3e service nova] Creating event network-changed:e61928d1-ad05-42ea-a297-789baff146e4 for instance d6856458-57f6-449c-91f9-4e462e33563c on n-h2-861111-1 Oct 12 23:19:40.921615 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d32414c4-5d80-4f10-8a28-2e06490b5631 req-b54cc315-d12f-42e7-bdf5-0bc7ab7cbf3e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086603 Oct 12 23:19:40.922518 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3586/7827] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:19:41.567812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9d4e1bc1-9c69-45ee-9a91-9e0201c36708 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:41.568437 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9d4e1bc1-9c69-45ee-9a91-9e0201c36708 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:41.575482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d4e1bc1-9c69-45ee-9a91-9e0201c36708 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:41.575973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d4e1bc1-9c69-45ee-9a91-9e0201c36708 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:41.576417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d4e1bc1-9c69-45ee-9a91-9e0201c36708 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:41.577121 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d4e1bc1-9c69-45ee-9a91-9e0201c36708 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:41.577583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d4e1bc1-9c69-45ee-9a91-9e0201c36708 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:41.578017 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9d4e1bc1-9c69-45ee-9a91-9e0201c36708 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:41.712024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9d4e1bc1-9c69-45ee-9a91-9e0201c36708 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:19:41.719754 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9d4e1bc1-9c69-45ee-9a91-9e0201c36708 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1393 microversion: 2.1 time: 0.155776 Oct 12 23:19:41.720392 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4242/7828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:19:41 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:19:42.743890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-23f5566b-061f-47ca-b108-4cbc33ad0113 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:42.744626 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-23f5566b-061f-47ca-b108-4cbc33ad0113 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:42.751971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23f5566b-061f-47ca-b108-4cbc33ad0113 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:42.752476 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23f5566b-061f-47ca-b108-4cbc33ad0113 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:42.752918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23f5566b-061f-47ca-b108-4cbc33ad0113 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:42.753620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23f5566b-061f-47ca-b108-4cbc33ad0113 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:42.754084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23f5566b-061f-47ca-b108-4cbc33ad0113 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:42.754530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23f5566b-061f-47ca-b108-4cbc33ad0113 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:42.888986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-23f5566b-061f-47ca-b108-4cbc33ad0113 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:19:42.897278 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-23f5566b-061f-47ca-b108-4cbc33ad0113 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1393 microversion: 2.1 time: 0.157694 Oct 12 23:19:42.897854 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3587/7829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:19:42 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:19:43.921114 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b45b3458-aef8-4de7-a798-e8ea44b47da8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:43.921735 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b45b3458-aef8-4de7-a798-e8ea44b47da8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:43.929205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b45b3458-aef8-4de7-a798-e8ea44b47da8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:43.929692 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b45b3458-aef8-4de7-a798-e8ea44b47da8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:43.930140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b45b3458-aef8-4de7-a798-e8ea44b47da8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:43.930835 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b45b3458-aef8-4de7-a798-e8ea44b47da8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:43.931313 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b45b3458-aef8-4de7-a798-e8ea44b47da8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:43.931747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b45b3458-aef8-4de7-a798-e8ea44b47da8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:44.067158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b45b3458-aef8-4de7-a798-e8ea44b47da8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:19:44.074823 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b45b3458-aef8-4de7-a798-e8ea44b47da8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1393 microversion: 2.1 time: 0.157691 Oct 12 23:19:44.075413 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4243/7830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:19:43 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:19:45.098074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-51c45c95-d436-4575-a1a3-48e6e108ee20 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:45.098702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-51c45c95-d436-4575-a1a3-48e6e108ee20 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:45.105442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51c45c95-d436-4575-a1a3-48e6e108ee20 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:45.105931 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51c45c95-d436-4575-a1a3-48e6e108ee20 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:45.106377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51c45c95-d436-4575-a1a3-48e6e108ee20 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:45.107070 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51c45c95-d436-4575-a1a3-48e6e108ee20 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:45.107558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51c45c95-d436-4575-a1a3-48e6e108ee20 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:45.107996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51c45c95-d436-4575-a1a3-48e6e108ee20 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:45.241243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-51c45c95-d436-4575-a1a3-48e6e108ee20 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:19:45.248895 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-51c45c95-d436-4575-a1a3-48e6e108ee20 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1393 microversion: 2.1 time: 0.154972 Oct 12 23:19:45.249475 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3588/7831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:19:45 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:19:46.273291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ba85cc77-04d6-4365-988c-dbc4bc5b6a3e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:46.273915 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ba85cc77-04d6-4365-988c-dbc4bc5b6a3e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:46.280954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba85cc77-04d6-4365-988c-dbc4bc5b6a3e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:46.281446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba85cc77-04d6-4365-988c-dbc4bc5b6a3e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:46.281892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba85cc77-04d6-4365-988c-dbc4bc5b6a3e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:46.282604 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba85cc77-04d6-4365-988c-dbc4bc5b6a3e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:46.283061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba85cc77-04d6-4365-988c-dbc4bc5b6a3e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:46.283520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ba85cc77-04d6-4365-988c-dbc4bc5b6a3e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:46.417284 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ba85cc77-04d6-4365-988c-dbc4bc5b6a3e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:19:46.425006 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ba85cc77-04d6-4365-988c-dbc4bc5b6a3e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1393 microversion: 2.1 time: 0.156387 Oct 12 23:19:46.425582 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4244/7832] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:19:46 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:19:46.826913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d9c533c6-ae0e-42dc-be1e-d05a6787827a req-df792db2-54c1-47f8-b794-a1c708f5164e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6856458-57f6-449c-91f9-4e462e33563c", "name": "network-vif-plugged", "status": "completed", "tag": "e61928d1-ad05-42ea-a297-789baff146e4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:19:46.837461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d9c533c6-ae0e-42dc-be1e-d05a6787827a req-df792db2-54c1-47f8-b794-a1c708f5164e service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:46.837923 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d9c533c6-ae0e-42dc-be1e-d05a6787827a req-df792db2-54c1-47f8-b794-a1c708f5164e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:46.838390 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d9c533c6-ae0e-42dc-be1e-d05a6787827a req-df792db2-54c1-47f8-b794-a1c708f5164e service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:46.850935 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d9c533c6-ae0e-42dc-be1e-d05a6787827a req-df792db2-54c1-47f8-b794-a1c708f5164e service nova] Creating event network-vif-plugged:e61928d1-ad05-42ea-a297-789baff146e4 for instance d6856458-57f6-449c-91f9-4e462e33563c on n-h2-861111-1 Oct 12 23:19:46.855886 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d9c533c6-ae0e-42dc-be1e-d05a6787827a req-df792db2-54c1-47f8-b794-a1c708f5164e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032746 Oct 12 23:19:46.856655 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3589/7833] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:19:47.447947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a3de7866-5f81-409b-98d5-7157fb5b69ab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:47.448564 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a3de7866-5f81-409b-98d5-7157fb5b69ab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:47.455269 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3de7866-5f81-409b-98d5-7157fb5b69ab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:47.455759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3de7866-5f81-409b-98d5-7157fb5b69ab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:47.456197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3de7866-5f81-409b-98d5-7157fb5b69ab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:47.457379 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3de7866-5f81-409b-98d5-7157fb5b69ab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:47.457831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3de7866-5f81-409b-98d5-7157fb5b69ab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:47.458257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a3de7866-5f81-409b-98d5-7157fb5b69ab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:47.586541 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a3de7866-5f81-409b-98d5-7157fb5b69ab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:19:47.594768 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a3de7866-5f81-409b-98d5-7157fb5b69ab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1393 microversion: 2.1 time: 0.150745 Oct 12 23:19:47.595349 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4245/7834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:19:47 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:19:48.616774 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:19:48.617600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:19:48.621695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-82bd6091-a433-4d97-a7d5-b91ccad7627b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:48.622406 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-82bd6091-a433-4d97-a7d5-b91ccad7627b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:48.629695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82bd6091-a433-4d97-a7d5-b91ccad7627b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:48.630188 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82bd6091-a433-4d97-a7d5-b91ccad7627b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:48.630635 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82bd6091-a433-4d97-a7d5-b91ccad7627b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:48.631354 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82bd6091-a433-4d97-a7d5-b91ccad7627b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:48.631819 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82bd6091-a433-4d97-a7d5-b91ccad7627b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:48.632257 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82bd6091-a433-4d97-a7d5-b91ccad7627b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:48.761254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-82bd6091-a433-4d97-a7d5-b91ccad7627b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:19:48.769223 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-82bd6091-a433-4d97-a7d5-b91ccad7627b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1565 microversion: 2.1 time: 0.154866 Oct 12 23:19:48.769926 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3590/7835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:19:48 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:19:48.791843 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-81325e70-5dcd-4b0a-9196-887a22d9d0bf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:48.792459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-81325e70-5dcd-4b0a-9196-887a22d9d0bf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:48.794278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:19:48.795771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:19:48.801939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81325e70-5dcd-4b0a-9196-887a22d9d0bf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:48.802365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81325e70-5dcd-4b0a-9196-887a22d9d0bf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:48.802799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81325e70-5dcd-4b0a-9196-887a22d9d0bf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:48.803545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81325e70-5dcd-4b0a-9196-887a22d9d0bf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:48.803999 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81325e70-5dcd-4b0a-9196-887a22d9d0bf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:48.804424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-81325e70-5dcd-4b0a-9196-887a22d9d0bf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:48.935373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-81325e70-5dcd-4b0a-9196-887a22d9d0bf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:19:48.943016 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-81325e70-5dcd-4b0a-9196-887a22d9d0bf tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1565 microversion: 2.1 time: 0.155185 Oct 12 23:19:48.943614 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4246/7836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:19:48 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:19:50.828825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b91677b8-1d67-4186-a13a-b4d8aa186126 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:19:50.829768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b91677b8-1d67-4186-a13a-b4d8aa186126 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:19:50.829898 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-f31e5dfe-deef-4108-a06d-5a1796e74f3c req-ce18b65b-5163-417c-84dc-5d1e3f40e5af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6856458-57f6-449c-91f9-4e462e33563c", "tag": "e61928d1-ad05-42ea-a297-789baff146e4"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:19:50.839994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b91677b8-1d67-4186-a13a-b4d8aa186126 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:50.840598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b91677b8-1d67-4186-a13a-b4d8aa186126 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:50.840802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f31e5dfe-deef-4108-a06d-5a1796e74f3c req-ce18b65b-5163-417c-84dc-5d1e3f40e5af service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:50.841178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b91677b8-1d67-4186-a13a-b4d8aa186126 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:50.841294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f31e5dfe-deef-4108-a06d-5a1796e74f3c req-ce18b65b-5163-417c-84dc-5d1e3f40e5af service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:50.841699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-f31e5dfe-deef-4108-a06d-5a1796e74f3c req-ce18b65b-5163-417c-84dc-5d1e3f40e5af service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:50.842525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b91677b8-1d67-4186-a13a-b4d8aa186126 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:19:50.843084 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b91677b8-1d67-4186-a13a-b4d8aa186126 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:19:50.844308 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b91677b8-1d67-4186-a13a-b4d8aa186126 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:19:50.856085 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-f31e5dfe-deef-4108-a06d-5a1796e74f3c req-ce18b65b-5163-417c-84dc-5d1e3f40e5af service nova] Creating event network-changed:e61928d1-ad05-42ea-a297-789baff146e4 for instance d6856458-57f6-449c-91f9-4e462e33563c on n-h2-861111-1 Oct 12 23:19:50.861928 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-f31e5dfe-deef-4108-a06d-5a1796e74f3c req-ce18b65b-5163-417c-84dc-5d1e3f40e5af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035497 Oct 12 23:19:50.862555 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4247/7837] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:19:51.077768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b91677b8-1d67-4186-a13a-b4d8aa186126 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:19:51.085958 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b91677b8-1d67-4186-a13a-b4d8aa186126 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1565 microversion: 2.1 time: 0.262341 Oct 12 23:19:51.086540 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3591/7838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:19:50 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1565 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:20:22.367653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b53baba6-4bc8-4ce4-8923-26fe8cf0f3a6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:20:22.369897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b53baba6-4bc8-4ce4-8923-26fe8cf0f3a6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:20:22.372233 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:20:22.372872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=38 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:20:22.378937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b53baba6-4bc8-4ce4-8923-26fe8cf0f3a6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:20:22.379456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b53baba6-4bc8-4ce4-8923-26fe8cf0f3a6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:20:22.379897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b53baba6-4bc8-4ce4-8923-26fe8cf0f3a6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:20:22.380587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b53baba6-4bc8-4ce4-8923-26fe8cf0f3a6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:20:22.381038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b53baba6-4bc8-4ce4-8923-26fe8cf0f3a6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:20:22.381464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b53baba6-4bc8-4ce4-8923-26fe8cf0f3a6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:20:22.432253 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b53baba6-4bc8-4ce4-8923-26fe8cf0f3a6 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c/action" status: 200 len: 24564 microversion: 2.1 time: 0.069803 Oct 12 23:20:22.432957 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4248/7839] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:20:22 2022] POST /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c/action => generated 24564 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:20:52.628947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:20:52.629714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=36 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:20:52.634467 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-99962cd5-e3b2-4f65-97cb-bf224c94a8e8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:20:52.642170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99962cd5-e3b2-4f65-97cb-bf224c94a8e8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:20:52.642662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99962cd5-e3b2-4f65-97cb-bf224c94a8e8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:20:52.643114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99962cd5-e3b2-4f65-97cb-bf224c94a8e8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:20:52.666961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-99962cd5-e3b2-4f65-97cb-bf224c94a8e8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Going to try to stop instance {{(pid=120452) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 23:20:52.705470 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-99962cd5-e3b2-4f65-97cb-bf224c94a8e8 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c/action" status: 202 len: 0 microversion: 2.1 time: 0.078161 Oct 12 23:20:52.706065 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3592/7840] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:20:52 2022] POST /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:20:52.715583 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ad81d5e3-9a55-4490-98b1-79392a490b9f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:20:52.716298 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ad81d5e3-9a55-4490-98b1-79392a490b9f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:20:52.718954 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:20:52.719126 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 23:20:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c (ip 10.222.0.16) !!! Oct 12 23:20:52.720467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:20:52.721133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:20:52.732138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad81d5e3-9a55-4490-98b1-79392a490b9f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:20:52.732618 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad81d5e3-9a55-4490-98b1-79392a490b9f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:20:52.733069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad81d5e3-9a55-4490-98b1-79392a490b9f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:20:52.733778 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad81d5e3-9a55-4490-98b1-79392a490b9f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:20:52.734237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad81d5e3-9a55-4490-98b1-79392a490b9f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:20:52.734671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ad81d5e3-9a55-4490-98b1-79392a490b9f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:20:52.869812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ad81d5e3-9a55-4490-98b1-79392a490b9f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:20:52.878803 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ad81d5e3-9a55-4490-98b1-79392a490b9f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1693 microversion: 2.1 time: 0.167164 Oct 12 23:20:52.879397 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4249/7841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:20:52 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:20:53.904782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c0c0f3be-790e-4c02-a24d-b17e20ba4b8b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:20:53.905498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c0c0f3be-790e-4c02-a24d-b17e20ba4b8b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:20:53.912149 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0c0f3be-790e-4c02-a24d-b17e20ba4b8b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:20:53.912646 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0c0f3be-790e-4c02-a24d-b17e20ba4b8b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:20:53.913091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0c0f3be-790e-4c02-a24d-b17e20ba4b8b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:20:53.913796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0c0f3be-790e-4c02-a24d-b17e20ba4b8b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:20:53.914260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0c0f3be-790e-4c02-a24d-b17e20ba4b8b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:20:53.914699 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c0c0f3be-790e-4c02-a24d-b17e20ba4b8b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:20:54.048711 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c0c0f3be-790e-4c02-a24d-b17e20ba4b8b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:20:54.056560 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c0c0f3be-790e-4c02-a24d-b17e20ba4b8b tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1693 microversion: 2.1 time: 0.157088 Oct 12 23:20:54.057128 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3593/7842] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:20:53 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:20:55.081698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6a8127be-780f-4a1b-a27b-5f258050da2a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:20:55.082252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6a8127be-780f-4a1b-a27b-5f258050da2a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:20:55.089112 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a8127be-780f-4a1b-a27b-5f258050da2a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:20:55.089602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a8127be-780f-4a1b-a27b-5f258050da2a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:20:55.090043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a8127be-780f-4a1b-a27b-5f258050da2a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:20:55.090736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a8127be-780f-4a1b-a27b-5f258050da2a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:20:55.091197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a8127be-780f-4a1b-a27b-5f258050da2a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:20:55.091654 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6a8127be-780f-4a1b-a27b-5f258050da2a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:20:55.224786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6a8127be-780f-4a1b-a27b-5f258050da2a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:20:55.232554 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6a8127be-780f-4a1b-a27b-5f258050da2a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1693 microversion: 2.1 time: 0.154875 Oct 12 23:20:55.233133 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4250/7843] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:20:55 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:20:56.257114 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-084663b0-ce1b-4db7-9454-f25b55d4e65c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:20:56.257739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-084663b0-ce1b-4db7-9454-f25b55d4e65c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:20:56.264486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-084663b0-ce1b-4db7-9454-f25b55d4e65c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:20:56.264988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-084663b0-ce1b-4db7-9454-f25b55d4e65c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:20:56.265439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-084663b0-ce1b-4db7-9454-f25b55d4e65c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:20:56.266143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-084663b0-ce1b-4db7-9454-f25b55d4e65c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:20:56.266610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-084663b0-ce1b-4db7-9454-f25b55d4e65c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:20:56.267050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-084663b0-ce1b-4db7-9454-f25b55d4e65c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:20:56.398694 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-084663b0-ce1b-4db7-9454-f25b55d4e65c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:20:56.406793 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-084663b0-ce1b-4db7-9454-f25b55d4e65c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1693 microversion: 2.1 time: 0.154217 Oct 12 23:20:56.407389 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3594/7844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:20:56 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:20:57.429969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-08340804-d4ff-452b-a840-d95660553fce tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:20:57.430619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-08340804-d4ff-452b-a840-d95660553fce tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:20:57.437383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08340804-d4ff-452b-a840-d95660553fce tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:20:57.437868 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08340804-d4ff-452b-a840-d95660553fce tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:20:57.438314 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08340804-d4ff-452b-a840-d95660553fce tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:20:57.439000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08340804-d4ff-452b-a840-d95660553fce tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:20:57.439486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08340804-d4ff-452b-a840-d95660553fce tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:20:57.439919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08340804-d4ff-452b-a840-d95660553fce tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:20:57.568971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-08340804-d4ff-452b-a840-d95660553fce tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:20:57.576784 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-08340804-d4ff-452b-a840-d95660553fce tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1693 microversion: 2.1 time: 0.150769 Oct 12 23:20:57.577305 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4251/7845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:20:57 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:20:58.601154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d4648945-c374-4588-9eec-dabb89f25ad3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:20:58.601781 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d4648945-c374-4588-9eec-dabb89f25ad3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:20:58.608616 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4648945-c374-4588-9eec-dabb89f25ad3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:20:58.609111 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4648945-c374-4588-9eec-dabb89f25ad3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:20:58.609563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4648945-c374-4588-9eec-dabb89f25ad3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:20:58.610587 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4648945-c374-4588-9eec-dabb89f25ad3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:20:58.611076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4648945-c374-4588-9eec-dabb89f25ad3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:20:58.611550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4648945-c374-4588-9eec-dabb89f25ad3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:20:58.739965 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d4648945-c374-4588-9eec-dabb89f25ad3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:20:58.747706 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d4648945-c374-4588-9eec-dabb89f25ad3 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1693 microversion: 2.1 time: 0.151413 Oct 12 23:20:58.748277 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3595/7846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:20:58 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:20:59.771372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f747cfb1-71ad-4b2f-943e-fe5648c1a3f2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:20:59.772022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f747cfb1-71ad-4b2f-943e-fe5648c1a3f2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:20:59.778303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f747cfb1-71ad-4b2f-943e-fe5648c1a3f2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:20:59.778793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f747cfb1-71ad-4b2f-943e-fe5648c1a3f2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:20:59.779230 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f747cfb1-71ad-4b2f-943e-fe5648c1a3f2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:20:59.779935 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f747cfb1-71ad-4b2f-943e-fe5648c1a3f2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:20:59.780388 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f747cfb1-71ad-4b2f-943e-fe5648c1a3f2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:20:59.780812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f747cfb1-71ad-4b2f-943e-fe5648c1a3f2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:20:59.911779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f747cfb1-71ad-4b2f-943e-fe5648c1a3f2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:20:59.919468 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f747cfb1-71ad-4b2f-943e-fe5648c1a3f2 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1693 microversion: 2.1 time: 0.152048 Oct 12 23:20:59.920042 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4252/7847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:20:59 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:21:00.944117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d40c0f57-ae6b-473e-89f2-eab23b5ab864 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:21:00.944741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d40c0f57-ae6b-473e-89f2-eab23b5ab864 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:21:00.950927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d40c0f57-ae6b-473e-89f2-eab23b5ab864 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:00.951460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d40c0f57-ae6b-473e-89f2-eab23b5ab864 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:00.951913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d40c0f57-ae6b-473e-89f2-eab23b5ab864 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:00.952610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d40c0f57-ae6b-473e-89f2-eab23b5ab864 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:00.953071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d40c0f57-ae6b-473e-89f2-eab23b5ab864 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:00.953508 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d40c0f57-ae6b-473e-89f2-eab23b5ab864 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:01.082335 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d40c0f57-ae6b-473e-89f2-eab23b5ab864 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:21:01.090011 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d40c0f57-ae6b-473e-89f2-eab23b5ab864 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1693 microversion: 2.1 time: 0.150738 Oct 12 23:21:01.090580 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3596/7848] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:21:00 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:21:02.113010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3564579f-662c-453b-9028-13a90541d96d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:21:02.113561 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3564579f-662c-453b-9028-13a90541d96d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:21:02.120411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3564579f-662c-453b-9028-13a90541d96d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:02.120901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3564579f-662c-453b-9028-13a90541d96d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:02.121342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3564579f-662c-453b-9028-13a90541d96d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:02.122040 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3564579f-662c-453b-9028-13a90541d96d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:02.122499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3564579f-662c-453b-9028-13a90541d96d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:02.122937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3564579f-662c-453b-9028-13a90541d96d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:02.251726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-3564579f-662c-453b-9028-13a90541d96d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:21:02.260065 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3564579f-662c-453b-9028-13a90541d96d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1693 microversion: 2.1 time: 0.151134 Oct 12 23:21:02.260639 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4253/7849] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:21:02 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:21:03.283666 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c2f60fd9-2be4-4b58-822c-0aefdfea12a1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:21:03.284293 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c2f60fd9-2be4-4b58-822c-0aefdfea12a1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:21:03.291511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2f60fd9-2be4-4b58-822c-0aefdfea12a1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:03.292006 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2f60fd9-2be4-4b58-822c-0aefdfea12a1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:03.292456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2f60fd9-2be4-4b58-822c-0aefdfea12a1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:03.293152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2f60fd9-2be4-4b58-822c-0aefdfea12a1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:03.293613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2f60fd9-2be4-4b58-822c-0aefdfea12a1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:03.294046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2f60fd9-2be4-4b58-822c-0aefdfea12a1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:03.427296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c2f60fd9-2be4-4b58-822c-0aefdfea12a1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:21:03.435034 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c2f60fd9-2be4-4b58-822c-0aefdfea12a1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1670 microversion: 2.1 time: 0.155276 Oct 12 23:21:03.435617 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3597/7850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:21:03 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:21:04.528232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fd2568a6-6134-4dff-852b-1034c8e6ee6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:21:04.530471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-fd2568a6-6134-4dff-852b-1034c8e6ee6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:21:04.537587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd2568a6-6134-4dff-852b-1034c8e6ee6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:04.538073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd2568a6-6134-4dff-852b-1034c8e6ee6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:04.538516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd2568a6-6134-4dff-852b-1034c8e6ee6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:04.539207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd2568a6-6134-4dff-852b-1034c8e6ee6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:04.539696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd2568a6-6134-4dff-852b-1034c8e6ee6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:04.540130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-fd2568a6-6134-4dff-852b-1034c8e6ee6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:04.593028 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fd2568a6-6134-4dff-852b-1034c8e6ee6a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c/action" status: 200 len: 38379 microversion: 2.1 time: 0.068588 Oct 12 23:21:04.593839 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4254/7851] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:21:04 2022] POST /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c/action => generated 38379 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:21:04.605792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6c6d2328-2cbf-4aa1-9e94-65b20cee2944 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:21:04.612642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c6d2328-2cbf-4aa1-9e94-65b20cee2944 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:04.613686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c6d2328-2cbf-4aa1-9e94-65b20cee2944 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:04.614141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6c6d2328-2cbf-4aa1-9e94-65b20cee2944 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:04.638823 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6c6d2328-2cbf-4aa1-9e94-65b20cee2944 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Going to try to start instance {{(pid=120452) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 23:21:04.679916 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6c6d2328-2cbf-4aa1-9e94-65b20cee2944 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c/action" status: 202 len: 0 microversion: 2.1 time: 0.077840 Oct 12 23:21:04.680881 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3598/7852] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:21:04 2022] POST /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:21:04.689840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-62e0c6d1-a12e-46b7-8fd8-3643e054e10f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:21:04.690549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-62e0c6d1-a12e-46b7-8fd8-3643e054e10f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:21:04.698310 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e0c6d1-a12e-46b7-8fd8-3643e054e10f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:04.698793 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e0c6d1-a12e-46b7-8fd8-3643e054e10f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:04.699255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e0c6d1-a12e-46b7-8fd8-3643e054e10f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:04.699946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e0c6d1-a12e-46b7-8fd8-3643e054e10f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:04.700401 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e0c6d1-a12e-46b7-8fd8-3643e054e10f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:04.700889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-62e0c6d1-a12e-46b7-8fd8-3643e054e10f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:04.836913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-62e0c6d1-a12e-46b7-8fd8-3643e054e10f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:21:04.844808 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-62e0c6d1-a12e-46b7-8fd8-3643e054e10f tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1679 microversion: 2.1 time: 0.159211 Oct 12 23:21:04.845338 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4255/7853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:21:04 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:21:05.869683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-204c54fe-ed0b-45e0-beae-9b5903ebf917 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:21:05.870456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-204c54fe-ed0b-45e0-beae-9b5903ebf917 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:21:05.877794 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-204c54fe-ed0b-45e0-beae-9b5903ebf917 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:05.878792 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-204c54fe-ed0b-45e0-beae-9b5903ebf917 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:05.879283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-204c54fe-ed0b-45e0-beae-9b5903ebf917 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:05.880004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-204c54fe-ed0b-45e0-beae-9b5903ebf917 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:05.880477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-204c54fe-ed0b-45e0-beae-9b5903ebf917 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:05.880920 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-204c54fe-ed0b-45e0-beae-9b5903ebf917 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:06.106750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-204c54fe-ed0b-45e0-beae-9b5903ebf917 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:21:06.115152 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-204c54fe-ed0b-45e0-beae-9b5903ebf917 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1683 microversion: 2.1 time: 0.249826 Oct 12 23:21:06.115776 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3599/7854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:21:05 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1683 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:21:36.332984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-674bc9dd-cd36-46b5-9f40-0d088d7602d4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:21:36.335141 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-674bc9dd-cd36-46b5-9f40-0d088d7602d4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:21:36.337721 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=14 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:21:36.338376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=40 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:21:36.347152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-674bc9dd-cd36-46b5-9f40-0d088d7602d4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:36.347662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-674bc9dd-cd36-46b5-9f40-0d088d7602d4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:36.348100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-674bc9dd-cd36-46b5-9f40-0d088d7602d4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:36.348799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-674bc9dd-cd36-46b5-9f40-0d088d7602d4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:36.349252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-674bc9dd-cd36-46b5-9f40-0d088d7602d4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:36.349686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-674bc9dd-cd36-46b5-9f40-0d088d7602d4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:36.402846 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-674bc9dd-cd36-46b5-9f40-0d088d7602d4 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c/action" status: 200 len: 62940 microversion: 2.1 time: 0.074405 Oct 12 23:21:36.403874 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4256/7855] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:21:36 2022] POST /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c/action => generated 62940 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:21:53.740478 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-98747873-ac65-41ea-854c-ae4a45fcd6eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:21:53.741036 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-98747873-ac65-41ea-854c-ae4a45fcd6eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:21:53.743197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-6c8388fa-71cc-4988-9f33-ec55f241b308 req-040b2783-9b7c-4507-a512-0b08e39c80e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6856458-57f6-449c-91f9-4e462e33563c", "tag": "e61928d1-ad05-42ea-a297-789baff146e4"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:21:53.743741 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=16 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:21:53.744442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:21:53.750332 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98747873-ac65-41ea-854c-ae4a45fcd6eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:53.750919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98747873-ac65-41ea-854c-ae4a45fcd6eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:53.751325 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:21:53.751456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98747873-ac65-41ea-854c-ae4a45fcd6eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:53.752530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98747873-ac65-41ea-854c-ae4a45fcd6eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:53.752837 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:21:53.753058 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98747873-ac65-41ea-854c-ae4a45fcd6eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:53.753503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-98747873-ac65-41ea-854c-ae4a45fcd6eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:53.759133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6c8388fa-71cc-4988-9f33-ec55f241b308 req-040b2783-9b7c-4507-a512-0b08e39c80e2 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:53.759812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6c8388fa-71cc-4988-9f33-ec55f241b308 req-040b2783-9b7c-4507-a512-0b08e39c80e2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:53.760209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6c8388fa-71cc-4988-9f33-ec55f241b308 req-040b2783-9b7c-4507-a512-0b08e39c80e2 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:53.774724 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6c8388fa-71cc-4988-9f33-ec55f241b308 req-040b2783-9b7c-4507-a512-0b08e39c80e2 service nova] Creating event network-changed:e61928d1-ad05-42ea-a297-789baff146e4 for instance d6856458-57f6-449c-91f9-4e462e33563c on n-h2-861111-1 Oct 12 23:21:53.780916 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-6c8388fa-71cc-4988-9f33-ec55f241b308 req-040b2783-9b7c-4507-a512-0b08e39c80e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042422 Oct 12 23:21:53.782585 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4257/7856] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:21:53.789448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-98747873-ac65-41ea-854c-ae4a45fcd6eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:21:53.874848 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-98747873-ac65-41ea-854c-ae4a45fcd6eb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 204 len: 0 microversion: 2.1 time: 0.138042 Oct 12 23:21:53.879954 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3600/7857] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:21:53 2022] DELETE /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:21:53.886197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-31cea3e5-3868-4e0b-b869-0f39d8a93fcb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:21:53.887007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-31cea3e5-3868-4e0b-b869-0f39d8a93fcb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:21:53.896302 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31cea3e5-3868-4e0b-b869-0f39d8a93fcb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:53.896796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31cea3e5-3868-4e0b-b869-0f39d8a93fcb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:53.897242 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31cea3e5-3868-4e0b-b869-0f39d8a93fcb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:53.898138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31cea3e5-3868-4e0b-b869-0f39d8a93fcb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:53.898722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31cea3e5-3868-4e0b-b869-0f39d8a93fcb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:53.899205 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-31cea3e5-3868-4e0b-b869-0f39d8a93fcb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:54.044280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-31cea3e5-3868-4e0b-b869-0f39d8a93fcb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:21:54.052597 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-31cea3e5-3868-4e0b-b869-0f39d8a93fcb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1689 microversion: 2.1 time: 0.171631 Oct 12 23:21:54.053174 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4258/7858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:21:53 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:21:55.077397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-77d288b5-0b03-4a72-b530-fe09ea4acb4e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:21:55.078112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-77d288b5-0b03-4a72-b530-fe09ea4acb4e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:21:55.085501 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77d288b5-0b03-4a72-b530-fe09ea4acb4e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:55.086004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77d288b5-0b03-4a72-b530-fe09ea4acb4e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:55.086457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77d288b5-0b03-4a72-b530-fe09ea4acb4e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:55.087179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77d288b5-0b03-4a72-b530-fe09ea4acb4e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:55.087658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77d288b5-0b03-4a72-b530-fe09ea4acb4e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:55.088101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77d288b5-0b03-4a72-b530-fe09ea4acb4e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:55.302869 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-77d288b5-0b03-4a72-b530-fe09ea4acb4e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:21:55.310684 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-77d288b5-0b03-4a72-b530-fe09ea4acb4e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1689 microversion: 2.1 time: 0.237577 Oct 12 23:21:55.311312 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3601/7859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:21:55 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1689 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:21:55.911804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-b29271d5-3ac9-48f8-b44f-40325f23e87b req-38aca26b-a2e4-4496-9bcc-02968e7e6359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6856458-57f6-449c-91f9-4e462e33563c", "name": "network-vif-deleted", "tag": "e61928d1-ad05-42ea-a297-789baff146e4"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:21:55.922149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b29271d5-3ac9-48f8-b44f-40325f23e87b req-38aca26b-a2e4-4496-9bcc-02968e7e6359 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:55.922631 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b29271d5-3ac9-48f8-b44f-40325f23e87b req-38aca26b-a2e4-4496-9bcc-02968e7e6359 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:55.923064 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-b29271d5-3ac9-48f8-b44f-40325f23e87b req-38aca26b-a2e4-4496-9bcc-02968e7e6359 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:55.934956 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-b29271d5-3ac9-48f8-b44f-40325f23e87b req-38aca26b-a2e4-4496-9bcc-02968e7e6359 service nova] Creating event network-vif-deleted:e61928d1-ad05-42ea-a297-789baff146e4 for instance d6856458-57f6-449c-91f9-4e462e33563c on n-h2-861111-1 Oct 12 23:21:55.940032 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-b29271d5-3ac9-48f8-b44f-40325f23e87b req-38aca26b-a2e4-4496-9bcc-02968e7e6359 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032519 Oct 12 23:21:55.940629 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4259/7860] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:21:56.337147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dcb92d3b-06ba-4d7b-b405-23b6bce316ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:21:56.338338 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dcb92d3b-06ba-4d7b-b405-23b6bce316ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:21:56.345547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcb92d3b-06ba-4d7b-b405-23b6bce316ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:56.346043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcb92d3b-06ba-4d7b-b405-23b6bce316ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:56.346489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcb92d3b-06ba-4d7b-b405-23b6bce316ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:56.347192 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcb92d3b-06ba-4d7b-b405-23b6bce316ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:56.348320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcb92d3b-06ba-4d7b-b405-23b6bce316ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:56.348757 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcb92d3b-06ba-4d7b-b405-23b6bce316ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:56.380928 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcb92d3b-06ba-4d7b-b405-23b6bce316ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:56.381420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcb92d3b-06ba-4d7b-b405-23b6bce316ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:56.381867 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcb92d3b-06ba-4d7b-b405-23b6bce316ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:56.382321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-dcb92d3b-06ba-4d7b-b405-23b6bce316ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lazy-loading 'fault' on Instance uuid d6856458-57f6-449c-91f9-4e462e33563c {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:21:56.428238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dcb92d3b-06ba-4d7b-b405-23b6bce316ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:21:56.435468 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dcb92d3b-06ba-4d7b-b405-23b6bce316ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 200 len: 1357 microversion: 2.1 time: 0.102320 Oct 12 23:21:56.436011 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3602/7861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:21:56 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 1357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:21:57.459486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9dae1dac-bb68-4c9a-9e55-15b966b9c2be tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:21:57.460191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9dae1dac-bb68-4c9a-9e55-15b966b9c2be tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: d6856458-57f6-449c-91f9-4e462e33563c] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:21:57.466300 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9dae1dac-bb68-4c9a-9e55-15b966b9c2be tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:57.466783 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9dae1dac-bb68-4c9a-9e55-15b966b9c2be tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:57.467221 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9dae1dac-bb68-4c9a-9e55-15b966b9c2be tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:57.467928 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9dae1dac-bb68-4c9a-9e55-15b966b9c2be tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:21:57.468382 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9dae1dac-bb68-4c9a-9e55-15b966b9c2be tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:21:57.468808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9dae1dac-bb68-4c9a-9e55-15b966b9c2be tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:21:57.482348 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-9dae1dac-bb68-4c9a-9e55-15b966b9c2be tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] HTTP exception thrown: Instance d6856458-57f6-449c-91f9-4e462e33563c could not be found. Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9dae1dac-bb68-4c9a-9e55-15b966b9c2be tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Request method failure captured: Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c HTTP/1.1 Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0oDcsNZbK1s9UNJvxMC8RxC4ab4VJ9ZKIMF77QJsJZvVUWjtNdnoFUDs5DSCBdxR5bWpQMeaN0YxqWPQUxJY0Xl9lZ1L0H_qo_58rDYn9dWgmYp9aHXIvU5wG05-LSRMRtk73J6MtC3Hv8Dnt7etVEPS2sKlXDRy4IcGnrNH7WIBVA Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 42fa1a0f52f94b8ebd34b42034d66b70 Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-799438933 Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42fa1a0f52f94b8ebd34b42034d66b70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42fa1a0f52f94b8ebd34b42034d66b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42fa1a0f52f94b8ebd34b42034d66b70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42fa1a0f52f94b8ebd34b42034d66b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestNetworkAdvancedServerOps-799438933 Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 42fa1a0f52f94b8ebd34b42034d66b70 Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-799438933 Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestNetworkAdvancedServerOps-799438933-project Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 764c04554c2a4616bf01531df31e717e Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestNetworkAdvancedServerOps-799438933-project Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance d6856458-57f6-449c-91f9-4e462e33563c could not be found. Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'd6856458-57f6-449c-91f9-4e462e33563c'} Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6856458-57f6-449c-91f9-4e462e33563c could not be found. Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6856458-57f6-449c-91f9-4e462e33563c could not be found. Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:21:57.484003 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:21:57.489462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:21:57.489462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:21:57.489462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:21:57.489462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:21:57.489462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:21:57.489462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:21:57.489462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6856458-57f6-449c-91f9-4e462e33563c could not be found. Oct 12 23:21:57.489462 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:21:57.489462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9dae1dac-bb68-4c9a-9e55-15b966b9c2be tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Returning 404 to user: Instance d6856458-57f6-449c-91f9-4e462e33563c could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:21:57.489462 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9dae1dac-bb68-4c9a-9e55-15b966b9c2be tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c" status: 404 len: 111 microversion: 2.1 time: 0.031200 Oct 12 23:21:57.489462 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4260/7862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:21:57 2022] GET /compute/v2.1/servers/d6856458-57f6-449c-91f9-4e462e33563c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:22:00.804353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f0d2467-5b23-4f64-ab57-9f0df2617e47 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '.version_select at 0x7f5123109af0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:00.833044 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f0d2467-5b23-4f64-ab57-9f0df2617e47 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1438501890" status: 202 len: 0 microversion: 2.1 time: 0.032614 Oct 12 23:22:00.833659 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3603/7863] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Oct 12 23:22:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1438501890 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:22:00.866829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c15b9dda-a560-4027-978e-8d37a20b6f5d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'create', calling method: .version_select at 0x7f5122d38a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-143803028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAI7HEnm/aIIMl0pKlk5OofJCdBLZcBCrxZRkkRparwvfa/WRntQkaF74Y1hDoEMcRaX9vn/O0KxCHs+9Un3+Q9MBesLjaP1YtB4R2wFJ+pUxVOaqlk5LTuktIXyAI3JGg=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:22:00.883351 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-c15b9dda-a560-4027-978e-8d37a20b6f5d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:22:00.889549 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-c15b9dda-a560-4027-978e-8d37a20b6f5d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for user 764c04554c2a4616bf01531df31e717e and project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:22:00.913007 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c15b9dda-a560-4027-978e-8d37a20b6f5d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050698 Oct 12 23:22:00.913606 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4261/7864] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 23:22:00 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:22:06.336367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1955907615", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "networks": [{"uuid": "a88719f7-3dac-490e-aaf1-d0964e4f588f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-143803028", "security_groups": [{"name": "tempest-secgroup-smoke-1467967369"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:22:06.433553 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:22:06.457282 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] validate_networks() for [('a88719f7-3dac-490e-aaf1-d0964e4f588f', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:22:06.870624 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:22:06.871062 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:22:06.871586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:22:06.872010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:22:06.872436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:22:06.882261 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:06.882752 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:06.883199 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:06.883961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:06.884420 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:06.884854 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:06.901279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:22:06.906516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Getting quotas for user 764c04554c2a4616bf01531df31e717e and project 42fa1a0f52f94b8ebd34b42034d66b70. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:22:06.919295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:22:06.921607 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:22:06.969274 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-600a792c-aaa4-47ae-ba9e-c528a4ab2032 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.638436 Oct 12 23:22:06.970300 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3604/7865] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 23:22:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:22:06.981808 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bae14701-6d77-4dab-9271-7c84667465ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:06.982446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bae14701-6d77-4dab-9271-7c84667465ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:07.063493 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bae14701-6d77-4dab-9271-7c84667465ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:07.073041 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bae14701-6d77-4dab-9271-7c84667465ed tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1266 microversion: 2.1 time: 0.094683 Oct 12 23:22:07.087286 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4262/7866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:06 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:22:08.100091 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a69e138b-97cf-4e3e-8ef5-08f8a9fe3210 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:08.101783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a69e138b-97cf-4e3e-8ef5-08f8a9fe3210 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:08.109927 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a69e138b-97cf-4e3e-8ef5-08f8a9fe3210 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:08.110475 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a69e138b-97cf-4e3e-8ef5-08f8a9fe3210 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:08.111155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a69e138b-97cf-4e3e-8ef5-08f8a9fe3210 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:08.112081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a69e138b-97cf-4e3e-8ef5-08f8a9fe3210 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:08.113761 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a69e138b-97cf-4e3e-8ef5-08f8a9fe3210 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:08.114502 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a69e138b-97cf-4e3e-8ef5-08f8a9fe3210 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:08.183876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-a69e138b-97cf-4e3e-8ef5-08f8a9fe3210 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:08.191911 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a69e138b-97cf-4e3e-8ef5-08f8a9fe3210 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1324 microversion: 2.1 time: 0.097930 Oct 12 23:22:08.192485 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3605/7867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:08 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1324 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:22:09.217083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b489e161-4e4e-484d-8c1d-2dc0e69d8486 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:09.217888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b489e161-4e4e-484d-8c1d-2dc0e69d8486 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:09.220151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=12 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:22:09.228574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b489e161-4e4e-484d-8c1d-2dc0e69d8486 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:09.229078 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b489e161-4e4e-484d-8c1d-2dc0e69d8486 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:09.229723 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b489e161-4e4e-484d-8c1d-2dc0e69d8486 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:09.230446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b489e161-4e4e-484d-8c1d-2dc0e69d8486 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:09.230913 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b489e161-4e4e-484d-8c1d-2dc0e69d8486 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:09.231535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b489e161-4e4e-484d-8c1d-2dc0e69d8486 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:09.449213 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-b489e161-4e4e-484d-8c1d-2dc0e69d8486 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:09.458936 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b489e161-4e4e-484d-8c1d-2dc0e69d8486 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1392 microversion: 2.1 time: 0.245919 Oct 12 23:22:09.459556 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4263/7868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:09 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1392 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:22:09.549238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-14985864-dcc0-47cb-95a2-e83aa3806da4 req-2146639b-6822-49ea-ab69-1e1f6a62013a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4405743-14dc-4899-9fb2-4dd3b6bb6bc1", "tag": "bfeb8c9a-9cc4-45f8-be67-faaf5bcbaee1"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:22:09.570309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-14985864-dcc0-47cb-95a2-e83aa3806da4 req-2146639b-6822-49ea-ab69-1e1f6a62013a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:09.571745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-14985864-dcc0-47cb-95a2-e83aa3806da4 req-2146639b-6822-49ea-ab69-1e1f6a62013a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:09.572260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-14985864-dcc0-47cb-95a2-e83aa3806da4 req-2146639b-6822-49ea-ab69-1e1f6a62013a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:09.584862 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-14985864-dcc0-47cb-95a2-e83aa3806da4 req-2146639b-6822-49ea-ab69-1e1f6a62013a service nova] Creating event network-changed:bfeb8c9a-9cc4-45f8-be67-faaf5bcbaee1 for instance a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 on n-h2-861111-1 Oct 12 23:22:09.590213 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-14985864-dcc0-47cb-95a2-e83aa3806da4 req-2146639b-6822-49ea-ab69-1e1f6a62013a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045401 Oct 12 23:22:09.590823 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3606/7869] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:22:10.482958 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-21333643-b9e1-4359-885f-dfdaf4692770 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:10.483538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-21333643-b9e1-4359-885f-dfdaf4692770 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:10.490773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21333643-b9e1-4359-885f-dfdaf4692770 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:10.491281 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21333643-b9e1-4359-885f-dfdaf4692770 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:10.491726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21333643-b9e1-4359-885f-dfdaf4692770 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:10.492417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21333643-b9e1-4359-885f-dfdaf4692770 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:10.492873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21333643-b9e1-4359-885f-dfdaf4692770 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:10.493303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-21333643-b9e1-4359-885f-dfdaf4692770 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:10.621597 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-21333643-b9e1-4359-885f-dfdaf4692770 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:10.630092 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-21333643-b9e1-4359-885f-dfdaf4692770 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1392 microversion: 2.1 time: 0.150516 Oct 12 23:22:10.630674 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4264/7870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:10 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:22:11.654136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eace1388-cc27-4120-afb7-77569a7b0853 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:11.654802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eace1388-cc27-4120-afb7-77569a7b0853 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:11.661147 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eace1388-cc27-4120-afb7-77569a7b0853 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:11.661538 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eace1388-cc27-4120-afb7-77569a7b0853 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:11.661985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eace1388-cc27-4120-afb7-77569a7b0853 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:11.662673 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eace1388-cc27-4120-afb7-77569a7b0853 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:11.663137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eace1388-cc27-4120-afb7-77569a7b0853 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:11.663596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eace1388-cc27-4120-afb7-77569a7b0853 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:11.796397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-eace1388-cc27-4120-afb7-77569a7b0853 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:11.806134 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eace1388-cc27-4120-afb7-77569a7b0853 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1392 microversion: 2.1 time: 0.157059 Oct 12 23:22:11.806718 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3607/7871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:11 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:22:12.830167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ae4cc7c4-7851-48ed-b5f7-ef543ad6ca03 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:12.830789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ae4cc7c4-7851-48ed-b5f7-ef543ad6ca03 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:12.838001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae4cc7c4-7851-48ed-b5f7-ef543ad6ca03 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:12.838498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae4cc7c4-7851-48ed-b5f7-ef543ad6ca03 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:12.838948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae4cc7c4-7851-48ed-b5f7-ef543ad6ca03 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:12.839697 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae4cc7c4-7851-48ed-b5f7-ef543ad6ca03 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:12.840215 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae4cc7c4-7851-48ed-b5f7-ef543ad6ca03 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:12.840602 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ae4cc7c4-7851-48ed-b5f7-ef543ad6ca03 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:12.975340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ae4cc7c4-7851-48ed-b5f7-ef543ad6ca03 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:12.983044 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ae4cc7c4-7851-48ed-b5f7-ef543ad6ca03 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1392 microversion: 2.1 time: 0.156927 Oct 12 23:22:12.983692 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4265/7872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:12 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:22:14.008661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5481cf0c-f557-470e-9bb6-e1be151c5442 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:14.009404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5481cf0c-f557-470e-9bb6-e1be151c5442 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:14.016250 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5481cf0c-f557-470e-9bb6-e1be151c5442 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:14.016754 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5481cf0c-f557-470e-9bb6-e1be151c5442 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:14.017209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5481cf0c-f557-470e-9bb6-e1be151c5442 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:14.017929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5481cf0c-f557-470e-9bb6-e1be151c5442 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:14.018401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5481cf0c-f557-470e-9bb6-e1be151c5442 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:14.018845 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5481cf0c-f557-470e-9bb6-e1be151c5442 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:14.155615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5481cf0c-f557-470e-9bb6-e1be151c5442 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:14.163445 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5481cf0c-f557-470e-9bb6-e1be151c5442 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1392 microversion: 2.1 time: 0.160162 Oct 12 23:22:14.164026 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3608/7873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:14 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:22:15.187059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c86a4ebe-d020-45c0-ac64-ca5717657776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:15.187727 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c86a4ebe-d020-45c0-ac64-ca5717657776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:15.194649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86a4ebe-d020-45c0-ac64-ca5717657776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:15.195151 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86a4ebe-d020-45c0-ac64-ca5717657776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:15.195641 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86a4ebe-d020-45c0-ac64-ca5717657776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:15.196343 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86a4ebe-d020-45c0-ac64-ca5717657776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:15.196806 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86a4ebe-d020-45c0-ac64-ca5717657776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:15.197241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c86a4ebe-d020-45c0-ac64-ca5717657776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:15.331634 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c86a4ebe-d020-45c0-ac64-ca5717657776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:15.341152 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c86a4ebe-d020-45c0-ac64-ca5717657776 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1392 microversion: 2.1 time: 0.157901 Oct 12 23:22:15.342068 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4266/7874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:15 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:22:15.454725 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-0ba287f1-5760-413d-a88e-09f333f80b3f req-3948b4cc-6b2a-4f48-8947-204bc818ee2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4405743-14dc-4899-9fb2-4dd3b6bb6bc1", "name": "network-vif-plugged", "status": "completed", "tag": "bfeb8c9a-9cc4-45f8-be67-faaf5bcbaee1"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:22:15.466314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0ba287f1-5760-413d-a88e-09f333f80b3f req-3948b4cc-6b2a-4f48-8947-204bc818ee2f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:15.466806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0ba287f1-5760-413d-a88e-09f333f80b3f req-3948b4cc-6b2a-4f48-8947-204bc818ee2f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:15.467278 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0ba287f1-5760-413d-a88e-09f333f80b3f req-3948b4cc-6b2a-4f48-8947-204bc818ee2f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:15.478213 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-0ba287f1-5760-413d-a88e-09f333f80b3f req-3948b4cc-6b2a-4f48-8947-204bc818ee2f service nova] Creating event network-vif-plugged:bfeb8c9a-9cc4-45f8-be67-faaf5bcbaee1 for instance a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 on n-h2-861111-1 Oct 12 23:22:15.483155 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-0ba287f1-5760-413d-a88e-09f333f80b3f req-3948b4cc-6b2a-4f48-8947-204bc818ee2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032166 Oct 12 23:22:15.483776 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3609/7875] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:22:16.365527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-29d6a555-02e6-4a68-90aa-30988cecd0c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:16.366177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-29d6a555-02e6-4a68-90aa-30988cecd0c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:16.373043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d6a555-02e6-4a68-90aa-30988cecd0c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:16.373527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d6a555-02e6-4a68-90aa-30988cecd0c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:16.373969 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d6a555-02e6-4a68-90aa-30988cecd0c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:16.374872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d6a555-02e6-4a68-90aa-30988cecd0c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:16.375106 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d6a555-02e6-4a68-90aa-30988cecd0c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:16.375688 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-29d6a555-02e6-4a68-90aa-30988cecd0c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:16.508636 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-29d6a555-02e6-4a68-90aa-30988cecd0c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:16.516372 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-29d6a555-02e6-4a68-90aa-30988cecd0c0 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1392 microversion: 2.1 time: 0.155502 Oct 12 23:22:16.516945 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4267/7876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:16 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:22:17.538615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:22:17.539435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:22:17.543863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4524c091-4caa-4010-8021-014504a8dc5d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:17.544596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4524c091-4caa-4010-8021-014504a8dc5d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:17.552700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4524c091-4caa-4010-8021-014504a8dc5d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:17.553206 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4524c091-4caa-4010-8021-014504a8dc5d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:17.553663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4524c091-4caa-4010-8021-014504a8dc5d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:17.554393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4524c091-4caa-4010-8021-014504a8dc5d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:17.554870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4524c091-4caa-4010-8021-014504a8dc5d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:17.555336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4524c091-4caa-4010-8021-014504a8dc5d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:17.691583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4524c091-4caa-4010-8021-014504a8dc5d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:17.699218 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4524c091-4caa-4010-8021-014504a8dc5d tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1564 microversion: 2.1 time: 0.163038 Oct 12 23:22:17.699806 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3610/7877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:17 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:22:17.722110 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-16482aa0-49a1-4259-a18e-419f7a36f887 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:17.722820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-16482aa0-49a1-4259-a18e-419f7a36f887 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:17.725357 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:22:17.732071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16482aa0-49a1-4259-a18e-419f7a36f887 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:17.732573 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16482aa0-49a1-4259-a18e-419f7a36f887 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:17.733019 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16482aa0-49a1-4259-a18e-419f7a36f887 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:17.733765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16482aa0-49a1-4259-a18e-419f7a36f887 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:17.734262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16482aa0-49a1-4259-a18e-419f7a36f887 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:17.734728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-16482aa0-49a1-4259-a18e-419f7a36f887 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:17.866243 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-16482aa0-49a1-4259-a18e-419f7a36f887 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:17.874480 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-16482aa0-49a1-4259-a18e-419f7a36f887 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1564 microversion: 2.1 time: 0.156352 Oct 12 23:22:17.875061 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4268/7878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:17 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:22:19.731755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-88e10e30-cde8-438f-9c6e-1e8604ecd57a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:19.732393 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-88e10e30-cde8-438f-9c6e-1e8604ecd57a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:19.734467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-98b159a2-3c04-4e4e-a9f3-69201fd0749f req-dbd5360f-8ff4-4c91-ba43-639e52c79590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4405743-14dc-4899-9fb2-4dd3b6bb6bc1", "tag": "bfeb8c9a-9cc4-45f8-be67-faaf5bcbaee1"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:22:19.739304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88e10e30-cde8-438f-9c6e-1e8604ecd57a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:19.739806 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88e10e30-cde8-438f-9c6e-1e8604ecd57a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:19.740258 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88e10e30-cde8-438f-9c6e-1e8604ecd57a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:19.740973 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88e10e30-cde8-438f-9c6e-1e8604ecd57a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:19.741440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88e10e30-cde8-438f-9c6e-1e8604ecd57a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:19.741880 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88e10e30-cde8-438f-9c6e-1e8604ecd57a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:19.745939 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-98b159a2-3c04-4e4e-a9f3-69201fd0749f req-dbd5360f-8ff4-4c91-ba43-639e52c79590 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:19.746450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-98b159a2-3c04-4e4e-a9f3-69201fd0749f req-dbd5360f-8ff4-4c91-ba43-639e52c79590 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:19.747202 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-98b159a2-3c04-4e4e-a9f3-69201fd0749f req-dbd5360f-8ff4-4c91-ba43-639e52c79590 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:19.768611 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-98b159a2-3c04-4e4e-a9f3-69201fd0749f req-dbd5360f-8ff4-4c91-ba43-639e52c79590 service nova] Creating event network-changed:bfeb8c9a-9cc4-45f8-be67-faaf5bcbaee1 for instance a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 on n-h2-861111-1 Oct 12 23:22:19.774742 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-98b159a2-3c04-4e4e-a9f3-69201fd0749f req-dbd5360f-8ff4-4c91-ba43-639e52c79590 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044070 Oct 12 23:22:19.775565 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4269/7879] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:22:19.885637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-88e10e30-cde8-438f-9c6e-1e8604ecd57a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:19.893798 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-88e10e30-cde8-438f-9c6e-1e8604ecd57a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1564 microversion: 2.1 time: 0.165784 Oct 12 23:22:19.894374 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3611/7880] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:19 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:22:49.165698 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-da6baa06-bbac-4027-9220-bfa271b3646e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:22:49.167961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-da6baa06-bbac-4027-9220-bfa271b3646e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:49.170248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:22:49.170907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=38 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:22:49.178559 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da6baa06-bbac-4027-9220-bfa271b3646e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:49.179088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da6baa06-bbac-4027-9220-bfa271b3646e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:49.179639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da6baa06-bbac-4027-9220-bfa271b3646e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:49.180345 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da6baa06-bbac-4027-9220-bfa271b3646e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:49.180811 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da6baa06-bbac-4027-9220-bfa271b3646e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:49.181245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da6baa06-bbac-4027-9220-bfa271b3646e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:49.232723 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-da6baa06-bbac-4027-9220-bfa271b3646e tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1/action" status: 200 len: 24573 microversion: 2.1 time: 0.071409 Oct 12 23:22:49.233367 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4270/7881] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:22:49 2022] POST /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1/action => generated 24573 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:23:19.421740 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0c848fca-150a-411d-a2c0-b425dbe7569c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:23:19.422431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0c848fca-150a-411d-a2c0-b425dbe7569c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:19.424738 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:19.425460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=36 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:19.432887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c848fca-150a-411d-a2c0-b425dbe7569c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:19.433386 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c848fca-150a-411d-a2c0-b425dbe7569c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:19.433834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c848fca-150a-411d-a2c0-b425dbe7569c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:19.434556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c848fca-150a-411d-a2c0-b425dbe7569c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:19.435019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c848fca-150a-411d-a2c0-b425dbe7569c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:19.435486 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c848fca-150a-411d-a2c0-b425dbe7569c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:19.462460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-0c848fca-150a-411d-a2c0-b425dbe7569c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lazy-loading 'flavor' on Instance uuid a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:23:19.529652 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0c848fca-150a-411d-a2c0-b425dbe7569c tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1/action" status: 202 len: 0 microversion: 2.1 time: 0.111943 Oct 12 23:23:19.531181 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3612/7882] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:23:19 2022] POST /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:23:19.539570 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-527e262e-5368-41a8-a506-046eaca4089a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:19.540214 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-527e262e-5368-41a8-a506-046eaca4089a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:19.542724 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:19.543510 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=4 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:19.549828 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-527e262e-5368-41a8-a506-046eaca4089a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:19.550319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-527e262e-5368-41a8-a506-046eaca4089a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:19.550759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-527e262e-5368-41a8-a506-046eaca4089a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:19.551490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-527e262e-5368-41a8-a506-046eaca4089a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:19.551954 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-527e262e-5368-41a8-a506-046eaca4089a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:19.552383 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-527e262e-5368-41a8-a506-046eaca4089a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:19.683644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-527e262e-5368-41a8-a506-046eaca4089a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:19.691744 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-527e262e-5368-41a8-a506-046eaca4089a tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1691 microversion: 2.1 time: 0.156708 Oct 12 23:23:19.692316 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4271/7883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:19 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:20.716577 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-70473e1a-5a45-4247-8a7f-b84ccddb3588 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:20.717295 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-70473e1a-5a45-4247-8a7f-b84ccddb3588 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:20.724544 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70473e1a-5a45-4247-8a7f-b84ccddb3588 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:20.725041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70473e1a-5a45-4247-8a7f-b84ccddb3588 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:20.725490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70473e1a-5a45-4247-8a7f-b84ccddb3588 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:20.726230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70473e1a-5a45-4247-8a7f-b84ccddb3588 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:20.726701 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70473e1a-5a45-4247-8a7f-b84ccddb3588 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:20.727142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-70473e1a-5a45-4247-8a7f-b84ccddb3588 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:20.857317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-70473e1a-5a45-4247-8a7f-b84ccddb3588 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:20.865076 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-70473e1a-5a45-4247-8a7f-b84ccddb3588 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1691 microversion: 2.1 time: 0.152796 Oct 12 23:23:20.865645 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3613/7884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:20 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:21.890865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7e26bbc6-227f-48e5-bbdf-cf039d523567 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:21.891526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7e26bbc6-227f-48e5-bbdf-cf039d523567 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:21.902094 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e26bbc6-227f-48e5-bbdf-cf039d523567 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:21.902595 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e26bbc6-227f-48e5-bbdf-cf039d523567 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:21.903037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e26bbc6-227f-48e5-bbdf-cf039d523567 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:21.903784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e26bbc6-227f-48e5-bbdf-cf039d523567 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:21.904241 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e26bbc6-227f-48e5-bbdf-cf039d523567 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:21.904706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e26bbc6-227f-48e5-bbdf-cf039d523567 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:22.038148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7e26bbc6-227f-48e5-bbdf-cf039d523567 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:22.046627 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7e26bbc6-227f-48e5-bbdf-cf039d523567 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1674 microversion: 2.1 time: 0.159719 Oct 12 23:23:22.047208 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4272/7885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:21 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:23.140355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7355fa38-b680-4a48-8b7f-8439530f61c1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:23:23.142555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7355fa38-b680-4a48-8b7f-8439530f61c1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:23.149317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7355fa38-b680-4a48-8b7f-8439530f61c1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:23.149822 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7355fa38-b680-4a48-8b7f-8439530f61c1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:23.150275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7355fa38-b680-4a48-8b7f-8439530f61c1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:23.150978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7355fa38-b680-4a48-8b7f-8439530f61c1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:23.151485 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7355fa38-b680-4a48-8b7f-8439530f61c1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:23.151926 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7355fa38-b680-4a48-8b7f-8439530f61c1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:23.203138 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7355fa38-b680-4a48-8b7f-8439530f61c1 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1/action" status: 200 len: 38430 microversion: 2.1 time: 0.066562 Oct 12 23:23:23.203785 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3614/7886] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:23:23 2022] POST /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1/action => generated 38430 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:23:23.215816 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-99fd73fb-19e0-4a93-8759-f35d9e196921 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:23:23.216363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-99fd73fb-19e0-4a93-8759-f35d9e196921 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:23.223120 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99fd73fb-19e0-4a93-8759-f35d9e196921 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:23.223713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99fd73fb-19e0-4a93-8759-f35d9e196921 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:23.224159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99fd73fb-19e0-4a93-8759-f35d9e196921 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:23.224878 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99fd73fb-19e0-4a93-8759-f35d9e196921 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:23.225336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99fd73fb-19e0-4a93-8759-f35d9e196921 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:23.225802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-99fd73fb-19e0-4a93-8759-f35d9e196921 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:23.291469 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-99fd73fb-19e0-4a93-8759-f35d9e196921 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1/action" status: 202 len: 0 microversion: 2.1 time: 0.079255 Oct 12 23:23:23.292079 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4273/7887] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:23:23 2022] POST /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:23:23.300858 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9f9e38d0-b049-456d-a93f-b4a77c5ec188 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:23.301578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9f9e38d0-b049-456d-a93f-b4a77c5ec188 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:23.309266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f9e38d0-b049-456d-a93f-b4a77c5ec188 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:23.309852 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f9e38d0-b049-456d-a93f-b4a77c5ec188 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:23.310272 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f9e38d0-b049-456d-a93f-b4a77c5ec188 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:23.311052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f9e38d0-b049-456d-a93f-b4a77c5ec188 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:23.311556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f9e38d0-b049-456d-a93f-b4a77c5ec188 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:23.311999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f9e38d0-b049-456d-a93f-b4a77c5ec188 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:23.451580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9f9e38d0-b049-456d-a93f-b4a77c5ec188 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:23.459508 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9f9e38d0-b049-456d-a93f-b4a77c5ec188 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1680 microversion: 2.1 time: 0.162791 Oct 12 23:23:23.460083 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3615/7888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:23 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:24.483884 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c02fbd58-bd3d-4908-a7c7-7559f97dc317 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:24.484621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c02fbd58-bd3d-4908-a7c7-7559f97dc317 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:24.491518 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c02fbd58-bd3d-4908-a7c7-7559f97dc317 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:24.492002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c02fbd58-bd3d-4908-a7c7-7559f97dc317 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:24.492442 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c02fbd58-bd3d-4908-a7c7-7559f97dc317 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:24.493130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c02fbd58-bd3d-4908-a7c7-7559f97dc317 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:24.493584 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c02fbd58-bd3d-4908-a7c7-7559f97dc317 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:24.494027 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c02fbd58-bd3d-4908-a7c7-7559f97dc317 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:24.627100 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c02fbd58-bd3d-4908-a7c7-7559f97dc317 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:24.635685 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c02fbd58-bd3d-4908-a7c7-7559f97dc317 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1680 microversion: 2.1 time: 0.156086 Oct 12 23:23:24.636300 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4274/7889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:24 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:25.659580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-afdd25b6-9189-482d-89e4-83b5f9bf7eeb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:25.660136 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-afdd25b6-9189-482d-89e4-83b5f9bf7eeb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:25.667495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afdd25b6-9189-482d-89e4-83b5f9bf7eeb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:25.667999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afdd25b6-9189-482d-89e4-83b5f9bf7eeb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:25.668455 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afdd25b6-9189-482d-89e4-83b5f9bf7eeb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:25.669167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afdd25b6-9189-482d-89e4-83b5f9bf7eeb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:25.669642 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afdd25b6-9189-482d-89e4-83b5f9bf7eeb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:25.670089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-afdd25b6-9189-482d-89e4-83b5f9bf7eeb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:25.800700 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-afdd25b6-9189-482d-89e4-83b5f9bf7eeb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:25.809073 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-afdd25b6-9189-482d-89e4-83b5f9bf7eeb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1683 microversion: 2.1 time: 0.153559 Oct 12 23:23:25.809638 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3616/7890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:25 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:25.901876 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-b530b7be-e5da-46c7-bd0d-10e526ab5eab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:23:25.904124 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-b530b7be-e5da-46c7-bd0d-10e526ab5eab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:25.910892 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b530b7be-e5da-46c7-bd0d-10e526ab5eab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:25.911354 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b530b7be-e5da-46c7-bd0d-10e526ab5eab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:25.911802 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b530b7be-e5da-46c7-bd0d-10e526ab5eab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:25.912495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b530b7be-e5da-46c7-bd0d-10e526ab5eab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:25.912953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b530b7be-e5da-46c7-bd0d-10e526ab5eab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:25.913386 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-b530b7be-e5da-46c7-bd0d-10e526ab5eab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:25.956530 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-b530b7be-e5da-46c7-bd0d-10e526ab5eab tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "POST /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1/action" status: 200 len: 38430 microversion: 2.1 time: 0.058475 Oct 12 23:23:25.957146 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4275/7891] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:23:25 2022] POST /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1/action => generated 38430 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:23:26.913460 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c5dd8ff6-8b41-4b1d-9678-4020136dcbdb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:26.914903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c5dd8ff6-8b41-4b1d-9678-4020136dcbdb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:26.916744 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a4e24303-01d1-4dd6-99c6-50dead9899ad req-14e20faa-ea6f-4fd5-99de-358f5a438e41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4405743-14dc-4899-9fb2-4dd3b6bb6bc1", "tag": "bfeb8c9a-9cc4-45f8-be67-faaf5bcbaee1"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:23:26.922241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5dd8ff6-8b41-4b1d-9678-4020136dcbdb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:26.922737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5dd8ff6-8b41-4b1d-9678-4020136dcbdb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:26.923183 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5dd8ff6-8b41-4b1d-9678-4020136dcbdb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:26.924169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5dd8ff6-8b41-4b1d-9678-4020136dcbdb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:26.924915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5dd8ff6-8b41-4b1d-9678-4020136dcbdb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:26.925763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c5dd8ff6-8b41-4b1d-9678-4020136dcbdb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:26.928209 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a4e24303-01d1-4dd6-99c6-50dead9899ad req-14e20faa-ea6f-4fd5-99de-358f5a438e41 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:26.928786 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a4e24303-01d1-4dd6-99c6-50dead9899ad req-14e20faa-ea6f-4fd5-99de-358f5a438e41 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:26.929327 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a4e24303-01d1-4dd6-99c6-50dead9899ad req-14e20faa-ea6f-4fd5-99de-358f5a438e41 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:26.940668 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a4e24303-01d1-4dd6-99c6-50dead9899ad req-14e20faa-ea6f-4fd5-99de-358f5a438e41 service nova] Creating event network-changed:bfeb8c9a-9cc4-45f8-be67-faaf5bcbaee1 for instance a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 on n-h2-861111-1 Oct 12 23:23:26.945649 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a4e24303-01d1-4dd6-99c6-50dead9899ad req-14e20faa-ea6f-4fd5-99de-358f5a438e41 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033646 Oct 12 23:23:26.946391 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4276/7892] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:23:26.957067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c5dd8ff6-8b41-4b1d-9678-4020136dcbdb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:23:27.043922 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c5dd8ff6-8b41-4b1d-9678-4020136dcbdb tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 204 len: 0 microversion: 2.1 time: 0.133873 Oct 12 23:23:27.047283 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3617/7893] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:23:26 2022] DELETE /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:23:27.053707 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7ebcf54c-7082-423d-bc35-9fc7679fbc30 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:27.054449 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7ebcf54c-7082-423d-bc35-9fc7679fbc30 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:27.060746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ebcf54c-7082-423d-bc35-9fc7679fbc30 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:27.061232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ebcf54c-7082-423d-bc35-9fc7679fbc30 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:27.061667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ebcf54c-7082-423d-bc35-9fc7679fbc30 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:27.062355 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ebcf54c-7082-423d-bc35-9fc7679fbc30 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:27.062804 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ebcf54c-7082-423d-bc35-9fc7679fbc30 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:27.063228 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7ebcf54c-7082-423d-bc35-9fc7679fbc30 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:27.211312 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7ebcf54c-7082-423d-bc35-9fc7679fbc30 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:27.219199 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7ebcf54c-7082-423d-bc35-9fc7679fbc30 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1689 microversion: 2.1 time: 0.170121 Oct 12 23:23:27.219890 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4277/7894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:27 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:28.245583 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-513fa441-e9d1-4644-adfc-51c9183cf432 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:28.246352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-513fa441-e9d1-4644-adfc-51c9183cf432 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:28.253827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-513fa441-e9d1-4644-adfc-51c9183cf432 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:28.254355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-513fa441-e9d1-4644-adfc-51c9183cf432 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:28.254815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-513fa441-e9d1-4644-adfc-51c9183cf432 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:28.255558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-513fa441-e9d1-4644-adfc-51c9183cf432 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:28.256031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-513fa441-e9d1-4644-adfc-51c9183cf432 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:28.256517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-513fa441-e9d1-4644-adfc-51c9183cf432 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:28.398073 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-513fa441-e9d1-4644-adfc-51c9183cf432 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:28.405960 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-513fa441-e9d1-4644-adfc-51c9183cf432 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1689 microversion: 2.1 time: 0.165034 Oct 12 23:23:28.406539 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3618/7895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:28 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:29.114492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-49188256-c14a-4183-bbf9-d8fdd123dc42 req-06f0ed14-e897-4314-8451-af8c764cba57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4405743-14dc-4899-9fb2-4dd3b6bb6bc1", "name": "network-vif-deleted", "tag": "bfeb8c9a-9cc4-45f8-be67-faaf5bcbaee1"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:23:29.130444 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-49188256-c14a-4183-bbf9-d8fdd123dc42 req-06f0ed14-e897-4314-8451-af8c764cba57 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:29.130852 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-49188256-c14a-4183-bbf9-d8fdd123dc42 req-06f0ed14-e897-4314-8451-af8c764cba57 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:29.131308 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-49188256-c14a-4183-bbf9-d8fdd123dc42 req-06f0ed14-e897-4314-8451-af8c764cba57 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:29.143500 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-49188256-c14a-4183-bbf9-d8fdd123dc42 req-06f0ed14-e897-4314-8451-af8c764cba57 service nova] Creating event network-vif-deleted:bfeb8c9a-9cc4-45f8-be67-faaf5bcbaee1 for instance a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 on n-h2-861111-1 Oct 12 23:23:29.148683 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-49188256-c14a-4183-bbf9-d8fdd123dc42 req-06f0ed14-e897-4314-8451-af8c764cba57 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037445 Oct 12 23:23:29.149491 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4278/7896] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:23:29.429884 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cb8b9ccd-7bb9-4831-a6b9-0c08c09a85de tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:29.431218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cb8b9ccd-7bb9-4831-a6b9-0c08c09a85de tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:29.438430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cb8b9ccd-7bb9-4831-a6b9-0c08c09a85de tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:29.438954 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cb8b9ccd-7bb9-4831-a6b9-0c08c09a85de tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:29.439421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cb8b9ccd-7bb9-4831-a6b9-0c08c09a85de tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:29.440141 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cb8b9ccd-7bb9-4831-a6b9-0c08c09a85de tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:29.440644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cb8b9ccd-7bb9-4831-a6b9-0c08c09a85de tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:29.441082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cb8b9ccd-7bb9-4831-a6b9-0c08c09a85de tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:29.477682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cb8b9ccd-7bb9-4831-a6b9-0c08c09a85de tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:29.478178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cb8b9ccd-7bb9-4831-a6b9-0c08c09a85de tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:29.478885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cb8b9ccd-7bb9-4831-a6b9-0c08c09a85de tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:29.479537 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-cb8b9ccd-7bb9-4831-a6b9-0c08c09a85de tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lazy-loading 'fault' on Instance uuid a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:23:29.525281 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cb8b9ccd-7bb9-4831-a6b9-0c08c09a85de tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764c04554c2a4616bf01531df31e717e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa1a0f52f94b8ebd34b42034d66b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:29.534912 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cb8b9ccd-7bb9-4831-a6b9-0c08c09a85de tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 200 len: 1356 microversion: 2.1 time: 0.109056 Oct 12 23:23:29.535804 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3619/7897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:29 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:30.560599 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ead37400-088a-4f56-8cab-a34065aad8dc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:30.561303 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ead37400-088a-4f56-8cab-a34065aad8dc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] [instance: a4405743-14dc-4899-9fb2-4dd3b6bb6bc1] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:30.567565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ead37400-088a-4f56-8cab-a34065aad8dc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:30.568052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ead37400-088a-4f56-8cab-a34065aad8dc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:30.568498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ead37400-088a-4f56-8cab-a34065aad8dc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:30.569190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ead37400-088a-4f56-8cab-a34065aad8dc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:30.569644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ead37400-088a-4f56-8cab-a34065aad8dc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:30.570076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ead37400-088a-4f56-8cab-a34065aad8dc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:30.586571 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-ead37400-088a-4f56-8cab-a34065aad8dc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] HTTP exception thrown: Instance a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 could not be found. Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ead37400-088a-4f56-8cab-a34065aad8dc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Request method failure captured: Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 HTTP/1.1 Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0oDcsNZbK1s9UNJvxMC8RxC4ab4VJ9ZKIMF77QJsJZvVUWjtNdnoFUDs5DSCBdxR5bWpQMeaN0YxqWPQUxJY0Xl9lZ1L0H_qo_58rDYn9dWgmYp9aHXIvU5wG05-LSRMRtk73J6MtC3Hv8Dnt7etVEPS2sKlXDRy4IcGnrNH7WIBVA Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 42fa1a0f52f94b8ebd34b42034d66b70 Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-799438933 Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42fa1a0f52f94b8ebd34b42034d66b70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42fa1a0f52f94b8ebd34b42034d66b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42fa1a0f52f94b8ebd34b42034d66b70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42fa1a0f52f94b8ebd34b42034d66b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestNetworkAdvancedServerOps-799438933 Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 42fa1a0f52f94b8ebd34b42034d66b70 Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-799438933 Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestNetworkAdvancedServerOps-799438933-project Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 764c04554c2a4616bf01531df31e717e Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestNetworkAdvancedServerOps-799438933-project Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 could not be found. Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': 'a4405743-14dc-4899-9fb2-4dd3b6bb6bc1'} Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 could not be found. Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 could not be found. Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:23:30.588232 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:23:30.593821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:23:30.593821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:23:30.593821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:23:30.593821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:23:30.593821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:23:30.593821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:23:30.593821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 could not be found. Oct 12 23:23:30.593821 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:23:30.593821 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ead37400-088a-4f56-8cab-a34065aad8dc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Returning 404 to user: Instance a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:23:30.593821 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ead37400-088a-4f56-8cab-a34065aad8dc tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1" status: 404 len: 111 microversion: 2.1 time: 0.034355 Oct 12 23:23:30.593821 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4279/7898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:30 2022] GET /compute/v2.1/servers/a4405743-14dc-4899-9fb2-4dd3b6bb6bc1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:23:33.895127 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6be17652-ac2d-4065-b7e1-6f0429016222 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] Calling method '.version_select at 0x7f5128735700>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:33.919306 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6be17652-ac2d-4065-b7e1-6f0429016222 tempest-TestNetworkAdvancedServerOps-799438933 tempest-TestNetworkAdvancedServerOps-799438933-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-143803028" status: 202 len: 0 microversion: 2.1 time: 0.027866 Oct 12 23:23:33.920089 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3620/7899] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Oct 12 23:23:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-143803028 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:23:44.959191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=18 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:44.960747 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:45.146929 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-be4ca1d5-7c47-469d-93d8-711910092991 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Action: 'create', calling method: .version_select at 0x7f51233633a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-710344093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSRg16shBcWKph1VSiGxORZLVpHwmlGJ6woATfw9j5XGP1ZHmyddFgHs/Hb6w3wbNcQnMiY6Ib67W6qRrGGyFCjR6CWncIhzLgAM4WzjcbGKTSgrOEVyKlS1g/Y3NrTng=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:23:45.163948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-be4ca1d5-7c47-469d-93d8-711910092991 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Getting quotas for project 7c668c00d36b49829ad8de2181ec0237. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:23:45.169227 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-be4ca1d5-7c47-469d-93d8-711910092991 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Getting quotas for user 4ad65c86847048f987704ba020d2a6ac and project 7c668c00d36b49829ad8de2181ec0237. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:23:45.195764 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-be4ca1d5-7c47-469d-93d8-711910092991 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.242044 Oct 12 23:23:45.196560 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4280/7900] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 23:23:44 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:23:46.261371 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2050271021", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-710344093", "security_groups": [{"name": "tempest-secgroup-smoke-1697249435"}], "networks": [{"uuid": "7c2f4220-9c31-4171-80e9-38f1f73c622b"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:23:46.274955 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:46.275625 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:46.374971 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] validate_networks() for [('7c2f4220-9c31-4171-80e9-38f1f73c622b', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:23:46.858025 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:23:46.858461 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:23:46.858947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:23:46.859436 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:23:46.859862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:23:46.869007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:46.869499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:46.869942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:46.870674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:46.871135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:46.871601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:46.889563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Getting quotas for project 7c668c00d36b49829ad8de2181ec0237. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:23:46.895085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Getting quotas for user 4ad65c86847048f987704ba020d2a6ac and project 7c668c00d36b49829ad8de2181ec0237. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:23:46.908817 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:23:46.911066 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:23:46.958976 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-80600b4b-6f0c-4d19-8e47-01735d235486 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.701361 Oct 12 23:23:46.959651 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3621/7901] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 23:23:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:23:46.972551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0ad1ce7e-dc2c-4496-aff2-d0ef773e6458 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:46.973282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-0ad1ce7e-dc2c-4496-aff2-d0ef773e6458 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:47.112533 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-0ad1ce7e-dc2c-4496-aff2-d0ef773e6458 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:47.123072 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0ad1ce7e-dc2c-4496-aff2-d0ef773e6458 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1246 microversion: 2.1 time: 0.155301 Oct 12 23:23:47.128486 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4281/7902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:46 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1246 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:48.148874 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-99bf85df-1510-455f-b832-53dac0eca1a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:48.149496 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-99bf85df-1510-455f-b832-53dac0eca1a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:48.156842 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99bf85df-1510-455f-b832-53dac0eca1a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:48.157339 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99bf85df-1510-455f-b832-53dac0eca1a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:48.157783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99bf85df-1510-455f-b832-53dac0eca1a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:48.158617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99bf85df-1510-455f-b832-53dac0eca1a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:48.159085 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99bf85df-1510-455f-b832-53dac0eca1a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:48.159871 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99bf85df-1510-455f-b832-53dac0eca1a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:48.226680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-99bf85df-1510-455f-b832-53dac0eca1a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:48.235578 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-99bf85df-1510-455f-b832-53dac0eca1a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1304 microversion: 2.1 time: 0.092177 Oct 12 23:23:48.236164 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3622/7903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:48 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:49.258574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9de1fdb5-6add-46e8-a29f-0f63b4b5aa60 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:49.259319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9de1fdb5-6add-46e8-a29f-0f63b4b5aa60 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:49.266829 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9de1fdb5-6add-46e8-a29f-0f63b4b5aa60 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:49.267446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9de1fdb5-6add-46e8-a29f-0f63b4b5aa60 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:49.267973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9de1fdb5-6add-46e8-a29f-0f63b4b5aa60 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:49.268905 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9de1fdb5-6add-46e8-a29f-0f63b4b5aa60 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:49.269426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9de1fdb5-6add-46e8-a29f-0f63b4b5aa60 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:49.270026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9de1fdb5-6add-46e8-a29f-0f63b4b5aa60 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:49.468746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9de1fdb5-6add-46e8-a29f-0f63b4b5aa60 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:49.477204 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9de1fdb5-6add-46e8-a29f-0f63b4b5aa60 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1372 microversion: 2.1 time: 0.222728 Oct 12 23:23:49.477836 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4282/7904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:49 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:49.582864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-cac8b45f-50ea-48b4-b4f8-2542dde1a6eb req-9a44a1b1-9089-43d9-86c4-c848f979b46c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8000e8-aa4d-432c-9897-40fad65ad76e", "tag": "ea36e3b7-df6a-4e9c-87df-47b5d23fb00a"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:23:49.599429 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-cac8b45f-50ea-48b4-b4f8-2542dde1a6eb req-9a44a1b1-9089-43d9-86c4-c848f979b46c service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:49.601637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-cac8b45f-50ea-48b4-b4f8-2542dde1a6eb req-9a44a1b1-9089-43d9-86c4-c848f979b46c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:49.602267 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-cac8b45f-50ea-48b4-b4f8-2542dde1a6eb req-9a44a1b1-9089-43d9-86c4-c848f979b46c service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:49.615709 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-cac8b45f-50ea-48b4-b4f8-2542dde1a6eb req-9a44a1b1-9089-43d9-86c4-c848f979b46c service nova] Creating event network-changed:ea36e3b7-df6a-4e9c-87df-47b5d23fb00a for instance 8c8000e8-aa4d-432c-9897-40fad65ad76e on n-h2-861111-1 Oct 12 23:23:49.622294 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-cac8b45f-50ea-48b4-b4f8-2542dde1a6eb req-9a44a1b1-9089-43d9-86c4-c848f979b46c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126055 Oct 12 23:23:49.623620 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3623/7905] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:23:50.500952 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-268e46b4-b53d-4243-a761-8562c90f956d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:50.501576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-268e46b4-b53d-4243-a761-8562c90f956d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:50.508968 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-268e46b4-b53d-4243-a761-8562c90f956d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:50.509461 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-268e46b4-b53d-4243-a761-8562c90f956d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:50.509909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-268e46b4-b53d-4243-a761-8562c90f956d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:50.510609 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-268e46b4-b53d-4243-a761-8562c90f956d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:50.511070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-268e46b4-b53d-4243-a761-8562c90f956d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:50.511544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-268e46b4-b53d-4243-a761-8562c90f956d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:50.640420 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-268e46b4-b53d-4243-a761-8562c90f956d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:50.648244 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-268e46b4-b53d-4243-a761-8562c90f956d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1372 microversion: 2.1 time: 0.151165 Oct 12 23:23:50.648834 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4283/7906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:50 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:51.673397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2255bd80-8161-456c-b138-08ce655b6539 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:51.674115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2255bd80-8161-456c-b138-08ce655b6539 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:51.680782 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2255bd80-8161-456c-b138-08ce655b6539 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:51.681280 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2255bd80-8161-456c-b138-08ce655b6539 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:51.681730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2255bd80-8161-456c-b138-08ce655b6539 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:51.682434 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2255bd80-8161-456c-b138-08ce655b6539 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:51.682900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2255bd80-8161-456c-b138-08ce655b6539 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:51.683366 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2255bd80-8161-456c-b138-08ce655b6539 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:51.818113 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2255bd80-8161-456c-b138-08ce655b6539 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:51.827033 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2255bd80-8161-456c-b138-08ce655b6539 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1372 microversion: 2.1 time: 0.158735 Oct 12 23:23:51.827645 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3624/7907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:51 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:52.850531 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dcb09ea4-6649-4040-b405-4079b571c5a7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:52.851162 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dcb09ea4-6649-4040-b405-4079b571c5a7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:52.858676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcb09ea4-6649-4040-b405-4079b571c5a7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:52.859167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcb09ea4-6649-4040-b405-4079b571c5a7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:52.859639 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcb09ea4-6649-4040-b405-4079b571c5a7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:52.860338 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcb09ea4-6649-4040-b405-4079b571c5a7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:52.860800 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcb09ea4-6649-4040-b405-4079b571c5a7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:52.861231 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dcb09ea4-6649-4040-b405-4079b571c5a7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:52.996517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dcb09ea4-6649-4040-b405-4079b571c5a7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:53.004343 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dcb09ea4-6649-4040-b405-4079b571c5a7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1372 microversion: 2.1 time: 0.157851 Oct 12 23:23:53.004906 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4284/7908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:52 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:54.028566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3fe63176-3be3-4d3d-ac92-02db6d728056 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:54.029271 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3fe63176-3be3-4d3d-ac92-02db6d728056 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:54.036019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fe63176-3be3-4d3d-ac92-02db6d728056 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:54.036510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fe63176-3be3-4d3d-ac92-02db6d728056 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:54.036957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fe63176-3be3-4d3d-ac92-02db6d728056 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:54.037651 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fe63176-3be3-4d3d-ac92-02db6d728056 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:54.038663 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fe63176-3be3-4d3d-ac92-02db6d728056 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:54.039099 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fe63176-3be3-4d3d-ac92-02db6d728056 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:54.175421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3fe63176-3be3-4d3d-ac92-02db6d728056 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:54.183481 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3fe63176-3be3-4d3d-ac92-02db6d728056 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1372 microversion: 2.1 time: 0.158776 Oct 12 23:23:54.184061 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3625/7909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:54 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:55.207091 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e6972cb6-8cde-4b8b-8d46-332ea19ecb54 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:55.207750 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e6972cb6-8cde-4b8b-8d46-332ea19ecb54 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:55.214628 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6972cb6-8cde-4b8b-8d46-332ea19ecb54 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:55.215130 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6972cb6-8cde-4b8b-8d46-332ea19ecb54 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:55.215606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6972cb6-8cde-4b8b-8d46-332ea19ecb54 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:55.216294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6972cb6-8cde-4b8b-8d46-332ea19ecb54 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:55.216743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6972cb6-8cde-4b8b-8d46-332ea19ecb54 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:55.217166 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e6972cb6-8cde-4b8b-8d46-332ea19ecb54 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:55.350809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e6972cb6-8cde-4b8b-8d46-332ea19ecb54 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:55.358551 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e6972cb6-8cde-4b8b-8d46-332ea19ecb54 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1372 microversion: 2.1 time: 0.155372 Oct 12 23:23:55.359116 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4285/7910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:55 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:55.999662 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-4bced090-996a-4b4f-b543-77852456ec21 req-c50ff6e9-dc3b-4e71-903f-bcff881596b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8000e8-aa4d-432c-9897-40fad65ad76e", "name": "network-vif-plugged", "status": "completed", "tag": "ea36e3b7-df6a-4e9c-87df-47b5d23fb00a"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:23:56.011826 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4bced090-996a-4b4f-b543-77852456ec21 req-c50ff6e9-dc3b-4e71-903f-bcff881596b4 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:56.012317 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4bced090-996a-4b4f-b543-77852456ec21 req-c50ff6e9-dc3b-4e71-903f-bcff881596b4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:56.012755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-4bced090-996a-4b4f-b543-77852456ec21 req-c50ff6e9-dc3b-4e71-903f-bcff881596b4 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:56.024412 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-4bced090-996a-4b4f-b543-77852456ec21 req-c50ff6e9-dc3b-4e71-903f-bcff881596b4 service nova] Creating event network-vif-plugged:ea36e3b7-df6a-4e9c-87df-47b5d23fb00a for instance 8c8000e8-aa4d-432c-9897-40fad65ad76e on n-h2-861111-1 Oct 12 23:23:56.029585 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-4bced090-996a-4b4f-b543-77852456ec21 req-c50ff6e9-dc3b-4e71-903f-bcff881596b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088259 Oct 12 23:23:56.030199 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3626/7911] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:23:56.382188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-09a11dba-18ba-46c9-aed6-e71177b168a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:56.382812 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-09a11dba-18ba-46c9-aed6-e71177b168a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:56.389612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09a11dba-18ba-46c9-aed6-e71177b168a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:56.390095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09a11dba-18ba-46c9-aed6-e71177b168a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:56.390532 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09a11dba-18ba-46c9-aed6-e71177b168a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:56.391224 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09a11dba-18ba-46c9-aed6-e71177b168a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:56.391699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09a11dba-18ba-46c9-aed6-e71177b168a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:56.392216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-09a11dba-18ba-46c9-aed6-e71177b168a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:56.524920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-09a11dba-18ba-46c9-aed6-e71177b168a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:56.532681 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-09a11dba-18ba-46c9-aed6-e71177b168a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1372 microversion: 2.1 time: 0.155318 Oct 12 23:23:56.533261 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4286/7912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:56 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:57.557521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f1da6205-22a7-476a-a19c-5c1afa303f23 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:57.558242 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f1da6205-22a7-476a-a19c-5c1afa303f23 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:57.560320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:57.560994 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:57.568328 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1da6205-22a7-476a-a19c-5c1afa303f23 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:57.568843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1da6205-22a7-476a-a19c-5c1afa303f23 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:57.569834 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1da6205-22a7-476a-a19c-5c1afa303f23 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:57.570548 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1da6205-22a7-476a-a19c-5c1afa303f23 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:57.571019 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1da6205-22a7-476a-a19c-5c1afa303f23 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:57.571499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1da6205-22a7-476a-a19c-5c1afa303f23 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:57.702968 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f1da6205-22a7-476a-a19c-5c1afa303f23 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:57.711076 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f1da6205-22a7-476a-a19c-5c1afa303f23 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1556 microversion: 2.1 time: 0.158290 Oct 12 23:23:57.711685 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3627/7913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:57 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:57.733426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-28d609b6-d399-4a6e-a06f-ba52d5b06ae9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:57.734076 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-28d609b6-d399-4a6e-a06f-ba52d5b06ae9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:57.735933 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:57.742417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28d609b6-d399-4a6e-a06f-ba52d5b06ae9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:57.742902 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28d609b6-d399-4a6e-a06f-ba52d5b06ae9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:57.743376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28d609b6-d399-4a6e-a06f-ba52d5b06ae9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:57.744070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28d609b6-d399-4a6e-a06f-ba52d5b06ae9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:57.744526 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28d609b6-d399-4a6e-a06f-ba52d5b06ae9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:57.744955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-28d609b6-d399-4a6e-a06f-ba52d5b06ae9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:57.877497 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-28d609b6-d399-4a6e-a06f-ba52d5b06ae9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:57.886043 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-28d609b6-d399-4a6e-a06f-ba52d5b06ae9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1556 microversion: 2.1 time: 0.156501 Oct 12 23:23:57.886628 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4287/7914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:57 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:59.493892 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-402fd0ea-1833-4247-92d0-3793fef8f13c req-0c842429-0a37-442e-913c-0e5d8a25e664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8000e8-aa4d-432c-9897-40fad65ad76e", "tag": "ea36e3b7-df6a-4e9c-87df-47b5d23fb00a"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:23:59.504656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-402fd0ea-1833-4247-92d0-3793fef8f13c req-0c842429-0a37-442e-913c-0e5d8a25e664 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:59.505143 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-402fd0ea-1833-4247-92d0-3793fef8f13c req-0c842429-0a37-442e-913c-0e5d8a25e664 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:59.505586 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-402fd0ea-1833-4247-92d0-3793fef8f13c req-0c842429-0a37-442e-913c-0e5d8a25e664 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:59.517478 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-402fd0ea-1833-4247-92d0-3793fef8f13c req-0c842429-0a37-442e-913c-0e5d8a25e664 service nova] Creating event network-changed:ea36e3b7-df6a-4e9c-87df-47b5d23fb00a for instance 8c8000e8-aa4d-432c-9897-40fad65ad76e on n-h2-861111-1 Oct 12 23:23:59.522648 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-402fd0ea-1833-4247-92d0-3793fef8f13c req-0c842429-0a37-442e-913c-0e5d8a25e664 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032916 Oct 12 23:23:59.523451 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3628/7915] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:26:25.426873 n-d-861111-1 devstack@n-api.service[120453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aee61eb9-c5dd-4991-902f-85ebd1f559fb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 23:26:25.427850 n-d-861111-1 devstack@n-api.service[120453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84ea943b-c2e8-46fe-b7cd-216120f59743] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 23:26:25.428367 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:25.429196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=36 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:25.430112 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:26:25.430290 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 23:26:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e/action (ip 10.222.0.16) !!! Oct 12 23:26:25.431932 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:26:25.432056 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 23:26:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e/action (ip 10.222.0.16) !!! Oct 12 23:26:25.433073 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:26:25.433224 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 23:26:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e/action (ip 10.222.0.16) !!! Oct 12 23:26:25.437960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-1a6bbb83-57a2-48e3-a0e6-b88428c76b3a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:26:25.438492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-1a6bbb83-57a2-48e3-a0e6-b88428c76b3a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:25.450296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a6bbb83-57a2-48e3-a0e6-b88428c76b3a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:25.450782 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a6bbb83-57a2-48e3-a0e6-b88428c76b3a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:25.451220 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a6bbb83-57a2-48e3-a0e6-b88428c76b3a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:25.451932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a6bbb83-57a2-48e3-a0e6-b88428c76b3a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:25.452408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a6bbb83-57a2-48e3-a0e6-b88428c76b3a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:25.452813 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-1a6bbb83-57a2-48e3-a0e6-b88428c76b3a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:25.476738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.objects.instance [None req-1a6bbb83-57a2-48e3-a0e6-b88428c76b3a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lazy-loading 'flavor' on Instance uuid 8c8000e8-aa4d-432c-9897-40fad65ad76e {{(pid=120453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:26:25.661509 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-1a6bbb83-57a2-48e3-a0e6-b88428c76b3a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "POST /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e/action" status: 202 len: 0 microversion: 2.1 time: 0.236470 Oct 12 23:26:25.662122 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4288/7916] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:26:25 2022] POST /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:26:25.669282 n-d-861111-1 devstack@n-api.service[120452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b0df6e00-df54-42f7-81d1-59721b28bd80] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:26:25.670110 n-d-861111-1 devstack@n-api.service[120452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d1e6222c-d1f8-4742-acce-113cd0d666eb] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:26:25.670745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:25.671521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=32 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:25.672954 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:26:25.673107 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 23:26:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e (ip 10.222.0.16) !!! Oct 12 23:26:25.680063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-db900793-683f-41d0-9b48-fd1570f02bae tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:25.681412 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-db900793-683f-41d0-9b48-fd1570f02bae tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:25.693735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db900793-683f-41d0-9b48-fd1570f02bae tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:25.694227 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db900793-683f-41d0-9b48-fd1570f02bae tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:25.694677 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db900793-683f-41d0-9b48-fd1570f02bae tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:25.695993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db900793-683f-41d0-9b48-fd1570f02bae tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:25.695993 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db900793-683f-41d0-9b48-fd1570f02bae tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:25.696382 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db900793-683f-41d0-9b48-fd1570f02bae tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:25.883150 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-db900793-683f-41d0-9b48-fd1570f02bae tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:25.890978 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-db900793-683f-41d0-9b48-fd1570f02bae tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1679 microversion: 2.1 time: 0.223730 Oct 12 23:26:25.891606 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3629/7917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:25 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1679 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:26.919567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4fcf4897-d58c-4940-a3c9-0e79f9e5a4b5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:26.920280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4fcf4897-d58c-4940-a3c9-0e79f9e5a4b5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:26.930336 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4fcf4897-d58c-4940-a3c9-0e79f9e5a4b5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:26.931371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4fcf4897-d58c-4940-a3c9-0e79f9e5a4b5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:26.931818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4fcf4897-d58c-4940-a3c9-0e79f9e5a4b5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:26.932516 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4fcf4897-d58c-4940-a3c9-0e79f9e5a4b5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:26.932972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4fcf4897-d58c-4940-a3c9-0e79f9e5a4b5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:26.933403 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4fcf4897-d58c-4940-a3c9-0e79f9e5a4b5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:26.934100 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] [aee61eb9-c5dd-4991-902f-85ebd1f559fb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40484. Oct 12 23:26:26.934791 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] [84ea943b-c2e8-46fe-b7cd-216120f59743] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40486. Oct 12 23:26:27.068052 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4fcf4897-d58c-4940-a3c9-0e79f9e5a4b5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:27.075888 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4fcf4897-d58c-4940-a3c9-0e79f9e5a4b5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1679 microversion: 2.1 time: 0.164586 Oct 12 23:26:27.076466 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4289/7918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:26 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:28.100008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-61629bdb-db05-47e0-90c9-be8db4c53380 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:28.100640 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-61629bdb-db05-47e0-90c9-be8db4c53380 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:28.110350 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61629bdb-db05-47e0-90c9-be8db4c53380 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:28.110847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61629bdb-db05-47e0-90c9-be8db4c53380 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:28.111330 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61629bdb-db05-47e0-90c9-be8db4c53380 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:28.112038 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61629bdb-db05-47e0-90c9-be8db4c53380 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:28.112505 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61629bdb-db05-47e0-90c9-be8db4c53380 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:28.112942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61629bdb-db05-47e0-90c9-be8db4c53380 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:28.117172 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] [b0df6e00-df54-42f7-81d1-59721b28bd80] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40490. Oct 12 23:26:28.119963 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] [d1e6222c-d1f8-4742-acce-113cd0d666eb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40492. Oct 12 23:26:28.247306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-61629bdb-db05-47e0-90c9-be8db4c53380 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:28.255312 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-61629bdb-db05-47e0-90c9-be8db4c53380 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1679 microversion: 2.1 time: 0.159211 Oct 12 23:26:28.255885 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3630/7919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:28 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:29.279809 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8a21c380-97b1-43de-a5b3-d47a8d77a4c4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:29.280427 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8a21c380-97b1-43de-a5b3-d47a8d77a4c4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:29.287136 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a21c380-97b1-43de-a5b3-d47a8d77a4c4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:29.287645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a21c380-97b1-43de-a5b3-d47a8d77a4c4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:29.288080 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a21c380-97b1-43de-a5b3-d47a8d77a4c4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:29.288762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a21c380-97b1-43de-a5b3-d47a8d77a4c4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:29.289212 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a21c380-97b1-43de-a5b3-d47a8d77a4c4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:29.289635 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8a21c380-97b1-43de-a5b3-d47a8d77a4c4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:29.417226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8a21c380-97b1-43de-a5b3-d47a8d77a4c4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:29.424845 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8a21c380-97b1-43de-a5b3-d47a8d77a4c4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1679 microversion: 2.1 time: 0.148985 Oct 12 23:26:29.425413 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4290/7920] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:29 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:30.447873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-46d9d636-ea05-47a2-9eec-d5bcdeebca8a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:30.448488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-46d9d636-ea05-47a2-9eec-d5bcdeebca8a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:30.455445 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46d9d636-ea05-47a2-9eec-d5bcdeebca8a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:30.455934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46d9d636-ea05-47a2-9eec-d5bcdeebca8a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:30.456376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46d9d636-ea05-47a2-9eec-d5bcdeebca8a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:30.457068 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46d9d636-ea05-47a2-9eec-d5bcdeebca8a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:30.457528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46d9d636-ea05-47a2-9eec-d5bcdeebca8a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:30.457958 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46d9d636-ea05-47a2-9eec-d5bcdeebca8a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:30.587793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-46d9d636-ea05-47a2-9eec-d5bcdeebca8a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:30.595557 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-46d9d636-ea05-47a2-9eec-d5bcdeebca8a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1679 microversion: 2.1 time: 0.151617 Oct 12 23:26:30.596123 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3631/7921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:30 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:31.619487 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c126eee4-903d-4c2a-8e1d-42a3355ba157 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:31.620115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c126eee4-903d-4c2a-8e1d-42a3355ba157 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:31.627007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c126eee4-903d-4c2a-8e1d-42a3355ba157 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:31.627535 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c126eee4-903d-4c2a-8e1d-42a3355ba157 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:31.627984 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c126eee4-903d-4c2a-8e1d-42a3355ba157 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:31.628677 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c126eee4-903d-4c2a-8e1d-42a3355ba157 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:31.629396 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c126eee4-903d-4c2a-8e1d-42a3355ba157 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:31.629827 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c126eee4-903d-4c2a-8e1d-42a3355ba157 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:31.761901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c126eee4-903d-4c2a-8e1d-42a3355ba157 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:31.769894 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c126eee4-903d-4c2a-8e1d-42a3355ba157 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1679 microversion: 2.1 time: 0.154387 Oct 12 23:26:31.770629 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4291/7922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:31 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:32.794747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0a1b7640-c51c-4c59-9c63-1fd328de95ba tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:32.795407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0a1b7640-c51c-4c59-9c63-1fd328de95ba tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:32.802132 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1b7640-c51c-4c59-9c63-1fd328de95ba tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:32.802627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1b7640-c51c-4c59-9c63-1fd328de95ba tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:32.803109 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1b7640-c51c-4c59-9c63-1fd328de95ba tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:32.803837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1b7640-c51c-4c59-9c63-1fd328de95ba tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:32.804300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1b7640-c51c-4c59-9c63-1fd328de95ba tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:32.804737 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1b7640-c51c-4c59-9c63-1fd328de95ba tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:32.936417 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0a1b7640-c51c-4c59-9c63-1fd328de95ba tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:32.944051 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0a1b7640-c51c-4c59-9c63-1fd328de95ba tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1679 microversion: 2.1 time: 0.153956 Oct 12 23:26:32.944613 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3632/7923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:32 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:33.968143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-564e60cb-278b-41d2-aee6-2773aaca2852 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:33.968764 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-564e60cb-278b-41d2-aee6-2773aaca2852 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:33.975660 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564e60cb-278b-41d2-aee6-2773aaca2852 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:33.976139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564e60cb-278b-41d2-aee6-2773aaca2852 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:33.976576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564e60cb-278b-41d2-aee6-2773aaca2852 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:33.977263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564e60cb-278b-41d2-aee6-2773aaca2852 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:33.977716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564e60cb-278b-41d2-aee6-2773aaca2852 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:33.978140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-564e60cb-278b-41d2-aee6-2773aaca2852 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:34.107082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-564e60cb-278b-41d2-aee6-2773aaca2852 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:34.114809 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-564e60cb-278b-41d2-aee6-2773aaca2852 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1679 microversion: 2.1 time: 0.150607 Oct 12 23:26:34.115409 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4292/7924] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:33 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:35.139404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ec9267b6-6518-481e-9a03-b12d033dea1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:35.140029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ec9267b6-6518-481e-9a03-b12d033dea1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:35.146726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec9267b6-6518-481e-9a03-b12d033dea1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:35.147218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec9267b6-6518-481e-9a03-b12d033dea1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:35.147690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec9267b6-6518-481e-9a03-b12d033dea1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:35.148388 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec9267b6-6518-481e-9a03-b12d033dea1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:35.148847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec9267b6-6518-481e-9a03-b12d033dea1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:35.149279 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ec9267b6-6518-481e-9a03-b12d033dea1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:35.278243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ec9267b6-6518-481e-9a03-b12d033dea1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:35.286079 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ec9267b6-6518-481e-9a03-b12d033dea1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1679 microversion: 2.1 time: 0.150637 Oct 12 23:26:35.286663 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3633/7925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:35 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:36.309448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d8b531ac-8a93-40bf-a51c-7a70f4d675f3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:36.310066 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d8b531ac-8a93-40bf-a51c-7a70f4d675f3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:36.316998 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8b531ac-8a93-40bf-a51c-7a70f4d675f3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:36.317482 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8b531ac-8a93-40bf-a51c-7a70f4d675f3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:36.317921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8b531ac-8a93-40bf-a51c-7a70f4d675f3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:36.318614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8b531ac-8a93-40bf-a51c-7a70f4d675f3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:36.319069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8b531ac-8a93-40bf-a51c-7a70f4d675f3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:36.319519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d8b531ac-8a93-40bf-a51c-7a70f4d675f3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:36.452931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d8b531ac-8a93-40bf-a51c-7a70f4d675f3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:36.460663 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d8b531ac-8a93-40bf-a51c-7a70f4d675f3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1679 microversion: 2.1 time: 0.155090 Oct 12 23:26:36.461234 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4293/7926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:36 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:37.483766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d5f28870-d638-491f-b2c9-2c1309301109 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:37.484400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d5f28870-d638-491f-b2c9-2c1309301109 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:37.491306 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5f28870-d638-491f-b2c9-2c1309301109 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:37.491802 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5f28870-d638-491f-b2c9-2c1309301109 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:37.492252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5f28870-d638-491f-b2c9-2c1309301109 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:37.492956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5f28870-d638-491f-b2c9-2c1309301109 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:37.493421 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5f28870-d638-491f-b2c9-2c1309301109 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:37.493859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5f28870-d638-491f-b2c9-2c1309301109 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:37.627362 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d5f28870-d638-491f-b2c9-2c1309301109 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:37.635924 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d5f28870-d638-491f-b2c9-2c1309301109 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1700 microversion: 2.1 time: 0.156071 Oct 12 23:26:37.636494 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3634/7927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:37 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:38.659511 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2ddbb756-2cf2-4449-be0c-20b24bb38c4c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:38.660097 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2ddbb756-2cf2-4449-be0c-20b24bb38c4c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:38.667152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ddbb756-2cf2-4449-be0c-20b24bb38c4c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:38.667673 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ddbb756-2cf2-4449-be0c-20b24bb38c4c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:38.668118 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ddbb756-2cf2-4449-be0c-20b24bb38c4c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:38.668822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ddbb756-2cf2-4449-be0c-20b24bb38c4c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:38.669282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ddbb756-2cf2-4449-be0c-20b24bb38c4c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:38.669714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ddbb756-2cf2-4449-be0c-20b24bb38c4c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:38.811779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2ddbb756-2cf2-4449-be0c-20b24bb38c4c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:38.819563 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2ddbb756-2cf2-4449-be0c-20b24bb38c4c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1700 microversion: 2.1 time: 0.164029 Oct 12 23:26:38.820151 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4294/7928] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:38 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1700 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:26:39.844682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f11b5a93-55d8-479f-b828-89b547579e5d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:39.845311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f11b5a93-55d8-479f-b828-89b547579e5d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:39.852123 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f11b5a93-55d8-479f-b828-89b547579e5d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:39.852620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f11b5a93-55d8-479f-b828-89b547579e5d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:39.853071 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f11b5a93-55d8-479f-b828-89b547579e5d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:39.853777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f11b5a93-55d8-479f-b828-89b547579e5d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:39.854243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f11b5a93-55d8-479f-b828-89b547579e5d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:39.854686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f11b5a93-55d8-479f-b828-89b547579e5d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:39.988311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-f11b5a93-55d8-479f-b828-89b547579e5d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:39.996798 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f11b5a93-55d8-479f-b828-89b547579e5d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1700 microversion: 2.1 time: 0.156099 Oct 12 23:26:39.997382 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3635/7929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:39 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:40.678278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-cd1e1201-cdcf-4f20-9c7a-968bb7c7f2b6 req-c5b72f85-e623-425d-8c10-49512aa1fd74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8000e8-aa4d-432c-9897-40fad65ad76e", "name": "network-vif-plugged", "status": "completed", "tag": "ea36e3b7-df6a-4e9c-87df-47b5d23fb00a"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:26:40.690223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cd1e1201-cdcf-4f20-9c7a-968bb7c7f2b6 req-c5b72f85-e623-425d-8c10-49512aa1fd74 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:40.690703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cd1e1201-cdcf-4f20-9c7a-968bb7c7f2b6 req-c5b72f85-e623-425d-8c10-49512aa1fd74 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:40.691138 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-cd1e1201-cdcf-4f20-9c7a-968bb7c7f2b6 req-c5b72f85-e623-425d-8c10-49512aa1fd74 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:40.702188 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-cd1e1201-cdcf-4f20-9c7a-968bb7c7f2b6 req-c5b72f85-e623-425d-8c10-49512aa1fd74 service nova] Creating event network-vif-plugged:ea36e3b7-df6a-4e9c-87df-47b5d23fb00a for instance 8c8000e8-aa4d-432c-9897-40fad65ad76e on n-h2-861111-1 Oct 12 23:26:40.707472 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-cd1e1201-cdcf-4f20-9c7a-968bb7c7f2b6 req-c5b72f85-e623-425d-8c10-49512aa1fd74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032872 Oct 12 23:26:40.708195 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4295/7930] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:26:41.020612 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2154775e-96a8-462f-82a8-6408a8bb6ed9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:41.021244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2154775e-96a8-462f-82a8-6408a8bb6ed9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:41.028566 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2154775e-96a8-462f-82a8-6408a8bb6ed9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:41.029063 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2154775e-96a8-462f-82a8-6408a8bb6ed9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:41.029515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2154775e-96a8-462f-82a8-6408a8bb6ed9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:41.030222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2154775e-96a8-462f-82a8-6408a8bb6ed9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:41.030685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2154775e-96a8-462f-82a8-6408a8bb6ed9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:41.031124 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2154775e-96a8-462f-82a8-6408a8bb6ed9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:41.163839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-2154775e-96a8-462f-82a8-6408a8bb6ed9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:41.171540 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2154775e-96a8-462f-82a8-6408a8bb6ed9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1695 microversion: 2.1 time: 0.154872 Oct 12 23:26:41.172123 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3636/7931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:41 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:42.197676 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-c6ba5c14-b2ff-4e69-9175-749b89e284da tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:42.198556 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-c6ba5c14-b2ff-4e69-9175-749b89e284da tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:42.209503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6ba5c14-b2ff-4e69-9175-749b89e284da tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:42.210294 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6ba5c14-b2ff-4e69-9175-749b89e284da tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:42.210916 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6ba5c14-b2ff-4e69-9175-749b89e284da tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:42.211550 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6ba5c14-b2ff-4e69-9175-749b89e284da tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:42.212173 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6ba5c14-b2ff-4e69-9175-749b89e284da tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:42.213462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-c6ba5c14-b2ff-4e69-9175-749b89e284da tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:42.368716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-c6ba5c14-b2ff-4e69-9175-749b89e284da tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:42.378111 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-c6ba5c14-b2ff-4e69-9175-749b89e284da tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1695 microversion: 2.1 time: 0.186396 Oct 12 23:26:42.378857 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4296/7932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:42 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:43.402283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-89b93faa-a51f-4c3b-8d1e-1bd8454cc91b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:43.402848 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-89b93faa-a51f-4c3b-8d1e-1bd8454cc91b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:43.410121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89b93faa-a51f-4c3b-8d1e-1bd8454cc91b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:43.410731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89b93faa-a51f-4c3b-8d1e-1bd8454cc91b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:43.411312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89b93faa-a51f-4c3b-8d1e-1bd8454cc91b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:43.412231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89b93faa-a51f-4c3b-8d1e-1bd8454cc91b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:43.412953 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89b93faa-a51f-4c3b-8d1e-1bd8454cc91b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:43.413469 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-89b93faa-a51f-4c3b-8d1e-1bd8454cc91b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:43.559685 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-89b93faa-a51f-4c3b-8d1e-1bd8454cc91b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:43.568404 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-89b93faa-a51f-4c3b-8d1e-1bd8454cc91b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1695 microversion: 2.1 time: 0.170297 Oct 12 23:26:43.569397 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3637/7933] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:43 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:44.593703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-35c9e70f-2d16-4a60-a8b0-c49157551593 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:44.595079 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-35c9e70f-2d16-4a60-a8b0-c49157551593 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:44.601917 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35c9e70f-2d16-4a60-a8b0-c49157551593 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:44.602443 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35c9e70f-2d16-4a60-a8b0-c49157551593 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:44.603039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35c9e70f-2d16-4a60-a8b0-c49157551593 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:44.604477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35c9e70f-2d16-4a60-a8b0-c49157551593 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:44.605183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35c9e70f-2d16-4a60-a8b0-c49157551593 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:44.605710 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-35c9e70f-2d16-4a60-a8b0-c49157551593 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:44.753529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-35c9e70f-2d16-4a60-a8b0-c49157551593 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:44.766439 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-35c9e70f-2d16-4a60-a8b0-c49157551593 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1695 microversion: 2.1 time: 0.176659 Oct 12 23:26:44.767794 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4297/7934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:44 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:45.791263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-711bdde6-e69a-4f24-8fb7-5e23e9c1d1ac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:45.792509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-711bdde6-e69a-4f24-8fb7-5e23e9c1d1ac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:45.799978 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-711bdde6-e69a-4f24-8fb7-5e23e9c1d1ac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:45.800734 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-711bdde6-e69a-4f24-8fb7-5e23e9c1d1ac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:45.801182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-711bdde6-e69a-4f24-8fb7-5e23e9c1d1ac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:45.802081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-711bdde6-e69a-4f24-8fb7-5e23e9c1d1ac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:45.802546 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-711bdde6-e69a-4f24-8fb7-5e23e9c1d1ac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:45.802985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-711bdde6-e69a-4f24-8fb7-5e23e9c1d1ac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:45.950768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-711bdde6-e69a-4f24-8fb7-5e23e9c1d1ac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:45.959576 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-711bdde6-e69a-4f24-8fb7-5e23e9c1d1ac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1695 microversion: 2.1 time: 0.172209 Oct 12 23:26:45.960169 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3638/7935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:45 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:46.987672 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bb4957d6-c8e9-49cd-add6-be28fb134183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:46.989189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bb4957d6-c8e9-49cd-add6-be28fb134183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:46.996587 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb4957d6-c8e9-49cd-add6-be28fb134183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:46.997306 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb4957d6-c8e9-49cd-add6-be28fb134183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:46.997986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb4957d6-c8e9-49cd-add6-be28fb134183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:46.998819 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb4957d6-c8e9-49cd-add6-be28fb134183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:46.999505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb4957d6-c8e9-49cd-add6-be28fb134183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:47.000171 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bb4957d6-c8e9-49cd-add6-be28fb134183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:47.143115 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bb4957d6-c8e9-49cd-add6-be28fb134183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:47.151999 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bb4957d6-c8e9-49cd-add6-be28fb134183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1695 microversion: 2.1 time: 0.168258 Oct 12 23:26:47.166215 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4298/7936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:46 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:48.177129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-30bf2b75-8f1b-4af9-a528-9f4883840d1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:48.178488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-30bf2b75-8f1b-4af9-a528-9f4883840d1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:48.186009 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30bf2b75-8f1b-4af9-a528-9f4883840d1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:48.186861 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30bf2b75-8f1b-4af9-a528-9f4883840d1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:48.187596 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30bf2b75-8f1b-4af9-a528-9f4883840d1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:48.188316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30bf2b75-8f1b-4af9-a528-9f4883840d1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:48.188786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30bf2b75-8f1b-4af9-a528-9f4883840d1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:48.189225 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30bf2b75-8f1b-4af9-a528-9f4883840d1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:48.334692 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-30bf2b75-8f1b-4af9-a528-9f4883840d1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:48.343832 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-30bf2b75-8f1b-4af9-a528-9f4883840d1b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1695 microversion: 2.1 time: 0.170547 Oct 12 23:26:48.359756 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3639/7937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:48 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1695 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:49.370378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-97ec9d3c-acb9-4ada-8831-59a6ba8c81f4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:49.371191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-97ec9d3c-acb9-4ada-8831-59a6ba8c81f4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:49.378026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97ec9d3c-acb9-4ada-8831-59a6ba8c81f4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:49.378512 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97ec9d3c-acb9-4ada-8831-59a6ba8c81f4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:49.379206 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97ec9d3c-acb9-4ada-8831-59a6ba8c81f4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:49.379936 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97ec9d3c-acb9-4ada-8831-59a6ba8c81f4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:49.380418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97ec9d3c-acb9-4ada-8831-59a6ba8c81f4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:49.380847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97ec9d3c-acb9-4ada-8831-59a6ba8c81f4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:49.523975 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-97ec9d3c-acb9-4ada-8831-59a6ba8c81f4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:49.532379 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-97ec9d3c-acb9-4ada-8831-59a6ba8c81f4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1695 microversion: 2.1 time: 0.166157 Oct 12 23:26:49.533210 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4299/7938] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:49 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:50.556079 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0daa1c66-d824-455e-8886-860f9e657183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:50.556736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0daa1c66-d824-455e-8886-860f9e657183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:50.563512 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0daa1c66-d824-455e-8886-860f9e657183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:50.564004 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0daa1c66-d824-455e-8886-860f9e657183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:50.564448 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0daa1c66-d824-455e-8886-860f9e657183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:50.565154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0daa1c66-d824-455e-8886-860f9e657183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:50.565613 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0daa1c66-d824-455e-8886-860f9e657183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:50.566047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0daa1c66-d824-455e-8886-860f9e657183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:50.695212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-0daa1c66-d824-455e-8886-860f9e657183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:50.703629 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0daa1c66-d824-455e-8886-860f9e657183 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1695 microversion: 2.1 time: 0.151420 Oct 12 23:26:50.704195 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3640/7939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:50 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:51.726987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-14081139-b2c2-4de8-9770-5364bb709d6f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:51.727645 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-14081139-b2c2-4de8-9770-5364bb709d6f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:51.734873 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14081139-b2c2-4de8-9770-5364bb709d6f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:51.735462 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14081139-b2c2-4de8-9770-5364bb709d6f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:51.735908 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14081139-b2c2-4de8-9770-5364bb709d6f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:51.736601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14081139-b2c2-4de8-9770-5364bb709d6f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:51.737060 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14081139-b2c2-4de8-9770-5364bb709d6f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:51.737490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-14081139-b2c2-4de8-9770-5364bb709d6f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:51.870083 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-14081139-b2c2-4de8-9770-5364bb709d6f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:51.877892 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-14081139-b2c2-4de8-9770-5364bb709d6f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1677 microversion: 2.1 time: 0.154773 Oct 12 23:26:51.878461 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4300/7940] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:51 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:52.902040 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1d0ba040-eabf-4491-b926-1c2015bf9ddd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:52.902597 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1d0ba040-eabf-4491-b926-1c2015bf9ddd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:52.909374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d0ba040-eabf-4491-b926-1c2015bf9ddd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:52.909859 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d0ba040-eabf-4491-b926-1c2015bf9ddd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:52.910303 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d0ba040-eabf-4491-b926-1c2015bf9ddd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:52.910998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d0ba040-eabf-4491-b926-1c2015bf9ddd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:52.911492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d0ba040-eabf-4491-b926-1c2015bf9ddd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:52.911950 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1d0ba040-eabf-4491-b926-1c2015bf9ddd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:53.048296 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1d0ba040-eabf-4491-b926-1c2015bf9ddd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:53.056787 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1d0ba040-eabf-4491-b926-1c2015bf9ddd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1677 microversion: 2.1 time: 0.158173 Oct 12 23:26:53.057376 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3641/7941] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:52 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:54.081421 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e200e0d0-3721-4c67-a3c2-88621e68526a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:54.082034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e200e0d0-3721-4c67-a3c2-88621e68526a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:54.088883 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e200e0d0-3721-4c67-a3c2-88621e68526a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:54.089359 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e200e0d0-3721-4c67-a3c2-88621e68526a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:54.089796 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e200e0d0-3721-4c67-a3c2-88621e68526a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:54.090475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e200e0d0-3721-4c67-a3c2-88621e68526a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:54.090925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e200e0d0-3721-4c67-a3c2-88621e68526a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:54.091372 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e200e0d0-3721-4c67-a3c2-88621e68526a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:54.218189 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e200e0d0-3721-4c67-a3c2-88621e68526a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:54.225848 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e200e0d0-3721-4c67-a3c2-88621e68526a tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1620 microversion: 2.1 time: 0.148330 Oct 12 23:26:54.226416 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4301/7942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:54 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1620 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:54.249579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3df31310-e825-489d-b5f6-702526f51eb7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:26:54.250185 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3df31310-e825-489d-b5f6-702526f51eb7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:54.257154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3df31310-e825-489d-b5f6-702526f51eb7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:54.257644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3df31310-e825-489d-b5f6-702526f51eb7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:54.258090 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3df31310-e825-489d-b5f6-702526f51eb7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:54.258785 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3df31310-e825-489d-b5f6-702526f51eb7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:54.259315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3df31310-e825-489d-b5f6-702526f51eb7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:54.259748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3df31310-e825-489d-b5f6-702526f51eb7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:54.299551 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3df31310-e825-489d-b5f6-702526f51eb7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120452) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 23:26:54.363506 n-d-861111-1 devstack@n-api.service[120452]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3df31310-e825-489d-b5f6-702526f51eb7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [3f43aec9-e4e3-4d70-83f1-ac7aeaf3512f] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:26:54.715070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-c980ea8c-3545-4087-9855-08ad78b32008 req-da2f9aa8-d941-41f5-acb9-4ab42252f621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8000e8-aa4d-432c-9897-40fad65ad76e", "name": "network-vif-unplugged", "status": "completed", "tag": "ea36e3b7-df6a-4e9c-87df-47b5d23fb00a"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:26:54.725651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c980ea8c-3545-4087-9855-08ad78b32008 req-da2f9aa8-d941-41f5-acb9-4ab42252f621 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:54.727049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c980ea8c-3545-4087-9855-08ad78b32008 req-da2f9aa8-d941-41f5-acb9-4ab42252f621 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:54.727525 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c980ea8c-3545-4087-9855-08ad78b32008 req-da2f9aa8-d941-41f5-acb9-4ab42252f621 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:54.739486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.compute.server_external_events [req-c980ea8c-3545-4087-9855-08ad78b32008 req-da2f9aa8-d941-41f5-acb9-4ab42252f621 service nova] Unable to find a host for instance 8c8000e8-aa4d-432c-9897-40fad65ad76e. Dropping event network-vif-unplugged {{(pid=120453) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 12 23:26:54.740375 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-c980ea8c-3545-4087-9855-08ad78b32008 req-da2f9aa8-d941-41f5-acb9-4ab42252f621 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029236 Oct 12 23:26:54.740965 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4302/7943] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 12 23:26:55.370550 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [None req-3df31310-e825-489d-b5f6-702526f51eb7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [3f43aec9-e4e3-4d70-83f1-ac7aeaf3512f] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40600. Oct 12 23:26:55.373795 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3df31310-e825-489d-b5f6-702526f51eb7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "POST /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e/action" status: 202 len: 0 microversion: 2.1 time: 1.128148 Oct 12 23:26:55.374506 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3642/7944] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:26:54 2022] POST /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e/action => generated 0 bytes in 1129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:26:55.383063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2b1126ce-12ef-4698-9039-eb0a009dc35d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:55.383850 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2b1126ce-12ef-4698-9039-eb0a009dc35d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:55.391332 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b1126ce-12ef-4698-9039-eb0a009dc35d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:55.391820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b1126ce-12ef-4698-9039-eb0a009dc35d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:55.392259 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b1126ce-12ef-4698-9039-eb0a009dc35d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:55.392961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b1126ce-12ef-4698-9039-eb0a009dc35d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:55.393415 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b1126ce-12ef-4698-9039-eb0a009dc35d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:55.393879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2b1126ce-12ef-4698-9039-eb0a009dc35d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:55.530859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2b1126ce-12ef-4698-9039-eb0a009dc35d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:55.533238 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:55.540927 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2b1126ce-12ef-4698-9039-eb0a009dc35d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1628 microversion: 2.1 time: 0.161629 Oct 12 23:26:55.541508 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4303/7945] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:55 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1628 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:26:56.565930 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5ce01a0f-9f92-4e13-a50d-10eeeafe2260 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:56.566581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5ce01a0f-9f92-4e13-a50d-10eeeafe2260 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:56.568464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:56.575728 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ce01a0f-9f92-4e13-a50d-10eeeafe2260 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:56.576236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ce01a0f-9f92-4e13-a50d-10eeeafe2260 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:56.576693 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ce01a0f-9f92-4e13-a50d-10eeeafe2260 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:56.577440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ce01a0f-9f92-4e13-a50d-10eeeafe2260 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:56.577913 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ce01a0f-9f92-4e13-a50d-10eeeafe2260 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:56.578357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ce01a0f-9f92-4e13-a50d-10eeeafe2260 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:56.582895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:56.713943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5ce01a0f-9f92-4e13-a50d-10eeeafe2260 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:56.721903 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5ce01a0f-9f92-4e13-a50d-10eeeafe2260 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.160649 Oct 12 23:26:56.722474 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3643/7946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:56 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:57.746139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9f6f4bbd-5b98-40c7-a3ef-a67dbee8917e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:57.747589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9f6f4bbd-5b98-40c7-a3ef-a67dbee8917e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:57.751395 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=33 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:57.757934 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f6f4bbd-5b98-40c7-a3ef-a67dbee8917e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:57.758795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f6f4bbd-5b98-40c7-a3ef-a67dbee8917e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:57.760475 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f6f4bbd-5b98-40c7-a3ef-a67dbee8917e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:57.761608 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f6f4bbd-5b98-40c7-a3ef-a67dbee8917e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:57.762249 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f6f4bbd-5b98-40c7-a3ef-a67dbee8917e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:57.762841 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f6f4bbd-5b98-40c7-a3ef-a67dbee8917e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:57.907158 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9f6f4bbd-5b98-40c7-a3ef-a67dbee8917e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:57.915781 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9f6f4bbd-5b98-40c7-a3ef-a67dbee8917e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.173984 Oct 12 23:26:57.916572 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4304/7947] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:57 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:58.941243 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e753b8ba-3304-4395-8411-d7c2f7c1d7e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:58.941864 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e753b8ba-3304-4395-8411-d7c2f7c1d7e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:58.948438 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e753b8ba-3304-4395-8411-d7c2f7c1d7e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:58.948945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e753b8ba-3304-4395-8411-d7c2f7c1d7e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:58.949405 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e753b8ba-3304-4395-8411-d7c2f7c1d7e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:58.950125 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e753b8ba-3304-4395-8411-d7c2f7c1d7e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:58.950594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e753b8ba-3304-4395-8411-d7c2f7c1d7e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:58.951046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e753b8ba-3304-4395-8411-d7c2f7c1d7e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:59.086437 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-e753b8ba-3304-4395-8411-d7c2f7c1d7e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:59.094966 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e753b8ba-3304-4395-8411-d7c2f7c1d7e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.157671 Oct 12 23:26:59.095804 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3644/7948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:58 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:00.121154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d6acd416-636c-440d-b17a-fdcfb8020cac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:00.121971 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d6acd416-636c-440d-b17a-fdcfb8020cac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:00.129973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6acd416-636c-440d-b17a-fdcfb8020cac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:00.130471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6acd416-636c-440d-b17a-fdcfb8020cac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:00.130906 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6acd416-636c-440d-b17a-fdcfb8020cac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:00.131887 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6acd416-636c-440d-b17a-fdcfb8020cac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:00.132342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6acd416-636c-440d-b17a-fdcfb8020cac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:00.132759 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d6acd416-636c-440d-b17a-fdcfb8020cac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:00.271920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d6acd416-636c-440d-b17a-fdcfb8020cac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:00.280618 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d6acd416-636c-440d-b17a-fdcfb8020cac tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.163892 Oct 12 23:27:00.281668 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4305/7949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:00 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:01.304679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c814e5f3-bd18-48bc-8b51-54158b15ab24 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:01.305315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c814e5f3-bd18-48bc-8b51-54158b15ab24 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:01.312732 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c814e5f3-bd18-48bc-8b51-54158b15ab24 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:01.313233 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c814e5f3-bd18-48bc-8b51-54158b15ab24 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:01.313687 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c814e5f3-bd18-48bc-8b51-54158b15ab24 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:01.314400 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c814e5f3-bd18-48bc-8b51-54158b15ab24 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:01.314875 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c814e5f3-bd18-48bc-8b51-54158b15ab24 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:01.315351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c814e5f3-bd18-48bc-8b51-54158b15ab24 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:01.458739 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c814e5f3-bd18-48bc-8b51-54158b15ab24 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:01.466869 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c814e5f3-bd18-48bc-8b51-54158b15ab24 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.166080 Oct 12 23:27:01.467700 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3645/7950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:01 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:02.491410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-245376ec-2418-4b19-9a14-e5d265f2a845 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:02.492208 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-245376ec-2418-4b19-9a14-e5d265f2a845 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:02.499914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-245376ec-2418-4b19-9a14-e5d265f2a845 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:02.500407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-245376ec-2418-4b19-9a14-e5d265f2a845 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:02.500997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-245376ec-2418-4b19-9a14-e5d265f2a845 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:02.501701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-245376ec-2418-4b19-9a14-e5d265f2a845 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:02.502175 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-245376ec-2418-4b19-9a14-e5d265f2a845 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:02.502799 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-245376ec-2418-4b19-9a14-e5d265f2a845 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:02.650007 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-245376ec-2418-4b19-9a14-e5d265f2a845 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:02.658176 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-245376ec-2418-4b19-9a14-e5d265f2a845 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.170660 Oct 12 23:27:02.675431 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4306/7951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:02 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:03.683765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dede2462-47e2-413d-9595-cfc3b273e5fb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:03.684562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dede2462-47e2-413d-9595-cfc3b273e5fb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:03.691878 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dede2462-47e2-413d-9595-cfc3b273e5fb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:03.692372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dede2462-47e2-413d-9595-cfc3b273e5fb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:03.692837 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dede2462-47e2-413d-9595-cfc3b273e5fb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:03.693550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dede2462-47e2-413d-9595-cfc3b273e5fb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:03.694010 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dede2462-47e2-413d-9595-cfc3b273e5fb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:03.694472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dede2462-47e2-413d-9595-cfc3b273e5fb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:03.838450 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dede2462-47e2-413d-9595-cfc3b273e5fb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:03.846308 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dede2462-47e2-413d-9595-cfc3b273e5fb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.166997 Oct 12 23:27:03.847044 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3646/7952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:03 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:04.869990 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d320fef1-a6ce-4712-b028-a5bdf7438cf2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:04.870795 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d320fef1-a6ce-4712-b028-a5bdf7438cf2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:04.878150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d320fef1-a6ce-4712-b028-a5bdf7438cf2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:04.878729 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d320fef1-a6ce-4712-b028-a5bdf7438cf2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:04.879523 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d320fef1-a6ce-4712-b028-a5bdf7438cf2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:04.880402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d320fef1-a6ce-4712-b028-a5bdf7438cf2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:04.880932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d320fef1-a6ce-4712-b028-a5bdf7438cf2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:04.881505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d320fef1-a6ce-4712-b028-a5bdf7438cf2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:05.027979 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d320fef1-a6ce-4712-b028-a5bdf7438cf2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:05.039521 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d320fef1-a6ce-4712-b028-a5bdf7438cf2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.173538 Oct 12 23:27:05.040901 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4307/7953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:04 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:06.064529 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c10f8626-9d53-4f04-b693-42725f92070e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:06.065153 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c10f8626-9d53-4f04-b693-42725f92070e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:06.071919 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c10f8626-9d53-4f04-b693-42725f92070e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:06.072418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c10f8626-9d53-4f04-b693-42725f92070e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:06.072862 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c10f8626-9d53-4f04-b693-42725f92070e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:06.073556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c10f8626-9d53-4f04-b693-42725f92070e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:06.074017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c10f8626-9d53-4f04-b693-42725f92070e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:06.074451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c10f8626-9d53-4f04-b693-42725f92070e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:06.210230 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c10f8626-9d53-4f04-b693-42725f92070e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:06.217993 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c10f8626-9d53-4f04-b693-42725f92070e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.157379 Oct 12 23:27:06.218563 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3647/7954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:06 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:07.241402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-375b17fc-6371-412b-8a0c-8829a2d16a1c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:07.242025 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-375b17fc-6371-412b-8a0c-8829a2d16a1c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:07.249484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-375b17fc-6371-412b-8a0c-8829a2d16a1c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:07.249976 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-375b17fc-6371-412b-8a0c-8829a2d16a1c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:07.250414 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-375b17fc-6371-412b-8a0c-8829a2d16a1c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:07.251105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-375b17fc-6371-412b-8a0c-8829a2d16a1c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:07.251596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-375b17fc-6371-412b-8a0c-8829a2d16a1c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:07.252028 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-375b17fc-6371-412b-8a0c-8829a2d16a1c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:07.387622 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-375b17fc-6371-412b-8a0c-8829a2d16a1c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:07.395402 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-375b17fc-6371-412b-8a0c-8829a2d16a1c tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.157889 Oct 12 23:27:07.395999 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4308/7955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:07 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:08.418521 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-241fa928-23a0-455d-82bb-2c2f63e7ec87 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:08.419154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-241fa928-23a0-455d-82bb-2c2f63e7ec87 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:08.425972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-241fa928-23a0-455d-82bb-2c2f63e7ec87 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:08.426504 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-241fa928-23a0-455d-82bb-2c2f63e7ec87 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:08.426962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-241fa928-23a0-455d-82bb-2c2f63e7ec87 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:08.427708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-241fa928-23a0-455d-82bb-2c2f63e7ec87 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:08.428178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-241fa928-23a0-455d-82bb-2c2f63e7ec87 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:08.428620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-241fa928-23a0-455d-82bb-2c2f63e7ec87 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:08.558872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-241fa928-23a0-455d-82bb-2c2f63e7ec87 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:08.566834 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-241fa928-23a0-455d-82bb-2c2f63e7ec87 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.152233 Oct 12 23:27:08.567445 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3648/7956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:08 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:09.592464 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5c659566-a802-440b-9c33-c6b3619163e7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:09.593104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5c659566-a802-440b-9c33-c6b3619163e7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:09.599198 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c659566-a802-440b-9c33-c6b3619163e7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:09.599713 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c659566-a802-440b-9c33-c6b3619163e7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:09.600153 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c659566-a802-440b-9c33-c6b3619163e7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:09.600855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c659566-a802-440b-9c33-c6b3619163e7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:09.601309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c659566-a802-440b-9c33-c6b3619163e7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:09.601734 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5c659566-a802-440b-9c33-c6b3619163e7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:09.750986 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5c659566-a802-440b-9c33-c6b3619163e7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:09.759121 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5c659566-a802-440b-9c33-c6b3619163e7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.172494 Oct 12 23:27:09.759932 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4309/7957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:09 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:10.783309 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7b074caf-4a67-4a8c-9763-74e83beb887e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:10.783942 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7b074caf-4a67-4a8c-9763-74e83beb887e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:10.790814 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b074caf-4a67-4a8c-9763-74e83beb887e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:10.791340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b074caf-4a67-4a8c-9763-74e83beb887e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:10.791791 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b074caf-4a67-4a8c-9763-74e83beb887e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:10.792490 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b074caf-4a67-4a8c-9763-74e83beb887e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:10.792956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b074caf-4a67-4a8c-9763-74e83beb887e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:10.793391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b074caf-4a67-4a8c-9763-74e83beb887e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:10.925714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7b074caf-4a67-4a8c-9763-74e83beb887e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:10.933744 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7b074caf-4a67-4a8c-9763-74e83beb887e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.154369 Oct 12 23:27:10.934315 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3649/7958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:10 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:11.957038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f8d87133-c2bf-45f9-8ba4-32772e7851be tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:11.957653 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f8d87133-c2bf-45f9-8ba4-32772e7851be tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:11.964944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8d87133-c2bf-45f9-8ba4-32772e7851be tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:11.965514 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8d87133-c2bf-45f9-8ba4-32772e7851be tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:11.965962 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8d87133-c2bf-45f9-8ba4-32772e7851be tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:11.966671 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8d87133-c2bf-45f9-8ba4-32772e7851be tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:11.967119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8d87133-c2bf-45f9-8ba4-32772e7851be tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:11.967579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f8d87133-c2bf-45f9-8ba4-32772e7851be tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:12.179154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f8d87133-c2bf-45f9-8ba4-32772e7851be tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:12.187598 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f8d87133-c2bf-45f9-8ba4-32772e7851be tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.234358 Oct 12 23:27:12.188123 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4310/7959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:11 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:13.211507 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b41f580c-6f31-4837-9a9a-ee97d880a64e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:13.212065 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b41f580c-6f31-4837-9a9a-ee97d880a64e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:13.218818 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b41f580c-6f31-4837-9a9a-ee97d880a64e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:13.219351 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b41f580c-6f31-4837-9a9a-ee97d880a64e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:13.219804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b41f580c-6f31-4837-9a9a-ee97d880a64e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:13.220506 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b41f580c-6f31-4837-9a9a-ee97d880a64e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:13.220972 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b41f580c-6f31-4837-9a9a-ee97d880a64e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:13.221415 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b41f580c-6f31-4837-9a9a-ee97d880a64e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:13.351021 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b41f580c-6f31-4837-9a9a-ee97d880a64e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:13.358777 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b41f580c-6f31-4837-9a9a-ee97d880a64e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.151301 Oct 12 23:27:13.359368 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3650/7960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:13 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:14.382159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4ca3b4ce-2fee-4610-a44d-9dfe64c5255e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:14.382776 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4ca3b4ce-2fee-4610-a44d-9dfe64c5255e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:14.389652 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ca3b4ce-2fee-4610-a44d-9dfe64c5255e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:14.390132 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ca3b4ce-2fee-4610-a44d-9dfe64c5255e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:14.390565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ca3b4ce-2fee-4610-a44d-9dfe64c5255e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:14.391262 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ca3b4ce-2fee-4610-a44d-9dfe64c5255e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:14.391716 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ca3b4ce-2fee-4610-a44d-9dfe64c5255e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:14.392143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4ca3b4ce-2fee-4610-a44d-9dfe64c5255e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:14.520679 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4ca3b4ce-2fee-4610-a44d-9dfe64c5255e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:14.528856 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4ca3b4ce-2fee-4610-a44d-9dfe64c5255e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.150899 Oct 12 23:27:14.529426 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4311/7961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:14 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:15.551912 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cfa4cad2-fb5a-45e4-b6e6-5e708911536f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:15.552568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cfa4cad2-fb5a-45e4-b6e6-5e708911536f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:15.559559 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfa4cad2-fb5a-45e4-b6e6-5e708911536f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:15.560061 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfa4cad2-fb5a-45e4-b6e6-5e708911536f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:15.560511 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfa4cad2-fb5a-45e4-b6e6-5e708911536f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:15.561218 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfa4cad2-fb5a-45e4-b6e6-5e708911536f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:15.561683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfa4cad2-fb5a-45e4-b6e6-5e708911536f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:15.562122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cfa4cad2-fb5a-45e4-b6e6-5e708911536f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:15.694311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cfa4cad2-fb5a-45e4-b6e6-5e708911536f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:15.704081 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cfa4cad2-fb5a-45e4-b6e6-5e708911536f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.155955 Oct 12 23:27:15.704669 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3651/7962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:15 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:16.729997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e545d860-9f4c-4889-8215-5a7bcb908fd0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:16.730612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e545d860-9f4c-4889-8215-5a7bcb908fd0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:16.737417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e545d860-9f4c-4889-8215-5a7bcb908fd0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:16.737921 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e545d860-9f4c-4889-8215-5a7bcb908fd0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:16.738358 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e545d860-9f4c-4889-8215-5a7bcb908fd0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:16.739043 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e545d860-9f4c-4889-8215-5a7bcb908fd0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:16.739524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e545d860-9f4c-4889-8215-5a7bcb908fd0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:16.739947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e545d860-9f4c-4889-8215-5a7bcb908fd0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:16.878571 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e545d860-9f4c-4889-8215-5a7bcb908fd0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:16.887897 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e545d860-9f4c-4889-8215-5a7bcb908fd0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.161078 Oct 12 23:27:16.888530 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4312/7963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:16 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:17.007076 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-ab942c7e-9b22-4a18-b551-078f834dfed1 req-c5e12dff-fba8-4f22-915c-f1bbb1831bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8000e8-aa4d-432c-9897-40fad65ad76e", "name": "network-vif-plugged", "status": "completed", "tag": "ea36e3b7-df6a-4e9c-87df-47b5d23fb00a"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:27:17.020670 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ab942c7e-9b22-4a18-b551-078f834dfed1 req-c5e12dff-fba8-4f22-915c-f1bbb1831bbb service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:17.021430 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ab942c7e-9b22-4a18-b551-078f834dfed1 req-c5e12dff-fba8-4f22-915c-f1bbb1831bbb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:17.022096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ab942c7e-9b22-4a18-b551-078f834dfed1 req-c5e12dff-fba8-4f22-915c-f1bbb1831bbb service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:17.033568 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-ab942c7e-9b22-4a18-b551-078f834dfed1 req-c5e12dff-fba8-4f22-915c-f1bbb1831bbb service nova] Creating event network-vif-plugged:ea36e3b7-df6a-4e9c-87df-47b5d23fb00a for instance 8c8000e8-aa4d-432c-9897-40fad65ad76e on n-h2-861111-1 Oct 12 23:27:17.037703 n-d-861111-1 devstack@n-api.service[120452]: ERROR oslo.messaging._drivers.impl_rabbit [req-ab942c7e-9b22-4a18-b551-078f834dfed1 req-c5e12dff-fba8-4f22-915c-f1bbb1831bbb service nova] [75f240bb-79e9-4050-a853-c197a1740333] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:27:17.910980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-939c7210-c164-4666-a91d-7df4ec0186e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:17.911565 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-939c7210-c164-4666-a91d-7df4ec0186e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:17.919069 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-939c7210-c164-4666-a91d-7df4ec0186e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:17.919600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-939c7210-c164-4666-a91d-7df4ec0186e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:17.920037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-939c7210-c164-4666-a91d-7df4ec0186e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:17.920726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-939c7210-c164-4666-a91d-7df4ec0186e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:17.921176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-939c7210-c164-4666-a91d-7df4ec0186e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:17.921596 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-939c7210-c164-4666-a91d-7df4ec0186e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:18.052602 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [req-ab942c7e-9b22-4a18-b551-078f834dfed1 req-c5e12dff-fba8-4f22-915c-f1bbb1831bbb service nova] [75f240bb-79e9-4050-a853-c197a1740333] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40692. Oct 12 23:27:18.057241 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-ab942c7e-9b22-4a18-b551-078f834dfed1 req-c5e12dff-fba8-4f22-915c-f1bbb1831bbb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.055390 Oct 12 23:27:18.057949 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3652/7964] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:27:18.059274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-939c7210-c164-4666-a91d-7df4ec0186e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:18.068378 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-939c7210-c164-4666-a91d-7df4ec0186e3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.161686 Oct 12 23:27:18.068983 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4313/7965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:17 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:27:19.093944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-61eeadb5-4079-40bc-93b6-3ea6b8e67622 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:19.094578 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-61eeadb5-4079-40bc-93b6-3ea6b8e67622 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:19.101357 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61eeadb5-4079-40bc-93b6-3ea6b8e67622 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:19.101847 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61eeadb5-4079-40bc-93b6-3ea6b8e67622 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:19.102320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61eeadb5-4079-40bc-93b6-3ea6b8e67622 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:19.103008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61eeadb5-4079-40bc-93b6-3ea6b8e67622 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:19.103488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61eeadb5-4079-40bc-93b6-3ea6b8e67622 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:19.103921 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-61eeadb5-4079-40bc-93b6-3ea6b8e67622 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:19.239186 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-61eeadb5-4079-40bc-93b6-3ea6b8e67622 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:19.247440 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-61eeadb5-4079-40bc-93b6-3ea6b8e67622 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1686 microversion: 2.1 time: 0.158110 Oct 12 23:27:19.248041 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3653/7966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:19 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:20.271669 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7eade59f-a547-4875-8e68-c3fb4515f921 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:20.272274 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7eade59f-a547-4875-8e68-c3fb4515f921 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:20.279942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7eade59f-a547-4875-8e68-c3fb4515f921 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:20.280451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7eade59f-a547-4875-8e68-c3fb4515f921 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:20.280888 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7eade59f-a547-4875-8e68-c3fb4515f921 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:20.281580 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7eade59f-a547-4875-8e68-c3fb4515f921 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:20.282038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7eade59f-a547-4875-8e68-c3fb4515f921 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:20.282468 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7eade59f-a547-4875-8e68-c3fb4515f921 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:20.415762 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7eade59f-a547-4875-8e68-c3fb4515f921 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:20.423615 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7eade59f-a547-4875-8e68-c3fb4515f921 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1673 microversion: 2.1 time: 0.155949 Oct 12 23:27:20.424193 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4314/7967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:20 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:05.525029 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=21 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:05.525866 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=61 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:05.529613 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=21 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:05.530777 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=67 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:05.530905 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-809c2f24-5734-4846-8e17-68332f3b60a0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:05.531304 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-809c2f24-5734-4846-8e17-68332f3b60a0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:05.539601 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-809c2f24-5734-4846-8e17-68332f3b60a0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:05.540180 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-809c2f24-5734-4846-8e17-68332f3b60a0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:05.541887 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-809c2f24-5734-4846-8e17-68332f3b60a0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:05.542096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-809c2f24-5734-4846-8e17-68332f3b60a0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:05.542562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-809c2f24-5734-4846-8e17-68332f3b60a0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:05.542997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-809c2f24-5734-4846-8e17-68332f3b60a0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:05.570197 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-809c2f24-5734-4846-8e17-68332f3b60a0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:29:05.602143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-97dd5d89-4d8b-48ef-80f6-c3732351224e req-f56c1eb6-c2e5-407b-b356-e0b18a6afb2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8000e8-aa4d-432c-9897-40fad65ad76e", "tag": "ea36e3b7-df6a-4e9c-87df-47b5d23fb00a"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:29:05.612732 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-97dd5d89-4d8b-48ef-80f6-c3732351224e req-f56c1eb6-c2e5-407b-b356-e0b18a6afb2a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:05.613222 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-97dd5d89-4d8b-48ef-80f6-c3732351224e req-f56c1eb6-c2e5-407b-b356-e0b18a6afb2a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:05.613659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-97dd5d89-4d8b-48ef-80f6-c3732351224e req-f56c1eb6-c2e5-407b-b356-e0b18a6afb2a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:05.625365 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-97dd5d89-4d8b-48ef-80f6-c3732351224e req-f56c1eb6-c2e5-407b-b356-e0b18a6afb2a service nova] Creating event network-changed:ea36e3b7-df6a-4e9c-87df-47b5d23fb00a for instance 8c8000e8-aa4d-432c-9897-40fad65ad76e on n-h2-861111-1 Oct 12 23:29:05.631377 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-97dd5d89-4d8b-48ef-80f6-c3732351224e req-f56c1eb6-c2e5-407b-b356-e0b18a6afb2a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103934 Oct 12 23:29:05.632344 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4315/7968] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:29:05.653658 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-809c2f24-5734-4846-8e17-68332f3b60a0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 204 len: 0 microversion: 2.1 time: 0.130601 Oct 12 23:29:05.657735 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3654/7969] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:29:05 2022] DELETE /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:29:05.668280 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-060fce50-70da-4326-adda-e6d6006cb7b7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:05.669143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-060fce50-70da-4326-adda-e6d6006cb7b7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:05.675646 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-060fce50-70da-4326-adda-e6d6006cb7b7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:05.676542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-060fce50-70da-4326-adda-e6d6006cb7b7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:05.677015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-060fce50-70da-4326-adda-e6d6006cb7b7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:05.677761 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-060fce50-70da-4326-adda-e6d6006cb7b7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:05.678286 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-060fce50-70da-4326-adda-e6d6006cb7b7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:05.678753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-060fce50-70da-4326-adda-e6d6006cb7b7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:05.877474 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-060fce50-70da-4326-adda-e6d6006cb7b7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:05.885578 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-060fce50-70da-4326-adda-e6d6006cb7b7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1679 microversion: 2.1 time: 0.221607 Oct 12 23:29:05.886156 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4316/7970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:05 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1679 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:06.909568 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-00dc1a04-4293-4f8b-8b26-036d643adeb3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:06.910232 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-00dc1a04-4293-4f8b-8b26-036d643adeb3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:06.917730 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00dc1a04-4293-4f8b-8b26-036d643adeb3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:06.918228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00dc1a04-4293-4f8b-8b26-036d643adeb3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:06.918678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00dc1a04-4293-4f8b-8b26-036d643adeb3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:06.919408 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00dc1a04-4293-4f8b-8b26-036d643adeb3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:06.919876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00dc1a04-4293-4f8b-8b26-036d643adeb3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:06.920318 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-00dc1a04-4293-4f8b-8b26-036d643adeb3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:07.050531 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-00dc1a04-4293-4f8b-8b26-036d643adeb3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:07.059111 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-00dc1a04-4293-4f8b-8b26-036d643adeb3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 200 len: 1679 microversion: 2.1 time: 0.153868 Oct 12 23:29:07.060025 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3655/7971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:06 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:07.590455 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-e7b0c8bb-a16b-4352-84ed-39bc706cc406 req-f57a64b7-fd05-4b20-a9fb-b8bb20e24096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8000e8-aa4d-432c-9897-40fad65ad76e", "name": "network-vif-deleted", "tag": "ea36e3b7-df6a-4e9c-87df-47b5d23fb00a"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:29:07.599965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e7b0c8bb-a16b-4352-84ed-39bc706cc406 req-f57a64b7-fd05-4b20-a9fb-b8bb20e24096 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:07.600441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e7b0c8bb-a16b-4352-84ed-39bc706cc406 req-f57a64b7-fd05-4b20-a9fb-b8bb20e24096 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:07.600872 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-e7b0c8bb-a16b-4352-84ed-39bc706cc406 req-f57a64b7-fd05-4b20-a9fb-b8bb20e24096 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:07.612036 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-e7b0c8bb-a16b-4352-84ed-39bc706cc406 req-f57a64b7-fd05-4b20-a9fb-b8bb20e24096 service nova] Creating event network-vif-deleted:ea36e3b7-df6a-4e9c-87df-47b5d23fb00a for instance 8c8000e8-aa4d-432c-9897-40fad65ad76e on n-h2-861111-1 Oct 12 23:29:07.616795 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-e7b0c8bb-a16b-4352-84ed-39bc706cc406 req-f57a64b7-fd05-4b20-a9fb-b8bb20e24096 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102102 Oct 12 23:29:07.617413 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4317/7972] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:29:08.082209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0bb37e01-bc5f-46a4-bdc2-233111e6136f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:08.082796 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0bb37e01-bc5f-46a4-bdc2-233111e6136f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 8c8000e8-aa4d-432c-9897-40fad65ad76e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:08.089456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bb37e01-bc5f-46a4-bdc2-233111e6136f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:08.089952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bb37e01-bc5f-46a4-bdc2-233111e6136f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:08.090399 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bb37e01-bc5f-46a4-bdc2-233111e6136f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:08.091100 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bb37e01-bc5f-46a4-bdc2-233111e6136f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:08.091591 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bb37e01-bc5f-46a4-bdc2-233111e6136f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:08.092031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bb37e01-bc5f-46a4-bdc2-233111e6136f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:08.105118 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-0bb37e01-bc5f-46a4-bdc2-233111e6136f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] HTTP exception thrown: Instance 8c8000e8-aa4d-432c-9897-40fad65ad76e could not be found. Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0bb37e01-bc5f-46a4-bdc2-233111e6136f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Request method failure captured: Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e HTTP/1.1 Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR0x7gmi6nShYv1ypG8lNuw62s0LMtqTMp7E6Aszeu8WizOjmwdZQ-b3a3w-sZ2OY6nEKV25DmEj-ChPdKCpz1YIX4OgMK9Q6vSNFvVvl-0-XqrNpep9R2arqH6waTgcGduJS0r2oqgpljDYCqL2e4-6l1tzRq7wfp7r9lmfy1aO2deg Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 7c668c00d36b49829ad8de2181ec0237 Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestShelveInstance-1033860207 Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c668c00d36b49829ad8de2181ec0237"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c668c00d36b49829ad8de2181ec0237"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7c668c00d36b49829ad8de2181ec0237", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7c668c00d36b49829ad8de2181ec0237"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestShelveInstance-1033860207 Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 7c668c00d36b49829ad8de2181ec0237 Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestShelveInstance-1033860207 Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestShelveInstance-1033860207-project Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 4ad65c86847048f987704ba020d2a6ac Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestShelveInstance-1033860207-project Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance 8c8000e8-aa4d-432c-9897-40fad65ad76e could not be found. Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': '8c8000e8-aa4d-432c-9897-40fad65ad76e'} Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c8000e8-aa4d-432c-9897-40fad65ad76e could not be found. Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c8000e8-aa4d-432c-9897-40fad65ad76e could not be found. Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:29:08.106751 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:29:08.112470 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:29:08.112470 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:29:08.112470 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:29:08.112470 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:29:08.112470 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:29:08.112470 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c8000e8-aa4d-432c-9897-40fad65ad76e could not be found. Oct 12 23:29:08.112470 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:29:08.112470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0bb37e01-bc5f-46a4-bdc2-233111e6136f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Returning 404 to user: Instance 8c8000e8-aa4d-432c-9897-40fad65ad76e could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:29:08.112470 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0bb37e01-bc5f-46a4-bdc2-233111e6136f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e" status: 404 len: 111 microversion: 2.1 time: 0.030044 Oct 12 23:29:08.112470 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3656/7973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:08 2022] GET /compute/v2.1/servers/8c8000e8-aa4d-432c-9897-40fad65ad76e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:29:08.268840 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-14fcf9ea-2b5e-4d2c-99a2-e3b615641c76 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '.version_select at 0x7f5122bc10d0>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:08.297359 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-14fcf9ea-2b5e-4d2c-99a2-e3b615641c76 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-710344093" status: 202 len: 0 microversion: 2.1 time: 0.032725 Oct 12 23:29:08.297977 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4318/7974] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 12 23:29:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-710344093 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:29:08.323101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-93b33293-d8cc-4632-8257-66c593dd85b1 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Action: 'create', calling method: .version_select at 0x7f5123109160>, body: {"keypair": {"name": "tempest-TestShelveInstance-295732995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9qVUKKrEH7NRb42aV+GGH7hglNtKmGxbL44QNW4AuGBY6qdyFXF9+XdZPmjrkpfA0cAt2tQL7YAhSkA28SC0m5GXxCRRCQDL/NqxX2IiaMj88PY7P7DpymsNOmteum6g=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:29:08.338378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-93b33293-d8cc-4632-8257-66c593dd85b1 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Getting quotas for project 7c668c00d36b49829ad8de2181ec0237. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:29:08.343444 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-93b33293-d8cc-4632-8257-66c593dd85b1 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Getting quotas for user 4ad65c86847048f987704ba020d2a6ac and project 7c668c00d36b49829ad8de2181ec0237. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:29:08.370114 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-93b33293-d8cc-4632-8257-66c593dd85b1 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.050982 Oct 12 23:29:08.370710 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3657/7975] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 23:29:08 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:29:24.500188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=10 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:24.500965 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:24.506073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2120991190", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-295732995", "security_groups": [{"name": "tempest-secgroup-smoke-1164741529"}], "networks": [{"uuid": "7c2f4220-9c31-4171-80e9-38f1f73c622b"}], "block_device_mapping_v2": [{"uuid": "7f15a56f-9c66-44fe-a170-50cd519b26c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:29:24.617833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] validate_networks() for [('7c2f4220-9c31-4171-80e9-38f1f73c622b', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:29:25.030030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:29:25.030479 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:29:25.030957 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:29:25.031407 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:29:25.031907 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:29:25.041073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:25.041553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:25.041987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:25.042712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:25.043257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:25.043685 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:25.061601 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Getting quotas for project 7c668c00d36b49829ad8de2181ec0237. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:29:25.066803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Getting quotas for user 4ad65c86847048f987704ba020d2a6ac and project 7c668c00d36b49829ad8de2181ec0237. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:29:25.124297 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:29:25.126574 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f15a56f-9c66-44fe-a170-50cd519b26c8',volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:29:25.252754 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-957a36b6-b6d2-4e43-96a1-a5363ce6a117 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.754253 Oct 12 23:29:25.253403 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4319/7976] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 23:29:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:29:25.262747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:25.263562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:25.264409 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:25.269054 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1124c7e6-b0c7-45df-a64a-d1abde420ed9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:25.269690 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1124c7e6-b0c7-45df-a64a-d1abde420ed9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:25.338857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-1124c7e6-b0c7-45df-a64a-d1abde420ed9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:25.345853 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1124c7e6-b0c7-45df-a64a-d1abde420ed9 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1088 microversion: 2.1 time: 0.084903 Oct 12 23:29:25.346601 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3658/7977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:25 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:26.370817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-55973ce5-0574-4a58-93a4-7e7b680ba752 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:26.371484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-55973ce5-0574-4a58-93a4-7e7b680ba752 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:26.378380 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55973ce5-0574-4a58-93a4-7e7b680ba752 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:26.378865 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55973ce5-0574-4a58-93a4-7e7b680ba752 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:26.379387 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55973ce5-0574-4a58-93a4-7e7b680ba752 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:26.380373 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55973ce5-0574-4a58-93a4-7e7b680ba752 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:26.380833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55973ce5-0574-4a58-93a4-7e7b680ba752 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:26.381266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-55973ce5-0574-4a58-93a4-7e7b680ba752 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:26.450062 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-55973ce5-0574-4a58-93a4-7e7b680ba752 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:26.457845 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-55973ce5-0574-4a58-93a4-7e7b680ba752 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1186 microversion: 2.1 time: 0.091876 Oct 12 23:29:26.458427 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4320/7978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:26 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1186 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:27.480944 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7dfd4b9b-4088-4452-9fc8-4ac5fa8f7678 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:27.481513 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7dfd4b9b-4088-4452-9fc8-4ac5fa8f7678 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:27.488238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7dfd4b9b-4088-4452-9fc8-4ac5fa8f7678 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:27.489276 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7dfd4b9b-4088-4452-9fc8-4ac5fa8f7678 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:27.489804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7dfd4b9b-4088-4452-9fc8-4ac5fa8f7678 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:27.490530 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7dfd4b9b-4088-4452-9fc8-4ac5fa8f7678 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:27.490997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7dfd4b9b-4088-4452-9fc8-4ac5fa8f7678 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:27.491472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7dfd4b9b-4088-4452-9fc8-4ac5fa8f7678 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:27.718903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7dfd4b9b-4088-4452-9fc8-4ac5fa8f7678 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:27.727709 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7dfd4b9b-4088-4452-9fc8-4ac5fa8f7678 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1272 microversion: 2.1 time: 0.250647 Oct 12 23:29:27.743878 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3659/7979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:27 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:29:28.382144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-6873cdff-a32a-4f79-9e51-255326cb01ad req-2044b2e8-683a-413c-a663-9b5676d774b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67d36a1c-0077-4ede-8d85-97f69019309f", "tag": "a9cb606a-ebf2-4f46-88c5-02dfc89d0c46"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:29:28.393237 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6873cdff-a32a-4f79-9e51-255326cb01ad req-2044b2e8-683a-413c-a663-9b5676d774b3 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:28.393945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6873cdff-a32a-4f79-9e51-255326cb01ad req-2044b2e8-683a-413c-a663-9b5676d774b3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:28.394448 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-6873cdff-a32a-4f79-9e51-255326cb01ad req-2044b2e8-683a-413c-a663-9b5676d774b3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:28.406703 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-6873cdff-a32a-4f79-9e51-255326cb01ad req-2044b2e8-683a-413c-a663-9b5676d774b3 service nova] Creating event network-changed:a9cb606a-ebf2-4f46-88c5-02dfc89d0c46 for instance 67d36a1c-0077-4ede-8d85-97f69019309f on n-h1-861111-1 Oct 12 23:29:28.411627 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-6873cdff-a32a-4f79-9e51-255326cb01ad req-2044b2e8-683a-413c-a663-9b5676d774b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034173 Oct 12 23:29:28.412465 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4321/7980] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:29:28.751423 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-71acb148-3985-4d6c-b83d-dea934168b27 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:28.752404 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-71acb148-3985-4d6c-b83d-dea934168b27 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:28.765158 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71acb148-3985-4d6c-b83d-dea934168b27 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:28.766044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71acb148-3985-4d6c-b83d-dea934168b27 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:28.767473 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71acb148-3985-4d6c-b83d-dea934168b27 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:28.768820 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71acb148-3985-4d6c-b83d-dea934168b27 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:28.769698 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71acb148-3985-4d6c-b83d-dea934168b27 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:28.770372 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71acb148-3985-4d6c-b83d-dea934168b27 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:28.954041 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-71acb148-3985-4d6c-b83d-dea934168b27 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:28.963940 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-71acb148-3985-4d6c-b83d-dea934168b27 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1272 microversion: 2.1 time: 0.215643 Oct 12 23:29:28.964764 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3660/7981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:28 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:29.987505 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-566cf688-7e3c-4de0-b802-1db6e3982adb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:29.988108 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-566cf688-7e3c-4de0-b802-1db6e3982adb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:29.994924 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-566cf688-7e3c-4de0-b802-1db6e3982adb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:29.995459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-566cf688-7e3c-4de0-b802-1db6e3982adb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:29.995909 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-566cf688-7e3c-4de0-b802-1db6e3982adb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:29.996600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-566cf688-7e3c-4de0-b802-1db6e3982adb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:29.997057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-566cf688-7e3c-4de0-b802-1db6e3982adb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:29.997486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-566cf688-7e3c-4de0-b802-1db6e3982adb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:30.131471 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-566cf688-7e3c-4de0-b802-1db6e3982adb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:30.139367 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-566cf688-7e3c-4de0-b802-1db6e3982adb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1272 microversion: 2.1 time: 0.157078 Oct 12 23:29:30.139948 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4322/7982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:29 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:31.162652 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b01353b7-7579-41d3-a523-dc78d870a73d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:31.163312 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b01353b7-7579-41d3-a523-dc78d870a73d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:31.170401 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b01353b7-7579-41d3-a523-dc78d870a73d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:31.170906 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b01353b7-7579-41d3-a523-dc78d870a73d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:31.171389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b01353b7-7579-41d3-a523-dc78d870a73d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:31.172112 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b01353b7-7579-41d3-a523-dc78d870a73d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:31.172574 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b01353b7-7579-41d3-a523-dc78d870a73d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:31.173012 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b01353b7-7579-41d3-a523-dc78d870a73d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:31.308966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b01353b7-7579-41d3-a523-dc78d870a73d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:31.317711 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b01353b7-7579-41d3-a523-dc78d870a73d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1272 microversion: 2.1 time: 0.159206 Oct 12 23:29:31.318491 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3661/7983] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:31 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:32.341485 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9eabac1c-5b7d-496c-a91f-d1d3b04bb718 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:32.342234 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9eabac1c-5b7d-496c-a91f-d1d3b04bb718 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:32.348886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eabac1c-5b7d-496c-a91f-d1d3b04bb718 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:32.349441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eabac1c-5b7d-496c-a91f-d1d3b04bb718 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:32.349889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eabac1c-5b7d-496c-a91f-d1d3b04bb718 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:32.350569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eabac1c-5b7d-496c-a91f-d1d3b04bb718 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:32.351167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eabac1c-5b7d-496c-a91f-d1d3b04bb718 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:32.351712 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9eabac1c-5b7d-496c-a91f-d1d3b04bb718 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:32.481831 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9eabac1c-5b7d-496c-a91f-d1d3b04bb718 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:32.489542 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9eabac1c-5b7d-496c-a91f-d1d3b04bb718 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1260 microversion: 2.1 time: 0.151905 Oct 12 23:29:32.490116 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4323/7984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:32 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:33.514047 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-521a5d9e-d21c-408a-99a6-aef58e31748d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:33.514680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-521a5d9e-d21c-408a-99a6-aef58e31748d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:33.522000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-521a5d9e-d21c-408a-99a6-aef58e31748d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:33.522499 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-521a5d9e-d21c-408a-99a6-aef58e31748d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:33.522985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-521a5d9e-d21c-408a-99a6-aef58e31748d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:33.523721 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-521a5d9e-d21c-408a-99a6-aef58e31748d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:33.524190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-521a5d9e-d21c-408a-99a6-aef58e31748d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:33.524653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-521a5d9e-d21c-408a-99a6-aef58e31748d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:33.658431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-521a5d9e-d21c-408a-99a6-aef58e31748d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:33.666857 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-521a5d9e-d21c-408a-99a6-aef58e31748d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1260 microversion: 2.1 time: 0.156823 Oct 12 23:29:33.667472 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3662/7985] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:33 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:34.689568 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5f5f7bea-854a-47d6-972a-fb464e80619f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:34.690253 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5f5f7bea-854a-47d6-972a-fb464e80619f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:34.697015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f5f7bea-854a-47d6-972a-fb464e80619f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:34.697499 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f5f7bea-854a-47d6-972a-fb464e80619f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:34.697937 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f5f7bea-854a-47d6-972a-fb464e80619f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:34.698624 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f5f7bea-854a-47d6-972a-fb464e80619f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:34.699075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f5f7bea-854a-47d6-972a-fb464e80619f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:34.699528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5f5f7bea-854a-47d6-972a-fb464e80619f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:34.830859 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5f5f7bea-854a-47d6-972a-fb464e80619f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:34.839218 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5f5f7bea-854a-47d6-972a-fb464e80619f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1260 microversion: 2.1 time: 0.153569 Oct 12 23:29:34.839814 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4324/7986] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:34 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:35.862760 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-93e69599-94cb-4bf8-b7aa-a76b555b0203 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:35.863443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-93e69599-94cb-4bf8-b7aa-a76b555b0203 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:35.866655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:35.872032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93e69599-94cb-4bf8-b7aa-a76b555b0203 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:35.872557 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93e69599-94cb-4bf8-b7aa-a76b555b0203 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:35.873007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93e69599-94cb-4bf8-b7aa-a76b555b0203 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:35.873710 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93e69599-94cb-4bf8-b7aa-a76b555b0203 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:35.874175 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93e69599-94cb-4bf8-b7aa-a76b555b0203 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:35.874614 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-93e69599-94cb-4bf8-b7aa-a76b555b0203 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:36.006002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-93e69599-94cb-4bf8-b7aa-a76b555b0203 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:36.013698 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-93e69599-94cb-4bf8-b7aa-a76b555b0203 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1260 microversion: 2.1 time: 0.154907 Oct 12 23:29:36.014270 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3663/7987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:35 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:37.036576 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-20375053-3466-43b2-bdc7-854617dabac6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:37.037156 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-20375053-3466-43b2-bdc7-854617dabac6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:37.039070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:37.039763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:37.046441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20375053-3466-43b2-bdc7-854617dabac6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:37.046925 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20375053-3466-43b2-bdc7-854617dabac6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:37.047389 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20375053-3466-43b2-bdc7-854617dabac6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:37.048087 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20375053-3466-43b2-bdc7-854617dabac6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:37.048540 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20375053-3466-43b2-bdc7-854617dabac6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:37.048966 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-20375053-3466-43b2-bdc7-854617dabac6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:37.175168 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-20375053-3466-43b2-bdc7-854617dabac6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:37.183461 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-20375053-3466-43b2-bdc7-854617dabac6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1260 microversion: 2.1 time: 0.150862 Oct 12 23:29:37.184031 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4325/7988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:37 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:38.207493 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ae62184a-7150-417b-90f4-3e5d0c5e6834 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:38.208755 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ae62184a-7150-417b-90f4-3e5d0c5e6834 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:38.215610 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae62184a-7150-417b-90f4-3e5d0c5e6834 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:38.216104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae62184a-7150-417b-90f4-3e5d0c5e6834 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:38.216556 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae62184a-7150-417b-90f4-3e5d0c5e6834 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:38.217255 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae62184a-7150-417b-90f4-3e5d0c5e6834 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:38.217719 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae62184a-7150-417b-90f4-3e5d0c5e6834 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:38.218155 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae62184a-7150-417b-90f4-3e5d0c5e6834 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:38.346051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ae62184a-7150-417b-90f4-3e5d0c5e6834 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:38.354234 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ae62184a-7150-417b-90f4-3e5d0c5e6834 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1260 microversion: 2.1 time: 0.150721 Oct 12 23:29:38.354798 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3664/7989] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:38 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:39.377000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e61b1bf1-21da-4a5c-bf09-f89844ad7543 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:39.377614 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e61b1bf1-21da-4a5c-bf09-f89844ad7543 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:39.384726 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e61b1bf1-21da-4a5c-bf09-f89844ad7543 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:39.385204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e61b1bf1-21da-4a5c-bf09-f89844ad7543 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:39.385643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e61b1bf1-21da-4a5c-bf09-f89844ad7543 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:39.386324 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e61b1bf1-21da-4a5c-bf09-f89844ad7543 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:39.386773 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e61b1bf1-21da-4a5c-bf09-f89844ad7543 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:39.387196 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e61b1bf1-21da-4a5c-bf09-f89844ad7543 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:39.513105 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e61b1bf1-21da-4a5c-bf09-f89844ad7543 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:39.521400 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e61b1bf1-21da-4a5c-bf09-f89844ad7543 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1260 microversion: 2.1 time: 0.148295 Oct 12 23:29:39.521975 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4326/7990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:39 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:40.544844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-982fac48-e29e-4d59-9e10-9830df40cddb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:40.545472 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-982fac48-e29e-4d59-9e10-9830df40cddb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:40.552938 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982fac48-e29e-4d59-9e10-9830df40cddb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:40.553426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982fac48-e29e-4d59-9e10-9830df40cddb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:40.553872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982fac48-e29e-4d59-9e10-9830df40cddb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:40.554565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982fac48-e29e-4d59-9e10-9830df40cddb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:40.555026 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982fac48-e29e-4d59-9e10-9830df40cddb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:40.555510 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982fac48-e29e-4d59-9e10-9830df40cddb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:40.690464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-982fac48-e29e-4d59-9e10-9830df40cddb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:40.698230 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-982fac48-e29e-4d59-9e10-9830df40cddb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1260 microversion: 2.1 time: 0.157241 Oct 12 23:29:40.698806 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3665/7991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:40 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:41.721020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-95f80ef2-c4a0-420f-9317-77676430b232 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:41.721643 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-95f80ef2-c4a0-420f-9317-77676430b232 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:41.729167 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95f80ef2-c4a0-420f-9317-77676430b232 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:41.729651 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95f80ef2-c4a0-420f-9317-77676430b232 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:41.730096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95f80ef2-c4a0-420f-9317-77676430b232 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:41.730822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95f80ef2-c4a0-420f-9317-77676430b232 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:41.731304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95f80ef2-c4a0-420f-9317-77676430b232 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:41.731737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-95f80ef2-c4a0-420f-9317-77676430b232 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:41.865364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-95f80ef2-c4a0-420f-9317-77676430b232 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:41.873114 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-95f80ef2-c4a0-420f-9317-77676430b232 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1260 microversion: 2.1 time: 0.156029 Oct 12 23:29:41.873704 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4327/7992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:41 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:42.828914 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-0770f995-dd8d-4c6b-9719-28d920be089f req-2b241b87-13a1-4eea-9b6f-01117d5081ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d36a1c-0077-4ede-8d85-97f69019309f", "name": "network-vif-plugged", "status": "completed", "tag": "a9cb606a-ebf2-4f46-88c5-02dfc89d0c46"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:29:42.838241 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0770f995-dd8d-4c6b-9719-28d920be089f req-2b241b87-13a1-4eea-9b6f-01117d5081ae service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:42.838735 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0770f995-dd8d-4c6b-9719-28d920be089f req-2b241b87-13a1-4eea-9b6f-01117d5081ae service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:42.839179 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0770f995-dd8d-4c6b-9719-28d920be089f req-2b241b87-13a1-4eea-9b6f-01117d5081ae service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:42.850392 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-0770f995-dd8d-4c6b-9719-28d920be089f req-2b241b87-13a1-4eea-9b6f-01117d5081ae service nova] Creating event network-vif-plugged:a9cb606a-ebf2-4f46-88c5-02dfc89d0c46 for instance 67d36a1c-0077-4ede-8d85-97f69019309f on n-h1-861111-1 Oct 12 23:29:42.855519 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-0770f995-dd8d-4c6b-9719-28d920be089f req-2b241b87-13a1-4eea-9b6f-01117d5081ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119112 Oct 12 23:29:42.856095 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3666/7993] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:29:42.896104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-12b59ec6-353a-41af-921b-f61aaa401477 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:42.896705 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-12b59ec6-353a-41af-921b-f61aaa401477 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:42.903544 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12b59ec6-353a-41af-921b-f61aaa401477 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:42.904029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12b59ec6-353a-41af-921b-f61aaa401477 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:42.904467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12b59ec6-353a-41af-921b-f61aaa401477 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:42.905223 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12b59ec6-353a-41af-921b-f61aaa401477 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:42.905616 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12b59ec6-353a-41af-921b-f61aaa401477 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:42.906049 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-12b59ec6-353a-41af-921b-f61aaa401477 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:43.036987 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-12b59ec6-353a-41af-921b-f61aaa401477 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:43.044758 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-12b59ec6-353a-41af-921b-f61aaa401477 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1260 microversion: 2.1 time: 0.152547 Oct 12 23:29:43.045310 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4328/7994] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:42 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:44.070043 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5a8a0cef-2f16-497b-8f73-6369ec84d463 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:44.070764 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5a8a0cef-2f16-497b-8f73-6369ec84d463 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:44.076885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a8a0cef-2f16-497b-8f73-6369ec84d463 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:44.077376 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a8a0cef-2f16-497b-8f73-6369ec84d463 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:44.077825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a8a0cef-2f16-497b-8f73-6369ec84d463 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:44.078522 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a8a0cef-2f16-497b-8f73-6369ec84d463 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:44.078988 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a8a0cef-2f16-497b-8f73-6369ec84d463 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:44.079464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a8a0cef-2f16-497b-8f73-6369ec84d463 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:44.214915 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-5a8a0cef-2f16-497b-8f73-6369ec84d463 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:44.225336 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5a8a0cef-2f16-497b-8f73-6369ec84d463 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1260 microversion: 2.1 time: 0.160939 Oct 12 23:29:44.233828 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3667/7995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:44 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:45.248945 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-60d2d092-9af5-4103-8914-76d95481cd77 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:45.249553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-60d2d092-9af5-4103-8914-76d95481cd77 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:45.256668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d2d092-9af5-4103-8914-76d95481cd77 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:45.257143 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d2d092-9af5-4103-8914-76d95481cd77 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:45.257588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d2d092-9af5-4103-8914-76d95481cd77 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:45.258272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d2d092-9af5-4103-8914-76d95481cd77 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:45.258733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d2d092-9af5-4103-8914-76d95481cd77 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:45.259161 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-60d2d092-9af5-4103-8914-76d95481cd77 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:45.389889 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-60d2d092-9af5-4103-8914-76d95481cd77 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:45.398085 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-60d2d092-9af5-4103-8914-76d95481cd77 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1444 microversion: 2.1 time: 0.153122 Oct 12 23:29:45.398663 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4329/7996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:45 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:45.420292 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dd907c2c-65f6-4f99-b8ad-81057e198c66 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:45.420948 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dd907c2c-65f6-4f99-b8ad-81057e198c66 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:45.428157 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd907c2c-65f6-4f99-b8ad-81057e198c66 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:45.428644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd907c2c-65f6-4f99-b8ad-81057e198c66 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:45.429089 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd907c2c-65f6-4f99-b8ad-81057e198c66 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:45.429783 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd907c2c-65f6-4f99-b8ad-81057e198c66 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:45.430245 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd907c2c-65f6-4f99-b8ad-81057e198c66 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:45.430678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd907c2c-65f6-4f99-b8ad-81057e198c66 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:45.562205 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dd907c2c-65f6-4f99-b8ad-81057e198c66 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:45.570536 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dd907c2c-65f6-4f99-b8ad-81057e198c66 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1444 microversion: 2.1 time: 0.154176 Oct 12 23:29:45.571122 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3668/7997] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:45 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:29:47.180322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-901c112b-d8c9-4864-b095-0452cc40befb req-48a6cfdb-d0e1-4483-ac35-c9fc96c99f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67d36a1c-0077-4ede-8d85-97f69019309f", "tag": "a9cb606a-ebf2-4f46-88c5-02dfc89d0c46"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:29:47.190527 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-901c112b-d8c9-4864-b095-0452cc40befb req-48a6cfdb-d0e1-4483-ac35-c9fc96c99f95 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:47.191010 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-901c112b-d8c9-4864-b095-0452cc40befb req-48a6cfdb-d0e1-4483-ac35-c9fc96c99f95 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:47.191545 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-901c112b-d8c9-4864-b095-0452cc40befb req-48a6cfdb-d0e1-4483-ac35-c9fc96c99f95 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:47.202639 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-901c112b-d8c9-4864-b095-0452cc40befb req-48a6cfdb-d0e1-4483-ac35-c9fc96c99f95 service nova] Creating event network-changed:a9cb606a-ebf2-4f46-88c5-02dfc89d0c46 for instance 67d36a1c-0077-4ede-8d85-97f69019309f on n-h1-861111-1 Oct 12 23:29:47.208177 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-901c112b-d8c9-4864-b095-0452cc40befb req-48a6cfdb-d0e1-4483-ac35-c9fc96c99f95 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032305 Oct 12 23:29:47.209058 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4330/7998] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:31:43.483011 n-d-861111-1 devstack@n-api.service[120452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b0df6e00-df54-42f7-81d1-59721b28bd80] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 23:31:43.484111 n-d-861111-1 devstack@n-api.service[120452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d1e6222c-d1f8-4742-acce-113cd0d666eb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 23:31:43.484674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=24 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:31:43.485425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=56 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:31:43.486460 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:31:43.486624 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 23:31:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f/action (ip 10.222.0.16) !!! Oct 12 23:31:43.488040 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:31:43.488215 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 23:31:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f/action (ip 10.222.0.16) !!! Oct 12 23:31:43.493088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f1181d87-6d57-4f77-8c15-ecba7be70947 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:31:43.493619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f1181d87-6d57-4f77-8c15-ecba7be70947 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:43.506572 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1181d87-6d57-4f77-8c15-ecba7be70947 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:43.507060 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1181d87-6d57-4f77-8c15-ecba7be70947 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:43.507525 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1181d87-6d57-4f77-8c15-ecba7be70947 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:43.508219 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1181d87-6d57-4f77-8c15-ecba7be70947 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:43.508681 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1181d87-6d57-4f77-8c15-ecba7be70947 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:43.509115 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f1181d87-6d57-4f77-8c15-ecba7be70947 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:43.532321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-f1181d87-6d57-4f77-8c15-ecba7be70947 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lazy-loading 'flavor' on Instance uuid 67d36a1c-0077-4ede-8d85-97f69019309f {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:31:43.601618 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f1181d87-6d57-4f77-8c15-ecba7be70947 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "POST /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f/action" status: 202 len: 0 microversion: 2.1 time: 0.120391 Oct 12 23:31:43.602248 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3669/7999] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:31:43 2022] POST /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:31:43.608812 n-d-861111-1 devstack@n-api.service[120453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84ea943b-c2e8-46fe-b7cd-216120f59743] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 23:31:43.609708 n-d-861111-1 devstack@n-api.service[120453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aee61eb9-c5dd-4991-902f-85ebd1f559fb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 23:31:43.611257 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:31:43.612562 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=60 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:31:43.613882 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:31:43.614050 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 23:31:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f (ip 10.222.0.16) !!! Oct 12 23:31:43.616152 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:31:43.616291 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 23:31:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f (ip 10.222.0.16) !!! Oct 12 23:31:43.629029 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a4cca026-a15b-4ca2-a127-6be28bb80af3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:43.629737 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a4cca026-a15b-4ca2-a127-6be28bb80af3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:43.645765 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4cca026-a15b-4ca2-a127-6be28bb80af3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:43.646252 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4cca026-a15b-4ca2-a127-6be28bb80af3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:43.646686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4cca026-a15b-4ca2-a127-6be28bb80af3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:43.647411 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4cca026-a15b-4ca2-a127-6be28bb80af3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:43.647867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4cca026-a15b-4ca2-a127-6be28bb80af3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:43.648289 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a4cca026-a15b-4ca2-a127-6be28bb80af3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:43.781896 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a4cca026-a15b-4ca2-a127-6be28bb80af3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:43.789696 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a4cca026-a15b-4ca2-a127-6be28bb80af3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1569 microversion: 2.1 time: 0.182837 Oct 12 23:31:43.790266 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4331/8000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:43 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:44.815024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-51746e25-075c-48d9-a694-eaa0b1fd413e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:44.815768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-51746e25-075c-48d9-a694-eaa0b1fd413e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:44.824883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51746e25-075c-48d9-a694-eaa0b1fd413e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:44.825379 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51746e25-075c-48d9-a694-eaa0b1fd413e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:44.825827 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51746e25-075c-48d9-a694-eaa0b1fd413e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:44.826528 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51746e25-075c-48d9-a694-eaa0b1fd413e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:44.826992 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51746e25-075c-48d9-a694-eaa0b1fd413e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:44.827458 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51746e25-075c-48d9-a694-eaa0b1fd413e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:44.832663 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] [b0df6e00-df54-42f7-81d1-59721b28bd80] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41066. Oct 12 23:31:44.833374 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] [d1e6222c-d1f8-4742-acce-113cd0d666eb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41068. Oct 12 23:31:45.011872 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-51746e25-075c-48d9-a694-eaa0b1fd413e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:45.020490 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-51746e25-075c-48d9-a694-eaa0b1fd413e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1569 microversion: 2.1 time: 0.210977 Oct 12 23:31:45.020995 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3670/8001] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:44 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:31:46.043926 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-97c6221d-127f-47d3-aea3-eb65532c642f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:46.044575 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-97c6221d-127f-47d3-aea3-eb65532c642f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:46.055207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c6221d-127f-47d3-aea3-eb65532c642f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:46.055706 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c6221d-127f-47d3-aea3-eb65532c642f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:46.056140 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c6221d-127f-47d3-aea3-eb65532c642f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:46.056824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c6221d-127f-47d3-aea3-eb65532c642f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:46.057272 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c6221d-127f-47d3-aea3-eb65532c642f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:46.057696 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-97c6221d-127f-47d3-aea3-eb65532c642f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:46.061541 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] [84ea943b-c2e8-46fe-b7cd-216120f59743] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41074. Oct 12 23:31:46.062223 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] [aee61eb9-c5dd-4991-902f-85ebd1f559fb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41076. Oct 12 23:31:46.189758 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-97c6221d-127f-47d3-aea3-eb65532c642f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:46.197481 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-97c6221d-127f-47d3-aea3-eb65532c642f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1569 microversion: 2.1 time: 0.157487 Oct 12 23:31:46.198049 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4332/8002] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:46 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:47.221435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3efe0eb6-d1c8-485b-a71d-4440e3e1d989 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:47.222002 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3efe0eb6-d1c8-485b-a71d-4440e3e1d989 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:47.229320 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3efe0eb6-d1c8-485b-a71d-4440e3e1d989 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:47.229803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3efe0eb6-d1c8-485b-a71d-4440e3e1d989 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:47.230249 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3efe0eb6-d1c8-485b-a71d-4440e3e1d989 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:47.230945 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3efe0eb6-d1c8-485b-a71d-4440e3e1d989 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:47.231447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3efe0eb6-d1c8-485b-a71d-4440e3e1d989 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:47.231885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3efe0eb6-d1c8-485b-a71d-4440e3e1d989 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:47.363378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-3efe0eb6-d1c8-485b-a71d-4440e3e1d989 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:47.372099 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3efe0eb6-d1c8-485b-a71d-4440e3e1d989 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1569 microversion: 2.1 time: 0.154670 Oct 12 23:31:47.372668 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3671/8003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:47 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:48.396522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2ed9d65a-883d-46e2-afdb-d9952acd26e8 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:48.397177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2ed9d65a-883d-46e2-afdb-d9952acd26e8 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:48.404096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ed9d65a-883d-46e2-afdb-d9952acd26e8 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:48.404589 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ed9d65a-883d-46e2-afdb-d9952acd26e8 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:48.405030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ed9d65a-883d-46e2-afdb-d9952acd26e8 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:48.405725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ed9d65a-883d-46e2-afdb-d9952acd26e8 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:48.406185 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ed9d65a-883d-46e2-afdb-d9952acd26e8 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:48.406619 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ed9d65a-883d-46e2-afdb-d9952acd26e8 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:48.539424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2ed9d65a-883d-46e2-afdb-d9952acd26e8 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:48.547105 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2ed9d65a-883d-46e2-afdb-d9952acd26e8 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1569 microversion: 2.1 time: 0.154520 Oct 12 23:31:48.547709 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4333/8004] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:48 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:49.571337 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-948f7e5e-6541-4fea-a0a6-1a809600c932 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:49.571962 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-948f7e5e-6541-4fea-a0a6-1a809600c932 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:49.578860 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-948f7e5e-6541-4fea-a0a6-1a809600c932 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:49.579378 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-948f7e5e-6541-4fea-a0a6-1a809600c932 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:49.579825 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-948f7e5e-6541-4fea-a0a6-1a809600c932 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:49.580518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-948f7e5e-6541-4fea-a0a6-1a809600c932 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:49.580979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-948f7e5e-6541-4fea-a0a6-1a809600c932 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:49.581414 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-948f7e5e-6541-4fea-a0a6-1a809600c932 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:49.712526 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-948f7e5e-6541-4fea-a0a6-1a809600c932 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:49.720324 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-948f7e5e-6541-4fea-a0a6-1a809600c932 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1569 microversion: 2.1 time: 0.153426 Oct 12 23:31:49.720893 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3672/8005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:49 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:50.743644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-5be22a7c-90ae-4c33-8583-630642907342 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:50.744245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-5be22a7c-90ae-4c33-8583-630642907342 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:50.751126 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5be22a7c-90ae-4c33-8583-630642907342 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:50.751644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5be22a7c-90ae-4c33-8583-630642907342 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:50.752111 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5be22a7c-90ae-4c33-8583-630642907342 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:50.752797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5be22a7c-90ae-4c33-8583-630642907342 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:50.753276 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5be22a7c-90ae-4c33-8583-630642907342 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:50.753699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-5be22a7c-90ae-4c33-8583-630642907342 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:50.882402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-5be22a7c-90ae-4c33-8583-630642907342 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:50.890030 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-5be22a7c-90ae-4c33-8583-630642907342 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1569 microversion: 2.1 time: 0.150382 Oct 12 23:31:50.890605 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4334/8006] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:50 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:51.914555 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-80c89b57-22f8-410b-a0a7-7feab4a51e9f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:51.915159 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-80c89b57-22f8-410b-a0a7-7feab4a51e9f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:51.921961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80c89b57-22f8-410b-a0a7-7feab4a51e9f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:51.922456 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80c89b57-22f8-410b-a0a7-7feab4a51e9f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:51.922900 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80c89b57-22f8-410b-a0a7-7feab4a51e9f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:51.923619 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80c89b57-22f8-410b-a0a7-7feab4a51e9f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:51.924081 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80c89b57-22f8-410b-a0a7-7feab4a51e9f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:51.924516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80c89b57-22f8-410b-a0a7-7feab4a51e9f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:52.053446 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-80c89b57-22f8-410b-a0a7-7feab4a51e9f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:52.061149 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-80c89b57-22f8-410b-a0a7-7feab4a51e9f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1569 microversion: 2.1 time: 0.151008 Oct 12 23:31:52.061723 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3673/8007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:51 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:53.085318 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-124e84c2-24c0-41ab-895d-8098dfe774a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:53.085886 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-124e84c2-24c0-41ab-895d-8098dfe774a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:53.092494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-124e84c2-24c0-41ab-895d-8098dfe774a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:53.092977 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-124e84c2-24c0-41ab-895d-8098dfe774a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:53.093422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-124e84c2-24c0-41ab-895d-8098dfe774a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:53.094117 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-124e84c2-24c0-41ab-895d-8098dfe774a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:53.094572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-124e84c2-24c0-41ab-895d-8098dfe774a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:53.095001 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-124e84c2-24c0-41ab-895d-8098dfe774a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:53.524429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-124e84c2-24c0-41ab-895d-8098dfe774a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:53.532190 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-124e84c2-24c0-41ab-895d-8098dfe774a3 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1569 microversion: 2.1 time: 0.451132 Oct 12 23:31:53.532765 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4335/8008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:53 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1569 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:54.556985 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-25a87c04-a55e-4735-9274-7575daf3d7a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:54.557618 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-25a87c04-a55e-4735-9274-7575daf3d7a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:54.564442 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25a87c04-a55e-4735-9274-7575daf3d7a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:54.564940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25a87c04-a55e-4735-9274-7575daf3d7a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:54.565389 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25a87c04-a55e-4735-9274-7575daf3d7a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:54.566097 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25a87c04-a55e-4735-9274-7575daf3d7a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:54.566562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25a87c04-a55e-4735-9274-7575daf3d7a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:54.567000 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25a87c04-a55e-4735-9274-7575daf3d7a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:54.719844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-25a87c04-a55e-4735-9274-7575daf3d7a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:54.728148 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-25a87c04-a55e-4735-9274-7575daf3d7a5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1569 microversion: 2.1 time: 0.175646 Oct 12 23:31:54.728720 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3674/8009] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:54 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:55.752061 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-6b4227f4-2c37-4403-a7b7-c58b59cf78c0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:55.752675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-6b4227f4-2c37-4403-a7b7-c58b59cf78c0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:55.759953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b4227f4-2c37-4403-a7b7-c58b59cf78c0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:55.760436 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b4227f4-2c37-4403-a7b7-c58b59cf78c0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:55.760869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b4227f4-2c37-4403-a7b7-c58b59cf78c0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:55.761560 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b4227f4-2c37-4403-a7b7-c58b59cf78c0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:55.762011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b4227f4-2c37-4403-a7b7-c58b59cf78c0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:55.762554 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-6b4227f4-2c37-4403-a7b7-c58b59cf78c0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:55.889668 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-6b4227f4-2c37-4403-a7b7-c58b59cf78c0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:55.897836 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-6b4227f4-2c37-4403-a7b7-c58b59cf78c0 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1569 microversion: 2.1 time: 0.149672 Oct 12 23:31:55.898407 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4336/8010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:55 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:56.921590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bb7789ac-2cbd-448a-8605-3ebf2c7f8afc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:56.922214 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bb7789ac-2cbd-448a-8605-3ebf2c7f8afc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:56.929611 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb7789ac-2cbd-448a-8605-3ebf2c7f8afc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:56.930105 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb7789ac-2cbd-448a-8605-3ebf2c7f8afc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:56.930554 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb7789ac-2cbd-448a-8605-3ebf2c7f8afc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:56.931283 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb7789ac-2cbd-448a-8605-3ebf2c7f8afc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:56.931746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb7789ac-2cbd-448a-8605-3ebf2c7f8afc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:56.932181 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb7789ac-2cbd-448a-8605-3ebf2c7f8afc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:57.064046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-bb7789ac-2cbd-448a-8605-3ebf2c7f8afc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:57.071994 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bb7789ac-2cbd-448a-8605-3ebf2c7f8afc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1569 microversion: 2.1 time: 0.154324 Oct 12 23:31:57.072563 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3675/8011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:56 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:58.095594 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-18c864e2-8bab-4626-952a-6bec0dc068f5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:58.096255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-18c864e2-8bab-4626-952a-6bec0dc068f5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:58.103805 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18c864e2-8bab-4626-952a-6bec0dc068f5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:58.104301 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18c864e2-8bab-4626-952a-6bec0dc068f5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:58.104779 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18c864e2-8bab-4626-952a-6bec0dc068f5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:58.105481 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18c864e2-8bab-4626-952a-6bec0dc068f5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:58.105973 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18c864e2-8bab-4626-952a-6bec0dc068f5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:58.106412 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-18c864e2-8bab-4626-952a-6bec0dc068f5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:58.244974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-18c864e2-8bab-4626-952a-6bec0dc068f5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:58.253161 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-18c864e2-8bab-4626-952a-6bec0dc068f5 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1569 microversion: 2.1 time: 0.161525 Oct 12 23:31:58.253725 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4337/8012] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:58 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:59.277035 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6bde79d7-83b4-4cf9-92ca-8567a78f2fe6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:59.277599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6bde79d7-83b4-4cf9-92ca-8567a78f2fe6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:59.284523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bde79d7-83b4-4cf9-92ca-8567a78f2fe6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:59.285020 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bde79d7-83b4-4cf9-92ca-8567a78f2fe6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:59.285477 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bde79d7-83b4-4cf9-92ca-8567a78f2fe6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:59.286182 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bde79d7-83b4-4cf9-92ca-8567a78f2fe6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:59.286650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bde79d7-83b4-4cf9-92ca-8567a78f2fe6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:59.287679 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6bde79d7-83b4-4cf9-92ca-8567a78f2fe6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:59.418138 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6bde79d7-83b4-4cf9-92ca-8567a78f2fe6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:59.426342 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6bde79d7-83b4-4cf9-92ca-8567a78f2fe6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1510 microversion: 2.1 time: 0.153209 Oct 12 23:31:59.426920 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3676/8013] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:59 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:59.434245 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-c175588a-c63a-48b0-a065-ca165e8525e3 req-69a67b01-7e32-48e4-9c38-e1a2dc22eb19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d36a1c-0077-4ede-8d85-97f69019309f", "name": "network-vif-unplugged", "status": "completed", "tag": "a9cb606a-ebf2-4f46-88c5-02dfc89d0c46"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:31:59.444703 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c175588a-c63a-48b0-a065-ca165e8525e3 req-69a67b01-7e32-48e4-9c38-e1a2dc22eb19 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:59.445183 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c175588a-c63a-48b0-a065-ca165e8525e3 req-69a67b01-7e32-48e4-9c38-e1a2dc22eb19 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:59.445623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c175588a-c63a-48b0-a065-ca165e8525e3 req-69a67b01-7e32-48e4-9c38-e1a2dc22eb19 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:59.452016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d7d665b9-9bf2-4f28-80d9-bf119c098be4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:31:59.452627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d7d665b9-9bf2-4f28-80d9-bf119c098be4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:59.457623 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.compute.server_external_events [req-c175588a-c63a-48b0-a065-ca165e8525e3 req-69a67b01-7e32-48e4-9c38-e1a2dc22eb19 service nova] Unable to find a host for instance 67d36a1c-0077-4ede-8d85-97f69019309f. Dropping event network-vif-unplugged {{(pid=120453) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 12 23:31:59.458523 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-c175588a-c63a-48b0-a065-ca165e8525e3 req-69a67b01-7e32-48e4-9c38-e1a2dc22eb19 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028774 Oct 12 23:31:59.459027 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7d665b9-9bf2-4f28-80d9-bf119c098be4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:59.459514 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4338/8014] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 12 23:31:59.459656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7d665b9-9bf2-4f28-80d9-bf119c098be4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:59.460031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7d665b9-9bf2-4f28-80d9-bf119c098be4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:59.460749 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7d665b9-9bf2-4f28-80d9-bf119c098be4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:59.461212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7d665b9-9bf2-4f28-80d9-bf119c098be4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:59.461653 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7d665b9-9bf2-4f28-80d9-bf119c098be4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:59.491543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d7d665b9-9bf2-4f28-80d9-bf119c098be4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120452) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 23:31:59.556146 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d7d665b9-9bf2-4f28-80d9-bf119c098be4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "POST /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f/action" status: 202 len: 0 microversion: 2.1 time: 0.108332 Oct 12 23:31:59.556685 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3677/8015] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:31:59 2022] POST /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 23:31:59.564880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-8f44df0a-1d62-41ab-abe1-ec403e4af082 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:59.565498 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-8f44df0a-1d62-41ab-abe1-ec403e4af082 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:59.571334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f44df0a-1d62-41ab-abe1-ec403e4af082 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:59.571817 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f44df0a-1d62-41ab-abe1-ec403e4af082 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:59.572255 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f44df0a-1d62-41ab-abe1-ec403e4af082 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:59.572943 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f44df0a-1d62-41ab-abe1-ec403e4af082 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:59.573393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f44df0a-1d62-41ab-abe1-ec403e4af082 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:59.573818 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-8f44df0a-1d62-41ab-abe1-ec403e4af082 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:59.742931 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-8f44df0a-1d62-41ab-abe1-ec403e4af082 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:59.751023 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-8f44df0a-1d62-41ab-abe1-ec403e4af082 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1518 microversion: 2.1 time: 0.190120 Oct 12 23:31:59.751642 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4339/8016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:59 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1518 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:32:00.775028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d15ce907-7cae-40e2-b889-d3b1e5899dc7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:00.775726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d15ce907-7cae-40e2-b889-d3b1e5899dc7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:00.781903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d15ce907-7cae-40e2-b889-d3b1e5899dc7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:00.782402 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d15ce907-7cae-40e2-b889-d3b1e5899dc7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:00.782857 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d15ce907-7cae-40e2-b889-d3b1e5899dc7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:00.783590 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d15ce907-7cae-40e2-b889-d3b1e5899dc7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:00.784104 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d15ce907-7cae-40e2-b889-d3b1e5899dc7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:00.784547 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d15ce907-7cae-40e2-b889-d3b1e5899dc7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:00.921797 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d15ce907-7cae-40e2-b889-d3b1e5899dc7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:00.930683 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d15ce907-7cae-40e2-b889-d3b1e5899dc7 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1520 microversion: 2.1 time: 0.160356 Oct 12 23:32:00.931295 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3678/8017] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:00 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:01.955319 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-dc8c67c7-abf7-4293-83d0-275cc20ef160 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:01.956002 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-dc8c67c7-abf7-4293-83d0-275cc20ef160 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:01.962822 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc8c67c7-abf7-4293-83d0-275cc20ef160 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:01.963335 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc8c67c7-abf7-4293-83d0-275cc20ef160 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:01.963781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc8c67c7-abf7-4293-83d0-275cc20ef160 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:01.964524 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc8c67c7-abf7-4293-83d0-275cc20ef160 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:01.965008 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc8c67c7-abf7-4293-83d0-275cc20ef160 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:01.965435 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-dc8c67c7-abf7-4293-83d0-275cc20ef160 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:02.097743 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-dc8c67c7-abf7-4293-83d0-275cc20ef160 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:02.105886 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-dc8c67c7-abf7-4293-83d0-275cc20ef160 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1520 microversion: 2.1 time: 0.154473 Oct 12 23:32:02.106467 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4340/8018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:01 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:03.129479 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-295d38e5-b0cb-4404-8e22-1c8bb8d51749 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:03.130014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-295d38e5-b0cb-4404-8e22-1c8bb8d51749 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:03.137702 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-295d38e5-b0cb-4404-8e22-1c8bb8d51749 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:03.138211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-295d38e5-b0cb-4404-8e22-1c8bb8d51749 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:03.138664 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-295d38e5-b0cb-4404-8e22-1c8bb8d51749 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:03.139418 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-295d38e5-b0cb-4404-8e22-1c8bb8d51749 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:03.139903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-295d38e5-b0cb-4404-8e22-1c8bb8d51749 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:03.140353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-295d38e5-b0cb-4404-8e22-1c8bb8d51749 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:03.278509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-295d38e5-b0cb-4404-8e22-1c8bb8d51749 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:03.286447 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-295d38e5-b0cb-4404-8e22-1c8bb8d51749 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1520 microversion: 2.1 time: 0.160941 Oct 12 23:32:03.287060 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3679/8019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:03 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:04.310063 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ab5e87bd-a4fd-49d1-afb8-1a8f2299a4cb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:04.310621 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ab5e87bd-a4fd-49d1-afb8-1a8f2299a4cb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:04.317489 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab5e87bd-a4fd-49d1-afb8-1a8f2299a4cb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:04.317972 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab5e87bd-a4fd-49d1-afb8-1a8f2299a4cb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:04.318410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab5e87bd-a4fd-49d1-afb8-1a8f2299a4cb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:04.319107 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab5e87bd-a4fd-49d1-afb8-1a8f2299a4cb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:04.319588 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab5e87bd-a4fd-49d1-afb8-1a8f2299a4cb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:04.320024 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ab5e87bd-a4fd-49d1-afb8-1a8f2299a4cb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:04.460334 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ab5e87bd-a4fd-49d1-afb8-1a8f2299a4cb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:04.468664 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ab5e87bd-a4fd-49d1-afb8-1a8f2299a4cb tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1520 microversion: 2.1 time: 0.162146 Oct 12 23:32:04.469257 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4341/8020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:04 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:05.492940 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dc98e21c-6d29-4ebd-9110-66a22ee2cde1 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:05.493570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dc98e21c-6d29-4ebd-9110-66a22ee2cde1 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:05.500523 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc98e21c-6d29-4ebd-9110-66a22ee2cde1 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:05.501137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc98e21c-6d29-4ebd-9110-66a22ee2cde1 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:05.501464 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc98e21c-6d29-4ebd-9110-66a22ee2cde1 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:05.502168 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc98e21c-6d29-4ebd-9110-66a22ee2cde1 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:05.502726 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc98e21c-6d29-4ebd-9110-66a22ee2cde1 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:05.503170 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc98e21c-6d29-4ebd-9110-66a22ee2cde1 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:05.735492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-dc98e21c-6d29-4ebd-9110-66a22ee2cde1 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:05.743302 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dc98e21c-6d29-4ebd-9110-66a22ee2cde1 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1576 microversion: 2.1 time: 0.255074 Oct 12 23:32:05.743887 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3680/8021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:05 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1576 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:06.347797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-a462c470-5751-44ad-83b0-1cb20d24fcad req-a33c9c5a-840c-46e3-8811-aefac0f48db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67d36a1c-0077-4ede-8d85-97f69019309f", "tag": "a9cb606a-ebf2-4f46-88c5-02dfc89d0c46"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:32:06.360188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a462c470-5751-44ad-83b0-1cb20d24fcad req-a33c9c5a-840c-46e3-8811-aefac0f48db9 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:06.360662 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a462c470-5751-44ad-83b0-1cb20d24fcad req-a33c9c5a-840c-46e3-8811-aefac0f48db9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:06.361088 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-a462c470-5751-44ad-83b0-1cb20d24fcad req-a33c9c5a-840c-46e3-8811-aefac0f48db9 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:06.373332 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-a462c470-5751-44ad-83b0-1cb20d24fcad req-a33c9c5a-840c-46e3-8811-aefac0f48db9 service nova] Creating event network-changed:a9cb606a-ebf2-4f46-88c5-02dfc89d0c46 for instance 67d36a1c-0077-4ede-8d85-97f69019309f on n-h2-861111-1 Oct 12 23:32:06.378593 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-a462c470-5751-44ad-83b0-1cb20d24fcad req-a33c9c5a-840c-46e3-8811-aefac0f48db9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034822 Oct 12 23:32:06.379199 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4342/8022] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:32:06.766302 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-716c663b-143a-451c-9381-263251436288 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:06.766934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-716c663b-143a-451c-9381-263251436288 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:06.773922 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716c663b-143a-451c-9381-263251436288 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:06.774489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716c663b-143a-451c-9381-263251436288 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:06.775033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716c663b-143a-451c-9381-263251436288 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:06.776210 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716c663b-143a-451c-9381-263251436288 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:06.776984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716c663b-143a-451c-9381-263251436288 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:06.777488 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-716c663b-143a-451c-9381-263251436288 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:06.950387 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-716c663b-143a-451c-9381-263251436288 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:06.958160 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-716c663b-143a-451c-9381-263251436288 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1576 microversion: 2.1 time: 0.195761 Oct 12 23:32:06.958767 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3681/8023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:06 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:07.982919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-7e4ac771-ec9b-4c8b-b953-67e64444a5dd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:07.983681 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-7e4ac771-ec9b-4c8b-b953-67e64444a5dd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:07.990699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e4ac771-ec9b-4c8b-b953-67e64444a5dd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:07.991194 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e4ac771-ec9b-4c8b-b953-67e64444a5dd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:07.991663 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e4ac771-ec9b-4c8b-b953-67e64444a5dd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:07.992369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e4ac771-ec9b-4c8b-b953-67e64444a5dd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:07.992838 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e4ac771-ec9b-4c8b-b953-67e64444a5dd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:07.993267 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-7e4ac771-ec9b-4c8b-b953-67e64444a5dd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:08.124581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-7e4ac771-ec9b-4c8b-b953-67e64444a5dd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:08.133488 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-7e4ac771-ec9b-4c8b-b953-67e64444a5dd tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1576 microversion: 2.1 time: 0.155677 Oct 12 23:32:08.134076 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4343/8024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:07 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:09.157088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7eee1656-bc72-43b4-9d89-e11a1701ced2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:09.157665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7eee1656-bc72-43b4-9d89-e11a1701ced2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:09.164999 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7eee1656-bc72-43b4-9d89-e11a1701ced2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:09.165495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7eee1656-bc72-43b4-9d89-e11a1701ced2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:09.165943 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7eee1656-bc72-43b4-9d89-e11a1701ced2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:09.166647 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7eee1656-bc72-43b4-9d89-e11a1701ced2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:09.167116 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7eee1656-bc72-43b4-9d89-e11a1701ced2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:09.167579 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7eee1656-bc72-43b4-9d89-e11a1701ced2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:09.185697 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:32:09.302167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7eee1656-bc72-43b4-9d89-e11a1701ced2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:09.310268 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7eee1656-bc72-43b4-9d89-e11a1701ced2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1576 microversion: 2.1 time: 0.157199 Oct 12 23:32:09.310840 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3682/8025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:09 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:10.335265 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-11bbcdf9-2e1b-44b3-8ef7-67f1096577f6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:10.335824 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-11bbcdf9-2e1b-44b3-8ef7-67f1096577f6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:10.342684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11bbcdf9-2e1b-44b3-8ef7-67f1096577f6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:10.343177 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11bbcdf9-2e1b-44b3-8ef7-67f1096577f6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:10.343733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11bbcdf9-2e1b-44b3-8ef7-67f1096577f6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:10.344869 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11bbcdf9-2e1b-44b3-8ef7-67f1096577f6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:10.345521 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11bbcdf9-2e1b-44b3-8ef7-67f1096577f6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:10.346149 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-11bbcdf9-2e1b-44b3-8ef7-67f1096577f6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:10.483165 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-11bbcdf9-2e1b-44b3-8ef7-67f1096577f6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:10.491953 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-11bbcdf9-2e1b-44b3-8ef7-67f1096577f6 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1576 microversion: 2.1 time: 0.162267 Oct 12 23:32:10.492528 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4344/8026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:10 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:11.516582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ea6fec8b-50b2-4249-a185-dbd409f0220e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:11.517211 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ea6fec8b-50b2-4249-a185-dbd409f0220e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:11.524117 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea6fec8b-50b2-4249-a185-dbd409f0220e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:11.524615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea6fec8b-50b2-4249-a185-dbd409f0220e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:11.525069 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea6fec8b-50b2-4249-a185-dbd409f0220e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:11.525770 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea6fec8b-50b2-4249-a185-dbd409f0220e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:11.526236 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea6fec8b-50b2-4249-a185-dbd409f0220e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:11.526680 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ea6fec8b-50b2-4249-a185-dbd409f0220e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:11.654956 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ea6fec8b-50b2-4249-a185-dbd409f0220e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:11.662730 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ea6fec8b-50b2-4249-a185-dbd409f0220e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1576 microversion: 2.1 time: 0.150111 Oct 12 23:32:11.663352 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3683/8027] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:11 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:12.686102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-50c28074-1939-4ae7-a958-67ba53837ecf tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:12.686774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-50c28074-1939-4ae7-a958-67ba53837ecf tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:12.694074 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50c28074-1939-4ae7-a958-67ba53837ecf tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:12.694567 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50c28074-1939-4ae7-a958-67ba53837ecf tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:12.695004 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50c28074-1939-4ae7-a958-67ba53837ecf tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:12.695722 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50c28074-1939-4ae7-a958-67ba53837ecf tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:12.696176 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50c28074-1939-4ae7-a958-67ba53837ecf tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:12.696606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-50c28074-1939-4ae7-a958-67ba53837ecf tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:12.826503 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-50c28074-1939-4ae7-a958-67ba53837ecf tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:12.834879 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-50c28074-1939-4ae7-a958-67ba53837ecf tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1576 microversion: 2.1 time: 0.152753 Oct 12 23:32:12.835482 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4345/8028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:12 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:13.858044 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-74537bbd-7e4b-4a66-8052-d4dcd4bd23a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:13.858665 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-74537bbd-7e4b-4a66-8052-d4dcd4bd23a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:13.861353 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:32:13.867500 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74537bbd-7e4b-4a66-8052-d4dcd4bd23a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:13.867983 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74537bbd-7e4b-4a66-8052-d4dcd4bd23a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:13.868425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74537bbd-7e4b-4a66-8052-d4dcd4bd23a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:13.869122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74537bbd-7e4b-4a66-8052-d4dcd4bd23a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:13.869582 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74537bbd-7e4b-4a66-8052-d4dcd4bd23a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:13.870014 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-74537bbd-7e4b-4a66-8052-d4dcd4bd23a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:14.001748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-74537bbd-7e4b-4a66-8052-d4dcd4bd23a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:14.009771 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-74537bbd-7e4b-4a66-8052-d4dcd4bd23a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1576 microversion: 2.1 time: 0.155750 Oct 12 23:32:14.010333 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3684/8029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:13 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:15.034148 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f6a27984-0a3f-4746-8926-164e90d1e507 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:15.034757 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f6a27984-0a3f-4746-8926-164e90d1e507 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:15.038030 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=31 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:32:15.043397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6a27984-0a3f-4746-8926-164e90d1e507 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:15.043874 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6a27984-0a3f-4746-8926-164e90d1e507 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:15.044309 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6a27984-0a3f-4746-8926-164e90d1e507 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:15.044997 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6a27984-0a3f-4746-8926-164e90d1e507 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:15.045452 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6a27984-0a3f-4746-8926-164e90d1e507 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:15.045875 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f6a27984-0a3f-4746-8926-164e90d1e507 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:15.049774 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=83 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:32:15.176466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-f6a27984-0a3f-4746-8926-164e90d1e507 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:15.185266 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f6a27984-0a3f-4746-8926-164e90d1e507 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1576 microversion: 2.1 time: 0.155080 Oct 12 23:32:15.185854 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4346/8030] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:15 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:16.208416 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d6416ad4-f5a0-411b-9192-c2e6ed3f511f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:16.209048 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d6416ad4-f5a0-411b-9192-c2e6ed3f511f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:16.215082 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6416ad4-f5a0-411b-9192-c2e6ed3f511f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:16.215615 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6416ad4-f5a0-411b-9192-c2e6ed3f511f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:16.216067 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6416ad4-f5a0-411b-9192-c2e6ed3f511f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:16.216763 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6416ad4-f5a0-411b-9192-c2e6ed3f511f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:16.217244 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6416ad4-f5a0-411b-9192-c2e6ed3f511f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:16.217658 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6416ad4-f5a0-411b-9192-c2e6ed3f511f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:16.348870 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-d6416ad4-f5a0-411b-9192-c2e6ed3f511f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:16.356739 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d6416ad4-f5a0-411b-9192-c2e6ed3f511f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1576 microversion: 2.1 time: 0.152565 Oct 12 23:32:16.357328 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3685/8031] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:16 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:17.381880 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-17059c13-7de0-4f0c-b9ae-182b128c8d9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:17.382433 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-17059c13-7de0-4f0c-b9ae-182b128c8d9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:17.388781 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17059c13-7de0-4f0c-b9ae-182b128c8d9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:17.389268 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17059c13-7de0-4f0c-b9ae-182b128c8d9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:17.389708 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17059c13-7de0-4f0c-b9ae-182b128c8d9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:17.390402 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17059c13-7de0-4f0c-b9ae-182b128c8d9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:17.390857 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17059c13-7de0-4f0c-b9ae-182b128c8d9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:17.391337 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-17059c13-7de0-4f0c-b9ae-182b128c8d9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:17.527789 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-17059c13-7de0-4f0c-b9ae-182b128c8d9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:17.535851 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-17059c13-7de0-4f0c-b9ae-182b128c8d9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1576 microversion: 2.1 time: 0.158781 Oct 12 23:32:17.536494 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4347/8032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:17 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:18.072855 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-96b43c78-ae4d-4c87-9c18-381060a73156 req-22fe6e44-1ced-4d84-a7b6-5ff85c666203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d36a1c-0077-4ede-8d85-97f69019309f", "name": "network-vif-plugged", "status": "completed", "tag": "a9cb606a-ebf2-4f46-88c5-02dfc89d0c46"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:32:18.084517 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-96b43c78-ae4d-4c87-9c18-381060a73156 req-22fe6e44-1ced-4d84-a7b6-5ff85c666203 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:18.085032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-96b43c78-ae4d-4c87-9c18-381060a73156 req-22fe6e44-1ced-4d84-a7b6-5ff85c666203 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:18.085482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-96b43c78-ae4d-4c87-9c18-381060a73156 req-22fe6e44-1ced-4d84-a7b6-5ff85c666203 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:18.097921 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-96b43c78-ae4d-4c87-9c18-381060a73156 req-22fe6e44-1ced-4d84-a7b6-5ff85c666203 service nova] Creating event network-vif-plugged:a9cb606a-ebf2-4f46-88c5-02dfc89d0c46 for instance 67d36a1c-0077-4ede-8d85-97f69019309f on n-h2-861111-1 Oct 12 23:32:18.104002 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-96b43c78-ae4d-4c87-9c18-381060a73156 req-22fe6e44-1ced-4d84-a7b6-5ff85c666203 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035363 Oct 12 23:32:18.104934 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3686/8033] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:32:18.559542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-a35c15fc-7336-479a-b580-c1b75f667c7f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:18.560235 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-a35c15fc-7336-479a-b580-c1b75f667c7f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:18.567378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35c15fc-7336-479a-b580-c1b75f667c7f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:18.567867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35c15fc-7336-479a-b580-c1b75f667c7f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:18.568304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35c15fc-7336-479a-b580-c1b75f667c7f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:18.569055 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35c15fc-7336-479a-b580-c1b75f667c7f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:18.569519 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35c15fc-7336-479a-b580-c1b75f667c7f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:18.569946 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-a35c15fc-7336-479a-b580-c1b75f667c7f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:18.699617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-a35c15fc-7336-479a-b580-c1b75f667c7f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:18.707549 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-a35c15fc-7336-479a-b580-c1b75f667c7f tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1576 microversion: 2.1 time: 0.152044 Oct 12 23:32:18.708779 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4348/8034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:18 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:19.733052 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b26ac922-a348-4fd0-a0f8-2605d8c331a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:19.733765 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b26ac922-a348-4fd0-a0f8-2605d8c331a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:19.740494 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b26ac922-a348-4fd0-a0f8-2605d8c331a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:19.740986 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b26ac922-a348-4fd0-a0f8-2605d8c331a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:19.741435 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b26ac922-a348-4fd0-a0f8-2605d8c331a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:19.742131 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b26ac922-a348-4fd0-a0f8-2605d8c331a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:19.742593 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b26ac922-a348-4fd0-a0f8-2605d8c331a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:19.743030 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b26ac922-a348-4fd0-a0f8-2605d8c331a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:19.883717 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-b26ac922-a348-4fd0-a0f8-2605d8c331a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:19.891582 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b26ac922-a348-4fd0-a0f8-2605d8c331a2 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1563 microversion: 2.1 time: 0.163596 Oct 12 23:32:19.892164 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3687/8035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:19 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:33.510870 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=5 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:33.514984 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=7 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:33.515929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=28 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:33.516728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=17 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:33.522683 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-54c0b9f2-4bb9-49df-a05b-ca963eef2854 req-02db2fc9-03d8-4b22-acf5-4d549b2cff29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67d36a1c-0077-4ede-8d85-97f69019309f", "tag": "a9cb606a-ebf2-4f46-88c5-02dfc89d0c46"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:33:33.534298 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-54c0b9f2-4bb9-49df-a05b-ca963eef2854 req-02db2fc9-03d8-4b22-acf5-4d549b2cff29 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:33.534883 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-54c0b9f2-4bb9-49df-a05b-ca963eef2854 req-02db2fc9-03d8-4b22-acf5-4d549b2cff29 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:33.535374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-54c0b9f2-4bb9-49df-a05b-ca963eef2854 req-02db2fc9-03d8-4b22-acf5-4d549b2cff29 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:33.535753 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-36a61d79-f80a-490e-a887-2215e26a4c13 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:33.536250 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-36a61d79-f80a-490e-a887-2215e26a4c13 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:33.543365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36a61d79-f80a-490e-a887-2215e26a4c13 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:33.544102 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36a61d79-f80a-490e-a887-2215e26a4c13 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:33.544741 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36a61d79-f80a-490e-a887-2215e26a4c13 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:33.545446 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36a61d79-f80a-490e-a887-2215e26a4c13 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:33.545899 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36a61d79-f80a-490e-a887-2215e26a4c13 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:33.546453 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-36a61d79-f80a-490e-a887-2215e26a4c13 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:33.547092 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-54c0b9f2-4bb9-49df-a05b-ca963eef2854 req-02db2fc9-03d8-4b22-acf5-4d549b2cff29 service nova] Creating event network-changed:a9cb606a-ebf2-4f46-88c5-02dfc89d0c46 for instance 67d36a1c-0077-4ede-8d85-97f69019309f on n-h2-861111-1 Oct 12 23:33:33.552264 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-54c0b9f2-4bb9-49df-a05b-ca963eef2854 req-02db2fc9-03d8-4b22-acf5-4d549b2cff29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039361 Oct 12 23:33:33.552869 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3688/8036] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:33:33.575299 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-36a61d79-f80a-490e-a887-2215e26a4c13 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Going to try to terminate instance {{(pid=120453) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:33:33.669964 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-36a61d79-f80a-490e-a887-2215e26a4c13 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "DELETE /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 204 len: 0 microversion: 2.1 time: 0.161129 Oct 12 23:33:33.670959 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4349/8037] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:33:33 2022] DELETE /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:33:33.680146 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-07df21e1-27dd-4c34-bebe-299decdb0241 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:33.681674 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-07df21e1-27dd-4c34-bebe-299decdb0241 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:33.688550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07df21e1-27dd-4c34-bebe-299decdb0241 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:33.689208 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07df21e1-27dd-4c34-bebe-299decdb0241 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:33.689947 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07df21e1-27dd-4c34-bebe-299decdb0241 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:33.690777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07df21e1-27dd-4c34-bebe-299decdb0241 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:33.691515 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07df21e1-27dd-4c34-bebe-299decdb0241 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:33.692057 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07df21e1-27dd-4c34-bebe-299decdb0241 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:33.841750 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-07df21e1-27dd-4c34-bebe-299decdb0241 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:33.849737 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-07df21e1-27dd-4c34-bebe-299decdb0241 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1569 microversion: 2.1 time: 0.173958 Oct 12 23:33:33.850310 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3689/8038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:33 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:34.873756 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e85c40eb-6578-4cba-b91d-21ad3f28cc39 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:34.874456 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e85c40eb-6578-4cba-b91d-21ad3f28cc39 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:34.881362 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e85c40eb-6578-4cba-b91d-21ad3f28cc39 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:34.882095 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e85c40eb-6578-4cba-b91d-21ad3f28cc39 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:34.882529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e85c40eb-6578-4cba-b91d-21ad3f28cc39 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:34.883216 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e85c40eb-6578-4cba-b91d-21ad3f28cc39 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:34.883686 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e85c40eb-6578-4cba-b91d-21ad3f28cc39 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:34.884633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e85c40eb-6578-4cba-b91d-21ad3f28cc39 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:35.021039 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e85c40eb-6578-4cba-b91d-21ad3f28cc39 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:35.029614 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e85c40eb-6578-4cba-b91d-21ad3f28cc39 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1569 microversion: 2.1 time: 0.160091 Oct 12 23:33:35.030194 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4350/8039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:34 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:35.740686 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-7eb73ee2-1b3a-47cb-9adf-759d3440a8dc req-b154eef8-aacb-46cb-8aa9-caddad04f6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d36a1c-0077-4ede-8d85-97f69019309f", "name": "network-vif-deleted", "tag": "a9cb606a-ebf2-4f46-88c5-02dfc89d0c46"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:33:35.754126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7eb73ee2-1b3a-47cb-9adf-759d3440a8dc req-b154eef8-aacb-46cb-8aa9-caddad04f6ac service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:35.754896 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7eb73ee2-1b3a-47cb-9adf-759d3440a8dc req-b154eef8-aacb-46cb-8aa9-caddad04f6ac service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:35.755367 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7eb73ee2-1b3a-47cb-9adf-759d3440a8dc req-b154eef8-aacb-46cb-8aa9-caddad04f6ac service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:35.769256 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-7eb73ee2-1b3a-47cb-9adf-759d3440a8dc req-b154eef8-aacb-46cb-8aa9-caddad04f6ac service nova] Creating event network-vif-deleted:a9cb606a-ebf2-4f46-88c5-02dfc89d0c46 for instance 67d36a1c-0077-4ede-8d85-97f69019309f on n-h2-861111-1 Oct 12 23:33:35.778054 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-7eb73ee2-1b3a-47cb-9adf-759d3440a8dc req-b154eef8-aacb-46cb-8aa9-caddad04f6ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041664 Oct 12 23:33:35.778810 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3690/8040] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:33:36.053591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-65f5a1d9-9931-432a-886f-37ad23e9722d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:36.055098 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-65f5a1d9-9931-432a-886f-37ad23e9722d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:36.062891 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65f5a1d9-9931-432a-886f-37ad23e9722d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:36.063504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65f5a1d9-9931-432a-886f-37ad23e9722d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:36.064020 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65f5a1d9-9931-432a-886f-37ad23e9722d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:36.064842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65f5a1d9-9931-432a-886f-37ad23e9722d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:36.065374 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65f5a1d9-9931-432a-886f-37ad23e9722d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:36.065897 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-65f5a1d9-9931-432a-886f-37ad23e9722d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:36.130961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-65f5a1d9-9931-432a-886f-37ad23e9722d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:36.140268 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-65f5a1d9-9931-432a-886f-37ad23e9722d tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1219 microversion: 2.1 time: 0.090746 Oct 12 23:33:36.140968 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4351/8041] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:36 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:37.165516 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-48fc4b13-78bf-49e8-b081-4c5ad74f34cc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:37.166321 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-48fc4b13-78bf-49e8-b081-4c5ad74f34cc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:37.173426 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48fc4b13-78bf-49e8-b081-4c5ad74f34cc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:37.173925 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48fc4b13-78bf-49e8-b081-4c5ad74f34cc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:37.174377 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48fc4b13-78bf-49e8-b081-4c5ad74f34cc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:37.175088 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48fc4b13-78bf-49e8-b081-4c5ad74f34cc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:37.175661 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48fc4b13-78bf-49e8-b081-4c5ad74f34cc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:37.176101 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48fc4b13-78bf-49e8-b081-4c5ad74f34cc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:37.239617 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-48fc4b13-78bf-49e8-b081-4c5ad74f34cc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:37.248211 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-48fc4b13-78bf-49e8-b081-4c5ad74f34cc tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1219 microversion: 2.1 time: 0.087486 Oct 12 23:33:37.248797 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3691/8042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:37 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:38.271581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-ea7f24fe-d474-4ffe-9c98-6c67c1126707 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:38.272192 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-ea7f24fe-d474-4ffe-9c98-6c67c1126707 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:38.279501 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea7f24fe-d474-4ffe-9c98-6c67c1126707 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:38.279980 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea7f24fe-d474-4ffe-9c98-6c67c1126707 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:38.280413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea7f24fe-d474-4ffe-9c98-6c67c1126707 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:38.281133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea7f24fe-d474-4ffe-9c98-6c67c1126707 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:38.281586 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea7f24fe-d474-4ffe-9c98-6c67c1126707 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:38.282011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-ea7f24fe-d474-4ffe-9c98-6c67c1126707 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:38.355847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-ea7f24fe-d474-4ffe-9c98-6c67c1126707 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:38.364727 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-ea7f24fe-d474-4ffe-9c98-6c67c1126707 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1219 microversion: 2.1 time: 0.096903 Oct 12 23:33:38.365477 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4352/8043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:38 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:39.388474 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c17aa773-b063-4e9c-80de-92333584583b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:39.389213 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c17aa773-b063-4e9c-80de-92333584583b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:39.395997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c17aa773-b063-4e9c-80de-92333584583b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:39.396492 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c17aa773-b063-4e9c-80de-92333584583b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:39.396934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c17aa773-b063-4e9c-80de-92333584583b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:39.397632 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c17aa773-b063-4e9c-80de-92333584583b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:39.398094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c17aa773-b063-4e9c-80de-92333584583b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:39.398527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c17aa773-b063-4e9c-80de-92333584583b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:39.461893 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c17aa773-b063-4e9c-80de-92333584583b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad65c86847048f987704ba020d2a6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c668c00d36b49829ad8de2181ec0237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:39.469814 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c17aa773-b063-4e9c-80de-92333584583b tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 200 len: 1219 microversion: 2.1 time: 0.085225 Oct 12 23:33:39.470389 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3692/8044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:39 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:40.494429 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-431757fd-08fc-4dba-966e-9c675848ab9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:40.495057 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-431757fd-08fc-4dba-966e-9c675848ab9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] [instance: 67d36a1c-0077-4ede-8d85-97f69019309f] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:40.502015 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-431757fd-08fc-4dba-966e-9c675848ab9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:40.502517 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-431757fd-08fc-4dba-966e-9c675848ab9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:40.502960 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-431757fd-08fc-4dba-966e-9c675848ab9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:40.503725 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-431757fd-08fc-4dba-966e-9c675848ab9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:40.504304 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-431757fd-08fc-4dba-966e-9c675848ab9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:40.504746 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-431757fd-08fc-4dba-966e-9c675848ab9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:40.521919 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-431757fd-08fc-4dba-966e-9c675848ab9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] HTTP exception thrown: Instance 67d36a1c-0077-4ede-8d85-97f69019309f could not be found. Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-431757fd-08fc-4dba-966e-9c675848ab9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Request method failure captured: Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f HTTP/1.1 Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR0x7gmi6nShYv1ypG8lNuw62s0LMtqTMp7E6Aszeu8WizOjmwdZQ-b3a3w-sZ2OY6nEKV25DmEj-ChPdKCpz1YIX4OgMK9Q6vSNFvVvl-0-XqrNpep9R2arqH6waTgcGduJS0r2oqgpljDYCqL2e4-6l1tzRq7wfp7r9lmfy1aO2deg Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 7c668c00d36b49829ad8de2181ec0237 Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestShelveInstance-1033860207 Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c668c00d36b49829ad8de2181ec0237"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c668c00d36b49829ad8de2181ec0237"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7c668c00d36b49829ad8de2181ec0237", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7c668c00d36b49829ad8de2181ec0237"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestShelveInstance-1033860207 Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 7c668c00d36b49829ad8de2181ec0237 Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestShelveInstance-1033860207 Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestShelveInstance-1033860207-project Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 4ad65c86847048f987704ba020d2a6ac Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestShelveInstance-1033860207-project Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 67d36a1c-0077-4ede-8d85-97f69019309f could not be found. Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '67d36a1c-0077-4ede-8d85-97f69019309f'} Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67d36a1c-0077-4ede-8d85-97f69019309f could not be found. Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67d36a1c-0077-4ede-8d85-97f69019309f could not be found. Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:33:40.523629 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:33:40.528649 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:33:40.528649 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:33:40.528649 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:33:40.528649 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:33:40.528649 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:33:40.528649 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67d36a1c-0077-4ede-8d85-97f69019309f could not be found. Oct 12 23:33:40.528649 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:33:40.528649 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-431757fd-08fc-4dba-966e-9c675848ab9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Returning 404 to user: Instance 67d36a1c-0077-4ede-8d85-97f69019309f could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:33:40.528649 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-431757fd-08fc-4dba-966e-9c675848ab9e tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f" status: 404 len: 111 microversion: 2.1 time: 0.035435 Oct 12 23:33:40.528649 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4353/8045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:40 2022] GET /compute/v2.1/servers/67d36a1c-0077-4ede-8d85-97f69019309f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:33:40.697222 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-766971ae-80a8-4749-8e96-9686617f62f4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] Calling method '.version_select at 0x7f51230e6e50>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:40.730983 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-766971ae-80a8-4749-8e96-9686617f62f4 tempest-TestShelveInstance-1033860207 tempest-TestShelveInstance-1033860207-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-295732995" status: 202 len: 0 microversion: 2.1 time: 0.038283 Oct 12 23:33:40.731892 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3693/8046] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 12 23:33:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-295732995 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 23:33:58.069733 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:58.071342 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:58.271871 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-0b84edcc-b664-4c86-9107-e96e382d75eb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Action: 'create', calling method: .version_select at 0x7f5122b65c10>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-2011527841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPM3QKMgkvgTNEBA+0mlqRY41Z8nRPl+WC+WMjObfZIU8yJsbCTwOs9Dxlplt8f++Z8Mo5q6s8jUfI6e8kj0CbHo1gt2oKtj1t66tQGM4EtfNzcEhR+4NduAT+vXZZb9Yg=="}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:33:58.288073 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-0b84edcc-b664-4c86-9107-e96e382d75eb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Getting quotas for project 92a5a6a7bc2e4fb59b97d6958853a839. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:33:58.294096 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-0b84edcc-b664-4c86-9107-e96e382d75eb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Getting quotas for user 56d4803b73634cba99bdef0b4f7345c7 and project 92a5a6a7bc2e4fb59b97d6958853a839. Resources: {'key_pairs'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:33:58.326865 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-0b84edcc-b664-4c86-9107-e96e382d75eb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.262244 Oct 12 23:33:58.327600 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4354/8047] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 12 23:33:58 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:33:59.361539 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1816390800", "imageRef": "d1e68057-c368-47a5-ab06-787819be7f9c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2011527841", "security_groups": [{"name": "tempest-secgroup-smoke-1673519418"}], "networks": [{"uuid": "928643b3-7b49-47f1-8776-a4ee0f14e567"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:33:59.375689 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=22 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:59.376355 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:59.484462 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] validate_networks() for [('928643b3-7b49-47f1-8776-a4ee0f14e567', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:34:00.005562 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:34:00.006032 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:34:00.006979 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:34:00.007453 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:34:00.007897 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:34:00.017714 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:00.018217 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:00.018675 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:00.019678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:00.020152 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:00.020600 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:00.038252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Getting quotas for project 92a5a6a7bc2e4fb59b97d6958853a839. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:34:00.043733 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.quota [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Getting quotas for user 56d4803b73634cba99bdef0b4f7345c7 and project 92a5a6a7bc2e4fb59b97d6958853a839. Resources: {'ram', 'cores', 'instances'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:34:00.057543 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:34:00.059951 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1e68057-c368-47a5-ab06-787819be7f9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:34:00.107269 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a82531c4-4b01-40f9-8b21-14d0a870d0cb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.749701 Oct 12 23:34:00.107938 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3694/8048] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 23:33:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:34:00.120700 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-29acaf5b-b57f-4fd4-98b3-97afd5a0a685 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:00.121942 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-29acaf5b-b57f-4fd4-98b3-97afd5a0a685 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:00.198240 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-29acaf5b-b57f-4fd4-98b3-97afd5a0a685 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:00.207791 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-29acaf5b-b57f-4fd4-98b3-97afd5a0a685 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e" status: 200 len: 1249 microversion: 2.1 time: 0.092336 Oct 12 23:34:00.208735 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4355/8049] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:00 2022] GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e => generated 1249 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:01.234252 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-21e6e17b-897b-4d9e-a2c8-41715dd3203d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:01.234996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-21e6e17b-897b-4d9e-a2c8-41715dd3203d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:01.249957 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21e6e17b-897b-4d9e-a2c8-41715dd3203d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:01.250863 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21e6e17b-897b-4d9e-a2c8-41715dd3203d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:01.251564 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21e6e17b-897b-4d9e-a2c8-41715dd3203d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:01.253333 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21e6e17b-897b-4d9e-a2c8-41715dd3203d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:01.254017 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21e6e17b-897b-4d9e-a2c8-41715dd3203d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:01.255050 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-21e6e17b-897b-4d9e-a2c8-41715dd3203d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:01.344873 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-21e6e17b-897b-4d9e-a2c8-41715dd3203d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:01.353562 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-21e6e17b-897b-4d9e-a2c8-41715dd3203d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e" status: 200 len: 1319 microversion: 2.1 time: 0.127259 Oct 12 23:34:01.354399 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3695/8050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:01 2022] GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e => generated 1319 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:02.381440 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d3ecf5f1-0c39-47e5-877b-0a45984e7a57 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:02.383393 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d3ecf5f1-0c39-47e5-877b-0a45984e7a57 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:02.393451 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3ecf5f1-0c39-47e5-877b-0a45984e7a57 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:02.394005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3ecf5f1-0c39-47e5-877b-0a45984e7a57 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:02.394492 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3ecf5f1-0c39-47e5-877b-0a45984e7a57 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:02.395413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3ecf5f1-0c39-47e5-877b-0a45984e7a57 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:02.395930 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3ecf5f1-0c39-47e5-877b-0a45984e7a57 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:02.396371 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d3ecf5f1-0c39-47e5-877b-0a45984e7a57 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:02.541291 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d3ecf5f1-0c39-47e5-877b-0a45984e7a57 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:02.549522 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d3ecf5f1-0c39-47e5-877b-0a45984e7a57 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e" status: 200 len: 1375 microversion: 2.1 time: 0.173396 Oct 12 23:34:02.550120 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4356/8051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:02 2022] GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:02.687286 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-0b9a8276-3970-4aae-978f-a9218b380765 req-7dea28d5-d9ea-49cd-a0c7-aa60fd8cdc4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe98d4d-a99b-445c-bb77-6c54b31d719e", "tag": "dfabae8b-668d-4e23-8899-72ec616dd60f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:34:02.698833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0b9a8276-3970-4aae-978f-a9218b380765 req-7dea28d5-d9ea-49cd-a0c7-aa60fd8cdc4b service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:02.699352 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0b9a8276-3970-4aae-978f-a9218b380765 req-7dea28d5-d9ea-49cd-a0c7-aa60fd8cdc4b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:02.699793 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-0b9a8276-3970-4aae-978f-a9218b380765 req-7dea28d5-d9ea-49cd-a0c7-aa60fd8cdc4b service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:02.711809 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-0b9a8276-3970-4aae-978f-a9218b380765 req-7dea28d5-d9ea-49cd-a0c7-aa60fd8cdc4b service nova] Creating event network-changed:dfabae8b-668d-4e23-8899-72ec616dd60f for instance afe98d4d-a99b-445c-bb77-6c54b31d719e on n-h2-861111-1 Oct 12 23:34:02.716604 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-0b9a8276-3970-4aae-978f-a9218b380765 req-7dea28d5-d9ea-49cd-a0c7-aa60fd8cdc4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032999 Oct 12 23:34:02.717197 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3696/8052] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:34:03.573408 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d45587db-f654-4c0a-aab1-49b0ee1c319a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:03.574050 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d45587db-f654-4c0a-aab1-49b0ee1c319a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:03.580944 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d45587db-f654-4c0a-aab1-49b0ee1c319a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:03.581424 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d45587db-f654-4c0a-aab1-49b0ee1c319a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:03.581854 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d45587db-f654-4c0a-aab1-49b0ee1c319a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:03.582538 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d45587db-f654-4c0a-aab1-49b0ee1c319a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:03.582993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d45587db-f654-4c0a-aab1-49b0ee1c319a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:03.583467 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d45587db-f654-4c0a-aab1-49b0ee1c319a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:03.718384 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d45587db-f654-4c0a-aab1-49b0ee1c319a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:03.726445 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d45587db-f654-4c0a-aab1-49b0ee1c319a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e" status: 200 len: 1375 microversion: 2.1 time: 0.156885 Oct 12 23:34:03.727860 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4357/8053] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:03 2022] GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:04.751451 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ae0a2f5f-fa58-463a-8b1d-3a8d94235d34 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:04.752176 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ae0a2f5f-fa58-463a-8b1d-3a8d94235d34 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:04.758656 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae0a2f5f-fa58-463a-8b1d-3a8d94235d34 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:04.759162 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae0a2f5f-fa58-463a-8b1d-3a8d94235d34 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:04.759643 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae0a2f5f-fa58-463a-8b1d-3a8d94235d34 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:04.760425 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae0a2f5f-fa58-463a-8b1d-3a8d94235d34 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:04.760895 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae0a2f5f-fa58-463a-8b1d-3a8d94235d34 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:04.761340 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae0a2f5f-fa58-463a-8b1d-3a8d94235d34 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:04.893768 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-ae0a2f5f-fa58-463a-8b1d-3a8d94235d34 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:04.901887 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ae0a2f5f-fa58-463a-8b1d-3a8d94235d34 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e" status: 200 len: 1375 microversion: 2.1 time: 0.155591 Oct 12 23:34:04.902458 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3697/8054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:04 2022] GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:05.925932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-419aa550-be1c-40cb-a0dd-f1ac0bd2b1c4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:05.926552 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-419aa550-be1c-40cb-a0dd-f1ac0bd2b1c4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:05.933477 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-419aa550-be1c-40cb-a0dd-f1ac0bd2b1c4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:05.933967 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-419aa550-be1c-40cb-a0dd-f1ac0bd2b1c4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:05.934413 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-419aa550-be1c-40cb-a0dd-f1ac0bd2b1c4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:05.935109 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-419aa550-be1c-40cb-a0dd-f1ac0bd2b1c4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:05.935600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-419aa550-be1c-40cb-a0dd-f1ac0bd2b1c4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:05.936034 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-419aa550-be1c-40cb-a0dd-f1ac0bd2b1c4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:06.118133 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-419aa550-be1c-40cb-a0dd-f1ac0bd2b1c4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:06.125836 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-419aa550-be1c-40cb-a0dd-f1ac0bd2b1c4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e" status: 200 len: 1375 microversion: 2.1 time: 0.203819 Oct 12 23:34:06.126444 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4358/8055] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:05 2022] GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e => generated 1375 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:07.150311 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7f96e6e9-7edb-47fb-a12a-6c021c68a880 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:07.150890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7f96e6e9-7edb-47fb-a12a-6c021c68a880 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:07.158300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f96e6e9-7edb-47fb-a12a-6c021c68a880 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:07.158803 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f96e6e9-7edb-47fb-a12a-6c021c68a880 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:07.159275 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f96e6e9-7edb-47fb-a12a-6c021c68a880 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:07.159998 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f96e6e9-7edb-47fb-a12a-6c021c68a880 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:07.160470 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f96e6e9-7edb-47fb-a12a-6c021c68a880 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:07.160918 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f96e6e9-7edb-47fb-a12a-6c021c68a880 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:07.290137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7f96e6e9-7edb-47fb-a12a-6c021c68a880 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:07.297847 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7f96e6e9-7edb-47fb-a12a-6c021c68a880 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e" status: 200 len: 1375 microversion: 2.1 time: 0.153440 Oct 12 23:34:07.298423 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3698/8056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:07 2022] GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:08.321476 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-08c98843-4eb1-4d5e-b904-60021a0542bb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:08.322099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-08c98843-4eb1-4d5e-b904-60021a0542bb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:08.329406 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08c98843-4eb1-4d5e-b904-60021a0542bb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:08.329919 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08c98843-4eb1-4d5e-b904-60021a0542bb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:08.330341 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08c98843-4eb1-4d5e-b904-60021a0542bb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:08.331035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08c98843-4eb1-4d5e-b904-60021a0542bb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:08.331530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08c98843-4eb1-4d5e-b904-60021a0542bb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:08.331961 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-08c98843-4eb1-4d5e-b904-60021a0542bb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:08.465738 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-08c98843-4eb1-4d5e-b904-60021a0542bb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:08.474217 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-08c98843-4eb1-4d5e-b904-60021a0542bb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e" status: 200 len: 1375 microversion: 2.1 time: 0.156758 Oct 12 23:34:08.474849 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4359/8057] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:08 2022] GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:08.533766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-6f513d4a-a540-4336-b280-a9e8ca6ef283 req-144faa9f-dc11-4397-aa1d-5e3ee425a3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe98d4d-a99b-445c-bb77-6c54b31d719e", "name": "network-vif-plugged", "status": "completed", "tag": "dfabae8b-668d-4e23-8899-72ec616dd60f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:34:08.544790 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6f513d4a-a540-4336-b280-a9e8ca6ef283 req-144faa9f-dc11-4397-aa1d-5e3ee425a3f3 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:08.545341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6f513d4a-a540-4336-b280-a9e8ca6ef283 req-144faa9f-dc11-4397-aa1d-5e3ee425a3f3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:08.545798 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6f513d4a-a540-4336-b280-a9e8ca6ef283 req-144faa9f-dc11-4397-aa1d-5e3ee425a3f3 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:08.558037 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-6f513d4a-a540-4336-b280-a9e8ca6ef283 req-144faa9f-dc11-4397-aa1d-5e3ee425a3f3 service nova] Creating event network-vif-plugged:dfabae8b-668d-4e23-8899-72ec616dd60f for instance afe98d4d-a99b-445c-bb77-6c54b31d719e on n-h2-861111-1 Oct 12 23:34:08.563053 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-6f513d4a-a540-4336-b280-a9e8ca6ef283 req-144faa9f-dc11-4397-aa1d-5e3ee425a3f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033372 Oct 12 23:34:08.563680 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3699/8058] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:34:09.498590 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-df0df6d7-0fff-41e2-8601-7baf18fc2577 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:09.499203 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-df0df6d7-0fff-41e2-8601-7baf18fc2577 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:09.506026 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df0df6d7-0fff-41e2-8601-7baf18fc2577 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:09.506504 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df0df6d7-0fff-41e2-8601-7baf18fc2577 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:09.507193 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df0df6d7-0fff-41e2-8601-7baf18fc2577 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:09.507914 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df0df6d7-0fff-41e2-8601-7baf18fc2577 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:09.508364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df0df6d7-0fff-41e2-8601-7baf18fc2577 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:09.508784 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-df0df6d7-0fff-41e2-8601-7baf18fc2577 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:09.640191 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-df0df6d7-0fff-41e2-8601-7baf18fc2577 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:09.647947 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-df0df6d7-0fff-41e2-8601-7baf18fc2577 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e" status: 200 len: 1375 microversion: 2.1 time: 0.153295 Oct 12 23:34:09.649095 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4360/8059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:09 2022] GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:10.669122 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:10.670074 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:10.673966 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cdf4c8d8-38ba-4693-98b3-09907155e895 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:10.674682 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cdf4c8d8-38ba-4693-98b3-09907155e895 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:10.681604 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdf4c8d8-38ba-4693-98b3-09907155e895 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:10.682096 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdf4c8d8-38ba-4693-98b3-09907155e895 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:10.682565 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdf4c8d8-38ba-4693-98b3-09907155e895 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:10.683263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdf4c8d8-38ba-4693-98b3-09907155e895 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:10.683731 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdf4c8d8-38ba-4693-98b3-09907155e895 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:10.684171 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cdf4c8d8-38ba-4693-98b3-09907155e895 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:10.817952 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cdf4c8d8-38ba-4693-98b3-09907155e895 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:10.826233 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cdf4c8d8-38ba-4693-98b3-09907155e895 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e" status: 200 len: 1560 microversion: 2.1 time: 0.158948 Oct 12 23:34:10.826803 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3700/8060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:10 2022] GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:10.848748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d2336128-0bf6-4d8b-8021-13e0548ff7bd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:10.849363 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d2336128-0bf6-4d8b-8021-13e0548ff7bd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:10.851186 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:10.857099 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2336128-0bf6-4d8b-8021-13e0548ff7bd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:10.857579 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2336128-0bf6-4d8b-8021-13e0548ff7bd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:10.858013 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2336128-0bf6-4d8b-8021-13e0548ff7bd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:10.858699 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2336128-0bf6-4d8b-8021-13e0548ff7bd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:10.859150 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2336128-0bf6-4d8b-8021-13e0548ff7bd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:10.859606 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d2336128-0bf6-4d8b-8021-13e0548ff7bd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:10.990457 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d2336128-0bf6-4d8b-8021-13e0548ff7bd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:10.998201 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d2336128-0bf6-4d8b-8021-13e0548ff7bd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e" status: 200 len: 1560 microversion: 2.1 time: 0.153315 Oct 12 23:34:10.998827 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4361/8061] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:10 2022] GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:12.950961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-22a878a7-3646-4fdb-840d-cde88ffe71cf req-59df5485-7cea-457b-ad8a-c109d7614982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe98d4d-a99b-445c-bb77-6c54b31d719e", "tag": "dfabae8b-668d-4e23-8899-72ec616dd60f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:34:12.960844 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-22a878a7-3646-4fdb-840d-cde88ffe71cf req-59df5485-7cea-457b-ad8a-c109d7614982 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:12.961341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-22a878a7-3646-4fdb-840d-cde88ffe71cf req-59df5485-7cea-457b-ad8a-c109d7614982 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:12.961786 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-22a878a7-3646-4fdb-840d-cde88ffe71cf req-59df5485-7cea-457b-ad8a-c109d7614982 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:12.973759 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-22a878a7-3646-4fdb-840d-cde88ffe71cf req-59df5485-7cea-457b-ad8a-c109d7614982 service nova] Creating event network-changed:dfabae8b-668d-4e23-8899-72ec616dd60f for instance afe98d4d-a99b-445c-bb77-6c54b31d719e on n-h2-861111-1 Oct 12 23:34:12.979657 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-22a878a7-3646-4fdb-840d-cde88ffe71cf req-59df5485-7cea-457b-ad8a-c109d7614982 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090152 Oct 12 23:34:12.980277 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3701/8062] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:38.921801 n-d-861111-1 devstack@n-api.service[120453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aee61eb9-c5dd-4991-902f-85ebd1f559fb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 23:36:38.922697 n-d-861111-1 devstack@n-api.service[120453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84ea943b-c2e8-46fe-b7cd-216120f59743] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 23:36:38.923204 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:38.924031 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=36 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:38.925552 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:36:38.925720 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 23:36:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e/action (ip 10.222.0.16) !!! Oct 12 23:36:38.927946 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:36:38.928095 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 23:36:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e/action (ip 10.222.0.16) !!! Oct 12 23:36:38.934659 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-f37ce759-1091-44dc-9175-9a348f24428f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1919789214"}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:36:38.937036 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-f37ce759-1091-44dc-9175-9a348f24428f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:38.954139 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f37ce759-1091-44dc-9175-9a348f24428f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:38.954620 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f37ce759-1091-44dc-9175-9a348f24428f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:38.955054 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f37ce759-1091-44dc-9175-9a348f24428f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:38.955790 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f37ce759-1091-44dc-9175-9a348f24428f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:38.956244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f37ce759-1091-44dc-9175-9a348f24428f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:38.956667 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-f37ce759-1091-44dc-9175-9a348f24428f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:39.153005 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-f37ce759-1091-44dc-9175-9a348f24428f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "POST /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e/action" status: 202 len: 0 microversion: 2.1 time: 0.233024 Oct 12 23:36:39.153653 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4362/8063] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:36:38 2022] POST /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 23:36:45.270620 n-d-861111-1 devstack@n-api.service[120452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b0df6e00-df54-42f7-81d1-59721b28bd80] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:36:45.271562 n-d-861111-1 devstack@n-api.service[120452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d1e6222c-d1f8-4742-acce-113cd0d666eb] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:36:45.272260 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:45.273156 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=32 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:45.274909 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:36:45.275062 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 23:36:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 12 23:36:45.276436 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:36:45.276645 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 23:36:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 12 23:36:45.277749 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:36:45.278110 n-d-861111-1 devstack@n-api.service[120452]: Wed Oct 12 23:36:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 12 23:36:45.345365 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-453b8fa6-ac44-4a62-af9c-8970717ec052 req-a6fd3a97-6404-439c-ab6b-f9fbe0d8b279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe98d4d-a99b-445c-bb77-6c54b31d719e", "name": "network-vif-plugged", "status": "completed", "tag": "dfabae8b-668d-4e23-8899-72ec616dd60f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:36:45.356173 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-453b8fa6-ac44-4a62-af9c-8970717ec052 req-a6fd3a97-6404-439c-ab6b-f9fbe0d8b279 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:45.356655 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-453b8fa6-ac44-4a62-af9c-8970717ec052 req-a6fd3a97-6404-439c-ab6b-f9fbe0d8b279 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:45.357094 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-453b8fa6-ac44-4a62-af9c-8970717ec052 req-a6fd3a97-6404-439c-ab6b-f9fbe0d8b279 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:45.367060 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-453b8fa6-ac44-4a62-af9c-8970717ec052 req-a6fd3a97-6404-439c-ab6b-f9fbe0d8b279 service nova] Creating event network-vif-plugged:dfabae8b-668d-4e23-8899-72ec616dd60f for instance afe98d4d-a99b-445c-bb77-6c54b31d719e on n-h2-861111-1 Oct 12 23:36:45.373279 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-453b8fa6-ac44-4a62-af9c-8970717ec052 req-a6fd3a97-6404-439c-ab6b-f9fbe0d8b279 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104244 Oct 12 23:36:45.373870 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3702/8064] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:56.798640 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:56.799509 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:56.806400 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-905414132", "imageRef": "402144b8-d7dc-4574-a1d7-f02b1d5769c9", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2011527841", "security_groups": [{"name": "tempest-secgroup-smoke-1673519418"}], "networks": [{"uuid": "928643b3-7b49-47f1-8776-a4ee0f14e567"}]}} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:36:56.830897 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] [84ea943b-c2e8-46fe-b7cd-216120f59743] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41612. Oct 12 23:36:56.834664 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] [aee61eb9-c5dd-4991-902f-85ebd1f559fb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41610. Oct 12 23:36:56.920993 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.network.neutron [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] validate_networks() for [('928643b3-7b49-47f1-8776-a4ee0f14e567', None, None, None, None, None)] {{(pid=120453) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:36:57.326258 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Flavor limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:36:57.326689 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Image limits 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:36:57.327172 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Flavor pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:36:57.327617 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Image pref 0:0:0 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:36:57.328038 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.virt.hardware [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:36:57.336941 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:57.337426 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:57.337867 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:57.338600 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:57.339059 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:57.339530 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:57.356226 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Getting quotas for project 92a5a6a7bc2e4fb59b97d6958853a839. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:36:57.361322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.quota [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Getting quotas for user 56d4803b73634cba99bdef0b4f7345c7 and project 92a5a6a7bc2e4fb59b97d6958853a839. Resources: {'ram', 'cores', 'instances'} {{(pid=120453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:36:57.374081 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Going to run 1 instances... {{(pid=120453) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:36:57.376577 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='402144b8-d7dc-4574-a1d7-f02b1d5769c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:36:57.424648 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-937eaf28-8f50-4994-a78f-60d145c7f381 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.629795 Oct 12 23:36:57.425303 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4363/8065] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 12 23:36:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:36:57.436344 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:57.437106 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:57.443576 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8b7d2f2b-a4a7-4fae-a18f-44ca094cab33 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:57.444300 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8b7d2f2b-a4a7-4fae-a18f-44ca094cab33 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:57.462680 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] [b0df6e00-df54-42f7-81d1-59721b28bd80] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41628. Oct 12 23:36:57.465089 n-d-861111-1 devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] [d1e6222c-d1f8-4742-acce-113cd0d666eb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41630. Oct 12 23:36:57.562314 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-8b7d2f2b-a4a7-4fae-a18f-44ca094cab33 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:57.569387 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8b7d2f2b-a4a7-4fae-a18f-44ca094cab33 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1248 microversion: 2.1 time: 0.136155 Oct 12 23:36:57.570346 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3703/8066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:57 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1248 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:58.593855 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-210a8a09-095e-4cda-aad0-8f4d18c7d269 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:58.594763 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-210a8a09-095e-4cda-aad0-8f4d18c7d269 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:58.601248 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-210a8a09-095e-4cda-aad0-8f4d18c7d269 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:58.601920 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-210a8a09-095e-4cda-aad0-8f4d18c7d269 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:58.602376 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-210a8a09-095e-4cda-aad0-8f4d18c7d269 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:58.603197 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-210a8a09-095e-4cda-aad0-8f4d18c7d269 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:58.603684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-210a8a09-095e-4cda-aad0-8f4d18c7d269 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:58.604581 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-210a8a09-095e-4cda-aad0-8f4d18c7d269 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:58.670422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-210a8a09-095e-4cda-aad0-8f4d18c7d269 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:58.678337 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-210a8a09-095e-4cda-aad0-8f4d18c7d269 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1318 microversion: 2.1 time: 0.089381 Oct 12 23:36:58.678915 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4364/8067] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:58 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1318 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:59.420695 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-5fe886dd-475d-4d7d-95de-3e8702b3970a req-57e1a70e-6117-4da1-949f-7bce9be82c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe98d4d-a99b-445c-bb77-6c54b31d719e", "name": "network-vif-unplugged", "status": "completed", "tag": "dfabae8b-668d-4e23-8899-72ec616dd60f"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:36:59.463178 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5fe886dd-475d-4d7d-95de-3e8702b3970a req-57e1a70e-6117-4da1-949f-7bce9be82c9a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:59.474392 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5fe886dd-475d-4d7d-95de-3e8702b3970a req-57e1a70e-6117-4da1-949f-7bce9be82c9a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:59.482495 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5fe886dd-475d-4d7d-95de-3e8702b3970a req-57e1a70e-6117-4da1-949f-7bce9be82c9a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:59.528801 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-5fe886dd-475d-4d7d-95de-3e8702b3970a req-57e1a70e-6117-4da1-949f-7bce9be82c9a service nova] Creating event network-vif-unplugged:dfabae8b-668d-4e23-8899-72ec616dd60f for instance afe98d4d-a99b-445c-bb77-6c54b31d719e on n-h2-861111-1 Oct 12 23:36:59.543177 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-5fe886dd-475d-4d7d-95de-3e8702b3970a req-57e1a70e-6117-4da1-949f-7bce9be82c9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123678 Oct 12 23:36:59.545108 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3704/8068] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:59.701572 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-da8f0696-d425-4a79-a771-ce11fb336793 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:59.702974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-da8f0696-d425-4a79-a771-ce11fb336793 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:59.710473 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da8f0696-d425-4a79-a771-ce11fb336793 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:59.711450 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da8f0696-d425-4a79-a771-ce11fb336793 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:59.712200 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da8f0696-d425-4a79-a771-ce11fb336793 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:59.713719 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da8f0696-d425-4a79-a771-ce11fb336793 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:59.714490 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da8f0696-d425-4a79-a771-ce11fb336793 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:59.715137 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-da8f0696-d425-4a79-a771-ce11fb336793 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:59.886152 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-da8f0696-d425-4a79-a771-ce11fb336793 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:59.894247 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-da8f0696-d425-4a79-a771-ce11fb336793 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1374 microversion: 2.1 time: 0.196615 Oct 12 23:36:59.895425 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4365/8069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:59 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1374 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:00.921266 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-82b34e22-c0e2-4437-aa3a-eb50290f687f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:00.922005 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-82b34e22-c0e2-4437-aa3a-eb50290f687f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:00.928627 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82b34e22-c0e2-4437-aa3a-eb50290f687f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:00.929135 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82b34e22-c0e2-4437-aa3a-eb50290f687f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:00.929594 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82b34e22-c0e2-4437-aa3a-eb50290f687f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:00.930315 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82b34e22-c0e2-4437-aa3a-eb50290f687f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:00.930974 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82b34e22-c0e2-4437-aa3a-eb50290f687f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:00.932016 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-82b34e22-c0e2-4437-aa3a-eb50290f687f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:01.092419 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-82b34e22-c0e2-4437-aa3a-eb50290f687f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:01.100544 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-82b34e22-c0e2-4437-aa3a-eb50290f687f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1374 microversion: 2.1 time: 0.185334 Oct 12 23:37:01.101126 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3705/8070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:00 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:02.125768 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9f8eabff-331b-4aec-be8c-6a147c72aef8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:02.126398 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9f8eabff-331b-4aec-be8c-6a147c72aef8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:02.133612 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f8eabff-331b-4aec-be8c-6a147c72aef8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:02.134104 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f8eabff-331b-4aec-be8c-6a147c72aef8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:02.135207 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f8eabff-331b-4aec-be8c-6a147c72aef8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:02.135953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f8eabff-331b-4aec-be8c-6a147c72aef8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:02.136417 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f8eabff-331b-4aec-be8c-6a147c72aef8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:02.136844 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9f8eabff-331b-4aec-be8c-6a147c72aef8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:02.293147 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9f8eabff-331b-4aec-be8c-6a147c72aef8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:02.301535 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9f8eabff-331b-4aec-be8c-6a147c72aef8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1374 microversion: 2.1 time: 0.179692 Oct 12 23:37:02.302348 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4366/8071] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:02 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:03.325121 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-68fcadcc-d16b-400a-885f-643c9722e4e8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:03.325747 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-68fcadcc-d16b-400a-885f-643c9722e4e8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:03.332766 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68fcadcc-d16b-400a-885f-643c9722e4e8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:03.333265 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68fcadcc-d16b-400a-885f-643c9722e4e8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:03.333716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68fcadcc-d16b-400a-885f-643c9722e4e8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:03.334431 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68fcadcc-d16b-400a-885f-643c9722e4e8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:03.335051 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68fcadcc-d16b-400a-885f-643c9722e4e8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:03.335598 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68fcadcc-d16b-400a-885f-643c9722e4e8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:03.478748 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-68fcadcc-d16b-400a-885f-643c9722e4e8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:03.486951 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-68fcadcc-d16b-400a-885f-643c9722e4e8 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1374 microversion: 2.1 time: 0.165924 Oct 12 23:37:03.487578 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3706/8072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:03 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:04.510278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-9e53d1f6-bb1d-4bf3-8e52-ba3e8c9cca13 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:04.511011 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-9e53d1f6-bb1d-4bf3-8e52-ba3e8c9cca13 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:04.518154 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e53d1f6-bb1d-4bf3-8e52-ba3e8c9cca13 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:04.518644 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e53d1f6-bb1d-4bf3-8e52-ba3e8c9cca13 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:04.519089 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e53d1f6-bb1d-4bf3-8e52-ba3e8c9cca13 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:04.519823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e53d1f6-bb1d-4bf3-8e52-ba3e8c9cca13 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:04.520282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e53d1f6-bb1d-4bf3-8e52-ba3e8c9cca13 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:04.520714 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-9e53d1f6-bb1d-4bf3-8e52-ba3e8c9cca13 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:04.664201 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-9e53d1f6-bb1d-4bf3-8e52-ba3e8c9cca13 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:04.673302 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-9e53d1f6-bb1d-4bf3-8e52-ba3e8c9cca13 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1374 microversion: 2.1 time: 0.167134 Oct 12 23:37:04.684510 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4367/8073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:04 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:05.698815 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c2e978fe-0a52-459a-9f35-a02df5dba32d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:05.699558 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c2e978fe-0a52-459a-9f35-a02df5dba32d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:05.706934 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2e978fe-0a52-459a-9f35-a02df5dba32d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:05.707471 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2e978fe-0a52-459a-9f35-a02df5dba32d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:05.707932 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2e978fe-0a52-459a-9f35-a02df5dba32d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:05.711042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2e978fe-0a52-459a-9f35-a02df5dba32d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:05.711042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2e978fe-0a52-459a-9f35-a02df5dba32d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:05.711042 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c2e978fe-0a52-459a-9f35-a02df5dba32d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:05.889570 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c2e978fe-0a52-459a-9f35-a02df5dba32d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:05.898748 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c2e978fe-0a52-459a-9f35-a02df5dba32d tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1374 microversion: 2.1 time: 0.204427 Oct 12 23:37:05.899357 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3707/8074] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:05 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1374 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:06.922239 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-2ab50218-d52b-4415-bf26-ce040040f422 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:06.922842 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-2ab50218-d52b-4415-bf26-ce040040f422 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:06.929701 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ab50218-d52b-4415-bf26-ce040040f422 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:06.930188 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ab50218-d52b-4415-bf26-ce040040f422 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:06.930633 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ab50218-d52b-4415-bf26-ce040040f422 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:06.931369 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ab50218-d52b-4415-bf26-ce040040f422 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:06.931833 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ab50218-d52b-4415-bf26-ce040040f422 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:06.932263 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-2ab50218-d52b-4415-bf26-ce040040f422 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:07.067178 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-2ab50218-d52b-4415-bf26-ce040040f422 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:07.075574 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-2ab50218-d52b-4415-bf26-ce040040f422 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1374 microversion: 2.1 time: 0.157295 Oct 12 23:37:07.076158 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4368/8075] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:06 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:07.381310 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-10782678-413d-4860-b15e-878fe7aea61c req-b009fc25-9611-4b40-9f66-a911fd01df5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3d3216-ac11-43a1-a7e9-9441419e1c9e", "tag": "6bb977b6-19c8-42ca-87d1-bd0eb0dc6159"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:37:07.391736 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-10782678-413d-4860-b15e-878fe7aea61c req-b009fc25-9611-4b40-9f66-a911fd01df5a service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:07.392228 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-10782678-413d-4860-b15e-878fe7aea61c req-b009fc25-9611-4b40-9f66-a911fd01df5a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:07.392678 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-10782678-413d-4860-b15e-878fe7aea61c req-b009fc25-9611-4b40-9f66-a911fd01df5a service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:07.404315 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-10782678-413d-4860-b15e-878fe7aea61c req-b009fc25-9611-4b40-9f66-a911fd01df5a service nova] Creating event network-changed:6bb977b6-19c8-42ca-87d1-bd0eb0dc6159 for instance 1c3d3216-ac11-43a1-a7e9-9441419e1c9e on n-h1-861111-1 Oct 12 23:37:07.409519 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-10782678-413d-4860-b15e-878fe7aea61c req-b009fc25-9611-4b40-9f66-a911fd01df5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091902 Oct 12 23:37:07.410123 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3708/8076] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:37:08.098823 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-d5dc9eb1-c3d9-4c80-837f-34e070a532fc tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:08.099431 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-d5dc9eb1-c3d9-4c80-837f-34e070a532fc tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:08.101278 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=2 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:37:08.102144 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell0:SELECT=6 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:37:08.109441 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5dc9eb1-c3d9-4c80-837f-34e070a532fc tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:08.109932 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5dc9eb1-c3d9-4c80-837f-34e070a532fc tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:08.110378 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5dc9eb1-c3d9-4c80-837f-34e070a532fc tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:08.111075 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5dc9eb1-c3d9-4c80-837f-34e070a532fc tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:08.111569 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5dc9eb1-c3d9-4c80-837f-34e070a532fc tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:08.112005 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-d5dc9eb1-c3d9-4c80-837f-34e070a532fc tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:08.241520 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-d5dc9eb1-c3d9-4c80-837f-34e070a532fc tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:08.249380 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-d5dc9eb1-c3d9-4c80-837f-34e070a532fc tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1374 microversion: 2.1 time: 0.154534 Oct 12 23:37:08.249986 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4369/8077] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:08 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:09.273779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6822f382-b7f1-4f20-8f7f-fd33cf5ef98c tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:09.274489 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6822f382-b7f1-4f20-8f7f-fd33cf5ef98c tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:09.277055 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:37:09.283083 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6822f382-b7f1-4f20-8f7f-fd33cf5ef98c tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:09.283599 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6822f382-b7f1-4f20-8f7f-fd33cf5ef98c tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:09.284049 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6822f382-b7f1-4f20-8f7f-fd33cf5ef98c tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:09.284746 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6822f382-b7f1-4f20-8f7f-fd33cf5ef98c tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:09.285212 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6822f382-b7f1-4f20-8f7f-fd33cf5ef98c tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:09.285649 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6822f382-b7f1-4f20-8f7f-fd33cf5ef98c tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:09.416008 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-6822f382-b7f1-4f20-8f7f-fd33cf5ef98c tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:09.423650 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6822f382-b7f1-4f20-8f7f-fd33cf5ef98c tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1374 microversion: 2.1 time: 0.154139 Oct 12 23:37:09.424219 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3709/8078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:09 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:10.446484 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-bcbf14b3-cf2c-4ac6-b172-498d9380bdf4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:10.447170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-bcbf14b3-cf2c-4ac6-b172-498d9380bdf4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:10.453845 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcbf14b3-cf2c-4ac6-b172-498d9380bdf4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:10.454322 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcbf14b3-cf2c-4ac6-b172-498d9380bdf4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:10.454752 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcbf14b3-cf2c-4ac6-b172-498d9380bdf4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:10.455466 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcbf14b3-cf2c-4ac6-b172-498d9380bdf4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:10.455918 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcbf14b3-cf2c-4ac6-b172-498d9380bdf4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:10.456340 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-bcbf14b3-cf2c-4ac6-b172-498d9380bdf4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:10.591711 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-bcbf14b3-cf2c-4ac6-b172-498d9380bdf4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:10.599909 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-bcbf14b3-cf2c-4ac6-b172-498d9380bdf4 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1374 microversion: 2.1 time: 0.157352 Oct 12 23:37:10.600491 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4370/8079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:10 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:11.624129 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9c949feb-9366-46dc-8780-074cc9c704c5 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:11.624704 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9c949feb-9366-46dc-8780-074cc9c704c5 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:11.631527 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c949feb-9366-46dc-8780-074cc9c704c5 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:11.632028 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c949feb-9366-46dc-8780-074cc9c704c5 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:11.632482 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c949feb-9366-46dc-8780-074cc9c704c5 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:11.633443 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c949feb-9366-46dc-8780-074cc9c704c5 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:11.633910 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c949feb-9366-46dc-8780-074cc9c704c5 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:11.634997 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c949feb-9366-46dc-8780-074cc9c704c5 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:11.767877 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-9c949feb-9366-46dc-8780-074cc9c704c5 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:11.775877 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9c949feb-9366-46dc-8780-074cc9c704c5 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1374 microversion: 2.1 time: 0.155746 Oct 12 23:37:11.776465 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3710/8080] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:11 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:12.702495 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-82199e62-4954-4e29-ad32-bb9cad4110ca req-360b9202-d86e-432c-99d6-7e322bd04e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3d3216-ac11-43a1-a7e9-9441419e1c9e", "name": "network-vif-plugged", "status": "completed", "tag": "6bb977b6-19c8-42ca-87d1-bd0eb0dc6159"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:37:12.714071 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-82199e62-4954-4e29-ad32-bb9cad4110ca req-360b9202-d86e-432c-99d6-7e322bd04e47 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:12.714553 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-82199e62-4954-4e29-ad32-bb9cad4110ca req-360b9202-d86e-432c-99d6-7e322bd04e47 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:12.715022 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-82199e62-4954-4e29-ad32-bb9cad4110ca req-360b9202-d86e-432c-99d6-7e322bd04e47 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:12.726357 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-82199e62-4954-4e29-ad32-bb9cad4110ca req-360b9202-d86e-432c-99d6-7e322bd04e47 service nova] Creating event network-vif-plugged:6bb977b6-19c8-42ca-87d1-bd0eb0dc6159 for instance 1c3d3216-ac11-43a1-a7e9-9441419e1c9e on n-h1-861111-1 Oct 12 23:37:12.731431 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-82199e62-4954-4e29-ad32-bb9cad4110ca req-360b9202-d86e-432c-99d6-7e322bd04e47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032772 Oct 12 23:37:12.732028 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4371/8081] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:37:12.798708 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-18152828-127a-48bc-81fa-f8a13b543930 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:12.799297 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-18152828-127a-48bc-81fa-f8a13b543930 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:12.807015 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18152828-127a-48bc-81fa-f8a13b543930 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:12.807644 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18152828-127a-48bc-81fa-f8a13b543930 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:12.808189 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18152828-127a-48bc-81fa-f8a13b543930 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:12.808961 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18152828-127a-48bc-81fa-f8a13b543930 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:12.809657 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18152828-127a-48bc-81fa-f8a13b543930 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:12.810169 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18152828-127a-48bc-81fa-f8a13b543930 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:12.975779 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-18152828-127a-48bc-81fa-f8a13b543930 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:12.983579 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-18152828-127a-48bc-81fa-f8a13b543930 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1374 microversion: 2.1 time: 0.188702 Oct 12 23:37:12.984152 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3711/8082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:12 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:14.008675 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-e729e6fc-1aa6-40d8-9ef1-bb7c6550eb50 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:14.009410 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-e729e6fc-1aa6-40d8-9ef1-bb7c6550eb50 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:14.016037 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e729e6fc-1aa6-40d8-9ef1-bb7c6550eb50 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:14.016528 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e729e6fc-1aa6-40d8-9ef1-bb7c6550eb50 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:14.016974 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e729e6fc-1aa6-40d8-9ef1-bb7c6550eb50 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:14.017684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e729e6fc-1aa6-40d8-9ef1-bb7c6550eb50 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:14.018159 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e729e6fc-1aa6-40d8-9ef1-bb7c6550eb50 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:14.018591 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-e729e6fc-1aa6-40d8-9ef1-bb7c6550eb50 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:14.153419 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-e729e6fc-1aa6-40d8-9ef1-bb7c6550eb50 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:14.161293 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-e729e6fc-1aa6-40d8-9ef1-bb7c6550eb50 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1558 microversion: 2.1 time: 0.157984 Oct 12 23:37:14.162085 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4372/8083] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:14 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:14.183397 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c44a9793-2e08-40c3-94da-8efb5362af2f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:14.184024 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c44a9793-2e08-40c3-94da-8efb5362af2f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:14.190650 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c44a9793-2e08-40c3-94da-8efb5362af2f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:14.191142 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c44a9793-2e08-40c3-94da-8efb5362af2f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:14.191620 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c44a9793-2e08-40c3-94da-8efb5362af2f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:14.192341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c44a9793-2e08-40c3-94da-8efb5362af2f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:14.192804 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c44a9793-2e08-40c3-94da-8efb5362af2f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:14.193238 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c44a9793-2e08-40c3-94da-8efb5362af2f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:14.325712 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-c44a9793-2e08-40c3-94da-8efb5362af2f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:14.333368 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c44a9793-2e08-40c3-94da-8efb5362af2f tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1558 microversion: 2.1 time: 0.153889 Oct 12 23:37:14.333932 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3712/8084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:14 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:16.212847 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d4deff4c-7a0f-4d46-b997-06bf561c226e req-14df2241-81a9-4d83-8eb1-7cd6c8542a2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3d3216-ac11-43a1-a7e9-9441419e1c9e", "tag": "6bb977b6-19c8-42ca-87d1-bd0eb0dc6159"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:37:16.223551 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d4deff4c-7a0f-4d46-b997-06bf561c226e req-14df2241-81a9-4d83-8eb1-7cd6c8542a2f service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:16.224264 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d4deff4c-7a0f-4d46-b997-06bf561c226e req-14df2241-81a9-4d83-8eb1-7cd6c8542a2f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:16.224901 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d4deff4c-7a0f-4d46-b997-06bf561c226e req-14df2241-81a9-4d83-8eb1-7cd6c8542a2f service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:16.238991 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d4deff4c-7a0f-4d46-b997-06bf561c226e req-14df2241-81a9-4d83-8eb1-7cd6c8542a2f service nova] Creating event network-changed:6bb977b6-19c8-42ca-87d1-bd0eb0dc6159 for instance 1c3d3216-ac11-43a1-a7e9-9441419e1c9e on n-h1-861111-1 Oct 12 23:37:16.244457 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d4deff4c-7a0f-4d46-b997-06bf561c226e req-14df2241-81a9-4d83-8eb1-7cd6c8542a2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034932 Oct 12 23:37:16.245253 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4373/8085] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:38:55.345976 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=22 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:38:55.346885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=46 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:38:55.354341 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-53cfb97f-8683-4716-8934-e4110634b9b9 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1092124146"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:38:55.356876 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-53cfb97f-8683-4716-8934-e4110634b9b9 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:38:55.363716 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53cfb97f-8683-4716-8934-e4110634b9b9 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:55.364220 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53cfb97f-8683-4716-8934-e4110634b9b9 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:55.364696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53cfb97f-8683-4716-8934-e4110634b9b9 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:55.365440 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53cfb97f-8683-4716-8934-e4110634b9b9 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:55.365903 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53cfb97f-8683-4716-8934-e4110634b9b9 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:55.366336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53cfb97f-8683-4716-8934-e4110634b9b9 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:55.571535 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-53cfb97f-8683-4716-8934-e4110634b9b9 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "POST /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e/action" status: 202 len: 0 microversion: 2.1 time: 0.227231 Oct 12 23:38:55.572727 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3713/8086] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 12 23:38:55 2022] POST /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 23:39:01.051113 n-d-861111-1 devstack@n-api.service[120453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84ea943b-c2e8-46fe-b7cd-216120f59743] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 12 23:39:01.053129 n-d-861111-1 devstack@n-api.service[120453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aee61eb9-c5dd-4991-902f-85ebd1f559fb] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 12 23:39:01.053895 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:39:01.054794 n-d-861111-1 devstack@n-api.service[120453]: DEBUG dbcounter [-] [120453] Writing DB stats nova_cell1:SELECT=54 {{(pid=120453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:39:01.055975 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:39:01.056379 n-d-861111-1 devstack@n-api.service[120453]: Wed Oct 12 23:39:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 12 23:39:01.063364 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-7d3eaa79-daac-4cc4-81cb-ae12ecd7a43a req-fd0135a4-5778-4767-a5d6-5bd973b18aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3d3216-ac11-43a1-a7e9-9441419e1c9e", "name": "network-vif-plugged", "status": "completed", "tag": "6bb977b6-19c8-42ca-87d1-bd0eb0dc6159"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:39:01.077522 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7d3eaa79-daac-4cc4-81cb-ae12ecd7a43a req-fd0135a4-5778-4767-a5d6-5bd973b18aaf service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:01.078418 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7d3eaa79-daac-4cc4-81cb-ae12ecd7a43a req-fd0135a4-5778-4767-a5d6-5bd973b18aaf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:01.078953 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-7d3eaa79-daac-4cc4-81cb-ae12ecd7a43a req-fd0135a4-5778-4767-a5d6-5bd973b18aaf service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:01.094690 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-7d3eaa79-daac-4cc4-81cb-ae12ecd7a43a req-fd0135a4-5778-4767-a5d6-5bd973b18aaf service nova] Creating event network-vif-plugged:6bb977b6-19c8-42ca-87d1-bd0eb0dc6159 for instance 1c3d3216-ac11-43a1-a7e9-9441419e1c9e on n-h1-861111-1 Oct 12 23:39:01.100481 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-7d3eaa79-daac-4cc4-81cb-ae12ecd7a43a req-fd0135a4-5778-4767-a5d6-5bd973b18aaf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052168 Oct 12 23:39:01.101244 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4374/8087] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:39:09.331789 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:39:09.333031 n-d-861111-1 devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:39:09.336082 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-3dcc90c6-ae8c-4906-a406-06bca01f8b0f req-991def2f-dcb4-4a6c-9c87-0af6cc67e1fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3d3216-ac11-43a1-a7e9-9441419e1c9e", "tag": "6bb977b6-19c8-42ca-87d1-bd0eb0dc6159"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:39:09.337221 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-52927856-dd74-4a38-841c-16cc3cca086a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:39:09.338634 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-52927856-dd74-4a38-841c-16cc3cca086a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:39:09.346753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52927856-dd74-4a38-841c-16cc3cca086a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:09.347563 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52927856-dd74-4a38-841c-16cc3cca086a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:09.348277 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52927856-dd74-4a38-841c-16cc3cca086a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:09.348879 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3dcc90c6-ae8c-4906-a406-06bca01f8b0f req-991def2f-dcb4-4a6c-9c87-0af6cc67e1fa service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:09.349190 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52927856-dd74-4a38-841c-16cc3cca086a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:09.349365 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3dcc90c6-ae8c-4906-a406-06bca01f8b0f req-991def2f-dcb4-4a6c-9c87-0af6cc67e1fa service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:09.349797 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-3dcc90c6-ae8c-4906-a406-06bca01f8b0f req-991def2f-dcb4-4a6c-9c87-0af6cc67e1fa service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:09.349929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52927856-dd74-4a38-841c-16cc3cca086a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:09.350263 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-52927856-dd74-4a38-841c-16cc3cca086a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:09.364264 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-3dcc90c6-ae8c-4906-a406-06bca01f8b0f req-991def2f-dcb4-4a6c-9c87-0af6cc67e1fa service nova] Creating event network-changed:6bb977b6-19c8-42ca-87d1-bd0eb0dc6159 for instance 1c3d3216-ac11-43a1-a7e9-9441419e1c9e on n-h1-861111-1 Oct 12 23:39:09.370417 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-3dcc90c6-ae8c-4906-a406-06bca01f8b0f req-991def2f-dcb4-4a6c-9c87-0af6cc67e1fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038473 Oct 12 23:39:09.371661 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4375/8088] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:39:09.381975 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-52927856-dd74-4a38-841c-16cc3cca086a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:39:09.466272 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-52927856-dd74-4a38-841c-16cc3cca086a tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 204 len: 0 microversion: 2.1 time: 0.136657 Oct 12 23:39:09.467173 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3714/8089] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:39:09 2022] DELETE /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:39:09.473393 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] [84ea943b-c2e8-46fe-b7cd-216120f59743] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41910. Oct 12 23:39:09.475158 n-d-861111-1 devstack@n-api.service[120453]: INFO oslo.messaging._drivers.impl_rabbit [-] [aee61eb9-c5dd-4991-902f-85ebd1f559fb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41912. Oct 12 23:39:09.479955 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-400f6376-2eba-4dc3-9de9-7bc726b06b8e tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:39:09.480748 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-400f6376-2eba-4dc3-9de9-7bc726b06b8e tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:39:09.488000 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-400f6376-2eba-4dc3-9de9-7bc726b06b8e tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:09.488780 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-400f6376-2eba-4dc3-9de9-7bc726b06b8e tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:09.489296 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-400f6376-2eba-4dc3-9de9-7bc726b06b8e tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:09.490119 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-400f6376-2eba-4dc3-9de9-7bc726b06b8e tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:09.490684 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-400f6376-2eba-4dc3-9de9-7bc726b06b8e tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:09.491190 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-400f6376-2eba-4dc3-9de9-7bc726b06b8e tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:09.711664 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-400f6376-2eba-4dc3-9de9-7bc726b06b8e tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:39:09.719687 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-400f6376-2eba-4dc3-9de9-7bc726b06b8e tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1682 microversion: 2.1 time: 0.248321 Oct 12 23:39:09.720262 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4376/8090] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:39:09 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1682 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:39:10.744167 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cda2ccda-1673-4ee7-9d0a-07a698460c64 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:39:10.744795 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cda2ccda-1673-4ee7-9d0a-07a698460c64 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:39:10.751509 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cda2ccda-1673-4ee7-9d0a-07a698460c64 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:10.751996 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cda2ccda-1673-4ee7-9d0a-07a698460c64 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:10.752439 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cda2ccda-1673-4ee7-9d0a-07a698460c64 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:10.753126 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cda2ccda-1673-4ee7-9d0a-07a698460c64 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:10.753580 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cda2ccda-1673-4ee7-9d0a-07a698460c64 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:10.754007 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cda2ccda-1673-4ee7-9d0a-07a698460c64 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:10.893457 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-cda2ccda-1673-4ee7-9d0a-07a698460c64 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:39:10.902002 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cda2ccda-1673-4ee7-9d0a-07a698460c64 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1682 microversion: 2.1 time: 0.162169 Oct 12 23:39:10.902777 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3715/8091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:39:10 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:39:11.708542 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-d26f0d08-1a57-4d46-88df-fb12a162dc19 req-e1703f11-a837-47c6-8c25-496084e99837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3d3216-ac11-43a1-a7e9-9441419e1c9e", "name": "network-vif-deleted", "tag": "6bb977b6-19c8-42ca-87d1-bd0eb0dc6159"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:39:11.719232 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d26f0d08-1a57-4d46-88df-fb12a162dc19 req-e1703f11-a837-47c6-8c25-496084e99837 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:11.719740 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d26f0d08-1a57-4d46-88df-fb12a162dc19 req-e1703f11-a837-47c6-8c25-496084e99837 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:11.720170 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-d26f0d08-1a57-4d46-88df-fb12a162dc19 req-e1703f11-a837-47c6-8c25-496084e99837 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:11.732082 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-d26f0d08-1a57-4d46-88df-fb12a162dc19 req-e1703f11-a837-47c6-8c25-496084e99837 service nova] Creating event network-vif-deleted:6bb977b6-19c8-42ca-87d1-bd0eb0dc6159 for instance 1c3d3216-ac11-43a1-a7e9-9441419e1c9e on n-h1-861111-1 Oct 12 23:39:11.737053 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-d26f0d08-1a57-4d46-88df-fb12a162dc19 req-e1703f11-a837-47c6-8c25-496084e99837 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032304 Oct 12 23:39:11.737672 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4377/8092] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:39:11.925929 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4656de14-e3ff-4421-807a-2abc4a8a4451 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:39:11.926518 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4656de14-e3ff-4421-807a-2abc4a8a4451 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:39:11.933209 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4656de14-e3ff-4421-807a-2abc4a8a4451 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:11.933696 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4656de14-e3ff-4421-807a-2abc4a8a4451 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:11.934140 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4656de14-e3ff-4421-807a-2abc4a8a4451 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:11.934833 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4656de14-e3ff-4421-807a-2abc4a8a4451 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:11.935316 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4656de14-e3ff-4421-807a-2abc4a8a4451 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:11.935777 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4656de14-e3ff-4421-807a-2abc4a8a4451 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:11.966916 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4656de14-e3ff-4421-807a-2abc4a8a4451 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:11.967447 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4656de14-e3ff-4421-807a-2abc4a8a4451 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:11.967890 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4656de14-e3ff-4421-807a-2abc4a8a4451 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:11.968345 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-4656de14-e3ff-4421-807a-2abc4a8a4451 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lazy-loading 'fault' on Instance uuid 1c3d3216-ac11-43a1-a7e9-9441419e1c9e {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:39:12.009622 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-4656de14-e3ff-4421-807a-2abc4a8a4451 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:39:12.017650 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4656de14-e3ff-4421-807a-2abc4a8a4451 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 200 len: 1338 microversion: 2.1 time: 0.095653 Oct 12 23:39:12.018367 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3716/8093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:39:11 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 1338 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:39:13.043820 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3982f691-2ad9-42b8-bdc6-7bc41f42fe01 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:39:13.044529 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-3982f691-2ad9-42b8-bdc6-7bc41f42fe01 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: 1c3d3216-ac11-43a1-a7e9-9441419e1c9e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:39:13.050894 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3982f691-2ad9-42b8-bdc6-7bc41f42fe01 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:13.051422 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3982f691-2ad9-42b8-bdc6-7bc41f42fe01 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:13.051863 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3982f691-2ad9-42b8-bdc6-7bc41f42fe01 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:13.052585 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3982f691-2ad9-42b8-bdc6-7bc41f42fe01 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:13.053035 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3982f691-2ad9-42b8-bdc6-7bc41f42fe01 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:13.053486 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-3982f691-2ad9-42b8-bdc6-7bc41f42fe01 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:13.067618 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.wsgi [None req-3982f691-2ad9-42b8-bdc6-7bc41f42fe01 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] HTTP exception thrown: Instance 1c3d3216-ac11-43a1-a7e9-9441419e1c9e could not be found. Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3982f691-2ad9-42b8-bdc6-7bc41f42fe01 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Request method failure captured: Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: request: GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e HTTP/1.1 Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: Accept: application/json Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: Accept-Encoding: identity Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: Connection: close Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: Content-Length: 0 Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: Content-Type: application/json Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: Host: 10.222.0.16 Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: Openstack-System-Scope: None Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: User-Agent: python-urllib3/1.26.12 Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-Auth-Token: gAAAAABjR07gFGHmxls5uujomD7Xt41GVjZqInZBr_jYkR9NY-rXhYiY0BpHKa4TmmdFLcZWpHef8-oHMPNJ6lQWDOZQzrei_tGSq-2kWPC9XRc-Ur6bgZOll5IFE-pYS3c58HvuqcvQioCDfg7ACHkeprHVLdTpfnx6nxnJPvXhb4IN0N9ThBY Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Id: None Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-Domain-Name: None Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-Identity-Status: Confirmed Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-Is-Admin-Project: True Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Id: default Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Domain-Name: Default Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Id: 92a5a6a7bc2e4fb59b97d6958853a839 Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-Project-Name: tempest-TestSnapshotPattern-1345423356 Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-Role: reader,member Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-Roles: reader,member Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92a5a6a7bc2e4fb59b97d6958853a839"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92a5a6a7bc2e4fb59b97d6958853a839"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_92a5a6a7bc2e4fb59b97d6958853a839", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/92a5a6a7bc2e4fb59b97d6958853a839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant: tempest-TestSnapshotPattern-1345423356 Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Id: 92a5a6a7bc2e4fb59b97d6958853a839 Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-Tenant-Name: tempest-TestSnapshotPattern-1345423356 Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-User: tempest-TestSnapshotPattern-1345423356-project Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Id: default Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-User-Domain-Name: Default Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-User-Id: 56d4803b73634cba99bdef0b4f7345c7 Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: X-User-Name: tempest-TestSnapshotPattern-1345423356-project Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: method: > Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: exception: Instance 1c3d3216-ac11-43a1-a7e9-9441419e1c9e could not be found. Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: action_args: {'id': '1c3d3216-ac11-43a1-a7e9-9441419e1c9e'} Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3d3216-ac11-43a1-a7e9-9441419e1c9e could not be found. Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3d3216-ac11-43a1-a7e9-9441419e1c9e could not be found. Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:39:13.069266 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:39:13.074454 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:39:13.074454 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:39:13.074454 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:39:13.074454 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:39:13.074454 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:39:13.074454 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3d3216-ac11-43a1-a7e9-9441419e1c9e could not be found. Oct 12 23:39:13.074454 n-d-861111-1 devstack@n-api.service[120453]: ERROR nova.api.openstack.wsgi Oct 12 23:39:13.074454 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-3982f691-2ad9-42b8-bdc6-7bc41f42fe01 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Returning 404 to user: Instance 1c3d3216-ac11-43a1-a7e9-9441419e1c9e could not be found. {{(pid=120453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:39:13.074454 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-3982f691-2ad9-42b8-bdc6-7bc41f42fe01 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e" status: 404 len: 111 microversion: 2.1 time: 0.032576 Oct 12 23:39:13.074454 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4378/8094] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:39:13 2022] GET /compute/v2.1/servers/1c3d3216-ac11-43a1-a7e9-9441419e1c9e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:39:14.381204 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-31cb1f47-3ef8-4608-a0fe-64393c2a412b tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:39:14.381843 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-31cb1f47-3ef8-4608-a0fe-64393c2a412b tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:39:14.389753 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31cb1f47-3ef8-4608-a0fe-64393c2a412b tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:14.390254 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31cb1f47-3ef8-4608-a0fe-64393c2a412b tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:14.390709 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31cb1f47-3ef8-4608-a0fe-64393c2a412b tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:14.391498 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31cb1f47-3ef8-4608-a0fe-64393c2a412b tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:14.391967 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31cb1f47-3ef8-4608-a0fe-64393c2a412b tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:14.392407 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-31cb1f47-3ef8-4608-a0fe-64393c2a412b tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:14.419623 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-31cb1f47-3ef8-4608-a0fe-64393c2a412b tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:39:14.438244 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-abbc4c2d-fc1f-474e-aec8-22d1da9cbd4d req-09d39d27-c345-435a-a1cf-218b1681ebcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe98d4d-a99b-445c-bb77-6c54b31d719e", "tag": "dfabae8b-668d-4e23-8899-72ec616dd60f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:39:14.449397 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-abbc4c2d-fc1f-474e-aec8-22d1da9cbd4d req-09d39d27-c345-435a-a1cf-218b1681ebcc service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:14.449992 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-abbc4c2d-fc1f-474e-aec8-22d1da9cbd4d req-09d39d27-c345-435a-a1cf-218b1681ebcc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:14.450494 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-abbc4c2d-fc1f-474e-aec8-22d1da9cbd4d req-09d39d27-c345-435a-a1cf-218b1681ebcc service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:14.463212 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-abbc4c2d-fc1f-474e-aec8-22d1da9cbd4d req-09d39d27-c345-435a-a1cf-218b1681ebcc service nova] Creating event network-changed:dfabae8b-668d-4e23-8899-72ec616dd60f for instance afe98d4d-a99b-445c-bb77-6c54b31d719e on n-h2-861111-1 Oct 12 23:39:14.468531 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-abbc4c2d-fc1f-474e-aec8-22d1da9cbd4d req-09d39d27-c345-435a-a1cf-218b1681ebcc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088681 Oct 12 23:39:14.469406 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4379/8095] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:39:14.518570 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-31cb1f47-3ef8-4608-a0fe-64393c2a412b tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "DELETE /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e" status: 204 len: 0 microversion: 2.1 time: 0.141241 Oct 12 23:39:14.519536 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3717/8096] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 12 23:39:14 2022] DELETE /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:39:14.529070 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-4717af50-d943-45c7-8ce0-7a9fbc9a11fb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:39:14.529792 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.compute.api [None req-4717af50-d943-45c7-8ce0-7a9fbc9a11fb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] Fetching instance by UUID {{(pid=120453) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:39:14.538771 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4717af50-d943-45c7-8ce0-7a9fbc9a11fb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:14.539288 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4717af50-d943-45c7-8ce0-7a9fbc9a11fb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:14.539736 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4717af50-d943-45c7-8ce0-7a9fbc9a11fb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:14.540996 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4717af50-d943-45c7-8ce0-7a9fbc9a11fb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:14.541459 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4717af50-d943-45c7-8ce0-7a9fbc9a11fb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:14.541989 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [None req-4717af50-d943-45c7-8ce0-7a9fbc9a11fb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:14.681803 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.policy [None req-4717af50-d943-45c7-8ce0-7a9fbc9a11fb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120453) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:39:14.689706 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-4717af50-d943-45c7-8ce0-7a9fbc9a11fb tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e" status: 200 len: 1685 microversion: 2.1 time: 0.165190 Oct 12 23:39:14.690375 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4380/8097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:39:14 2022] GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:39:15.714503 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a379d07-5f77-4610-9eff-ee8dad958ccd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:39:15.715231 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7a379d07-5f77-4610-9eff-ee8dad958ccd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:39:15.722137 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a379d07-5f77-4610-9eff-ee8dad958ccd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:15.722637 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a379d07-5f77-4610-9eff-ee8dad958ccd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:15.723086 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a379d07-5f77-4610-9eff-ee8dad958ccd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:15.723839 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a379d07-5f77-4610-9eff-ee8dad958ccd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:15.724305 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a379d07-5f77-4610-9eff-ee8dad958ccd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:15.724745 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a379d07-5f77-4610-9eff-ee8dad958ccd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:16.251282 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [req-c8600319-d1c7-4c1d-bbb9-6eef231a32d6 req-9144e920-9700-42bc-b158-ea3ab1aef796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe98d4d-a99b-445c-bb77-6c54b31d719e", "name": "network-vif-deleted", "tag": "dfabae8b-668d-4e23-8899-72ec616dd60f"}]} {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:39:16.260154 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a379d07-5f77-4610-9eff-ee8dad958ccd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d4803b73634cba99bdef0b4f7345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a5a6a7bc2e4fb59b97d6958853a839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:39:16.268328 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7a379d07-5f77-4610-9eff-ee8dad958ccd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e" status: 200 len: 1566 microversion: 2.1 time: 0.558027 Oct 12 23:39:16.269043 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3718/8098] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:39:15 2022] GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e => generated 1566 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:39:16.270728 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c8600319-d1c7-4c1d-bbb9-6eef231a32d6 req-9144e920-9700-42bc-b158-ea3ab1aef796 service nova] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:16.271295 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c8600319-d1c7-4c1d-bbb9-6eef231a32d6 req-9144e920-9700-42bc-b158-ea3ab1aef796 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:16.271948 n-d-861111-1 devstack@n-api.service[120453]: DEBUG oslo_concurrency.lockutils [req-c8600319-d1c7-4c1d-bbb9-6eef231a32d6 req-9144e920-9700-42bc-b158-ea3ab1aef796 service nova] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:16.283805 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.compute.server_external_events [req-c8600319-d1c7-4c1d-bbb9-6eef231a32d6 req-9144e920-9700-42bc-b158-ea3ab1aef796 service nova] Creating event network-vif-deleted:dfabae8b-668d-4e23-8899-72ec616dd60f for instance afe98d4d-a99b-445c-bb77-6c54b31d719e on n-h2-861111-1 Oct 12 23:39:16.288455 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [req-c8600319-d1c7-4c1d-bbb9-6eef231a32d6 req-9144e920-9700-42bc-b158-ea3ab1aef796 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041674 Oct 12 23:39:16.289042 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4381/8099] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 12 23:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:39:17.294033 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b5829c1-9e2e-4a07-9fc2-15c704976544 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:39:17.294581 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6b5829c1-9e2e-4a07-9fc2-15c704976544 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] [instance: afe98d4d-a99b-445c-bb77-6c54b31d719e] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:39:17.301391 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b5829c1-9e2e-4a07-9fc2-15c704976544 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:17.301885 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b5829c1-9e2e-4a07-9fc2-15c704976544 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:17.302336 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b5829c1-9e2e-4a07-9fc2-15c704976544 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:17.303046 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b5829c1-9e2e-4a07-9fc2-15c704976544 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Acquiring lock "2bc00301-6462-4874-9c83-c889d0ff6a49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:39:17.303540 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b5829c1-9e2e-4a07-9fc2-15c704976544 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:39:17.303981 n-d-861111-1 devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b5829c1-9e2e-4a07-9fc2-15c704976544 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Lock "2bc00301-6462-4874-9c83-c889d0ff6a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:39:17.317822 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-6b5829c1-9e2e-4a07-9fc2-15c704976544 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] HTTP exception thrown: Instance afe98d4d-a99b-445c-bb77-6c54b31d719e could not be found. Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b5829c1-9e2e-4a07-9fc2-15c704976544 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Request method failure captured: Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e HTTP/1.1 Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: Accept: application/json Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: Accept-Encoding: identity Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: Connection: close Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: Content-Length: 0 Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: Content-Type: application/json Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: Host: 10.222.0.16 Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: Openstack-System-Scope: None Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjR07gFGHmxls5uujomD7Xt41GVjZqInZBr_jYkR9NY-rXhYiY0BpHKa4TmmdFLcZWpHef8-oHMPNJ6lQWDOZQzrei_tGSq-2kWPC9XRc-Ur6bgZOll5IFE-pYS3c58HvuqcvQioCDfg7ACHkeprHVLdTpfnx6nxnJPvXhb4IN0N9ThBY Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Id: None Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-Domain-Name: None Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-Identity-Status: Confirmed Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-Is-Admin-Project: True Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Id: default Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Domain-Name: Default Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Id: 92a5a6a7bc2e4fb59b97d6958853a839 Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-Project-Name: tempest-TestSnapshotPattern-1345423356 Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-Role: reader,member Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-Roles: reader,member Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92a5a6a7bc2e4fb59b97d6958853a839"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92a5a6a7bc2e4fb59b97d6958853a839"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_92a5a6a7bc2e4fb59b97d6958853a839", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/92a5a6a7bc2e4fb59b97d6958853a839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant: tempest-TestSnapshotPattern-1345423356 Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Id: 92a5a6a7bc2e4fb59b97d6958853a839 Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestSnapshotPattern-1345423356 Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-User: tempest-TestSnapshotPattern-1345423356-project Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Id: default Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-User-Domain-Name: Default Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-User-Id: 56d4803b73634cba99bdef0b4f7345c7 Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: X-User-Name: tempest-TestSnapshotPattern-1345423356-project Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: method: > Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: exception: Instance afe98d4d-a99b-445c-bb77-6c54b31d719e could not be found. Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: action_args: {'id': 'afe98d4d-a99b-445c-bb77-6c54b31d719e'} Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe98d4d-a99b-445c-bb77-6c54b31d719e could not be found. Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe98d4d-a99b-445c-bb77-6c54b31d719e could not be found. Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:39:17.319550 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:39:17.325374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:39:17.325374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:39:17.325374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:39:17.325374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:39:17.325374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:39:17.325374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe98d4d-a99b-445c-bb77-6c54b31d719e could not be found. Oct 12 23:39:17.325374 n-d-861111-1 devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Oct 12 23:39:17.325374 n-d-861111-1 devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b5829c1-9e2e-4a07-9fc2-15c704976544 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Returning 404 to user: Instance afe98d4d-a99b-445c-bb77-6c54b31d719e could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:39:17.325374 n-d-861111-1 devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6b5829c1-9e2e-4a07-9fc2-15c704976544 tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e" status: 404 len: 111 microversion: 2.1 time: 0.031019 Oct 12 23:39:17.325374 n-d-861111-1 devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3719/8100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 12 23:39:17 2022] GET /compute/v2.1/servers/afe98d4d-a99b-445c-bb77-6c54b31d719e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:39:17.483947 n-d-861111-1 devstack@n-api.service[120453]: DEBUG nova.api.openstack.wsgi [None req-fa20394a-dbb0-45fd-bddd-31dab5fec0dd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] Calling method '.version_select at 0x7f5122b52f70>' {{(pid=120453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:39:17.509630 n-d-861111-1 devstack@n-api.service[120453]: INFO nova.api.openstack.requestlog [None req-fa20394a-dbb0-45fd-bddd-31dab5fec0dd tempest-TestSnapshotPattern-1345423356 tempest-TestSnapshotPattern-1345423356-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2011527841" status: 202 len: 0 microversion: 2.1 time: 0.030985 Oct 12 23:39:17.510161 n-d-861111-1 devstack@n-api.service[120453]: [pid: 120453|app: 0|req: 4382/8101] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 12 23:39:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2011527841 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)